request for proposals: child & youth network s hared...
TRANSCRIPT
Request for proposals: Child & Youth Network Shared Measurement System Introduction The Child & Youth Network (CYN), in partnership with United Way Elgin Middlesex, is seeking proposals from experienced and qualified bidders to configure an online system to support the CYN’s Shared Measurement initiative. With more than 170 partners across the community, the CYN is looking for an online solution to measure the impact of the network. The CYN is looking for a solution that is:
• easy to use; • cost-effective; • adaptable to future changes, including program structure and/or related business processes; • flexible to align with existing CYN systems; • streamlined; and, • useful for both CYN backbone staff and CYN partners.
This is a new initiative for the CYN that will enable partners to share the results of their work, and will support the network to better understand the collective impact of initiatives from the Child & Youth Agenda. Funding for this initiative has been provided by the CYN. Background The CYN uses Collective Impact as a lens to understand how our community can approach collective change, and deepen the impact of our work with families and the service system. CYN partners, including United Way Elgin Middlesex, work to improve outcomes for children, youth and families across four priority areas and through approximately 50 initiatives. One of the five conditions of Collective Impact is Shared Measurement. Shared Measurement is a collaborative measurement process used by engaged partners in order to achieve shared goals. Visit www.fsg.org for more information. In support of this condition, a Shared Measurement Framework has been developed to understand the Collective Impact of the network. To support the implementation of a CYN Shared Measurement Framework, the CYN is looking for an online system to manage the collection of data, and to facilitate efficient analysis to understand the impact of the CYN in our community. This project has three main objectives:
• to track the progress of CYN projects and initiatives on an ongoing basis; • to improve the process to create the CYN Annual Progress Report; and, • to enhance the ability to understand the CYN’s collective impact and share data with the
community. The project will strengthen the network’s ability to understand its impact so continuous improvement and course correction can be made. With more information to understand the effectiveness of network priorities, it will be possible to have a stronger understanding of strategy development on an ongoing basis. As noted above, over the past two years, the CYN has worked in collaboration with community partners, including experts in evaluation, to develop a comprehensive framework to support this initiative. This work has been a complex, iterative process, and the successful bidder will bring their expertise to this project in order to build upon and enhance the work that has been done so far.
The CYN is looking for skilled bidders that can support the Shared Measurement initiative to be successful by making recommendations based on best practices from work on other projects, and experience in the field. The Planning Tool and Impact Review Tool (Appendices A & B) have been attached to this RFP. These tools provide context for the structure and functionality of the final online tool to be developed by the successful bidder. Appendix C, a sample of CYN planning tool outputs, approach outcomes, and impact outcomes, provides additional context regarding measures as part of the evaluation framework. These supporting documents should be used to gain a thorough understanding of the Shared Measurement initiative, and should inform the applicant’s Project Plan as outlined in the Submission Requirements section of this document.
Scope of Work Definitions 1. “Partners” includes the representatives of community organizations, educational or health
institutions and/or interested community members that comprise the membership of the Child & Youth Network.
2. “Shared Measurement Framework” means a “framework that allows for the use of a common set of measures to monitor performance, track progress towards outcomes and learn what is and is not working in the group’s collective approach.” (John Kania, FSG)
3. “Shared Measurement Initiative” means a “community strategy to develop and implement a shared measurement framework.”
Guidelines & Deliverables 1. The successful bidder will be required to undertake the following elements:
a. Preliminary consult: Meet with CYN staff and partners to determine requirements and gather necessary information to begin work on the project.
b. Develop online system with multiple forms: Three online forms to be developed: i. Project Planning– Partners will complete this form to provide information about the
initiative, including background information and plans to evaluate the initiative (see Appendix A)
ii. Reporting – Pulling from information provided in the Project Planning tool, partners will be asked to report on the results that were achieved in relation to the initiative (see Appendix B and C);
iii. Evaluation Score Card. Evaluation committee members will complete this form to assess the quality and contribution of the initiative relative to other outcomes of the network.
c. Registration process: Develop a process for CYN partners to easily login and create/manage profiles in the online system.
d. Committee review process: A process will be configured in the system to support an evaluation committee to review and analyze all reports submitted by CYN partners through the online system.
e. User portals & role types: Four user portals to be created: 1) CYN Partner, 2) CYN Priority Staff, 3) CYN Administrator, and 4) Evaluation Committee Member.
f. Reports: Configuration of 3-5 specific reports to aggregate data across the system.
g. Explore potential software integration: The CYN currently uses Clear Point Strategy
(https://www.clearpointstrategy.com/) to measure progress on the Child and Youth Agenda. As part of this configuration, the CYN is looking to explore the ability to push data from the CYN Shared Measurement System to Clear Point in order to support the annual reporting process. The CYN is also looking to explore other potential opportunities for software integration to make certain the system that is configured has the ability to grow and change based on future business requirements.
h. QA and testing: Testing will be conducted on an ongoing basis throughout the configuration to ensure the functionality of the system is consistent with project team expectations.
i. Training: Training for CYN staff. 2. Project Timelines and Deliverables (to be finalized with successful bidder)
a. Phase One (June 2019) i. Portal and Role type for CYN Partner is configured ii. Project Planning tool configured for CYN partners to enter data about their initiative is
available b. Phase Two (July 2019)
i. Portal for remaining roles (CYN Administrator) ii. Project Manager Role type and Portal is configured
c. Phase Three (December 2019) i. Reporting tool is configured for CYN partners to provide information about their
results d. Phase Four (end of January 2020)
i. Portal for remaining role completed (Evaluation Committee Member) ii. Evaluation Committee will reviews and score reports in January 2020 iii. Reports are configured to aggregate data
e. Phase Five (February 2020) i. Finalize remaining deliverables ii. Explore integration with Clear Point Strategy iii. Reports are configured to aggregate data
3. Project Management
a. Upon the contract award notification from United Way Elgin Middlesex, the successful bidder will be required to submit a Statement of Work of the agreed upon requirements and tasks for the engagement. The Statement of Work will include:
i. Background and Objectives; ii. Scope of Work; iii. Work Plan and Deliverables; iv. Roles and Responsibilities; v. Change Order Process of the Scope of Work; vi. Milestone Payment Schedule.
Project Plan & Submission Requirements Bidders must:
1. Provide a general overview of their business; summarize the firm’s capabilities and areas of expertise
relative to the requirements outlined in this RFP. 2. Provide documentation that outlines how your organization will:
a) Website/Application Security • Provide and maintain independent validation by a reputable application security assessor of
implementation of OWASP ASVS v3.0.x Level 2 application security controls.
• Ensure that re-validation is performed on an annual basis at a minimum, or upon any
significant changes to website/application functionality. b) Web Hosting Security
• Provide and maintain independent validation by a reputable application security assessor of implementation of relevant CIS version 7 security controls for the bidder’s development, test, QA, and production environments.
• Ensure that re-validation is performed on an annual basis at a minimum, or upon any significant changes to website/application functionality.
3. Provide overview of past experience • Describe three (3) similar projects that your firm has completed in the last five (5) years.
• If applicable, describe your firm’s history working with the public sector or a community collaborative in the last five (5) years.
• Does your firm have experience with software integration, aligning your product to various other commonly used platforms?
4. Provide a minimum of three (3) references within the last five (5) years from recent projects of recent size and complexity.
• Bidders shall provide, at a minimum, the following information with respect to each reference. Information submitted is subject to verification, and further pertinent information may be obtained from references.
Reference 1/2/3 Client name and address
Client contact information Name: Email: Telephone:
Description of project scope of work and major project components/deliverables
Project commencement and completion dates Total value of contract Total hours of the contract List the name(s) of project manager and key personnel from your firm who involved in this project
Primary sub-contractors (if any) used on the project, name and address, telephone
5. Provide an overview of the Project Team’s qualifications to undertake this work. 6. Provide a detailed project plan that clearly outlines the bidder’s understanding of the work to be
undertaken to configure a software system to support the Shared Measurement initiative, including: • The project objectives and the services to be provided; • Technical requirements and activities/tasks required to complete the project; and, • Potential challenges and barriers to project completion and outline strategies that will mitigate
potential challenges from occurring. 7. Provide a detailed project schedule to complete the deliverables as outlined in this document,
including but not limited to the following: • Clear description of the activities and/or tasks proposed to carry out the various aspects of the
project and to fulfil the objectives identified within this RFP; • Indication of approval required by the CYN at each deliverable/activities of the assignment;
and, • Estimated time to complete the project.
8. Provide information of your firm’s current workload and availability to complete the projects to meet
milestones and deadline. 9. Provide a description of the future support relationship for the online tool to be developed.
Specifically, outline what the bidder’s relationship with the CYN will look like after the configuration has been completed. Clearly articulate whether there will be any additional and/or ongoing costs related to future support.
10. Provide a detailed itemized breakdown of project costs against a proposed phased timeline, including hourly rates, product licencing fees, support, and lump sum or any other related charge and payment details. Specifically, bidders must submit a project estimate that details the number of hours and associated costs for:
• Site development • Content development • Hosting • Maintenance / support • Rate for post-launch site development/ maintenance • Rate for post-launch content development
Submission Process and Weighting Each proposal will be evaluated by CYN partners on the basis of the information provided by the bidder in its proposal. Each proposal will be reviewed to assess compliance with the requirements set out in this RFP. Evaluation results will be the property of the CYN and held at United Way Elgin MIddlesex. The CYN and United Way Elgin Middlesex do not intend to disclose details of the evaluation results under any circumstances. Submissions will be evaluated by a community-based team identified based on outlined projects requirements. The successful bidder will be notified on or before April 1, 2019. The CYN reserve the right to reject all bids should it be deemed that no bidder can meet the requirements outlined above based on the submissions provided.
Submission Due Date Please note all bids must be submitted on or before Friday, March 15, 2019. Submissions should be submitted electronically to [email protected].
Cost The upset cost for this project should ideally not exceed $60,000. The CYN is seeking firm prices. All prices must be stated in Canadian funds. HST shall not be included and shown as an extra.
Contact Please contact Sara Middleton, Director, Community Impact, United Way Elgin Middlesex at [email protected] should you have any questions.
APPENDIX A
DRAFT CYN Initiative Planning Tool
The purpose of the CYN Planning Tool is to provide a step-by step guide for community partners and project managers to inform both their initiative planning and evaluation activities.
The Initiative Planning Tool will allow community partners and project managers to break down initiatives into separate components to reflect on their work and guide the development of evaluation activities.
By completing the Initiative Planning Tool for each initiative, it will also provide the Shared Measurement group with valuable information to understand the goals of each initiative and provide guidance and assistance with the proposed evaluation activities.
CYN Partners
Shared Measurement
CYN INITIATIVE PLANNING TOOL - DRAFT
What are the primary and secondary target audiences/beneficiaries? Please select all that apply. Primary Target Audience(s) – Individuals/groups who are the direct recipients/beneficiaries of the project/initiative. ☐ Prenatal ☐ Children
☐ Youth ☐ 13-18 years
☐ Families ☐ Newcomers
☐ Individuals with special needs
Background Information
Please name the project/initiative:
Is this project/initiative a (x): ☐ Program/activity ☐ Supportive policy ☐ Supportive environment ☐ Other:_________________________________________________ Definitions:
1. Program/Activity – Planning and implementing a set of activities, events, services, or materials aimed at addressing a specific issue or producing a specific change among participants/a community.
2. Supportive Policy – Developing and implementing or revising legislation, regulations, standards, directives, or practices to support specific behaviour change.
3. Supportive Environment – Implementing environmental changes that promote and enable specific behaviours.
Under which CYN Priority Group work plan does this project/initiative fall? Please select all that apply. (x) ☐ Healthy Eating/Healthy Physical Activity ☐ Literacy ☐ Ending Poverty ☐ Family-Centred Service System
Which CYN shared outcomes, identified throughout the 2016 strategic planning conversations, does this project/intervention target? Please select all that apply. (x)
☐ Londoners have an increased and meaningful understanding of poverty and its impact on our community
☐ Families have more opportunities to become financially sustainable
☐ There is an increase in the number of opportunities to develop sustainable food solutions
☐ Families experiencing poverty have enhanced access to basic needs services in their neighbourhoods
☐ Community leaders have resources to initiate change
☐ More children enter the school system with a strong foundation for success
☐ More children and youth continue to develop literacy skills and competencies throughout their school years
☐ More young people will graduate from secondary school (or the equivalent)
☐ More community members engage in activities which improve all forms of literacy
☐ More children, youth, and families are engaged in regular, healthy physical activity
☐ More children, youth, and families interrupt sedentary behaviour more frequently on a daily basis
☐ More children, youth, and families are engaged in daily, healthy eating habits including a reduced consumption of sugar sweetened beverages and increased consumption of vegetables and fruit
☐ More children, youth, and families live in and/or have frequent access to healthy, supportive environments that encourage, provide for, and lead to increased physical activity and healthy eating habits
☐ Families are connected and engaged in their neighbourhood
☐ Families experience reduced storytelling ☐ Families have better and more consistent
experience when accessing services ☐ Families can easily access a full range of services ☐ Families experience shorter wait times
Audience: CYN Partners
☐ Less than 12 months ☐ 1-3 years ☐ 4-6 years ☐ 7-12 years
☐ Adults ☐19-21 years ☐ 21-30 years ☐ > 30 years
☐ Indigenous ☐ Professionals/ Service
Providers ☐ Francophone
☐ LGBTQ+ ☐ Homeless/ at risk of
becoming homeless ☐ Other: ☐ Other:
Secondary Target Audience(s) – Individuals/groups who may indirectly benefit from the project/ initiative.
☐ Prenatal ☐ Children
☐ Less than 12 months ☐ 1-3 years ☐ 4-6 years ☐ 7-12 years
☐ Youth ☐ 13-18 years
☐ Adults ☐19-21 years ☐ 21-30 years ☐ > 30 years
☐ Families ☐ Newcomers ☐ Indigenous ☐ Professionals/ Service
Providers ☐ Francophone
☐ Individuals with special needs
☐ LGBTQ+ ☐ Homeless/ at risk of
becoming homeless ☐ Other: ☐ Other:
Provide a brief, high-level summary of the project/initiative. What is it about? What is the overall goal of the project/initiative? A goal is a broad statement about the long-term outcome a project/initiative is aiming to achieve through its activities.
Example: To increase the amount of time children aged 10-15 years old spend participating in physical activity by providing no-cost afterschool physical activity programming. What is the need/gap being addressed by this project/initiative? Create your case for support by noting any evidence base for this need/gap, such as the Child & Youth Agenda, a needs assessment, community or program survey, available research or literature, etc.
*Note: Click here to access a list of available research/literature prepared by CYN to support your response.
Example: Children in this neighbourhood are not meeting their physical activity requirements. Results from a survey conducted in this neighbourhood asking about healthy physical activity demonstrated 79% of children have limited access to recreational programming. Further, when asked about what would help them increase physical activity levels, the most common theme that arose was access to financial support to be able to afford access to physical activity programming.
What benefits does this project/initiative provide to the target audience(s)?
Example: Free afterschool physical activity programming for children aged 10-15 years old in this neighbourhood will increase children’s access to and level of participation in regular physical activity. This will help children meet the recommended levels of weekly physical activity and promote the development of healthy behaviours and habits.
Define Risk Factors And Risk Conditions Of Interest Identify the risk factors or risk conditions this project/initiative plans to address. *Note: A project/initiative can target risk factors, risk conditions, or both risk factors and conditions.
Definitions: • Risk Factors are personal level factors that influence the likelihood an individual will experience a
specific issue or outcome. • Risk Conditions are factors or characteristics of the social and physical environment that affect a
specific group of people or community. Risk Factors: Please select all that apply.
• Quality of diet and nutrition • Level of physical activity • Level of literacy skills • Level of self-esteem • Unemployment • Level of income • Level of education • Substance Use • Experience of trauma, abuse, or neglect • Mental health • Physical health • Age • Gender • English language proficiency • Coping skills • Presence of supportive relationships/social network • Acculturation and integration • Level of knowledge/awareness
Risk Conditions: Please select all that apply.
• Socioeconomic conditions • Availability of appropriate facilities • Availability of programming/opportunities • Level of community engagement • Availability of engagement opportunities • Level of communication • Level of available support • Availability of resources
• Level of transience • Amount of neighbourhood organization/leadership • Availability of economic/job opportunities • Transportation options • Presence of discrimination • Sense of neighbourhood safety • Level of accessibility • Service/programming/resource affordability • Housing affordability • Housing availability • Availability of culturally appropriate services and resources
Identify The Target Environment
Identify the target environment for your project/initiative. Please select all that apply. (x)
Example: This initiative is targeting the community environment, as it provides programming in the community for any child aged 10-15 years old living in this neighbourhood. ☐ Home ☐ School ☐ Community ☐ Other: ________________________________________________________________________
Plan For Implementation Use the table below to list collaborators/partners involved in the project/initiative. Identify their area of expertise (e.g. policy, research and evaluation, education, program development/ implementation, etc.), type of contribution (e.g., provide space, time, expertise, staff, financial support, referrals to the project/initiative, etc.), and expected level of involvement.
Name Of Partner Area Of Expertise Type Of Contribution Expected Level Of Involvement
(Note: A drop-down list will be available in this column to choose from high, medium, or low.)
Comments:
What is the expected timeframe of this project/initiative? (I.e. What are the expected start and end dates? What are the project/initiative phases and action steps? What are the milestone dates/expected timelines for each phase or action step?)
*Note: If you have already developed a work plan for this project/initiative for another funder, please upload and attach it here. EXAMPLE Phase Description: Prepare For Program Implementation Task Description Start Date End Date Partner Responsible Meet with partners to confirm roles and final product/deliverable
January 22, 2018 January 26, 2018 CYN/CYN
Prepare program curriculum and list of materials/resources
February 5, 2018 April 27, 2018 CYN
Partners review program curriculum and provide feedback
April 30, 2018 May 10, 2018 CYN
Revise program curriculum and activity descriptions based on feedback
May 11, 2018 May 31, 2018 CYN
Secure/confirm facility space and materials
June 1, 2018 June 29, 2018 CYN
Hire and train Afterschool Program Coordinator
June 1, 2018 August 31, 2018 CYN
Promote Afterschool Program to potential participants
July 2, 2018 September 13, 2018
CYN/CYN
TEMPLATE (Please use the template provided below to outline expected project/initiative timeframes) Phase Description: Task Description Start Date End Date Partner Responsible
Comments:
PROJECT/INITIATIVE TIMEFRAME GANTT CHART (Note: If partners use the template available in the online platform, based on the dates and steps provided, a Gantt chart will automatically be created to provide a visual of their project/initiative plan timeframe, as seen in the example below.)
2018 Action Steps/Phases Jan Fe
b Mar
Apr May
Jun
Jul Aug
Sep
Oct Nov
Dec
Phase 1: Prepare For Program Implementation
• Meet with partners to confirm roles and final product/deliverable
• Prepare program curriculum and list of materials/resources
• Partners review program curriculum and provide feedback
• Revise program curriculum and activity descriptions based on feedback
• Secure/confirm facility space and materials
• Hire and train Afterschool Program Coordinator
• Promote Afterschool Program to potential participants
Determine The Approach(es) What approach(es) will your project/initiative use? Please refer to the definitions below each approach.
*Note: Projects/initiatives can use more than one approach. Please choose all that apply. (x) ☐ Public Awareness To inform, influence, or engage target audiences (children, youth, families, and stakeholders) about a particular message or issue to enhance knowledge and/or encourage behaviour change. Examples of public awareness activities include: a media campaign, social media engagement, websites, distribution of brochures, flyers, pamphlets, etc., print media, outreach activities, and advertising. ☐ Education, Skill Development, And Capacity Building To strengthen an individual’s knowledge or understanding of a particular topic, increase an individual’s skills and abilities, and increase an individual’s capacity or competency through deliberate, organized, and sustained efforts. Examples of education, skill development, and capacity building approaches include: workshops, trainings, courses, networking events, curriculum development, lectures/conferences, programs, developing tools and resources, communities of practice, and professional development. ☐ Service Delivery To develop and deliver organizational and system-wide user-focused services and resources. Examples of services delivery activities include: improving access to services or programs, enhancing service experience, development of new partnership, development of standardized tools/practices, offering a new service site, and developing a new resource. ☐ Research And Advocacy To support and encourage the generation of new knowledge and evidence-informed decisions that help guide or influence decisions that support CYN initiatives and improve outcomes.
Examples of research and advocacy include: seeking funding to support research, stakeholder engagement, advocacy projects, pilot projects, creating a practice framework or theory of change, conducting a literature review, preparing a policy or position paper, and influencing policy improvements/change. ☐ Facilities And Infrastructure To develop or improve an aspect of the physical or built environment. Examples of facilities and infrastructure activities include: the development of new facilities, enhancing existing facilities, enhancing infrastructure and access, and built environment changes.
Select Techniques
Based on the approach(es) selected, what techniques do you plan to use to carry out your project/initiative? Please select all that apply. (x)
Public Awareness Education Service Delivery
☐ Media campaign ☐ Social media engagement ☐ Website ☐ Brochures, flyers, pamphlets, etc. ☐ Print media ☐ Outreach activities ☐ Advertising ☐ Other:
☐ Workshops ☐ Trainings ☐ Networking events ☐ Curriculum development ☐ Lectures/conferences ☐ Programs ☐ Tools and resources ☐ Community of practice ☐ Professional development ☐ Other:
☐ Program/service access Improvement
☐ Service experience enhancement ☐ New partnership ☐ Standardized tool or practice ☐ New service site ☐ Other:
Research And Advocacy Facilities And Infrastructure
☐ Research funding ☐ Stakeholder engagement ☐ Advocacy ☐ Pilot project ☐ Practice framework/theory of
change ☐ Literature review ☐ Policy/position paper ☐ Policy improvement/change ☐ Other:
☐ New facility ☐ Facility enhancement ☐ Infrastructure enhancement ☐ Accessibility ☐ Built environment change ☐ Other:
Select Corresponding Indicators And Metrics From the CYN shared outcome(s) and approach(es) you identified above, please choose 1-2 shared outcomes for which you will measure and report results. Please remember to consider the primary focus of
the project/initiative and select outcomes, indicators, and metrics that you feel you can measure, and measure well. For each selected shared outcome, please choose 1-2 corresponding approaches, approach outputs, approach indicators and metrics, and the impact indicators and metrics you will use to evaluate and measure the progress or impact of your project/initiative. (Use the Shared Measurement Toolkit to help you in selecting indicators and metrics.) Note: Please see the sample indicators and metrics document for more details.
CYN SHARED OUTCOME:
Approach:
Outputs:
Approach Outcomes
Indicators Metrics
Impact Outcomes
Indicators Metrics
Must Report On Outcome Regardless Of Approach:
CYN SHARED OUTCOME:
Approach:
Outputs:
Approach Outcomes
Indicators Metrics
Impact Outcomes
Indicators Metrics
Must Report On Outcome Regardless Of Approach:
Map Initiative Activities To The Approach
Please list the project/initiative activities you plan to complete for each approach chosen.
Approach(es) Activities
Plan Evaluation Activities
Will the evaluation activities for this project/initiative be formal or informal?
☐ Informal – When information is gathered through non-systematic means or formalized data collection procedures. This may occur through observation, meetings, experiences, or informal interviews and conversations.
☐ Formal – Using systematic procedures and formalized data collection tools to gather information for a specified
purpose and to answer specific evaluation questions.
Who will be conducting the evaluation for this project/initiative?
☐ Internal evaluator/team member
☐ External consultant
☐ Postsecondary institution partner
☐ Other (please specify): _____________________________
What data collection method(s) will you use to evaluate your project/initiative? Please choose all that apply. (x) (Use the Shared Measurement Toolkit to help you in selecting a data collection method.) ☐ Surveys/questionnaires ☐ Interviews ☐ Focus groups ☐ Tracking data (e.g. database, documentation) ☐ Online analytics (e.g. # of website views, # of downloads, etc.) ☐ Other (please specify): _____________________________
Please provide a brief description of how you plan to implement each selected data collection method.
Example: Surveys will be conducted with participants after the completion of each workshop and 3 months after each workshop. Please outline the timelines for your evaluation and/or data collection activities. EXAMPLE Phase Description: Develop and Implement Data Collection Tools Task Description Start Date End Date Partner Responsible Determine the data points to be collected by each data collection tool
January 5, 2018 January 10, 2018 CYN/CYN/Evaluator
Develop each data collection tool January 11, 2018 January 31, 2018 Evaluator Test each data collection tool February 1, 2018 February 15, 2018 Evaluator Revise each data collection tool February 15, 2018 February 25, 2018 Evaluator Conduct surveys March 1, 2018 March 10, 2018 CYN/CYN Conduct focus groups March 15, 2018 March 20, 2018 CYN/CYN TEMPLATE (Please use the template provided below to outline expected evaluation timelines) Phase Description: Task Description Start Date End Date Partner Responsible
Additional Details: EVALUATION TIMELINES GANTT CHART (Note: Based on the dates and steps provided by partners in the online platform, a Gantt chart will automatically be created to provide a visual of their evaluation timelines, as seen in the example below.) 2018 Action Steps/Phases Jan Fe
b Mar
Apr May
Jun
Jul Aug
Sept
Oct Nov
Dec
Phase 3: Develop and Implement Data Collection Tools
• Determine the data points to be collected by each data collection tool
• Develop each data collection tool • Test each data collection tool • Revise each data collection tool • Conduct surveys • Conduct focus groups Note:
• Please indicate if assistance identifying measurement methods is needed. (See the Shared Measurement Toolkit or reach out to any CYN Project Manager for more assistance identifying data collection methods.)
• The nature and scope of the project/initiative will influence the level and feasibility of evaluation.
18
APPENDIX B
DRAFT CYN Initiative Impact Review
The purpose of the CYN Initiative Impact Review is to have a common format in which data related to the initiatives can be outlined to identify contribution to the shared outcomes. The CYN Initiative Impact Review is used by both CYN partners and the Shared Measurement group.
The Impact Review will be used by community partners and project managers to compile the data they have collected on their evaluation activities outlined in the planning tool and gives community partners/project managers a chance to reflect on the initiative.
Once completed, the Impact Review will be returned to the Shared Measurement group to review and develop feedback to return to community partners and project managers and inform the annual progress report.
CYN Partners
Shared Measurement
19
CYN INITIATIVE IMPACT REVIEW- DRAFT
Please enter the name of the project/initiative:
Implemented Evaluation Activities
Please indicate whether the evaluation activities for this project/initiative were informal or formal.
☐ Informal – When information is gathered through non-systematic means or formalized data collection procedures. This may occur through observation, meetings, experiences, or informal interviews and conversations.
☐ Formal – Using systematic procedures and formalized data collection tools to gather information for a specified
purpose and to answer specific evaluation questions.
Please identify who conducted the evaluation for this project/initiative.
☐ Internal evaluator/team member ☐ External consultant ☐ Postsecondary institution partner ☐ Other (please specify): _____________________________
Please identify all types of data that were collected as part of the evaluation for this project/initiative. Please choose all that apply. (X)
☐ Quantitative – Information that can be measured using numbers. ☐ Qualitative Data – Descriptive information that can be observed, but is non-numerical.
Select the data collection method(s) you used to evaluate your project/initiative. Please choose all that apply.
☐ Surveys/questionnaires ☐ Interviews ☐ Focus groups ☐ Tracking data (e.g. database, documentation) ☐ Online analytics (e.g. # of website views, # of downloads, etc.) ☐ Other (please specify): _____________________________
Where applicable, please upload a copy of each data collection tool used to evaluate your project/initiative.
Please provide a brief description of each data collection method selected above and how it was implemented.
Audience: CYN Partners
20
For each selected data collection method, what was the time period between which data was collected (i.e. what time period does the data represent?), what was the source of information (e.g. participants, database, partners, documentation, website, etc.), and from how many individuals/participants was data collected?
Data Collection Method Start Date End Date Source of Information Number of Respondents
☐ Surveys/questionnaires ☐ Interviews ☐ Focus groups ☐ Tracking data ☐ Online analytics ☐ Other
Were any limitations experienced during the data collection or evaluation process (e.g. a high level of participant drop-out part-way through the program, low response rate, etc.)? ☐ Yes ☐ No If yes, please describe any limitations experienced below: Please indicate the timeframe of the evaluation activities for this project/initiative. (E.g. What were the start and end dates? What were the evaluation phases and action steps? What were the milestone dates/timelines for each phase or action step?)
Phase Description: Task Description Start Date End Date Partner Responsible
Were evaluation activities completed as planned? (E.g. Were evaluation activities completed/implemented according to planned timelines? Were all planned evaluation tasks completed? Were intended data collection methods used? Was data collected from intended sources?)
☐ Yes ☐ No
21
If no, what changed or was done differently than initially planned? Please provide any additional details about the evaluation activities below.
22
Report Data Please provide the results for your project/initiative below and indicate whether these results met your expectations. In total, how many individuals participated in the project/initiative? (e.g. total program participants, families served, individuals reached) _____________
CYN SHARED OUTCOME:
Approach: Outputs Results
Less Than Expected
Met Expectation
s
Exceeded Expectation
s ☐ ☐ ☐ ☐ ☐ ☐
Approach Outcomes
Indicator Metrics Results Less Than Expected
Met Expectation
s
Exceeded Expectation
s ☐ ☐ ☐ ☐ ☐ ☐
Impact Outcomes
☐ ☐ ☐
☐ ☐ ☐
Must Report On Outcome Regardless Of Approach:
☐ ☐ ☐
Were there any unintended results you did not expect?
☐ Yes ☐ No
If yes, please explain below:
23
Do you have any project/initiative level evaluation results available that you would like to share?
☐ Yes ☐ No If yes, please share three high level, key results or pieces of information specific to the project/initiative below.
24
Do you have any participant stories or stories of impact/change that occurred as a result of the project/initiative that you would like to share?
☐ Yes ☐ No If yes, please share 1-2 key stories below.
25
Experience Implementing The Project/Initiative
Please identify below the direct recipients/beneficiaries actually reached by the project/initiative. Please select all that apply. (x) ☐ Prenatal ☐ Children
☐ Less than 12 months ☐ 1-3 years ☐ 4-6 years ☐ 7-12 years
☐ Youth ☐ 13-18 years
☐ Adults ☐19-21 years ☐ 21-30 years ☐ > 30 years
☐ Families ☐ Newcomers ☐ Indigenous ☐ Professionals/
Service Providers
☐ Francophone
☐ Individuals with special needs
☐ LGBTQ+ ☐ Homeless/ at risk of
becoming homeless ☐ Other:
Were project/initiative activities completed as planned? (E.g. Were activities completed according to planned timelines? Were all planned tasks completed? Were activities implemented as intended/ planned? Were intended groups reached?)
☐ Yes ☐ No If no, what changed or was done differently than initially planned?
Please indicate the status of your project/initiative.
☐ New project/initiative
☐ Continuation
☐ Conclusion of the project/initiative
☐ Other:
If this is a new project/initiative or the continuation of an existing project/initiative:
Overall, how well do you think implementation of the project/initiative is going?
☐ Very well ☐ Well ☐ Neutral ☐ Poor ☐ Very Poor
How do you know? Please explain below.
What do you think has been a success during this project/initiative?
What do you think is not going well or what have been the biggest obstacles experienced during this project/initiative?
26
What would you change or do differently for this project/initiative?
Based on your results, what data would be useful to start collecting in the future?
If this is the conclusion of a project/initiative: Do you feel that this project/initiative has made an impact? If yes, in what way? If no, why not?
What are you proud of about this project/initiative?
What do you think did not go well or what were the biggest obstacles experienced during this project/initiative?
In what ways could this project or initiative be improved?
Would you do this project/initiative again? Why or why not?
27
APPENDIX C
SAMPLE: CYN PLANNING TOOL OUTPUTS, APPROACH OUTCOMES, AND IMPACT OUTCOMES
Note: Only ENDING POVERTY priority information is shared in this document.
28
TABLE OF CONTENTS PRIORITY: ENDING POVERTY ................................................................................................................... 29
Londoners have an increased understanding of poverty. ........................................................................ 29 More young people will graduate from secondary school (or the equivalent). ......................................... 37 Families have more opportunity to become financially sustainable. ........................................................ 45 There is an increase in the number of opportunities to develop sustainable food solutions. ................... 52 Families have enhanced access to basic needs services in their neighbourhoods. ................................ 60 Community leaders have resources to initiate change. ............................................................................ 68
PRIORITY: MAKING LITERACY A WAY OF LIFE ......................................... Error! Bookmark not defined. More children enter the school system with a strong foundation for success.Error! Bookmark not defined. More children and youth continue to develop literacy skills throughout their school years.Error! Bookmark not defined. More young people will graduate from secondary school. ......................... Error! Bookmark not defined. More community members engage in activities which improve all forms of literacyError! Bookmark not defined.
PRIORITY: HEALTHY EATING AND HEALTHY PHYSICAL ACTIVITY ....... Error! Bookmark not defined. More children, youth and families are engaged in regular, healthy, physical activity.Error! Bookmark not defined. More children, youth, and families interrupt sedentary behaviour more frequently.Error! Bookmark not defined. More children, youth, and families are engaged in daily, healthy eating habits.Error! Bookmark not defined. More children, youth, and families have access to healthy, supportive environmentsError! Bookmark not defined.
PRIORITY: FAMILY-CENTRED SERVICE SYSTEM ..................................... Error! Bookmark not defined. Families are connected and engaged in their neighbourhood. .................. Error! Bookmark not defined. Families experience reduced storytelling. .................................................. Error! Bookmark not defined. Families have better and more consistent experience when accessing services.Error! Bookmark not defined. Families can easily access a full range of services. ................................... Error! Bookmark not defined. Families experience shorter wait times. ..................................................... Error! Bookmark not defined.
29
PRIORITY: ENDING POVERTY
OUTCOME: Londoners have an increased and meaningful understanding of poverty and its impact on our community.
APPROACH: Public Awareness
Description: To inform, influence, or engage target audiences (children, youth, families, and stakeholders) about a particular message or issue to enhance knowledge and/or encourage behaviour change.
Approach Outputs
Indicators Metrics
Exposure & Tools
• # of individuals who were engaged through the campaign • # of shares, re-tweets, reposts, likes • # of visitors to the site • # of flyers, brochures, pamphlets distributed • # of print media • # of outreach activities • # of tools developed to assist individuals to increase their understanding of
poverty and its impact on the community
Approach Outcomes
Indicators • Metrics
Increased awareness of the issue/message
• # and % of individuals who have an increased awareness of poverty and its impact on our community
• # and % of individuals who know where to go to get more information about poverty and its impact on our community.
• # and % of individuals who shared information about poverty and its impact on our community.
• # and % of individuals who seek further information about poverty and its impact on our community.
Increased knowledge of the issue/message
• # and % of individuals who have an increased understanding of poverty and its impact on our community.
• # and % of individuals who understand the importance of addressing poverty and its impact on our community.
• # and % of individuals who understand the consequences of not addressing poverty and its impact on our community.
• # of individuals who understand how to address poverty and its impact on our community
Positive change in attitude toward
• # and % of individuals who changed their attitude towards poverty and its impact on our community.
• # of individuals who support addressing poverty and its impact on our community
Increased self-efficacy to • # and % of individuals who want to/are willing to change their behaviour to
30
Indicators • Metrics change behaviour address poverty and its impact on our community.
• # and % of individuals who have the information/resources they need to address poverty and the impact it has on our community.
Increased intention to change behaviour
• # and % of individuals who intend to change their behaviour to address poverty and its impact on our community.
Positive change in behaviour
• # and % of individuals who change their behaviour to address poverty and its impact on our community.
Maintenance of the changed/adopted behaviour
• # and % of individuals who have maintained their behaviour related to addressing poverty and its impact on our community.
• # and % of individuals who encouraged someone else to change their behaviour to address poverty and its impact on our community.
APPROACH: Research and Advocacy
Description: To support and encourage the generation of new knowledge and evidence-informed decisions that help guide or influence decisions that support CYN initiatives and improve outcomes.
Approach Outputs
Indicators Metrics
Development or capture of knowledge related to a specific issue
(Knowledge Generation, Capture, Synthesis)
• # of pilot/demonstration projects implemented to test an idea/model • # of research projects implemented • # of knowledge products prepared (e.g. white paper, research paper/report,
case study, learning brief, videos) • # of best practices identified • # of lessons learned • Types of lessons learned • # of policy briefs/documents created
Dissemination of knowledge related to a specific issue
(Knowledge Sharing)
• # of communications disseminated • # of educational briefings shared • # of education sessions held or presented at (e.g. forums, meetings, workshops,
trainings, presentations, seminars, events) • # of publications • # of website visits • # of downloads of a knowledge product • # of best practices shared • # of lessons learned being shared • # of tools created to support application/use of knowledge or evidence (e.g.
implementation guide, manual, handbook, aid, toolkit)
Approach Outcomes
Indicators • Metrics Increased awareness of a specific issue
• # and % of individuals who have an increased awareness of poverty and its impact on our community
31
Indicators • Metrics • # and % of individuals who know where to go to get more information about
poverty and its impact on our community. • # and % of individuals who shared information about poverty and its impact on
our community. • # and % of individuals who seek further information about poverty and its impact
on our community
Increased understanding of a specific issue
• # and % of individuals who have an increased understanding of poverty and its impact on our community.
• # and % of individuals who understand the importance of addressing poverty and its impact on our community.
• # and % of individuals who understand the consequences of not addressing poverty and its impact on our community.
• # of individuals who understand how to address poverty and its impact on our community.
Change in attitudes, beliefs, and values about a specific issue
(Persuasion)
• # and % of individuals who changed their attitude towards poverty and its impact on our community.
Increased will and support for a specific issue
(Decision)
• # of individuals who support addressing poverty and its impact on our community
• # and % of individuals who align their actions, support, and or resources around poverty and its impact on our community.
Increased capacity to apply knowledge about/address a specific issue
• # and % of individuals who know what actions to take to address poverty and its impact on our community
• # and % of individuals who have the information/knowledge they need to address poverty and its impact on our community
• # and % of individuals who feel confident they could take action to address poverty and its impact on our community
Implementation of evidence-based policy and practice
(Knowledge Application, Implementation)
• # of new policies or practices implemented related to addressing poverty and its impact on our community
• # of existing policies or practices that are revised related to addressing poverty and its impact on our community
• $ allocated to address poverty and its impact on our community • # of projects/models adapted to a new setting or scaled up that address poverty
and its impact on our community
Positive changes for individuals or social/ physical conditions
(Confirmation)
• # and % of individuals who change their behaviour to address poverty and its impact on our community.
• # and % of individuals who have maintained their behaviour related to addressing poverty and its impact on our community.
• # and % of individuals who encouraged someone else to change their behaviour to address poverty and its impact on our community.
• # and % of individuals with lived experience who were positively impacted because of the actions taken to address poverty and its impact on our community.
APPROACH: Education, skill development, and capacity building
32
Description: To strengthen individual's knowledge or understanding of a particular topic, increase an individual’s skills and abilities and increase an individual’s capacity or competency through deliberate, organized, and sustained efforts.
Approach Outputs
Indicators Metrics Provision of education, skill development, and capacity building opportunities
• # of workshops • # of trainings • # of courses • # of networking events
Approach Outcomes
Indicators • Metrics
Positive reaction to the learning experience. (Engagement, Relevance, Satisfaction)
• # and % of individuals who considered the learning experience useful. • # and % of individuals who considered the learning experience to be relevant. • # and % of individuals who thought the learning experience was effective. • # and % of individuals who considered the learning experience to be practical. • # and % of individuals who were satisfied with the learning experience. • # and % of individuals who would recommend the learning experience to others.
Increased knowledge, skills, and capacity as a result of the learning experience. (Knowledge, Skills, and Attitudes)
• # and % of individuals who had increased knowledge of poverty and its impact on our community.
• # and % of individuals who had a change in attitude about poverty and its impact on our community.
• # and % of individuals who had an increase in skills in addressing poverty and its impact on our community.
• # and % of individuals who had an increase in capacity (ability) to address poverty and its impact on our community.
Intent to apply the knowledge and change behaviour as a result of the learning experience. (Confidence, Commitment, Self-efficacy)
• # and % of individuals who believe they can apply the knowledge and skills they learned to address poverty and its impact on our community.
• # and % of individuals who feel confident about applying the knowledge and skills they learned to address poverty and its impact on our community.
• # and % of individuals who are committed to applying the knowledge and skills they learned to address poverty and its impact on our community.
• # and % of individuals who understand how to apply the knowledge and skills they learned to address poverty and its impact on our community.
• # and % of individuals who report they will be able to use the knowledge and skills they learned to address poverty and its impact on our community.
• # and % of individuals who intend to apply the knowledge and skills they have learned to address poverty and its impact on our community.
Application and uptake of the knowledge and skills developed during the learning experience. (application, transfer)
• # and % of individuals who apply the knowledge and skills they have learned to address poverty and its impact on our community.
• # and % of individuals who transferred their knowledge and skills to another person to increase their understanding of poverty and its impact on our community.
Positive results due to knowledge and skills
• # and % of individuals who participated in the learning experience who were positively impacted because of the actions taken to address poverty and its
33
Indicators • Metrics application. (Individual, Organizational)
impact on our community. • # and % of individuals with lived experience who were positively impacted
because of the actions taken to address poverty and its impact on our community.
APPROACH: Service Delivery
Description: To develop and deliver organizational and system-wide user-focused services and resources.
Approach Outputs
Indicators Metrics
Service provision opportunities.
• # of available service sites • Service hours of operation • # of new/existing services or programs available • # of new/existing resources available
Approach Outcomes
Indicators • Metrics
Services and resources are available
• # and % of individuals who report they have access to services they need related to poverty and its impact on our community
• # and % of individuals who report they have access to resources they need related to poverty and its impact on our community
• # and % of individuals who felt informed about services available to them related to poverty and its impact on our community
Services and resources are accessible
• # and % of individuals who report the service/resource was easy to access • # and % of individuals who report they could access the service (site) within a
reasonable amount of travel time • # and % of individuals who report the services they need are available when
they need them • # and % of individuals who report the service provider was flexible
A positive service environment and culture exists
• # and % of individuals who report the service provider was non-judgemental • # and % of individuals who report the service they received was culturally
sensitive/appropriate • # and % of individuals who report the service provider was respectful • # and % of individuals who report the service provider was caring • # and % of individuals who report the service provider was professional • # and % of individuals who report the service environment was clean • # and % of individuals who report the service environment was welcoming • # and % of individuals who report they felt safe/comfortable accessing the
service • # and % of service providers that use standardized tools (e.g. screening,
assessment, processes)
34
Indicators • Metrics • # and % of service providers that use a shared information system • # and % of service providers with defined/agreed upon service standards or
benchmarks
Service providers are knowledgeable, competent, and skilled
• # and % of individuals who report the service provider was knowledgeable • # and % of individuals who received appropriate referrals to services • # of referrals provided to services/resources • # and % of service providers who report they understand the needs of those
who access their service • # and % of service providers who report they are able to address/meet the
needs of those who access their service • # and % of service providers who report they have the resources they need to
provide adequate service • # and % of staff trained in service competencies • # and % of service providers who report they coordinate/collaborate with other
service providers • # and % of individuals who felt the service provider communicated clearly
Exceptional service is provided
• # and % of individuals who report the service met their needs • # and % of individuals who report the service provider was helpful • # and % of individuals who report the service was provided in a timely manner • # of times people report they had to share their story • # and % of individuals who felt they had input in the service • # and % of individuals who felt the service provider was reliable (e.g. followed
through, did what they said they would)
Quality service is experienced
• # and % of individuals who report they felt heard • # and % of individuals who report they were satisfied with the services • # and % of individuals who report they had a positive experience accessing the
service • # and % of individuals who would recommend the service • # and % of individuals who report they trust the service provider • # and % of individuals who report they value the service/resource
Services are used by the community
• # and % of individuals who accessed a specific service/program • # and % of individuals who used/received a specific resource • Amount of a specific resource distributed • Frequency of service/resource use
Services and resources provided have an impact
• # and % of individuals who experienced a positive outcome as a result of accessing the service
• # and % of individuals who experienced a positive outcome as a result of receiving the resource
• Type of positive outcome individual experienced as a result of accessing the service/receiving the resource
APPROACH: Facilities and Infrastructure
Description: To develop or improve an aspect of the physical or built environment.
Approach Outputs
35
Indicators Metrics
Infrastructure opportunities.
• # facilities available • # of new facilities available • # of new infrastructure available
Approach Outcomes
Indicators • Metrics
Facilities and infrastructure enable effective service delivery
• # and % of people who report the facility has adequate parking (e.g. for cars, bicycles)
• # and % of people who report the facility is accessible by public transit, walking or biking
• # and % of people who report the facility is within a reasonable distance • # and % of people who report the facility is in a convenient location • # and % of people who report the facility is welcoming • # and % of people who report they feel safe accessing/using the facility • # of safety audits completed • # and % of safety concerns addressed • # of injuries/accidents reported • # of barriers to participation identified/removed • # and % of people who report the facility has adequate signage • # of accessibility improvements completed • # and % of people who report the facility allows for ease of mobility • # and % of people who report the facility is accessible to community members of
all abilities • # of facilities available • # of facility enhancements completed • Type of facility enhancements completed • # and % of people who report they are better able to access service/perform a
specific behaviour as a result of a new or enhanced facility • # and % of people who report they access service/perform a specific behaviour
more often as a result of a new or enhanced facility
Facilities and infrastructure are fit for the purpose for which they are used
• # and % of people who report the facility has appropriate equipment to meet the needs of those who use it
• # and % of people who report the facility fits the purpose for which it is used • # and % of facilities that are in good condition • # and % of people who report the quality of the facility and/or equipment is good • # and % of people who report the facility is well maintained • # and % of facilities that comply with/meet service standards • # and % of facilities with adequate IT capabilities/infrastructure • # and % of facilities that can be adapted to fit the needs of the community/a
group • # and % of facilities that have space for shared service/programming • # and % of facilities that can be used for a variety of different functions (i.e. they
are multi-purpose)
Facilities and infrastructure meet community needs
• # of different groups (e.g. service providers, community groups) that use the facility
• # and % of people who report the facility is inclusive of all people in the community (i.e. ages, abilities, income levels, cultural backgrounds, interests)
• # of community members involved in decision-making related to the facility and its use
36
Indicators • Metrics • # and % of community members who feel a sense of ownership for the facility • # and % of people who report available facilities address/meet the needs and
interest of the local community • # and % of people who report there is a facility/place in their community where
they can access a specific service/perform a specific behaviour • # and % of people who are satisfied with the facility
Facilities and infrastructure are economically sustainable and affordable
• Amount of funding made available to enhance/maintain/build the facility • Annual cost of operations and management • Annual savings from energy efficiencies • Annual capital costs • Annual utility costs • Annual facility maintenance costs • Annual facility revenue • # and % of people who report accessing the facility is affordable
Facilities and infrastructure are available at times of demand and are well utilized
• # of hours the facility is open • # of unique people who visit/use the facility • # of visits to the facility
Facilities and infrastructure are environmentally sustainable
• # of trees planted • # of greening space projects completed • # of energy efficiency enhancements completed • Amount of energy consumed by the facility • Amount of resources (e.g. water) consumed by the facility • Amount of energy produced by the facility • Amount of energy saved in the facility • Amount of waste produced by the facility • Amount of waste recycled or reused
IMPACT OUTCOMES
Indicator (How do we know?)
Metric
Londoners are aware of poverty and its impact on our community
# and % of Londoners who are aware of poverty and its impact on the community
Londoners are aware of how they can contribute to addressing poverty
# and % of individuals who can articulate their role in helping reduce poverty # and % of individuals who consider reducing poverty a high priority
MUST REPORT ON OUTCOME REGARDLESS OF APPROACH
• # of Londoners who have an increased understanding of poverty and its impact on our community.
37
OUTCOME: More young people will graduate from secondary school (or the equivalent).
APPROACH: Public Awareness
Description: To inform, influence, or engage target audiences (children, youth, families, and stakeholders) about a particular message or issue to enhance knowledge and/or encourage behaviour change.
Approach Outputs
Indicators Metrics
Exposure & Tools
• # of individuals who were engaged through the campaign • # of shares, re-tweets, reposts, likes • # of visitors to the site • # of flyers, brochures, pamphlets distributed • # of print media • # of outreach activities • # of tools developed to assist individuals to increase their understanding of
poverty and its impact on the community
Approach Outcomes
Indicators • Metrics
Increased awareness of the issue/message
• # and % of individuals who have an increased awareness of the importance of graduating from secondary school
• # and % of individuals who know where to go to get more information about graduating from secondary school
• # and % of individuals who shared information about the importance of graduating from secondary school
• # and % of individuals who seek further information about graduating from secondary school
Increased knowledge of the issue/message
• # and % of individuals who understand the importance of graduating from secondary school
• # and % of individuals who understand the consequences of not graduating from secondary school
• # of individuals who understand how to graduate from secondary school
Positive change in attitude toward
• # and % of individuals who changed their attitude towards graduating from secondary school
• # of individuals who support assisting young people to graduate from secondary school
Increased self-efficacy to change behaviour
• # and % of individuals who want to/are willing to change their behaviour to graduate from secondary school
• # and % of individuals who have the information/resources they need to graduate from secondary school
Increased intention to change behaviour • # and % of individuals who intend to graduate from secondary school
Positive change in • # and % of individuals who change their behaviour to graduate from secondary
38
Indicators • Metrics behaviour school Maintenance of the changed/adopted behaviour
• # and % of young people who graduate from secondary school
APPROACH: Research and Advocacy
Description: To support and encourage the generation of new knowledge and evidence-informed decisions that help guide or influence decisions that support CYN initiatives and improve outcomes.
Approach Outputs
Indicators Metrics
Development or capture of knowledge related to a specific issue
(Knowledge Generation, Capture, Synthesis)
• # of pilot/demonstration projects implemented to test an idea/model • # of research projects implemented • # of knowledge products prepared (e.g. white paper, research paper/report,
case study, learning brief, videos) • # of best practices identified • # of lessons learned • Types of lessons learned • # of policy briefs/documents created
Dissemination of knowledge related to a specific issue
(Knowledge Sharing)
• # of communications disseminated • # of educational briefings shared • # of education sessions held or presented at (e.g. forums, meetings, workshops,
trainings, presentations, seminars, events) • # of publications • # of website visits • # of downloads of a knowledge product • # of best practices shared • # of lessons learned being shared • # of tools created to support application/use of knowledge or evidence (e.g.
implementation guide, manual, handbook, aid, toolkit)
Approach Outcomes
Indicators • Metrics
Increased awareness of a specific issue
• # and % of individuals who have an increased awareness of the importance of graduating from secondary school
• # and % of individuals who know where to go to get more information about graduating from secondary school
• # and % of individuals who shared information about graduating from secondary school
• # and % of individuals who seek further information about graduating from secondary school
Increased understanding • # and % of individuals who have an increased understanding of graduating from
39
Indicators • Metrics of a specific issue secondary school
• # and % of individuals who understand the importance of graduating from secondary school
• # and % of individuals who understand the consequences of not graduating from high school
• # of individuals who understand how to graduate from secondary school Change in attitudes, beliefs, and values about a specific issue
(Persuasion)
• # and % of individuals who changed their attitude towards graduating from secondary school
Increased will and support for a specific issue
(Decision)
• # of individuals who support assisting young people to graduate from secondary school
• # and % of individuals who align their actions, support, and or resources around young people graduating from secondary school
Increased capacity to apply knowledge about/address a specific issue
• # and % of individuals who know what actions to take to graduate from secondary school
• # and % of individuals who have the information/knowledge they need to graduate from secondary school
• # and % of individuals who feel confident they could take action to graduate from secondary school
Implementation of evidence-based policy and practice
(Knowledge Application, Implementation)
• # of new policies or practices implemented related to graduating from secondary school
• # of existing policies or practices that are revised related to graduating from secondary school
• $ allocated to address graduating from secondary school • # of projects/models adapted to a new setting or scaled up that address
graduating from secondary school
Positive changes for individuals or social/ physical conditions
(Confirmation)
• # and % of individuals who change their behaviour to graduate from secondary school
• # and % of individuals who have maintained their behaviour related to graduating from secondary school
• # and % of individuals who encouraged someone else to change their behaviour to graduate from secondary school
• # and % of individuals with lived experience who were positively impacted because of the actions taken to address graduating from secondary school
APPROACH: Education, skill development, and capacity building
Description: To strengthen individual's knowledge or understanding of a particular topic, increase an individual’s skills and abilities and increase an individual’s capacity or competency through deliberate, organized, and sustained efforts.
Approach Outputs
Indicators Metrics
40
Indicators Metrics Provision of education, skill development, and capacity building opportunities
• # of workshops • # of trainings • # of courses • # of networking events
Approach Outcomes
Indicators • Metrics
Positive reaction to the learning experience. (Engagement, Relevance, Satisfaction)
• # and % of individuals who considered the learning experience useful. • # and % of individuals who considered the learning experience to be relevant. • # and % of individuals who thought the learning experience was effective. • # and % of individuals who considered the learning experience to be practical. • # and % of individuals who were satisfied with the learning experience. • # and % of individuals who would recommend the learning experience to others.
Increased knowledge, skills, and capacity as a result of the learning experience. (Knowledge, Skills, and Attitudes)
• # and % of individuals who had increased knowledge of graduating from secondary school
• # and % of individuals who had a change in attitude about graduating from secondary school
• # and % of individuals who had an increase in skills related to graduating from secondary school
• # and % of individuals who had an increase in capacity (ability) related to graduating from secondary school
Intent to apply the knowledge and change behaviour as a result of the learning experience. (Confidence, Commitment, Self-efficacy)
• # and % of individuals who believe they can apply the knowledge and skills they learned to graduate from secondary school
• # and % of individuals who feel confident about applying the knowledge and skills they learned to graduate from secondary school
• # and % of individuals who are committed to applying the knowledge and skills they learned to graduate from secondary school
• # and % of individuals who understand how to apply the knowledge and skills they learned to graduate from secondary school
• # and % of individuals who report they will be able to use the knowledge and skills they learned to graduate from secondary school.
• # and % of individuals who intend to apply the knowledge and skills they have learned to graduate from high school.
Application and uptake of the knowledge and skills developed during the learning experience. (application, transfer)
• # and % of individuals who apply the knowledge and skills they have learned to graduate from secondary school.
• # and % of individuals who transferred their knowledge and skills to another person to increase their understanding of the importance of graduating from secondary school.
Positive results due to knowledge and skills application. (Individual, Organizational)
• # and % of individuals who participated in the learning experience who were positively impacted because of the actions taken related to graduating from secondary school.
• # and % of individuals with lived experience who were positively impacted because of the actions taken related to graduating from secondary school.
APPROACH: Service Delivery
Description: To develop and deliver organizational and system-wide user-focused services and resources.
41
Approach Outputs
Indicators Metrics
Service provision opportunities.
• # of available service sites • Service hours of operation • # of new/existing services or programs available • # of new/existing resources available
Approach Outcomes
Indicators • Metrics
Services and resources are available
• # and % of individuals who report they have access to services they need related to graduating from secondary school.
• # and % of individuals who report they have access to resources they need related to poverty and its impact on our community
• # and % of individuals who felt informed about services available to them related to poverty and its impact on our community
Services and resources are accessible
• # and % of individuals who report the service/resource was easy to access • # and % of individuals who report they could access the service (site) within a
reasonable amount of travel time • # and % of individuals who report the services they need are available when
they need them • # and % of individuals who report the service provider was flexible
A positive service environment and culture exists
• # and % of individuals who report the service provider was non-judgemental • # and % of individuals who report the service they received was culturally
sensitive/appropriate • # and % of individuals who report the service provider was respectful • # and % of individuals who report the service provider was caring • # and % of individuals who report the service provider was professional • # and % of individuals who report the service environment was clean • # and % of individuals who report the service environment was welcoming • # and % of individuals who report they felt safe/comfortable accessing the
service • # and % of service providers that use standardized tools (e.g. screening,
assessment, processes) • # and % of service providers that use a shared information system • # and % of service providers with defined/agreed upon service standards or
benchmarks
Service providers are knowledgeable, competent, and skilled
• # and % of individuals who report the service provider was knowledgeable • # and % of individuals who received appropriate referrals to services • # of referrals provided to services/resources • # and % of service providers who report they understand the needs of those
who access their service • # and % of service providers who report they are able to address/meet the
needs of those who access their service • # and % of service providers who report they have the resources they need to
provide adequate service
42
Indicators • Metrics • # and % of staff trained in service competencies • # and % of service providers who report they coordinate/collaborate with other
service providers • # and % of individuals who felt the service provider communicated clearly
Exceptional service is provided
• # and % of individuals who report the service met their needs • # and % of individuals who report the service provider was helpful • # and % of individuals who report the service was provided in a timely manner • # of times people report they had to share their story • # and % of individuals who felt they had input in the service • # and % of individuals who felt the service provider was reliable (e.g. followed
through, did what they said they would)
Quality service is experienced
• # and % of individuals who report they felt heard • # and % of individuals who report they were satisfied with the services • # and % of individuals who report they had a positive experience accessing the
service • # and % of individuals who would recommend the service • # and % of individuals who report they trust the service provider • # and % of individuals who report they value the service/resource
Services are used by the community
• # and % of individuals who accessed a specific service/program • # and % of individuals who used/received a specific resource • Amount of a specific resource distributed • Frequency of service/resource use
Services and resources provided have an impact
• # and % of individuals who experienced a positive outcome as a result of accessing the service
• # and % of individuals who experienced a positive outcome as a result of receiving the resource
• Type of positive outcome individual experienced as a result of accessing the service/receiving the resource
APPROACH: Facilities and Infrastructure
Description: To develop or improve an aspect of the physical or built environment.
Approach Outputs
Indicators Metrics
Infrastructure opportunities.
• # facilities available • # of new facilities available • # of new infrastructure available
Approach Outcomes
Indicators • Metrics Facilities and infrastructure enable
• # and % of people who report the facility has adequate parking (e.g. for cars, bicycles)
43
Indicators • Metrics effective service delivery • # and % of people who report the facility is accessible by public transit, walking
or biking • # and % of people who report the facility is within a reasonable distance • # and % of people who report the facility is in a convenient location • # and % of people who report the facility is welcoming • # and % of people who report they feel safe accessing/using the facility • # of safety audits completed • # and % of safety concerns addressed • # of injuries/accidents reported • # of barriers to participation identified/removed • # and % of people who report the facility has adequate signage • # of accessibility improvements completed • # and % of people who report the facility allows for ease of mobility • # and % of people who report the facility is accessible to community members of
all abilities • # of facilities available • # of facility enhancements completed • Type of facility enhancements completed • # and % of people who report they are better able to access service/perform a
specific behaviour as a result of a new or enhanced facility • # and % of people who report they access service/perform a specific behaviour
more often as a result of a new or enhanced facility
Facilities and infrastructure are fit for the purpose for which they are used
• # and % of people who report the facility has appropriate equipment to meet the needs of those who use it
• # and % of people who report the facility fits the purpose for which it is used • # and % of facilities that are in good condition • # and % of people who report the quality of the facility and/or equipment is good • # and % of people who report the facility is well maintained • # and % of facilities that comply with/meet service standards • # and % of facilities with adequate IT capabilities/infrastructure • # and % of facilities that can be adapted to fit the needs of the community/a
group • # and % of facilities that have space for shared service/programming • # and % of facilities that can be used for a variety of different functions (i.e. they
are multi-purpose)
Facilities and infrastructure meet community needs
• # of different groups (e.g. service providers, community groups) that use the facility
• # and % of people who report the facility is inclusive of all people in the community (i.e. ages, abilities, income levels, cultural backgrounds, interests)
• # of community members involved in decision-making related to the facility and its use
• # and % of community members who feel a sense of ownership for the facility • # and % of people who report available facilities address/meet the needs and
interest of the local community • # and % of people who report there is a facility/place in their community where
they can access a specific service/perform a specific behaviour • # and % of people who are satisfied with the facility
Facilities and infrastructure are economically sustainable and affordable
• Amount of funding made available to enhance/maintain/build the facility • Annual cost of operations and management • Annual savings from energy efficiencies • Annual capital costs • Annual utility costs
44
Indicators • Metrics • Annual facility maintenance costs • Annual facility revenue • # and % of people who report accessing the facility is affordable
Facilities and infrastructure are available at times of demand and are well utilized
• # of hours the facility is open • # of unique people who visit/use the facility • # of visits to the facility
Facilities and infrastructure are environmentally sustainable
• # of trees planted • # of greening space projects completed • # of energy efficiency enhancements completed • Amount of energy consumed by the facility • Amount of resources (e.g. water) consumed by the facility • Amount of energy produced by the facility • Amount of energy saved in the facility • Amount of waste produced by the facility • Amount of waste recycled or reused
IMPACT OUTCOMES
Indicator (How do we know?)
Metric
Young people have the resources and support to foster educational achievement
# of individuals who know how to access volunteer opportunities to complete their volunteer hours # of individuals who know how to access resources and support to help them with their education # of individuals who have the resources and support they need to be successful in their education # of individuals who feel prepared for high school # of individuals who learned new skills that will help them be successful in school # of individuals who feel prepared for the provincial literacy test
Young people are engaged in their education
# of individuals who have a plan for their education # of individuals who are satisfied with their education experience # of individuals who plan to graduate from high school # of individuals working towards/actively engaged in completing their high school course credits # of individuals working towards/actively engaged in completing their volunteer hours for school # of individuals who participate in educational activities
Young people graduate from high school with their cohort
# of individuals who are on track to complete their high school diploma or equivalent # of individuals who have completed high school course credits # of individuals who passed the provincial literacy test # of individuals who have completed the requirements for a high school diploma or equivalent # of individuals who have completed the 40 hours of volunteer work require for a high school diploma or equivalent # of individuals who graduated from high school with their cohort
MUST REPORT ON OUTCOME REGARDLESS OF APPROACH
45
• # of young people who reported the intervention increased the likelihood they will graduate from secondary school
OUTCOME: Families have more opportunity to become financially sustainable.
APPROACH: Public Awareness
Description: To inform, influence, or engage target audiences (children, youth, families, and stakeholders) about a particular message or issue to enhance knowledge and/or encourage behaviour change.
Approach Outputs
Indicators Metrics
Exposure & Tools
• # of individuals who were engaged through the campaign • # of shares, re-tweets, reposts, likes • # of visitors to the site • # of flyers, brochures, pamphlets distributed • # of print media • # of outreach activities • # of tools developed to assist individuals to increase their understanding of
poverty and its impact on the community
Approach Outcomes
Indicators • Metrics
Increased awareness of the issue/message
• # and % of individuals who have an increased awareness of opportunities for families to become financially sustainable
• # and % of individuals who know where to go to get more information about opportunities for families to become financially sustainable
• # and % of individuals who shared information about opportunities for families to become financially sustainable
• # and % of individuals who seek further information about opportunities for families to become financially sustainable
Increased knowledge of the issue/message
• # and % of individuals who have an increased understanding of opportunities for families to become financially sustainable
• # and % of individuals who understand the importance of opportunities for families to become financially sustainable
• # and % of individuals who understand the consequences of not addressing opportunities for families to become financially sustainable
• # of individuals who understand how to provide opportunities for families to become financially sustainable
Positive change in attitude toward
• # and % of individuals who changed their attitude towards opportunities for families to become financially sustainable
• # of individuals who support opportunities for families to become financially
46
Indicators • Metrics sustainable
Increased self-efficacy to change behaviour
• # and % of individuals who want to/are willing to change their behaviour to address opportunities for families to become financially sustainable
• # and % of individuals who have the information/resources they need to address family financial sustainability
Increased intention to change behaviour
• # and % of individuals who intend to change their behaviour to address family financial sustainability
Positive change in behaviour
• # and % of individuals who change their behaviour to address family financial sustainability
Maintenance of the changed/adopted behaviour
• # and % of individuals who have maintained their behaviour related to addressing family financial sustainability
• # and % of individuals who encouraged someone else to change their behaviour to address family financial sustainability
APPROACH: Research and Advocacy
Description: To support and encourage the generation of new knowledge and evidence-informed decisions that help guide or influence decisions that support CYN initiatives and improve outcomes.
Approach Outputs
Indicators Metrics
Development or capture of knowledge related to a specific issue
(Knowledge Generation, Capture, Synthesis)
• # of pilot/demonstration projects implemented to test an idea/model • # of research projects implemented • # of knowledge products prepared (e.g. white paper, research paper/report,
case study, learning brief, videos) • # of best practices identified • # of lessons learned • Types of lessons learned • # of policy briefs/documents created
Dissemination of knowledge related to a specific issue
(Knowledge Sharing)
• # of communications disseminated • # of educational briefings shared • # of education sessions held or presented at (e.g. forums, meetings, workshops,
trainings, presentations, seminars, events) • # of publications • # of website visits • # of downloads of a knowledge product • # of best practices shared • # of lessons learned being shared • # of tools created to support application/use of knowledge or evidence (e.g.
implementation guide, manual, handbook, aid, toolkit)
Approach Outcomes
47
Indicators • Metrics
Increased awareness of a specific issue
• # and % of individuals who have an increased awareness of opportunities for family financial sustainability
• # and % of individuals who know where to go to get more information about opportunities for family financial sustainability
• # and % of individuals who shared information about opportunities for family financial sustainability
• # and % of individuals who seek further information about opportunities for family financial sustainability
Increased understanding of a specific issue
• # and % of individuals who have an increased understanding of opportunities for family financial sustainability
• # and % of individuals who understand the importance of addressing family financial sustainability
• # and % of individuals who understand the consequences of not addressing family financial sustainability
• # of individuals who understand how to address family financial sustainability Change in attitudes, beliefs, and values about a specific issue
(Persuasion)
• # and % of individuals who changed their attitude towards opportunities for family financial sustainability
Increased will and support for a specific issue
(Decision)
• # of individuals who support addressing family financial sustainability • # and % of individuals who align their actions, support, and or resources around
family financial sustainability
Increased capacity to apply knowledge about/address a specific issue
• # and % of individuals who know what actions to take to address family financial sustainability
• # and % of individuals who have the information/knowledge they need to address family financial sustainability
• # and % of individuals who feel confident they could take action to address family financial sustainability
Implementation of evidence-based policy and practice
(Knowledge Application, Implementation)
• # of new policies or practices implemented related to family financial sustainability
• # of existing policies or practices that are revised related to addressing family financial sustainability
• $ allocated to address family financial sustainability • # of projects/models adapted to family financial sustainability
Positive changes for individuals or social/ physical conditions
(Confirmation)
• # and % of individuals who change their behaviour to address family financial sustainability
• # and % of individuals who have maintained their behaviour related to family financial sustainability
• # and % of individuals who encouraged someone else to change their behaviour to address family financial sustainability
• # and % of individuals with lived experience who were positively impacted because of the actions taken to address family financial sustainability
APPROACH: Education, skill development, and capacity building
Description: To strengthen individual's knowledge or understanding of a particular topic, increase an individual’s skills and abilities and increase an individual’s capacity or competency through deliberate, organized, and sustained efforts.
48
Approach Outputs
Indicators Metrics Provision of education, skill development, and capacity building opportunities
• # of workshops • # of trainings • # of courses • # of networking events
Approach Outcomes
Indicators • Metrics
Positive reaction to the learning experience. (Engagement, Relevance, Satisfaction)
• # and % of individuals who considered the learning experience useful. • # and % of individuals who considered the learning experience to be relevant. • # and % of individuals who thought the learning experience was effective. • # and % of individuals who considered the learning experience to be practical. • # and % of individuals who were satisfied with the learning experience. • # and % of individuals who would recommend the learning experience to others.
Increased knowledge, skills, and capacity as a result of the learning experience. (Knowledge, Skills, and Attitudes)
• # and % of individuals who had increased knowledge of family financial sustainability
• # and % of individuals who had a change in attitude about family financial sustainability
• # and % of individuals who had an increase in skills in addressing family financial sustainability
• # and % of individuals who had an increase in capacity (ability) to address family financial sustainability
Intent to apply the knowledge and change behaviour as a result of the learning experience. (Confidence, Commitment, Self-efficacy)
• # and % of individuals who believe they can apply the knowledge and skills they learned to address family financial sustainability
• # and % of individuals who feel confident about applying the knowledge and skills they learned to address family financial sustainability
• # and % of individuals who are committed to applying the knowledge and skills they learned to address family financial sustainability
• # and % of individuals who understand how to apply the knowledge and skills they learned to address family financial sustainability
• # and % of individuals who report they will be able to use the knowledge and skills they learned to address family financial sustainability
• # and % of individuals who intend to apply the knowledge and skills they have learned to address family financial sustainability
Application and uptake of the knowledge and skills developed during the learning experience. (application, transfer)
• # and % of individuals who apply the knowledge and skills they have learned to address family financial sustainability
• # and % of individuals who transferred their knowledge and skills to another person to increase their understanding of family financial sustainability
Positive results due to knowledge and skills application. (Individual, Organizational)
• # and % of individuals who participated in the learning experience who were positively impacted because of the actions taken to address family financial sustainability
• # and % of individuals with lived experience who were positively impacted because of the actions taken to address family financial sustainability
49
APPROACH: Service Delivery
Description: To develop and deliver organizational and system-wide user-focused services and resources.
Approach Outputs
Indicators Metrics
Service provision opportunities.
• # of available service sites • Service hours of operation • # of new/existing services or programs available • # of new/existing resources available
Approach Outcomes
Indicators • Metrics
Services and resources are available
• # and % of individuals who report they have access to services they need related to family financial sustainability
• # and % of individuals who report they have access to resources they need related to family financial sustainability
• # and % of individuals who felt informed about services available to them related to family financial sustainability
Services and resources are accessible
• # and % of individuals who report the service/resource was easy to access • # and % of individuals who report they could access the service (site) within a
reasonable amount of travel time • # and % of individuals who report the services they need are available when
they need them • # and % of individuals who report the service provider was flexible
A positive service environment and culture exists
• # and % of individuals who report the service provider was non-judgemental • # and % of individuals who report the service they received was culturally
sensitive/appropriate • # and % of individuals who report the service provider was respectful • # and % of individuals who report the service provider was caring • # and % of individuals who report the service provider was professional • # and % of individuals who report the service environment was clean • # and % of individuals who report the service environment was welcoming • # and % of individuals who report they felt safe/comfortable accessing the
service • # and % of service providers that use standardized tools (e.g. screening,
assessment, processes) • # and % of service providers that use a shared information system • # and % of service providers with defined/agreed upon service standards or
benchmarks Service providers are knowledgeable, competent, and skilled
• # and % of individuals who report the service provider was knowledgeable • # and % of individuals who received appropriate referrals to services • # of referrals provided to services/resources • # and % of service providers who report they understand the needs of those
50
Indicators • Metrics who access their service
• # and % of service providers who report they are able to address/meet the needs of those who access their service
• # and % of service providers who report they have the resources they need to provide adequate service
• # and % of staff trained in service competencies • # and % of service providers who report they coordinate/collaborate with other
service providers • # and % of individuals who felt the service provider communicated clearly
Exceptional service is provided
• # and % of individuals who report the service met their needs • # and % of individuals who report the service provider was helpful • # and % of individuals who report the service was provided in a timely manner • # of times people report they had to share their story • # and % of individuals who felt they had input in the service • # and % of individuals who felt the service provider was reliable (e.g. followed
through, did what they said they would)
Quality service is experienced
• # and % of individuals who report they felt heard • # and % of individuals who report they were satisfied with the services • # and % of individuals who report they had a positive experience accessing the
service • # and % of individuals who would recommend the service • # and % of individuals who report they trust the service provider • # and % of individuals who report they value the service/resource
Services are used by the community
• # and % of individuals who accessed a specific service/program • # and % of individuals who used/received a specific resource • Amount of a specific resource distributed • Frequency of service/resource use
Services and resources provided have an impact
• # and % of individuals who experienced a positive outcome as a result of accessing the service
• # and % of individuals who experienced a positive outcome as a result of receiving the resource
• Type of positive outcome individual experienced as a result of accessing the service/receiving the resource
APPROACH: Facilities and Infrastructure
Description: To develop or improve an aspect of the physical or built environment.
Approach Outputs
Indicators Metrics
Infrastructure opportunities.
• # facilities available • # of new facilities available • # of new infrastructure available
Approach Outcomes
51
Indicators • Metrics
Facilities and infrastructure enable effective service delivery
• # and % of people who report the facility has adequate parking (e.g. for cars, bicycles)
• # and % of people who report the facility is accessible by public transit, walking or biking
• # and % of people who report the facility is within a reasonable distance • # and % of people who report the facility is in a convenient location • # and % of people who report the facility is welcoming • # and % of people who report they feel safe accessing/using the facility • # of safety audits completed • # and % of safety concerns addressed • # of injuries/accidents reported • # of barriers to participation identified/removed • # and % of people who report the facility has adequate signage • # of accessibility improvements completed • # and % of people who report the facility allows for ease of mobility • # and % of people who report the facility is accessible to community members of
all abilities • # of facilities available • # of facility enhancements completed • Type of facility enhancements completed • # and % of people who report they are better able to access service/perform a
specific behaviour as a result of a new or enhanced facility • # and % of people who report they access service/perform a specific behaviour
more often as a result of a new or enhanced facility
Facilities and infrastructure are fit for the purpose for which they are used
• # and % of people who report the facility has appropriate equipment to meet the needs of those who use it
• # and % of people who report the facility fits the purpose for which it is used • # and % of facilities that are in good condition • # and % of people who report the quality of the facility and/or equipment is good • # and % of people who report the facility is well maintained • # and % of facilities that comply with/meet service standards • # and % of facilities with adequate IT capabilities/infrastructure • # and % of facilities that can be adapted to fit the needs of the community/a
group • # and % of facilities that have space for shared service/programming • # and % of facilities that can be used for a variety of different functions (i.e. they
are multi-purpose)
Facilities and infrastructure meet community needs
• # of different groups (e.g. service providers, community groups) that use the facility
• # and % of people who report the facility is inclusive of all people in the community (i.e. ages, abilities, income levels, cultural backgrounds, interests)
• # of community members involved in decision-making related to the facility and its use
• # and % of community members who feel a sense of ownership for the facility • # and % of people who report available facilities address/meet the needs and
interest of the local community • # and % of people who report there is a facility/place in their community where
they can access a specific service/perform a specific behaviour • # and % of people who are satisfied with the facility
Facilities and infrastructure are
• Amount of funding made available to enhance/maintain/build the facility • Annual cost of operations and management
52
Indicators • Metrics economically sustainable and affordable
• Annual savings from energy efficiencies • Annual capital costs • Annual utility costs • Annual facility maintenance costs • Annual facility revenue • # and % of people who report accessing the facility is affordable
Facilities and infrastructure are available at times of demand and are well utilized
• # of hours the facility is open • # of unique people who visit/use the facility • # of visits to the facility
Facilities and infrastructure are environmentally sustainable
• # of trees planted • # of greening space projects completed • # of energy efficiency enhancements completed • Amount of energy consumed by the facility • Amount of resources (e.g. water) consumed by the facility • Amount of energy produced by the facility • Amount of energy saved in the facility • Amount of waste produced by the facility • Amount of waste recycled or reused
IMPACT OUTCOMES
Indicator (How do we know?)
Metric
Families learn new ways to save money
# of individuals who learned new ways to save money # of individuals who learned skills that will help them to save on groceries # of individuals who know how to make a budget # of individuals who learned strategies for managing and/or reducing debt
Families are saving money # of individuals who save money on their monthly grocery bill Average amount ($) individuals saved on their monthly grocery bill # of individuals who have made a written budget # of individuals who are following a budget # of individuals who have a savings plan # of individuals who save regularly
Families have opportunities for meaningful employment
# of individuals who know how to find and access employment or self-employment opportunities # of individuals who are employed or self-employed # of individuals who started a business # of individuals who received employment counselling, training, or networking support # of individuals who received financial support to start a business
MUST REPORT ON OUTCOME REGARDLESS OF APPROACH
• # of new opportunities for families to become financially sustainable
OUTCOME: There is an increase in the number of opportunities to develop sustainable food solutions.
APPROACH: Public Awareness
53
Description: To inform, influence, or engage target audiences (children, youth, families, and stakeholders) about a particular message or issue to enhance knowledge and/or encourage behaviour change.
Approach Outputs
Indicators Metrics
Exposure & Tools
• # of individuals who were engaged through the campaign • # of shares, re-tweets, reposts, likes • # of visitors to the site • # of flyers, brochures, pamphlets distributed • # of print media • # of outreach activities • # of tools developed to assist individuals to increase their understanding of
poverty and its impact on the community
Approach Outcomes
Indicators • Metrics
Increased awareness of the issue/message
• # and % of individuals who have an increased awareness of sustainable food solutions.
• # and % of individuals who know where to go to get more information about sustainable food solutions.
• # and % of individuals who shared information about sustainable food solutions. • # and % of individuals who seek further information about sustainable food
solutions.
Increased knowledge of the issue/message
• # and % of individuals who have an increased understanding of sustainable food solutions.
• # and % of individuals who understand the importance of addressing sustainable food solutions.
• # and % of individuals who understand the consequences of not addressing sustainable food solutions.
• # of individuals who understand how to address sustainable food solutions.
Positive change in attitude toward
• # and % of individuals who changed their attitude towards sustainable food solutions.
• # of individuals who support addressing sustainable food solutions.
Increased self-efficacy to change behaviour
• # and % of individuals who want to/are willing to change their behaviour to address sustainable food solutions.
• # and % of individuals who have the information/resources they need to address sustainable food solutions.
Increased intention to change behaviour
• # and % of individuals who intend to change their behaviour to address sustainable food solutions.
Positive change in behaviour
• # and % of individuals who change their behaviour to address sustainable food solutions.
Maintenance of the changed/adopted behaviour
• # and % of individuals who have maintained their behaviour related to addressing sustainable food solutions.
• # and % of individuals who encouraged someone else to change their behaviour to address sustainable food solutions.
54
APPROACH: Research and Advocacy
Description: To support and encourage the generation of new knowledge and evidence-informed decisions that help guide or influence decisions that support CYN initiatives and improve outcomes.
Approach Outputs
Indicators Metrics
Development or capture of knowledge related to a specific issue
(Knowledge Generation, Capture, Synthesis)
• # of pilot/demonstration projects implemented to test an idea/model • # of research projects implemented • # of knowledge products prepared (e.g. white paper, research paper/report,
case study, learning brief, videos) • # of best practices identified • # of lessons learned • Types of lessons learned • # of policy briefs/documents created
Dissemination of knowledge related to a specific issue
(Knowledge Sharing)
• # of communications disseminated • # of educational briefings shared • # of education sessions held or presented at (e.g. forums, meetings, workshops,
trainings, presentations, seminars, events) • # of publications • # of website visits • # of downloads of a knowledge product • # of best practices shared • # of lessons learned being shared • # of tools created to support application/use of knowledge or evidence (e.g.
implementation guide, manual, handbook, aid, toolkit)
Approach Outcomes
Indicators • Metrics
Increased awareness of a specific issue
• # and % of individuals who have an increased awareness of sustainable food solutions.
• # and % of individuals who know where to go to get more information about sustainable food solutions.
• # and % of individuals who shared information about sustainable food solutions. • # and % of individuals who seek further information about sustainable food
solutions.
Increased understanding of a specific issue
• # and % of individuals who have an increased understanding of sustainable food solutions.
• # and % of individuals who understand the importance of addressing sustainable food solutions.
• # and % of individuals who understand the consequences of not addressing sustainable food solutions.
• # of individuals who understand how to address sustainable food solutions.
55
Indicators • Metrics Change in attitudes, beliefs, and values about a specific issue
(Persuasion)
• # and % of individuals who changed their attitude towards sustainable food solutions.
Increased will and support for a specific issue
(Decision)
• # of individuals who support addressing sustainable food solutions. • # and % of individuals who align their actions, support, and or resources around
sustainable food solutions.
Increased capacity to apply knowledge about/address a specific issue
• # and % of individuals who know what actions to take to address sustainable food solutions.
• # and % of individuals who have the information/knowledge they need to address sustainable food solutions.
• # and % of individuals who feel confident they could take action to address sustainable food solutions.
Implementation of evidence-based policy and practice
(Knowledge Application, Implementation)
• # of new policies or practices implemented related to addressing sustainable food solutions.
• # of existing policies or practices that are revised related to addressing sustainable food solutions.
• $ allocated to address sustainable food solutions. • # of projects/models adapted to a new setting or scaled up that address
sustainable food solutions.
Positive changes for individuals or social/ physical conditions
(Confirmation)
• # and % of individuals who change their behaviour to address sustainable food solutions.
• # and % of individuals who have maintained their behaviour related to addressing sustainable food solutions.
• # and % of individuals who encouraged someone else to change their behaviour to address sustainable food solutions.
• # and % of individuals with lived experience who were positively impacted because of the actions taken to address sustainable food solutions.
APPROACH: Education, skill development, and capacity building
Description: To strengthen individual's knowledge or understanding of a particular topic, increase an individual’s skills and abilities and increase an individual’s capacity or competency through deliberate, organized, and sustained efforts.
Approach Outputs
Indicators Metrics Provision of education, skill development, and capacity building opportunities
• # of workshops • # of trainings • # of courses • # of networking events
Approach Outcomes
56
Indicators • Metrics
Positive reaction to the learning experience. (Engagement, Relevance, Satisfaction)
• # and % of individuals who considered the learning experience useful. • # and % of individuals who considered the learning experience to be relevant. • # and % of individuals who thought the learning experience was effective. • # and % of individuals who considered the learning experience to be practical. • # and % of individuals who were satisfied with the learning experience. • # and % of individuals who would recommend the learning experience to others.
Increased knowledge, skills, and capacity as a result of the learning experience. (Knowledge, Skills, and Attitudes)
• # and % of individuals who had increased knowledge of sustainable food solutions.
• # and % of individuals who had a change in attitude about sustainable food solutions.
• # and % of individuals who had an increase in skills in addressing sustainable food solutions.
• # and % of individuals who had an increase in capacity (ability) to address sustainable food solutions.
Intent to apply the knowledge and change behaviour as a result of the learning experience. (Confidence, Commitment, Self-efficacy)
• # and % of individuals who believe they can apply the knowledge and skills they learned to address sustainable food solutions.
• # and % of individuals who feel confident about applying the knowledge and skills they learned to address sustainable food solutions.
• # and % of individuals who are committed to applying the knowledge and skills they learned to address sustainable food solutions.
• # and % of individuals who understand how to apply the knowledge and skills they learned to address sustainable food solutions.
• # and % of individuals who report they will be able to use the knowledge and skills they learned to address sustainable food solutions.
• # and % of individuals who intend to apply the knowledge and skills they have learned to address sustainable food solutions.
Application and uptake of the knowledge and skills developed during the learning experience. (application, transfer)
• # and % of individuals who apply the knowledge and skills they have learned to address sustainable food solutions.
• # and % of individuals who transferred their knowledge and skills to another person to increase their understanding of sustainable food solutions.
Positive results due to knowledge and skills application. (Individual, Organizational)
• # and % of individuals who participated in the learning experience who were positively impacted because of the actions taken to address sustainable food solutions.
• # and % of individuals with lived experience who were positively impacted because of the actions taken to address sustainable food solutions.
APPROACH: Service Delivery
Description: To develop and deliver organizational and system-wide user-focused services and resources.
Approach Outputs
Indicators Metrics Service provision opportunities.
• # of available service sites • Service hours of operation
57
Indicators Metrics • # of new/existing services or programs available • # of new/existing resources available
Approach Outcomes
Indicators • Metrics
Services and resources are available
• # and % of individuals who report they have access to services they need related to sustainable food solutions.
• # and % of individuals who report they have access to resources they need related to sustainable food solutions.
• # and % of individuals who felt informed about services available to them related to sustainable food solutions.
Services and resources are accessible
• # and % of individuals who report the service/resource was easy to access • # and % of individuals who report they could access the service (site) within a
reasonable amount of travel time • # and % of individuals who report the services they need are available when
they need them • # and % of individuals who report the service provider was flexible
A positive service environment and culture exists
• # and % of individuals who report the service provider was non-judgemental • # and % of individuals who report the service they received was culturally
sensitive/appropriate • # and % of individuals who report the service provider was respectful • # and % of individuals who report the service provider was caring • # and % of individuals who report the service provider was professional • # and % of individuals who report the service environment was clean • # and % of individuals who report the service environment was welcoming • # and % of individuals who report they felt safe/comfortable accessing the
service • # and % of service providers that use standardized tools (e.g. screening,
assessment, processes) • # and % of service providers that use a shared information system • # and % of service providers with defined/agreed upon service standards or
benchmarks
Service providers are knowledgeable, competent, and skilled
• # and % of individuals who report the service provider was knowledgeable • # and % of individuals who received appropriate referrals to services • # of referrals provided to services/resources • # and % of service providers who report they understand the needs of those
who access their service • # and % of service providers who report they are able to address/meet the
needs of those who access their service • # and % of service providers who report they have the resources they need to
provide adequate service • # and % of staff trained in service competencies • # and % of service providers who report they coordinate/collaborate with other
service providers • # and % of individuals who felt the service provider communicated clearly
Exceptional service is provided
• # and % of individuals who report the service met their needs • # and % of individuals who report the service provider was helpful • # and % of individuals who report the service was provided in a timely manner
58
Indicators • Metrics • # of times people report they had to share their story • # and % of individuals who felt they had input in the service • # and % of individuals who felt the service provider was reliable (e.g. followed
through, did what they said they would)
Quality service is experienced
• # and % of individuals who report they felt heard • # and % of individuals who report they were satisfied with the services • # and % of individuals who report they had a positive experience accessing the
service • # and % of individuals who would recommend the service • # and % of individuals who report they trust the service provider • # and % of individuals who report they value the service/resource
Services are used by the community
• # and % of individuals who accessed a specific service/program • # and % of individuals who used/received a specific resource • Amount of a specific resource distributed • Frequency of service/resource use
Services and resources provided have an impact
• # and % of individuals who experienced a positive outcome as a result of accessing the service
• # and % of individuals who experienced a positive outcome as a result of receiving the resource
• Type of positive outcome individual experienced as a result of accessing the service/receiving the resource
APPROACH: Facilities and Infrastructure
Description: To develop or improve an aspect of the physical or built environment.
Approach Outputs
Indicators Metrics
Infrastructure opportunities.
• # facilities available • # of new facilities available • # of new infrastructure available
Approach Outcomes
Indicators • Metrics
Facilities and infrastructure enable effective service delivery
• # and % of people who report the facility has adequate parking (e.g. for cars, bicycles)
• # and % of people who report the facility is accessible by public transit, walking or biking
• # and % of people who report the facility is within a reasonable distance • # and % of people who report the facility is in a convenient location • # and % of people who report the facility is welcoming • # and % of people who report they feel safe accessing/using the facility • # of safety audits completed
59
Indicators • Metrics • # and % of safety concerns addressed • # of injuries/accidents reported • # of barriers to participation identified/removed • # and % of people who report the facility has adequate signage • # of accessibility improvements completed • # and % of people who report the facility allows for ease of mobility • # and % of people who report the facility is accessible to community members of
all abilities • # of facilities available • # of facility enhancements completed • Type of facility enhancements completed • # and % of people who report they are better able to access service/perform a
specific behaviour as a result of a new or enhanced facility • # and % of people who report they access service/perform a specific behaviour
more often as a result of a new or enhanced facility
Facilities and infrastructure are fit for the purpose for which they are used
• # and % of people who report the facility has appropriate equipment to meet the needs of those who use it
• # and % of people who report the facility fits the purpose for which it is used • # and % of facilities that are in good condition • # and % of people who report the quality of the facility and/or equipment is good • # and % of people who report the facility is well maintained • # and % of facilities that comply with/meet service standards • # and % of facilities with adequate IT capabilities/infrastructure • # and % of facilities that can be adapted to fit the needs of the community/a
group • # and % of facilities that have space for shared service/programming • # and % of facilities that can be used for a variety of different functions (i.e. they
are multi-purpose)
Facilities and infrastructure meet community needs
• # of different groups (e.g. service providers, community groups) that use the facility
• # and % of people who report the facility is inclusive of all people in the community (i.e. ages, abilities, income levels, cultural backgrounds, interests)
• # of community members involved in decision-making related to the facility and its use
• # and % of community members who feel a sense of ownership for the facility • # and % of people who report available facilities address/meet the needs and
interest of the local community • # and % of people who report there is a facility/place in their community where
they can access a specific service/perform a specific behaviour • # and % of people who are satisfied with the facility
Facilities and infrastructure are economically sustainable and affordable
• Amount of funding made available to enhance/maintain/build the facility • Annual cost of operations and management • Annual savings from energy efficiencies • Annual capital costs • Annual utility costs • Annual facility maintenance costs • Annual facility revenue • # and % of people who report accessing the facility is affordable
Facilities and infrastructure are available at times of demand and are well utilized
• # of hours the facility is open • # of unique people who visit/use the facility • # of visits to the facility
60
Indicators • Metrics
Facilities and infrastructure are environmentally sustainable
• # of trees planted • # of greening space projects completed • # of energy efficiency enhancements completed • Amount of energy consumed by the facility • Amount of resources (e.g. water) consumed by the facility • Amount of energy produced by the facility • Amount of energy saved in the facility • Amount of waste produced by the facility • Amount of waste recycled or reused
IMPACT OUTCOMES
Indicator (How do we know?)
Metric
Sustainable food solutions are developed.
# of individuals who decreased the number of times they accessed emergency food sources # of individuals who have more or different options to purchase food # of individuals who have (improved) access to healthy food
MUST REPORT ON OUTCOME REGARDLESS OF APPROACH
• # of new opportunities to develop sustainable food solutions • # of new sustainable food solutions developed
OUTCOME: Families experiencing poverty have enhanced access to basic needs services in their neighbourhoods.
APPROACH: Public Awareness
Description: To inform, influence, or engage target audiences (children, youth, families, and stakeholders) about a particular message or issue to enhance knowledge and/or encourage behaviour change.
Approach Outputs
Indicators Metrics
Exposure & Tools
• # of individuals who were engaged through the campaign • # of shares, re-tweets, reposts, likes • # of visitors to the site • # of flyers, brochures, pamphlets distributed • # of print media • # of outreach activities
61
Indicators Metrics • # of tools developed to assist individuals to increase their understanding of
poverty and its impact on the community
Approach Outcomes
Indicators • Metrics
Increased awareness of the issue/message
• # and % of individuals who have an increased awareness of basic needs services.
• # and % of individuals who know where to go to get more information about basic needs services.
• # and % of individuals who shared information about basic needs services. • # and % of individuals who seek further information about basic needs services.
Increased knowledge of the issue/message
• # and % of individuals who have an increased understanding of basic needs services.
• # and % of individuals who understand the importance of addressing basic needs services.
• # and % of individuals who understand the consequences of not addressing basic needs services.
• # of individuals who understand how to address the need for basic needs services.
Positive change in attitude toward
• # and % of individuals who changed their attitude towards the need for basic needs services.
• # of individuals who support addressing basic needs services.
Increased self-efficacy to change behaviour
• # and % of individuals who want to/are willing to change their behaviour to address basic needs services.
• # and % of individuals who have the information/resources they need to address basic needs services.
Increased intention to change behaviour
• # and % of individuals who intend to change their behaviour to address basic needs services.
Positive change in behaviour
• # and % of individuals who change their behaviour to address the need for basic needs services.
Maintenance of the changed/adopted behaviour
• # and % of individuals who have maintained their behaviour related to addressing the need for basic needs services.
• # and % of individuals who encouraged someone else to change their behaviour to the need for basic needs services.
APPROACH: Research and Advocacy
Description: To support and encourage the generation of new knowledge and evidence-informed decisions that help guide or influence decisions that support CYN initiatives and improve outcomes.
Approach Outputs
Indicators Metrics
62
Indicators Metrics
Development or capture of knowledge related to a specific issue
(Knowledge Generation, Capture, Synthesis)
• # of pilot/demonstration projects implemented to test an idea/model • # of research projects implemented • # of knowledge products prepared (e.g. white paper, research paper/report,
case study, learning brief, videos) • # of best practices identified • # of lessons learned • Types of lessons learned • # of policy briefs/documents created
Dissemination of knowledge related to a specific issue
(Knowledge Sharing)
• # of communications disseminated • # of educational briefings shared • # of education sessions held or presented at (e.g. forums, meetings, workshops,
trainings, presentations, seminars, events) • # of publications • # of website visits • # of downloads of a knowledge product • # of best practices shared • # of lessons learned being shared • # of tools created to support application/use of knowledge or evidence (e.g.
implementation guide, manual, handbook, aid, toolkit)
Approach Outcomes
Indicators • Metrics
Increased awareness of a specific issue
• # and % of individuals who have an increased awareness of basic needs services.
• # and % of individuals who know where to go to get more information about basic needs services.
• # and % of individuals who shared information about basic needs services. • # and % of individuals who seek further information about basic needs services.
Increased understanding of a specific issue
• # and % of individuals who have an increased understanding of basic needs services.
• # and % of individuals who understand the importance of addressing basic needs services.
• # and % of individuals who understand the consequences of not addressing basic needs services.
• # of individuals who understand how to address basic needs services. Change in attitudes, beliefs, and values about a specific issue
(Persuasion)
• # and % of individuals who changed their attitude towards basic needs services.
Increased will and support for a specific issue
(Decision)
• # of individuals who support addressing basic needs services. • # and % of individuals who align their actions, support, and or resources around
basic needs services.
Increased capacity to apply knowledge about/address a specific issue
• # and % of individuals who know what actions to take to address basic needs services.
• # and % of individuals who have the information/knowledge they need to address basic needs services.
• # and % of individuals who feel confident they could take action to address basic needs services.
63
Indicators • Metrics
Implementation of evidence-based policy and practice
(Knowledge Application, Implementation)
• # of new policies or practices implemented related to addressing basic needs services.
• # of existing policies or practices that are revised related to addressing basic needs services.
• $ allocated to address basic needs services. • # of projects/models adapted to a new setting or scaled up that address basic
needs services.
Positive changes for individuals or social/ physical conditions
(Confirmation)
• # and % of individuals who change their behaviour to address basic needs services.
• # and % of individuals who have maintained their behaviour related to addressing basic needs services.
• # and % of individuals who encouraged someone else to change their behaviour to address basic needs services.
• # and % of individuals with lived experience who were positively impacted because of the actions taken to address basic needs services.
APPROACH: Education, skill development, and capacity building
Description: To strengthen individual's knowledge or understanding of a particular topic, increase an individual’s skills and abilities and increase an individual’s capacity or competency through deliberate, organized, and sustained efforts.
Approach Outputs
Indicators Metrics Provision of education, skill development, and capacity building opportunities
• # of workshops • # of trainings • # of courses • # of networking events
Approach Outcomes
Indicators • Metrics
Positive reaction to the learning experience. (Engagement, Relevance, Satisfaction)
• # and % of individuals who considered the learning experience useful. • # and % of individuals who considered the learning experience to be relevant. • # and % of individuals who thought the learning experience was effective. • # and % of individuals who considered the learning experience to be practical. • # and % of individuals who were satisfied with the learning experience. • # and % of individuals who would recommend the learning experience to others.
Increased knowledge, skills, and capacity as a result of the learning experience. (Knowledge, Skills, and Attitudes)
• # and % of individuals who had increased knowledge of basic needs services. • # and % of individuals who had a change in attitude about basic needs services. • # and % of individuals who had an increase in skills in addressing basic needs
services. • # and % of individuals who had an increase in capacity (ability) to address basic
64
Indicators • Metrics needs services.
Intent to apply the knowledge and change behaviour as a result of the learning experience. (Confidence, Commitment, Self-efficacy)
• # and % of individuals who believe they can apply the knowledge and skills they learned to address basic needs services.
• # and % of individuals who feel confident about applying the knowledge and skills they learned to address basic needs services.
• # and % of individuals who are committed to applying the knowledge and skills they learned to address basic needs services.
• # and % of individuals who understand how to apply the knowledge and skills they learned to address basic needs services.
• # and % of individuals who report they will be able to use the knowledge and skills they learned to address basic needs services.
• # and % of individuals who intend to apply the knowledge and skills they have learned to address basic needs services.
Application and uptake of the knowledge and skills developed during the learning experience. (application, transfer)
• # and % of individuals who apply the knowledge and skills they have learned to address basic needs services.
• # and % of individuals who transferred their knowledge and skills to another person to increase their understanding of basic needs services.
Positive results due to knowledge and skills application. (Individual, Organizational)
• # and % of individuals who participated in the learning experience who were positively impacted because of the actions taken to address basic needs services.
• # and % of individuals with lived experience who were positively impacted because of the actions taken to address basic needs services.
APPROACH: Service Delivery
Description: To develop and deliver organizational and system-wide user-focused services and resources.
Approach Outputs
Indicators Metrics
Service provision opportunities.
• # of available service sites • Service hours of operation • # of new/existing services or programs available • # of new/existing resources available
Approach Outcomes
Indicators • Metrics
Services and resources are available
• # and % of individuals who report they have access to services they need related to basic needs services.
• # and % of individuals who report they have access to resources they need related to basic needs services.
• # and % of individuals who felt informed about services available to them related to basic needs services.
65
Indicators • Metrics
Services and resources are accessible
• # and % of individuals who report the service/resource was easy to access • # and % of individuals who report they could access the service (site) within a
reasonable amount of travel time • # and % of individuals who report the services they need are available when
they need them • # and % of individuals who report the service provider was flexible
A positive service environment and culture exists
• # and % of individuals who report the service provider was non-judgemental • # and % of individuals who report the service they received was culturally
sensitive/appropriate • # and % of individuals who report the service provider was respectful • # and % of individuals who report the service provider was caring • # and % of individuals who report the service provider was professional • # and % of individuals who report the service environment was clean • # and % of individuals who report the service environment was welcoming • # and % of individuals who report they felt safe/comfortable accessing the
service • # and % of service providers that use standardized tools (e.g. screening,
assessment, processes) • # and % of service providers that use a shared information system • # and % of service providers with defined/agreed upon service standards or
benchmarks
Service providers are knowledgeable, competent, and skilled
• # and % of individuals who report the service provider was knowledgeable • # and % of individuals who received appropriate referrals to services • # of referrals provided to services/resources • # and % of service providers who report they understand the needs of those
who access their service • # and % of service providers who report they are able to address/meet the
needs of those who access their service • # and % of service providers who report they have the resources they need to
provide adequate service • # and % of staff trained in service competencies • # and % of service providers who report they coordinate/collaborate with other
service providers • # and % of individuals who felt the service provider communicated clearly
Exceptional service is provided
• # and % of individuals who report the service met their needs • # and % of individuals who report the service provider was helpful • # and % of individuals who report the service was provided in a timely manner • # of times people report they had to share their story • # and % of individuals who felt they had input in the service • # and % of individuals who felt the service provider was reliable (e.g. followed
through, did what they said they would)
Quality service is experienced
• # and % of individuals who report they felt heard • # and % of individuals who report they were satisfied with the services • # and % of individuals who report they had a positive experience accessing the
service • # and % of individuals who would recommend the service • # and % of individuals who report they trust the service provider • # and % of individuals who report they value the service/resource
Services are used by the community
• # and % of individuals who accessed a specific service/program • # and % of individuals who used/received a specific resource • Amount of a specific resource distributed • Frequency of service/resource use
66
Indicators • Metrics
Services and resources provided have an impact
• # and % of individuals who experienced a positive outcome as a result of accessing the service
• # and % of individuals who experienced a positive outcome as a result of receiving the resource
• Type of positive outcome individual experienced as a result of accessing the service/receiving the resource
APPROACH: Facilities and Infrastructure
Description: To develop or improve an aspect of the physical or built environment.
Approach Outputs
Indicators Metrics
Infrastructure opportunities.
• # facilities available • # of new facilities available • # of new infrastructure available
Approach Outcomes
Indicators • Metrics
Facilities and infrastructure enable effective service delivery
• # and % of people who report the facility has adequate parking (e.g. for cars, bicycles)
• # and % of people who report the facility is accessible by public transit, walking or biking
• # and % of people who report the facility is within a reasonable distance • # and % of people who report the facility is in a convenient location • # and % of people who report the facility is welcoming • # and % of people who report they feel safe accessing/using the facility • # of safety audits completed • # and % of safety concerns addressed • # of injuries/accidents reported • # of barriers to participation identified/removed • # and % of people who report the facility has adequate signage • # of accessibility improvements completed • # and % of people who report the facility allows for ease of mobility • # and % of people who report the facility is accessible to community members of
all abilities • # of facilities available • # of facility enhancements completed • Type of facility enhancements completed • # and % of people who report they are better able to access service/perform a
specific behaviour as a result of a new or enhanced facility • # and % of people who report they access service/perform a specific behaviour
more often as a result of a new or enhanced facility Facilities and infrastructure are fit for the
• # and % of people who report the facility has appropriate equipment to meet the needs of those who use it
67
Indicators • Metrics purpose for which they are used
• # and % of people who report the facility fits the purpose for which it is used • # and % of facilities that are in good condition • # and % of people who report the quality of the facility and/or equipment is good • # and % of people who report the facility is well maintained • # and % of facilities that comply with/meet service standards • # and % of facilities with adequate IT capabilities/infrastructure • # and % of facilities that can be adapted to fit the needs of the community/a
group • # and % of facilities that have space for shared service/programming • # and % of facilities that can be used for a variety of different functions (i.e. they
are multi-purpose)
Facilities and infrastructure meet community needs
• # of different groups (e.g. service providers, community groups) that use the facility
• # and % of people who report the facility is inclusive of all people in the community (i.e. ages, abilities, income levels, cultural backgrounds, interests)
• # of community members involved in decision-making related to the facility and its use
• # and % of community members who feel a sense of ownership for the facility • # and % of people who report available facilities address/meet the needs and
interest of the local community • # and % of people who report there is a facility/place in their community where
they can access a specific service/perform a specific behaviour • # and % of people who are satisfied with the facility
Facilities and infrastructure are economically sustainable and affordable
• Amount of funding made available to enhance/maintain/build the facility • Annual cost of operations and management • Annual savings from energy efficiencies • Annual capital costs • Annual utility costs • Annual facility maintenance costs • Annual facility revenue • # and % of people who report accessing the facility is affordable
Facilities and infrastructure are available at times of demand and are well utilized
• # of hours the facility is open • # of unique people who visit/use the facility • # of visits to the facility
Facilities and infrastructure are environmentally sustainable
• # of trees planted • # of greening space projects completed • # of energy efficiency enhancements completed • Amount of energy consumed by the facility • Amount of resources (e.g. water) consumed by the facility • Amount of energy produced by the facility • Amount of energy saved in the facility • Amount of waste produced by the facility • Amount of waste recycled or reused
IMPACT OUTCOMES
Indicator (How do we know?)
Metric
Enhanced access to basic # of individuals who know where to go to get support to meet their basic needs
68
Indicator (How do we know?)
Metric
needs services is provided. # of individuals who have access to basic resources they need to care for themselves # of individuals who have access to stable housing # of individuals who have access to housing supports
MUST REPORT ON OUTCOME REGARDLESS OF APPROACH
• # of new enhanced basic needs services offered in neighbourhoods • # of families who have access to enhanced basic needs services in their neighbourhoods
OUTCOME: Community leaders have resources to initiate change.
APPROACH: Public Awareness
Description: To inform, influence, or engage target audiences (children, youth, families, and stakeholders) about a particular message or issue to enhance knowledge and/or encourage behaviour change.
Approach Outputs
Indicators Metrics
Exposure & Tools
• # of individuals who were engaged through the campaign • # of shares, re-tweets, reposts, likes • # of visitors to the site • # of flyers, brochures, pamphlets distributed • # of print media • # of outreach activities • # of tools developed to assist individuals to increase their understanding of
poverty and its impact on the community
Approach Outcomes
Indicators • Metrics
Increased awareness of the issue/message
• # and % of individuals who have an increased awareness of resources for community leaders to initiate change.
• # and % of individuals who know where to go to get more information about resources for community leaders to initiate change.
• # and % of individuals who shared information about resources for community leaders to initiate change.
• # and % of individuals who seek further information about resources for community leaders to initiate change.
Increased knowledge of the issue/message
• # and % of individuals who have an increased understanding of resources for community leaders to initiate change.
69
Indicators • Metrics • # and % of individuals who understand the importance of addressing resources
for community leaders to initiate change. • # and % of individuals who understand the consequences of not addressing
resources for community leaders to initiate change. • # of individuals who understand how to address resources for community
leaders to initiate change.
Positive change in attitude toward
• # and % of individuals who changed their attitude towards resources for community leaders to initiate change.
• # of individuals who support addressing resources for community leaders to initiate change.
Increased self-efficacy to change behaviour
• # and % of individuals who want to/are willing to change their behaviour to initiate change.
• # and % of individuals who have the information/resources they need to initiate change.
Increased intention to change behaviour • # and % of individuals who intend to change their behaviour to initiate change.
Positive change in behaviour • # and % of individuals who change their behaviour to initiate change.
Maintenance of the changed/adopted behaviour
• # and % of individuals who have maintained their behaviour related to initiating change.
• # and % of individuals who encouraged someone else to change their behaviour to initiate change.
APPROACH: Research and Advocacy
Description: To support and encourage the generation of new knowledge and evidence-informed decisions that help guide or influence decisions that support CYN initiatives and improve outcomes.
Approach Outputs
Indicators Metrics
Development or capture of knowledge related to a specific issue
(Knowledge Generation, Capture, Synthesis)
• # of pilot/demonstration projects implemented to test an idea/model • # of research projects implemented • # of knowledge products prepared (e.g. white paper, research paper/report,
case study, learning brief, videos) • # of best practices identified • # of lessons learned • Types of lessons learned • # of policy briefs/documents created
Dissemination of knowledge related to a specific issue
(Knowledge Sharing)
• # of communications disseminated • # of educational briefings shared • # of education sessions held or presented at (e.g. forums, meetings, workshops,
trainings, presentations, seminars, events) • # of publications • # of website visits • # of downloads of a knowledge product
70
Indicators Metrics • # of best practices shared • # of lessons learned being shared • # of tools created to support application/use of knowledge or evidence (e.g.
implementation guide, manual, handbook, aid, toolkit)
Approach Outcomes
Indicators • Metrics
Increased awareness of a specific issue
• # and % of individuals who have an increased awareness of resources for community leaders to initiate change.
• # and % of individuals who know where to go to get more information about resources for community leaders to initiate change.
• # and % of individuals who shared information about resources for community leaders to initiate change.
• # and % of individuals who seek further information about resources for community leaders to initiate change.
Increased understanding of a specific issue
• # and % of individuals who have an increased understanding of resources for community leaders to initiate change.
• # and % of individuals who understand the importance of addressing resources for community leaders to initiate change.
• # and % of individuals who understand the consequences of not addressing resources for community leaders to initiate change.
• # of individuals who understand how to access resources to initiate change. Change in attitudes, beliefs, and values about a specific issue
(Persuasion)
• # and % of individuals who changed their attitude towards initiating change.
Increased will and support for a specific issue
(Decision)
• # of individuals who support community leaders to initiate change. • # and % of individuals who align their actions, support, and or resources
supporting community leaders to initiate change.
Increased capacity to apply knowledge about/address a specific issue
• # and % of individuals who know what actions to take to initiate change. • # and % of individuals who have the information/knowledge they need to initiate
change. • # and % of individuals who feel confident they could take action to initiate
change.
Implementation of evidence-based policy and practice
(Knowledge Application, Implementation)
• # of new policies or practices implemented related to assisting community leaders to initiate change.
• # of existing policies or practices that are revised related to assisting community leaders to initiate change.
• $ allocated to provide resources to community leaders to initiate change. • # of projects/models adapted to a new setting or scaled up that provide
community leaders with the resources to initiate change.
Positive changes for individuals or social/ physical conditions
(Confirmation)
• # and % of individuals who change their behaviour to assist community leaders to initiate change.
• # and % of individuals who have maintained their behaviour related to initiating change.
• # and % of individuals who encouraged someone else to change their behaviour to initiate change.
71
Indicators • Metrics • # and % of individuals with lived experience who were positively impacted
because of the actions taken to assist community leaders to initiate change.
APPROACH: Education, skill development, and capacity building
Description: To strengthen individual's knowledge or understanding of a particular topic, increase an individual’s skills and abilities and increase an individual’s capacity or competency through deliberate, organized, and sustained efforts.
Approach Outputs
Indicators Metrics Provision of education, skill development, and capacity building opportunities
• # of workshops • # of trainings • # of courses • # of networking events
Approach Outcomes
Indicators • Metrics
Positive reaction to the learning experience. (Engagement, Relevance, Satisfaction)
• # and % of individuals who considered the learning experience useful. • # and % of individuals who considered the learning experience to be relevant. • # and % of individuals who thought the learning experience was effective. • # and % of individuals who considered the learning experience to be practical. • # and % of individuals who were satisfied with the learning experience. • # and % of individuals who would recommend the learning experience to others.
Increased knowledge, skills, and capacity as a result of the learning experience. (Knowledge, Skills, and Attitudes)
• # and % of individuals who had increased knowledge of resources for community leaders to initiate change.
• # and % of individuals who had a change in attitude about initiating change. • # and % of individuals who had an increase in skills in initiating change. • # and % of individuals who had an increase in capacity (ability) to initiate
change.
Intent to apply the knowledge and change behaviour as a result of the learning experience. (Confidence, Commitment, Self-efficacy)
• # and % of individuals who believe they can apply the knowledge and skills they learned to initiate change.
• # and % of individuals who feel confident about applying the knowledge and skills they learned to initiate change.
• # and % of individuals who are committed to applying the knowledge and skills they learned to initiate change.
• # and % of individuals who understand how to apply the knowledge and skills they learned to initiate change.
• # and % of individuals who report they will be able to use the knowledge and skills they learned to initiate change.
• # and % of individuals who intend to apply the knowledge and skills they have learned to initiate change.
72
Indicators • Metrics Application and uptake of the knowledge and skills developed during the learning experience. (application, transfer)
• # and % of individuals who apply the knowledge and skills they have learned to initiate change.
• # and % of individuals who transferred their knowledge and skills to another person to increase their understanding of how to initiate change.
Positive results due to knowledge and skills application. (Individual, Organizational)
• # and % of individuals who participated in the learning experience who were positively impacted because of the actions taken to initiate change.
• # and % of individuals with lived experience who were positively impacted because of the actions taken to initiate change.
APPROACH: Service Delivery
Description: To develop and deliver organizational and system-wide user-focused services and resources.
Approach Outputs
Indicators Metrics
Service provision opportunities.
• # of available service sites • Service hours of operation • # of new/existing services or programs available • # of new/existing resources available
Approach Outcomes
Indicators • Metrics
Services and resources are available
• # and % of individuals who report they have access to services they need related to initiate change.
• # and % of individuals who report they have access to resources they need to initiate change.
• # and % of individuals who felt informed about services available to them to initiate change.
Services and resources are accessible
• # and % of individuals who report the service/resource was easy to access • # and % of individuals who report they could access the service (site) within a
reasonable amount of travel time • # and % of individuals who report the services they need are available when
they need them • # and % of individuals who report the service provider was flexible
A positive service environment and culture exists
• # and % of individuals who report the service provider was non-judgemental • # and % of individuals who report the service they received was culturally
sensitive/appropriate • # and % of individuals who report the service provider was respectful • # and % of individuals who report the service provider was caring • # and % of individuals who report the service provider was professional • # and % of individuals who report the service environment was clean
73
Indicators • Metrics • # and % of individuals who report the service environment was welcoming • # and % of individuals who report they felt safe/comfortable accessing the
service • # and % of service providers that use standardized tools (e.g. screening,
assessment, processes) • # and % of service providers that use a shared information system • # and % of service providers with defined/agreed upon service standards or
benchmarks
Service providers are knowledgeable, competent, and skilled
• # and % of individuals who report the service provider was knowledgeable • # and % of individuals who received appropriate referrals to services • # of referrals provided to services/resources • # and % of service providers who report they understand the needs of those
who access their service • # and % of service providers who report they are able to address/meet the
needs of those who access their service • # and % of service providers who report they have the resources they need to
provide adequate service • # and % of staff trained in service competencies • # and % of service providers who report they coordinate/collaborate with other
service providers • # and % of individuals who felt the service provider communicated clearly
Exceptional service is provided
• # and % of individuals who report the service met their needs • # and % of individuals who report the service provider was helpful • # and % of individuals who report the service was provided in a timely manner • # of times people report they had to share their story • # and % of individuals who felt they had input in the service • # and % of individuals who felt the service provider was reliable (e.g. followed
through, did what they said they would)
Quality service is experienced
• # and % of individuals who report they felt heard • # and % of individuals who report they were satisfied with the services • # and % of individuals who report they had a positive experience accessing the
service • # and % of individuals who would recommend the service • # and % of individuals who report they trust the service provider • # and % of individuals who report they value the service/resource
Services are used by the community
• # and % of individuals who accessed a specific service/program • # and % of individuals who used/received a specific resource • Amount of a specific resource distributed • Frequency of service/resource use
Services and resources provided have an impact
• # and % of individuals who experienced a positive outcome as a result of accessing the service
• # and % of individuals who experienced a positive outcome as a result of receiving the resource
• Type of positive outcome individual experienced as a result of accessing the service/receiving the resource
APPROACH: Facilities and Infrastructure
Description: To develop or improve an aspect of the physical or built environment.
74
Approach Outputs
Indicators Metrics
Infrastructure opportunities.
• # facilities available • # of new facilities available • # of new infrastructure available
Approach Outcomes
Indicators • Metrics
Facilities and infrastructure enable effective service delivery
• # and % of people who report the facility has adequate parking (e.g. for cars, bicycles)
• # and % of people who report the facility is accessible by public transit, walking or biking
• # and % of people who report the facility is within a reasonable distance • # and % of people who report the facility is in a convenient location • # and % of people who report the facility is welcoming • # and % of people who report they feel safe accessing/using the facility • # of safety audits completed • # and % of safety concerns addressed • # of injuries/accidents reported • # of barriers to participation identified/removed • # and % of people who report the facility has adequate signage • # of accessibility improvements completed • # and % of people who report the facility allows for ease of mobility • # and % of people who report the facility is accessible to community members of
all abilities • # of facilities available • # of facility enhancements completed • Type of facility enhancements completed • # and % of people who report they are better able to access service/perform a
specific behaviour as a result of a new or enhanced facility • # and % of people who report they access service/perform a specific behaviour
more often as a result of a new or enhanced facility
Facilities and infrastructure are fit for the purpose for which they are used
• # and % of people who report the facility has appropriate equipment to meet the needs of those who use it
• # and % of people who report the facility fits the purpose for which it is used • # and % of facilities that are in good condition • # and % of people who report the quality of the facility and/or equipment is good • # and % of people who report the facility is well maintained • # and % of facilities that comply with/meet service standards • # and % of facilities with adequate IT capabilities/infrastructure • # and % of facilities that can be adapted to fit the needs of the community/a
group • # and % of facilities that have space for shared service/programming • # and % of facilities that can be used for a variety of different functions (i.e. they
are multi-purpose) Facilities and • # of different groups (e.g. service providers, community groups) that use the
75
Indicators • Metrics infrastructure meet community needs
facility • # and % of people who report the facility is inclusive of all people in the
community (i.e. ages, abilities, income levels, cultural backgrounds, interests) • # of community members involved in decision-making related to the facility and
its use • # and % of community members who feel a sense of ownership for the facility • # and % of people who report available facilities address/meet the needs and
interest of the local community • # and % of people who report there is a facility/place in their community where
they can access a specific service/perform a specific behaviour • # and % of people who are satisfied with the facility
Facilities and infrastructure are economically sustainable and affordable
• Amount of funding made available to enhance/maintain/build the facility • Annual cost of operations and management • Annual savings from energy efficiencies • Annual capital costs • Annual utility costs • Annual facility maintenance costs • Annual facility revenue • # and % of people who report accessing the facility is affordable
Facilities and infrastructure are available at times of demand and are well utilized
• # of hours the facility is open • # of unique people who visit/use the facility • # of visits to the facility
Facilities and infrastructure are environmentally sustainable
• # of trees planted • # of greening space projects completed • # of energy efficiency enhancements completed • Amount of energy consumed by the facility • Amount of resources (e.g. water) consumed by the facility • Amount of energy produced by the facility • Amount of energy saved in the facility • Amount of waste produced by the facility • Amount of waste recycled or reused
IMPACT OUTCOMES
Indicator (How do we know?)
Metric
Foundational infrastructure is prepared to create change
# of best practice reviews published # of advocacy efforts to address poverty # of policy changes proposed/implemented # of individuals who report improved coordination between community groups in response to poverty challenges
MUST REPORT ON OUTCOME REGARDLESS OF APPROACH
• # of community leaders who have the resources to initiate change