eco family experiences and outcomes measurement system lauren barton, eco at sri siobhan colgan, eco...
TRANSCRIPT
![Page 1: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/1.jpg)
ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM
Lauren Barton, ECO at SRI
Siobhan Colgan, ECO at FPG
Kathy Hebbeler, ECO at SRI
Melissa Raspa, ECO at RTI
Alice Ridgway, Connecticut
Chelsea Guillen, Il l inois
Lisa Backer, Minnesota
Robin Nelson, Texas
![Page 2: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/2.jpg)
GOALS FOR TODAY
• Introduce the Family Experiences and Outcomes Measurement System
• Hear feedback from states who helped us refine the framework and piloted the self-assessment
• Discuss applications and uses with participants
![Page 3: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/3.jpg)
HAVE YOU BEEN WONDERING…
• How well do we measure the experiences of families in our program or state?
• How can we interpret our family outcomes data?
• How do we know if we are heading in the right direction?
• How can we prioritize improvements to our family outcomes measurement system?
![Page 4: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/4.jpg)
Family Experiences and Outcomes Measurement System
INTRODUCING…
![Page 5: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/5.jpg)
PROCESS OF DEVELOPMENT
• Parallels the Child Outcomes Measurement Framework & Self-assessment
• ECO workgroup
• Partner state workgroup
• Connecticut• Illinois• Minnesota• Texas
• Your feedback!
![Page 6: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/6.jpg)
TWO CORE ASPECTS
Framework• Set of components and quality
indicators
• Provides the structure for the self-assessment
Self-assessment • Scale that provides criteria for levels of
implementation within each quality indicator
• Ratings are assigned based on level of implementation within each indicator
![Page 7: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/7.jpg)
PURPOSE OF THE FAMILY FRAMEWORK
• Provides a common language and organizing structure for discussing family outcomes and experiences
• Assist states in developing a measurement system that captures various aspects of family outcomes and experiences, such as
• benefits that families receive from program participation• family satisfaction with services• perceived helpfulness of the services• family involvement with the service delivery system
![Page 8: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/8.jpg)
FRAMEWORK
Components
• 7 key areas of a measurement system
Quality indicators
• 15 specific statements that further describe each of the components
• 1 to 5 quality indicators per component
Elements
• Various examples of what constitute quality at the indicator level
![Page 9: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/9.jpg)
FRAMEWORK COMPONENTS
![Page 10: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/10.jpg)
EXAMPLE COMPONENT: PURPOSEQuality Indicator: The state has articulated purpose(s) of the family experiences and outcomes measurement system
Elements: a. Stakeholders are involved in development of the purpose(s).b. Written statement addresses why data are being collected and how
data are being used. Statement specifies who will use the data and for what purposes.
c. Statement is easily accessible to local administrators, providers, families and general public.
d. Families receiving services are fully informed of purposes of collecting data on family experiences and outcomes.
e. Purpose includes meeting reporting requirements and providing ongoing information for data-based decision-making for program improvement.
f. Purpose includes examining multiple aspects of families’ experiences with the program and their outcomes (e.g., helpfulness of early intervention, family outcomes, family-centered services)
![Page 11: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/11.jpg)
SELF-ASSESSMENT
• Allows states to evaluate the quality of their family experiences and outcomes measurement system
• Assists states in setting priorities for improving their measurement system
• Provides information to assist states in advocating for resources for systems development
11
![Page 12: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/12.jpg)
SELF-ASSESSMENT PROCESS: QUESTIONS TO CONSIDER
• Who will participate in the assessment process?
• What constitutes your Family Experiences and Outcomes Measurement?
• What is the purpose of the self assessment for your program?
• Do you want to complete the entire measure or focus on one or two areas you are concerned about?
• What will happen with the results of your assessment?
![Page 13: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/13.jpg)
HOW DOES IT WORK?
• Each quality indicator has multiple elements
• Elements provide evidence to determine the extent of implementation
• Each element is rated as• NY = Not Yet• IP = In Process• IF = Fully Implemented• DK = Don’t know• NA = Not applicable (only where applicable)
• The quality indicator is given a rating based on the ratings of the elements
![Page 14: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/14.jpg)
QUALITY INDICATOR RATINGS
Implementation of ElementsQuality
Indicator Rating
None of the elements are yet in process 1
Some of the elements are in process 2All of the elements are in process 3At least one element is fully implemented and the rest are in process 4
Most of the elements are fully implemented and the rest are in process 5
Nearly all elements are fully implemented and the rest are in process 6
All elements are fully implemented 7
![Page 15: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/15.jpg)
SAMPLE RATING PAGEComponent
Indicator
Element
![Page 16: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/16.jpg)
HOW DID IT GO?
![Page 17: ECO FAMILY EXPERIENCES AND OUTCOMES MEASUREMENT SYSTEM Lauren Barton, ECO at SRI Siobhan Colgan, ECO at FPG Kathy Hebbeler, ECO at SRI Melissa Raspa, ECO](https://reader030.vdocuments.site/reader030/viewer/2022033100/56649f305503460f94c4a477/html5/thumbnails/17.jpg)
DISCUSSION QUESTIONS
• What uses can you see for the tool in your state or program?
• How can families be involved in the self-assessment process?
• What additional ECO resources might be useful?