… what did delaware do? ensuring representative sample for family survey…
TRANSCRIPT
![Page 1: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/1.jpg)
… what did Delaware do?
Ensuring representative sample for Family Survey….
![Page 2: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/2.jpg)
2
The Basics
Already had existing Family Survey in place
OPEC (Ongoing Program Evaluation Committee) provided guidance on survey creation and modifications
Updated questions now include those that align with Federal Outcomes
![Page 3: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/3.jpg)
3
The Basics
Letters mailed to explain Family Survey
Postcard reminder sent
Up to four attempts made to survey families via phone
For those families with no phone– surveys are hand-delivered by Service Coordinators
![Page 4: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/4.jpg)
4
The Basics
Initially conducted through telephone survey. Starting this year, survey can be accessed by families through Survey Monkey (in English and Spanish), or may respond through telephone survey (surveyors made up to four attempts), or hand delivered by Service Coordinators
University of Delaware conducts survey and analyzes results
![Page 5: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/5.jpg)
5
The Basics
Unique Identifier
Allows for identification of primary household language to ensure appropriate survey version
Ensures no duplication of responses
Allows oversampling for demographic indicators
Allows for further data analysis
![Page 6: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/6.jpg)
6
The Basics
Survey includes families with:
children who are currently enrolled in Part C and have been enrolled for at least 6 months
and
children who were enrolled in Part C for at least 6 months and who have transitioned from Part C within the past 6 months
![Page 7: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/7.jpg)
7
The Basics
To achieve representative sample, matrix is used and we oversample the population How do we know when we have a representative sample? As
we fill the cells, we know if we have any areas where we need to concentrate our efforts….
Goal for each cell is 30% of eligible population
Cells are defined by geographic region (North/South) Ethnicity (African American/Caucasian/Other) Eliminated in 2008 Survey: length of time in program
(less than 18 months/more than 18 months)
![Page 8: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/8.jpg)
8
The Basics
Even though Sampling Matrix does not include gender, data is analyzed to ensure results are representative of the population we serve
Delaware did not report out gender as part of Indicator 4/Family Outcomes in FFY06 APR
![Page 9: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/9.jpg)
9
The Basics
Response rates for 2007: Initial sample size of 433 158 surveys completed 36.5% response rate
Response rate for 2008 Initial sample size of 556 189 surveys completed 34% response rate
![Page 10: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/10.jpg)
10
Sampling Matrix from 2008 Family Survey
Cell
NumberIn Cell
(a)
“Contact-able”
Families(b)
Goal for Cell(c)
Number of Completed Surveys in
Cell (d)
% of Completed
Surveys(d/a)
North, Caucasian 176 152 53 62 35.23%
North, African American 107 68 33 26 24.30%
North, Latino 34 21 12 9 26.47%
North, Other 35 31 13 16 45.71%
South, Caucasian 118 101 36 41 34.75%
South, African American 46 32 14 15 32.61%
South, Latino 39 23 14 20 51.28%
South, Other 1 1 -- 0 0.00%
Total 556 429 175 189
![Page 11: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/11.jpg)
11
Ensuring Statewide Race/Ethnicity Representation for 2008 Family Survey
2008 Results+ CDW
Program Rate Ethnic
Background Number Percent Caucasian 104 55.0% 53.2% African American 34 18.2% 28.0% Latino 24 12.7% 12.0% Asian 5 2.6% 2.8% Other 16 8.5% 4.0% Not identified 6 3.0% -- Total 189 100.0% 100.0%
+ as reported 08-08-08 CDW Program Rate = 618 data
![Page 12: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/12.jpg)
12
Ensuring Regional Race/Ethnicity Representation for 2008 Family Survey
Ethnic Background
2008 Results
North Surveys
Completed
CDW North Program
Rate
South Surveys
Completed
CDW South Program
Rate
Caucasian 54.87% 50.70% 53.95% 58.10%
African American 23.01% 30.40% 19.74% 23.10%
Latino 7.96% 9.50% 26.31% 16.90%
Other 14.16% 9.40% 0.00% 1.90%
CDW Program Rate = 618 data
![Page 13: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/13.jpg)
13
Representation by Region for 2008 Family Survey
Frequency PercentCDW
Program Rate
North 115 60.8% 62.8%
South 68 36.0% 37.2%
Missing 6 3.2% ---
CDW Program Rate = 618 data
![Page 14: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/14.jpg)
14
Above and Beyond APR Reporting
Delaware also analyzes data by:GenderLength of time in program for questions
regarding transition planning (State focus) removed in 2008 as variable in sampling
because cell sampling size became too small and analysis by length of time in program showed no difference except in questions on transition planning
![Page 15: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/15.jpg)
15
So Delaware asks:
What are the minimum requirements in ensuring representativeness?
![Page 16: … what did Delaware do? Ensuring representative sample for Family Survey…](https://reader035.vdocuments.site/reader035/viewer/2022070400/56649f145503460f94c2861f/html5/thumbnails/16.jpg)
16
2007 Family Survey Report can be viewed on Delaware’s Birth to Three website:
http://www.dhss.delaware.gov/dhss/dms/epqc/birth3/directry.html
2008 Family Survey Report will become available in the fall
Delaware’s Contacts:
Rosanne Griff-Cabelli, Part C [email protected]
Susan Campbell, Asst Part C [email protected]