welcome to the jrsa webinar on issues in using administrative records
DESCRIPTION
Welcome to the JRSA Webinar on Issues in Using Administrative Records. For technical assistance: Send chat to JRSA Webinar or e-mail: [email protected] To submit a question for the presenter: Send chat to Stan Orchowsky. Issues in Using Administrative Records. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/1.jpg)
Welcome to the JRSA Webinar onIssues in Using Administrative Records
For technical assistance:Send chat to JRSA Webinar or e-mail: [email protected]
To submit a question for the presenter:Send chat to Stan Orchowsky
![Page 2: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/2.jpg)
Issues in Using Administrative Records
Justice Research and Statistics Association WebinarFebruary 19, 2013
Dennis P. CulhaneCo-Principal Investigator,
Actionable Intelligence for Social PolicyUniversity of Pennsylvania
![Page 3: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/3.jpg)
OverviewDefinition of Administrative DataSources for …Strategies for obtaining …Challenges to accessing…Data quality issues with …Legal issues with ...Analytic strategies for ...Implications of ...Publication/Dissemination issues with …Example UsesActionable Intelligence for Social Policy: IDS Resources
![Page 4: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/4.jpg)
Administrative recordsWhat are they?
Data routinely gathered for operational or business purposes by public or private agencies
Examples: Medicaid claims Vital statisticsSchool attendance and achievementLabor and wage data
![Page 5: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/5.jpg)
Common Sources for Justice Research:
Police incident reports (including geocodes)Police (arrests)Family court records; Juvenile Probation /
PlacementsCorrections (jail and prison)Labor and wage dataVital records (births/deaths)Child welfare (out of home placements) School attendance (truancy), achievement,
drop-out
![Page 6: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/6.jpg)
Strategies for accessing….Legal agreements (MOU’s or DEA’s) between data
sharing and data host agencies
Governing/Advisory Board Oversight
Partnership with research organizations (colleges/universities) with IRBs and which may be “covered entities”
Encryption as alternative to identified data
Develop political support as high up as possible
![Page 7: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/7.jpg)
Challenges to accessing….Legal barriers – agencies have legal responsibilities for
data stewardship
Political barriers – some agencies may not want to cooperate or share with one another (turf issues, fear of transparency)
Data barriers – staff availability and technical abilities; fear of “bad data” being discovered
Technical/scientific barriers – need qualified analysts to conduct the work – not as simple as it may seem.
![Page 8: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/8.jpg)
Data quality issues with….CoverageCompletenessAccuracyLinkage approaches (deterministic v
probabilistic)Data audit and validation checksChart reviewsChallenges with “charges” data in health
recordsKnow thy datasets…..
![Page 9: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/9.jpg)
Legal issues with…..HIPAA, FERPA and the Common RuleIdentified, Limited and Deidentified datasetsData storage and physical securityData destruction and certificationLegal agreements (MOUs and DEAs)Accommodations: on-site linkage and
analysis; agencies conduct the analysis and return results….
![Page 10: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/10.jpg)
Common Analytic Strategies that Leverage Utility…
Services utilization measures
Event history analysis
Time Series Analysis
Cost-Offset Analysis
![Page 11: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/11.jpg)
ImplicationsAdministrative data are the “language” of public agencies
– defines and measures their activities/practices
Agencies and public officials are sensitive to cost data and opportunities for efficiency and cost-savings
Beware of over-promising – easy to find high cost users (and significant cost-offsets), but they don’t generalize to all cases.
Need to show nuance – matching service supports and need, so as not to over-utilize and be inefficient
![Page 12: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/12.jpg)
Publication/Dissemination issuesPublic agencies will/should want opportunity to
preview results based on their data.
Good to include agency researchers or analysts as coauthors on reports and papers
Need to decide before project about auspices of research (academic or agency – affects dissemination rules)
Need to develop “Executive friendly” versions of results and publications.
![Page 13: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/13.jpg)
Questions
?
![Page 14: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/14.jpg)
Young Adult Outcomes Of Youth Exiting Dependent Or Delinquent Care In Los
Angeles County
Supported by the Conrad N. Hilton Foundation
An example use of Integrated Administrative Records
Dennis Culhane, PhD & Thomas Byrne Stephen Metraux, PhDSchool of Social Policy & Practice Department of Health Policy & Public Health University of PennsylvaniaUniversity of the Sciences in Philadelphia
Manuel Moreno, PhD & Halil Toros, PhD Research & Evaluation Services, Chief Executive Office-Service Integration Branch
Los Angeles County
![Page 15: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/15.jpg)
Analytic Approach
Study focuses on all youth who exited child welfare and/or juvenile probation systems between ages of 16 and 21 in LA County
Sample divided into three study groups: Juvenile Probation (JP) group Child Welfare (CW) group Crossover group
Assessed longitudinal outcomes in two four year periods: Years 1-4 following exit Years 5-8 following exit
![Page 16: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/16.jpg)
Exiters
Child Welfare
Health
Mental Health
JailProbation
Public Assistance
Substance Use Tx
Earnings
Sec. and Post Sec.
Edu.
Data Sources
![Page 17: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/17.jpg)
Outcomes By Domain
0
10
20
30
40
50
60
70
80
90
49 48
18 19
115
25
68
2822
17
4
66
82
37 39
47
11
Years 1-4 JP ExiterCW ExiterCrossover Youth
Outcome
% o
f Exi
ters
With
Ser
vice
Use
![Page 18: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/18.jpg)
Outcomes By Domain
0
10
20
30
40
50
60
70
45
33
2017
5 6
24
41
26
19
93
62
54
38
31
149
Years 5-8
JP ExiterCW ExiterCrossover Youth
% o
f Ex
iter
s W
ith
Serv
ice
Use
![Page 19: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/19.jpg)
Higher Education Outcomes
05
101520253035404550
29.7
0.3 0.5 0.7 0.2
45.5
0.2 0.6 1.6 0.4
39.1
JP Exiter
CW Exiter
Crossover Youth
% o
f Ex
iter
s
![Page 20: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/20.jpg)
Cost Across Multiple Domains
JP Exiter CW Exiter Crossover Youth$0
$10,000
$20,000
$30,000
$40,000
$50,000
$60,000
$70,000
$80,000
$15,985$12,532
$35,171Average Cumulative Cost of Services Use Across Domains in Years 1-4
Health
Mental Health
Public Welfare
Criminal Jus-tice
EarningsCum
ulat
ive
Cos
t
![Page 21: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/21.jpg)
Distribution of Service Costs
$0$20,000$40,000$60,000$80,000
$100,000$120,000$140,000$160,000$180,000
$1,297$6,343
$19,898
$85,245
Cumulative Cost of Services Use in Years 1-4 (JP Group)
DPHHealthMental HealthSocial ServicesCriminal JusticeEarnings
Cum
ulat
ive
Cos
t
![Page 22: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/22.jpg)
Implications For Policy & Research
Sizeable proportions of youth in all three study groups continue to make substantial demands upon public services systems upon reaching adulthood
Crossover youth (i.e. those involved in both child welfare and juvenile justice systems) Comprise a particularly vulnerable group of exiters. Warrant specific targeting for outreach and
intervention
![Page 23: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/23.jpg)
Implications For Policy & Research
Identify heavy services users and provide them with intensive services that facilitate better outcomes and generate net cost savings.
Top 25% of service users consumed about 75% of the services used by the study group at an average cost of over $70,000 per person.
Identifying youth in this quartile for housing, coordinated health and mental health services, and case management could support successful transitions to adulthood in a cost-effective manner .
![Page 24: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/24.jpg)
Actionable Intelligence for Social Policy: Promoting the future of integrated data systems
Network of integrated data systems (IDS).10 Sites: 4 States, 6 Large Cities / Counties
Best practices in IDS operations and use.
Establish new sites and develop existing ones.
Fund, execute, and show the value of IDS analyses.
![Page 25: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/25.jpg)
Network of Integrated Data Systems
ISP
![Page 26: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/26.jpg)
Example Multi-Site ProjectsAre there links between foster care and later
juvenile justice involvement?What practices are most important?
Do veterans released from incarceration use VA services to promote better outcomes?How can veterans be better connected?
Do assisted housing programs support better educational outcomes for children?What are the key mediators?
![Page 27: Welcome to the JRSA Webinar on Issues in Using Administrative Records](https://reader036.vdocuments.site/reader036/viewer/2022062323/56816567550346895dd7f30a/html5/thumbnails/27.jpg)
Contact InformationActionable Intelligence for Social Policyhttp://www.aisp.upenn.edu
Dennis Culhane, PhDEmail: [email protected]: 215 – 746 – 3245