research and evaluation center jeffrey a. butts john jay college of criminal justice city university...
TRANSCRIPT
Research and Evaluation Center
Jeffrey A. ButtsJohn Jay College of Criminal Justice
City University of New York
August 7, 2012
Evidence-Based Models for Court-Involved Youth
Research and Evaluation Center
WHAT IS EVIDENCE BASED PRACTICE?
The use of systematic decision-making processes or provision of services which have been shown, through available scientific evidence, to consistently improve measurable client outcomes. Instead of tradition, gut reaction or single observations as the basis for making decisions, EBP relies on data collected through experimental research and accounts for individual client characteristics and clinician (or program) expertise.
- University of Washington Evidence Based Practice Institute
2
Notice the creative contrast…
Research and Evaluation Center
WHERE CAN WE GO FOR HELP?
33
Colorado Department of Public Safety
George Mason University
Research and Evaluation Center
ADVANCES IN EBP FOR YOUTH JUSTICE
4
Research and Evaluation Center
ADVANCES IN EBP FOR YOUTH JUSTICE
5
Research and Evaluation Center
ADVANCES IN EBP FOR YOUTH JUSTICE
6
Research and Evaluation Center
ADVANCES IN EBP FOR YOUTH JUSTICE
7
Research and Evaluation Center
ADVANCES IN EBP FOR YOUTH JUSTICE
8
Research and Evaluation Center
ADVANCES IN EBP FOR YOUTH JUSTICE
9
Research and Evaluation Center
10
Research and Evaluation Center
11
Research and Evaluation Center
12
Research and Evaluation Center
13
Research and Evaluation Center
14
Research and Evaluation Center
15
Research and Evaluation Center
16
Research and Evaluation Center
17
Research and Evaluation Center
EVIDENCE IS PURCHASED, NOT SIMPLY DISCOVERED
Research is a competitive enterprise
There are limited funds
Researchers are not always disinterested
Funding of research can be (is?) political
Some program models are easier than others to evaluate properly
Marketing forces often overwhelm data
18
Research and Evaluation Center
SO NOT ALL PROGRAMS CAN BE EVALUATED…
WHAT OTHER OPTIONS ARE THERE?
19
Research and Evaluation Center
Georgetown University Center for Juvenile Justice Reform
http://cjjr.georgetown.edu/pdfs/ebp/ebppaper.pdf
SPEP developed by Mark Lipsey of Vanderbilt University
20
STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP)
Research and Evaluation Center
STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP)
Based on meta-analysis -- 600 studies of programs that reduce recidivism
SPEP assigns scores to a select core of program components based on how closely the components match programs with demonstrated effectiveness in prior research
Service Type Supplemental Services Treatment Amount (duration & contact hours) Treatment Quality Youth Risk Level
21
Research and Evaluation Center
22
Research and Evaluation Center
STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP)
Two purposes of the instrument: 1) Assess the effectiveness of programs that seek to reduce
recidivism
2) Identify the components of a program that need improvement
States already using SPEP to assess youth programs North Carolina Arizona Pennsylvania* Florida* Connecticut*
* participating in Georgetown’s Juvenile Justice System Improvement Project (JJSIP) that incorporates SPEP
23
Research and Evaluation Center
STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP)
The SPEP approach would allow us to ensure higher quality programs without spending so much on evaluation
Incorporating principles supported by SPEP would allow programs to deliver better services during implementation and the scaling up of program procedures rather than waiting for data collection and follow-up
Research dollars could be use more efficiently, focusing on a smaller set of critical questions and answering them with a higher degree of accuracy
Many important questions have not been answered or even asked yet…
24
Research and Evaluation Center
25
WHAT’S YOUR THEORY?
Risk Factor
s
Community disorder
Poverty
Family violence
School failure
Thrill seeking Cognitive defects
Unemployment
Lack of empathy DefiancePoor decision-
making
Poor nutrition
Hopelessness
GreedYouth Crim
e
Mental illness
Substance abuse
We Aren’t Even Close to Having All The Answers
Protective Factors
Family support
School successSecure housing
Stable employmentHealt
hPositive friends
Ethical framework Belonging Adult
guidanceSelf-efficacy
Community respectPhysical safetyFuture aspirations
Research and Evaluation Center
26
IF OUR GOAL IS EFFECTIVENESS…
When choosing interventions for youth in the justice system, we must be AGNOSTIC -- open to new facts
Advocating one intervention over another based on turf, convenience, bias or financial interests is simply wrong
Central goal of intervention is to ensure community safety by changing youth behavior -- NOT merely to deliver a particular type of service or to ensure the financial stability of providers
Research and Evaluation Center
27
Arrest?
Research and Evaluation Center
28
WHY IS THIS SO DIFFICULT?
We seem to hear mostly about mental health, substance abuse, and trauma?
Most troubling cases often involve MH, SA and Trauma
MH, SA, Trauma overlooked & under-diagnosed for years
The science related to these issues has improved
Interest group politics and public relations
Research and Evaluation Center
CONTACT INFORMATION
Jeffrey A. Butts, Ph.D.Director, Research & Evaluation Center
John Jay College of Criminal JusticeCity University of New York
http://about.me/jbutts