quotesfrom’evaluationsfrom’ providerswho’have’been’through’...
TRANSCRIPT
![Page 1: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/1.jpg)
Quotes from evaluations from providers who have been through the SPEP interview process
“This was a great experience. It felt like the focus was on helping kids and not being under fire. Great information sharing. Thanks.”
![Page 2: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/2.jpg)
Quotes from evaluations from providers who have been through the SPEP interview process
“This provided an exciting opportunity to share our program and gather knowledge on how to enhance our practices and better the lives of our juveniles and their families”
![Page 3: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/3.jpg)
Quotes from evaluations from providers who have been through the SPEP interview process
“I felt it was very thorough and insightful.”
![Page 4: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/4.jpg)
Quotes from evaluations from providers who have been through the SPEP interview process
“As a provider, it was beneficial to have a team validate the program, analyze our data and show us what we are doing well and what we can improve on.”
![Page 5: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/5.jpg)
Quotes from evaluations from providers who have been through the SPEP interview process
“Very thorough with explaining SPEP and walking us through the process”
![Page 6: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/6.jpg)
The EPISCenter represents a collaborative partnership between the Pennsylvania Commission on Crime and Delinquency (PCCD), and the Prevention Research Center, College of Health and Human Development, Penn State University. The EPISCenter is funded by PCCD and the Department of Public Welfare. This resource was developed by the EPISCenter through PCCD grant VP-ST-24368.
SPEP in PA: A Year in Review August 15, 2014 Jeff Gregro, Berks County Juvenile Probation Heather Perry, EPISCenter
![Page 7: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/7.jpg)
Overview
� Overall Approach
� Lessons Learned
� Emerging Themes
� Process for Performance Improvement
� Questions & Answers
![Page 8: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/8.jpg)
Overall Approach
![Page 9: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/9.jpg)
Overall Approach
� Building a Learning Community
� Communication Strategies
� Pilot process
� Resource Development
![Page 10: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/10.jpg)
Building a Learning Community
![Page 11: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/11.jpg)
Communication Strategies
![Page 12: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/12.jpg)
Communication Strategies
Service Type
Provider Delivery
SPEP Assessment
Probation Usage
![Page 13: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/13.jpg)
Communication Strategies
SPEP Assessment
Understanding SPEP (score)
Improvement Implications
Improvement Plan
Plan Implementation Service
Type
Provider Delivery
SPEP Assessment
Probation Usage
![Page 14: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/14.jpg)
Communication Strategies
![Page 15: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/15.jpg)
Communication Strategies
![Page 16: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/16.jpg)
Communication Strategies
![Page 17: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/17.jpg)
Pilot & Evaluation Processes What we’re finding
![Page 18: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/18.jpg)
Pilot & Evaluation Processes What answers or resources are needed?
![Page 19: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/19.jpg)
Pilot & Evaluation Processes What’s working?
![Page 20: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/20.jpg)
1 2 3 4 5 6
Meaningfully increased my knowledge and understanding of SPEP
Was presented in a way that was easy to understand
Provided me with the right level of information
Provided practical steps my agency/county can prepare for SPEP
Clearly described the SPEP process, including probation/provider roles
Key stakeholders groups were represented in today's audience
There was plenty of time for questions & discussion
Strongly Disagree Strongly Agree
Kickoff Meetings
![Page 21: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/21.jpg)
1 2 3 4 5 6
Scheduled at a convenient time
Interview lasted as long as planned
Interviewer used positive tone
The SPEP interview felt like an audit (reverse)
Provider was provided helpful materials to prepare
Questions were clear
Interivewers listened well
Strongly Disagree Strongly Agree
SPEP Interviews
![Page 22: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/22.jpg)
1 2 3 4 5 6
Meaningfully increased my knowledge and understanding of SPEP
Was presented in a way that was easy to understand
Provided me with the right level of information
Provided practical steps my agency/county can prepare for SPEP
Clearly described the SPEP process, including probation/provider roles
There was plenty of time for questions & discussion
Strongly Disagree Strongly Agree
SPEP Webinars
![Page 23: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/23.jpg)
SPEP Resources
![Page 24: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/24.jpg)
Resource Development in PA
![Page 25: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/25.jpg)
Resource Development
![Page 26: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/26.jpg)
Resource Development-‐more to come….
� SPEP Guide or Manual for JPO, Providers and Stakeholders
� Benchcards/fact sheets
� Service Index Summaries
� Documents/training videos/Pre-visit Checklists specific to Residential Facilities
� EBP Service Type Fact Sheets
� Probation & Provider Partnership evaluations
![Page 27: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/27.jpg)
Lessons Learned
![Page 28: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/28.jpg)
What we’re noticing in the Jield � SPEP isn’t broad enough to capture every
service � There is a need for D&A SPEPs � No simple way to do SPEP � Preliminary anxiety leading up to SPEP-and the
feeling of it being a positive experience afterwards
� The message has been consistent among everyone-this is a partnership and Performance Improvement is the main purpose of SPEP
![Page 29: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/29.jpg)
Residential vs. Community Based
� Residential Facilities are pleasantly challenging-some SPEPs are a huge undertaking and it’s a matter of breaking the programs down (unpacking) in order to understand the complexities
� Additional assistance is available to help Providers prepare for SPEP-suited to their needs-before/during /after
� Challenges of data collection
![Page 30: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/30.jpg)
A SPEPable service:
� Must be considered a therapeutic service-those oriented mainly toward facilitating constructive internalized and sustained changes in behavior
� Sufficient research evidence of effectiveness
Therapeutic Services
Restorative
Restitution/Community Service
Mediation
Counseling
Individual
Mentoring
Family
Family Crisis
Group
Mixed
Skill Building
Behavior Management
Cognitive Behavioral erapy
Social Skills Training
Challenge
Remedial Academic Program
Job Related Training
![Page 31: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/31.jpg)
A SCOREable service:
� Must be SPEPable � The cohort includes 10 or more juveniles � Quality of service delivery completed within
the last year � Dosage information is available on ALL
juveniles in cohort � Valid risk scores available for at least 80% of
the cohort
![Page 32: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/32.jpg)
Emerging Themes
![Page 33: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/33.jpg)
� 28 fully scored services; avg. score was 60, range of 37-100
� Most services scored well on staff training and supervision
� Most services need to improve written protocols and response to drift
� Few services meet dosage and duration standards
29%
71%
% of Initial SPEP Scores over and under 50
< 50
=>50
Most services* score ≥ 50:
* important to consider selection bias of self-selected early adopters
![Page 34: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/34.jpg)
Limitations and Cautions…. o The data may not reflect the true state of services.
Caution should be used in drawing conclusions given the small amount of data we have.
o SPEP research base only differentiates scores at a cut point of 50. Implications unclear of scores between 50 and 100.
o Pilot phase has shown ongoing need for more tools and training.
o Narrow list of services relative to actual services provided (ie D&A, Case Management)
![Page 35: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/35.jpg)
Early BeneJits from the Pilot Phase
� Qualitative interviews lead JPOs better understanding what programs “really” offer (and for whom services are best suited)
� JPOs are now more routinely sending YLS risk score to providers (better service matching and treatment plans)
� Ongoing education of juvenile court system re: relationship of dosage and duration to youth/service outcomes
![Page 36: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/36.jpg)
Early BeneJits from the Pilot Phase (cont.)
� Service providers are more aware of research supporting services
� Providers are proactively planning for SPEP and actively interested in Performance Improvement by utilizing website and asking questions
� Improved relations between probation and providers
![Page 37: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/37.jpg)
Process for Performance Improvement
![Page 38: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/38.jpg)
Process Improvement Plan
� Addresses the areas identified during the SPEP process, as prioritized by stakeholders
� Identifies the timeframe and method for improvements in accordance with the stakeholder capacities
� Identifies the needed technical assistance and support which may be necessary to implement improvements.
� Process for monitoring the progress and outcomes of the Program Improvement Plan.
![Page 39: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/39.jpg)
What should be included in the Performance Improvement Plan? � Basic program information
� Recommendations from SPEP Feedback Report
� Goal Statements
� Action Steps
� Person(s) Responsible
� Target Date of Completion/Date Completed
� Goals Progress Updates
� Metric for Measuring Performance Improvement
![Page 40: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/40.jpg)
Performance Improvement Plan
![Page 41: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/41.jpg)
Q&A
![Page 42: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/42.jpg)
Thank You!
� Next webinar: More information will be forthcoming
� Don’t forget to fill out the evaluation of this webinar (available in “web links” pod)
� EPISCenter website for additional resources: � www.episcenter.psu.edu/juvenile
![Page 43: Quotesfrom’evaluationsfrom’ providerswho’have’been’through’ the’SPEP’interview…episcenter.psu.edu/sites/default/files/Presentations/SPEP-Webinar-7-Slides.pdf ·](https://reader034.vdocuments.site/reader034/viewer/2022051921/600ed5f33592b40d63410b84/html5/thumbnails/43.jpg)
Contact Info
� Jeff Gregro Deputy Chief of Juvenile Probation – County of Berks [email protected]
� Heather Perry Juvenile Justice System Improvement Specialist [email protected]