how to use data in organizations · how to use data in organizations -- or how to make your...
TRANSCRIPT
![Page 1: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/1.jpg)
HOW TO USE DATA IN ORGANIZATIONS
-- or how to make your
organization hum with numbers..
Sacramento, CA
October, 2011
Collaborating for a Change: A Statewide Probation Work Session
Charlene Rhyne, PhD CJI Consultant
![Page 2: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/2.jpg)
WHY ARE YOU HERE?
• I love numbers • My boss is a data geek • My Chief wants everyone to work with
numbers • The State is moving in this new direction
2
![Page 3: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/3.jpg)
CONGRATULATIONS • Learning organization • Using data to ensure growth
– Accuracy
– Adherence
– Achievement
• Evidence-based principle
– Measure relevant processes and practices – Provide measurement feedback
3
![Page 4: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/4.jpg)
EVIDENCE BASED PRINCIPLES
• 1. Assess risk/needs
• 2. Enhance intrinsic motivation
• 3. Target Interventions
• 4. Skill train with directed practice
• 5. Increase positive reinforcement
• 6. Engage ongoing support in natural communities
• 7. Measure relevant processes and practices
• 8. Provide measurement feedback
4
![Page 5: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/5.jpg)
WHAT WE WILL TALK ABOUT TODAY?
• How to get started?
• Where does the data come from?
• Big picture
• Drilling down
• On-going monitoring
5
![Page 6: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/6.jpg)
QA vs CQI QUALITY ASSURANCE
• Driven by regulatory and accrediting agencies
• Tends to focus on finding who is responsible for errors
• Relies on inspections to identify errors
• Periodically monitors quality
• Management/leadership is top-to-bottom
CONTINUOUS QUALITY IMPROVEMENT
• Internally driven, empowers all personnel to make improvements
• Focuses on improving the system
• Seeks to prevent errors by continuously clarifying and improving processes
• Continuously strives to improve quality
• Management/leadership is shared governance model
6
![Page 7: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/7.jpg)
GETTING STARTED
• Feeling overwhelmed?
• Find a champion
• Convene a data committee
• Create a logic model
7
![Page 8: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/8.jpg)
WHAT IS A LOGIC MODEL?
• Story board of the work you are doing
• Logical relationships between resources invested, activities that take place and changes that occur
• Used in program planning, evaluation, management, communications and measurement
• Start with a simple process flow diagram
INPUTS ACTIVITES OUTPUTS OUTCOMES
8
![Page 9: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/9.jpg)
INPUTS
• What we invest
• Staff • Expertise • Money • Materials
INPUTS ACTIVITES OUTPUTS OUTCOMES
9
![Page 10: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/10.jpg)
ACTIVITIES
• Actions taken to accomplish outcomes
• Assessments • Case planning • Referrals • Sanctions
INPUTS ACTIVITES OUTPUTS OUTCOMES
10
![Page 11: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/11.jpg)
OUTPUTS
• What we get by doing the activities
• % of high and medium risked probationers with an
assessment within 60 days of intake
• % of high and medium risked probationers with a case plan within 60 days of assessment
• % of referrals that target top 4 criminogenic needs
INPUTS ACTIVITES OUTPUTS OUTCOMES
11
![Page 12: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/12.jpg)
OUTCOMES
INPUTS ACTIVITES OUTPUTS OUTCOMES
12
• Results or changes for individuals,
groups, communities, organizations, systems
• Outcomes can be: • Short term • Intermediate • Long term
![Page 13: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/13.jpg)
BENEFITS – or why are we doing all this work?
• Why this logic model thing? – Provide a framework to focus our work
– Provides a common language
– Helps us differentiate between ‘what we do’ and ‘results’
– Creates understanding
– A way of thinking – not just a pretty picture
13
![Page 14: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/14.jpg)
INPUTS
ACTIVITIES
OUTPUTS
OUTCOMES
SHORT
LONG
OFFICERS
ASSESSING
% OF
ASSESSMENTS COMPLETED ON
TIME
% OF MED AND HIGH RISK
CLIENTS WITH AT LEAST ONE OF CRIMINOGENIC NEEDS ADDRESSED IN CASEPLAN
COMMUNITY
SAFETY
TRAINING
CASE PLANNING
% OF CASE PLANS
COMPLETED ON TIME
% OF REFERRED CLIENTS ENTERING TX
ASSESSMENT TOOLS
REFERRALS
% OF TARGET
NEEDS REFERRED TO
TX
FINAL PRODUCT
14
![Page 15: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/15.jpg)
WHERE DO YOU GET THE DATA?
• Electronic case management system • Case file reviews • Observations • Taping • Spreadsheets • Satisfaction Surveys • IT • R&E
15
![Page 16: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/16.jpg)
WHAT HAPPENS IF YOU DON’T MEASURE?
• How do you know:
• If you are improving or declining?
• How you compare with others?
• Where are cost-effective results being produced?
• Where to improve?
• Where to distribute resources?
• Are you achieving your mission and vision?
16
![Page 17: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/17.jpg)
WHAT IS CQI?
• Ensure that we are meeting our goals – EBP? – How well? – Improved outcomes
• Commitment to improve services
• Creating an appetite for data results in
quality services 17
![Page 18: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/18.jpg)
CORE CONCEPTS OF CQI
• Quality defined • Success achieved • Most problems are found in processes, not
in people • Variation in processes can lead to
unwanted variation in outcomes • It is possible to achieve continual
improvement • Continuous improvement is effective
» http://www.fpm.iastate.edu/worldclass/
18
![Page 19: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/19.jpg)
EVIDENCE BASED
PRACTICE
PLAN
DO
STUDY
ACT
Develop CQI policies and procedures
Conduct reg reviews through the creation of reports using obj and measurable performance objectives
Feedback mechanism: bring in CJM, stakeholders for review
Implement changes; corrective action
PDSA
19
![Page 20: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/20.jpg)
DATA DISCUSSION
• Who?
• What?
• How?
20
![Page 21: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/21.jpg)
DO’S & DON’TS
DO
DON’T
• Empower staff • Time to meet goals • Let manager review • Focus on strengths,
affirmations and praise • Expect results • Focus on teamwork • Accountability for outcomes
under influence • Learn from others • Use behavior change
principles
• Play power games • Ignore lack of effort • Let meetings become dreary • Focus on minutia • Allow excuses • Allow blaming others
21
![Page 22: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/22.jpg)
DATA REVIEW PROCESS
OVERALL DEPT
UNIT
PPO PPO
UNIT
PPO
22
![Page 23: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/23.jpg)
START AT THE TOP
• Department-wide
75% 82% 85%
74%
1st QTR 2nd QTR 3RD QTR 4TH QTR
Percent of Assessments Completed In A Timely Manner BENCHMARK = 85%
23
![Page 24: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/24.jpg)
DRILL DOWN
• Unit Level: Percent of assessments completed in a timely manner**
24
UNIT 3RD QTR 4TH QTR Generic Unit A 96% 90%
Generic Unit B 88% 76%
Gang Unit 65% 62%
Domestic Violence 90% 72%
Sex Offenders 85% 70%
Overall total 85% 74%
** Benchmark =85%
![Page 25: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/25.jpg)
DRILL DOWN
• PO level: Percent of assessments completed in a timely manner**
OFFICER/DV UNIT 3RD QTR 4TH QTR Paul Jones 96% 85%
Sally Wilkes 88% 70%
Nancy Smith 87% 62%
Andrew Duran 92% 72%
Cynthia Young 86% 70%
Overall total 90% 72%
** Benchmark =85%
25
![Page 26: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/26.jpg)
STREAMLINING CQI
• Coordinate CQI plan development with workplan
development
• Automate measurement whenever possible
• Collect and review multiple data elements at all times
• Develop a dashboard of key measures
• Prioritize measures on an annual basis
26
![Page 27: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/27.jpg)
KEY INGREDIENTS: MAINTAINING YOUR SANITY
• Remember to keep your sense of humor
• If you do not have a sense of humor, develop one
• Reward small gains
• Recognize high achievers
• Talk to other jurisdictions
• Remember this is about the journey, not the destination
• This process is on-going, iterative and evolutionary
27
![Page 28: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/28.jpg)
THE NEVER ENDING JOURNEY
• What do you always take on your travels?
28
![Page 29: HOW TO USE DATA IN ORGANIZATIONS · HOW TO USE DATA IN ORGANIZATIONS -- or how to make your organization hum with numbers.. Sacramento, CA . October, 2011 . Collaborating for a Change:](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec68a06b2ac0f54dd3dd510/html5/thumbnails/29.jpg)
QUESTIONS? • CONTACT INFORMATION:
[email protected] Charlene Rhyne, MSW, PhD Manager, Quality Systems & Evaluation Services Multnomah County Dept. of Community Justice 501 SE Hawthorne Blvd. Suite 250 Portland, OR 97214 503.988.4126
29