data for learning and improvement david m. williams, ph.d. institute for healthcare improvement
TRANSCRIPT
![Page 1: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/1.jpg)
Data for Learning and ImprovementDavid M. Williams, Ph.D.
Institute for Healthcare Improvement
![Page 2: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/2.jpg)
Murder rate down compared to this
time last year.
![Page 3: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/3.jpg)
![Page 4: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/4.jpg)
![Page 5: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/5.jpg)
![Page 6: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/6.jpg)
![Page 7: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/7.jpg)
Celebration
![Page 8: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/8.jpg)
![Page 9: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/9.jpg)
Despair
![Page 10: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/10.jpg)
Three Considerations
• Data Definition• Date Collection• Data Display
![Page 11: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/11.jpg)
Data Definition
![Page 12: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/12.jpg)
![Page 13: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/13.jpg)
% child receiving assessments
Wait times
% of mom’s receiving pre-natal vitamins
% children in one clinic receiving assessment
# of books read% of meals with veg
Number of double smiles
PDSAs per week% parents rating 7 or greater for confidence
% of Mom’s screened for unhealthy habits
# of huddles per week
% Team members rate promise level
![Page 14: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/14.jpg)
Data Definition
How will you know a change is an improvement?
![Page 15: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/15.jpg)
Count =
Percentage = Rate =
Count
CountTotal 100
CountTotal Pop
100,000 population
![Page 16: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/16.jpg)
Data Collection
![Page 17: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/17.jpg)
![Page 18: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/18.jpg)
![Page 19: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/19.jpg)
![Page 20: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/20.jpg)
![Page 21: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/21.jpg)
Safety Cross
![Page 22: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/22.jpg)
Case Study
![Page 23: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/23.jpg)
![Page 24: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/24.jpg)
![Page 25: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/25.jpg)
![Page 26: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/26.jpg)
![Page 27: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/27.jpg)
![Page 28: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/28.jpg)
Data Display
![Page 29: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/29.jpg)
![Page 30: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/30.jpg)
Elements of a Run Chart
Se-ries1
160
180
200
220
240
260
280
300
320
LO
S (m
inut
es)
2/16/11 3/16 4/13 5/11 6/8
Week
Mea
sure
Time
X (CL)~
The centerline (CL) on a Run Chart is the Median
IG p.435
![Page 31: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/31.jpg)
Low Tech – Hand Written – Tester Owned
![Page 32: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/32.jpg)
% antenatal bookers eligible for Healthy Start in Leith (self report)(n=410; source Maternity Trak)
Monthly data
release
Monthly data
release
Leith Pioneer site work
started 3 March
Universal enquiry re HSComplete form
at booking appt
Team meeting
Leith Survey Monkey
Team meeting
and survey results
Focus on Trak docu-mentation
“Shift” on run chart (6+ points above median)
Median
Annotated
![Page 33: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/33.jpg)
![Page 34: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/34.jpg)
Change Made Between Weeks 7 & 8
Before Change (Measure on Week 4) After Change (Meaure on Week 11)0
1
2
3
4
5
6
7
8
9
8
3
Del
ay t
ime
(ho
urs
)
![Page 35: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/35.jpg)
Case 1
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
9
10
Weeks
Del
ay t
ime
(ho
urs
)
Ch
ang
e
![Page 36: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/36.jpg)
Case 2
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
9
10
Weeks
Del
ay t
ime
(ho
urs
)
Ch
ang
e
![Page 37: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/37.jpg)
Case 3
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
9
10
Weeks
Del
ay t
me
(ho
urs
)
Ch
ang
e
![Page 38: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/38.jpg)
Case 4
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
9
10
Weeks
Del
ay t
ime
(ho
urs
)
Ch
ang
e
![Page 39: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/39.jpg)
Case 5
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
9
Weeks
Del
ay t
ime
(ho
urs
)
Ch
ang
e
![Page 40: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/40.jpg)
Case 6
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
9
10
Weeks
Del
ay t
ime
(ho
urs
)
Ch
ang
e
![Page 41: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/41.jpg)
Change Made Between Weeks 7 & 8
Before Change (Measure on Week 4) After Change (Meaure on Week 11)0
1
2
3
4
5
6
7
8
9
8
3
Del
ay t
ime
(ho
urs
)
![Page 42: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/42.jpg)
Radar or Spider Diagram
![Page 43: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/43.jpg)
Radar or Spider Diagram
1 2 3 4 5 6 7 8 9 10 11 12 13 14
0
2
4
6
8
10
1 2 3 4 5 6 7 8 9 10 11 12 13 14
0123456789
10
1 2 3 4 5 6 7 8 9 10 11 12 13 14
0123456789
10
1 2 3 4 5 6 7 8 9 10 11 12 13 14
0
2
4
6
8
10
1 2 3 4 5 6 7 8 9 10 11 12 13 14
0123456789
1 2 3 4 5 6 7 8 9 10 11 12 13 14
0123456789
10
![Page 44: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/44.jpg)
Aggregate vs. Stratified
![Page 45: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/45.jpg)
Chinese Restaurant Demand Collection
![Page 46: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/46.jpg)
Monday Tuesday Wednesday Thursday Friday0
5
10
15
20
25
30
Tables per Day
Lunch
Dinner
![Page 47: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/47.jpg)
Monday Tuesday Wednesday Thursday Friday0
5
10
15
20
25
30
Tables per day - Lunch
Monday Tuesday Wednesday Thursday Friday0
5
10
15
20
25
30
Tables per day - Dinner
![Page 48: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/48.jpg)
Breaking Down Data
![Page 49: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/49.jpg)
![Page 50: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/50.jpg)
![Page 51: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/51.jpg)
![Page 52: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/52.jpg)
![Page 53: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/53.jpg)
Final 2 Slides
![Page 54: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/54.jpg)
1 2 3 4 5 6 7 8 9 10111213141516171819202122232425262728293031320
1
2
3
4
5
6
7
8
9
10
# of Run Charts per Storyboard
CPP Storyboards
# o
f P
DS
A C
har
ts
![Page 55: Data for Learning and Improvement David M. Williams, Ph.D. Institute for Healthcare Improvement](https://reader036.vdocuments.site/reader036/viewer/2022070406/56649e0d5503460f94af6094/html5/thumbnails/55.jpg)
Case Study – Improvers in action
https://www.youtube.com/watch?v=iWYIWE7SKcM