pilot research to large scale practice: kenya’s path...
TRANSCRIPT
RTI International, Research Triangle Park, North Carolina, USA
Pilot research to large scale practice: Kenya’s path to a national literacy program underpinned by evidence
Dr. Benjamin PiperSenior Director, Africa Education
RTI International
Tusome Kenya Research Pathway
1.Experimental research2.Implementation research3.Applying findings broadly
2
PRIMR Experimental Research –to Tusome Implementation
• Coach to teacher ratios? 15:1 is better• Literacy and numeracy programs together? Yes• Mother tongue programs effective in MT? Yes• Mother tongue programs effective in other subjects? No• Which program ingredients matter most?
– Training and coaching !– New book at 1:1 ratio !!!– Teachers’ guides !!!!!
• Which ICT program can support learning?– E-readers for kids Yes $$$$– Tablets for teachers Yes $$– Tablets for coaches Yes $
• Tusome included almost all of these elements3
National Tusome Early Literacy Programme
Experimental Research: Books
5
1:1 books
Implementation research: National books distribution
6
Experimental Research: Teachers’ Guides
7
World Development article (Piper et al, 2018)
Implementation Research: Teachers’ Guide Utilization
8
75% of teachers are teaching 75% of the lessons150
137126
113
9184
75
0
20
40
60
80
100
120
140
160
Total Lessons 75th 50th 25th
Lessons Taught % of the lessons taught
Experimental Research: Teacher Professional Development Designs
9 RTI TPD study
Skill-based teacher training
Implementation Research: Teaching Targets
Benchmark levels (cwpm)
Emergent Fluent
Kiswahili 17 45
English 30 65
10
Piper et al, 2018
JEDU
Experimental Research: Coaching
11
Piper et al, 2015
TATE
Implementation Research: National & Regional Data for Accountability
12
Piper et al, 2017
IJEDICT
Implementation Research: Using location data
13
Did Tusome Work?
14
15
External Evaluation by MSI(Freudenberger & Davis, 2017)
Tusome Average Effect Sizes
0.67 0.63
1.04
0.76
0
0.2
0.4
0.6
0.8
1
1.2
English KiswahiliGrade 1 Grade 2
16
17
1.2 million children
Applying Research: Gov’t of Kenya Book Purchases
18
$4.00
$2.80
$2.00
$0.85 $0.75
$0.00
$0.50
$1.00
$1.50
$2.00
$2.50
$3.00
$3.50
$4.00
$4.50
Typicalbookstore cost
Discounted cost Expected MOEcost
MOE 2019printing costs
Tusome cost
Book
Costs in
USD
Applying Research: Multi-Country Teachers’ Guide study
19
Teachers’Guides
Guidelines
Applying Research: TPD study
TPD Model1. Lecture2. Discussion3. Modeling4. Practice
20
Multi-countryTPD study
2018
Applying Research: Coaching study
21
Multi-countryCoaching
study2019
Reflections
• 1) Experimental 2) Implementation 3) Applying Research
• Your first attempt will be wrong• Design for scale – Real world RCTs• Research implementation at scale• Develop best practices literature• Learning @ Scale study (Applying)
– Instruction ingredients– System ingredients 22
Large Scale Programs –Gains in Oral Reading Fluency
67
3
644
4
11
21
0
5
10
15
20
25
Baseline Year 1 Year 2 Year 3 Year 4
Increa
se in
Oral R
eading
Fluen
cy
Jordan Malawi Nepal
Rwanda Uganda (average) Tanzania
Average Kenya ‐ Kiswahili Kenya ‐ English