road safety education checklist - etscetsc.eu/wp-content/uploads/educational-checklist_crow.pdf ·...
TRANSCRIPT
ROAD SAFETY
EDUCATION
CHECKLISTWilma Slinger, CROW
OVERVIEW
• Background and development
• Implementation
• Results so far
• Future steps
Background and development of the checklist
3
NL CONCEPT OF ‘LIFE LONG
LEARNING’
• Road Safety Education (RSE) at important shifts in modes of traffic
participation
• Know-how, skills and attitudes for safe participation in traffic
• For all age groups: “from the cradle to the grave”
Preschool
education
‘learn in traffic’
Primary school
‘blind spot lesson’
Secondary school
‘Case 101’
Novice drivers
‘Traffic Battle’
License holders
‘Motorcycle – risk
course’
Elderly road users
’eBike Training’
TOOLKIT RSE INTERVENTIONS
• First step in quality assurance
• Inventory and assessment of RSE interventions
• Database with interventions classified by target group and educational
goals
• Used by professionals to give a recommendation about the ‘best
matched’ intervention
• Web-based: http://www.crow.nl/mobiliteit-en-gedrag/tools/toolkit
• Over 100 products in The Netherlands
EDUCATIONAL CHECKLIST
• Which steps are essential to the development of an effective
intervention?
• Have all these steps been passed through and have decisions been
substantiated?
• Inspired by ‘Intervention mapping’ methodology: tool for the planning and
development of health promotion interventions
• Evidence and theory based approach
10 STEPS
1. Problem analysis
2. Target group specification
3. Educational goals
4. Didactical principles
5. Content and lay-out of teaching materials
6. Assessment and evaluation during the intervention
7. Intervention manual
8. Implementation of the intervention
9. Process evaluation
10.Outcome evaluation
Implementation of the checklist
9
ASSESSMENT PROCEDURE
1. Group assessment- two educational experts in each group- read through available documentation- have personal interview with producer- discussion about scores for each step
2. Documentation of group assessment
3. Producer comments on assessment and makes up improvement plan
4. Final assessment is added and assessments are published in RSE Toolkit website
5. Strong but also weak points of interventions are described
6. Interventions of producers who do not wish to co-operate are removed from the RSE Toolkit
Results so far
13
INTERVENTIONS ASSESSED
Target group # in Toolkit # assessed
Preschool 3 2
Primary school 32 19
Secondary school 41 28
Novice drivers 8 6
License holders 6 2
Elderly people 7 6
Total 97 63
ASSESSMENT RESULTS
ASSESSMENT RESULTS
PRACTICAL CONSEQUENCES OF
CHECKLIST PROCESS
• Producers adjust and refine road safety education programs
• Re-assessment proces started
• NL road safety subsidy > 12 million Euro yearly (government)
• This Money is used more efficient and effective
LESSONS LEARNED
• Checklist useful development tool and assessment tool
• Checklist is prerequisite to quality, no guarantee for positive outcomes
• Producers adapt the 10 steps for the development of interventions
• Involvement of producers is needed (personal interview)
• Involvement of a group of assessors is needed: ratings need to be
discussed
• Assessment groups need to combine theoretical and practical
knowledge and expertise
Future steps
19
EVALUATIONS NEEDED
• The checklist results give insight in the care and the precision by which
the program is produced
• But …. without an outcome evaluation there is no insight in the actual
safety changes in the behavior of road users
• Still not many outcome evaluations available in the field of road safety
education interventions
• Only about 9% of all RSE interventions have been evaluated in a sound
study using at least a quasi-experimental design (experimental and
control group, before and after measurement)
• 10 ‘golden rules’ of RSE evaluation studies
UNIVERSAL MEASURING ROD
• Development of standardized assessment instruments
• Compare similar interventions for similar target groups
• Give insight in most effective interventions
• Direct measurement of intended safe behavior in traffic
• Development of bicycle test for children in primary school:
- situation awareness
- hazard perception
- social behavior and moral reasoning
ULTIMATE GOAL
• All interventions are being developed according to the ten steps of the
educational checklist
• All interventions are being evaluated and monitored
• Only evidence-based interventions are being implemented and
subsidized by the government