road safety education checklist - etscetsc.eu/wp-content/uploads/educational-checklist_crow.pdf ·...

24
ROAD SAFETY EDUCATION CHECKLIST Wilma Slinger, CROW

Upload: others

Post on 26-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

ROAD SAFETY

EDUCATION

CHECKLISTWilma Slinger, CROW

Page 2: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

OVERVIEW

• Background and development

• Implementation

• Results so far

• Future steps

Page 3: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

Background and development of the checklist

3

Page 4: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

NL CONCEPT OF ‘LIFE LONG

LEARNING’

• Road Safety Education (RSE) at important shifts in modes of traffic

participation

• Know-how, skills and attitudes for safe participation in traffic

• For all age groups: “from the cradle to the grave”

Page 5: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

Preschool

education

‘learn in traffic’

Primary school

‘blind spot lesson’

Secondary school

‘Case 101’

Novice drivers

‘Traffic Battle’

License holders

‘Motorcycle – risk

course’

Elderly road users

’eBike Training’

Page 6: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

TOOLKIT RSE INTERVENTIONS

• First step in quality assurance

• Inventory and assessment of RSE interventions

• Database with interventions classified by target group and educational

goals

• Used by professionals to give a recommendation about the ‘best

matched’ intervention

• Web-based: http://www.crow.nl/mobiliteit-en-gedrag/tools/toolkit

• Over 100 products in The Netherlands

Page 7: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

EDUCATIONAL CHECKLIST

• Which steps are essential to the development of an effective

intervention?

• Have all these steps been passed through and have decisions been

substantiated?

• Inspired by ‘Intervention mapping’ methodology: tool for the planning and

development of health promotion interventions

• Evidence and theory based approach

Page 8: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

10 STEPS

1. Problem analysis

2. Target group specification

3. Educational goals

4. Didactical principles

5. Content and lay-out of teaching materials

6. Assessment and evaluation during the intervention

7. Intervention manual

8. Implementation of the intervention

9. Process evaluation

10.Outcome evaluation

Page 9: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

Implementation of the checklist

9

Page 10: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision
Page 11: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

ASSESSMENT PROCEDURE

1. Group assessment- two educational experts in each group- read through available documentation- have personal interview with producer- discussion about scores for each step

2. Documentation of group assessment

3. Producer comments on assessment and makes up improvement plan

4. Final assessment is added and assessments are published in RSE Toolkit website

5. Strong but also weak points of interventions are described

6. Interventions of producers who do not wish to co-operate are removed from the RSE Toolkit

Page 12: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision
Page 13: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

Results so far

13

Page 14: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

INTERVENTIONS ASSESSED

Target group # in Toolkit # assessed

Preschool 3 2

Primary school 32 19

Secondary school 41 28

Novice drivers 8 6

License holders 6 2

Elderly people 7 6

Total 97 63

Page 15: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

ASSESSMENT RESULTS

Page 16: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

ASSESSMENT RESULTS

Page 17: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

PRACTICAL CONSEQUENCES OF

CHECKLIST PROCESS

• Producers adjust and refine road safety education programs

• Re-assessment proces started

• NL road safety subsidy > 12 million Euro yearly (government)

• This Money is used more efficient and effective

Page 18: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

LESSONS LEARNED

• Checklist useful development tool and assessment tool

• Checklist is prerequisite to quality, no guarantee for positive outcomes

• Producers adapt the 10 steps for the development of interventions

• Involvement of producers is needed (personal interview)

• Involvement of a group of assessors is needed: ratings need to be

discussed

• Assessment groups need to combine theoretical and practical

knowledge and expertise

Page 19: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

Future steps

19

Page 20: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

EVALUATIONS NEEDED

• The checklist results give insight in the care and the precision by which

the program is produced

• But …. without an outcome evaluation there is no insight in the actual

safety changes in the behavior of road users

• Still not many outcome evaluations available in the field of road safety

education interventions

• Only about 9% of all RSE interventions have been evaluated in a sound

study using at least a quasi-experimental design (experimental and

control group, before and after measurement)

• 10 ‘golden rules’ of RSE evaluation studies

Page 21: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision
Page 22: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

UNIVERSAL MEASURING ROD

• Development of standardized assessment instruments

• Compare similar interventions for similar target groups

• Give insight in most effective interventions

• Direct measurement of intended safe behavior in traffic

• Development of bicycle test for children in primary school:

- situation awareness

- hazard perception

- social behavior and moral reasoning

Page 23: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

ULTIMATE GOAL

• All interventions are being developed according to the ten steps of the

educational checklist

• All interventions are being evaluated and monitored

• Only evidence-based interventions are being implemented and

subsidized by the government

Page 24: ROAD SAFETY EDUCATION CHECKLIST - ETSCetsc.eu/wp-content/uploads/Educational-checklist_CROW.pdf · EVALUATIONS NEEDED • The checklist results give insight in the care and the precision

Thank you for your attention!

24

[email protected]