poetz, phipps, leduc: development of indicators for measurement at each stage of knowledge...
TRANSCRIPT
www.neurodevnet.ca
WORKING TOGETHER FOR HEALTHY BRAINS
A n n e l i e s e P o e t z , P h D – M a n a g e r , K T C o r eD a v i d P h i p p s , P h D , M B A – L e a d , K T C o r eR e n e e L e d u c , M S c – P r o g r a m O ffi c e r , N C E S e c r e t a r i a tM o b i l i z i n g S c i e n c e K n o w l e d g e a n d R e s e a r c h : N C E S h a r i n g o f B e s t P r a c ti c e s S y m p o s i u mT h u r s d a y J a n u a r y 2 9 , 2 0 1 5 1 1 : 0 0 a m – 1 2 : 0 0 p m ( S a b l e A B C D )H a l i f a x , N o v a S c o ti a
Development of indicators for measurement at each stage of Knowledge Translationfrom Research to Impact
Evaluation Framework
Phipps, D. (2013)
KT Core Services
Role of Evaluation
How are the KT Core services helping NeuroDevNet researchers & trainees?
How have we made a difference for children with NDDs and their families, in Canada?
Indicators are important because…
Anatomy of indicator
Definition components1) Name/title of indicator2) Definition (including N/D if
applicable)3) Type 4) Rationale5) Strengths/Limitations6) Data Source(s)7) Stage in CPPI8) Date9) Responsibility for collecting
data
Example1) [CB] % increase in knowledge2) Sum of scores/#attendees x 100 3) Outcome4) Measure knowledge gained5) S: measures change/impact,
L: bias & missing data6) Pre-Post questionnaires7) All8) May 28, 20149) KT Core
Process
1. Map services onto CPPI evaluation framework
2. Identify indicators for tracking each service
3. Design and develop database for tracking (& reports to be generated)
4. Fully define indicators
Database
Data tracking: MS Access
Reports
For management decisions
For Progress ReportingThis is the template from HQ to fill out for the table portion of our progress report:
For Progress ReportingThis is what Access gives us as a report:
For Progress Reporting
Another report Access gives us to help with writing of narrative sections:
Take away messages
1) Have an evaluation framework to position your indicators
2) Define indicators to the fullest extent possible
3) Integrate a system for data tracking & reports
ExercisePart 1: – Identify your network/organization/project goal(s)– Identify the outcome drivers:
What is the intended change? [What is the baseline?]What is the intended benefit?Who will stand to benefit and how? How will the change be made? [Activity, KP, KU, output]How is the process and result relevant, useful, accessible,
broad reaching, will be applied by the end user?
Part 2: create a comprehensive definition for 1 indicator that is linked to a goal that you identified in part 1
www.neurodevnet.ca
WORKING TOGETHER FOR HEALTHY BRAINS
Questions?Anneliese Poetz, PhD
Manager, Knowledge Translation CoreNeuroDevNet
David Phipps, PhD, MBALead, Knowledge Translation Core
Renee Leduc, MScProgram Officer, NCE Secretariat