program fidelity influencing training program functioning and effectiveness cheryl j. woods, csw
TRANSCRIPT
![Page 1: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/1.jpg)
Program FidelityProgram Fidelity
Influencing Training Program Functioning and Effectiveness
Cheryl J. Woods, CSW
![Page 2: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/2.jpg)
Program FidelityProgram Fidelity• The degree to which a program or
intervention is delivered as was intended,• What a program or intervention consists of
in practice,• And how well the program or intervention
functions according to its specific design
![Page 3: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/3.jpg)
Who determines program fidelity?
•Top Down
•Consensus
![Page 4: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/4.jpg)
Outcomes and ProcessesOutcomes and ProcessesOutcomes are what we hope to accomplish
through implementation of the program or intervention
Processes refer to what the program or intervention will do to achieve the anticipated outcomes and the way it will be done
![Page 5: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/5.jpg)
Why be concerned with Why be concerned with fidelity?fidelity?
It may be difficult to know what actually happened during the program or intervention– What took place– The quality of the program delivered– Whether the target audience was reached
![Page 6: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/6.jpg)
What are the benefits of What are the benefits of knowing?knowing?
Information about program fidelity– Helps explain differences in observed changes
in the outcomes– Helps strengthen conclusions that the program
or intervention is effective
![Page 7: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/7.jpg)
Attention to fidelity Attention to fidelity Helps us understand the internal dynamics and
operations of the program or intervention– How the pieces of the program fit together– How the users (e.g. trainers, providers, and
trainees) interact– The obstacles faced and resolved
![Page 8: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/8.jpg)
Attention to fidelityAttention to fidelityLets us see the – The strengths and weaknesses of a program or
intervention– Anticipated and unanticipated consequences
![Page 9: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/9.jpg)
Attention to fidelityAttention to fidelityHelps us learn more about “Best Practices”
for:– Replicating– Maintaining – Diffusing programs or interventions
![Page 10: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/10.jpg)
Without attention to fidelityWithout attention to fidelity
It is difficult to know whether to ascribe program outcomes to the full effect of the program as originally intended or to imperfect implementation of the program
![Page 11: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/11.jpg)
For instanceFor instancethe same program at three different sites
– Site A – every one just gets together – Site B – the content of the program is delivered
with little attention to how much or how it is delivered
– Site C – The program is implemented as designed
![Page 12: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/12.jpg)
Promotes FidelityPromotes Fidelity
![Page 13: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/13.jpg)
PreparationPreparation
– Theory of how the program or intervention produces change
– Specification of major components or the active ingredients
– Manual– Training
![Page 14: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/14.jpg)
SupervisionSupervision
Ongoing supervision that includes– Continuous monitoring of implementation– Provisions for corrective action
![Page 15: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/15.jpg)
Threats to Program Threats to Program FidelityFidelity
![Page 16: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/16.jpg)
Cultural IssuesCultural Issues
Language differences between trainers and trainees
Lack of respect for and/or knowledge about the culture and worldview of trainees from diverse cultural backgrounds
Lack of consideration for the values and integrity of the community being served
![Page 17: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/17.jpg)
Issues related to the trainee Issues related to the trainee
Pattern of attachment and internal working model
Level of active participation
Developmental issues
Emotional state or history of trauma
![Page 18: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/18.jpg)
Learning skillsAttitude of the traineeTrainee expectations and assumptions
![Page 19: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/19.jpg)
Issues related to the Issues related to the characteristics of the interventioncharacteristics of the intervention
Attrition
Mismatch between trainee and training
Scheduling problems
Conflict in the goals of the training by trainees, trainers, administration, and community
![Page 20: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/20.jpg)
More issues related to More issues related to the the characteristics of the interventioncharacteristics of the intervention
Program intake timing
Physical setting of training
Attitude of the trainer
Trainer expectations and assumptions
Trainer adherence to program specifications
![Page 21: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/21.jpg)
Verification Verification
Documentation that all aspects are delivered as described and for measuring fidelity across sessions, implementers and sites
![Page 22: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/22.jpg)
Verification of program fidelityVerification of program fidelity
Documentation of Delivery– Are the essential components actually being
delivered? – Quality (e.g. usefulness, affective quality,
responsiveness)
![Page 23: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/23.jpg)
Documentation of Delivery (continued)– Content– Unusual events– Problem solving
![Page 24: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/24.jpg)
AdaptationAdaptation
Modifications can be deliberate or accidental
Balance between fidelity and adaptationRigidity also threatens fidelity by not
allowing for innovation
![Page 25: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/25.jpg)
Intentional ModificationsIntentional Modifications
May included– Enhancements of program components– Adjustments in the nature of the components– Changes in the manner or intensity of delivery– Cultural and other modifications required by
local circumstances
![Page 26: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/26.jpg)
Assessment ToolsAssessment ToolsUsed to verify program fidelityTrainee forms (trainee perceptions)
– What they received– Trainee satisfaction
![Page 27: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/27.jpg)
MeasuresMeasuresTapes can be reviewed and rated
– Audio– Video
![Page 28: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/28.jpg)
Other measuresOther measures– Environmental rating forms– Process notes– Attendance sheets– Adherence measures– Structured observations and interviews
![Page 29: Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW](https://reader031.vdocuments.site/reader031/viewer/2022032605/56649e845503460f94b86076/html5/thumbnails/29.jpg)
Benefits Benefits Documented compliance to State mandates
Greater willingness to assume outcomes of training
Trainer competency can be evaluated independently of trainee performance
Higher level of training transferred to the work environment