so you need to do an evaluation! bob hamblen, colorado state university
Post on 19-Dec-2015
215 views
TRANSCRIPT
![Page 1: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/1.jpg)
So you need to do an So you need to do an evaluation!evaluation!
Bob Hamblen, Colorado State UniversityBob Hamblen, Colorado State University
![Page 2: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/2.jpg)
What outcomes do you want What outcomes do you want to measure?to measure?
How many people attendedHow many people attendedHow you improved your How you improved your
programprogramWhat people learnedWhat people learnedWhat practices were adoptedWhat practices were adoptedAny changes or impacts that Any changes or impacts that
occurred as a result of the occurred as a result of the programprogram
![Page 3: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/3.jpg)
Who are you targeting Who are you targeting with your program?with your program?
Examples:Examples: Small-acreage ownersSmall-acreage owners RealtorsRealtors Decision makersDecision makers VolunteersVolunteers AgenciesAgencies
![Page 4: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/4.jpg)
Things you need to do to Things you need to do to get desired outcomesget desired outcomes
Examples:Examples:WorkshopsWorkshopsClassesClassesOne-on-one trainingsOne-on-one trainingsNewslettersNewslettersQuestionnairesQuestionnairesTestingTesting
![Page 5: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/5.jpg)
What resources do you need What resources do you need to make your program to make your program
happen?happen?
Examples:Examples:Staff timeStaff timeAudiovisual equipmentAudiovisual equipmentMeeting locationMeeting locationInstructional materialInstructional materialInstructorsInstructorsPartnershipsPartnershipsPossibly volunteersPossibly volunteers
![Page 6: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/6.jpg)
Evaluation process reviewEvaluation process review
Start with what you want the Start with what you want the learner to do or learnlearner to do or learn
![Page 7: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/7.jpg)
Steamboat Creek pre/post Steamboat Creek pre/post test datatest data
% Correct% Correct
Before Before (1996)(1996)
% Correct% Correct
After (1998)After (1998)
Program Program participantsparticipants 65%65% 76%76%
Non-Non-participantsparticipants 50%50% 49%49%
![Page 8: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/8.jpg)
Washoe Valley pre/post Washoe Valley pre/post test datatest data
% Correct % Correct Before Before (1998)(1998)
% Correct % Correct After (2000)After (2000)
Random Random sample of sample of target target audienceaudience
63.8%63.8% 72.3%72.3%
![Page 9: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/9.jpg)
Satisfaction with programSatisfaction with program
Steamboat Creek, 1998
![Page 10: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/10.jpg)
Knowledge gainKnowledge gain
Steamboat Creek, 1998
![Page 11: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/11.jpg)
Steamboat Creek, 1998
Behavior changeBehavior change
![Page 12: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/12.jpg)
Septic system Septic system maintenancemaintenance
64% of respondents to a 64% of respondents to a survey (n=53) had pumped survey (n=53) had pumped their septic tanks within the their septic tanks within the past three yearspast three years
![Page 13: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/13.jpg)
Water quality dataWater quality data
Before Before projectproject
After After diverting diverting
waterwater
Total Total phosphorusphosphorus 2.1 g/day2.1 g/day 0.5 g/day0.5 g/day
Suspended Suspended sedimentsediment 238.7 g/day238.7 g/day 11 g/day11 g/day
![Page 14: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/14.jpg)
Example: A weed program Example: A weed program for for ssmallmall-a-acreage ownerscreage owners
You need resources such as:You need resources such as:InstructorsInstructorsAudiovisual equipmentAudiovisual equipmentWeed mountsWeed mountsHandoutsHandoutsMeeting facilityMeeting facilityAdvertising to get participantsAdvertising to get participantsPossibly volunteersPossibly volunteers
![Page 15: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/15.jpg)
Action items:Action items:
Conduct the educational program Conduct the educational program (class, workshop, field (class, workshop, field demonstration, etc.)demonstration, etc.)
Teach weed curriculumTeach weed curriculumSupply weed identification books, Supply weed identification books,
mounts, etc.mounts, etc.Provide noxious weed samples for Provide noxious weed samples for
participants to identifyparticipants to identifyInvite participants to bring in their Invite participants to bring in their
own weed samplesown weed samplesPractice identification skillsPractice identification skills
![Page 16: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/16.jpg)
• Short-term outcome: Be able Short-term outcome: Be able to correctly identify 8 of 10 to correctly identify 8 of 10 noxious weed samplesnoxious weed samples
• Medium-term outcome: Medium-term outcome: Change grazing practices to Change grazing practices to reduce weedsreduce weeds
• Long-term outcome: Reduce Long-term outcome: Reduce noxious weed population in the noxious weed population in the homeowner association by 90%homeowner association by 90%
Select the right evaluation Select the right evaluation tools to measure the desired tools to measure the desired outcomeoutcome
![Page 17: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/17.jpg)
ReviewReview
Do the evaluation activityDo the evaluation activity
![Page 18: So you need to do an evaluation! Bob Hamblen, Colorado State University](https://reader031.vdocuments.site/reader031/viewer/2022032704/56649d405503460f94a19afe/html5/thumbnails/18.jpg)
Evaluation processEvaluation process
Make the evaluation process the Make the evaluation process the first step in your program first step in your program planning!planning!