housekeeping all participants are automatically muted by webinar administrators. please type any...
TRANSCRIPT
![Page 1: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/1.jpg)
HOUSEKEEPING
All participants are automatically muted by webinar administrators.
Please type any questions using the Chat feature.
This Webinar will be recorded and posted on websites of the participant CBA programs.
![Page 2: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/2.jpg)
THIS WEBINAR IS PART OF THE GRANT WRITING PREPAREDNESS SERIES
CO-HOSTED BY:
SHARED ACTION, AIDS PROJECT LOS ANGELES
CAPACITY FOR HEALTH, ASIAN AND PACIFIC ISLANDER
AMERICAN HEALTH FORUM
CA STD/HIV PREVENTION TRAINING CENTER
![Page 3: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/3.jpg)
TODAY’S WEBINAR:
Shared Action at AIDS Project Los Angeles, a Capacity Building Assistance Program, in Los
Angeles
WAS DEVELOPED BY:
![Page 4: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/4.jpg)
WHO WE ARE:
We are funded by The Centers for Disease Control and Prevention
(CDC) to provide FREE trainings and one-on-one technical assistance
for community-based organizations (CBOs) on:
(1) Organizational Infrastructure and Program Sustainability,
(2) Evidence-Based Interventions (EBIs) and Public Health Strategies,
and
(3) Monitoring and Evaluation.
![Page 5: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/5.jpg)
DEVELOPING EVALUATION PLANS
Andi ZaverlExperience:• CBA Evaluation Specialist
Education:• Claremont Graduate
University• Chapman University
![Page 6: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/6.jpg)
Developing an Evaluation Plan
This Webinar will be recorded and made available through our websites along with copies of the slides
![Page 7: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/7.jpg)
LEARNING OBJECTIVES
By the end of this Webinar, participants will:
• Be able to explain the importance of developing an Evaluation Plan.
• Be able to identify the 5 key elements to include in an Evaluation Plan.
![Page 8: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/8.jpg)
8
What is an Evaluation Plan?
• An Evaluation Plan is a written document that
outlines policy and procedure on how each of
your objectives (outcome and process) will be
evaluated to ensure that your program’s goal
is met.
![Page 9: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/9.jpg)
9
What’s the Purpose?• 6. Monitoring and Evaluation
– Develop a Monitoring and Evaluation Plan- Funded applicants must work with CDC to develop and implement a process monitoring plan and conduct routine monitoring and evaluation for each intervention and/or service they provide. For applicants that are selected for funding, CDC will provide a template and technical assistance for developing a process monitoring plan at the time of award. At a minimum, the monitoring plan will include the following: • Program goals and measurable objectives.• Activities that will be conducted to meet the objectives.• Data collection plans, proposed staffing, timelines, and tools.• How data will be used, by whom, and when to measure progress towards
meeting objectives.• Procedures to ensure that data quality and security are consistent with CDC
guidelines.
![Page 10: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/10.jpg)
10
Purpose
• Other than being required:– Increases efficiency of the evaluation.– Ensure evaluation is planned from the beginning.
– Reduces duplicate work.
– Increases use of evaluation findings.
![Page 11: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/11.jpg)
11
Evaluation Plan Elements
I. Description of your program (e.g. background, design)
II. Purpose of the Evaluation
III. Objectives, Indicators, Logic Model
IV. Evaluation Methods
V. Report and Information Transfer
![Page 12: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/12.jpg)
12
An Example Intervention:
Community Promise:
• Community Level Intervention
• Uses Peer Advocates and Role Model Stories to diffuse HIV Prevention information to persons at risk.
![Page 13: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/13.jpg)
13
Evaluation Plan Elements
I. Description of your program (e.g. background, design)
II. Purpose of the Evaluation
III. Objectives, Indicators, Logic Model
IV. Evaluation Methods
V. Report and Information Transfer
![Page 14: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/14.jpg)
14
I. Description of your program
• Brief description of:
– Type of Intervention
– Target Population
– Geographical Coverage
– Goals
![Page 15: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/15.jpg)
15
II. Determining the purpose
• What is the primary purpose of the evaluation?
• Who is most likely to need and use the information obtained?
• How will the information be used?
![Page 16: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/16.jpg)
16
III. Objectives, Indicators and Logic Model
• List of Process and Outcome objectives
– Process Objective
– Outcome Objective:
• List of Indicators: expected outcomes
![Page 17: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/17.jpg)
17
Performance Indicators
Indicator Year 1 Year 2 Year 3
• Knowledge10% 15% 15%
• Retention 70% 75% 80%
![Page 18: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/18.jpg)
18
IV. Evaluation Methods
• Gather data• Analyze• Use findings
![Page 19: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/19.jpg)
19
Methods- Collecting Data
• Variables (e.g., demographics, KABB, participation, marketing)
• Data collection methods– Formative evaluation/Community Assessment: Literature
review, existing data, focus groups, interviews– Process and Outcome monitoring: Sign-in sheets, risk-
assessments, pre and post, follow-ups, behavioral commitment forms, etc.
– Paper or computer-based
![Page 20: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/20.jpg)
20
For Example:
• By December 31, 2011, the program staff will recruit 50 African American MSM at high risk for HIV to participate in HIV 101 workshop.
• The program staff will collect data from the participants on age, gender, ethnic background, sexual behavior and place of recruitment.
![Page 21: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/21.jpg)
21
Methods- Collecting Data (cont’)
• Staffing Pattern:– Personnel involvement in the evaluation– Qualification skills
• Resources:– Hardware and software– Confidentiality/Protection– Special infrastructure needs
![Page 22: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/22.jpg)
22
Methods-Analysis
• Data management– Organizing data– Transforming data to electronic base– Storage of data
• Statistical analysis– Description of statistical processes (e.g., frequencies,
tables, special statistics)
– Triangulation
![Page 23: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/23.jpg)
23
V. Report
• Description of how the findings will be presented to the funders and opportunities to diffuse the information to other stakeholders.
![Page 24: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/24.jpg)
24
Evaluation PlanRemember to include:
I. Program Description (e.g. background, design)
II. Purpose of the EvaluationIII. Objectives, Indicators, Logic
ModelIV. Methods (e.g. variables,
collection methods)V. Report
![Page 25: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/25.jpg)
25
Evaluation Plan for this Grant Proposal
• Describe the applicant’s goals for development and implementation of enhanced HIV testing.
• Provide objectives, a list of minimum steps to achieve objectives
• Describe how and at what point data collection will occur.
• Describe how monitoring and evaluation data will be used, by whom, and when.
• Describe how any technical assistance needs associated with meeting program monitoring and reporting requirements will be identified and met.
![Page 26: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/26.jpg)
26
Evaluation Plan TemplateEvaluationQuestion
Indicators Data Sources/Methods
Person Responsible
Timeline
1.
2.
3.
![Page 27: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/27.jpg)
27
Evaluation Plan Template1.FOCUSWhat will we evaluate (which program or aspect of a program)?
2. QUESTIONSWhat do you want to know?
3. INDICATORS-EVIDENCEHow will we know it?
4. TIMINGWhen should we collect data?
5. DATA COLLECTION
SOURCESWho will have this information?
METHODSHow will we gather the information?
SAMPLEWho will we question?
INSTRUMENTSWhat tools shall we use?
1.
2.
3.
4.
1.a.b.c.
2.a.b.c.
![Page 28: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/28.jpg)
28
Evaluation Plan Template6. How will the data be analyzed?
7. How will the data be interpreted?
8. How will the results be communicated?
To Whom When? Where? How?
http://www.uwex.edu/ces/pdande/evaluation/index.html
![Page 29: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/29.jpg)
29
Evaluation Plan Template
![Page 30: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/30.jpg)
30
Conclusions
• Remember:
–Always check with funder for their requirements.
–Be as thorough as possible.
– Evaluation plan ensures a more effective evaluation.
![Page 31: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/31.jpg)
THANK YOU!
Any Questions?
![Page 32: HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be](https://reader033.vdocuments.site/reader033/viewer/2022051614/5518008a550346a2228b4c0e/html5/thumbnails/32.jpg)
Additional Resources
-AIDS Project Los Angeles- Shared Actionwww.sharedaction.org
-Capacity 4 Health, APIAHF www.capacity4health.org
-CA STD/HIV Prevention Training Center www.stdhivtraining.org
Contact us for individualized capacity building assistance
Slides and a recorded version of this webinar will be available on the following websites: