youth participatory evaluation

YOUTH PARTICIPATORY EVALUATION

By: Nou Yang, Padah Vang, and Pao Thao

YOUTH PARTICIPATORY EVALUATION

B Y : N O U Y A N G , P A D A H V A N G , A N D P A O T H A O

I. Welcome and Introductions

II. Youth Leadership Initiative programIII. Overview of Youth Participatory Evaluation

a) Defining YPE b) Our YPE Process and the YPQA tool

lV. Reflecting your own program

V. Evaluation

WELCOME AND INTRODUCTION

PA O T H A O● H A R D I N G S E N I O R

H I G H S C H O O L● 1 0 T H G R A D E R● 1 6 Y E A R S O L D● E M E R G I N G

L E A D E R F O R Y L I

PADAH VANG

● CENTRAL HIGH SCHOOL

● 11TH GRADER● 17 YEARS OLD● MENTOR FOR YLI

NOU YANG

● DIRECTOR FOR YLI

● PROVIDES SUPPORT AND STRUCTURE TO PROGRAM

Welcome and Introductions

● YLI’s mission is to develop leaders

for today that are able to work

across multicultural differences

● Youth Participatory Evaluation or

YPE is a team of youth in YLI that

uses the YPQA method to improve

YLI’s program quality.

O V E R V I E W O F E V A L U A T I O N

➢ Evaluation is a systematic process

➢ Evaluation involves collecting data➢ Evaluation is a process for improving knowledge and decision making

➢ Everyone is an evaluator

➢ Everyone has different values

ASSESS

PLAN

IMPROVE

W H Y Y P E ?

Pao Thao

• Learn new skills

• A chance to improve the

program

• To give back to the program

Padah Vang

• Learn and see YLI

from a differenct

perspective

• Be part of the change

• Skill building

Nou Yang

• Opportunity to share

process of evaluation

with youth

• Align our evaluation

process with our

youth – adult

partnership model

YOUTH PARTICIPATORY EVALUATION DEFINITION

❖ Youth Participatory Evaluation or YPE is

Definition from Kim Sabo-Flores

“Youth participatory evaluation involves young people in the process of evaluating the programs, organizations, agencies, and systems that have been designed to serve them.

❖ The YPE process can be completely youth-driven, or it can be

conducted in partnership with adults.

Y O U T H P A R T I C I P A T O R Y E V A L U A T I O N - O U R D E F I N I T I O N

❖ 2013-2014 YLI Quality Team Definition

By Maddy, Pao, Xe, Say Meh, ThengYeng, and Padah

“A youth-driven process, in partnership with adults, that allows for youth and adults to work together, share their opinions, and co-create a process for evaluation.

An opportunity for youth who have experience in the program have an understanding of the program’s core values.

A process of critical analysis of the data collection, resulting in meaningful recommendations that involves stakeholders in taking action to improve the quality of the program; where youth get to evaluate and change their program that benefits all stakeholders in YLI and improve the program quality where youth and adults learn, develop and improve their various evaluation skills, while improving the program itself.”

OUR EVALUATION PLANMilestone Deliverable

September Conduct a quality programming workshop with youth leaders Recruit youth leaders to take on this project

 October Orientation to YPE

Define group purpose Share past history of YLI’s evaluation efforts

 November Assist the large group in having a quality experience during

Action Teams as they learn about different issues Learn about evaluation Determine timeline

 December Learn about quality programming

Learn how to assess quality in after-school programming Observe and collect data using YPQA tool Data entry

 January Review data collected and make meaning

Determine missing data Make recommendations to improve quality programming Identify with staff and volunteers key behavioral changes

P R A C T I C E N O T E T A K I N G

● Observe image and take notes on what you see.

E F F E C T I V E N O T E T A K I N G

❖ Plan on observing at least one hour of programming

❖ Notes should include quotes, actions, and other factual information

❖ Rich detail in snapshot form

❖ Focus on interactions

❖ Describe who, what, when, and where including the materials used - what you see in the room

❖ Should be objective - recognize your own bias

❖ Can stand alone - someone should be able to read your anecdote and understand them

❖ Can be used for more than one item

❖ Remember that your notes are all you have to rely on later on in the evaluation process

N O T E T A K I N G # 2

● Let’s practice again!

● Observe and use your new skills in note taking.

Y O U T H P R O G R A M Q U A L I T Y A S S E S S M E N T ( Y P Q A ) ● What is it?

○ The YPQA is a systematic method that measures the quality of a program

● How is it done?○ By using your notes you then

use the YPQA packet and rank each section with a 1,3, or 5. with 1 being the the worse and 5 being the best.

● What does it evaluate?○ It is categorized into 4 different

sections: Safe Environment, Supportive Environment, Interaction, and Engagement. By evaluating all 4 of these categories it measures and averages the quality of a program.

Y P Q A V A L I D A T E D I N S T R U M E N T

The instrument consists of the domain. Within each domain there are items for which you have to score what you see.

Scoring scale: 1,3,5

Ratings must have supporting evidence.

ANALYZE DATA

OUR RECOMMENDATIONS BASED ON YPQA DATA# 1 S T R U C T U R E A C T I O N T E A M S T O M A X I M I Z E Y O U T H A N D A D U LT S W O R K I N G T O G E T H E R # 2 P R A C T I C E O R I N C R E A S E T H E U S E O F L E A R N I N G F O C U S O R S K I L L S T O B E L E A R N E D F O R E A C H A C T I V I T Y

# 3 P R O V I D E R E F L E C T I O N T I M E A T T H E E N D O F E A C H S E S S I O N S O T H A T Y O U T H C A N S H A R E T H E S K I L L S T H E Y A R E L E A R N I N G

# 4 T O H A V E A Y O U T H Q U A L I T Y C O A C H

AGREE VS. DISAGREE

My program engages youth in the evaluation process.

It would be easy for my program to implement Youth Participatory Evaluation.

C L O S I N G

Why do you ladies and gentlemen think that us youth are running this workshop?

TIPS ON ENGAGING YOUTH IN YPE Open-minded adult advisor who will work in equal partnership with

youth Adults, know when to hold our hands and when to let go Be ready to put in additional time for meetings, trainings, etc. Small group size (ours is 6) Have participants who have been part of the program but still active in

it be part of YPE Build trusting relationship with youth – do what you say you will do Youth, don’t be afraid. It’s your program; be the change. There is no

limit to what you can do.

THANK YOU FOR YOUR TIME!

A S Y O U A R E A B O U T T O L E A V E P L E A S E T A K E A

F E W S E C O N D S A N D F I L L O U T T H E E V A L U A T I O N

O N T H I S S E S S I O N .