national association for welfare research and statistics conference (nawrs) august 25, 2015 atlanta,...
TRANSCRIPT
National Association for Welfare Research and Statistics Conference (NAWRS)August 25, 2015Atlanta, GA
The Pathways for Advancing Careers and Education (PACE) Evaluation: Early Lessons from Interviews with PACE Participants
Karen Gardiner Kristin SeefeldtAbt Associates University of Michigan
2
The Pathways for Advancing Careers and Education (PACE) Study is supported by the Office of Planning, Research and Evaluation (OPRE), Administration for Children and Families (ACF), U.S. Department of Health and Human Services (HHS) (Contract #: HHSP23320072913YC).
The contents of this presentation do not necessarily represent the official views or policies of OPRE, ACF, or HHS.
Today’s Presentation
Overview of PACE and career pathways framework Highlight findings from qualitative interviews with study
participants – Motivations for enrolling in program – Definition of success and their chances of experiencing success – Challenges to participation
Potential programmatic implications Questions
3
What is PACE?
Evaluation of nine promising programs that aim to increase education, training, employment and self-sufficiency among low-income, low-skilled adults– Impact study using random assignment methodology– Implementation study
• In-depth qualitative sub-study is focus of presentation
Sponsored by the Office for Planning, Research and Evaluation, ACF
Led by Abt Associates, in partnership with MEF Associates and University of Michigan
4
PACE Sites
5
Year Up National Capital Region
Year Up Atlanta
Year Up Boston
Year Up Chicago
Year Up New York City
Year Up Providence
Year Up Puget Sound
Year Up San Francisco Bay
Area
San Diego Workforce Partnership Bridge to Employment
Program
Des Moines Area Community College
WTA Connect
Valley Initiative for Development and
Advancement (VIDA)
Instituto del Progreso Latino Carreras en Salud
Madison Area Technical College Patient Care Pathways
Bellingham Technical College I-BEST
Pima Community College Pathways to Healthcare Program
ISIS HPOG site
ISIS site
Workforce Development Council of Seattle-King County Health Careers for All
Everett Community College I-BEST
Whatcom Community College I-BEST
Key Career Pathways Ideas
A series of connected education and training programs and support services
Enables individuals to secure employment within a specific industry or occupational sector, and to advance within that sector
Each step prepares participant for the next level of employment and education
Partnerships between education and training providers, social service providers, workforce
Signature program components– Comprehensive assessment, basic and technical skills
instruction, academic and non-academic supports, connections to employment
6
7
V. BA+ Programs: Upper-Skilled Jobs V. BA+ Programs: Upper-Skilled Jobs
IV. 1-2-Year Certificate to AA Programs: Mid-Level Skilled
Jobs
IV. 1-2-Year Certificate to AA Programs: Mid-Level Skilled
Jobs
III. Short-Term Certificate Programs: Entry-Level Skilled
Jobs
III. Short-Term Certificate Programs: Entry-Level Skilled
Jobs
II. Sectoral Bridge Programs Semi-Skilled Jobs
II. Sectoral Bridge Programs Semi-Skilled Jobs
I. Basic Bridge ProgramsI. Basic Bridge Programs
Pro
spec
ts f
or
go
od
-pay
ing
, st
ab
le e
mp
loym
en
t
Occupational, academic, and life skills
The Basic Career Pathways Model
In-depth Qualitative Sub-Study: Interviews with Participants Goal: Gain a more comprehensive understanding of
treatment and control group members’– Motivation for wanting to enroll in a program– Expected outcomes of participating in a program– Experiences with program services (PACE or
otherwise)– Challenges to completing programs – Resources to help them succeed
8
Sub-Study Methodology Two rounds of interviews
– First round conducted March to November 2014• Motivation for enrolling in the program• Definition of success• Assessment of chance of success• Perceived challenges and barriers to success
– Second round starting fall 2015 Sample of treatment and control group members who
enrolled in study approximately 6 months prior to first interviews– 146 interviews scheduled, 123 conducted (84 treatment
group and 39 controls group)– Sample not designed to be representative of all PACE
participants, but is demographically similar9
Data Analysis
Audio-recorded interviews audio transcribed into Word documents, imported into NVivo
Initial coding based on major topics in discussion guide and themes that emerged during interviews
Further coded and analyzed text segments associated with certain broad categories using an inductive thematic approach (Guest, Namey, and Mitchell 2013)
Analyses presented today for treatment group only
10
Findings: Motivation to Enroll in Program
Desire for a career and to leave the low-wage labor market (n=54):
“I’m trying to find a better, more productive way to get into a career versus just working these—I mean, I have a great job. By all means, I have a great job, but, ehh, it’s a job.”
“I could be just a part of something just bigger than myself, bigger than a minimum-wage job, bigger than just getting by.”
11
Findings: Motivation to Enroll in Program (cont.)
For their children, to provide a better life economically and to serve as a good role model (n = 14):
“[My kids] ask for things and I can’t give ‘em to them… I need to be better [financially]. I want to be able—my kid wants a car at 16. [If I get a better paying job]I’ll be able to give him a car at 16, if he wants to. He deserves it though.”
“Well, one of my motivations is my son. I want, when he grows up, I’m gonna be like, ‘You know, I was old, and I did it [went to school]. You could do it too.’”
12
Findings: Motivation to Enroll in Program (cont.) Part of a process of self-transformation; overcoming
significant personal challenges– drug abuse, domestic violence, criminal convictions
“It's because I just had had my son, the baby one, and the father—he was very abusive and violent. I said to myself, ‘What am I doing? I have to better myself. I have to do something for me and my boys because it's just me and them,’ because the fathers are never around.”
13
Findings: Motivation to Enroll in Program (cont.)
Specific to health care-related fields: aligns with self-conception of being caregivers, previous experience caring for family members
“I’ve always been a nurse. As I had mentioned, my dad was a drug addict. A lot of the times, he was very ill. I had to feed him. I had to check his blood pressure from a young age. My mom was a depressed person because of what my father would do. I had to nurse her in bed all the time, feed her and just check on her. I’m natural at it. I’ve been doing it all my life—over 30 years now, so yeah, it’s very natural to me. I love it.”
14
Findings: How Participants Define Success
Definition of success included– Finishing the program (either current program or
entire pathway)– Getting a job– Getting good grades– Understanding the material covered in course work
“I wouldn’t want my nurse to only know 70 percent of what she’s talking about. You could pass with Cs, but I think I would want to know a little bit more than 70 percent to get by.”
15
Findings: Do Participants Believe They Will Be Successful?
Nearly all believed they would succeed:– “I am someone who follows through”– “I’m pretty relentless”– “They've seen me rise up, kind of like a phoenix rising
from the ashes up”– “I want this so bad”
16
Findings: Challenges
Finances are “very tight” (n=28)
“It’s been just paying bills. There’s no fun out of it. We don’t have—we can’t do what we wanted to do. We used to go to the movies, go shopping, any events that come to [the city], like the fair, none of that. It’s strictly bills and surviving.”
Loans from previous education and training (n=10)
“All the student loans was horrible… I owe maybe 13 grand or something. It was an expensive school….Now I owe a bunch of money and it’s crazy….I ended up—everywhere I looked, with their degree, or diploma certificate, it was minimum wage.”
17
Findings: Challenges (cont.)
For parents, guilt about time away from children (n=16)
“It’s been very hard. I mean there’s plenty of days I feel like I barely see my sons. I mean if I’m coming home at 8:00 at night, my youngest—I normally make him go to bed—or not make him—I have him go to bed before 10:00 p.m. or by 10:00 p.m. That gives me maybe a hour and a half, because I don’t get home ’til around 8:20 p.m., 8:30 p.m. Then I’m trying to hurry up and cook and go over his homework, so it’s hard. It’s hard. I definitely feel like I’m kind of neglecting home.”
18
Findings: Challenges (cont.)
Material was challenging (n=18)– Very different from what learned before (e.g., medical
terminology)– Had not been in school for many years– High school had not prepared them for this training
ESL students noted challenges due to language skills (n=8)
19
Findings: Challenges (cont.)
Time is another commonly cited challenge (n=19)– Many responsibilities (e.g., work and family in addition
to training)– Some difficulties finding enough time to study– Difficulty juggling multiple assignments
“It’s just the time that I would have to put in to study and not get distracted, because my husband works until 6:00 p.m., so in the meantime, I have to attend to my son and take care of the house and stuff too at the same time and pay bills. I take care of all those things.”
20
Implications for Programs
Programs could build on participants’ initial motivations and strengths to:– Frame marketing and recruitment materials– Design or adapt programs– For parents, find ways to involve children
Programs could help participants address financial challenges by:– Providing or linking to additional support – Providing financial literacy counseling and/or
workshops
21
Implications for Programs (cont.) Programs could help participants address
classroom-related challenges by:– Incorporating “back to school” boot camps or
orientations to prepare for coursework– Extra support or tutoring tailored to specific material in
class (e.g., medical terminology) Programs could help participants address balancing
responsibilities by:– Workshops or programming on time management,
goal setting– Integrating social supports and activities into the
structure of the program22
Questions?
23
Contact Information
Karen GardinerPACE Project DirectorAbt Associates, Inc. [email protected]
Nicole ConstancePACE Federal Project OfficerOPRE/ACF/[email protected]
Kristin SeefeldtAssistant ProfessorSchool of Social WorkUniversity of [email protected]
Website:www.career-pathways.org
24
Citation
Guest, Gregory, Emily Namey, and Marilyn Mitchell. 2013. Collecting Qualitative Data: A Field Manual for Applied Research. Thousand Oaks CA: Sage Publications.
25