measuring our success: providing evidence for cte outcomes

Download Measuring  Our  Success: Providing Evidence for CTE Outcomes

Post on 31-Dec-2015

15 views

Category:

Documents

0 download

Embed Size (px)

DESCRIPTION

Measuring Our Success: Providing Evidence for CTE Outcomes. KC Greaney , Santa Rosa Junior College Mallory Newell, De Anza College Terrence Willett, RP Group. RP Conference, Kellogg West, CA April 2013. - PowerPoint PPT Presentation

TRANSCRIPT

RP Conference 2013 CTE EOS

KC Greaney, Santa Rosa Junior CollegeMallory Newell, De Anza College Terrence Willett, RP GroupMeasuring Our Success: Providing Evidence for CTE OutcomesRP Conference, Kellogg West, CAApril 201312Measuring Our Success, RP Conference, April 2013A Brief Overview

- CTE Survey Outcomes - CTE Launchboard Project- CTE Users Feedback Survey- CTE OS Data Visualization Tool

Terrence has until 2:30 to explain our study and its preliminary results22012 Statewide Effort:CTE Employment Outcomes SurveyPioneered at Cabrillo College over past 12+ yearsReplicated at other individual colleges including Chaffey, Los Rios, Riverside, Mt. SAC, Santa MonicaStatewide effort instigated by Bay Area Vocational Deans

Measuring Our Success, RP Conference, April 201333CTE Employment Outcomes SurveyCollaborative effort among community college consortia, the Chancellors Office, and the RP Group

Dual purposesProvide insightful information for local program improvementCollect statewide data for documentation of CTE outcomes

Practitioner-Driven EffortStatewide meetings, conference calls, collaborationAll methodology, implementation and survey questions vettedReport format developed in response to practitioner needsMeasuring Our Success, RP Conference, April 201344CTE Employment Outcomes SurveyMethodology 2 Surveys: Completers, Leavers 3 Modalities: e-mail, then US mail, then phone callsSurvey conducted approximately 1.5 years after completing/leaving

Sample 15 Colleges All students included who met the criteriaBy 2009/10, had either earned a vocational award of 6+ units OR met VTEA concentrator definition AND did not enroll in 2010/11 Total = 15,105 (7,681 Completers and 7,424 Leavers)Measuring Our Success, RP Conference, April 201355CTE Employment Outcomes SurveyData Chancellors Office MIS data wherever possible Local data supplement (student contact information) Survey dataComplete data set provided to colleges for further analysis

Measuring Our Success, RP Conference, April 201366CTE Employment Outcomes SurveyResponse Rates Overall, 30% (Completers: 34%, Leavers: 26%)By College, overall response rate ranged from 19% to 37%

Reports Statewide reports for Completers and Leavers College-level reports for Completers and Leavers

Measuring Our Success, RP Conference, April 201377Statewide Findings: CompletersThe big questions

Are our CTE students employable?Do they find jobs in the field in which we trained them? Do they see an increase in income?

in other words, was the program worth it?

Measuring Our Success, RP Conference, April 201388Statewide Findings: Completers 34% Response rate 94% Satisfaction rate with education and training 30% transferred (25% pursuing related field) 77% working in their field of study (or close)73% are interested in taking more classes or training in their field in the near future45% successfully engaged in a job search, 14% did not (the remainder were not looking or were already employed)

Measuring Our Success, RP Conference, April 201399Findings: Completers 79% of respondents are employed for pay

Measuring Our Success, RP Conference, April 20131010Findings: CompletersMore students worked full-time after completing studies and trainingMeasuring Our Success, RP Conference, April 20131111Findings: CompletersThe hourly wage of degree/certificate earners increased 39% from their hourly wage before their studies ($17.78) to their hourly wage after completing a degree or certificate ($24.79)

Measuring Our Success, RP Conference, April 20131212Statewide Findings: LeaversThe big questions

Are our CTE leavers losers? Or have we failed them? Are leavers employable? Do they find jobs in the field in which we trained them? Do they see an increase in income?

in other words, were the courses and training worth it, even if the student did not complete a program of study?

Measuring Our Success, RP Conference, April 20131313Statewide Findings: LeaversSimilar to Completers, except:

Lower Response Rate (26% versus 34% for Completers)Fewer with the goal of earning a certificate or degree (60% versus 80% for completers)Twice as many with the goal of upgrading job skills and/or renewing a license/permit (19% versus 10% for Completers)Slightly higher transfer rate (34% versus 30% for Completers)Slightly fewer report working in their field of study (or close 70% versus 77% for Completers)Earnings increase is lower (26% increase versus 39% for Completers)Measuring Our Success, RP Conference, April 20131414Basic DemographicsCompletersLeaversAll CCCsGender: Female60%51%54%Asian18%17%11%Black6%5%7%Latino19%20%30%White45%47%32%DSPS8%4%~ESL7%5%~Acad. Disadvantaged47%40%~Migrant Worker8%6%~n=7,681n=7,424n=2.8 millionMeasuring Our Success, RP Conference, April 20131515SwirlCompletersLeaversAttended multiple colleges within the same district13.5%14.4%Attended multiple districts40.6%39.7%Attended only one college44.6%44.8%Measuring Our Success, RP Conference, April 20131616CTE Survey: Changes in 2013Implement all the lessons we learned from the pilot year35 colleges participatingMove away from Completers versus LeaversMove towards CTE Skill BuildersBroaden cohort to students who completed 9+ units of SAM-coded vocational courses (to include those who completed a certificate or vocational degree)Tighter timeline (reports out by the end of June)Add questions re: industry certification, impact of coursework, more responses taking transfer into accountMeasuring Our Success, RP Conference, April 20131717CTE Survey: Changes in 2014Santa Rosa Junior College will continue to administer survey, working directly with interested collegesChancellors Office endorses survey and will continue to define cohort via MIS and provide basic data RP Group is supportive, but no longer directly involvedCCCAOE continues to support survey At Spring 2013 annual meeting, the CCCAOE Excellence in Collaboration award given to RP Group (Kathy Booth), Bay Area Vocational Deans Group (Rock Pfoetenhauer and Kit ODougherty) and Santa Rosa Junior College (KC Greaney)CalPASS+ will host CTEOS survey data in future

Measuring Our Success, RP Conference, April 2013181819Measuring Our Success, RP Conference, April 2013CTE User Feedback SurveyTerrence has until 2:30 to explain our study and its preliminary results19CTE User Feedback SurveyA link to the survey was emailed to all college contacts who participated in the survey in the 2011-12 academic yearReceived 7 valid responsesRespondents suggested that the results had largely been used to inform decision making in the areas of: Enrollment managementAccreditationPerkins or other reportingProgram improvementsChanges to program degree offerings

20Measuring Our Success, RP Conference, April 201320CTE User Feedback SurveyAdditional HighlightsRespondents found the following to be most valuable about the survey: Ease of administration by the RP GroupThe multiple ways students were contacted to increase response ratesThe overall findings from the survey from my collegeThe model report that was provided

Respondents stated the following technical support would have been beneficial: Assistance with the initial data pull of studentsAssistance with analyzing the resultsExamples of how other colleges shared the results and with whom

21Measuring Our Success, RP Conference, April 20132122Measuring Our Success, RP Conference, April 2013Launchboard ProjectTerrence has until 2:30 to explain our study and its preliminary results22CTE Launchboard4 Community Colleges participating in the pilotIncludes data elements from original Launchboard Metrics (OLB) and metrics from the Common Metrics (CMLB) associated with the Doing What Matters Framework: http://doingwhatmatters.cccco.edu/.Currently includes 67 data elementsAll metrics are presented by program TOPS code Some metrics presented by region as defined in the Doing What Matters FrameworkIncludes data from: COMIS, CalPASS Plus, EDD, Centers for Excellence, and data files submitted by colleges

23Measuring Our Success, RP Conference, April 201323CTE LaunchboardIncludes measures in the following areas:Alignment middle school to high school and high school to CCCEnrollments course completion in high school and CCC in CTE pathwayCapacity FTEF, students served in CTE programs by CCC, students served in similar programs in non CCC collegesSupport completed work readiness program, internship, took basic skills course, received financial aid, DSPS or EOPSReturn on Investment number of years of income to equal cost per students

24Measuring Our Success, RP Conference, April 201324CTE LaunchboardMilestonesCompleted major requirements in a CTE area (Primary Goal) (CMLB)Earned more than 8 units in the same TOP code within 3 years of first enrollment (OLB)Term-to-term retention (OLB)Completed college-level English or math within 3 years of first enrollment (OLB)Course completion and success (OLB)

25Measuring Our Success, RP Conference, April 201325CTE LaunchboardCredentialsIndustry-recognized certificates (OLB)Non-credit certificates (OLB)Chancellors Office approved credit certificates in and not in CTE pathway (OLB)Associates degree in and not in CTE pathway (OLB)Transfer in and not in CTE pathway (CMLB)

26Measuring Our Success, RP Conference, April 201326CTE LaunchboardEmployment:Students are employed in same or similar field (OLB)Wage gain in field (OLB)Wage gain for students earning 9+ units (OLB)Average wage of students who are employed in same or similar field (OLB) Job retention (OLB)

27Measuring Our Success, RP Conference, April 201327CTE LaunchboardDemand:Recent demand in Doing What Matters Economic Region (OLB)Projected demand in Doing What Matters Economic Region (OLB)Present demand in Doing What Matters Economic Region (OLB)Median (50th

Recommended

View more >