MEASURING STUDENT SUCCESS SYMPOSIUM

Ontario College Key Performance Indicators

Joanne Brown Manager, Colleges Unit, MTCU

Presentation to OISE Research Policy Symposium

November 22, 2013

2

WHAT IS STUDENT SUCCESS? • Gaining employment? • Employment related to field of study? • Satisfied students? • Graduation? • Critical thinking? • Gaining an education? • Satisfied employers? • Desire to gain knowledge? • Becoming a better engaged citizen? • Satisfied graduates? • Gaining opportunities to enroll in other programming? • Contributing to meaningful research?

ANSWER: All of the above…and more.

STUDENT SUCCESS AS DEFINED IN THE COLLEGE SECTOR

• Ontario Colleges of Applied Arts and Technology Act:

– The objects of the colleges are to offer a comprehensive program of career-oriented, post-secondary education and training to assist individuals in finding and keeping employment, to meet the needs of employers and the changing work environment and to support the economic and social development of their local and diverse communities.

3

KPIs and STUDENT SUCCESS

4

Student Success

Student Satisfaction

Graduation Rate

Graduate Satisfaction

Employment Rate

Employer Satisfaction

CONTINUOUS EVOLUTION

5

1996: Provincial Auditor - collect, report and tie KPI to funding

1998: Launch

2005: Data sharing agreement

2012: Launch of Web-based Employment Profile

2013: OPEN GOVERNMENT

OPEN GOVERNMENT

• Involves making data the

government collects available to the

public in a free and accessible way.

• Subject to privacy, security and

confidentiality protections.

OPEN GOVERNMENT: ACCOUNTABILITY AND TRANSPARENCY

6

College System

• Colleges Ontario

• MTCU webpage

Provincial Program

• Employment Profile

Local Program

• Institutional Webpages

Employment rates, graduate and employer satisfaction rates are tied to

performance funding.

VALUE OF KPI

*Approx. 120-page analysis of 2011-12 Fanshawe College KPI results disaggregated by question.

7

• Monitoring the outcomes that

result from this use of public

funds and better

understanding how the

system is used by students

and serves employers.

• Results in better allocation of

public funds and more efficient

achievement of goals.

• Better outcomes for our

students and our

communities.

• Continuous improvement.

RESPONDING TO STUDENTS

8

CURRENT UPGRADES

• Modernization and updating of questionnaire

• Expansion of demographic information collected

• Growth of ability to monitor outcomes of government funded initiatives

Student Satisfaction and

Engagement Survey

• Collection of longitudinal data by introduction of a survey at two years

• Alignment with university practices

• Growth of ability to monitor outcomes of government funded initiatives

Graduate Outcomes Surveys

• Centralization and automation of calculations

• Better capture of student movement based on the Ontario Education Number (OEN)

Graduation Rate Calculation

9

BETTER TRACKING OF STUDENT SUCCESS

• Research indicates engagement is a critical component of student success.

• 20 engagement-related questions added focusing on:

• support offered by colleges to students

• student engagement in college life

• student time commitments.

• Separate monitoring of in-class apprentices, international, first generation and students with disabilities.

Student Satisfaction and

Engagement Survey

• Inclusion of:

• work-integrated learning experience

• survey section for Co-op Diploma Apprenticeship graduates

• Development of a graduate outcomes survey at two years to assess progression of graduate’s career or further education path.

Graduate Outcomes Surveys

• Separate monitoring of preparatory programs, international, Co-op Diploma Apprenticeship, and Second Career students.

Graduation Rate Calculation

10

LONG-TERM OPPORTUNITIES

11

• KPIs for all sectors of Ontario’s Postsecondary

Education System:

• Public Colleges

• Private Career Colleges

• Publicly-assisted Universities

• Other OSAP-eligible institutions

• Harmonized data collection methods

• Uniform KPI calculations

• Timely and comprehensive reporting

• Linkages with other relevant information

• and…

CLOSING THOUGHTS

The Ministry is allocating approximately $1.42 billion in operating support to the college system in 2013-14.

The Ministry will spend approximately $2.1 million (0.15% of overall expenditure) in College KPI to monitor this investment of public funds.

In addition to monitoring, this expenditure provides the following benefits annually:

131,926 students report on their satisfaction.

56,431 graduates report on their satisfaction and outcomes.

8,622 employers report on their satisfaction with college graduates preparation for the workforce.

Approximately 500 fields of data collected.

12