multiple measures assessment project (mmap) cañada pilot study pilot... · multiple measures...
TRANSCRIPT
Multiple Measures Assessment Project (MMAP)
Cañada Pilot Study
December 2015
12/09/2015 CAÑADA COLLEGE 1
What is MMAP?
Multiple Measures Assessment Project (MMAP) is:
Part of the Common Assessment Initiative
A statewide initiative with about 20 pilot colleges
(Cañada is one of them)
Using high school transcript as one of the multiple
measures
12/09/2015 CAÑADA COLLEGE 2
MMAP Pilot Process Timeline
February 2015: Established the MMAP Team; Studied data
March 2015: Established measures and research plan
April-August 2015: Implemented multiple measures, including validating high school transcripts and placement in college level courses
January 2016: Will analyze the results in terms of student demographics and course success
12/09/2015 CAÑADA COLLEGE 3
Cañada MMAP TeamTeam Members:
English Faculty: Yolanda Valenzuela, David Clay, Susan Gangel, and Kim Huynh
Math Faculty: Denise Hum
Assessment Coordinator: Jeanne Stalker
Researcher: Tracy Huang
Deans:, Janet Stringer, David Johnson, and Chialin Hsieh
Interim VPSS: Kim Lopez
12/09/2015 CAÑADA COLLEGE 4
Data Summary
12/09/2015 CAÑADA COLLEGE 5
Cohort groups were selected from 2009-2011
(CalPass Plus)
Average time elapsed between HS graduation
and enrolling at Cañada: 4 years
Majority of HS students came to us with GPA of
“C” or lower.
Majority of HS students took English or math in
their first semester at Cañada
Target Population for MMAP
New college students
Recent high school graduates (within 3 years)
Students with above average cumulative high school GPA
Students with above average grades in high school English/Math courses
12/09/2015 CAÑADA COLLEGE 6
Decision Trees--English
12/09/2015 CAÑADA COLLEGE 7
• New student from high school within 3 years
• Cum GPA >=2.3• High school
English course grade equal or higher than B-
Decision Trees--Math
12/09/2015 CAÑADA COLLEGE 8
• New student from high school within 3 years
• Cum GPA >=3.2• High school Math
course grade equal or higher than C
Web Application for the Decision Trees
Development of the Web application◦English Questionnaire
◦Math Questionnaire
12/09/2015 CAÑADA COLLEGE 9
Implementation of the transcript placement
Assessment Center staff validated HS transcripts in fall 2015
Waived the prerequisites for students to enroll in fall 2015
12/09/2015 CAÑADA COLLEGE 10
Evaluation of the MMAP Analyzed the # of students placed and enrolled in college
level English/math in 2015 with the # of students placed
and enrolled in college level English/math in 2014.
Will compare college level English/math success rates in
college level English/math in 2015 with the success rates in
college level English/math in 2014.
12/09/2015 CAÑADA COLLEGE 11
12/09/2015 CAÑADA COLLEGE 12
123
259
66
170
54%
66%
0%
10%
20%
30%
40%
50%
60%
70%
0
50
100
150
200
250
300
2014 College Level English 2015 College Level English
# o
f St
ud
ents
Progression from Placement to EnrollmentEnglish: 2014 vs. 2015
Placed Enrolled Progression
2014: COMPASS 2015: MMAP + COMPASS
191
245
70
116
37%
47%
0%
10%
20%
30%
40%
50%
60%
70%
0
50
100
150
200
250
300
2014 College Level Math 2015 College Level Math
# o
f St
ud
ents
Progression from Placement to EnrollmentMath: 2014 vs. 2015
Placed Enrolled Progression
2014: COMPASS 2015: MMAP + COMPASS
12/09/2015 CAÑADA COLLEGE 13
123 123
66 64
134
106
0
50
100
150
200
250
300
Placement 2014 Placement 2015 Enrollment 2014 Enrollment 2015
COLLEGE LEVEL ENGLISH PLACEMENTS AND ENROLLMENT TOTAL
2014 VS. 2015
COMPASS MMAP
(Total 170)
Increase 109%
Increase 158%
(Total 259)
12/09/2015 CAÑADA COLLEGE 14
23 2410 13
56
46
0
10
20
30
40
50
60
70
80
90
100
Placement2014
Placement2015
Enrollment2014
Enrollment2015
College Level English Placements and EnrollmentHispanic
2014 vs. 2015
COMPASS MMAP
Increase 490%
Increase 248%
(Total 80)
(Total 59)
48 51
28 23
35
27
0
10
20
30
40
50
60
70
80
90
100
Placement2014
Placement2015
Enrollment2014
Enrollment2015
College Level English Placements and EnrollmentWhite
2014 vs. 2015
COMPASS MMAP
Increase 79%
Increase 79%
(Total 86)
(Total 50)
12/09/2015 CAÑADA COLLEGE 15
191 192 70 78
53
38
0
50
100
150
200
250
300
Placement 2014 Placement 2015 Enrollment 2014 Enrollment 2015
College Level Math Placements and EnrollmentTotal
2014 vs. 2015
COMPASS MMAP
Increase 28%
Increase 66%
(Total 245)
(Total 116)
12/09/2015 CAÑADA COLLEGE 16
91 95 22 35
22
16
0
20
40
60
80
100
120
140
Placement2014
Placement2015
Enrollment2014
Enrollment2015
College Level Math Placements and EnrollmentFemale
2014 vs. 2015
COMPASS MMAP
Increase 29%
Increase 132%
(Total 117)
(Total 51)57 57 17 22
12
10
0
10
20
30
40
50
60
70
80
90
100
Placement2014
Placement2015
Enrollment2014
Enrollment2015
College Level Math Placements and EnrollmentHispanic
2014 vs. 2015
COMPASS MMAP
Increase 21%
Increase 88%
(Total 69)
(Total 32)
Next Steps
Share the MMAP outcomes broadly and collect feedback to refine strategies—Fall 2015
Continue pilot in Spring 2016 using the same implementation logistics—November 2015
Evaluate course success rates of fall cohorts, and revisit placement rule sets if needed—Spring 2016
Study student feedback on placement and enrollment patterns—Spring 2016
12/09/2015 CAÑADA COLLEGE 17
Questions
12/09/2015 CAÑADA COLLEGE 18