student success in general chemistry i carss poster_2013...general chemistry and organic chemistry...

1
The Center for Achievement, Retention, and Student Success (CARSS) is a comprehensive program that addresses retention of freshmen and transfer students in STEM fields at the University at Albany-State University of New York (UAlbany). We utilize a holistic model reliant on the creation of learning communities through group study and support. We have met the original program goals of: sustainability, institutionalization, provision of peer tutoring and peer/staff mentoring, ongoing project evaluation, and dissemination. The program continues to grow as evidenced by stakeholder driven increases in the number of tutoring sessions from 109 in year one to >600 per semester. On average, the program serves >600 students per semester. To accommodate UAlbany STEM student population needs, the CARSS program has made >135 appointments of STEM tutors who offer tutoring assistance to STEM tutees. As a result, pass rates in key gateway courses have steadily improved. Additionally, it is clear that both the small group sessions that foster the formation of semester-long learning communities, as well as the “pre-exam review sessions”, positively impact grades and retention outcomes. Goals Increasing the 4-year graduation rates of a cohort of freshman with declared STEM majors Increasing the 2-3 year graduation rates of transfer students entering into UAlbany in their junior year Institutionalizing the Center for Achievement, Retention and Student Success (CARSS) Increasing retention of historically underrepresented students in STEM majors Creating and supporting learning communities Strategies Provision of free tutoring in STEM gateway courses Provision of review/recitation sessions Creation of an on-campus home Establishment of a STEM Tutors training course Aggressive dissemination: website (www.albany.edu/carss); brochure; faculty in-class support; videos; participation in student orientations Establishment of a bona fide, furnished, dedicated center space Securing financial commitment from the University Administration to permanently support tutor and coordinator salaries Features of CARSS project sustainability include the following: I. It has a dedicated permanent fully furnished space from which to operate II. UAlbany has committed to continuing the CARSS program coordinator staff line III. UAlbany has committed $150,000.00 annually in support of the CARSS program at the termination of the grant funding period Our earlier studies to identify students who were “at-risk” revealed characteristics that enabled us to identify such students early in their academic careers and target them for participation in CARSS programs. In this follow up work, we sought to verify and quantify the positive impact of CARSS participation on performance in key gateway courses. Our Specific Aims were to: 1. Determine the impact of CARSS participation on pass rates in the two-semester general chemistry and organic chemistry course sequences 2. Quantify the probability of positive outcomes (passing grades) as a function of frequency of participation in CARSS programs DUE-0756985 Principal Investigator Rabi A. Musah Co-Investigators Denise M. McKeon Hua Shi Project Evaluator Patrice Lancey—Market Research Analysis LLC Project Program Coordinator Dianne E. Jester CARSS Center for Achievement, Retention, and Student Success A CARSS “learning community”. Permanent CARSS center Develop a program that caters to the needs of transfer and non-traditional students Develop a tutor training course text Expand the number of tutoring and review sessions to service greater numbers of students Characteristics of CARSS Student Participants Positive Dose-response Effect for Students Enrolled in General Chemistry II Participation in CARSS study groups and review sessions positively impacts final grades in General Chemistry & Organic Chemistry Overall Project Opportunities Implementation: Determination of Dose-response Effects of CARSS Participation on Retention 0% 20% 40% 60% 100% 80% 20% 40% 100% estimated probability of a student obtaining a C- or better final grade 60% 80% 0% 0% 20% 40% Estimated probabilities are calculated from a predictive model that used all students enrolled in General Chemisrty I in Fall 2010 and Fall 2011. estimated probability of a student obtaining a C- or better final grade estimated probability of a student obtaining a C- or better final grade STUDENT SUCCESS IN GENERAL CHEMISTRY I Estimated Probability of a Student Obtaining a C- or Better Final Grade based on Number of CARSS Sessions (Group and Review)Attended and SAT Math Score 60% 80% 100% Did not attend CARSS Attended CARSS 1 - 4 times Attended CARSS 5 or more times SAT Math Score above 610 81.3% SAT Math Score above 610 89.3% 97.2% SAT Math Score above 610 SAT Math Score between 530 and 610 58.7% SAT Math Score less than 530 40.7% SAT Math Score less than 530 57.0% 73.3% SAT Math Score between 530 and 610 92.0% SAT Math Score between 530 and 610 84.6% SAT Math Score less than 530 FINAL GRADE 35% 40% 30% A B C+ GRADE DISTRIBUTION OF STUDENTS IN GENERAL CHEMISTRY I WHO DID NOT ATTEND ANY CARSS SESSIONS DURING FALL 2011 4.0% 3.1% B+ 13.6% 10% 15% 20% 25% 5% A- E W 11.1% 11.4% D+ D C C- B- 22.5% E, W C+, C, C- 5.6% 15.1% 10.8% D+, D 7.7% 4.6% 11.7% 4.6% 7.4% 18.2% A, A- B+, B, B- 24.7% 23.7% D+ A- FINAL GRADE E W C B+ B B- 12.6% 23.2% 6.3% 7.0% C+ A, A- B+, B, B- C+, C, C- D+, D E, W 35% D 1.3% 2.6% 4.3% C- 3.9% 6.6% 11.4% 10% 6.3% 18.2% 15% A 5.6% 5% 30% 28.8% 25% 36.4% 12.6% 20% 18.2% 40% GRADE DISTRIBUTION OF STUDENTS IN GENERAL CHEMISTRY I WHO ATTENDED AT LEAST ONE CARSS SESSION DURING FALL 2011 Positive Dose-response Effect for Students Enrolled in General Chemistry I Historically, SAT scores have been used as a reference point when evaluating success at the college level. We have defined success as a grade of C- or better because: (i) this is the minimum grade required as a prerequisite for advancement in the major for several gateway courses; (ii) it is the minimum grade accepted for transfer course credit in any course; and (iii) as the foundation courses collectively comprise approximately one-third of the credits in the science majors, grades of less than C- are often a predictor of lack of success in upper level courses and, ultimately, in unsuccessful completion of the major. Our data indicates that student participation in CARSS services clearly increases the probability of earning a higher final grade in General Chemistry I and II, two crucial courses for all science majors and ones which prove to be stumbling blocks for many students. This effect is positively linked with the number of times a student participates in CARSS services (study group and review sessions) within a given semester. Moreover, it appears that attendance at even one CARSS review session can affect the likelihood that a student will earn a higher final grade in a course for which CARSS provides services.

Upload: others

Post on 21-May-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: STUDENT SUCCESS IN GENERAL CHEMISTRY I CARSS POSTER_2013...general chemistry and organic chemistry course sequences 2. Quantify the probability of positive outcomes (passing grades)

The Center for Achievement, Retention, and Student Success (CARSS) is a

comprehensive program that addresses retention of freshmen and transfer

students in STEM fields at the University at Albany-State University of New

York (UAlbany).

We utilize a holistic model reliant on the creation of learning communities

through group study and support. We have met the original program goals

of: sustainability, institutionalization, provision of peer tutoring and

peer/staff mentoring, ongoing project evaluation, and dissemination.

The program continues to grow as evidenced by stakeholder driven

increases in the number of tutoring sessions from 109 in year one to >600

per semester. On average, the program serves >600 students per

semester. To accommodate UAlbany STEM student population needs, the

CARSS program has made >135 appointments of STEM tutors who offer

tutoring assistance to STEM tutees. As a result, pass rates in key gateway

courses have steadily improved. Additionally, it is clear that both the small

group sessions that foster the formation of semester-long learning

communities, as well as the “pre-exam review sessions”, positively impact

grades and retention outcomes.

Goals

Increasing the 4-year graduation rates of a cohort of freshman with

declared STEM majors

Increasing the 2-3 year graduation rates of transfer students entering

into UAlbany in their junior year

Institutionalizing the Center for Achievement, Retention and Student

Success (CARSS)

Increasing retention of historically underrepresented students in STEM

majors

Creating and supporting learning communities

Strategies

Provision of free tutoring in STEM gateway courses

Provision of review/recitation sessions

Creation of an on-campus home

Establishment of a STEM Tutors training course

Aggressive dissemination: website (www.albany.edu/carss); brochure;

faculty in-class support; videos; participation in student orientations

Establishment of a bona fide, furnished, dedicated center space

Securing financial commitment from the University Administration to

permanently support tutor and coordinator salaries

Features of CARSS project sustainability include the following:

I. It has a dedicated permanent fully furnished space from which to

operate

II. UAlbany has committed to continuing the CARSS program coordinator

staff line

III. UAlbany has committed $150,000.00 annually in support of the CARSS

program at the termination of the grant funding period

Our earlier studies to identify students who were “at-risk” revealed characteristics that enabled us to identify such students early in their academic careers and target them for participation in CARSS programs. In this follow up work, we sought to verify and quantify the positive impact of CARSS participation on performance in key gateway courses. Our Specific Aims were to:

1. Determine the impact of CARSS participation on pass rates in the two-semester general chemistry and organic chemistry course sequences

2. Quantify the probability of positive outcomes (passing grades) as a function of frequency of participation in CARSS programs

DUE-0756985

Principal Investigator

Rabi A. Musah

Co-Investigators

Denise M. McKeon

Hua Shi

Project Evaluator

Patrice Lancey—Market

Research Analysis LLC

Project Program Coordinator

Dianne E. Jester

CARSS

Center for Achievement,

Retention, and Student

Success

A CARSS “learning community”. Permanent CARSS center

• Develop a program that caters to the needs of transfer and non-traditional

students

• Develop a tutor training course text

• Expand the number of tutoring and review sessions to service greater

numbers of students

Characteristics of CARSS Student Participants

Positive Dose-response Effect for Students Enrolled in General Chemistry II

Participation in CARSS study groups and review sessions positively impacts final grades in General

Chemistry & Organic Chemistry

Overall Project

Opportunities

Implementation:

Determination of Dose-response Effects

of CARSS Participation on Retention

0% 20% 40% 60% 100%80%

20% 40% 100%estimated probability of a student obtaining a C- or better final grade

60% 80%0%

0% 20% 40%

Estimated probabilities are calculated from a predictive model that used all students enrolled in

General Chemisrty I in Fall 2010 and Fall 2011.

estimated probability of a student obtaining a C- or better final grade

estimated probability of a student obtaining a C- or better final grade

STUDENT SUCCESS IN GENERAL CHEMISTRY I

Estimated Probability of a Student Obtaining a C- or Better Final Grade based on

Number of CARSS Sessions (Group and Review)Attended and SAT Math Score

60% 80% 100%

Did not attend

CARSS

Attended CARSS

1 - 4 times

Attended CARSS

5 or more times

SAT Math Score above 610

81.3%

SAT Math Score above 610

89.3%

97.2%

SAT Math Score above 610

SAT Math Score between 530 and 610

58.7%

SAT Math Score less than 530

40.7%

SAT Math Score less than 530

57.0% 73.3%

SAT Math Score between 530 and 610

92.0%

SAT Math Score between 530 and 610

84.6%

SAT Math Score less than 530

FINAL GRADE

35%

40%

30%

AB

C+

GRADE DISTRIBUTION OF STUDENTS IN GENERAL CHEMISTRY I WHO DID NOT ATTEND ANY

CARSS SESSIONS DURING FALL 2011

4.0%3.1%

B+

13.6%

10%

15%

20%

25%

5%

A-

E W

11.1% 11.4%

D+

D

C

C-

B-

22.5%

E, WC+, C, C-

5.6%

15.1%

10.8%

D+, D

7.7%

4.6%

11.7%

4.6%

7.4%

18.2%

A, A- B+, B, B-

24.7%23.7%

D+

A-

FINAL GRADE

EW

C

B+

B

B-

12.6%

23.2%

6.3%7.0%

C+

A, A- B+, B, B- C+, C, C- D+, D E, W

35%

D1.3%

2.6%

4.3%

C-

3.9%

6.6%11.4%

10%

6.3%

18.2%

15%

A5.6%

5%

30% 28.8%

25%

36.4%

12.6%

20%18.2%

40%

GRADE DISTRIBUTION OF STUDENTS IN GENERAL CHEMISTRY I WHO ATTENDED AT LEAST

ONE CARSS SESSION DURING FALL 2011

Positive Dose-response Effect for Students Enrolled in General Chemistry I

Historically, SAT scores have been used as a reference point when evaluating

success at the college level. We have defined success as a grade of C- or better

because: (i) this is the minimum grade required as a prerequisite for advancement

in the major for several gateway courses; (ii) it is the minimum grade accepted for

transfer course credit in any course; and (iii) as the foundation courses collectively

comprise approximately one-third of the credits in the science majors, grades of

less than C- are often a predictor of lack of success in upper level courses and,

ultimately, in unsuccessful completion of the major.

Our data indicates that student participation in CARSS services clearly increases

the probability of earning a higher final grade in General Chemistry I and II, two

crucial courses for all science majors and ones which prove to be stumbling blocks

for many students. This effect is positively linked with the number of times a

student participates in CARSS services (study group and review sessions) within a

given semester. Moreover, it appears that attendance at even one CARSS review

session can affect the likelihood that a student will earn a higher final grade in a

course for which CARSS provides services.