students expectations assessment of student expectations in the classroom and applications for...

40
STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed Badawy, Mara Dougherty, Katie Marie Hrapczynski, Elise Larsen, Matthew Walker Miller, Breanne Robertson, Karl Schmitt, Artesha Taylor Sharma, Breanne Robertson Co-Investigators: Spencer Benson, Sabrina Kramer, Alexis Williams Presenters: Hameed Badawy and Karl Schmitt

Upload: vernon-walsh

Post on 04-Jan-2016

224 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

STUDENTS EXPECTATIONSASSESSMENT OF STUDENT EXPECTATIONS IN THE

CLASSROOM AND APPLICATIONS FOR FACULTY

Lilly Graduate Fellows:Andrea Andrew, Abdel-Hameed Badawy, Mara Dougherty, Katie Marie Hrapczynski, Elise Larsen, Matthew Walker Miller, Breanne Robertson, Karl Schmitt, Artesha Taylor Sharma, Breanne RobertsonCo-Investigators: Spencer Benson, Sabrina Kramer, Alexis Williams

Presenters: Hameed Badawy and Karl Schmitt

Page 2: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Motivation

• Student expectations for a course?• Teaching techniques?• Technologies and tools?• Different Assessments?

• Student expectations for instructors?• Types of Communication?

Page 3: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Motivation II

• Do these student expectations match faculty’s impressions?

• How can we identify similarities and discrepancies?

• How do we address these?

Page 4: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Outline• Motivation• Related Work• Tool Description• Pilot Results• Faculty Feedback• Conclusions• Q&A

Page 5: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

What Others Say…

• Sanders, et al.• Planning for 4-year curriculum/course of study• Did not compare with faculty perceptions of student

expectations (gap analysis)

• Trudeau & Barnes• Focused on instructor traits

• Royal, Eli, & Bradley• Focused on instructor goals for student development

• Umbach & Wawrzynski• Showed positive correlation with many of the techniques

our survey addressed and student engagement

Page 6: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

A Simple, Deployable ToolTool Requirements:

• Components of interest• Learning activities• Learning assessments• Technology• Instructor communication

• Broad applicability• Appropriate length• Sufficiently informative• Flexibility

Page 7: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

1st Page of Content on SurveyThis page collected demographic information and will be trimmed down or eliminated in final draft as much of this information is directly available to professors.

We have not displayed our consent form, it was however the first actual page of the survey.

Page 8: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

2nd Page of ContentThe bulk of our questions lie on this page.

Page 9: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

3rd Page of ContentOur final question and open ended question are on this page

Page 10: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

43%

27%

29%Position Distri-

bution

Tenure & Tenure-TrackOther InstructorsGraduate Students / TAs

29%

20%28%

23%Class Distribution

Freshman SophmoreJunior Senior

Participation Summary

• Pilot Student Survey • Instructor Survey

288 instructors across all disciplines at University of Maryland, College Park

816 undergraduate students enrolled in STEM courses

27 Instructors; 25 courses

73%

27%Major Distri-

bution

STEM

Non-STEM

Page 11: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Outline

• Motivation• Related Work• Tool Description• Pilot Results• Faculty Feedback• Conclusions• Q&A

Page 12: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Think, Pair, Share, Predict - Results

•Learning Activities• Classroom Discussion, Readings, Chalk-/White-Boards, Study Guides, Demonstrations

• Learning Assessment• Exam types, Projects, Papers, Homework, Class Participation

• Technology• PowerPoint, ELMS, e-Texts, Clickers, Social Media

• Instructor• Office Hours, Classroom, Non-Office Hours, Naming, Answering Emails and Phone-

calls, Assignment return, Grade posting

Page 13: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Learning Activities:Which do you think students expect the most?

Study G

uides

Disc

ussions

Readings

Demonstr

ations

Chalk/White

-bo...

0%

100%

0%0%0%

1. Study Guides

2. Discussions

3. Readings

4. Demonstrations

5. Chalk/White-board

Page 14: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Learning Activities (Students vs. Faculty)

Spring 2012

Study Guides Discussions Readings Demonstrations Chalkboard/WB0%

20%

40%

60%

80%

100%

Students Faculty Perception

Page 15: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Learning Activities (by Class)

Study Guides Discussions Readings Demonstrations Chalkboard/WB0%

20%

40%

60%

80%

100%

Freshman Sophomore Junior Senior

Spring 2012

Seniors expect more discussion, fewer demonstrations, and less use of the chalkboard/whiteboard than other students

Page 16: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

• Learning Activities• Classroom Discussion, Readings, Chalk-/White-Boards, Study Guides, Demonstrations

•Learning Assessment• Exam types, Projects, Papers, Homework, Class Participation

• Technology• PowerPoint, ELMS, e-Texts, Clickers, Social Media

• Instructor• Office Hours, Classroom, Non-Office Hours, Naming, Answering Emails and Phone-

calls, Assignment return, Grade posting

Think, Pair, Share, Predict - Results

Page 17: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Learning Assessment: Which do you think students expect the most?

Multi

ple Choic...

Essa

y-Based Ex..

.

Individual

Pro...

Gro

up Projects

Writt

en Papers

Homework

Class Parti

cip...

0%

100%

0% 0%0%0%0%

1. Multiple Choice Exams

2. Essay-Based Exams

3. Individual Projects

4. Group Projects

5. Written Papers

6. Homework

7. Class Participation

Page 18: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Learning Assessment (Students vs. Faculty)

0%

20%

40%

60%

80%

100%Student Faculty Perception

Spring 2012

Page 19: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Learning Assessment (by Class)

Multiple Choice Exams

Essay-Based Exams

Individual Projects

Group Projects

Written Papers

Homework Class Par-ticipation

0%

20%

40%

60%

80%

100%Freshman Sophomore Junior Senior

Spring 2012

Seniors expect more sophisticated learning assessment components, such as essay-based exams, group projects, and written papers

Page 20: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

• Learning Activities• Classroom Discussion, Readings, Chalk-/White-Boards, Study Guides, Demonstrations

• Learning Assessment• Exam types, Projects, Papers, Homework, Class Participation

•Technology• PowerPoint, ELMS, e-Texts, Clickers, Social Media

• Instructor• Office Hours, Classroom, Non-Office Hours, Naming, Answering Emails and Phone-calls,

Assignment return, Grade posting

Think, Pair, Share, Predict - Results

Page 21: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Technology: Which do you think students expect the most?

PowerPoint

Learn

ing Manag..

.

E-Textb

ooks

Socia

l Media

Clicke

rs

0%

50%

0%0%

50%

1. PowerPoint

2. Learning Management System (ELMS, etc)

3. E-Textbooks

4. Social Media

5. Clickers

Page 22: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Technology (Students vs. Faculty)

0%

20%

40%

60%

80%

100%

Student Faculty Perception

Spring 2012

Page 23: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Technology (by Class)

Powerpoint Learning Management

System

e-Textbooks Social Media Clickers0%

20%

40%

60%

80%

100%

Freshman Sophomore Junior Senior

Spring 2012

Fewer freshmen expect PowerPoint compared to other students

Students tend not to expect e-textbooks and social media in STEM courses

Page 24: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

• Learning Activities• Classroom Discussion, Readings, Chalk-/White-Boards, Study Guides, Demonstrations

• Learning Assessment• Exam types, Projects, Papers, Homework, Class Participation

• Technology• PowerPoint, ELMS, e-Texts, Clickers, Social Media

•Instructor Availability• Office Hours, Classroom, Non-Office Hours, Naming,

Answering Emails and Phone-calls, Assignment return, Grade posting

Think, Pair, Share, Predict - Results

Page 25: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Instructor Availability: Which do you think students expect the most?

Offi

ce H

ours

Inte

racti

on wi...

Accessi

bility ...

Know Student N

...

0% 0%0%

100%

1. Office Hours

2. Interaction with Students in Class

3. Accessibility Outside Office Hours

4. Know Student Names

Page 26: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Instructor Availability (Students vs. Faculty)

Office Hours Interaction with Students in Class

Accessible Outside Office Hours

Know Student Names

0%

20%

40%

60%

80%

100%

Student Faculty Perception

Spring 2012

Page 27: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Instructor Availability (by Class)

Office Hours Interaction with Students in Class

Accessibility Outside Office

Hours

Know Student Names

0%

20%

40%

60%

80%

100%Freshman

Sophomore

Junior

Senior

Spring 2012

Page 28: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Interesting Comparisons - Results

• Honors vs. Non-honors students

• 200 vs. 400 level course comparison

Page 29: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Honors vs. Non-Honors Students

0%

20%

40%

60%

80%

100%Honors

Non-Honors

Spring 2012

Learning Assessment Components Comparison

In general, honors students have fewer expectations compared to non-honors students. This trend was also observed with learning activities components.

Page 30: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Comparison of Student Response for BSCI 223 and BSCI 440

Po

we

r P

oin

t slid

es

Le

arn

ing

Ma

na

ge

me

...

e-T

ext

bo

oks

Stu

dy

gu

ide

s

So

cia

l Me

dia

In-c

lass

dis

cuss

ion

s

Cla

ss p

art

icip

atio

n_

x...

Mu

ltip

le c

ho

ice

_x0

0...

Gro

up

Pro

ject

s

Ho

me

wo

rk

Writ

ten

Pa

pe

rs

Ess

ay-

ba

sed

Exa

ms

Sm

all

dis

cuss

ion

_x0

...

Re

ad

ing

s o

the

r_x0

00

...

Ind

ivid

ua

l Pro

ject

s

Clic

kers

Te

xtb

oo

ks

De

mo

nst

ratio

ns

Ch

alk

bo

ard

/WB

0%

20%

40%

60%

80%

100%

BSCI 223 BSCI 440

Page 31: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Outline

• Motivation• Related Work• Tool Description• Pilot Results• Faculty Feedback• Conclusions• Q&A

Page 32: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Faculty Feedback

“I thought this survey was great at getting a cross section of what my students expected from the class. Plus, we are trying some new formats for the course, and we want to see how the student body changes. I was surprised at some the expectations, but the complaint of the majority: this class is too much work is wrong, in my opinion.”

Page 33: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

“What misconceptions do you think faculty have about students?”

• Students had the opportunity to comment on their perceptions of faculty misconceptions

• Dominant themes included:• Constraints on student time• Student effort• Student attitude toward classes

• Other themes: • Faculty communication• Effectiveness of pedagogy• Course pace• Overall comprehension

Page 34: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

“What misconceptions do you think faculty have about students?”

“We don't want to be engaged. I am very frustrated that so many of my classes are so geared toward the exam, yes I want to learn the information but I could just read a book. I want to be engaged.”

Page 35: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

“What misconceptions do you think faculty have about students?”

“That students prefer an excessive amount of ‘easy’ questions on exams in comparison to a shorter amount of more difficult questions.”

Page 36: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

“What misconceptions do you think faculty have about students?”

“That the students know exactly what the faculty member expects of them…every teacher has their own standards and expectations.”

Page 37: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Conclusions

• Students and instructors do not always agree on expectations in the classroom.

• Many students feel that instructors adopt a condescending attitude and underestimate their abilities.

• This tool provides an early opportunity for instructors and students to communicate and to improve learning.

Page 38: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Reflection

• Which student expectations do not match your current teaching style?

• What curriculum changes might you make based on this information?

• Are there questions specific to your course or to your discipline that you would want to add?

Page 39: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Coming this fall…

Student Survey Tool• Improvements to pilot survey will be made

based on faculty and student feedback• The refined survey can be customized and

available for individual faculty use• Format for course management system at UMD

for easy distribution

Page 40: STUDENTS EXPECTATIONS ASSESSMENT OF STUDENT EXPECTATIONS IN THE CLASSROOM AND APPLICATIONS FOR FACULTY Lilly Graduate Fellows: Andrea Andrew, Abdel-Hameed

Thank You

• UMCP Center for Teaching Excellence• Spencer Benson, Sabrina Kramer, Alexis Williams

• Instructors and students who participated in the surveys

• Faculty who distributed the student survey