measuring student success in mastering physics & astronomy tips & techniques to consider

Measuring Measuring Student Success Student Success

in Mastering in Mastering PhysicsPhysics

& Astronomy& AstronomyTips & Techniques to Tips & Techniques to

ConsiderConsider

Scott Hildreth - Chabot Scott Hildreth - Chabot CollegeCollege

2Scott Hildreth - Chabot College - Febrarury 2013

A bit about me…A bit about me…

Teaching Physics & Astronomy since 1989Teaching Physics & Astronomy since 1989

Chabot College, CSU East Bay, UC BerkeleyChabot College, CSU East Bay, UC Berkeley

Astro sections ~ 50 students (3 hours/week)Astro sections ~ 50 students (3 hours/week)

Physics sections ~ 30 – 45 students (7 Physics sections ~ 30 – 45 students (7 hours/week)hours/week)


Ways I used Ways I used MasteringMastering initially…initially…

In PhysicsIn Physics – for automated – for automated grading of traditional grading of traditional Homework problems in a once-Homework problems in a once-a-week assignmenta-week assignment

In AstronomyIn Astronomy – for tracking – for tracking student access and time using student access and time using animated tutorialsanimated tutorials


Why did you decide to measure Why did you decide to measure student data? student data? External InfluencesExternal Influences

Rich History in Physics Rich History in Physics Education Research Education Research Assessments (FCI, MBT, CSEM)Assessments (FCI, MBT, CSEM)

Improve results w/ Mastering?Improve results w/ Mastering?

Retention/Success ComparisonsRetention/Success Comparisons Can I justify use/time/effort?Can I justify use/time/effort?


Why did you decide to measure Why did you decide to measure student data? student data? Internal InfluencesInternal Influences

Expanding opportunity to use Expanding opportunity to use new resourcesnew resources

Web, YouTube, SimulationsWeb, YouTube, SimulationsBut What works? For Whom?But What works? For Whom?How did learning preferences How did learning preferences

impact resource use/success?impact resource use/success?


An An “Aha” “Aha”

momenmomentt


Mastering Captures DataMastering Captures Data

Cannon, Annie

Chandrasekhar

Einstein, Albert

Feynman, Richard

Hawking, Stephen

Herschel, Carol

Klumpke-Roberts,

Lightman, Alan

Perlmutter, Saul

Rubin, Vera

Quickly see who

is working



Quickly see what they miss

& why



Quickly what

they miss & why


How I got started… How I got started… Using Diagnostic Data from HWUsing Diagnostic Data from HW Changed Lectures Changed Lectures

““Tuned” delivery to key problemsTuned” delivery to key problems Focused on Common ErrorsFocused on Common Errors

Changed Class FormatChanged Class Format More peer learning with group workMore peer learning with group work Correlated Group Work to RetentionCorrelated Group Work to Retention


Another Another AHA AHA

moment…moment…MeasurinMeasurin

g and g and CorrelatinCorrelatin

g Datag Data


Mastering Enables RAPID Mastering Enables RAPID Data AnalysisData Analysis


Retrieving and Using Retrieving and Using Mastering DataMastering Data

Download Grade Book to ExcelDownload Grade Book to Excel Create total columns for various Create total columns for various

assignment typesassignment types Graph totals against one anotherGraph totals against one another

Now I spend my time looking at data Now I spend my time looking at data and coming up with new ways to try and coming up with new ways to try things…things…


Fall 2012 Astro Data from Excel


Does HW improve Quiz Does HW improve Quiz Scores?Scores?


Does Homework SuccessDoes Homework SuccessCorrelate to Exam Success?Correlate to Exam Success?


Homework Quizzes DO Homework Quizzes DO Correlate better with ExamsCorrelate better with Exams


Ways I Use Mastering Ways I Use Mastering Now…Now…

Calculus-based PhysicsCalculus-based Physics HomeworkHomework

Introductory “prelecture” assignments for each chapterIntroductory “prelecture” assignments for each chapter Weekly homework assignments Weekly homework assignments HW Quiz in class to ensure students working authenticallyHW Quiz in class to ensure students working authentically

In-class collaborative In-class collaborative group workgroup work (teams) (teams) LectureLecture – doing problems together – doing problems together Exam Review Exam Review

In-class competition (teams)In-class competition (teams) Outside of class preparationOutside of class preparation

Extra CreditExtra Credit & Remedial Help & Remedial Help


Ways I Use Mastering Ways I Use Mastering Now…Now…

Introductory AstronomyIntroductory Astronomy HomeworkHomework

Weekly homework assignments with ranking tasksWeekly homework assignments with ranking tasks Reading quizzesReading quizzes Links to additional reading, videos, and resourcesLinks to additional reading, videos, and resources

LectureLecture – doing online simulations together – doing online simulations together Exam Review Exam Review

Outside of class preparationOutside of class preparation

Extra CreditExtra Credit & Remedial Help & Remedial Help


A quick caveat…A quick caveat…

You don’t have to do all of these at once! You don’t have to do all of these at once! Try one new thing a term…but measure it!!Try one new thing a term…but measure it!!


Long Term Benefit: Long Term Benefit: Data!Data!


Mastering Enables Data Mastering Enables Data Analysis: Learning Analysis: Learning

OutcomesOutcomes


Personal GoalsPersonal Goals

Track student usageTrack student usage easily easily

Take earlier, positive actionTake earlier, positive actionStudents obviously strugglingStudents obviously strugglingThose working hard, and…Those working hard, and…Those hardly working.Those hardly working.


Current Data Analysis Current Data Analysis ProjectsProjects

Identify most-missed problems Identify most-missed problems with diagnostic datawith diagnostic data

Add messages, hints, YouTube Add messages, hints, YouTube to suggest and target student to suggest and target student thinkingthinking““online office hour” nudges…online office hour” nudges…

See if students do better See if students do better


Questions? Discussion?Questions? Discussion?

Check out the resource list and current Check out the resource list and current researchresearch http://www.chabotcollege.edu/faculty/shildreth/ma

stering

Login to my classes to look aroundLogin to my classes to look around Email me with questions!Email me with questions!

Images reprinted in the online presentation and available online were Images reprinted in the online presentation and available online were borrowed with permission from "e-mail.this.book", The Cartoon Bank, borrowed with permission from "e-mail.this.book", The Cartoon Bank, Alfred A. Knopf, NY, 1996. “The Far Side” comics by Gary Larson Alfred A. Knopf, NY, 1996. “The Far Side” comics by Gary Larson cannot be distributed online.cannot be distributed online.

measuring student success in mastering physics & astronomy tips & techniques to consider

Documents

student data

astro data

mastering initiallyin

mastering captures dataquickly

mastering captures datacannon

diagnostic data

results w mastering

hoursweek physics sections