a user-friendly approach to streamlining the collection and analysis of slo evidence dave karp &...
TRANSCRIPT
![Page 1: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/1.jpg)
A User-Friendly Approach to Streamlining the Collection
and Analysis of SLO Evidence
Dave Karp&
Tom Vitzelio
![Page 2: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/2.jpg)
Embedded Assessments
![Page 3: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/3.jpg)
What is Embedded Assessment?
Take place in a class or a group of classes
Determines whether students are learning pre-established learning outcomes
Take advantage of pre-existing student motivation to perform well
Assess what is actually taught
![Page 4: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/4.jpg)
Types of Course-Embedded Assessment Exams Research Papers and Projects Performances Field Experiences, Lab Reports and
Internships Pre/Post Comparisons Student Portfolios Capstone Evaluations
![Page 5: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/5.jpg)
Advantages of Embedded Assessment
Student motivation is high because the assessment activity is part of a course activity
Costs are reduced because incentives are unnecessary
It usually does not require additional student time as it is part of the curriculum
It is faculty-driven and thus, more likely, to be used for improvement
Because it’s linked to the curriculum, it’s more likely to identify specific curricular needs/deficiencies
Feedback to faculty is usually quick
![Page 6: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/6.jpg)
Disadvantages of Embedded Assessment
Faculty commitment is absolutely essential, but can be hard to get
Faculty resistance to the process may be substantial
Achieving agreement among faculty on an assessment approach across courses is a challenge
Usually there are no comparable data
![Page 7: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/7.jpg)
SLOs Assessment vs. Grades
Identified Learning Outcomes
Student 1 Student 2 Student 3 Student 4 Student 5 LearningOutcomeAverage
Spelling 3 4 1 2 3 2.6
Grammar 2 5 3 2 5 3.4
Punctuation 4 5 2 3 4 3.6
Structure 4 3 4 5 3 3.8
TOTAL 13 17 10 12 15
Individual Student Grade: C A D C B
![Page 8: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/8.jpg)
An “All-Purpose” Rubric Form to Streamline SLO Assessments
![Page 9: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/9.jpg)
Workshop Focus Our focus is on a tool that makes it
easy to Grade a regular assignment, and Assess students’ performance on a
course level SLO The tool is an “all purpose rubric”
form developed by Chaffey’s Business department
![Page 10: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/10.jpg)
Benefits of the Rubric Automates the grading process Provides a checklist Easily adjustable Can be distributed to students
before and/or after collecting the assignment
May be as simple or complex as the faculty member desires
Quickly and easily enables the SLO assessment
![Page 11: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/11.jpg)
Excel Terminology Worksheet
An individual spreadsheet Workbook
A collection of worksheets combined in a file
Cell The intersection between a row and a
column in a worksheet
![Page 12: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/12.jpg)
May be Simple or Complex
Examples
![Page 13: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/13.jpg)
Preparing Your Rubric Open the All Purpose file Save it with a new name
“Assignment 2 Grading and Assessment” Fill in line items Assign weighted values for each item Fill in the total points possible on the
assignment
![Page 14: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/14.jpg)
Preparing Your Rubric Make copies of the worksheet to fill
in for each student in the class Type each student’s name in the
worksheet tab The student’s name automatically
appears on the worksheet Evaluate the students’
performances
![Page 15: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/15.jpg)
The Assessment Once the grading (evaluation) is
complete, the workbook contains all the data needed to conduct an assessment
All you do is make a copy of the same rubric you used to grade the assignment
The trick is Excel’s 3D Reference function
![Page 16: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/16.jpg)
The Assessment Examples
![Page 17: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/17.jpg)
How to Do a 3D Reference Make another copy of the blank
worksheet Type “Assessment” into the
Worksheet tab click in cell O4, which is the cell
containing the score on the first item
Type =AVERAGE(
![Page 18: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/18.jpg)
How to Do a 3D Reference click on the tab for Student 1's
worksheet – Then click in cell O4 Press down on the “Shift” key and
while still holding it down, click on the tab for the last student worksheet
![Page 19: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/19.jpg)
How to Do a 3D Reference Without going to a different sheet, click
in the formula bar (the one labeled “fx” near the top of the page)
You will notice that there is a formula there that reads something like this: =AVERAGE('Student 1:Student 5'!O4
Type a “)” at the end of the formula Click on the green check to the left of
the formula bar (or press the “Enter” key)
![Page 20: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/20.jpg)
How to Do a 3D Reference Go back to the Assessment worksheet Cell O4 contains the average of all the
students’ scores for that line item! Copy the formula in cell O4 and paste
it into all of the other cells in column O that correspond to one of the rubric’s line items
![Page 21: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/21.jpg)
How to Do a 3D Reference Once done, you have a worksheet
that shows: The class performance on each line
item, and The overall average score on the
assignment
![Page 22: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/22.jpg)
The Assessment This worksheet now contains the
class assessment on this project The only extra work required on top
of the grading for the assignment was to spend a few minutes creating the Assessment worksheet
Now, all you have to do is talk about the results with your colleagues!
![Page 23: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio](https://reader036.vdocuments.site/reader036/viewer/2022062407/56649ea75503460f94baa13e/html5/thumbnails/23.jpg)
A User-Friendly Approach to Streamlining the Collection
and Analysis of SLO Evidence
- The End -