rubrics- the versatile and practical choice february 2016
TRANSCRIPT
![Page 1: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/1.jpg)
RUBRICS: THE VERSATILE AND PRACTICAL CHOICEAssessment Day 4.0February 2016
Eric Streeter, Senior Academic Advisor
![Page 2: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/2.jpg)
Outline• What are rubrics• Why we chose to use rubrics• Creating the rubrics• Experience using rubrics in academic advising• Data
![Page 3: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/3.jpg)
WHAT ARE RUBRICS?
![Page 4: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/4.jpg)
Rubrics• Used to score or rate• Articulates what is being measured and the scale it is
being measured on• Descriptive rubrics: the gold standard
• The scales is further explained for each item being measured
![Page 5: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/5.jpg)
A Descriptive Rubric Example
Needs
Improvement (1)
Developing (2) Sufficient (3) Above
Average (4)
Clarity (Thesis
supported by relevant
information and ideas.)
The purpose of the student
work is not well-defined. Central ideas
are not focused to support the
thesis. Thoughts appear
disconnected.
The central purpose of the student work is identified.
Ideas are generally
focused in a way that
supports the thesis.
The central purpose of the student work is clear and ideas are
almost always focused in a
way that supports the
thesis. Relevant details
illustrate the author’s ideas.
The central purpose of the student work is clear and supporting
ideas always are always
well-focused. Details are relevant,
enrich the work.
![Page 6: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/6.jpg)
Your Experience with Rubrics• Academic assignments• Judged contests (talent show, costume contest, etc.)• Performance evaluations• Candidate evaluations• To an extent – some survey questions resemble rubrics
![Page 7: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/7.jpg)
WHY USE RUBRICS?
![Page 8: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/8.jpg)
The Choice: Rooted in Mapping• Direct measure for learning outcomes• Context for learning for measuring: mostly advising
appointments• Ease of use• Versatility
• Conversations in advisement appointments• “Assignments” completed by advisees• Timeframes for use
![Page 9: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/9.jpg)
Rubric VersatilityAdvising Structure:• College of Arts and Sciences• School of Architecture and
Planning• School of Engineering and
Applied Sciences• School of Management• School of Medicine and
Biomedical Sciences• School of Nursing• School of Pharmacy and
Pharmaceutical Sciences
• School of Public Health and Health Professions
• Student Advising Services• Athletics• Access to College Excellence
Program (ACE)• Daniel Acker Scholars• Educational Opportunity
Program (EOP)• Student Support Services
(SSS)• University Honors College
![Page 10: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/10.jpg)
CREATING OUR RUBRICS
![Page 11: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/11.jpg)
Rubric Tool
Baseline, form Campus Labs• Was already available to us
• Easy to access• Easy to set up
![Page 12: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/12.jpg)
Development & Testing• Developing the criteria and descriptions
• Decision to use a 3 point scale
• Testing• Several advisors form different departments• Multiple contexts• Increased support for the tool
![Page 13: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/13.jpg)
ADVISING ASSESSMENT RUBRICSMajor and General Education Requirements RubricGoals Rubric
![Page 14: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/14.jpg)
Decisions and Tradeoffs
Choice
• Flexibility for sampling method• Timeline• Sample size
Tradeoffs
• Challenges to viability of the data
![Page 15: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/15.jpg)
Decisions and Tradeoffs
Choice
• Baseline tool• Availability• Ease of use• Ease of set up
Tradeoffs
• Lack of flexibility to make certain customizations• Comment sections• Criteria descriptions• Built in reports do not say
much• Advisors cannot view the
data they entered
![Page 16: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/16.jpg)
Decisions and Tradeoffs
Choice
• Entering student person number• Demographic data • Makes using the tool faster
when other demographic data is not entered
Tradeoffs
• Some data gets lost when ID numbers get entered incorrectly
![Page 17: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/17.jpg)
Decisions and Tradeoffs
Choice
• 3 point scale• Easy to use• Required less instruction
Tradeoffs
• Less dynamic data
![Page 18: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/18.jpg)
Challenges• Training
• People do not understand what a rubric is at first• When to do the assessment
• Limitations of the Baseline tool• Challenges to the data based on the tradeoffs
![Page 19: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/19.jpg)
Successes• Positive feedback about ease of use• Every unit agreed to use at least one rubric• Data!
![Page 20: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/20.jpg)
DATA
![Page 21: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/21.jpg)
LO: Students will know the requirements for their major•Requirements Rubric
![Page 22: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/22.jpg)
LO: Students will know the requirements for their major•Requirements Rubric
![Page 23: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/23.jpg)
LO: Students will know the requirements for their major•Requirements Rubric
![Page 24: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/24.jpg)
LO: Students will know the requirements for their major•Requirements Rubric
![Page 25: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/25.jpg)
LO: Students will know their requirements for general education•Requirements Rubric
![Page 26: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/26.jpg)
LO: Students will know their requirements for general education•Requirements Rubric
![Page 27: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/27.jpg)
LO: Students will be able to select appropriate courses based on their goals
• Goals Rubric
![Page 28: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/28.jpg)
LO: Students will be able to select appropriate courses based on their goals
• Goals Rubric
![Page 29: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/29.jpg)
LO: Students will be able to select appropriate courses based on their goals
• Goals Rubric
![Page 30: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/30.jpg)
USING THE DATA
![Page 31: Rubrics- the Versatile and Practical Choice February 2016](https://reader036.vdocuments.site/reader036/viewer/2022062903/58a6ffc01a28ab4c438b47f5/html5/thumbnails/31.jpg)
“Closing the Loop”• Share data • Engage stakeholders • Make interpretations• Set targets for improvement• Brainstorm ideas for improvement• Implement changes for improvement• Continue to assess after changes are implimented