technology and rubrics - adea€¦ · • multiple sources of assessment send a rubric to a variety...
TRANSCRIPT
![Page 1: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/1.jpg)
David Taylor, Ed. D.Director, Educational and Technology ServicesUniversity of Texas Dental Branch at Houston
![Page 2: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/2.jpg)
Writing and conceptualizing Rubrics• Reflecting• Listing criteria• Grouping and labeling• Application
Incorporating rubrics into scoring process Automated scoring with rubrics
![Page 3: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/3.jpg)
![Page 4: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/4.jpg)
![Page 5: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/5.jpg)
![Page 6: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/6.jpg)
![Page 7: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/7.jpg)
Online tool for creating, administering and analyzing surveys Includes Current Student Inventory, with over 500 validated
questions for evaluating educational uses of technology Choose from a large collection of model surveys and validated
questions created by Flashlight staff or adapt surveys, rubrics, and item banks created by other users, at other institutions
Use a variety of question types to create your own items, including rubrics;
Flashlight Online
![Page 8: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/8.jpg)
• Create rubricsFlashlight Online includes two rubric builders, so a rubric can be shown in an expanded or collapsed form.
• A matrix approach to rubricsFaculty can collect rubric-based student responses , for specific skill assessments, in a single, shared database and compare across different courses, different years
• Sharing RubricsFlashlight Online users can build on rubrics originally created by other users.
• Multiple sources of assessmentSend a rubric to a variety of judges who then each use the rubric to rate the work.
![Page 9: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/9.jpg)
Dimension 1: Problem Identification
![Page 10: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/10.jpg)
Question and assessment authoring Question banking by learning objective Integration with learning management
systems Instant feedback to
enhance learning Secure delivery for
high-stakes exams On-demand results,
reports and item analysis
![Page 11: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/11.jpg)
Captivate/Robodemo Drag and Drop Essay Explanation Fill in Blanks Hotspot Likert Macromedia Flash Matching Matrix
Multiple Choice Multiple Response Numeric Pull-down List Ranking Select a Blank Spoken Response Text Match True/False Yes/No
![Page 12: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/12.jpg)
The Questionmark Scoring Tool Offers:◦ In-line grader’s annotations as well as overall comments ◦ Up to 12 scoring dimensions within each rubric ◦ Individual scoring comments for each dimension of the
rubric ◦ Automated, customized, template-driven emails relaying
scores and comments to participants ◦ The ability to assign different rubrics to the same
question, depending on how the question is used
The Questionmark Scoring Tool helps both individual and multiple graders maintain consistency in marking constructed answers. This is achieved by using the Scoring Tool to define rubrics, or scoring rules, for each question.
![Page 13: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/13.jpg)
![Page 14: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/14.jpg)
![Page 15: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/15.jpg)
![Page 16: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/16.jpg)
![Page 17: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/17.jpg)
![Page 18: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/18.jpg)
![Page 19: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/19.jpg)
Can computers be trusted for natural language reading and scoring?◦ Can a machine read, understand and grade an
essay response? ◦ Issues and problems
Simulators as assessment devices for clinical skills
![Page 20: Technology and Rubrics - ADEA€¦ · • Multiple sources of assessment Send a rubric to a variety of judges who then each use the rubric to rate the work. Dimension 1: Problem Identification](https://reader034.vdocuments.site/reader034/viewer/2022050301/5f6a37d4a8cf644982475bfb/html5/thumbnails/20.jpg)
General guides and information on Rubrics http://www.educationatlas.com/rubrics.html http://www.cotf.edu/ete/teacher/rubrics.html http://www.tltgroup.org/resources/Rubrics.htm#ReferencesGuides
Rubric for Rubrics http://www.tltgroup.org/resources/Rubrics/A_Rubric_for_Rubrics.htm
“First Generation” Tools for Creating Rubrics http://rubistar.4teachers.org/index.php http://www.teach-nology.com/web_tools/rubrics/
“Second Generation” Tools for Creating Rubrics: Flashlight 2.0 http://www.tltgroup.org/resources/flashlight/rubrics.htm (Mullinix) http://www.tltgroup.org/Flashlight/FLO2/rubrics.htm#Creating_rubrics
(Ehrmann)
Questionmark Perception http://www.questionmark.com/us/perception/index.aspx