tests and quizzes (samigo) 2011

Tests & Quizzes (aka SAMigo)

Christine Doherty, Stanford UniversityJune 16, 2011

Agenda

• Future of T&Q: Development Dilemmas• Community Contribution• 2.8 Highlights• 2.9 Plans• Q&A

Future of T&Q:Development Dilemmas

Guiding Principles

Flexibility/FreedomReliability/Error-Free

Development Focus

Improve UI/InteractionAdd New Features

Project Management

Stanford as GatekeeperModularize/Distribute

Community Contribution

New Release Process

http://confluence.sakaiproject.org/confluence/display/SAM

Rationale

• User experience reviews are critical:

• New features can cause clutter in UI, confusion, bad user experience

• New features can clash with existing or planned features and lead to unexpected behavior

• Stanford only has one designer to tackle the workload, so we need help

Requirements for Contributions

Clear specs are a must:

• Rationale for new feature/enhancement

• Description of expected behavior

• Documentation of all affected screens

• Screen shots desirable

TimelineDate Milestone

June 1 Contributor submits design specs for new feature or enhancement via JIRA. SAMigo developers route spec to UX team for review.

Jun 15 Stanford provides initial feedback on specs

July 1 Contributor responds with revisions July 15 Stanford gives second round of feedback August 15 Contributed code QA'ed to revised spec and submitted to

Stanford September 1 SAMigo code freeze for release; Sakai QA team begins

2.8 Highlights

Respondus Integration before 2.8

Respondus Sakai – T&Q

Question Types ChangedMissing Metadata

Respondus Integration in 2.8

Respondus Sakai – T&Q

QTI XML or Zip file from RespondusImports to Sakai Tests & Quizzes

Respondus Integration

Respondus Integration

Respondus Integration

Respondus Sakai – T&Q

Respondus Sakai – T&Q

Record Average Score

• New Feature: ability to record average score for multiple submissions

• Redesigned UI for student’s Submitted Assessments list to accommodate displaying average scores

• Contributed by Rice University

Record Average Score

Record Average Score

Record Average Score

Record Average Score

Record Average Score

Record Average Score

Record Average Score

Record Average Score

Record Average Score

Release Scores Only

• Based on feedback from instructors wanting to show students their scores without allowing them to see questions again (since questions are reused in subsequent tests)

• Solution is to separate out scores from rest of feedback options

Release Scores Only to Students

Release Scores Only

Clarification of Settings

Send zero scores to Gradebook for non-submission records

• Clash of scoring rules in Tests & Quizzes and Gradebook caused inability to set zero scores for non-submission records for inclusion in course grade calculation

• Solution is to allow instructors to explicitly enter a zero score for a non-submission record that gets sent to gradebook

• Patch contributed by Longsight

Send zero scores to Gradebook for non-submission records

Send zero scores to Gradebook for non-submission records

Send zero scores to Gradebook for non-submission records

Send zero scores to Gradebook

Send zero scores to Gradebook for non-submission records

Send zero scores to Gradebook for non-submission records

Send zero scores to Gradebook for non-submission records

Rich Text Entry for Short Answer/Essay

• Instructors from several institutions requested a way for students to enter rich text in essay questions for equations, foreign characters, or just general formatting

• Solution is to present students with the ability to use the FCKeditor in Short Answer/Essay questions.

• Contributed by Longsight

Rich Text Entry for Short Answer/Essay

Rich-text for Short Answer

Rich-text for Short Answer

Publish Action

• Based on feedback that Settings and Publish actions were redundant, both leading to Settings page

• Solution is to link Publish action to Publish Assessment page where settings are verified and notification added (if desired)

Publish Action

Publish Action

Publish Action

Publish Action

Remove Assessment Types

• Assessment Types often prove to be confusing to instructors, since they may not know what the labels mean and what settings go with them

• One solution is to remove any trace of assessment types with a sakai property (samigo.showAssessmentTypes=False)

• Contributed by Longsight

Remove Assessment Types

Remove Assessment Types

Remove Assessment Types

2.9 Plans

Stanford contributions for 2.9

• Restyling and rewriting of warning messages

• Reset selection and warning messages redraw at current question, instead of top of page

• Reworking automatic submission logic

• Validation for numeric response questions

• Count Characters button for Short Answer/Essay questions

• Render part information and images in Print view

Community contributions for 2.9

• Redesign of main Assessments page (Longsight)

• Calculated question type (University of Dayton)

• Survey – Matrix of Choices question type (Rutgers)

• Extended Matching Item question type (University of Cape Town)

Redesign of Main Assessments Page

Redesign of Main Assessments Page

Contacts

Questions and feedback: samigo-dev@lists.stanford.edu

Lydia Li, Stanford University Project Manager lydial@stanford.edu

Karen Tsao Samigo Developer ktsao@stanford.edu

Homepage:http://confluence.sakaiproject.org/confluence/display/SAM

Online Final Exams Using Sakai at Stanford University

Jamie Tsui

9:45 AM - 10:15 AM in Beaudry B

Questions?