2009 upa poster final version
TRANSCRIPT
Miriam L. GerverU.S. Census Bureau
Types of Observers
Subject matter experts •Technical experts, such as programers and software •
developersResearch sponsors •
Immediately Before Testing
Turn cell phone off •Use restroom facilities prior to each meeting •Avoid accepting beverages when offered •
After Testing
Researcher and observer compare meeting notes •Coordinate follow-up customer service activities •
Preparing the Observer
Logistics
Coordinate travel plans and schedules •Discuss handling sensitive information, if applicable •Discuss any special needs that should be taken •
into consideration while traveling togetherExchange cell phone numbers •Bring business cards, if possible •Bring workplace identification badges •Stress importance of promptness •
Location Specific Considerations
Take extra time into consideration if extra tasks, • such as clearing security or watching a safety video at a construction site
Dress appropriately and be mindful of an specific • clothing considerations, such as close- toed shoes at construction sites
Observer’s Role Within Usability Testing
Ask the observer to review any relevant material • in preparation for any potential content questions
Ask the observer to review the usability testing • protocol and research goals
Discuss what should be done after the meeting, • such as comparing notes
Explain the role of the observer and provide written • observer guidelines, if available
During Testing
General Instructions
Researchers should explain their role and the role • of the observer to the researcher
Researcher should sit closest to the user •Observer (in addition to the researcher) should •
take notesResearcher should allow a few minutes prior to •
the conclusion of the meeting for observers to ask relevant questions
Be respectful of the meeting’s ending time • Guidelines for Answering Questions and Observing
Be careful not to undermine the researcher or take • control of the meeting
If a user struggles with a particular task, observer • should try not to help them until invited to
Answer user questions within his or her subject • matter domain when invited by the researcher
Hold observer questions/comments for the user • until the end of the meeting
Keep the questions unbiased, on topic, and as brief • as possible
Purpose: To provide guidance for effective participation of observers in usability testing outside of a lab.
U S C E N S U S B U R E A U
Observers in the Field: Logistics and Guidelines for Usability Testing in Businesses and Institutions