2009 upa poster final version

Miriam L. GerverU.S. Census Bureau

Types of Observers

Subject matter experts •Technical experts, such as programers and software •

developersResearch sponsors •

Immediately Before Testing

Turn cell phone off •Use restroom facilities prior to each meeting •Avoid accepting beverages when offered •

After Testing

Researcher and observer compare meeting notes •Coordinate follow-up customer service activities •

Preparing the Observer

Logistics

Coordinate travel plans and schedules •Discuss handling sensitive information, if applicable •Discuss any special needs that should be taken •

into consideration while traveling togetherExchange cell phone numbers •Bring business cards, if possible •Bring workplace identification badges •Stress importance of promptness •

Location Specific Considerations

Take extra time into consideration if extra tasks, • such as clearing security or watching a safety video at a construction site

Dress appropriately and be mindful of an specific • clothing considerations, such as close- toed shoes at construction sites

Observer’s Role Within Usability Testing

Ask the observer to review any relevant material • in preparation for any potential content questions

Ask the observer to review the usability testing • protocol and research goals

Discuss what should be done after the meeting, • such as comparing notes

Explain the role of the observer and provide written • observer guidelines, if available

During Testing

General Instructions

Researchers should explain their role and the role • of the observer to the researcher

Researcher should sit closest to the user •Observer (in addition to the researcher) should •

take notesResearcher should allow a few minutes prior to •

the conclusion of the meeting for observers to ask relevant questions

Be respectful of the meeting’s ending time • Guidelines for Answering Questions and Observing

Be careful not to undermine the researcher or take • control of the meeting

If a user struggles with a particular task, observer • should try not to help them until invited to

Answer user questions within his or her subject • matter domain when invited by the researcher

Hold observer questions/comments for the user • until the end of the meeting

Keep the questions unbiased, on topic, and as brief • as possible

Purpose: To provide guidance for effective participation of observers in usability testing outside of a lab.

U S C E N S U S B U R E A U

Observers in the Field: Logistics and Guidelines for Usability Testing in Businesses and Institutions