Extremely Rapid Usability Extremely Rapid Usability TestingTesting

(ERUT)(ERUT)

When you can’t do anything do something… its better than nothingWhen you can’t do anything do something… its better than nothing

(K. Holtzblatt)(K. Holtzblatt)

What is ERUTWhat is ERUT

Discount usability methodDiscount usability method Evaluation vs discovery methodEvaluation vs discovery method Mash up of informal HCI methodsMash up of informal HCI methods

– QuestionnairesQuestionnaires– Co discoveryCo discovery– Storyboards Storyboards – Usability testingUsability testing

Short time framesShort time frames– Less than 20 minutesLess than 20 minutes

Provides insights onlyProvides insights only

GoalGoal

Narrow Focus onlyNarrow Focus only Two objectives:Two objectives:

– Assess the usefulness of the core functionality Assess the usefulness of the core functionality of the productof the product

– Find major usability problems in that core Find major usability problems in that core functionality functionality

The MethodologyThe Methodology

Recruit participants on the flyRecruit participants on the fly Prescreen questionnairePrescreen questionnaire Core tasks that reflect the product USPCore tasks that reflect the product USP Run the testRun the test Record results using storyboardsRecord results using storyboards Post test interviewPost test interview

Recruit participantsRecruit participants

Advantage of ERUT in a trade booth contextAdvantage of ERUT in a trade booth context– Broad brush of users in one place at one timeBroad brush of users in one place at one time– They are in the booth willinglyThey are in the booth willingly– A “hallway methodology” attracts them to the A “hallway methodology” attracts them to the

boothbooth

Prescreen QuestionnairePrescreen Questionnaire

Short questionnaire that screens for that Short questionnaire that screens for that target audiencetarget audience

Find the users three core tasksFind the users three core tasks– Compare to products USP tasksCompare to products USP tasks

Define three core tasksDefine three core tasks

Representative of the core functionality of Representative of the core functionality of the productthe product

One task should reflect the heart of the One task should reflect the heart of the products USPproducts USP

Tasks need to be motivationalTasks need to be motivational Product should be able to do these tasksProduct should be able to do these tasks

Run the testRun the test

Run one task onlyRun one task only– Ask the participant to choose the task of interestAsk the participant to choose the task of interest

Co – discoveryCo – discovery– If participants know each other than test in pairsIf participants know each other than test in pairs– Equally or more important to observe comments Equally or more important to observe comments

Active Intervention or coaching if single Active Intervention or coaching if single participantparticipant

Recording results using StoryboardsRecording results using Storyboards

Use hardcopy screenshots to record the Use hardcopy screenshots to record the story of where users traveled through the story of where users traveled through the interface to complete the taskinterface to complete the task

- Paper is cheaper and does not require the - Paper is cheaper and does not require the hours of reviewing video tape.hours of reviewing video tape.

Post Test InterviewPost Test Interview

Clarify and follow up on any remaining Clarify and follow up on any remaining questionsquestions

Key is to make the questions fit the trade Key is to make the questions fit the trade booth atmospherebooth atmosphere– Work them into the conversationWork them into the conversation– Expect not to ask them allExpect not to ask them all

Test Artifacts for AnalysisTest Artifacts for Analysis

Prescreen QuestionnairePrescreen Questionnaire– Identifies target audience, core tasks and Identifies target audience, core tasks and

indicates alignment with products USPindicates alignment with products USP

Storyboard screensStoryboard screens– Records task, task success, user comments, Records task, task success, user comments,

visual picture of paths taken visual picture of paths taken

Post test surveyPost test survey– optionaloptional

ERUT AdvantagesERUT Advantages

Narrow focus on Business goals and core Narrow focus on Business goals and core functionality produces valuable insightsfunctionality produces valuable insights

Rapid gathering of good quality user Rapid gathering of good quality user feedbackfeedback

Easy access to broad brush of usersEasy access to broad brush of users Fluid –adaptable to changeFluid –adaptable to change

ERUT DisadvantagesERUT Disadvantages

Narrow FocusNarrow Focus Rapid hectic environmentRapid hectic environment Participants are in a trade show frame of Participants are in a trade show frame of

mind and their comments are not reflective mind and their comments are not reflective of their real world.of their real world.

SummarySummary

Valuable methodology to have in your tool Valuable methodology to have in your tool kit when conference or trade show kit when conference or trade show opportunity arisesopportunity arises

Insights onlyInsights only Useful when faced with something is better Useful when faced with something is better

than nothingthan nothing