rapid turnaround usability testing: not just a pipe dream
DESCRIPTION
This was presented at the IA Summit in Phoenix, AZ. Talk Abstract: Is your usability testing always attached to a design project? And does it require a fair amount of planning, time, and resources to accomplish? Time for the designer to come up with his business questions and create a few prototypes; time for the researcher to develop an applicable discussion guide; time for the moderator to conduct the interviews, create and review the transcripts, make sense of it all, and finally come out with some solid findings and recommendations? If so, you’re in the norm. But there’s a better way that can enable you to get more insight quicker, cheaper, and with fewer people and headaches. This talk will describe how, with a little planning and a few innovative techniques, you can conduct regular, fast-turnaround usability interviews with a shoestring staff and budget. You can provide timely feedback to designers, uncover surprising problems with your site, and capture rich customer quotes – and do this week after week. By scheduling regular customer interviews regardless of the project timing, you can start to condition your designers and project managers to expect to be able to get customer input whenever they want. And exploring customers’ “native tasks” can give insights about parts of the site you and your designers would never even think to ask about. Finally, the unique debrief methodology will greatly simplify the analysis process, enabling you to quickly produce Findings and Recommendations that will be already bought-into by the team. This talk is aimed at IA’s, Usability professionals, and designers who want to learn how to get more customer input into their designs without the hassle, time, and expense of traditional usability interviews. You will walk away from this talk with a practical plan-of-action and some new techniques for conducting rapid-turnaround usability testing.TRANSCRIPT
![Page 1: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/1.jpg)
RAPID-TURNAROUNDUSABILITY TESTING:
IA Summit 2010Holly Phillips & Kyle Soucy
NOT JUSTA PIPE DREAM
![Page 2: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/2.jpg)
Over the last two years, we’veconducted 88 usability teststogether while doing rapiddesign iterations and…
we’ve never met before now!
![Page 3: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/3.jpg)
Q. How do you getmore customer inputinto your designswithout the time andexpense oftraditional usabilitytesting?
![Page 4: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/4.jpg)
A. Rapid-turnaroundUsability Testing
![Page 5: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/5.jpg)
RITE Usability Testing
Test Test TestRevise
Prototyp
e Revise
Prototyp
e
![Page 6: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/6.jpg)
How do you makedesign decisionsbased on only testing1 person?
![Page 7: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/7.jpg)
Process Overview
Define Scope Define Tasks Prototype
Conduct Testing
Debrief
Report/Present Findings
Revise Prototype
2 week iteration
![Page 8: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/8.jpg)
Key to Success…
Attendance of productdecision makers during testing!
![Page 9: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/9.jpg)
A different way to think aboutusability testing…
![Page 10: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/10.jpg)
Where’s the “rapid” in the process?
Define Scope Define Tasks Prototype
3 DAYS!
Conduct Testing
Debrief
Report/Present Findings
Revise Prototype
2 week iteration
![Page 11: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/11.jpg)
Benefits
• Team stays on the same page -- no working ina vacuum!
• Rapid feedback from end users
• Produces rapid findings and recommendations
• Team consensus on product changes
• Saves time and money
• Ingrains usability testing into the design anddevelopment process
![Page 12: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/12.jpg)
Interview-based Tasks
![Page 13: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/13.jpg)
Script
![Page 14: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/14.jpg)
“Improv Testing” Process
1. Interview participant about how they use theproduct.
2. Use the answers given in the interview tocreate tasks on the fly.
When in doubt just ask, “what was the last thing you didwhen you used this product? Can you show me?”
![Page 15: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/15.jpg)
Benefits
• Learn users true intent
• Gain the insight and feedback that truly matters
• No need to conduct an in-depth task analysis
• The unexpected -- enjoy the ride toenlightenment!
![Page 16: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/16.jpg)
Observer Debriefing
![Page 17: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/17.jpg)
Why debrief?
photo by agit8
![Page 18: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/18.jpg)
![Page 19: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/19.jpg)
How to debrief
• Do nothing• Informal discussion• Affinity diagramming.
![Page 20: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/20.jpg)
• Structured• Quote/Observation• Implication: H2, W4, Wif• Round-robin or lead + additions• After every 3-6 respondents.
![Page 21: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/21.jpg)
GeneralizationsJumping to solutionsI'm right you're wrong.
photo by subboard.com
Benefits
![Page 22: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/22.jpg)
GeneralizationsJumping to solutionsI'm right you're wrong
photo by subboard.com
Different perspectiveootb thinkingImmediate "transcript" and importance.
Benefits
![Page 23: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/23.jpg)
http://www.apw.cnyric.org/teacherpage3.cfm?teacher=438
![Page 24: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/24.jpg)
Report Findings
• fast-turnaround• no surprises• recommendations, not just problem• speeds up start of next round of designs.
![Page 25: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/25.jpg)
Gotchas!
![Page 26: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/26.jpg)
• Not getting the team involved
• Not finding a moderator comfortable withinterview-based tasks
• Not sticking to the structure in the debrief.
Gotchas!
![Page 27: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/27.jpg)
photo by nike
Go for it.
![Page 28: Rapid turnaround usability testing: not just a pipe dream](https://reader035.vdocuments.site/reader035/viewer/2022081717/54c766e14a79597f648b456e/html5/thumbnails/28.jpg)
Thank You!