usability testing: analyzing data
TRANSCRIPT
![Page 1: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/1.jpg)
• Compile
• Summarize data
• Analyze data
• Develop recommendations
• Produce the final report
Wednesday, March 28, 12
![Page 2: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/2.jpg)
Data Analysis
Wednesday, March 28, 12
![Page 3: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/3.jpg)
next 2 weeks:
Wednesday, March 28, 12
![Page 4: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/4.jpg)
Wednesday, March 28, 12
![Page 5: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/5.jpg)
Wednesday, March 28, 12
![Page 6: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/6.jpg)
Step 1: Compile
Wednesday, March 28, 12
![Page 7: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/7.jpg)
Wednesday, March 28, 12
![Page 8: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/8.jpg)
Get it into a pile.
Wednesday, March 28, 12
![Page 9: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/9.jpg)
Get your piles sorted.
Wednesday, March 28, 12
![Page 10: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/10.jpg)
Ideally:
Wednesday, March 28, 12
![Page 11: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/11.jpg)
compile as you test.
Wednesday, March 28, 12
![Page 12: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/12.jpg)
further test the test.
Wednesday, March 28, 12
![Page 13: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/13.jpg)
keep the data legible.
Wednesday, March 28, 12
![Page 14: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/14.jpg)
• Type handwritten notes
• Verify data captures
• Back up files
Wednesday, March 28, 12
![Page 15: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/15.jpg)
Organize raw data.
Wednesday, March 28, 12
![Page 16: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/16.jpg)
Do whatever it takes to get it done.
Wednesday, March 28, 12
![Page 17: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/17.jpg)
• lists
• tallies
• matrices
• stories
• structure models
• flow diagrams
Wednesday, March 28, 12
![Page 18: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/18.jpg)
Wednesday, March 28, 12
![Page 19: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/19.jpg)
Wednesday, March 28, 12
![Page 20: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/20.jpg)
Wednesday, March 28, 12
![Page 21: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/21.jpg)
Wednesday, March 28, 12
![Page 22: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/22.jpg)
Goal:
Wednesday, March 28, 12
![Page 23: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/23.jpg)
Wednesday, March 28, 12
![Page 24: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/24.jpg)
Step 2: summarize
Wednesday, March 28, 12
![Page 25: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/25.jpg)
1. task accuracy
Wednesday, March 28, 12
![Page 26: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/26.jpg)
number of errors made per task
Wednesday, March 28, 12
![Page 27: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/27.jpg)
• categorize errors by type
• ommission
• commission
Wednesday, March 28, 12
![Page 28: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/28.jpg)
# of participants who performed:
• successfully
• successfully but with some assistance
• assistance types, tasks, products
Wednesday, March 28, 12
![Page 29: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/29.jpg)
Vital Statistics:
Wednesday, March 28, 12
![Page 30: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/30.jpg)
% performing successfully, including those who needed assistance
• regardless of time limits
• regardless of assistance needed
Wednesday, March 28, 12
![Page 31: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/31.jpg)
If this percentage is very low, you’ve got a
serious problem.
Wednesday, March 28, 12
![Page 32: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/32.jpg)
% performing successfully
• including those who corrected errors
Wednesday, March 28, 12
![Page 33: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/33.jpg)
% performing successfully within benchmark
• indicative of efficiency
Wednesday, March 28, 12
![Page 34: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/34.jpg)
2. task timings
Wednesday, March 28, 12
![Page 35: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/35.jpg)
Wednesday, March 28, 12
![Page 36: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/36.jpg)
summarize preference data
Wednesday, March 28, 12
![Page 37: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/37.jpg)
Limited choice questions:
• Sum by choice
• Chart trends
Wednesday, March 28, 12
![Page 38: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/38.jpg)
Free-form questions:• Group into meaningful categories
• Ex: particular screen, doc section, etc.
Wednesday, March 28, 12
![Page 39: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/39.jpg)
Summarize other measures
• Unnecessary returns to main navigation
• Number/type of hints and prompts
• Times site map was accessed
• Points of hesitation (and for how long)
Wednesday, March 28, 12
![Page 40: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/40.jpg)
Summarize by Group/Version
Wednesday, March 28, 12
![Page 41: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/41.jpg)
(see pages 255 - 259)
Wednesday, March 28, 12
![Page 42: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/42.jpg)
3: analyze data
Wednesday, March 28, 12
![Page 43: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/43.jpg)
What didn’t succeed?
Wednesday, March 28, 12
![Page 44: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/44.jpg)
Wednesday, March 28, 12
![Page 45: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/45.jpg)
What were the difficulties?
Wednesday, March 28, 12
![Page 46: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/46.jpg)
What were the error sources?
Wednesday, March 28, 12
![Page 47: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/47.jpg)
Prioritize problemsby severity
Wednesday, March 28, 12
![Page 48: Usability Testing: analyzing data](https://reader033.vdocuments.site/reader033/viewer/2022052823/5556f434d8b42a4a418b456b/html5/thumbnails/48.jpg)
Severity descriptions & definitions: p. 262
Wednesday, March 28, 12