Usability Testing: Targeting Mobile Devices

Download Usability Testing: Targeting Mobile Devices

Post on 16-Jan-2015

160 views

Category:

Design

1 download

Embed Size (px)

DESCRIPTION

How to use Steve Krug's Rocket Surgery methodology applied to Mobile Device Usability Testing.

TRANSCRIPT

<ul><li> 1. Introduction to User Testing Wayne Pau, Emerging Technologies SAP Mar28, 2013Internal</li></ul> <p> 2. Introduction to User Testing Implementing Quick &amp; Effective User Testing Wayne Pau, Emerging Technologies SAP Feb 4, 2013 MEICs Mobile Accelerator Programme Workshop #6 3. My Apology SlideIf I'm curt with you it's because time is a factor. I think fast, I talk fast and I need you guys to act fast if you wanna get out of this. So, pretty please... with sugar on top - Winston Wolfe (Pulp Fiction) 2012 SAP AG. All rights reserved.Internal3 4. Background Info Giving credit to Steve Krug 5. Buy this bookSteve Krug2nd BookCheap &amp; Dirty Usability Testing161 pages 2012 SAP AG. All rights reserved.Internal5 6. then buy this next (and read it first)Steve Krug1st BookWeb-Focused216 pages 2012 SAP AG. All rights reserved.Internal6 7. Even more info Website:Advanced Common Sense http://www.sensible.com/ 2012 SAP AG. All rights reserved.Internal7 8. Steve Krug Recorded Samplehttp://www.rocketsurgerymadeeasy.com/ http://www.youtube.com/watch?feature=player_embedded&amp;v=Q ckIzHC99Xc All of Chapter 2 in Rocket Surgery Made Easy 2012 SAP AG. All rights reserved.Internal8 9. The Basics Some general info about Usability Testing 10. What User Testing is NotNot statistically relevant Quantitative ResearchNot a Market Focus GroupNot for Baking-Off UI ChoicesNot mining for new UI Designs/PatternsNot Contextual Design or Voice of God interviews 2012 SAP AG. All rights reserved.Internal10 11. Why do User/Usability Testing1.No Product is perfect. Everything can be Improved.2.Serious problems are easy to Spot. Encountered by most Users.3.User-Centered approach makes for better products. 2012 SAP AG. All rights reserved.Internal11 12. How to do User Testing One Morning per MonthFind 3x Participants for 1 Hr sessionFind 3x Tasks, expand into ScenariosRecord/BroadcastDebrief in Afternoon 2012 SAP AG. All rights reserved.Internal12 13. Recruiting Users 14. # of Subjects3 or 4 for 2+ rounds3 or 4 allows testingAM, debrief in PM2x Rounds w/ 3 &gt; 1x round with 6Recruit loosely, grade on a curve 2012 SAP AG. All rights reserved.Internal14 15. Recruitment - ExceptionsIf you site is only used a particular population/relevenceIf you subject has conflicting or divergent interestsIf you app is esoteric and needs domain expertise 2012 SAP AG. All rights reserved.Internal15 16. Recruitment Good IdesOffer good Incentive (Gift Cert)Keep invitation simpleDont offer too much infoAsk Relatives/Friends/FamilyEveryone was Newbie once 2012 SAP AG. All rights reserved.Internal16 17. Testing Script A template for Usability Session 18. Script Breakdown1.Welcome2.Questions (Warm-up)3.Acclimatizing (Familiarizing Participant)4.Tasks (Prepared Scenario)5.Probing (Digging into issues)6.Wrapping Up (Close &amp; Thanks) 2012 SAP AG. All rights reserved.Internal18 19. Welcome 20. Welcome Part 1 Hi, session.. My name is Wayne Pau, and I'm going to be walking you through thisYou probably already know, but let me explain why we've asked you to come here today: We're testing a web site that we're working on to see what it's like for actual people to use it. I want to make it clear right away that we're testing the site, not you. You can't do anything wrong here. In fact, this is probably the one place today where you don't have to worry about making mistakes. 2012 SAP AG. All rights reserved.Internal20 21. Welcome Part 2 We want to hear exactly what you think, so please don't worry that you're going to hurt our feelings. We want to improve it, so we need to know honestly what you think. As we go along, I'm going to ask you to think out loud, to tell me what's going through your mind. This will help us. If you have questions, just ask. I may not be able to answer them right away, since we're interested in how people do when they don't have someone sitting next to them, but I will try to answer any questions you still have when we're done. We have a lot to do, and I'm going to try to keep us moving, but we'll try to make sure that it's fun, too. 2012 SAP AG. All rights reserved.Internal21 22. Welcome Part 3 You may have noticed the camera. With your permission, we're going to videotape the computer screen and what you have to say. The video will be used only to help us figure out how to improve the site, and it won't be seen by anyone except the people working on the project. It also helps me, because I don't have to take as many notes. There are also some people watching the video in another room. If you would, I'm going to ask you to sign something for us. It simply says that we have your permission to tape you, but that it will only be seen by the people working on the project. It also says that you won't talk to anybody about what we're showing you today, since it hasn't been made public yet. Do you have any questions before we begin? 2012 SAP AG. All rights reserved.Internal22 23. Welcome - Tips Stick to the script, stick to the script, stick to the scriptTry to remain neutral &amp; calmTest Participant (Not Subject. They are not being tested) 2012 SAP AG. All rights reserved.Internal23 24. Acclimatizing 25. Questions Part 1 Before we look at the site, I'd like to ask you just a few quick questions. First, what's your occupation? Good. Now, roughly how many hours a week would you say you spend using the Internet, including email? How do you spend that time? In a typical day, for instance, tell me what you do, at work and at home.Do you have any favorite Web sites? 2012 SAP AG. All rights reserved.Internal25 26. Questions Part 2 Now, finally, have you bought anything on the Internet? How do you feel about buying things on the Internet? And what have you bought? OK, great. We're done with the questions, and we can start looking at things. 2012 SAP AG. All rights reserved.Internal26 27. Questions - Tips Build some rapport with your ParticipantAssist in your Grade on a CurveGet Participant Talking 2012 SAP AG. All rights reserved.Internal27 28. Acclimatizing 29. Acclimatizing OK, great. Were done with the questions, and can start looking at things.First Im going to ask you to look at this page and tell me what you make of it: what strikes you about it, whose site you think it is, what you can do here, and what you can do here, and what its for. Just look around and do a little narrative. You can scroll if you want to, but dont click on anything yet. 2012 SAP AG. All rights reserved.Internal29 30. Acclimatizing - Tips Get them used to listening to instructionsGet them used to verbalizingGet them use to thinking out loud 2012 SAP AG. All rights reserved.Internal30 31. Tasks 32. Tasks Now Im going to ask you to try doing some specific tasks. Im going to read each one out loud and give you a printed copy. Im going to ask you to do these task without using Search. Well learn a lot more about how well the site works that way. And again, as much as possible, it will help us if you can try to think out loud as you go along. 2012 SAP AG. All rights reserved.Internal32 33. Tasks FoodNetwork.ca 2012 SAP AG. All rights reserved.Internal33 34. Tasks #1 FoodNetwork.caAssume you are big fan of Anna Olsen and love all her shows. You are going to be home tomorrow all day and would like to determine when she is on first on FoodNetwork tomorrow. If possible, find out: What TV series it is (she has multiple)What is the Episode AboutWhat recipes will be shown (in case you want follow along) 2012 SAP AG. All rights reserved.Internal34 35. Tasks #1 FoodNetwork.caAssume you are big fan of Anna Olsen and love all her shows. You are going to be home tomorrow all day and would like to determine when she is on first onFoodNetwork tomorrow. If possible, find out: What TV series it is (she has multiple)What is the Episode AboutWhat recipes will be shown (in case you want follow along) 2012 SAP AG. All rights reserved.Internal35 36. Tasks #2 FoodNetwork.caYouve recently come back from a short vacation to New Orleans. You had a great time and especially loved the Cajun food. Check FoodNetwork.ca for possible maincourse dinner dishes that you can try at home. Assume you will looking at following criteria to help you narrow it down: How it was ratedYou like Fish over Red MeatYou really Blacken Anything 2012 SAP AG. All rights reserved.Internal36 37. Tasks #3 FoodNetwork.caYouve had a rough week and are looking at cheering yourself up with some food. However you still want to eat healthy and really dont like nuts (actually you could be allergic). Can you find a good, quick recipe that would entice you? 2012 SAP AG. All rights reserved.Internal37 38. Tasks - Tips When in doubt *SAY NOTHING*Use every permutation of uh huh or OK possibleAim for somewhat pleased demeanorDeflect ( What would you do if I was not here?)Mine leading non-verbal clues (Is that what you expected?) 2012 SAP AG. All rights reserved.Internal38 39. Probing 40. Probing Thanks, that was very helpful.If youll excuse me for a minute, Im just about to see if the people on the team have any follow-up questions theyd like me to ask you. 2012 SAP AG. All rights reserved.Internal40 41. Tasks - Tips Relax hands-off approachAsk Why?Avoid asking for solutions or redesigning on the spot 2012 SAP AG. All rights reserved.Internal41 42. Wrap-up 43. Wrap-up &amp; Thank-you Do you have any questions for me, now that were done?Thanks. That was exactly what we need, its been very helpful. 2012 SAP AG. All rights reserved.Internal43 44. User Test Results 45. Real Testing WorldReview results right awayTriage the informationFind a Fix (or approach)Do the *LEAST* you can do to fix the problem 2012 SAP AG. All rights reserved.Internal45 46. 7 Reasons to Tweak (vs. Rebuild) 1.Cheap &amp; Cost effective2.Less work &amp; resource intensive3.Less Stressful4.Implemented Quicker5.Small &amp; more likely to be scheduled6.Less Risky than Overhaul7.Might know the issue, but not the perfect solution 2012 SAP AG. All rights reserved.Internal46 47. Waynes Issue Triage1.Is it MVP? Can we Dump the culprit?2.Is there a Small Tweak we can do?3.Was it effective enough? (Do we need to Tweak the Tweak?)4.Did we Breaking anything more Important?5.Is it a new feature? DONT ADD ANYTHING!!! 2012 SAP AG. All rights reserved.Internal47 48. Something is Better than Nothing Perfect is the Enemy of Good VoltaireA good plan executed today is better than a perfect plan executed tomorrow. -General George PattonPOGE Principle of Good Enough 2012 SAP AG. All rights reserved.Internal48 49. Thank you Contact information: Wayne Pau (wayne.pau@sap.com) Emerging Technologies </p>