UX testing for

mobile appMarine Barbaroux

@miss embe - @mobilefoo

Who am I?

Definition

The extent to which a productThe extent to which a product can be used by specified usersThe extent to which a product can be used by specified users to achieve specified goalsThe extent to which a product can be used by specified users to achieve specified goalsThe extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction

The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use.

Expert only(Guidelines based)

Automated(Large numbers)

Involving Users(Qualitative info)

Involving Users(Qualitative info)

Today

What you’ll need

Your app (as early as possible)Define the most important tasks to complete

Define your success criteria

NotepadPen

(Or recorder)

observelisten

record

Shut up Or ask

TestersSelect a few representative people from your target audience With their device

(your mum isn’t OK)

5x

Test its usability• Introduce yourself

• Always explain that you are testing the app, not the user. (Eventually, lie

and say this is someone else’s app)

• Always start at the same point

• If possible, test in context

• Avoid biases: don’t give the answers to your questions!

• Ask people to think aloud as they perform your task

• Listen, and ask more.

• You can come back to some points later

If they ask… What happens if I click here?

What do you think would happen? 

I think it would do so and so.

Let’s find out then

Oh! Hum…

what’s on your mind? 

Case study:Instagram

Case study:Instagram

« Now you have just downloaded the app, can you show me exactly how you’d go to take a photo with it? »

Hands on!

Measure usability and satisfaction

• Did they succeed to complete the task? • How fast? How easily? • Did they smile? • Did they struggle? If so, where, how often?

Pitfalls to avoid Don’t give the answer in the question

Use a script

Don’t give clues on how users are doing during the task (Users want to make you happy, so they will look for clues in your body language or things you say.)Stay neutral, never say ‘this is good’ but rather ‘Ok, thanks’

Don’t change your design entirely after 1 user test (it might be an accident, try another one first)

Don’t reuse the same participant in subsequent tests

Do you want more?

Ask me or look at the reference material

10 heuristics from J Nielsen

1. Visibility of System Status2. Match Between System and the Real World3. User Control and Freedom4. Consistency and Standards5. Error Prevention6. Recognition Rather Than Recall7. Flexibility and Efficiency of Use8. Aesthetic and Minimalist Design9. Help Users Recognize, Diagnose, and Recover from Errors10. Help and Documentation

Books to read • "Don't Make Me Think", Steve Krugg• "Designing Interfaces", Jennifer Tidwell• "About Face 3.0, The Essentials of Interaction Design", Alan Cooper, et al• "Rapid Contextual Design: A How-to Guide to Key Techniques for User-

Centered Design", Karen Holtzblatt, et al.• "The Inmates Are Running the Asylum", Alan Cooper• "The Design of Everyday Things" by Don Norman• “Measuring the User Experience”, Thomas Trulis• Sketching User Experiences, Bill Buxton• Designing Interactions, Bill Moggridge• Handbook of Usability Testing, Jared Spool• Wami http://www.wammi.com/samples/index.html

Useful links• Test descriptions and definitions• Methods:

http://wiki.fluidproject.org/display/fluid/User+Testing+Methods#UserTestingMethods-UserTestingFacilitationMethods

• http://download.techsmith.com/morae/docs/customer-research/3.1/HW-Usability-testing-with-Morae.pdf

• http://download.techsmith.com/morae/docs/customer-research/3.1/Usability-Testing-Basics.pdf

• • http://www.elezea.com/2011/01/onboarding-best-practices-mobile/• http://www.alistapart.com/articles/good-help-is-hard-to-find/• Fluid http://wiki.fluidproject.org/display/fluid/Design+Handbook• http://www.usability.gov/guidelines/guidelines_book.pdf

• Usability 101 http://www.useit.com/alertbox/20030825.html• http://en.wikipedia.org/wiki/Usability

• 10 heuristics from J Nielsen http://www.useit.com/papers/heuristic/heuristic_list.html