conducting quick check testing to get user feedback

42
+ Conducting Quick Check Testing to Get User Feedback

Upload: jrubin8877

Post on 23-Jan-2015

420 views

Category:

Documents


0 download

DESCRIPTION

Given at Usability Professionals Association Conference June 6, 2012

TRANSCRIPT

Page 1: Conducting Quick Check Testing to Get User Feedback

+Conducting Quick Check Testing to Get User Feedback

Page 2: Conducting Quick Check Testing to Get User Feedback

+

Introduction 3:00 – 3:02

Quick check testsWhat are they? What problems do they solve? How do they compare to traditional testing?

3:02 – 3:10

Planning & conducting a quick check test 3:10 – 3:15

Comparison 3:15 – 3:20

Group Exercise 3:20 – 3:30

Discussion 3:30 – 3:35

Case Study 3:35 – 3:45

Questions / Discussion 3:45 – 3:50

Tips & Takeways 3:50 – 3:55

Wrap-up, Final questions 3:55 – 4:00

Schedule

Page 3: Conducting Quick Check Testing to Get User Feedback

+Today’s Challenges(And yesterday’s and tomorrow’s)

Knowing whether a design will work

Time

Budget

Resources

Access to users

Page 4: Conducting Quick Check Testing to Get User Feedback

+Quick Check Tests

Post your design and gather feedback and reactions Quickly Low or no cost

Validate design or ask specific questions Gauge understanding of content Check effectiveness, impact of design Explore interactions

Can conduct online or post print-outs

Provide an alternative to more thorough usability testing

Page 5: Conducting Quick Check Testing to Get User Feedback

Picture Source: Whitney Quesenbery

Page 6: Conducting Quick Check Testing to Get User Feedback

+

1. Decide what you want to check Content, flow, design, colors, images, understanding, tone Documents, screenshots, video Tasks, questions

2. Consider context and bounds What instructions and context will participants need to be helpful? Number / label areas to help provide easy reference points How can you convey that without biasing them?

3. Pick a good location, time High-traffic areas or low-traffic, secured areas

4. Coordinate logistics and set it up

5. Check in and observe

Planning a Quick Check Test

Page 7: Conducting Quick Check Testing to Get User Feedback

+

Where would you look to complete [task 1]?

Was there anything that helped you know that?

How clear is the content?

Are there any design elements that help you understand how to use this?

What would you suggest changing?

Are there any elements your friends, family, or colleagues would have trouble understanding?

Sample Questions

Page 8: Conducting Quick Check Testing to Get User Feedback

+

Notablehttp://www.notableapp.com

flickr http://www.flickr.comTo give people “Add a note” option, go to You > Your Account > Privacy & Permissions

Online Options

Page 9: Conducting Quick Check Testing to Get User Feedback

+

You want to get reactions to your mobile app design. Think about how you’ll set up a quick check test.1.Define your goals, what you want to learn.

2.Consider: Participants & advertising (how will participants learn about this) Where you can set up the test (online, in-person location; timing, duration) Context, background participants might need Questions you want answered How you will collect results (email, suggestion box, post-it notes) Format or Supplies you will need (online - website, file type, etc.; in-person - paper, post-it notes, pens)

3.Use the next slides to plan out your first quick check test.

Group Exercise

Plan a Quick Check Test

Page 10: Conducting Quick Check Testing to Get User Feedback

+

Goals

Participants & Recruiting

Location (online, in-person...)

Duration

Background / Context participants will need

Materials needed

Questions you want answered

How you will collect results

Group Exercise

Plan a Quick Check Test

Page 11: Conducting Quick Check Testing to Get User Feedback

+Case Study

Page 12: Conducting Quick Check Testing to Get User Feedback

+

Page 13: Conducting Quick Check Testing to Get User Feedback

+

Howto.gov/firstfridays

Page 14: Conducting Quick Check Testing to Get User Feedback

+

Page 15: Conducting Quick Check Testing to Get User Feedback

+

Page 16: Conducting Quick Check Testing to Get User Feedback

+

Page 17: Conducting Quick Check Testing to Get User Feedback

+Video

SAVE YouTube VIDEO LOCALLY JUST IN CASE WE DON’T HAVE ACCESS TO WEB FROM ROOM!

Page 18: Conducting Quick Check Testing to Get User Feedback

+

Moderated Unmoderated

10th Floor 6th Floor

Page 19: Conducting Quick Check Testing to Get User Feedback

+

Permissions

Page 20: Conducting Quick Check Testing to Get User Feedback

+

Page 21: Conducting Quick Check Testing to Get User Feedback

+

Page 22: Conducting Quick Check Testing to Get User Feedback

+

Page 23: Conducting Quick Check Testing to Get User Feedback

+

Page 24: Conducting Quick Check Testing to Get User Feedback

+

Page 25: Conducting Quick Check Testing to Get User Feedback

+Publications Test: Success rate by task

Page 26: Conducting Quick Check Testing to Get User Feedback

+

Page 27: Conducting Quick Check Testing to Get User Feedback

+

Page 28: Conducting Quick Check Testing to Get User Feedback

+

Page 29: Conducting Quick Check Testing to Get User Feedback

+

Page 30: Conducting Quick Check Testing to Get User Feedback

+

Page 31: Conducting Quick Check Testing to Get User Feedback

+

Page 32: Conducting Quick Check Testing to Get User Feedback

+

Page 33: Conducting Quick Check Testing to Get User Feedback

+

Page 34: Conducting Quick Check Testing to Get User Feedback

+

Moderated Unmoderated

10th Floor 6th Floor

Page 35: Conducting Quick Check Testing to Get User Feedback

+

Page 36: Conducting Quick Check Testing to Get User Feedback

+

Page 37: Conducting Quick Check Testing to Get User Feedback

+

Page 38: Conducting Quick Check Testing to Get User Feedback

+

Page 39: Conducting Quick Check Testing to Get User Feedback

+Quick Test steps

1. Pick site / document to test

2. Develop tasks (even “First Clicks are OK)

3. Determine # testers needed to succeed (10)

4. Timed dry run of the test

5. Select location

6. Set up materials 45 min before test begins

7. Test people for 5-15 min max each

8. Record the successes / failures and feedback

9. Debrief problems and solutions

Page 40: Conducting Quick Check Testing to Get User Feedback

+Wrap-up

Page 41: Conducting Quick Check Testing to Get User Feedback

+To Learn More…

Kate Walser [email protected] @kwalser +1 (571) 281-2626

Jon Rubin [email protected] @govnewmedia +1 (202) 501-0855

Page 42: Conducting Quick Check Testing to Get User Feedback

+

Quick Check TestWhitney Quesenbery, Open University open hallway usability test

Photo Credits