progress ux - research methods workshop - 11/2013

!1

User Research and Usability Methods workshop

Jon-Eric Steinbomer, Director of Research Jessica Sears Steinbomer, Principal

| © 2013 Progress UX LLC!2

!

9-10 Research Methods!10-10:30 Recruiting Participants!coffee <br>!10:45-11:15 Study Plans & Moderator Guides!11:15-12:00 Moderate!!12:00-1:00 Lunch & Presenting Research

Our Agenda

| © 2013 Progress UX LLC

UX Research

!3

| © 2013 Progress UX LLC!4

| © 2013 Progress UX LLC!5

!

What people do!!

How people use!!

Small sample size - usually 8-12 people per study!....but great depth

UX Research

| © 2013 Progress UX LLC!6

• Test early - with prototypes whenever possible.!

• Evidence is more important than deliverables.!

• Iterate on the design during the research phase.!

• Collaboration with design & development.!

• Focus on behaviors rather opinions.

Key UX Research Principals

“Individuals and interactions over processes and tools” -Agile Manifesto

| © 2013 Progress UX LLC

Methods

!7

| © 2013 Progress UX LLC!8

!

Study Planning!Recruiting!Study Sessions!Analysis and Reporting!

Structure Common to All Methods

| © 2013 Progress UX LLC!9

!

• What are the goals?!• What are the research questions?!• Who are the users?!• Which context is appropriate?!• Which research method is

appropriate?!

Study Planning

| © 2013 Progress UX LLC!10

!

• Research Goals!• Research Questions!• Participants!• Method!• Measures!• Specific Tasks and Questions!

Study Plans Contain

| © 2013 Progress UX LLC!11

!

• Usability Lab!• Remote !• On Location (ethnography)

Contexts

| © 2013 Progress UX LLC!12

Usability Lab

Behind the glass Moderator communicates through microphone “voice of God”

| © 2013 Progress UX LLC!13

Silverback ($69.95)

Usability Lab Software

Morae ($1,995)

| © 2013 Progress UX LLC!14

!

• Participant Comfort!• Limit Distraction!• Just you and the participant!• Chat with observers/note-takers

Lab Best Practices

| © 2013 Progress UX LLC!15

Remote Research

Researchers

ParticipantObservers

Participant

Participant Participant

Participant

Participant

Participant

Participant

Participant

Observers

| © 2013 Progress UX LLC!16

Ethnographic “bonus”Participants are more comfortable as they speak to us using their own OS, browser, resolution, etc.

| © 2013 Progress UX LLC!17

Tools

| © 2013 Progress UX LLC

Remote Case Study

!18

| © 2013 Progress UX LLC!19

• Too many abandonsSweepstakes entry form

18

| © 2013 Progress UX LLC!20

Live Intercept

18

| © 2013 Progress UX LLC!2118

Recommendations sample• Top-down design

• Validation before human verify

• Better error feedback

| © 2013 Progress UX LLC!2218

Remote UX Research Best Practices

• Mind the time zones.!• One moderator per session.!• If time allows, start broad, then narrow down to your

subject (website, prototype, product).!• Have a backup plan for the screen-share. !• Test the screen share before the session.

| © 2013 Progress UX LLC!2318

Ethnography - Best Practices!

• Limit the number of interviewers - 2 people if possible!

• Be nimble!• Mind the background

noise!• Note the environmental

factors!• Take lots of pictures and

video

| © 2013 Progress UX LLC

Mobile Research

!24

| © 2013 Progress UX LLC!2518

Mobile app/Hardware Research

| © 2013 Progress UX LLC

Prototypes

!26

| © 2013 Progress UX LLC!27

Low-Fidelity Paper-based prototype

Mid-fidelity Balsamiq prototype

Full-Fidelity “clickable” prototype

Gesture prototype testing (Kinect)

| © 2013 Progress UX LLC!2818

Prototype Testing Best Practices

• Flexibility when moderating is key!• Prototype should be easily modified!• Comfort with things breaking !• Make participant aware it’s a

prototype!

| © 2013 Progress UX LLC

Moderating

!29

| © 2013 Progress UX LLC!3018

Best Practices

• Participant comfort!• It’s not about you (empathy)!• Place your participant as the expert!• Use their words!• Emphasize there is no right or wrong!• Don’t assume - ask!

| © 2013 Progress UX LLC!3118

Best Practices, cont.

• Avoid asking leading questions or “questioning with the target”!

• Resist rescuing !• Let the participant lead as much as

possible!• Introduce the goals and structure of

the session up-front

| © 2013 Progress UX LLC!3218

Moderation Issues

• Taking notes while moderating - takes practice!• Time management!• Talkers - interrupting gracefully!• Non-Talkers!• “Bad” Participants!

!

| © 2013 Progress UX LLC

Recruiting Participants

!33

| © 2013 Progress UX LLC!34

• Personas

• Marketing data

• Call center data

• Sales staff

Identify who you want to speak with

| © 2013 Progress UX LLC!35

Forums

Social media

Ethnio - Live Intercept

Cast the net

| © 2013 Progress UX LLC!36

Recruiting - Ethnio Live Intercept

| © 2013 Progress UX LLC!37

• Screening SurveyCollect the data

| © 2013 Progress UX LLC!38

• Organization TipsScheduling

| © 2013 Progress UX LLC!39

• Initial Contact

• Scheduling specifics

• Confirm

• Double Check

Make the Call

| © 2013 Progress UX LLC!40

• No-shows- Oh No!

• Recruit reserve participants

• Make time in the schedule for reserves

• Mr. Wrong

Bloopers and Out-takes

| © 2013 Progress UX LLC

Study Plans and Moderator Guides

!41

| © 2013 Progress UX LLC!42

Your turn!