intro to user research

Friday, October 21, 2011

MATT TONAKCOMMUNITY MANAGER


THE NERDERY

WE HELP OUR PARTNERS GET BIG IDEAS OUT OF THEIR HEADS AND ONTO THEIR CLIENTS’ WEBSITES

HTTP://WWW.NERDERY.COMTWITTER: @THE_NERDERY

821,217 4334HOURS WORKED SINCE 2003 PROJECTS DOGS IN OUR OFFICE BIKE COMMUTERS

HOURS WORKED, LAST 12 MONTHS

PEOPLE WHO WORK AT THE NERDERY

AVERAGE JANUARY TEMPERATURE

TWO HUNDRED SIXTY-ONE

EIGHT 6

FOURº


http://www.nerdery.com/people#Tt

http://www.nerdery.com/people#Tt

HOW TO PARTICIPATE

Using the questions panels in the GoToMeeting app

On Twitter @The_Nerdery

Send us an email at [email protected]


mailto:[email protected]


INTRO TO

USER RESEARCHI N T E R A C T I V E P R I M E R S E R I E S


ZACKUSER EXPERIENCE DESIGNER


MIKEDIRECTOR OF USER EXPERIENCE


WHAT IS UX?

User Goals

Business Goals

Application


WHAT IS UX?

User Goals Business Goals Application

Aligning user behavior and motivations with business objectives

through interaction design


WHAT IS UX?


WHAT IS UX?

UX is not part of the process...


WHAT IS UX?

UX is not part of the process...

...it is the process.


A WORD ABOUT PROCESS



^Friday, October 21, 2011


(OR SEVERAL)

^Friday, October 21, 2011

DESIGN PHILOSOPHIES


DESIGN PHILOSOPHIES

There is no “one-size-fits-all”


DESIGN PHILOSOPHIES


Self Design


DESIGN PHILOSOPHIES


Self Design

Genius Design


DESIGN PHILOSOPHIES


Self Design

Genius Design

User-Centered Design


DESIGN SOLVES PROBLEMS


DESIGN SOLVES PROBLEMS...now let’s cook some dinner


SELF DESIGNSOLVING YOUR OWN PROBLEM



I know what I want for dinner.

Self Design is cooking for yourself.



I know what I want for dinner.

Self Design is cooking for yourself.

Pretty simple.Friday, October 21, 2011

GENIUS DESIGNSOLVING A PROBLEM YOU’VE SOLVED BEFORE



If I’ve made dinner for Mike (or people like him) many times before, I rely on my

domain specific experience to cook dinner for Mike.



If I’ve made dinner for Mike (or people like him) many times before, I rely on my

domain specific experience to cook dinner for Mike.

I don’t actually cook for Mike. #justsayin’


GENIUS DESIGNTHERE’S A CATCH


GENIUS DESIGNTHERE’S A CATCH

Genius Design presupposes that you originally did your research to

define the problem.


USER-CENTERED DESIGNAKA: UX DESIGN


USER-CENTERED DESIGNAKA: UX DESIGN

A UX PROCESS STARTS WITH

UNDERSTANDING THE PROBLEM


USER-CENTERED DESIGN

FOCUSES ON BEHAVIOR, USE & CONTEXT.



FOCUSES ON BEHAVIOR, USE & CONTEXT.

BUILDING EMPATHY.



HOW DO WE DO THAT?



HOW DO WE DO THAT?

USER RESEARCH


USER RESEARCH

IS NOT

MARKETING RESEARCH


USER RESEARCH

IS NOT

MARKETING RESEARCH

...but there is some overlap


USER RESEARCH

IS NOT

MARKETING RESEARCH


We do this


USER RESEARCH

IS NOT

MARKETING RESEARCH


We do this

We DON’T do this


MARKETING RESEARCHUSER RESEARCH


MARKETING RESEARCH

Preferences

Opinions

Likes

Desires

USER RESEARCH


MARKETING RESEARCH

Preferences

Opinions

Likes

Desires

USER RESEARCH

Behavior

Needs

Goals

Tasks

Mental & Physical Context


RESEARCH SPECTRUM

http://www.flickr.com/photos/rosenfeldmedia/2159500714/in/set-72157603511616271/ Indi Young - Mental Models: Rosenfeld Media


http://www.flickr.com/photos/rosenfeldmedia/2159500714/in/set-72157603511616271/


RESEARCH SPECTRUM

http://www.flickr.com/photos/rosenfeldmedia/2159500714/in/set-72157603511616271/ Indi Young - Mental Models: Rosenfeld Media

overlap




WHY DO USER RESEARCH?



Remember when we said that design solves problems?



Remember when we said that design solves problems?

Remember when we said that a UX process starts with defining the problem?



Remember when we said that a UX process starts with defining the problem?



Research tells us what the problem is.




Research tells us why it’s a problem.




Research shows us how to fix it.

Research tells us why it’s a problem.


BENEFITS OF USER RESEARCH



Throughly defines the problem.




Informs design decisions.





Provides direction & priority.






SHOWS US THE “WHAT”







TEACHES US THE “WHY”







TEACHES US THE “WHY”

GUIDES US TO THE “HOW”


EXAMPLE PROJECT NEEDS

“WHAT”

“WHY”

“HOW”

Stated: What Research Tells Us:



“WHAT”

“WHY”

“HOW”

“We need a website redesign”




“WHAT”

“WHY”

“HOW”

“We need a website redesign” The website doesn’t meet users’ expectations




“WHAT”

“WHY”

“HOW”


“The current site isn’t working for us”

The website doesn’t meet users’ expectations




“WHAT”

“WHY”

“HOW”




There are usability flaws in the design




“WHAT”

“WHY”

“HOW”



“We should update the look & feel”






“WHAT”

“WHY”

“HOW”






We need to design clearercall to action buttons.




“WHAT”

“WHY”

“HOW”








Vague & Undefined



“WHAT”

“WHY”

“HOW”








Vague & UndefinedClear & Actionable


vs. QUANTITATIVEQUALITATIVE

BEWARE OF THE DATA TYPE


vs. X QUANTITATIVEQUALITATIVE



vs.

Just remember

X QUANTITATIVEQUALITATIVE



vs.

Just remember

We need both!

X QUANTITATIVEQUALITATIVE




vs. X QUALITATIVEQUANTITATIVESubjective

“Non-measurable”NOT Numerical

Concepts

Objective“Measurable”

Numerical DataStatistics



QUALITATIVEQUANTITATIVE



QUALITATIVE

QUANTITATIVE


BEWARE OF THE DATA TYPEQUALITATIVEQUANTITATIVE


Page Views

Bounce Rate

Time On Site

Yes/No

True/False



Page Views

Bounce Rate

Time On Site

Yes/No

True/False

Expectations

Reactions

Confusion

Comprehension

Behavior



BEWARE OF THE DATA TYPEQUANTITATIVE QUALITATIVE



QUANTITATIVE

QUALITATIVE



QUANTITATIVE QUALITATIVE



informs QUANTITATIVE QUALITATIVE



informs

“WHAT”




informs

“WHAT” “WHY”




informs “WHAT” “WHY”




informs i.e. Sign-up page bounce rate it high.





informs i.e. Sign-up page bounce rate it high. i.e. Call to action text is confusing.




WHEN SHOULD YOU DO USER RESEARCH?

Timeframe Beginning of the project During Design Production Project Completion

- inform direction & scope- throughly defines the problem- provides insights for next steps

- re-enforce direction- validate design decisions- acquire design feedback at significantly lower cost

- gauge progress/success- guides product direction- discover areas for improvement

- Contextual Inquiry- Field Study/Ethnography- User Interviews- Surveys

- Usability Testing- Card Sorting- Personas- Mental Models

- Usability Testing- Site Search Analytics- Web Analytics- A/B Testing/Multivariate Testing

Benefit

Example Method/Use


BONUS ROUND


BONUS ROUND

ONGOING RESEARCH


BONUS ROUND

ONGOING RESEARCH

How:


BONUS ROUND

ONGOING RESEARCH

How: - Create a solid and sustainable research plan for a continuous feedback loop from your customers/users


BONUS ROUND

ONGOING RESEARCH

Why:



BONUS ROUND

ONGOING RESEARCH

Why: - Your audience changes and evolves over time



BONUS ROUND

ONGOING RESEARCH


- Your product/service/website will attract new audience segments



BONUS ROUND

ONGOING RESEARCH


- Your product/service/website will attract new audience segments

-Other products/services/websites introduce new expectations for interacting with your information











Benefit

Example Method/Use










Benefit

Example Method/Use

Let’s talk about a few in more detail


CONTEXTUAL INQUIRY


WHAT IS CONTEXTUAL INQUIRY?

Fancy Definition:



a field data-gathering technique that studies a few carefully selected individuals in depth to arrive at a fuller understanding of the work practice across all customers.

Fancy Definition:




Fancy Definition:

- Hugh Beyer and Karen Holtzblatt - Contextual Design: Defining Customer-Centered Systems




Fancy Definition:

Non-Nerd Version:





Fancy Definition:

go watch people work in their own context.Non-Nerd Version:





Fancy Definition:

go watch people work in their own context.Non-Nerd Version:


- Us


THE “HOW-TO” OF CONTEXTUAL INQUIRY

4. Analyze

5. Report

1. Recruiting

3. Observe

2. Research Plan

Review what you learned. What patterns emerged?

Create appropriate documentation to communicate what you found to the team.

Contact & schedule the people you will observe. THIS IS THE MOST IMPORTANT STEP.

Watch users completing relevant goals & tasks in their own context.

Establish a clear focus for what you’re seeking to understand & what you hope to learn.


WHAT’S THE BENEFIT OF CONTEXTUAL INQUIRY?

Environment

Applications

Issues

Tasks

Goals

What is their physical location like? How does it impact the design or how they use it?

What other hardware or software are they using to do their work? Can (or should) they be integrated? Can the new design eliminate the need of these factors?

Are there current frustrations or problems with the existing design? What about with their physical environment or other systems and processes? Can the new design support those?

What are the steps people are taking to accomplish those goals?

What are the high level priorities of the people using the current design? What are they trying to accomplish?


WHAT’S THE BENEFIT OF CONTEXTUAL INQUIRY?

Who does the person work with to accomplish a goal or task?

Do people have “cheat-sheets” or other materials to help them accomplish goals and tasks?

Are people creating ways to work around a poor design now?

Are there several ways in which people are accomplishing the same goal or task? Should the design support one? Both?

What causes someone to begin down a path of completing a goal?

Work-Arounds

Triggers

Variation(s)

Partners

“Crutches”


RECOMMENDATIONS FOR CONTEXTUAL INQUIRY

Recruiting

Timeline

Be sure to observe an appropriate, representative sample of your target audience.Aim for 3-5 participants separately.

Allow 1-2 weeks for recruiting effort. (Varies depending on the project & participant availability)Allow 1-2 weeks for conducting the research. (Assuming 5 participants)Allow AT LEAST 1 week for analysisAllow 1 week to create a report.

Approximately 4-8 weeks total


USABILITY TESTING


WHAT IS USABILITY TESTING?

Definition:


WHAT IS USABILITY TESTING?

a form of gathering feedback from actual users of a design by having them attempt to complete intended goals and tasks with said design.

Definition:


THE “HOW-TO” OFUSABILITY TESTING

4. Analyze

5. Report

1. Recruiting

3. Conduct Tests

2. Research Plan

Discuss test results with any participating team members & review recordings if available.

Create appropriate documentation that conveys the findings from the research.

Determine who you will conduct usability testing with, write a screener to ensure you recruit your target audience from the responses & schedule the participants. Again, a CRITICAL step.

Conduct the test (ideally with an experience moderator) & observe, while taking notes.

Where will the tests take place? What will the research cover? As before, Establish a clear focus for what you hope to learn.


WHAT’S THE BENEFIT OF USABILITY TESTING?

Path Taken

Impression

Expectations

Level of difficulty

Task Completion

What were the steps involved in completing a given task?

Did the user(s) understand the overall message and intent that the design meant to convey?

Is the solution designed meeting expectations of those intended to use it?

If so, how difficult was it for them to complete the task(s)? Why?

Can the users complete the available tasks of the design?


VARIATIONS OFUSABILITY TESTING

Guerilla

In-Person, Moderated

Remote, Un-moderated

Remote, Moderated

Usability testing done with minimal recruiting effort and logistical planning. Common locations are coffee shops, bars, offices, etc.

Sessions are conducted at a physical location with a live, in-person moderator leading the session(s) with participants.

Sessions are conducted using an online service that allows users to participate at their convenience, without a moderator.

Research is conducted via “live recruiting” from an existing website. Participants are immediately connected with a moderator from a remote location.



Guerilla



Remote, Moderated





Good



Guerilla



Remote, Moderated





Better



Guerilla



Remote, Moderated





Best


RECOMMENDATIONS FORUSABILITY TESTING

Recruiting

Timeline

Do your own recruiting if possible. If this is not possible, work closely with a recruiting agency to ensure the participants being recruited match your target audience.(especially for the particular research you’re doing)

Aim for 5-10 participants. (dependent on the study)

Allow 1-2 weeks for recruiting effort. (Varies depending on the recruiting method)Allow 1 week for conducting the tests. (Assuming 5 participants)Allow 3 days to 1 week for analysis.Allow 3 days to 1 week to create a report.

Approximately 3-6 weeks total


PUTTING IT ALL TOGETHER


FICTIONAL PROJECT: WEB APP REDESIGN


“We need to redesign our web application to increase customer engagement”



“We need to redesign our web application to increase customer engagement”


GO!


Let’s get started:





THE “WHAT”




Targeted SurveysTHE “WHAT”




Targeted Surveys Web AnalyticsTHE “WHAT”



THE “WHY”



User InterviewsTHE “WHY”



User Interviews Contextual InquiryTHE “WHY”



THE “HOW”



Usability TestingTHE “HOW”



Usability Testing

“HOW”

Project Overview:

Targeted Surveys

Web Analytics

User Interviews

Contextual Inquiry

Time

Prototype[design & development}

“WHY”“WHAT”

iteration(s)


WHAT ELSE?


NERDERY RESEARCH METHODS

Usability Testing

Surveys

Card Sorting

Stakeholder Interviews

User Interviews

Contextual Inquiry

Personas

Field Study/Ethnography

Site Search Analytics

Web Analytics

A/B Testing : Multivariate Testing

Mental Models



Usability Testing

Surveys

Card Sorting


User Interviews

Contextual Inquiry

Personas



Web Analytics


Mental Models

“WHAT”



Usability Testing

Surveys

Card Sorting


User Interviews

Contextual Inquiry

Personas



Web Analytics


Mental Models

“WHY”



Usability Testing

Surveys

Card Sorting


User Interviews

Contextual Inquiry

Personas



Web Analytics


Mental Models

“HOW”


QUESTIONS?Using the questions panels in the GoToMeeting app

On Twitter @The_Nerdery

Send us an email at [email protected]

More answers online at http://nerdery.com




http://nerdery.com

http://nerdery.com

intro to user research

Design

user behavior

user researchfriday

user researchis

usercentered designfocuses

usercentered designaka

design philosophiesfriday

notmarketing research

thismarketing research