university of washington hcde 518 user research 2 hcde 518 autumn 2011 with credit to jake wobbrock,...

University of Washington HCDE 518

User Research 2

HCDE 518Autumn 2011

With credit to Jake Wobbrock, Dave Hendry, Andy Ko, Jennifer Turns, & Mark Zachry


Agenda Announcements, Hand in

assignments Mid-quarter Eval Sketching Critiques Lecture – Interviews Design Activity Break – 10 mins Lecture – Questionnaires Design Activity Lecture – Observation

(direct & indirect)

Design Activity Break – 10 mins Two Case Studies Next Class Group Project Work Time


Mid-Quarter Evaluation

Jim Borgford-Parnell Center for Engineering Learning & Teaching (CELT)

~20 minutes


Announcements, Questions

R3 due now A2 due now R2 grades posted A2 returned today P0 comments uploaded (check with your

teammate who uploaded)

Questions?


Assignment 1

Very interesting descriptions of what you love and hate

Many insightful design principles

Scores: 4.0 – Excellent 3.5 – Complete, but

some problems ---> 3.0 – Something missing

Common problems: Not explaining why an

interaction was successful or not

Not defining your design principles

Principles were more about process than products

Not applying design principles to your loved/hated things


A1 – Some of Your Design Principles

Tactile Accessible Beautiful Autonomy Sustainable Finesse Safe Efficient Consistency Performant Makes me happy Big picture view Permanence

Error mitigation Expected experience Avoid errors Sticky settings Feedback Not overdesigned Understandable Versatile Flexible/Customizable Simple Harmony Humanity Sentimentality


A1 – Things you love and hateLove :) Hate :(iPhone Travel booksiPhone Alarm clock

Soap dispenser Education workshopKindle Fire Timed traffic lightsMacbook Air Wireless remote

controlRice cooker GimpInstagram Comcast emailDominion Power cordsBluetooth headset Microwave

DirecTV remote MicrowaveFrench Press Kitchen cabinent

Android phone iPhone

Love :) Hate :(Headlamp Garage door openerElectric dispensing pot Sony remoteHonda accord GPS Stove topIBM trackpoint TouchpadDroid smartphone Android OSGoogle Laptop audio softwareRabbit Toy Toenail clippersiPad FiOS remote controlMacbook Pro Office ChairSolar powered charger Samsung FocusLenovo thinkpad Safeway self-checkoutBaby monitor Automatic clockSmart car Chia headNord Electro keyboard Windows VistaLogitech mouse Adobe IllustratorWater Bottle Amazon’s search insideESPN Score Center Alarm clock


P0 – Your Design Questions Orange/Chore Bored

How can we make chores in the household less stressful and more engaging for a couple?

Green/Market Maven How do we connect consumers to their local farmers markets?

Brown How can a social networking service offer comfortable levels of privacy

for its users? Purple

TBD


P0 – Your Design Questions Yellow/Mamalode

How can an iPad magazine reader facilitate local networking and support among mothers?

Red How can we help stakeholders (clients, therapists, clinical

administrators, and the research team) get the best possible outcome when a client reports suicidal ideation or intent?

Blue How can an entertainment/communication system increase a sense of

connectedness?


Sketching Critiques – 20 minutes

Break into groups of 3 people Take turns showing and explaining your 3 sketches

with each other Critics should offer advice and feedback about the

idea Strengths, Weaknesses, Originality, Feasibility Sketcher: take notes about what feedback was offered Critic: be critical, but constructive and courteous! Each critic should sign and date the page after the sketches


LECTURE – USER RESEARCH, PT. 2


User Research – Data Gathering

Triangulation Recording techniques Interviews Questionnaires Observations

Direct vs. Indirect


Triangulation

All user research techniques havetheir own limitations

Use multiple techniques to fully understand a design scenario Choose techniques that account

for the weaknesses of each other Choose techniques to cover both a

breadth and depth of the user experience

Key Concept


Triangulation

What are some complementary techniques you might use to account for the weaknesses of each other?

What are some techniques that cover both breadth and depth when combined?


Data Recording Approaches

1. Notes2. Notes + still camera 3. Notes + Audio4. Notes + Audio + still camera 5. Video

What are the advantages and disadvantages to each of these?


Interviews

Purpose: Collect detailed information about tasks, activities, technologies. Understand the why behind activities, rather than the what.

Suitable for relatively small number of people (5 – 30) - Shoot for ~12 to reach data saturation, though not always feasible


Interviews

UnstructuredBroad questions concerning some general area

StructuredNarrow questions concerning specific area

Semi-structuredBalance between broad/narrow questions

Focus groupsGroup discussion around a topic


Creating an Interview Guide

Who do you need to interview and why? Demographic questions Open questions Closed questions Activities

Sketching Demonstrations

Reliability and validity Be careful about leading questions


Running an Interview

0. Recruitment1. Introduction 2. Warm up session 3. Main session 4. Cool-off period 5. Closing session


Example – Huang & Truong

https://courses.washington.edu/hcde518/readings/MobilePhoneInterviewProtocol.pdf


Design Activity: Devising an Interview Plan – 10 minutes

Scenario: You’ve been asked to gather information on the design of a patient education system for hospital/doctor's office waiting rooms

You've decided to conduct some interviews and to collect data with questionnaires. Propose a plan answering these questions: What is the goal of the interview? Who do you need to interview? How many? What kinds of questions/activities? List a few specific questions


BREAK – 10 MINUTES


Questionnaires/Surveys

Purpose: Deepen understanding by collecting information from a broad range of people

Suitable for large number of people 20 – 1,000+


Questionnaires

Be clear on the goal Keep it short Open and closed

questions Rating scales (e.g. Likert) Be sure to pilot your questionnaire and expect

to iterate 3-4 times Online or on paper?


Example – Huang & Truong

https://courses.washington.edu/hcde518/readings/MobilePhoneSurvey.pdf


Design Activity: Devising Questions for Questionnaires – 10 minutes

Scenario: You are designing a new video sharing system and would like to determine how people share videos online and what features they find useful and not useful Propose three questions (at least 1 open and 1

closed) Discuss ideas for distribution & recruitment

techniques, paper vs. online, etc.


Observations in the Field

Helps you understand people’s context, task, activities, goals

What people do is different than what people say they do

People are notoriously poor and describing their work


What to Pay Attention To

Key features Space Actors Activities Objects / workarounds Acts Events / triggers Time Goals Feelings

Questions How is the physical space

adapted to the job? What are the key

constraints on the job? Where are strategic

decisions made? Where are tactical decisions

made?


Examples

What might you observe about each case? Is observation appropriate?

A nurse as she treats patients in a hospital A teacher while he is teaching a classroom full of

kindergartners A team of emergency medical technicians working

on a case A writer working on a book


Laboratory Studies

Useful for studying and recording the details of how people perform: Goals Tasks Action sequences

Disadvantages: Not the user’s natural environment, missing context

Better for doing tests of prototypes where detail is important


Lab Studies


Indirect Observations

Diary studies Experience Sampling studies Interaction logs


Diary Studies

Have users carry a diary with them to answer specific questions about activities throughout the day when certain activities occur


Example

PAL diary study Fits in one’s pocket Record when PAL is desirable


Experience Sampling Studies

Have users carry around a device that has them answer questions at given intervals Cell phone, PDA, SMS

Good for getting in-the-moment assessments Example: page user once every 3 hours and ask

them to fill out a short survey on their current activity and rate sleepiness level on a scale from 1 to 7


Example – Track Your Happiness

Go to TrackYourHappiness.org and sign up


Diary Study vs. Experience Sampling

Both can collect similar types of information Diary is less intrusive ES can be more reliable at getting regular data

User is less likely to forget

Another alternative – context-based sampling MyExperience Toolkit -

http://myexperience.sourceforge.net/


Interaction Logs / Usage Logs

Use software to automatically log interactions with a system e.g., number of clicks, time spent on task, etc. e.g., pages visited within a site: Google Analytics

Can also be used on other platforms using interesting sensors to sense context of use Example: Logging steps with a pedometer


Example

Using Bluetooth tags to track people’s distance from their cell phones Intent: Inform design of “always on” ubiquitous

computing applications


Design Exercise: Improving Picture Messaging – 5 minutes

Suppose you wanted to improve the picture messaging feature on a mobile phone

Describe TWO different kinds of indirect observational approaches that might be useful


Summary: Consider study needs and purposes, pros/cons of methods

Triangulate!InterviewsFocus groupsQuestionnaires Direct observation in the field Direct observation in the labIndirect observation What types of recording techniques?


Discussion: Your projects

What methods are you considering for your project?

How do they cover both breadth and depth? How do they complement one another?


BREAK – 10 MINUTES


Case Studies Huang & Truong

Questionnaire and Interviews Focus on understanding how and why

people dispose of their old mobile phones Identify design opportunities

Tee, Brush, & Inkpen Interviews, family trees Understand ways that families currently

communicate Identify design opportunities


Questions

What were your overall thoughts? What did you like about the approach? What would you have changed about the

approach? Why do you think they chose the approach

they did?


My Own Examples

Interviews/Observations with parents & pediatricians to inform design of tracking developmental progress in young children

Contextual Inquiry, survey, and interviews for understanding how technology can support healthy sleep behaviors

Cultural probe plus interviews/draw the experience for understanding people’s views on privacy surrounding sensing technologies


Next Class

Wednesday, October 26th Personas, Scenarios, & Storyboards

Upcoming Work Reflection 4 Sketching, Week 5

Theme: Sports, Fitness, & Recreation Keep working on P1!


Group Project Meet Time

university of washington hcde 518 user research 2 hcde 518 autumn 2011 with credit to jake wobbrock,...

Documents