experience sampling vassilis javed khan panos markopoulos the method and its tools

EXPERIENCE SAMPLING

VASSILISJAVEDKHAN

PANOSMARKOPOULOS

THE METHOD AND ITS TOOLS

INDUSTRIALDESIGNDEPARTMENT 2290609

INDEX

• ESM: definition, uses & tools

• Why is there a need for another ES tool?

• ESRM & Reconexp

• Our plans for developing a better ES tool


ESM HISTORY

• Early 1970s pagers were introduced

• University of Chicago wanted to study “flow” experiences

• What were the most enjoyable moments of participants’ day


ESM DEFINITION

• A method to solicit respondents’ answers at random moments of the day[Hektner J.M., Schmidt J.A., Csikszentmihalyi M.,, Experience Sampling Method, Measuring the quality of everyday life, 2007, SAGE, ISBN 1412925576]

• ESM is a survey method, i.e. a way to collect self-reported data from participants that is executed over sustained periods of time

• Computerized ESM


WHERE/HOW ESM IS USED?

• Psychology & Social psychology• Feelings of people• Activities and what makes them happy

• Medical• Assessing the burden of different illnesses• The health consequences of stress

• Political• For evaluating policies

• HCI, UX & design• Assessing the experience of a service or a product• Eliciting requirements for a service or a product


ON MY WAY TO LEIDEN…


ON MY WAY TO LEIDEN…

• How accurate?• How easy?


DRAWBACKS & BENEFITS OF ESM

– Self-selection bias– Nonresponse and selective nonresponse– Obtrusive– High cost of implementation

+ Extremely rich data over time

(subjective +objective data)


RELATED TOOLS

• GENERIC• Academia

− MyExperience− D’PUIS− PMAT− ESP− PsychLab

• Commercial− Entyware by Techneos

• CUSTOM (for a single study)


MyExperience (beta) FEATURES

• XML Questionnaire development • Availability of several “sensors”

(GPS, device usage information)• Supports photo, video and audio

capture• Plug-in architecture• Windows Mobile devices


MyExperience XML example


FUTURE ES TOOL

• Why another tool?• Conditions are right: truly affordable

• Shortcomings of previous tools

• New methodological developments


CONDITIONS ARE RIGHT: More people have powerful devices

• “Globally, research house Ovum expects 171.9 million smartphones to ship this year, up 23% on 2008 and about 15% of the worldwide mobile phone market in 2009” [reuters.com]

http://www.appleinsider.com/articles/08/02/14/google_iphone_usage_shocks_search_giant.html


CONDITIONS ARE RIGHT: Internet on mobile devices is now affordable


PREVIOUS TOOLS’ SHORTCOMINGS

• Difficult to install• Too technical to

execute• Little support• Need of expensive

devices


NEW METHODOLOGICAL DEVELOPMENTS

• Providing feedback to participants improves their motivation [Hsieh, G., Li, I., Dey, A., Forlizzi, J., and Hudson, S. E. 2008. Using visualizations to increase compliance in experience sampling. UbiComp '08]

• Reconstruction of sampling day [Khan, V.J., Markopoulos, P., Eggen, B., de Ruyter, B., IJsselsteijn, W.A. (2008) Reconexp: A way to reduce the data loss of the Experiencing Sampling Method, MobileHCI '08]

• Defining inconvenient times [Isomursu, M., Tähti, M., Väinämö, S., and Kuutti, K. 2007. Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. Int. J. Hum.-Comput. Stud. 65, 4 (Apr. 2007), 404-418]


RECONEXP STUDY: OUR EXPERIENCE

• RECONSTRUCTING EXPERIENCE• A first tool supporting the ESRM method


GOAL

• Investigate communication needs of “busy” parents (under context)

• What information are “busy” parents willing to automatically exchange with each other during a typical day of theirs?


METHOD

• EXPERIENCE SAMPLING + DAY RECONSTRUCTION


+ DAY RECONSTRUCTION


RESULTS

• Busy parents are willing to automatically exchange information which will help them to:

• Infer the availability of partner

• Feel reassured about the well being of family members

• Help coordinate tasks in the evening


Frequency of chosen information statements


SITUATIONAL DATA ANALYSIS


RECONEXP SUMMARY

• Supports personalization of available answers• Supports feedback to participants• Supports filling out unanswered queries


WHAT WOULD NEXT ES TOOL LOOK LIKE?


TOOL COMPONENTS

• Questionnaire Developer• Event triggering editor

• Choice of presentation medium (mobile | pc)

• Real time feedback to participants• Data analysis & Visualization tools• Notification manager (participant and researcher)• Methodology wizard• Experience granularity• Participant’s state of mind-based triggering of queries

• Emphasis is on mobile studies


INTERESTING?

• HTTP://ESRM.ID.TUE.NL

• [email protected]• [email protected]


ESRM

• Experience Sampling and Reconstruction Method

• A method combining ESM with DRM


DAY RECONSTRUCTION

• DRM respondents first revive memories of the previous day by constructing a diary consisting of a sequence of episodes. Then they describe each episode by answering questions about the situation and about the feelings that they experienced, as in experience sampling.

[Kahneman, Daniel, Alan B. Krueger, David A. Schkade, Norbert Schwarz and Arthur A. Stone. 2004. “A Survey Method for Characterizing Daily Life Experience: The Day

Reconstruction Method.” Science. 306:5702, pp. 1776–780.]

• Shortcomings: data for one day, requires one-to-one access with

participant


PLATFORM?

Windows Mobile Blackberry iPhone Palm Nokia


CRITERIA

• Market share• Development tools• Cost• Form factor

experience sampling vassilis javed khan panos markopoulos the method and its tools

Documents

industrial design department

tools slide

affordable slide

product slide

leiden slide

evening slide

ux design

day reconstruction slide