techniques and tools for field-based early-stage study and iteration of ubicomp applications
DESCRIPTION
Techniques and tools for field-based early-stage study and iteration of Ubicomp applications. Scott Carter EECS Department University of California, Berkeley [email protected]. Committee Jennifer Mankoff (chair), Anind Dey, John Canny, Peter Lyman. 1. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/1.jpg)
Techniques and tools for field-based early-stage studyand iteration of Ubicomp applications
1
Scott CarterEECS DepartmentUniversity of California, [email protected]
CommitteeJennifer Mankoff (chair), Anind Dey, John Canny, Peter Lyman
![Page 2: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/2.jpg)
2
what are ubicomp apps? examples…social proximity jabberwocky (paulos ’04)
location urban tapestry (lane ‘05)
activity
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
resource queries transit services tour guide (abowd ’97)
![Page 3: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/3.jpg)
3
capture and access field data health (alivetech ’05) reminder apps
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
gaming cysmn (blast theory ’01)
location,proximity-based
what are ubicomp apps? examples…
![Page 4: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/4.jpg)
4
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp evaluation is hard (Carter ’05)
![Page 5: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/5.jpg)
5
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp evaluation is hard
rapid prototyping
![Page 6: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/6.jpg)
6
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp evaluation is hard
rapid prototyping
scale
![Page 7: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/7.jpg)
7
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp evaluation is hard
rapid prototyping
scale
unobtrusiveness
![Page 8: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/8.jpg)
8
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp evaluation is hard
rapid prototyping
scale
unobtrusiveness
data sparsity
![Page 9: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/9.jpg)
9
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
thesis
Leverage pre-existing infrastructures and the increasing power of mobile devices to address the challenges of early stage field evaluations of ubicomp applications.
![Page 10: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/10.jpg)
10
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
why early stage and field?
early stage
field
>> potential to iterate>> could answer some research questions
>> realism especially important in ubicomp >> Sharp & Rehman ‘05: “Real-world deployment is the only way”>> Kjeldskov: might be able to recreate field in a lab
![Page 11: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/11.jpg)
11
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: WoZ
researcher designs app behavior in momento and provides instructions for wizards
wizards use momento to simulate app behavior
![Page 12: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/12.jpg)
12
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: report methods
researcher designs experiment, configures momento or reporter
researcher runs experiment, monitoring tool
![Page 13: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/13.jpg)
13
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
limitations: when challenges do not applydata easy to get (no sparsity)
infrastructure already available (no scale issues)
target users early, early adopters (no unobtrusiveness)
tools off-the-shelf (no prototyping)
![Page 14: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/14.jpg)
14
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
most relevant related work
rapid prototyping
Topiary (Li ’04)
scale
unobtrusiveness
data sparsity
rapid prototypingContextESM (Intille ’03)
scale
unobtrusiveness
data sparsity
WoZ Report methods
SUEDE (Klemmer ‘00)
DART (Dow ‘05)
Doorman (Makela ‘01)
Crossweaver (Sinha ‘03)
Active Capture (Chang ‘05)
other work
iESP (Intel ’03)
Mobile probes (Hulkko, ‘04)
other work
![Page 15: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/15.jpg)
15
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
outline
ubicomp challenges case study
report methods
momento
validation plans
timeline
summary
![Page 16: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/16.jpg)
16
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp challenges case study: dr. bluesocial mobile game
get points by collecting cures, healing the sick
![Page 17: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/17.jpg)
17
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp challenges case study: dr. blue
![Page 18: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/18.jpg)
18
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp challenges case study: dr. blue
![Page 19: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/19.jpg)
19
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: dr. blue: rapid prototypingmajor difficulty: building a mobile application
communicationsensordisplay
also difficult: game engine
![Page 20: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/20.jpg)
20
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: dr. blue: scale
everyone needs a device and recording method
![Page 21: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/21.jpg)
21
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: dr. blue: unobtrusivenessnew device and interface
interruptions: evaluation and application behavior
![Page 22: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/22.jpg)
22
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: dr. blue: sparsity
encounters may be limited
![Page 23: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/23.jpg)
23
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
outline
ubicomp challenges case study
report methods
momento
validation plans
timeline
summary
![Page 24: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/24.jpg)
24
momento
WoZ simulation using SMS/MMS infrastructure
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 25: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/25.jpg)
25
momento
WoZ simulation using SMS/MMS infrastructure
… and J2ME on the mobile device
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 26: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/26.jpg)
26
momento
input and output
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 27: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/27.jpg)
27
momento: building dr. blue
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 28: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/28.jpg)
28
momento: building dr. blue
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 29: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/29.jpg)
29
momento: building dr. blue
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 30: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/30.jpg)
30
momento: building dr. blue
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 31: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/31.jpg)
31
momento: building dr. blue
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 32: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/32.jpg)
32
momento: limitations
SMS/MMS, wizard latency
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
24-hour wizards?
synchronous and streaming data
gui creation (damask – Lin ’02)
![Page 33: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/33.jpg)
momento: summary
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
scale
unobtrusivenessdata sparsity
rapid prototypingany device supporting sms/mms
esm feedback on critical events
easy to change application behavior
integrate context
more control
participants
rules to take advantage of external services
wizards
familiar devices, but interruptions
![Page 34: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/34.jpg)
34
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
outline
ubicomp challenges case study
report methods
momento
validation plans
timeline
summary
![Page 35: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/35.jpg)
35
report methods
diary study
experience-sampling method (esm)
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 36: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/36.jpg)
36
diary study issues
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
unobtrusiveness
data sparsity
scale
neglect due to burden of study
generic responses
no feedback
data re-entry, transcribing
![Page 37: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/37.jpg)
37
diary study technique (Carter & Mankoff ’05)
capture
annotate
upload
feedback
elicitation
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 38: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/38.jpg)
38
diary study technique: reporter
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 39: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/39.jpg)
39
reporter
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
scale
unobtrusivenessdata sparsity
rapid prototypingany digital capture device
rapid feedback cycle
-
familiar devices
no interruptions
no transcribing
responses tied to captured artifacts feedback not in situ
![Page 40: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/40.jpg)
40
esm: momento
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
scheduled or context events
automatic question formatting
![Page 41: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/41.jpg)
41
esm: momento
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
scale
unobtrusivenessdata sparsity
many devices
responses in situ
rapid prototypingknowledge feedback to application behavior
redirect questions
participants
integrate context
familiar devices, but interruptions
![Page 42: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/42.jpg)
42
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
outline
ubicomp challenges case study
report methods
momento
validation plans
timeline
summary
![Page 43: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/43.jpg)
43
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
validation: diary study pipeline
testbed: diary study at uc berkeley
interviews with researchers
compare to traditional diary studies (literature)
unobtrusiveness
data sparsity
scale
success?
fewer instances of neglect due to burden of study
more specific recall, fewer generic responses
reduce time to data analysis (no data re-entry)
![Page 44: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/44.jpg)
44
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
validation: momento esm study
sensor data for awareness app
location, activity data
interviews with wizards, participants
unobtrusiveness
data sparsity
scale
success?
minimal neglect due to burden of study
useful feedback on critical events
wizards able to manage momento queries and complete other work
![Page 45: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/45.jpg)
45
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
validation: momento scale study
implement dr. blue
wide deployment (>~30)
feedback on critical events, retainment
unobtrusiveness
data sparsity
scale
success?
minimal neglect due to burden of study
useful feedback on critical events
wizards able to manage momento queries and complete other work
rapid prototypingiteration time shorter than similar social mobile apps
![Page 46: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/46.jpg)
46
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
contributions
a tool (momento) that improves evaluations by simplifying prototyping, making them easier to scale, reducing obtrusiveness, and facilitating data collection
a diary study technique that is easier to scale, less obtrusive, and yields better quality data than previous diary study techniques
identification of major challenges in ubicompevaluation: rapid prototyping, scale, unobtrusiveness, and data sparsity
validation of momento and diary study technique
![Page 47: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/47.jpg)
47
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
timeline
![Page 48: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/48.jpg)
48
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
timeline
![Page 49: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/49.jpg)
49
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
timeline: diary study
![Page 50: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/50.jpg)
50
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
timeline: momento
![Page 51: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/51.jpg)
51
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
summary
Leverage pre-existing infrastructures and the increasing power of mobile devices to address the challenges of field evaluations of Ubicomp applications
Wizard-of-Oz and report methods for early stage, field experiments
Ubicomp evaluation challenges: rapid prototyping, scale, unobtrusiveness, data sparsity
![Page 52: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/52.jpg)
52
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
acknowledgements
Scott Lederer, Christopher Beckmann, Jonathan Hey, Jeffrey Heer, Tara Matthews, Scott Klemmer, James Lin, Tye Rattenbury, Alan Newberger, David Nguyen, Judd Antin, Joe Hall, Nathan Good, Siobhan Hadley
Prof. Robert Kraut, Prof. Susan Fussell, Prof. Jason Hong, Laura Dabbish, Joe Tullio, Jeffrey Nichols, James Fogarty
![Page 53: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/53.jpg)
Techniques and tools for field-based early-stage studyand iteration of Ubicomp applications
53
Scott CarterEECS DepartmentUniversity of California, [email protected]
CommitteeJennifer Mankoff (chair), Anind Dey, John Canny, Peter Lyman
![Page 54: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/54.jpg)
54
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
other slides
![Page 55: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/55.jpg)
55
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
worldwide txt stats
number of computer users: about 1 bil by 2006 (IDC)email users: 700 mil by 2006 (Radicati Group)
about 2 bil mobile subscribers by 2006 (In-Stat/MDR)70% use sms (text.it) (number much lower in us)
![Page 56: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/56.jpg)
56
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
scope
formative and early stages
field methods
distributed, asynchronous activities
>> easier to iterate, could answer some research questions
>> realism especially important in ubicomp >> Sharp & Rehman ‘05: “Real-world deployment is the only way…”>> Kjeldskov: might be able to recreate field in a lab
>> distributed harder, concentrate on asynchronous
broad user base>> minimize programming
![Page 57: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/57.jpg)
57
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
rapid prototyping
scale
unobtrusiveness
data sparsity
ambiguity
>> simplify interface iteration, reduce coding, reduce burden of reinstallations
>> minimizing infrastructure deployment and time, encourage uptake
>> use familiar devices and lower distraction costs
>> capture and encourage feedback from critical events
>> allow people to control error handling
thesis: addressing challenges
![Page 58: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/58.jpg)
58
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: wizard of oz
Kelley (1984)
![Page 59: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/59.jpg)
59
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: wizard of oz
Kelley (1984)
![Page 60: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/60.jpg)
60
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: wizard of oz
![Page 61: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/61.jpg)
61
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: report methods
diary
experience sampling
![Page 62: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/62.jpg)
62
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: report methods
diary
experience sampling>> researchers send questions
![Page 63: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/63.jpg)
63
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: report methods
diary
experience sampling
>> participants report on events
>> researchers send questions
![Page 64: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/64.jpg)
64
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
approach: report methods
![Page 65: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/65.jpg)
65
diary studies
feedback or elicitation
participants report on events
form completion (feedback)participant controlled capture (elicitation)
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 66: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/66.jpg)
66
advances in recording devices
smaller
part of everyday infrastructure
easier to transfer files
annotation
new, more frequent uses for media
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 67: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/67.jpg)
67
findings
+ photos best for who and where recognition
audio elicitation
tangible objects
raw location information
- poor recognition
+/- clandestine captures
- poor recall
+ attitudes and beliefs
- poor sequencing and recall
+ peripheral information often crucial
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 68: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/68.jpg)
68
findings
tangible objects and attitudes and beliefs
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 69: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/69.jpg)
69
findingsperipheral information often crucial
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 70: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/70.jpg)
70
momento
desktop
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 71: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/71.jpg)
71
applications
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 72: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/72.jpg)
72
applications
interruptibility updates (social, activity)
Momento: How busy are you right now? 1 not busy at all, 5 is really busy.
…
P: Who is most available?
Momento: Joe
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 73: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/73.jpg)
73
applications
txt adventure (social, gaming)
Momento: You're in a forest. There is a trail to the N and a cabin to the W. Which way would you like to go? N/W
P: N
Momento: You open the cabin but there was a troll and he squashed you with his fist. Game over. Bad luck
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 74: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/74.jpg)
74
applications
near by (location, resource)
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 75: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/75.jpg)
75
applications
idea tagger (capture and access)
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 76: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/76.jpg)
76
diary study or esm?
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 77: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/77.jpg)
77
diary study or esm?
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
>> auto-driven: participant-sensed events>> creativity, attitudes, beliefs, breadth
diary study
![Page 78: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/78.jpg)
78
diary study or esm?
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
>> auto-driven: participant-sensed events>> creativity, attitudes, beliefs, breadth
diary study
>> researcher-driven: more control>> time use, depth
esm
![Page 79: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/79.jpg)
79
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
validation: interface support
augment current application
add functional feature
success?
demonstrate it works
no deployment
novel approach
![Page 80: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/80.jpg)
80
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
validation: interface support
![Page 81: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/81.jpg)
81
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
validation: interface support
![Page 82: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/82.jpg)
82
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
validation: interface support
![Page 83: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/83.jpg)
83
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
other slides
![Page 84: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/84.jpg)
When Participants Do the Capturing
84
Carter & Mankoff
diary studies and related methods
beeper studies
![Page 85: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/85.jpg)
When Participants Do the Capturing
85
Carter & Mankoff
diary studies and related methods
cultural probes
![Page 86: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/86.jpg)
86
momento: building dr. blue
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
![Page 87: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/87.jpg)
87
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp evaluation is hard
rapid prototyping
scale
unobtrusiveness
data sparsity
ambiguity
![Page 88: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/88.jpg)
88
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: dr. blue: ambiguity
![Page 89: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/89.jpg)
89
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp evaluation challenges
rapid prototyping
scale
unobtrusiveness
data sparsity
ambiguity
Metrics: adoption, awareness, distraction, invisibility, (Scholtz and Consolvo)
![Page 90: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/90.jpg)
90
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubicomp challenges case study: hebb
![Page 91: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/91.jpg)
91
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: rapid prototyping
![Page 92: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/92.jpg)
92
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: rapid prototyping>> simplify interface iteration, reduce coding, reduce burden of reinstallations
![Page 93: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/93.jpg)
93
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: scale
![Page 94: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/94.jpg)
94
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: scale>> minimize infrastructure deployment and time, encourage uptake
![Page 95: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/95.jpg)
95
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: unobtrusiveness
![Page 96: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/96.jpg)
96
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: unobtrusiveness>> use familiar devices and lower distraction costs
![Page 97: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/97.jpg)
97
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: sparsity
![Page 98: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/98.jpg)
98
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: sparsity
>> capture and encourage feedback from critical events
![Page 99: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/99.jpg)
99
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: ambiguity
![Page 100: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/100.jpg)
100
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
case study: hebb: ambiguity
>> allow people to control error handling
![Page 101: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/101.jpg)
101
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubiquitous computing (weiser)
![Page 102: Techniques and tools for field-based early-stage study and iteration of Ubicomp applications](https://reader035.vdocuments.site/reader035/viewer/2022062805/56814d24550346895dba5823/html5/thumbnails/102.jpg)
102
CarterTechniques and tools for field-based early-stage study and iteration of Ubicomp applications
ubiquitous computing
off-the-desktop interfaces