![Page 1: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/1.jpg)
Contextual Dissonance:Design Bias in Sensor-Enhanced Experience Sampling Methods
@neal_lathia, k. rachuri, c. mascolo (@cecim), j. rentfrowcomputer laboratory, university of cambridge#ubicomp13
![Page 2: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/2.jpg)
Contextual Dissonance?
![Page 3: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/3.jpg)
Contextual Dissonance:Design Bias in Sensor-Enhanced Experience Sampling Methods
![Page 4: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/4.jpg)
You are tasked with researching X (e.g., X = emotions) in daily life using ubiquitous tech; so you decide to build a system that will:
●Ask participants for assessments of the X they experience
●Collect sensor data to 'objectively' measure participants' contexts and quantify their behaviour
Research Scenario
![Page 5: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/5.jpg)
why would you do this?
●… to explore whether machine learning approaches could infer people's subjective responses/complex behaviours
●… to understand the extent that the broad set of sensor data reflects self-reported behaviour
![Page 6: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/6.jpg)
“...automated tracing is widely used to provide insight into what and when; however, it does not provide the why...”
Froehlich et al.
![Page 7: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/7.jpg)
Contextual Dissonance:Design Bias in Sensor-Enhanced Experience Sampling Methods
![Page 8: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/8.jpg)
![Page 9: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/9.jpg)
Contextual Dissonance:Design Bias in Sensor-Enhanced Experience Sampling Methods
![Page 10: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/10.jpg)
“...researchers are faced with concrete decisions regarding design [...] studies have often been classifed into the three categories of interval-, signal-, and event-contingent protocols...”
Bolger et. al
ESM design: how should I ask questions?
![Page 11: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/11.jpg)
“...sampling to capture data from the sensors of the phone cannot be performed continuously, as this will drain the battery rapidly. However, conservative sampling leads to the loss of valuable behavioural data...”
K. Rachuri
sensor design: how should I sample from sensors?
![Page 12: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/12.jpg)
Both of these design protocols will affect the quantity and quality of data that you receive from participants.
![Page 13: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/13.jpg)
● Shouldn't sense everything all the time: triggers a survey based on a particular sensor
●Ask for subjective responses and, while doing so, sample data from other sensors to gather behavioural signals
Research Scenario
![Page 14: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/14.jpg)
We built a system like this. It includes: sensor data collection, ESM interfaces, etc., and remote reconfguration.
![Page 15: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/15.jpg)
Open Source Smartphone Libraries for Computational Social ScienceN. Lathia, K. Rachuri, C. Mascolo, G. Roussos. 2nd ACM Workshop on Mobile Systems for Computational Social Science.
as an aside...
![Page 16: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/16.jpg)
22 users; 1-month; questions about mood & current context (location, sociability); background sensing from many sensors; triggers remotely reconfgured weekly.
![Page 17: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/17.jpg)
Contextual Dissonance:Design Bias in Sensor-Enhanced Experience Sampling Methods
… by asking the “what if” question:
![Page 18: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/18.jpg)
Your ESM protocol is driven by the accelerometer's state: questionnaires will be triggered based on when the participant is moving.
Example Research Scenario
![Page 19: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/19.jpg)
...skews sampling towards the later hours of the day
![Page 20: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/20.jpg)
But all sensors have their own distribution...
… so how have I skewed my other results?
![Page 21: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/21.jpg)
P( state(sensor1) = b | state(accelerometer) = a) ~ P( state(sensor1)) = b
![Page 22: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/22.jpg)
Data that I would have received by continuous sampling
![Page 23: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/23.jpg)
Data received by triggering on one sensor's state.
![Page 24: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/24.jpg)
Bias?
![Page 25: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/25.jpg)
Accelerometer ~ Non-Stationary10.61% of the data is non-stationary.
When it is, participants are:95.23% non-silent; 39.24% at home; 14.43% communicating with others.
![Page 26: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/26.jpg)
Full Sample vs. Accelerometer Trigger
Non-silent?37.78% | 95.23%
Communicating with others?4.60% | 14.43%
![Page 27: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/27.jpg)
More Examples?
Microphone ~ Silent/Non-SilentAccelerometer ~ Moving/Not-Moving
Location ~ Home/AwayScreen ~ Using the device
SMS/Calls ~ Communicating with othersProximity ~ Near the phone
![Page 28: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/28.jpg)
Microphone ~ Non-Silent37.78% of the data is non-silent.
When it is, participants are:26.75% non-stationary; 47.12% at home; 9.48% communicating with others.
![Page 29: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/29.jpg)
Full Sample vs. Microphone Trigger
Moving?10.61% | 26.75%
Communicating with others?4.60% | 9.48%
![Page 30: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/30.jpg)
Dissonance; a tension or clash resulting from the combination of two disharmonious elements
![Page 31: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/31.jpg)
Dissonance; between using sensor states to trigger ESM surveys while using sensor data to quantify context and behaviour.
![Page 32: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/32.jpg)
Ok; so replace the accelerometer trigger with sampling uniformly across time.
Example Research Scenario
![Page 33: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/33.jpg)
temporal sampling is more likely to fnd your participant in “dominant” contexts, e.g., at home.
![Page 34: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/34.jpg)
But the response data I get back from participants will not be affected by the choices that I make... right?
Research Scenario
![Page 35: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/35.jpg)
1-month; 4 groups with random weekly trigger orders: (a) screen, (b) communication events, (c) immediately during non-silence, (d) some time after non-silence
![Page 36: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/36.jpg)
![Page 37: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/37.jpg)
“4 of the 6 tests found that the negative affect ratings (and 2 out of 6 for the positive ratings) were signifcantly different from one another with at least 90% confdence.”
![Page 38: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/38.jpg)
who are you with?
alone 33.33% of the time (screen trigger) to 60.77% of the time (microphone trigger)
![Page 39: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/39.jpg)
Contextual Dissonance:Design Bias in Sensor-Enhanced Experience Sampling Methods
![Page 40: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/40.jpg)
Where do we go from here?Opportunities for more research...
![Page 41: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/41.jpg)
![Page 42: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/42.jpg)
![Page 43: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/43.jpg)
Generalise sensor-enhanced experience sampling tool. Currently in alpha testing.
![Page 44: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/44.jpg)
Working with Android sensors?Try out library!
One of the goals is to enable easy and quick access to sensor data in 2 lines of code.https://github.com/nlathia/SensorManager
![Page 45: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/45.jpg)
Contextual Dissonance:Design Bias in Sensor-Enhanced Experience Sampling Methods
@neal_lathia, k. rachuri, @cecim, j. rentfrowACM Ubicomp 2013
![Page 46: Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods](https://reader031.vdocuments.site/reader031/viewer/2022020217/54954745ac7959292e8b4dc4/html5/thumbnails/46.jpg)
References
● Smyth and Stone. “Ecological Momentary Assessment Research in Behavioral Medicine.” Journal of Happiness Studies 2003.
● Froehlich et al. “MyExperience: A System for In Situ Tracing and Capturing User Feedback on Mobile Phones.” ACM MobiSys 2007.
● Froehlich et al. “UbiGreen: Investigating a Mobile Tool for Tracking and Supporting Green Transportation Habits” ACM CHI 2009.
● Rachuri. “Smartphones Based Social Sensing: Adaptive Sampling, Sensing and Computation Offloading.” PhD Thesis 2013.
● Bolger et. al. “Diary Methods: Capturing Life as it is Lived” Ann. Rev. Psychology 2003.