hot & tight: exploring thermo and squeeze cues recognition...
TRANSCRIPT
![Page 1: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/1.jpg)
"Hot & Tight: Exploring Thermo and Squeeze Cues Recognition on Wrist Wearables
Human ICT convergence / Geeyoung Noh
![Page 2: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/2.jpg)
Notification apps:
easy to see and feel if it is on your wrist.
Watches, bracelets ...
What are wearables great for?
Today’s wearables device
![Page 3: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/3.jpg)
Potential of haptic feedback through tactile patterns
On wearables haptic cues are readily and privately received.
Advantage: Direct contact with skin
![Page 4: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/4.jpg)
Potential of haptic feedback through tactile patterns
Our hands are capable to detect a variety of haptic feedback
![Page 5: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/5.jpg)
Past research has focused mostly on vibration and little work has explored other forms of haptic feedback
The issue
Potential of haptic feedback through tactile patterns
Our hands are capable to detect a variety of haptic feedback
![Page 6: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/6.jpg)
Past research has focused mostly on vibration and little work has explored other forms of haptic feedback
The issue
Potential of haptic feedback through tactile patterns
Our hands are capable to detect a variety of haptic feedback
e.g., Tactons (Brewster et al.)
![Page 7: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/7.jpg)
Our goal: to expand the research on notification modalities
In this paper, we explore the advantage of different haptic modalities for wearable computing
Temperature Squeeze
What we need do?
Watch
![Page 8: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/8.jpg)
Related work : visual stimuli for wearables
Hansson and Ljungstrand (2012) Lyons et all (2012)
LED display Multiple displays
![Page 9: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/9.jpg)
Mastscheko et al. (2010)
Spatial patterns
Related work : visual stimuli for wearables
Location and time-based patterns
Oakley and Park (2008)
![Page 10: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/10.jpg)
Related work : Temperature / Squeezing for wearables
Baumann et all (2010)Wilson et all (2011)
Temperature : Palm of the hand & Wrist
Squeezing wearable Haptics
![Page 11: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/11.jpg)
Servo
Arduino
Squeezing
Our prototypes used in the study
Housing
Wrist strap
VibrationMotor
Thermocouples
2 Peltiers
Thermo couples
Vibration and Temperature
Servo
Arduino
Squeezing
Servo
Arduino
Squeezing
![Page 12: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/12.jpg)
Our prototypes used in the study
Housing
Wrist strap
VibrationMotor
Thermocouples
2 Peltiers
Thermo couples
·67 x 42 x 27 mm 3D printed boxes
·Watch style straps
·Arduino Pro Mini microprocessor
1. Vibration and Temperature
·2 Peltiers with temperature sensors
![Page 13: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/13.jpg)
Our prototypes used in the study
·67 x 42 x 27 mm 3D printed boxes
·Watch style straps
·Arduino Pro Mini microprocessor
2. SqueezingServo
Arduino
·1 Servo motor
![Page 14: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/14.jpg)
Tactile Stimuli
Five different time-varying cues for each of the three modalities
·4 seconds ·Right-aligned ·3 degree thermo(JND - just noticeable difference)s
![Page 15: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/15.jpg)
Participants
‧12 participlants‧All right-handed‧Familiar with smart-devices
Experiment
‧45 minutes‧3 conditon modality (latin square design): vibation, thermo, squeeze‧25 randomly (5 trials x 5 stimuli)‧Error trials repeated
Evaluation Process
‧Used headphones with white noise
![Page 16: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/16.jpg)
Preparing Experiment
Demographics
Checking Tempreature, wrist -size
Practices
Condition 1
Nasa TLXNasa TLXNasa TLX
Interviews
User study
Evaluation Process
Condition 2 Condition 3
![Page 17: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/17.jpg)
·ANOVA and post-hoc tests with Bonferroni CI adjustments
Results : Time
Significant p<0.01
5.4s (0.4)average rocognitions time :
Fastest
![Page 18: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/18.jpg)
Results : Time
Not significant
4.4s (1) average rocognitions time :
![Page 19: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/19.jpg)
Results : Time
Significant p<0.01
4.2s (0.5) average rocognitions time :
Slowest
![Page 20: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/20.jpg)
Results : Errors
Error are very different from person to person (Some outliers)
![Page 21: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/21.jpg)
US
ER
INP
UT
Results : Errors confusion matrices
Two-short pulses
cue with 2 short-pulses and the one with a long followed by a short pulse: the difference of 300ms for the duration between short and long pulse was too small for accurate detection.
More than half of the errors 2 short-pulses
and the one with a long followed by a short pulse
: the difference of 300ms
US
ER
INP
UT
CORRECT
VIBRATION ‧Vibration Errors : 13 errors
![Page 22: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/22.jpg)
US
ER
INP
UT
CORRECT
SQUEEZE ‧Squeeze Errors : 38 errors
68% of errors
Same problem with the vibration condition
Results : Errors confusion matrices
Two-short pulses
![Page 23: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/23.jpg)
Hot VS Cold
neutral (skin) temperature
with the slightly
cold or warm cues (± 3C )̊
+6C ̊with +3C ̊cues (24%)
-6C ̊with -3C ̊cues (24%)
Strong VS Mild
cold stimuli for hot ones (19%)
hot for cold ones (3%)
Skin VS stimuli
US
ER
INP
UT
CORRECT
THEREMO ‧Thermal Errors : 110 errors
Results : Errors confusion matrices
: 48% of errors : 16% of errors : 22% of errors
![Page 24: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/24.jpg)
0"
2"
4"
6"
8"
10"
12"
14"
16"
18"
20"
Workload" Mental" Physical" Temporal" Performance" Effort" FrustraAon"
Temperature" VibraAon" Squeeze"
TLX
Vibration perceived more easily
Results : Cognitive workload
![Page 25: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/25.jpg)
Temperature Squeeze
·similar to vibration
·pulse recognition works only if >300ms (or 13Hz)
·different from person to person
·different feeling (body part)
·Wrist, more conservative threshold than palm
Discussion
Vibaration
·easiest
·most accurate
![Page 26: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/26.jpg)
In conclusion, this paper suggests that diverse haptic notification cues on wearable devices are feasible
but more research, how to best design haptic cues specifically for wrist.
Conclusions
![Page 27: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short](https://reader030.vdocuments.site/reader030/viewer/2022040716/5e2097c5516c9748281e3b97/html5/thumbnails/27.jpg)
rrors :
Vibration < Squeeze < Temperature
Vibration > Squeeze > Temperature
Squeeze has a lot of potential (similar to vibration)
Personal preferences are important
Thank you.
Summary
Errors
Easy of use
Potential
Preferences