assets2013 clean
TRANSCRIPT
![Page 1: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/1.jpg)
UBIBRAILLE Designing and Evaluating a Vibrotactile Braille-Reading Device
HUGO NICOLAU JOÃO GUERREIRO TIAGO GUERREIRO LUÍS CARRIÇO
![Page 2: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/2.jpg)
motivation :: constantly online
![Page 3: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/3.jpg)
blind users :: auditory feedback
![Page 4: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/4.jpg)
challenge :: alternative modality
![Page 5: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/5.jpg)
problem :: deaf-blind users
![Page 6: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/6.jpg)
problem :: mobile usage
![Page 7: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/7.jpg)
problem :: noisy environments
![Page 8: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/8.jpg)
problem :: privacy
![Page 9: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/9.jpg)
earphones?
![Page 10: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/10.jpg)
goal :: inconspicuous and private
![Page 11: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/11.jpg)
related work
[Al-Qudah et al, 2011] [Jayant et al, 2010]
[Ohtsuka et al, 2008] [Rantala et al, 2009]
![Page 12: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/12.jpg)
our approach :: UbiBraille
![Page 13: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/13.jpg)
inspiration :: perkins brailler
![Page 14: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/14.jpg)
example :: ‘a’
![Page 15: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/15.jpg)
example :: ‘b’
![Page 16: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/16.jpg)
same approach for reading
![Page 17: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/17.jpg)
ubibraille :: hardware
Six rings
Lilypad vibe board
Vibration motor (10 mm), 3,8 Volts
Arduino Mega ADK board
![Page 18: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/18.jpg)
ubibraille :: ‘b’
![Page 19: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/19.jpg)
advantage :: mnemonic
![Page 20: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/20.jpg)
advantage :: speed
![Page 21: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/21.jpg)
1. Will participants be able to discriminate simultaneous stimuli?
![Page 22: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/22.jpg)
2. Will participants be able to leverage Braille knowledge?
![Page 23: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/23.jpg)
3. What are the most common error patterns?
![Page 24: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/24.jpg)
user study :: character recognition
11 blind participants (8 male, 3 female) Ages 21 – 61 (m=45, sd=16)
Braille typists
![Page 25: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/25.jpg)
assessment :: braille proficiency
![Page 26: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/26.jpg)
user study :: procedure
![Page 27: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/27.jpg)
user study :: procedure
1. Audio signal 2. Delay (2 seconds)
3. Random braille character (from 26 letters)
4. Answer 5. Monitor register answer
26 le
tter
s x
2 bl
ocks
![Page 28: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/28.jpg)
results :: character recognition
![Page 29: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/29.jpg)
0%
10%
20%
30%
40%
50%
60%
a b c d e f g h i j k l m n o p q r s t u v w x y z overall accuracy
82% sd=17.25%
![Page 30: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/30.jpg)
0%
10%
20%
30%
40%
50%
60%
a b c d e f g h i j k l m n o p q r s t u v w x y z
error rate per character
![Page 31: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/31.jpg)
32% 32% 32%
55%
36%
0%
10%
20%
30%
40%
50%
60%
a b c d e f g h i j k l m n o p q r s t u v w x y z
‘novyz’ are harder
![Page 32: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/32.jpg)
32% 32% 32%
55%
36%
0%
10%
20%
30%
40%
50%
60%
a b c d e f g h i j k l m n o p q r s t u v w x y z
N O V Y Z‘novyz’ are harder
![Page 33: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/33.jpg)
error pattern :: 1 finger issues
51.6%
![Page 34: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/34.jpg)
N O V Y Z
Q R1 finger error :: insertion
![Page 35: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/35.jpg)
N O V Y Z
Q R U X U1 finger error :: omission
![Page 36: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/36.jpg)
error pattern :: 2 finger issues
25.3%
![Page 37: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/37.jpg)
Z X
25.3% error pattern :: 2 finger issues
![Page 38: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/38.jpg)
accuracy rate per participant
0%
20%
40%
60%
80%
100%
P1 P2 P3 P4 P5 P6 P7 P8 P9 P10 P11
![Page 39: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/39.jpg)
0%
20%
40%
60%
80%
100%
P1 P2 P3 P4 P5 P6 P7 P8 P9 P10 P11
result :: individual differences
![Page 40: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/40.jpg)
[rho=.571, p=.066, N=11]
leverage braille knowledge :: reading
![Page 41: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/41.jpg)
[rho=.627, p=.039, N=11]
leverage braille knowledge :: writing
![Page 42: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/42.jpg)
Memory
![Page 43: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/43.jpg)
82% overall accuracy
More fingers, more errors
Mostly 1-finger errors
Leverage braille knowledge
character recognition :: major results
![Page 44: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/44.jpg)
user study #2 :: word recognition
![Page 45: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/45.jpg)
7 blind participants (from study #1) Ages 21 – 62
user study :: participants
![Page 46: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/46.jpg)
1. Audio signal 2. Delay (2 seconds)
3. Random word 4. Answer 5. Monitor register answer
2 tim
es
user study :: procedure
![Page 47: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/47.jpg)
stimulus interval
‘a’ ‘c’ ‘t’ ‘o’ ‘r’
Condition Stimulus (ms) Interval (ms)
4000ms 2000 2000
2000ms 1000 1000
1000ms 500 500
500ms 250 250
user study :: conditions
![Page 48: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/48.jpg)
user study :: design
4 conditions (randomized) 10 words per condition 280 trials 5 characters per word Commonly used words (Portuguese)
![Page 49: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/49.jpg)
results :: word recognition
![Page 50: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/50.jpg)
recognition accuracy rate
93% 89% 64% 33% 0%
20%
40%
60%
80%
100%
4000ms 2000ms 1000ms 500ms
Error bars denote 95% CI
![Page 51: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/51.jpg)
93% 89% 64% 33% 0%
20%
40%
60%
80%
100%
4000ms 2000ms 1000ms 500ms
Error bars denote 95% CI
No sig. diff. p>.05
recognition accuracy rate
![Page 52: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/52.jpg)
93% 89% 64% 33% 0%
20%
40%
60%
80%
100%
4000ms 2000ms 1000ms 500ms
Error bars denote 95% CI
Z=-2.041, p<.05
recognition accuracy rate
![Page 53: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/53.jpg)
93% 89% 64% 33% 0%
20%
40%
60%
80%
100%
4000ms 2000ms 1000ms 500ms
Error bars denote 95% CI
Z=-2.379, p<.05
recognition accuracy rate
![Page 54: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/54.jpg)
leverage braille knowledge :: reading and writing
[rho=.805, p<.05, N=7]
[rho=.543, p=.208, N=7]
![Page 55: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/55.jpg)
Identify through context
![Page 56: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/56.jpg)
word recognition :: ease of use
Condition Median IQR 4000ms 5 1 2000ms 5 2 1000ms 3 2 500ms 2 1
likert scale [1-5] : 5 is better
![Page 57: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/57.jpg)
longest durations are easier
Condition Median IQR 4000ms 5 1 2000ms 5 2 1000ms 3 2 500ms 2 1
likert scale [1-5] : 5 is better
![Page 58: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/58.jpg)
Z=-2.530, p<.05
Z=-2.428, p<.05
Condition Median IQR 4000ms 5 1 2000ms 5 2 1000ms 3 2 500ms 2 1
likert scale [1-5] : 5 is better
longest durations are easier
![Page 59: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/59.jpg)
1s duration + 1s interval à 90%
leverage braille knowledge
12 wpm
room for improvements
word recognition :: major results
![Page 60: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/60.jpg)
conclusion :: ubibraille
![Page 61: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/61.jpg)
conclusion :: inconspicuous communication
![Page 62: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/62.jpg)
conclusion :: leverage braille-related abilities
![Page 63: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/63.jpg)
conclusion :: character- and word-level results
![Page 64: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/64.jpg)
future work :: ubibraille
![Page 65: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/65.jpg)
future work :: finger discrimination
![Page 66: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/66.jpg)
future work :: new applications
![Page 67: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/67.jpg)
future work :: multi-point feedback
![Page 68: Assets2013 clean](https://reader035.vdocuments.site/reader035/viewer/2022081404/5597c6c11a28abc0098b4799/html5/thumbnails/68.jpg)
The End. HUGO NICOLAU [email protected] paper and slides @ http://web.ist.utl.pt/hugo.nicolau