interacting with small devices in big wayspmuthuku/mlsp_page/lectures/slides/harri… · 2.high...
TRANSCRIPT
![Page 1: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/1.jpg)
Interacting with SmallDevices in Big WaysChris Harrison
1
![Page 2: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/2.jpg)
Small Powerful+
2
![Page 3: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/3.jpg)
»Computing power
3
Time
Computing Factors
![Page 4: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/4.jpg)
»Computing power»Storage
4
Time
Computing Factors
![Page 5: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/5.jpg)
»Computing power»Storage»Bandwidth
5
Time
Computing Factors
![Page 6: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/6.jpg)
»Computing power»Storage»Bandwidth»Screen Resolution»...
6
Time
Computing Factors
![Page 7: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/7.jpg)
Human Factors
7
Time
![Page 8: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/8.jpg)
»Finger size
Human Factors
8
Time
![Page 9: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/9.jpg)
Human Factors
»Finger size»Visual acuity
9
Time
![Page 10: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/10.jpg)
»Finger size»Visual acuity»Manual dexterity»…
Time
Human Factors
10
![Page 11: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/11.jpg)
Time
Size
11
Mobile Device Size
![Page 12: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/12.jpg)
mobile device
limited surface area=
12
![Page 13: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/13.jpg)
13
![Page 14: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/14.jpg)
14
![Page 15: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/15.jpg)
15
![Page 16: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/16.jpg)
mobile device
limited input richness16
=
![Page 17: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/17.jpg)
Scratch Input++
17
![Page 18: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/18.jpg)
18
Scratch Input
![Page 19: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/19.jpg)
19
Project IdeaOne or more microphones on underside of device
1) Localize taps around the device on an ad hoc surface
2) Listen and classify gestures being performed (non-spatial)
Some combination of the two above
Possible uses: Laptop, smartphone, kitchen, light switch
Reach goal: couple with projector for interactive graphicsOblique from smartphoneFrom lid of laptop
![Page 20: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/20.jpg)
On-Body Interfaces
20
![Page 21: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/21.jpg)
Acoustics on the Body
21
Longitudinal (compression) waves
![Page 22: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/22.jpg)
Acoustics on the Body
22
Transverse surface distortions (ripples)
![Page 23: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/23.jpg)
23
![Page 24: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/24.jpg)
24
ProjectedInterface
Pico-Projector
Sensing Armband
![Page 25: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/25.jpg)
25
![Page 26: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/26.jpg)
26
![Page 27: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/27.jpg)
27
Project Idea1.Skinput++ Entirely passive approach; better signal
processing and machine learning
2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)
3.1D (along arm) time of flight.
4.Add active elements to the skin, look at e.g., reflected signal, attenuation of particular frequencies.
5.Phase offset (receiver/transmitter pair on upper arm/wrist)
![Page 28: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/28.jpg)
28
Warning!Not for the feignt of heart!
These projects need research, not just engineering
Self motivated team
I can advise project, but will be traveling a lot
Expected end result is a publication
![Page 29: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/29.jpg)
Analyzing Callsfor Closeness
29
![Page 30: Interacting with Small Devices in Big Wayspmuthuku/mlsp_page/lectures/slides/Harri… · 2.High resolution Skinput on the wrist (perhaps using accelerometers on wrist bone assembly)](https://reader036.vdocuments.site/reader036/viewer/2022081611/5f0705d17e708231d41ae92e/html5/thumbnails/30.jpg)
30
Project IdeaLarge corpus of phone calls
Mine calls for acoustic features
See if personal closeness of the two individuals can be predicted
Example app: bootstrapping sharing/privacy settings on social networking sites