introduction to wearables
DESCRIPTION
An Introduction to Wearable Computers given on Thursday December 11th 2014 by Mark Billinghurst. Presented to people from CitiGroup and so case studies were from the financial sector.TRANSCRIPT
![Page 1: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/1.jpg)
Introduction to Wearables
Mark Billinghurst HIT Lab NZ
December 2014
![Page 2: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/2.jpg)
![Page 3: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/3.jpg)
Room Desk Lap Hand Head
![Page 4: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/4.jpg)
![Page 5: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/5.jpg)
Wearable Computing ▪ Computer on the body that is: ▪ Always on ▪ Always accessible ▪ Always connected
▪ Other attributes ▪ Augmenting user actions ▪ Aware of user and surroundings
![Page 6: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/6.jpg)
The Ideal Wearable ▪ Persists and Provides Constant Access: Designed
for everyday and continuous user over a lifetime. ▪ Senses and Models Context: Observes and
models the users and environment. ▪ Augments and Mediates: Information support for
the user in both the physical and virtual realities. ▪ Interacts Seamlessly: Adapts its input and output
modalities to those most appropriate at the time.
Starner, T. E. (1999). Wearable computing and contextual awareness (Doctoral dissertation, Massachusetts Institute of Technology).
![Page 7: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/7.jpg)
Wearable Attributes
▪ fafds
![Page 8: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/8.jpg)
History
![Page 9: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/9.jpg)
History of Wearables ▪ 1960-90: Early Exploration ▪ Custom build devices
▪ 1990 - 2000: Academic, Military Research ▪ MIT, CMU, Georgia Tech, EPFL, etc ▪ 1997: ISWC conference starts
▪ 1995 – 2005+: First Commercial Uses ▪ Niche industry applications, Military
▪ 2010 - : Second Wave of Wearables ▪ Consumer applications, Head Worn
![Page 10: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/10.jpg)
The Gamblers
▪ Timing device for roulette prediction ▪ Card counting hardware (toe input)
Ed Thorp (1961)
Thorp, E. O. (1998, October). The invention of the first wearable computer. In Wearable Computers, 1998. Second International Symposium on (pp. 4-8). IEEE.
Belt computer
Shoe Input
Glasses Display
Keith Taft (1972)
![Page 11: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/11.jpg)
The Hackers (1980’s - )
! MIT Media Lab – Wearable Computing (1993)
http://www.media.mit.edu/wearables/
![Page 12: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/12.jpg)
Enabling Technologies (1989+) ▪ Private Eye Display (Reflection Tech.) ▪ 720 x 280 dipslay ▪ Red LED ▪ Vibrating mirror
▪ Twiddler (Handykey) ▪ Chording keypad ▪ Mouse emulation
![Page 13: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/13.jpg)
MIT Tin Lizzy (1993) ▪ General Purpose Wearable ▪ Doug Platt, Thad Starner ▪ 150 MHz Pentium CPU ▪ 32-64 Mb RAM, 6 Gb HDD ▪ VGA display ▪ Cellular modem
http://www.media.mit.edu/wearables/lizzy/lizzy/index.html
![Page 14: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/14.jpg)
Prototype Applications ▪ Remembrance Agent ▪ Rhodes (97)
▪ Augmented Reality ▪ Feiner (97), Thomas (98)
▪ Remote Collaboration ▪ Garner (97), Kraut (96)
▪ Maintenance/Factory ▪ Caudell (92), Thompson (97)
![Page 15: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/15.jpg)
Mobile AR: Touring Machine (1997)
▪ University of Columbia ▪ Feiner, MacIntyre, Höllerer, Webster
▪ Combines ▪ See through head mounted display ▪ GPS tracking ▪ Orientation sensor ▪ Backpack PC (custom) ▪ Tablet input
Feiner, S., MacIntyre, B., Höllerer, T., & Webster, A. (1997). A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal Technologies, 1(4), 208-217.
![Page 16: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/16.jpg)
MARS View ▪ Virtual tags overlaid on the real world ▪ “Information in place”
![Page 17: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/17.jpg)
PCI 3D Graphics Board
Hard Drive
Serial Ports
CPU
PC104 Sound Card
PC104 PCMCIA
GPS Antenna
RTK correction Antenna
HMD Controller
Tracker Controller
DC to DC Converter
Battery
Wearable Computer
GPS RTK correction
Radio
Example self-built working solution with PCI-based 3D graphics
Columbia Touring Machine
Mobile AR - Hardware
![Page 18: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/18.jpg)
Early Commercial Systems ▪ Xybernaut (1996 - 2007) ▪ Belt worn, HMD, 200 MHz
▪ ViA (1996 – 2001) ▪ Belt worn, Audio Interface ▪ 700 MHz Crusoe
▪ Symbol (1998 – 2006) ▪ Wrist worn computer ▪ Finger scanner
![Page 19: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/19.jpg)
Symbol WWC 1000 (1998 - )
! Wrist worn wearable + finger barcode scanner ! $3500 USD, current price $1000 ! Over 30K sold in first 2 years, still selling (>100k units?) ! First widely deployed wearable computer
![Page 20: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/20.jpg)
Reasons For Success ! Well defined large market niche
! Stock pickers with holster scanners
! Significant usability/ergonomics effort ! Over 40,000 hours user testing
! Provided significant performance improvement ! Met user needs, solved existing problems
! Addressed social factors ! Company with substantial R+D resources
Stein, R., Ferrero, S., Hetfield, M., Quinn, A., & Krichever, M. (1998, October). Development of a commercially successful wearable data collection system. In Wearable Computers, 1998. Digest of Papers. Second International Symposium on (pp. 18-24). IEEE.
![Page 21: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/21.jpg)
Second Gen. Commercial Systems ! Recon (2010 - )
! Head worn displays for sports ! Ski goggle display ! Investment from Intel (2013)
! Google (2011 - ) ! Google Glass ! Consumer focus
![Page 22: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/22.jpg)
Recon MOD/MOD live (2010 - ) ! http://www.reconinstruments.com ! Ski goggle wearable
! Niche market focus ! Show speed, maps, phone calls etc ! $199/$299 accessory ! GPS location, orientation, sensor output ! Android platform/SDK
! Sales: > 50K units sold
![Page 23: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/23.jpg)
Use Case ! While skiing
show: ! maps, ! speed, ! altitude ! phone calls ! text messages
![Page 24: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/24.jpg)
Google Glass (2011 - )
![Page 25: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/25.jpg)
![Page 26: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/26.jpg)
Other HWCs ▪ Vuzix M-100 ▪ $999, professional
▪ Recon Jet ▪ $600, more sensors, sports
▪ Opinvent ▪ 500 Euro, multi-view mode
▪ Motorola Golden-i ▪ Rugged, remote assistance
![Page 27: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/27.jpg)
![Page 28: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/28.jpg)
dsfh
![Page 29: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/29.jpg)
![Page 30: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/30.jpg)
Summary ! First wearable companies
! Targeting niche markets ! Expensive/poorly designed solutions ! Mostly low sales (< 10,000)
! Current generation ! First general consumer wearable (Glass, others) ! Bigger niche markets (skiing, sports) – > 50K+ sales ! Lower costs/better design
![Page 31: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/31.jpg)
Market Analysis
![Page 32: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/32.jpg)
![Page 33: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/33.jpg)
Gartner - Hype Cycle
! 5-10 years to widespread commercial acceptance
5 – 10 years to widespread commercialization
![Page 34: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/34.jpg)
Projected Market - 1
![Page 35: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/35.jpg)
![Page 36: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/36.jpg)
Total Number Wearable Devices
![Page 37: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/37.jpg)
![Page 38: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/38.jpg)
Wide Difference in Market Size
![Page 39: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/39.jpg)
Key Companies
![Page 40: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/40.jpg)
Summary ! Wearables reach mass market over 5-10 years ! Analysts disagree on projected sales
! Maybe 20 million devices shipped/year by 2018 ! Up to $11 Billion market size by 2018
! Wearable computers small cf to other technology ! Smart glass around 10% of all wearable sales ! All wearable devices < 10% of smart phone sales
![Page 41: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/41.jpg)
Experience Design
![Page 42: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/42.jpg)
“The product is no longer the basis of value. The experience is.”
Venkat Ramaswamy The Future of Competition.
![Page 43: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/43.jpg)
![Page 44: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/44.jpg)
![Page 45: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/45.jpg)
Using the N-gage
![Page 46: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/46.jpg)
SideTalking
! www.sidetalkin.com
![Page 47: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/47.jpg)
![Page 48: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/48.jpg)
Experience Design is All About You
! Users should be involved throughout the Design Process
! Consider all the needs of the user
![Page 49: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/49.jpg)
Glass User Experience ! Truly Wearable Computing
! Less than 46 ounces
! Hands-free Information Access ! Voice interaction, Ego-vision camera
! Intuitive User Interface ! Touch, Gesture, Speech, Head Motion
! Access to all Google Services ! Map, Search, Location, Messaging, Email, etc
![Page 50: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/50.jpg)
Living Heads Up vs. Heads Down
![Page 51: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/51.jpg)
![Page 52: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/52.jpg)
Lost in Screen Space
![Page 53: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/53.jpg)
PHYSICAL
![Page 54: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/54.jpg)
Physical Elements ! Interface design ! Input techniques ! Interaction metaphors ! Wearability/Ergonomics
![Page 55: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/55.jpg)
Design For Device
! Simple, relevant information ! Complement existing devices
![Page 56: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/56.jpg)
Typical Usage Times
![Page 57: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/57.jpg)
Consider Your User ! Wearable User
! Probably Mobile ! One/no hand interaction ! Short application use ! Need to be able to multitask ! Use in outdoor or indoor environment ! Want to enhance interaction with real world
![Page 58: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/58.jpg)
It's like a rear view mirror
Don't overload the user. S2ck to the absolutely essen2al, avoid long
interac2ons. Be explicit.
![Page 59: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/59.jpg)
Micro Interac3ons
The posi2on of the display and limited input ability makes longer interac2ons less comfortable.
Using it shouldn’t take longer than taking out your phone.
![Page 60: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/60.jpg)
Micro-Interactions
▪ On mobiles people split attention between display and real world
![Page 61: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/61.jpg)
Time Looking at Screen
Oulasvirta, A. (2005). The fragmentation of attention in mobile interaction, and what to do with it. interactions, 12(6), 16-18.
![Page 62: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/62.jpg)
Design for MicroInteractions ▪ Design interaction less than a few seconds
! Tiny bursts of interaction ! One task per interaction ! One input per interaction
▪ Benefits ! Use limited input ! Minimize interruptions ! Reduce attention fragmentation
![Page 63: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/63.jpg)
Do one thing at a time
![Page 64: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/64.jpg)
Make it Glanceable
! Seek to rigorously reduce information density. ! Design for recognition, not reading.
Bad Good
![Page 65: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/65.jpg)
Reduce the number of info chunks
Reducing the total # of information chunks will increase the glanceability of your design.
1
2
3
1
2
3
4
5 (6)
![Page 66: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/66.jpg)
Single Interactions Faster than 4 s
1
2
3
1
2
3
4
5 (6)
Eye Movements: ~ 2 secs
Eye Movements: ~ 0.9 sec
![Page 67: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/67.jpg)
Test the glanceability of your design ✓
![Page 68: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/68.jpg)
Don’t Get in the Way
! Enhance, not replace, real world interaction
![Page 69: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/69.jpg)
Keep it Relevant
! Information at the right time and place
![Page 70: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/70.jpg)
✓ Test your design indoors + outdoors
![Page 71: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/71.jpg)
Interface Guidelines ▪ Don’t design a mobile app ! Design for emotion ▪ Make it glanceable ! Do one thing at a time ! Reduce number of information chunks ▪ Design for indoor and outdoor use
![Page 72: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/72.jpg)
Physical Input ! Interaction on the go
! Must support mobile input
! Fatigue ! “Gorrilla” Arm from free-hand input
! Comfort ! People want to do small gestures by waist
! Socially Acceptable ! Do I look silly doing this?
![Page 73: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/73.jpg)
Twiddler Input
▪ Chording or multi-tap input ▪ Possible to achieve 40 - 60 wpm after 30+ hours ▪ Chording input about 50% faster than multi-tap ▪ cf 20 wpm on T9, or 60+ wpm for QWERTY
Lyons, K., Starner, T., Plaisted, D., Fusia, J., Lyons, A., Drew, A., & Looney, E. W. (2004, April). Twiddler typing: One-handed chording text entry for mobile phones. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 671-678). ACM.
![Page 74: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/74.jpg)
Virtual Keyboards
▪ In air text input ▪ Virtual QWERTY keyboard up to 20 wpm ▪ Word Gesture up to 28 wpm
▪ Handwriting around 20-30 wpm
A. Markussen, et. al. Vulture: A Mid-Air Word-Gesture Keyboard (CHI 2014)
![Page 75: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/75.jpg)
Unobtrusive Input Devices
▪ GestureWrist ▪ Capacitive sensing ▪ Change signal depending on hand shape
Rekimoto, J. (2001). Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Wearable Computers, 2001. Proceedings. Fifth International Symposium on (pp. 21-27). IEEE.
![Page 76: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/76.jpg)
GesturePad
![Page 77: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/77.jpg)
Skinput
Using EMG to detect muscle activity
Tan, D., Morris, D., & Saponas, T. S. (2010). Interfaces on the go. XRDS: Crossroads, The ACM Magazine for Students, 16(4), 30-34.
![Page 78: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/78.jpg)
Types of Head Mounted Displays
Occluded See-thru
Multiplexed
![Page 79: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/79.jpg)
See-through Thin Displays
▪ Waveguide techniques for thin see-through displays ▪ Wider FOV, AR applications, Social acceptability
Opinvent Ora
Lumus
![Page 80: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/80.jpg)
Where to put Wearables?
▪ Places for unobtrusive wearable technology
Gemperle, F., Kasabach, C., Stivoric, J., Bauer, M., & Martin, R. (1998, October). Design for wearability. In Wearable Computers, 1998. Digest of Papers. Second International Symposium on (pp. 116-122). IEEE.
![Page 81: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/81.jpg)
Where to Place Trackpad?
▪ User study 25 people different postures ▪ Front of thigh most preferred, torso/upper arm worst
Thomas, Bruce, et al. "Determination of placement of a body-attached mouse as a pointing input device for wearable computers.” ISWC 1999. IEEE Computer Society, 1999.
![Page 82: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/82.jpg)
Where do users want Wearables?
29% on clothing 28% on wrist 12% on Glasses
![Page 83: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/83.jpg)
SOCIAL/CULTURAL
![Page 84: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/84.jpg)
TAT Augmented ID
![Page 85: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/85.jpg)
![Page 86: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/86.jpg)
![Page 87: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/87.jpg)
How is the User Perceived?
![Page 88: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/88.jpg)
The Glasshole Effect
![Page 89: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/89.jpg)
Social Interaction
! For mobiles, location and audience have a significant impact on the type of gestures people will be willing to perform.
![Page 90: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/90.jpg)
Professional vs. Everyday Use
! Everyday acceptance ! Only 12% US adults said they would use AR glasses ! 20% handheld AR users experienced social issues ! 40% neutral/uncomfortable with public gestures
! Professional Use ! 85% Doctors said they would use AR glass in job ! < 25% neutral/uncomfortable with work gestures
![Page 91: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/91.jpg)
COGNITIVE
![Page 92: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/92.jpg)
Cognitive Load and Interfaces
![Page 93: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/93.jpg)
A Typical Work Day
Which is the most cognitively demanding?
![Page 94: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/94.jpg)
Cognitive Interference ▪ Structural interference ▪ Two or more tasks compete for limited
resources of a peripheral system - eg two cognitive processes needing vision
▪ Capacity interference ▪ Total available central processing overwhelmed
by multiple concurrent tasks - eg trying to add and count at same time
![Page 95: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/95.jpg)
Resource Competition Framework
▪ Mobility tasks compete for cognitive resources with other tasks ▪ the most important given higher priority
▪ RCF is a method for analyzing this, based on: ▪ task analysis ▪ modelling cognitive resources ▪ a resource approach to attention
Oulasvirta, A., Tamminen, S., Roto, V., & Kuorelahti, J. (2005, April). Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 919-928). ACM.
![Page 96: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/96.jpg)
Cognitive Resources & Limitations
![Page 97: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/97.jpg)
![Page 98: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/98.jpg)
Application of RCF
Busy street > Escalator > Café > Laboratory. But if you made Wayfinding, Path Planning, Estimating
Time to Target, Collision Avoidance easier?
![Page 99: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/99.jpg)
Handling Interruptions
▪ Gradually increase engagement ▪ Reduce attention load
Receiving SMS on Glass
“Bing”
Tap Swipe
Glass
Show Message Start Reply User
Look Up
Say Reply
![Page 100: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/100.jpg)
Nomadic Radio (2000)
▪ Spatial audio wearable interface Sawhney, N., & Schmandt, C. (2000). Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM transactions on Computer-Human interaction (TOCHI), 7(3), 353-383.
![Page 101: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/101.jpg)
Spatial Audio Metaphor
Messages arranged depending on time of day
![Page 102: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/102.jpg)
Notification Interruptions
▪ Dynamic scaling of incoming message based on interruptibility of the user ▪ Busy = silence ▪ Availble = preview
![Page 103: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/103.jpg)
Use Cases
![Page 104: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/104.jpg)
Ideal Applications ! Use cases that require:
! Hands-free interaction ! Mobile information access ! Constant access to information ! Supporting activity in real world ! Low likelihood of social issues ! Enhanced view of reality
![Page 105: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/105.jpg)
Wearable Use Cases
![Page 106: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/106.jpg)
Smart Watch Consumer Insights/Primary Uses
Personal assistance Health & Fitness Personal safety
Communication Smart home access Near Field Communication
(NFC)
![Page 107: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/107.jpg)
![Page 108: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/108.jpg)
Social ac3on First-‐person journalist Tim Pool broadcasts an in2mate view of Istanbul protests. 'I want to show you what it's like to be there as best I can, even if that ends with me running full-‐speed into a cafe and rubbing lemons all over my face a<er being tear-‐gassed'
![Page 109: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/109.jpg)
![Page 110: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/110.jpg)
CityViewAR
! Using AR to visualize Christchurch city buildings ! 3D models of buildings, 2D images, text, panoramas ! AR View, Map view, List view ! Available on Android market
![Page 111: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/111.jpg)
CityViewAR on Glass
! AR overlay of virtual buildings in Christchurch
![Page 112: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/112.jpg)
Financial Services Applications ! Which Financial Services task could benefit from
using wearables? ! always on, connected, accessible
! Match task requirements to wearable attributes ! Hands-busy, constant information access, user
monitoring, mobile, etc
! Key question: can this task be done on a mobile phone instead of wearable?
![Page 113: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/113.jpg)
Financial Applications ! Possible types of Financial Services experiences
! Customer Service ! Consumer Banking ! Finance Trading ! Remote Collaboration
![Page 114: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/114.jpg)
CUSTOMER SERVICE
![Page 115: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/115.jpg)
Customer Service ! Wearables provide
! Constant access to information ! Mobile access – move agent from behind counter ! Improved face to face customer experience
- Customer face recognition - Eye to eye contact
![Page 116: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/116.jpg)
Example: Virgin Atlantic
! Virgin Atlantic trialing Glass for customer check in ! Features
! Agent greets customer curb-side, start check-in process ! Provide customer details, personalized service ! Document verification – camera scanning of boarding pass
![Page 117: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/117.jpg)
! Advantages ! Focus attention on customer ! Moves agent to customer
- Earlier engagement
! Reduces technology barrier between agent and customer
- Hide behind computer/desk
! Provides personalized service - Name, flight details, weather, diet,
translation services, etc
![Page 118: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/118.jpg)
“The trial was a huge success with positive feedback from both our staff and customers on the usage of wearable technology” ! Key findings
! Only Google Glass permitted the agent to maintain eye contact showing they were engaged and interesting in helping.
! Some passengers were taken aback initially by Glass wearing concierges, but, on the whole, passengers responded well.
! Technical challenges to overcome - Short battery life, camera resolution, wifi issues
![Page 119: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/119.jpg)
CONSUMER BANKING
![Page 120: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/120.jpg)
Consumer Banking ! Use Glass to provide mobile finance services
! Bank locator ! In-store payments ! Currency conversion ! Receipt capture (using camera) ! Account balance checking ! Etc
! Some banks porting their mobile apps to Glass
![Page 121: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/121.jpg)
Example: Westpac ! Ported mobile finance app Cash Tank to Glass ! Features
! Check balance ! Transfer funds ! Find nearest ATM/bank branch ! Get alerts and notifications
! Trialed in NZ and Australia
![Page 122: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/122.jpg)
Demo Video
! https://www.youtube.com/watch?v=6qX25cE7Bww
![Page 123: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/123.jpg)
Other Examples ! CaixaBank ! Well Fargo ! Discover ! Saudi Investment Bank ATM finder ! FISERV Mobile payments on Glass ! TMG See2Pay small-dollar payments on Glass
! http://blog.dwolla.com/dwolla-now-available-on-google-glass/
![Page 124: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/124.jpg)
See2pay Demo
! https://www.youtube.com/watch?v=D-3UKp0a4nU
![Page 125: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/125.jpg)
CiaxaBank Glass Application
Branch finder (AR), currency converter, contact details
![Page 126: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/126.jpg)
FINANCE TRADING
![Page 127: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/127.jpg)
Finance Trading ! Currently most finance trading is confined to
fixed desks/location ! Wearables could allow managers to maintain
awareness while away from trading floor ! Provides constant access to markets ! Alerts where ever they are ! Constant monitoring of individual funds ! Etc.
![Page 128: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/128.jpg)
Deskbound to Mobile
![Page 129: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/129.jpg)
COLLABORATION
![Page 130: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/130.jpg)
Google Glass
▪ Wearable computer – Ego-Vision view ▪ camera + processing + display + connectivity
![Page 131: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/131.jpg)
Example – Vipaar Telemedicine
! Vipaar + UAB - http://www.vipaar.com ! Endoscopic view streamed remotely ! Remote expert adds hands – viewed in Glass
![Page 132: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/132.jpg)
VIPAAR Demo
https://www.youtube.com/watch?v=aTOoBwfqBe0
![Page 133: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/133.jpg)
GoToAssist ! http://www.gotoassist.com/ ! Remote collaboration platform
! Screen sharing ! File transfer ! Chat, Annotation
! SeeIt platform supports Glass
![Page 134: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/134.jpg)
SeeIt Glass Demo
! http://www.citrix.com/tv/#videos/10065
![Page 135: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/135.jpg)
Research Problems
![Page 136: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/136.jpg)
Challenges for the Future (2001) ▪ Privacy ▪ Power use ▪ Networking ▪ Collaboration ▪ Heat dissipation ▪ Interface design ▪ Intellectual tools ▪ Augmented Reality systems
Starner, T. (2001). The challenges of wearable computing: Part 1. IEEE Micro,21(4), 44-52. Starner, T. (2001). The challenges of wearable computing: Part 2. IEEE Micro,21(4), 54-67.
![Page 137: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/137.jpg)
Gesture Interaction With Glass ▪ 3 Gear Systems ▪ Hand tracking
▪ Hand data sent to glass ▪ Wifi networking ▪ Hand joint position ▪ AR application rendering ▪ Vuforia tracking
![Page 138: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/138.jpg)
Performance
▪ Full 3d hand model input ▪ 10 - 15 fps tracking, 1 cm fingertip resolution
![Page 139: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/139.jpg)
● Meta Gesture Interaction
▪ Depth sensor + Stereo see-through ▪ https://www.spaceglasses.com/
![Page 140: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/140.jpg)
Current Collaboration
▪ First person remote conferencing/hangouts ▪ Limitations
- Single POV, no spatial cues, no annotations, etc
![Page 141: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/141.jpg)
Sharing Space: Social Panoramas
▪ Capture and share social spaces in real time ▪ Enable remote people to feel like they’re with you
![Page 142: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/142.jpg)
Context Sensing ▪ Using context to manage information ▪ progressive information display as user shows
interest
▪ Context from ▪ Speech ▪ Gaze ▪ Real world
▪ Wearable AR Display
Ajanki, A., Billinghurst, M., Gamper, H., Järvenpää, T., Kandemir, M., Kaski, S., ... & Tossavainen, T. (2011). An augmented reality interface to contextual information. Virtual reality, 15(2-3), 161-173.
![Page 143: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/143.jpg)
![Page 144: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/144.jpg)
![Page 145: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/145.jpg)
Gaze Interaction
![Page 146: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/146.jpg)
AR View
![Page 147: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/147.jpg)
More Information Over Time
![Page 148: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/148.jpg)
Conclusions
![Page 149: Introduction to Wearables](https://reader034.vdocuments.site/reader034/viewer/2022042715/559ccd3e1a28ab9e1f8b46ca/html5/thumbnails/149.jpg)
Conclusions ! Wearable computing represents a fourth
generation of computing devices ! Google Glass is the first consumer wearable
! Lightweight, usable, etc
! A range of wearables will appear in 2014 ! Ecosystem of devices
! Significant research opportunities exist ! User interaction, displays, social impact