wearable computers and augmented reality david mizell intel research seattle feb. 24, 2003
Post on 22-Dec-2015
223 views
TRANSCRIPT
![Page 1: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/1.jpg)
Wearable Computers and Augmented Reality
David Mizell
Intel Research Seattle
Feb. 24, 2003
![Page 2: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/2.jpg)
Outline
• Wearable computers– Overview– Research issues
• Augmented reality– Components– Applications– Research issues
![Page 3: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/3.jpg)
Wearable Computers
• Battery-powered PC on belt
• Head-mounted display
• Speech input• Wireless
communication
![Page 4: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/4.jpg)
Application Premises
Tool Model• Application specific• Worn only while
doing a certain job• Hands-free
requirement
Clothing Model• Worn all day; used all
day• Wide variety of
applications• User sometimes
unaware of application
![Page 5: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/5.jpg)
Research Emphases
Tool Model• User interface design
– Speech input
– Eye tracking
• Development issue: creating/transforming application data
Clothing Model
• Packaging; incorporating into clothing
• Battery life
• AI, agent technology
• Activity inferencing
• Image processing
• Design of keyboard or keyboard substitute
![Page 6: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/6.jpg)
Augmented Reality
• Wearable computer• See-through head-
mounted display• 6DOF head
position/orientation tracker
Superimposes and stabilizes computer-generated information upon specific coordinates of the real surroundings.
6DOF tracker
image source
beam splitter
![Page 7: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/7.jpg)
An example: aircraft wire bundle assembly at Boeing
![Page 8: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/8.jpg)
Formboard storage
![Page 9: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/9.jpg)
Formboard rework
![Page 10: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/10.jpg)
The AR “generic” formboard
![Page 11: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/11.jpg)
experiment in the Boeing Everett factory, summer 1997
•six-week experiment
•wire shop & mockup shop workers
•AR vs. traditional bundle forming
•TriSen optical tracker & see-through HMD
•Via II wearable computer (in vest)
![Page 12: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/12.jpg)
Summary of Results
It worked. We could assemble bundles on the AR formboard, move them over to the traditional formboard, and they would pass QA inspection.
![Page 13: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/13.jpg)
Results…
• Productivity was no higher. Clearly fault of the user interface.
• Wide disparity of user acceptance levels. Women hated the HMD.
• Intriguing anecdotal evidence of training benefits
![Page 14: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/14.jpg)
AR-for-Maintenance Lab Demo
![Page 15: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/15.jpg)
![Page 16: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/16.jpg)
Applying Augmented Reality to Maintenance
• Potential to guide minimally-trained mechanic through a complex maintenance procedure
• The ultimate in “just-in-time” training -- occurs during the maintenance procedure, on the real item being maintained
• Good fit for the military -- complex equipment, maintainers expensive to train, hard to keep – also for Space Station: on-orbit training for astronauts
• Requires portable, easily-deployed & registered tracker system, comfortable see-through head-mounted display
![Page 17: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/17.jpg)
Also notice:
• The “minimalist” nature of the annotations.
![Page 18: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/18.jpg)
AR research issues
• Tracker design– At 50 Hz., track head xyz position to 1 mm.,
roll-pitch-yaw orientation to .1 degree– 2+ m. range (near term)– Robust– Portable– Easy to set up/calibrate– cheap
![Page 19: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/19.jpg)
Trackers – what’s available now
• Magnetometers – AC and DC
• Acoustic-inertial hybrid
• Optical-inertial hybrid
• Videometric
• “ultimate” tracker: track against real environment; no fiducial marking
![Page 20: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/20.jpg)
AR research issues (2)
• Authoring system– Use real object and AR– Use CAD model of object and VR
• User interface– What to show the user– How user should give input to system
• AR display design
![Page 21: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/21.jpg)
AR display design: optical see-through vs. video see-through
Courtesy of DigiLens, Inc.
video camera
computer
![Page 22: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/22.jpg)
AR display design: advantages of optical see-through and
video see-through
Optical• Higher-resolution
(now)• Lightweight• Higher frame rate
(now)
Video• Work in image
domain– Pixel resolution
– Partial occlusion
• Eliminate “image rivalry”
![Page 23: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/23.jpg)
AR research issues (3)
• Registration: establish fixed relationship between tracker coordinate system and real-world coordinate system, and between tracker coordinate system, display, and user’s eye
• Calibration: use objects in known world coordinates to adjust for systematic tracking or display errors
• (these terms often blurred together in AR research, and referred to as “calibration”)
![Page 24: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/24.jpg)
Registration: the basic idea
VV = ( TVD TDS TSW ) VW
Also needed: ev : coordinates of eye in virtual screen coordinates
which pixel on display to illuminate detector to virtual
screen of display dynamic – this iswhat tracker gives you
world coordinates to tracker source coordinates – fixed at setup time
point in real world coordinates
![Page 25: Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003](https://reader030.vdocuments.site/reader030/viewer/2022032523/56649d7e5503460f94a61b28/html5/thumbnails/25.jpg)
Summary
• Inherently multi-disciplinary research– CS – interface design– Physics – tracker design– Physiology; optics – HMD design
• And you get to wear funny hats!