#2see through AR

HCI multi touch display seminarManuel Blechschmidt

supervisor: Christian Holz

Final Presentation

hasso-plattner institutewinter 2009/10

Video see-trough devices

optical see-through head-mounted display

See through ARMaking a display like a window to the real world

Demonstration

Demonstration

Related Work

Johnny Lee: Head Tracking for Desktop VR Displays using the Wii Remote

Related Work

Harrison, C. and Hudson, S. E. 2008. Pseudo-3D Video Conferencing with a Generic Webcam

How to does it work?

How to does it work?

How to does it work?

How to does it work?

How to does it work?

How to does it work?

How to does it work?

How to does it work?

How to does it work?

Math

G1

G2

G3

G4

SG 1E

SG 2E

SG 3E

SG 3EwM

hM

x kykzk

• Head position• Monitor Width• Monitor height

• Distance of projection plan eE

• 4 lines from head position crossing edges of display

ImplementationMacBook Prointegrated webcam → faceexternal webcam → occluded partOpenCV

Comparison

optical HMD video HMD display see thru

Acceptance User has to wear a HMD User has to wear a HMD is enabled when device is used

Latency no latency „only“ latency of video stream big latency because of analyzing images

Resolution excellent satisfying quite bad

Field of view 20° - 60° 20° - 90° small, max 60 ° normally a lot less

Cost expensive less expensive cheap

View Matching exact some cm shift not exact yet

Source: A comparison of optical and video se-throug head-mounted displays J. P. Roland, R. L. Holoway , and H.Fuchs

Further research• Use motion detection like TinyMotion to know

when the camera is moving• Use depth cam to get a better understanding

of the environment• Get better hardware to have a better feeling

about what is possible• Think about augmented reality features which

could be build in

end