bernhard kress – wearia13
TRANSCRIPT
Google Confidential and Proprietary
Diffractive and holographic optics as combiners in Head Mounted Displays.
ISWC Zurich 2013
Bernard Kress ([email protected])
Google Confidential and Proprietary
Outline
1) Introduction to optical combiners for see-through displays
2) Conventional optical combiner architectures
3) Diffractive and holographic combiner architectures
4) What else can diffractives offer for wearable computing?
Google Confidential and Proprietary
1) Pupil forming architecture
2) Non -pupil forming architecture (magnifier) - Glass
There are two main optical architectures we can built upon:
Google Confidential and Proprietary
Most of these architectures have been developped since the 70s especially for rotary wing aircraft HMDs
Google Confidential and Proprietary
See through optics
Available optical combiner technologies
Google Confidential and Proprietary
See through optics
Free space architectures
Google Confidential and Proprietary
See through optics
Free space architectures
Light guide architectures
Google Confidential and Proprietary
See through optics
Free space architectures
Waveguide architectures
Light guide architectures
Google Confidential and Proprietary
Free space optical combiner technology
Arrayed or cascaded combiners
Curved combiners
Flat combiners @< 45deg
Classification of optical combiners along functionalities 1- Free space and guided space architectures
Flat combiner @ 45deg
Free form TIR combiners
Google Confidential and Proprietary
Half tone mirror
Free space optical combiner technology
Arrayed or cascaded combiners
Curved combiners
Flat combiners @< 45deg
Flat combiner @ 45deg
Free form TIR combiners
Beam splitter
Google Confidential and Proprietary
45 degrees combiner in vertical direction
Google Confidential and Proprietary
Another example of 45 degrees combiner
Google Confidential and Proprietary
Vertical 45 degrees wide FOV combiner example (Laster)
Google Confidential and Proprietary
GlassUp’s combiner
Google Confidential and Proprietary
Vuzix’s Smart Glass M100
Google Confidential and Proprietary
Google Glass: 45 degrees flat combiner in horizontal direction
Google Confidential and Proprietary
Use of phase conjugate material
Free space optical combiner technology
Arrayed or cascaded combiners
Curved combiners
Flat combiners @< 45deg
Flat combiner @ 45deg
Free form TIR combiners
Flat reflective lens
Google Confidential and Proprietary
Flat beam deflector Off-axis flat lens
Free space optical combiner technology
Arrayed or cascaded combiners
Curved combiners
Flat combiners @< 45deg
Flat combiner @ 45deg
Free form TIR combiners
Google Confidential and Proprietary
The notion of « Bug Eye » in optics
Google Confidential and Proprietary
Implementing the off-axis imaging task– aspheric profiles
Google Confidential and Proprietary
« Bug-eye » reflective combiner – ODA Labs
Google Confidential and Proprietary
« Bug-eye » reflective combiner – Laster
Google Confidential and Proprietary
Occulus rift occlusion « Bug eye » version
Google Confidential and Proprietary
Sony’s HMZ T2 3D glasses – for gamers
Google Confidential and Proprietary
Digilens / Virtuality example of curved combiner and off-axis holographic relay lenses
Google Confidential and Proprietary
Arrayed reflectors
Free space optical combiner technology
Curved combiners
Flat combiners @< 45deg
Flat combiner @ 45deg
Arrayed or cascaded combiners
Free form TIR combiners
Google Confidential and Proprietary
Free space optical combiner technology
Curved combiners
Flat combiners @< 45deg
Flat combiner @ 45deg
Arrayed or cascaded combiners
Free form TIR combiners
TIR free form surfaces with see through corrector
Google Confidential and Proprietary
Example of TIR / free-form surfaces combiner
Google Confidential and Proprietary
Verizon/Kopin’s Golden-i and Canon’s implementations examples of TIR free form optical combiners
Google Confidential and Proprietary
Verizon/Kopin’s Golden Eye
Google Confidential and Proprietary
Guided wave optical combiner technology
Holographic extractors Diffractive extractors
Classification of optical combiners along functionalities 2- Guided wave architectures
Cascaded mirrors combiners
Dynamic extractors
Google Confidential and Proprietary
Guided wave optical combiner technology
Holographic extractors Diffractive extractors
Cascaded mirrors combiners
Dynamic extractors
Micro-mirrors array
Google Confidential and Proprietary
Epson Moverio light guide tilted mirror combiner
Google Confidential and Proprietary
Cascaded dichroic mirrors: Lumus LOE
Google Confidential and Proprietary
Lumus LOE monocular and binocular 3D see through display
Google Confidential and Proprietary
Optinvent light pipe arrayed prisms architecture
Google Confidential and Proprietary
Guided wave optical combiner technology
Holographic coupler / extractors
Diffractive coupler / extractors
Cascaded mirrors combiners
Dynamic extractors
Leaky gratings Incoupling grating
Google Confidential and Proprietary
Holographic optical elements (HOEs) Sanwiched “goop” with index modulation
Diffractive optical elements (DOEs) Surface relief modulation
Google Confidential and Proprietary
Holographic optical elements (HOEs) Sanwiched “goop” with index modulation
Diffractive optical elements (DOEs) Surface relief modulation
Beam splitter Engineered diffusers Grating / Beam redirection CGH (custom pattern projection)
DOE / aspheric lenses Micro lens arrays (MLAs) Beam shaping / beam homogenizing
Google Confidential and Proprietary
Hologram type Angular selectivity Spectral selectivity
η (%) @550nm
α (°)
η (%) @550nm
λ (nm)
η (%) @30°
α (°)
η (%) @30°
λ (nm)
Transmission hologram
Reflection hologram
30 60 0 550 650 450
30 60 0 550 650 450
100 100
100 100
Spectral and angular Bragg selectivity in reflective and transmission volume Holograms
Google Confidential and Proprietary
Kogelnik model for Bragg selectivity in volume holograms
Google Confidential and Proprietary
Google Confidential and Proprietary
Vuzix / Nokia Waveguide diffractive combiner (with laser pico projector)
Google Confidential and Proprietary
Example of Exit Pupil Expander in 2 directions
Google Confidential and Proprietary
Example of Vuzix’s diffractive see through combiners (mock-up devices)
Google Confidential and Proprietary
Guided wave optical combiner technology
Holographic coupler / extractors
Diffractive coupler / extractors
Cascaded mirrors combiners
Dynamic extractors
Leaky reflective holograms IncouplingTIR hologram Leaky transmission holograms Incoupling TIR hologram
Google Confidential and Proprietary
Example of SONY reflective holographic combiner
Uses guided space and super-imposed RGB reflective volume holograms. Horizontal design.
Google Confidential and Proprietary
Example of KONICA/MINOLTA volume holographic combiner
Uses guided space and single reflective hologram with multiple RGB exposure. Vertical design.
Google Confidential and Proprietary
Guided wave optical combiner technology
Holographic coupler / extractors
Diffractive coupler / extractors
Cascaded mirrors combiners
Dynamic extractors
Dynamic holographic extractors Incoupling hologram
Google Confidential and Proprietary
… and a few odd balls which cannot be classified
Google Confidential and Proprietary
Olympus’ opaque see- through HMD using tapered light guide and 45 degrees mirror combiner
The combiner (tappered light guide) is smaller than the eye pupil therefore producing a see-through effect.
Google Confidential and Proprietary
Switchable hologram HMD for time / field sequencing (Univ of Strasbourg / SBG Labs)
Google Confidential and Proprietary
Innovega diffuser glasses and contact lens combo
Google Confidential and Proprietary
Innovega compound HMD
Google Confidential and Proprietary
Comparative analysis of combiner optics
Google Confidential and Proprietary
Gesture sensing via diffractive optics
Google Confidential and Proprietary
… try to look less like this…
Google Confidential and Proprietary
… but more like this!!
Google Confidential and Proprietary
Projector Camera
CPU
Traditional weaponery used for 3D scanning via structured illumination using multiple fringe projection
Google Confidential and Proprietary
Diffractive projectors are small and cheap
Google Confidential and Proprietary
… with more complex structured illumination…
CGH structures as under microscope
Projected code pattern
Zoom on patterns / non-repeating 3x3 codes
Google Confidential and Proprietary
Primesense KINECT: Two cameras (visible and IR) and a diffractive projector
IR camera Visible camera
Laser + diffractives assembly
Temp sensor and Peltier cooler
Google Confidential and Proprietary
Dual diffractives package assembly -> producing optical convolution between a CGH and a crossed grating
Google Confidential and Proprietary
zoom
Pattern generator CGH microscope pictures.
Google Confidential and Proprietary
Sam
e spot patterns (rotated by 180 degrees)
Binary CGH pattern
Zero order
Single tile pattern projection from CGH element
Spot pattern on scene
Google Confidential and Proprietary
Two examples of Epson Moverio binocular see through displays linked to Kinect Primsense gesture sensor (presented at AWE 2013)
Google Confidential and Proprietary
First generation Primesense Kinect sensor
Second generation Primesense sensor
Target size of wearable projector / sensor
Google Confidential and Proprietary
How small can one make the projector elements?
Static 8 pattern diffractive projector window
Google Confidential and Proprietary
Surface topology scan over structured light pattern generator etched in quartz window
1 µm
Google Confidential and Proprietary
Example of virtual interface projection with simple structured illumination from previous piece of quartz.
IR camera
RGB camera
Google Confidential and Proprietary
The key is to produce smarter optics and as a result reduce signal processing requirements
- smaller, faster, cooler, cheaper -
Signal processing Optics
Signal processing Smart Optics
Signal processing « Smarter » Optics
Canesta TOF
Primesense Kinect
What is needed for HMDs
Signal processing Optics LeapMotion
Google Confidential and Proprietary
Google Confidential and Proprietary