mixed reality with microsoft hololens

Image: microsoft.com/hololens

MixedRealitywithMicrosoftHoloLensPhilipp Bauknecht, 11/15/2016

goto; conference Berlin

Philipp BauknechtFounder & CEOmedialesson GmbH@GrillPhil

4x

AR vs. VR vs. MR

Virtual Reality Augmented Reality Mixed Reality

Virtual Reality

Image: gospelherald.com

Augmented Reality

Image: parenting.blog.austin360.com

Mixed Reality

Image: littleover.derby.sch.uk

Virtual Reality Augmented Reality Mixed Reality

Immersion��

Comfort��

Collaboration�

Mobility��

Immersion�

Comfort��

Collaboration�

Mobility��

Immersion��

Comfort��

Collaboration��

Mobility��

Holograms

What is aHologram?

• A hologram is an object like any other object in the real world, with only one difference: instead of being made of physical matter, a hologram is made entirely of light.

• Holographic objects can be viewed from different angles and distances, just like physical objects.

• Holograms do not offer any physical resistance when touched orpushed because the don‘t have any mass.

Image: Lucasfilm

Image: Marvel/Paramount Pictures

Microsoft HoloLens

Mixed Reality + Virtual Reality

Spatial Mapping

Fully unthered

Runs Windows 10

Interaction usinggaze, gesturesand voice

Image: microsoft.com

See-through holographic lenses (waveguides)2 HD (720p) 16:9 light enginesAutomatic pupillary distance calibration

Build-in speakersSpatial audio

Battery 2-3 hours of active useFully functional when chargingPassively cooled (no fans)

Intel Atom CPUCustom-build Holographic Processing Unit (HPU)

579g

64GB Flash2GB RAM

Wi-Fi 802.11acBluetooth 4.1 LE

Volume up/down

Brightness up/down


Audio 3.5mm jack

Micro USB 2.0

4 Environment understanding cameras

depth camera

2MP photo& HD video camera

4 MicrophonesAmbient light sensor

Use scenarios

Marketing


Product Design


Education


Architecture


Remote Services


Research & Science


Games & Entertainment


Semi-virtualConstruction


Current Projects

Live Demo

Development

Tooling

• Visual Studio 2015 with Update 3 (free as Community Edition)Pro tip: Make sure to pick Tools (1.4) and SDK (10.0.10586) of the Universal Windows App Development Tools when doing a custom install.

• HoloLens Emulator

• Unity 5.5.0b11 (as of November 9th)Pro tip: Do not use the HoloLens Technical Preview builds of Unity as they are outdated and broken.

Frameworkoptions

• All apps are Universal Windows Platform (UWP) apps

• Raw power: DirectX 11 using C++ or C# with SharpDX• Easy to prototype and build: Unity using C#

Appviewoptions

Holographic View 2D ViewImage: microsoft.com Image: microsoft.com

Appviewoptions

Holographic View 2D View

• Creates holograms• No other app can draw at the same

time• Can render world-locked holograms• Shell does not render at the same time• App is responsible to handle all user

input.

• Renders on a slate• Slates are world-locked and can be

adjusted in size and position by the user

• Apps resolution stays fixed• Apps have to switch into 2D view for

keyboard entry• All UWP apps run in 2D view without

modifications

Image: microsoft.com Image: microsoft.com

DevelopmentworkflowusingUnity

1. Use Unity to layout your scenes, place holograms, camera and light2. Develop components using Visual Studio.3. Export the project from Unity as Visual Studio Solution. You will

still be able to modify scripts but not a scene.4. Deploy app to the Emulator or your real device.

Demo Workflow

Wheretostart

1. Grab the tools2. Attend the free Holographic Academy online

https://developer.microsoft.com/EN-US/WINDOWS/HOLOGRAPHIC/ACADEMY

3. Deep dive into the Holographic App Development documentationhttps://developer.microsoft.com/en-us/windows/holographic/documentation

4. Check you open source Galaxy Explorer app on GitHubhttps://github.com/Microsoft/GalaxyExplorer

5. Submit your first app to the Windows Store

Howtobuy

Availabily• Australia• Canada• Ireland• France• Germany• New Zealand• United Kingdom• United States

Order online at microsoftstore.com

Developer Edition3.299 EUR incl. VAT

Commercial Suite5.489 EUR incl. VAT

Thanks. Questions?

mixed reality with microsoft hololens

Documents