mixed reality with hololens - sita · mixed reality with hololens sita innovation day 2016 rené...

Mixed Reality with HoloLensSita Innovation Day 2016

René SchulteDirector, Immersive Experiences

[email protected]

@rschu

Cloud and

InfrastructureCRM

Portals and

Collaboration

Enterprise

Social

Data and

Analytics

Custom

DevelopmentUser Experience

Formerly known

as IdentityMine

2

3© 2016 Valorem Consulting Group LLC

What we doWe create amazing user experiences. We design where others spec. We create where others just build.

Our first thought is not “what are the limitations of this device” but “how to empower every individual and every

organization to achieve more through Digital Transformation”. On top of that, we are technology innovators.


Immersive Overview

Comprehensive 3D Expertise

Valorem’s experienced design and development experts are fluent

in the 3D programming world.

• In-house 3D engine supporting Direct3D 9, 11 & 12

• Well versed with the various AR & VR devices and their specific

SDKs

• Unity Pro innovator – developing cross-platform and rapid

prototyping solutions

• In-house 3D artists for 3D content creation using 3D authoring

tools like 3ds Max, Maya, ZBrush, etc.

• 8 years of experience in 3D visualizations

.


User Experience First

Define the experience, then go build it

UX and Technology Innovators

Don’t allow technical blockers to impede creativity

The Right Talent at the Right Time

From enterprise to game development, our user experience design

and development experts come from diverse backgrounds

Why Valorem?

One of seven agencies accepted into the first Microsoft HoloLens

Academy / Agency Readiness Program

6© 2015 IdentityMine Inc. | Design Process

Guiding Principles

Immersive Technology

Immersive Device Landscape

Oculus RiftSamsung Gear VR Microsoft HoloLensGoogle Cardboard HTC Vive

9© 2016 Valorem Consulting Group LLC.

VR – Virtual Reality

Fully immersive multimedia experience


AR – Augmented Reality

Not fully immersive

Real world enhanced with virtual elements

Microsoft HoloLens Spans Realities

Augmented Reality Mixed Reality Virtual Reality

Augments the real world with helpful information

Blends holograms with your real world

Can transport you to a virtual world

Replaces the real world

Why HoloLens?


HoloLens Input


Developing for HoloLens

Direct3D with C++ or C# via SharpDX

Highly efficient workflow

Built-in VR and HoloLens support

First class citizen for HoloLens development

Free for personal use

HoloLens Portfolio

Exciting and cool videos

Engineering and Communication

HoloLens chemical plant

Architecture and Construction

HoloLens architectural model

Manufacturing and Training

HoloLens Assembly Line

Product Design and Presentation

HoloTire

Education and Entertainment

HoloDino

Entertainment

TowerBlocks

Aviation and GIS Data Visualization

HoloFlight


There’s even more outside the box…

Immersive UX Envisioning

Immersive Demo Day

Learn about the HoloLens and other

VR/AR/MR technologies with hands-

on demos and discussions

Envisioning Video

See your HoloLens concept come to

life with a video simulating the future

experience

Onsite Workshop

Collaborative sessions that help to

determine project goals, define criteria

for success and engage with immersive

design, production and technical

experts

Interactive Prototype

Rapid prototyping and POC (proof of

concept) development allows you to

quickly experience, interact and iterate

with your HoloLens application

34

Immersive UX Envisioning Options


Demonstration of new technology and existing applications by creative

and engineering experts

Activities

• Overview of up to three VR/AR/MR devices and production methods

• Hands-on demonstration of the technology and applications

Deliverables

• On-site demo(s)

• Demo devices provided


Immersive Demo Day

36© 2016 Valorem Consulting Group LLC 36© 2015 IdentityMine Inc. | Design Process

HTC Vive

Discovery workshop to identify and clearly understand your business

goals, user workflows, scenarios and assess any platform challenges.

Activities

• Questionnaire & agenda development

• Industry research

Onsite Concepting & Envisioning

• Demonstration of HoloLens device and existing applications by creative and engineering experts

• Collaborative meetings to determine project goals and define criteria for success

• Brainstorming / sketching and whiteboarding

• Key personas, scenarios, and primary use case development

Onsite Workshop


Deliverables (delivered 2 weeks after onsite)

Primary User Personas

Fictitious identities that reflect your user groups

Key Scenarios

Your persona’s journey and where your app fits in

Primary Use Cases

Outline of specific tasks your users wish to achieve with your app

Annotated Storyboards

Series of concepts that illustrate application experience and user interactions (up to

two (2) concepts with up to seven (7) medium fidelity illustrations)

Creative Brief

Documentation of all findings during the envisioning workshop


Onsite Workshop


Sample artifacts

3D Models Storyboard

Whiteboard sketches

Photographic storyboard3D grey box illustrations

Vector art storyboards

39© 2016 Valorem Consulting Group LLC 39© 2015 IdentityMine Inc. | Design Process

HTC Vive

A production video prototype that communicates your concept by

telling a story of how one or more persons would use the application.

Deliverables (2 weeks after onsite)

Pre-Production

Scripting, production planning, shot list development

3D Modeling

Basic non-interactive 3D modeling for use in the video

Video Production

Anticipated two (2) day video shoot with required equipment, shooting crew,

production crew, studio / set, talent, and props

Post-Production

Editorial, graphics, effects / compositing, finishing, audio, and reviews

Video Prototype (animatic)

Up to one minute HD video (animatic) utilizing live action and 3D elements to

simulate the final application

Envisioning Video


Sample artifacts

Video production

Video prototype


Sample video

42© 2016 Valorem Consulting Group LLC 42

Interactive prototype to help understand and visualize the requirements

of a solution in detail to ensure all goals will be met during a full

production effort

Deliverables

Functional Proof of Concept (POC)

An interactive visual holographic proof of concept which can be viewed on the

HoloLens device

Source Code

Application source code and binary builds

Quality Assurance

Quality assurance team will test the HoloLens proof of concept application to ensure

expected functionality and performance

Interactive Prototype


Kinect applications

Sample artifacts

HoloLens application


Immersive Project ExecutionProject Management

Presales / Kick-off

Brainstorming & Ideation

UX & 3D Design

UX Prototype• Project Discovery• Estimation

• Proposal

• Project Kick-off Meeting• UX Strategy• Persona Development

• User Interviews

• Concepting• Rapid prototyping

Development | Co-Development

Design Integration

Testing & QA

• Information Architecture • Wireframes

• Visual Design

Compositions• Style Guide

• 3D Modelling • Feasibility• Interactions & Animations

UI / UX to reality

• Dedicated Project Lead• Project Status Reviews/Reports

• Delivery Management

45

Demo Time!

Speaker

Visor

Cooling channel

Front hinge

Volume buttons

Back Hinge

Arm

Adjustment wheelPower button and charging

battery life indicators

Brightness buttons

Nose pad

HoloLens Device Features

Gestures Overview

60 Minutes

50 Minutes

40 Minutes

30 Minutes

20 Minutes

10 Minutes

Time’s Up!


Thank you

for your time.

René SchulteDirector, Immersive Experiences

[email protected]

@rschu

mixed reality with hololens - sita · mixed reality with hololens sita innovation day 2016 rené...

Documents