first glimpse on hololenshololens environment •manuals and training materials to be migrated to...

Sascha Frömming

ET/R&D

First Glimpse on HoloLens

Schwelmer Symposium 2017

3 | TKE/TIS | HoloLens |

HoloLens Key Features

Smart Mixed Reality


HoloLens Key Features

No targets and hands free operation


HoloLens – mixed reality for technicians and customers

End-to-end digitization project Elevator Field Support Training & Showcases

• Fully digitalized end-to-end process

• Real time data transfer to CAD

• Significant increase of efficiency

• Hands-free access to expert information and support

• Visualization and identification of problems

• Improve first time fix rate

• Simulation of technical environments in trainings and showrooms

• Bring technology virtually into classrooms

• Foster worldwide knowledge transfer

Increase efficiency

and customer experience

Increase efficiency

and elevator uptime

Increase effectiveness

and customer experience


Remote Support


Field Operations: Efficiency increase and enable first time fix

Approach

Remote Calls • Real time connection to remote expert

network via Skype

• Expert supported diagnostics to improve first time fix rate

• Access to specific information:

Health & Safety rules and warnings

Historic maintenance protocols

Details about system & components

Visualization

Documentation • Document service tasks performed

• Provide specific information / comments for next maintenance visits

• Complex tasks

• Problematic units

• New routes

• New technicians

Field operations

Strategic distributors

• Virtual onsite support

in countries without

tkE presence

+

First Field pilot started in USA; focus on learning about further needs and improvements


Remote support field test using Skype with HoloLens (01-MAR-2016)

Field test showed significantly improved troubleshooting: time reduction from 1 hour to 22 minutes

On-site technician using HoloLens Remote expert using tablet

1st step on the HoloLens strategic roadmap for Field: Skype-supported assistance


Onsite sales engineering (MOD)

Customer ‘wow’ effect (sales)

Remote troubleshooting (SER)

Digital transformation of Field Service (overall)

• Transforming from hand-held to hands-free mobility solution

• Remote onsite training tailored for immediate needs

• Increased learning impact via gamification

• Instant spare parts ordering

• Safety and quality warnings virtually projected in real life situations

• Mixed Reality gives shape to the intangible, i.e.:

• Technician showing the customer what was broken and how it was fixed, which part was replaced, …

• MOD sales rep visualizing the modernization with 3D holograms into real life situation

• tkE leading the change in the industry

• HoloLens combined with MAX: real time parameter visualization during operation

• 3D visualized instructions from remote expert

• Successful implementation of new technologies to market using online support

• Paperless operation instructions and maintenance manuals, instantly updated and deployed using the cloud

• Through the almost instant measurement of surfaces (1mm accurate), shafts, machine rooms and all components therein or thereto can be easily and correctly measured by non-technical trained staff (like sales reps)

• MOD sales rep can make modernization tangible to the customer (see above), thereby increasing hit rate

• Engineers are provided with accurate measurements and 3D mapping of actual situation, thereby speeding up engineering process

Field Approach: Seamless integration of one solution in multiple areas


+

Machine learning

Cloud based storage

+

Elevator

MAX


Elevator data always at hand

Digital-age partners for our technicians

Better informed, enhanced troubleshooting, less stress


A potential of 50% decrease in

elevator downtime

MAX till date

+80,000 elevators already

connected

Global goal: Connect 180,000

elevators to the cloud by end 2017


• Increased elevator availability

• Quicker service interventions

• Further improved safety and reliability

• Better capacity for planning

• Transparency in service data

• Improved elevator lifetime

MAX


HoloLens 3D Maintenance Training


HoloLens Training / Showrooms: Increase effectiveness of trainings and customer

experience

Approach

Individual Training

Virtual Training Rooms

Showroom/ demos

• 3D model trainings

• tkE technology to be transferred into HoloLens environment

• Manuals and training materials to be migrated to HoloLens to support workforce

• MS virtual rooms already in place

• New training concepts based on virtual rooms and avatars are promising

• Envisioning workshop scheduled to develop a tkE approach

• Sales support with 3D models and mixed reality already seen in MS labs as well as in tkE use cases

Different approaches for training concepts based on HoloLens are currently under review


Job Site Preparation


Holohack Hackathon in Atlanta on Dec 2nd/3rd 2016

Link: https://holohack.devpost.com/,

Recruitung

• 150 participants

• ~25 candidates identified

• 8 interviews by now

• 2 interns hired

Development

• HoloLens in Smart City

• “Wow” 3D visualizations

Branding

• tk as high tech employer

• Campus awareness

Successful AR/MR smart cities hackathon with thyssenkrupp & Microsoft HoloLens carried out

https://holohack.devpost.com/

https://holohack.devpost.com/


HoloLens applications reach next level

Premiere of the MULTI mock-up (1:3) on 05.11.2015 at Innovation

Center

Customer and press event with 150 guests

Media presence: > 230 articles with > 360 million readers.

Unveiling

HoloLens Press conference on September 15th, 2016 with ~50 international journal

ists

Media presence with > 300 million readers

HoloLens video with over 78,000 views

“Going up? HoloLens is now a key tool

for thyssenkrupp elevator technicians”

“HoloLens: the virtual reality headset

for elevator repair”

“Microsoft HoloLens

verringert Wartungszeit“

“thyssenkrupp has unveiled new

holographic technology designed to give

technicians access to hands-free

information …”


Unveiling MULTI

Backup


MAX System overview

4

5 5

6

Events

power up event

change of service

Load weigher overload

stuck car

Data

car and hall calls

trips & re-levels

door movements

configuration data

ERP (start ticketing)

Tools

Abnormalities

Problems

Events

Immediate emergency calls

Basic data/ event collection from elevators ww

Providing relevant

information to

technicians

Support technicians on

on-site visits

1

Instructions from Cloud to the site

3

Spare parts ordered

Maintenance/ emergency tickets

Historical/ elevator specific data

contract-no., ID, BOM

Call Center

Microsoft

Azure / Azure

ML

Data collection and storage

Data analysis

Data Science

Predictive Maintenance

Dashboard

Information about resolutions

Visualization of (historical) data & events

Instructions to the site via Cloud

Events

2

Decision makers along the

process

Service-Technician

Supervisor

Remote-Service-Support-Engineer

Remote-Service-Technician

Branch Manager

4

CUSTOMER

http://www.google.de/url?url=http://voicent.com/predictive-dialer/blog/&rct=j&frm=1&q=&esrc=s&sa=U&ei=PRvvVIH6F4GpUv_WgpgB&ved=0CCoQ9QEwCg&sig2=5sl6bFMJeDS8meJDOmWFVQ&usg=AFQjCNFxz6dq2EFq1DbUXP7Dk9vABx7RZw

first glimpse on hololenshololens environment •manuals and training materials to be migrated to...

Documents