augmented reality for workforce mobility -...

20
© 2015 Electric Power Research Institute, Inc. All rights reserved. John Simmins Technical Executive Information, Communication, and Cyber Security (ICCS) European Engagement Summit April 28-29, 2015 Augmented Reality for Workforce Mobility The Next Level

Upload: vophuc

Post on 18-Mar-2019

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

© 2015 Electric Power Research Institute, Inc. All rights reserved.

John Simmins

Technical Executive

Information, Communication, and

Cyber Security (ICCS) European

Engagement Summit

April 28-29, 2015

Augmented Reality for

Workforce MobilityThe Next Level

Page 2: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

2© 2015 Electric Power Research Institute, Inc. All rights reserved.

Agenda

Augmented reality - definition

Augmented reality – efficiency

Augmented reality

– First EPRI project

– Next EPRI project

Page 3: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

3© 2015 Electric Power Research Institute, Inc. All rights reserved.

Augmented Reality: What is it and where did it come from?

Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data.

• Not to be confused with virtual

reality – which replaces a real

world with a simulated one.

Page 4: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

4© 2015 Electric Power Research Institute, Inc. All rights reserved.

Augmented Reality: What is it and where did it come from?

Combines the real world with

the virtual world,

Is interactive and in real-time

Is registered in 3 dimensions.

Page 5: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

5© 2015 Electric Power Research Institute, Inc. All rights reserved.

So, why consider augmented reality?

Page 6: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

6© 2015 Electric Power Research Institute, Inc. All rights reserved.

Boeing Results*

46 Participants

Tablets, not HMDs

Three areas of interest

– First time quality (lowest

errors)

– Fastest Time

– Worker efficiency

*T. Richardson, S. Gilbert, J. Holub, F. Thompson, A. MacAllister,

R. Radkowski, E. Winer, P.Davies, and S. Terry, “Fusing

Self-Reported and Sensor Data from Mixed-Reality Training”,

Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) 2014

**

**Model Based Instruction

Page 7: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

7© 2015 Electric Power Research Institute, Inc. All rights reserved.

Boeing Results*

46 Participants

Tablets, not HMDs

Three areas of interest

– First time quality (lowest

errors)

– Fastest Time

– Worker efficiency

*T. Richardson, S. Gilbert, J. Holub, F. Thompson, A. MacAllister,

R. Radkowski, E. Winer, P.Davies, and S. Terry, “Fusing

Self-Reported and Sensor Data from Mixed-Reality Training”,

Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) 2014

**

**Model Based Instruction

Page 8: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

8© 2015 Electric Power Research Institute, Inc. All rights reserved.

Boeing Results*

46 Participants

Tablets, not HMDs

Three areas of interest

– First time quality

(lowest errors)

– Fastest Time

– Worker efficiency

*T. Richardson, S. Gilbert, J. Holub, F. Thompson, A. MacAllister,

R. Radkowski, E. Winer, P.Davies, and S. Terry, “Fusing

Self-Reported and Sensor Data from Mixed-Reality Training”,

Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) 2014

**

**Model Based Instruction

Page 9: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

9© 2015 Electric Power Research Institute, Inc. All rights reserved.

Canadian Air Force Results*

The task performance results were evaluated using five parameters:

– The amount of work required to do the task

– The level of understanding of the intent of the task

– The likelihood of information being lost or misplaced

– The likelihood of an error in the task

– The long-term durability of the information

Results

– 16-31 percent improvement across the five evaluation criteria

– Task work decreases from 119 hours to 82 hours.

*NGRAIN Case Study

Page 10: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

10© 2015 Electric Power Research Institute, Inc. All rights reserved.

Canadian Air Force Results*

The task was to integrate

electronic technologies into the

Interactive Electronic Technical

Manuals (IETMs) currently used

by CF CC-130 technicians:

– The number of technicians is

smaller and less experienced.

– Enable novices to perform

maintenance like seasoned

experts

– Interactive animations added

Results

– Technicians completed tasks 25%

faster

– Technicians completed tasks with

22% more accurately

*NGRAIN Case Study

Page 11: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

11© 2015 Electric Power Research Institute, Inc. All rights reserved.

Key Workflow Enablers For Utilities

Infrastructure &

Technology

– Comm protocols

– High speed networks

– Store and forward

– Advanced analytics

Standards

– Enterprise

– Replace existing workflows

– Interface with existing back

office systems

Page 12: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

12© 2015 Electric Power Research Institute, Inc. All rights reserved.

Field Force Data Visualization (FFDV)

Showcase the power of the

Common Information Model

(CIM) in reducing “vendor lock-

in”

Illustrate the immediate value of

CIM

Create a proof-of-concept as to

what is possible in field force

communications

Demonstrate benefits in

efficiencies and worker safety

Page 13: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

13© 2015 Electric Power Research Institute, Inc. All rights reserved.

Emergency Restoration – Field Force Data Visualization

The Keys:

– GIS Context Aware

– CIM

– Augmented Reality

– Data overlays

Usable for ANY work but

excels at storm damage

assessment

Usable for ANY asset

Page 14: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

14© 2015 Electric Power Research Institute, Inc. All rights reserved.

Successes

Imported and displayed four

sets of GIS data

Created and tested several

CIM messages

Demonstrated value to

utilities

Illustrated data problems with

CIS

Page 15: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

15© 2015 Electric Power Research Institute, Inc. All rights reserved.

Challenges

Hardware

– GPS location services can be

enhanced

– Robustness

Data

– Challenges with large data sets

– Bad GIS data

Software

– Presentation icons scalable

– Use of SDK reduced issues with

AR

– Define more CIM messages

Page 16: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

16© 2015 Electric Power Research Institute, Inc. All rights reserved.

New Supplemental Project

Page 17: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

17© 2015 Electric Power Research Institute, Inc. All rights reserved.

Accelerating Augmented Reality for the Electricity Industry

Project Description

– Establish list of use cases

– Pair up leading AR

companies with participants

– Develop AR solutions

– Incorporate standards

– Measure results

– Calculate cost/benefit

Page 18: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

18© 2015 Electric Power Research Institute, Inc. All rights reserved.

Accelerating Augmented Reality for the Electricity Industry

Value

– Direct interaction with leading

augmented reality technology

providers

– Identify and define the utility

activities that the technology

providers will focus on

– First to demonstrate vendor

products

– Clear understanding of the

value of augmented reality for

utility applications

Page 19: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

19© 2015 Electric Power Research Institute, Inc. All rights reserved.

Together…Shaping the Future of Electricity

Page 20: Augmented Reality for Workforce Mobility - EPRIsmartgrid.epri.com/doc/ICCS_Summit/I1.1_Simmins_2015-02-28... · Self-Reported and Sensor Data from Mixed-Reality Training”, Interservice/Industry

20© 2015 Electric Power Research Institute, Inc. All rights reserved.

GWAC Stack