augmented and virtual reality with big data

Copyr igh t © 2015, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

MICHAEL THOMAS | 2015TWITTER: @MIKE_D_THOMAS

VIRTUAL AND AUGMENTED REALITY WITH BIG DATA

HADOOPSPHERE VIRTUAL CONCLAVE – AUGUST 2015


CONVERGING TRENDS

User interface technologies: new

head gear and beyond

Growth in data, in many ways


EVENT STREAMS: THE HEADWATERS OF BIG DATA

• Where does Big Data come from? • Streams.

• IoT• Other aspects of the digital economy: network infrastructure, social media, etc.

• Many, many, many events – still too many for even the cheapest of disks

SAS Event Stream Processing analyzes data in-motion:• for storage• Low latency actuation• …and real-time presentation of high-throughput event

streamsAmazon river dolphin

Meeting of the waters, Amazon RiverNevado Mismi, most distant source of the Amazon River


… it is about applying analytics while the data is in motion

Streaming Analytics


Streaming Analytics Ecosystem

EdgeAnalytics

In-MotionAnalytics

At-RestAnalytics

Network Systems, Surveillance

Monitor equipment on the platform for failures and safety

issues, and take action.

Identify fraudulent transactions and be alerted in real-time.

Intelligently integrate customerinformation with real-time

streaming data

Strategic Data IntegrationTransactions, Logs, Clickstreams


from punch cards…

To immersion and ubiquity

Microsoft HoloLens

Epson Movario

MicroOptical MV-1

Oculus Rift

WebGL

Google Cardboard

Emotive EPOC

User interfaces: the long arc

Leap Motion Controller

Microsoft Kinect


REALITY & ANALYTICS

• Augmented reality

• Augmented virtual reality

• Data reality

http://blogs.sas.com/content/sascom/2015/01/30/reality-fueled-by-iot/





AUGMENTED REALITY

• “Head’s up” use cases:• Technicians in an industrial space• Medical

• Convergence towards form factor of stylish sunglasses

• Can augment reality with simple, traditional visualizations and text

Microsoft HoloLens

Epson Movario

MicroOptical MV-1

And dozens of others…


AUGMENTED VIRTUAL REALITY

• Uses VR technologies• Augment VR• Context from 3D models• 3D models directly project

business data


CUSTOMER SCENARIO

BUSINESS CHALLENGE• Monitoring Electronic Submersible Pump efficiency & well performance

for deep sea drilling rigs

• Failure of one pump is $2M/day; one day of productivity loss equates to $20M in deferred revenue

CRITICAL COMPONENT FAILURE AVOIDANCE OIL AND GAS COMPANY

SOLUTION• Over 2.1 million sensors generating 3 trillion rows of data/minute

monitored for potential failure (temperature, vibration, ..)• Automated sub-second detection of spectral performance and sensor

reading quality• Solving more event-driven problems in shorter time than previously

possible


DEMONSTRATION


UI EVENT STREAMS

…. mice and keyboards generate lots of events• New user input devices generate even more • Event stream processing can ingest UI event

streams, just like any other event stream• User experiences can create even more Big

Data…. high-throughput input devices can create much more

Emotive EPOC

Leap Motion Controller

Microsoft Kinect


DATA REALITYDATA REALITY

1

2

3

Take an interesting high-throughput stream

Make a reality

Augment with traditional visualization as needed

Data reality is the windshield that complements the dashboardData reality and traditional visualization, not or, not versus


DATA REALITYBEYOND READING DATA: GAPS & OPPORTUNITIES

• Age of big data not yet realized volume impact on perception and cognition

• Screens are capable of much higher data throughput than traditional data visualization

• The optical nerve absorbs around 8 Megabits/second• speed reader takes in <1K per second• High definition TV market suggests even higher throughput rates to cognition

• Deferring distillation and aggregation to cognition, data reality makes human intelligence and intuition more powerful


FIELD TRIP: THE HIGH DEF TV STORE• Businesses have lots of high definition screens• But they aren’t used anywhere near their capacity• Businesses don’t use the screens the way they are sold on the shop floor

• They aren’t used in the way that manufacturers and retailers use them to grab consumers’ attention and imagination


FIELD TRIP: THE HIGH DEF TV STORE

Artistic demo: 3D bar chart Reality


FIELD TRIP: THE HIGH DEF TV STORE

Also, the display of analysis results related to selling a credit card…

Very much ‘screen as versatile and available paper’A very good way to communicate this message.


MEANWHILE, SAS®

VISUAL ANALYTICS ATTACKS BIG DATA TODAY

SAS® Visual Analytics analyzes a day at ‘DinoFun World’https://www.youtube.com/watch?v=BIPscav27Js&

http://www.sas.com/en_us/software/business-intelligence/visual-analytics.html






https://www.youtube.com/watch?v=BIPscav27Js&




REALITY HARDWAREUsages Hardware

Augmented Reality

“Heads up” rendering of data augmenting view of reality

AR headsetsMobile screens:

smartphone, tablet

Augmented Virtual Reality

3D models provide identity and context

HeadsetFlat screensCardboard

Data Reality

Represent the nature of wide high-throughput real-time data streams using reality metaphors

HeadsetFlat screensCardboard


DATA REALITYWE HAVE THE TECHNOLOGY…

• Streaming analytics with SAS® Event Stream Processing can turn a high-throughput real-time event stream in to a reality

• Traditional techniques can augment actual, virtual or data reality• Reality metaphors are, by nature, a fit for wide, multi-dimensional,

interconnected data with a time series aspect• Are you ready to perceive streaming data in a new way?


YOUR THOUGHTS?

Blog: http://blogs.sas.com/content/sascom/author/michaelthomas/Twitter: @mike_d_thomas

http://blogs.sas.com/content/sascom/author/michaelthomas/



https://twitter.com/mike_d_thomas

https://twitter.com/mike_d_thomas


THANK YOU

augmented and virtual reality with big data

Technology