immersive visual data analysis - university at buffalo...reasoning about quantitative information....

59
Immersive Visual Data Analysis Oliver Kreylos W.M. Keck Center for Active Visualization in the Earth Sciences (KeckCAVES) University of California, Davis

Upload: others

Post on 24-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Immersive Visual

Data Analysis

Oliver Kreylos

W.M. Keck Center for Active Visualization

in the Earth Sciences (KeckCAVES)

University of California, Davis

Page 2: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

KeckCAVES

●Interdisciplinary research project

–Computer science

–Physical sciences

–Faculty, post-docs, graduate/undergraduate students

●Develops virtual reality (VR) for scientific data

analysis

–Methods, software, systems

●Visualization facility

–Shared access to high-end visualization systems

Page 3: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

KeckCAVES

Page 4: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Principles of

Scientific

Visualization

Page 5: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Data-Driven Science

●Modern science is in the business of creating,

processing, and consuming massive amounts

of data

●Data sizes are driven by high-resolution

sensors and high-performance computing

●Example: Computational Fluid Dynamics

(CFD)

●A single wind tunnel simulation can create

petabytes of data

Page 6: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

CFD: Cow at Mach 8

(from http://blogs.mentor.com/robinbornoff/blog/)

Page 7: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Data-Driven Science

●End product of science is insight, not data

●Scientific process turns data into insight:

●Data analysis usually a multi-step pipeline

●Data analysis is often manual

DataAnalysis

RawData

DerivedData

Page 8: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Visualization

“At their best, graphics are instruments for

reasoning about quantitative information.

Often the most effective way to describe,

explore, and summarize a set of numbers –

even a very large set – is to look at pictures of

those numbers.”

Edward R. Tufte, The Visual Display of

Quantitative Information (1983)

Page 9: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

CFD: Cow at Mach 8

(from http://blogs.mentor.com/robinbornoff/blog/)

Bow shock

Page 10: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Classes of Data

●Two classes of scientific data:

–Non-spatial

●Gene co-expression networks

–Spatial

●Air flow around a cow

●Important sub-class:

–Three-dimensional spatial

●3D spatial data is problematic for traditional

visualization

–Traditional displays are two-dimensional

Page 11: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

3D Visualization in 2D

●Displaying 3D data in 2D requires projection

●Projection distorts...

–relative positions

–distances and sizes

–angles

–areas and volumes

●Projection can hide important structure

Page 12: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Projection Distortion

Page 13: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Projection Distortion

Not parallel

Page 14: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Projection Distortion

Not same length

Page 15: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Projection Distortion

Not a right angle

Page 16: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Projection Distortion

Ceci n'est pas un cube

Page 17: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

2D Visualization

●Projection can also create spurious structure

(from http://moillusions.com)

Page 18: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

3D Visualization in VR

●VR is a display medium for 3D content

●VR presents 3D objects without projection:

–No distortion of positions, distances, angles, areas, or volumes

–No hidden or spurious structures

●VR is “holographic”

●VR lets users apply their full power of visual

perception to 3D data analysis

Page 19: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Principles of

Virtual Reality

Page 20: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vision

Page 21: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vision

Page 22: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vision

Page 23: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vision

Page 24: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vision

Page 25: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vision

Page 26: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vision

Page 27: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Movement

Page 28: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Movement

Page 29: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Movement

Page 30: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Movement

Page 31: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Movement

Page 32: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Movement

Page 33: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Movement

Page 34: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vintage VR

Page 35: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Modern VR

Page 36: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Head-mounted Displays

Page 37: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Head-mounted Displays

Page 38: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Head-mounted Displays

Page 39: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Interactive

Visualization

Page 40: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Static Visualization

VisualizationData Picture

Parameters

Page 41: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Interactive Visualization

VisualizationData Picture

Parameters

User

Page 42: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Interaction in VR

●VR is particularly good medium for interaction:

–“Holographic” 3D display

–Direct natural 3D interaction

●Hand-held 3D input devices

–Real-time feedback

Page 43: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Immersive Visual

Data Analysis

Page 44: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

LiDAR Viewer

Page 45: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

3D Visualizer

Page 46: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Nanotech Construction Kit

Page 47: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Tele-Collaboration

Page 48: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

3D Video Avatars

Page 49: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

KeckCAVES

Software

Page 50: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

KeckCAVES Software

●All KeckCAVES software is publicly available

●Free and open-source (GNU GPL)

●Runs primarily on Linux, also on Mac OS X

●http://keckcaves.org

Page 51: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Vrui VR Toolkit

●Foundation for everything else

●Lets VR software run on wide range of

hardware

–Laptop or desktop

–3D TVs

–Projected 3D screens

–CAVEs et al.

–Head-mounted displays

●http://idav.ucdavis.edu/~okreylos/

ResDev/Vrui

Page 52: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

LiDAR Viewer

●Analysis of massive 3D point cloud data

●http://idav.ucdavis.edu/~okreylos/

ResDev/LiDAR

Page 53: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

3D Visualizer

●Analysis of 3D gridded volumetric data

●http://idav.ucdavis.edu/~okreylos/

ResDev/DataExploration

Page 54: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Nanotech Construction Kit

●Interactive creation of molecular structures

●http://idav.ucdavis.edu/~okreylos/

ResDev/NanoTech

Page 55: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Tele-Collaboration

●Vrui add-on to connect multiple VR systems

●http://idav.ucdavis.edu/~okreylos/

ResDev/Collaboration

Page 56: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

3D Video Avatars

●Capture, transmit, and play 3D video

●http://idav.ucdavis.edu/~okreylos/

ResDev/Kinect

Page 57: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

VR Hardware

●Good VR hardware has hit the mass market

●Head-mounted displays:

–Oculus Rift

–HTC Vive

●works natively with Vrui

●Easy to buy

–Best Buy, Amazon, newegg

●Easy to set up

●VR no longer limited to central facilities

Page 58: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Conclusions

●VR is a powerful medium for analysis of 3D

spatial scientific data

–Presents 3D data in “holographic” 3D

–Supports natural 3D interaction

–Supports natural collaboration

●KeckCAVES software is publicly available

–Free and open-source software (GNU GPL)

–Runs on Linux (and also Mac OS X)

–http://keckcaves.org

●Anyone can use VR

Page 59: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers

Demos!