computer graphics 2m370wstahw/edu/2z860/slides/vis01.pdf · • attributes of visualization •...

55
1 Visualisatie BMT Introduction, visualization, visualization pipeline Arjan Kok Huub van de Wetering ([email protected])

Upload: others

Post on 12-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

1

VisualisatieBMT

Introduction, visualization, visualization pipeline

Arjan Kok

Huub van de Wetering ([email protected])

Page 2: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

2

Lecture overview

• Goal• Summary• Study material

• What is visualization

• Examples• Visualization pipeline

Page 3: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

3

Goal

• Provide theoretical and practical knowledge in:• Data visualization • Data representation• Computer graphics

• Data processing in Java• Visualization in MayaVi

Page 4: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

4

Summary (1)

• Introduction• What is visualization• Related disciplines• Fields of applications

• The visualization pipeline

• Definition• Data enrichment, mapping, rendering

Page 5: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

5

Summary (2)

• Basic data representation• Datasets• Sampling• Interpolation

• Graphics rendering

• Rendering process• Color• Lighting, shading

Page 6: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

6

Summary (3)

• Algorithms• Scalar algorithms• Vector algorithms• Tensor algorithms• Modeling algorithms

• Volume visualization• Ray tracing, ray sampling• Volume interpolation

• …

Page 7: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

7

Study material

• Theory• Book• Slides

• Practice

• MayaVi (visualization tool)• Jaspis (java programming tool)• Assignments

Page 8: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

8

Book

• The Visualization Toolkit –An Object-Oriented Approach to 3D GraphicsW. Schroeder, K. Martin, B. LorensenPrentice Hall

• Book contains a lot more than thecourse does (course will addressspecific parts/chapters)

• Book contains software (VTK) we shallnot (directly) use

Page 9: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

9

Slides

• Slides used in lectures will be available at:

http://www.win.tue.nl/~wstahw/2Z860

Page 10: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

10

Visualization

Page 11: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

11

What do we visualize?

Page 12: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

12

Visualization

The purpose of computing is insight, not numbers

- Richard Hamming

Page 13: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

13

Visualization - insight in data

Page 14: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

14

From data to pictures

• Attributes of Visualization• Making abstract data visible (complex, many)• Forming a mental image of something abstract• Using the abilities of human vision and interaction

DATA VISUALIZATION PICTURES

12.4556 34.442

-22.2000E+11 0.3324

a: 27.3099 b: 43.3

C:33.323 34.445

Page 15: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

15

Scientific visualization

• The use of computer imaging techniques as a tool for comprehending data obtained by simulation or physical measurements

• The techniques that allow scientists and engineers to extract knowledge from the results of simulations and computations

Page 16: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

16

Goals in visualization

• Exploration of data and information• Enhancing understanding of concepts and processes• Gaining new (unexpected) insight• Making invisible visible• Effective presentation of significant features

• Quality control of simulations and measurements• Increasing scientific production

Page 17: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

17

Visualization challenges

• Getting usable data• Parsable• Visualizable

• Defining your goal• What is the focus of attention or primary features

• Who is the audience• What is the message

• Choosing meaningful/compelling visual representations

Page 18: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

18

Graphs

0

2

4

6

8

10

12

14

16

18

20

1 2 3 4 5 6 7 8 9 10

Page 19: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

19

Complex data

• We are interested in more complex data• Multi-dimensional• Complex geometry• Computed or collected

• Simulations

• MRI, CT, ..• Microscopic to galactic data collections

Page 20: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

20

Some examples

Page 21: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

21

Related disciplines

SIGNAL PROCESSING

COMPUTER GRAPHICS

COMPUTER AIDED DESIGN

PERCEPTUAL PSYCHOLOGY

GEOMETRIC MODELING

IMAGE PROCESSING

VISUALIZATION

USER INTERFACE STUDIES

Page 22: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

22

Imaging, graphics, visualization

• Imaging• The study of 2D images

(transformations, enhancement, information extraction)• Graphics

• Creating images using a computer(2D drawing techniques, 3D rendering techniques)

• Visualization

• Exploring, transforming, and viewing data as images

Page 23: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

23

Imaging, graphics, visualization

• Visualization uses computer graphics and imaging as tools for the higher level goal of getting insight into data

• Graphics and imaging are particular forms of visualization …

Page 24: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

24

Imaging, graphics, visualization

any data

image

2D/3D object

image

image

image

Data transformation

nD2D, 3D2DData dimensionality

VisualizationGraphicsImaging

Page 25: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

25

Applications

Page 26: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

26

Applications

• Biochemistry• Molecular modeling/dynamics• Industrial research on molecular structures• Drug design

DATA VISUALIZATION PICTURES

molecule

structures

Page 27: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

27

Molecular visualization

Page 28: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

28

Molecular visualization

Page 29: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

29

Applications

• Mathematics• Understanding complex concepts

(functions, surfaces, fields, ..)

DATA VISUALIZATION PICTURES

functions

f(x,y,z)

function plot

Page 30: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

30

Mathematics

z = F(x,y) = e-rcos(10r)

saddle quadric surfaceF(x,y,z) = 0

nested implicit functions

Page 31: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

31

Applications

• Medicine• Diagnosis• Treatment planning• Education• Research

DATA VISUALIZATION PICTURES

2D/3Dscan data

surfaces/slices

Page 32: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

32

Medicine

Page 33: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

33

Examples

• Geosciences• Weather forecast• Topography• Geology

DATA VISUALIZATION PICTURES

surface/volume data

surfaces/height plots

Page 34: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

34

Geosciences

Ocean surface height during the El Nino event

Rain during summer 2004

Page 35: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

35

Applications

• Space sciences• Astronomy• Astrophysics• Remote sensing

Page 36: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

36

Space sciences

Orion Nebula as seen from a virtual spacecraft

Page 37: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

37

Applications

• Engineering and physics• Computational fluid dynamics

• Fluid flow simulation• Surface modeling

• Finite element simulations

• Physical processes(strength, elasticity, flow, ..)

Page 38: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

38

Computational fluid dynamics

air pressure ona plane wing

velocity of a turbulent jet flow

internal waves inside the ocean

Page 39: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

39

Finite element methods

pressure on a plane wing

2D flow past a cylinder

Page 40: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

40

Applications

• Architecture• Simulations of:

• Indoor lighting• Sound• Heath

• Air

Page 41: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

41

Architecture

Simulation of light in a theatre

Page 42: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

42

Applications

• Visualization is applicable in any research or engineering field

DATA VISUALIZATION PICTURES

12.4556 34.442

-22.2000E+11 0.3324

a: 27.3099 b: 43.3

C:33.323 34.445

Page 43: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

43

Visualization pipeline

• Describes the steps to transform “raw” data into displayable images

• Goal of these steps is to convert the information to a format amenable to understanding by the human perceptual system while maintaining the integrity of information

Page 44: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

44

Visualization pipeline

Raw Data

Derived Data

Abstract Visualization Object

Displayable Image

Data Enrichment/Enhancement

Visualization Mapping

Rendering

Page 45: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

45

Getting the data

Simulation dataMeasured data

Data formats

HDF, NetCDF, XDR,Dicom, ….

Data compression

RLE, Fractal methods, ….

my own format

Visualization internal data(ready for the pipeline)

Page 46: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

46

Step 1: Data enrichment

• Data enrichment• Interpolation• Filtering and smoothing• Selection• Merging

• Format conversion• 2D and 3D conversions (rotation, translation)

data object(s)data enrichment

(filter object)data object(s)

Page 47: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

47

Step 2: Mapping

• Mapping• Generating displayable data (2D and 3D objects) whose

shape, dimensions and color represent the enriched data

• Abstract visualization objects• The 2D and 3D objects resulting from the mapping stage

(graphical primitives)

data object(s)mapping

(mapper object)abstract

visualization objects

Page 48: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

48

Step 3: Rendering

• Rendering• Produces an image (view) of the 2D/3D abstract

visualization objects• Several rendering parameters

(lighting, shadows, reflections, etc)

abstract visualization objects

renderingimage(s)

Page 49: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

49

Step 3: Rendering

• Rendering• Special rendering techniques such as volume rendering

for non-opaque data

data object(s)volume

renderingimage(s)

Page 50: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

50

Example

Page 51: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

51

Example pipeline

surfacedatapolydata

datapolydata

datastr. pnts

surfaces

lines

image

outlinefilter

geometryfilter

reader

render

mapper

mapper

mapper

Page 52: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

52

Visualization and interaction

Raw Data

Derived Data

Abstract Visualization Object

Displayable Image

Data Enrichment/Enhancement

Visualization Mapping

Rendering

user input

Page 53: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

53

Visualization and research process

• Visualization plays a large role in forming the link between hypothesis and experiment, and between insight and new hypothesis

Page 54: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

54

Visualization and research process

Page 55: Computer Graphics 2M370wstahw/edu/2Z860/slides/vis01.pdf · • Attributes of Visualization • Making abstract data visible (complex, many) • Forming a mental image of something

55

Visualization pipeline (revisited)

Raw Data

Derived Data

Abstract Visualization Object

Displayable Image

Data Enrichment/Enhancement

Visualization Mapping

Rendering