exploring data visualization

52

Upload: jim-jenkins

Post on 28-Jun-2015

908 views

Category:

Technology


1 download

DESCRIPTION

Exploring Data Visualization Course Sampler

TRANSCRIPT

Page 1: Exploring Data Visualization
Mark Zimmerman
Typewritten Text
349 Berkshire Drive • Riva, Maryland 21140 888-501-2100 • 410-956-8805 Website: www.ATIcourses.com • Email: [email protected]
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
http://www.ATIcourses.com/schedule.htm http://www.aticourses.com/data_presentation_and_visualization.htm
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
ATI Course Schedule: ATI's Exploring Data: Visualization course
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Professional Development Short Course On:
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Exploring Data: Accessing, Understanding and Visualizing Data To Gain Insight.
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Instructor:
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Ted Meyer Dr. Brand Fortner
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Val Travers
Typewritten Text
Val Travers
Typewritten Text
Page 2: Exploring Data Visualization

44 – Vol. 93 Register online at www.ATIcourses.com or call ATI at 888.501.2100 or 410.956.8805

Course Outline

1. Overview.• Why Visualization? – The Purposes for Visualization: Evaluation,

Exploration, Presentation.2. Basics of Data.

• Data Elements – Values, Locations, Data Types, Dimensionality ensuring a successful mission.

• Data Structures – Tables, Arrays, Volumes.• Data – Univariate, Bivariate, Multi-variate.• Data Relations – Linked Tables.• Data Systems.• Metadata – Vs. Data, Types, Purpose.

3. Visualization.• Purposes – Evaluation, Exploration, Presentation.• Editorializing – Decision Support.• Basics – Textons, Perceptual Grouping.• Visualizing Column Data – Plotting Methods.• Visualizing Grids – Images, Aspects of Images, Multi-Spectral Data

Manipulation, Analysis, Resolution, Intepolation.• Color – Perception, Models, Computers and Methods.• Visualizing Volumes – Transparency, Isosurfaces.• Visualizing Relations – Entity-Relations & Graphs.• Visualizing Polygons – Wireframes, Rendering, Shading.• Visualizing the World – Basic Projections, Global, Locart.• N-dimensional Data – Perceiving Many Dimensions.• Exploration Basics – Linking, Perspective and Interaction.• Mixing Methods to Show Relationships.• Manipulating Viewpoint – Animation, Brushing, Probes.• Highlights for Improving Presentation Visualizations – Color,

Grouping, Labeling, Clutter.5. Data Access – Standards and Tools.

• Data Standards – Overview, Purpose, Why Use?• Overview of Popular Standards.• Grid/Image Standards – DTED, NITF, SDTS.• Science Standards.• SQL and Databases.• Metadata – PVL, XML.

6. Tools for Visualization.• APIs & Libraries.• Development Enviroments.

CLIGraphical

• Applications.• Which Tool?• User Interfaces.

7. A Survey of Data Tools.• Commercial.• Shareware & Freeware.

What You Will Learn

• Decision support techniques: which type ofvisualization is appropriate.

• Appropriate visualization techniques for thespectrum of data types.

• Cross-discipline visualization methods and“tricks”.

• Leveraging color in visualizations.• Use of data standards and tools. • Capabilities of visualization tools. This course is intended to provide a survey ofinformation and techniques to students, giving themthe basics needed to improve the ways theyunderstand, access, and explore data.

Instructors

Ted Meyer has worked with the NationalGeospatial-Intelligence Agency (NGA), NASA,and the US Army and Marine Corps to developsystems that interact with and provide data accessto users. At the MITRE Corporation and FortnerSoftware he has lead efforts to build tools toprovide users improved access and better insightinto data. Mr. Meyer was the Information Architectfor NASA’s groundbreaking Earth Science Dataand Information System Project where he helpedto design and implement the data architecture forEOSDIS.

Dr. Brand Fortner, an astrophysicist bytraining, has founded two scientific visualizationcompanies (Spyglass, Inc., Fortner SoftwareLLC.), and has written two books on visualization(The Data Handbook and Number by Colors, withTed Meyer). Besides his own companies, Dr.Fortner has held positions at the NCSA, NASA(where he lead the HDF-EOS team), and atJHU/APL (chief scientist, intelligence exploitationgroup). He currently is research professor in thedepartment of physics, North Carolina StateUniversity.

SummaryVisualization of data has become a mainstay in

everyday life. Whether reading the newspaper orpresenting viewgraphs to the board of directors,professionals are expected to be able to interpretand apply basic visualization techniques. Technicalworkers, engineers and scientists, need to have aneven greater understanding of visualizationtechniques and methods. In general, though, thebasic concepts of understanding the purposes ofvisualization, the building block concepts of visualperception, and the processes and methods forcreating good visualizations are not required evenin most technical degree programs. This courseprovides a “Visualization in a Nutshell” overviewthat provides the building blocks necessary foreffective use of visualization.

Exploring Data: VisualizationE

NG

INE

ER

ING

Mark Zimmerman
Typewritten Text
SEE CURRENT SCHEDULE FOR THE LATEST DATES
Mark Zimmerman
Typewritten Text
http://www.ATIcourses.com/schedule.htm
Mark Zimmerman
Typewritten Text
Page 3: Exploring Data Visualization

www.ATIcourses.com

Boost Your Skills with On-Site Courses Tailored to Your Needs The Applied Technology Institute specializes in training programs for technical professionals. Our courses keep you current in the state-of-the-art technology that is essential to keep your company on the cutting edge in today’s highly competitive marketplace. Since 1984, ATI has earned the trust of training departments nationwide, and has presented on-site training at the major Navy, Air Force and NASA centers, and for a large number of contractors. Our training increases effectiveness and productivity. Learn from the proven best. For a Free On-Site Quote Visit Us At: http://www.ATIcourses.com/free_onsite_quote.asp For Our Current Public Course Schedule Go To: http://www.ATIcourses.com/schedule.htm

Mark Zimmerman
Typewritten Text
349 Berkshire Drive Riva, Maryland 21140 Telephone 1-888-501-2100 / (410) 965-8805 Fax (410) 956-5785 Email: [email protected]
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
philiptravers
Typewritten Text
Page 4: Exploring Data Visualization

NASA’sData Pyramid

Page 5: Exploring Data Visualization

Universe of Data• Data Elements• Data Structures (Objects)• Data Collections• Data Systems

• Metadata

Page 6: Exploring Data Visualization

When Dealing with Data• How are the numbers stored?• How is the data Organized• What is the dimensionality of the data?• Is the data on a grid?• What is the best way to analyze the data?

Page 7: Exploring Data Visualization

Data Characteristics• Numeric, symbolic (or mix) • Scalar, vector, or complex structure • Various units • Discrete or continuous • Spatial, quantity, category, temporal, relational, structural • Accurate or approximate • Dense or sparce • Ordered or non-ordered • Disjoint or overlapping • Binary, enumerated, multilevel • Independent or dependent • Multidimensional • Single or multiple sets • May have similarity or distance metric • May have intuitive graphical representation (e.g. temperature with color) • Has semantics which may be crucial in graphical consideration

Page 8: Exploring Data Visualization

Numbers in Computers• Quantitative: Numeric vs. Non-numeric data

– Categorical Data: Finite set– Text

• Number Types– Binary

• Bytes, Integers, Floating point• Fixed precision• Not readable by humans• Storage and processing efficient

– ASCII• Text, Characters• Variable precision• Human readable• Storage and processing inefficient

Page 9: Exploring Data Visualization

Evaluating Number Types• Storage and processing efficiency• Data range required• Numeric precision required• Calculation issues• Portability

Page 10: Exploring Data Visualization

Bytes• 8 bits represents 28 (256) distinct values• Unsigned and Signed

– Twos-complement• Representation

– Hexadecimal, Octal, Decimal, Binary

Page 11: Exploring Data Visualization

Integers• Short and long integers• Signed and unsigned• Fixed point numbers

– Scale and Offset number = scale x (value + offset)

Page 12: Exploring Data Visualization

Floating Point Numbers• Single precision (4-byte)

– 9.10956 x 10-28

– sign exponent mantissa– 0 -28 910956 decimal– 0 -1011010 1001000001011000110001

binary– IEEE Standard 754

• Double precision (8-byte)• Zero, NaN, INF, Complex numbers, Extended

Page 13: Exploring Data Visualization

ASCII Text Numbers• ASCII Characters• Numbers

– Exponential notation– Delimiters - space, comma, tab– Line separators– Position formats

• Unicode (16-bit characters)

Page 14: Exploring Data Visualization

Storage and Processing Efficiency• Bytes - efficient use of disk space and CPU

cycles• Integers - efficient use of disk space and CPU

cycles, especially if no FPU• Floating point - less disk efficient, needs FPU to

be processing efficient• ASCII Text - disk and processing hog, no direct

access unless position formatted, processing requires translation

Page 15: Exploring Data Visualization

Data Range• Bytes - 0 to 255 unsigned or -128 to 127 signed,

easy to exceed range• Integers - depends on size, -32768 to 32767 for

2-byte integers, easy to exceed range• Floating point - very large, but user needs to

know when to use double precision• ASCII Text - limited only by capabilities of

reading software (most software is limited to integer or floating point ranges)

Page 16: Exploring Data Visualization

Numeric Precision• Bytes - always one• Integers - precision is always one for integers, 1/scale

for fixed point• Floating point - can vary depending upon a variety of

numerical factors, but the maximum is about 7 and 15 decimal digits for single and double precision numbers

• ASCII Text - limited only by capabilities of reading software (most software is limited to integer or floating point precision)

Page 17: Exploring Data Visualization

Calculation Issues• Bytes - dangerous because of likely overflow• Integers - dangerous because of likely overflow• Floating point - Usually easy, but be aware of problems:

roundoff, differencing similar numbers, comparisons• ASCII Text - must first convert to integers or floating

point and then subject to same limitations as those types

Page 18: Exploring Data Visualization

Portability• Bytes - Most computers store bytes the same way• Integers - byte ordering problems: little vs. big endian,

fixed point problematic because of scale and offset• Floating point - IEEE standard is most common, but

heritage data may be in other forms• ASCII Text - extremely portable and human readable on

most platforms, with minor problems associated with delimiters, line end characters, and file transfer

Page 19: Exploring Data Visualization

Scientific Data Storage• Text vs. Binary, Public vs. Private• Issues:Numerical Precision

– Numerical Range– Portability– Efficiency– Self-Documenting– Power & Extensibility

• How do the Various Formats Rate?

Page 20: Exploring Data Visualization

How do the Various Formats Rate?

TextBinaryInteger

BinaryFloat

Precision Variable Fair Good

Range Infinite Poor Excellent

Portability Excellent Fair Poor

Efficiency Poor Excellent Excellent

PrivateBinary

PrivateText

StandardBinary

Portability Poor Excellent Excellent

Efficiency Excellent Poor Excellent

Self-Document Poor Good Excellent

Power &Extensibility

Good Good Varies

• What the World Needs is a Powerful, Extensible,Self-Documenting, Standard Binary FloatingPoint File Format for Technical Data

Page 21: Exploring Data Visualization

Kinds of Science Data

• Science Data Types• Metadata• Images• Atomic Types

– Integers– Floating Point– ASCII Text

Example text. This is example of text block. It may include parsealbe language. Or a variety of other textual information. It may include formatted text as long as the formatting is Example text. This is example of text block. It may include parsealbe language. Or a variety of other textual information. It may include formatted text as long as the formatting is Example text. This is example of text block. It may include parl information. It may include ariety mation. It may include formatted text as long as the formatting is

2D Arrays

nD Arrays

Metadata

Tables &Relational Tables

Array ofRecords

Page 22: Exploring Data Visualization

How are my Numbers Organized?

• Dimensionality, Data Locations, and Data Values

• Column Data: List of Data Locations and ValuesX Y Velocity0.5 0.5 0.03500.5 1.0 0.07140.5 1.5 0.38531.0 0.5 0.49111.0 1.0 0.24221.0 1.5 0.92071.5 0.5 0.57441.5 1.0 0.33051.5 1.5 0.8485

• 2D Matrix Data: Locations Implicit in Matrix X

0.5 1.0 1.50.5 0.0350 0.4911 0.5744

Y 1.0 0.0714 0.2422 0.3305

1.5 0.3853 0.9207 0.8485

• 3D Matrix Data: Same as 2DZ=6.0 0.5 1.0 1.5

Z=3.0 0.5 1.0 1.5 2.4064

Z=0.0 0.5 1.0 1.5 1.7672 2.5157

0.5 0.0350 0.4911 0.5744 1.7253 2.7190

1.0 0.0714 0.2422 0.3305 1.7757

1.5 0.3853 0.9207 0.8485

• Polygonal Data: List of ObjectsPolygon

NamePolygon Position Vertices Temp. Stress

A (0.5,0.5,0.0) (vertex info) 72.2 0.034B (0.5,1.0,0.5) • 74.8 0.056C (1.0,0.5,0.5) • 71.3 0.089• • • • •

Page 23: Exploring Data Visualization

Column1 Column2 Column34727 1097 04470 1064 14470 1047 14501 1014 14501 964 14449 931 14464 948 14438 1031 14433 948 14407 956 14396 1014 14381 1196 14349 1717 14580 1741 14664 1411 14706 1312 14690 1245 14727 1097 12376 1188 02182 1237 11883 1510 11893 1551 11899 1551 11925 1568 11920 1642 11946 1692 11951 1733 12009 1783 11988 1923 11993 1932 1

Column Data• Column, Record, Flat File or Table Data

– Records, fields

Time Free_Response Controlled_Response0.00 0.000 0.00000.02 -0.0001 -0.00010.04 -0.0012 -0.00120.06 -0.0039 -0.00390.08 -0.0081 -0.00810.1 -0.0137 -0.01370.12 -0.0211 -0.02110.14 -0.0305 -0.03050.16 -0.042 -0.0420.18 -0.0554 -0.05530.2 -0.0702 -0.070.22 -0.0863 -0.08560.24 -0.1038 -0.10220.26 -0.1232 -0.120.28 -0.1447 -0.13870.3 -0.1675 -0.15770.32 -0.1909 -0.17580.34 -0.2139 -0.19240.36 -0.2356 -0.20670.38 -0.255 -0.21820.4 -0.2719 -0.227

# Data recorded on 01/02/91 at 694 stations. -99 means data not avail.# X and Y is Lat-Long mapped onto polar sterographic projection

X-coord Y-coord Temp(F) Dewpt(F) Press(Mb) U(m/s) V(m/s)4158095.30 2769728.30 15.00 5.00 1020.60 -0.31 2.554206175.00 2711076.00 17.00 5.00 1022.30 -0.52 4.094157729.80 2479427.00 24.00 7.00 1025.70 -1.21 4.473925337.00 2395113.80 27.00 11.00 1026.70 -1.06 5.043975751.30 2386686.80 22.00 7.00 1025.40 -0.89 4.024151424.80 2401246.50 25.00 10.00 1026.70 0.68 2.484089275.00 2322289.50 27.00 4.00 1027.10 2.24 2.134105378.00 2298648.30 30.00 14.00 1027.80 3.60 0.224102765.80 2221281.00 25.00 4.00 1026.40 4.26 1.824157063.30 2257515.30 32.00 8.00 1029.10 3.03 4.164135176.50 2259278.80 30.00 10.00 1028.40 4.71 2.07

Page 24: Exploring Data Visualization

Column Data• Univariate

– One Parameter• Bivariate• Trivariate• Hypervariate

– Multi-parameter

Temperature Variation

53.37956.13258.80374.001

100.896105.08274.42561.11090.95474.48850.07352.92973.25668.17882.253

102.23069.39582.663

103.07570.152

101.36066.188

Alpha Channel Data Age z-fact

Temperature Bias

Temperature Drift

Temperature Aging

0.9950 0.1987 0.1297 107.289 57.677 53.3790.9801 0.3894 0.1739 106.358 69.561 56.1320.9553 0.5646 0.2167 104.817 80.477 58.8030.9211 0.7174 0.4607 102.682 89.991 74.0010.8776 0.8415 0.8924 99.973 97.724 100.8960.8253 0.9320 0.9596 96.718 103.366 105.0820.7648 0.9854 0.4675 92.950 106.694 74.4250.6967 0.9996 0.2538 88.705 107.573 61.1100.6216 0.9738 0.7328 84.026 105.971 90.9540.5403 0.9093 0.4685 78.961 101.949 74.488

Univariate

Hypervariate

Page 25: Exploring Data Visualization

Categorical Data• Non-numeric

– Data broken into groups– Examples: color,

educational level, race, station, age group

• Numeric data can bedivided into categories:– Low– Medium– High

• Often tabular column datawith relations to numeric paramters

Test Site Source z-factalpha red 0.1297

gamma blue 0.1739epsilon blue 0.2167delta blue 0.4607

nu blue 0.8924omicron blue 0.9596lambda blue 0.4675kappa blue 0.2538delta red 0.7328

nu red 0.4685omicron red 0.0766

pi red 0.1224sigma red 0.4487

tau green 0.3672gamma red 0.5931kappa red 0.9138delta blue 0.3868

nu blue 0.5997omicron green 0.9274

Page 26: Exploring Data Visualization

Arrays of Data• Scales and Grids• Numeric Types

5.444 7.323 9.629 11.170 12.655 13.687 14.453

5.119 7.170 8.985 10.786 12.467 13.742 14.693

4.458 6.180 8.355 10.584 12.381 13.777 14.852

4.144 5.485 7.459 9.768 11.900 13.605 14.910

3.706 4.821 6.489 8.466 10.817 13.017 14.750

3.457 4.145 5.637 7.342 9.451 11.882 14.166

3.044 3.397 4.697 6.352 8.182 10.364 12.903

2.763 2.790 3.698 5.181 6.960 8.863 11.123

3.049 2.520 2.905 3.994 5.607 7.395 9.330

Page 27: Exploring Data Visualization

Grids• Uniform grids and no grids

• Non-uniform grids

• Warped grids

• Sparse grids

0.0350 0.4911 0.5744(0.5, 0.5) (1.0, 0.7) (1.5, 0.5)

0.0714 0.7477 0.3305(0.7, 1.0) (1.0, 1.0) (1.3, 1.0)

0.3853 0.9207 0.8485(0.5, 1.5) (1.0, 1.2) (1.5, 1.5)

0.5 1 1.50.5 NaN 0.4911 0.57441.0 0.0714 0.7477 NaN1.5 0.3853 NaN 0.8485

0.5 1 1.50.5 0.0350 0.4911 0.57441.0 0.0714 0.7477 0.33051.5 0.3853 0.9207 0.8485

0.5 0.7 1.80.5 0.0350 0.4911 0.57441.0 0.0714 0.7477 0.33051.1 0.3853 0.9207 0.8485

Page 28: Exploring Data Visualization

Grids• Uniform grids and no grids

0.5 1 1.50.5 0.0350 0.4911 0.57441.0 0.0714 0.7477 0.33051.5 0.3853 0.9207 0.8485

0.00 0.25 0.50 0.75 1.00 1.25 1.50 1.75 2.00

0.00

0.25

0.50

0.75

1.00

1.25

1.50

1.75

2.00

X Y0.5 0.5 0.03500.5 1 0.49110.5 1.5 0.57441 0.5 0.07141 1 0.74771 1.5 0.3305

1.5 0.5 0.38531.5 1 0.92071.5 1.5 0.8485

Page 29: Exploring Data Visualization

Grids• Non-uniform grids

0.5 0.7 1.80.5 0.0350 0.4911 0.57441.0 0.0714 0.7477 0.33051.1 0.3853 0.9207 0.8485

0.00 0.25 0.50 0.75 1.00 1.25 1.50 1.75 2.00

0.00

0.25

0.50

0.75

1.00

1.25

1.50

1.75

2.00

X Y0.5 0.5 0.03500.5 1 0.49110.5 1.1 0.57440.7 0.5 0.07140.7 1 0.74770.7 1.1 0.33051.8 0.5 0.38531.8 1 0.92071.8 1.1 0.8485

Page 30: Exploring Data Visualization

Grids• Warped grids

0.0350 0.4911 0.5744(0.5, 0.5) (1.0, 0.7) (1.5, 0.5)

0.0714 0.7477 0.3305(0.7, 1.0) (1.0, 1.0) (1.3, 1.0)

0.3853 0.9207 0.8485(0.5, 1.5) (1.0, 1.2) (1.5, 1.5)

0.00 0.25 0.50 0.75 1.00 1.25 1.50 1.75 2.00

0.00

0.25

0.50

0.75

1.00

1.25

1.50

1.75

2.00

X Y0.5 0.5 0.03501 0.7 0.4911

1.5 0.5 0.57440.7 1 0.07141 1 0.7477

1.3 1 0.33050.5 0.15 0.38531 1.2 0.9207

1.5 1.5 0.8485

Page 31: Exploring Data Visualization

Grids• Sparse grids

0.5 1 1.50.5 NaN 0.4911 0.57441.0 0.0714 0.7477 NaN1.5 0.3853 NaN 0.8485

0.00 0.25 0.50 0.75 1.00 1.25 1.50 1.75 2.00

0.00

0.25

0.50

0.75

1.00

1.25

1.50

1.75

2.00

X Y0.5 0.5 NaN0.5 1 0.49110.5 1.5 0.57441 0.5 0.07141 1 0.74771 1.5 NaN

1.5 0.5 0.38531.5 1 NaN1.5 1.5 0.8485

Page 32: Exploring Data Visualization

Grids• Hex grids

Page 33: Exploring Data Visualization

Grids & Scales• Scales Support Gridding

5.444 7.323 9.629 11.170 12.655 13.687 14.453

5.119 7.170 8.985 10.786 12.467 13.742 14.693

4.458 6.180 8.355 10.584 12.381 13.777 14.852

4.144 5.485 7.459 9.768 11.900 13.605 14.910

3.706 4.821 6.489 8.466 10.817 13.017 14.750

3.457 4.145 5.637 7.342 9.451 11.882 14.166

3.044 3.397 4.697 6.352 8.182 10.364 12.903

2.763 2.790 3.698 5.181 6.960 8.863 11.123

3.049 2.520 2.905 3.994 5.607 7.395 9.330

1 2 3 4 5 6 7

1

2

3

4

5

7

6

8

9

Indices

1.1 1.2 1.3 1. 4 1. 5 1. 6 1. 7

1.3

2 .3

3 .3

4 .3

5 .3

7 .3

6 .3

8 .3

9 .3

Uniform Gridding

1.1 1.2 1.3 1. 4 1. 5 1. 6 1. 7

2.3

2 .7

3 .3

3 .4

5 .1

7 .8

6 .3

11 .3

15 .3

Etc...

Page 34: Exploring Data Visualization

Volumes of Data

4.46 6.18 8.36 10.58 12.38

4.14 5.49 7.46 9.77 11.90

3.71 4.82 6.49 8.47 10.82

3.46 4.15 5.64 7.34 9.45

3.04 3.40 4.70 6.35 8.18

2.76 2.79 3.70 5.18 6.96

3.05 2.52 2.91 3.99 5.61

3.02 2.38 2.38 3.05 4.31

3.47 2.52 2.14 2.41 3.29

3.71 2.71 2.08 2.00 2.50

4.40 3.16 2.26 1.82 1.94

4.94 3.86 2.87 2.10 1.78

5.17 4.64 3.86 2.94 2.22

5.95 5.61 5.04 4.17 3.24

5.81 6.16 6.03 5.44 4.58

4.46 6.18 8.36 10.58 12.38

4.14 5.49 7.46 9.77 11.90

3.71 4.82 6.49 8.47 10.82

3.46 4.15 5.64 7.34 9.45

3.04 3.40 4.70 6.35 8.18

2.76 2.79 3.70 5.18 6.96

3.05 2.52 2.91 3.99 5.61

3.02 2.38 2.38 3.05 4.31

3.47 2.52 2.14 2.41 3.29

3.71 2.71 2.08 2.00 2.50

4.40 3.16 2.26 1.82 1.94

4.94 3.86 2.87 2.10 1.78

5.17 4.64 3.86 2.94 2.22

5.95 5.61 5.04 4.17 3.24

5.81 6.16 6.03 5.44 4.58

• Large I/O and processingrequirements

• Specialized Visualization

And Scales

1.1 1.2 1.3 1. 4 1. 5

2.3

2 .7

3 .3

3 .4

5 .1

7 .8

6 .3

11 .3

15 .3

15 .3

Page 35: Exploring Data Visualization

Visualization Polygonal Data

• Positioning of polygons in 3-space

• Polygons may be colored according to data value

• Requires significant computational resources

• Animation

A

B

C

P1

P2 P3

P4

P8 P5

P6

PolygonName

Nodes NearestNeighbors

Temperature Stress

A P1,P2,P3,P4 B,C,D,E 34.7 .023B P4,P3,P5,P6 A,C,E,F 23.1 .028C P2,P3,P5,P8 A,B,D,F 24.5 .024D P1,P2,P7,P8 A,C,E,F 29.4 .033E P1,P4,P6,P7 A,B,D,F 28.6 .023F P5,P6,P7,P8 B,C,D,E 31.9 .031

Page 36: Exploring Data Visualization

Data with Relations

Page 37: Exploring Data Visualization

Files of Data• Proprietary Formats• Images Files• Science Data Formats• Multi-object files• Linking Metadata to Data

Page 38: Exploring Data Visualization

Collections of Data• Databases• Files and Directory Structures• Tapes• Hybrid Systems• Boxes in Corners

Page 39: Exploring Data Visualization

Metadata• Metadata is Data• One person’s metadata is another

person’s data• Types of Metadata

– Structural– Attribute - Search and Labeling– Descriptive

• XML

Page 40: Exploring Data Visualization

Metadata Example

DATE = '26-04-90' /ORIGIN = 'UH IFA' / INSTITUTION W RITING THE DATATELESCOP= 'NASA IRTF' / DATA ACQUISITION TELESCOPEINSTRUME= 'ProtoCAM' / DATA ACQUISITION INSTRUMENT OBSERVER= 'BBLW' / OBSERVER NAME/IDENTIFICATIONDATE_OBS= '18/04/90' / DATE OF ACQUISITION('dd/mm/yy')TIME_OBS= '20:33:26.77' / TIME OF ACQUISITION(hh:mm:ss.ss)ITIME = 20.00 / INTEGRATION TIME IN SECONDSFILTER = 0 / 0=BROADBAND 1=CVFW AVE_LEN= 2.20 / W AVELENGTH IN MICRONSPLATE_SC= 0.25 / PLATESCALERA = '10:16:53.92' / RIGHT ASCENSION in degreeDEC = '20:07:21.8' / DECLINATION in degreeEPOCH = 1950.0 / EPOCH AIRMASS = 1.003 / AIRMASSOBJECT = 'GL 388'CO M MENT = 'k=4.6 l=4.6'VGATE = -2.30 / SBRC ARRAY GATE VOLTAGE

…Image of object GL 388 taken on April 18, 1990 with the IRTF telescope, using the ProtoCAM. The image is centered on 10 degrees, 16 minutes, 53 seconds right ascension, 20 degrees, 7 minutes, 21 seconds declination, using the 1950 epoch…

Human Readable Computer Readable

XML

Page 41: Exploring Data Visualization

Case Studies:ASCI and EOSDIS

Page 42: Exploring Data Visualization

ASCI• Accelerated Strategic Computing

Initiative• Comprehensive Test Ban Treaty, 1992• ASCI's vision:

– “to shift promptly from nuclear test-based methods to computational-based methods of ensuring the safety, reliability, and performance of our nuclear weapons stockpile.”

Page 43: Exploring Data Visualization

ASCI Data Requirements• Computational mechanics: meshes & fields• Sound data model w. robust data

abstractions• Common format allows

– common tools – sharing

• Common appl’n programming interface (API)– shield apps from model complexities– standardize data organization and semantics

Page 44: Exploring Data Visualization

ASCI Datatypes

Page 45: Exploring Data Visualization

EOSDIS: Understanding Global Climate Change

Page 46: Exploring Data Visualization

EOSDIS Processing Levels

Page 47: Exploring Data Visualization

EOSDIS Example: Library Analogy

Page 48: Exploring Data Visualization

Granule

Platform, Instrument, Sensor

Spatial and Temporal

Orbit Parameters

Browse

QA Data Statistics

Production History

Collection

Platform, Instrument, Sensor

Delivered Algorithm Package

Guide

Bibliographic Reference

Papers/Documents

Keyword

Example Categories for Granule- andCollection-Level Metadata

Page 49: Exploring Data Visualization

Biases• Disciplines

– Geospatial, simulation• Data structures

– large multidimensional structures, multi-layered structures, meshes, some indexed structures

• Geometry– space and time

• Operations– visualization, partial access, filtering,

integration

Page 50: Exploring Data Visualization

What is Scientific Data?

Page 51: Exploring Data Visualization

What is scientific data?• A variety of data types and structures• Large data structures• Many objects• Metadata: parameters, variables, legacy

in a variety of forms

Page 52: Exploring Data Visualization
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
You have enjoyed an ATI's preview of
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Exploring Data: Accessing, Understanding and Visualizing Data To Gain Insight.
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
http://www.aticourses.com/wordpress-2.7/weblog1/
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Please post your comments and questions to our blog:
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Mark Zimmerman
Typewritten Text
Sign-up for ATI's monthly Course Schedule Updates :
Mark Zimmerman
Typewritten Text
http://www.aticourses.com/email_signup_page.html
Val Travers
Typewritten Text
Val Travers
Typewritten Text
Val Travers
Typewritten Text
Val Travers
Typewritten Text