filtergraph: a fast, flexible and sharable service for visualization in big data science (data...

36
A fast, flexible and sharable service for visualization in big data science Dan Burger Web Application Developer Vanderbilt University, Nashville, TN USA Twitter: @danburger [email protected]

Upload: dan-burger

Post on 28-May-2015

145 views

Category:

Technology


1 download

DESCRIPTION

My talk from the Data Visualization Summit in Boston on September 12, 2013. This talk will explore Filtergraph, a web application being developed by Vanderbilt’s Initiative in Data-Intensive Astrophysics to conduct rapid and intuitive visualization of large multi-dimensional datasets. Filtergraph has been designed with an understanding of the cognitive workflow in big-data exploration, enabling users to quickly, easily, and intuitively delve into massive datasets and quickly find emergent patterns in the data. While Filtergraph was designed for astronomy research projects at Vanderbilt, including searches for extrasolar planets from databases involving millions of stars, Filtergraph has broad potential for generating flexible, colorful and interactive data-visualization portals using a wide variety of data sources. Currently, Filtergraph has more than 100 users in 20 countries. Filtergraph is freely available at http://filtergraph.vanderbilt.edu/.

TRANSCRIPT

Page 1: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

A fast, flexible and sharable service for visualization in big data science

Dan BurgerWeb Application DeveloperVanderbilt University, Nashville, TN USA

Twitter: @[email protected]

Page 2: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

my.vanderbilt.edu/keltsouth, web.mit.edu/newsoffice/2011/tess-nasa-award.html

KELT

TESS

Transiting ExoplanetSurvey Satellite

Kilodegree Extremely Little Telescope

Page 3: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

• Large amounts of data– Tens of columns–Millions of rows

• Need for exploratory data analysis– Bad data, missing data, categories,

biases, relationships, patterns

Page 4: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 5: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

http://filtergraph.vanderbilt.edu/

Page 6: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

Five years ofearthquake

data

Page 7: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

filtergraph.vanderbilt.edu/earthquakes

Page 8: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

Admin interface

Page 9: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

Title and description

Filters

Graphcontrol

Save and share

Interactive plot

Page 10: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 11: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

Click and drag to zoom in

Page 12: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 13: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

Click to get more information

Page 14: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 15: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

Spin around

Page 16: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 17: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 18: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 19: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 20: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 21: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 22: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 23: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 24: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

filtergraph.vanderbilt.edu/tess

Page 25: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

New Message

To: My colleagues

Check out this data file!I hope this goes through...

Large file (73 MB)

Page 26: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

New Message

To: My colleagues

http://filtergraph.vanderbilt.edu/myfile

It was so easy!

Page 27: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)
Page 28: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

No plugins or software needed!

Page 29: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

http://slowpokes.vanderbilt.edu/visualization.html

Embed portals on your site

Page 30: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

gnuplot

and more...web2py.com, numpy.org, gnuplot.info, graphicsmagic.org

Page 31: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

http://www.skyandtelescope.com/news/Old-Fat-Stars-Flicker-220565641.html

Page 32: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

http://www.sciencedaily.com/releases/2013/08/130821132348.htm

Page 33: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

http://nashvillepublicradio.org/blog/2013/08/27/star-gravity-discovery-at-vandy-boosts-search-for-distant-planets-like-earth/

Page 34: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

http://www.nbcnews.com/science/stars-twinkling-light-can-reveal-strength-gravitational-pull-6C10972389

Page 35: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

Thanks to:

Keivan StassunRob Siverd

Joshua PepperRachel-Chloe Gibbs

Nathan MeyerManodeep SinhaMartin PaegertNathan De LeePhillip Cargile

Alyce Dobyns-LaddVanderbilt Initiative in Data-intensive Astrophysics

NASA ADAP grant

Images on slide 4 from Hipparcos data:http://filtergraph.vanderbilt.edu/hiptest

Page 36: Filtergraph: A fast, flexible and sharable service for visualization in big data science (Data Visualization Summit Boston 2013)

http://filtergraph.vanderbilt.edu

Dan BurgerTwitter: @danburger

[email protected]