big data: what's it really about?

35
Big Data What is it REALLY About?

Upload: insidehpc

Post on 17-Jan-2015

671 views

Category:

Technology


0 download

DESCRIPTION

In this presentation from the Hurricane Electric Carrier Event, Rich Brueckner from insideBIGDATA describes what's really behind this phenomenon and why you should care. Watch the video presentation: http://wp.me/p3RLEV-1r1

TRANSCRIPT

Page 1: Big Data: What's it Really About?

Big Data What is it REALLY About?

Page 2: Big Data: What's it Really About?

The Proper Introduction

Page 3: Big Data: What's it Really About?

What Big Data is Not

Size Matters Not

Page 4: Big Data: What's it Really About?

For Tonight’s Purposes, ���Big Data = High Performance Data Analysis

Page 5: Big Data: What's it Really About?

Big Data is About Two Things

Page 6: Big Data: What's it Really About?

Big Data is About Two Things

First it’s about Money, Lots of Money

Page 7: Big Data: What's it Really About?
Page 8: Big Data: What's it Really About?

So What’s the Second thing?

Page 9: Big Data: What's it Really About?

So what’s the Second thing?

Page 10: Big Data: What's it Really About?

So what’s the Second thing?

Page 11: Big Data: What's it Really About?

So what’s the Second thing?

“ In the philosophy of decision theory, Bayesian inference is closely related to discussions of subjective probability.""Bayesian probability provides a rational method for updating beliefs.

Page 12: Big Data: What's it Really About?

Big Data is about Degrees of Belief.

Page 13: Big Data: What's it Really About?

So where are headed tonight?

Page 14: Big Data: What's it Really About?

Agenda •  How Big Data Got Me Here

•  Case Studies

•  HPC and Big Data

•  The Future - What’s Next?

Page 15: Big Data: What's it Really About?

Beware the Big Data Naysayers What is their agenda?

Page 16: Big Data: What's it Really About?

If Big Data is So Powerful, ���Why can’t it predict the Economy? The Stock Market is all about Degrees of Belief!

• The economic system is non-linear.

• Therefore, even a small stimulus can create a completely unexpected result

• It’s a complex dynamical system where you don’t have clear knowledge of the initial conditions or the conditions of the stimulus.

• Big Data can can help you see averages, find the needle in the haystack, and help identify the accurate models for predicting what the market is really going to be doing.

Page 17: Big Data: What's it Really About?

How Big Data Got Me Here

Page 18: Big Data: What's it Really About?

How Big Data Got Me Here

•  REACH – Measure of total audience size. •  RESONANCE – How much activity someone creates

when he/she publishes. •  RELEVANCE – How relevant someone is to a topic.

Page 19: Big Data: What's it Really About?

Case Study: Sumo Fraud

Page 20: Big Data: What's it Really About?

Case Study: Prediction Machine

Page 21: Big Data: What's it Really About?

Case Study: Mortgage Fraud Lexis Nexis Risk Analysis

• Developed HPCC technology - an HPC alternative to Hadoop

• Database has 270 Million Individuals in the US Alone

• They know you’re that John Smith

• Graph Analysis spots Relationships

• Ability to spot mortgage fraud rings that were previously undetectable

Page 22: Big Data: What's it Really About?
Page 23: Big Data: What's it Really About?

Case Study: Big Brother Watches Big Brother

Page 24: Big Data: What's it Really About?

HPC and Big Data

Venus (HPC)

Mars (Big Data)

Page 25: Big Data: What's it Really About?

Big Data- What’s Changed?

http://bit.ly/1gZ7ZbD

Page 26: Big Data: What's it Really About?

The Big Data Frontier

There is no Eminent Domain

Page 27: Big Data: What's it Really About?

HPC - What’s Changed?

2013 Tianhe 2 3,120,000 cores 33.86 Petaflops (1015)

1986 CRAY X-MP/4 4 Vector Processors 800 Mflops (106)

Page 28: Big Data: What's it Really About?

The HPC Frontier

Page 29: Big Data: What's it Really About?

Big Data Companies to Watch •  Continuuity - Big Data App Server

•  Lexis Nexis - HPCC Risk Analysis

•  Hortonworks, Cloudera, Zettaset, MongoDB Jaspersoft, Treasure Data, Revolution, and Teradata

•  IBM, HP, Dell, Mellanox, Intel, Nvidia and Cray

•  Startups - too many to mention them all

Page 30: Big Data: What's it Really About?
Page 31: Big Data: What's it Really About?

Summary Big Data is about two things:

• Money! Making More and Keeping it

• Degrees of Belief

Page 32: Big Data: What's it Really About?

Call to Action •  Check out insideBIGDATA.com

•  Buy this book:

•  Big Data: A Revolution That Will Transform How We Live, Work, and Think by Viktor Mayer-Schonberger and Kenneth Cukier

Page 33: Big Data: What's it Really About?
Page 34: Big Data: What's it Really About?

Call to Action • Read this SCI-FI Original: The Observer Effect

• “A scientist seeks uses Big Data to prove the existence of God.”

• bitly.com/theObserverEffect

Page 35: Big Data: What's it Really About?

Poll: So how did I do tonight?