big data: what's it really about?

Big Data What is it REALLY About?

The Proper Introduction

What Big Data is Not

Size Matters Not

For Tonight’s Purposes, ���Big Data = High Performance Data Analysis

Big Data is About Two Things

Big Data is About Two Things

First it’s about Money, Lots of Money

So What’s the Second thing?

So what’s the Second thing?

So what’s the Second thing?

So what’s the Second thing?

“ In the philosophy of decision theory, Bayesian inference is closely related to discussions of subjective probability.""Bayesian probability provides a rational method for updating beliefs.

Big Data is about Degrees of Belief.

So where are headed tonight?

Agenda •  How Big Data Got Me Here

•  Case Studies

•  HPC and Big Data

•  The Future - What’s Next?

Beware the Big Data Naysayers What is their agenda?

If Big Data is So Powerful, ���Why can’t it predict the Economy? The Stock Market is all about Degrees of Belief!

• The economic system is non-linear.

• Therefore, even a small stimulus can create a completely unexpected result

• It’s a complex dynamical system where you don’t have clear knowledge of the initial conditions or the conditions of the stimulus.

• Big Data can can help you see averages, find the needle in the haystack, and help identify the accurate models for predicting what the market is really going to be doing.

How Big Data Got Me Here

How Big Data Got Me Here

•  REACH – Measure of total audience size. •  RESONANCE – How much activity someone creates

when he/she publishes. •  RELEVANCE – How relevant someone is to a topic.

Case Study: Sumo Fraud

Case Study: Prediction Machine

Case Study: Mortgage Fraud Lexis Nexis Risk Analysis

• Developed HPCC technology - an HPC alternative to Hadoop

• Database has 270 Million Individuals in the US Alone

• They know you’re that John Smith

• Graph Analysis spots Relationships

• Ability to spot mortgage fraud rings that were previously undetectable

Case Study: Big Brother Watches Big Brother

HPC and Big Data

Venus (HPC)

Mars (Big Data)

Big Data- What’s Changed?

http://bit.ly/1gZ7ZbD

The Big Data Frontier

There is no Eminent Domain

HPC - What’s Changed?

2013 Tianhe 2 3,120,000 cores 33.86 Petaflops (1015)

1986 CRAY X-MP/4 4 Vector Processors 800 Mflops (106)

The HPC Frontier

Big Data Companies to Watch •  Continuuity - Big Data App Server

•  Lexis Nexis - HPCC Risk Analysis

•  Hortonworks, Cloudera, Zettaset, MongoDB Jaspersoft, Treasure Data, Revolution, and Teradata

•  IBM, HP, Dell, Mellanox, Intel, Nvidia and Cray

•  Startups - too many to mention them all

Summary Big Data is about two things:

• Money! Making More and Keeping it

• Degrees of Belief

Call to Action •  Check out insideBIGDATA.com

•  Buy this book:

•  Big Data: A Revolution That Will Transform How We Live, Work, and Think by Viktor Mayer-Schonberger and Kenneth Cukier

Call to Action • Read this SCI-FI Original: The Observer Effect

• “A scientist seeks uses Big Data to prove the existence of God.”

• bitly.com/theObserverEffect

Poll: So how did I do tonight?