Big Data – Are You Ready?

“Keeping Afloat in a Sea of 'Big Data”ITBusinessEdge – 9/6/11

“Why big data is a big deal”InfoWorld – 9/1/11

“The challenge–and opportunity–of big data”McKinsey Quarterly—5/11

“Getting a Handle on Big Data with Hadoop”Businessweek-9/7/11

“Ten reasons why Big Data will change the travel industry”Tnooz -8/15/11

“The promise of Big Data”Intelligent Utility-8/28/11

Big Data Buzz

Big Data Buzz

Courtesy: Asigra

Big Data Buzz

Courtesy: Asigra

Have you faced any of these?• Your IT guy says that adding new fields to the table will

require more than a month of testing as it requires changes in data models.

• You have to procure new hardware with a more powerful CPU and hundreds of gigabytes of memory to process your data in time.

• Frequent write operations lock data records and block reading operations.

Big Data Buzz

Agenda

• Big Data Overview• How Big is Big Data?• What Makes it Big Data?• Where Do we see Big Data?• What / Who / Why collects all this Data?

• Big Data In Action

• Challenges

• Opportunities

• Big Data Technologies

What is Big Data?

Big Data refers to datasets that grow so large that it is difficult to capture, store, manage, share, analyze and visualize with the typical database software tools.

How big is Big Data?

• It is not a single number but a set of parameters.

• Any data that can challenge our current technology in some manner can be considered as Big Data – Volume

– Communication

– Speed of Generating

– Meaningful Analysis

What Makes it Big Data?

VOLUME(Large amount of

Data)

VELOCITY(Needs to be

analyzedQuickly)

VARIETY(Different types

of Structured

& Unstructured Data)

VALUE

Big Data is Everywhere!

Lots of data is being collected and warehoused

• Web data, E-commerce

• Purchases at departmental and grocery stores

• Bank or Credit Card transactions

• Social Network Interactions

Web Browsers Search Engines

Internet Explorer

Firefox

Chrome

Safari

AOL Explorer

What is collecting all this Data?

Smartphones & Apps

Apple’s iPhone(Apple O/S)

Samsung, HTC.Nokia, Motorola(Android O/S)

RIM Corp’s Blackberry(BlackBerry O/S)

Tablet Computers & Apps

IPad

Galaxy

Kindle Fire

What is collecting all this Data?

Games Boxes and GPS Systems Internet Service Providers

What is collecting all this Data?

Hospitals & Other Medical Systems Banking & Phone Systems

Can you hear me now? (Heh heh heh!)

What is collecting all this Data?

A real pain in the apps! What are they collecting?

• Restaurant reservations (Open Table)

• Weather in L.A. in 3 days (Weather+)

• Side effects of medications (MedWatcher)

• 3-star hotels in New Orleans (Priceline)

• Which PC should one buy and where? (PriceCheck)

What is collecting all this Data?

Consumer Products Companies Big Box Stores

Who is collecting all this Data?

What data are they getting?Credit Card Companies

Who is collecting all this Data?

Why are they collecting all the data?

Target Marketing• To suggest medications

that precisely match your medical history.

• To “push” television channels to your set instead of your “pulling” them in.

• To send advertisements on those channels just for you!

Targeted Information• To know your needs even

before you know, based on past purchasing habits!

• To notify you of your expiring driver’s license or credit cards or last refill on a Rx, etc.

• To give you turn-by-turn directions to a shelter in case of emergency.

Acquire all available data

ANALYZE

DECIDE

ORGANIZE

ACQUIRE

Big Data in Action

Organize and distill big data using massive parallelism

ANALYZE

DECIDE ACQUIRE

ORGANIZE

Big Data in Action

Analyze all your data, at once

ANALYZE

DECIDE ACQUIRE

ORGANIZEANALYZE

Big Data in Action

Decide based on real-time big data

ANALYZE

ACQUIRE

ORGANIZE

DECIDE

Big Data in Action

Makebetter decisionsusingbig data

ANALYZE

DECIDE ACQUIRE

ORGANIZE

Big Data in Action

Challenges

• Storage and Protection

• Backup and Restoration

• Organization and Categorization of the data

• Cost Control and Availability of critical data at all times

• Acquisition of right data from right sources & its delivery to the Right People in Real-time

• Comprehension and Usage of Big data in unstructured formats such as text or video

Big Data Opportunities

• Improve productivity and gain competitive advantage by identifying trends

• Growing at almost 10% a year, Big Data industry is worth more than $100 billion. This is roughly twice as fast as the software business.

The Million Dollar Question is :

How will you take advantage of this opportunity?

Big Data Technologies

26

Big Data technologies describe a new generation of technologies and architectures, designed to economically extract value from very large volumes of a wide variety of data, by enabling high velocity capture, discovery and/or analysis.

Thank You!