unlocking the intelligence in big data

16
Unlocking the Intelligence in Big Data Ron Kasabian General Manager Big Data Solutions Intel Corporation

Upload: intel-it-center

Post on 05-Jul-2015

399 views

Category:

Technology


0 download

DESCRIPTION

Ron Kasabian GM of Big Data Solutions at Intel discusses the driving forces of Big Data and the insights that Intel technologies are driving.

TRANSCRIPT

Page 1: Unlocking the Intelligence in Big Data

Unlocking the Intelligence in

Big Data Ron Kasabian

General Manager Big Data Solutions

Intel Corporation

Page 2: Unlocking the Intelligence in Big Data

2

What’s Driving Big Data?

40%

AVERAGE

SERVER COST

90%

STORAGE

COST / GB Lower Cost of

Compute & Storage

Volume &

Type of Data

10X Data growth by 2016 90% unstructured 1

New Investments in

Tools & Services

$17B

2012

$7B

2010

$3B

1: IDC Digital Universe Study December 2012 2: Intel Forecast 3: IDC WW Big Data Forecast

2002 - 20122 2002 - 20122

20173

Page 3: Unlocking the Intelligence in Big Data

3

Business intelligence

Biodiversity trends

Customer purchase habits

Epidemic migration paths

Falls prevention for the elderly

Extreme weather prediction

Insight

Untapped Value of Big Data

Medical Scans

Social Media

News &

Journals

Satellite

Images

E-commerce

TV &

Video

Transport

Analyze/ Predict

Sensors & Surveillance

Correlate

Page 4: Unlocking the Intelligence in Big Data

4

Today’s Big Data Insights

Consumer Behavior

Security & Risk Management

Operational Efficiency

Location Aware

Ad Placement

Buyer Protection

Program

Personalized

Preventive Care

Claim Fraud

Reduction

Traffic

Optimization

Smart Energy

Grid

Page 5: Unlocking the Intelligence in Big Data

5

Big Data in Action at Intel Test Time Reduction:

Predictive analytics in manufacturing to identify failing parts quickly

Expected to save ~$20M in 2013

Reseller Channel Management:

Improved reseller engagement with customer profile analytics

Increased sales by $5M per Qtr. while reducing costs

Malware Detection:

Analyzing ~4B access events per day at the system, network, and

application levels l to discover of new malware threats before they

arise.

Page 6: Unlocking the Intelligence in Big Data

6

Eric Dishman

Intel Fellow,

General Manager, Health Strategy and Solutions Group

Datacenter and Connected Systems Group

Page 7: Unlocking the Intelligence in Big Data

7

End To End Big Data Vision

Sensors and Devices

Generating Data

Device Gateways

E2E Analytics

Page 8: Unlocking the Intelligence in Big Data

8

Single Machine or Device Focus

• Monitor a single device

• Requires Human Intervention

• Preventative Maintenance and Monitoring

Aggregated Systems Focus

• Many devices and systems

• Autonomous decisions & real-time optimization

• Transformative business opportunities

Internet of Things Analytics Evolution From Devices to Systems, Monitoring to Automation

Analytics Today Analytics Future

Page 9: Unlocking the Intelligence in Big Data

9

Barriers impeding Big Data Adoption

Complexity Cost Confidentiality

Page 10: Unlocking the Intelligence in Big Data

10

Cache Acceleration Software

Intel®

Enterprise

Edition for

Lustre

AIM Suite

Intel’s Role in Big Data Lower the Time and Cost to deliver Big Data Solutions

End to End Analytics

Edge Devices

Network

Storage Server

Other names and brands may be claimed as the property of others

DC Silicon/Hardware

Ecosystem Enabling

Page 11: Unlocking the Intelligence in Big Data

11

Xeon 5600 HDD 1GbE

<7 minutes

The Power of Platform Solutions TeraSort for 1TB sort: >4 hour process time

Upgrade processor

~50% reduction

Upgrade to SSD

~80% reduction

Upgrade to 10GbE

~50% reduction

Intel distribution

~40% reduction

Other brands and names are the property of their respective owners

Page 12: Unlocking the Intelligence in Big Data

12

Intel® Distribution for Apache Hadoop

Granular access control in HBase

Up to 20X faster decryption with AES-NI*

30X faster Terasort on Intel® Xeon

processors, Intel 10GbE, and SSD

Up to 8.5X faster queries in Hive*

Up to 30% gain in job performance,

automated by Intel® Active Tuner

*Based on internal testing

Rhino

Cloud

HPC

Common authentication,

access control, auditing

Bringing MapReduce to

data on Lustre FS

Optimizing Hadoop for

virtualization & cloud

Drive down complexity , Increase performance on IA, Secure the data

Page 13: Unlocking the Intelligence in Big Data

13

Challenge: Extreme Complexity

How do you

effectively create and

then analyze

something like this?

Page 14: Unlocking the Intelligence in Big Data

14

Open Source Relationship Computing Tools To Build & Analyze Graphs For Big Data Mining, Machine Learning

Intel® Graph Builder (Intel Labs)

GraphLab (CMU ISTC for Cloud Computing)

Data

Page 15: Unlocking the Intelligence in Big Data

15

Intel’s Big Data Research

INVESTING IN 1000’S OF SCIENTISTS ACROSS

INTEL, ACADEMIA, INDUSTRY & GOVERNMENT LABS

Future Data

Experiences

Distributed Data Computing

Machine Learning Algorithms

Data Ecosystem Infrastructure

Analytical Applications

Page 16: Unlocking the Intelligence in Big Data

16