data explosion big data analytics in the new cognitive era › wp-content › ...does the era of big...

© 2013 IBM Corporation

Data Explosion –

Big Data Analytics in the new Cognitive Era

Les King

Director, Database, Analytics, Big Data Solutions

May, 2014

[email protected]

mailto:[email protected]

2 © 2013 IBM Corporation

2

The Future of Analytics - Cognitive

Tabulating Systems Era

1900 2011

Programmable Systems Era

1950


2 years ago, Watson’s advanced analytic capabilities could sort through the

equivalent of 200 million pages of data to uncover an answer in 3 SECONDS and

would fill up this entire room.

Today…Watson is now 24x faster and has gone from the size of a

master bedroom to three stacked pizza boxes.


Real time analytics is not only about reducing the latency between what flows

through your transaction systems and when it lands in your data warehouse so

you can perform analytics …. It is about real time activities performed by people

( your customers – and – potential customers ) through non-traditional sources (

facebook, tweets ) and being able to react to that immediately to capture an

opportunity.


We are here

Sensors

and Devices

Social

Media

VoIP

Enterprise

Data

2013

In just two days we now generate as much data as

was generated in total through 2003

4/5th of all data is unstructured and growing

15 times the rate of structured data

Over 1 billion tweets are sent every 3 days

2015

Percentage of

uncertain data

… and are fueling an explosion of data—a new economic asset that

has become the basis of significant opportunity


Today’s organizations are facing many disruptive forces

The ability to exploit big data

Creating the need for

organizations to

understand and anticipate

customer behavior and

needs based on customer

insights across all

channels

Creating new

opportunities to capture

meaningful information

from new varieties of

data and content coming

at organizations in huge

volumes and at

accelerated velocity

Creating the need for all

parts of the organization

to optimize all of their

processes to create new

opportunities, to mitigate

risk, and to increase

efficiency

3 The shift of power to the consumer 1 Accelerating

pressure to do more with less

2


Data AVAILABLE to an

organization

Data an organization

can PROCESS

The Big Data Conundrum

The percentage of available data an enterprise can analyze is decreasing

proportionately to the available to that enterprise

Quite simply, this means as enterprises, we are getting

“more naive” about our business over time


Transactional & Application Data

Sensor Data

Social Data

Enterprise Content

• Volume

• Structured

• Throughput

• Variety

• Unstructured

• Volume

• Variety

• Unstructured

• Veracity

• Velocity

• Structured

• Ingestion

Big Data is all data and all paradigms for extracting value


Why Act Now?

Create IT Agility Manage Risk Outperform

Only 1 in 5 organizations allocate more than 50% of IT budget to new projects

Of leaders cite growth as the key source of value

from analytics

Source:

1 - IBM IBV Study: Analytics: A blueprint for value, October 2013

2 - IBM Global Study on the Economic Impact of IT Risk, 2013

3 - IBM Global Data Center Study, 2012

Of respondents were impacted by a cyber security breach over the past 24 months

46% 75% 1in5


Pervasive

connectivity

Big data

Social

Analytics

Mobile Cloud

Digital transformation forces

67% of global consumers

want to use mobile devices to complete retail transactions

The emergence of big data and analytics, social, mobile and cloud

are fundamentally changing how we live, work and interact …

2.5 billion gigabytes of data

generated every day

1/3 of consumer data

will be stored in the cloud by 2016

1.3 billion global mobile workers

by 2015, representing nearly 35% of the worldwide workforce*

* XXX


61% of consumers use digital

channels as part of their

purchasing journey

67% of information in most

companies has no

business, legal or regulatory

value

2/3 U.S. adults will not return to a business

that lost their personal

information

Explosion of new forms of data causing significant challenge of dealing with

data from non-traditional sources

Realities of today’s economy

Rising customer

expectations

Need to manage

costs and ensure

integrity

Competition

for customers


Big Car Makers in Race to Recall More aggressive regulators, potential for court action pressure industry to act

Putting Student Data to the Test to Identify Struggling Kids | WLRN

Importance of content has never been higher

New Rule Protects Privacy, Secures Health Information


80% 150%

95% 98.5%

The Opportunities from Big Data & Analytics Are Infinite

Reduction in

serious accidents

Revenue

growth rate

Accuracy monthly sales forecasts

On-time delivery target achieved

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=5q9PX7BDyQbRtM&tbnid=Qcl9xPLj1zkY1M:&ved=0CAUQjRw&url=http://zozotown.com/en/_news/1226/default.html&ei=H4ASUbyUIrPq0QGSnYCgAg&psig=AFQjCNHabrV9sNS1KoyLlL7fDwedVWlIBg&ust=1360253319110502


Does the Era of Big Data Signify the End of the Data

Warehouse? NO!

“Instead they [organizations] are moving towards multiple systems, including

content management, data warehouses, data marts and specialized file

systems tied together with data services and metadata, which will become the

"logical" enterprise data warehouse.”

Andrew Foo, Senior IT Architect Smarter Planet Solutions Team -

“Big data brings new life to the data warehouse by enriching it and introducing

new insights taken from non-traditional sources, as well as unexplored data

sources. The integration of big data and traditional data warehousing can

produce results that are the best of both worlds.”

Top 10 Strategic Technology Trends for 2013


15

Big Data & Analytics – How to get started

Helps organizations Imagine it, unleashing creativity to address business

challenges now and in the future

Allows enterprises to Trust it, managing risk, securing data and ensuring

privacy while protecting the organization’s reputation

Lets customers Realize it by architecting solutions that encompass all data and

analytics scenarios

1

2

3


Imagine It. Every Industry can Leverage Big Data and Analytics

Insurance

• 360˚ View of Domain

or Subject

• Catastrophe Modeling

• Fraud & Abuse

Banking

• Optimizing Offers and

Cross-sell

• Customer Service and

Call Center Efficiency

Telco

• Pro-active Call Center

• Network Analytics

• Location Based

Services

Energy & Utilities

• Smart Meter Analytics

• Distribution Load

Forecasting/Scheduling

• Condition Based

Maintenance

Media & Entertainment

• Business process

transformation

• Audience & Marketing

Optimization

Retail

• Actionable Customer

Insight

• Merchandise

Optimization

• Dynamic Pricing

Travel & Transport

• Customer Analytics &

Loyalty Marketing

• Predictive Maintenance

Analytics

Consumer Products

• Shelf Availability

• Promotional Spend

Optimization

• Merchandising

Compliance

Government

• Civilian Services

• Defense & Intelligence

• Tax & Treasury Services

Healthcare

• Measure & Act on

Population Health

Outcomes

• Engage Consumers in

their Healthcare

Automotive

• Advanced Condition

Monitoring

• Data Warehouse

Optimization

Life Sciences

• Increase visibility into

drug safety and

effectiveness

Chemical & Petroleum

• Operational Surveillance,

Analysis & Optimization

• Data Warehouse

Consolidation, Integration

& Augmentation

Aerospace & Defense

• Uniform Information

Access Platform

• Data Warehouse

Optimization

Electronics

• Customer/ Channel

Analytics

• Advanced Condition

Monitoring


Information Integration & Governance

Exploration, landing and

archive

Trusted data

Reporting & interactive analysis

Deep analytics & modeling

Data types Real-time processing & analytics

Transaction and application data

Machine and sensor data

Enterprise content

Social data

Image and video

Third-party data

Operational systems

Actionable insight

Decision

management

Predictive analytics and modeling

Reporting, analysis, content

analytics

Discovery and exploration

Realize It. Invest in a Big Data & Analytics platform


Trust It. Be proactive about privacy, security and governance.

Create foundation of trusted data

Understand usage and monitor compliance

Model exposure and understand

variability

Trust the facts Ensure privacy

and security Make risk

aware decisions

© 2013 IBM Corporation

Thank You

Les King

Director, Database, Analytics, Big Data Solutions

May, 2014

[email protected]

mailto:[email protected]

data explosion big data analytics in the new cognitive era › wp-content › ...does the era of big...

Documents