Enabling a data driven agile business

Tharindu MathewAssociate Tech. LeadWSO2 Inc.

Guess who?

Courtesy of http://www.outsider-trading.com/

Peter Brand from Moneyball

Brand analyzes player data and helps GM Beane to drive Oakland A’s to spectacular seasonal performance with a team on a slim payrole

Picture courtesy of imdb

A Data Scientist is…

The sexiest job of the 21st century…

Harvard Business Review - http://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century/ar/1

Careers at facebook

Picture courtesy of facebook

Data as a new source of growth

Data

Data Analytics

Internet of Things

Mobile

Cloud

Recap of 2011

• Complete re-write of monitoring products

• Focusing on 3 main aspects

• Performance

• Scalability

• Customizability

In Sept 2012

WSO2 BAM WSO2 CEP

“Open source, multi-tenanted big data native product platform”

Progress

• 10+ customers

• 4 releases – Just fresh this week - BAM 2.2.0 and CEP 2.2.0

• Heavy internal usage – API Manager, Stratos 2.0, Carbon Ops network

• Enabling data scientists to work their magic on data not be concerned about ops

Creating a big data strategy…

Big Problems?

Big data expertise

Driving decisions

Getting everyone on board

Creating a big data strategy… - Being Big Data native

Creating a big data strategy… - Federated Analytics

Federated Analytics

Spreadsheets

Real-time streams

Logs

Creating a big data strategy… - Scaling

Vision for 2013

“Data to knowledge” fusing WSO2 BAM, CEP, ESB and DSS

And also…

Try to run through 10 TB in 2 seconds

Data created & shared (2012 – 2015)

0

2000

4000

6000

8000

2012 2013 2014 2015

Zettabytes

Zettabytes

What is a Zettabyte?

Mark Liberman calculated the storage requirements for all human speech ever spoken at 42 zettabytes if digitized as 16 kHz 16-bit audio.

(1 billion terra bytes = 1 zetta byte)

Questions