Roger Breu

SQL Server PDW Solution SalesMicrosoft Western Europeroger.breu@microsoft.com

Microsoft Solutions for Big Data | Oct 17th 2013

From Numbers And Data To Insights And Value

The world of data has changed

By 2015, organizations integrating high-value, diverse, new information types and sources into a coherent information management infrastructure will outperform their industry peers financially by more than 20%.

– Gartner, Regina Casonato et al., “Information Management in the 21st Century”

Consumerization of IT

10x increase every five years

85% from new data types

Dataexplosion

4.3 connected devices per adult

27%using social media input

The Large Hadron Collider produces 1 PB/sec

But, my customer isn’t CERN and doesn’t have a Large Hadron Collider…

But your customers do have…

Sensors Clicks Logs

Transactional records

Call centers Images

DocumentsSignals

from social media

Simulations

Big Data is Any Data That Can’t Be Managed by Traditional Means

or is beyond the current ability of the enterprise to manage

Big Data is All This and More:

volume, variety, velocity(and volatility & variability)

Traditional Data is Highly Structuredtraditional databases are

organized around planned queries

A Definition

Web app optimization

Smart meter monitoring

Equipment monitoring

Advertising analysis

Life sciences research

Fraud detection

Healthcare outcomes

Weather forecasting

Social network analysis

Churn analysis

Traffic flow optimization

IT infrastructure optimization

Legal discovery

Natural resource exploration

GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN THEIR

INDUSTRY

Common Big Data Customer Scenarios

DemoTwitter Analytics Demo with Microsoft Excel

Is this Big Data?Is this Enterprise Ready?

Big Data is more than just new BI!Big Data is more than just Hadoop!

Fast

L

oad

Source Systems

Historical Data(Beyond Active Window)

Summarize & Load

Big Data Sources (Raw, Unstructured)

Alerts, Notifications

Data & Compute Intensive Application

ERP CRM LOB APPS

Integrate/Enrich

SQL Server StreamInsight

Enterprise ETL with SSIS, DQS, MDS

HDInsight on Windows Azure

HDInsight on Windows Server

SQL Server FTDW Data Marts

SQL Server Reporting Services

SQL Server Analysis Server

Business Insights

Interactive Reports

Performance Scorecards

Crawlers

Bots

Devices

Sensors

SQL Server Parallel Data Warehouse

Data Insights Value

Azure Market Place

4. Business Analytics:

Interactionwith data

2. Map Reduce:

Storing and processing of unstructured

data

3. Streaming:

Real-time data processing

1. Data

Warehousing:

Storing and analysis of

structured data

The Big (Data) Picture, 4 main topics:

The Traditional Data Warehouse

14

… data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing.

– Gartner, “The State of Data Warehousing in 2012”

Data sources

OLTP ERP CRM LOB

ETL

Data warehouse

BI and analytics

The Traditional Data Warehouse

15

Data sources

OLTP ERP CRM LOB

Increasing data volumes

1

Real-time data

2

Non-Relational Data

Devices

Web Sensors

Social

New data sources & types

3

Cloud-born data

4

ETL

Data warehouse

BI and analytics

INFRASTRUCTURE

DATA MANAGEMENT & PROCESSING

DATA ENRICHMENT AND FEDERATED QUERY

BI & ANALYTICS

Self-service CollaborationCorporate PredictiveMobile

Extract, transform, load

Single query model Data quality

Master data management

Non-relationalRelational Analytical StreamingInternal & External

Data sources

OLTP ERP CRM LOB

Non-Relational Data

Devices

Web Sensors

Social

The Modern Data Warehouse

DemoCombining Structured and Semistructured Data with SQL Server PDW and Polybase

DemoCombining Structured and Semistructured Data with SQL Server PDW and Polybase

And remember, it’s not just working with Twitter

data

SQL Server PDW

APPL

ICAT

ION

SD

ATA

SYST

EMS

Microsoft Applications

DAT

A SO

URC

ES

Traditional Sources (RDBMS, OLTP, OLAP)

New Sources (web logs, email, sensor data,

social media)

HDInsight

PolybaseFeature in SQL PDW

CREATE TABLE Customers ([user_id] INT, name NVARCHAR(50)…

CREATE EXTERNAL TABLE ClickEvent (url varchar(50), event_date date, user_ID varchar(50) )WITH LOCATION =‘hdfs://MyHadoop:5000/clickstream/click.txt’;

SELECT COUNT(*) FROM Customers c JOIN ClickEvent e ONc.[user_ID] = e.[user_ID]WHERE c.Name = 'Jones';

Socket for Big Data: Hadoop Access Made Simple

Simplicity & Manageability

ENTERPRISE READYANALYTICS FOR

EVERYONE

Broaden accessibility of Big Data Analytics to all

users

CONNECTED TO THE WORLDS DATA

Combine internal and external data

OPEN & FLEXIBLE

Develop once, deploy on-premises or in the cloud

Pillars of Microsoft’s Big Data Strategy

Data Platform market is estimated to grow 9% YoYBusiness Intelligence market growing 16.4% YoYData Warehousing growing 13.5% YoYBig Data market estimated to grow 39.4% YoY

Source: IDC

Whats in it for you as Partner?

Software

HardwareConsult-ing

Leverage pre-engineered Data Warehouse and Hadoop Appliance solutions from Microsoft (and it’s hardware partners)• De-risk your projects• Streamline deployments• Modernize your customers Data Warehouse/BI

Environments >> Make them Big Data Ready!Leverage and connect the cloud• Streamline deployments• Decommission fast if smaller hadoop (HDInsight)

cluster is sufficient

Whats in it for you as Partner?

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentations. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Thank you

• SQL Server Parallel Data Warehouse (PDW) Landing Page:

• www.microsoft.com/PDW

• Microsoft Big Data Landing Page:• www.microsoft.com/bigdata

• Introduction to Polybase:• http://

www.microsoft.com/en-us/sqlserver/solutions-technologies/data-warehousing/polybase.aspx

• Twitter Analytics for Excel:• http://extendedresults.com/products/twitteranalytics/

Additional Resources