A Closer Look at SQL Data

Warehouse/Big Data

Faisal Hajazi

Solutions Architect – Data Platform

Microsoft Malaysia

Embracing data transforms businessIt is central to outperforming competitors

Agriculture EducationManufacturing Aerospace FinancialAutomotive GovernmentRetailHealthcare

Manage data

variety and

volume across all

data repositories

Modern

Maintain

historical data

from varied

sources

Traditional

Gain real-time

insights without

impacting

performance

Operational

Fragmented systems and processes

Multiple tools and skillsets

Siloed insights on disconnected data

High cost of ownership

Manage data variety

and volume across

all data repositories

Modern

Maintain historical

data from varied

sources

Traditional

Gain real-time

insights without

impacting

performance

Operational

Manage data

variety and

volume across all

data repositories

Modern

Maintain

historical data

from varied

sources

Traditional

Gain real-time

insights without

impacting

performance

Operational

SQL Server 2016 + Reference Architectures

Analytics Platform System

Azure SQL Data Warehouse

Azure Data Lake

Manage data variety

and volume across

all data repositories

Modern

Maintain historical

data from varied

sources

Traditional

Gain real-time

insights without

impacting

performance

Operational

Fragmented systems and processes

Multiple tools and skillsets

Siloed insights on disconnected data

High cost of ownership

SQL Server 2016

Azure SQL DW

Azure Data Lake

Analytics Platform System

SMP MPP

Azure SQL Database

On

-pre

mis

es

Clo

ud

Business intelligence

Machine learning

analytics

Insights

A full portfolio across on-premises + cloudOptimized for analytics: built-in or 3rd-party

Elastic scale from gigabytes to

petabytes across on-premises and cloud.

Fast time-to-value with reference

architectures, appliance, or cloud.

Low TCO ½ the cost of Exadata; pause

cloud compute for added savings.

Flexibility & choice without

tradeoffs, common technology, tools and

languages.

Cortana Analytics SuiteTransform data into intelligent action

DATA

Business apps

Custom apps

Sensors and devices

INTELLIGENCE ACTION

People

Automated Systems

SQL Server 2016Flexible, high-performance database

Real-time operational analytics and up to 100x performance gains on DW queries

ETL built-in for data integration and cleansing across data sources

Multiple levels of security andanalytics built-in or supports 3rd-party tools

Fast time to market with Reference Architecture

Scales from 1TB to 80TB

ETLbuilt-in

SQL Server

Operational DW

SQL Server

Traditional DW

App

Real-timeanalytics w/o perf impact100X

query

performance

gains

SecurityManage data

access

A complete solution; built-in

Oracle SAP Hadoop

SMP data

warehouse

SQL Server 2016Flexible, high-performance database

In-memory Columnstoreperformance and data compression

Reduced query time by 75%

Cut transactional performance down to 10 seconds

ETLbuilt-in

SQL Server

Operational DW

SQL Server

Traditional DW

App

Real-timeanalytics w/o perf impact100X

query

performance

gains

SecurityManage data

access

A complete solution; built-in

Oracle SAP Hadoop

SMP data

warehouse

Analytics Platform SystemSoftware + hardware pre-optimized for data warehousing performance

Massive parallel processing (MPP) for breakthrough performance

Query across relational and non-relational data

Scales from 1TB to 6PB of data

½ the cost of Exadata*

SQL Server

Massive Parallel

Processing

PolyBase

Choice of

Hadoop Region

Select… Result set

Plug-and-play DW appliance

Traditional &

operational DW

Analytics Platform SystemSoftware + hardware pre-optimized for data warehousing performance

SQL Server

Massive Parallel

Processing

PolyBase

Choice of

Hadoop Region

Select… Result set

Plug-and-play DW appliance

Traditional &

operational DW

Handles TBs of data

Query complexity

Near-real-time insights

Cut a 4-hour query to less

than 15 seconds

Azure SQL Data WarehouseA true elastic DW service with enterprise-class features

Create a DW in minutes

Only vendor to separate storage & compute with compute pause

Query across relational and non-relational data

Scales from a few KBs to 1PB

Fastest time to market;

start today, query today

Traditional,

operational, &

modern DW

Azure SQL

Data Warehouse

Analytics

Apps

Control

node

Azure SQL Data WarehouseA true elastic DW service with enterprise-class features

Fastest time to market;

start today, query today

Traditional,

operational, &

modern DW

Azure SQL

Data Warehouse

Analytics

Apps

Control

node

Ingests big data

Scaled workload to 100x in

minutes

Drives business insights to

improve customer satisfaction

Azure Data Lake StoreA cost-effective cloud repository for big data

Designed for multiple analytics frameworks & data durability

Offers enterprise-grade security for even the most sensitive data

Scales from few KBs to PBs

ADL Analytics

Spark

Azure Machine

Learning

HDInsight

R

Azure Data Lake StoreLOB Applications

Social

Clickstream

Sensors

Video

Web

Relational

Devices

Gather and store the widest variety of

data indefinitely—analyze as needed

Operational &

modern DW

Only true hybrid solutionData warehousing your way

On-premises, cloud, or hybrid

SQL Serverin Azure VM

Azure SQL Data Warehouse

SMP MPP

Petabyte-scale

Data warehouse

SMP

Analytics Platform System

MPP

SQL Server

Data warehouse

Petabyte-scale

Common development tools

Familiar T-SQL

Common management tools

Hybrid scenarios which work well

Both Analytics Platform System and Azure SQL Data Warehouse have a massively parallel processing (MPP) engine. Here are a few scenarios where they can be leveraged together.

Dev/testTest new ideas in Azure SQL DW before rolling out to production in APS

ArchiveArchive cold data to blob storage for any workload execution

GovernanceStore data in APS that company policy prohibits being in the cloud

DisasterRecoveryAzure SQL DW or APS as disaster recovery solution