SQL Server Evolution OverviewMyles Matheson and Scott Klein M211

Mission Critical & Hyperscale Cloud

The Evolution of Microsoft Data Platform

SQL Server2000

SQL Server2005

SQL Server2008

SQL Server2008 R2

SQL Server2012

XML ● KPIs

Management Studio ● Mirroring

Compression ● Policy-Based Mgmt ● Programmability

PowerPivot ● SharePoint Integration ● Master Data Services

AlwaysOn ● ColumnStore Index ● Data Quality Services ● Power View ● Cloud Connectivity

Mission Critical & Cloud Performance

Cloud-Ready Self-Service BI

SQL Server2014

In-Memory Across Workloads ● Performance & Scale ● Hybrid Cloud Optimized ● HDInsight ● Cloud BI

Performance & Productivity

Mission Critical

Modern DB platform

Operational Analytics ● StretchDB ● Polybase ● R Integration ● Temporal ● Query Data Store ● RLS ● Always Encrypted

SQL Server2016

Hyperscale cloud

Deeper insights across data

Do more. Achieve more.

Mission critical platform

Performance

Operational analytics• Minimize performance impact

running real-time analytics on transaction data

• Avoid data sprawl

In-memory OLTP for more applications

Query Store

Security

Always Encrypted

Row level security

Dynamic Data Masking

Availability

Enhanced AlwaysOn• 3 synchronous replicas for

auto failover across domains• Round robin load balancing

of replicas • DTC for transactional integrity

across database instances with AlwaysOn

Enhanced online operations

Scalability

Support for Windows Server 2016

12TB 16 Sockets

Deeper insights across data

Access any data

PolyBase

Power Query for analytics and reporting

Enhanced SSIS• Designer support for previous

SSIS versions

• Support for Power Query

Scale and manage

Enterprise-grade Analysis Services

New single SSDT in Visual Studio 2015

Enhanced MDS • Excel add-in 15x faster

• More granular security roles

• Archival options for transaction logs

• Reuse entities across models

Powerful insights

Built-in advanced analytics

Business insights through rich visualizations on mobile devices

Enhanced Reporting Services

Hyperscale cloud

Hybrid solutionsStretch tables into Azure

Power BI with on-premises data

Hybrid scenarios with SSIS

Enhanced backup to Azure

Simplicity

Easy migration of on-premises SQL Server

Simplified Add Azure Replica Wizard

Consistency

Common development, management and identity tools

Consistent experience from on-premises to Azure

Performance Security Availability Scalability

Operational analyticsInsights on operational data; Works with in-memory OLTP and disk-based OLTP

In-memory OLTP enhancementsGreater T-SQL surface area, terabytes of memory supported, and greater number of parallel CPUs

Query data store Monitor and optimize query plans

Native JSON Expanded support for JSON data

Temporal database supportQuery data as points in time

Always encryptedSensitive data remains encrypted at all times with ability to query

Row-level securityApply fine-grained access control to table rows

Dynamic data maskingReal-time obfuscation of data to prevent unauthorized access

Other enhancementsAudit success/failure of database operations

TDE support for storage of in-memory OLTP tables

Enhanced auditing for OLTP with ability to track history of record changes

Enhanced AlwaysOnThree synchronous replicas for auto failover across domains

Round robin load balancing of replicas

Automatic failover based on database health

DTC for transactional integrity across database instances with AlwaysOn

Support for SSIS with AlwaysOn

Enhanced database caching Cache data with automatic, multiple TempDB files per instance in multi-core environments

Mission-critical performance

Traditional operational/analytics architecture Key issues

Complex implementation

Requires two servers (capital expenditures and operational expenditures)

Data latency in analytics

More businesses demand; requires real-time analytics

BI and analytics

SQL Server

Database

Application tier

Presentation layer

IIS Server

ETL

Hourly, Daily, Weekly Database

SQL ServerRelational DW

SQL ServerAnalysis Server

BI analysts

Minimizing data latency for analytics Benefits No data latency No ETL No separate data

warehouse

Challenges Analytics queries are

resource intensive and can cause blocking

Minimizing impact on operational workloads

Sub-optimal execution of analytics on relational schema

BI and analytics

Add analytics-specific indexes

SQL ServerAnalysis Server

SQL Server

Database

Application tier

Presentation layer

IIS Server

BI analysts

Demo – Operation Analytics

JSON became ubiquitous Compact and simple data exchange format

The choice on the web

Recommended scenario I CAN accept JSON, easily parse and store it as relational

I CAN export relational easily as JSON

I CAN correlate relational and non-relational

Motivation for JSON

[ { "Number":"SO43659", "Date":"2011-05-31T00:00:00" "AccountNumber":"AW29825", "Price":59.99, "Quantity":1 }, { "Number":"SO43661", "Date":"2011-06-01T00:00:00“ "AccountNumber":"AW73565“, "Price":24.99, "Quantity":3 }]

Data exchange with JSON

Number Date Customer Price Quantity

SO43659 2011-05-31T00:00:00 AW29825 59.99 1

SO43661 2011-06-01T00:00:00 AW73565 24.99 3

SELECT * FROM myTable

FOR JSON AUTO

SELECT * FROM OPENJSON(@json)

CREATE TABLE SalesOrderRecord ( Id int PRIMARY KEY IDENTITY, OrderNumber NVARCHAR(25) NOT NULL, OrderDate DATETIME NOT NULL,

JSalesOrderDetails NVARCHAR(4000) CONSTRAINT SalesOrderDetails_IS_JSON

CHECK ( ISJSON(JSalesOrderDetails)>0 ),

Quantity AS CAST(JSON_VALUE(JSalesOrderDetails, '$.Order.Qty') AS int) )

GO

CREATE INDEX idxJson ON SalesOrderRecord(Quantity) INCLUDE (Price);

JSON and relational

JSON is plain textISJSON guarantees

consistency

Optimize further with computed column and

INDEX

Demo – JSON

Access any data Scale and manage

Powerful Insights

Advanced analytics

PolyBase Insights from data across SQL Server and Hadoop with simplicity of T-SQL

Enhanced SSISDesigner support for previous SSIS versions

Support for Power Query

Enterprise-grade Analysis Services Enhanced performance and scalability for analysis services

Single SSDT in Visual Studio 2015 (CTP3)Build richer analytics solutions as part of your development projects in Visual Studio

Enhanced MDS Excel add-in 15x faster; more granular security roles; archival options for transaction logs; and reuse entities across models

Mobile BIBusiness insights for your on-premises data through rich visualization on mobile devices with native apps for Windows, iOS and Android

Enhanced Reporting ServicesNew modern reports with rich visualizations

R integration (CTP3)Bringing predictive analytic capabilities to your relational database

Analytics libraries (CTP3)Expand your “R” script library with Microsoft Azure Marketplace

Deeper insights across data

PolyBaseQuery relational and non-relational data with T-SQL

T-SQL query

CapabilityT-SQL for querying relational and non-relational data across SQL Server and Hadoop

Benefits New business insights across

your data lake Leverage existing skillsets

and BI tools Faster time to insights and

simplified ETL process

SQL Server

Hadoop

Quote:

************************

**********************

*********************

**********************

***********************

$658.39

Jim Gray

Name

11/13/58

DOB

WA

State

Ann Smith

04/29/76

ME

Data ScientistInteract directly with data

Built-in to SQL Server

Data Developer/DBAManage data and analytics together

Built-in advanced analyticsIn-database analytics at massive scale

Example Solutions• Sales forecasting

• Warehouse efficiency

• Predictive maintenance

Relational Data

Analytic Library

T-SQL Interface

Extensibility

?R

R Integration

010010

100100

010101

Microsoft Azure Marketplace

New R scripts

010010

100100

010101

010010

100100

010101

010010

100100

010101

010010

100100

010101

010010

100100

010101

• Credit risk protection

Demo - Polybase

Rich visualizations on mobile devices

CapabilitiesBusiness insights through rich visualizations on any device. Native apps for Windows, iOS and Android

Benefits Access your data from anywhere

Touch optimized data exploration and perfect scaling to any screen form-factor

Collaborate with colleagues on the go

Modern reports with SQL Server Reporting

Services Report consumption from modern browsers

Improved parameters

Modern themes

New chart types

Hybrid BI

Power BI connectivity to on-premises Analysis Services Pin on-premises SSRS report to Power BI Dashboard

Continuous investments

SQL Server Analysis Services

Live Power BI reports &

dashboards

LiveQuery

Scheduled Refresh

Cloud

On-premises

Data

Datazen

For on-premises implementations - optimized for SQL Server. Rich, interactive data visualization on all major mobile platformsNo additional cost for SQL Server Enterprise Edition customers 2008 or later and Software Assurance

Mobile BI apps for SQL Server

Datazen Publisher App

Create beautiful visualizationsand KPIs with a touch-based designerConnect to Datazen Server toaccess SQL Server data Publish for access by others

Data visualization and publishing

SQL Server

Analysis Services

File

Data sources

Active directory controller

Authentication

Internet boundary

Viewer Apps

Publisher App

Web browser

Datazen Enterprise Server

Core Service

Data Acquisition Service

Web applications

Enterprise environment

Architecture overviewDatazen Server, Publisher and mobile apps

Demo - RS

Hybrid solutions Simplicity Consistency

Stretch DatabaseStretch operational tables in a secure manner into Azure for cost effective historic data availability works with Always Encrypted and Row Level Security

Power BI with on-premises dataNew interactive query with Analysis Services. Customer data stays behind your firewall

Hybrid Scenarios with SSISAzure Data Factory integration with SSIS, package lineage and impact analysis and connect SSIS to cloud data source

Enhanced Backup to AzureFaster restore times and 50% reduction in storage, support larger DBs with Block blobs and custom backup schedule with local staging

Easy migration of on-premises SQL ServerSimple point and click migration to Azure

Simplified Add Azure Replica Wizard Automatic listener configuration for AlwaysOn in Azure VMs

Common development, management and identity toolsIncluding Active Directory, Visual Studio, Hyper-V and System Center

Consistent Experience from SQL Server on-premises to Microsoft Azure IaaS and PaaS

Deeper insights across data

Capability

Stretch large operational tables from on-premises to Azure with the ability to query

Benefits

Cost effective historical data availability for operational DBs

Entire table is online and queryable

Transparent to application

Supports new TCE transparent encryption and Row Level Security

Apps continue working without change or disruption

BI integration for on-

premises and cloud

Cold/closed data

OrdersIn-memory OLTP table

Hot/active data

Order historyStretched table

Trickle data movement and

remote query processing

On-premises

Azure

Stretch SQL Server into AzureSecurely stretch cold tables to Azure with remote query processing

Order history    

Name SSN Date

Jane Doecm61ba906f

d2/28/200

5

Jim Grayox7ff654ae6

d3/18/200

5

John Smithi2y36cg776r

g4/10/200

5

Bill Brownnx290pldo9

0l4/27/200

5

Sue Danielsypo85ba616

rj5/12/200

5

Sarah Jonesbns51ra806f

d5/22/200

5

Jake Marksmci12hh906

fj6/07/200

5

Eric Mears utb76b916gi6/18/201

4

Rachel Hoganpx61hi9306f

j7/1/2014

Sam Johnson ol43bi506gd7/12/201

4

David Simon tx83hal916fi7/29/201

4

Michelle Burns nb95re926gi8/10/201

4

Reed Deanvc61ira536f

e8/23/201

4

Order history    

Name SSN Date

Jane Doecm61ba906f

d2/28/200

5

Jim Grayox7ff654ae6

d3/18/200

5

John Smithi2y36cg776r

g4/10/200

5

Bill Brownnx290pldo9

0l4/27/200

5

Customer data

Product data

Order History

Stretch to cloud

Stretch SQL Server into AzureStretch warm and cold tables to Azure with remote query processing

CapabilityStretch cold database tables from on-premises SQL Server Databases to Azure with remote query processing

Benefits Cost effective historical data Entire table is online and remains

queryable from on-premises apps

Transparent to applications Supports Always Encrypted &

Row Level SecuritySQL Server App

Query

Microsoft Azure

Jim Grayox7ff654ae6

d3/18/200

5

Live dashboards

and exploration

Analysis Services on-

premisesTabular model

Interactive query

AS Connector

Capability

Publish on-premises Analysis Services data models for consumption in Power BI

Benefits

Faster time to solution without having to move your data to the cloud.

Optimized query performance for sub-second response times.

Manage and secure data residing on-premises in SQL Server Analysis Services.

SQL Server vNext

Connect live to on-premises Analysis Services data

Demo - StretchDB

VISUALIZE + DECIDE

MobileReports

Natural languagequeryDashboardsApplications

Streaming

CAPTURE + MANAGE

RelationalInternal & external

Non-relational NoSQL

TRANSFORM + ANALYZE

Orchestration

Machine learningModeling

Information management

Complex event processing

The Microsoftdata platform

Session code Session name Start TimeM211 The SQL Server Evolution: Overview 9/2/2015 9:00M218 Upgrading Microsoft SQL Server 9/2/2015 10:40M320 In-Memory OLTP: The Road Ahead 9/2/2015 11:55M225 Using Azure Machine Learning to predict Trade Me auction prices 9/2/2015 13:55M324 Why you should be thinking Hybrid with SQL Server 2016 9/2/2015 13:55M327 Big Data for the SQL Ninja 9/2/2015 15:10M229 Introduction to Cortana Analytics 9/2/2015 16:30M236 Microsoft SQL Server BI Drill Down 9/3/2015 9:00M410 SQL Server Execution Plans and the Query Optimizer 9/3/2015 10:40M242 Microsoft Azure SQL Data Warehouse Overview 9/3/2015 11:55M244 BI in Action How Microsoft Finance uses Power BI 9/3/2015 13:55M352 BI in the cloud, is it possible? Sure is with Azure! 9/3/2015 15:10M355 End-to-End SQL Server Master Data Services 9/3/2015 15:10

M359Advanced SSDT and DACFx - Practical techniques for real world database development and deployment. 9/3/2015 16:30

M252 Telling Stories with Data BI Tools as a Key Component of the Business Narrative 9/4/2015 9:00M370 Azure Machine Learning: From Design to Integration 9/4/2015 10:40M378 Elastic for SQL shards, pools, stretch 9/4/2015 11:55M383 Mission Critical features in SQL Server 2016 9/4/2015 13:55

Related Ignite NZ Sessions

Storage OverviewSKYCITY Theatre Thu 3:30pm

Server Virtualisation OverviewNZ2 Wed 1:30pm

What’s New in System Centre for ManagementNZ1 Fri 11:00am

Security and Assurance OverviewNZ4 Fri 9:00am

Azure Consistent Service Delivery OverviewNZ1 Wed 10:00am

Networking OverviewSKYCITY Theatre Thu 11:00am

Find me later at… Hub Happy Hour Wed 5:30-6:30pm Hub Happy Hour Thu 5:30-6:30pm Closing drinks Fri 3:00-4:30pm

1

2

3

4

5

6

Resources

TechNet & MSDN FlashSubscribe to our fortnightly newsletter

http://aka.ms/technetnz http://aka.ms/msdnnz

http://aka.ms/ch9nz

Microsoft Virtual AcademyFree Online Learning

http://aka.ms/mva

Sessions on Demand

Complete your session evaluation now and be in to win!

© 2015 Microsoft Corporation. All rights reserved.Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or

other countries.MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.