on-premises storage hybrid cloud storage public cloud storage
TRANSCRIPT
Deliver scalable software defined storage anywhere
Session Objectives And Takeaways
Microsoft’s Storage Strategy
On-PremisesStorage
Hybrid CloudStorage
Public CloudStorage
3
4
21Microsoft Storage Strategy
Cloud + Enterprise
5
Trends
Source: multiple research sources
Public IT cloud services spending will reach $56.6
billion in 2014 and grow to more than $127
billion in 2018
$127B
More than 65 percent of enterprise IT organizations will commit to hybrid cloud technologies before 2016
>65%
Data volume growing at 40% or more, will reach 44 zettabytes by 2020
40%
Storage Spaces (SDS) and traditional SAN/NAS connectivity to support Private Clouds and Virtualized environments.(future: Microsoft Azure Stack)
On-PremisesStorage
StorSimple and 3rd party solutions providing on-premises storage integrated with Azure Storage.Azure Site Recovery and Backup providing Availability on Demand.
Hybrid CloudStorage
Azure Storage for scalable, reliable, and economical cloud storage for data big and small.
Public CloudStorage
Customer
ServiceproviderMicrosoft
ONEconsistent platform
Cloud + Enterprise Approach to Storage
Cloud + Enterprise Strategy
3
4
2On Premises StorageHyper-ConvergedConvergedBlock StorageCloud Fabric
5
1
Microsoft offers industry leading portfolio for building on-premises clouds
Microsoft embraces your choice of storage Microsoft offers solutions to reduce storage
costs
Choice: On-premises Storage
NAS
File Based Storage
SAN Partners
Block Storage
Storage Spaces
SAN Alternative
Storage Spaces Direct
Hyper-Converged
Microsoft Azure Stack/Object Storage
Cloud Fabric
Fibre Channel / iSCSI / FCoE SMB3
Hyper-Converged
Reliability, scalability, flexibility • Fault tolerance to disk, enclosure, node failures• Scale pools to large number of drives• Simple and fine grained expansion• Fast VM creation and efficient VM snapshots
Simplifying the datacenter• Collapsing Storage and Compute• Removes storage area network• Storage controller is a software service
Cloud design points and management• Standard servers with local storage• New device types such as SATA and NVMe SSD• Prescriptive hardware configurations• Deploy/manage/monitor with SCVMM, SCOM &
PowerShell
Hyper-converged with Windows Server 2016Storage Spaces Direct
Hyper-converged Infrastructure
Storage Spaces Direct Development Partners
Quanta D51PH
HP Apollo 2000 System
Dell PowerEdge R730xdCisco UCS C3260 Rack Server
Intel® Server Board S2600WT-Based Systems Lenovo System x3650 M5
Fujitsu Primergy RX2540 M1
DEMOHyper-converged
Performance using tiered flash drives with Storage Space Direct “shared nothing” storage
Scaling from Commodity to Cloud
Sca
le
Converged
Hyper-converged
Cost: Customers desire the economics and simplicity of hyper-converged
Cloud Scale: Large scale private and hosted clouds need the flexibility to independently scale compute and storage
Choice: Windows Server Software-defined Storage empowers both models giving customers flexibility
Converged
Converged Software-defined StorageStorage Spaces
Flexibility: Compute and Storage scale independentlyScalability: Ability to scale each layer for the highest demandsManageability: Segments layers to admin roles
Hyper-V Cluster
SMB3 storage network fabric
Scale-out File Server
Shared JBOD Storage
Syste
m C
en
ter
Scale-out compute with low cost commodity servers
Low cost NIC’s at scale
Inexpensive Ethernet for storage fabric
Elastic, reliable, optimized with Storage Spaces
NAS head
3rd Party NAS
Choice: Converged Infrastructure
HYPER-V
SMB3 storage network fabric
SoFS with Storage Spaces
Syste
m C
en
ter
SoFS with Storage Spaces Direct
Choice: NAS or Software-defined Storage with either shared or shared nothing disksFile Based Storage: Ethernet / Infiniband with SMB3 for storage fabricLeverage Existing Investments: Repurpose existing storage into Software-defined Storage stackManageability: Entire stack manageable with System Center with any solution
SoFS with SAN
Shared JBOD Storage
An easy solution to leverage the learnings from the cloud model in your own IT environment, allowing for full control and maximum efficiency.
Cloud Platform System Standard
Azure-consistent cloud in a box, based on proven technology and ready to run in your IT environmentSoftware-defined datacenter technologies and integrated Azure services for better economicsSingle point of support and fully automated patch and update process
Customer stories
“ In the past, a customer bought a SAN with expensive RAID [redundant array of independent disks] drives for an initial purchase price of more than $3,000 a terabyte. With Storage Spaces, our customers can use storage that costs less than $300 a terabyte.”
— Rand Morimoto, President, Convergent Computing
“ By using Storage Spaces, we’re getting storage performance of 450,000 IOPS and roughly a gigabyte per second in throughput—more than 20 times the IOPS and four times the throughput of our SAN.”
— Daniel Weissenborn, Solution Architect, ClearPointe
These and other case studies are available at Microsoft’s web site.
A1 Telekom Austria AG – IT Services Provider Boosts Network Availability, Resilience with Server Upgrade
ABM – Facilities Solutions Firm Reduces IP Address Management Time by 90 Percent
Avanade – Microsoft Co-Venture Uses Server Solution to Eliminate Latency for Field Force
Chunghwa Telecom – Telecom Reduces Costs by 30 Percent, Downtime by 50 Percent with Server Upgrade
ClearPointe – IT Firm Boosts Storage Performance Tenfold, Trims Costs with Software-Defined Storage
Convergent Computing – IT Consultant Delivers Flexible, Hybrid Cloud Computing and 50 Percent Lower Costs
Dimension Data – Hosting Provider Upgrades Software to Reduce Costs, Expand Choice and Services
Edgenet – Data Services Provider Upgrades Operating System to Boost IT Management Efficiency
Equifax – Financial Services Firm Improves File Server Availability by 40 Hours a Year
Fasthosts – Hosting Provider Increases IT Efficiency and Agility with Software Upgrade
Fujitsu – Fujitsu Reduces Cloud Storage Costs by 35 Percent, Creates More Competitive Offering
Georgia Institute of Technology – Georgia Tech Students Gain Broad Access to Powerful Design Software with Virtualization
ING Direct Australia – Online Bank Boosts IT Efficiency by 20 Percent with Upgrade, Strengthens Innovation
iWeb – Hosting Provider Grows Revenue and Customer Base with Private Cloud Offering
Kennards Hire – Equipment Rental Firm Improves IT Efficiency and Business Agility with Software Upgrade
Lower Saxony Ministry of Justice – State Reduces IP Management Work by 25 Percent, Extends Virtualization with Upgrade
Lufthansa Systems – Lufthansa Systems Uses Hybrid Cloud to Trim IT Delivery to Hours and Reduce Costs
Microsoft – Microsoft Uses Operating System to Triple Storage Capacity, Reduce Time-to-Market
nGenx Corporation – Cloud Service Provider Builds Cost-Effective Storage Solution to Support Business Growth
NTTX Select – Hosting Provider Uses Industry-Standard Storage to Slash Storage Costs by 30 Percent
Pedcor Companies – Real Estate Firm Expects to Avoid $560,000 in IT Costs by Using New Operating System
Studio Moderna – Retailer Deploys File Share Storage, Saves 50 Percent in Storage Costs
Telekom Slovenije – Telecom Company Uses File-Based Storage to Reduce Costs, Not Performance
TrinityComputer.de – IT Provider Gives SMB Customers Flexible Cloud Options, Lower Costs with Upgrade
T-Systems International GmbH – Cloud Hosting Provider Aims to Improve Service, Lower Costs with Server Upgrade
VaiSulWeb – Hosting Provider Quickly Offers Cost-Effective Cloud Services to Small Businesses
Volkswagen Financial Services – Car Financer Improves Performance of Web Applications, Reduces Costs with Upgrade
Western Health – Australian Healthcare Organization Gains Efficiency, Lower Costs with Private Cloud
WorkITsafe – IT Provider Gives SMBs Greater Business Continuity, Lower Costs with Software Upgrade
Cloud Platform SystemPremium
Do-it-yourself Cloud Platform SystemStandard
Choice: Solution IntegrationFaster time to value
MoreCustomization
System Center
Windows Azure Pack
Standardization
CPS value in small package
• Azure services integration, WAP portal, automated patch and update
• 4-16 servers
• OEM-led support
• Ideal for small enterprises, departments and regional offices, local government and education
Maximum CPS scalability and resiliency
• Azure integration, WAP portal, automated patch and update, enterprise workload automation
• 1-4 racks (24-128 compute nodes)
• Microsoft-led support
• Ideal for enterprise datacenter consolidation and for hosting service providers
Maximum flexibility and customization
• Azure services and WAP portal
• Build your own infrastructure based on the well known and proven Microsoft platform
• Certified for Windows Server components
DEMOSDS Performance
ReFS file system enhancements make major contributions to an overall SDS architecture
Block Storage
Single Pane of Glass Management• End-to-end management with SCVMM• SMAPI for broad ecosystem interoperability• Deep health and availability insight of storage• Storage QoS for control of noisy neighbors
Reducing Disaster Recovery Costs• In-box software replication with Storage Replica• Lowering RPO with both sync & async replication• Lowering RTO with Stretch Cluster and ASR
automation
Cloud Powered SAN• Azure Site Recovery (ASR) management of hardware
replication and cross site failover• Backup of traditional storage array to the cloud
Choice: Partner SAN
Hyper-V
Fibre Channel / iSCSI / FCoE
Storage Array(s)
Managed by
System Center
DEMOStorage Replica
Stretch Cluster scenario
Cloud Fabric
Opportunity to rethink your datacenter approach: think services, not serversTraditional datacenterTight coupling between infrastructure and apps
Expensive, vertically integrated hardware
Silo-ed infrastructure and operations
Highly customized processes and configurations
Microsoft Azure datacenterLoosely coupled apps and micro-services
Industry-standard hardware
Service-focused DevOps
Standardized processes and configurations
Microsoft Azure
APP INNOVATION
HybridHyper-scale
Enterprise-grade
Power of Azure with the control of the datacenterMicrosoft Azure Stack
Microsoft Azure StackDatacenter
Windows Server Linux
Portal IaaS | PaaS services
Cloud-inspired infrastructurePowered by Windows Server, Hyper-V, System Center, and Azure technologies
Windows Server Linux
Portal IaaS | PaaS services
Cloud infrastructure
Efficient at Cloud Scale• File System – ReFS delivers highest levels of scale and resiliency for
virtualization• Deduplication –Scale-out optimized for lowest $ per GB
Resilient and Diagnosable• VM Storage resiliency – Preserve tenant VM session state in the event of transient
storage disruption• Storage health monitoring – One place to look for all storage health events
Multi-tenant Control and Security• Storage Quality of Service – QoS control and manage noisy neighbors • SMB Security – Pre-authentication integrity to prevent tampering & man-in-the-
middle attacks
Cloud Consistency and Availability• Blob storage – Run cloud born apps on-premises or in Azure• Rolling upgrades – Cloud design points to for no downtime upgrades
Cloud Fabric Storage Features
Microsoft Azure Stack
Azure-consistent storage
Microsoft’s Cloud Storage offering for Microsoft Azure Stack
Delivers Azure-consistent Blobs, Tables and Storage accounts down to API/library level
Comprehensive private cloud service provider manageability designed for Microsoft Azure Stack
Ready to deploy in either enterprise-private clouds or hosted public clouds from service providers
IaaS storage (page blobs), and PaaS storage (block blobs, append blobs, tables)
Integral part of Microsoft Software-Defined Storage (SDS) vision - highly-reliable, resilient, and scalable cloud storage based on standard hardware, or can just as well leverage existing SAN investments
SMB3 storage network fabric
Scale-out File Server
For Administrator
Azure Stack storage cloud admin service
For Tenant
Azure-consistent blob
service
Azure-consistent
table service
Azure-consistent account service
Flexible choices across a breadth of storage Not just bits, but also choice in integrated
solutions Slashing storage costs with Software-
defined Storage
On Premises Storage Summary
NAS
File Based Storage
SAN Partners
Block Storage
Storage Spaces
SAN Alternative
Storage Spaces Direct
Hyper-Converged
Microsoft Azure Stack/Object Storage
Cloud Fabric
Fibre Channel / iSCSI / FCoE SMB3
12
5
3Hybrid Cloud StorageStorSimple
4
Storage challenges
Storage Today = Complex & Expensive
Storage cost and
infrastructure sprawl
Complex data protection &
recovery
Resource constraints
Rapid data growth - 40% YoY*
* Source: EMC Digital Universe with Research and Analysis by IDC, 2014
StorSimple Consolidates Storage Functions
Primary Storage
Archival Storage
Disk-based Backup
Remote Replication
Tape backup and DR
Storage Today Microsoft Azure StorSimple
Consolidate storage
infrastructure
Simplify data protection
Accelerate disaster recovery
Increase IT agility to meet business needs
StorSimple
StorSimple hybrid cloud storage delivers primary storage, data protection and disaster recovery in a single solution that integrates Azure storage services
Seamless Cloud Integration
Enterprise SAN storage
Inline de-dupe, compression, and automatic
tiering
Automated offsite data protection using cloud snapshots
Highly efficient, location
independent disaster recovery
Consolidated storage and
data management
Data mobility for enterprise
data
Applications in physical or virtual servers
StorSimple Hybrid Storage Array
CUSTOMER DATA CENTER
AZURE DATA CENTER
Linux File Server
VMware Server
Windows
File Server
StorSimple Manager
Azure-based applications
StorSimple Virtual
Appliance
iSCSI
Internet
iSCSI
Simplify offsite data protection
Microsoft Azure
Production Data Production Data
Cloud Snapshots
Datacenter-1 Datacenter-2Periodic VSS consistent cloud snapshots of production data
Location independent recovery from cloud snapshot
StorSimple Virtual Appliance
Application and workload focus
* Only available with StorSimple 8000 series
Cloud Apps
*
Virtual Machines SharePoi
ntFile
shares
Archives SQL Server*
Azureworkloads
On-premisesworkloads
DR* Dev/test*
Thinking ROI - Traditional vs Hybrid Cloud Storage
Function Traditional Storage Products Traditional Storage Cost
Cost with Microsoft Azure
StorSimple1
Primary and Archival Storage
Storage Array with Associated Software
$90,000 $02
Backup and Disaster Recovery
Backup Media Server and Software $30,000
$02Disk Backup with Deduplication Licenses
$120,000
Offsite Tape Storage $30,000
Capital Cost for the Customer $270,000 $0
Support Cost $130,000 $19,500
Cloud Storage Cost $0 $180,000
3-Year Customer Cost $400,000 $199,500
Additional Customer Benefits None
• Tape eliminated• Tested, location independent DR• Cloud used as secondary DC• Power/space/cooling savings• IT time/productivity savings
40–60% Savings
1 Based on ASAP+ $60k offer with StorSimple 8100 array and platinum support over 3 years (EA Level-A pricing); based on 1.5x de-dupe and compression with data backup and disaster recovery2 8100 storage array list price $100,000; includes de-dupe and compression, data protection and disaster recovery software, and unlimited licenses for StorSimple Virtual Appliance3 8100 storage array built and distributed by Seagate
Illustrative cost comparison for 60TB of primary data
1 32 4
Public Cloud StorageAzure Storage & Data Services
5
Azure Storage & Data Services
Blobs“Highly scalable, REST based cloud object store”
Tables“Key Value, high scale, auto-scaling NoSQL store”
Disks“Persistent block storage for Azure IaaS VMs”
Files“Fully Managed File Shares in the Cloud”
Data Lake Store“HDFS as a service”
DocumentDB“NoSQL document database service”
Azure SQL DB“Fully managed database-as-a-service built on SQL”
Storage for VMs
Unstructured Data
Structured Data
Storage for VMsDisks“Persistent disks for Azure IaaS VMs”
Files“Fully Managed File Shares in the Cloud”
Storage for VMs - Disks
Disks“Persistent disks for Azure IaaS VMs”
• Used by all Azure IaaS VMs – Both OS and data disks• Each disk is a stored as a “page blob” in Azure Storage’s distributed file system
• 3 synchronous, strongly consistent copies – No RAID for redundancy is required
• Two disk types – Standard & Premium• Standard – Magnetic disk based hardware
• 1TB and 500 IOPS per disk - Stripe for more capacity/throughput• Premium – SSD based hardware
• High IOPS, low latency• Provisioned model - Buy for capacity (up to 1TB) or IOPS performance (up to
5000 IOPS)
High I/O performance and low latency Ideal for IO-intensive workloads
Use with specific VM series: DS & GS Blob Cache - RAM and Local SSD used for caching: Very low cached read
latency Attach and stripe premium disks for maximum performance
DS – Up to 50,000 IOPS & 512 MB/s. GS – Up to 80,000 IOPS & 2GB/s Can still use standard disks for bulk data storage
Scenarios: Windows IaaS workloads
SQL Server, Sharepoint, Dynamics, Exchange Linux IaaS workloads
MySQL, MongoDB, Cassandra And more including
Oracle, SAP, Cloudera, etc.
Deeper Look - Premium Storage Disks
Premium Storage Disks – Customer testimonials“Serko®, one of Asia’s leading corporate travel solutions, handles over 300 million SQL
transactions per week using 8 SQL Server VMs. With Azure Premium Storage we envisage that the current VMs will scale to over 500 million SQL transactions per SQL server per week, reducing our overall costs is key as we scale globally.”- Philip Ball, Chief Technical Officer, Serko
“At JumpStart, we are using Premium Storage for SQL Servers running our educational games like School of Dragons and JumpStart, on Azure. The disk speeds have enabled us to both run the application and take back-ups two times faster than we have before.”- Michael Boldezar, VP Platform Technology, JumpStart
“After the implementation of a critical application for Chronodrive on Azure, we quickly noticed an additional need for I/O on our SQL Server. Thanks to Azure Premium Storage, we have finally the capacity to guarantee that our application runs smoothly, and we hope to save 2 million Euros a year with the new optimal performance!”- Anthony Lewkowicz, Chief Information Security Officer, Chronodrive
Storage for VMs - Files
Files“Fully Managed File Shares in the Cloud”
• Map shares to Windows and Linux VMs without managing storage, servers, etc.• Based on industry standard SMB 3.0; Secure + Reliable• Connect securely to Azure Files from On-Prem or Cloud
• Scenarios:• Hybrid file sharing between on-premises and cloud; easy movement of data offsite
to the cloud• Migrate file or share based applications to the cloud with no code changes• Build modern applications with REST API that interoperate with older systems• HA workloads with SMB 3.0 persistent handles – IIS hosting backed by Files, SQL
Server failover instance, etc.
Creating and using Azure File shares
Azure Files Demo
Summary - Virtual Machine Storage Architecture
Azure Virtual Machine
C:\OS Disk
E:\, F:\, etc.Standard Data
Disks
D:\Temporary
Disk
Disk Cache
Azure Page Blob
Y:\, Z:\, etc.SMB Share
E:\, F:\, etc.Premium Data
Disks
Azure Page Blobs
(Premium Storage)
Azure Files
SSD Read Cache
Unstructured Data Services
Blobs“Highly scalable, REST based cloud object store”
Data Lake Store“HDFS as a service”
Unstructured Data Services
Blobs“Highly scalable, REST based cloud object store”
Scenarios: Cloud Service persistent data, Data sharing, Big Data, Backups
• Two Types of Blobs • Block Blobs (commonly used): Read and write
data in blocks. Optimized for sequential IO. Most cost effective Storage.
• Page Blobs: Sparse files, read/write in 512 byte pages. Optimized for random access
• Very high scale storage (PBs, 100s of K tps, 10s of Gbps bandwidth) - Partitioned across storage accounts
• Storage Redundancy levels: LRS (local 3 copies), GRS (Additional async Geo), RA-GRS (read-access to Geo)
Data Lake Store“HDFS as a service”
Scenarios: For Big Data Analytics Workloads
• Accessible to all HDFS compliant analytic applications (Hortonworks, Cloudera, MapR)
• No fixed limits file size (PB file sizes)• Very high throughput for read and write• Designed for diversity of analytic workloads• Fully Managed, monitored, and supported by
Microsoft• Enterprise grade features around security,
compliance & management• Currently in Private Preview, public preview soon
Structured Data Services
Tables“Key Value, high scale, auto-scaling NoSQL store”
DocumentDB“NoSQL document database service”
Azure SQL DB“Fully managed database-as-a-service built on SQL”
Structured DataTables“Key Value, high scale, auto-scaling NoSQL store”
Scenarios: User, device and service metadata, structured data
• No limits on number of table rows or table size
• Dynamic load balancing of hot tables and table regions
• NoSQL - Schema-less entities with strong consistency
• Best for Key/value lookups on partition key and row key
• Entity group transactions for atomic batching
DocumentDB“NoSQL document database service”
Scenarios: Modern applications that use JSON data stores (like MongoDB)
• Flexible schema for iterative application development
• Automatic indexing with SQL query interface
• Transactional support for multi-document operations
• Scalable database storage with predictable performance
Azure SQL DB“Fully managed database-as-a-service built on SQL”
Scenarios: Relational DBs without infrastructure/management hassle
• Fully compatible with SQL Server 2014 databases
• Built for both SaaS and Enterprise applications
• Elastic database pool for unpredictable SaaS workloads
• 99.99% availability built-in• Geo-replication and restore
services for data protection• Secure and compliant for
your sensitive data
1 3
4
2 5Summary
In Review: Session Objectives And Takeaways
On-PremisesStorage
Hybrid CloudStorage
Public CloudStorage
Customer
ServiceproviderMicrosoft
ONEconsistent platform
Cloud + Enterprise Strategy
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.