mdc205 rick claus sr. technical evangelist, microsoft @rickstercdn

Storage Spaces:What’s New in Windows Server 2012 R2

MDC205Rick ClausSr. Technical Evangelist, Microsoft

@RicksterCDNhttp://about.me/rickclaus

Storage platform design challengesDesign of large service

platforms, such as Azure & Bing, share similar design goals

Need cost-effective hardware to meet budget requirements

Minimize operational expenditure where possible, as inefficiencies can reduce scale

Need to build-in handling of resiliency, must reduce/eliminate individual points of failure

New apps/services

Device proliferation

Data explosion

Cloud computing

De-Mystifying Storage Appliances

Clustered

What’s in a storage appliance?

x86/x64 Processors Memory Network Adapters Storage HBAs

“Back”

“Front”

Multiple physical interfaces; Pools disks, presents LUNs, Simple,

Mirrored, Parity etc. Presents

interfaces:iSCSI, FC, FCoE,

NFS, SMB

Multiple physical interfaces; Pools disks, presents LUNs, Simple,

Mirrored, Parity etc. Presents

interfaces:iSCSI, FC, FCoE,

NFS, SMB

Deploy two or more for a Scale Out CA Solution

Servers

Servers

Servers

Servers

Servers

Servers

Servers

Servers

SAS

Ethernet: 1Gb/10GbFC: 1/2/4/8/16 Gb

Clustered

Windows Server 2012 R2 File Server & Spaces

Windows Server 2012 Spaces

Windows Server 2012 File Server

Multiple physical interfaces; Pools disks, presents LUNs, Simple, Mirrored, etc.

Presents interfaces:

iSCSI, NFS, SMB

Multiple physical interfaces; Pools disks, presents LUNs, Simple, Mirrored, etc.

Presents interfaces:

iSCSI, NFS, SMB

Deploy two or more for a Scale Out CA Solution

Servers

Servers

Servers

Servers

Servers

Servers

Servers

Servers

SAS

SMB3/Ethernet: 1Gb/10Gb40Gb/56 Gb RDMA

Infrastructure-as-a-Service Storage Vision• Dramatically lowering the costs and effort of

delivering IaaS storage services

• Disaggregated compute and storage• Independent manage and scale at each layer

• Industry standard servers, networking and storage• Inexpensive networks• Inexpensive shared JBOD storage

Scale-Out File Server ClustersStorage Spaces Virtualization and Resiliency

Hyper-V Clusters

SMB

Shared JBODStorage

PowerS

hell &

SC

VM

M 2

012 R

2

Man

agem

ent

Familiar Deployment ModelTraditional Storage

with FC/iSCSI Storage ArrayWindows File Server Cluster

with Storage Spaces

Hyper-V Compute Nodes


FC/SAS Disk ShelfFC/SAS Disk Shelf

FC/SAS Disk ShelfStorage Compute

Shared SAS JBODShared SAS JBODShared SAS JBOD

Storage Compute

FC/iSCSI(Block)

SMB(File)

Windows File Server Cluster

(commodity hardware)

Embedded CPUs and

Controllers

(proprietary Software)

Familiar Enterprise-Grade Capabilities• Storage Tiering• Data deduplication• RAID resiliency groups• Pooling of disks• High availability• Persistent write-back

cache• Copy offload• Snapshots

• Storage Tiering (new with R2)

• Data deduplication (enhanced with R2)

• Flexible resiliency options (enhanced with R2)

• Pooling of disks• Continuous availability• Persistent write-back cache (new

with R2)

• SMB copy offload• Snapshots

Traditional Storagewith FC/iSCSI Storage Array

Windows File Server Clusterwith Storage Spaces

Storage tiering

Improved storage cost-performance with industry-standard hardware

Use solid-state drives (SSD) and hard-disk drives (HDD) in tiered storage space

Can “pin” high priority files to the SSD tier

Hard Disk Drives

Hot data

Cold data

Solid State Drives

Storage Spaces

Storage tiering

Case Study: Windows Release

Team(dogfooding our own stuff)

• Problems:• Capacity• Cost• Resiliency

• Needs:• Capacity for a month of data• Dramatically lower $/TB• Scalable platform for future expansion

Case Study: Windows Release Team

Case Study: Windows Release Team• 2x

increase…

• 3x increase…

• 5x increase…

• 6x reduction…

in total storage throughput

$1,350/TB$450/TB

in raw capacity with same budget

in effective capacity with dedupe

in number of servers

Traditional Storage

Storage Spaces

Case Study: Windows Release Team

20x File Servers

with 10GbE Links

20x 60-Bay JBODs

with 3TB 7200RPM HDDs

Aggregate 80Gbps Network

Planning to double the deployment

over the next year

Windows Build

Servers

Dev Test Dev

• Hundreds of build servers generating data• Thousands of developers and test developers• Thousands of internal and external partners

…

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

Partners

720PB Weekly Data

Volume

Storage SpacesCost-Efficient Business Critical Storage

Component Overview• Industry standard commodity storage

hardware• Shared SAS JBOD arrays with enterprise-grade redundancy• Dual-Port SAS drives

Sampling of available Spaces Certified Hardware

Capabilities Overview (1)• Pooling of disks

• Flexible resilient storage spaces

• Native data striping

• Enclosure awareness with certified hardware

• Parallelized rebuild utilizes spare pool capacity

Physical Disks from

Shared SAS JBODs

Storage Pool

Storage Spaces

Data Copy 1 Data Copy 2

Mirror Space

Mirror Space

Parity Space

Mirror Space

Capabilities Overview (2)• Data Integrity Scanner• Periodic background scan detects latent

corruptions, auto-corrects where possible• Integration with both NTFS and ReFS

• Operational Simplicity• PowerShell, Server Manager, and SCVMM

2012 R2

• Continuous Availability with Windows File Server Cluster

Deployment Recommendations

Resiliency Name

Number of Data Copies Maintained

Deployment Recommendations

Mirror 2 (two-way mirror)3 (three-way mirror)

All Workloads

Parity 2 (single parity)3 (dual parity)

Sequential workloads with large units of read/write, such as Archival

Simple 1 Workloads which do not need resiliency, or provide alternate resiliency mechanism

Spaces & Windows File Server Cluster

Clustered Storage Pool & Storage Spaces


SMB

Unified Cluster Shared Volume

Namespace

Shared SASJBOD Arrays

Clustered File Servers

\\SRV\VDI \\SRV\CRM \\SRV\DB

60-baySAS Array

60-baySAS Array

Mirror Space

Mirror Space

Mirror Space

9 6 G b p s S h a r e d S A S L i n k s

ComputeStorage CSV aggregates

namespace for data access across volumes

Architecturally similar to traditional storage deployment

Scaling the Windows File Server Cluster

Clustered Storage Pool & Storage

SpacesMirror SpaceMirror Space Mirror Space Mirror Space

Physical or Virtualized Workloads


High Speed Network(10GbE/InfiniBand)


Namespace

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-bay Shared SAS JBOD Arrays

Clustered File Servers with 10GbE/InfiniBand

7 8 6 G b p s S h a r e d S A S L i n k s

\\SRV\Folders\\SRV\VDI_Dev\\SRV\VDI_Mrktg \\SRV\DB

SMB SMB

Further Scaling the Cluster

Clustered Storage Spaces

Physical or Virtualized Workloads Hyper-V Compute Nodes


Unified Namespace (CSV)



768Gbps Shared SAS Links



0.96PB

0.96PB

0.96PB


0.96PB

\\SRV\VDI_Mktg \\SRV\Ops\\SRV\DB

SMB SMBSMB

Mirror

Mirror

Mirror

Mirror

Mirror

Mirror

Mirror

Mirror

… … … …

… …

“We’re able to use commodity hardware to achieve the same functionality [of traditional storage] at a far lower cost.”

Jeremy RussellSenior Development

Lead

“By using Storage Spaces, Hyper-V over SMB, and other new features, I eliminate big, lumpy

capital expenditures… I can buy inexpensive storage, buy only what I need, and scale in a

completely linear manner.”Philip MossChief Technology Officer

Storage SpacesWindow Server 2012 R2 Capabilities

Storage Spaces R2 Objectives

Building upon the foundation in Windows Server 2012 to further deliver:

Minimized Opex

Continuous Availability

Minimize $/TB & Capex

Maximize IOPS/$

http://www.microsoft.com/en-us/server-cloud/windows-server/default.aspx

Dual Parity: Minimizing $/TB• Provides resiliency to two disk failures for

archival workloads, while minimizing space utilization for resiliency

• Efficient rebuild times

• Supported with Windows Clustering

• Integrated Journaling for power fault resiliency

Match workload characteristics to drivesCommon Workload

Characteristics• Large data set, and majority of data is

cold• Minority of data is in active use, and is

hot• The hot data is the “working set”

• Working set changes over time

Common Drive Characteristics• Hard Disk Drives, 7200RPM• Capacity Optimized ( $/TB)

• Solid State Drives• Performance Optimized ( IOPS/$)

Data Set

Current Working Set

Tiered Storage: Maximizing IOPS/$

• Utilize best characteristics of SSDs and HDDs in single storage space

• Provides balance between capacity & performance

• Admins can assign files to specific storage tiers


Storage Space

HDD Tier

Cold Data

SSD Tier

Hot Data

400GB EMLC SAS SSD

4TB 7200RPM SAS HDD

Reads/Writes Accumulates Data Activity

Write-Back Cache: Maximizing IOPS/$• Absorbs short-term

spikes in random write activity

• Seamless integration and familiar management

• Complements Tiered Storage


Storage Space

HDD Tier

Cold Data

SSD Tier & WBC

Hot Data

400GB EMLC SAS SSD

4TB 7200RPM SAS HDD

Reads/Writes Accumulates Data Activity

Seamless

Integration

Write-Back Cache & Tiered Storage Demo

Windows Server 2012 File Server Cluster


SpacesMirror SpaceMirror Space Mirror Space Mirror Space





Namespace\\SRV\Folders\\SRV\DB

SMB



SMB

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array


\\SRV\VDI_Mrktg \\SRV\Archive

Windows Server 2012 R2 File Server Cluster


Spaces

Tiered Mirror Space

Tiered Mirror Space

Tiered Mirror Space

Dual Parity Space





Namespace\\SRV\Folders\\SRV\DB

SMB


with SSDs and HDDs


SMB

60-baySAS Array

60-baySAS Array

60-baySAS Array

60-baySAS Array

\\SRV\VDI_Mrktg \\SRV\Archive


Windows File Server Cluster Configurations

Capacity Optimized

• High Capacity• Cost-Efficient• Best $/TB

Balanced

• Tiered Storage• High

Performance SSDs

• High Capacity HDDs

• Best IOPS/$

Performance Optimized

• Extreme Performance

• Greatest throughput, highest IOPS

Windows File Server Cluster Configurations

Capacity Optimized

• High Capacity• Cost-Efficient• Best $/TB

Balanced

• Tiered Storage• High Capacity

HDDs• High

Performance SSDs

• Best IOPS/$

Performance Optimized

• Extreme Performance

• Greatest throughput, highest IOPS

Windows File Server Cluster Solution Partners• Certified Storage Spaces Hardware• High-Performance Servers and Storage

http://www.raidinc.com/ http://www.dataonstorage.com/http://www.fujitsu.com/

fts/

Takeaways• Windows Server 2012 R2 is a key

component in your public or private cloud deployment:• Cost-Efficiency, Maximized IOPS/$• Scale & Capacity, Minimized $/TB• Continuous Availability, Windows File Server Cluster

• We have seen customers who achieved:• 2x Increased throughput• 3x Reduced capital expenditure• 5x Increased capacity• 6x Reduction in servers to manage

BONUS Material

a.k.a: How to build your own Storage Tiering demo rig on the cheap.

## Configure the physical host ### Create 4 VHDX files on the SSD with 10GB each (assumes D is SDD)1..4 | % { New-VHD -Path D:\VHD\SSD_$_.VHDX -Fixed –Size 10GB}

# Create 8 VHDX files on the HDD with 30GB each (assumes E is HDD)1..8 | % { New-VHD -Path F:\VHD\HDD_$_.VHDX -Fixed –Size 30GB}

# Create a new VM. Assumes you have an Windows Server 2012 R2 OS VHDX in placeNew-VM -Name DC -Path D:\VMS –VHDPath D:\vhd\DC_OS.VHDX -Memory 2GB

# Add all data disks to the VM1..4 | % { Add-VMHardDiskDrive -VMName DC -ControllerType SCSI -Path D:\vhd\SSD_$_.VHDX }1..8 | % { Add-VMHardDiskDrive -VMName DC -ControllerType SCSI -Path F:\vhd\HDD_$_.VHDX }

## setting media type as SSD or HDD

# make storage pool of all disks.$s = Get-StorageSubSystemNew-StoragePool -StorageSubSystemId $s.UniqueId -FriendlyName Pool1 -PhysicalDisks (Get-PhysicalDisk -CanPool $true)

# Configure media type for virtual SAS disksGet-StoragePool Pool1 | Get-PhysicalDisk | ? Size -lt 20GB | Set-PhysicalDisk –MediaType SSDGet-StoragePool Pool1 | Get-PhysicalDisk | ? Size -gt 20GB | Set-PhysicalDisk –MediaType HDD

# Configure Tiers# Configure two tiersGet-StoragePool Pool1 | New-StorageTier –FriendlyName SSDTier –MediaType SSDGet-StoragePool Pool1 | New-StorageTier –FriendlyName HDDTier –MediaType HDD

# check configGet-StorageTier | FT FriendlyName, MediaType, Size -AutoSize

# Configure resiliency settingsGet-StoragePool Pool1 | Set-ResiliencySetting -Name Simple -NumberOfColumnsDefault 4Get-StoragePool Pool1 | Set-ResiliencySetting -Name Mirror -NumberOfColumnsDefault 2

## Make simple and mirrored Spaces # Create simple and mirrored spaces with tiering$SSD = Get-StorageTier -FriendlyName SSDTier$HDD = Get-StorageTier -FriendlyName HDDTier

Get-StoragePool Pool1 | New-VirtualDisk -FriendlyName Space1 -ResiliencySettingName Simple –StorageTiers $SSD, $HDD -StorageTierSizes 8GB, 32GB -WriteCacheSize 1GB

Get-StoragePool Pool1 | New-VirtualDisk -FriendlyName Space2 -ResiliencySettingName Mirror -StorageTiers $SSD, $HDD -StorageTierSizes 8GB, 32GB –WriteCacheSize 1GB

## create partitions and volumes# Configure volume “F” on Space1Get-VirtualDisk Space1 | Get-Disk | Set-Disk -IsReadOnly 0Get-VirtualDisk Space1 | Get-Disk | Set-Disk -IsOffline 0Get-VirtualDisk Space1 | Get-Disk | Initialize-Disk -PartitionStyle GPTGet-VirtualDisk Space1 | Get-Disk | New-Partition -DriveLetter “F” -UseMaximumSizeInitialize-Volume -DriveLetter “F” -FileSystem NTFS -Confirm:$false

# Configure volume “G” on Space2Get-VirtualDisk Space2 | Get-Disk | Set-Disk -IsReadOnly 0Get-VirtualDisk Space2 | Get-Disk | Set-Disk -IsOffline 0Get-VirtualDisk Space2 | Get-Disk | Initialize-Disk -PartitionStyle GPTGet-VirtualDisk Space2 | Get-Disk | New-Partition -DriveLetter “G” -UseMaximumSizeInitialize-Volume -DriveLetter “G” -FileSystem NTFS -Confirm:$false

## Create test files on F # Create 3 files on volume “F”, place them on different tiers1..3 | % { fsutil file createnew f:\file$_.dat (4GB) fsutil file setvaliddata f:\file$_.dat (4GB)}Set-FileStorageTier -FilePath f:\file1.dat -DesiredStorageTierFriendlyName Space1_SSDTierSet-FileStorageTier -FilePath f:\file2.dat -DesiredStorageTierFriendlyName Space1_HDDTierGet-FileStorageTier -VolumeDriveLetter F

## Create test files on G # Create 3 files on volume “G”, place them on different tiers1..3 | % { fsutil file createnew g:\file$_.dat (4GB) fsutil file setvaliddata g:\file$_.dat (4GB)}Set-FileStorageTier -FilePath g:\file1.dat -DesiredStorageTierFriendlyName Space1_SSDTierSet-FileStorageTier -FilePath g:\file2.dat -DesiredStorageTierFriendlyName Space1_HDDTierGet-FileStorageTier -VolumeDriveLetter g

## Tasks for Storage Tiering # Check tasks used by Storage TieringGet-ScheduledTask -TaskName *Tier* | FT –AutoSizeGet-ScheduledTask -TaskName *Tier* | Get-ScheduledTaskInfo

# run and check status of tasksGet-ScheduledTask -TaskName "Storage Tiers Optimization" | Start-ScheduledTaskGet-ScheduledTask -TaskName "Storage Tiers Optimization" | Get-ScheduledTaskInfo

## Run some workload on F # Check file location on tiers for volume F:Get-FileStorageTier -VolumeDriveLetter F | FT -AutoSize

# Running SQLIO on F:, using File1 (HDD tier), File2 (HDD tier) and File 3 (unspecified tier)c:\sqlio\sqlio2.exe -s30 -frandom -kR -b8 -t4 -o16 -BN f:\file1.datc:\sqlio\sqlio2.exe -s30 -frandom -kR -b8 -t4 -o16 -BN f:\file2.datc:\sqlio\sqlio2.exe -s30 -frandom -kR -b8 -t4 -o16 -BN f:\file3.datc:\sqlio\sqlio2.exe -s30 -fsequential -kR -b512 -t4 -o4 -BN f:\file1.datc:\sqlio\sqlio2.exe -s30 -fsequential -kR -b512 -t4 -o4 -BN f:\file2.datc:\sqlio\sqlio2.exe -s30 -fsequential -kR -b512 -t4 -o4 -BN f:\file3.dat

## Run some workload on G # Check file location on tiers for volume G:Get-FileStorageTier -VolumeDriveLetter F | FT -AutoSize

# Running SQLIO on G:, using File1 (HDD tier), File2 (HDD tier) and File 3 (unspecified tier)c:\sqlio\sqlio2.exe -s30 -frandom -kR -b8 -t4 -o16 -BN g:\file1.datc:\sqlio\sqlio2.exe -s30 -frandom -kR -b8 -t4 -o16 -BN g:\file2.datc:\sqlio\sqlio2.exe -s30 -frandom -kR -b8 -t4 -o16 -BN g:\file3.datc:\sqlio\sqlio2.exe -s30 -fsequential -kR -b512 -t4 -o4 -BN g:\file1.datc:\sqlio\sqlio2.exe -s30 -fsequential -kR -b512 -t4 -o4 -BN g:\file2.datc:\sqlio\sqlio2.exe -s30 -fsequential -kR -b512 -t4 -o4 -BN g:\file3.dat

Evaluate this session and you could win instantly!

Head to...aka.ms/te

© 2013 Microsoft Corporation. All rights reserved.Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

mdc205 rick claus sr. technical evangelist, microsoft @rickstercdn

Documents

spaces windows server

gb4clusteredwindows

windows vista

storage spaces

iaas storage services

product names

informational purposes

market conditions