Long Live DAS!
Ryan Jancaitis – Product Management - Symantec
Frank Ober – Data Center Solutions Architect - Intel
SYMANTEC VISION 2014
1. IDC, Digital Universe study, December 2012 2. IDC, Worldwide Disk-Based Data Protection and Recovery 2012-2016 Forecast, December 2012
1.2ZB
7.9ZB
40ZB
61.8%
THE WORLD’S DATA IN 2010
THE WORLD’S DATA BY 2015
THE WORLD’S DATA BY 2020
UNSTRUCTURED DATA GROWTH RATE TO 2014
The Storage Conundrum
Long Live DAS! 3
SYMANTEC VISION 2014
Data Center Challenge: A Tier-1 Bottleneck
Tier-1 App Faster/More CPU Faster/More RAM
Faster Internals
10/40/100 GbE InfiniBand
RDMA
IOPs Maxed Wide Stripe
Over-Allocation
Tier-1 != $/IOP Tier-1 = $/GB
Tier-1 Storage
VMAX is a “Capacity Tier” - John Roese, CTO, EMC
4 Long Live DAS!
SYMANTEC VISION 2014
SSDs are Fundamentally Changing the Data Center
“HDD revenue will stay flat in 2014, with estimates at $32 billion ” – HIS
Long Live DAS! 5
“Worldwide SSD revenue is now expected to grow at a CAGR of 20% for 2012–2017.” – Nov 13 IDC
“SSDs will continue to complement (slower) hard disk drives while replacing the fastest 15,000-RPM drives.” - Gartner
“Worldwide SSD shipments across all market segments are projected to increase by 46% in
2013 and grow at a 31% 2012–2017 CAGR. “ – Nov 13 IDC
“All Flash Array Forecast $1.5 Billion by 2015” – IDC
SYMANTEC VISION 2014
Any form Factor flash optimization Right $/IOPS with Flash/SSD
Optimize SSD
• App aware Storage Tiering
• Optimize Storage with Compression & Dedup
• Migration to ANY storage
Optimize R+W Performance
• Remove logjams in SAN
• Rely on commodity SAN storage
• Optimize Read & Writes
Enable True DAS
• Mix of SATA & Flash for SLA
• Benefits of SAN in DAS
• Linearly scale as need grows
• Reduce Host protocol overhead
• Enable Scale-out architecture on host
• Migrate to All Flash with ease
Eliminate Host Bottleneck
Less Disruptive
Marginal Benefit
SSD in SAN
High Performance
Expensive SAN
All-Flash in SAN
Lower latency
SAN for efficiency
In-server SSD
SSD closest to CPU
Avoid SAN
Eliminate the SAN
Long Live DAS! 6
SYMANTEC VISION 2014
PCI Express* SSD vs Multi SATA* SSDs
SATA SSDs advantages
• Matured hardware RAID/Adapter for management of SSDs
• Matured technology/eco system for SSDs
• Cost & performance balance
Quick Performance Comparison
• Random WRITE IOPS: 6 x S3700 = one PCIe SSD 1.6T (4 lanes, Gen3)
• Random READ IOPS: ~8 x S3700 = 1 x PCIe SSD
Mix-Use PCIe and SATA SSDs
• hot-pluggable 2.5” PCIe SSD has same maintenance advantage as SATA SSD
• TCO, balance on performance and cost
Performance of 6~8 Intel S3700 SSDs is close to 1x PCIe SSD
4K random workloads (IOPS)
Measurements made on Hanlan Creek (Intel S5520HC) system with two Intel Xeon X5560@ 2.93GHz and 12GB (per CPU) Mem running RHEL6.4 O/S, Intel
S3700 SATA Gen3 SSDs are connected to LSI* HBA 9211, NVMe SSD is under development, data collected by FIO* tool
0
100000
200000
300000
400000
500000
600000
100% read 50% read 0% read
6x800GB Intel S3700
1x NVMe 1600GB
IOPS
Long Live DAS!
SYMANTEC VISION 2014
Intel® Data Center Family of SSDs – Why They Matter
9
Feature Benefits Full Data Path Protection Data + Non Data Path Protects against unexpected data corruption throughout the drive
Power Loss Data Protection PLI + PLI check Protects data against unexpected power loss
Intel Developed Controller √ Intel Quality & Reliability
Consistent Performance √ Tighter IOPS and lower max latencies for consistent and
predictable performance
AES 256b encryption 256b Enhanced data protection for data at rest
Max Capacities 800GB – 1.6TB Q2’14 – 2.0 TB Q4’14 Increased capacities for growing storage needs
NAND Technology 20nm & 25nm w/ & w/o HET* Leading edge NAND technology provides a better cost structure
OEM Validation √ Major server OEM qualified, warranted, and serviced
NVMe Protocol PCIe Connection & NVMe Protocol Lowest latency storage driver available! @ 6µs
*Other names and brands may be claimed as the property of others.
Long Live DAS!
SYMANTEC VISION 2014
Intel® Data Center Family of SSDs
Protect against possible corruption of in-transit and stored data through every element of the SSD
Including SRAM, DRAM, and NAND memory
Starting when the data enters the drive until the point it leaves
Host SATA
Frontend SATA3
Interface CRC
NAND
NAND ECC
LBA Tag Check
Internal CRC
Transfer
Buffer
S/DRAM ECC
LBA Tag Check
Internal CRC
10 *Other names and brands may be claimed as the property of others.
Long Live DAS!
SYMANTEC VISION 2014
Intel® Data Center Family of SSDs
• Power Loss Data Protection Features
Power Failure Detection Circuit
Power Loss Tolerant Charge Storage
Enhanced Firmware Data Safe Mode
Hot Plug Inrush Current Mitigation
http://hardware.slashdot.org/story/13/12/27/208249/power-loss-protected-ssds-tested-only-intel-s3500-passes
11 *Other names and brands may be claimed as the property of others.
http://intel.ly/1ghGULV
Long Live DAS!
SYMANTEC VISION 2014
Intel® Data Center Family of SSDs
12
• QoS spec is unique to Intel® Data Center SSDs
Specified maximum latency
Better RAID system performance
Consistently high IOPS and low latency
DC S3500: 4K Random Write Workload2
Tight Predictable IOPS
IOP
S
Time seconds
0
5000
10000
15000
20000
0 200 400 600 800 1000
0
5000
10000
15000
20000
0 200 400 600 800 1000
Competitor SSD: 4K Random Write Workload1
Loose Unpredictable IOPS
IOP
S
Time seconds
*Other names and brands may be claimed as the property of others.
Long Live DAS!
SYMANTEC VISION 2014
Intel SSD Labs (Folsom, CA)
13
• ISV-OEM enablement
• Oracle
• SQL Server
• NoSQL
• VMWare
• Hyper-V
• Openstack
• Hadoop, Splunk, Big Data
Big Data and HPC
Virtualization
And Internal Cloud
Direct Attached Storage
Databases and
Applications
Long Live DAS!
SYMANTEC VISION 2014
SSD in Databases…
• Top DB SSD use cases:
• Log Writer – Traditional & In Memory
• Caches - b-Cache, Intel CAS or TempDB
• MS SQL – Buffer Pool Extension (2014*), Oracle Smart Flash Cache (2010)
• Pure SSD is always the best approach for DB’s
• #1 Industry Trend = movement to In Memory DB’s (IMDB)
• Case Studies
• Symantec White Paper on HA / FSS - http://bit.ly/QhTJzd
• Intel® SSD DC S3700 for Oracle* Log Writer http://intel.ly/1fkobDJ
• Oracle* TimesTen + Intel® SSD DC S3700 http://intel.ly/1ewyjEm
• Aerospike* Acceleration w/Intel® SSD http://bit.ly/1hF8p6w
14
Opportunity for Case Study?
*Other names and brands may be claimed as the property of others.
Long Live DAS!
SYMANTEC VISION 2014
Solid-state proliferation requires data
management efficiency software.
Gartner, 2012
SSD + Software
Long Live DAS! 15
Gartner: Understanding Application Workloads is Understanding SSDs © 2012
SYMANTEC VISION 2014
Any form Factor flash optimization Right $/IOPS with Flash/SSD
Optimize SSD
• App aware Storage Tiering
• Optimize Storage with Compression & Dedup
• Migration to ANY storage
Optimize R+W Performance
• Remove logjams in SAN
• Rely on commodity SAN storage
• Optimize Read & Writes
Enable True DAS
• Mix of SATA & Flash for SLA
• Benefits of SAN in DAS
• Linearly scale as need grows
• Reduce Host protocol overhead
• Enable Scale-out architecture on host
• Migrate to All Flash with ease
Eliminate Host Bottleneck
Less Disruptive
Marginal Benefit
SSD in SAN
High Performance
Expensive SAN
All-Flash in SAN
Lower latency
SAN for efficiency
In-server SSD
SSD closest to CPU
Avoid SAN
Eliminate the SAN
SmartIO FSS
Long Live DAS! 17
SYMANTEC VISION 2014
Introducing SmartIO
Volume Manager Read Cache
File System Read Cache
File System Write-Back Cache
• Linux Only in 6.1 • New CLI: sfcache • Granular, Online Control
• I/O Optimization • Application Integration • HCL Independence
• Boot Persistence
Highlights
Long Live DAS! 18
SYMANTEC VISION 2014
Write-Back Standalone Server
Application
SAN Storage
SF Cache Layer
Write-Back Cluster File System
Application
SAN Storage
CFS Distributed Cache Layer
Write WRITE
Cache Reflection
Lazy Flush
3
1
Lazy Flush
ACK
1 2
3
1
ACK
2
SmartIO Write-Back
Long Live DAS! 19
SYMANTEC VISION 2014
SmartIO Benefits
Increased Application
Performance
Improved Storage
Utilization
Reduced Storage Costs
Cascaded Performance
Benefits
Bring Data Closer to Application De-Couple IOPs and Capacity
Increase Application Density Maximize Back-end Resources
Long Live DAS! 20
SYMANTEC VISION 2014
SmartIO: Increased Application Performance
21
Overview
• More than 2x OLTP transactions per minute
• Application Insight
• Oracle
• Sybase
• Adjust heuristics based on workload type
• No Application downtime
• No Application re-architecting
Results
2.5x
Server Dell 820 - 32 Cores - 256 GB RAM
Storage IBM DS8100 – 16 GB Cache – 64 Spindles
SSD 1 TB PCIe
Workload OLTP – 150 Users – 5000 Warehouses – 7
GB SGA
Configuration
Long Live DAS!
SYMANTEC VISION 2014
SmartIO: Reduced Storage Costs
22
Overview
• Combine “Tier-2” Storage with SmartIO
• Over 2x performance than “Tier-1” array
• 60% Cost Savings
• De-couple IOPs from Capacity
• Reduce infrastructure required to maximize HDD performance
Results
Tier-1
Server Dell 820 - 32 Cores - 256 GB RAM
$13.54/TPM
Storage EMC VMAX – 16 GB Cache –
128x15k RPM Disks
Tier-2
Server Dell 820 – 16 Cores – 128 GB
RAM
$5.78/TPM Storage EMC Cx4 – 16 GB Cache – 80x15k
RPM disks
SSSD 1 TB PCIe
Configuration
Long Live DAS!
SYMANTEC VISION 2014
SmartIO: Improved Storage Utilization
23
Overview
• More than 2x OLTP transactions per minute
• SmartIO frees up backend:
• Spindles
• Cache
• 2x the workload density on same array
• No performance degradation
Results
Servers Dell 820 - 32 Cores - 256 GB RAM
Storage IBM DS8100 – 16 GB Cache – 64 Spindles
SSD 1 TB PCIe
Workload OLTP – 150 Users – 5000 Warehouses – 7
GB SGA
Configuration
Long Live DAS!
SYMANTEC VISION 2014
SmartIO: Cascaded Performance Benefits
24
Overview
• Node 1 running SmartIO
• 4x performance improvement
• Node 2
• No SSD
• No SmartIO
• 60% performance improvement
• Reduced workload from Node 1 benefits Node 2
Results
Servers
Node 1 Dell 820 - 32 Cores - 256 GB RAM
Node 2 Dell 720 – 16 Cores – 96 GB RAM
Storage IBM DS8100 – 16 GB Cache
SSD 1TB PCIe
Workload OLTP – 150 Users – 5000 Users – 7
GB SGA
Configuration
Long Live DAS!
SYMANTEC VISION 2014
Introducing: Flexible Storage Sharing
Flexible Storage Sharing
• Build true DAS cluster
• HDD
• SSD
• Hybrid
• Ease of administration
• Virtualization support
• RDMA Interconnect
• InfiniBand
• Ethernet
• Built on existing technologies
Features
• Reduced Infrastructure • Improved Flexibility • All CFS/SFRAC use cases
Benefits
10GE/IB
Highly Available Applications
Highly Available File Systems
Long Live DAS! 25
SYMANTEC VISION 2014
Oracle 11gR2 1.4 TB Data Files
2000 Warehouses 100 Users
CFS+Intel: Managed Performance
512GB
80 Cores
Storage Foundation 4.5x SAN performance
20% SAN Cost*
* Pro-rated cost for EMC VMAX 20K using 1/5th of Available Capacity
But… What about redundancy? What about high availability? What happens if hardware fails?
Long Live DAS! 26
3700 Series 800 GB
Redo Logs: 4k 2-way Stripe
Data Volumes: 8k 3-way Stripe
SYMANTEC VISION 2014
Data Volume: 8k 3-Way
Stripe/Mirror
Redo Logs: 4k 2-Way
Stripe/Mirror
CFS+Intel: Managed Performance
IB
Cluster File System
Oracle 11gR2 1.4 TB Data Files
2000 Warehouses 100 Users
With… Full Data Redundancy Fast-failover capabilities Disaster Recovery App/Server Administrator Control
4x SAN performance
22% SAN Cost*
* Pro-rated cost for EMC VMAX 20K using 1/5th of Available Capacity
Long Live DAS! 27
SYMANTEC VISION 2014
CFS+Intel: Managed Performance
Long Live DAS! 28
• Do not put redo logs on Solid State Disk (SSD)1 • Although generally, Solid State Disks write performance is good on
average, they may endure write peaks which will highly increase
waits on 'log file sync'
1Document 1376916.1 Troubleshooting: "Log File Sync" Waits
SYMANTEC VISION 2014
Data Volume: 8k
4-Way Stripe
Redo Logs: 4k Striped
CFS+Intel: Flexible Performance
IB
Cluster File System
Long Live DAS! 29
Performance Configuration
• 577, 000 TPmC
• 700% Improvement over SAN
IB
Cluster File System
Warehouse Configuration
• 1.5 hr Load time
• 2x vs SAN
• 17k QPH
• 4x vs SAN
Data Volume: 8k
2-Way Stripe/Mirror
Redo Logs: 4k 2-way
Stripe/Mirror
SYMANTEC VISION 2014
Next Steps
Long Live DAS! 30
Community and Blogs (@IntelSSD)
Steve Shaw: (Oracle/Linux) https://communities.intel.com/people/steveshaw/content
Chris Black:https://communities.intel.com/people/ChristianBlack/content
Frank Ober:https://communities.intel.com/people/FrankOber/content
Community and Blogs (@SymantecStorage)
Symantec/Intel Whitepaper
Symantec Connect
Symantec.com
6.1 Trialware
Thank you!
Copyright © 2014 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.
Long Live DAS!