smb direct for sql server and private cloud · 2019. 12. 21. · microsoft sql server appliance –...
TRANSCRIPT
-
Increased Performance, Higher Scalability and Extreme Resiliency June, 2014
SMB Direct for SQL Server and Private Cloud
-
© 2014 Mellanox Technologies 2 - Mellanox Confidential -
Mellanox Overview
Leading provider of high-throughput, low-latency server and storage interconnect • FDR 56Gb/s InfiniBand and 10/40/56GbE • Reduces application wait-time for data • Dramatically increases ROI on data center infrastructure
Company headquarters: • Yokneam, Israel; Sunnyvale, California • ~1,432 employees* worldwide
Solid financial position • FY13 revenue of $390.9M • 1Q14 revenue of $98.7M • 2Q14 guidance ~$100M to $105M • Cash + investments @ 3/31/14 = $340.1M
Ticker: MLNX
* As of March 2014
-
© 2014 Mellanox Technologies 3 - Mellanox Confidential -
Leadership in Strategic Markets with an End to End Portfolio
Host/Fabric Software ICs Switches/Gateways Adapter Cards Cables/Modules
End-to-End - Cloud, Enterprise, and Storage Optimized - InfiniBand and Ethernet Portfolio
Metro / WAN
DB/Enterprise Cloud Web 2.0 Storage Big Data
-
© 2014 Mellanox Technologies 4 - Mellanox Confidential -
Mellanox Unique Value Proposition
ZERO Copy Remote Data Transfer
Low Latency, High Performance Data Transfers
InfiniBand - 56Gb/s RoCE* – 40Gb/s
Kernel Bypass Protocol Offload
* RDMA over Converged Ethernet
Application Application USER
KERNEL
HARDWARE
Buffer Buffer
-
© 2014 Mellanox Technologies 5 - Mellanox Confidential -
RDMA – How it Works
RDMA over InfiniBand or Ethernet
KER
NEL
H
AR
DW
AR
E U
SER
RACK 1
OS
NIC Buffer 1
Application
1 Application
2
OS
Buffer 1
NIC Buffer 1
TCP/IP RACK 2
HCA HCA
Buffer 1 Buffer 1
Buffer 1
Buffer 1
Buffer 1
-
© 2014 Mellanox Technologies 6 - Mellanox Confidential -
5X Performance Improvement Over 10GbE
New class of enterprise file storage with RDMA support Lower latency, higher throughout, lower CPU
overhead Fibre Channel replacement at a lower cost and
higher performance Leverages Windows Server 2012 R2 Mellanox
inbox InfiniBand & Ethernet RDMA drivers Accelerates Microsoft Hyper-V over SMB and
Microsoft SQL Server over SMB solutions
Microsoft Windows Server 2012 R2 SMB Direct
File Client File Server
SMB Client
User
Kernel
Disk RDMA
Adapter
Network w/ RDMA support
RDMA Adapter
SMB Server
Network w/ RDMA support
NTFS SCSI
Application
-
© 2014 Mellanox Technologies 7 - Mellanox Confidential -
Measuring SMB Direct Performance
Single Server
Fusion IO Fusion IO Fusion IO Fusion-IO
IO Micro Benchmark
SMB Client
SMB Server
Fusion IO Fusion IO Fusion IO Fusion-IO
IO Micro Benchmark
10GbE
10GbE
SMB Client
SMB Server
Fusion IO Fusion IO Fusion IO Fusion-IO
IO Micro Benchmark
FDR IB
FDR IB
SMB Client
SMB Server
Fusion IO Fusion IO Fusion IO Fusion-IO
IO Micro Benchmark
QDR IB
QDR IB
-
© 2014 Mellanox Technologies 8 - Mellanox Confidential -
Microsoft Delivers High-End Storage at a Fraction of the Cost
FDR 56Gb/s InfiniBand delivers 5X higher throughput with 50% less CPU overhead vs. 10GbE
Native Throughput Performance over FDR InfiniBand
-
© 2014 Mellanox Technologies 9 - Mellanox Confidential -
Performance and Resiliency Similar to a Traditional SAN
1.1 Million IOPS for 8KB random reads 700K IOPS for 8KB random writes
100Gbps aggregate read bandwidth
92Gbps aggregate write bandwidth
Source: http://www.mellanox.com/related-docs/applications/Achieving-1.1M-IOPS-over-SMB-Direct.pdf
*
*Cluster Shared Volumes
Scale-Out File Server Cluster using Windows Server 2012 R2 SMB Direct
FDR InfiniBand enables Native Performance
http://www.mellanox.com/related-docs/applications/Achieving-1.1M-IOPS-over-SMB-Direct.pdf
-
© 2014 Mellanox Technologies 10 - Mellanox Confidential -
Hyper-V Live Migration on SMB Direct with Mellanox Interconnect
SMB as a transport for Live Migration of VMs Delivers the power of SMB to provide:
• RDMA (SMB Direct) • Streaming over multiple NICs (SMB Multichannel)
Provides highest bandwidth and lowest latency
0
10
20
30
40
50
60
70
Seco
nds
Live Migration Times* New in
Windows Server
2012 R2
Live migration can stream over
multiple networks for
improved bandwidth
Live Migration can take
advantage of high speed networking
RDMA enables offloading
CPU resources to NIC during live migration
Source: TechED’13 Opening Keynote Session with Satya Nadella
* Lower is better
Click To Watch Video
https://onedrive.live.com/?cid=dfbe7fc34a5643c6&id=DFBE7FC34A5643C6!11854&sff=1&authkey=!ALTVOWdVzRAvBQEhttps://onedrive.live.com/?cid=dfbe7fc34a5643c6&id=DFBE7FC34A5643C6!11854&sff=1&authkey=!ALTVOWdVzRAvBQEhttps://onedrive.live.com/?cid=dfbe7fc34a5643c6&id=DFBE7FC34A5643C6!11854&sff=1&authkey=!ALTVOWdVzRAvBQE
-
© 2014 Mellanox Technologies 11 - Mellanox Confidential -
Success Story: Edgenet
Reduced complexity vs. FC storage management • Creates a more manageable storage subsystem
- SMB easier to provision than Fibre Channel devices • The storage server manages all the connections
- Client Servers only need to know one path via SMB
10x Acceleration vs FC • Allows consolidation of many FC arrays over SMB • Live migration between servers at record speeds Mellanox VPI solutions
• Provides user access to the Hyper-V hosted application
Source: http://www.mellanox.com/related-docs/case_studies/CS_Edgenet_Boost_Performance_Lower_Cost.pdf
http://www.mellanox.com/related-docs/case_studies/CS_Edgenet_Boost_Performance_Lower_Cost.pdfhttp://www.mellanox.com/related-docs/case_studies/CS_Edgenet_Boost_Performance_Lower_Cost.pdfhttp://www.mellanox.com/related-docs/case_studies/CS_Edgenet_Boost_Performance_Lower_Cost.pdfhttp://www.mellanox.com/related-docs/case_studies/CS_Edgenet_Boost_Performance_Lower_Cost.pdf
-
© 2014 Mellanox Technologies 12 - Mellanox Confidential -
Accelerating Microsoft SQL 2012 Parallel Data Warehouse V2
Analyze 1 Petabyte of Data in 1 Second
Up to 100X faster performance than legacy data warehouse queries
Up to 50X faster data query, up to 2X the data loading rate
Unlimited storage scalability for future proofing
Accelerated by Mellanox FDR 56Gb/s InfiniBand end-to-end solutions
-
© 2014 Mellanox Technologies 13 - Mellanox Confidential -
Microsoft SQL Server Appliance – 10X Faster & 50% Lower Capital Cost
Control Node
Mgmt. Node
LZ
Backup Node
Estimated total HW component list price: $1M $ Estimated total HW component list price: $500K $
Ethernet, InfiniBand & Fibre Channel
• Pure hardware costs are ~50% lower
• Price per raw TB is close to 70% lower due to higher capacity
• 70% more disk I/O bandwidth
InfiniBand
• 128 cores on 8 compute nodes • 2TB of RAM on compute • Up to 168 TB of temp DB • Up to 1PB of user data
• 160 cores on 10 compute nodes • 1.28 TB of RAM on compute • Up to 30 TB of temp DB • Up to 150 TB of user data
Parallel Data Warehouse Appliance V1 Parallel Data Warehouse Appliance V2
-
© 2014 Mellanox Technologies 14 - Mellanox Confidential -
SMB Direct Storage Solutions
-
File Storage Controller FSC 2200
X-IO Technologies – Confidential
-
X-IO Technologies – Confidential
X-IO FSC 2200
16
• File Storage Controller (FSC) 2200 is a certified Cluster-in-a-Box appliance that brings together the very best of Microsoft Windows Storage Server 2012 and the X-IO Intelligent Storage Element (ISE) family of enterprise disk and hybrid storage products.
• Provides 400 to 8000 IOPS for every 1 TB of provisioned storage.
• This range is above that of utility and archival (Tier 2) storage, and below that of real-time, ultra-high-performance applications.
• Supports IP client connectivity using CIFS/SMB 3, NFS 4.1 and iSCSI
• Minimum configuration is two servers (controllers) running Windows Storage Server 2012 directly connected to an ISE unit, but can be expanded both in terms of servers and ISE
-
X-IO Technologies – Confidential
X-IO FSC 2200
17
Client Connectivity IP, iSCSI Controllers Two HP DL360e Gen8 CPU per Controller 2x Quad-core per controller (Intel
E5-2403, 1.8GHz)
Memory per controller 32GB Fibre channel Ports 2x 8Gb Ethernet Ports per controller 4x 1Gb Ethernet, 2x 10/40Gb
Ethernet ports (Infiniband-capable)
Supported ISE ISE 200-series or ISE 700 series
File Services CIFS/SMB, NFS
-
18 CONFIDENTIAL | © V i o l i n M e m o r y , I n c . 2 0 1 4
Introducing The Windows Flash Array
-
19 CONFIDENTIAL | © V i o l i n M e m o r y , I n c . 2 0 1 4
Windows in a Flash!
Transformative Speed in Storage
Consolidation and cost savings
Increases server utilization
SMB Direct for Microsoft applications
Enables file server functions
RDMA as a Storage Superhighway
Encryption Dedupe Live Migration Mirroring Scale-Out
>1 year of Joint Violin - Microsoft Development
-
20 CONFIDENTIAL | © V i o l i n M e m o r y , I n c . 2 0 1 4
1.2M
1.0M
800K
600K
400K
200K
SQL WRITES*
Beta Site Performance: SQL* and Hyper-V
• SMB Direct reduces CPU load up to 30% • Latency averages 500 microseconds at Load
SQL READS*
HYPER-V WRITES
WFA
AFA
IOPS
41% Increase
54% Increase
2x Increase
30% Decrease
50% Decrease
SQL Writes
SQL Reads
Hyper-V Writes
Application Server CPU Utilization
Latency at Load
WFA
WFA
AFA
AFA
*All Microsoft SQL results based on SQLIO load test with Infiniband connectivity
-
© 2014 Mellanox Technologies 21 - Mellanox Confidential -
DataOn Cluster-in-a-Box over RDMA
Extremely economical Simplified architecture
Easy to install appliance
CiB interconnects:
• ConnectX-3 40GbE • ConnectX-3 56Gbs InfiniBand
Deployed at:
-
© 2014 Mellanox Technologies 22 - Mellanox Confidential -
File Server (SMB 3.0)
File Client (SMB 3.0) SQLIO
RDMA NIC
RDMA NIC
RDMA NIC
RDMA NIC
RDMA NIC
RDMA NIC
SAS
SAS HBA
JBOD SSD SSD SSD SSD SSD SSD SSD SSD
SAS
SAS HBA
JBOD SSD SSD SSD SSD SSD SSD SSD SSD
SAS
SAS HBA
JBOD SSD SSD SSD SSD SSD SSD SSD SSD
SAS
SAS HBA
JBOD SSD SSD SSD SSD SSD SSD SSD SSD
SAS
SAS HBA
JBOD SSD SSD SSD SSD SSD SSD SSD SSD
Storage Spaces
SAS
SAS HBA
JBOD SSD SSD SSD SSD SSD SSD SSD SSD
8KB random reads from a mirrored space
(disk) ~600,000 IOPS
8KB random reads from cache (RAM) ~1,000,000 IOPS
32KB random reads from a mirrored space
(disk) ~500,000 IOPS
~16.5 GBytes/sec
EchoStreams: InfiniBand Enables Near Linear Scalability
-
© 2014 Mellanox Technologies 23 - Mellanox Confidential -
Preconfigured Microsoft Hyper-V cloud IaaS hardware platform • Full integrated converged data center solution
Iron Pod Description • Fault tolerant Mellanox 40/56GbE server and storage network
- Fully redundant network for high availability • ConnectX-3 Pro adapters for RDMA and NVGRE acceleration
- Dual 40/56GbE network adapters
More info about Iron Networks: • http://www.mellanox.com/related-
docs/solutions/Iron_Networks_Microsoft_Fast_Track_Architecture.pdf • http://ironnetworks.com/Microsoft-Converged-Infrastructure/IronPOD-Cloud-
Building-Blocks • http://ironnetworks.com/Microsoft-Converged-Infrastructure/IronPOD-System-500
Iron Networks – IRON POD
http://ironnetworks.com/Microsoft-Converged-Infrastructure/IronPOD-Cloud-Building-Blockshttp://ironnetworks.com/Microsoft-Converged-Infrastructure/IronPOD-Cloud-Building-Blockshttp://ironnetworks.com/Microsoft-Converged-Infrastructure/IronPOD-Cloud-Building-Blockshttp://ironnetworks.com/Microsoft-Converged-Infrastructure/IronPOD-Cloud-Building-Blockshttp://ironnetworks.com/Microsoft-Converged-Infrastructure/IronPOD-System-500http://www.ironnetworks.com/
-
Thank You
SMB Direct for SQL Server and Private CloudMellanox OverviewLeadership in Strategic Markets with an End to End PortfolioMellanox Unique Value Proposition RDMA – How it WorksMicrosoft Windows Server 2012 R2 SMB DirectMeasuring SMB Direct PerformanceMicrosoft Delivers High-End Storage at a Fraction of the CostPerformance and Resiliency Similar to a Traditional SANHyper-V Live Migration on SMB Direct with Mellanox InterconnectSuccess Story: Edgenet Accelerating Microsoft SQL 2012 Parallel Data Warehouse V2Microsoft SQL Server Appliance – 10X Faster & 50% Lower Capital CostSMB Direct Storage SolutionsFile Storage Controller�FSC 2200X-IO FSC 2200X-IO FSC 2200Introducing The Windows Flash ArrayWindows in a Flash!Beta Site Performance: SQL* and Hyper-V DataOn Cluster-in-a-Box over RDMAEchoStreams: InfiniBand Enables Near Linear Scalability Iron Networks – IRON PODSlide Number 24