forum k-21 brent compton, director storage solution ... · brent compton, director storage solution...
TRANSCRIPT
![Page 1: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/1.jpg)
meets : All-Flash Ceph!
Forum K-21
Brent Compton, Director Storage Solution Architectures, Red Hat
Gunna Marripudi, Principal Architect, Samsung Semiconductor Inc.
![Page 2: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/2.jpg)
Ceph Architecture Overview
Flash Memory Summit 2016 Santa Clara, CA 2
![Page 3: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/3.jpg)
STANDARD SERVERS AND MEDIA (HDD, SSD, PCIE)
STANDARD NICS AND SWITCHES
WORKLOADS
ACCESS
PLATFORM
NETWORK
CEPH STORAGE CLUSTER
CEPH BLOCK & OBJECT CLIENTS
Ceph Cluster Building Blocks
Flash Memory Summit 2016 Santa Clara, CA 3
![Page 4: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/4.jpg)
OpenStack Starter100TB
S500TB
M1PB
L2PB
IOPSOPTIMIZED
THROUGHPUTOPTIMIZED
COST-CAPACITYOPTIMIZED
Ceph Cluster Possibilities
Flash Memory Summit 2016 Santa Clara, CA 4
![Page 5: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/5.jpg)
OpenStack Starter100TB
S500TB
M1PB
L2PB
IOPSOPTIMIZED
THROUGHPUTOPTIMIZED
COST-CAPACITYOPTIMIZED
Flash in Ceph Clusters
Flash Memory Summit 2016 Santa Clara, CA 5
SSDs
![Page 6: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/6.jpg)
NVMe Reference Design1
EIA 310-D 19”2U Form Factor 24x 2.5” NVMe SSDs (U.2) 2x PCIe Gen3 x16 Slots
PCIeSwitch
PCIeSwitch
1 http://www.samsung.com/semiconductor/support/tools-utilities/All-Flash-Array-Reference-Design/Flash Memory Summit 2016 Santa Clara, CA 6
![Page 7: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/7.jpg)
High-Performance Ceph over NVMe
MessengerOSD
FileStoreXFS
blk_mqNVMe Driver
40GbE Network
RBDCeph Clients
RADOS
Flash Memory Summit 2016 Santa Clara, CA 7
![Page 8: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/8.jpg)
Ceph Reference Design over NVMe
Test configuration• Ceph Jewel w/jemalloc• 2x replication• Default debug values set• OSD nodes with
– 2x Xeon® E5-2699 v3 CPUs– 24x Samsung PM953 2.5”
960GB SSDs• CBT test framework• RHEL 7.2
Flash Memory Summit 2016 Santa Clara, CA 8
![Page 9: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/9.jpg)
IOPS Optimized Configuration
Random Read• >700K IOPS with 12 PM953 SSDs in the cluster for 4KB IOs• >500K IOPS with 12 PM953 SSDs in the cluster for 8KB IOs
Flash Memory Summit 2016 Santa Clara, CA 9
![Page 10: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/10.jpg)
IOPS Optimized Configuration
Random Write• >100K IOPS with 12 PM953 SSDs in the cluster for 4KB IOs• >70K IOPS with 12 PM953 SSDs in the cluster for 8KB IOs
Flash Memory Summit 2016 Santa Clara, CA 10
![Page 11: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/11.jpg)
IOPS Optimized Configuration
Random IO Latency (1 job, QD=1)• 95th percentile <500usec for Random Read of 4KB and 8KB• 95th percentile <100usec for Random Write of 4KB and 8KB
Flash Memory Summit 2016 Santa Clara, CA 11
![Page 12: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/12.jpg)
Throughput Optimized Configuration
Sequential Read• >28GB/s throughput with 72 PM953 SSDs in the cluster• >800MB/s throughput per TB cluster capacity
Flash Memory Summit 2016 Santa Clara, CA 12
![Page 13: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/13.jpg)
Throughput Optimized Configuration
Sequential Write• >6GB/s throughput with 72 PM953 SSDs in the cluster• >179MB/s throughput per TB cluster capacity
Flash Memory Summit 2016 Santa Clara, CA 13
![Page 14: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/14.jpg)
Ceph Scalability: 3 Nodes to 5 Nodes
Performance scales 1.3x-1.6x
Flash Memory Summit 2016 Santa Clara, CA 14
![Page 15: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/15.jpg)
Ceph Reference Design for NVMe
Extensible platform for IOPS and Throughput optimized configuration
>1.2M IOPS and >45GB/s throughput in 5 Node Ceph Cluster
Ready for end-user deployments!
Flash Memory Summit 2016 Santa Clara, CA 15
![Page 16: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/16.jpg)
Flash Memory Summit 2016 Santa Clara, CA 16
![Page 17: Forum K-21 Brent Compton, Director Storage Solution ... · Brent Compton, Director Storage Solution Architectures, Red Hat Gunna Marripudi, Principal Architect, Samsung Semiconductor](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc380d51ae1b30bf65e2949/html5/thumbnails/17.jpg)
Test Configuration
System tuning, Ceph configuration and CBT test methodology as detailed in• http://www.samsung.com/semiconductor/support/t
ools-utilities/All-Flash-Array-Reference-Design/downloads/High-Performance_Red_Hat_Ceph_Storage_Using_Samsung_NVMe_SSDs-WP-20160622.pdf
Flash Memory Summit 2016 Santa Clara, CA 17