the cloudiest storage - snia · benefits of having vendor storage in the cloud •not all...
Post on 26-Jul-2020
1 Views
Preview:
TRANSCRIPT
2019 Storage Developer Conference. © All Rights Reserved. 1
The Cloudiest Storage, The Storagiest CloudAn Independent Study of Hyperscalers' Storage Offerings
Gregory Touretsky
2019 Storage Developer Conference. © All Rights Reserved. 3
Introducing Infinidat
>5 EB deployed and growing!
Because they pay me
2019 Storage Developer Conference. © All Rights Reserved. 4
What are we going to talk about?
From the traditional enterprise storage point of view
Block File Object
Agenda
2019 Storage Developer Conference. © All Rights Reserved. 5
Key takeaway: today’s public cloud storage offerings are not good enough for “lift and shift”
enterprise workloads
2019 Storage Developer Conference. © All Rights Reserved. 7
Basic FunctionalityAWS EBS Azure MD GCP PD IBM BS Oracle BV Alibaba CD
Max size 16 TiB 32 TiB (data)2 TiB (boot)
64 TB 12 TB 32TB Varies by tier, up to 32TiB
Snapshots Copy to S3 Copy to Blob Copy to GCS Yes Copy to object Copy to object
Availability 99.99% 99.999% ?? 99.9% / 99.95% 99.99% ??
Media tiers Yes Yes Yes Yes No Yes
Encryption Yes Yes Yes Yes Yes Yes
2019 Storage Developer Conference. © All Rights Reserved. 9
Enterprise FunctionalityAWS Azure GCP IBM Oracle Alibaba
Multi-attach No No Read-only Yes Read-only No
RW Snapshots No No No Clone Clone No
Consistency Gs Yes No No No Yes No
Async Replication
No GRS No Yes No No
Sync replication
No ZRS Regional PD No No No
Multi-path No No No Yes No? No
Thin provisioning
No No No No No No
Compression No No No No No No
On-prem connectivity
No No No No No No
2019 Storage Developer Conference. © All Rights Reserved. 10
Block storage – single disk latency, ms
0
5
10
15
20
25
30
35
4k random read, ms 4k random write, ms 64k random read, ms 64k random write, ms
AWS m4.10xlarge, RHEL7.5 EBS 1 vol 200GB, 25 threads, IO1/10k IOPsAWS m4.10xlarge, RHEL7.5 EBS 1 vol 200GB, 25 threads, GP2 600-3000IOPsAzure Disk 1 - PremiumSSD 1023GB 5000 IOPs 200MBps) 25 threadsGCP n1-standard-16, one out of 1 vols- SSD PD - 100GB - 3000 IOPS; 48 MBps; 25 threadsGCP n1-standard-16, one out of 8 vols- SSD PD - 100GB - 3000 IOPS; 48 MBps; 25 threads
2019 Storage Developer Conference. © All Rights Reserved. 11
Block storage – single disk, IOPS
0
10000
20000
30000
40000
50000
60000
4k random read, ms 4k random write, ms 64k random read, ms 64k random write, ms
AWS m4.10xlarge, RHEL7.5 EBS 1 vol 200GB, 25 threads, IO1/10k IOPsAWS m4.10xlarge, RHEL7.5 EBS 1 vol 200GB, 25 threads, GP2 600-3000IOPsAzure Disk 1 - PremiumSSD 1023GB 5000 IOPs 200MBps) 25 threadsGCP n1-standard-16, one out of 1 vols- SSD PD - 100GB - 3000 IOPS; 48 MBps; 25 threadsGCP n1-standard-16, one out of 8 vols- SSD PD - 100GB - 3000 IOPS; 48 MBps; 25 threads
2019 Storage Developer Conference. © All Rights Reserved. 12
Block storage – single disk, MB/sec
0
100
200
300
400
500
600
4k random read, ms 4k random write, ms 64k random read, ms 64k random write, ms 1M seq read, MB/sec 1M seq wr ite, MB/sec
AWS m4.10xlarge, RHEL7.5 EBS 1 vol 200GB, 25 threads, IO1/10k IOPsAWS m4.10xlarge, RHEL7.5 EBS 1 vol 200GB, 25 threads, GP2 600-3000IOPsAzure Disk 1 - PremiumSSD 1023GB 5000 IOPs 200MBps) 25 threadsGCP n1-standard-16, one out of 1 vols- SSD PD - 100GB - 3000 IOPS; 48 MBps; 25 threadsGCP n1-standard-16, one out of 8 vols- SSD PD - 100GB - 3000 IOPS; 48 MBps; 25 threads
2019 Storage Developer Conference. © All Rights Reserved. 13
Price: $/GB/month
0
0.1
0.2
0.3
0.4
0.5
0.6
Top SSD Low SSD Top HDD Low HDD
AWS Azure Google IBM Oracle Alibaba• AWS: IOPS cost is not included for provisioned io volumes• Azure: no Ultra disks included; price calculated based on 1TiB drives• Google: Regional and Zonal storage pricing• IBM: Endurance tiers, media is not clear• Oracle: single tier, media is not clear
2019 Storage Developer Conference. © All Rights Reserved. 14
Price: 1PB usable over 3 years
$-
$2,000,000
$4,000,000
$6,000,000
$8,000,000
$10,000,000
$12,000,000
$14,000,000
$16,000,000
$18,000,000
$20,000,000
Top SSD Low SSD Top HDD Low HDD
AWS Azure Google IBM Oracle Alibaba• AWS: IOPS cost is not included for provisioned io volumes• Azure: no Ultra disks included; price calculated based on 1TiB drives• Google: Regional and Zonal storage pricing• IBM: Endurance tiers, media is not clear• Oracle: single tier, media is not clear
2019 Storage Developer Conference. © All Rights Reserved. 15
Notes§ Tiering varies between clouds
§ Usually media-defined (HDD vs SSD)§ Performance per disk / instance is limited
§ depends on max instance throughput, max volume xput, aggregated volumes xput, number of attached drives, storage account, …
§ Availability?§ No replication, multipath, SLAs are low, …
§ Basic functionality is there§ But most of the Enterprise features are not
§ Expensive
2019 Storage Developer Conference. © All Rights Reserved. 17
Basic FunctionalityAWS EFS Azure Files GCP
FilestoreIBM FS Oracle FS Alibaba NAS
Max size No limit (8 EB) 5TiB. 100 TiB(preview)
63.9 TB 12 TB No limit (8EB) 10PB
Snapshots No Yes No Yes Yes Yes
Availability 99.9% High (replication)
99.9% ?? ?? 99.9%
Performance tiers
Yes Yes Yes Yes No Yes
Encryption Yes Yes ?? Yes Yes Yes
Protocols NFSv4.1 (part) SMB 3.0 NFSv3 NFS NFSv3 NFSv3/4, SMB2/3
2019 Storage Developer Conference. © All Rights Reserved. 18
Enterprise FunctionalityAWS Azure GCP IBM Oracle Alibaba
RW Snapshots No No No Clone
Consistency Gs No No No No
Async Replication
No GRS No Yes
Sync replication
Cross-AZ ZRS No No
Thin provisioning
No No No No
Compression No No No No
Quotas No No No No
On-prem connectivity
Yes (*) Yes (*) No No
2019 Storage Developer Conference. © All Rights Reserved. 19
File storage – single disk latency, ms
4k random read, ms 4k random write, ms 64k random read, ms 64k random write, msm4.10xlarge, RHEL7.5 EFS - GP , 25 threads. 80GB used 4.1 107 15.6 99
Azure FS - GRS 34.2 29.9 57.1 54.5
GCP n1-s tandard-16 us-east1b Google Filestore 2.5TBPremium Tier (R: 30k ops, W:25k ops; R:700MBps,
W:350MBps)0.6 8.2 1.7 10
0.1
1
10
100
1000Log
2019 Storage Developer Conference. © All Rights Reserved. 20
File storage – single disk, IOPS
4k random read, ms 4k random write, ms 64k random read, ms 64k random write, msm4.10xlarge, RHEL7.5 EFS - GP , 25 threads. 80GB used 6036 234 1597 252
Azure FS - GRS 730 836 438 458
GCP n1-s tandard-16 us-east1b Google Filestore 2.5TBPremium Tier (R: 30k ops, W:25k ops; R:700MBps,
W:350MBps)43063 3041 14942 2492
1
10
100
1000
10000
100000Log
2019 Storage Developer Conference. © All Rights Reserved. 21
File storage – single disk, MB/sec
4k random read, ms 4k random write,ms
64k random read,ms
64k random write,ms
1M seq read,MB/sec
1M seq wr ite,MB/sec
m4.10xlarge, RHEL7.5 EFS - GP , 25 threads. 80GB used 23 0.915 99 15 100 101
Azure FS - GRS 2 3 27 28 74 32
GCP n1-s tandard-16 us-east1b Google Filestore 2.5TBPremium Tier (R: 30k ops, W:25k ops; R:700MBps,
W:350MBps)168 11 933 155 1072 382
0.1
1
10
100
1000
10000Log
2019 Storage Developer Conference. © All Rights Reserved. 22
File storage: $/GB/month
0
0.1
0.2
0.3
0.4
0.5
0.6
Standard tier Low cost tier
AWS Azure Google IBM Oracle Alibaba
2019 Storage Developer Conference. © All Rights Reserved. 23
File storage: 1PB usable over 3 years
$-
$2,000,000
$4,000,000
$6,000,000
$8,000,000
$10,000,000
$12,000,000
$14,000,000
$16,000,000
$18,000,000
$20,000,000
Standard tier Low cost tier
AWS Azure Google IBM Oracle Alibaba
2019 Storage Developer Conference. © All Rights Reserved. 24
Notes
§ Performance is limited§ depends on max instance throughput, used capacity, storage
account, …§ Basic functionality is there
§ But most of the Enterprise features are not§ Availability?§ Expensive
2019 Storage Developer Conference. © All Rights Reserved. 26
Object storage: $/GB/month
0
0.005
0.01
0.015
0.02
0.025
0.03
Standard tier Low cost
AWS Azure Google IBM Oracle Alibaba
Storage only, doesn’t include requests costs or egress
2019 Storage Developer Conference. © All Rights Reserved. 27
Object storage: 1PB usable over 3 years
$-
$100,000
$200,000
$300,000
$400,000
$500,000
$600,000
$700,000
$800,000
$900,000
$1,000,000
Standard tier Low cost
AWS Azure Google IBM Oracle Alibaba
2019 Storage Developer Conference. © All Rights Reserved. 28
Data access vs Data storage costsS3 Standard storage - US East On Sep, 10 2019
Storage cost <50TB $0.023 per GB per monthNext 450TB $0.022 per GB per monthOver 500TB $0.021 per GB per month
PUT, COPY, POST, or LIST Requests $0.005 per 1000 requestsGET, SELECT and all other Requests $0.0004 per 1000 requests
Data transfer from AWS to Internet $0.090 per GB
INPUTSEnvironmnet life time 3 yearsUsed capacity 1,000 TB# of PUT/POST 200 requests / sec# of GET 500 requests / secAmount of data transferred to Internet 0 TBs
Estimated S3 costStorage $775,800.00PUT/POST requests $94,608.00GET requests $18,921.60Egress $0.00Total $889,329.60
2019 Storage Developer Conference. © All Rights Reserved. 29
Notes
§ Object storage is THE cloud storage§ Still have a limited adoption on-prem§ There is no “Enterprise” feature-set for
object§ Not cheap
2019 Storage Developer Conference. © All Rights Reserved. 31
Actual Enterprise customer’s noteBenefits of having VENDOR storage in the CLOUD
•Not all applications can be rewritten to consume services in CLOUD, hence a lot of applications will be migrated 1 to 1.•Easy to move large amout of data to CLOUD as it would be possible to set up replication links between on-prem and CLOUD.•VENDOR can do capacity overallocation to further reduce cost of storage. There is no overallocation possible with native CLOUD storage•Benefit from the VENDOR compression for further cost reduction•Such service would offer:
• A simple tier for migration to CLOUD• Ability to use Active-Active and Sync replication between separate Availability Zones in
CLOUD which would be very helpful.• Ability to use snapshots for easy data protection• Performance – storage bandwidth is high and latency is important (IOPS are less
important)
2019 Storage Developer Conference. © All Rights Reserved. 32
Meet INFINIDAT Neutrix Cloud
Neutrix CloudOn-Prem / Co-Lo
VMware on AWS
Use Case 1: DisasterRecovery
Use Case 2: Cloud-Adjacent Storage
Use cases 1 and 2 can be combined to enable true hybrid cloud workflows — DevOpsv CI/CD etc
• Low, predictable latency• Secure dedicated connection• Economic savings
(NFS/iSCSI)
2019 Storage Developer Conference. © All Rights Reserved. 33
Summary
§ Clouds offer reach selection of storage solutions§ developed for apps that don’t expect HA
infrastructure § “Lift and shift” approach for a traditional
enterprise workload is problematic§ There is a major area for cloud storage improvements
§ And an opportunity for Enterprise storage solutions in or near public clouds
top related