aws summit berlin 2013 - choosing the right data storage options with aws

45
James Brown, Business Development Manager Choosing the right data storage options with AWS

Upload: aws-germany

Post on 20-Aug-2015

378 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

James Brown, Business Development Manager

Choosing the right data storage options with AWS

Page 2: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Object Storage

Block Storage

Connecting AWS Storage to On-premise

What are we going to cover?

Page 3: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

#1Object Storage

●○○

Page 4: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Amazon S3Simple Storage Service

Page 5: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

99.999999999%Durability

Page 6: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Over 2 TrillionUnique Customer Objects

Page 7: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Over 1.1 millionPeak Transactions Per Second

Page 8: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Spotify adds over 20,000 tracks a

day.

“Amazon S3 gives us confidence in

our ability to expand storage

quickly while also providing high data durability.”

Emil Fredriksson, operations director

Case S

tudy

Page 9: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Amazon S3Store objects from 1 byte to 5 terabytes

Uses standards based REST and SOAP protocols

Highly durable, fully managed

Designed to make web-scale computing easier

Amazon S3 - Unlimited Storage

Page 10: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Amazon S3 WebsitesEasily handle peak loads at low cost

Pay as you go pricing

Inexpensive and Highly Scalable web hosting

Static Website Hosting

Page 11: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Real Clear Politics served up

to 20x normal demand with S3

Websites

Case S

tudy

Page 12: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

CloudFrontPay as you go pricing with no long term

commitments

Caches content closer to your users to

lower latency and better performance

Integrated low latency content distribution network

Deliver content with lower latency with CloudFront

Page 13: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Storage costs as low as 5½ cents per GB

Page 14: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

USE AMAZON S3WHEN YOU NEED:

High Durability

Unlimited Storage Capacity

High Scale

High Volume Static Websites

Delivery via CloudFront

Page 15: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Amazon GlacierLow-Cost Archiving Service

Page 16: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

1¢Per GB / Month

Page 17: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

$125Per TB / Year

Page 18: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

99.999999999%Durability

Page 19: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

3-5 HoursData Retrieval

Page 20: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Storage Costsvs

Retrieval Costs

Page 21: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Lifecycle PoliciesCreate rules on object prefix

Create rules to also delete expired object

Automatically tier S3 data in Glacier

Using Lifecycle policies to move data

Page 22: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Riverbed WhitewaterEliminates the burden of tape

Improve DR

Additional layer of security

Reduce storage requirements by 10 to 30x

A physical device can manage integration with Glacier

3rd Party Solution integration with Glacier

Page 23: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Their use of S3, Glacier and

CloudFront gives them more time to

concentrate on their business,

rather than worrying about the hardware

Page 24: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

#2Block Storage

○●○

Page 25: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Amazon EBSElastic Block Store

Page 26: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Ephemeral storage is on every EC2 instance

Page 27: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Amazon EBSParticularly suited for applications that require

a database, file system, or access to raw block

level storage.

Can be attached to a running instance

Network attached persistent block level storage volumes

EBS Drives can be moved between instances

Page 28: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

How do our customers use EBS?

Enterprises

Enterprise workloads are built

on block storageOracle, SAP,

Microsoft

Gaming customers

Very high performance

databases.500,000 IOPS for a new game launch

Social Network /

Mobile Apps

Very high performance and consistent I/O for

NoSQL and relational DBs

Marketing / Analytics

High performance I/O databases

Page 29: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Multiple drives on one Amazon EC2 instance

Page 30: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

10GB Ú 1TB

Page 31: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Provisioned IOPSAmazon EBS

Page 32: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Provisioned IOPSP-IOPS is designed to run transactional

applications that require high and

consistent I/O

Workloads on Provisioned IOPs

Use Cases

Relational Databases

NoSQL Databases (eg MongoDB)

High Performance File Systems

Enterprise Workloads (eg CRM, MS Exchange, ERP)

Page 33: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Provisioned IOPS- For steady I/O use Provisioned IOPS

- For bursty I/O, run the numbers

Optimized for price/performance

Page 34: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

EBS SnapshotsAmazon EBS

Page 35: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

EBS Snapshots- Snapshots from EBS are stored in Amazon

S3- Rollback to a previous version- Can be copied between regions

EBS Snapshots – Stored in Amazon S3

Page 36: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

USE AMAZON EBSWHEN YOU NEED:

Filesystem for an instanceNTFS, ExtFS, RAID, LVM…

Long-term persistent storage

Data changes frequently

Access to raw, unformatted block-level storage

Page 37: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

#3Connecting AWS Storage to On-

Premise Environments○○●

Page 38: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

AWS Storage GatewayConnecting with on-premise

Page 39: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

AWS Storage Gateway- Low latency access to frequently accessed data- Minimise the need to scale out on-premise

storage- Snapshots allow access to old data

Up to 150TBs supported from a single Storage Gateway

Extend your on-premise storage

Page 40: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

USE AWS STORAGE GATEWAYWHEN YOU NEED:

Synchronize data for disaster recovery

Departmental fileshare

Backup your data

Page 41: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Oracle Secure Backup Module

Page 42: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Oracle Secure Backup (OSB) Cloud

Module allows customers to backup

Oracle Databases directly to Amazon S3

using the Oracle Recovery Manager

(RMAN)

Backup Oracle into Amazon S3

Page 43: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Restore times reduced from 15

to 2½ hours

Took less that 1 hour to configure

per database

Offered significant improvements in

durability of backups

Case S

tudy

Page 44: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

IT’S ALL ABOUT

CHOICEPERFORMANCE-ORIENTED

COST-ORIENTED

Page 45: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS

Thank You