© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

David Elliott, Manager, Solutions Architecture, AWS

Rob Hart, Head of Solutions & Design Architecture, DVSA

July 7th, 2016

Getting Started with Managed

Database Services on AWS

What to expect from the session

• Why managed database services?

• AWS managed database options

• Amazon RDS—A relational managed database

• Amazon DynamoDB—A nonrelational managed database

• Amazon ElastiCache—A managed in-memory cache

• Amazon Redshift—A managed data warehouse

• Choosing AWS managed database services

• Rob Hart, Head of Solutions & Design Architecture, DVSA

• Wrap-up

Why managed database services?

If you host your databases on-premises

Power, HVAC, net

Rack and stack

Server maintenance

OS patches

DB software patches

Database backups

Scaling

High availability

DB software installs

OS installation

you

App optimization

If you host your databases in Amazon EC2

Power, HVAC, net

Rack and stack

Server maintenance

OS patches

DB software patches

Database backups

Scaling

High availability

DB software installs

OS installation

you

App optimization

If you choose a managed DB service

Power, HVAC, net

Rack and stack

Server maintenance

OS patches

DB software patches

Database backups

App optimization

High availability

DB software installs

OS installation

you

Scaling

What are the AWS managed DB

options?

A managed service for each major DB type

Amazon

Redshift

Data

warehouse

Amazon

DynamoDB

Document

and key-

value store

Amazon

RDS

Relationaldatabase

engines

Amazon

ElastiCache

In-memory

key-value

store

What is Amazon RDS?

Relational databases

Fully managed

Fast, predictable performance

Simple and fast to scale

Low cost, pay for what you useAmazon

RDS

Amazon Aurora

Amazon Aurora: Fast, available, and MySQL-compatible

SQL

Trans-

actions

AZ 1 AZ 2 AZ 3

Caching

Amazon

S3

5x faster than MySQL on

same hardware

SysBench: 100K writes/sec

and 500K reads/sec

Designed for 99.99%

availability

6-way replicated storage

across 3 AZs

Scale to 64 TB and 15 Read

Replicas

Use cases

Applicable wherever you need relational databases

eCommerce Gaming

Websites IT solutions

Apps

Reporting

RDS feature matrix

Feature Aurora MySQL PostgreSQL MariaDB Oracle SQL Server

VPC

High availability

Instance scaling

Encryption

Read replicas Oracle

GoldenGateCross-region

Maximum storage 64 TB 6 TB 6 TB 6 TB 6 TB 4 TB

Scale storage Auto

Scaling

Provisioned IOPS NA 30,000 30,000 30,000 30,000 20,000

Largest instance R3.8XL R3.8XL

M4.10XL

R3.8XL

M4.10XL

R3.8XL

M4.10XL

R3.8XL

M4.10XL

R3.8XL

M4.10XL

How do Amazon RDS backups work?

Automated backups

Restore your database to a point in

time

Enabled by default

Choose a retention period, up to 35

days

Manual snapshots

Build a new database instance from a

snapshot when needed

Initiated by you

Persist until you delete them

Stored in Amazon S3

Monthly

bill= +

Further details at http://aws.amazon.com/rds/pricing/

You pay for the resources that you use

Storage

consumed

Duration for which DB

instances were used

(Price depends on

type of storage)

(Price depends on

type of DB instance)

Free tier (for first 12 months)

• 750 micro DB instance hours

• 20 GB of DB storage

• 20 GB for backups

• 10 million I/O operations

GBN ×

What is Amazon DynamoDB?

Amazon DynamoDB

NoSQL database

Fully managed

Single-digit millisecond latency

Massive and seamless scalability

Low costAmazon

DynamoDB

Amazon DynamoDB: a managed document and

key-value store

• Simple and fast to deploy, easy to scale

• Data is automatically replicated

• Fast, predictable performance

• Helps provide security and control

• Fine-grained access control

• No cost to get started

• Pay only for what you consume

Popular use cases

Ad tech IoT GamingMobile

& web

Ad serving,

retargeting, ID

lookup, user

profile

management,

session-

tracking, RTB

Tracking state,

metadata and

readings from

millions of

devices, real-

time

notifications

Recording

game details,

leaderboards,

session

information,

usage history,

and logs

Storing user

profiles,

session details,

personalization

settings, entity

specific

metadata

Writes

Replicated continuously to 3 AZs

Persisted to disk (custom SSD)

Reads

Strongly or eventually consistent

No latency trade-off

Automatic replication for rock-solid durability and

availability

Simple app architecture with Amazon DynamoDB

Elastic Load

Balancing Amazon EC2

app instances

Clients

DynamoDB

Business logic

You pay for the resources that you use

Monthly

bill = GB +

Pricing varies by region. Further details at http://aws.amazon.com/dynamodb/pricing/

Storage

consumed

Write

capacity

units

(WCUs)

+

Read

capacity

units

(RCUs)

Free tier:

• Generous free tier of 25 GB, 25 WCUs, and 25 RCUs

• That is, you get over 60M read requests and 60M write request for free in a month

• The free tier is indefinite—you benefit from this every month

What is Amazon Redshift?

Amazon

Redshift

a lot faster

a lot cheaper

a whole lot simpler

Relational data warehouse

Massively parallel; petabyte scale

Fully managed

HDD and SSD platforms

$1,000/TB/year; starts at $0.25/hour

Amazon Redshift architectureLeader node

• Simple SQL endpoint

• Stores metadata

• Optimizes query plan

• Coordinates query execution

Compute nodes

• Local columnar storage

• Parallel/distributed execution of all

queries, loads, backups, restores,

resizes

Start at just $0.25/hour, grow to 2 PB

(compressed)

• DC1: SSD; scale 160 GB–326 TB

• DS2: HDD; scale 2 TB–2 PB

10 GigE

(HPC)

IngestionBackupRestore

JDBC/ODBC

Amazon Redshift is fast

Dramatically less I/O

Column storage

Data compression

Zone maps

Direct-attached storage

Large data block sizes

10 | 13 | 14 | 26 |…

… | 100 | 245 | 324

375 | 393 | 417…

… 512 | 549 | 623

637 | 712 | 809 …

… | 834 | 921 | 959

10

324

375

623

637

959

ID Age State Amount

123 20 CA 500

345 25 WA 250

678 40 FL 125

957 37 WA 375

Fully managed, continuous/incremental backups

Multiple copies within cluster

Continuous and incremental backups

to Amazon S3

Continuous and incremental backups

across regions

Streaming restore

Amazon S3

Amazon S3

Region 1

Region 2

Security is built-in

• Load encrypted from S3

• SSL to secure data in transit

• Amazon VPC for network isolation

• Encryption to secure data at rest

• On-premises HSM and AWS

CloudHSM support

• SOC 1, 2, and 3; PCI-DSS;

FedRAMP; BAA

10 GigE

(HPC)

Ingestion

Backup

Restore

Customer VPC

Internal

VPC

JDBC/ODBC

You pay for what you use

Further details at https://aws.amazon.com/redshift/pricing/

Monthly

bill = N ×

Duration for which the

nodes were usedNumber of nodes

(Price depends on type

of node)

2 month free trial

Leader node is free

No upfront costs, pay as you go

What is Amazon ElastiCache?

In-memory key-value store

High-performance

Memcached and Redis

Fully managed; zero adminAmazon

ElastiCache

Popular use cases

Caching layer for

performance or cost

optimization

Databases

Ephemeral key-value

data

Storage

Leaderboards

In-memory lists

Session management

Event counters

High-performance

app patterns

Amazon ElastiCache: simple app architecture

Elastic Load

Balancing Amazon EC2

app instances

Clients

Amazon RDSAmazon

ElastiCache

• Fully managed

• Cache node auto-

discovery

• Multi-AZ node

placement

Key ElastiCache features

• Fully managed

• Multi-AZ with

auto-failover

• Persistence

• Read replicas

How ElastiCache billing works

Monthly

bill = N ×

Further details at http://aws.amazon.com/elasticache/pricing/

Duration for which the

nodes were usedNumber of nodes

(Price depends on type

of node)

Free tier (for first 12 months)—750 micro cache node hours

To sum up…

What I’ll Cover

• DVSA - Who we are &

what we do?

• MOT

• Our challenge & why

AWS ?

• Why RDS ?

• What we have achieved

• Working with AWS & what’s Next

Rob Hart, Head of Solutions & Design Architecture, DVSA

DVSA

What We Do

• Driving Test

• MOT

• Operator Licensing

• Test & Inspection

• Enforcement

MOT Stats

80,000 users

55,000 testers

42 million

tests

per year

500 tests

performed a

minute at

peak

Over 27,000

businesses

across the

UK

DVSA MOT before AWS

• Scale

• Number and speed of provisioning of disks

• The need for provisioned IOP

• Speed of rollout to development at test environments

• Agility to bring new environments on line quickly

• Data transfer

• Loading many millions of records legacy to new solution

Choosing AWS

DVSA commissioned an independent review to evaluate

cloud providers across a number of criteria including:

• Security

• Reliability

• Availability

• Performance

• Flexibility and support for Open Standards

Against these criteria AWS was identified as the preferred

platform by DVSA

Choosing RDS and the Benefits

Platform as a Service

• Conservatively oversized, provisioned IOPS, maximum server sizes

• Monitoring established “right size”

Automation

• Terraform deployments

Data Management

• Backup/Snapshots

• Cloning

• Replication

Monitoring

• Comprehensive

• Out of the box

Considerations

Security

• RDS does not need to be accessible outside AWS

• Locked down to ensure no external access

Cost

• RDS instances run continuously

• Rightsizing is important

• Server size, IOPS requirement, storage all factors

Data Import/Export

• Database not accessed directly from outside AWS

RDSWeb

App

EC2

Import /

Export

SSH

RDS Options Considered

What We’ve Achieved with RDS

Over 32 million

tests completed

since release

143

deployments

since go-live

a year ago.

Over 5 billion

database

records

Working with Amazon Web Services

DVSA worked with AWS throughout the build, migration

and early live running:

• Key architectural decisions

• Best use of the platform

• Support on hand when issues were encountered in immediate

fixing and problem resolution

• Well architected review

What’s Next

• Operator Licencing now running on AWS in Beta with full

production rollout this year

• Moving existing applications to the AWS cloud

• Discoveries for developing new cloud native applications

Thank you!

Benefits of AWS managed database services

Pay only for what

you use

No upfront cost

Fully managed

services

AWS handles

installs, patching,

restarts

Easy to scale

Grow as you need

Designed for use

with other AWS

services

AWS

Data PipelineAmazon

EC2

Amazon

S3

Amazon

CloudWatchAmazon

SNS

Amazon

VPC

Please remember to rate this

session under My Agenda on

awssummit.london