amazon aurora

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Aurora& AWS Database Migration Service

Danilo Poccia, Technical Evengelist@danilop danilop

Meet Amazon Aurora ……Databases reimagined for the cloud

R Speed and availability of high-end commercial databases

R Simplicity and cost-effectiveness of open source databases

R Drop-in compatibility with MySQL

R Simple pay as you go pricing

Delivered as a managed service

Reimagining the relational database

What if you were inventing the database today?

You wouldn’t design it the way we did in 1970

You’d build something ü that can scale out …ü that is self-healing …ü that leverages existing AWS services …

Not much has changed in last 30 years

Even when you scale it out, you’re still replicating the same stack

SQL

Transactions

Caching

Logging

SQL

Transactions

Caching

Logging

Application

SQL

Transactions

Caching

Logging

SQL

Transactions

Caching

Logging

Application

SQL

Transactions

Caching

Logging

SQL

Transactions

Caching

Logging

Storage

Application

A service-oriented architecture applied to the database

Moved the logging and storage layer into a multi-tenant, scale-out database-optimized storage service

Integrated with other AWS services like Amazon EC2, Amazon VPC, Amazon DynamoDB, Amazon SWF, and Amazon Route 53 for control plane operations

Integrated with Amazon S3 for continuous backup with 99.999999999% durability

Control planeData plane

Amazon DynamoDB

Amazon SWF

Amazon Route 53

Logging + Storage

SQL

Transactions

Caching

Amazon S3

1

2

3

Fastest growing service

in AWS history

Aurora customer adoption

Aurora requires fewer I/Os

Binlog Data Double-write bufferLog records FRM files, metadata

T Y P E O F W RI T E S

EBS mirrorEBS mirror

AZ 1 AZ 2

Amazon S3

MYSQL WITH STANDBY

SEQUENTIALWRITE

SEQUENTIALWRITE

EBSAmazon Elastic

Block Store (EBS)

PrimaryInstance

StandbyInstance

AZ 1 AZ 3

PrimaryInstance

Amazon S3

AZ 2

ReplicaInstance

AMAZON AURORA

ASYNC4/6 QUORUM

DISTRIBUTED WRITES

Amazon Aurora is highly available

Highly available storage

• Six copies of data across three AZs

• Latency tolerant quorum system for read/write

• Up to 15 replicas with low replication lag

Survivable caches

• Cache remains warm in the event of a database restart

• Lets you resume fully loaded operations much faster

Instant crash recovery

• Underlying storage replays redo records on demand as part of a disk read

• Parallel, distributed, asynchronous

AZ 1 AZ 2 AZ 3

Amazon S3

SQLTransactions

CachingT0

Simplify storage management

• Automatic storage scaling up to 64 TB—no performance impact

• Continuous, incremental backups to Amazon S3

• Instantly create user snapshots—no performance impact

• Automatic restriping, mirror repair, hot spot management, encryption

Up to 64 TB of storage—auto-incremented in 10 GB units

up to 64 TB

Simplify data security

R Encryption to secure data at rest • AES-256; hardware accelerated• All blocks on disk and in Amazon S3 are encrypted• Key management by using AWS KMS

R SSL to secure data in transit

R Network isolation by using Amazon VPC by default

R No direct access to nodes

R Supports industry standard security and data protection certifications

Storage

SQL

Transactions

Caching

Amazon S3

Application

If you host your databases on-premises

Power, HVAC, netRack and stack

Server maintenance

OS patches

DB software patchesDatabase backups

ScalingHigh availability

DB software installs

OS installation

you

App optimization

If you host your databases in Amazon EC2


Server maintenance

OS patches


ScalingHigh availability


OS installation

you

App optimization

If you choose Amazon RDS


Server maintenance

OS patches


App optimization

High availability


OS installation

you

Scaling

Migration to Aurora is easy

Start your first migration in 10 minutes or less

Keep your apps running during the migration

Replicate within, to, or from Amazon EC2 or Amazon

RDS

Move data to the same or different database engine

Learn more at aws.amazon.com/dms

AWSDatabase Migration

Service

CustomerPremises

Application Users

AWS

Internet

VPN

Keep your apps running during the migration

Start a replication instance

Configure both database endpoints

Select tables, schemas, or databases

Let AWS Database Migration Service create tables, load data, and keep them in sync

Switch applications over to the target at your convenience

AWSDatabase Migration

Service

Load is table by table

Creates tables at target databaseSets up metadata required at targetPopulates data from sourceEach process loads one entire tableCan use multiple processesCan be paused

§ When restarted, will continue from where it was stopped§ Will reload any tables that were currently in progress

Replication instance

Source Target

Change data capture (CDC) and apply


Source Target

update

t1 t2

t1

t2

Transactions

No agent

Uses recovery log

Native change data capture API

Change apply after bulk load

Oracle supplemental loggingMySQL row-level bin logging

SQL Server bulk logged/full recoveryPostgres WAL


Source Target

Multiple targets

Target

Target


Source Target

Multiple sources

Source

Source

You don’t have to take everything

Source

L

Target

Replication instance instance

Homogenous or heterogeneous


SQL Server MySQL


Oracle Oracle


Oracle Aurora

MigratefromOracleandSQLServer

Moveyourtables,views,storedprocedures,anddatamanipulation language(DML)toMySQL,MariaDB,andAmazonAurora

Knowexactlywheremanualeditsareneeded

Download ataws.amazon.com/dms

AWSSchema Conversion

Tool

Know exactly where manual edits are needed

Thank you!@danilop danilop

amazon aurora

Technology