aws summit singapore - opening keynote by dr. werner vogels

DR. WERNER VOGELS

CHIEF TECHNOLOGY OFFICER

AMAZON.COM

WELCOME

@WERNERWELCOME

FROM 2010

70%YOY GROWTH

1,000,000+ACTIVE CUSTOMERS PER MONTH

AWS IN 2016:

70%YOY GROWTH


AWS IN 2016:

10XCOMPUTE CAPACITY IN USE

OF 14 OTHERS, COMBINED

70%YOY GROWTH


AWS IN 2016:

10XCOMPUTE CAPACITY IN USE

OF 14 OTHERS, COMBINED

$10B+RUN RATE

THE TECHNOLOGY

PLATFORM OF CHOICE

LARGEST NUMBER OF START-UP CUSTOMERS

LARGEST NUMBER OF ENTERPRISE CUSTOMERS

LARGEST NUMBER OF PUBLIC SECTOR CUSTOMERS

BROADEST ECOSYSTEM OF SYSTEM INTEGRATORS

BROADEST ECOSYSTEM OF ISVS

INNOVATION ACROSS VIRTUALLY EVERY INDUSTRY

98% REDUCTION IN TIME

FOR CLINICAL TRIALS

MILLIONS OF CONCURRENT

PLAYERS AT LAUNCH

PETABYTES OF REALTIME

DATA PER SEASON

REPLAY BILLIONS OF

TRADES INSTANTLY

PATTERNS FOR INNOVATION

1: REMOVE CONSTRAINTS

UNBOUND CREATIVITY THROUGH TECHNOLOGY

Data Center Servers Networking Databases Storage

EVERYTHING IS PROGRAMMABLE

You are no longer constrained to a location

ASIA’S ONLINE FASHION DESTINATION

Karthik S, CTO

From the DC to AWS

ZALORA Group

22

ZALORA AT A GLANCE

11MMOBILE APP

DOWNLOADS

4MCUSTOMERS 7M

VISITSWEEKLY

1.5MORDERS SHIPPED

IN Q4 2015

6.5MFACEBOOK

FANS

5MSUBSCRIBER

S

Zalora in numbers

Q4 2015Record one-day sales achieved during 12-12 Online Fever (six times previous record)Clocked 250% increase in mobile customers

2012ZALORA Group formed

Q2 2013Launched 7-11 pick-upsLaunched iOS AppLaunched in-house delivery fleet

Received our one millionth order

Q1 2013Launched first fully optimized mobile site

Received highest funding ever for a start up

Q3 2013Signed River IslandLaunched ZALORA e-MagazineLaunched Android App

Q2 2014Launched Marketplace

Q3 2014Launched ZALORA label

Q4 2014Launched same-day deliveryOpened first click-and-mortar store

Q1 2015Celebrated 3rd anniversary

Q2 2015Launched ZALORA Taiwan

Key milestones in the Zalora journey

∙ Platform fully hosted in a physical DC in Hong Kong

∙ Average capacity utilisation of 10%

∙ Living dangerously during peaks

∙ Lead-time for adding peak capacity - 10 days!!

∙ Marketing estimates of traffic spikes usually not accurate

23

FROM LAUNCH THROUGH HYPER GROWTH

24

TYPICAL 48 HOURS

Bursty Traffic - Random Period

∙ Early experiments and doubts (2014 onwards)

∙ Gradual traffic and infrastructure ramp-up

∙ Straddling the cloud/DC - LIVE traffic split

∙ Live migration in 30 days for all sites

∙ Average utilisation at 40%, costs down 40% vs DC

∙ Page speeds up 1-2s for ID/PH (slow countries) vs DC

25

TO INFINITY AND BEYOND

WHAT WE DID TO OUR DC

26

www.zalora.com

THANK YOU

UNBOUND CREATIVITY THROUGH TECHNOLOGY

INFRASTRUCTURE

SERVICES

PLATFORM

SERVICES

ENTERPRISE

SERVICES

SECURITY &

COMPLIANCEMARKETPLACE

PHYSICAL

INFRASTRUCTURE

COMPUTE

STORAGE

DATABASES

NETWORKING

MONITORING

ANALYTICS

APP SERVICES

MOBILE SERVICES

DEV & OPS

IOT

MIGRATION

HYBRID

VIRTUAL

DESKTOPS

CORPORATE EMAIL

COLLABORATION

IDENTITY

ACCESS CONTROL

KEY MANAGEMENT

CONFIG

COMPLIANCE

AUDITING

BUSINESS APPS

BUSINESS

INTELLIGENCE

SECURITY

DEVOPS TOOLS

NETWORKING

REGIONS

AVAILABILITY

ZONES

EDGE POPS

GLOBAL NETWORK

GOVCLOUD

INFRASTRUCTURE SERVICES

COMPUTE

STORAGE

DATABASES

NETWORKING

MONITORING

PLATFORM

SERVICES

ANALYTICS

APP SERVICES

MOBILE SERVICES

DEV & OPS

IOT

ENTERPRISE

SERVICES

MIGRATION

HYBRID

VIRTUAL

DESKTOPS

CORPORATE

EMAIL

COLLABORATION

SECURITY &

COMPLIANCE

IDENTITY

ACCESS CONTROL

KEY MANAGEMENT

CONFIG

COMPLIANCE

AUDITING

MARKETPLACE

BUSINESS APPS

BUSINESS

INTELLIGENCE

SECURITY

DEVOPS TOOLS

NETWORKING

PHYSICAL

INFRASTRUCTURE

REGIONS

AVAILABILITY

ZONES

EDGE POPS

GLOBAL NETWORK

GOVCLOUD

• GENERAL PURPOSE (M4)

• COMPUTE OPTIMIZED (C4)

• MEMORY OPTIMIZED (R3, X1)

• GPU OPTIMIZED (G2)

• STORAGE OPTIMIZED (D2)

• IO OPTIMIZED (I2)

• LOW COST, BURST-ABLE (T2)

• DEDICATED INSTANCES


COMPUTE

STORAGE

DATABASES

NETWORKING

MONITORING

PLATFORM

SERVICES

ANALYTICS

APP SERVICES

MOBILE SERVICES

DEV & OPS

IOT

ENTERPRISE

SERVICES

MIGRATION

HYBRID

VIRTUAL

DESKTOPS

CORPORATE

EMAIL

COLLABORATION

SECURITY &

COMPLIANCE

IDENTITY

ACCESS CONTROL

KEY MANAGEMENT

CONFIG

COMPLIANCE

AUDITING

MARKETPLACE

BUSINESS APPS

BUSINESS

INTELLIGENCE

SECURITY

DEVOPS TOOLS

NETWORKING

PHYSICAL

INFRASTRUCTURE

REGIONS

AVAILABILITY

ZONES

EDGE POPS

GLOBAL NETWORK

GOVCLOUD

• MULTI-AZ REPLICATION

• READ REPLICAS

• LIKE FOR LIKE MIGRATION

• CROSS-ENGINE MIGRATION

AMAZON AURORA

INFRASTRUCTURE

SERVICES

PLATFORM

SERVICES

ENTERPRISE

SERVICES

SECURITY &


PHYSICAL

INFRASTRUCTURE

COMPUTE

STORAGE

DATABASES

NETWORKING

MONITORING

ANALYTICS

APP SERVICES

MOBILE SERVICES

DEV & OPS

IOT

MIGRATION

HYBRID

VIRTUAL

DESKTOPS

CORPORATE EMAIL

COLLABORATION

IDENTITY

ACCESS CONTROL

KEY MANAGEMENT

CONFIG

COMPLIANCE

AUDITING

BUSINESS APPS

BUSINESS

INTELLIGENCE

SECURITY

DEVOPS TOOLS

NETWORKING

REGIONS

AVAILABILITY

ZONES

EDGE POPS

GLOBAL NETWORK

GOVCLOUD

PLATFORM

SERVICES

ANALYTICS

APP SERVICES

MOBILE SERVICES

DEV & OPS

IOT

ENTERPRISE

SERVICES

MIGRATION

HYBRID

VIRTUAL

DESKTOPS

CORPORATE

EMAIL

COLLABORATION

INFRASTRUCTURE

SERVICES

COMPUTE

STORAGE

DATABASES

NETWORKING

MONITORING

MARKETPLACE

BUSINESS APPS

BUSINESS

INTELLIGENCE

SECURITY

DEVOPS TOOLS

NETWORKING

PHYSICAL

INFRASTRUCTURE

REGIONS

AVAILABILITY

ZONES

EDGE POPS

GLOBAL NETWORK

GOVCLOUD

SECURITY & COMPLIANCE

IDENTITY

ACCESS CONTROL

KEY MANAGEMENT

CONFIG

COMPLIANCE

AUDITING

• IDENTITY POLICIES

• LOCATION POLICIES

• TIME-BASED POLICIES

• INDIVIDUAL API CALLS

• KEY ROTATION

• TEMPORARY CREDENTIALS

• POLICY SIMULATOR

INFRASTRUCTURE

SERVICES

PLATFORM

SERVICES

ENTERPRISE

SERVICES

SECURITY &


PHYSICAL

INFRASTRUCTURE

COMPUTE

STORAGE

DATABASES

NETWORKING

MONITORING

ANALYTICS

APP SERVICES

MOBILE SERVICES

DEV & OPS

IOT

MIGRATION

HYBRID

VIRTUAL

DESKTOPS

CORPORATE EMAIL

COLLABORATION

IDENTITY

ACCESS CONTROL

KEY MANAGEMENT

CONFIG

COMPLIANCE

AUDITING

BUSINESS APPS

BUSINESS

INTELLIGENCE

SECURITY

DEVOPS TOOLS

NETWORKING

REGIONS

AVAILABILITY

ZONES

EDGE POPS

GLOBAL NETWORK

GOVCLOUD


COMPUTE

STORAGE

DATABASES

NETWORKING

MONITORING

PLATFORM

SERVICES

ANALYTICS

APP SERVICES

MOBILE SERVICES

DEV & OPS

IOT

ENTERPRISE

SERVICES

MIGRATION

HYBRID

VIRTUAL

DESKTOPS

CORPORATE

EMAIL

COLLABORATION

SECURITY &

COMPLIANCE

IDENTITY

ACCESS CONTROL

KEY MANAGEMENT

CONFIG

COMPLIANCE

AUDITING

MARKETPLACE

BUSINESS APPS

BUSINESS

INTELLIGENCE

SECURITY

DEVOPS TOOLS

NETWORKING

PHYSICAL

INFRASTRUCTURE

REGIONS

AVAILABILITY

ZONES

EDGE POPS

GLOBAL NETWORK

GOVCLOUD

• OBJECT, ARCHIVE

• FILESYSTEM & BLOCK STORE

• GENERAL PURPOSE (SSD)

• PROVISIONED IOPS (SSD)

• MAGNETIC

SOLID STATE

INNOVATION IN BLOCK STORAGE

LATENCY-SENSITIVE, TRANSACTIONAL WORKLOADS

CONSISTENT HIGH IOPS

"BURST" MODEL

CAN WE INNOVATE WITH MAGNETIC MEDIA?

TWO NEW EBS VOLUME TYPES BUILT FOR THROUGHPUT

THROUGHPUT

OPTIMIZED HDD

(ST1)

UP TO 500MB/S

$0.045 PER GB/MONTH

COLD HDD

(SC1)

UP TO 250MB/S

$0.025 PER GB/MONTH

THE INDUSTRY’S BEST PRICE/PERFORMANCE

BLOCK STORAGE FOR BIG DATA WORKLOADS

PROCESSING

LOGS

STREAMING

DATA PROCESSING

DATA ANALYTICS

WITH MAP/REDUCE

DATA

WAREHOUSING

LESS FREQUENTLY

ACCESSED

MOBILE ENGAGEMENT

PLATFORM

SOCIAL COMMERCE

SOLUTIONS

PLATFORM FOR

OPERATIONAL INTELLIGENCE

SOCIAL GAMING

CLOUD-DELIVERED,

NEXT-GENERATION SECURITY

SERVICES

OPEN SOURCE, SCALABLE

PLATFORM FOR APACHE

KAFKA

MOVE FAST WITHOUT SACRIFICING CONTROL

ORMOVEFAST

STAYSECURE

BROADEST SET OF ACCREDITATIONS & CERTIFICATIONS

GLACIER VAULT LOCK

& SEC RULE 17A-4(F)

27018

BROADEST SERVICES TO SECURE APPLICATIONS

NETWORKING

VIRTUAL

PRIVATE

CLOUD

WEB

APPLICATION

FIREWALL


NETWORKING

VIRTUAL

PRIVATE

CLOUD

WEB

APPLICATION

FIREWALL

IDENTITY

IAM ACTIVE

DIRECTORY

INTEGRATION

SAML

FEDERATION


NETWORKING

VIRTUAL

PRIVATE

CLOUD

WEB

APPLICATION

FIREWALL

ENCRYPTION

KEY

MANAGE-

MENT

SERVICE

CLOUDHSM SERVER-

SIDE

ENCRYPTION

ENCRYPTION

SDK

IDENTITY

IAM ACTIVE

DIRECTORY

INTEGRATION

SAML

FEDERATION


COMPLIANCE

CONFIGCLOUD

TRAIL

SERVICE

CATALOG

CONFIG

RULESINSPECTOR

NETWORKING

VIRTUAL

PRIVATE

CLOUD

WEB

APPLICATION

FIREWALL

ENCRYPTION

KEY

MANAGE-

MENT

SERVICE

CLOUDHSM SERVER-

SIDE

ENCRYPTION

ENCRYPTION

SDK

IDENTITY

IAM ACTIVE

DIRECTORY

INTEGRATION

SAML

FEDERATION


AMAZON INSPECTOR: NOW GENERALLY AVAILABLE

COMPLIANCE

CONFIGCLOUD

TRAIL

SERVICE

CATALOG

CONFIG

RULESINSPECTOR

NETWORKING

VIRTUAL

PRIVATE

CLOUD

WEB

APPLICATION

FIREWALL

ENCRYPTION

CLOUDHSM SERVER-

SIDE

ENCRYPTION

ENCRYPTION

SDK

IDENTITY

IAM ACTIVE

DIRECTORY

INTEGRATION

SAML

FEDERATIONKEY

MANAGE-

MENT

SERVICE

WHAT’S BEING

ASSESSED?

NETWORK, VMS, OS

& APPLICATION

CONFIGURATIONS

DETECT & REMEDIATE SECURITY ISSUES EARLY & OFTEN

WITH AMAZON INSPECTOR

WHAT’S BEING

ASSESSED?

NETWORK, VMS, OS

& APPLICATION

CONFIGURATIONS

BUILT-IN

CONTENT LIBRARY

CHECK COMMON

SECURITY

STANDARDS &

VULNERABILITIES



WHAT’S BEING

ASSESSED?

NETWORK, VMS, OS

& APPLICATION

CONFIGURATIONS

BUILT-IN

CONTENT LIBRARY

CHECK COMMON

SECURITY

STANDARDS &

VULNERABILITIES

DETAILED

LISTS

DETAILED

DASHBOARD



WHAT’S BEING

ASSESSED?

NETWORK, VMS, OS

& APPLICATION

CONFIGURATIONS

BUILT-IN

CONTENT LIBRARY

CHECK COMMON

SECURITY

STANDARDS &

VULNERABILITIES

DETAILED

LISTS

DETAILED

DASHBOARD

FULL AUDIT

TRAILS

TRACK WHAT TESTS

WERE PERFORMED

WHEN AND THEIR

RESULTS



EARLY CUSTOMER AND PARTNER SUCCESS WITH AMAZON INSPECTOR

ORMOVEFAST

STAYSECURE

ANDMOVEFAST

STAYSECURE

AUTOMATE EVERYTHING

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Pallanikumaran Selvan, Chief Infrastructure Consultant

Data.gov.sg

Enabling Open DataRapid development with AWS

Government

Digital

Services

SINGAPORE’S OPEN DATA PLATFORM

MISSION

Help people understand and use public data

DASHBOARDS

DATA NARRATIVES

TIDY DATA

DEVELOPER APIs

Understanding

Public Data

Amazon

EC2 Instance

Starting Point

RDS

(Postgresql)

Splitting Up The Instance

CHALLENGE

How do you replicate this set-up?

Photo credit: Spencer Cooper / Flickr

Amazon

EC2

Amazon

RDS

DATA.GOV.SG

Amazon

Route 53

Amazon

EC2

Amazon

RDS

MASTER

Amazon

Route 53

Using VPCs and Route 53

Amazon

EC2

Amazon

RDS

DEV

Amazon

Route 53Gitlab

CI

Data.gov.sg

Team

Slack

Notification

API Gateway Lambda DynamoDB

Core Services

ECS

Agency APILambda

Agency API

Scrappers

➔ Historical data for all APIs

➔ Massive streams of data

➔ Managed NoSQL Database

Historical Data

DynamoDB

LESSON

Positive Constraints

AWS Lambda

➔ Stateless

➔ Loosely-Coupled

➔ Cohesive

Amazon

DynamoDB

Amazon

DynamoDB

ap-southeast-1

AWS

Lambda

ap-northeast-1

Lambda in Tokyo

Serverless Architecture

Amazon

DynamoDB

Agency

Server

AWS

Lambda

Amazon

API GatewayDevelopers

POST

GET

Moving Public Facing APIs

Amazon

DynamoDB

Agency

Server

AWS

Lambda

Amazon

API GatewayDevelopers

POST

GET

Self-managed API Servers

Amazon

DynamoDB

Agency

Server

AWS

Lambda

Amazon

API Gateway

Developers

POST

Amazon

EC2Elastic Load

Balancer

With 100 lines of code...

RESPONSE

TIMES

(ms)

10 xFASTER

THEN NOW

1400

1200

1000

800

600

400

200

0

Freedom

Disciplined

Development

Positive

Constraints

Amazon

EC2

Amazon

Glacier

Amazon

S3

Amazon

RDS

DATA.GOV.SG MASTER DEV

BACKUPS

Gitlab

CI

Data.gov.sg

Team

Amazon

DynamoDB

Amazon

S3

AWS

Lambda

Amazon

CloudWatch

Amazon API

Gateway

Amazon

SESAWS

Lambda

ECS

AWS

Lambda

Developers

Slack

Amazon

Route 53Amazon

Route 53

Amazon

Route 53

Our Architecture

Amazon

EC2

Amazon

RDS

Amazon

EC2

Amazon

RDS

Apigee

Amazon ECS Amazon EFS

Amazon EC2 NFS

Next Steps

FUTURE

NOW

Thank You

END TO END CONTINUOUS DELIVERY WITH ELASTIC BEANSTALK

SPIN UP

ENVIRONMENT

QA

ENVIRONMENTDEPLOY

APP

BUILD

APP

TEST

APP

QA

APP

APP

JAVA, .NET, PHP,

NODE.JS, PYTHON,

RUBY, GO

CONTAINER

DOCKER,

MULTI-

CONTAINER

COMPONENTS OF APPS & ELASTIC BEANSTALK

APP

JAVA, .NET, PHP,

NODE.JS, PYTHON,

RUBY, GO

CONTAINER

DOCKER,

MULTI-

CONTAINER

AMI,

APP SERVER,

WEB SERVER

PLATFORM


APP

JAVA, .NET, PHP,

NODE.JS, PYTHON,

RUBY, GO

INSTANCES AUTO-

SCALING

CONTAINER

DOCKER,

MULTI-

CONTAINER

LOAD

BALANCINGAMI,

APP SERVER,

WEB SERVER

HEALTH

CHECKS

PLATFORM


PLATFORM UPDATES: A SHARED RESPONSIBILITY

JAVA, .NET, PHP,

NODE.JS, PYTHON,

RUBY, GO

INSTANCES AUTO-

SCALING

CONTAINER

DOCKER,

MULTI-

CONTAINER

LOAD

BALANCINGAMI,

APP SERVER,

WEB SERVER

HEALTH

CHECKS

PLATFORMAPP

CAN WE REMOVE MORE OF THE

MAINTENANCE BURDEN FOR WEB APPS?

PLATFORM UPDATES FOR ELASTIC BEANSTALK

SAFELY AND AUTOMATICALLY KEEP YOUR WEB APP PLATFORM UP TO DATE

KEEP YOUR APPLICATION PLATFORM UP-TO-DATE, AUTOMATICALLY

STAY IN CONTROL OF PLATFORM UPDATES

SAFELY PERFORM UPDATES WHILE MAINTAINING AVAILABILITY

MANAGED PLATFORM UPDATES FOR ELASTIC BEANSTALK

v2

REQUEST

AUTO-SCALING GROUP

LOAD

BALANCER

v2

REQUEST

AUTO-SCALING GROUP

LOAD

BALANCER

AUTO-SCALING GROUP

“BLUE”

“GREEN”

REQUEST

v2

AUTO-SCALING GROUP

LOAD

BALANCER

AUTO-SCALING GROUP

“BLUE”

“GREEN”

REQUEST LOAD

BALANCER AUTO-SCALING GROUP

SIMPLIFY, RELENTLESSLY

SIMPLICITY SCALABILITY LOW COST RELIABILITY LOW LATENCY

AMAZON S3: SIMPLE BY NAME, SIMPLE BY NATURE

AMAZON S3

BUILDING BLOCKS FOR

INTERNET-SCALE APPS

CAN WE APPLY THE SAME APPROACH TO

ALL APPLICATION COMPONENT

AMAZON S3

BUILDING BLOCKS FOR

INTERNET-SCALE APPS

STORAGE

AWS LAMBDA

FUNCTIONS


AWS LAMBDA: A SERVERLESS COMPUTE PLATFORM

AWS LAMBDA: INTERNET-SCALE COMPUTE PLATFORM

DEPLOY YOUR CODE IN SECONDS

SUB-SECOND METERING

NO SERVERS TO PROCURE, PROVISION OR MANAGE

MOBILE

CHAT APP

AD DATA ANALYTICS

AND ROUTINGMOBILE APP

ANALYTICS

IMAGE CONTENT

FILTERING

REAL-TIME VIDEO

AD BIDDING

NEWS CONTENT

PROCESSINGGENE SEQUENCE

SEARCH

CLOUD

TELEPHONY

DATA

PROCESSING

WEB

APPLICATIONSWEB APPLICATIONS

THREAT INTELLIGENCE

AND ANALYTICS

NEWS CONTENT

PROCESSINGGAME METRICS ANALYTICS

SERVERLESS WEB APPLICATIONS

HTML IN S3

JAVASCRIPT

COGNITO

API GATEWAY DYNAMODB

SEARCH

RECOMMEND

CREATE/UPDATE


NODE.JS

WEB APP

SERVER-SENT EVENT

STREAMING RESPONSE

QUER

Y

S

3

LAMBDA

CASCADE

FUNCTION N

LAMBDA

CASCADE

FUNCTION 0 LAMBDA

COUNTING

FUNCTION 0

USER

LAMBDA

COUNTING

FUNCTION 0

LAMBDA

COUNTING

FUNCTION 0

LAMBDA

COUNTING

FUNCTION 0

WEB UI CASCADE PROCESS


INTERNET OF THINGS

CLOUDWATCH

EVENTS

LIFECYCLE

HOOKS

CONFIG

RULES

SCHEDULED

JOBS

ECOSYSTEM

CONNECTIVE TISSUE OF AWS ENVIRONMENTS

AMAZON S3

BUILDING BLOCKS FOR

INTERNET-SCALE APPS

STORAGE

AWS LAMBDA

FUNCTIONS

AMAZON DYNAMODB

DATA STORE


AMAZON DYNAMODB: AN INTERNET SCALE DATA STORE

OVER 200 MILLION USERSOVER 4 BILLION ITEMS STORED

MILLIONS OF ADS

PER MONTH

130+ MILLION NEW

USERS IN 1 YEAR

150+ MILLION

MESSAGES PER

MONTH

STATCAST USES BURST SCALABILITY

FOR MANY GAMES ON A SINGLE DAY

OVER 5 BILLION ITEMS OVER 200 MILLION MESSAGES

PROCESSED DAILY

COGNITIVE TRAINING 5+ MILLION

REGISTERED USERS

WEARABLE AND

IOT SOLUTIONS

170,000 CONCURRENT

PLAYERS

APIS EMAIL MESSAGING

NOTIFICATION MONITORING ENCRYPTION

SERVICES NOT SERVERS: A BROAD SERVERLESS PLATFORM

AMAZON S3

STORAGE

AWS LAMBDA

FUNCTIONS

AMAZON DYNAMODB

DATA STORE

2: OBSERVE & ACT

DRIVEN BY DATA

CORE COMPONENTS FOR BIG DATA WORKLOADS

DATA STORE

OF RECORD

S3

HIGH PERFORMANCE

DATABASES

RDS

DYNAMODB

ANALYTICS

CLUSTERS

HADOOP ON EMR

SPARK ON EMR

PREDICTIVE

ANALYTICS

MACHINE LEARNINGELASTICSEARCH

SERVICE

ELASTICSEARCH DATA

WAREHOUSE

REDSHIFT

STREAMING

DATA

KINESIS STREAMS

MOVING DATA TO THE CLOUD

PERSISTENT

CONNECTIVITY

SMALL &

FREQUENT

HUGE,

LESS FREQUENT

MEDIUM &

OFTEN

PERSISTENT

CONNECTIVITY


KINESIS STREAMS

BUILD CUSTOM APPLICATIONS TO

COLLECT & ANALYZE STREAMING DATA

REAL TIME STREAMING DATA WITH AMAZON KINESIS

KINESIS STREAMS



KINESIS FIREHOSE

EASILY LOAD STREAMING

DATA INTO AWS


KINESIS STREAMS



KINESIS FIREHOSE


DATA INTO AWS

ELASTICSEARCH INTEGRATION


KINESIS ANALYTICS

RUN STANDARD SQL QUERIES

OVER STREAMING DATA

KINESIS STREAMS




KINESIS FIREHOSE


DATA INTO AWS

ELASTICSEARCH INTEGRATION


Goragot Wongpaisarnsin

Assistant General Manager

TSQUARE : Connected Mobility Solution in Thailand

Toyota Tsusho Electronics (Thailand), Co., Ltd.

COMPANY INTRODUCTION

Connected

Content

Biz

Embedded

SW Biz

Device

Biz

TSQUARE : Connected Mobility Solution

Connected Content

Embedded SW

Device

Traffic Info GPS Data Heat Map Anomaly Flood

CHALLENGE ON AWS

mobile client

(over 1M downloaded)

Elastic Load

BalancingEC2

instances

Auto Scaling group

Amazon

S3

MySQL DB

instance

security group

Singapore Region

GPS Vehicle

Probes (over 60,000 Probes)

CHALLENGING ON AWS

• Reduce Time to Market

• Increase Business Chances

• Stabilize Quality of Service

• DevOpt Team Building

Business

Ideation

Production Development

Release

& Deployment

Prototyping

Incubation

Business

DeveloperOperation

BENEFITS ON AWS

• Max. 35% Cost Optimization

• Simple to reconfigure system

• x 2,500 Performance Up

• Powerful for prototyping idea

6000

3900

2014 2015

Cost (USD/month)

695

2,000,000

Previous System New System

IoT Gateway Performance (TPS)

NEXT STAGES WITH AWS

Accessibility

Performance

Sustainability

Convenience

Usability

AWS

Lambda

Amazon

Glacier

Amazon

Redshift

Memcached

AWS

CloudFormation

Amazon

Kinesis

Amazon Machine

Learning

AWS IoT

Amazon

Cognito

Amazon API

Gateway

Thank you

SMALL &

FREQUENT

HUGE,

LESS FREQUENT

MEDIUM &

OFTEN

PERSISTENT

CONNECTIVITY


SNOWBALL

PETABYTE SCALE

DATA TRANSPORT SERVICE

LARGE CUSTOMER

DATASET

END-TO-END

CUSTODY

CUSTOMER DATASET

LOADED

10 SNOWBALLS CONNECTED TO YOUR DMZ = THE THROUGHPUT OF A 100G NETWORK CONNECTION

SNOWBALL MOMENTUM BUILDS

30 TIMES 500+ BILLIONAROUND THE WORLD OBJECTS MOVED

SMALL &

FREQUENT

HUGE,

LESS FREQUENT

MEDIUM &

OFTEN

PERSISTENT

CONNECTIVITY


LONG DISTANCE

FROM AWS REGION

LARGE

SIZE OBJECTS

LARGE NUMBER

OF OBJECTS

MOVING DATA TO THE CLOUD: LIMITED BY THE SPEED OF LIGHT

CAN WE USE THE AWS GLOBAL NETWORK TO

SPEED UP DATA IN BOTH DIRECTIONS?

ACCELERATE TRANSFERS TO AMAZON S3 USING THE AWS EDGE NETWORK

AMAZON S3 TRANSFER ACCELERATION

300% FASTER FOR MOST USE CASES

EVEN FASTER IN OTHERS

NO COST UNLESS IT’S FASTER

AMAZON S3 TRANSFER ACCELERATION

VIDEO

COLLABORATION

VIDEO

ANALYSIS

CINEMATIC

VIRTUAL REALITY

AMAZON S3 TRANSFER ACCELERATION RESULTS

SMALL &

FREQUENT

HUGE,

LESS FREQUENT

MEDIUM &

OFTEN

PERSISTENT

CONNECTIVITY


CONNECT WITH CUSTOMERS WHEREVER THEY ARE

THE BEST MOBILE APPS RUN ON AWS

MOBILE DEVICE MOBILE BACKEND

THE DUALITY OF DEVICES

S 3DYNA MO DB

MO B I L E A NA L YT I CS


RDS

DATA AND

CONTENT

ANALYTICS


S 3DYNA MO DB


S NS

NOTIFICATIONS


RDS

DATA AND

CONTENT

ANALYTICS


S 3DYNA MO DB


S NS

A MA ZO N CO G NI T O

A P I G A T E W A Y

L A MB DA

L A MB DA

L A MB DA NOTIFICATIONS


RDS

DATA AND

CONTENT

ANALYTICS


S T O R E & S Y N CD A T A

S A F E G U A R DA W S C R E D E N T I A L S

G U E S TA C C E S S

S O C I A L I D E N T I T Y& L O G I N

AMAZON COGNITO: A HIDDEN GEM

Y O U R I D E N T I T YP O O L

S T O R E & S Y N CD A T A

S A F E G U A R DA W S C R E D E N T I A L S

G U E S TA C C E S S

S O C I A L I D E N T I T Y & L O G I N

AMAZON COGNITO: A HIDDEN GEM

EASY USER MANAGEMENT

LAMBDA DRIVEN WORKFLOWS

MULTI-FACTOR AUTHENTICATION

EMAIL AND PHONE NUMBER VERIFICATION

FULLY MANAGED IDENTITY POOLS WITH AMAZON COGNITO

CONNECT EVERY THING

SENSORS ACTUATORS

Extract value from

device data

Augment devices’

constrained onboard

resources

Augment devices’

constrained

environments

compute

storage

Big Data

Shadow

State

Apps

offline

WHY CONNECT DEVICES TO THE CLOUD?

Run code in the cloud,

and update it without

deploying firmware

updates

Run code in the cloud, and

take action in physical space

through one or more devices

Secure device data, even

when the device operates

in unsecured physical

space.

bidirectional

policy

WHY CONNECT DEVICES TO THE CLOUD?

Many SDKs &

Tools

Alternate Protocols Scalability Security &

Management

Integration with Cloud and

Mobile Applications

CONNECTING DEVICES TO CLOUD APPLICATIONS REQUIRES

UNDIFFERENTIATED HEAVY LIFTING.

AWS IOT

Securely connect one or one-billion devices to AWS, so they can

interact with applications and other devices

AWS IOT

DEVICE SDKSet of client libraries to

connect, authenticate and

exchange messages

DEVICE GATEWAYCommunicate with devices via

MQTT and HTTP

AUTHENTICATION

AUTHORIZATIONSecure with mutual

authentication and encryption

RULES ENGINETransform messages

based on rules and

route to AWS Services

AWS Services

- - - - -

3P Services

DEVICE SHADOWPersistent thing state

during intermittent

connections

APPLICATIONS

AWS IoT API

DEVICE REGISTRYIdentity and Management of

your things

3: EXPERIMENT, MEASURE, LEARN

Statcast Personal Finances

Healthcare

Digital

Web E-commerce

App Platform

Digital Content

Media Web SitesWeb CRM

Digital Media

Digital Services

Education Analytics

FROM EXPERIMENTS TO DIGITAL TRANSFORMATION


Standard Chartered

Anju Patwardhan

Global Chief Innovation Officer

THE JOURNEY TO AWS IS A WELL TRODDEN PATH

DEVELOPMENT

& TEST

ALL TOGETHER NEW

APPLICATIONS

DIGITAL

ANALYTICS

MOBILEDC MIGRATION

MISSION

CRITICAL APPS

ALL IN

1 2 3 4

THE DESTINATION FOR MANY ENTERPRISES: ALL IN

HYBRID AS A STEPPING STONE

Integrated networking

Hybrid app deployments


Hybrid app deployment

Integrated DevOps Management


Realtime data integration

integrated resource management




Data integration

Hybrid app deployment Integrated networkingIntegrated networking

Integrated security

data integration

Integrated Networking

Automated and integrated back-ups

ON-PREMISES

AWS

BROAD SERVICES FOR HYBRID APPLICATIONS

Single-Tenant

Compute

Bring Your Own

Image/License

Simultaneous, Self-Service

Provisioning of Many VMs

Integration with Existing

Management Tools

Massive Scale

Import / Export

Isolated Network

Across Regions

Fully Isolated

Network Posture

DNS-Based Global

Load Balancing

Network Forensic

Tools

Web Application

Firewall

Isolated Network

within Region

Private Connections from

Your DC to AWS

Network

Performance Tiers

Global Content

Delivery Network

Security Info & Event

Management (SIEM) Integration

Provider-Enabled

Encryption Services

Centralized Key

Management

Automated Security

Assessment

Rich, Role-Based

Access Controls

Hardware Security

Module (HSM) Support

Active Directory (AD)

Integration / AD-aaS

Track Resource

Inventory and Changes

Bulk Object Delete and

Data Lifecycle Mgmt Policies

Customer Ownership

Of Data

Many Scalable

Database Engines

Data

Archival

Simple Import of

Massive Data Amounts

Customer Control

Over Data Locale

Elastic File

System

Database Migration

and Conversion Tools

Gateway – Cached

Volumes

Create and Standardize

on Best Practices

Automate Operations

Management

Release Software

Using Continuous Delivery

Monitor Resources

And Applications

Centralize and Simplify

Software Deployments

Build, Publish

and Manage APIs

Managed Source

Control

Integration with Existing

Management Tools

Data

Warehouse

Integrated

Compute

Integrated

NetworkingIntegrated

Security & Access

Data Integration &

Lifecycle MgmtResource and

Deployment Mgmt

A STRATEGIC,

PHASED MIGRATION

2014 2015 2016

E.G. INNOVATION LABS, MOBILE APP PILOTS, HACKATHONS

E.G. ONLINE BANKING, STREAM DATA PROCESSING

E.G. MOBILE BANKING APP

EXPERIMENTATION

DEVELOP & TEST

PRODUCTION

TRAINING & CERTIFICATION

FOUR KEY COMPONENTS OF MIGRATION


DATA MIGRATION



DATA MIGRATION

DATABASEMIGRATION


AWS DATABASE MIGRATION SERVICE

ON-PREMISES

DATABASES

MIGRATE BETWEEN DATABASE ENGINES

ENGINE A

SCHEMA CONVERSION TOOL

SCHEMA & DATA

TRANSFORMATION

DATABASE MIGRATION SERVICE

CONVERT DATABASE

FUNCTIONSTables

Partitons

Sequences

Views

Stored Procedures

Triggers

Functions

ENGINE B

AMAZON AURORA


DATA MIGRATION

DATABASEMIGRATION

APPLICATION MIGRATION


AWS APPLICATION DISCOVERY SERVICEAUTOMATE THE DISCOVERY OF DATA CENTER APPLICATIONS

& THEIR DEPENDENCIES

SIMPLIFY APPLICATION DISCOVERY WITH AWS ADS

AUTOMATICALLY DISCOVERY APP INVENTORY

IDENTFIES APP & INFRASTRUCTURE DEPENDENCIES

MEASURES PERFORMANCE BASELINE

DATA ENCRYPTED WITH AMAZON KMS

GET HELP WITH MIGRATION FROM ISV AND SI PARTNERS


DATA MIGRATION

DATABASEMIGRATION

APPLICATION MIGRATION


REINVENT REPEAT

THANK YOU

@WERNER

aws summit singapore - opening keynote by dr. werner vogels

Technology