fault tolerant applications on aws
DESCRIPTION
TRANSCRIPT
![Page 1: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/1.jpg)
Building Fault-Tolerant
Applications in the Cloud
Ryan Holland
Ecosystem Solution Architect
![Page 2: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/2.jpg)
Faults? Facilities
Hardware
Networking
Code
People
![Page 3: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/3.jpg)
What is “Fault-Tolerant”?
Degrees of risk mitigation - not binary
Automated
Tested!
![Page 4: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/4.jpg)
Agenda
The AWS Approach
Building Blocks
Design Patterns
![Page 5: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/5.jpg)
Old School Fault-Tolerance: Build Two
![Page 6: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/6.jpg)
No Up-Front
Capital Expense
Pay Only for
What You Use
Self-Service
Infrastructure Easily Scale
Up and Down
Improve Agility &
Time-to-Market
Low Cost
Cloud Computing Benefits
Deploy
![Page 7: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/7.jpg)
No Up-Front HA
Capital Expense
Pay for DR Only
When You Use it
Self-Service
DR Infrastructure Easily Deliver Fault-
Tolerant Applications
Improve Agility &
Time-to-Recovery
Low Cost
Backups
Cloud Computing Fault-Tolerance Benefits
Deploy
![Page 8: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/8.jpg)
AWS Cloud allows Overcast Redundancy
Have the shadow
duplicate of your
infrastructure ready to go
when you need it…
…but only pay for what
you actually use
![Page 9: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/9.jpg)
Old Barriers to HA
are now Surmountable
Cost
Complexity
Expertise
![Page 10: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/10.jpg)
AWS Building Blocks: Two Strategies
Inherently fault-
tolerant services Services that are fault-tolerant
with the right architecture
S3
SimpleDb
DynamoDB
Cloudfront
SWF, SQS, SNS, SES
Route53
Elastic Load Balancer
Elastic Beanstalk
ElastiCache
Elastic MapReduce
IAM
Amazon EC2
VPC
EBS
RDS
![Page 11: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/11.jpg)
The Stack:
Resources
Deployment
Management
Configuration
Networking
Facilities
Geographies
![Page 12: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/12.jpg)
The Stack:
EC2 Instances
Amazon Machine Images
CW Alarms - AutoScaling
Cloudformation - Beanstalk
Route53 – ElasticIP – ELB
Availability Zones
Regions
![Page 13: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/13.jpg)
Regional Diversity
Use Regions for:
Latency
• Customers
• Data Vendors
• Staff
Compliance
Disaster Recovery
… and Fault Tolerance!
![Page 14: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/14.jpg)
Proper Use of Multiple Availability Zones
![Page 15: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/15.jpg)
107.22.18.45 isn’t fault-tolerant but 50.17.200.146 is: EIP
Elastic Load Balancing
Automated DNS: Route53
Latency-Based Routing
Network Fault-Tolerance Tools
![Page 16: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/16.jpg)
New EC2 VPC feature:
Elastic Network Interface
Up to 8 Interfaces
with 30 Addresses
each
Span Subnets
Attach/Detach
Public or Private
![Page 17: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/17.jpg)
Cloudformation – Elastic Beanstalk
Q: Is your stack unique?
![Page 18: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/18.jpg)
Cloudwatch – Alarms – AutoScaling
![Page 19: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/19.jpg)
AMI’s
Maintenance is critical
Alternatives: Chef, Puppet, cfn-init, etc.
When in doubt: 64-bit
Replicate for DR
![Page 20: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/20.jpg)
EC2 Instances
Consistent, reliable building block
100% API controlled
Reserved Instances
EBS
Immense Fleet Scale
![Page 21: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/21.jpg)
Example:
a “fork-lifted” app
![Page 22: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/22.jpg)
Example:
Fault-Tolerant
![Page 23: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/23.jpg)
Why mess with all of that?
![Page 24: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/24.jpg)
Design For Failure
SPOF
![Page 25: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/25.jpg)
Build Loosely Coupled Systems
Tight
Coupling
Loose Coupling
using Queues
Copyright ©
2011 Amazon
Web Services
![Page 26: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/26.jpg)
Fault-Tolerant Front-end Systems
Addressing: Route53, EIP
Distribution: Multi-AZ, ELB, Cloudfront
Redundancy: Auto-Scaling
Monitoring: Cloudwatch
Platform: Elastic Beanstalk
Amazon CloudFront
Amazon CloudWatch
Auto Scaling
Amazon Route
53
Elastic Load
Balancer
AWS Elastic
Beanstalk
Elastic IP
![Page 27: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/27.jpg)
Fault-Tolerant Data-Tier Systems
Tuned
Patched
Cached
Sharded
Replicated
Backed Up
Archived
Monitored
![Page 28: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/28.jpg)
Fault-Tolerant Data-Tier Systems
Tuned
Patched
Cached
Sharded
Replicated
Backed Up
Archived
Monitored
LOTS
OF
WORK
![Page 29: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/29.jpg)
AWS Fault-Tolerant Data-Tier Services
S3
SimpleDB
EMR
DynamoDB
RDS
Amazon Elastic
MapReduce
Amazon Simple
Storage Service
(S3)
Amazon Relational
Database Service
(RDS)
Amazon SimpleDB
Amazon DynamoDB
Amazon
ElastiCache
![Page 30: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/30.jpg)
RDS Fault-Tolerant Features
Multi-AZ Deployments
Read Replicas
Automated Backups
Snapshots
RDS DB Instance RDS DB Instance
Multi-AZ Standby
![Page 31: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/31.jpg)
Storage Gateway Your Datacenter
Amazon Elastic Block Storage
(EBS)
Amazon Elastic Compute Cloud
(EC2)
Amazon Simple Storage Service (S3)
Clients
On-premises Host
AWS Storage Gateway
VM
Direct Attached or Storage Area Network Disks
SSL
Internet or
Direct Connect
AWS Storage
Gateway Service
Application Servers
![Page 32: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/32.jpg)
Test! Use a Chaos Monkey!
http://techblog.netflix.com/2010/12/5-lessons-weve-learned-using-aws.html
Prudent
Conservative
Professional
Open source
…and all the cool kids are doing it
![Page 33: Fault Tolerant Applications on AWS](https://reader031.vdocuments.site/reader031/viewer/2022020122/54b4c2874a7959217c8b46bb/html5/thumbnails/33.jpg)
Thank You!