the pace of innovation at aws - amazon s3and...the pace of innovation at aws werner vogels! vp &...
TRANSCRIPT
The Pace of Innovation at AWS Werner Vogels!
VP & CTO, amazon.com!
@werner!
What sets AWS apart from other providers?!
Breadth and Depth of Services!
Infrastructure!
Foundation Services!
Regions Availability Zones Edge POPs
Storage Security & Access
Infrastructure!
Foundation Services!
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Infrastructure!
Foundation Services!
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Infrastructure!
Foundation Services!
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real time!
Data warehouse!
Infrastructure!
Foundation Services!
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real time!
Data warehouse!
App Services
Queuing!
Orchestration!
App streaming!
Transcoding!
Email!
Search!
Infrastructure!
Foundation Services!
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real time!
Data warehouse!
App Services
Queuing!
Orchestration!
App streaming!
Transcoding!
Email!
Search!
Deployment & Management
Containers!
Dev/ops!
Templates!
Infrastructure!
Foundation Services!
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real time!
Data warehouse!
App Services
Queuing!
Orchestration!
App streaming!
Transcoding!
Email!
Search!
Deployment & Management
Containers!
Dev/ops!
Templates!
Mobile & Devices
Identity!
Sync!
Analytics!
Notifications!
Amazon WorkSpaces!
Delivering on the promise of desktop virtualization !
Most successful preview, ever!
Infrastructure & admin tools!
End user desktop and mobile apps!
Fully managed, secure document storage and sharing service for the Enterprise!
Amazon WorkDocs!
Secure!
Easy sharing! Simple document!feedback!
Access from !any device!
Integrate your!corporate directory! Low cost!
Is secure email and calendaring made easy!Amazon WorkMail!
Managed email and calendaring solution!
Always available, anytime, anywhere.!
Integrates with Amazon WorkDocs!
Infrastructure!
Foundation Services!
Regions Availability Zones CDN Points of Presence
Storage (Object, Block and Archive) Networking Security &
Access Control
Platform Services!
Databases
Relational!
NoSQL!
Columnar!
Caching!
Analytics
Hadoop!
Real-time!
Data warehouse!
App Services
Queuing!
Orchestration!
App streaming!
Transcoding!
Email!
Search!
Deployment & Management
Containers!
Dev/ops Tools!
Resource Templates!
Mobile & Devices
Identity!
Sync!
Mobile Analytics!
Notifications!
Applications! Virtual Desktops Collaboration and Sharing
Data Workflows!
Usage Tracking!
Monitoring and Logs!
Compute (VMs, Auto-scaling and Load Balancing)
What sets AWS apart from other providers?!
Breadth and Depth of Services!
What sets AWS apart from other providers?!
Breadth and Depth of Services
Relentless Focus on Cost Reduction!
The AWS Price Reduction Philosophy!47 Price Reductions Since 2006!
Infrastructure innovation!
Ecosystem!Global Footprint!
New Features!New Services!
AWS Trusted Advisor!Four reports available to all!
What sets AWS apart from other providers?!
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation!
Small, autonomous teams!Roadmap ownership!
Decoupled launch schedules!
Small, “Two Pizza” Teams!
Get Core Functionality in the Hands of Customers, Quickly!Operational stability!High scale!
Limited initial feature set!
Iterate Based on Customer Feedback!
Amazon Redshift
Amazon Glacier
Amazon Workspaces
EPIC COLLABORATION
+
=
Rapid pace of Innovation!
2008 2009 2010 2011 2012 2013 2014
280!
159!
82!61!48!
24!
516!
What sets AWS apart from other providers?!
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation
Innovation at every level of the stack!
Every day, AWS adds enough new server capacity to support all of Amazon’s global infrastructure when it was
a $7B annual revenue enterprise!
Get Networks Out of the Way!Relative cost of networking increasing quickly!
• Server & storage prices falling fast!• Network costs trending to dominate!
Networking frozen in time!• Vertically integrated ecosystem!• Indefensible profit margins !
AWS solution:!• Custom net H/W & protocol stack!• Private long haul links!
57%
8%
18%
13%
4% Servers
Networking Equipment
Power Distribu>on & Cooling
Power
Other Infrastructure
Monthly Costs!
3yr server & 10 yr infrastructure amortization!
AWS Global Regions Locations
US-WEST (Oregon)
GOV CLOUD
US-WEST (N. California)US-EAST (Virginia)
EU (Dublin)
EU (Frankfurt)
SOUTH AMERICA (Sao Paulo)
CHINA (Beijing)
ASIA PAC (Sydney)
ASIA PAC (Singapore)
ASIA PAC (Tokyo)
Regions
PoP
Redundant paths to transit centers!Transit centers connect to:!• Private links to other AWS regions!• Private links to AWS Direct Connect customers!• Internet through peering & paid transit!
Redundant paths to transit centers!Transit centers connect to:!• Private links to other AWS regions!• Private links to AWS Direct Connect customers!• Internet through peering & paid transit!
82, 864 fiber strands in region!AZs <2ms apart & usually <1ms!25Tbps peak inter-AZs traffic!
Why Does AWS Offer AZs?!Asynchronous replication between distant data centers!• Committing to an SSD order 1 to 2ms!• But, LA to New York is 74ms round trip!• You can’t wait 74ms to commit a transaction!On failure, difficult & high skill decision:!• Fail-over & lose transactions, or!• Or don’t fail-over & lose availability!• Difficult choice!• Use AZs for no-admin failover!• Sync works when <2ms!• Can be combined with regional replication for
very high availability!!
74ms!
1 of 28 availability zones world-wide!
All regions have 2 or more AZs!
Each AZ is 1 or more DC!- No data center is in two AZs!
- Some AZs have as many as 6 DCs!
DCs in AZ less than ¼ ms apart!
Data centers & Availability zones!
Single DC typically over 50,000 servers & often over 80,000 !
• Larger DCs undesirable (blast radius)!
• Diminishing returns on scale!
Up to 102Tbps provisioned in to a single DC!!AWS custom network equipment:!
• Multi-ODM sourced!• Amazon custom network protocol
stack!
Remove the “virtualization tax”!!NIC supports Supports Single Root I/O Virtualization!Much lower latency & less latency jitter!
Loga
rithm
ic S
cale
tp0 tp50 tp99 tp99.9 tp00
>2x average latency
reduction
>10x latency variability
improvement
Previous generation
Current generation
OEM servers!• Very general designs able to run wide variety of workloads!• Vast, expensive, world-wide distribution network (30% of cost)!
AWS custom servers & storage!• Specialized servers optimized for a specific workload!• Move hot software kernels to hardware implementations!• Custom Intel processors beyond commercially available clock rates!• DCs, servers, networking, storage designed to integrated specs!
Example Storage Rack 864 disks, 2,350lb
Power Infrastructure!Some DCs with custom power sub-stations!
• Lower power cost & build more quickly!
• Negotiated power purchasing agreements!
Custom switchgear firmware!
3 100% carbon neutral regions:!• US West (Oregon)!• AWS GovCloud (US)!• EU (Frankfurt)!
