the cloud: risks, rewards and realities cloud computing how we got here, where we are, and where we...
TRANSCRIPT
The Cloud: Risks, Rewards and Realities
Cloud ComputingHow We Got Here, Where We Are,
and Where we Are Heading
Jeff Barr, Senior Evangelist
Amazon Web Services
The Cloud: Risks, Rewards and Realities
The Cloud is Suddenly Everywhere
The Cloud: Risks, Rewards and Realities
How Did This Happen?What is it?
Where did it come from?
Where are we now?
Where are we going?
The Cloud: Risks, Rewards and Realities
What is it?
The Cloud: Risks, Rewards and Realities
What is Cloud Computing?Cloud Computing is a utility service - giving you access to technology resources managed by experts and available on-demand.
You simply access these services over the internet, with no up-front costs and you pay only for the resources you use.
Just like your electric utility….
The Cloud: Risks, Rewards and Realities
Where did it come from?
The Cloud: Risks, Rewards and Realities
Where Did The Cloud Come From?
1960!
IBM 1401
The Cloud: Risks, Rewards and Realities
Communication 1960’s:
RS-232 Modem
1970’s: Internet TCP/IP ISDN
1980’s: DNS DSL Ethernet
The Cloud: Risks, Rewards and Realities
Commodity Computing 1960 - IBM 1401
1977 - TRS-80
1977 - Apple ][
1982 - IBM PC
1985 – Rack mounted PC
The Cloud: Risks, Rewards and Realities
Or, Put Another Way
Communications
Commodity Computing
Architecture
Software
Business Value
The Cloud: Risks, Rewards and Realities
ArchitectureSeparation of design and
implementation
Formal approach to design
Modularity
The Cloud: Risks, Rewards and Realities
Software Cooperative development
IBM Share DECtape sharing BSD Open source
High-level languages Portable code Easy Sharing
Virtualization IBM VM/360 Xen
The Cloud: Risks, Rewards and Realities
Business FocusValue of IT recognized
IT becomes a crucial success factor
Emergence of the CIO
The Cloud: Risks, Rewards and Realities
Where are we now?
The Cloud: Risks, Rewards and Realities
Where We AreCloud adoption is now at early majority point
The Cloud: Risks, Rewards and Realities
New Economic Model
No capital expenditure
Cost-effective and economical
Pay as you go and pay only for what you use
True elastic capacity; Scale up and down
Improved time to market
The Cloud: Risks, Rewards and Realities
Why Are People So Excited?
The Cloud: Risks, Rewards and Realities
Elastic and Pay-Per-Use Infrastructure
Unable to serve
customers
InfrastructureCost $
time
LargeCapital
Expenditure
OpportunityCost
PredictedDemand
TraditionalHardware
ActualDemand
AutomatedVirtualization
The Cloud: Risks, Rewards and Realities
• Web site / application / SaaS hosting
• Internal IT application hosting
• Content delivery and media distribution
• High performance computing, batch data processing, and large scale analytics
• Storage, backup, and disaster recovery
• Development and test environments
Common Cloud Use Cases
The Cloud: Risks, Rewards and Realities
Example: Wall Street App on Amazon EC2
3000 CPU’s for one firm’s risk management processes
Num
ber
of E
C2
Inst
ance
s
300 CPU’s on weekends
Thursday4/23/2009
Friday4/24/2009
Sunday4/26/2009
Monday4/27/2009
Tuesday4/28/2009
Saturday4/25/2009
Wednesday4/22/2009
3000 -
300 -
The Cloud: Risks, Rewards and Realities
Example: Video App on Amazon EC2N
um
be
r of
EC
2 In
sta
nce
s
4/12/2008
Launch of Facebook modification
Scaled to peak of 5,000 instances in 3 days
4/14/2008 4/15/2008 4/16/2008 4/18/2008 4/19/2008 4/20/20084/17/20084/13/2008
The Cloud: Risks, Rewards and Realities
Example: 30,000 Core Cluster in Minutes
Cycle Computing’s “Nekomata”Top 5 Pharma – Molecular Dynamics95,078 compute hours (10.9 years)EC2 Spot Instances – 57% savings3 AWS Regions (US East, US West, EU West)CapEx: NoneOpEx: $1279 / hour for AWS + CycleCloud
The Cloud: Risks, Rewards and Realities 23
The Cloud: Risks, Rewards and Realities
What is Amazon Web Services?Amazon Web Services is a cloud computing platform that provides flexible, scalable, and cost-effective technology infrastructure for businesses of all sizes around the world…
…utilizing the knowledge, expertise, and tools used to run Amazon.com’s global web properties since 1995.
The Cloud: Risks, Rewards and Realities
2009Jan
» Amazon RDS» High-Memory Instances» Lower EC2 Pricing
» AWS Multi-Factor Authentication» Virtual Private Cloud» Lower Reserved Instance Pricing
» AWS Security Center
» Reserved Instances in EU Region» Elastic MapReduce» SQS in EU Region
» New SimpleDB Features» FPS General Availability
» Lower pricing tiers for Amazon CloudFront» AWS Management Console
» Amazon EC2 with Windows» Amazon EC2 in EU Region» AWS Toolkit for Eclipse» Amazon EC2 Reserved Instances » AWS Import/Export
» New CloudFront Feature» Monitoring, Auto Scaling & Elastic Load Balancing
» Amazon Elastic MapReduce in Europe
» EBS Shared Snapshots» SimpleDB in EU Region» Monitoring, Auto Scaling & Elastic Load Balancing in EU
Feb Mar
Apr May
Jun AugJul Sep Oct Nov Dec Feb
» Amazon CloudFront Private Content» SAS70 Type II Audit» AWS SDK for .NET
» Amazon EC2 with Windows Server 2008, Spot Instances, Boot from Amazon EBS» Amazon CloudFront Streaming» Amazon VPC enters Unlimited Beta» AWS Region in Northern California» International Support for AWS Import/Export
» Amazon EC2 Reserved Instances with Windows, Extra Large High Memory Instances» Amazon S3 Versioning Feature» Consolidated Billing for AWS» Lower pricing for Outbound Data Transfer
2010Jan Mar
» Amazon SNS
The pace of innovation in 2009
The Cloud: Risks, Rewards and Realities
2010Jan
» Amazon RDS Read Replicas» Suse EC2 Linux» Amazon SNS Console» Amazon ELB HTTPS» AWS Free Tier» EMR Resizing Cluster
» RDS Reserved» CloudFront Default Root» Startup Challenge 2010» CloudFront Invalidation
» CloudFront HTTPS» NYC Edge Location» Lowers Pricing HTTP» AWS Import Export GA» Amazon SNS» Amazon S3 Console» Amazon EBS CloudWatch
» Amazon SNS» Combined AWS Data Transfer Savings» Amazon EMR Bootstrap Actions» Amazon ELB Session Stickiness» Amazon RDS in EU» New Singapore Region
» EMR JobFlow Debugging» Simple DB Consistent Reads» Simple DB Conditional Puts
» VPC in EU» Amazon RDS in US-west» Amazon CloudFront Access Logs» Amazon RDS Multi-AZ» Amazon S3 RRS» Amazon RDS Console
» Amazon SQS Longer retention, Free TierAmazon S3 Bucket Policies» Amazon VPC IP Address» Cluster Compute Instances» Amazon S3 RRS Notifications
» Lowered Pricing EC2» AWS IAM» Amazon VPC Console» Micro Instances» Amazon Linux AMI» Amazon EC2 Tagging, Filtering, Idempotency, » Oracle Certified AWS» AWS PHP SDK
Feb Mar
Apr May
Jun AugJul Sep Oct Nov Dec Feb
» Amazon S3 Lowered Pricing» CloudFront GA, SLA» S3 Multipart» GPGPU Instance Types» ISO27001/2 Certification
» AWS Elastic Beanstalk» Amazon Simple Email Service» Improved AWS Support “Bronze”» Amazon CloudWatch Console
» AWS CloudFormation» Amazon S3 Static Websites» AWS IAM Website Login» Paris Edge Location
2011Jan Mar
» VM Connector» Tokyo Region» AWS Support JP
And pace accelerates in 2010….
» Amazon EC2 Reserved Instances with Windows, Extra Large High Memory Instances» Amazon S3 Versioning Feature» Consolidated Billing for AWS» Lower pricing for Outbound Data Transfer
» AWS Java SDK» Windows BYOL» Singapore Pop» CloudFront Private Streaming
» Free Monitoring EC2» Amazon Route 53» PCI DSS Level 1 Certification» Mobile SDKs (Android, iPhone)» Large Object S3 Support» Florida POP» Import/Export APAC
» New VPC» Dedicated Instances» Windows2008 R2
The Cloud: Risks, Rewards and Realities
2011Jan Feb Ma
rApr Ma
yJun AugJul Sep Oct Nov Dec Feb
2012Jan Mar
“Every day is a launch day”
» AWS Elastic Beanstalk» Amazon Simple Email Service» Improved AWS Support “Bronze”» Amazon CloudWatch Console
» AWS CloudFormation» Amazon S3 Static Websites» AWS IAM Website Login» Paris Edge Location» Amazon Route53» New VPC» Dedicated Instances in VPC» Windows 2008 R2» New AZ in JP
» VM Connector» Tokyo Region» AWS Support JP» AWS IAM for CloudFront» VPC Virtual Networking» VPC Internet Access
» Spot Integration with HPC instances» Amazon EMR in APAC» AWS Mobile SDKs» Live Streaming with CloudFront» AWS IAM GA» AWS IAM Web Console
» AWS IAM GA» AWS IAM Web Console» AWS Beanstalk Tomcat 7 Support» Amazon CloudWatch Custom Metrics» Amazon CloudWatch lower pricing» AWS SAP Certification» Amazon RDS for Oracle» Amazon ELB ipv6 support, Zone Apex» Amazon ELB Security Group integration» Amazon Route53 GA, ELB integration» Amazon Route 53 Weighted RR» New pricing control for Spot» AWS CloudFormation new enhancements
» On-demand Red Hat » Stockholm Edge Location» AWS Elastic Beanstalk new enhancements» New Data Transfer pricing» Free Inbound Data Transfer
» AWS Import/Export for EBS» AWS CloudFormation new features» AWS SDK for Ruby» Attachment support for Amazon SES» AWS Startup Challenge goes global
» AWS DirectConnect» Amazon VPC Everywhere» Mulit-AZ VPC» AWS IAM Identity Federation» AWS toolkit of eclipse 2.0» AWS GovCloud US» Spot in Amazon EMR» Amazon ElastiCache» Amazon VM import Win2k3
» AWS Mobile SDK GA» AWS Toolkit of Visual Studio» AWS DirectConnect USWest Location
The Cloud: Risks, Rewards and Realities
AWS Regions
Ashburn, VA / Dallas, TX / Jacksonville, FL / Los Angeles, CA / Miami, FL / Newark, NJ / New York, NY / Palo Alto, CA / Seattle, WA / St. Louis, MO / Amsterdam / Dublin / Frankfurt / London / Hong Kong / Paris / Stockholm / Tokyo / Singapore
US East (Northern Virginia)US West (Northern California)GovCloud (US) (West Coast)Europe (Dublin)Asia Pacific (Singapore)Asia Pacific (Tokyo)
6 AWS Regions
19 AWS CloudFront Locations
The Cloud: Risks, Rewards and Realities
Amazon Web Services
ComputeAmazon Elastic Compute Cloud (EC2)
Auto Scaling
StorageAmazon Simple Storage Service
(S3)Elastic Block StorageAWS Import/Export
Cloud-Powered Applications
Content DeliveryAmazon
CloudFront
MessagingAmazon Simple Queue Service (SQS)
Amazon Simple Notification Service (SNS)Amazon Simple Email Service (SES)
Parallel Processing
Amazon Elastic
MapReduce
MonitoringAmazon
CloudWatch
DatabaseAmazon RDS
Amazon SimpleDBThird-Party Offerings
ManagementAWS Management
ConsoleAWS Elastic Beanstalk
ToolsAWS Toolkits for Eclipse
Java, PHP, Ruby, Python, .Net Developer
Centers
NetworkVirtual Private Cloud
Route 53AWS Direct Connect
Elastic Load Balancing
Metering and Billing
Identity and Access Management
CachingAmazon
ElastiCache
Regions and Availability Zones
The Cloud: Risks, Rewards and Realities
AWS Security Resources
AWS Security White Paper
C & A: SAS 70 Type II ISO 27001 PCI DSS FISMA Moderate
HIPAA applications
AWS GovCloud (US)
http://aws.amazon.com/security/
The Cloud: Risks, Rewards and Realities
Amazon Elastic Compute Cloud
Amazon EC2: on-demand compute powerObtain and boot new server instances in minutesQuickly scale capacity up or downEleven instance typesHourly billing
Key features:Support for Windows, Linux, and FreeBSDSupports all major web and application platformsDeploy across Availability Zones for reliability
The Cloud: Risks, Rewards and Realities
Amazon EC2 Pricing Options
On-DemandInstances
Pay as you go for compute power
Pay only for what you use, no up-front commitments or long-term contracts
Unix/Linux instances start at $0.02/hour USD in the US East Region
ReservedInstances
Pay a low up-front fee and receive a significant discount on the hourly pricing for that instance
1- or 3-year terms
Helps ensure that compute capacity is available when it is needed
SpotInstances
Enables you to bid on unused Amazon EC2 capacity
Spot Price is based on supply/demand and is determined automatically
If the Spot Price is below your bid, your instances will start
If the Spot Price rises above your bid, your instances will stop
The Cloud: Risks, Rewards and Realities
Amazon EC2 Instance Specs
Standard High-CPU High-Memory Cluster
Micro Small
Large Extra Large
Medium
Extra Large
Extra Large
Double Extra Large
Quadruple Extra Large
Cluster Compute Quadruple Extra
Large
Cluster GPU Quadruple Extra
Large
Bits 32 32 64 64 32 64 64 64 64 64 64
RAM 613 MB
1.7 GB
7.5 GB
15 GB 1.7 GB 7 GB 17.1 GB
34.2 GB
68.4 GB 23 22
Local Disk
0 160 GB
850 GB
1690 GB
350 GB 1690 GB 420 GB
850 GB
1690 GB 1690 GB 1690 GB
EC2 Compute Units
Burst to 2
1 4 8 5 20 6.5 13 26 33.5 33.5
Cores 1 1 2 4 2 8 2 4 8 8(Dual Processor)
8(Dual Processor)
GPU 2 x Nvidia Tesla "Fermi" M2050
Firewall Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes
Linux Per Hour
$0.02 $0.085
$0.34 $0.68 $0.17 $0.68 $0.50 $1.20 $2.40 $1.60 $2.10
Windows Per Hour
$0.03 $0.12
$0.48 $0.96 $0.29 $1.16 $0.62 $1.44 $2.88 N/A N/A
All prices subject to change – Current as of April 15, 2011
The Cloud: Risks, Rewards and Realities
https://aws.amazon.com/console
AWS Management Console
The Cloud: Risks, Rewards and Realities
Where are we going?
The Cloud: Risks, Rewards and Realities
Where Are We Going (Our Newest Services)
Relational Database Service Provision a relational database in seconds
Virtual Private Cloud Virtualized network – routers, ACLs, IP ranges
Elastic Beanstalk Simplified application hosting
AWS CloudFormation Higher-level application (stack) management
The Cloud: Risks, Rewards and Realities
Amazon Relational Database Service Provision a new relational database in seconds
MySQL (5.1 and 5.5) Oracle (11G)
Offload common administrative tasks to AWS OS upgrades DB upgrades and patches Scaling CPU and storage Backups & Restores
Use your existing code and tools
Pay only for what you use, no up-front commitments
The Cloud: Risks, Rewards and Realities
RDS in Action
The Cloud: Risks, Rewards and Realities
RDS in Action
The Cloud: Risks, Rewards and Realities
AWS CloudFormation Stack Creation
AMAZON CONFIDENTIAL
Define a JSON template of AWS Resources to provision (EC2 instances, AZ lists, AMIs, EIP, RDS, etc)
Parameterization supported
Use CLI, API, or Management Console to register and create an AWS stack
Service automatically determines interdependencies
AWS resources get created across tiers and AZs forming a CloudFormation Stack
The Cloud: Risks, Rewards and Realities
Amazon Virtual Private Cloud - VPC Create an isolated set of EC2 instances in the AWS cloud
Divide your IP address range into one or more public or private subnets
Control inbound and outbound access to and from individual subnets using stateless Network Access Control Lists
Protect your Instances with stateful filters for inbound and outbound traffic using Security Groups
Bridge your VPC and your onsite IT infrastructure with an encrypted VPN connection
The Cloud: Risks, Rewards and Realities
The Cloud: Risks, Rewards and Realities
The Cloud: Risks, Rewards and Realities
AWS Elastic BeanstalkSimple way to deploy and manage an application
Fault tolerance Scale Administration
First Container Type: Java / Tomcat
Other platforms and languages to follow
Upload applications to AWS in minutes
Retain control and ability to “open the hood”
The Cloud: Risks, Rewards and Realities
The Cloud: Risks, Rewards and Realities
The Cloud: Risks, Rewards and Realities
For More InformationAWS Web Site: http://aws.amazon.com
AWS Blog: http://aws.typepad.com
Email: [email protected]
Twitter: @jeffbarr
The Cloud: Risks, Rewards and Realities
Thank YOU!
The Cloud: Risks, Rewards and Realities
Slide Credits Crystal Ball: http://amzn.to/g06rZ8
RS-232 Cable: http://amzn.to/gxGpnJ
IBM 1401: http://en.wikipedia.org/wiki/File:IBM_1401_Control_Panel.jpg
IBM Flowcharting Template: http://www.retroist.com/2009/01/11/ibm-flowcharting-template/
COBOL for Dummies: http://amzn.to/g3OjEb
Internet in a Box: http://en.wikipedia.org/wiki/Internet_in_a_Box
TRS-80: http://en.wikipedia.org/wiki/TRS-80
Ethernet Connector: http://en.wikipedia.org/wiki/Ethernet
9-Track Tape: http://en.wikipedia.org/wiki/9_track_tape
DECtape: http://en.wikipedia.org/wiki/DECtape
C Programming Language: http://en.wikipedia.org/wiki/File:Kr_c_prog_lang.jpg
Innovation curve: http://en.wikipedia.org/wiki/File:DiffusionOfInnovation.png