enterprise-ready private and hybrid cloud computing today
DESCRIPTION
RightScale User Conference NYC 2011: Enterprise-Ready Private and Hybrid Cloud Computing Today Rich Wolski - Founder and CTO, Eucalyptus In this session, we'll discuss the use of Eucalyptus and RightScale to build enterprise-grade cloud computing environments. By combining on-premise clouds with Amazon Web Services (AWS) through a common cloud management interface, Eucalyptus and AWS form a coherent platform for reliable and cost-effective enterprise cloud computing. The RightScale Cloud Management Platform delivers the high-level framework for cost-effectively automating and managing this ensemble of technologies.TRANSCRIPT
RightScale and Eucalyptus:The State of the Art in
Enterprise-grade Cloud Computing
Rich WolskiChief Technology OfficerEucalyptus Systems Inc.June 7, 2011
Origins of cloud
SLAs
Web Services
Virtualization
Enterprise cloud
SLAs
Web Services
Virtualization
EnterpriseDatacenter
eCommerce + Infrastructure
• Self-service and “zero touch.”– Scalable automatic rental of resource intensive goods
• Transactional and asynchronous– Interaction with the site is transactional– Delivery is asynchronous
• Site integrity and site availability are critical– Individual transactions can fail but the site cannot
• Customer requests must be isolated– Service venue must manage competing needs
• Scale out for request volume, scale up for request weight
The State of the Architecture
Eucalyptus -- confidential
IaaSCompute, Network, Storage
IaaSCompute, Network, Storage
ManagementPlatform
ManagementPlatform
Ruby/Java/PHP
PaaS
Ruby/Java/PHP
PaaS
GoogleAppEngine(AppScale)
GoogleAppEngine(AppScale)
MapReduce(Hadoop)
MapReduce(Hadoop)
VMContainer
VMContainer
Applications (SaaS or otherwise)
The State of the Art
IaaSCompute, Network, Storage
IaaSCompute, Network, Storage
ManagementPlatform
ManagementPlatform
Ruby/Java/PHP
PaaS
Ruby/Java/PHP
PaaS
GoogleAppEngine(AppScale)
GoogleAppEngine(AppScale)
MapReduce(Hadoop)
MapReduce(Hadoop)
VMContainer
VMContainer
Applications (SaaS or otherwise)
What’s in a name?
• Elastic Utility Computing Architecture Linking Your Programs To Useful Systems
• Open source web services based implementation of elastic/utility/cloud computing infrastructure– Born of an NSF-funded research project in 2008 at UC Santa
Barbara• Software overlay
– integrates multiple hardware and software platforms– Configuration agnostic– Policy agnostic
• Packages for all popular Linux distros and build from source
Open-source Cloud Infrastructure
• Original Idea: Develop an open-source, freely available cloud platform for commodity hardware and software environments– Stimulate interest and build community knowledge– Quickly identify useful innovations– Act to dampen the “hype”
• First-principles cloud implementation– Not a refactorization of previously developed technology
• Mature open source technologies for eCommerce– J2EE, MySQL, Web Services are high quality and scalable as open
source
• Runs on existing infrastructure without modification– Hypervisor, distro, configuration neutral
Architecture
Client-side APITranslator
Cloud Controller
Cluster Controller Node Controller
Database Walrus (S3)
Storage Controller
vSphere
ESXESXi
ESX
ESXi
ESX
ESX
RHEV-M
Xen and/or KVM
Why IaaS?
• Applications are often multi-technology– System “images” for different technologies can be combined– Multiple language technologies at different revision levels
• Legacy support– System images that mimic bare metal deployments can be used– Legacies are archived with the environment necessary to run
them
• Transparency– Debugging and performance tuning can go down to the
hypervisor
• QoS containers– QoS is implemented in the infrastructure today => familiar
• Anti-lock in– If clouds fail, a return path to bare metal is available
Why not IaaS?
• Self-service pushes system administration tasks to the end-user– Users must understand dynamic resource provisioning
• QoS hard to optimize at a fine-grained level– A machine is a pretty big QoS bundle
• Heterogeneity is powerful but hard to manage– Multi-technology development and maintenance is a tough
software engineering problem
• RightScale is the solution to these problems
Hybrid Clouds
• Public Cloud– Flat ID Management system and “limitless” scale– “roll forward” development
• Craft a new VM when a run time exception occurs• Garbage collect asynchronously
• Private Cloud– Complex access controls and limited resources/quotas– Resource management throughout the stack is critical
• How can one application live comfortably in both worlds?
Hybrid Architecture
Acme Enterprises
VMVMVMVM
VMVM
VMVMVMVM
VMVM
VMVM
VMVM
VMVMVMVM
VMVM
VMVM
VMVM
VMVM
AWS Image Ecosystem
Courtesy Philip Papadopoulos, SDSC
Three Commands, No Waiting
• Well – some waiting…
$ sudo -E euca-bundle-vol -p Ubuntu-10.10-Maverick-32bit\ -s 2048 -d /mnt -r i386 --kernel eki-6CBD12F2 --ramdisk eri-A97113E4 $ euca-upload-bundle -b cloudexpo -m /mnt/Ubuntu-10.10-Maverick-32bit.manifest.xml $ euca-register cloudexpo/Ubuntu-10.10-Maverick-32bit.manifest.xml
It works, but you should use
Eucalyptus Ecosystem
When Things go Bump in the Night
Acme Enterprises
VMVMVMVM
VMVM
VMVM
VMVM
VMVM
• Hybrid compatibility– AWS and Eucalyptus use the same API
• AWS image ecosystem– Free software from AWS runs in Eucalyptus managed by RightScale– Thousands of images
• Eucalyptus partner ecosystem– Hundreds of technologies that complement both RightScale and
Eucalyptus
• Full on-premise cloud operation– Same tools work with AWS and Eucalyptus in disconnected or
disaster modes
• RightScale ready
myOpenSourceCloud?
• Linux is the operating system platform of choice for enterprises because…– Hardware portable
• Separates software lifecycle from hardware lifecycle• Prevents lock-in
– Vast ecosystem of software• Linux distros provide QA (free or paid)
– Transparent• Possible to own the source code for everything
– Fast to remediate• Open source web community is often faster than paid support
– Cost effective• Possible to mix free and paid offerings fluidly
OSS and The Next Data Center
• If…– the most mature eCommerce technologies are open source
• And…– Enterprise IT prefers open source platforms for deployment at
scale
• And…– Private Clouds are the next platform for Enterprise IT
• Then…– The On-premise Private Cloud will be built from Open Source
Happening Already?
Eucalyptus -- confidential
To Get Started
• Check out– RightScale myCloud– Eucalyptus FastStart
http://www.eucalyptus.com/go/fastStart
Thanks
…is great!
Questions?