cloud computing and high performance networking
DESCRIPTION
Cloud Computing and High Performance Networking. David Irwin Computer Science Department University of Massachusetts, Amherst. Cloud Computing. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/1.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Cloud Computing and High Performance Networking
David Irwin
Computer Science DepartmentUniversity of Massachusetts, Amherst
![Page 2: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/2.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Cloud Computing
Wikipedia: âInternet-based computing, whereby shared resources, software and information are provided to computers and other devices on-demand, like the electricity gridâ
![Page 3: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/3.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Cloud Computing
Shared resources == lots of computers in data centers
Benefit from âEconomy of Scaleâ Cost per unit falls as scale increases I.e., like Costco but for computers and software services
![Page 4: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/4.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Outline
Virtualized Data Centers The foundation for cloud computing
Hardware Virtualization The foundation for virtualized data centers
Public/private Cloud Computing Relevance to education
Shared testbeds NSFâs GENI prototype
![Page 5: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/5.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Data Center Overview Large Server and Storage Farms
Used by enterprises to run server applications Used by Internet companies
Google, Facebook, YouTube, Amazon Size varies depending on needs
Architecture Traditional: applications run on physical servers
Manual mapping of applications to servers IT admins deal with âchangeâ
Modern: virtualized data centers Application runs inside of virtual servers; VM mapped to
physical servers Provides flexibility in mapping from virtual to physical
resources
![Page 6: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/6.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Virtualized Data Center
Simplifies resource management Application started from preconfigured VM images, e.g., virtual
appliances Virtualization layer permits resource allocations to vary
dynamically Migrate VMs between physical machines with no down-time
Workload management Internet applications dynamic workloads
How much capacity to allocate to applications? Traditional approach: IT admins estimate peak
workloads and provision sufficient servers Flash crowd react manually by adding capacity Time scale of hours: lost revenue, bad publicity for
application
![Page 7: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/7.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Dynamic Provisioning
Track workload and dynamically provision capacity
Monitor Predict Provision Predictive versus reactive provisioning
Predictive: predict future workload and provision Reactive: react whenever capacity falls short of demand
Traditional data centers: bring up a new server Borrow from free pool or reclaim under-used server
Virtualized data center: exploit virtualization to speed up application startup time
![Page 8: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/8.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Outline
Virtualized Data Centers The foundation for cloud computing
Hardware Virtualization The foundation for virtualized data centers
Public/private Cloud Computing Relevance to education
Shared testbeds NSFâs GENI prototype
![Page 9: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/9.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Virtual machines are hotHeadlines from August 2007
VMware IPO: $19.1 billion
Xen sale: $500 million
![Page 10: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/10.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Traditional OS Structure
Host Machine
Operating System
App App App App
![Page 11: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/11.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
OS abstractions
HardwareHardware
OSOS
ApplicationsApplications
What are the interfaces and the resources?What is being virtualized?
InstructionsCPU
Virtual addrsPhysical mem
Syst callsI/O devices
![Page 12: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/12.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
OS abstractions
HardwareHardware
OSOS
ApplicationsApplications
What are the interfaces and the resources?What is being virtualized?
InstructionsCPU
Virtual addrsPhysical mem
Syst callsI/O devices
![Page 13: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/13.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Virtual Machine Structure
Host Machine
Virtual Machine Monitor (Hypervisor)
Guest OS
GuestApp
GuestApp
Guest OS Guest OS
GuestApp
![Page 14: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/14.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Why are VMs useful?
Code reuse Can run old operating systems + apps on new hardware Original purpose of VMs by IBM in the 60s
Encapsulation Can put entire state of an âapplicationâ in one thing Move it, restore it, copy it, etc
Isolation, security All interactions with hardware are mediated Hypervisor can keep one VM from affecting another Hypervisor cannot be corrupted by guest operating
systems
![Page 15: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/15.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Encapsulation
Say I want to suspend/restore an application I decide to write the process memory to disk I reboot my kernel and restart the process
Will this work? No, application state is spread out in many places Application might involve multiple processes Applications have state in the kernel (lost on reboot) (e.g. open files, locks, process ids, driver states, etc)
![Page 16: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/16.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Encapsulation
Virtual machines capture all of this state
Can suspend/restore an application On same machine between boots On different machines
Very useful in server farms As we discussed earlier
![Page 17: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/17.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Examples
Full Virtualization Run any OS; expose full x86 ISA E.g., VMware, Xen on HVM
Para-virtualization Run any (slightly modified) OS; expose (slightly modified) x86
ISA E.g, Xen
OS-level virtualization Run multiple copies of same OS E.g, VServers, User-mode Linux
![Page 18: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/18.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Outline
Virtualized Data Centers The foundation for cloud computing
Hardware Virtualization The foundation for virtualized data centers
Public/private Cloud Computing Relevance to education
Shared testbeds NSFâs GENI prototype
![Page 19: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/19.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Types of Cloud Computing
Software-as-a-Service E.g., Gmail, Google Calendar
Platform-as-a-Service E.g., Azure, AppEngine
Infrastructure-as-a-Service E.g., Amazon EC2, S3, EBS
Implementations at different levels of abstraction Analagous to a software stack: hardware OSapplication Lower-level == more difficult to use + more freedom to
innovate
![Page 20: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/20.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Types of Cloud Computing
Software-as-a-Service E.g., Gmail, Google Calendar
Platform-as-a-Service E.g., Azure, AppEngine
Infrastructure-as-a-Service E.g., Amazon EC2, S3, EBS
Implementations at different levels of abstraction Analagous to a software stack: hardware OSapplication Lower-level == more difficult to use + more freedom to
innovate
Focus of much of this talk.Good for classroom, since it provides most
freedom to innovate
![Page 21: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/21.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Cloud Computing Benefits Low upfront capital expenditure
No need to buy, power, cool, or maintain hardware Cheaper for small or short-term operations E.g., educators teaching project-based courses
Predictable costs Flat fees for usage, e.g., $/hour Nice for fixed budgets: $250 class computing budget Computing budgets are hard to predict
Flexible pricing plans On-demand: pay $0.10 every hour, quit at anytime Spot: use computers when price <=$0.10/hour Reserved: reserve computers for long period at
$0.05/hour
![Page 22: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/22.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Example: Amazon EC2
![Page 23: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/23.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Types of Amazon Resources
Elastic Compute Cloud (EC2) ($0.085/hour) Elastic IPs AutoScaling CloudWatch ($0.015/hour) Elastic MapReduce Elastic LoadBalancing
Simple Storage Service (S3) ($0.15/GB-month) Elastic Block Store (EBS) ($0.10/GB-month)
Elastic Snapshots SimpleDB
Prices are continuing to fall as usage increasesâŚ..
![Page 24: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/24.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Educators and Cloud Computing
Excellent platforms for experimentation Donât care if students âbreakâ things
Give root access to machine Install arbitrary software
Students isolated from other students/users
Enables distributed application projects Can access many machines for short time-period
E.g., Class of 20 working in pairs developing an application that runs over 5 machines need 50 computers!
Costs $500 for a two week assignment (via Amazon Spot Pricing) Also can use âfreeâ testbeds, e.g., PlanetLab, GENI
![Page 25: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/25.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Importance of Distributed Apps
Internet services use many computers to serve Internet users
E.g., Google, Facebook, YouTube, Yahoo, Microsoft Services may use thousands of computers running at
multiple data centers throughout the world Importance of these applications is still increasing at a
rapid rate
Important for students to learn how to develop distributed applications in this environment
Traditionally a difficult task, since access is expensive
![Page 26: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/26.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Private Clouds
If you already own a lot of mostly idle machines you can install private cloud software
Make your own infrastructure look like a cloud Donât get the low cost benefitsâŚ.. âŚ.but maybe make your infrastructure more flexible or
usable
Good for class project maintenance if you have the time to invest to learn and install software
Example: Eucalyptus, emulates Amazon EC2 interfaces
![Page 27: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/27.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Outline
Virtualized Data Centers The foundation for cloud computing
Hardware Virtualization The foundation for virtualized data centers
Public/private Cloud Computing Relevance to education
Shared testbeds NSFâs GENI prototype
![Page 28: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/28.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Shared Testbeds
Run by universities and companies to experiment with new research prototypes
Often are âfreeâ: may need to contribute a few computers Formed from donations by participants
Not as stable as commercial clouds Focus on one or more characteristics
Compute isolation Network isolation Geographic diversity Hardware diversity
Examples: PlanetLab, Emulab, NSFâs Global Environment for Network Innovations (GENI)
![Page 29: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/29.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
PlanetLab Get access to machines hosted around the world
Experiment with global network services No resource isolation Network presence but little compute power
Success led to GENI
![Page 30: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/30.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
Status GENI connects diverse testbeds together
Many components/link types Routers, edge nodes, wireless, wired, storage,
sensors, fiber-optic, etc.
Prototyping started last year (http://geni.net) Hasnât been built, but isnât vaporware
Existing systems form foundation 80 projects clustered around 4 âcontrol
frameworksâ PlanetLab, Emulab, Orca, Orbit 4 projects at UMass-Amherst! Run by BBN (Cambridge); also at UMass-Lowell and
Williams
![Page 31: Cloud Computing and High Performance Networking](https://reader035.vdocuments.site/reader035/viewer/2022062517/56813659550346895d9de443/html5/thumbnails/31.jpg)
UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTS ASSACHUSETTS AAMHERST ⢠MHERST ⢠Department of Computer Science Department of Computer Science ⢠2008 ⢠2008
GENI Overview
Sliverable GENI Substrate(Contributing domains/Aggregates)
Wind tunnel
Experiments(Guests occupying slices)
Embedding
Petri dish
Observatory