cloud computing and reservoir project csfi 2008 30 may 2008

Cloud Computing and RESERVOIR projectCSFI 200830 May 2008

Author:Stefano Beco ([email protected])

Resources and Services Virtualizationwithout Barriershttp://www.reservoir-fp7.eu

The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 215605.

Cloud Computing and RESERVOIR project

2

Outline

• Introduction to Cloud Computing• Introduction to RESERVOIR• The Service Oriented Infrastructure

Equation• RESERVOIR challenges• Conclusions


3

Just to start… “Five computers”

• "I think there is a world market for about five computers" — Remark attributed to Thomas J. Watson (Chairman of the Board of International Business Machines) – 1943


4

Cloud computing

• Cloud computing is an information technology infrastructure in which computing resources are virtualized and accessed as a service.

• "Cloud" will be a grand buzzword unifier in IT for the next months: utility computing, grid computing, software-as-a-service, and many other scalable remote computing models will get linked to cloud computing.


5

Cloud computing

• As “Could computing” seems to be “anything anywhere”, shouldn’t we focus more on “Cloud business” instead?

• “Technology vendors will deliver cloud infrastructure, but those details must be linked for us all, or 'the cloud' will just be nothing more than a buzz-word… We can't spend all of our time arguing about how to implement the cloud and almost no time talking about whether our business can fit the cloud model.”Daryl Plummer, Gartner Group Vice President, Gartner Fellow


6

So… Five computers!


• “… In a sense, says Yahoo Research Chief Prabhakar Raghavan, there are only five computers on earth. He lists Google, Yahoo, Microsoft, IBM, and Amazon. Few others, he says, can turn electricity into computing power with comparable efficiency …”

From Google and the wisdom of clouds, by Steven Baker - BusinessWeek.com

http://www.msnbc.msn.com/id/22261846/


7

RESERVOIR Motivation

• Service-Oriented economy is at our door• Services over the Internet are winning in the

market– Consumers use YouTube, eBay, Amazon, Second

Life…– SMEs use hosted Microsoft Exchange,

Salesforce.com– Enterprises routinely rely on remote IT outsourcing

• Services reduce complexity and cost• Service-Oriented Economy

requires

Service-Oriented Infrastructure



8

RESERVOIR Vision

• The Next Generation Infrastructure for Service Delivery– Provide revolutionary foundation for a new European

infrastructure where resources and services can be transparently and dynamically managed, provisioned and relocated like utilities – virtually “without borders”

– No single facility/provider can create a seemingly infinite infrastructure capable of serving massive amounts of users at all times, from all locations

• Federation of clouds• Leverage the diversity factor to achieve economies of scale• Leverage locality

– Analogies exists in areas outside IT services• Electrical power delivery: capacity can be shifted to guarantee

supply and lower costs• Roaming cellular communications: talk wherever you are

– Enable utility-like deployment of services, relieving the service consumer from awareness of the IT attributes while assuring QoS and security


9

The Service Oriented Infrastructure (SOI) Equation

• Integration of virtualization technologies with grid computing driven by new techniques for business service management

= SOIVirtualization-Aware Grid

e.g., VM usage/size as the unit for metering and billing

Grid-Aware Virtualizatione.g., live migration across administrative domains

BSMe.g., policy-based management

of service-level agreement + +


10

Grid node or Service Site

Physical Resources

Service Tasks

SOI: Grid Computing


11

SOI: Grid Computing + Virtualization

Improved isolation, Relax dependencies, Well defined billing units

Virtual Execution Environment (VEE)


12


+ BSMPolicy 1:If possible keep VEEs fromthe same organization in the same physical box


13


+ BSMPolicy 1:If possible keep VEEs fromthe same organization in the same physical box

Policy 2:Turn off underutilized physical boxes


14


+ BSM

Policy 2:Turn off underutilized physical boxes

Policy 1:If possible keep VEEs fromthe same organization in the same physical box

Local optimizations (within a single site): placement, power, etc.


15


+ BSM - BoundariesPolicy 3:If possible keep VEEs in “owning”organization


16


+ BSM - BoundariesPolicy 3:If possible keep VEEs in “owning”organization

Policy 4:If possible keep VEEs in least number of external organizations


17


+ BSM - Boundaries

Migration across sites Global optimizations: placement, cost, etc.

Policy 3:If possible keep VEEs in “owning”organization

Policy 4:If possible keep VEEs in least number of external organizations


18

Policy 5:“Follow” your customer


+ BSM - Boundaries


19

… - Boundaries Virtualize the Network …

Create virtual networks connecting VEEs regardless of physical server location


20

… - Boundaries ... and the Storage

Enable secure access to relevant data regardless of storage location


21

… - Boundaries ... and the Storage

Enable secure access to relevant data regardless of storage location

“… Unfortunately, at least to date, the methods used to achieve these goals in today’s commercial clouds have not been open and general purpose, but instead been mostly proprietary and specialized for the specific internal uses (e.g., large-scale data analysis) of the companies that developed them. The idea that we might want to enable interoperability between providers (as in the electric power grid) has not yet surfaced. Grid technologies and protocols speak precisely to these issues, and should be considered…”

“…will move towards a mix of microproduction and large utilities, with increasing numbers of small-scale producers (wind, solar, biomass, etc., for energy; for computing, local clusters and embedded processors—in shoes and walls?) co-existing with large-scale regional producers, and load being distributed among them dynamically …”

“ … In building this distributed “cloud” or “grid” (“groud”?), we will need to support on-demand provisioning and configuration of integrated “virtual systems” providing the precise capabilities needed by an end-user … We will need the centralized scale of today’s cloud utilities, and the distribution and interoperability of today’s grid facilities…”

From There’s Grid in then thar Clouds - Ian Foster

http://ianfoster.typepad.com/blog/2008/01/theres-grid-in.html




22

RESERVOIR Challenges

• The RESERVOIR envisioned highly dynamic and cooperative infrastructure relies on:– A service definition language that captures in a high level

language the functional and infrastructure requirements of the service (including servers, images, network, storage, inter-tier relations and QoS requirements)

– An abstraction layer that separates implementation details from the high level automation system that is responsible for the provisioning, monitoring and reallocation of resources

– Inter-domain protocols that enable multiple management sites to cooperate in providing a single service, where the cooperation is automatically driven from a service definition document (fully automated cross-domains SLA management)

– The capability of creating fully isolated virtual organizations spread across geographies and management domains

– The flexibility of placing and relocating service instances on resources anywhere even across geographies and management domains


23

RESERVOIR from 10000 feet

Physical Layer

Virtualization Layer

Service Layer

Service Manager Service

User Layer

Grid Site

ServiceEnd-user

ServiceAdmin.

Virtual Execution Environment Management System

Value Chain

ServiceConsumer

ServiceProvider

InfrastructureProvider


24

Conclusions

• Cloud computing is the top of “virtualization-as-a-service” concept!– “Grid” is (finally!) becoming an appliance, a commodity– “Cloud” targets to “anything anywhere” and “when you like”– Caveat! Don’t forget about “cloud business” when creating

“cloud technology”!• RESERVOIR aims at Next-Generation Infrastructure

for Service Delivery– Virtualization-aware Grid + Grid-aware virtualization +

Business Service Management = Service Oriented Infrastructure

– Resources and services must be transparently and dynamically managed, provisioned and relocated virtually “without borders”, in order to actually realize the utility computing paradigm in commercial scenarios

– Security, scalability, availability, reliability, cost efficiency, data intensive, mobility, personalization


25

a “Take Home” message:Five computers?


• “… In a sense, says Yahoo Research Chief Prabhakar Raghavan, there are only five computers on earth. He lists Google, Yahoo, Microsoft, IBM, and Amazon. Few others, he says, can turn electricity into computing power with comparable efficiency …”

From Google and the wisdom of clouds, by Steven Baker - BusinessWeek.com

• “… The World Wide Web is becoming one vast, programmable machine. As NYU's Clay Shirky likes to say, Watson was off by four …” – Nicholas Carr

From Wired Magazine Q&A with Nicholas Carr

One

Cloud

http://www.msnbc.msn.com/id/22261846/

http://www.wired.com/techbiz/people/magazine/16-01/st_qa

Cloud Computing and RESERVOIR projectCSFI 200830 May 2008

Author:Stefano Beco ([email protected])

Resources and Services Virtualizationwithout Barriershttp://www.reservoir-fp7.eu


Thanks!!

cloud computing and reservoir project csfi 2008 30 may 2008

Documents

cloud infrastructure

comcloud computing

computing power

utility computing

grid computing

cloud business

cloud model

gartner fellowcloud