introduction to cloud computing and the aneka platform dr. rajkumar buyya cloud computing and...

36
Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information Systems The University of Melbourne, Australia www.cloudbus.org www.manjrasoft.com Major Sponsors/Supporters M anjra soft

Upload: clement-davidson

Post on 23-Dec-2015

321 views

Category:

Documents


9 download

TRANSCRIPT

Page 1: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

Introduction to Cloud Computing and the Aneka Platform

Dr. Rajkumar BuyyaCloud Computing and Distributed Systems (CLOUDS) LabDept. of Computing and Information SystemsThe University of Melbourne, Australia

www.cloudbus.orgwww.manjrasoft.com

Major Sponsors/Supporters

Manjrasoft

Page 2: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

2

The Next Revolution in ITThe Big Switch in IT

Classical Computing Buy & Own

Hardware, System Software, Applications often to meet peak needs.

Install, Configure, Test, Verify, Evaluate

Manage .. Finally, use it $$$$....$(High CapEx)

Cloud Computing Subscribe Use

$ - pay for what you use, based on QoS

Every

18 m

on

ths?

Page 3: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

3

Outline

“Computer Utilities” Vision and Promising IT Paradigms/Platforms

Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges

Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange

Aneka: Cloud Application Platform Summary and Thoughts for Future

Page 4: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

4

“Computer Utilities” Vision: Implications of the Internet

1969 – Leonard Kleinrock, ARPANET project “As of now, computer networks are still in their

infancy, but as they grow up and become sophisticated, we will probably see the spread of “Computer Utilities”, which, like present electric and telephone utilities, will service individual homes and offices across the country”.

During the last 40 years, several advances have taken place in both “computing” and “communications” areas that are turning the vision of “Computer Utilities” in to a reality.

Page 5: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

5

Computing Paradigms and Attributes: Realizing the ‘Computer

Utilities’ Vision Web Data Centres Utility Computing Service Computing Grid Computing P2P Computing Market-Oriented

Computing Cloud Computing …

-Ubiquitous -Reliable-Scalable

-Autonomic-Dynamic discovery

- Composable -QoS-SLA- …

} +

Paradigms

Attributes/Capabilities

?-Trillion $ business

Page 6: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

6

Outline

“Computer Utilities” Vision and Promising IT Paradigms/Platforms

Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges

Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange

Aneka: Cloud Application Platform Summary and Thoughts for Future

Page 7: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

7

Very popular: too many are “In Search” of Cloud Computing

Page 8: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

8

Open Data Center Alliance (ODCA)for Cloud Computing

Page 9: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

9

Defining Clouds: There are many views for what is cloud computing?

Over 20 definitions: http://cloudcomputing.sys-con.com/read/612375_p.htm Renting “remote storage” backup Renting “remote server” hosting Web server Renting “remote more servers” to manage large workload

Buyya’s Scientific definition of Cloud Computing “Cloud is a market-oriented distributed computing system consisting

of a collection of inter-connected and virtualised computers that are dynamically provisioned and presented as one or more unified computing resources based on service-level agreements (SLAs) established through negotiation between the service provider and consumers.”

SLA = {negotiated and agreed QoS parameters + rewards + penalties for violation of agreement....}

Page 10: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

10

Subscription-Oriented Cloud Services: X{compute, apps, data, ..}

as a Service (..aaS)

Clients

OtherCloud Services

Govt.Cloud Services

PrivateCloud

Cloud Manager

Public Cloud

Page 11: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

11

Rentable Cloud Services

Infrastructure as a Service (IaaS)

CPU, Storage: Amazon.com, Nirvanix, GoGrid….

Platform as a Service (PaaS)

Google App Engine, Microsoft Azure, Manjrasoft Aneka..

Software as a Service (SaaS)

SalesForce.Com

Infrastructure as a Service (IaaS)

Software as a Service (SaaS)

Platform as a Service (PaaS)

Manjrasoft

....

Page 12: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

12

Cloud Deployment Models

Private/Enterprise Clouds

Cloud model run within a company’s own Data Center / infrastructure for

internal and/or partners use.

Public/Internet Clouds

3rd party, multi-tenant Cloud

infrastructure & services:

* available on subscription basis

Hybrid/InterClouds

Mixed usage of private and public

Clouds: Leasing publiccloud services

when private cloud capacity is insufficient

Page 13: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

13

Cloud Applications

•Scientific/Tech Applications•Business Applications•Consumer/Social Applications

Science and Technical Applications

Business Applications

Consumer/Social Applications

Page 14: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

14

When will Cloud spending become 50% of IT spending or reach to a

trillion $ business/year?

120?

2016

15%

600?

2020?

30% 1000?

2020?

50%

Buyya’s Guestimate!

2000

Page 15: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

15

Cloud Computing Challenges: Dealing with too many issues

Uhm, I am not quite clear…Yet another

complex IT paradigm?

Virtualization

QoS

Service Level

Agreements

Resource Metering

Billing

Pricing

Provisioning on DemandUtility & Risk Management

Scalability

Reliability

Energy Efficiency

Security

Privacy

Trust

Legal &

Regulatory

Software Eng. Complexity

Programming Env. & Application Dev.

Page 16: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

16

Outline

“Computer Utilities” Vision and Promising IT Paradigms/Platforms

Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges

Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange

Aneka: Cloud Application Platform Summary and Thoughts for Future

Page 17: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

17

Market-Oriented Cloud Architecture: QoS negotiation and SLA-based Resource Allocation

DispatcherVM

MonitorService Request

Monitor

Pricing Accounting

Service Request Examiner and Admission Control

- Customer-driven Service Management- Computational Risk Management- Autonomic Resource Management

Users/Brokers

SLAResource Allocator

Virtual Machines

(VMs)

Physical Machines

Page 18: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

18

Cloud to expand (lease more resources) with increase in demand

DispatcherVM

MonitorService Request

Monitor

Pricing Accounting

Service Request Examiner and Admission Control

- Customer-driven Service Management- Computational Risk Management- Autonomic Resource Management

Users/Brokers

SLAResource Allocator

Virtual Machines

(VMs)

Physical Machines

Page 19: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

19

Cloud to shrink (unlease resources) with decrease in demand

DispatcherVM

MonitorService Request

Monitor

Pricing Accounting

Service Request Examiner and Admission Control

- Customer-driven Service Management- Computational Risk Management- Autonomic Resource Management

Users/Brokers

SLAResource Allocator

Virtual Machines

(VMs)

Physical Machines

Page 20: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

20

Outline

“Computer Utilities” Vision and Promising IT Paradigms/Platforms

Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges

Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange

Aneka: Cloud Application Platform Summary and Thoughts for Future

Page 21: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

21

Aneka: The Cloud Application Platform (CAP) for Resource-Intensive Apps(Available as Manjrasoft Product)

Lightweight Container hosting multiple services.

All programming models available from within the same container (unlike others)

SDK containing APIs for multiple programming models and tools

Runtime Environment for managing application execution management

Suitable for Development of Enterprise

Cloud Applications Cloud enabling legacy

applications Portability for Customer

Apps: Enterprise ↔ Public Clouds .NET/Win ↔ Mono/Linux

Multiple Infrastructures

Multi-core Cluster Grid Cloud

Thread Task ... MapReduce

2100 2100 2100 2100

2100 2100 2100 2100

Aneka

Multiple Applications

1. SDK

2. Runtime

Page 22: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

22

Aneka: The Cloud Application Platform (CAP) for Resource-Intensive Apps(Available as Manjrasoft Product)

Lightweight Container hosting multiple services.

All programming models available from within the same container (unlike others)

SDK containing APIs for multiple programming models and tools

Runtime Environment for managing application execution management

Suitable for Development of Enterprise

Cloud Applications Cloud enabling legacy

applications Portability for Customer

Apps: Enterprise ↔ Public Clouds .NET/Win ↔ Mono/Linux

Private Cloud

LAN network

AmazonMicrosoft Google

IBM

Data Center

Hardware Profile Services

Container

Persiste

nce

TaskModel

ThreadModel

Map Reduce Model

OtherModels

.NET @ Windows Mono @ Linux

Secu

rity

Programming Models

Software Development Kit

ManagementStudio

Application

Foundation Services

MembershipServices

ReservationServices

LicenseServices

APIsDesign Explorer

Management Kit

AdministrationPortal

SLA-NegotiationWeb Services

ManagementWeb Services

StorageServices

AccountingServices

Fabric Services

Dynamic Resource Provisioning Services

Infrastructure

Physical Machines/Virtual Machines

Private Cloud

LAN network

Private Cloud

LAN network

AmazonMicrosoft Google

IBM

Data Center

AmazonMicrosoft Google

IBM

Data Center

Hardware Profile Services

Container

Persiste

nce

TaskModel

ThreadModel

Map Reduce Model

OtherModels

.NET @ Windows Mono @ Linux

Secu

rity

Programming Models

Software Development Kit

ManagementStudio

Application

Foundation Services

MembershipServices

ReservationServices

LicenseServices

APIsDesign Explorer

Management Kit

AdministrationPortal

SLA-NegotiationWeb Services

ManagementWeb Services

StorageServices

AccountingServices

Fabric Services

Dynamic Resource Provisioning Services

Infrastructure

Physical Machines/Virtual Machines

Patent

(PCT)

Page 23: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

23

Aneka as a Cloud Application Platform

DatacentersClusters

Desktop PCsPublic Clouds

Platform

Infrastructure

Applications& Services Application Development

Cloud Middleware

Aneka

Scheduling & Execution

Monitoring Billing

SLA & QoS UserManagement

ApplicationManagement Dynamic

Provisioning

Bag of Tasks Dist. Threads MapReduce …

Page 24: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

24

Aneka: components

public DumbTask: ITask { … public void Execute() { …… }}

for(int i=0; i<n; i++){ … DumbTask task = new DumbTask(); app.SubmitExecution(task);}

Executor

Scheduler

Executor

Executor Executor

ClientAgent

work units

internet

internet

Aneka enterprise Cloud

ClientAgent

work units

Aneka User Agent

Aneka Worker ServiceAneka Manager

Programming / Deployment Model

Page 25: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

25

Aneka - Dynamic deployment of Application Tasks on Clouds

Application

Aneka Application

AnekaManager

Aneka Workker/Executor

Manager / Executor

Aneka Threads

Page 26: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

26

Aneka Support for InterCloud / Federation of Resource Pools

XenServer Pool Aneka + Xen Server

private Cloud VMWare Pool

Aneka + VMWare private Cloud

Amazon EC2 Pool Aneka + public EC2

Windows Azure Aneka + public Azure

Executors/Schedulers

Executor

Client Libraries

Executors

Scheduler

Public Cloud

publicly available resources(physical and virtual)

Scheduler

internet

Private Cloud

private enterprise network

VPN(virtual resources)

Executor

Page 27: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

Aneka Case Studies

Page 28: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

28

(GoFront: A unit of China Southern Railway Group)

Aneka utilizes idle desktops (30) to decrease task time

from days to hours

Time (in hrs)

Single Server

Aneka Cloud

Raw Locomotive Design Files(Using AutoDesk Maya) Using Maya

Graphical Mode Directly

Case 1: Single Server

4 cores server

Aneka Maya Renderer

Use private Aneka Cloud

GoFront Private Aneka Cloud

LAN network (Running Maya Batch Mode on

demand)

Case 2: Aneka Enterprise Cloud Manjrasoft

Application: Locomotive design CAD rendering

Page 29: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

29

A scalable architecture for TitanStrike on-line Gaming Portal

TitanStrike Private Aneka Cloud

LAN network (Running Game plugins on Demand) Case 2: Aneka Enterprise Cloud = Scalability

Aneka-based GameController

The local scheduler interacts with Aneka

and distributes the load in the cloud.

Manjrasoft

Distributed log parsing

logslogs

Case 1: Single Server = Huge Overload

Single scheduler controlling the

execution of all the matches.

Game Servers

Gamers profilesPlayers statisticsTeam playingMultiple games

Titan Strike On Line Gaming Portal

Centralized log parsing

logs

logs

Single GameController

Page 30: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

30

Indian Space Research Organization (ISRO) - ADRIN

Receiving stationprocessing

Archiving

Aneka Cloud

Distribution

Private Cloud Citrix Xen

Public Cloud Amazon AWS

Manjrasoft

Page 31: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

31

Health Care: SaaS Cloud for ECG Sensor Data Analysis

Embedded Bluetooth Enabled Data Processor & Communication Module

ECG Sensor ModuleECG Data Analysis Software

Wireless ECG Sensor

Sa

aS

Pa

aS

Iaa

S

Blu

etoo

th c

onne

ctiv

ity

Wireless/ Mobile 3G Network

1

2

3

4

6

5

A User

Millions of users

Use

r R

eque

sts

User Requests

User QoS based Scaling of Compute Resources

Dynamic Scalable Runtime

Page 32: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

32

IEEE Scalable Computing Challenge at CCGrid 2010 Conference

Page 33: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

33

Global Recognition for Aneka:Frost, Telstra….

-> 2010 Frost & Sullivan "New Product Innovation" Award

-> 2011 Telstra Innovation Challenge, “People’s Choice”

Award

Page 34: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

34

Outline

“Computer Utilities” Vision and Promising IT Paradigms/Platforms

Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges

Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange

Aneka: Cloud Application Platform Summary and Thoughts for Future

Page 35: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

35

Summary

Several Computing Paradigms have promised to deliver “Computing Utilities” vision: Cloud Computing is the most recent kid in the block

promising to turn vision into reality Many exciting business and consumer applications

enabled. Aneka is rapidly emerging as a platform for:

Building Clouds (especially “private”) and their apps. Accelerating Applications and Managing their execution. Already used in engineering, life science, gaming, and

business intelligence applications.

Page 36: Introduction to Cloud Computing and the Aneka Platform Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computing and Information

36

References

Quick Overview: Rajkumar Buyya and Karthik Sukumar,

Platforms for Building and Deploying Applications for Cloud Computing, CSI Communications, Vol.35, No. 1, Pages: 6-11, ISSN 0970-647X, Computer Society of India (CSI), Mumbai, India, May 2011.

Aneka: C. Vecchiola, X. Chu, and R. Buyya,

Aneka: A Software Platform for .NET-based Cloud Computing, High Speed and Large Scale Scientific Computing, 267-295pp, IOS Press, Amsterdam, Netherlands, 2009.

Software – download: http://www.manjrasoft.com/

Wiley Press, New York, USA, Feb 2011