radko zhelev, ipp bas generic resource framework for cloud systems 1 generic resource framework for...

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems1

Generic Resource Framework for Cloud Systems

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems2

Summary

• Resource abstraction – representing resources in a unified way; generic management without knowledge of the underlying resource access protocol; extensibility; modeling with regards to Cloud requirements

• SOA – OSGi approach; lightweight service architecture; high dynamics

• Distribution topology – Cluster to Cluster management; One Management Cluster per datacenter

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems3

• Typically consist of one or more Datacenters physically spread in strategic geographical locations

Cloud Systems Physics

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems4

Distributed Topology

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems5

Roles• Managed Datacenter Nodes, Devices and

Logical Units – hardware/virtual resources, service applications, configurations, tenant users, maintenance procedures, etc.

• Management Server (MS) Cluster – handles directly the management of resources: maintains resource information, enables monitoring, schedules management operations, performs filtering

• Remote Access Servers (RAS) – consolidate results from MS Clusters and provide administrator access (via GUI or Web Browser) to management and monitoring functionality

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems6

Resource abstraction – the Control Unit

• State Variables – name-value pairs defining the Control Unit state.• Control Unit Actions – the operations available upon the resource. Constructors! and

Destructors• Control Unit Metadata – describing the Interface - State Variables and Actions• Control Unit Type – a class of resources having the same Interface and respectively –

metadata. There may be many instances of the same type (having the same interface), which are in different state (different values of the state variables)

• Control Unit ID – identifier in the scope of the Control Unit Type

Type: My Application Type: User

ID: fooState Variables: Status: running SecureMode: enabledActions: stop() start() setSecureMode(boolean)

ID: john.smithState Variables: username: john.smith email: john.smith@gmail.com roles: view apps, change configsActions: setEmail(String) addRole(String) removeRole(String)

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems7

Control Unit Hierarchies

• Resources are naturally grouped in relations => We define Control Unit Hierarchies – parent and sub Control Units

• Host Control Units – roots of hierarchies

• Components Control Units – belong to certain Resource Host

• Control Unit Identification - 4 elements: (host type, host id, control unit type, control unit id)

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems10

The OSGi PlatformOSGi – Open Service Gateway InitiativeJava Application Platform:- Application lifecycle: OSGi Bundles can be started,

stopped, installed, uninstalled- Service Registry: cooperation model, service orientation- Specification standard: interoperability

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems11

System Architecture

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems12

Use Case: Retrieving Control Unit State

The same is for

invoke action

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems13

System Architecture – optional OSGi on Datacenter Node

Applicable for PAAS and SAASNot applicable for

IAAS

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems17

Use Case: Extensibility - adding new resource management feature

Cloud Company developers have Implemented Agent-based Control Unit representation of a new type of resource.

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems18

Use Case: Extensibility - adding new resource management feature

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems19

Use Case: Extensibility - adding new resource management feature

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems20

Use Case: Extensibility - adding new resource management feature

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems21

Use Case: Extensibility - adding new resource management feature

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems22

Use Case: Extensibility - adding new resource management feature

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems23

Use Case: Extensibility - adding new resource management feature

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems24

Use Case: Extensibility - adding new resource management feature

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems25

Events HandlingTwo known approaches:• Publish/subscribe – publishers send events

without knowledge about the listeners. (convenience for the publishers)

• Subscribe/publish – events are fired in response to a subscriptions (influences efficiency)

Our approach:• Admin applications subscribe into the System – subscription filters are spanned to all physical locations (MS Hosts and Control Unit Agents)• Control Unit Providers fire all state change events into the System• The System decides whether notifications should be delivered

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems26

Related Work and Analysis

• Grid Monitoring Architecture

• SOA – Web Services, OGSA, Globus• Resource Abstraction- schema-based and object based- WSRF and OCCI

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems27

Future Work

• Persistent storing of resource data; search filters• User Management and Access Control

• Rule-based Automations

Shifting responsibility from providers to the system

Receive 10 events that CPU > 90%

Install new application instanceto share the load

Radko Zhelev,IPP BAS

Generic Resource Framework for Cloud Systems28

Thanks for your attention