influence of virtualization on process of grid application deployment distributed systems research...

Influence of Virtualization on Process

of Grid Application Deployment

Distributed Systems Research GroupDepartment of Computer Science AGH-UST

Cracow, PolandJacek Cała, Krzysztof Zieliński

CCM case study

Jacek Cała:

comments ON

Jacek Cała:

comments ON

Influence of Virtualization on Process of Grid Application Deployment

DSRG

Cracow Grid Workshop 2006

Background

Virtualization is about creating illusions• there are many CPUs on my one-CPU desktop,

• there is more memory in my system than physical RAM,

• a device is available here while in reality it is 100 km away,

• there is more than one machine in my box.


DSRG


Background

• Virtualization is the process of presenting computing resources in a way which gives benefit over the original configuration

• Virtualization describes the separation of a resource or request for a service from the underlying physical delivery of that service


DSRG


Key Features of Virtualization

• Consolidation– more resources perceived as one e.g. many

hard disk drives creating one storage space

• Partitioning– huge resources dedicated for particular users

e.g. one server machine divided on many virtual servers

– isolation, security, etc.

• Containment– different resources perceived in the same way

e.g. video cards from different vendors available with the same programming interface


DSRG


Techniques of Virtualization

• Machine Virtualization:– Hardware-level virtualization– Hosted virtualization– Hypervisor virtualization

• CPU– HyperThreading, TSS, FSS

• Storage virtualization:– NAS, SAN

• Memory– Virtual Memory

• Language– Virtual machines – Java VM, .NET CLR


DSRG


Execution Manager

TargetManager

Planningtool

Preparationtool

Lunchingtool

Deployment plan

RepositoryManager1

2 3

4

5NodeManager

ApplicationManager

Installationtool

Configurationtool

Softwarepackage Target

Deployment ProcessThe same, selected, virtualization layerRequirements Resources


DSRG


Matching an Application to Resources

Application

Target Domain

Virtualizationdecisions

Mapping


DSRG


D&C Specification

• Deployment and Configuration of Component-based Distributed Applications Specification

• Defined by OMG – first adopted version – April 2006

• Allows describing both resource properties an application requirements

• Platform Independent Model– PSM → CCM


DSRG


D&C – Target Domain

Resource

Bridge

Property

SharedResource

connectionInterconnect

bridge

resource

infoProperty

1..*

*Domain

Node1..* 1..*

*

connect

resourceresource

***

*sharedResource

node interconnect*

Node

SatisfierProperty


DSRG


What is a NODE?

• Most obviously – a computer system

• But may be something smaller:– an OS on virtual machine– a Solaris project– a process – in case of CCM a ComponentServer– a thread

• And why not something larger:– a cluster


DSRG


Node as a Computer System

Computer System/OS in VM

• resources: – CPU, memory, storage,

NIC,

• interconnect:– computer network

• bridge:– switch, router

Node•name : “hare.ics.agh.edu.pl”•label : “hare”

Resource• name : “Hare’s CPU”• resourceType : “CPU”

Resource• name : “Hare’s Memory”• resourceType : “Memory”

Resource• name : “Hare’s HDD”• resourceType : “Storage”

SatisfierProperty• name : “speed”• kind : “Maximum”• dynamic : true• value : 2673

SatisfierProperty• name : “model”• kind : “Attribute”• dynamic : false• value : “Intel Pentium 4”

SatisfierProperty• name : “size”• kind : “Capacity”• dynamic : true• value : 1048576

SatisfierProperty• name : “latency”• kind : “Minimum”• dynamic : false• value : 10

SatisfierProperty• name : “throughput”• kind : “Maximum”• dynamic : false• value : 10000


DSRG


Node as a Process

CCM Component Server• resources:

– heap, stack, threads, priority, CPU usage, start time

– [JVM] GC algorithm, vendor

• interconnect:– IPC shared memory,

pipes, signals– socket (unix, tcp, etc.)

• bridge:– proxy, gateway

Node•name : “CompServer1”•label : “CS1”

Resource• name : “CS1 Memory”• resourceType : “Memory”

Resource• name : “CS1 Load”• resourceType : “CPUUsage”

SatisfierProperty• name : “debugMode”• kind : “Attribute”• dynamic : false• value : false

SatisfierProperty• name : “niceLevel”• kind : “Attribute”• dynamic : false• value : “32”

SatisfierProperty• name : “heapSize”• kind : “Capacity”• dynamic : true• value : 20970520

Resource• name : “CS1 Debug”• resourceType : “ProcessAttributes”

SatisfierProperty• name : “stackSize”• kind : “Capacity”• dynamic : true• value : 1048576


DSRG


Domain Description Techniques

• Common Information Model (CIM)

• Directory Enabled Networking (DEN)

• DEN ng

• WS-Management


DSRG


D&C – App. Requirements

ImplementationRequirement

NamedImplementation

Artifact

ImplementationArtifact

Description

primaryArtifact

MonolithicImplementation

Description

referencedArtifact

1..*

deployRequirement

1*

Requirement

deployRequirement*

ComponentAssembly

Description

Component ImplementationDescription

xor


DSRG


Execution Manager

TargetManager

Planningtool

Preparationtool

Lunchingtool

Deployment plan

Requirements ResourcesRepositoryManager1

2 3

4

5NodeManager

ApplicationManager

Installationtool

Configurationtool

Deployment Process

Softwarepackage Target

The same, selected, virtualization layer

The same description language


DSRG


Definition of D&C Domain

Resource

Bridge

Property

SharedResource

connectionInterconnect

bridge

resource

infoProperty

1..*

*Domain

Node1..* 1..*

*

connect

resourceresource

***

*

sharedResource

node interconnect*

SatisfierProperty

* subnode

property*


DSRG


D&C – App. Requirements

NamedImplementation

Artifact

ImplementationArtifact

Description

primaryArtifact

MonolithicImplementation

Description

referencedArtifact

1..*

1

Requirement

deployRequirement*


deployRequirement

*

ComponentAssembly

Description

Component ImplementationDescription

xor


deployRequirement

*


DSRG


Matching an Application to Resources

ApplicationTarget Domain

Thank you!Any questions?

influence of virtualization on process of grid application deployment distributed systems research...

Documents