Virtualization for autonomous administration of servers

PlanContext

Client Specifications

Xen setting upPreliminary study

Requirements

Architecture

Test Scheme

Integration in TUNeIntroduction to TUNe

Architecture

Wrappers and Reconf diagrams

Project Management

Conclusion

Context

Context

Context Servers cost Electrical Consumption Distributed Servers

Metric Server reservation price Per server electrical consumption

Network load and servers distances

Goal

Minimizing costs =

Bringing together low CPU consumers

minimizing electrical consumption

= Shutting down low CPU

consumers

minimizing communication times

= Bringing together highly communicating servers

Context

Vir

tua

l Ma

chin

e 1

Vir

tua

l Ma

chin

e 2

ExpansionCriteria

ShrinkCriteria

Clients Specification

Client Specifications

Xen Paravirtualization Tools

TUNe

NFS

A working scenario

Client Specifications

Vir

tua

l Ma

chin

e 1

Vir

tua

l Ma

chin

e 2

Request number rising

Request number reduction

Hardware

Domain 0

Abstraction LayerXen Control

InterfaceModified Drivers

User Applications

Xen Control Software

Preliminary Study

User Domain 1

Abstraction Layer

Modified Drivers

User Applications

Xen Hypervisor

User Domain 2

Abstraction Layer

Modified Drivers

User Applications

Dom0-1

DomU

Dom0-2

xm m

igra

te

Preliminary Study

Physical Machine

DomU-1

Dom0

xenbr0

vif2.0vif1.0 vif2.0

vif0.0

eth0

DomU-2

eth0 eth1 eth0

peth0

Preliminary Study

Preliminary Study

Dom0-1

DomU

Dom0-2

xm m

igra

te

NFS server

Requirements

Migration requirements:no task interruption

TCP connection keeping

Results consistency

CPU load independence

Migration performance study:Interruption duration

Migration duration

Delay

Integration in TUNe

A-204-06

DHCP Server

NFS Server

Switch

A-204-02

DNS Server

NTP Server

Architecture

A-204-03 A-204-04

A-204-05

Architecture

dom0

Ubuntu Gutsy Gibbon / Xen Management

Xend Daemon

domU-1

Ubuntu Dapper Drake / NFS root

domU-1

GNU/Linux Debian Etch / NFS root

Tests

Test Scheme

TCP connections preservation Migration of streaming server

Results integrity Writting in a file

CPU load independency Migration with different CPU loads

Interruption duration Ping probing

Delay Comparison with local execution of LU factorizations

Migration duration Comparison with equivalent RMI calls

Migration

Test SchemeResults consistency

Dom0-1

DomU

Dom0-2

Writtingin a file

Migration

Test SchemeCPU Load Independence

Dom0-1

DomU

Dom0-2

CPU loading

Migration

Test SchemeInterruption Duration

Dom0-1

DomU

Dom0-2

Pings

Results: 1s

Monitor Computer

Migration

Test SchemeDelay

DomU

Dom0-2Dom0-1

LUFactorizations

Test SchemeDelay

DomU

Dom0-2

Dom0-1

Chrono

Ping pong Migration

Migration

Test SchemeTCP Connection Preservation

Dom0-1

DomU

Dom0-2

StreamingServer

Streaming Client

Test SchemeTCP Connection Preservation

Streaming Client Output

Dom0 Source Dom0 Destination

Network Traffic Monitor

TUNe

TUNe PresentationComponent-Based Architecture

Fractal Components ADLArchitecture Description Languague

TUNe Presentation High Level management tools

Tune Wrapper

Stubs

Legacy Software

Wrappers

TUNe Presentation Deployment diagrams

S1.configure S2.configure

S1.start

S2.start

S2

+wrapper : String = S2.xml+legacyFile : String = S2.tgz+host-family : String = localhost

1

1

S2

+wrapper : String = S2.xml+legacyFile : String = S2.tgz+host-family : String = localhost

TUNe Presentation Reconfiguration diagrams

this.stop

this.start

this.reconfigure

event

Migration

Pool Architecture

Dom0-1 Dom0-2

DomU

Event

Migrate

TUNe Administrator

Probe0-1 Probe0-2

Pool ArchitectureTUNe wrappers

domU wrapper

StartStop

Migrate

domUProbe wrapper

StartStop

Pool ArchitectureTUNe Diagrams

this.probed.migrate

Migrate

etch1-1.start

etch1-1-Probe.start

Start

etch1-1.stop

etch1-1-Probe.stop

Stop

Project Management

Google Code version control softwareSpecification documentArchitecture documentRisk AnalysisAction ListScheduleTutorials

Project Management

Project ManagementSpecification document

R3

Requirement Formulation

Calculation results will not be affected by virtual machine migration.

RationalMigration should keep virtual machine memory state and hosted applications execution background.

Priority P0

Demand Reference

D4

Test Reference

T3

Project ManagementRisk Analysis

Risk Probability Criticality Product Preventive Actions Corrective Actions

Data loss (large size) 2 1 2 Copy on external hard drive Backup

Data loss (small size) 2 3 6 Copy on SVN repository Backup

Network breakdown 1 2 2Local copy of

documentation and API

Schedule adaptation

System crash (OS, VM) 1 2 2 Installation guide Reinstall

Project ManagementAction List

Deadline Whole team(Xen Attitune Team)

Julien C(Doudou)

Julien L(Juju)

Ezequiel(L’Argentin)

Hery Mathieu(Le J)

Project ManagementSchedule

Project ManagementTutorials

Xen installation and setting up

NFS server

DNS server

DHCP server

NTP server

TUNe

Conclusion

Conclusion

Further improvementsTotal Autonomy

Kdeploy -> Grid

J2EE

Other administration policies

Conclusion

Tests TUNe Improvements

CPU Load OKMigration OKInterruption OKIntegrity OKDelay NOKStreaming NOK

Network Architecture

Hardware Architecture

Xen 3.1

Kernel 19-6

Kernel 18.8NFS root (domU)

DHCP Server

NFS Server

Bug

Filesystem

NFS Boot on DomU

Functionnal configuration

Kernel 22-14

Kernel 18.8Xen (dom0) Wrappers,

Deployment diagram

Reconf Diagram,Probe TUNe modifications

Streaming scenario

kdeployJ2EE

Policies

NTP Server

DNS Server

Clock issues

Synchronisationissues

Issues resolved

Name resolution

Delay OKStreaming OK

Network Architecture

Hardware Architecture

Tests

CPU Load OKMigration OKInterruption OKIntegrity OKDelay NOKStreaming NOK

Kernel 18.8Xen (dom0)

NTP Server

Clock issues

Synchronisationissues

Issues resolved

Functionnal configuration

Delay OKStreaming OK

Conclusion

TUNe Improvements

Wrappers,Deployment diagram

Reconf Diagram,Probe TUNe modifications

Streaming scenario

kdeployJ2EE

Policies

DNS Server

Name resolution

Xen 3.1

Kernel 19-6

Kernel 18.8NFS root (domU)

DHCP Server

NFS Server

Bug

Filesystem

NFS Boot on DomU

Kernel 22-14

Network Architecture

Tests TUNe Improvements

Wrappers,Deployment diagram

Reconf Diagram,Probe TUNe modifications

Streaming scenario

kdeployJ2EE

Policies

DNS Server

Name resolution

Delay OKStreaming OK

Conclusion

Hardware Architecture

CPU Load OKMigration OKInterruption OKIntegrity OKDelay NOKStreaming NOK

Kernel 18.8Xen (dom0)

NTP Server

Clock issues

Synchronisationissues

Issues resolved

Xen 3.1

Kernel 19-6

Kernel 18.8NFS root (domU)

DHCP Server

NFS Server

Bug

Filesystem

NFS Boot on DomU

Functionnal configuration

Kernel 22-14

Network Architecture

Conclusion

Hardware Architecture

Tests TUNe Improvements

CPU Load OKMigration OKInterruption OKIntegrity OKDelay NOKStreaming NOK

Kernel 18.8Xen (dom0) Wrappers,

Deployment diagram

Reconf Diagram,Probe TUNe modifications

Streaming scenario

kdeployJ2EE

Policies

NTP Server

DNS Server

Clock issues

Synchronisationissues

Issues resolved

Name resolution

Xen 3.1

Kernel 19-6

Kernel 18.8NFS root (domU)

DHCP Server

NFS Server

Bug

Filesystem

NFS Boot on DomU

Functionnal configuration

Kernel 22-14

Delay OKStreaming OK

Questions