Oxford eScienceOxford eScienceOxGrid:

Virtualisation at OxfordRhys Newman

Manager of Interdisciplinary Grid Development, Oxford University

Campus Grid Workshop – Edinburgh June 2005

Spare Computer Spare Computer ResourcesResources

Yesterday’s analysis shows how the costs of a Yesterday’s analysis shows how the costs of a campus grid will be about £30k per week.campus grid will be about £30k per week.• Still much cheaper than £6 million to buy the machines Still much cheaper than £6 million to buy the machines

to do the same work, and to do the same work, and stillstill have to pay for the have to pay for the electricity!electricity!

Assuming 20000 machines available with average Assuming 20000 machines available with average age less than 3 years, there may be up to 500TB age less than 3 years, there may be up to 500TB availableavailable• Still cannot quantify this figure precisely.Still cannot quantify this figure precisely.• But storage is easier to manage with simpler technology, But storage is easier to manage with simpler technology,

and does not have the associated running costs.and does not have the associated running costs.

Oxgrid ClientOxgrid Client

A background “screen saver” to manage A background “screen saver” to manage idle/spare resources.idle/spare resources.

Developed in Java for cross platform propertiesDeveloped in Java for cross platform properties• A very useful attribute for heterogeneous computing A very useful attribute for heterogeneous computing

environments.environments. Initially will be used to assess how much CPU Initially will be used to assess how much CPU

time and storage can be harnessed without time and storage can be harnessed without impacting users (machine owners).impacting users (machine owners).

Oxgrid ClientOxgrid Client Most computers (90% or more) run Windows, so Most computers (90% or more) run Windows, so

initial prototype designed for that, rather than initial prototype designed for that, rather than YALA.YALA.

Oxgrid Client runs in the background and can be Oxgrid Client runs in the background and can be configured by the Oxgrid Icon in the system tray.configured by the Oxgrid Icon in the system tray.

End user (host machine) acceptance:End user (host machine) acceptance:• Does it interfere with normal work?Does it interfere with normal work?• Does it cause any instability of the machine?Does it cause any instability of the machine?• Is it easy to use and understand (provider’s Is it easy to use and understand (provider’s

perspective)?perspective)?

Oxgrid ClientOxgrid Client

Oxgrid ClientOxgrid ClientAdvanced ScheduleAdvanced Schedule

Software Only:1. Storable/Freezable2. Relocatable over the

network

Emulation / Emulation / VirtualisationVirtualisation

A Virtual Machine can be frozen on A Virtual Machine can be frozen on command to provide OS level command to provide OS level checkpointing!checkpointing!

A management system can monitor A management system can monitor progress of jobs and continually match progress of jobs and continually match them to idle resources, moving them at them to idle resources, moving them at will.will.

host hardwarehost OS

Emulatorother

softwareEmulated hardwareGuest OS

Grid Job

FundamentalsFundamentals Moving a whole disk image of an OS Moving a whole disk image of an OS

around the network to find a CPU.around the network to find a CPU. Storing whole disk images until free Storing whole disk images until free

processing is available.processing is available. But technology is changing the design But technology is changing the design

considerations.considerations.• CPU x2 in 18 mths, NW x2 in 9 mths, Storage CPU x2 in 18 mths, NW x2 in 9 mths, Storage

£/MB halving in 6 mths.£/MB halving in 6 mths. Systems desiged in the past are built Systems desiged in the past are built

around different assumptions – not around different assumptions – not necessarily the best suited in this new necessarily the best suited in this new world.world.

OxGrid: OperationOxGrid: OperationResearcher:needs lots of computer time/storage

OxGrid Operation CentreManages idle/spare resources

“100 jobs in 24 hours please”

Various IdleResourcesRunning OxGrid Client

First 2 hours hereNext 10 hours here

6 Hours hereFinal 4 hours hereNeed to finish in 24 hours

Each job may only take 12 hoursOxGrid turns many unreliable resources into one large reliable resource

OxGridOxGrid Central Management of virtualised Central Management of virtualised

resources around Oxford University.resources around Oxford University. All key technologies and equipment All key technologies and equipment

needed already exists:needed already exists:• Networking, internet technologies.Networking, internet technologies.• Virtualisation.Virtualisation.• Idle machines and spare storage.Idle machines and spare storage.• real users with real needs.real users with real needs.

Activity does not fit into an existing Activity does not fit into an existing department:department:• too much like product development for too much like product development for

computer sciencecomputer science• too much like product development for too much like product development for

computer services.computer services.

Virtualisation as the Enabling Virtualisation as the Enabling TechnologyTechnology

Virtualisation enables existing resources to Virtualisation enables existing resources to be leveraged without complex security and be leveraged without complex security and software engineering constraints on users. software engineering constraints on users.

Virtualisation guarantees resource Virtualisation guarantees resource providers security and acceptable use by providers security and acceptable use by 33rdrd parties (owner’s perspective). parties (owner’s perspective).

Core technology is open source, technique Core technology is open source, technique is industry standard and no longer suffers is industry standard and no longer suffers from performance issues:from performance issues:• 10 machines at 80% is better than 1 at 100%!10 machines at 80% is better than 1 at 100%!

Interesting OpportunitiesInteresting Opportunities

With virtualisation computing becomes a With virtualisation computing becomes a liquid commodity….liquid commodity….

A commodity can be traded…..A commodity can be traded….. A traded commodity can have derivative A traded commodity can have derivative

instruments…..instruments….. Value can be derived for the main and Value can be derived for the main and

derivative markets.derivative markets. What commercial interests could be here What commercial interests could be here

either as customers or providers?either as customers or providers?

+ =

Coming soon….Coming soon….If Oxgrid can use idle resources If Oxgrid can use idle resources so well within Oxford, so well within Oxford, then it should be as easy to share then it should be as easy to share machines between Universities……machines between Universities……