Advanced Techniques for Scheduling, Reservation, and Access Management for

Remote Laboratories

Wolfgang Ziegler, Oliver WäldrichFraunhofer Institute SCAI

Philipp WiederResearch Centre Jülich

Workshop on Collaborative Remote Laboratories In conjunction with e-Science 2006

Amsterdam, December 4, 2006

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 2

Acknowledgements

Some of the work reported in this presentation is funded by the German Federal Ministry of Education and Research through the VIOLA project under grant #01AK605F. This presentation also includes work carried out jointly within the CoreGRID Network of Excellence funded by the European Commission’s IST programme under grant

#004265.

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 3

Content

• Motivation• Meta-Scheduling in Grids

– The VIOLA environment– WS-Agreement

• Integrating Remote Laboratories• Perspectives

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 4

Motivation

• Obvious commonalities managing Collaborative Remote Laboratories (CRLs) and Grid resources– Advance reservation allows usage at a defined

point in time– Negotiation of usage conditions– SLAs as reliable contracts between provider &

consumer– Access control based on roles

Evaluate potential of integrating CRLs as resourcesinto existing Grid environments

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 5

VIOLA project

• German project founded by BMBF• Duration June 2004 – April 2007• http://www.viola-testbed.de/• Goals

– Test of advanced network equipment & network architectures

– Development & test of software tools for the user-driven dynamical provision of bandwidth

– Enhancement and test of new advanced applications (e.g. Grid, Virtual Reality)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 6

The VIOLA MetaScheduling Service

Site 1 Site n

Local Scheduler

Site n

Adapter

HTTPS

Partial job n

MetaScheduling Service

…

HTTPS

Local Scheduler

Site 1

Adapter

Partial job 1

Network

NetworkRMS

Adapter

Switch/Router

ClientSubmission of job dataWS-Agreement

HTTPS

WS-Agreement

• Goal: Co-allocation of MPI jobs

• Client initiates the reservation (WS-Agreement) and submits the job-data

• Negotiation of timeslot with local schedulers

• Interface between MetaScheduling Service and local RMS realised through Adapter pattern

• Interface MetaScheduling Service / Adapters based on HTTPS/XML (SOAP)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 7

Negotiation Protocol

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 8

WS-Agreement StructureWS-Agreement characteristics• Protocol for dynamic agreement

management• Terms can relate to:

– functional description– non-functional properties

• WS-Agreement is domain-agnostic• Agreement can involve 4 parties:

– agreement initiator and provider– service consumer and provider

• State can be published and monitored via agreement properties

• Can be chained or nested to represent complex relationships

Service Layer

ConsumerOperations

Server

Service

Agreement Layer Provider

Initiator

Create /Query/Terminate

Agreement

Term Compositor

Creation constraint.

Guarantees

Service Descriptions

Context

Service Properties

Service References

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 9

Virtual Organisation Management

• VOs are used for authorisation in Grids– Already in Globus Toolkit & LCG/gLite – UNICORE in transition

• VOs allow the definition of roles and role based authorisation for resource access and usage

• However, mostly X.509 certificate based (VOMS/VOMRS)• Shibboleth could be an interesting option for CRLs• Interoperability with existing Grid Infrastructures seems to

be a major advantage of using VO technology also for CRLs• Would allow seamless integration

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 10

Integrating Remote Laboratories

Site 1 Site n

Local Scheduler

Site n

Adapter

HTTPS

Partial job n

MetaScheduling Service

…

HTTPS

Local Scheduler

Site 1

Adapter

Partial job 1

Network

NetworkRMS

Adapter

Switch/Router

ClientSubmission of job dataWS-Agreement

HTTPS

WS-Agreement

Laboratory

HTTPS

Local Scheduler

Adapter

Instruments

CollaborationTool

WS-Agreement

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 11

The Role of the MetaScheduling Service

• Negotiation of not only computers and network, but also instruments and people

• Consideration of additional domain-specific SLA terms

• Provision of authorisation information for the initial setup of the collaborative environment

• Service orchestration: launching and managing of services, tools, and applications

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 12

Domain-specific tasks

• Specification of WS-Agreement SLA terms for CRLs

• Connection of the Collaboration Tool to the MetaScheduling Service

• Realisation of adaptors towards– laboratories or instruments (possibly via

Common Instrument Middleware Arch. (CIMA))– people to negotiate common time-slot for

performing the experiment

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 13

Status Quo Vadis?

• Meta-scheduling demonstration– at IST 2006 & CoreGRID Industrial Conf. 2006– Groundwater pollution simulation (& steering)– Co-scheduling of clusters & network

• Ongoing work– From co-allocation to workflow scheduling

• Plans for prototype implementation– Integrating an CRL - looking for volunteers ;-)– Evaluation compared to other approaches