e-science collaboration between the uk and china paul townend ( [email protected]...
TRANSCRIPT
e-Science Collaboration between the UK and China
Paul Townend ( [email protected] )University of Leeds
• Leeds and Beihang have been collaborating together to integrate the White Rose Grid with the CROWN Grid system, developed by Beihang
• This collaboration is called CoLaB, and is co-led by Prof. J. Huai at Beihang and Prof. J Xu at Leeds, and managed by the EPSRC WRG e-Science Centre
• Weekly meetings which involve many participants in the collaboration take place using the Access Grid, and regular research seminars are organised
• CROWN has been deployed and registered at Leeds, with both normal and “secure” CROWN servers installed
• A Resource Location and Discovery Service (RLDS) has been deployed to register and maintain information about the resources available at Leeds. This RLDS service is in turn registered with the main CROWN RLDS service located at Beihang, thus connecting the two Grids together
CoLaBCoLaB: Collaboration between Leeds & Beihang
• To test the initial linkup, BLAST (Basic Local Alignment Search Tool) and AREM (Advanced Regional Eta-coordinate numerical prediction Model) services have been deployed, and jobs scheduled and executed across the Leeds/Beihang system
Initial Linkup and the g-Viz Application
• A computational biological visualization service (developed within the g-Viz project at Leeds) has also been deployed
• Compatibility between GT4 and CROWN has been demonstrated
• Visualization services on a global scale were tested and are running successfully
2005 e-Science AHM @ Nottingham…
Leeds Grid (WRG/Testgrid) CROWN GRID
Alternative 1 SimulationsWeb Services(GT4)
Portal
Alternative 2 SimulationsPortal
Web Services (CROWN Middleware)
Alternative 3 SimulationsPortal
SimulationsWeb Services (CROWN Middleware)
SimSim
Web PortalWeb Portal
Visualization Service AVisualization Service A
SimSim
Visualization Service BVisualization Service B
SimSimSimSim
SimSim
SimSim
Live Demonstration @ Nottingham
• Two joint research sub-groups have been created, leveraging expertise at the two sites in order to perform research in the areas of i) Grid Security and Dependability, and ii) Evaluation of Grid systems, with the intention of publishing joint papers and developing advanced Grid middleware and applications
• One of the key features required of a Grid application is the ability to deliver non-trivial levels of Quality of Service (QoS), even when the application itself may use autonomous resources across a wide-range of administrative domains
• However, to date, the subject of dependability has been strangely neglected, with no large-scale community effort in providing tools to facilitate the development of dependable Grid applications
• The CoLaB Security & Dependability Group are proposing a number of extensions to the CROWN middleware to facilitate the development of more dependable applications
Stage Two: Joint Research & Development
• We are integrating the PreServ provenance system developed at Southampton into the main CROWN middleware in order to build up a Grid environment in which fault/intrusion tolerance can be achieved
• This system is to be turned off by default, but to be configurable via the CROWN administrative interface (new in CROWN 2.0)
• Developers at both sites have been assigned to work on this integration as we speak, and the CoLaB team are in close communication with researchers in Southampton to facilitate this integration
• Once this is complete, the FT-Grid fault tolerance system (developed at Leeds) will be integrated into CROWN
• The FT-Grid system can query provenance data produced using PreServ in order to build up topology information that in turn can be used in fault tolerance adjudication mechanisms
Stage Two: Current Progress & Future Plan (1)
• This CoLaB work will have significant benefits to the CROWN project, and a strong differentiation between CROWN and Globus
• CROWN will become the first major Grid middleware system to have an integrated provenance system, and the first to have integrated fault tolerance mechanisms (which will also provide CROWN with a certain amount of Intrusion Tolerance capability)
• Theoretical research will be also performed to enhance the benefits of using these systems
Stage Two: Current Progress & Future Plan (2)
Tax Lookup Services
TL3TL2TL1
Exchange Rate services
ER3ER2ER1 ER4
Provenance Service
Provenance StorePReServ
UDDI Repository
UDDI Database
Clientapplication
Import Duty Services
ID1 ID2 ID3
ID4 ID5
Websphere
• The CoLaB Evaluation Group are using and improving the Grid-FIT tool, developed at Leeds
• Grid-FIT is a tool for assessing the dependability of Grid middleware based on fault/attack injection
• It can intercept and manipulate SOAP messages between services, and has the capability to manipulate specific RPC parameters within a message
• Grid-FIT will be used intensively to evaluate both CROWN and Globus v4 in terms of system performance under both the fault-free and faulty conditions
Stage Two: Current Progress & Future Plan (3)
Instrumented SOAP API
Original SOAP Protocol Stack
Web Service
Send Hook
Receive H
ook
Original Sending Layer
Intercept Retransmit
Intercep
t R
etransm
it
Origin
al Receivin
g Layer
Receive
Quick Trigger
Transmit
Message Trigger
Fault Injection
Results
Log
WS-FIT
wi
ni
rr
q wt
tt
ti
nt
rt
Process ² p
Questions?