07/06/11 new features of ws-pgrade (and guse) 2010 q3 - 2011 q2 miklós kozlovszky...
TRANSCRIPT
07/06/11
New Features of WS-PGRADE (and gUSE)
2010 Q3 - 2011 Q2
Miklós Kozlovszky ([email protected])
MTA SZTAKILPDS
07/06/11 2
Outline•External features (WS-PGRADE)
– GridsphereLiferay 6.x based (JSR 168 GS JSR 286 Liferay)
– gUSE remote access specification + implementation
– New portlets• Public key (support of remote resources)• Internal Services Portlet group (visual feedback about the internal services)• Resources (management of the available resources)• gLite Explorer – It gives a chart to the users for configured gLite VOs
– Security enhancement (XSS extinguished)
•Internal features (gUSE)– Statistics & logging
– Submitters• ARC• UNICORE
– Authentication• SAML (Security Assertion Markup Language)
– LFS support
– PBS support
– Computing as a Service” new upcoming technologies as: Google Application Engine new supported middleware
– Optimization of submitter status updates (concurrency API)
•Additional elements
DCI Bridge
Metabroker
Translator service
07/06/11
New portlets
• Internal Services Portlet– group visual feedback
about the internal services
• Resources Portlet– management of the
available resources• gLite Explorer Portlet
– It gives a chart to the users for configured gLite VOs
• Public key Portlet– Support of remote
resources which need dedicated user accounts and SSH level identification.
07/06/11
gUSE remote access
gUSE
WS-PGRADE
ASM
MOSGRID/x Remote client (CLI)
Remote access
API
Programming Environment (JAVA API)
Remote access module(JAVA API)
Chemaxon’s JChem JAVA API
SHIWA
Client side
Server side
ASM
07/06/11
ASM - Basic idea
• A new module called “Application Specific Module” has been developed for gUSE that ease the creation of Application Specified Portlets – The module provides programming API to control applications
developed using gUSE– The module provides programming API to access inner gUSE
services
• Any kind of Graphical interface can be developed on top of this module – GUI written in JSP, JSTL (Java Servlet Tag Library ) and Java– GUI can be customized for the grid application– GUI can be customized for end users
07/06/11
ASM Concept
WS-PGRADE
Internal components
submitter
Desktop or Service grids / cloud / ClustersDCIs
gUSE
Web browserClient
Liferay + Tomcat
07/06/11
ASM Concept contd.
WS-PGRADE
Internal components
submitter
Desktop or Service grids / cloud / ClustersDCIs
gUSE
Web browserClient
Developed web-interface
Liferay + Tomcat
07/06/11
ASM Concept in details
Web browserClient
Developed web-
interface
Web pages (JSP, JSF or other)
JAVA event handler, and inner classes
Application Specific Module API
Configuration files (wsdd)
You develop it
You develop it
07/06/11
Statistics & logging
ObjectiveGeneric method for measuring workflow, job and
resource performance
Solution:Integrate a new service into the WS-PGRADE
Grid Portal Data CollectionMetric CalculationMetric Visualization
07/06/11
Aggregate Job Example
Aggregate Job for
LongRunner
Aggregate Job for
LongRunner
Aggregate Job for Random
Aggregate Job for Random
Inserted IntoInserted Into
Aggregate Job for
LongRunner
Aggregate Job for
LongRunner
Inserted Into
SEEGRID GILDASEEGRID
07/06/11
Workflow InstanceStatus =
Done
Workflow InstanceStatus =
Done
07/06/11
Data Aggregation
Job Status Entries toJob Instance Entries
Job Instance toAggregate Job Entries
07/06/11
Demo
07/06/11
07/06/11
07/06/11
07/06/11
Case studies…-CancerGrid was covered (skipping)
07/06/11
ProSim workflow in g-USE
• UK project for Protein Molecule Simulation on the Grid
• a combination of GEMLCA and standard g-USE jobs
• Executed on 5 different sites of the UK NGS
• Parameter sweeps in phases 3 and 4
• Status: actively used in production
Phase 1Phase 2
07/06/11
MosGrid Science Gateway for Molecular Simulations
• Requirement: Workflow enabled grid portal for UNICORE based on Liferay
• Solution:– Adaptation of WS-PGRADE
from GridSphere to Liferay– Development of UNICORE
Submitter– Support for SAML– Development of ASM support
• See details:– Previous presentation by Sandra
Gesing: A Science Gateway for Molecular Simulations
07/06/11
Advanced simulation event visualization and result analysisSimulations write result files:
vector results: a sequence of (time, value) pairs recorded during simulation
example: queue lengths during simulation; end-to-end delays of arrived packets
typical visualization: line chart
scalar results: values of variables, typically recorded at the end of simulation
example: total number of packets dropped; average throughputtypical visualization: bar chart, x-y plot (scatter plot)
File format: line-oriented text fileyou can use OMNeT++'s tools to process and visualize themor you can use 3rd party tools (R, Matlab, Excel, etc) or write your own
ones for specialized computations
07/06/11
Two types of OMNET portalsOMNET user portal
• User accounts exist for 1 week
• Can handle NED files that use INET and Queuing module sets from OMNET
• No binary come from end user– Portal does grid operations with
one fixed certificate
OMNET developer portal
• Permanent user accounts
• Can handle custom OMNET modules and NED files that handle such modules
• Binaries come from end users– Users are authenticated based
on their personal certificates
07/06/11
OMNeT++ user portalAccount request
07/06/11
OMNeT++ user portalAccount request
07/06/11
OMNeT++ user portal“Account created” email
07/06/11
OMNeT++ user portalPersonal settings
07/06/11
OMNeT++ user portalInput definition window
07/06/11
OMNeT++ user portalSimulation execution window
07/06/11
OMNeT++ user portalSimulation execution window
07/06/11
OMNeT++ user portalSimulation execution window
07/06/11
OMNeT++ user portalResult download window