european commission directorate-general information society unit f2 – grid technologies insert...

INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Overview of Overview of GCM GCM (Grid Component Model)(Grid Component Model) andand Grid GridCOMPCOMPEU ProjectEU Project

Denis Caromel Denis Caromel

OASIS INRIA-UNSA-CNRS I3SOASIS INRIA-UNSA-CNRS I3S

Melbourne, Jan. 29 2007Melbourne, Jan. 29 2007

1. ProActive context1. ProActive context2. GCM2. GCM



ProActive andProActive and GCM GCM

• StructuringStructuring

of the libraryof the library3 big layersInner bricks

• Component Component

Aspects: notAspects: not

onlyonly

in Cp Box!in Cp Box!



ProActiveProActive• New GUIsNew GUIs

IC2D EclipseTimIt



Grid Computing with Grid Computing with ProActiveProActive

Melbourne

Amsterdam

Beijing

Shanghai

Hierarchical

Deployment

Challenges: Programming Model,

Scale, Latency, Heterogeneity,

Versatility (protocols,firewalls...)



A

ProActiveProActive : Active objects : Active objects

Proxy

Java Object

A ag = newActive (“A”, […], VirtualNode)V v1 = ag.foo (param);V v2 = ag.bar (param);...v1.bar(); //Wait-By-Necessity

V

Wait-By-Necessity

is a

Dataflow

Synchronization

JVM

A

JVM

Active Object

Future Object Request

Req. Queue

Thread

v1v2 ag

WBN!



A

Creating AO and GroupsCreating AO and Groups

Typed Group Java or Active Object

A ag = newActiveGroup (“A”, […], VirtualNode)V v = ag.foo(param);...v.bar(); //Wait-by-necessity

V

Group, Type, and Asynchrony

are crucial for Cpt. and GRID

JVM



Objects to Distributed ComponentsObjects to Distributed Components

Typed Group Java or Active Object

ComponentIdentity Cpt = newActiveComponent (params);A a = Cpt … .getFcInterface ("interfaceName");V v = a.foo(param);

V

AExample

of a

component

instance

JVM

Truly

Distributed

Components




GCMGCM + +

Scopes and Objectives:Scopes and Objectives:

Grid Codes that Compose and DeployGrid Codes that Compose and Deploy

No programming, No Scripting, … No PainNo programming, No Scripting, … No Pain

Innovation:Innovation:

Composite Components Composite Components

Multicast and GatherCastMulticast and GatherCast

MultiCastMultiCast GatherCastGatherCast



• GCM: Grid Component ModelGCM: Grid Component ModelGCM Being defined in the NoE CoreGRID

(42 institutions)

Open Source ObjectWeb ProActive implements a preliminary version of GCMService Oriented: NESSI relation exp.

• GridCOMP takes:GridCOMP takes:GCM as a first specification, ProActive as a starting point, and Open Source reference implementation.

The vision: The vision: GCMGCM to be the GRID to be the GRID GSMGSM



GridCOMP PartnersGridCOMP Partners



GCM ArchitectureGCM Architecture



GCM Technical StructureGCM Technical Structure

1. Component Specification as an XML schema or DTD

2. Run-Time API defined in several languages

C, Java

3. Packaging described as an XML schema

4. Information for Deployment

(Virtual Nodes, … Variables, File Transfer, …)



Content and ActivitiesContent and Activities

• 1 - Primitive Component Programming1 - Primitive Component Programming

• 2 - Legacy Code Wrapping, Interoperability2 - Legacy Code Wrapping, Interoperability

• 3 - Composition and Composites, Deployment3 - Composition and Composites, Deployment

• 4 – Autonomic features4 – Autonomic features

• 5 – IDE for GCM (Composition GUI, etc.)5 – IDE for GCM (Composition GUI, etc.)



Collective InterfacesCollective Interfaces



Collective InterfacesCollective Interfaces

• SimplifySimplify the design and configuration of the design and configuration of component systemscomponent systems

• ExposeExpose the collective nature of interfaces the collective nature of interfacesCardinality attributeMulticast, Gathercast, gather-multicast

• The framework handles collective behaviour The framework handles collective behaviour • at the level of the interfaceat the level of the interface

• Based on Fractal API : Based on Fractal API : Dedicated controller Interface typing Verifications



Multicast interfacesMulticast interfaces

Transform a single invocation into a list of invocationsTransform a single invocation into a list of invocations

• Multiple invocationsMultiple invocationsParallelismAsynchronismDispatch

• Data redistribution (invocation parameters)Data redistribution (invocation parameters)Parameterisable: Distribution FunctionBroadcast, scatteringDynamic redistribution: Dynamic dispatch

• Result = Result = listlist of results of results



Multicast interfacesMulticast interfacesResults as lists of resultsResults as lists of results

Invocation parameters may also be Invocation parameters may also be distributed from listsdistributed from lists



Gathercast interfacesGathercast interfaces

Transform: Transform:

a list of invocations a list of invocations

a single invocationa single invocation

• Synchronization of incoming Synchronization of incoming invocationsinvocations~ “join” invocationsTimeout / Drop policyBidirectional Bindings (callers

callee)

• Data gatheringData gathering

Aggregation of parameters into lists

• Result: Result:

Redistribution of resultsRedistribution of results

Redistribution function



Status of GCM in ProActiveStatus of GCM in ProActive

• Partial implementation: Partial implementation: ADL schema, API, Multicast, Gathercast, …Component GUI (prototype)

• Distributed components for various applications: Distributed components for various applications: Numerical, Legacy, …

• On-going experiments:On-going experiments:up to 300+ CPUs



Current GCM experiments in ProActiveCurrent GCM experiments in ProActive

• JEM3D: 3D JEM3D: 3D electromagnetic electromagnetic application: application:

a single Cp on 300+ a single Cp on 300+ CPUs on GridCPUs on Grid

• Vibro-Acoustic Vibro-Acoustic application with application with EADS (legacy MPI EADS (legacy MPI coupling)coupling)



Current GCM experiments in ProActiveCurrent GCM experiments in ProActive

• IBM:IBM:Security Fingerprint System

• ATOS Origin:ATOS Origin:Financial Application Optimization

• GridSystems:GridSystems:Wing SimulationTelecom Application, EDR processing



Update on ProActive and GCM (1)Update on ProActive and GCM (1)

• New Version under preparation:New Version under preparation:

Nov. 10: ProActive Version 3.2 Beta

Jan. 26: ProActive Version 3.2(After PlugTests’ Learning, New Web

Site)

New features in 3.2 release:Next slide



New Web Site with 3.2 VersionNew Web Site with 3.2 Version



Chinese Web thank to Tsinghua Univ.Chinese Web thank to Tsinghua Univ.



Update on ProActive and GCM (2)Update on ProActive and GCM (2)

• New Features in ProActive Version 3.2:New Features in ProActive Version 3.2:New features in 3.2 release:

Conformance tests for Fractal, towards conformance tests for GCM

IC2D Eclipse Plugin

TimIt (Hierarchical, Visual)

Skeleton (improved, with File Transfer, Documentation)

gLite EGEE deployment updated

Support for Java 1.5 Generics:Active Objects can be instantiated from Generic Classes

Some Warnings removed

Improvements in OSGi integration

Prototype TTools for UML modeling of GCM components (TBC)



A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM

• Once upon a time: Once upon a time: GSM: Global System for Mobile communication

• Process: Process: “critical decisions […] the GSM initiative became a success in

Europe […] Initially the strategy and technical specifications were agreed for

Europe and […] incorporating all non-European requirements […] worldwide to participate ”

From: Gsm & Umts: The Creation From: Gsm & Umts: The Creation

of Global Mobile Communicationsof Global Mobile Communications

Standardization of GSM was crucial for Standardization of GSM was crucial for EU advances in Mobile Telephony EU advances in Mobile Telephony

(Science and Business)(Science and Business)



A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM

GRID faces the same challenge: GRID faces the same challenge: Build FlexibilityOpennessInteroperability

Objectives:Objectives:

Build a Word-Wide standard for Build a Word-Wide standard for

Science and Business GRIDs: GCMScience and Business GRIDs: GCM



GSM and GCM PicturesGSM and GCM Pictures

• GSM cells:GSM cells:

• Components:Components:



GSM and GCM PicturesGSM and GCM Pictures



Conclusion (1)Conclusion (1) Scientific Issues and DirectionsScientific Issues and Directions

Components in the membrane:Components in the membrane:• Membrane:Membrane:

Meta-Objects Java Objects

• Components:Components:Active Objects

• If Cp in Mb:If Cp in Mb:Active Objects as

Meta-ObjectsNot suited for all

cases. If Dist. AO

If light+local POJOTBD




Conclusion (2) Conclusion (2) Key technology advancementsKey technology advancements

• Programming the Grid with reusable, composable, components Programming the Grid with reusable, composable, components vs. ad hoc solutions

• Component for Separation of Concerns and AOP:Component for Separation of Concerns and AOP:Gathercast allows to have synchronisation outside functional code

• Deployment on various architectures Deployment on various architectures Super Computer Center, Clusters, data-center, desktop Grids, …

• Interoperability with related Grid software Interoperability with related Grid software

• Integration into Service Oriented Architecture (SOA)Integration into Service Oriented Architecture (SOA)




Conclusion (3) Conclusion (3) Research ChallengesResearch Challenges

• A general enough GCM, still efficientA general enough GCM, still efficient

• Effective composition: Effective composition:

Semantics, Deployment, Portability

• Non-Functional Aspects: Non-Functional Aspects:

Security, Load-Balancing, Fault-tolerance,CP. Specif (Lotos, UML TTools, pNets) and Model Checking Verification

european commission directorate-general information society unit f2 – grid technologies insert...

Documents

gcm slide

grid jvm slide

grid gsm slide

grid component model

grid codes

fooparam v

gcm structuring structuring

necessity v group