european commission directorate-general information society unit f2 – grid technologies insert...

Post on 14-Dec-2015

219 Views

Category:

Documents

2 Downloads

Preview:

Click to see full reader

TRANSCRIPT

INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Overview of Overview of GCM GCM (Grid Component Model)(Grid Component Model) andand Grid GridCOMPCOMPEU ProjectEU Project

Denis Caromel Denis Caromel

OASIS INRIA-UNSA-CNRS I3SOASIS INRIA-UNSA-CNRS I3S

Melbourne, Jan. 29 2007Melbourne, Jan. 29 2007

1. ProActive context1. ProActive context2. GCM2. GCM

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

ProActive andProActive and GCM GCM

• StructuringStructuring

of the libraryof the library3 big layersInner bricks

• Component Component

Aspects: notAspects: not

onlyonly

in Cp Box!in Cp Box!

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

ProActiveProActive• New GUIsNew GUIs

IC2D EclipseTimIt

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Grid Computing with Grid Computing with ProActiveProActive

Melbourne

Amsterdam

Beijing

Shanghai

Hierarchical

Deployment

Challenges: Programming Model,

Scale, Latency, Heterogeneity,

Versatility (protocols,firewalls...)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

A

ProActiveProActive : Active objects : Active objects

Proxy

Java Object

A ag = newActive (“A”, […], VirtualNode)V v1 = ag.foo (param);V v2 = ag.bar (param);...v1.bar(); //Wait-By-Necessity

V

Wait-By-Necessity

is a

Dataflow

Synchronization

JVM

A

JVM

Active Object

Future Object Request

Req. Queue

Thread

v1v2 ag

WBN!

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

A

Creating AO and GroupsCreating AO and Groups

Typed Group Java or Active Object

A ag = newActiveGroup (“A”, […], VirtualNode)V v = ag.foo(param);...v.bar(); //Wait-by-necessity

V

Group, Type, and Asynchrony

are crucial for Cpt. and GRID

JVM

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Objects to Distributed ComponentsObjects to Distributed Components

Typed Group Java or Active Object

ComponentIdentity Cpt = newActiveComponent (params);A a = Cpt … .getFcInterface ("interfaceName");V v = a.foo(param);

V

AExample

of a

component

instance

JVM

Truly

Distributed

Components

INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

GCMGCM + +

Scopes and Objectives:Scopes and Objectives:

Grid Codes that Compose and DeployGrid Codes that Compose and Deploy

No programming, No Scripting, … No PainNo programming, No Scripting, … No Pain

Innovation:Innovation:

Composite Components Composite Components

Multicast and GatherCastMulticast and GatherCast

MultiCastMultiCast GatherCastGatherCast

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

• GCM: Grid Component ModelGCM: Grid Component ModelGCM Being defined in the NoE CoreGRID

(42 institutions)

Open Source ObjectWeb ProActive implements a preliminary version of GCMService Oriented: NESSI relation exp.

• GridCOMP takes:GridCOMP takes:GCM as a first specification, ProActive as a starting point, and Open Source reference implementation.

The vision: The vision: GCMGCM to be the GRID to be the GRID GSMGSM

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

GridCOMP PartnersGridCOMP Partners

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

GCM ArchitectureGCM Architecture

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

GCM Technical StructureGCM Technical Structure

1. Component Specification as an XML schema or DTD

2. Run-Time API defined in several languages

C, Java

3. Packaging described as an XML schema

4. Information for Deployment

(Virtual Nodes, … Variables, File Transfer, …)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Content and ActivitiesContent and Activities

• 1 - Primitive Component Programming1 - Primitive Component Programming

• 2 - Legacy Code Wrapping, Interoperability2 - Legacy Code Wrapping, Interoperability

• 3 - Composition and Composites, Deployment3 - Composition and Composites, Deployment

• 4 – Autonomic features4 – Autonomic features

• 5 – IDE for GCM (Composition GUI, etc.)5 – IDE for GCM (Composition GUI, etc.)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Collective InterfacesCollective Interfaces

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Collective InterfacesCollective Interfaces

• SimplifySimplify the design and configuration of the design and configuration of component systemscomponent systems

• ExposeExpose the collective nature of interfaces the collective nature of interfacesCardinality attributeMulticast, Gathercast, gather-multicast

• The framework handles collective behaviour The framework handles collective behaviour • at the level of the interfaceat the level of the interface

• Based on Fractal API : Based on Fractal API : Dedicated controller Interface typing Verifications

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Multicast interfacesMulticast interfaces

Transform a single invocation into a list of invocationsTransform a single invocation into a list of invocations

• Multiple invocationsMultiple invocationsParallelismAsynchronismDispatch

• Data redistribution (invocation parameters)Data redistribution (invocation parameters)Parameterisable: Distribution FunctionBroadcast, scatteringDynamic redistribution: Dynamic dispatch

• Result = Result = listlist of results of results

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Multicast interfacesMulticast interfacesResults as lists of resultsResults as lists of results

Invocation parameters may also be Invocation parameters may also be distributed from listsdistributed from lists

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Gathercast interfacesGathercast interfaces

Transform: Transform:

a list of invocations a list of invocations

a single invocationa single invocation

• Synchronization of incoming Synchronization of incoming invocationsinvocations~ “join” invocationsTimeout / Drop policyBidirectional Bindings (callers

callee)

• Data gatheringData gathering

Aggregation of parameters into lists

• Result: Result:

Redistribution of resultsRedistribution of results

Redistribution function

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Status of GCM in ProActiveStatus of GCM in ProActive

• Partial implementation: Partial implementation: ADL schema, API, Multicast, Gathercast, …Component GUI (prototype)

• Distributed components for various applications: Distributed components for various applications: Numerical, Legacy, …

• On-going experiments:On-going experiments:up to 300+ CPUs

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Current GCM experiments in ProActiveCurrent GCM experiments in ProActive

• JEM3D: 3D JEM3D: 3D electromagnetic electromagnetic application: application:

a single Cp on 300+ a single Cp on 300+ CPUs on GridCPUs on Grid

• Vibro-Acoustic Vibro-Acoustic application with application with EADS (legacy MPI EADS (legacy MPI coupling)coupling)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Current GCM experiments in ProActiveCurrent GCM experiments in ProActive

• IBM:IBM:Security Fingerprint System

• ATOS Origin:ATOS Origin:Financial Application Optimization

• GridSystems:GridSystems:Wing SimulationTelecom Application, EDR processing

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Update on ProActive and GCM (1)Update on ProActive and GCM (1)

• New Version under preparation:New Version under preparation:

Nov. 10: ProActive Version 3.2 Beta

Jan. 26: ProActive Version 3.2(After PlugTests’ Learning, New Web

Site)

New features in 3.2 release:Next slide

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

New Web Site with 3.2 VersionNew Web Site with 3.2 Version

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Chinese Web thank to Tsinghua Univ.Chinese Web thank to Tsinghua Univ.

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Update on ProActive and GCM (2)Update on ProActive and GCM (2)

• New Features in ProActive Version 3.2:New Features in ProActive Version 3.2:New features in 3.2 release:

Conformance tests for Fractal, towards conformance tests for GCM

IC2D Eclipse Plugin

TimIt (Hierarchical, Visual)

Skeleton (improved, with File Transfer, Documentation)

gLite EGEE deployment updated

Support for Java 1.5 Generics:Active Objects can be instantiated from Generic Classes

Some Warnings removed

Improvements in OSGi integration

Prototype TTools for UML modeling of GCM components (TBC)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM

• Once upon a time: Once upon a time: GSM: Global System for Mobile communication

• Process: Process: “critical decisions […] the GSM initiative became a success in

Europe […] Initially the strategy and technical specifications were agreed for

Europe and […] incorporating all non-European requirements […] worldwide to participate ”

From: Gsm & Umts: The Creation From: Gsm & Umts: The Creation

of Global Mobile Communicationsof Global Mobile Communications

Standardization of GSM was crucial for Standardization of GSM was crucial for EU advances in Mobile Telephony EU advances in Mobile Telephony

(Science and Business)(Science and Business)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM

GRID faces the same challenge: GRID faces the same challenge: Build FlexibilityOpennessInteroperability

Objectives:Objectives:

Build a Word-Wide standard for Build a Word-Wide standard for

Science and Business GRIDs: GCMScience and Business GRIDs: GCM

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

GSM and GCM PicturesGSM and GCM Pictures

• GSM cells:GSM cells:

• Components:Components:

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

GSM and GCM PicturesGSM and GCM Pictures

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

GSM and GCM PicturesGSM and GCM Pictures

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Conclusion (1)Conclusion (1) Scientific Issues and DirectionsScientific Issues and Directions

Components in the membrane:Components in the membrane:• Membrane:Membrane:

Meta-Objects Java Objects

• Components:Components:Active Objects

• If Cp in Mb:If Cp in Mb:Active Objects as

Meta-ObjectsNot suited for all

cases. If Dist. AO

If light+local POJOTBD

INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Conclusion (2) Conclusion (2) Key technology advancementsKey technology advancements

• Programming the Grid with reusable, composable, components Programming the Grid with reusable, composable, components vs. ad hoc solutions

• Component for Separation of Concerns and AOP:Component for Separation of Concerns and AOP:Gathercast allows to have synchronisation outside functional code

• Deployment on various architectures Deployment on various architectures Super Computer Center, Clusters, data-center, desktop Grids, …

• Interoperability with related Grid software Interoperability with related Grid software

• Integration into Service Oriented Architecture (SOA)Integration into Service Oriented Architecture (SOA)

INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Conclusion (3) Conclusion (3) Research ChallengesResearch Challenges

• A general enough GCM, still efficientA general enough GCM, still efficient

• Effective composition: Effective composition:

Semantics, Deployment, Portability

• Non-Functional Aspects: Non-Functional Aspects:

Security, Load-Balancing, Fault-tolerance,CP. Specif (Lotos, UML TTools, pNets) and Model Checking Verification

top related