the grid component model and its implementation in proactive coregrid network of excellence,...
TRANSCRIPT
![Page 1: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/1.jpg)
The Grid Component Model and its Implementation in ProActive
CoreGrid Network of Excellence,
Institute on Programming Models
D.PM02 “Proposal for a Grid Component Model”
D.PM.04 “Basic Features of the GCM (assessed)”
![Page 2: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/2.jpg)
Context CoreGrid NoE
Institute on Programming Model aims at defining a component model for the Grid
“By defining the GCM, the V.I. aims at the precise specification of an effective Grid Component Model.”
The features are discussed taking Fractal as the reference model.
The features are defined as extensions to the Fractal specification.
The PM institute expects several different implementations of the GCM, not necessarily relying on existing Fractal implementations.
![Page 3: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/3.jpg)
Outline
A Summary of Fractal
Communication semantics
Dynamic Controllers, adaptativity and Autonomicity
Parallelism and Distribution
The GCM in ProActive
![Page 4: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/4.jpg)
GCM is Based on Fractal
Fractal provides: Terminology, API (and ADL) Interoperability Hierarchical structure Separation of concerns Abstract component model no constrain on
implementation: several implementations exist Multi-level specification: almost every object is a level 0
Fractal component
We can imagine a multi-level specification of the GCM
We focus on the Grid specific extensions of Fractal
general features
![Page 5: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/5.jpg)
A Fractal Component
![Page 6: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/6.jpg)
Outline
A Summary of Fractal
Communication semantics
Dynamic Controllers, adaptativity and Autonomicity
Parallelism and Distribution
The GCM in ProActive
![Page 7: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/7.jpg)
Communications
Fractal: somewhat “unspecified”, notion of “address space” most implementations use synchronous primitive
bindings, but not all of them, Composite bindings allow for “other” communication
semantics In the GCM:
Communication semantics should be specified in the interfaces
Asynchronous method call is the default
![Page 8: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/8.jpg)
Outline
A Summary of Fractal
Communication semantics
Dynamic Controllers, adaptativity and Autonomicity
Parallelism and Distribution
The GCM in ProActive
![Page 9: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/9.jpg)
Dynamic Controllers (components in component’s membrane)
Interest for the GCM: Reconfiguration and adaptativity of the membranes For autonomic aspects:
hierarchical composition of autonomic aspects (also multicast)
Fractal (GCM) Components in the menbrane
Apply Fractal specification to the non-functional aspect Pluggable NF server interfaces (NF components) NF client interfaces
![Page 10: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/10.jpg)
Dynamic Controllers (2)
Adaptativity and autonomicity Dynamic reconfiguration of the controllers Called component controller Better separation of concerns
Modification of the content controller (for the membrane) Controller components should be lightweight components Might have restriction on distribution or complexity of
component controllers Conformance levels: component controllers are optional
![Page 11: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/11.jpg)
Autonomicity
Self-Configuring: handles reconfiguration inside itself Self-Healing: provides its services in spite of failures Self-Optimising: adapts its configuration and structure
in order to achieve the best/required performance. Self-Protecting: predicts, prevents, detects and
identifies attacks, and to protect itself against them.
Open and extensible specification Several levels of autonomicity depending on:
autonomic controllers implemented autonomicity level implemented by each controller
![Page 12: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/12.jpg)
Outline
A Summary of Fractal
Communication semantics
Dynamic Controllers, adaptativity and Autonomicity
Parallelism and Distribution
The GCM in ProActive
![Page 13: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/13.jpg)
Parallel Components: Distribution
Notion of Virtual Nodes distribution Maps the virtual architecture to a physical one One can envisage more sophisticated information
such as, for instance, topology information, QoS requirements between the nodes, etc.
Parallel components can Be distributed or not Admit several implementation
adaptive implementations
![Page 14: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/14.jpg)
Collective interfaces
Multicast
Gathercast
SPMD by assembly of components
Allow MxN communications.
![Page 15: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/15.jpg)
Current situation (Fractal model)
Simple type system
Component type types of its interfaces
Interface type : Name Signature Role Contingency Cardinality: single or collection (one-to-one)
![Page 16: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/16.jpg)
Proposal
Simplify the design and configuration of component systems
Expose the collective nature of interfaces Cardinality attribute Multicast, gathercast, gather-multicast
The framework handles collective behaviour at the level of the interface
Dedicated and customizable controllers Data distribution strategy defines exposed types
![Page 17: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/17.jpg)
Multicast interfaces
Transform a single invocation into a list of invocations
Multiple invocations Parallelism Asynchronism Dispatch
Data redistribution (invocation parameters) Parameterisable distribution function Broadcast, scattering Dynamic redistribution (dynamic dispatch)
Result = list of results
![Page 18: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/18.jpg)
![Page 19: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/19.jpg)
Gathercast interfaces
Transform a list of invocations into a single invocation
Synchronization of incoming invocations
~ “join” invocations Timeout / drop policy Bidirectional bindings
(callers callee)
Data gathering
Aggregation of parameters (e.g., into lists)
Result: redistribution of results
Redistribution function
![Page 20: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/20.jpg)
Outline
A Summary of Fractal
Communication semantics
Dynamic Controllers, adaptativity and Autonomicity
Parallelism and Distribution
The GCM in ProActive
![Page 21: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/21.jpg)
A Prototype GCM implementation in ProActive
Distributed Fractal implementation
Support for deployment
Asynchronous communication
“Each component is an Active Object”
Plus Multicast and gathercast
![Page 22: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/22.jpg)
Configuration of Collective Interfaces
Interface type = [name, signature, role, contingency, cardinality]
Metadata in signature {class, method, parameter}
@paramDispatch=BLOCK
void foo(List<A> l)
Distribution strategies Block, cyclic Round-robin User-defined
![Page 23: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/23.jpg)
InterfaceType interface:string getFcItfCardinality();
TypeFactory interface:InterfaceType createFcItfType (
…string cardinality
)…
CollectiveInterfacesController Collective interface policy On a per-interface basis Specified at instantiation-time May be updated dynamically
API: Dedicated Controllers
![Page 24: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/24.jpg)
Summary / Conclusion
ProActive/Fractal: Fractal with distributed components and asynchronous method invocation
Multicast/Gathercast specification + implementation: collective communications
Deployment of components « Component Oriented SPMD » Experiments and validation
a prototype implementation of the GCM: ProActive/GCM
![Page 25: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/25.jpg)
Current and Future Works
MxN as an optimization for the coupling of multicast and gathercast
Generalisation of the data distribution and gathering policies for multicast and gathercast (new conditions on typing)
Refinement of the specification and implementation of component controllers
…
![Page 26: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/26.jpg)
![Page 27: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/27.jpg)
Summary: Requirements and Concepts
Hierarchical composition Fractal
Extensibility From Fractal design
dynamic controllers (for non-functional)
open and extensible communication mechanisms
Support for reflection Fractal specification and API
Lightweight Conformance levels
No controller imposed
ADL with support for deployment Virtual Nodes
Packaging packaging being defined by the Fractal community
Support for deployment Notion of virtual nodes
ADL with support for deployment
![Page 28: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/28.jpg)
![Page 29: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/29.jpg)
Sequential and parallel implementation XML component specifications, and Multicast-Gathercast interfaces allow plugging and unplugging several componentsto the same interface dynamically
Asynchronous ports and Extended/Extensible port semantics Asynchronous Method Invocation as default but can be
defined via tags; + Possibility to support method calls / message oriented / streaming / …
Group related communication on interfaces Multicast / Gathercast interfaces
Interoperability Exportation and importation as web-servicesLanguage neutrality API in various languages
Various interface specifications exportation of a web-service port
![Page 30: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/30.jpg)
Adaptivity: Globally due to dynamic controllers
• Exploit Component Hierarchical abstraction for adaptivity
Dynamic controllers
• plug/unplug component Fractal: content + binding controller
• Give a standard for adaptive behavior and unanticipated extension of the model Dynamic controllers
• Give a standard for the autonomic management components
Autonomic controllers
• Plug/unplug non-functional interfaces Dynamic controllers
Parallel binding: Well-defined and verifiable composition
Multicast / Gathercast
![Page 31: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/31.jpg)
Conclusion
Future (technical) works: model has to be refined Technical issues (dynamic controllers) APIs extended ADL (behaviour, dynamic controllers) …
Like in Fractal, we aim at a multi-level specification, an implementation of the GCM can be level 1.1 Fractal compliant and level 1.2.1 GCM compliant. GCM levels to be specified
Next steps: assessment, experiments, (reference) implementations ( GridCOMP)
![Page 32: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/32.jpg)
Questions / Comments ?
![Page 33: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/33.jpg)
Dynamic Controllers
As suggested as an extension of Fractal, controllers can be components (they still belong to the membrane)
![Page 34: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/34.jpg)
![Page 35: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/35.jpg)
![Page 36: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/36.jpg)
![Page 37: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/37.jpg)
Multicast interfaces
![Page 38: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/38.jpg)
Gathercast interfaces
![Page 39: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/39.jpg)
Multicast interfaces
Results as lists of results
Invocation parameters may also be distributed from lists
![Page 40: The Grid Component Model and its Implementation in ProActive CoreGrid Network of Excellence, Institute on Programming Models D.PM02 “Proposal for a Grid](https://reader035.vdocuments.site/reader035/viewer/2022062518/56649e9c5503460f94b9d360/html5/thumbnails/40.jpg)
Current situation in Fractal: 2 cardinalities
Single Collection