cnes, jp antikidis, wgiss17 grid session may 2004 a "virtual factory" experiment wide aera...

19
CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso may 2004 Jean pierre Antikidis CNES Programme Directorate "Space Information systems"

Upload: christopher-parrish

Post on 27-Mar-2015

214 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

A "Virtual Factory" experiment

Wide Aera Grid Usage

Generic demonstrative experiment of VFC

17th WGISS,Tromso may 2004Jean pierre Antikidis

CNES Programme Directorate"Space Information systems"

Page 2: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

GRID

Classical GRID based

Page 3: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Virtual machine defined by Middleware primitives

« Pseudo-machine »

Page 4: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

GRIDTechno

Basic Gridprimitives

(middleware)

GRID based High levelservices

"Upperware"

"End User"

"User case"

ServiceDeveloper

Page 5: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

FP5 IST - Grid -related ProjectsGrid Project Portfolio•Infrastructure

DataTag•Computing

EuroGrid, DataGrid, Damien

•Tools and Middleware

GridLab, GRIP

•Applications

EGSO, CrossGrid, FlowGrid, BioGrid, OpenMolGrid, Moses, COG, GEMSS, Grace, Mammogrid, Selene

•P2P / ASP / Webservices

P2People, ASP-BP, WEBSI, MMAPS, GRASP, GRIA

•Clustering

GridStart

Project name Start date Duration Funding (€)1 EUROGRID 01.11.2000 36 2,065,7692 DATAGRID 01.01.2001 36 9,872,5063 DAMIEN 01.01.2001 30 1,229,3484 GRIA 01.12.2001 30 2,016,2135 DATATAG 01.01.2002 24 3,980,8266 GRIDLAB 01.01.2002 36 5,085,9987 GRIP 01.01.2002 24 1,338,9968 EGSO 01.03.2002 36 2,400,0009 CROSSGRID 01.03.2002 36 4,860,00110 MOSES 01.03.2002 30 1,505,60411 MMAPS 01.03.2002 30 2,392,00012 GRIDSTART 01.04.2002 36 1,449,06613 GRASP 01.04.2002 30 1,955,45514 WEBSI 01.05.2002 24 1,799,99815 ASP-BP 01.05.2002 24 3,485,99216 P2PEOPLE 01.07.2002 19 763,58217 FLOWGRID 01.09.2002 24 1,099,12018 OPENMOLGRID 01.09.2002 27 1,988,57919 GRACE 01.09.2002 30 1,889,99520 COG 01.09.2002 18 1,061,70321 BIOGRID 01.09.2002 24 834,44522 GEMSS 01.09.2002 30 2,626,61123 MAMMOGRID 01.09.2002 36 1,899,93824 SELENE 01.11.2002 12 283,000

Total 57,884,745

Page 6: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Page 7: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

A WGISS GRID based Experiment ?

The Virtual Factory ConceptConnect several resource center in a WAGMake Process server availableCreate a virtual distribution schemeAllow the projection by users of needed processPotential partners: Data and GRID providers (Europe+others), Remote job submitter and users (DC representatives ? )

Page 8: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Specific features of the VFC exper.

Not Data specific Not Thematic specificAims at demonstrating the conceptual capability of Virtual services implementation Rely on simple application case and COMPARING conventional and Virtual WAG approaches (including costs elements)Try to identify botlenecking issues and possible needed GRID additions>>Nota: End result is most a fraction of input information !

Page 9: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

An example of Virtual storage handling

Conventional:

Locate the information (catalogues etc..)

Get hold of the data (media, access costs, transmission & delays)

Process the information

Transfert the result to suitable place

WAG based concept:

Create a "Light" Grid connecting a few centers

Make their archive accessible from this GRID

Enable the creation of jobs submitted to this GRID

=>>Then could be demontrated the feasibility of a virtual factory able to dematerialize the handling of information

Page 10: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

W.A.GRID based

Data providers

System designer

User agent

WAG

User case

Data

User data

Real flow

"Virtual elements

GRID

Page 11: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

TECHNOLOGICAL CONVERGENCE

VirtualComputer

Factory

Automated Data Acces

Grid basedadvanced concepts

WAG techno

DC problematic

Page 12: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Some flavor of future Potential test-cases…

Page 13: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Page 14: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Page 15: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Page 16: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Objectives The context of this work package is the strong collaboration with researchers belonging to several university laboratories located in Africa (Ivory Coast, Burkina Faso, Senegal, République Centre Afrique, Bénin and Vietnam..); the African partners having worked in the GIRGEA (Groupe Internationale de Recherches en Géophysique Europe-Afrique) for 10 years. This group has been recently enlarged to Vietnam researchers. The final goal is to provide to scientists from developing countries make use a Wide Aera Grid in order to develop researches in equatorial geophysics. In addition to the experimental data acquisition performed in Africa by the GIRGEA, an empirical equatorial electrojet model has been designed to take into account the observations. This model should now be compared to other related physical parameters, obtained using various instruments.The possibility to translate experimental and theoretical works conducted in Africa into cheap and operational services making use of virtual implementation will be analysed.

Page 17: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Description of work The volume and the quality of the observations are increasing due to global and permanent networks as well as satellites. To carry out geophysical integrated studies, the researchers from developing countries need to combine distributed data bases and large computational resources for addressing the problem of global computations and assimilation of large distributed data sets. Heaven will be an opportunity to provide them such services.The experimental model is based on magnetic measurements carried out continuously along the equator in Africa, Brazil, India and Vietnam. During the International Equatorial Electrojet Year (1993-1994) those networks were extended and a database was constituted. The satellite data has come from the satellite experiment Oersted and Champ. In this first step, the work will consist of describing the software and database in the Virtual contextFor the second step, other satellite databases will be needed by the different models. These models are time-consuming with large sets of data.After the processing, the data are visualised in 1 or 2 D plots, 3D plots may be used in the second step. Geophysical services will be useful to select the interesting zone and plot the satellite data on the map. 

Page 18: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

CONCLUSION

Exchanging performance against design flexibility Create "at whish" "virtual" computer topologyCreate "at whish" any needed distribution scheme(This might induce technological and intellectual changes very comparables to Internet revolution in particular for highly distributed collaborative applications

Proposal: present an experimental layout at WGISS18

Virtual emulation of collaborative processing Virtual emulation of collaborative processing systems (Virtual Factory Concepts) is a rather systems (Virtual Factory Concepts) is a rather elegant approach fully exploiting the potential of elegant approach fully exploiting the potential of GRID systems by taking advantage of the GRID systems by taking advantage of the combination of several properties usaly considered combination of several properties usaly considered as side feature by:as side feature by:

Page 19: CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004 A "Virtual Factory" experiment Wide Aera Grid Usage Generic demonstrative experiment of VFC 17th WGISS,Tromso

CNES, JP ANTIKIDIS, WGISS17 GRID SESSION MAY 2004

Thank You for your attention