5a. esa & wp9 : scale up study
DESCRIPTION
5a. ESA & WP9 : scale up study. Welcome and introduction (15m) WP9 – Earth Observation Applications (5 0 m) ESA and WP9: infrastr, appl, TB 0/1 (5 0 m) Demonstration of EO applications (45m) ESA and WP9 : scale up , effort, recovery plan (5 0 m) Side ESA actions related to GRID (30m) - PowerPoint PPT PresentationTRANSCRIPT
5a. ESA & WP9: scale up study
ESA DataGrid Review Frascati, 10 June 2002
1. Welcome and introduction (15m)
2. WP9 – Earth Observation Applications (50m)
3. ESA and WP9: infrastr, appl, TB 0/1 (50m)
4. Demonstration of EO applications (45m)
5. ESA and WP9: scale up, effort, recovery plan (50m)
6. Side ESA actions related to GRID (30m)
7. Reviewer separate meeting (60m)
8. Conclusions (30m)
ESA DataGrid Review – 10 June 2002 – n° 2
Summary
ESA and WP9 part 2 (45m) DataGrid EO Scaling up vision (MM,
10m)
DataGrid ESA initial committed effort, present situation and revised plan, reporting and cost statement issues (LF, 20m)
ESA DataGrid Review – 10 June 2002 – n° 3
Task 9.5 Scaling Study
Outcome is the D9.6 Deliverable (Report) Due by end of June
Main Topics: Assesment of Testbed1 Assessment of EO Requirements – Integration of
SpaceGrid results Recommendations for Scaling
General recommendations Specific EO recommendations EO Applications and Technology Survey
Application frameworks for GRID Study on a EO Repository and Workflow Framework
DataGrid EO Scaling up vision
Marcello Mariucci
University of Stuttgart
Institute of Parallel and Distributed High-Performance Systems
Applications of Parallel and Distributed Systems Department
ESA DataGrid Review – 10 June 2002 – n° 5
Introduction
• Earth Observation (EO) Services typically represent a sequence of EO Application Functions
Expl:
• EO Application Functions are geographically distributed, and exchange large EO data products
• Functions are part of large-scale, logically self-contained EO Application Systems, which are independently maintained by EO actors B2B EAI Framework
get_item_catalogue get_item_archive charge_user deliver_product
ESA DataGrid Review – 10 June 2002 – n° 6
ARSENAL Project
– Workflow (control flow)
– Repository (meta data management)
– Web Service and (unified access)
– Grid technology (high-performance processing)
• Study on a large-scale B2B EAI • EO Application Framework
based on
For Details see: [M.Mariucci, B.Mitschang: On Making RAMSES and EO Application Framework. To be published in: The 2002 International Symposium on Information Systems and Engineering, ISE2002, July 2002, San Diego]
ESA DataGrid Review – 10 June 2002 – n° 7
ARSENAL Concepts
• Functional composition: Gathering EO Application Functions to EO Application Components
• Service assembly:Specification of EO application functionrelationships and workflows
• Automation and consistent processing:Execution of EO application services bymeans of a workflow management system
• Information Base:Constitution of a domain-specific, distri-buted database of the EO application’s structural and semantic information
ESA DataGrid Review – 10 June 2002 – n° 8
ARSENAL LayersM
eta
data
Rep
osito
ry
Clients
EO AppServs
EO AppCompDescriptions
Image Processing Archive
Catalogue
ProductPackaging
MeteoModelling
SubscriptionManagement EO AppComp
Implementationsand Deployments
Oil Slick Detectionand Monitoring Weather Forecast
Meta
data
Rep
osito
ry
Clients
EO AppServs
EO AppCompDescriptions
Image Processing Archive
Catalogue
ProductPackaging
MeteoModelling
SubscriptionManagement EO AppComp
Implementationsand Deployments
Oil Slick Detectionand Monitoring Weather Forecast
ESA DataGrid Review – 10 June 2002 – n° 9
ARSENAL Architecture
SystemModelling
Tool
Middleware (Grid, SOAP, CORBA, etc.)
Catalogue Server
Image Processing
Server
COTS
Meteo Modelling Data Fusion
…
EO ApplicationComponents
EO Application Repository
Tools and Engines
EO ApplicationComponent
Model
EO ApplicationService Model
EO System Model
Workflow Engine
…
EO Application Clients
…Coastal Guard
Application
Forestry Application
Admin
COTSValue-Adder
SystemModelling
Tool
Middleware (Grid, SOAP, CORBA, etc.)
Catalogue Server
Image Processing
Server
COTS
Meteo Modelling Data Fusion
…
EO ApplicationComponents
EO Application Repository
Tools and Engines
EO ApplicationComponent
Model
EO ApplicationService Model
EO System Model
Workflow Engine
…
EO Application Clients
…Coastal Guard
Application
Forestry Application
Admin
COTSValue-Adder
ESA DataGrid Review – 10 June 2002 – n° 10
OMG Model Driven Architecture
Model DrivenArchitecture
System Information Model
MOF UML
GRID
Web-Services
CO
RB
A XM
L
Space
Manufacturing
Finance
E-Commerce
Telecom
HealthCare
• ARSENAL is based on a Model Driven Architecture(OMG Standard, 2001)
ESA DataGrid Review – 10 June 2002 – n° 11
ARSENAL Development Process
Asynchronous Collaborative Work
Design-Time Development-Time Run-Time
• Instantiation of the Information Model•Provision of EO AppComps and
collaborative development of flexible EO AppServs•Support during the complete
development life cycle
•Creation of the Information Model(Application Repository)
•Discovery and location of EO AppServs•Execution of EO
AppServs
Asynchronous Collaborative Work
Design-Time Development-Time Run-Time
• Instantiation of the Information Model•Provision of EO AppComps and
collaborative development of flexible EO AppServs•Support during the complete
development life cycle
•Creation of the Information Model(Application Repository)
•Discovery and location of EO AppServs•Execution of EO
AppServs
ESA DataGrid Review – 10 June 2002 – n° 12
ARSENAL Information Model (simplified)
DataConnectors ControlConnectors
DataStructures
Activities
Services
AuthorisationsStructures
Functions
Users Groups
Components
ESA DataGrid Review – 10 June 2002 – n° 13
JDBC/SQL
ARSENAL Prototype
ModellingTool
Web Client
ARSENAL Repository
EO ApplicationComponent
ArsenalDesigner
ODBC/SQL
Web Server
HTTP/SOAP
FDL
EO ApplicationComponent
WorkflowEngine
MQSeries
MQSeries
Grid, RMI, etc.
Grid, CORBA, etc.
DevelopmentTime
DesignTime
RunTime
ESA DataGrid Review – 10 June 2002 – n° 14
Meteo Model
Development
Execution
Value Adding Service ProviderSystem Operator
Replication Manager
Data Flow Manager
Collective
User-
Manager
Image Processor CPU …
Customer
Fabric Resources
Portal
Resource
Fabric
On-Line Storage Meteo Model
Development
Execution
Value Adding Service ProviderSystem Operator
Replication Manager Resource Brokering
Information Service
Control Flow Manager Data Flow Manager
Application
Collective
User -specific Application Environment
Connectivity
Application Repository Manager
Service Development GUI
Resource Manager
Image Processor
Resource Manager
CPU
Resource Manager
…
CustomerCustomer
Resource ManagerResource Manager
Application developer
Fabric ResourcesComponents
Services
Resource
Fabric
On -Line Storage
Outlook