grid perspectives at esa/esac [email protected] science archives and vo team computer...
TRANSCRIPT
GRID Perspectives at ESA/ESAC
[email protected] Archives and VO Team
Computer Support Group
ESAC, Villafranca del Castillo, Madrid, Spain
Science Operations & Data Systems Division Research & Scientific Support Department
Christophe ARVISETScience Operations & Data Systems Division
Research & Scientific Support DepartmentIVOA Interop, Victoria, 17/05/2006, page 2
Main Goals of ESAC GRID activities
Build a GRID at ESAC
that can be used by all projects at ESAC
Scientists to use GRID for cpu intensive tasks
Support to Projects for Pipeline Data Processing
Integration with other GRIDs ESTEC, ESRIN, UCM, others, …. Closer link to the VO
Science Operations & Data Systems Division Research & Scientific Support Department
Christophe ARVISETScience Operations & Data Systems Division
Research & Scientific Support DepartmentIVOA Interop, Victoria, 17/05/2006, page 3
Grid Computing
scigrid.esac.esa.intvogrid.esac.esa.int
GT4
Science Operations & Data Systems Division Research & Scientific Support Department
Christophe ARVISETScience Operations & Data Systems Division
Research & Scientific Support DepartmentIVOA Interop, Victoria, 17/05/2006, page 4
How this all is organized?
NET1 LAN
NET4 LAN
OPS FireWall
User Desktop
Happy User
SCIGRIDComputing
Nodes
Mission’sData Archives
SCIGRIDGlobal Overview
Computing Nodes
VO Grid
User’s Data Storage
Firewall Migration is forcing us to divide the Local Grid
To be installed10 nodes, RHEL
dual cpu, 6GB RAM
Scigrid linked to ESTEC GRID ESRIN GRID UCM GRID
Science Operations & Data Systems Division Research & Scientific Support Department
Christophe ARVISETScience Operations & Data Systems Division
Research & Scientific Support DepartmentIVOA Interop, Victoria, 17/05/2006, page 5
GRID for the day to day analysis The user could use the local Grid
to: Run IDL Run SAS, OSA or whatever
mission-specific software interactively
Data visualization Submit massive data
processing batch jobs, … The user will use his/her desktop
for: Internet browsing Email Writing documents MP3 Data visualization
SAS
OSA
iPython
Heasoft
Science Operations & Data Systems Division Research & Scientific Support Department
Christophe ARVISETScience Operations & Data Systems Division
Research & Scientific Support DepartmentIVOA Interop, Victoria, 17/05/2006, page 6
GRID for Project Data Processing
Standard Pipeline Data Processing Bulk and On-the-Fly (OTF) Processing of data Run the Pipeline on many observations Automatic process, no human intervention Perfectly tuned for GRID processing
Migrate XMM-Newton Archive OTF to scigrid (2006)
Run Herschel Pipeline Data Processing on scigrid (2007) Increase number of nodes
GAIA data processing in 2012+ Several hundreds of machines ?
Science Operations & Data Systems Division Research & Scientific Support Department
Christophe ARVISETScience Operations & Data Systems Division
Research & Scientific Support DepartmentIVOA Interop, Victoria, 17/05/2006, page 7
GRID and the Virtual Observatory
Interaction ESA VO and ESAC GRID teams being built up
Main long term goals ESA VO as a data provider ESA VO as a data processing centre
Use the GRID with VO protocols DAL, SSO/Certificates, SkyNode/Xmatch, … Build a VOSpace located on the ESA VO Grid
Like to start linking ESAVO GRID with other VO GRIDs
Science Operations & Data Systems Division Research & Scientific Support Department
Christophe ARVISETScience Operations & Data Systems Division
Research & Scientific Support DepartmentIVOA Interop, Victoria, 17/05/2006, page 8
Example : Xmatch on GRID (TBD)