2008-06-26gerard lemson theory in the vo and the simdb specification euro-vo dca workshop garching,...

2008-06-26 Gerard Lemson

Theory in the VOand the SimDB specification

Euro-VO DCA workshopGarching, June 26, 2008

Feedback questionnaire

2008-06-26 Gerard Lemson

Overview Theory in the VO

Definition Motivation Issues

Standardisation for theory Existing standards Theory interest group: SimDB and SimDAP Prototype implementations

2008-06-26 Gerard Lemson

What theory? Simulation resultss

raw, “Level-0” data Post-processing, Level-1 products

halo catalogues theoretical spectra ...

Synthetic observations (Level 2) virtual telescope

Analysis (Level 3?) correlation functions power spectra ...

Services related to these

This talk, focus on LARGE simulations and post-processing products 3+1D, spatial/temporal “micro-physics” simulations under discussion, sometimes already

supported.

2008-06-26 Gerard Lemson

Detailed observations

electron density

gas pressuregas temperature

Courtesy Alexis Finoguenov, Ulrich Briel, Peter Schuecker, (MPE)

2008-06-26 Gerard Lemson

Require detailed models

Courtesy Volker Springel

2008-06-26 Gerard Lemson

Observations in the VO Most VO efforts concentrate on observational

data sets simple observables: photons detected at a certain

time from a certain area on the sky long history of archiving pre-existing standards (FITS) valuable over long time (digitising >80 yr old

plates) Standards observationally biased

common sky: cone search, SIAP, region common objects: XMatch data models: characterisation of sky/time/energy,

STC

2008-06-26 Gerard Lemson

Theory in the VO: issues Simulations not so simple

Complex observables, non-standard No standardisation on data formats or metadata Archiving ad hoc, for local use

Moore’s law makes useful lifetime relatively short: few years later can do better

Current IVOA standards somewhat irrelevant No common sky No common objects New data models required for content, physics,

code

2008-06-26 Gerard Lemson

“Moore’s law” for N-body simulations

Courtesy Simon White

Millennium Run

Mare Nostrum

2008-06-26 Gerard Lemson

Historical simulations

Toomre & Toomre, 1972

Di Matteo, Springel and Hernquist, 2005

Volker Springel

2008-06-26 Gerard Lemson

Theory in the VO: issues Simulations not so simple

Complex observables, non-standard No standardisation on data formats or metadata Archiving ad hoc, for local use

Moore’s law makes useful lifetime relatively short: few years later can do better

Current IVOA standards somewhat irrelevant No common sky No common objects New data models required for content, physics,

code

2008-06-26 Gerard Lemson

So why bother? Simulations are interesting:

For many cases only way to see processes in action

Complex observations require sophisticated models for interpretation

Bridging gap in specialisations: not everyone has required expertise to create simulations, though they can analyse them.

Many use cases do not require the latest/greatest exposure time calculator survey design

2008-06-26 Gerard Lemson

DAL standards Similarity of

products SSAP

theory spectra SCS-like

mock catalogues SIAP-like

visualisation services

2008-06-26 Gerard Lemson

Other Registry

Allows any web service ADQL + TAP

theory SkyNode (Rick Wagner) Millennium Run (see later today)

Applications VisIVO (see later today)

Semantics theory UCDs Vocabularies/ontologies for astronomical

objects, physical processes, ...

2008-06-26 Gerard Lemson

SimDB and SimDAP Effort of IVOA theory interest group Originally attempt at S*AP protocol for

simulations (SNAP) queryData getData

DAL v2: based on data model. queryData in terms of elements in DM

getData special attention large datasets no uniform formats see SimDAP presentation (Claudio Gheller)

2008-06-26 Gerard Lemson

SimDB: Simulation Database Supports discovery of interesting

simulation results. and links to (SimDAP)services for

accessing them Rich data model describing simulations

and post-processing products Focused on 3+1D simulations

but easily extended

2008-06-26 Gerard Lemson

Common questions What was simulated?

LSS, galaxy merger, rings of Saturn What physics was included?

gravity only, hydrodynamics, chemistry How is the world represented?

N bodies, adaptive mesh, spherically symmetric 1D

What properties are calculated? position, velocity, mass, temperature, density,

chemical abundances How do I get access? etc.

2008-06-26 Gerard Lemson

SimDB: Data model (in progress)

2008-06-26 Gerard Lemson

File

2008-06-26 Gerard Lemson

Storage

2008-06-26 Gerard Lemson

Results of Experiments

2008-06-26 Gerard Lemson

Experiments

2008-06-26 Gerard Lemson

Protocol

2008-06-26 Gerard Lemson

Parameters

2008-06-26 Gerard Lemson

Target

2008-06-26 Gerard Lemson

Web service

2008-06-26 Gerard Lemson

SimDB data model

2008-06-26 Gerard Lemson

Complex? Registry data

model

Spectrum Data Model

STC SDSS SkyServer

etc.

2008-06-26 Gerard Lemson

Representations (Generated)* XML Schemas

Protocol: PDR code (courtesy Franck LePetit + Laurent Bourges)

Simulation: Millennium Run Ideally generated from simulation and post-

processing pipe-lines Relational Database Schema Java code HTML

* http://code.google.com/p/volute/wiki/TheoryHome

2008-06-26 Gerard Lemson

XML fragments (PDR protocol)

2008-06-26 Gerard Lemson

Representations (Generated)* XML Schemas

Protocol: PDR code (courtesy Franck LePetit + Laurent Bourges)

Simulation: Millennium Run Ideally generated from simulation and post-

processing pipe-lines Relational Database Schema Java code HTML

* http://code.google.com/p/volute/wiki/TheoryHome

2008-06-26 Gerard Lemson

RDB views (ADQL/TAP interface)

2008-06-26 Gerard Lemson

RDB tables (generated)

2008-06-26 Gerard Lemson

Representations (Generated)* XML Schemas

Protocol: PDR code (courtesy Franck LePetit + Laurent Bourges)

Simulation: Millennium Run Ideally generated from simulation and post-

processing pipe-lines Relational Database Schema Java code HTML

* http://code.google.com/p/volute/wiki/TheoryHome

2008-06-26 Gerard Lemson

SimDB: Implementation Complex data model requires more

advanced support Simple HTTP requests insufficient Browsing or full query language needed

More registry than S*AP queryData a few central sites (France, Germany,

Italy, USA) with advanced access methods

2008-06-26 Gerard Lemson

(Laurent Bourges)

2008-06-26 Gerard Lemson

Access Services (in progress) ADQL+TAP

relational mapping global-as-view wrapping

“REST” XML documents GET and PUT (and DELETE ?)

OAI ala Resource Registry harvesting

Web Browsing (example) Fully generated support possible (in

progress)

2008-06-26 Gerard Lemson

Prototypes CNRS

GalMER ITVO

Trieste: http://wwwas.oats.inaf.it/IA2/ITVO Catania: http://itvo.oact.inaf.it

Under development SimCat (UCSD) PDR/SimDB (Paris) Horizon/GalICS (Lyon) GAVO (hydro simulations)

2008-06-26 Gerard Lemson

Main message SimDB/SimDAP in progress Participate in the IVOA theory interest

group If you have a “theory service”

whether standard or not: wrap it deploy it register it

2008-06-26 Gerard Lemson

Thank you.

Thanks toUgo BeccianiLaurent BourgesIgor ChillingarianClaudio GhellerNorman GrayFranck LePetitMireille LouysPatrizia ManzatoRick WagnerHervé Wozniak