1 s. derriere, ivoa interoperability meeting, pune, 2004/09/27-29 vizier repository lessons learnt...
TRANSCRIPT
![Page 1: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/1.jpg)
1S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
VizieR repositoryVizieR repositoryLessons learnt and issues
![Page 2: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/2.jpg)
2S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
Repository implementationRepository implementation● Uses the VTOAI OAI-PMH2 Perl Data
Provider library (H. Suleman, V. Tech)● Slightly modified to handle namespaces (vs:...)
in elements
● Answers OAI-PMH requests● verbs: Identify, ListSets, ListRecords, GetRecord● from, until● metadataPrefix (ivo_vor), identifier,
resumptionToken (for long lists)
![Page 3: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/3.jpg)
3S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
Repository implementationRepository implementation● http://vizier.u-strasbg.fr/viz-bin/registry/vizier/oai.pl
● Latest version uses VOResource-v0.10● http://vizier.u-strasbg.fr/viz-bin/registry/vizier/oai_test.pl
(in test... will move to oai.pl)
● Only a repository (not full registry)● Dynamical content/answer
● Resources are built on-the-fly from the contents of the VizieR DB
● Uses VizieR metadata to fill resource elements
![Page 4: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/4.jpg)
4S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
Catalogue 2:• Table1• Table2• Table3
Catalogue 3: Obsoleted by Cat34
• Table
Catalogue 1:• Table1• Table2
+ Standardized metadata
• +4300 catalogues• +10000 tables
VizieR structureVizieR structure
Catalogue 2:• Table1• Table2• Table3
Catalogue 3: Obsoleted by Cat34
• Table
Catalogue 1:• Table1• Table2
+ Standardized metadata
Clone1
Catalogue 2:• Table1• Table2• Table3
Catalogue 3: Obsoleted by Cat34
• Table
Catalogue 1:• Table1• Table2
+ Standardized metadata
Clone2
![Page 5: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/5.jpg)
5S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
Metadata extractionMetadata extraction
![Page 6: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/6.jpg)
6S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
Metadata extractionMetadata extraction
![Page 7: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/7.jpg)
7S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
Metadata extractionMetadata extraction
![Page 8: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/8.jpg)
8S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
Metadata extractionMetadata extraction
![Page 9: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/9.jpg)
9S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
XML generationXML generation
![Page 10: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/10.jpg)
10S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
Dynamical repositoryDynamical repository● The VizieR repository currently has no
memory:● :o) always up-to-date● :o) easy to maintain (especially useful for HUGE
collections like VizieR)● :o( not the OAI spirit (OAI is book-oriented: once
a resource has existed, it must exist forever, even as 'deleted')
● Need hard-coded XML version ?● What date should be used ?
● Metadata change => created=? modified=?
![Page 11: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/11.jpg)
11S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
IssuesIssues● Resources granularity
● Currently, VizieR description at Table level only● Why not Catalogues ?● Create resources for Tables AND Catalogues ?● Make use of OAI Sets (4000 sets?)● How to handle hierarchy in a 'flat' registry?
● Handling mirrors (no, not again?)● Dupplicate resources?
● 10,000 resources * 9 mirrors = 90,000 !● Dupplicate interfaces (and accessURL)?
![Page 12: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/12.jpg)
12S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
IssuesIssues● Currently, all VizieR tables are presented as
<resource xsi:type="vs:TabularSkyService">● (needed to describe the table columns)
● For each table, there are different interfaces● WebBrowser (for humans)● ParamHTTP (retrieve VOTable)
● If the table contains positions, I can make a ConeSearch on this table
● new <resource xsi:type=...>?● new interface?● single resource VizieRConeSearch ?
● thousands possible table-id as parameters!
![Page 13: 1 S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29 VizieR repository Lessons learnt and issues](https://reader035.vdocuments.site/reader035/viewer/2022070305/55149d04550346f06e8b584e/html5/thumbnails/13.jpg)
13S. Derriere, IVOA Interoperability meeting, Pune, 2004/09/27-29
IssuesIssues● How to describe a WS in an interface
(methods?)● Relations between resources with
<relatedResource>● Standard 'deprecatedBy' ?● Point to ivo-id and not Name?