astronomy data in the dataverse by august muench
TRANSCRIPT
Astronomy Data in the Dataverse● In Scope: taking advantage of standardized file type to
enhance discoverability and curation of Astronomy data;● Out of scope:
a. Outreach to Astronomy Community;b. Connections to Literature and Article search.
array dataheaderkey : valueFITS File array dataheader
key : valueFITS File array dataheaderkey : value
FITS Files● Flexible Image Transport System
a. 1981, developedb. 2008, Version 3
● Our catch all data containera. Tables, Sparse Matrices, Images, Cubes, Photon listsb. once FITS, always FITS(*)
array dataheaderkey : valueFITS File array dataheader
key : valueFITS File array dataheaderkey : value
DataverseDatasetCitation Metadata(manual authoring)
Astronomy & Astrophysics Metadata(automated extraction + curation)
field0 = [unique(key0:value, key1:value, )]field1 = [unique(key2:value, null, … )]field2 = array.type(key3:value, key4:value,...)field3 = array.columns...fieldN = there is no value validation
array dataheaderkey : valueFITS File array dataheader
key : valueFITS File array dataheaderkey : value
Suggested directions:
1. Retain File Level metadata (no aggregation);2. Validate File Level metadata by completeness & content;3. Expose full unparsed header via API;4. Provide transmutable data objects (CSV/TSV tables); 5. Compressed image previews.
File Metadata
key0 : valuekey1 : value…keyN :
validate completeness
array dataheaderkey : valueFITS File array dataheader
key : valueFITS File array dataheaderkey : value
Suggested directions:
1. Retain File Level metadata (no aggregation);2. Validate File Level metadata by completeness & content;3. Expose full unparsed header via API;4. Provide transmutable data objects (CSV/TSV tables); 5. Compressed image previews and other data widgets.
File Metadata
key0 : valuekey1 : value…keyN :
validate completeness
array dataheaderkey : valueFITS File array dataheader
key : valueFITS File array dataheaderkey : value
Suggested directions:
1. Retain File Level metadata (no aggregation);2. Validate File Level metadata by completeness & content;3. Expose full unparsed header via API;4. Provide transmutable data objects (CSV/TSV tables); 5. Compressed image previews and other data widgets.
/api/access/datafile/$id/metadata/header
array dataheaderkey : valueFITS File array dataheader
key : valueFITS File array dataheaderkey : value
Suggested directions:
1. Retain File Level metadata (no aggregation);2. Validate File Level metadata by completeness & content;3. Expose full unparsed header via API;4. Provide transmutable data objects (CSV/TSV tables); 5. Compressed image previews and other data widgets.
array.tsvarray.csvarray.json
array dataheaderkey : valueFITS File array dataheader
key : valueFITS File array dataheaderkey : value
Suggested directions:
1. Retain File Level metadata (no aggregation);2. Validate File Level metadata by completeness & content;3. Expose full unparsed header via API;4. Provide transmutable data objects (CSV/TSV tables); 5. Compressed image previews and other data widgets.