the virtual radiation belt observatory (virbo) and the future of the vxo environment
DESCRIPTION
The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment. R.S. Weigel Department of Computational and Data Sciences George Mason University, Fairfax, Virginia. Contributors. Software * Eric Kihn (NOAA/NGDC, ViRBO Web and API) - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/1.jpg)
The Virtual Radiation Belt Observatory (ViRBO) and the
Future of the VxO Environment
R.S. WeigelDepartment of Computational and
Data SciencesGeorge Mason University, Fairfax,
Virginia
![Page 2: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/2.jpg)
ContributorsSoftware * Eric Kihn (NOAA/NGDC, ViRBO Web and API) * Mikhail Zhizhin (RFO, ViRBO Web and API) * Dmitry Mishin (RFO, ViRBO Web and API) * Dmitry Kokovin (RFO, ViRBO Web and API) * Jeremy Faden (Cottage Systems, Autoplot) Data * Dan Baker (CU/LASP, Data and metadata) * Sebastian Boudier (Onera, Data calibration) * Janet Green (NOAA/SEC, Data and metadata) * Shri Kanekal (CU/LASP, Data and metadata) * Reiner Friedel (LANL, Data and calibration) * Paul O'Brien (Aerospace, Data and metadata)
![Page 3: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/3.jpg)
The Heliophysics Data Environment
![Page 4: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/4.jpg)
Outline• What is a VxO?• Goal of VO effort• Where to start• FAQ• Relevance of VO effort to Scientist• Steps to create VO environment• Needed services• ViRBO
![Page 5: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/5.jpg)
What is a VxO
• Virtual Observatory where x represents a domain such as thermosphere/ionosphere or radiation belt
• For a given community, a VxO provides– A comprehensive list of available data– Community-specific services on data– Connections to other VxOs with relevant
services
![Page 6: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/6.jpg)
Goal of VO effort• “VOs should make ‘standard’ scientific research
much more efficient.” [Roberts et al., 2005]
• Rate of science output must keep up with rate of potential science output given amount of available data
• The framework which is used must allow for this
• Requires improvements in:search interfacesanalysis visualizationaccess communication
• … all parts of the chain from instrument or model output to end user must continuously improve.
![Page 7: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/7.jpg)
More ambitious goal
• Ultimately VOs and associated services should enable us to answer “higher-order” queries such as “Show me the data from cases where a large CME and its effects that was observed by SOHO was also observed in situ in the heliosphere, in the Earth's magnetotail, and in responses in the magnetospheres and ionospheres of any planets.”
Roberts et al, 2005 [http://hpde.gsfc.nasa.gov/VO_Framework_7_Jan_05.html]
![Page 8: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/8.jpg)
Other goals
• … “If the new paradigm is successful, even the PI teams should be tempted to use VOs for looking at their own data.”
![Page 9: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/9.jpg)
History• In (funded) development for about 3 years• A fundamental change in the data
approach• Virtual Observatories for Radiation Belt,
Thermosphere/Ionosphere, Magnetosphere, Solar, and Heliosphere.
• Newer services include an event list manager, waves, and an energetic particles.
![Page 10: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/10.jpg)
Where to start
• Look at http://vspo.gsfc.nasa.gov/• Key function: High-level pointers to
known data sets. (Also another interface to data from CDAWeb/SPDF, which can be confusing).
• If you know of a data set that you can’t find a reference to there, let them know.
• For more detailed information and services, VSPO will return pointers to relevant Virtual Observatory.
![Page 11: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/11.jpg)
Frequently asked Questions
• Do I need to learn more data interfaces?
• The boundaries between the VO and the traditional data center (“Big Box/Little Box”). To be discussed throughout
![Page 12: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/12.jpg)
Big Box/Small Box implementations
• Two implementation extremes– Data Center/Big Box: Store all data in a
central location. – VO/Small Box: VO creates domain-specific
metadata and uses metadata to enable services. No local data storage.
• What is emerging– VO sometimes create services or work on
problems with overlap with Big Box. Usually means there is a un-met demand for a service.
– Services are generalized and designed to meet community need.
– VOs sometimes store data. Again because of an un-met need. VOs recognize existing “Big Boxes” will eventually fill the need.
![Page 13: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/13.jpg)
Relevance to Scientist
• Many of us have become data managers and solve similar problems do not depend on science specialty.
• We build ad-hoc solutions• If you have a problem, ask if it is cross-
domain. – If it is, there is probably another person or VO
working on a similar problem. There is usually potential for leveraging effort.
• Example: Event list• Example: Web browser visualization
– Identify and develop cross-cutting services. They eventually become “core” services.
![Page 14: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/14.jpg)
The Heliophysics Data Environment
![Page 15: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/15.jpg)
Steps to create VO environment
1. Describe the data in a standard format (SPASE; http://spase-group.org/). Primary VxO activity in past 3 years. If you know of a data product that does not have associated metadata, tell a VO.
2. Create services3. Connect services
![Page 16: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/16.jpg)
Steps to create VO environment
1. Describe the data in a standard format (SPASE; http://spase-group.org/). Primary VxO activity in past 3 years. If you know of a data product that does not have associated metadata, tell a VO.
2. Create services3. Connect services
![Page 17: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/17.jpg)
Key Concept
•Everything should be viewed as a service
![Page 18: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/18.jpg)
Example Services
• CCMC• VMR – Will add services to CCMC
data
• SSCWeb – Orbit calculations• ViRBO - L* calculations (using
SSCWeb data)
![Page 19: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/19.jpg)
Needed Services, Tools, and Roles
• Metadata– Creators– Standard– Query– Edit– Management
• Data– Creators– Ingestion service (with
versioning!)
• Data Base– API– General– Mass store and backup– Fast Cache (Content
delivery service)– Filter service
• Visualization– Pre-computed– Static and on demand– Interactive and
dynamic
![Page 20: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/20.jpg)
Notes
• Each is an intellectual challenge in its own right.
• Many entities do some of these things to some extent.
![Page 21: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/21.jpg)
Specialized cross-domain needs
BasicDB
MassStore &Backup
Service
Data base
LoggingService
DataAPI
Filter Service
ContentDeliveryService
IngestService &API
Softwareinterface
Finished data and metadata products
API and software
![Page 22: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/22.jpg)
Specialized cross-domain needs
BasicDB
MassStore &Backup
API
Service
Data base
LoggingService
DataAPI
Filter Service
ContentDeliveryService
IngestService &API
Softwareinterface
Includes version control!
Metadata Managementservice and API
![Page 24: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/24.jpg)
Specialized cross-domain needs
BasicDB
MassStore &Backup
API
Service
Data base
LoggingService
DataAPI
Filter Service
ContentDeliveryService
IngestService &API
SoftwareinterfaceMetadata Management
service and API
![Page 25: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/25.jpg)
Specialized cross-domain needs
BasicDB
MassStore &Backup
API
Service
Data base
LoggingService
DataAPI
Filter Service
ContentDeliveryService
IngestService &API
Softwareinterface
![Page 26: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/26.jpg)
Specialized cross-domain needs
BasicDB
MassStore &Backup
API
Service
Data base
LoggingService
DataAPI
Filter Service
ContentDeliveryService
IngestService &API
Softwareinterface
![Page 27: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/27.jpg)
Specialized cross-domain needs
BasicDB
MassStore &Backup
API
Service
Data base
LoggingService
DataAPI
Filter Service
ContentDeliveryService
IngestService &API
Softwareinterface
![Page 28: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/28.jpg)
Specialized cross-domain needs
BasicDB
MassStore &Backup
API
Service
Data base
LoggingService
DataAPI
Filter Service
ContentDeliveryService
IngestService &API
Softwareinterface
![Page 29: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/29.jpg)
Specialized cross-domain needs
BasicDB
MassStore &Backup
API
Service
Data base
LoggingService
DataAPI
Filter Service
ContentDeliveryService
IngestService &API
Softwareinterface
![Page 30: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/30.jpg)
Autoplot + Time Series Server
![Page 31: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/31.jpg)
ViRBO
• Breaking the VO paradigm in many ways (not just connecting services and creating metadata)
• Improved high-level tools and services are fine, but first– Increase data accessibility– Increase amount of available data
• We have:– Created many climatological data sets– Simplified access to many existing data sets.– Creating a time series server– See virbo.org for more …
![Page 32: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/32.jpg)
ViRBO Current Projects
•VxOware•Autoplot•Time Series Server
![Page 33: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/33.jpg)
Future and existing services
– L and L* data base– L-sort plots– Fly-through AP-8/AE-8 and AP-9/AE-9– Hosting SVN for AP-9/AE-9
development– Hosting meeting notes and documents– Work with RBSP to develop or connect
services– Many more …
![Page 34: The Virtual Radiation Belt Observatory (ViRBO) and the Future of the VxO Environment](https://reader035.vdocuments.site/reader035/viewer/2022062803/56814751550346895db4940c/html5/thumbnails/34.jpg)
Onward
• Virtual Observatories provide services
• Researchers guide Virtual Observatory activities