data management and applications at socib
TRANSCRIPT
![Page 1: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/1.jpg)
Data Management and Applications at SOCIB
S. Lora, JP. Beltran, K. Sebastián, S. Gómara and J. Tintoré
David March [email protected]
IMDIS 2013
Lucca, Italy
![Page 2: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/2.jpg)
OUTLINE
• What is SOCIB?
• Data Management
• Applications
• Further works
![Page 3: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/3.jpg)
OUTLINE
• What is SOCIB?
• Data Management
• Applications
• Further works
![Page 4: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/4.jpg)
WHAT IS SOCIB
• Marine Research Infrastructure located in Balearic Islands
• Integrated system in implementation phase (2010-2014)
• Nearshore to open sea (NW Mediterranean)
• Components:
– Distributed multiplatform observing system
– Numerical forecasting system
– Data Management and visualization system
• Provide free open and quality controlled data for science, technology development and
response to society needs
![Page 5: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/5.jpg)
WHAT IS SOCIB
OBSERVING FACILITIES
Research vessel HF Radar
Glider Drifting buoys
Fixed stations Beach Monitoring
MODELLING FACILITY
Currents (ROMS) Waves (SWAN)
STRATEGIC ISSUES & APPLICATIONS
FOR SOCIETY
Integrated Coastal
Management
Marine Spatial Planning
![Page 6: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/6.jpg)
DATA SOURCES DATA TYPES
PARAMETERS DATA FORMATS
WHAT IS SOCIB
![Page 7: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/7.jpg)
OUTLINE
• What is SOCIB?
• Data Management
• Applications
• Further works
![Page 8: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/8.jpg)
DATA MANAGEMENT
DATA CENTER FACILITY
• Manage all multi-platform SOCIB Data
• Allow users to discover, gather, visualize and download
• Immerse in the international framework
OPEN DATA PRINCIPLES
• Discoverable and accessible
• Freely available
• Interoperable, standardized and quality controlled
CHALLENGE
• Implement an integrated data management system
![Page 9: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/9.jpg)
DATA MANAGEMENT
LIFE CYCLE OF DATA
![Page 10: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/10.jpg)
DATA MANAGEMENT
LIFE CYCLE OF DATA
![Page 11: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/11.jpg)
DATA MANAGEMENT
DATA PROCESSING
• Manages the state of all the instrumentation
• PostgreSQL
• Managed by web-based application
1. Input data ingestion
2. Data calibration
3. Parameter derivation
4. Merging (existent & new)
5. Quality Control
6. Product generation
Custom software implementations
(operational / sporadic running)
SOCIB Web based Real-Time Data Monitor
Java Matlab Python R GIS
DATA PROCESSING STAGES INSTRUMENTATION MANAGEMENT DB
![Page 12: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/12.jpg)
DATA MANAGEMENT
LIFE CYCLE OF DATA
![Page 13: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/13.jpg)
DATA MANAGEMENT
DATA ARCHIVAL
SPATIAL DATABASE • POINT / LINE / POLYGON
netCDF REPOSITORY • CF conventions
• GRID / RASTER / MESH / TIME SERIES
![Page 14: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/14.jpg)
DATA MANAGEMENT
LIFE CYCLE OF DATA
![Page 15: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/15.jpg)
DATA MANAGEMENT
DATA DISTRIBUTION AND ACCESS
THREDDS • OGC (WMS) , OpenDAP, jWebChart
GEOSERVER • OGC (WMS, WFS, KML)
DATA DISCOVERY • API RESTful
• JSON/GeoJSON • Interoperability
• Standards
• Web services
http://thredds.socib.es/
http://apps.socib.es/DataDiscovery
http://gis.socib.es/geoserver
API
![Page 16: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/16.jpg)
DATA MANAGEMENT
LIFE CYCLE OF DATA
![Page 17: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/17.jpg)
DATA MANAGEMENT
DATA CATALOG AND DATA DISCOVERY
SOCIB INSTRUMENTATION APP • Observation platforms, CF conventions
GEONETWORK • ISO19115, CSW
THREDDS • ncISO
http://gis.socib.es/geonetwork
![Page 18: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/18.jpg)
DATA MANAGEMENT
LIFE CYCLE OF DATA
![Page 19: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/19.jpg)
DATA MANAGEMENT
APPLICATIONS AND USERS
WEB DEVELOPMENT MAPPING LIBRARIES
MULTIPLE DEVICES
Desktop / Web Mobile
OpenLayers GeoExt Google Maps
USERS
Researchers
and
Techinicians
Policy and
decision makers
General society
![Page 20: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/20.jpg)
DATA MANAGEMENT
![Page 21: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/21.jpg)
DATA MANAGEMENT
Data Center in numbers 2010 – present
DATA PRODUCTION • 184 deployments
• 201 instruments
• Serving more than 50,000 NetCDF files (3.1 TB)
CORPORATE WEBSITE • 248,935 pageviews
• 59,128 visitors (4.21 pages/visit)
• 3’49” Avg. visit duration
![Page 22: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/22.jpg)
OUTLINE
• What is SOCIB?
• Data Management
• Applications
• Further works
![Page 23: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/23.jpg)
APPLICATIONS
DAPP – Deployments application http://apps.socib.es/dapp/
Web application to display information related to trajectories
from mobile platforms (e.g., gliders, drifter buoys, ARGO
profilers, research vessel)
TECHNOLOGIES
USERS
• Scientists & Researchers
• Technicians
• Search and Rescue (SAR)
API
![Page 24: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/24.jpg)
APPLICATIONS
LW4NC2 http://thredds.socib.es/lw4nc2
Web application for multidimensional (grid) data from
netCDF files, usually from numerical models or HF radar.
USERS
• Researchers
• Technicians
TECHNOLOGIES
![Page 25: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/25.jpg)
APPLICATIONS
SACOSTA TECHNOLOGIES http://gis.socib.es/sacosta
Web-based map viewer for cartographic data such as
environmental sensitivity of the coastline
USERS
• Search and Rescue (SAR)
• Policy makers
![Page 26: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/26.jpg)
APPLICATIONS
SEABOARD
TECHNOLOGIES
USERS
Web tool to disseminate SOCIB real time data to entities that
collaborate with the SOCIB Beach Monitoring Facility
http://seaboard.socib.es
• Hotel guest
• Beach users
API
![Page 27: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/27.jpg)
APPLICATIONS
FOLLOW THE GLIDER
TECHNOLOGIES
USERS
Educational web tool aimed to present the autonomous
underwater gliders and gain awareness of their importance
for coastal research.
http://followtheglider.com/
• Students
• Teachers
• General public
API
![Page 28: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/28.jpg)
APPLICATIONS
BEAMON
TECHNOLOGIES
USERS
Web tool to display real time data of beach images acquired
by the beach monitoring facility.
http://apps.socib.es/beamon
• Researchers
• Surfers, anglers
• General public
![Page 29: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/29.jpg)
APPLICATIONS
SOCIB MOBILE
TECHNOLOGIES
USERS
• General public
• Researchers
• Technicians
Apps for real-time data from fixed stations (oceanographic
buoys, sea level stations and coastal weather stations, etc.)
and glider trajectories
API
![Page 30: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/30.jpg)
APPLICATIONS
SOCIB WEBSITE
TECHNOLOGIES
USERS
Corporate website to provide an overview of the different
Facilities.
• General public
• Researchers
http://www.socib.es/
![Page 31: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/31.jpg)
OUTLINE
• What is SOCIB?
• Data Management
• Applications
• Further works
![Page 32: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/32.jpg)
FURTHER WORKS
vs
MANAGE BIG DATA OBSERVATIONAL DATA
DATA DISCOVERY NEW APPLICATIONS
MONITORING SERVICES
![Page 33: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/33.jpg)
CONCLUSIONS
• SOCIB Data Centre is an example of the marine information
systems of new ocean observatories and/or marine research
infrastructures
• Open Data principles in line with the INSPIRE Directive and other
important European initiatives such as Emodnet or Copernicus
• Response to society needs and provide support to the Integrated
Maritime Policy and the Marine Strategy Framework Directive
![Page 34: Data Management and Applications at SOCIB](https://reader033.vdocuments.site/reader033/viewer/2022052901/556394eed8b42ad2128b55f4/html5/thumbnails/34.jpg)
THANK YOU! GRAZIE!
GRACIAS!
David March [email protected]
Data Centre [email protected]
J. Tintoré
S. Gómara K. Sebastián S. Lora
JP. Beltran B. Frontera