marine and coastal data services in the cloud · marine and coastal data services in the cloud...

www.snowflakesoftware.com www.seazone.com

Marine and Coastal Data Services in the Cloud

Richard Rombouts - Snowflake Software Ltd. &

Keiran Millard – SeaZone Solutions Ltd.


Marine Geospatial Data

Inspired Marine Data?


SeaZone HydroSpatial

• Global • Base

• One

Content

Cove

rage


Becoming Inspired

Discover Metadata

HydroSpatial Base

INSPIRE

MEDIN

Application Schema

INSPIRE Themes

Feature Catalogue

ISO 19131

HS Base

Build

Use Available for others to use


HydroSpatial Base and INSPIRE

Hydrography8.24%

Transport Networks13.48%

Land Cover8.99%

Elevation1.87%Geology

4.87%

Agricultural and aquaculture facilities

3.37%

Area management/restriction/re

gulation zones and reporting units

11.24%

Buildings8.61%

Habitats and biotopes

3.00%Human health and safety

2.62%

Land Use

0.75%

Species distribution

2.62%

Natural Risk Zones3.00%

Utility and governmental services10.49%

Production and industrial facilities16.48%

Sea Regions0.37%


How to expose INSPIRE features?

Hydrography8.24%

Transport Networks13.48%

Land Cover8.99%

Elevation1.87%Geology

4.87%

Agricultural and aquaculture facilities

3.37%

Area management/restriction/re

gulation zones and reporting units

11.24%

Buildings8.61%

Habitats and biotopes

3.00%Human health and safety

2.62%

Land Use

0.75%

Species distribution

2.62%

Natural Risk Zones3.00%

Utility and governmental services10.49%

Production and industrial facilities16.48%

Sea Regions0.37%

WFS

SR:Coastline

EL:Bathymetry HY:InterTidalArea

TN:ShipRoute


Cloud Data Services • Data as a Service (DaaS) is not new!

Do it yourself

Partner

Out-source


Cloud Data Service Infrastructure

WFS WFS WFS WFS

API Management

Administration Services Data Publication Services

Data Maintenance

Transform Publish Validate

Receive Validate Load

Hydro spatial

Service Monitoring & Testing

Performance & Capability (Ad-hoc)

Availability

(Continuous)

Workflow

Validation fails


Data Maintenance Infrastructure

WFS WFS WFS WFS

API Management

Data Publication Services

HydroSpatial

Hydrographical Offices

OGR2OGR Esri

FileGeoDB

Current configuration


Data Maintenance Infrastructure

WFS WFS WFS WFS

API Management

Data Publication Services

HydroSpatial

Hydrographical Offices

Workflow

Transform, Validate, Publish

Workflow

Validate, Load

Planned configuration


Database Cluster • Configuration

– Postgres database cluster (EnterpriseDB) on Amazon Web Services

• Benefits of Cluster: – Can start with two database instances and increase number of

instances as demand increases – Data automatically replicated between instances – Can establish database instances in different geographic regions

(e.g. Europe, North America, Middle East) to ensure QoS


Configuring the Data Services • Publishing from single source to multiple

schemas (eg. INSPIRE, S-100) • Using off-the-shelf software • Rapid configuration and deployment of

new data services


DEMONSTRATION Configuring Data Services with GO Publisher


Deploying Data Services • Once schema transformation configured –

project is deployed within WFS • But first need to configure WFS settings:

– GetCapabilities – Encoding format (compressed/uncompressed) – Servlet pattern

• Finally, generate WFS war and deploy to application server


Deploying Data Services

Desktop

Server

HydroSpatial

Translation configuration

Data Request

Schema translation

Data Request

Schema translation

Database Records

Database Records

SQL Query

SQL Query

Database table information


DEMONSTRATION Deploying Data Services with GO Publisher


API Management Services • Security:

• Firewalls, ports • usernames/password

• Analytics and Reporting • Billing and Payments • Bad requests

• Malformed/Malicious • Request the world or data

outside allowable area of interest


API Management Services WFS Proxy


Administrator Services Service Monitoring & Testing

Performance & Capability (Ad-hoc )

Availability (Continuous)

Requirements: • GetCapabilities & DescribeFeatureType

Response: <10 seconds • GetFeature: Bounding Box for 1 feature ≤

30 seconds • 50 simultaneous users

Measurement: • 10 requests submitted per second for 50

simultaneous users • Combination of GetCapabilities,

DescribeFeatureType & GetFeature • Sustained for 1 min

Requirements: • Available 99% of time • Max unplanned downtime = 3.63 days/yr • Periods of planned downtime for are

maintenance excluded

Measurement: • 10 requests submitted per hour • Monitoring is continuous for lifetime of service • Combination of requests


Using the Data Services


DEMONSTRATION Using the Data Services in Quantum GIS


Richard Rombouts

[email protected] @RichRombouts ; @Sflakesoftware

Keiran Millard [email protected] @SeaZoneDotCom

marine and coastal data services in the cloud · marine and coastal data services in the cloud...

Documents