where linked data meets big data: applying standard data models to environmental data streams

Where Big Data meets Linked Data:

Applying standard data models to environmental data

streamsAdam Leadbetter, Damian Smyth, Robert Fuller, Eoin

O’GradyMarine Institute, Ireland

Adam ShepherdWoods Hole Oceanographic Institution, US

adam.leadbetter@marine.ie

http://whatis.techtarget.com/definition/3Vs

HTTP://XKCD.COM/927/

https://s-media-cache-ak0.pinimg.com/564x/e7/c2/6b/e7c26b7963b2628d10fe649008b02d23.jpg

https://upload.wikimedia.org/wikipedia/commons/thumb/9/9d/Sir_Tim_Berners-Lee.jpg/640px-Sir_Tim_Berners-Lee.jpg/

@prefix mi-feature: < http://linked.marine.ie/feature/>.@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.

mi-gbco:temperature om:process nvs-l22:TOOL0861;om:observedProperty nvs-p01:TEMPPR01;om:result <_:result>.om:resultTime "2016-08-18T11:42:59.782Z" .

<http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;om:phenomenonTime "2016-08-18T11:42:59.782Z" .om:relatedObservation mi-gbco:temperature.

http://iode.org/index.php?option=com_oe&task=viewDocumentRecord&docID=875

http://smartbay.marine.ie

http://github.com/IrishMarineInstitute/uwobs

2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M

%{NUMBER:pressure:float}%{SPACE}%{NUMBER:temperature:float}%{SPACE}%{NUMBER:conductivity:float}%{SPACE}%{NUMBER:salinity:float}%{SPACE}%{NUMBER:sound_velocity:float}%{SPACE}%{TIME:raw_time}

2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M

%{NUMBER:pressure:float}%{SPACE}%{NUMBER:temperature:float}%{SPACE}%{NUMBER:conductivity:float}%{SPACE}%{NUMBER:salinity:float}%{SPACE}%{NUMBER:sound_velocity:float}%{SPACE}%{TIME:raw_time}

An observation is an action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure

Observation

result

Observation

result

property

Observation

result

Feature property

Observation

result

Feature property

procedure

{ "id":"foo", "phenomenonTime": {"instant":"2016-08-18T11:42:59.782Z"}, "featureOfInterest":{"href":"http://linked.marine.ie/feature/exampleURI"}, "member":[{ "id":"#temperature", "type":"Measurement", "result": { "value":16.118, "uom":"http://vocab.nerc.ac.uk/collection/P06/current/UPAA/" }, "observedProperty": { "href":"http://vocab.nerc.ac.uk/collection/P01/current/TEMPPR01/" }, "procedure":{ "href":"http://vocab.nerc.ac.uk/collection/L22/current/TOOL0861/" }, "resultTime":"2016-08-18T11:42:59.782Z“}]}

{ "@context": "http://example.org/om-context", "id":"foo", "phenomenonTime": {"instant":"2016-08-18T11:42:59.782Z"}, "featureOfInterest":{"href":"http://linked.marine.ie/feature/exampleURI"}, "member":[{ "id":"#temperature", "type":"Measurement", "result": { "value":16.118, "uom":"http://vocab.nerc.ac.uk/collection/P06/current/UPAA/" }, "observedProperty": { "href":"http://vocab.nerc.ac.uk/collection/P01/current/TEMPPR01/" }, "procedure":{ "href":"http://vocab.nerc.ac.uk/collection/L22/current/TOOL0861/" }, "resultTime":"2016-08-18T11:42:59.782Z“}]}

“There are emergent technologies throughout the

fields around oceanography which we will

incorporate into oceanography, and through

that convergence we will make oceanography

into something even more magical”

John Delaney

Adam Leadbetteradam.leadbetter@ma

rine.ie @AdamLeadbetter

where linked data meets big data: applying standard data models to environmental data streams

Data & Analytics

big data meets data nationalism

windowing data in big data streams

algorithms for geometric data streams

finding frequent items in data streams -...

aggregating data streams for more effective revenue...

multiple aggregations over data streams

continuous queries over data streams

section 8.1. mining data streams

analysing real world data streams with spatio-temporal...

summit - amazon web services... · kinesis data. streams....

big data meets big data

monitoring distributed data streams

capturing data streams 13

alibali mult data streams a

data science meets linked data

national data streams data analysis partners catalog

18 data streams

integrating distributed data streams

5.1 mining data streams

privacy preservation for data streams