dgi 2015 roundtable 5 co-chair's presentation

Roundtable 5

Harnessing Innovation Opportunities fromOpen Data and Big Data

Co-Chairs:Roger Longhorn

Secretary-General, Global Spatial Data Infrastructure (GSDI) Association www.gsdi.org

Contact: [email protected] / [email protected]

Gabor Remetey-FülöppSecretary General, Hungarian Association for Geo-information (HUNAGI)

www.hunagi.huContact: [email protected]

Roundtable 5 on Open Data and Big Data

Defense Geospatial Intelligence Conference

QEEII Conference Center

London, 20 January 20151

Relevances from the keynotes




Defense Geospatial Intelligence Conference2

• Neil Thompson: Data availability is an issue: 60% vs 38% in previous year

• Jane Dickerson: Content, Context, Conveience, Consequences Principles of Robert Cardello (NGI). Flexible sharing, full interoperability, timely service and multi-national partnership– Stuart Blundel’ intervention (Exelis, based on ad hoc discussion with the next sittings): agencies

should not compete with private sector but leveraging their services

• Éric Laliberté: clear vision and strategy is prepequisite for successful implementation (the case of CSA)

• Dan Jablonsky (DigitalGlobe): set up some dedicated homeland security areas where also Open and Big Data play important role

• Robert B, Murett (INSCT): expanded range of sensors and data management are needed to handle the global commons: air, space, high seas and cyber. Challanges include how to get more with less, commin/data transfer, data sharing

• Craig Clarke: OSINT Impact of the social media: smart phones 2005 – 2014

• Anne Cathrine Frostrup (Kartverk) importance of availability, accessibility and usability of reliable geospatial data

Agenda

• Introduction

• Open Data Issues and Challenges

• Open Data Discussion – Key Issues

• Big Data Issues and Challenges

• Big Data Discussion – Key Issues

• Research needs and programmes





Introduction





• What is Open Data?Open Definition from the Open Knowledge Foundation:

– defines “openness” in relation to data and content,

– precisely defines “open” in the terms “open data” and “open

content”,

– ensures interoperability (shared access) between different

collections of open material.

“A piece of data or content is open if anyone is free to use, reuse,

and redistribute it — subject only, at most, to the requirement to

attribute and/or share-alike.”

http://opendefinition.org/okd/ http://okfn.org/

http://opendefinition.org/okd/

http://okfn.org/

Introduction





• What Open Data definition covers?• Access

• Redistribution

• Reuse

• Absence of Technological Restriction

• Attribution

• Integrity

• No Discrimination Against Persons or Groups

• Distribution of License

• License Must Not Be Specific to a Package

• License Must http://opendefinition.org/okd/ http://okfn.org/

http://opendefinition.org/okd/

http://okfn.org/

Open Data Policies





The G8 Open Data Charter

• Principle 1 – Open Data by default

• Principle 2: Quality and Quantity

• Principle 3: Usable by All

• Principle 4: Releasing Data for Improved Governance

• Principle 5: Releasing Data for Innovation

GEO/GEOSS Data Sharing Principles





• GEO – mandate for the 2nd decade to implement GEOSS, a global, coordinated, comprehensive and sustained System of Observation Systems providing information for the benefit of the society (9 dedicated Society Benefit Areas)

• Implementation requirement: setting up Data Sharing Principles– Recognizing Relevant International and National Policies and Legislation

• Data and Products (space based and in situ) at minimum time delay and minimum cost

• Free of Charge or Cost of reproduction for research and edu

Objective: improve coordination, avoid duplication, provide easier and more open data access, foster use, building capacity and identify gaps

Source: Douglas Cripe (PhD), Group on Earth Observations (GEO) Secretariat at IGIT2015, 16 January, 2015 Székesfehérvár, Hungary www.earthobservations.org

http://www.earthobservations.org

GSDI involvement in GEO activities

Integrated Geo-spatial Information and Interoperable Services supported by Global Spatial Data Infrastructure Association (GSDI) www.gsdi.org, www.igs.orgGSDI delegates since 2007 (FGDC, CIESIN, Esri, HUNAGI)active in

Data Sharig PrinciplesArchitecture and Data ComUser Interface ComGEO Common InfrastructurePlenariesMinisterial Summits (*)



GSDI World ConferencelRotterdam CEOS WGISS

CODATA, GEO_OGC

(*) GSDI Statement toCape Town Declaration

GSDI Statement toAt GEO V Bucarest

GSDI contribution at GEO VIII Istanbul

GSDI Statementat GEO X Foz Do Iguazu

(*) GSDI Statementat GEO X Geneva

GSDI delegateat GEO IV 2007

GSDI delegateat GEO IX 2012

GSDI delegateat GEO VIII 2011

GSDI delegateat GEO VII 2010

GSDI delegateat GEO X 2014

GSDI delegateat GEO V 2008

(*) GSDI Statement at GEO VII Beijing

Regiona/cross borderlEURISY, DanubeRegStrategy



GSDI World ConferenceSingapore

GSDI World ConferenceQuebec City

GSDI World ConferenceAddis Ababa

http://www.gsdi.org

http://www.igs.org

The European Open Data Policy





Roberto Viola of DG Connect said in an interview to EUROGI in Ocober 2014

– It is anticipated, that the opportunity to innovate with GI will largerly increased thanks to the revision of PSI directive the legal cornerstone of the Open Data Initiative

– The new rules to be implemented by July 2015

– All the public data should become re-usable as default at no or much less costs

– Expected impact on the governmental agencies such as cadastre

The European Open Data Policy





Open data and its economic impacts

Authentic overview made by the representative of the DG CNECT Dr.Márta Nagy-Rothengass atOpen Data Open Source for GI Session, EUROGI Imagine Conference in October 2014

• EU is towards a data-driven economy. Open data is significant part of it. The big data market rises from 10 bn € to 50 bn € between 2011-2015 and revolutionises the decision making

• Open data offers opportunities for growth, jobs, better quality, better efficiency and innovative services and develops ecosystems across the economy and society

• Open govt’l data: an untapped business est. 140 bn € in the former EU28, Better governance, empower citizens, address societal challenges and accelerate scientific progress

• Industry involvement is a key (PPP is open – join it!)

• The EU Open Data Strategy – milestones incude: EC Communicationon Open Data (2011), Revision of PSI Directive (2013) Guidelines on PSI re-use (July 2014).

• Now we are speaking on EU open data infrastructure

• Research and Innovation funding available to foster cross-sectral re-use with merging different types of data

Open Data Issues and ChallengesWhat data should be made public?

1. Economic drivers

– Recent studies reveal the value to economies of opening up public datasets for unrestricted use, including commercially.

2. Principles for governance of society

– Reactive versus proactive release of government data?

– Privacy concerns

– Existing regulations

How to make data publicly ‘open’? Lessons learned by the EU PSI Directive

How to efficiently implement and monitor Open Data policy?

– Voluntary v mandatory? Regulations? Infringements to be applied?

How to judge the effectiveness of an Open Data policy?

– Defining effectiveness benefits for Gov, Society and business? Cost-Benefit Analysis

– What indicators? Some will be financial but many difficult to measure





Open Data Issues and Challenges





Some academic viewpoints

Open Source, Open Data and Content are foundations for Open Educational Resources (Prof. J. Strobl, Salzburg Uni):

Open educational resources are considered as a transformational and potentially disruptive game changerStages are: spatial literacy, spatial awareness and spatial thinkingOpen educational resources not equal open educationNeed to share a higher level: not only data but knowledge as well

Open data and content(Prof. P.Baumann Jacobs Uni):Outreach to science, communities and citizens. New, advanced technical solutions helps database visualization, parallel/distributed query processing, secured archive integration ISO standard for multi-dimensional spatio-temporal arrays has been approved

Note: Open Source Open Data at the FOSS4G (Seoul) & FOSS4G-Europe (PoliMi Como, July, 2015)with the 3rd NASA WWEC

Big Data Issues and Challenges





Big Data Issues and ChallengesIntergeo 2015 Berlin 17,000 professionals

• In focus: UAVs,/UASs

• Still lack of legislation

keeping privacy

ESA Big Data Conference

Frascati, November 2014

ISDE and ICSU CODATA

Conference in Beijing

July, 2014 (Science related)

GEO-OGC Think Tank in Frascati, Sept 2013, wGISS-37,38, 2014

EUROGI policy paper on Big and Linked Data (GI-related)





Big Data Issues and Challenges

Data acqusition, Data from positioning, Earth observation, imaging, social networks, citizen science

Processing and AnalysisFacebook 300 petabytes of data (daily increase: 600 TB)Google web index: 100 PB , 600 queries/s) Data Torrent can process 1.5 bn events per second

Use of extremely large and realistcally complex datasets, real-time cross-stream analysis

Management and ServiceLegal framework,Interoperability, Data sharing, Capacity building, Collaboration, Usability: timely, reliable, ready to support in temporaly critical decision (eg. Disaster response or other homeland security measures)





Big Data Discussion – Key Issues• Homeland security (disaster management, rescue and mitigation critical

infrastructures, land, water, etc) supporting solutions):• Dynamic real-time location- and object to object communication–based services

Sensor webs, RFIDs, IoTs (enabling traceabilitiy) in transportation, logistics,, animal and plant health, food security, human health monitoring – unique digital identifiers

• Integrated and interoperable indoor-outdoor positioning and navigation (for orientation support, rescue operation)

• Mobile GI, crowdsourcing, VGI, social networks, autonomous data collection, UAVs,/UUVs, real-time data flows from ubiquitous sensors

• Need for Strategy, (Coordination, Implementation, Collaborationfor major Societal Benefit Areas)

• Need for appropriate legislation (e.g. UAVs keeping privacy as much as possible)

• Need for awareness raising (role of NGOs, e.g. EUROGI policy paper) and PPPs.

• Need for Capacity Building in Big Data Analitycs• Need for Research and Innovation





Research needs and programmesBackground on the EU Horizon 2020 RTD Programme

Topic ICT-16 2015 "Big Data: Research”

• Scope

• Expected impact

• Challenges and issues to be addressed

• The Horizon 2020 Big Data ‘Action’ (Budget: 561 M EUR)

• Research and Innovation actions

• Big Data Processing Examples and Benchmarking Environment





References





Background on the EU Horizon 2020 RTD Programme. Topic ICT-16 2015 "Big Data: Research" Handout. Please ask copy by email from the moderators.

Additional references from the moderators incl.:

Shared and Open Data – European efforts

23rd ICSU CODATA Conference, Taipei Oct 27-31, 2012

(with K.Janssen KU.Leuven and C. Bamps EUROGI

Roger LonghornOpen Data Meets Big Data

Open Data Forum 2014, Taipei July 9, 2014

Thank you for your participation!





Dr Gábor Remetey-Fülöpp,Secretary General, Hungarian Association

for Geo-information (HUNAGI) – www.hunagi.hu

Contact: [email protected]

Roger Longhorn

Secretary-General, Global Spatial Data Infrastructure (GSDI) Association – www.gsdi.org

Contact: [email protected] / [email protected]

http://www.hunagi.hu

mailto:[email protected]

http://www.gsdi.org

mailto:[email protected]

dgi 2015 roundtable 5 co-chair's presentation

Data & Analytics

terms open data

data availability

piece of data

data management

open data definition

open content

data sharingcraig clarke

big data cochairs