open data & linked open data

21
Open Data and LOD(Linked Open Data) Kouji KOZAKI LOD Challenge committee / The Institute of Scientific and Industrial Research (I.S.I.R), Osaka University 2015/8/2 1 Kansai Mash App! VOL.02 2015.08.02 Kansai Mash App! VOL.02

Upload: kouji-kozaki

Post on 14-Aug-2015

158 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Open Data & Linked Open Data

Open Data and LOD(Linked Open Data)

Kouji KOZAKILOD Challenge committee /

The Institute of Scientific and Industrial Research (I.S.I.R), Osaka University

2015/8/2 1

Kansai Mash App! VOL.022015.08.02

Kansai Mash App! VOL.02

Page 2: Open Data & Linked Open Data

Year \ Area Dataset Idea Application VisualizeBase

technology

FY2014(245works)FY2013(321works)FY2012(205works)FY2011( 73works)

871018721

51675034

691224418

201824

1813

LOD(Linked Open Data)Challenge

A series of contest which aim to spread LOD.It is held every year from 2011. Numbers of submissions http://lod.sfc.keio.ac.jp/

22015/8/2

LOD Challenge 2015 will be announced SOON!

Kansai Mash App! VOL.02

Page 3: Open Data & Linked Open Data

Open Data

Open Data Published data which anyone can use freely

Definition of Open Data(Open Definition) “Open data and content can be freely used,

modified, and shared by anyone for any purpose” (cf. http://opendefinition.org/)

Examples which are NOT Open Data It is restricted to modify and/or share. Its users are limited. e.g. Only academic institutes Its purposes to use are limited.

e.g. No commercial, Only for submitting a contest

2015/8/2 Kansai Mash App! VOL.02 3

Page 4: Open Data & Linked Open Data

G8 Summit 2013 in Lough ErneG8 Open Data Charter

http://www.mofa.go.jp/mofaj/files/000006820.pdf

2013/06/18

Principle 1: Open Data by DefaultPrinciple 2: Quality and QuantityPrinciple 3: Usable by AllPrinciple 4: Releasing Data for Improved GovernancePrinciple 5: Releasing Data for Innovation

G8 countries agree about “Promotion of Open Data”

42015/8/2 Kansai Mash App! VOL.02

Page 5: Open Data & Linked Open Data

Two viewpoints for open data

license No limitations for purpose, users, sharing, modifying

e.g. CC-BY (http://creativecommons.org/licenses/by/4.0/) It is important for the users to use without worry.

Machine readable formats Formats which are easy for processing by program

e.g. CSV, JSON, RDF (Linked Data), etc. It is important to develop application in low costs. LOD (Linked Open Data) is a good way for publishing

open data. It ranks as 5 star in “5 ★ Open Data” by Tim Berners-

Lee (http://5stardata.info/).2015/8/2 Kansai Mash App! VOL.02 5

Page 6: Open Data & Linked Open Data

Linked Data It aim to create new value by linking data on the Web. Proposed by Web Tim Berners-Lee (2006-).※ Linked Open Data(LOD):Linked Data published as Open Data.

http://linkeddata.org/

• Technologies for linking data on web are provided.→Data on Web can be used as a global database.

62015/8/2 Kansai Mash App! VOL.02

Page 7: Open Data & Linked Open Data

TED Talk by Tim Berrners Lee (2009)~Raw Data Now!~

http://www.ted.com/talks/tim_berners_lee_on_the_next_web.html

Publish Open Data on Web=Raw Data Now!

72015/8/2 Kansai Mash App! VOL.02

Page 8: Open Data & Linked Open Data

How LOD are extend on the Web~LOD Cloud~

2007/5/12007/10/8

2008/9/182009/7/142010/9/22

http://lod-cloud.net/

2011/9/19Each circle represents a DB (LOD)

DBPedia

82015/8/2 Kansai Mash App! VOL.02

Page 9: Open Data & Linked Open Data

How LOD are extend on the Web~LOD Cloud~

Linking Open Data cloud diagram 2014, by Max Schmachtenberg, Christian Bizer, Anja Jentzschand Richard Cyganiak. http://lod-cloud.net/

2014/08/30

92015/8/2 Kansai Mash App! VOL.02

Page 10: Open Data & Linked Open Data

2015/8/2 10

Domains # of dataset % Government 183 18.05

Publications 96 9.47

Life sciences 83 8.19

User-generated content 48 4.73

Cross-domain 41 4.04

Media 22 2.17

Geographic 21 2.07

Social web 520 51.28

Total 1014

Kansai Mash App! VOL.02

Page 11: Open Data & Linked Open Data

DBpedia

Community project to generate LOD from Wikipedia.Data is extracted from infoboxes based on definition of an ontology.

http://dbpedia.org/

112015/8/2

An example of Infobox(Osaka (Osaka city))

Kansai Mash App! VOL.02

Page 12: Open Data & Linked Open Data

An example of Data in DBpedia

2015/8/2 12

http://dbpedia.org/resource/Osaka

Links to related data through property(named hyper-link) using URIs.

Each data has a URI as a global ID.

Kansai Mash App! VOL.02

Page 13: Open Data & Linked Open Data

Search API for DBpedia(SPARQL endpoint)

2015/8/2 13

http://dbpedia.org/sparql

Kansai Mash App! VOL.02

Page 14: Open Data & Linked Open Data

A query example

select distinct ?labelwhere {<http://dbpedia.org/resource/Osaka_Castle> rdfs:label ?label} LIMIT 100

2015/8/2 Kansai Mash App! VOL.02 14

Page 15: Open Data & Linked Open Data

DBpedia Japanese

2015/8/2 Kansai Mash App! VOL.02 15

http://jp.dbpedia.org/

SPARQL Endpoint

Page 16: Open Data & Linked Open Data

Example of a data in DBpedia Japanese

2015/8/2 Kansai Mash App! VOL.02 16

http://ja.dbpedia.org/page/大阪府

Page 17: Open Data & Linked Open Data

SPARQL Endpoint for DBpediaJapanese

2015/8/2 Kansai Mash App! VOL.02 17

Sample queries in Japanesehttps://t.co/6eQIPel5Vh

http://ja.dbpedia.org/sparql

Page 18: Open Data & Linked Open Data

A query example 「各都道府県で生まれた政治家の数」を調べる The numbers of Japanese politicians who born each

prefectures.PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>PREFIX dbpedia-owl: <http://dbpedia.org/ontology/>PREFIX dcterms: <http://purl.org/dc/terms/>PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>PREFIX dbpedia-ja: <http://ja.dbpedia.org/resource/>PREFIX category-ja: <http://ja.dbpedia.org/resource/Category:>

select distinct ?pref (count(?s) AS ?c) where {?pref rdf:type dbpedia-owl:Place.?pref dcterms:subject category-ja:日本の都道府県.?s rdf:type dbpedia-owl:Politician;

dbpedia-owl:birthPlace ?pref.}GROUP BY ?prefORDER BY ?c

2015/8/2 Kansai Mash App! VOL.02 18

Page 19: Open Data & Linked Open Data

A query example 「各都道府県で生まれた芸人の数」を調べる The numbers of Japanese comedians who born each

prefectures.

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>PREFIX dbpedia-owl: <http://dbpedia.org/ontology/>PREFIX dcterms: <http://purl.org/dc/terms/>PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>PREFIX dbpedia-ja: <http://ja.dbpedia.org/resource/>PREFIX category-ja: <http://ja.dbpedia.org/resource/Category:>

select distinct ?pref (count(?s) AS ?c) where {?pref rdf:type dbpedia-owl:Place.?pref dcterms:subject category-ja:日本の都道府県.?s rdf:type dbpedia-owl:Comedian;

dbpedia-owl:birthPlace ?pref.}GROUP BY ?prefORDER BY ?c

2015/8/2 Kansai Mash App! VOL.02 19

ここを,Politician→Comedianに変えるだけ!

Page 20: Open Data & Linked Open Data

SPARQL検索が可能な日本語LOD

2015/8/2 20

http://wp.lodosaka.jp/tool/searchdata/

LODハッカソン関西のWebサイトで(関西で開催しているLODのイベント)• SPARQL検索が可能な日本語LOD• SPARQLの使い方の解説

を掲載していますので,詳しく知りたい方はこちらをご覧下さい.その他にも,• LODの作成・公開の方法• LODの活用事例などの情報も掲載しています.

Kansai Mash App! VOL.02

Page 21: Open Data & Linked Open Data

Summary

Linked Open Data Open data published as Linked Data

LOD techniques URIs as global ID. Links to other data through property (named hyper-link). SPARQL endpoint as search API.

Examples of LOD DBpedia

LOD based on Wikipedia You can use it as multi-lingual database.

Some open data by Osaka-city are published also as LOD.

2015/8/2 21Kansai Mash App! VOL.02