open data & linked open data
TRANSCRIPT
Open Data and LOD(Linked Open Data)
Kouji KOZAKILOD Challenge committee /
The Institute of Scientific and Industrial Research (I.S.I.R), Osaka University
2015/8/2 1
Kansai Mash App! VOL.022015.08.02
Kansai Mash App! VOL.02
Year \ Area Dataset Idea Application VisualizeBase
technology
FY2014(245works)FY2013(321works)FY2012(205works)FY2011( 73works)
871018721
51675034
691224418
201824
1813
LOD(Linked Open Data)Challenge
A series of contest which aim to spread LOD.It is held every year from 2011. Numbers of submissions http://lod.sfc.keio.ac.jp/
22015/8/2
LOD Challenge 2015 will be announced SOON!
Kansai Mash App! VOL.02
Open Data
Open Data Published data which anyone can use freely
Definition of Open Data(Open Definition) “Open data and content can be freely used,
modified, and shared by anyone for any purpose” (cf. http://opendefinition.org/)
Examples which are NOT Open Data It is restricted to modify and/or share. Its users are limited. e.g. Only academic institutes Its purposes to use are limited.
e.g. No commercial, Only for submitting a contest
2015/8/2 Kansai Mash App! VOL.02 3
G8 Summit 2013 in Lough ErneG8 Open Data Charter
http://www.mofa.go.jp/mofaj/files/000006820.pdf
2013/06/18
Principle 1: Open Data by DefaultPrinciple 2: Quality and QuantityPrinciple 3: Usable by AllPrinciple 4: Releasing Data for Improved GovernancePrinciple 5: Releasing Data for Innovation
G8 countries agree about “Promotion of Open Data”
42015/8/2 Kansai Mash App! VOL.02
Two viewpoints for open data
license No limitations for purpose, users, sharing, modifying
e.g. CC-BY (http://creativecommons.org/licenses/by/4.0/) It is important for the users to use without worry.
Machine readable formats Formats which are easy for processing by program
e.g. CSV, JSON, RDF (Linked Data), etc. It is important to develop application in low costs. LOD (Linked Open Data) is a good way for publishing
open data. It ranks as 5 star in “5 ★ Open Data” by Tim Berners-
Lee (http://5stardata.info/).2015/8/2 Kansai Mash App! VOL.02 5
Linked Data It aim to create new value by linking data on the Web. Proposed by Web Tim Berners-Lee (2006-).※ Linked Open Data(LOD):Linked Data published as Open Data.
http://linkeddata.org/
• Technologies for linking data on web are provided.→Data on Web can be used as a global database.
62015/8/2 Kansai Mash App! VOL.02
TED Talk by Tim Berrners Lee (2009)~Raw Data Now!~
http://www.ted.com/talks/tim_berners_lee_on_the_next_web.html
Publish Open Data on Web=Raw Data Now!
72015/8/2 Kansai Mash App! VOL.02
How LOD are extend on the Web~LOD Cloud~
2007/5/12007/10/8
2008/9/182009/7/142010/9/22
http://lod-cloud.net/
2011/9/19Each circle represents a DB (LOD)
DBPedia
82015/8/2 Kansai Mash App! VOL.02
How LOD are extend on the Web~LOD Cloud~
Linking Open Data cloud diagram 2014, by Max Schmachtenberg, Christian Bizer, Anja Jentzschand Richard Cyganiak. http://lod-cloud.net/
2014/08/30
92015/8/2 Kansai Mash App! VOL.02
2015/8/2 10
Domains # of dataset % Government 183 18.05
Publications 96 9.47
Life sciences 83 8.19
User-generated content 48 4.73
Cross-domain 41 4.04
Media 22 2.17
Geographic 21 2.07
Social web 520 51.28
Total 1014
Kansai Mash App! VOL.02
DBpedia
Community project to generate LOD from Wikipedia.Data is extracted from infoboxes based on definition of an ontology.
http://dbpedia.org/
112015/8/2
An example of Infobox(Osaka (Osaka city))
Kansai Mash App! VOL.02
An example of Data in DBpedia
2015/8/2 12
http://dbpedia.org/resource/Osaka
Links to related data through property(named hyper-link) using URIs.
Each data has a URI as a global ID.
Kansai Mash App! VOL.02
Search API for DBpedia(SPARQL endpoint)
2015/8/2 13
http://dbpedia.org/sparql
Kansai Mash App! VOL.02
A query example
select distinct ?labelwhere {<http://dbpedia.org/resource/Osaka_Castle> rdfs:label ?label} LIMIT 100
2015/8/2 Kansai Mash App! VOL.02 14
DBpedia Japanese
2015/8/2 Kansai Mash App! VOL.02 15
http://jp.dbpedia.org/
SPARQL Endpoint
Example of a data in DBpedia Japanese
2015/8/2 Kansai Mash App! VOL.02 16
http://ja.dbpedia.org/page/大阪府
SPARQL Endpoint for DBpediaJapanese
2015/8/2 Kansai Mash App! VOL.02 17
Sample queries in Japanesehttps://t.co/6eQIPel5Vh
http://ja.dbpedia.org/sparql
A query example 「各都道府県で生まれた政治家の数」を調べる The numbers of Japanese politicians who born each
prefectures.PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>PREFIX dbpedia-owl: <http://dbpedia.org/ontology/>PREFIX dcterms: <http://purl.org/dc/terms/>PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>PREFIX dbpedia-ja: <http://ja.dbpedia.org/resource/>PREFIX category-ja: <http://ja.dbpedia.org/resource/Category:>
select distinct ?pref (count(?s) AS ?c) where {?pref rdf:type dbpedia-owl:Place.?pref dcterms:subject category-ja:日本の都道府県.?s rdf:type dbpedia-owl:Politician;
dbpedia-owl:birthPlace ?pref.}GROUP BY ?prefORDER BY ?c
2015/8/2 Kansai Mash App! VOL.02 18
A query example 「各都道府県で生まれた芸人の数」を調べる The numbers of Japanese comedians who born each
prefectures.
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>PREFIX dbpedia-owl: <http://dbpedia.org/ontology/>PREFIX dcterms: <http://purl.org/dc/terms/>PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>PREFIX dbpedia-ja: <http://ja.dbpedia.org/resource/>PREFIX category-ja: <http://ja.dbpedia.org/resource/Category:>
select distinct ?pref (count(?s) AS ?c) where {?pref rdf:type dbpedia-owl:Place.?pref dcterms:subject category-ja:日本の都道府県.?s rdf:type dbpedia-owl:Comedian;
dbpedia-owl:birthPlace ?pref.}GROUP BY ?prefORDER BY ?c
2015/8/2 Kansai Mash App! VOL.02 19
ここを,Politician→Comedianに変えるだけ!
SPARQL検索が可能な日本語LOD
2015/8/2 20
http://wp.lodosaka.jp/tool/searchdata/
LODハッカソン関西のWebサイトで(関西で開催しているLODのイベント)• SPARQL検索が可能な日本語LOD• SPARQLの使い方の解説
を掲載していますので,詳しく知りたい方はこちらをご覧下さい.その他にも,• LODの作成・公開の方法• LODの活用事例などの情報も掲載しています.
Kansai Mash App! VOL.02
Summary
Linked Open Data Open data published as Linked Data
LOD techniques URIs as global ID. Links to other data through property (named hyper-link). SPARQL endpoint as search API.
Examples of LOD DBpedia
LOD based on Wikipedia You can use it as multi-lingual database.
Some open data by Osaka-city are published also as LOD.
2015/8/2 21Kansai Mash App! VOL.02