knowledge graphs creation - project | lambda

52
Knowledge Graphs creation Dr Anastasia Dimou post-doc researcher imec.be - IDLab.technology [email protected] @natadimou

Upload: others

Post on 25-Jul-2022

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Knowledge Graphs creation - Project | Lambda

Knowledge Graphs creation

Dr Anastasia Dimou post-doc researcher

imec.be - IDLab.technology [email protected] @natadimou

Page 2: Knowledge Graphs creation - Project | Lambda

do you remember ... how Google results were in 1999?

Page 3: Knowledge Graphs creation - Project | Lambda

1999

… how are the same results presented nowadays?

Presenter
Presentation Notes
In mid-1999 (20 years ago) Google had been polished tremendously, and with that, it exited beta and entered official release. https://cdn1-www.mandatory.com/assets/uploads/2018/10/google-2.jpg
Page 4: Knowledge Graphs creation - Project | Lambda

2019

… what has changed the past 20 years?

Presenter
Presentation Notes
In mid-1999 (20 years ago) Google had been polished tremendously, and with that, it exited beta and entered official release.
Page 5: Knowledge Graphs creation - Project | Lambda

3

1

2

4

Web of Documents

Page 6: Knowledge Graphs creation - Project | Lambda
Presenter
Presentation Notes
Hyperlinks Vs typed links Fundamental difference: providing context to the data
Page 7: Knowledge Graphs creation - Project | Lambda

a

b

d c

e

g f

h i C

B D A a b

d c

e g

f B C

? ?

3

1

2

4

? ?

?

Web of Data

Page 8: Knowledge Graphs creation - Project | Lambda

Knowledge Graphs

Presenter
Presentation Notes
KGs start with data, and it is the data itself – organised and viewed as a graph of entities and their relationships – that takes centre stage.
Page 9: Knowledge Graphs creation - Project | Lambda

Knowledge Graph describes entities and their interrelations by means of a graph

Page 10: Knowledge Graphs creation - Project | Lambda

where are these Knowledge Graphs coming from?

Page 11: Knowledge Graphs creation - Project | Lambda

Knowledge Graph creation

KG creation history

languages for KG creation

R2RML and RML

data transformations

Page 12: Knowledge Graphs creation - Project | Lambda

Knowledge Graph creation

KG creation history

languages for KG creation

R2RML and RML

data transformations

Page 13: Knowledge Graphs creation - Project | Lambda

data

custom dedicated script for a data owner’s data (-) new development cycle every time a modification is needed

KG

dev1

data holder

Page 14: Knowledge Graphs creation - Project | Lambda

KG

dedicated tool for certain format (+) great solution if a data owner has data only in a certain format

DB

dev1

data holder

KG

CSV

dev2

data holder

KG

XML

dev3

data holder

KG

JSON

dev4

data holder

Presenter
Presentation Notes
Data has heterogeneous formats
Page 15: Knowledge Graphs creation - Project | Lambda

KG1

DB

dev1

KG2

CSV

dev2

data holder

KG3

XML

dev3

KG4

JSON

dev4

dedicated tool for certain format (-) learn and maintain multiple tools if a data owner has data in different formats

Presenter
Presentation Notes
Data has heterogeneous formats
Page 16: Knowledge Graphs creation - Project | Lambda

KG1

dev1

KG2

dev2

data holder

KG3

dev3

KG4

dev4

DB CSV XML JSON

dedicated tool for certain format (-) learn and maintain multiple tools if a data owner has data in different formats

Presenter
Presentation Notes
Data has heterogeneous formats
Page 17: Knowledge Graphs creation - Project | Lambda

KG1

dev1

KG2

dev2

data holder

KG3

dev3

KG4

dev4

DB CSV XML JSON

KG

dedicated tool for certain format (-) post-processing step to integrate

Presenter
Presentation Notes
Data has heterogeneous formats
Page 18: Knowledge Graphs creation - Project | Lambda

KG

dev 1

KG

dev 2

data holder

KG

dev 3

KG

dev 4

DB CSV XML JSON

KG

dedicated tool for certain format (-) post-processing step to integrate

Presenter
Presentation Notes
Data has heterogeneous formats
Page 19: Knowledge Graphs creation - Project | Lambda

dev1

data holder

DB CSV XML JSON

KG

a tool for all data formats (+) learn and maintain a single tool

Presenter
Presentation Notes
Data has heterogeneous formats
Page 20: Knowledge Graphs creation - Project | Lambda

dev1

data holder

DB CSV XML JSON

KG

a tool for all data formats (+) learn and maintain a single tool (+) configure the rules that define how a KG is generated

rules

Presenter
Presentation Notes
Data has heterogeneous formats
Page 21: Knowledge Graphs creation - Project | Lambda

Knowledge Graph creation

KG creation history

languages for KG creation

R2RML and RML

data transformations

Page 22: Knowledge Graphs creation - Project | Lambda

data holder

DB CSV XML JSON

KG

rules

rules based on: dedicated mapping languages adjusted query languages

Presenter
Presentation Notes
Data has heterogeneous formats
Page 23: Knowledge Graphs creation - Project | Lambda

KR2RML (RDBs, XML,JSON)

2015

2016 (XML,CSV,JSON,HTML)

SPARQL-Generate homogeneous

data sources heterogeneous data sources R2RML

(RDBs) 2012

RML (RDBs, NoSQL,RDF,

CSV,XML,JSON,HTML) 2013

xR2RML (RDBs+NoSQL)

2014

2008 (XML,RDBs)

XSPARQL

mapping languages based

(SPARQL) query languages based

Mapping Language analysis of comparative characteristics B. De Meester, P. Heyvaert, R. Verborgh, A. Dimou et al. KGB 2019

2013 (CSV) Tarql

Presenter
Presentation Notes
Tarql Feb 2013
Page 24: Knowledge Graphs creation - Project | Lambda

homogeneous data sources

heterogeneous data sources

mapping languages based

R2RML (RDBs)

RML (RDBs, NoSQL,RDF,

CSV,XML,JSON,HTML)

xR2RML (RDBs+NoSQL)

KR2RML (RDBs, XML,JSON)

Presenter
Presentation Notes
Data has heterogeneous formats
Page 25: Knowledge Graphs creation - Project | Lambda

homogeneous data sources

heterogeneous data sources R2RML

(RDBs) RML

(RDBs, NoSQL,RDF, CSV,XML,JSON,HTML)

xR2RML (RDBs+NoSQL)

KR2RML (RDBs, XML,JSON)

DB2triples (https://github.com/antidot/db2triples)

XSPARQL (http://xsparql.sourceforge.net/)

Morph (https://github.com/oeg-upm/morph-rdb)

R2RML Parser (https://github.com/nkons/r2rml-parser)

(https://github.com/RMLio/rmlmapper-java) RMLMapper (https://github.com/semantifyit/RocketRML) RocketRML

(https://github.com/RMLio/RMLStreamer) RMLStreamer (https://github.com/carml/carml) CARML

(https://github.com/SDM-TIB/SDM-RDFizer) SDM-RDFizer

Choose yourself the best tool for your needs! http://rml.io/test-cases/ http://rml.io/implementation-report/

Conformance test-cases for the RDF Mapping Language. P. Heyvaert, D. Chaves-Fraga, F. Priyatna, O. Corcho,

E. Mannens, R. Verborgh, A. Dimou. KGSWC2019

Presenter
Presentation Notes
Data has heterogeneous formats
Page 26: Knowledge Graphs creation - Project | Lambda

Knowledge Graph creation

KG creation history

languages for KG creation

R2RML and RML

data transformations

Page 27: Knowledge Graphs creation - Project | Lambda

https://www.w3.org/TR/r2rml/ W3C recommendation to create a

knowledge graph from a relational database

Page 28: Knowledge Graphs creation - Project | Lambda

http://RML.io RML: A Generic Language for Integrated RDF Mappings

of Heterogeneous Data A. Dimou et al. LDOW 2014

Page 29: Knowledge Graphs creation - Project | Lambda

R2RML Vs RML

Page 30: Knowledge Graphs creation - Project | Lambda

rank name nationality mark notes

1 Anzhelika Sidorova Russia 4.95 WL,PB

2 Sandi Morris USA 4.90 SB

3 Katerina Stefanidi Greece 4.85 SB

4 Holly Bradshaw UK 4.80 -

5 Alysha Newman Canada 4.80 -

6 Angelica Bengtsson Sweden 4.80 NR

Presenter
Presentation Notes
Results of female pole vault for 2019 world championship
Page 31: Knowledge Graphs creation - Project | Lambda

rank name nationality mark notes

1 Anzhelika Sidorova Russia 4.95 WL,PB

2 Sandi Morris USA 4.90 SB

3 Katerina Stefanidi Greece 4.85 SB

4 Holly Bradshaw UK 4.80 -

5 Alysha Newman Canada 4.80 -

6 Angelica Bengtsson Sweden 4.80 NR

Page 32: Knowledge Graphs creation - Project | Lambda

subject object predicate

Triple

rank name nationality mark notes

1 Anzhelika Sidorova Russia 4.95 WL,PB

2 Sandi Morris USA 4.90 SB

3 Katerina Stefanidi Greece 4.85 SB

4 Holly Bradshaw UK 4.80 -

5 Alysha Newman Canada 4.80 -

6 Angelica Bengtsson Sweden 4.80 NR

Page 33: Knowledge Graphs creation - Project | Lambda

http:://ex.com/{name} rr:column "Mark"

ex:score

Subject Map Predicate Map Object Map

rank name nationality mark notes

1 Anzhelika Sidorova Russia 4.95 WL,PB

2 Sandi Morris USA 4.90 SB

3 Katerina Stefanidi Greece 4.85 SB

4 Holly Bradshaw UK 4.80 -

5 Alysha Newman Canada 4.80 -

6 Angelica Bengtsson Sweden 4.80 NR

Page 34: Knowledge Graphs creation - Project | Lambda

rank name nationality mark notes

1 Anzhelika Sidorova Russia 4.95 WL,PB

2 Sandi Morris USA 4.90 SB

3 Katerina Stefanidi Greece 4.85 SB

4 Holly Bradshaw UK 4.80 -

5 Alysha Newman Canada 4.80 -

6 Angelica Bengtsson Sweden 4.80 NR

Page 35: Knowledge Graphs creation - Project | Lambda

rank name nationality mark notes

1 Anzhelika Sidorova Russia 4.95 WL,PB

2 Sandi Morris USA 4.90 SB

3 Katerina Stefanidi Greece 4.85 SB

4 Holly Bradshaw UK 4.80 -

5 Alysha Newman Canada 4.80 -

6 Angelica Bengtsson Sweden 4.80 NR

http:://ex.com/{name} http:://ex.com/{country_name} if (nationality == country_name)

ex:score

Subject Map Predicate Map Referencing Object Map

Page 36: Knowledge Graphs creation - Project | Lambda

rank name nationality mark notes

1 Anzhelika Sidorova Russia 4.95 WL,PB

2 Sandi Morris USA 4.90 SB

3 Katerina Stefanidi Greece 4.85 SB

4 Holly Bradshaw UK 4.80 -

5 Alysha Newman Canada 4.80 -

6 Angelica Bengtsson Sweden 4.80 NR

Page 37: Knowledge Graphs creation - Project | Lambda
Page 38: Knowledge Graphs creation - Project | Lambda

R2RML Vs RML

Page 39: Knowledge Graphs creation - Project | Lambda

YARRRML = YAML + RML https://rml.io/yarrrml/

Page 40: Knowledge Graphs creation - Project | Lambda

Developer-friendly serialisations and their UIs YARRRML = YAML + RML(Matey, https://rml.io/yarrrml/) Expressive RDF Mapper (XRM, https://zazuko.com/products/expressive-rdf-mapper/)

Page 41: Knowledge Graphs creation - Project | Lambda

Declarative Rules for Linked Data Generation at your Fingertips! P. Heyvaert, Ben De Meester, Anastasia Dimou, Ruben Verborgh et al. ESWC 2018

Page 42: Knowledge Graphs creation - Project | Lambda

Developer-friendly serialisations and their UIs YARRRML = YAML + RML(Matey, https://rml.io/yarrrml/) Expressive RDF Mapper (XRM, https://zazuko.com/products/expressive-rdf-mapper/)

User-friendly UIs RMLEditor (https://app.rml.io/rmleditor/) RMLx Visual Editor (http://pebbie.org/mashup/rml)

Page 43: Knowledge Graphs creation - Project | Lambda

Specification and implementation of mapping rule visualization and editing: MapVOWL and the RMLEditor. P. Heyvaert & A. Dimou, et al. JWS 2018

Page 44: Knowledge Graphs creation - Project | Lambda

Developer-friendly serialisations and their UIs YARRRML = YAML + RML(Matey, https://rml.io/yarrrml/) Expressive RDF Mapper (XRM, https://zazuko.com/products/expressive-rdf-mapper/)

User-friendly UIs RMLEditor (https://app.rml.io/rmleditor/) RMLx Visual Editor (http://pebbie.org/mashup/rml)

Do It For You Mapeathor (https://github.com/oeg-upm/Mapeathor)

Page 45: Knowledge Graphs creation - Project | Lambda

Knowledge Graph creation

KG creation history

languages for KG creation

R2RML and RML

data transformations

Page 46: Knowledge Graphs creation - Project | Lambda

what if the data needs to be changed/processed?

7th June 2020 07/09/2020 09/07/2020 2019/09/07

June 7th, 2020

2019-09-05^^xsd:date

Page 47: Knowledge Graphs creation - Project | Lambda

data holder

DB CSV XML JSON

KG

schema rules

rules based on: schema transformation languages data transformation languages

data rules

Presenter
Presentation Notes
Data has heterogeneous formats
Page 48: Knowledge Graphs creation - Project | Lambda

data holder

DB CSV XML JSON

KG

schema rules

data rules

http://FnO.io An Ontology to Semantically Declare & Describe Functions B. De Meester, A. Dimou, R. Verborgh, E. Mannens & R. Van De Walle. ESWC P&D 2016

FunUL FunUL: a method to incorporate functions into uplift mapping languages A. Crotti Junior, C. Debruyne, R. Brennan, & D. O’Sullivan. iiWAS 2016

Presenter
Presentation Notes
Data has heterogeneous formats
Page 49: Knowledge Graphs creation - Project | Lambda

FnO FunUL

Presenter
Presentation Notes
Data has heterogeneous formats
Page 50: Knowledge Graphs creation - Project | Lambda

Knowledge Graph Construction Community Group https://www.w3.org/community/kg-construct/

Page 51: Knowledge Graphs creation - Project | Lambda

Dr Anastasia Dimou

Dr Pieter Heyvaert

Dr Ben De Meester

Sven Lieber

Gerald Haesendonck

RML.io team https://www.w3.org/community/kg-construct/

Dylan Van Assche

Thomas Delva

Page 52: Knowledge Graphs creation - Project | Lambda

High Quality Knowledge Graphs construction to enable Intelligent Agents

Dr Anastasia Dimou post-doc researcher

imec.be - IDLab.technology [email protected] @natadimou