wikinet: a very large-scale multi-lingual concept network vivi nastase, michael strube hits ggmbh...
TRANSCRIPT
![Page 1: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/1.jpg)
WikiNet:a very large-scale multi-lingual concept network
Vivi Nastase, Michael Strube
HITS gGmbH
Benjamin Börschinger, Cäcilia Zirn
University of Heidelberg
Anas Elghafari
University of Tübingen
![Page 2: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/2.jpg)
2
Democratic Senator Barack Obama has been elected the first black president of the United States, prompting celebrations across the country. "It's been a long time coming, but tonight... change has come to America," the president-elect told a jubilant crowd at a victory rally in Chicago. His rival John McCain accepted defeat, and called on his supporters to lend the next president their goodwill.
![Page 3: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/3.jpg)
3
Democratic Senator Barack Obama has been elected the first black president of the United States, prompting celebrations across the country. "It's been a long time coming, but tonight... change has come to America," the president-elect told a jubilant crowd at a victory rally in Chicago. His rival John McCain accepted defeat, and called on his supporters to lend the next president their goodwill.
![Page 4: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/4.jpg)
4
Democratic Senator Barack Obama has been elected the first black president of the United States, prompting celebrations across the country. "It's been a long time coming, but tonight... change has come to America," the president-elect told a jubilant crowd at a victory rally in Chicago. His rival John McCain accepted defeat, and called on his supporters to lend the next president their goodwill.
![Page 5: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/5.jpg)
5
Democratic Senator Barack Obama has been elected the first black president of the United States, prompting celebrations across the country. "It's been a long time coming, but tonight... change has come to America," the president-elect told a jubilant crowd at a victory rally in Chicago. His rival John McCain accepted defeat, and called on his supporters to lend the next president their goodwill.
![Page 6: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/6.jpg)
6
Democratic Senator Barack Obama has been elected the first black president of the United States, prompting celebrations across the country. "It's been a long time coming, but tonight... change has come to America," the president-elect told a jubilant crowd at a victory rally in Chicago. His rival John McCain accepted defeat, and called on his supporters to lend the next president their goodwill.
![Page 7: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/7.jpg)
7
Democratic Senator Barack Obama has been elected the first black president of the United States, prompting celebrations across the country. "It's been a long time coming, but tonight... change has come to America," the president-elect told a jubilant crowd at a victory rally in Chicago. His rival John McCain accepted defeat, and called on his supporters to lend the next president their goodwill.
![Page 8: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/8.jpg)
8
Democratic Senator Barack Obama has been elected the first black president of the United States, prompting celebrations across the country. "It's been a long time coming, but tonight... change has come to America," the president-elect told a jubilant crowd at a victory rally in Chicago. His rival John McCain accepted defeat, and called on his supporters to lend the next president their goodwill.
![Page 9: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/9.jpg)
9
Democratic Senator Barack Obama has been elected the first black president of the United States, prompting celebrations across the country. "It's been a long time coming, but tonight... change has come to America," the president-elect told a jubilant crowd at a victory rally in Chicago. His rival John McCain accepted defeat, and called on his supporters to lend the next president their goodwill.
![Page 10: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/10.jpg)
10
Barack Obamahis
United StatesAmerica
presidentpresident-elect
![Page 11: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/11.jpg)
11
Barack Obamahis
United StatesAmerica
presidentpresident-elect
![Page 12: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/12.jpg)
12
Barack Obamahis United States
America
presidentpresident-elect
country
is asenator (2005-2008)
Chicago
part of
![Page 13: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/13.jpg)
13
Making knowledge accessible to computers
![Page 14: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/14.jpg)
14
The many facets of Wikipedia
![Page 15: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/15.jpg)
15
![Page 16: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/16.jpg)
16
![Page 17: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/17.jpg)
17
![Page 18: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/18.jpg)
18
The many facets of Wikipedia• Articles• Categories• Category-category links• Article-category links• Hyperlinks, redirects, disambiguation links• Anchor texts• Cross-language links• Infoboxes• Article structure• Edits and more
![Page 19: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/19.jpg)
19
and now let's restructure (some of) this for machine consumption
![Page 20: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/20.jpg)
20
The category and article network
![Page 21: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/21.jpg)
21
– explicit relationsPrime Ministers of New Zealand, Movies directed by Woody Allen
– partly explicit relationsVillages in Brandenburg, Conflicts in 2000
– implicit relationsMixed martial arts television programs
– class attributesAlbums by artist, Books by genre
Wikipedia categories encode knowledge
![Page 22: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/22.jpg)
22
Deconstructing categories
![Page 23: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/23.jpg)
23
Deconstructing categories
![Page 24: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/24.jpg)
24
Deconstructing Wikipedia categories
Apply patterns to parsed structure:– Queen (band) members,
Chancellors of Germany:Rel Cx, Cx Rel– Films directed by Woody Allen:Cy [VBN IN] Cx– Villages in Brandenburg:Cy [IN] Cx– Albums by artist:Cy by Cx
– Mixed martial arts television programs:Cx1 Cx2 … Cxn
![Page 25: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/25.jpg)
25
Deconstructing categories→ explicit relation categories: Cy Rel
Queen (band) members
Freddy Mercury
Brian May
John Deacon
Roger Taylor
Queen (band)
Freddy Mercury
Brian May
John Deacon
Roger Taylor
members
![Page 26: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/26.jpg)
26
Deconstructing categories→ explicit relation categories:
Cy [VBN IN] Cx
Movies Woody Allen
Annie Hall
Deconstructing HarryThe Scoop
…
isa directed by
Movies directed by Woody Allen
Annie Hall
Deconstructing Harry
The Scoop…
![Page 27: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/27.jpg)
27
Deconstructing categories partly explicit relations Cy [IN] Cx
Villages in Brandenburg
Siethen Goerden
Villages
Siethen Goerden
Brandenburg
isa located-in
Geography
spatial
![Page 28: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/28.jpg)
28
Deconstructing categories by categories: Cx by Cy
attribute
![Page 29: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/29.jpg)
29
![Page 30: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/30.jpg)
30
Category and articles network + deconstructed categories
![Page 31: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/31.jpg)
31
How good is it?
![Page 32: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/32.jpg)
32
Some issues
Relations that are too general – Military equipment of the Soviet Union → spatial
Unnamed relations – science fiction novels
![Page 33: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/33.jpg)
33
Some issues
![Page 34: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/34.jpg)
34
Category name ↔ infobox relation/attribute linkestablished for 42,060 categories
Propagated to 698,929 previously induced relations
![Page 35: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/35.jpg)
35
![Page 36: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/36.jpg)
36
After: Starting with category-article network Deconstructing categories Propagating infobox relations Mapping all these onto concepts
![Page 37: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/37.jpg)
37
![Page 38: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/38.jpg)
38
After: Starting with category-article network Deconstructing categories Propagating infobox relations Mapping all these onto concepts Adding cross-language links
![Page 39: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/39.jpg)
39
![Page 40: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/40.jpg)
40
![Page 41: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/41.jpg)
41
After: Adding category-article network Deconstructing categories Propagating infobox relations Mapping all these onto concepts Adding cross-language links Adding some disambiguating pageswe obtain ...
![Page 42: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/42.jpg)
42
WikiNet – a multi-lingual concept network
![Page 43: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/43.jpg)
43
WikiNet – a multi-lingual concept network
A multi-lingual index- maps terms to ids
![Page 44: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/44.jpg)
44
WikiNet – a multi-lingual concept network
A reversed index file to map ids to terms
![Page 45: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/45.jpg)
45
WikiNet – a multi-lingual concept network
A list of named relations between ids
![Page 46: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/46.jpg)
46
WikiNet – a multi-lingual concept network
A list of co-occurrence relations between ids
![Page 47: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/47.jpg)
47
WikiNet
• Approx 3 million conceptsMultilingual accessParaphrases and variants
• Approx 36 ( + 162 ) million relations
![Page 48: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/48.jpg)
48
WikiNet
• Language stats:– En: 3,347,712– Fr: 498,811– De: 459,697– It: 368,529– Tr: 83,239– Bg: 55,068...
![Page 49: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/49.jpg)
49
What's next:
• Fill in cross-language gaps• Add more concepts – identify texts that contain
concepts we don't know about and extract the knowledge
• Add more relations Article – article linksNovel relations from texts
• Add organizationGet inspiration from Cyc!
![Page 50: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/50.jpg)
50
... and also:
• Build a tool kit for use with WikiNet:Link texts to WikiNetVarious computations (relatedness, similarity, associations)
![Page 51: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/51.jpg)
51
... and also:
• Put the resource and toolkit to use:
SummarizationMetonymy resolutionCoSyne – content synchronization of wiki pages
![Page 52: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/52.jpg)
52
Thank you!
![Page 53: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/53.jpg)
53
Thank you!
![Page 54: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/54.jpg)
54
Connecting
![Page 55: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/55.jpg)
55
Category links
![Page 56: WikiNet: a very large-scale multi-lingual concept network Vivi Nastase, Michael Strube HITS gGmbH Benjamin B ö rschinger, C ä cilia Zirn University of](https://reader035.vdocuments.site/reader035/viewer/2022062713/56649cbe5503460f94984130/html5/thumbnails/56.jpg)
56
Collaborative projects on the web:
Open Mind Common Sense (Push Singh) Mindpixel (Chris McKinstry)
How to break the knowledge acquisition bottleneck?