![Page 1: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/1.jpg)
Discovering Coherent Topics Using General Knowledge
Zhiyuan (Brett) Chen Arjun Mukherjee
Bing Liu
Meichun Hsu Malu Castellanos Riddhiman Ghosh
http://www.cs.uic.edu/~zchen/
![Page 2: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/2.jpg)
Document 1
Topic Model …
Document 2
Document M
Topic 1
Topic 2
Topic T
…
Topic Model
![Page 3: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/3.jpg)
Coherent Topics
Price Cheap Expensive Cost Money Pricey Dollar
![Page 4: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/4.jpg)
Coherent Topics
Price Cheap Expensive Cost Money Pricey Dollar
Price Family Cheap Expensive Politics Cost Size
![Page 5: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/5.jpg)
Issues of Unsupervised Topic Models
Objective functions do not correlate well with human judgments (Chang et al., 2009).
Many topics are not coherent.
![Page 6: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/6.jpg)
Remedy: Knowledge-based Topic Models
![Page 7: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/7.jpg)
Knowledge-based Topic Models
DF-LDA (Andrzejewski et al., 2009)
Picture Photo Must-Link
Picture Price Cannot-Link
![Page 8: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/8.jpg)
Knowledge-based Topic Models
Seeded models (Burns et al., 2012; Jagarlamudi et al., 2012; Lu et al., 2011; Mukherjee and Liu, 2012)
DF-LDA (Andrzejewski et al., 2009)
![Page 9: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/9.jpg)
Knowledge is correct for a domain.
Knowledge Assumptions
![Page 10: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/10.jpg)
Knowledge is correct for a domain. Knowledge is domain dependent.
Knowledge Assumptions
![Page 11: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/11.jpg)
Existing Model Flow
![Page 12: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/12.jpg)
Existing Model Flow
![Page 13: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/13.jpg)
Existing Model Flow
![Page 14: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/14.jpg)
Existing Model Flow
![Page 15: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/15.jpg)
Existing Model Flow
![Page 16: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/16.jpg)
Existing Model Flow
![Page 17: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/17.jpg)
Our Proposed Model Flow
![Page 18: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/18.jpg)
Our Proposed Model Flow
![Page 19: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/19.jpg)
Our Proposed Model Flow General Knowledge
![Page 20: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/20.jpg)
May be wrong for a domain
Domain Independent
General Knowledge
![Page 21: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/21.jpg)
Synonyms {Expensive, Pricey}
Lexical Semantic Relations
Antonyms {Expensive, Cheap}
Adjective-Attributes {Expensive, Price}
![Page 22: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/22.jpg)
Synonyms {Expensive, Pricey}
Lexical Semantic Relations
Antonyms {Expensive, Cheap}
Adjective-Attributes {Expensive, Price}
WordNet
(Fei et al. 2012)
![Page 23: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/23.jpg)
LR-Sets
Example: {Expensive, Pricey, Cheap, Price}
![Page 24: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/24.jpg)
LR-Sets (Lexical Relation)
Example: {Expensive, Pricey, Cheap, Price}
Words should be in the same topic
![Page 25: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/25.jpg)
Issues of LR-Sets
Partially wrong knowledge
No correct LR-sets for a word
![Page 26: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/26.jpg)
Issues of LR-Sets
No correct LR-sets for a word
Card
{Card, Menu}
{Card, Bill}
![Page 27: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/27.jpg)
Issues of LR-Sets
No correct LR-sets for a word {Card, Menu}
{Card, Bill}
![Page 28: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/28.jpg)
Issues of LR-Sets
No correct LR-sets for a word {Card, Menu}
{Card, Bill}
![Page 29: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/29.jpg)
Issues of LR-Sets
Partially wrong knowledge
{Picture, Pic, Flick} Picture
![Page 30: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/30.jpg)
Issues of LR-Sets
Partially wrong knowledge
{Picture, Pic, Flick}
![Page 31: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/31.jpg)
Addressing Issues
Word Correlation + GPU
Relaxing wrong sets for a word
Partially wrong knowledge
No correct LR-sets for a word
![Page 32: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/32.jpg)
Addressing Issues
Word Correlation + GPU
Relaxing wrong sets for a word
Partially wrong knowledge
No correct LR-sets for a word
![Page 33: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/33.jpg)
Relaxing Wrong LR-sets {Card, Menu}
{Card, Bill}
![Page 34: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/34.jpg)
Relaxing Wrong LR-sets {Card, Menu}
{Card, Bill}
{Card}
![Page 35: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/35.jpg)
Estimate Knowledge
{Picture, Image}
{Picture, Painting}
![Page 36: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/36.jpg)
Word Distributions From LDA
Word Prob Picture 0.20 Image 0.15 Photo 0.12 Quality 0.10 Resolution 0.05 … Painting 0.0002
![Page 37: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/37.jpg)
Estimate Word Correlation
Word Prob Picture 0.20 Image 0.15 Photo 0.12 Quality 0.10 Resolution 0.05 … Painting 0.0002
{Picture, Image}
{Picture, Painting}
![Page 38: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/38.jpg)
Word Correlation Matrix C
Word Prob Picture 0.20 Image 0.15 Photo 0.12 Quality 0.10 Resolution 0.05 … Painting 0.0002
{Picture, Image}
{Picture, Painting}
0.15 / 0.20
0.0002 / 0.20
![Page 39: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/39.jpg)
Quality of LR-set s Towards w
![Page 40: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/40.jpg)
Relaxing Wrong LR-sets {Card, Menu}
{Card, Bill}
Q(s1, “Card”) < ɛ
Q(s2, “Card”) < ɛ
![Page 41: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/41.jpg)
Relaxing Wrong LR-sets {Card, Menu}
{Card, Bill}
{Card}
Q(s1, “Card”) < ɛ
Q(s2, “Card”) < ɛ
![Page 42: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/42.jpg)
Addressing Issues
Word Correlation + GPU
Relaxing wrong sets for a word
Partially wrong knowledge
No correct LR-sets for a word
![Page 43: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/43.jpg)
Simple Pólya Urn Model (SPU)
![Page 44: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/44.jpg)
Simple Pólya Urn Model (SPU)
![Page 45: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/45.jpg)
Simple Pólya Urn Model (SPU)
![Page 46: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/46.jpg)
Simple Pólya Urn Model (SPU)
![Page 47: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/47.jpg)
Simple Pólya Urn Model (SPU)
![Page 48: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/48.jpg)
Simple Pólya Urn Model (SPU)
The richer get richer!
![Page 49: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/49.jpg)
Interpreting LDA Under SPU
![Page 50: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/50.jpg)
Topic 0
picture Interpreting LDA Under SPU
![Page 51: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/51.jpg)
Topic 0
picture
Interpreting LDA Under SPU picture
![Page 52: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/52.jpg)
Generalized Pólya Urn Model (GPU)
![Page 53: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/53.jpg)
Generalized Pólya Urn Model (GPU)
![Page 54: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/54.jpg)
Generalized Pólya Urn Model (GPU)
![Page 55: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/55.jpg)
Generalized Pólya Urn Model (GPU)
![Page 56: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/56.jpg)
Generalized Pólya Urn Model (GPU)
![Page 57: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/57.jpg)
Topic 0
Applying GPU picture
![Page 58: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/58.jpg)
Topic 0
painting
image
picture picture
Applying GPU
![Page 59: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/59.jpg)
Topic 0
painting
image
Applying GPU
Word Correlation
picture picture
![Page 60: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/60.jpg)
Addressing Issues
Word Correlation + GPU
Relaxing wrong sets for a word
Partially wrong knowledge
No correct LR-sets for a word
![Page 61: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/61.jpg)
Evaluation
![Page 62: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/62.jpg)
Evaluation
Evaluation
Human Evaluation Topic Coherence
KL-Divergence
Four domains
![Page 63: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/63.jpg)
Model Comparison
LDA (Blei et al., 2003)
DF-LDA (Andrzejewski et al., 2009) MDK-LDA (Chen et al., 2013)
LDA-GPU (Mimno et al., 2011)
GK-LDA
![Page 64: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/64.jpg)
KL-Divergence
![Page 65: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/65.jpg)
Topic Coherence (#T = 15)
![Page 66: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/66.jpg)
Human Evaluation
![Page 67: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/67.jpg)
Example Topics
love
![Page 68: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/68.jpg)
Conclusions Discovering Coherent Topics Using General Knowledge
![Page 69: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/69.jpg)
Conclusions Discovering Coherent Topics Using General Knowledge
Partially wrong knowledge
No correct LR-sets for a word
![Page 70: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/70.jpg)
Conclusions Discovering Coherent Topics Using General Knowledge
Word Correlation + GPU
Relaxing wrong sets for a word
Partially wrong knowledge
No correct LR-sets for a word
![Page 71: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/71.jpg)
Datasets: http://www.cs.uic.edu/~zchen/
![Page 72: Discovering Coherent Topics Using General Knowledgezchen/presentations/CIKM...Issues of LR-Sets . No correct LR-sets for a word {Card, Menu} {Card, Bill} Issues of LR-Sets . Partially](https://reader033.vdocuments.site/reader033/viewer/2022043019/5f3b4617e5ec0f576903b6e0/html5/thumbnails/72.jpg)
Datasets: http://www.cs.uic.edu/~zchen/