conceptnet: a wonderful semantic world by bijoy arif

31
ConceptNet: A Wonderful Semantic World By Bijoy Arif

Upload: amber-casey

Post on 16-Dec-2015

222 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ConceptNet: A Wonderful Semantic World By Bijoy Arif

ConceptNet: A Wonderful Semantic World

By Bijoy Arif

Page 2: ConceptNet: A Wonderful Semantic World By Bijoy Arif

The Development of the Space-Time View of Quantum Electrodynamics

“We have a habit in writing articles published in scientific journals to make the work as finished as possible, to cover all the tracks, to not worry about the blind alleys or to describe how you had the wrong idea first, and so on. So there isn't any place to publish, ...”

Richard P. Feynman, Noble Lecture

Page 3: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Presentation Plan

Part 1

1. Introduction

2. Background Knowledge

3. ConceptNet and Its Counterparts

Part 2

4. Building of ConceptNet

5. Structure of ConceptNet

6. Applications of ConceptNet

7. Present ConceptNet

Page 4: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Presentation Plan (cont...)

Part 3

8. ConceptNet in Windows

9. ConceptNet Modules

10. Demo of ConceptNet

11. Quick Review

12. My View of ConceptNet

Page 5: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Part 1

Page 6: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Introduction: What is ConceptNet?

> ConceptNet is a semantic network to give common sense knowledge(concept) to machine.

> Simply means a tool so that computers can understand daily usage English.

Page 7: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Features

> Python based SQL toolkit

> Maintain Semantic Network

> Acquire data from Open Mind Common Sense Corpus

> Till now Open Source

Page 8: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Origin and Creators

> Originated in MIT Media Lab

> First Appeared as The ConceptNet Project v2.1

>Introduced by

Hugo Liu

Push Singh

Ian Eslick

Page 9: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Background Knowledge: What is Semantic Network?

> A network represents semantic relation between concepts.

> Semantics is the meaning of something focuses on relation between signifiers like words, phrases, signs or symbols.

> Here Concepts means some abstract objects.

> In Computer Science terminology, It is a directed or undirected graph consisting of vertices, which represent concepts, and edges.

Page 10: ConceptNet: A Wonderful Semantic World By Bijoy Arif

What is Open Mind Common Sense Corpus?

> Open Mind Common Sense (OMCS) is an artificial intelligence project based at the Massachusetts Institute of Technology (MIT) Media Lab whose goal is to build and utilize a large commonsense knowledge base from the contributions of many thousands of people across the Web.

> Unlike common corpus like British National Corpus, International Corpus of English

Page 11: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Relation between OMCS and ConcepNet

> The project is brainchild of Marvin Minsky, Push Singh, Catherine Havasi and others. Eventually they contributed to ConceptNet

> ConceptNet is a semantic network based on the information in the OMCS database.

Simply saying, OMCS is the core of ConceptNet.

Page 12: ConceptNet: A Wonderful Semantic World By Bijoy Arif

ConceptNet and Its counterparts

> Two other popular Natural Language Processing toolkit like ConceptNet are:

WordNet

Cyc

> ConceptNet project is inspired by these two projects.

Page 13: ConceptNet: A Wonderful Semantic World By Bijoy Arif

WordNet and Cyc

> WordNet is large lexical database, initiated in Princeton University in mid 1980s by George A. Miller, to provide meaning and relation of English words.

> Cyc is started by Cycorp Company in 1984 to create common sense knowledge in a formalized logical framework.

Page 14: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Similarity and Difference

> ConceptNet is the combination of WordNet like structure and Cyc like relation.

> Extended WordNet's notion of node and repertoire in semantic network.

> WordNet and Cyc are handcrafted by knowledge engineers but ConceptNet is OMCS corpus based, not manually handcrafting commonsense knowledge.

Page 15: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Similarity and Difference (cont...)

> WordNet has a lexical emphasis and employs a formal taxonomic approach.

> Cyc represents commonsense in a formalized logical framework means it excels in careful deductive reasoning.

> ConceptNet represents contextual common sense reasoning over real world texts.

Page 16: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Part 2

Page 17: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Building of ConceptNet

ConceptNet's extraction rules from semi-structured OMCS:

> Extraction Phase

> Normalization Phase

> Relaxation Phase

Page 18: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Building of ConceptNet (cont...)

> approximately fifty extraction rules are used to map OMCS's English sentences into ConceptNet binary relation assertion.

> Extracted Nodes are also normalized.

> Relaxation means to smooth over semantic gaps and improve the connectivity of network.

Page 19: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Structure of ConceptNet

> K Lines (1.25 million assertions)

> Things (52,000 assertions)

> Agents (104,000 assertions)

> Events (38,000 assertions)

> Spatial (36,000 assertions)

> Causal (17,000 assertions)

> Functional (115,000 assertions)

> Affective (34,000 assertions)

Page 20: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Structure of ConceptNet (cont...)

Overall semantic network contains:

> 1.6 millions assertions

> over 300,000 nodes

Page 21: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Applications of ConceptNet

> Commonsense ARIA

> Goose

> MakeBelieve

> GloBuddy

> AAA- a profiling and recommendation system

and many more

Page 22: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Present ConceptNet

> Originally initiated as ConceptNet 2

> It is no longer maintained

> Then ConceptNet 3 was introduced

> Now ConceptNet 5 is available

> Developed by

Rob Speer

Catherine Havasi and

Many others

Page 23: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Part 3

Page 24: ConceptNet: A Wonderful Semantic World By Bijoy Arif

ConceptNet in Windows

> Using ConceptNet in Linux or Mac is very easy

> But in Windows, need bag of tricks

> Need a way to use others SQL database in Python

Page 25: ConceptNet: A Wonderful Semantic World By Bijoy Arif

ConceptNet in Windows (cont...)

Need to download

> Any Python Machine

> ConceptNet.tar.gz

> csc-util.tar.gz

> Django.tar.gz

> Simplenlp.tar.gz

Page 26: ConceptNet: A Wonderful Semantic World By Bijoy Arif

ConceptNet Modules

Http://csc.media.mit.edu/docs/conceptnet/conceptnet4.html

Page 27: ConceptNet: A Wonderful Semantic World By Bijoy Arif

ConceptNet Demo

>>> It is time to visit wonderful world

Page 28: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Quick Review

> Initiated as ConceptNet 2

> MIT Media Lab is Place of Birth

> Use OMCS Corpus to create, maintain and develop ConceptNet

> Maintain a large database brilliantly

> Combination of WordNet like structure and Cyc like relation

> Now ConceptNet 5 is available

Page 29: ConceptNet: A Wonderful Semantic World By Bijoy Arif

My View of ConceptNet

> OMCS should be open source as well.

> Must have a way to interact with OMCS to change, develop, acquire data.

> ConceptNet have a way to update its database directly from interactive OMCS.

> Overall it is a nice world.

Thank You

Page 30: ConceptNet: A Wonderful Semantic World By Bijoy Arif

References

[1] ConceptNet-a practical commonsense reasoning toolkit by H Liu and P Singh

[2]Http://csc.media.mit.edu/docs/conceptnet/conceptnet4.html

Page 31: ConceptNet: A Wonderful Semantic World By Bijoy Arif

Questions????