dependency relations for sanskrit parsing and treebank

30
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Dependency Relations for Sanskrit Parsing and Treebank Amba Kulkarni 1 Pavankumar Satuluri 2 Sanjeev Panchal 1 Malay Maity 1 Amruta Malvade 1 1 Department of Sanskrit Studies University of Hyderabad 2 School of Linguistics & Literary Studies Chinmaya Vishwavidyapeeth Ernakulam 19 th International Workshop on Treebanks and Linguistic Theories 2020 1 / 23

Upload: others

Post on 25-Jun-2022

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Dependency Relations for Sanskrit Parsing andTreebank

Amba Kulkarni1 Pavankumar Satuluri2 Sanjeev Panchal1Malay Maity1 Amruta Malvade1

1Department of Sanskrit StudiesUniversity of Hyderabad

2School of Linguistics & Literary StudiesChinmaya Vishwavidyapeeth

Ernakulam

19th International Workshop on Treebanks and LinguisticTheories 2020

1 / 23

Page 2: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Introduction

1 Pānini’s Grammar

2 Samsādhanī Tagset

3 Enhanced Tagset

4 Samsādhanı Parser

5 Sanskrit Treebank

6 Evaluation

7 Conclusion

2 / 23

Page 3: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Introduction

1 Pānini’s Grammar

2 Samsādhanī Tagset

3 Enhanced Tagset

4 Samsādhanı Parser

5 Sanskrit Treebank

6 Evaluation

7 Conclusion

2 / 23

Page 4: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Introduction

1 Pānini’s Grammar

2 Samsādhanī Tagset

3 Enhanced Tagset

4 Samsādhanı Parser

5 Sanskrit Treebank

6 Evaluation

7 Conclusion

2 / 23

Page 5: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Introduction

1 Pānini’s Grammar

2 Samsādhanī Tagset

3 Enhanced Tagset

4 Samsādhanı Parser

5 Sanskrit Treebank

6 Evaluation

7 Conclusion

2 / 23

Page 6: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Introduction

1 Pānini’s Grammar

2 Samsādhanī Tagset

3 Enhanced Tagset

4 Samsādhanı Parser

5 Sanskrit Treebank

6 Evaluation

7 Conclusion

2 / 23

Page 7: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Introduction

1 Pānini’s Grammar

2 Samsādhanī Tagset

3 Enhanced Tagset

4 Samsādhanı Parser

5 Sanskrit Treebank

6 Evaluation

7 Conclusion

2 / 23

Page 8: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Introduction

1 Pānini’s Grammar

2 Samsādhanī Tagset

3 Enhanced Tagset

4 Samsādhanı Parser

5 Sanskrit Treebank

6 Evaluation

7 Conclusion

2 / 23

Page 9: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Introduction

1 Pānini’s Grammar

2 Samsādhanī Tagset

3 Enhanced Tagset

4 Samsādhanı Parser

5 Sanskrit Treebank

6 Evaluation

7 Conclusion

2 / 23

Page 10: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Pāṇini’s Grammar

Around 400 BCEFull-fledged grammar of the then prevalent SanskritCovering both Vedic and Non-Vedic textsOnly full-fledged, manually written, computational grammarfor any natural language

3 / 23

Page 11: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Samsādhanī Tagset

The first tagset for Sanskrit (Ramakrishnamacharyulu 2009)Approximately 100 relationsInter-sentential relationsIntra-sentential relations

4 / 23

Page 12: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Samsādhanī Tagset

Examined from computational view pointFound to be fine-grainedFine-grain relations - 100

5 / 23

Page 13: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Samsādhanī Tagset

Kartāanubhavī(experiencer)amūrtaḥ(abstract)prayojakaḥ(causative agent)prayojyaḥ(causee)abhiprerakaḥ(cause of temptation)karmakartṛkaraṇakartṛṣaṣṭīkartā

6 / 23

Page 14: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Samsādhanī Tagset

Skt: Rāmaḥ(Kartā) pacatiEng: Rama cooks

Skt: Ghaṭaḥ(anubhavī kartā) naśyatiEng: Pot is experiencing the destruction

Coarse-grain relations - 31

7 / 23

Page 15: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Lacunae in the Samsādhanī Tagset

Relations without any associated semanticsRelations due to morphological requirementComplementiser

Inconsistent with Pāṇinian GrammarCoordinating conjuncts

8 / 23

Page 16: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Relations due to morphological requirement

grāmaṃ paritaḥ vṛkṣāḥ santi.village surrounding trees are.

upapadasambandhaḥlocation

Kartā

Figure: Old annotation

grāmaṃ paritaḥ vṛkṣāḥ santi.village surrounding trees are.

reference_pointlocation

Kartā

Figure: New annotation

9 / 23

Page 17: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Complementiser

ahaṃ gṛhaṃ gacchāmi iti rāmaḥ avadat.I home goes that Rama said

anuyogī

agentpratiyogī

agent

karma

Figure: Complementiser: old version

ahaṃ gṛhaṃ gacchāmi iti rāmaḥ avadat.I home goes that Rama said

agentvākyakarma

vākyakarmadyotakaḥ

agent

karma

Figure: Complementiser: new version

10 / 23

Page 18: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Coordinating Conjuncts

Rāmaḥ Sītā ca vanaṃ gacchati.Rama Sita and forest go.

kartākarma

conjunctconjunct

Figure: Conjuncts: Old version

Rāmaḥ Sītā ca vanaṃ gacchati.Rama Sita and forest go.

kartā

karmaconjunct conjunction

Figure: Conjuncts: New version

11 / 23

Page 19: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Samsādhanī Enhanced Tagset

The current version has 54 relations and classified into followingcategories.

Predicate-argument relationsNon-Predicate argument relations

Verb-verb relationsVerb-noun relationsNoun-noun relations

Relations due to special wordsConjuncts and DisjunctsMiscellaneous

12 / 23

Page 20: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Samsādhanı Parser

1 First full-fledged Parser for Sanskrit.2 Follows Pāṇinian Grammar and the Theories of Verbal

cognition.ākāṅkṣā (expectancy)yogyatā (meaning congruity)sannidhi (proximity)

3 Implemented as an edge-centric binary join to build adependency tree, in bottom-up approach, with local andglobal constraints on the edges and the edge labels.

13 / 23

Page 21: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Sanskrit Treebank

1 SHMT(Sanskrit-Hindi Machine Translation System)Consortium - 3000 Sentences.

2 Pañcatantra - 230 sentences. (Dwivedi and Guha, 2017)3 Treebank of Vedic Sanskrit (Hellwig et al., 2020)

14 / 23

Page 22: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Sanskrit Treebank

Samsādhanī Platform1 Saṅkṣepa Rāmāyaṇam2 Śrīmad-Bhagavad-Gıtā3 Śiśupālavadham

15 / 23

Page 23: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Sanskrit Treebank

1 Grammar Books2 NCERT(National Council for Education, Research and

Training) 9th grade - 284 sentences3 Independent sentences from various Sanskrit books.4 130 Short stories

16 / 23

Page 24: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Ambiguities during annotation

Skt: mārgāḥ avaruddhāḥ bhavanti.Gloss: Road{pl,nom} blocked{pl,nom} be{pres,pl,3p}.Eng: The roads are blocked.

mārgāḥ avaruddhāḥ bhavanti. mārgāḥ avaruddhāḥ bhavanti.Roads blocked are. Roads to be blocked happened.

Kartāpredicative adjective Kartākarma

Figure: Inflectional Information

17 / 23

Page 25: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Ambiguities during annotation

Skt: mitrāṇi kathayanti.Gloss: friend{pl,nom} / friend{pl,acc} tell{pres,pl,3p } /tell{pres,pl,3p [causative]}Eng: Friends tell / (They) tell friends / Friends make (somebody)tell / (They) make (somebody) tell friends.

18 / 23

Page 26: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Ambiguities during annotation

Skt: rāmaḥ pustakaṃ krıtvā paṭhati.Gloss: Rama{sg,nom} book{sg,acc} purchase{abs}read{pres,sg,3p}.Eng: Rama reads a book after purchasing it.

19 / 23

Page 27: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Evaluation

Source Sent Exact Failed Partial LAS UAS-ences Match Match

Grammar 468 343 2(.4%) 123 89% 97%9th grade 284 183 15(.6%) 87 82% 89%Skt Learner 1070 817 66(6%) 181 88% 92%BhG sample 36 7 3(8%) 26 70% 76%Average 1858 1350 86 (4.6%) 417 85.5% 91.5%

Table: Performance of Parser

20 / 23

Page 28: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Evaluation

machine→ kartā karma adjective pred adj .. Totalmanual↓ (agent) (goal)kartā (agent) 1322 14 10 26 .. 1523karma (goal) 31 883 7 .. 1069adjective 29 12 260 .. 406pred adj. 23 114 .. 162.. .. .. .. .. ..Total 1460 952 306 140 .. 6226

Table: Confusion Matrix

21 / 23

Page 29: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Conclusion

Improvised version of dependency relationsSignificant improvements

22 / 23

Page 30: Dependency Relations for Sanskrit Parsing and Treebank

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

...

.

Thank You

23 / 23