discourse and summarization - sameer singhsameersingh.org/courses/...discourse-summarization.pdf ·...
TRANSCRIPT
![Page 1: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/1.jpg)
DiscourseandSummarization
Prof.SameerSinghCS295:STATISTICALNLP
WINTER2017
March16,2017
BasedonslidesfromDanJurafsky,JacobEisenstein,andeveryoneelsetheycopiedfrom.
![Page 2: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/2.jpg)
Upcoming…
• Finalreportdueinaweek:March20,2017• Instructionsup:ACLstyle,5pages(+references)Project
2CS295:STATISTICALNLP(WINTER2017)
![Page 3: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/3.jpg)
Outline
Discourse
3
Summarization
Wrapup
CS295:STATISTICALNLP(WINTER2017)
![Page 4: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/4.jpg)
Outline
Discourse
4
Summarization
Wrapup
CS295:STATISTICALNLP(WINTER2017)
![Page 5: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/5.jpg)
Discourse
5
Coreference
Coherence
Relations
Resolvingentities andevents.
Whatmakesthetextcoherent?
Rhetorical andnarrative linksbetweenunits
CS295:STATISTICALNLP(WINTER2017)
![Page 6: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/6.jpg)
Discourse
6
Coreference
Coherence
Relations
Resolvingentities andevents.
Whatmakesthetextcoherent?
Rhetorical andnarrative linksbetweenunits
CS295:STATISTICALNLP(WINTER2017)
![Page 7: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/7.jpg)
Coherence
7CS295:STATISTICALNLP(WINTER2017)
![Page 8: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/8.jpg)
Coherence
8CS295:STATISTICALNLP(WINTER2017)
![Page 9: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/9.jpg)
CoherencevsSemantics
9
Ameaninglesssentencecanbegrammatical..
Colorlessgreenideassleepfuriously
Thediscourseequivalentofgrammaticalityiscoherence
Canacoherenttextbewithoutmeaning?
CS295:STATISTICALNLP(WINTER2017)
![Page 10: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/10.jpg)
ExampleEssay
10CS295:STATISTICALNLP(WINTER2017)
![Page 11: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/11.jpg)
ExampleEssay
11
Thesecondreasonforthefive-paragraphthemeisthatitmakesyoufocusonasingletopic.Somepeoplestartwritingontheusualtopic,likeTVcommercials,andtheywindupallovertheplace,talkingaboutwhereTVcamefromorcapitalismorhealthfoodsorwhatever.Butwithonlyfiveparagraphsandonetopicyou’renottemptedtogetbeyondyouroriginalidea,likecommercialsareagoodsourceofinformationaboutproducts.Yougiveyourthreeexamples,andzap!you’redone.Thisisanotherwaythefive-paragraphthemekeepsyoufromthinkingtoomuch.
CS295:STATISTICALNLP(WINTER2017)
![Page 12: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/12.jpg)
Detecting“Coherency”
12CS295:STATISTICALNLP(WINTER2017)
![Page 13: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/13.jpg)
DiscourseConnectors
13CS295:STATISTICALNLP(WINTER2017)
![Page 14: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/14.jpg)
LexicalChains
14CS295:STATISTICALNLP(WINTER2017)
![Page 15: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/15.jpg)
DiscourseRelations
15
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 16: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/16.jpg)
DiscourseRelations
16
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 17: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/17.jpg)
DiscourseRelations
17
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 18: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/18.jpg)
DiscourseRelations
18
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 19: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/19.jpg)
DiscourseRelations
19
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 20: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/20.jpg)
DiscourseRelations
20
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 21: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/21.jpg)
CoherenceStructure
21
Segmentation
Zoning/Ordering
Centering/Salience
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 22: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/22.jpg)
CoherenceStructure
22
Segmentation`
Zoning/Ordering
Centering/Salience
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 23: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/23.jpg)
CoherenceStructure
23
Segmentation
Zoning/Ordering
Centering/Salience
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 24: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/24.jpg)
CoherenceStructure
24
Segmentation
Zoning/Ordering
Centering/Salience
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
1.Intoday’ssociety,collegeisambiguous.2.Weneedittolive,3.butwealsoneedittolove.4.Moreover,withoutcollegemostoftheworld’slearningwouldbeegregious.5.College,however,hasmyriadcosts.6.Oneofthemostimportantissuesfacingtheworldishowtoreducecollegecosts.7.Somehavearguedthatcollegecostsareduetotheluxuriesstudentsnowexpect.8.Othershavearguedthatthecostsarearesultofathletics.9.Inreality,highcollegecostsaretheresultofexcessivepayforteachingassistants
CS295:STATISTICALNLP(WINTER2017)
![Page 25: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/25.jpg)
ApplicationsofCoherence
25
SentenceOrdering
Whengeneratingsummaries,reordertillsentencesarecoherent.
ReadabilityAssessment Isapieceoftexteasilyreadable?
CS295:STATISTICALNLP(WINTER2017)
![Page 26: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/26.jpg)
Discourse
26
Coreference
Coherence
Relations
Resolvingentities andevents.
Whatmakesthetextcoherent?
Rhetorical andnarrative linksbetweenunits
CS295:STATISTICALNLP(WINTER2017)
![Page 27: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/27.jpg)
DiscourseRelations
27CS295:STATISTICALNLP(WINTER2017)
![Page 28: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/28.jpg)
UseinSentimentAnalysis
28CS295:STATISTICALNLP(WINTER2017)
![Page 29: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/29.jpg)
Outline
Discourse
29
Summarization
Wrapup
CS295:STATISTICALNLP(WINTER2017)
![Page 30: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/30.jpg)
TextSummarizationGoal:produceanabridgedversionofatextthatcontainsinformationthatisimportantorrelevanttoauser.
SummarizationApplications◦ outlinesorabstractsofanydocument,article,etc◦ summariesofemailthreads◦ actionitemsfromameeting◦ simplifyingtextbycompressingsentences
30CS295:STATISTICALNLP(WINTER2017)
![Page 31: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/31.jpg)
Whattosummarize?Single-documentsummarization◦ Givenasingledocument,produce◦ abstract◦ outline◦ headline
Multiple-documentsummarization◦ Givenagroupofdocuments,producea“gist”:◦ aseriesofnewsstoriesonthesameevent◦ asetofwebpagesaboutsometopicorquestion
31CS295:STATISTICALNLP(WINTER2017)
![Page 32: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/32.jpg)
Query-focusedvsGenericGenericsummarization:◦ Summarizethecontentofadocument
Query-focusedsummarization:◦ summarizeadocumentwithrespecttoaninformationneedexpressedinauserquery.
◦ akindofcomplexquestionanswering:◦ Answeraquestionbysummarizingadocumentthathastheinformationtoconstructtheanswer
32CS295:STATISTICALNLP(WINTER2017)
![Page 33: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/33.jpg)
Extractivesummarization&AbstractivesummarizationExtractivesummarization:◦ createthesummaryfromphrasesorsentencesinthesourcedocument(s)
Abstractivesummarization:◦ expresstheideasinthesourcedocumentsusing(atleastinpart)differentwords
33CS295:STATISTICALNLP(WINTER2017)
![Page 34: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/34.jpg)
Summarization:ThreeStages1. contentselection:choosesentencestoextractfromthedocument
2. informationordering:chooseanordertoplacetheminthesummary
3. sentencerealization:cleanupthesentences
34
DocumentSentence
SegmentationSentenceExtraction
All sentencesfrom documents
Extracted sentences
Information Ordering
Sentence Realization
Summary
Content Selection
Sentence Simplification
CS295:STATISTICALNLP(WINTER2017)
![Page 35: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/35.jpg)
Simplifyingsentences
appositives Rajam,28,anartistwhowaslivingatthetimeinPhiladelphia,foundtheinspirationinthebackofcitymagazines.
attribution clauses Rebelsagreedtotalkswithgovernmentofficials,internationalobserverssaidTuesday.
PPswithoutnamed entities
ThecommercialfishingrestrictionsinWashingtonwillnotbeliftedunlessthesalmonpopulationincreases[PPtoasustainablenumber]]
initialadverbials “Forexample”,“Ontheotherhand”,“Asamatteroffact”,“Atthispoint”
CS295:STATISTICALNLP(WINTER2017) 35Zajic etal.(2007),Conroyetal.(2006),Vanderwende etal.(2007)
Simplestmethod:parsesentences,userulestodecidewhichmodifierstoprune(morerecentlyawidevarietyofmachine-learningmethods)
![Page 36: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/36.jpg)
ROUGE(RecallOrientedUnderstudyforGistingEvaluation)Intrinsicmetricforautomaticallyevaluatingsummaries◦ BasedonBLEU(ametricusedformachinetranslation)◦ Notasgoodashumanevaluation(“Didthisanswertheuser’squestion?”)◦ Butmuchmoreconvenient
GivenadocumentD,andanautomaticsummaryX:◦ HaveNhumansproduceasetofreferencesummariesofD◦ Runsystem,givingautomaticsummaryX◦ WhatpercentageofthebigramsfromthereferencesummariesappearinX?
36
ROUGE − 2 =min(count(i,X),count(i,S))
bigrams i∈S∑
s∈{RefSummaries}∑
count(i,S)bigrams i∈S∑
s∈{RefSummaries}∑
CS295:STATISTICALNLP(WINTER2017)
![Page 37: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/37.jpg)
Outline
Discourse
37
Summarization
Wrapup
CS295:STATISTICALNLP(WINTER2017)
![Page 38: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/38.jpg)
WordoutofContext
38CS295:STATISTICALNLP(WINTER2017)
![Page 39: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/39.jpg)
WordsinContext
39CS295:STATISTICALNLP(WINTER2017)
![Page 40: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/40.jpg)
Sentences
40CS295:STATISTICALNLP(WINTER2017)
![Page 41: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/41.jpg)
InformationExtraction
CS295:STATISTICALNLP(WINTER2017) 41
![Page 42: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/42.jpg)
MachineTranslation
42CS295:STATISTICALNLP(WINTER2017)
![Page 43: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/43.jpg)
Other“Applications”
43CS295:STATISTICALNLP(WINTER2017)
DocumentDocumentDocument
DocumentDocume
ntDocumentDocume
ntDocument
Question Processing
PassageRetrieval
Query Formulation
Answer Type Detection
Question
Passage Retrieval
Document Retrieval
Answer Processing
Answer
passages
Indexing
RelevantDocs
DocumentDocumentDocument
DocumentSentence
SegmentationSentenceExtraction
All sentencesfrom documents
Extracted sentences
Information Ordering
Sentence Realization
Summary
Content Selection
Sentence Simplification
![Page 44: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/44.jpg)
Wrapup oftheCourse
CS295:STATISTICALNLP(WINTER2017) 44
![Page 45: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/45.jpg)
AndNow!
CS295:STATISTICALNLP(WINTER2017) 45
![Page 46: Discourse and Summarization - Sameer Singhsameersingh.org/courses/...discourse-summarization.pdf · Discourse Relations 15 1. In today’s society, college is ambiguous. 2. We need](https://reader033.vdocuments.site/reader033/viewer/2022050419/5f8ee03af3b59967811867a8/html5/thumbnails/46.jpg)
DoresearchinNLP!
46CS295:STATISTICALNLP(WINTER2017)