machinelearningfor language(technology( lecture5...
TRANSCRIPT
![Page 1: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/1.jpg)
Machine Learning for Language Technology Lecture 5: Bayesian Classifica3on
Marina San3ni Department of Linguis3cs and Philology Uppsala University, Uppsala, Sweden
Autumn 2014
Acknowledgement: Thanks to Prof. Joakim Nivre for course design and materials
![Page 2: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/2.jpg)
Bayesian Classifica3on (i)
![Page 3: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/3.jpg)
Bayesian Classifica3on (ii)
![Page 4: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/4.jpg)
Instance APributes
![Page 5: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/5.jpg)
Ex: Spam Filtering
![Page 6: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/6.jpg)
Naive Bayes Classifiers
![Page 7: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/7.jpg)
Modeling
![Page 8: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/8.jpg)
Inference
![Page 9: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/9.jpg)
Learning (i)
![Page 10: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/10.jpg)
Learning (ii)
![Page 11: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/11.jpg)
Learning (iii)
![Page 12: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/12.jpg)
Evalua3on (i)
![Page 13: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/13.jpg)
Evalua3on (ii)
![Page 14: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/14.jpg)
Mul3-‐Class Classifica3on
![Page 15: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/15.jpg)
Naive Bayes in NLP
![Page 16: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/16.jpg)
Tips and Tricks
![Page 17: MachineLearningfor Language(Technology( Lecture5 ...santini.se/teaching/ml/2014/Lecture5_Bayesian_Classification.pdf · Word sense disambiguation Key properties: Attributes can be](https://reader034.vdocuments.site/reader034/viewer/2022043018/5f3a4338f0d5b860a0461cbd/html5/thumbnails/17.jpg)
The end