reumass amherst 2015 data science bootcampmarlin/teaching/reu/bootcamp-day4.pdf · 2015-06-03 ·...
TRANSCRIPT
![Page 1: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/1.jpg)
REUMass Amherst 2015 Data Science Bootcamp
Day 4: Unsupervised Learning
Prof. Ben Marlin [email protected]
![Page 2: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/2.jpg)
Plan for Day 4: • Clustering • Dimensionality Reduc8on
![Page 3: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/3.jpg)
Clustering
![Page 4: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/4.jpg)
Defini8on of a Par88oning
![Page 5: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/5.jpg)
Example: Gene Expression Data
![Page 6: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/6.jpg)
Example: Online Community Detec8on
![Page 7: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/7.jpg)
Example: Super Pixels
![Page 8: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/8.jpg)
The K-‐Means Algorithm
![Page 9: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/9.jpg)
The K-‐Means Algorithm
![Page 10: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/10.jpg)
Dimensionality Reduc8on
![Page 11: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/11.jpg)
Example: Image Manifolds
![Page 12: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/12.jpg)
Example: Digits
![Page 13: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/13.jpg)
Linear Dimensionality Reduc8on
X N
D
¼ Z
K
£ B D
![Page 14: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/14.jpg)
Linear Dimensionality Reduc8on
![Page 15: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/15.jpg)
Principal Components Analysis Under the assump4on that the matrix B is orthonormal, we obtain a classical method called Principal Components Analysis where the basis elements correspond to direc4ons of maximum varia4on in the data.
![Page 16: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/16.jpg)
Sparse Coding Under the addi4onal constraint that the rows of Z are sparse, we obtain a method called Sparse Coding:
![Page 17: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/17.jpg)
Sparse Coding
![Page 18: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/18.jpg)
Mul8-‐Dimensional Scaling
![Page 19: REUMass Amherst 2015 Data Science Bootcampmarlin/teaching/REU/bootcamp-day4.pdf · 2015-06-03 · REUMass Amherst 2015 Data Science Bootcamp Day 4: Unsupervised Learning! Prof. Ben](https://reader033.vdocuments.site/reader033/viewer/2022050314/5f77226e7205af660365c439/html5/thumbnails/19.jpg)
ISOMAP