probabilistic clustering - university of minnesotavision.psych.umn.edu › users › schrater ›...
TRANSCRIPT
![Page 1: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/1.jpg)
Probabilistic Clustering
EM, Mixtures of Gaussians, RBFs, etc
![Page 2: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/2.jpg)
![Page 3: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/3.jpg)
![Page 4: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/4.jpg)
But only if we are given the distributions and prior
![Page 5: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/5.jpg)
![Page 6: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/6.jpg)
![Page 7: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/7.jpg)
![Page 8: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/8.jpg)
![Page 9: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/9.jpg)
![Page 10: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/10.jpg)
![Page 11: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/11.jpg)
![Page 12: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/12.jpg)
![Page 13: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/13.jpg)
http://www.ncrg.aston.ac.uk/netlab/
* PCA* Mixtures of probabilistic PCA* Gaussian mixture model with EM training* Linear and logistic regression with IRLS* Multi-layer perceptron with linear, logistic and
softmax outputs and error functions* Radial basis function (RBF) networks with
both Gaussian and non-local basis functions* Optimisers, including quasi-Newton methods,
conjugate gradients and scaled conj grad.* Multi-layer perceptron with Gaussian mixture
outputs (mixture density networks)* Gaussian prior distributions over parameters
for the MLP, RBF and GLM including multiple hyper-parameters
* Laplace approximation framework for Bayesian inference (evidence procedure)
* Automatic Relevance Determination for input selection
* Markov chain Monte-Carlo including simple Metropolis and hybrid Monte-Carlo
* K-nearest neighbour classifier* K-means clustering* Generative Topographic Map* Neuroscale topographic projection* Gaussian Processes* Hinton diagrams for network weights* Self-organising map
![Page 14: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/14.jpg)
Data sampled fromMixture of 3 Gaussians Spectral Clustering
![Page 15: Probabilistic Clustering - University of Minnesotavision.psych.umn.edu › users › schrater › schrater_lab › ...NETLAB Algorithms for Pattern+ kecog Software available on the](https://reader033.vdocuments.site/reader033/viewer/2022060506/5f1f4c16208e8777956d062a/html5/thumbnails/15.jpg)
Original Data Gaussian Mixture ModelClassification