on mechanism in clustering
DESCRIPTION
On Mechanism in Clustering. Speaker: Caiming Zhong 04-02-2010. Outline. Some main components of a clustering algorithm A mechanism: Adaptive (Autonomous) scheme, or framework K-Means: single prototype for one cluster - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/1.jpg)
On Mechanism in Clustering
Speaker: Caiming Zhong
04-02-2010
![Page 2: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/2.jpg)
2
Outline
Some main components of a clustering algorithm
A mechanism: Adaptive (Autonomous) scheme, or framework K-Means: single prototype for one cluster Affinity Propagation Multi-prototype based autonomy
Potential topics
![Page 3: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/3.jpg)
3
Main components of a clustering algorithm Distance metric (Similarity measure) Objective function Clustering scheme
![Page 4: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/4.jpg)
4
Main components of a clustering algorithm (cont.) Distance metric (Similarity measure)
Cornerstone for a clustering algorithm. Euclidean distance is the most used, but doesn’t
work some time.
![Page 5: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/5.jpg)
5
Euclidean
vs.
Geodesic
![Page 6: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/6.jpg)
6
Main components of a clustering algorithm (cont.) A similarity measure is not always a metric Conventional similarity measures
![Page 7: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/7.jpg)
7
![Page 8: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/8.jpg)
8
![Page 9: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/9.jpg)
9
![Page 10: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/10.jpg)
10
![Page 11: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/11.jpg)
11
Main components of a clustering algorithm (cont.) Special similarity measures
Point symmetry distance
![Page 12: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/12.jpg)
12
![Page 13: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/13.jpg)
13
![Page 14: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/14.jpg)
14
![Page 15: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/15.jpg)
15
![Page 16: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/16.jpg)
16
![Page 17: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/17.jpg)
17
Main components of a clustering algorithm (cont.) Special similarity measures
Path-based distance (minmax diatance)
![Page 18: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/18.jpg)
18
![Page 19: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/19.jpg)
19
![Page 20: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/20.jpg)
20
![Page 21: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/21.jpg)
21
Densities
![Page 22: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/22.jpg)
22
Main components of a clustering algorithm (cont.) Objective Function
What objective function to be optimized? K-Means: MSE, compactness Path-based: connectivity Point symmetry: Symmetry
![Page 23: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/23.jpg)
23
Main components of a clustering algorithm (cont.) Clustering framework
Split-and-merge Agglomerative Divisive Partitioning Density connectivity …
![Page 24: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/24.jpg)
24
A mechanism: Autonomous framework Generally a clustering process of clustering
scheme stops when a certain criterion is satisfied. The criterion is usually user-specifieduser-specified parameters.
The number of clusters The number of iterations
If the criterion is not a specific threshold, but convergence (the stable state is achieved), we can say “Autonomous frameworkAutonomous framework”
![Page 25: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/25.jpg)
25
A mechanism: Autonomous framework (cont.) K-Means is a typical autonomous framework
Repeatedly move prototypes (representative points of a cluster), until no prototype changed
Affinity propagation
![Page 26: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/26.jpg)
26
![Page 28: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/28.jpg)
28
A mechanism: Autonomous framework (cont.)
A multi-prototype clustering algorithm
![Page 29: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/29.jpg)
29
![Page 30: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/30.jpg)
30
![Page 31: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/31.jpg)
31
![Page 32: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/32.jpg)
32
![Page 33: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/33.jpg)
33
![Page 34: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/34.jpg)
34
![Page 35: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/35.jpg)
35
![Page 36: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/36.jpg)
36
![Page 37: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/37.jpg)
37
![Page 38: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/38.jpg)
38
![Page 39: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/39.jpg)
39
Potential topics
Apply existing mechanisms onto Graph (K-MST Graph) , in breeding.
Improve the existing mechanisms. Exploit new mechanism.
![Page 40: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/40.jpg)
40
References
R. XU, D. WUNSCH, Survey of clustering algorithms. IEEE Transactions on Neural Networks, 2005.
M. Su, C. Chou, A modified version of the K-means algorithm with a distance based on cluster symmetry, IEEE Transactions on PAMI, 2001.
S, Bandyopadhyay, S. Saha, GAPS: A clustering method using a new point symmetry-based distance measure, Pattern Recognition, 2007.
B. Fischer, J. Buhmann, Path-Based Clustering for Grouping of Smooth Curves and Texture Segmentation, IEEE Transactions PAMI, 2003.
![Page 41: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/41.jpg)
41
References (cont.)
H. Chang, D. Yeung, Robust path-based spectral clustering, Pattern recognition, 2008.
B. Frey, D. Dueck, Clustering by passing messages between data points, Science, 2007.
M. Liu, X. Jiang, AC. Kot, A multi-prototype clustering algorithm, Pattern Recognition, 2009.
![Page 42: On Mechanism in Clustering](https://reader035.vdocuments.site/reader035/viewer/2022062223/568145af550346895db2ada0/html5/thumbnails/42.jpg)
42
Thanks!