1 pattern recognition concepts how should objects be represented? algorithms for...
TRANSCRIPT
![Page 1: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/1.jpg)
1
Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions * artificial neural networks How should learning/training be done?
![Page 2: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/2.jpg)
2
Feature Vector Representation
X=[x1, x2, … , xn],
each xj a real number Xj may be object
measurement Xj may be count of
object parts Example: object rep.
[#holes, Area, moments, ]
Moment is, loosely speaking, a quantitative measure of the shape of a set of points. Second moment", for example, is widely used and measures the "width" of a set of points in one dimension
![Page 3: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/3.jpg)
3
Possible features for char rec.
Inertia is the resistance of any physical object to a change in its state of motion or rest, or the tendency of an object to resist any change in its motion.
Strokes are the individual pen movements that are required to draw a character.
![Page 4: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/4.jpg)
4
Some Terminology
Classes: set of m known classes of objects (a) might have known description for each (b) might have set of samples for each Reject Class: a generic class for objects not in any of the designated known classes Classifier: Assign object to a class based on features
![Page 5: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/5.jpg)
5
Classification paradigms
![Page 6: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/6.jpg)
6
Discriminant functions
Functions f(x, K) perform some computation on feature vector x
Knowledge K from training or programming is used
Final stage determines class
![Page 7: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/7.jpg)
7
Decision-Tree Classifier Uses subsets of
features in seq. Feature
extraction may be interleaved with classification decisions
Can be easy to design and efficient in execution
![Page 8: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/8.jpg)
8
Decision Trees
#holes
moment ofinertia
#strokes #strokes
best axisdirection
#strokes
- / 1 x w 0 A 8 B
01
2
< t t
2 4
0 1
060
90
0 1
![Page 9: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/9.jpg)
9
Classification using nearest class mean
Compute the Euclidean distance between feature vector X and the mean of each class.
Choose closest class, if close enough (reject otherwise)
Low error rate at left
![Page 10: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/10.jpg)
10
Nearest mean might yield poor results with complex structure
Class 2 has two modes
If modes are detected, two subclass mean vectors can be used
![Page 11: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/11.jpg)
11
Scaling coordinates by std dev
![Page 12: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/12.jpg)
12
Another problem for nearest mean classification If unscaled, object X
is equidistant from each class mean
With scaling X closer to left distribution
Coordinate axes not natural for this data
1D discrimination possible with PCA
![Page 13: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/13.jpg)
13
Receiver Operating Curve ROC
Plots correct detection rate versus false alarm rate
Generally, false alarms go up with attempts to detect higher percentages of known objects
![Page 14: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/14.jpg)
14
Confusion matrix shows empirical performance
![Page 15: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/15.jpg)
15
Bayesian decision-making
![Page 16: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/16.jpg)
16
Normal distribution 0 mean and unit
std deviation Table enables us
to fit histograms and represent them simply
New observation of variable x can then be translated into probability
![Page 17: 1 Pattern Recognition Concepts How should objects be represented? Algorithms for recognition/matching * nearest neighbors * decision tree * decision functions](https://reader030.vdocuments.site/reader030/viewer/2022032606/56649ea35503460f94ba76f2/html5/thumbnails/17.jpg)
17
Parametric Models can be used