Optimized Nearest Neighbor MethodsCam Weighted Distance vs. Statistical Confidence

Robert R. Puckett

Cam-Weighted Distance Deforms the distribution by

transformation Simulates strengthening and weakening

effects between prototypes. k-nearest neighbors used to estimate

parameters of the distribution Inverse transform

used to provide a

“cam weighted

distance”

Statistical Confidence

Confidence proportional majority value of neighbors.

On low confidence choose bigger k

An alternative to globally increasing the k value.

Algorithm selectively increases the k-value only when the confidence is below some threshold.

Goals

Implement NN-Base System Cam-NN Add-on Statistical Confidence Add-on

Create hybrid method Test against dataset

Schedule

Main Milestones Software development Dataset generation Analysis Report Writing

ID

6

7

4

1

14

17

2

9

18

8

11

3

5

13

15

12

16

10

19

10/9

10/12

10/26

11/7

11/9

11/14

11/15

12/5

S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F SOct 8, '06 Oct 15, '06 Oct 22, '06 Oct 29, '06 Nov 5, '06 Nov 12, '06 Nov 19, '06 Nov 26, '06 Dec 3, '06

References Duda, R. O., P. E. Hart, et al. (2001). Pattern

classification. New York, Wiley.

Wang, J., P. Neskovic, et al. (2006). "Neighborhood size selection in the k-nearest-neighbor rule using statistical confidence." Pattern Recognition 39 (3): 417-423.

Zhou, C. Y. and Y. Q. Chen (2006). "Improving nearest neighbor classification with cam weighted distance." Pattern Recognition 39 (4): 635-645.