1-nn rule: given an unknown sample x decide if for that is, assign x to category if the closest...

Post on 15-Jan-2016

219 views

Category:

Documents

0 download

Report

Download

Tags:

Embed Size (px):

TRANSCRIPT

1-NN Rule: Given an unknown sample X decide if

for

That is, assign X to category if the closest neighbor of X is from category i.

),(),( jlik XXdXXd ikjl

k-NN rule: instead of looking at the closest sample, we look at k nearest neighbors to X and we take a vote. The largest vote wins. k is usually taken as an odd number so that no ties occur.

Page 4: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 5: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Distance Measures(Metrices)Non-negativity

Reflexivity when only x = y

Symmetry

Triangle inequality

Euclidian distance satisfies.Not always a meaningful measure.Consider 2 features with different units scaling

problem.

0),( yxD

),(),( xyDyxD

),(),(),( yxDyzDzxD

)(2

hight

)(1

weight

Scale of changed to half.1X

Page 6: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Minkowski MetricA general definition

norm – City block (Manhattan) distance norm – Euclidian

Scaling: Normalize the data by re-scaling (Reduce the range to 0-1) (equivalent to changing the metric)

iik yxyxL/1

),(

1L2L

baL 1

Page 7: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 8: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 9: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 10: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 11: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 12: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 13: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 14: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 15: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 16: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 17: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 18: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

Page 19: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i

References

R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, New York: John Wiley, 2001. N. Yalabık, “Pattern Classification with Biomedical Applications Course Material”, 2010.

X Login - 1 Main Screen X 1.1 Add Category 1 1.2 Modify Category 1 1.3 Add Item 1 1.4 Modify Item 1 1.5 Loan Item 1 …

PART I: GENERAL REGULATION€¦ · mentioned in category A and Category B and if required by the Authority in the case of building falling within Sub category C 1 and C11 of Category

209299Orig1s000 - Food and Drug Administration · ALT/AST and TBL remain in this category (AST/ALT is 3 to 5 x ULN; and total BL remains less than 2 x ULN) • If interrupted, resume

FY2014 Category Codes, Requisition Workflow, and Laser, Radioactive & X-ray Approvals CATEGORY CODES, REQUISITION WORKFLOW, AND RADIOACTIVE, LASER & X-RAY

Utility Representations - Cornell University utility.pdf · utility representations • If u represents ≻, then we must have x ≻ y if and only if u(x)≤ u(y) • Thus, x ∼

Licensee Category CAMP REST AMP SCWC GDC …...15 Southwest Park, Clothing Accessories X X X X X X X X X MA 02090 Infant/Toddler Apparel X X X X X X X X X X Mr. Kevin Meisinger Men's

Category 1 Category 2 Category 3 Category k Obs. 1x 11 x 12 x 13 …x 1k Obs. 2x 21 x 22 x 23 …x 2k Obs. 3x 31 x 32 x 33 …x 3k Obs. 4x 41 x 42 x 43 …x 4k

Chapter Four Utility. Utility Functions A utility function U(x) represents a preference relation if and only if: x’ x” U(x’) > U(x”) x’ x” U(x’)

Licensee Category CAMP REST AMP SCWC GDC SMC DPT BDPT … · Clothing Accessories X Collectibles X Consumables X Domestics X Drinkware X Electronics & Content X Footwear X Furniture/Furnishings

Conceptual Engineering Cost Estimate Detailed Cost ... · Conceptual Engineering Cost Estimate Detailed Cost Estimate Breakdown per FRA Categories x Summary x Category 10 x Category

Tema: Água. Score Click if X wins Click if O wins O X

VMware vSphere 6.7 Tagging€¦ · If the category is “application name,” the tags might be “DB,” “Middleware,” or “vCenter Server.” If the category is “CPU type,”