support vector machine - wordpress.com · 10/8/2016 · support vector machine (destek vektör...
TRANSCRIPT
![Page 1: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/1.jpg)
Support Vector Machine
YZM 3226 – Makine Öğrenmesi
![Page 2: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/2.jpg)
Outline
◘ Support Vector Machine (Destek Vektör Makineleri)
◘ SVM Tarihçe
◘ Linear Sınıflandırıcılar
◘ SVM Uygulama Alanları
◘ SVM Related Links
![Page 3: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/3.jpg)
Support Vector Machine
◘ Değişkenler arasındaki örüntülerin bilinmediği veri setlerindeki
sınıflama problemleri için önerilmiş bir makine öğrenmesi
yöntemidir»
◘ «Sınıflama, regresyon ve aykırı değer belirleme için kullanılabilen
eğiticili (supervised) öğrenme yöntemidir»
◘ Eğitim verisinde öğrenme yaparak yeni veri üzerinde doğru tahmin
yapmaya ve genelleştirmeye çalışan makine öğrenmesidir»
![Page 4: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/4.jpg)
SVM History
◘ Vapnik and colleagues (1992)—groundwork from Vapnik &
Chervonenkis’ statistical learning theory in 1960s.
V. Vapnik
![Page 5: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/5.jpg)
Support Vector Machines (SVM)
◘ It searches for the linear optimal separating hyperplane (i.e., “decision
boundary”)
◘ SVM finds this hyperplane using support vectors (training tuples) and
margins
Support VectorsSmall Margin Large Margin
![Page 6: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/6.jpg)
SVM—General Philosophy
Support Vectors
Small Margin Large Margin
![Page 7: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/7.jpg)
Support Vector Machines (SVM)
◘ There are infinite lines (hyperplanes)
separating the two classes but we
want to find the best one
(the one that minimizes classification
error on unseen data)
◘ SVM searches for the hyperplane
with the largest margin
![Page 8: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/8.jpg)
October 25, 2016 Data Mining: Concepts and Techniques
SVM—Margins and Support Vectors
![Page 9: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/9.jpg)
SVM—When Data Is Linearly Separable
m
Let data D be (X1, y1), …, (X|D|, y|D|), where Xi is the set of training tuples associated with the class labels yi
There are infinite lines (hyperplanes) separating the two classes but we want to find the best one (the one that minimizes classification error on unseen data)
SVM searches for the hyperplane with the largest margin, i.e., maximum marginal hyperplane (MMH)
![Page 10: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/10.jpg)
Linear Classifiersf x
a
yest
denotes +1
denotes -1
f(x,w,b) = sign(w x + b)
How would you classify this data?
w x + b<0
w x + b>0
![Page 11: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/11.jpg)
Linear Classifiersf x
a
yest
denotes +1
denotes -1
f(x,w,b) = sign(w x + b)
How would you classify this data?
![Page 12: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/12.jpg)
Linear Classifiersf x
a
yest
denotes +1
denotes -1
f(x,w,b) = sign(w x + b)
How would you classify this data?
![Page 13: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/13.jpg)
Linear Classifiersf x
a
yest
denotes +1
denotes -1
f(x,w,b) = sign(w x + b)
Any of these would be fine..
..but which is best?
![Page 14: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/14.jpg)
Linear SVM Mathematically
What we know:
◘ w . x+ + b = +1
◘ w . x- + b = -1
◘ w . (x+-x-) = 2
X-
x+
ww
wxxM
2)(
M=Margin Width
![Page 15: Support Vector Machine - WordPress.com · 10/8/2016 · Support Vector Machine (Destek Vektör Makineleri) SVM Tarihçe Linear Sınıflandırıcılar SVM Uygulama Alanları SVM Related](https://reader034.vdocuments.site/reader034/viewer/2022042308/5ed448d6bda1e66ddf5525d4/html5/thumbnails/15.jpg)
SVM Applications
◘ Used for: classification and numeric prediction
◘ Applications:
– handwritten digit recognition,
– text recognition,
– speech recognition,
– object recognition,
– speaker identification,
– benchmarking time-series prediction tests,
– content-based image retrieval,
– biometrics,
– protein sequence problem
– breast cancer diagnosis
– etc.