scale-invariance of support vector machines based on the ... · unité de recherche inria...

17
HAL Id: inria-00071984 https://hal.inria.fr/inria-00071984 Submitted on 23 May 2006 HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. Scale-Invariance of Support Vector Machines based on the Triangular Kernel Hichem Sahbi, François Fleuret To cite this version: Hichem Sahbi, François Fleuret. Scale-Invariance of Support Vector Machines based on the Triangular Kernel. [Research Report] RR-4601, INRIA. 2002. inria-00071984

Upload: others

Post on 06-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

HAL Id: inria-00071984https://hal.inria.fr/inria-00071984

Submitted on 23 May 2006

HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, estdestinée au dépôt et à la diffusion de documentsscientifiques de niveau recherche, publiés ou non,émanant des établissements d’enseignement et derecherche français ou étrangers, des laboratoirespublics ou privés.

Scale-Invariance of Support Vector Machines based onthe Triangular KernelHichem Sahbi, François Fleuret

To cite this version:Hichem Sahbi, François Fleuret. Scale-Invariance of Support Vector Machines based on the TriangularKernel. [Research Report] RR-4601, INRIA. 2002. �inria-00071984�

Page 2: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

ISS

N 0

249-

6399

ISR

N IN

RIA

/RR

--46

01--

FR

+E

NG

ap por t de r ech er ch e

THÈME 3

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

Scale-Invariance of Support Vector Machines basedon the Triangular Kernel

Hichem Sahbi — François Fleuret

N° 4601

Octobre 2002

Page 3: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone
Page 4: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

Unité de recherche INRIA RocquencourtDomaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France)

Téléphone : +33 1 39 63 55 11 — Télécopie : +33 1 39 63 53 30

������������ ����������� ��������������� ���"!$#%�&�'!(���*)+����,��� ��&-/.0��-"�&12�� !(,���3 �4���� �5��������*67�8�4 ��&�

9�:<;>=�?A@CB4DE=GF�:IH�JLKMDEN�OQP�:SRTJVU<?AW�KX?QY

Z8[�\^]�_�`�acbedAfg_XhIiQjkfIlnmQdo[�mQ]�]�_^pS]�iqjr[slnd�_Qtlu]�iwvQ_XxXtzy�mqd�d�{X_XxXt�j�mQd�dsiwl|xIxgiqdsj�_Mx

}LhImw~�_^fIx8b������b��

��iw�s��mQh�f�y�_�hI_Xjr[�_XhIjr[s_�dE�4�Q�Q����a��Vj�fgmq�shg_��w�Q�Q��a��X`��siqvq_Xx

�o�4�X�^�>���q�q� Z8[�l|x�hI_^�Emqhgf� ¡m�j�¢sxg_Xx�mqd0fI[�_£xIj^iq¤n_^pSludz¥¦iqhgl|iwd�j�_�iwdsy�fI[�_�vQmzmzy0�E_^hg ¡mqhI]�iwdsj^_Xx8mq §z¢���p�Emqhgf�¨©_Xj�fgmQh��ªiqjr[slnd�_Mx&�siQx�_My�mQd�fg[�_�fIhgl|iwdsvq¢�¤|iwh8«q_Xhgds_^¤S¬�& ­fI_^hVi�]�iwfg[�_X]�i>fgl|j^iq¤"iwd�iw¤u®zxgl|x8mw �fg[�_xIj^iq¤n_^pSludz¥>iwhIluiqdsj�_�mq �¤u_XiwhId�lud�v°¯&lnfg[±fg[�i>f�«q_Xhgd�_X¤<t©¯�_�ln¤u¤n¢�x�fIhIiwfg_�l²frx���_X[si¦¥zlnmQh£¯&lnfg[³i´xgln]���¤u_ª�w�j^¤uiQxgxglnµ�j^iwfglumqd���hImq��¤u_^]¶iqdsy°j^mq]��siwhI_�lnfIxV�E_^hg ¡mqhI]�iqdsj�_Mx�fImTfI[�mQxg_£mq i�·�iq¢sxIx�l|iwdª«Q_^hId�_^¤4mqdª ¸iqj�_y�_�fg_MjkfIlnmQd�iqdsy�[siwdsy�¯&hglnf�fI_^d0jr[siwhriqj�fg_^h8hI_Xj^mqvqdsl²fIlnmQd¹�ºA»�¼I½�¾ �>¿4�q� xg¢����Emqhgf&¥q_Xj�fgmQh]�iqjr[slnd�_Qtz«q_^hId�_X¤E]�_^fg[�m�y�xXt�x�fri>fIlux�fgl|j^iq¤E¤u_Xiqhgdslnd�v�tQmQ��~�_Xj�f&hg_Mj�mqvQd�lnpfIlnmQd

Page 5: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�� ����������� ����7��� ��,��� �5�� � �& £! 1����&��,��&�^��� 1��&- ��#*)+- �T!(�^����-"�� �! ��� �������� !(�4���� �5����������4�

� ���� ��� _ hriw���Emqhgfª��hImq�EmQxg_ y�_Xx�hI{Xxg¢�¤nfIiwfIx�j�mQdsj�_Xhgd�iwdAf�¤�� lndz¥>iwhIl|iwdsj^_ iq¢�� jr[�iwd�vQ_^]�_^dAfIxy�� {Mjr[�_^¤u¤n_Mxo_^f�¤u_Xx��Emqd�ds_Xx���_Xh� ¡mQhg]�iqdsj�_Mxoy�_Mx���������� �"!$#&%(')!*�+�-,�.�'(/10324%"5��siqxg{^_Mx�xg¢�h�¤n_ d�m>®Qiq¢fIhgl|iwdsvq¢�¤|iwluhg_Q¬�����hI{Xx�¢�d�_Tiqdsiw¤u®�x�_�]�i>fI[�{^]�i>fIl76A¢�_Ty�_�¤�� lndz¥>iwhIl|iwdsj^_�iq¢��´jr[siqd�vq_X]�_XdAfIx�y8� {Xjr[�_X¤n¤u_Xxy�_V¤9� iw����hI_^dAfIluxIxgiqvq_Vi¦¥q_XjVj�_�d�m>®Aiw¢Gtzd�mQ¢sx8¤9� lu¤n¤u¢sx�fghImqdsx&i¦¥Q_Xj�¢�d0��hgmQ��¤u\^]�_�x�lu]���¤n_�y�_�j^¤uiQxgxgl²µEj^i>fIlnmQd_Xd �q��t�_^f�dsmq¢sx�j^mq]��siwhImqd�x�xg_XxV�E_^hg ¡mqhI]�iqdsj�_Mx;:�j�_X¤n¤u_Xx�mQ��fg_Xdz¢�_Xx�i¦¥q_Mj�¢�d d�m>®Aiw¢´·�iq¢sxgxglu_^d´xg¢�hy�_Xx�f=<Qjr[�_�y�_�y�{^fg_Xj�fglumqd�y�_�¥zluxIiwvQ_Xx�_�f�y�_�hg_Mj�mqdsdsiwl|xgxIiwd�j�_�y�_�jXiwhriqj�fg\^hI_XxX¬> ¾ �M� ¼ ��? ��� x�¢��s��mQh�f�¥q_Xj�fgmQhL]�iqjr[�lud�_qtAd�m>®Aiw¢�� tQiq����hI_^dAfgl|xIxgiqvq_&x�fri>fIlux�fgl@6A¢�_qtzhI_Xj�mQd�dsiqluxIxgiqdsj�_&y�_ ¡mQhg]�_Mx

Page 6: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�8'(.�� % 032�� . �"0 .+2�'(% ��� �(� %)�"!�0 % 5 ��� ! / % !9�"0 . 2������ .+��%)�"2�%�� `

� �E £!"����1����'!(����

smqhoi y�_Xj^iQy�_ªd�m>¯�t&§z¢��s��mQh�fo¨©_MjkfImqh��°iqjr[�lud�_Xx�� `��V[si¦¥q_��shgm>¥Q_^d±fgm �E_°vq_Xd�_^hIl|j�iqdsy _��Tj^ln_XdQfiq¤nvQmqhIl²fI[�]�xV ¡mqh�j�¤|iqxIx�lnµ�j^iwfglumqd iwdsy hI_^vQhg_MxgxglumqdG¬�§�¨��ªx�vqmwf�fI[�_^luh��Emq�s¢�¤uiqhglnf�®°�EmwfI[  ¡hgmQ]7i�xgmq¤ul|yfI[�_^mQhg_^fgl|j^iq¤sx�¢s����mQh�f��n�qt����StziwdsyT��_Mj^iw¢�x�_&fI[�_^®�j^¤n_MiwhI¤n®£¢�dAfglu_�fg[s_�xg��_Mj�lnµ�j^iwfglumqd�mw  fI[�_�]�m�y�_X¤� ¡hImq]fI[�_£fghriwlud�lndsvs¬�Z8[s_� ¡mQhg]�_^hVj�mQhghI_Xxg��mQdsy�x�fgmTfI[�_�jr[�mql|j�_�mq Lfg[s_£¢�d�y�_^hI¤n®zlud�vT«Q_^hId�_^¤St iwdsy0fI[�_�¤uiwfg_^hjXiwd���_�y�mqd�_�mq��fglu]�iq¤n¤u®T¯&lnfg[�j�¤|iqxIxglujXiw¤�6A¢siqy�hIiwfgl|j�mQ��fglu]�l��Mi>fglumqd�]�_�fI[�m�y�x^¬

� _x�fg¢sy�®�lud�fg[�l|x(�siw�E_^h(§�¨��ªx"�siqxg_Xy�mQd�fg[�_©fIhgl|iwdsvq¢�¤|iwh «Q_^hId�_^¤StMiqdsy�¯�_L��hIm>¥Al|y�_©_)�z�E_^hIlu]�_XdAfIiw¤hI_Xxg¢�¤nfIxx�[�m>¯&lud�v�fI[�_^luh'vQmAm�y��E_^hg ¡mqhI]�iwdsj^_XxX¬�� _�¯&lu¤n¤�x�[sm>¯ fI[si>fMtziq¤²fI[�mq¢svq[�¤n_Mxgx'��mQ��¢�¤|iwh'fg[siqd�fg[�_·�iq¢sxIx�l|iwdª«Q_^hId�_^¤St�fg[s_£fIhgl|iwdsvq¢�¤|iwhV«q_Xhgd�_X¤�]�iq«q_Mx�fI[�_�fghriwlud�lndsv���hIm�j�_Mxgx�lndz¥>iwhIl|iwdAf�fIm�i�xIj^iw¤ulud�v�mq fI[�_�y�iwfIi�¬bed��r�£¯�_�x�¢s]�]�iqhgl��^_Vfg[s_�x�friwdsy�iqhIyT ¡mqhI]�iw¤ul��Mi>fglumqd�mw L§z¨V�ªx^t�iwdsy�¯_��shg_Mx�_XdQf8fI[�_�fghIluiqd�vq¢s¤uiqh

«Q_^hId�_^¤S¬Gbed��r`&¯_x�[�m>¯ iwd�iw¤u®QfIlujXiw¤u¤n®�[�m>¯ fghriwlud�lud�v�i�§z¨V�/¢sxglnd�v�fg[�_©fIhgl|iwdsvq¢�¤|iwhG«Q_^hId�_^¤qlux"lndz¥>iwhIluiqdAffIm xIj^iq¤nlud�v�¬ Z8[s_^dGtL¯�_ovQln¥Q_olud��I�°hI_Xxg¢�¤nfIx£mqd±i xgln]���¤u_0�q� ��hgmQ��¤u_^]�iwdsy mqd hI_Xiq¤²p ¯�mqhI¤uy friqxg«zxfIm´lu¤u¤n¢sx�fghri>fI_0¯&[si>f�fg[slux�ludz¥¦iqhgl|iwd�j�_o]�_Miwdsx�iwd�y fIm xg[�m>¯/[�m>¯ l²f�lu]���hgm>¥Q_Xx�fg[�_0vQ_^d�_XhIiq¤nl��Xiwfglumqd�E_^hg ¡mqhI]�iwdsj^_q¬

�������´���(!$# �&�'!(��� )+����,��^ ��&-

!#"%$ &('�)+*,-)+.�,0/-12.�34)65%7�89):';7�1<*� _�¯&lu¤u¤( ¡m�j^¢sx�mQd´§z¨V�ªx� ¡mqh�j�¤|iqxIx�lnµ�j^iwfglumqdG¬=�iQx�l|j^iq¤n¤u®qt §z¨V� ]�_�fI[�m�y�x��shgmq~�_Xjkf�y�i>fri�fIm�j�¤|iqxIxgl² ¡®lud0i£xg�siqj^_�mq (¤|iwhIvq_�>¡mQh�lud�µsdsl²fI_@?8y�lu]�_^dsxglnmQdGt�¯&[�_Xhg_�i�¤ulud�_Xiqh8j^hglnfg_Xhglumqd�lux8¢�x�_My ¬6 �mqh�iqdz®�fghriwlud�lndsvxg_�fMtzmqd�_�j^iqd�jr[�mzmQxg_�iqd�iq����hImq��hIluiwfg_��shgmq~�_XjkfIlnmQdBA xgm�fI[si>f&¤ulnds_Xiwh8xg_^�siqhIiq��ln¤ulnf�®�jXiwd���_�iqjr[�_Xln¥Q_Xy ¬� mQ]���¢�fIiwfglumqd lux�y�mqd�_�¯&lnfg[�mQ¢�f�iwd _ ����¤uluj^l²f� ¡mQhg] mq 'fI[�_���hImw~�_Xj�fglumqdGt �s¢�f�mqd�¤u®ª¯&lnfg[´fg[�_�«Q_^hId�_^¤j^mqhIhg_Mx��Emqd�y�lndsv�fgm�fI[�_�xIj^iw¤|iwh8��hIm�y�¢sj�f8�E_�f�¯�_^_Xd0��hgmq~�_Xj�fglumqdsxX¬Z8[�_�]�m�y�_X¤Glux�fI[z¢sx�xg��_Mj�lnµs_Xy��z®�jr[�mzmQxglud�v�fI[�_�«q_Xhgds_^¤DCFE

CFGIH�J#HLKNMPO QRASGIHFMTJASGUHLKVM(W��dsy�¤n_^f�� x�y�_^dsmwfg_YX�fg[�_� ¡¢sdsjkfIlnmQd�¯&[slujr[0x�luvqd�l|x8fg[�_��shg_My�luj�fg_My�j^¤uiQxgxZE

X:GUH9M[O Q]\-J^ASGUHFM_Wa`cbd"_�ffe��E_°i hriwdsy�mQ] ¥>iwhIluiq��¤u_�mqdRgih x�fIiwd�y�lndsv  ¡mqh�fI[�_� ¡_Xiwfg¢�hI_°y�l|x�fghIln��¢�fglumqd mw �y�iwfIi fgm

j^¤uiQxgxgln ¡®j>¸lnd�fg[�_ mqhIlnvQlnd�iw¤�xg�siQj�_@?�t�iwd�ylk mQdnmpoiqpJ�q�r°fg[�_ hg_Miw¤Vj�¤|iqxIxomq �fg[�_ y�i>fri�¬4�´_ ¯&lu¤n¤y�_^d�mqfg_YstOumpGIHFv�J%w�vZMxJZy�y�y�J�GUH{z9J%wpz�M|r�i�fghriwlud�lud�v�xg_�f�vq_Xd�_^hri>fI_Xy�lS¬ l<¬ y°iQj^j�mQhIy�lnd�vTfgm}GIe�J~k�Mr¬�Z8[�_j^mq]���¢�fri>fIlnmQdomw �\ l|x&iqjr[�_Xln¥Q_Xy��z®�]�lndsln]�l��^lud�v���� \���A¢sdsy�_^h�j^mqhIhg_Mjkf8j�¤|iqxIx�lnµ�j^iwfglumqdTmq "fI[�_Vfghriwlud�lndsvxg_�fMtqlS¬ _Q¬D�F�xJ:wp�DX:GUHL��M���qq¬�Z8[�l|x�lux©_�6A¢�ln¥>iq¤n_XdQf©fIm�]�i+��ln]�l��^lud�v�fg[�_&]�iqhgvQlnd���_^f�¯_X_^d�fg[s_8fghriwlud�lndsv�EmqludAfIx�iqdsy fg[s_Tx�_X�siwhri>fIlnd�v0[z®z��_Xh�p ��¤|iwdR>¡lud fg[s_T[�luvq[�pey�lu]�_XdsxglnmQdsiw¤Lxg�siqj^_@?�¬�Z8[�l|x�_Xdsx�¢shg_Mx�vqmzm�yvQ_^d�_XhIiq¤nl��Xiwfglumqdª�shgmQ��_Xh�f�®0mqd´fg[s_�hI_Xiq¤���mQ��¢�¤|i>fglumqd"¬�b f�j^iqd°�E_��shgm>¥Q_^d]�u�T�©fI[si>f�\ l|xVmw fg[�_� ¡mqhI]� ��� � w � ASGUH � Mrts¯&[�_^hI_Vfg[�_ � � j�mQ]�_V ¡hImq]/fI[�_� ¡mq¤u¤um>¯&lnd�v 6A¢siQy�hIiwfgl|j�mQ��fglu]�l��Mi>fIlnmQd���hImq�s¤n_X]�E

�������;���T�@�

Page 7: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

� �8.�/��)0���� � % ���=% !

xi

ixΨ( )

ω

4luvq¢�hI_°�pE��+� . 5(5"0 � '(.+!�0 �+2 0@5 ��% �N� �+� %����� . � #�,��� �4� ���)%(')!�032 ��! / %-� �"0 ��032�.�����.+!*. 032 .-/10 � /�+0� %)2 5"0 �+2�59��.�'(%��� /�% �=% . � 032�%(.+� ' �"03! % �"0 �+2 0@5 �15)%����

���:�����

Page 8: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�8'(.�� % 032�� . �"0 .+2�'(% ��� �(� %)�"!�0 % 5 ��� ! / % !9�"0 . 2������ .+��%)�"2�%�� �

��lud�lu]�l��^_�-G � MPO �

�� ��o��

��� � � � � ��w��Iw�� CFGUH{�%J#H���M¢sdsy�_^h�F�|J � � � iqdsy �

�� � w � O�

Z8[�_�¥>iq¤n¢�_�mq #b£y�mz_Xx�d�mqf�iw���E_Xiqh�lnd fg[s_�mq��fIln]�l��Xi>fIlnmQdGt"iqdsy l²f�[siQxVfgm0�E_Tj�mq]���¢�fg_XyGt"vqlu¥q_XdfI[�_ � � E

b O o ������������ v � � � ��w��iCFGIHL�~J%H���M9`��������� v � � � ��w��iCFGIHL�|J%H���M

� 4ludsiw¤u¤n®Qt�¢sxglndsv£fI[�_�_ ���siqdsxglnmQd�mq �\�t�¯�_�j^iwd�¯&hIl²fI_�fI[�_�j�¤|iqxIxgl²µ�jXi>fIlnmQdT ¡¢�dsj�fglumqd�iqxZE

X:GUH9M[O ��� �Uw��2C9GUHL�~J_HFM ` b

!#"I! � .�7%)6* �"!5�)+.$#&%�.�* %�5Z8[s_°j�¤|iqxIx�lnµ�jXi>fglumqd �Em>¯_Xh�mw £§z¨V�ªxoj^mq]�_Xxoy�lnhI_Xj�fg¤u®  ¡hImq] fg[s_´j�mQ]���¤n_)��l²f�®±mw �fg[�_´¢�dsy�_Xhg¤u®zlndsv«Q_^hId�_^¤S¬ �°iwdz® «q_Xhgds_^¤|x�jXiwd ��_ ¢sxg_XyGt�fI[�_ ]�mQx�f�x�fIiqdsy�iqhIy���_Xlnd�v³fI[�_ ·�iw¢sxIx�l|iwd CFGUH�J H K M O'��() oY��� H o�H K ��� *�+�,-*/.w¬ Z8[�_��siwhriw]�_�fI_^h0, lnd fg[�l|x�«q_^hId�_X¤'l|x£y�luhI_XjkfI¤n® hI_^¤|i>fI_Xy fIm´xIj^iw¤ulud�vs¬´b  �l²f

l|x�m>¥q_Xhg_Mx�fIln]�i>fI_Xy tqfg[�_V_ ���Emqd�_XdAfgl|iw¤���_X[si¦¥q_Mx'iq¤n]�mQx�f8¤nlud�_Xiqhg¤u®�iwdsyTl²f�j^iqdT�E_Vxg[�m>¯&dTfI[si>f�fg[s_���hImwp~�_MjkfIlnmQd lndAfImªfg[s_�[�luvq[�p y�lu]�_^dsxglumqd xg�siqj^_Tlux�iq¤uxgm°iw¤u]�mQx�f�¤ulnd�_Miwh�iwdsy ¢sx�_X¤n_MxgxX¬ ��d fI[�_0j�mqdAfIhIiqhg®Qt¯&[s_^d0¢�dsy�_Xhg_Mx�fIln]�iwfg_XyGt�fg[s_� ¡¢�dsj�fglumqd�¤|iqjr«�x&iwdz®ohI_^vQ¢�¤|iwhIl��Mi>fglumqd���m>¯�_^h�iqdsy�fg[�_£y�_Xj^luxglnmQd0��mQ¢�dsyzpiqhg®�luxG~�iwvqvQ_Xy�iwd�y£luhIhg_Xvq¢�¤|iwhMtw[�luvq[�¤u®£xg_^d�x�lnfglu¥q_8fIm�d�mql|xg®�fghriwlud�lud�v�y�iwfIi >¸xg_^_�µsvq¢�hI_�`�tQ]�luy�y�¤n_�hIm>¯^?k¬§�_^¥q_XhIiq¤"]�_�fI[�m�y�x�[si¦¥q_��E_^_Xd´y�_X¥q_X¤nmQ��_My�fgmo_Mx�fIln]�iwfg_£iqdªmq��fglu]�iq¤�,�tGxgm�fI[si>fVfg[�_£¯&[�mq¤u_��shgm�j�_Mxgx¯�mq¢s¤uy���_�ludz¥>iwhIluiqdQf�fgmTxIj^iq¤nlud�v�� ���S¬

� _� ¡m�j�¢sx�[�_^hI_�mqdªi�¤u_XxIx�x�fIiqdsy�iwhry�«q_Xhgd�_X¤GhI_� ¡_^hIhI_Xy�iqx&fI[�_ !9�"0 . 2 �+��� .+�� % �"24%�� tE¯&[�l|jr[0lux��siqxgl²pjXiw¤u¤n®0iwd´i���d�_� ¡¢sdsjkfIlnmQdªmw ©fI[�_£�'¢sj�¤uluy�_Xiwd´y�lux�fIiqdsj�_£��_^f�¯_X_^d�fI[�_��EmqludAfIx�lnd°fg[�_£mqhIlnvQlnd�iw¤(xg�siQj�_qt_)����hg_Mxgxg_Xy�iQx(C212GIH�J(w;M6O G%q#oR��� H o�wD��� +�,�M43�¬LZ8[�_YG�M 3  ¡mQhIj^_XxLfg[�l|x�]�iq����lud�v�fIm��E_��EmQxglnfglu¥q_qtziwd�y_Xdsxg¢�hg_MxLfI[�l|x'_)�z�shg_MxgxglnmQd�fgm£��_�i�«Q_^hId�_^¤S¬+�´_V¯&lu¤n¤�]�iw«Q_&fg[�_�iqxIxg¢�]���fglumqd�fI[si>f8¯�_VjXiwdojr[�mAx�_5,°xgmfI[si>f�iq¤n¤�fI[�_�y�iwfIi�¤nlu¥q_Mx8lnd�i��siq¤n¤ mq 4hriqy�lu¢sx�6* t�lS¬ _q¬&7 Gx��� e ���98:,;+ � M6O q��x8¯_V¯&ln¤u¤Gxg_^_V��_X¤nm>¯�tAfg[s_V�shgm�j�_Mxgxl|xludsy�_X��_Xdsy�iqdQf&mq �,�¬2 4lnd�iw¤u¤n®QtQfI[�_�«q_Xhgd�_X¤ j^iwd���_�y�_^µsd�_My¯&lnfg[smq¢�f& ¡mQhIj^lnd�v�lnfIx&�EmQxgl²fIln¥Q_^d�_MxgxZE

C 1 GUH�J^w;MPO q#o ��� H o wD���,

�������;���T�@�

Page 9: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

� �8.�/��)0���� � % ���=% !

−10 −5 0 5 10

1

1.5

0.5

2

00 0.05−0.05−0.1 0.1

1

1.005

1.01

0.995

0.990

1

1+1e−4

1+5e−5

1−5e−5

1−1e−4−1e−3 −5e−4 5e−4 1e−3

4luvq¢�hI_���E�·�iw¢sxIx�l|iwd´«q_Xhgd�_X¤#>¸j�mQdAfgludA¢smq¢sxV¤ulnd�_�?Viwdsy°fghIluiqd�vq¢s¤uiqh�«Q_^hId�_^¤#>¸ysiqxg[�_Xy°¤nlud�_@?�iwfV¥>iqhglumq¢sxxIj^iq¤n_Mx�>¡¤u_� ­f&fgm�hIlnvQ[AfXt�hI_Xxg��_Mjkfglu¥q_X¤n®��#q/��>t��#q * iwd�y��#q/��Z?�¬©bedQfI¢�lnfglu¥q_^¤u®qt�¯&[s_^hI_XiqxfI[�_�fghIluiqd�vq¢s¤uiqh«Q_^hId�_^¤(lux�fg[�_�xgiq]�_�i>f�iw¤u¤(xIj^iw¤u_XxXt�fI[�_�·�iw¢sxIx�l|iwd0«Q_^hId�_^¤([siqx�y�l��_^hI_^dAf�x�[siq��_Mx^t� ¡hImq]*iT��luhriqjkp ¤uln«Q_fIm�i£¢sd�l² ¡mQhg] ¯_XlnvQ[Afglud�v£mq (fI[�_�d�_XlnvQ[A�EmqhI[�mzm�y ¬

�mwfg_°fg[siwf�lnf�jXiwd �E_´_Miqxgln¤u® ��hIm>¥q_Xd >�� �@� t��siwvQ_´����?�fg[�i>fofI[�l|xo«Q_^hId�_^¤�[siqx�iwd lud�µsd�lnfg_´¨ �y�ln]�_^d�x�lumqdGt�iqdsy�lux&iwf�¤n_Miqx�f�iqx8�Em>¯_Xh� ¡¢�¤ iQx�fg[�_�·�iq¢sxgxgl|iwd�«q_^hId�_X¤Elud�fg_Xhg] mw 4xg_^��iwhriw��lu¤nlnf�®q¬

���������s�� ��V���4�^�� ���� ��� !(,�� �����-"-"�����8�

�#"%$ &��F)65%7%* �c1��f'�� % ' .L7�)6* �"!5�)+. #&%D.�* %�5��d°ludAfg_^hI_Xx�fglud�v���hgmQ��_Xh�f�®�mw 'fg[�_£fghIluiqd�vq¢s¤uiqh�«q_Xhgds_^¤"l|xV[�l|x�ludz¥¦iqhgl|iwd�j�_���lud°x�[�iw�E_���fgm�xgjXiw¤ulndsv >¸xg_^_µ�vq¢�hI_���?k¬L·Vlu¥q_Xd0i�xIj^iq¤nlud�v£ ¸iqjkfImqh��}W 0t�x�¢�jr[�iqd�ludz¥>iwhIluiqdsj�_�j^iqd��E_� ¡mqhI]�iw¤u¤n®T_)����hg_Mxgxg_Xy�iqxZE

C 1 G���H�J��}w�MPO q#o�� ��� H o wD���,O � C�12GIH�J-w�M�`aG%q-o���M >��@?

Z8[z¢sxXt�¯&[�_XdofI[�_���mQlndAfrx�iwhI_�xgjXiw¤u_XyT�z®�i�j^_^hgfIiqlnd� ¸iqj�fgmqh���tzfg[s_�¥¦iq¤n¢s_Vmq (fI[�_�«q_Xhgds_^¤GxIj^iw¤u_Xx��z®��ts�s¤n¢sx�iTj�mQdsx�fIiwdAf&fI_^hI] fI[si>f�y�mA_Mx�d�mqf�y�_X��_Xdsy�mqd0fI[�_��EmqludAfIx��s¢�f�mQd�¤n®�mqd���¬&��x�¯�_�¯&lu¤n¤4x�_X_qtfI[�_�_�6A¢�lu¤uln��hIlu¢�] j�mQdsx�fghriwludQf � ��� � w � O �]�iw«q_Mxfg[�_ q#o���fgm�¥>iwdsluxg[�lud�fg[�_�y�_Xj�l|xglnmQdo ¡¢�d�jkfglumqd"¬�#"I! �*"!:)+.�7%)+*#� % 1�� '�� %$�95�)&%'% 7)(5%�.bed°fg[�_£ ¡mq¤u¤um>¯&lnd�v�t�¯_�j�mQdsx�l|y�_XhVi�x�lnfg¢siwfglumqd´¯&[�_^hI_�¯�_�xIj^iq¤n_�fg[�_�y�iwfIio�A®ªiT ¸iqj�fgmqh��]W �¬ d"_�f�� xy�_^d�mqfg_ s+*�O m,��H v J�yZy�y�J-� H z r°i fIhIiqlndslnd�v xg_�fo ¡mqh�fI[si>fo�Emq�s¢�¤uiwfglumqdG¬j� _°y�_^dsmwfg_�X.* fg[�_j^¤uiQxgxglnµ�j^iwfglumqd� ¡¢�dsj�fglumqd°mQ��fIiqlnds_Xy��z®�fghriwlud�lud�v�fg[s_�§z¨V� mQd s+* >­fg[z¢sxXtDX v l|x�fI[�_£j^¤uiQxgxglnµs_^h���¢�lu¤²f ¡hImq]$fg[�_�y�iwfIi�i>f&mQhgluvqludsiw¤ xIj^iq¤n_�?k¬6� _�¯&ln¤u¤Gx�[sm>¯ fg[s_� ¡mq¤u¤nm>¯&lud�v�_�6A¢siw¤ulnf�®{E

���:�����

Page 10: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�8'(.�� % 032�� . �"0 .+2�'(% ��� �(� %)�"!�0 % 5 ��� ! / % !9�"0 . 2������ .+��%)�"2�%�� �

�{H�J X * G �}H9M2OlX v GUH9M

d"_�f � * t \ * iwdsyBb * ��_Vfg[s_V��iwhriw]�_�fI_^hrx'mq Gfg[�_�j^¤uiQxgxgl²µEj^i>fIlnmQd� ¡¢�dsj�fglumqd�_Xx�fglu]�i>fg_MyTmQdfs * ¬6�´_[�i¦¥q_�E

X * GUH9M[O ��� * � w��2C21 G���HL�~J#HFM ` b *

Z8[z¢sxXt�fg[s_ � * � j^mq]�_V ¡hgmQ]$fg[s_�]�lud�lu]�l��Mi>fglumqd0xg®zx�fg_X] j�mQhghI_Xxg�Emqdsy�lud�v£fgm�s+*LE

��lud�lu]�l��^_� * G � * MPO �

�� * � o �

��� � � * � � *� wp�Nw��YC�1<G ��H{�%J���H���M¢�d�y�_^h�F�|J � * � � iqdsy �

�� * � w � O�

b f& ¡mQ¤n¤um>¯�x^tz ¡hImq] _�6A¢siw¤ulnf�®}>���?TE

� * G � * MPO ��� * � o �

��� � � * � � *� w � w � G �DC 1 GUH � J_H � M9`Rq#o���MO �

�� * � o � �

��� � � * � � *� w��Iw��iC21 GIHL�~J#H ��M

o G%q#o��DM� ��� * � w ��� �� � � � *� w ����

O ��� * � o � �

��� � � * � � *� w��Iw��iC21 GIHL�~J#H ��M

O q�

�� ��� � * � o �

��� � � � * � � � *� w � w � C 1 GIH � J_H � M ��O q

�� v G � � * M

� [�l|jr[0¤n_Miqy�x�fIm�E:�F�|J � * � O v* �

v� tsiwd�yTfIm£ ¡mQ¤n¤um>¯&lud�v�_�6A¢siw¤ulnf�®qt��{H�E

�������;���T�@�

Page 11: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

� �8.�/��)0���� � % ���=% !

� � � *� w��ZC�1<G �FH�J��FH ��MPO � �q� �v� w���G C�1<GUH�J#H���MD`lq#o ��M

O � � � v� w��@C�1<GUH�J#H���M9` q#o ��

� � � v� w��O � � � v� w��@C�1<GUH�J#H���M

Z8[z¢sxXt�¯�_�jXiwd�_XiQx�lu¤n®�x�[�m>¯ fg[siwfb * Olb v ¬2 4lnd�iw¤u¤n®T¯�_�mq��fIiwlud�mq¢�h&]�iwlud�hg_Mx�¢�¤nfZE

X * G��{H9M[O ��� * � w � C 1 G ��H � J���H9M ` b *

O ��q� �v� w � G�� C 1 GUH � J_H9MD`RG~q-o��DM~M ` b v

O ��� v� w��2C�1<GUH{�~J_H9MD` q#o��

���� v� w�� ` b v

O ��� v� w � C 1 GUH � J_H9M�`�b v

O X v GUHFM

� ��� �´�8��� � �& £!(-

�^"%$ &#7%3��54%j!�� �95�)&%'% 7)( �F)�';7%1 *�.;1��5 %�3Z(m�lu¤u¤n¢sx�fghri>fI_�fI[�_�xgjXiw¤u_�ludA¥>iqhgl|iwdsj^_�mw "fg[�_�fghIluiqd�vq¢s¤uiqh'«q_Xhgds_^¤StQ¯�_�[�i¦¥q_�xg_�f8¢���i�xgln]���¤u_Vj^¤uiQxgxglnµ�j^iwpfIlnmQd�friqxg«�lud£f�¯�m�y�ln]�_Xdsx�lumqd"¬4Z8[�_&mQhgluvqludsiq¤qfIhIiqlnd�lud�v��Emq��¢�¤|i>fIlnmQd£l|x©i�x�_^fLmw  ��q � �EmqludQfrx^tq¢�d�ln ¡mqhI]�¤u®y�lux�fghIln�s¢�fg_My�lndTfg[�_�¢sd�l²f&x=6Q¢�iwhI_q¬(Z8[s_�j�¤|iqxIx©mq G_Xiqjr[�mq �fg[�mAx�_�xIiw]���¤u_Xx'lux�i�y�_^fg_Xhg]�lud�lux�fgl|j8 ¡¢�d�jkfglumqdmq (lnfIx&¤um�j^iwfglumqd�lnd�fg[s_�x 6A¢siqhg_�>¸xg_^_VµsvQ¢�hg_�`st�¢����E_^h�hIm>¯^?k¬

shgmQ]/fg[�l|x�xIiw]���¤u_qt�¯�_�[si¦¥q_V��hImzy�¢sj�_MyTf�¯�m�mwfg[s_^hrx^tzmqds_�xIj^iq¤n_My�y�m>¯&d��z®oi£ ¸iqj�fgmQh�mq (q/�t�iwd�yfI[�_omqfg[�_Xh�xIj^iq¤n_My ¢�� �z®´fg[�_0xIiw]�_� ¸iqj�fgmQhX¬ �´_�[si¦¥q_T�s¢�ln¤nf�fg[�hI_^_0§z¨��ªx��siQx�_My mqd i°vQiq¢sxgxgl|iwd«Q_^hId�_^¤�¯&l²fI[ ,�O �y � mqd�fg[smQxg_�fg[shg_X_�xIiw]���¤u_XxXtAiqdsy�fg[shg_X_V§z¨V�ªx'��iqxg_Xy�mqdTfg[�_�fghIluiqd�vq¢s¤uiqhL«q_Xhgd�_X¤<¬��_Xxg¢�¤²frx&iwhI_�x�[�m>¯&d�mqd�µsvQ¢�hg_�`s¬��x�_)�z�E_Xj�fg_My tsfI[�_�vAiw¢sxIx�l|iwd0«Q_^hId�_^¤G_Xl²fI[�_^hVx�]�mzmwfI[�_Xx�fgmzmT]£¢sjr[�>­µsvQ¢�hI_�`�tE]�l|y�y�¤u_�hIm>¯�ts¤u_� ­fT?kt

l|x�iQj^j�¢shIiwfg_ >­µsvQ¢�hI_�`�t�]�l|y�y�¤u_�hgm>¯�t�j�_^dAfI_^hT?�mqh&m>¥q_Xh�µsfIxi>­µ�vq¢�hI_�`�t�]�l|y�y�¤u_�hIm>¯�t�hgluvq[AfT?kt�¯&[�lu¤u_�fg[�_fIhgl|iwdsvq¢�¤|iwh8«q_Xhgds_^¤���_X[si¦¥q_Mx&x�lu]�ln¤|iwhI¤u®Ti>f�iw¤u¤GxIj^iw¤u_XxX¬

�^"I! /-) � %n, %9' % �{';7�1 *Z8[s_�]�mwfglu¥>i>fIlnmQd0 ¡mqh�fI[�l|x�x�fg¢sy�®�l|x&fgmo¢�dsy�_XhIx�fIiqdsy�fg[�_£vqmzm�y�vq_^ds_^hriw¤ul��Mi>fglumqd��E_^hg ¡mqhI]�iqdsj�_�mq ©fg[�_fIhgl|iwdsvq¢�¤|iwh�«q_Xhgds_^¤©lud´fI[�_Tj�mQdAfg_ �zf�mq ' ¸iqj^_Ty�_�fI_Xj�fglumqdG¬ � _�[si¦¥Q_�y�_^¥q_X¤nmQ��_My°lud mq¢�h�¤|iw� i�[�luvq[�¤u®

���:�����

Page 12: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�8'(.�� % 032�� . �"0 .+2�'(% ��� �(� %)�"!�0 % 5 ��� ! / % !9�"0 . 2������ .+��%)�"2�%�� �

� �J�q � v�� * � ;J�q � * � ;J�q/ � *

·�iw¢sxIx�l|iwd�«q_Xhgd�_X¤

Z(hIluiqd�vq¢�¤|iwh�«q_Xhgds_^¤

4luvq¢�hI_T`;E�� 5"0� �F� % '��7. 5(5"0 � '(. !90 � 2 !*. 5~ 032��� ��4/ % ������%)� � � � 5 /�� � 5 ! / % !�� .+032�032 �-5)%)!�5)'(.�� %���� ! /1� %(% � 0 �;% � %)2�!6� . ' ! � ��� 4/ % �:�+��� % 5. �=%������ %�� . '('=�+� � 032@� ! ��!3/�% 5). %�� .�')! � �� �+� %(. 5)%-�%��=%*�4� %"5)%)2�! . !90 � 2 ��4/ % 0 ��� �7% � � � 5 / � � 5 ! / % � % 5"��� !�5 ��� !3/�% '�� . 5(5(0 � '(. !90 � 2 5�� 03!3/ ._� . �15(5"0 . 2S % �"24%�� �.+2 � !3/�% � � � % � � � � 5 / � � 5 � %"5"��� !�5 � 03!3/-!3/�% !9�"0 . 2 �+��� .+��%)�"2�%�� �

�������;���T�@�

Page 13: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�M� �8.�/��)0���� � % ���=% !

4luvq¢�hI_0��E � .+032�032�� 5). ��{� % 5-! � �f� .�'(% � �(����� .+!�0 �+2 5�� 4/ %�������% �-� � � 5 / � � 5 5). ��{�7%"5 �(� � .�7��� 5 %�� '(� 2�5(!9� .+032�%���� �(����� .+!�0 �+2 � /10V�7% ! / %�� � � % � � � � 5 / � � 5 . 5). �F� %2�(� � . /10 � / � '=�+2 5"!9� . 0324% ����=�4��� . !90 � 2 �

_��Tj�lu_^dAf�y�_�fI_Xj�fgmqh��siqxg_Xy mqd i0[�lu_^hriwhrjr[z®�mw �§z¨V�ªx � �@� ¬�Z8[�_T]�iqlnd l|y�_Xi0�E_^[�ludsy fI[�lux£iw���shgmAiqjr[l|x&fIm�y�_Mj�mQ]��EmQxg_�fI[�_£xg�siqj^_�mw © ¸iQj�_£��luj�fg¢�hI_Xx��z®0j^mqdsx�fghriwlud�lud�v�]�mqhI_�iwd�y0]�mQhg_�fg[�_XlnhV��mAx�_MxY>¸_^®q_¤um�j^iwfglumqdsxx?lnd�fg[�_�lu]�iwvQ_V�s¤uiqd�� �zts���S¬

� _�y�m°d�mqf�vQm´ludAfgm°fg[�_�y�_^fIiwlu¤|x�mq �fg[�_� ¸iQj�_�pey�_^fg_Xj�fglumqd xIjr[�_X]�_QtL��¢�f�¯�_�~�¢sx�f� ¡m�j�¢sx�mqd fg[�_vQ_^d�_XhIiq¤nl��Xiwfglumqd ��_Xh� ¡mQhg]�iqdsj�_Mx�mw &ludsy�lu¥Al|y�¢siq¤�j^¤uiQxgxglnµs_^hrx�y�_My�lujXi>fI_Xy fgm´j�mqd�x�fIhIiqlnd�_My ��mQ��¢�¤|i>fglumqd�x^¬ 4luvq¢�hI_��ªxg[�m>¯�x�xgmq]�_�_ ��iw]���¤u_Xx� ¡hgmQ] f�¯�m0mw 8fg[�_X]0¬0Z8[s_�µshrx�f� ¸iqh�¤u_XxIx�j�mQdsx�fIhIiqlnds_Xy´fg[siqd fg[�_xg_Xj^mqdsyG¬�=�mwfg[ iqhg_ªxg®zdQfI[�_�fIlujXiw¤u¤n® vq_^ds_^hri>fg_My �z® y�mqlud�v i���d�_��sl²fI]�iq� fghriwdsx� ¡mqhI]�i>fIlnmQdsx�mw �fg[�_mQhgluvqludsiq¤���l|jkfg¢shg_Mx > �V�-d y�iwfIiq�siqxg_ªmw � ¸iQj�_Mx|?�¬ Z8[�_´hg_Mx�¢s¤²frxTvqlu¥q_Xd [�_Xhg_°j^mqhIhg_Mx��Emqd�y³fgm³§�¨��ªxfIhIiqlnds_Xy�¯&l²fI[�� � ¸iQj�_��sluj�fg¢�hI_XxLiqdsy��2 ��siqjr«zvqhImq¢sdsy�lu]�iwvq_Mx^¬4�LhIhgmQh©hIiwfg_MxLiwhI_8_Xx�fglu]�iwfg_My�mqd�� mqfg[�_XhL ¸iQj�_��sluj�fg¢�hI_XxXtQ¥Q_^hIl² ¡®zlud�v�fI[�_VxIiw]�_��EmQxg_�j^mqdsx�fghriwludAfIxXtQiqdsy��2 �mwfI[�_^h�siqjr«zvQhgmQ¢�dsy���l|jkfg¢shg_Mx^¬��x�_)�z�E_Xj�fg_My tsfI[�_�]�mQhg_�fI[�_� ¸iQj�_Xx�iwhI_�j�mQdsx�fIhIiqlnds_Xy�lnd°��mAx�_QtsfI[�_�_XiQx�lu_^h�lux�fg[�_£j�¤|iqxIx�lnµ�j^iwfglumqdGt

xgludsj�_�fgmq¤u_^hriwd�j�_�fImTfghriwd�x�¤|i>fIlnmQd°iwdsyªhgmqfIi>fIlnmQd�lux�d�m�]�mqhI_�_ ���E_XjkfI_Xyª ¡hgmQ] fI[�_�§z¨�� ¬ �&_Mx�¢s¤²frx�mQdfriw��¤u_��Txg[�m>¯ fI[�_T�E_^hg ¡mqhI]�iqdsj�_�mq ��EmwfI[´fI[�_�fIhgl|iwd�vQ¢�¤|iwh�iwdsy´fI[�_�·�iw¢�xgxgluiqd´«Q_^hId�_^¤S¬ � [�lu¤u_�fg[�_·�iq¢sxIx�l|iwd «q_Xhgds_^¤©hI_^¤uln_Mx�[�_Mi¦¥Alu¤u®ªmqd fI[�_ojr[�mQluj^_�mw  ,�t4fg[�_�fIhgl|iwdsvq¢�¤|iwh�«Q_^hId�_^¤'iQjr[�lu_^¥q_MxVfg[�_�xgiq]�_mQhIy�_^h8mw 4��_Xh� ¡mQhg]�iwd�j�_Xx8¯&lnfg[smq¢�f&fI¢�d�lud�v�mw ©iwdz®oxIj^iw¤u_V�siwhriw]�_�fI_^hM¬

�^" � � )6*^,��].�7�' ' %�* � �^):.�) �{' %D. .�% �F1&� *^7�';7�1 *Z8[slux&¤|iqx�f�_)�z�E_^hIlu]�_XdAf�lux�i�j�¤|iqxIx�l|j^iq¤ ��hgmQ��¤u_^] mq ©[siwdsy�¯&hglnf�fI_^d�y�luvqlnf�hg_Mj�mQvqd�lnfglumqd�mqd�fg[s_�� �b�§�Zysi>fIiq�siqxg_q¬4}Ll|jkfI¢�hg_Mx&mw 4fg[slux&y�iwfIiq�siqxg_�[si¦¥q_�i�hg_Mx�mQ¤n¢�fIlnmQd�mq  � � � ��¤|iqjr«�iwdsy�¯&[�lnfg_���l ��_^¤|x^¬

� _�fghriwludTfI_^dª§z¨��°x^t�X�� �� J�yZy�yZJ|X���� t�_XiQjr[omqds_�y�_Xy�l|j^iwfg_Xyofgm�mQd�_�mq (fI[�_�y�luvqlnfIxX¬LZ8[�_Vfghriwlud�lndsv ¡mQh©_XiQjr[�mw �fg[�_X] l|x©y�mqds_�mQd��2;J 2 &_ ��iw]���¤u_Xx©iqdsy�fg[�_8fI_Xx�fglud�v�lux©y�mQd�_8mqd£fg[�_iq/;J 22�hg_X]�iwlud�lndsv

���:�����

Page 14: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�8'(.�� % 032�� . �"0 .+2�'(% ��� �(� %)�"!�0 % 5 ��� ! / % !9�"0 . 2������ .+��%)�"2�%�� �Q�

Z4iw�s¤n_0��E�}4_Xh� ¡mQhg]�iqdsj�_�j�mQ]���iwhIluxgmqd´��_^f�¯_X_^d fg[�_TfghIluiqd�vq¢�¤|iwh�iqdsy´fg[�_o·�iq¢sxgxgl|iwd «q_^hId�_X¤©mqd fg[�_ ¸iQj�_�¥�x^¬©dsmqd�pS ¸iqj^_Vj^¤uiQxgxgl²µEj^i>fIlnmQdo��hImq�s¤n_X]�¬

� _Xiq« ��iqhIy��_Xhgds_^¤ j�mqd�x�fIhIiqlndAfIx j�mqd�x�fIhIiqlndAfIxZ(hIluiqd�vq¢�¤|iwh �;y �� ;y ��� �·�iq¢sxIx�l|iwd�>�,�Onq/���? � y �� � q�y � � �·�iq¢sxIx�l|iwd�>�,�O ��y�q/2*�? � y � � ;y �2 �·�iq¢sxIx�l|iwd�>�,�Onq/2*�? � q�y�q � � �� y��� �·�iq¢sxIx�l|iwd�>�,�Onq/p? �Lq�y � �� y��� �

Z4iw�s¤n_���E�}�_^hg ¡mqhI]�iqdsj�_�j�mq]��siqhgl|xgmqd��E_�f�¯�_^_^dTfg[�_�fghIluiqd�vq¢s¤uiqhiwd�y�fg[s_�·�iq¢sxgxgl|iwd�«q_Xhgds_^¤EmqdT[siqdsyzp¯&hIlnf�fg_Xd�y�lnvQl²f�j^¤uiQxgxgl²µEj^i>fIlnmQdG¬

��_^hId�_X¤ �LhIhgmQh�hri>fI_Z(hgl|iwd�vQ¢�¤|iwh �;y ��� �·�iw¢�xgxgluiqd�> ,BO q �� v M � ��y � �·�iw¢�xgxgluiqd�> ,BO q�M ��y�q �·�iw¢�xgxgluiqd�> ,BO q M �;y � �·�iw¢�xgxgluiqd�> ,BO q �M � ;y � �

4luvq¢�hI_ ��E �4� % / .+2 � � �"03!�! % 2 � 0 ��03! 5 �(�=� !3/�% , ���"� ��.+!*. �(. 5)% �

�������;���T�@�

Page 15: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�¦� �8.�/��)0���� � % ���=% !

4luvq¢�hI_°��E 4/ % !9�"0 . 2 �+���7. �� % �"24%�� '(. 2 5 % ��. � .+!*% ! � � ���=�4��� . !90 � 2 �%�� % 2 0 � 03! � %��)��03� %"5�� . �"0 �+�155)'(.��7%"5��

lu]�iwvQ_XxX¬�� _o¢�x�_�i � � ��iqiwhgp ¯�i¦¥Q_^¤u_�f�j�mz_��Tj^ln_XdQf£hg_X��hg_Mx�_XdAfIi>fIlnmQd mw 8fg[�_���l|jkfg¢shg_Mx�fgm´vQiqlnd ¤um�j^iw¤ludz¥>iwhIluiqdsj�_�fgm�¤umzjXiw¤Gy�_^ ¡mqhI]�i>fglumqd�x^¬Z8[�_�µsdsiq¤ j�¤|iqxIx�lnµs_^h_X�lux��siQx�_My�mqd�i�¯&lud�d�_Xh�pSfIiq«q_�iq¤n¤�hI¢�¤n_Q¬©Z8[�_�hI_Xxg¢�¤nfmq Gfg[�_�j�¤|iqxIxgl²µ�jXi>fIlnmQd�lux

fI[�_�ludsy�_ ��mw 4fg[�_�§z¨V�7¯&l²fI[�fI[�_�[�luvq[�_Mx�f&hI_Xxg��mQdsxg_�E

X:GIHFM2O����������

X � � GIHFM

�&_Mx�¢s¤²frx£iqhg_oxg[�m>¯&d mQd fIiw�s¤n_0�� ¡mqh£fg[�_0·�iw¢sxIxgluiqd «q_^hId�_X¤'i>f�¥¦iqhglumq¢�x , iwd�y fg[�_ofghIluiqd�vq¢s¤uiqh«Q_^hId�_^¤S¬

� � �� ������-"�^��

� _�[si¦¥Q_�x�[�m>¯&d0lud0fg[�l|x�iqh�fIluj^¤n_�fI[si>fVj�¤|iqxIx�lnµ�j^iwfglumqd�¯&l²fI[°§z¨��°x��siQx�_My0mqd�fg[�_�fghIluiqd�vq¢�¤|iwh&«Q_^hId�_^¤l|x&ludz¥¦iqhgl|iwdAf8fgm�fI[�_�xIj^iw¤ulud�v�mw 4fg[�_�ysi>fIis¬LZ8[�_^hI_� ¡mQhg_Qt�¢sxglnd�v�fI[�l|x&«q_Xhgd�_X¤"i¦¥qmQluysx'fI[�_�_Xx�fglu]�i>fIlnmQd�mq iqd�mq��fIln]�iq¤(xIj^iw¤ulud�v��siwhriw]�_^fg_^hM¬�§z¢sjr[ªiqd�_Xx�fglu]�iwfglumqd�l|x�¢�x�¢siq¤n¤u®��siqxg_Xy�mqdªj^hgmAxgx�¥¦iq¤nl|y�iwfglumqdªiwd�yl|x�j�mq]���¢�fIi>fIlnmQd�dsiq¤n® lndAfI_^dsxgln¥Q_qt©xglndsj^_olnf£hI_�6A¢�luhg_Mx�fIm°hI¢�d xg_^¥q_XhIiq¤©fglu]�_Xx�fg[�_0j�mQ]���¤n_^fg_ofghriwlud�lndsv�shgm�j�_MxgxX¬

� _´�E_^¤ulu_^¥q_ªfg[�_ ��_Xd�_�µsfIxofgm vQ_�f� ¡hgmQ] fI[�_ªfIhgl|iwdsvq¢�¤|iwhT«Q_^hId�_^¤�fgm±vqm �E_^®Qmqdsy xglu]��s¤n_ xgjXiw¤u_ludz¥>iwhIluiqdsj�_�iQxy�_^µsd�_My�lndTfg[�l|x'��iw�E_^hM¬+ smqhlndsx�fIiqdsj�_QtQ_)����_Xhglu]�_^dAfIxx�[�m>¯³fI[si>f8l²f�_^dsxg¢�hI_Xxi�j�mQhghI_Xj�fj^¤uiQxgxglnµ�j^iwfglumqd mw ��Emq�s¢�¤uiwfglumqd ]�l ��lnd�v±¥>iwhIlnmQ¢sxoxIj^iq¤n_Mx}>¸xg_^_°fg[�_ xg��lnhriw¤V_ ��iq]��s¤n_Qt& ¡mqh�¯&[�lujr[�fg[�_�Emq¢sdsy�iwhI®oiwf�fI[�_�j�_XdAfg_^h&hI_�6A¢�luhI_Xx8i�xgjXiw¤u_� ¸iQjkfImqh8 ¸iwh�xg]�iw¤u¤n_Xh�fg[siqd0iwf8fg[�_�mQ¢�fg_Xh�iwhI_Xi�tAµsvQ¢�hI_���?k¬

���:�����

Page 16: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

�8'(.�� % 032�� . �"0 .+2�'(% ��� �(� %)�"!�0 % 5 ��� ! / % !9�"0 . 2������ .+��%)�"2�%�� �M`

� �&�>�8���& ����&-

�u��� =V¬©��¬(=mAx�_XhXt'bk¬·V¢�®qmQdGt8iwdsy±¨�¬��¬L¨Liw�sd�ln«�¬ � fIhIiqlnd�lud�v iw¤uvqmQhglnfg[s]  ¡mqhTmQ��fglu]�iw¤&]�iwhIvqludj^¤uiQxgxgl²µ�_^hrx^¬ 032�� � ��'(%=%��+032��+5 �%�-! / % � 0 �(! / �;2�2���.���� � �~ 5 / �(� �+2 � � �����! . !90 � 24.���� %(. �"2&032��4/ %(�+� >t ��Eu�^�Q�����/�q��ts�� �Q��¬

� ��� � ¬;=�¢�hIvq_Mx^¬�� fg¢�fImqhIluiq¤ mqd0x�¢��s��mQh�f8¥q_MjkfgmQh8]�iQjr[�lud�_Xx� ¡mQh���i>f�fI_^hId�hI_Xj^mqvQd�l²fIlnmQdG¬ � .+!*. ,-032&032��.+2 � 24� �_� %���� % � 0@5)'(��� % � >t��;>S��?kt �� �p��¬

� `�� �¬ � [shgl|x�fIluiqd�liqdsy���¬�§�[si¦¯_^p Z4i¦®z¤nmQhX¬ �;2 �"2&!��=� �+��' !90 � 2 !*����������� �"!-#&%(')!*�+� ,�.�'(/1032�% 5 .+2 ��+!3/�% � % �"24%��� �=. 5)% �f� %(. �"2&032�� %)! / � � 5k¬ � iw]£��hgl|y�vQ_���d�lu¥q_^hrxgl²f�®�}LhI_XxIxXts�w�q�Q��¬

� ��� �¬ � hIlux�fgl|iwd�lud�lSt � ¬ � iq]��s��_X¤n¤St�iwd�y��s¬8§z[si¦¯�_�peZ(i¦®z¤umqhM¬���®zdsiq]�lujXiw¤u¤n®³iqy�iq��fglud�v «Q_^hId�_^¤|x�ludxg¢����Emqhgf&¥q_Xj�fgmQh�]�iQjr[�lnds_XxX¬4bed�� �=��'(%(%�� 032��+5 ��� � ��� �Et�¥qmQ¤n¢s]�_��Q�qt�� � ����¬

� ��� �¬_ (¤u_^¢shg_^f0iqdsy �£¬8·V_X]�iqdG¬ � mAiwhrx�_^p<fImwpSµsd�_�¥zl|x�¢siq¤Vxg_^¤u_Xj�fglumqdG¬ �"2�! %)�"2�. !90 � 24.������ ���"2�.�� �%�� � �����! %)�-# 0@5"0 � 2�t��s��>����q��?�E �9���E�M� ��tQ�w�Q���q¬

� ��� �¬Z 4¤u_^¢�hI_�f4iwdsy��£¬¦·V_X]�iqdG¬� siQx�f" ¸iqj�_Ly�_�fg_MjkfIlnmQd�¯&l²fI[���hI_Xj�l|xg_©��mAx�_©_Mx�fIln]�i>fIlnmQdG¬>bed�� � ��'(%(% �+032��+5�%� � ����� ����� �Qt�¥Qmq¤u¢�]�_��qt��siqvq_Xx��q` �����w`p��tz�w�q�A��¬

� �@��§�¬>§�iq[A�sl<t>�£¬>·V_X]�iwdGt>iwd�y �¬�=�mq¢>~�_X]�iqi�¬p siqj^_y�_^fg_Mjkfglumqd�¢sx�lud�v�j^mQiqhIxg_�pSfgmqp<µsds_Lx�¢��s��mQh�f"¥Q_Xj�fgmqhj^¤uiQxgxgl²µ�_^hrx^¬4bed�� � ��'=%(%�� 032 � 5 �%��� � ��� ����� �qt �w�Q�Q��¬

� ����¨£¬ �¬�¨Liq��d�lu«�¬ �/�% � . !9��� % �%� �&! . !90@5"!�0 '(.���� %(.+�"2�032�� 4/ %(� � >¬�§z��hIlnd�vQ_^hgpS¨©_Xhg¤|iwv�t��� �p��¬

� �� �!4�& �!4-

"!$# �X� ¾ ¿ �4�w��% ¾ # &

')( ��*+* ¾ �¦�-, º �w� ¾ � > ����./% # º � &��¬n� §zfIiwd�y�iwhry smqhI]�iw¤ul��Mi>fglumqd ¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬ `��¬ �+Z(hIluiqd�vq¢�¤|iwh8«Q_^hId�_^¤�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬ �

&0( �q� ? ºQ¼ % #21 ����%<� # � º°¾�3 ��. º � ?¸���M�4%65 º � 7`s¬n� §�j^iw¤ulud�v�mw 4fg[�_�fIhgl|iwd�vQ¢�¤|iwh�«q_^hId�_X¤�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬ �`s¬ � bedz¥>iwhIl|iwdsj^_�mq (fI[�_�j�¤|iqxIx�lnµs_Xh ¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬ �

8)9;: * º ��% º # �X� <��¬n� §�ln]���¤u_��w� j^¤uiQxgxglnµ�j^iwfglumqdo�shgmQ��¤n_X] ¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬ ���¬ � �iqj^_�y�_�fg_MjkfIlnmQd�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬ ���¬ ` ��iwdsy�¯&hglnf�fI_^d�jr[siwhriqj�fg_XhhI_Xj^mqvqdsl²fIlnmQd ¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬�¬V¬�¬ �M�

=)> ¾ # � ? �4�4% ¾ # ?'

�������;���T�@�

Page 17: Scale-Invariance of Support Vector Machines based on the ... · Unité de recherche INRIA Rocquencourt Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France) Téléphone

Unité de recherche INRIA RocquencourtDomaine de Voluceau - Rocquencourt - BP 105 - 78153 Le Chesnay Cedex (France)

Unité de recherche INRIA Lorraine : LORIA, Technopôle de Nancy-Brabois - Campus scientifique615, rue du Jardin Botanique - BP 101 - 54602 Villers-lès-Nancy Cedex (France)

Unité de recherche INRIA Rennes : IRISA, Campus universitaire de Beaulieu - 35042 Rennes Cedex (France)Unité de recherche INRIA Rhône-Alpes : 655, avenue de l’Europe - 38330 Montbonnot-St-Martin (France)

Unité de recherche INRIA Sophia Antipolis : 2004, route des Lucioles - BP 93 - 06902 Sophia Antipolis Cedex (France)

ÉditeurINRIA - Domaine de Voluceau - Rocquencourt, BP 105 - 78153 Le Chesnay Cedex (France)��������� ���� ���������� ��� ���

ISSN 0249-6399