c se 546 wi 12 linear regression

8/12/2019 c Se 546 Wi 12 Linear Regression

1/31

!"#$%&' )*+,-. /,0.,11*2+

3*-1 4 5-.*-+6, 7.-8,29

:*+;,. MfM -m;.-*+a 7,1; 8-;- i `->MfM -m;,1;a

p1, ;.-*+*+0 8-;- ;2 2FJD*c, F-.-D,;,.1 . 7,1; 1,; ,..2.' ^2. ;N,!"#$ &'$()'".4M

,K-C?-;, ;N, ,..2. ?1*+0'


26/31

7,1; 1,; ,..2. -1 - G?+6J2+ 2G D28,C

62DFC,[*;E


27/31

qK,.jr+0' ;N*1 1C*8, *1 12 *DF2.;-+; P,-., C22@*+0 -; *; -0-*+R

V11?D,' e-;- 0,+,.-;,8 G.2D 8*1;.*L?J2+D(X,Y)A hypothesis spaceH

e,j+,',..2.1 G2. NEF2;N,1*1 h H Training error: errortrain(h) Data (true) error: errortrue(h)

We say hoverfitsthe training data if there existsan hH such that:

errortrain(h) < errortrain(h)and

errortrue(h) > errortrue(h)


28/31

"?DD-.E' ,..2. ,1JD-;2.1

H2C8 ";-+8-.8'

7.-*+*+0' 2FJD*1J6-CCE L*-1,8

7,1;' 2?. j+-C D,-?.,M ?+L*-1,8b


29/31

#..2. -1 - G?+6J2+ 2G +?DL,. 2G ;.-*+*+0

,[-DFC,1 G2. - j[,8 D28,C 62DFC,[*;E

little data infinite data


30/31

"?DD-.E' ,..2. ,1JD-;2.1

H2C8 ";-+8-.8'

7.-*+*+0' 2FJD*1J6-CCE L*-1,8

7,1;' 2?. j+-C D,-?.,M ?+L*-1,8b

Be careful!!!

Test set only unbiased if you never never ever ever

do any any any any learning on the test data

For example, if you use the test set to selectthe degree of the polynomial"no longer unbiased!!!

(We will address this problem later in the semester)


31/31

:N-; E2? +,,8 ;2 @+2P

/,0.,11*2+ 3-1*1 G?+6J2+ _ G,-;?.,1 qFJD*c*+0 1?D 1d?-.,8 ,..2. /,C-J2+1N*F L,;P,,+ .,0.,11*2+ -+8 H-?11*-+1

3*-1h5-.*-+6, ;.-8,h29 IC-E P*;N VFFC,;

NBF'44D1;,T*CC*+2*1T,8?4?1,.14,[+,.4X-K-TG4C,-1;1d?-.,14 7.?, ,..2.M ;.-*+*+0 ,..2.M ;,1; ,..2.

m,K,. C,-.+ 2+ ;N, ;,1; 8-;- qK,.jr+0

c se 546 wi 12 linear regression

Documents