a gentle introduction to t)x a manual for self-study michael doob

95

Upload: dinhbao

Post on 14-Feb-2017

221 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ����������� ��������������������������� �

!#"%$�&(')$+*-,/.+02143 *5,7698;:<'�=)>

?A@CBED<FHGJILK(MNMPOK)GQ<FSR5T7UVGJW;T4MHX ?YF9TZD<GU�F9T7@[BJ\]^D_Ga`(W_@cbPGRE\5@cTed�MHX�?�FSW_@fT7MSO<Fgh@[W_W_@[QiGJj<k<?�FSW_@cTZMSOiF_kil�FHWiFSm_F�n4oP]qpHrsp

?�Kututsv4ws`stsxy?zl{l)| v+}e]{r)~�]?�Kututsv4wul{l�`a| `(?��)r4}e](tsv^�a|�l��

Page 2: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

|

Page 3: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ���y�+� �Y���������

x @[R7\5T�TZD_G(O<FSmVW_G � \�� ] ~�� @C\F�ICFHR7jSG^FHW<m�B MPU�Q_Ic@CBFHTZG m Q<RZMPjSREFHU2TZDiF9T�jPM;G \ TZMuG��;T7R7FSMSREm @[W<FHR7dI[GW_jSTZD<\ TZM)Q_RZM m��iB G+FHT5T7R7FPB/TZ@[bSGTed;Q GJ\ZG T U�F9TZGJRZ@CFHI | ]^D<@[\ bSGJRZd�B MPUVQ<Ic@CBFHTZ@[MSWaBFSW-BF��<\ZG�_W_G�� QiG B/TZG mTZD<@cW_j;\T7MaD<FSQ_QiGJW�F9T+TZ@[U�GJ\J|yr(M � TZD_G)jSMNM m�W_G � \�y\eT7R7FS@cjPDPTZX MSR � FSR7m-TZG��NT+@C\�bPGR7d-GJFP\5d TZM-TedNQiG \5GT�<\Z@cW<j ] ~�� |��NM @cT \ Q MP\7\5@[O_I[G�TZM \5T7FHRZT � @fT7DhGJFP\5@[GR�T7G��NT FHWim � MSR����_Q T7M UVMPRZGABMSU�Q_I[@[BJF9TZG m\Z@fT��<F9T7@cMPW<\|

]^D_GVQ��_R7Q MP\ZG MSX�TZD<@[\sU�FHW��<FSI @C\)TZM�\eTEFHRZT)X R7MSU T7D_G�bSGJRZd�O GjS@[W_W_@[W_j�FHW<m�TZM�U�M9bSG-TZM � FHREm_\TZD<GJ\ZG)U�MSR7G)BMSU�Q_I[@[BJF9T7GJm \Z@fT��<F9T7@cMPW<\J|yr(M Q<RZGJb;@[M��i\��NW_M � I[GJm jPG(MHX ] ~ � @[\^FS\7\��_U�GJm |�v�d�Q_RZM BGGJm��@[W_j�F�\5G B/TZ@[MSW�F9T4F TZ@[U�GSkijSR7GJF9T7GR�b9FHR7@cGTZ@[GJ\^MHX TZG��NT(BFHW O GuQ_RZM m��iB GJmL|

�(GR7GVFSRZG�F X G � \��_jSjPGJ\5TZ@[MSW<\�{T7D_GR7G�FHR7G \ZMSU�G G�� GREB @C\5G \(@[WzG FSBED \5G B/TZ@[MSW | v�GV\��_R7GVFSW<mYm_MTZD<GU�� ]^D<G MPW_I[d � F d T7M I[GJFSRZW ] ~ � @C\�ONd��<\5@[W_j @cTJ| v+GT5T7GR�dSGTJk+G�� QiGJRZ@[U�GW;T�MSW dSM��<RVM � W��TZR7d�T7M�U�F��PG \5MPUVG�b9FSRZ@CF9T7@cMPW<\�MSW T7D_G G�� GJR7B@[\ZGJ\J|�]^D_GJRZG @C\uW_M � F dAT7D<F9T dSM�� BJFHW m_FHU�FSjSG�TZD<G] ~ � Q<RZMPjSREFHU � @fT7D dPM��_R^G��NQ GR7@[UVGJW;T7\J|��M���BFHW �<W<m F�B MPUVQ<IcGTZGuFHW<\ � GR�TZM�U�MP\5T{G�� GREB @C\5G \�ONdI[M;M!�N@cW_j F9T4T7D_G ] ~�� \ZM��_REB G"�iIcG-TZD<FHT � FP\#�<\ZGJmATZM Q_R7M m��<BGuTZD_@C\sm M B��_U�GW;T |$�M��% I[I W_MSTZ@CB G-TZD<FHTTZD<GR7GaFHR7GuRZGX GR7GW<BGJ\^@[W T7D_GaR7@cjPD;T4U�FSRZjP@cW TZM'&)(+*,&.-%/'01�132+49|�ghD_GJWAdSM�� X GJGILT7D<F9T4dPM�� � FHW;TU�MSR7G�@cW X MPRZU�FHTZ@[MSW MSW�F-T7MSQ_@CBHk_TZD<FHT \ � D_GR7GsTZM�I[M;M!� |

} W<B@[m_GW;TZI[dSk T7D_GR7GaFHR7GuF X G � �<O<\^T7D<F9T)FSQ_Q GJFHR^@[W�TZD_@C\{U�FHW��<FSI5�NT7D_Gd FHR7G6�<\5G m TZM�D_@Cm GaB MPU7�Q_I[@[BJF9T7@cMPW<\98 } I[MNM���F9TT7D_@C\�FS\+\5MPU�G TZD<@cW_j-Ic@:�SG4Q MNG T7@[B{I[@CB GWi\5G<;/|��(\�dSM���O GJBMSU�G4U�MSR7G{G�� Q GR7@cGJW<B G mF9T$�<\Z@[W_j ] ~ � k_dSM!�% I[I O GaFHO_I[GsTZM=�<W<m T7D_GU�|

] ~ � @C\)F�Q��_O_I[@CB m MPU�FH@[W�Q_R7MSjSREFHU TZD<FHT)@C\�F b FS@cICFHO<IcGuX MPR(W_M Ic@CB GJW<\ZGaX GGP|�} T � FS\sm GbPGI[MSQ GJmONd K)MSW<FSI[m?>�W�� T7D�F9T@�;TEFHW X MPR7mA`(W_@[bSGRE\Z@fTed�FP\(F�U�FBAeMPR{Q_R7M�AeGJB TJ|�} W�TZD_G-Q_RZM��_TC� MSR7@[GW;TZG m�U�FHR��SGTQ_ICFSBGSk T7D_GaQ_R7MSjPR7FSU � M!�_I[m B GJR5TEFH@[W_I[d B M;\eT4U�FSW;d TZD_M!�<\ZFSW<m_\{MSXym_MSI[I[FSR7\J|]^D_Ga] ~3� `(\ZGRE\9DsRZM!�_Q8 ]{`ED";)@[\�F W_MSW_Q<RZM��_TsMPRZj;FHW_@:FJFHTZ@[MSW � D_@CBEDzm_@[\5TZR7@cO3� TZG \sBMSQ_@[GJ\)MHX^] ~ � kG�<Q m_FHTZG \u\5MSX T � FSRZGPk FSW<mjS@[bSG \ @cW X MPRZU�FHTZ@[MSW FSOiM!� TyW_G � m GbPGI[MSQ_U�GW;TE\ @[WVOiMSTZDVD<FHREm � FHR7G+FHWim-\ZMHX T � FHR7G�@[W @cT7\yQ��<O_Ic@CBFHTZ@[MSW<\]{`@DsO MPFHT^FSW<m ] ~�� W_@IHJ�_GJ\J|�KSMP@cW<@cW_jaTZD_@C\L�<\5GJR7\+jSR7M��<Q�@[\�@[W_G�� Q GW<\Z@cbPG��;Q_I[GJFS\ZG)BMSW<\Z@Cm GR^m MS@[W_jV\5Mi|]^D_GaFPm_m R7GJ\7\+@C\�

] ~�� `(\ZGRE\#DsRZM!�_QMy| t |_v�M<� NJO�P�Q

M�RZM9bN@Cm GWiB GSk n{}RPPp�N�SJP`a|T� | �a|

4z�)m_m @C\5MPW g GJ\ZI[GdSk_n4GJFSm_@cW_jik ?YFS\7\ZFPBEDJ�i\5GT5T7\JkVUN!W�S<k;}C� v^rXPB�ep�P3U��YUJo�S!W�W��ZN

@

Page 4: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; } W;TZR7MNm��<B/T7@cMPW

]^D_@C\aU�FSWJ�iFHI � M��<I[m W_MST D<F bPG B MPUVG�@cW;TZMYOiGJ@cW_j � @fT7D_M�� T TZD_G FH@Cm MHX4MSTZD_GJR7\J|�} W Q<FHRZTZ@CB����ICFHR4T7D_G-Q<RZMNMHX R7GJFPm @[W_j FHW<mA\��_jPjSGJ\5TZ@[MSWi\4MHXyT7D_GaX MPIcI[M � @cW<j QiGJMSQ_I[G-DiF bSGuO GGWY@cWNb9FHI:�<FHO<IcG!��g FHI[GG m�a| �4I � �_FHICFHU 8 `4W<@cbPGRE\5@cTedYMSX(�4I[OiGJR5TEF!;/k K(GJO_O_@[G���| �4IC\ZQ<F��_jPD 8 `4W<@cbPGRE\5@cTedzMSX)l�FHI[@fX MPRZW_@CF!; k r4GJI �\ZMSW,�-|Lx�| v�GJGO G�8 `4W_@[bSGJR7\Z@cTedAMHX+`4T7FHDG;/kLv^FHR7O<FHREF v�GGTZMPW 8 �(U�GR7@[BJFHWz?YF9TZD<GU�F9T7@[BJFHI��NM B @[G Ted�;/kv^FHRZT4l+D<@cICm_\"8 ] G��_FP\��-|�� ? |i`4W_@[bSGJR7\Z@fTed�; kN?YFHR7d l+M9bSGW;T7RZd?8 `(W_@[bSGRE\Z@fTed�MSX g FS\ZD_@cW<jHTZMPW ;/k_K)@[U �@cTZR7@cM;\�K(@CFHU�FHW;TEFHREFS\R8 ] GU�Q_I[G(`4W<@cbPGRE\5@cTed�;/kHn{MPOiGJR5T7M�K)MSU�@[W_@[U�FSW_W_@ 8 r(F b9FSI_`4W<m GJR � F9T7GR�Nd \5TZGJU�\l+GW;T7GR ;/k��(@CB/TZMPR{~@ A �;D<M�� T68 `4W<@cbPGRE\5@cTed�MHX r4@ AeU�GjPGW ; k_?AMP\ZD_G)x<GJm GJRE8 �;TJ|�� F � RZGJW<B G)`4W_@[bSGJR7\Z@fTed�; kKPMP\ZGQ�? |Px<MSW;T98 `(b;@[bSGJR7\Z@Cm_FSmVv^FHREB GI[MSWiF!;/k�KPMSWiFS\�m G4?A@[REFHW<m_F"DsMPUVG \#8 } Wi\eT7@fT�� TZM-m_G(?�F9T7GU�F9T7@[BJFM��<R7FAG �4Q_I[@CBFSm<F?�sv�REF�FJ@cI ;/kyn{MSO DsRZM;\Z\ 8 v�MP\5TZMPW l+MSI[IcGJjSG ; k+>�ICF��<\7�(FSD_W 8 `4W_@[bSGJR7\Z@fTed MHX(?YFHR��O��_R7jJ; kP�(W_@fTEF �4MNM9bPGR#8 `(W_@[bSGRE\Z@fTedVMHXLK)GICF � FSRZG<;/k�K��_RZjPGW >�MP\ZI[M � \C�N@%8 ?YFSBFSIcG \eT7GR�l+MPIcI[GjPG ; k�>�GG \b9FHW�m GR� FSFSW 8 n{@ A � \��_W_@[bSGJR7\Z@fT7G@cT9DsRZMPW_@cW<jSGWG;/k�KPMSD_W��LGJG=8 r4MPR5T7D_RZMPQAl+MPRZQ MSREF9T7@cMPW ;/k��N@[IcbN@[M��LGJb;d8 M�RZ@[W<BG TZMPW `(W_@cbPGRE\5@cTed�;/k9n{MPOiGJR5T�?AGJ\7\ZGR$8 �(IcO_@[MSW l+MSI[I[GjSG<;/k9~U�@[Icd �-|H?AMNMSR7GE8 DsRZ@[W_W_GJIcIil+MPIcI[GjPG ; k�M��<W_j M�FHR�� 8 `(W_@[bSGRE\Z@fTed MHX ?�FHR7dNI[FSW<m3;/kNl+R7FS@cj"MICF9TZT@8 `(W_@[bSGRE\Z@fTedaMSXL?�FHW_@cTZMPO<F!; kSKsF b;@Cm�n{MSO GRZT7\8 l+MPIcMPR7FPm MJ; k�>uF��3�SM)� FPFHR7@cW_GJW 8 `(W_@cbPGRE\5@cTedVMHX�KPd;b�FP\C�NdNI �FJ;/k�KP@[U g R7@cjPDPTE8 } M � F)�;T7FHTZGs`4W_@[bSGJR7\Z@fTed�; kFHWim K)MSU�@[W_@ � g,��A5FS\5TedJ� 8 g GI[I[BMSU�Gu} W<\5TZ@cT�� T7G�X MSR^T7D_G �4@C\eT7MSR7d MHX�?AG m @[B@cW<G ;/|

} WhFSm<m @fT7@cMPWh\5GJbSGREFHI^Q GMPQ_IcG�D<F bPGA\5GJWPT�U�GAQ<FSR5TE\�MSR FHI[I4MSX(TZD<G@[R IcM BJFHI{U�FHW��<FSI[\J| } D<F bPGR7GJB GJ@cbPGJm F X G � MHT7D_GRE\AMPWqT7D_G R7GO M��_Wim | } W QiFHRZTZ@CB��_ICFHR�~�Ic@:FJFSOiGTZD v^FHR7W_D<FHRZT 8 ]�� DE�<@[m G<;/k�;T7GQ_D<FSWhb |+v�GJBED;TZMPI[\ZD_GJ@cU 85M��_REm��_Gz`4W_@[bSGJR7\Z@fTed�; k�r4GJI[\ZMSW �a|�x�|+v�GGJOiG 8 `4W_@[bSGJR7\Z@cTed MHXa`4T7FHDG;FHWim��LGJ\ZI[@cG�� FHU�Q MSRZT 8 K)@cjP@fTEFHI+~ HJ�_@cQ<UVGJW;T�l+MSR7QiMPR7FHTZ@[MSW ; k ?�FSRZ@[G ?�B�M�FSR5T7I[FSW<m��5l+MSW_W FHWim�� F����R7@cGV?�FHW_W 85�;T7R7FHT��<\al+MPUVQ3� TZGJRY; k n{MPOiGJR5Tu?AG \Z\ZGR=8 �(IcO_@[MSW l+MSI[IcGJjSG<;/k r4MNGI MyG T7GRE\5MPW 8�� @cO_REFHR7d MHXl+MSW<jSR7GJ\7\�; k l+R7FS@cj'M�I[FHT5T 8 `4W_@[bSGJR7\Z@cTed MSX�?�FHW_@cTZMPO<F!; ki�(I[FSW,�NQ_REFHjPGW<\ 8 �;T7FSW X MSREm��L@[W_G FHR)�)BBGI[GR��F9T7MSR(l+GW;T7GR k W_M � MSX �4Q<Q_IcG l+MPU�Q�� TZGJR7\Y;/k l+D_RZ@C\5TZ@[W<F�]^D_@cGJIcG 8 l�FHR7IcGTZMSW�`4W<@cbPGRE\5@cTed�;/k_FHWim KsFHW_@[GI? |�� @[R7@cW�8 l�FSIc@cX MSR7W_@CF(} W<\5TZ@cT��_TZG{MHX ] G BED_W_MPIcMPjSd�; D<F bPG � R7@cT5TZGJW�b FSRZ@[M��i\LTedNQ GJ\yMHX IcG B/T��_RZG^W_MSTZG \ TZD<FHTD<F bPG)O GGJW U�M;\eT4D_GJIcQ_X �_I |

@[@

Page 5: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� �������s�����

} W;TZR7M m��<B/T7@cMPW���������������������������������������������������������������������������������������������������������������������������������������������������� @l+MSW;T7GW;T7\����������������������������������������������������������������������������������������������������������������������������������������������������������+@[@c@US|3DsGT5T7@cW_j �NT7FHRZTZG m��������������������������������������������������������������������������������������������������������������������������������������� U

UP| U�ghD<FHT(] ~�� @C\{FHW<m � D<FHT{] ~�� @C\5W% T�����������������������������������������������������������������������������������������?UUP| pVx_R7MSU ] ~�� �<I[G�TZM�R7GJFSm<FHO_I[G�M�� T7Q�� TJk_TZD_GuO_@[j�\5GT#�_Q�������������������������������������������������������������pUP| o �LGT \{m M�@cT���������������������������������������������������������������������������������������������������������������������������������������=SUP| S�] ~ � DiFS\^GbPGR7d;TZD_@[W_j7�_W<m GJR(B MPWPT7RZMPI �������������������������������������������������������������������������������������������UP| O ghD<FHT(] ~ � � MSW% T4m M��������������������������������������������������������������������������������������������������������������������=W

p |_�(IcI BED<FHREFSB TZGRE\�jSR7GJFHT^FSW<m \ZU�FHI[I������������������������������������������������������������������������������������������������������������"Np_| U �NMPUVGuBED<FSR7FPB/T7GRE\+FSRZG�U�MSR7Gu\5Q GJB@[FSI TZD<FSW MSTZD_GJR7\������������������������������������������������������������������'Np_| pV]+d;Q GJ\ZG TZTZ@[W_j � @fT7DAFHWAFSBJB GW;T���������������������������������������������������������������������������������������������������� U Pp_| o�K)MHT7\Jk<m_FP\5D<GJ\Jk�HJ�_MSTZG \k���������������������������������������������������������������������������������������������������������������� U op_| S�K)@�� GR7GW;T{X MSW;TE\������������������������������������������������������������������������������������������������������������������������������ U<O

o_|_]^D<Ga\5D<FSQiG�MSX T7D_@cW<jP\�TZM BMSU�G��������������������������������������������������������������������������������������������������������������#U No<| Uu`4W<@fTE\k��<W_@fTE\k3�_W_@cT7\����������������������������������������������������������������������������������������������������������������������'U No<| p7M�FHjPGs\ZD<FSQiG������������������������������������������������������������������������������������������������������������������������������������sp�Po<| o=M�FHREFHjPR7FSQ_D \ZD<FHQ G��������������������������������������������������������������������������������������������������������������������������ypPpo<| S �L@[W_Gu\ZD<FHQ G�������������������������������������������������������������������������������������������������������������������������������������p�Qo<| OVx_MNMSTZW_MSTZGJ\���������������������������������������������������������������������������������������������������������������������������������������p��o<| Q=�4G FSm I[@[W_GJ\{FSW<m X M;MSTZI[@cW<GJ\������������������������������������������������������������������������������������������������������������ p�Wo<|���t)bSGJR5X �<IcILFSW<m �<W<m GRZX �_I[ILO M<�NG \��������������������������������������������������������������������������������������������������)p�N

S<|��%DsRZM!�_Q<\Jk! !DsR7M��_Qi\k#" FHW<m ?AMSR7G"DsRZM!�_Q<\�$&%#'(��������������������������������������������������������������������������������o3UO |_r(M�U�F9TZD�FHW��N@[G Ted�D_GR7G��)����������������������������������������������������������������������������������������������������������������������� oPo

O_| U �LMST7\^MSX W_G � \ZdNU-O MSIC\������������������������������������������������������������������������������������������������������������������)oPoO_| pVx_REFSB TZ@[MSW<\*���������������������������������������������������������������������������������������������������������������������������������������)o&�O_| o ���_Oi\ZBRZ@[Q T7\{FSW<m�\C�<QiGJR7\7B R7@cQ_T7\����������������������������������������������������������������������������������������������������so!WO_| S�n{MNMHTE\k_\�HJ�<FHR7G�FHW<m MHT7D_GR � @C\5G��������������������������������������������������������������������������������������������������-o!NO_| O �L@[W_G \k_FSOiM9bPGsFSW<m OiGJIcM � ������������������������������������������������������������������������������������������������������������o!NO_| Q�K)GI[@cU�@cTZGRE\{ICFHR7jSG�FHW<m \ZU�FSIcI+�����������������������������������������������������������������������������������������������������"SJPO_|�� ]^D_M;\5Gu\ZQiG B @CFHI X �_W<B TZ@[MSW<\������������������������������������������������������������������������������������������������������������"S UO_| W=�4G FHR{dPGSk D_G FHR{dSG!�,����������������������������������������������������������������������������������������������������������������������� SNpO_| N�?�FHTZR7@[BGJ\,����������������������������������������������������������������������������������������������������������������������������������������� S;oO_| U P K)@[\ZQ_ICF dSG m�G H!�iF9TZ@[MSWi\-��������������������������������������������������������������������������������������������������������������� S�O

Q_|_�(IcI @cWAFVRZM � ���������������������������������������������������������������������������������������������������������������������������������������������$SJWQ<| U"M@CBY�N@cW<j �_Q T7D_G�T7FSO.��������������������������������������������������������������������������������������������������������������������� SJWQ<| p7�4MPRZ@:FMPW;T7FHI FSIc@[jSW_U�GJWPT � @cTZD�U�MSR7Gu\5MPQ_D_@C\eT7@[BJF9TZG m�QiF9T5T7GR7W<\����������������������������������������������)O�U�N|_n4MSI[Ic@[W_j�dSM!�_R{M � W/�����������������������������������������������������������������������������������������������������������������������������������$O!O� | Uu]^D_G�I[MSW_j�FHWim \ZD_MPR5T{MHX @fT����������������������������������������������������������������������������������������������������������=O!O

@[@c@

Page 6: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; l+MSW;T7GW;T7\

� | pVx @cI[I[@cW_j�@[W � @fT7DAQ<FHREFHU�G T7GRE\������������������������������������������������������������������������������������������������������=O��� | o�v�d�FHWNd MSTZD_GJR{W<FHU�G ������������������������������������������������������������������������������������������������������������������� Q!PW_|_] M�GR7R{@[\4DJ�<U�FSW �������������������������������������������������������������������������������������������������������������������������������������#Q;p

W<| Uu]^D_GsX MSR7jSMST5T7GW O;dPG ���������������������������������������������������������������������������������������������������������������������'Q;pW<| pV]^D_G�U�@[\7\ZQiGJIcI[GJm MSR$�<W��NW_M � W BMSW;TZR7MSI \ZGHJ�_GJW<B G.�����������������������������������������������������������������EQ;pW<| o�]^D_G�U�@[\ZW<FSUVG m X MSW;T��������������������������������������������������������������������������������������������������������������������#Q�SW<| S�?A@C\5U�FHT7BED_G m�U�F9T7D_GU�FHTZ@CB\��������������������������������������������������������������������������������������������������������#Q�SW<| OV?A@C\5U�FHT7BED_G m�O_REFSBGJ\�������������������������������������������������������������������������������������������������������������������� QJO

N_|_K)@[jSjS@[W_j�FVIc@cT5T7IcG m GGJQiGJR+��������������������������������������������������������������������������������������������������������������������������Q!WN<| Uuv�@cj7�<I[GJ\Jk I[@fTZTZI[G"�<I[GJ\+���������������������������������������������������������������������������������������������������������������������Q!WN<| p � FSRZjPGR�U�FSB R7M�Q<FSBY�9FSjSGJ\,��������������������������������������������������������������������������������������������������������������Q!NN<| o=�4MPRZ@:FMPW;T7FHI FSW<m�bPGRZTZ@CBFSI Ic@[W_GJ\ ������������������������������������������������������������������������������������������������� ��PN<| S�v�M<� GJ\ � @fT7D_@[W O M<� GJ\ ���������������������������������������������������������������������������������������������������������������������Sp

UP<|il+MSW;TZR7MSI � MSREm�I[@C\eT ��������������������������������������������������������������������������������������������������������������������������������� � �U�UP| }�jPG T4ONd � @cTZDAFVIc@cT5T7IcGaD<GI[Q �����������������������������������������������������������������������������������������������������������������=W!P

@[b

Page 7: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

����������� ����4� ��� ����� ��� �����s�

������ $:��������Z8 $+&s=�� $�:��������58 &�� :

x @[R7\5T(MHXFSIcI k<I[G T \)\5GJG � D<F9T)\5TZGJQ<\(FSRZG�W_G B G \Z\7FHR7d T7M�Q_RZM m��iB G-F�m M B��_U�GW;T9�<\Z@cW<j�] ~ � |^]^D<G�<RE\eT4\5TZGJQ @C\^T7M�Ted;Q G�TZD<G6�<IcG�T7D<F9T(] ~ � RZG FSm_\J|�]^D_@C\{@[\R�i\C�<FSIcI[d BJFHI[IcG m T7D_Ga] ~ � �iIcGuMPR^TZD_Gu@[W_Q�� T�<I[GSkLFSW<mA@cT�BJFHWYO G�B R7GJF9T7GJm?�i\5@[W_j F \5@[U�Q_I[G-T7G��NTsG m @cTZMSR=8 @[WzX FSB/T k @fX�dSM��� R7G �<\Z@cW<j F�X FHW<Bd � MSREmQ_R7M B GJ\7\ZMSR kJdPM��uD<F bPG�TZMsOiG^\��_RZGTZD<FHT dPM��_R��<IcG�@C\ \7F bSG m�@cW-�E�<l+}5} MSR W_MSW<m_MNB��_U�GW;T U�M m G � @fT7D_M��_TFHWNd \5Q GJB@[FSI B MPWPT7RZMPILBED<FHREFSB TZGJR7\Y;/|�]^D<G-] ~ � Q<RZMPjSREFHU TZD<GWAR7GJFSm<\{dSM!�_R{@cW<Q�� T9�iIcGaFSW<m�Q_R7MNm��<B G \� D<FHT�@C\^BFHI[I[GJm�FVK �)} �<I[G78 K �(}�\eTEFHW<m_\+X MPR�K)G �)@[BGs} Wim GQ GW<m_GW;TY; |�]^D_@C\�iIcGs@[\�W_MST�R7GJFPm_FHO<IcGPk;FHTI[GJFS\5T^W_MHT^ONdVD��_U�FSW<\|�]^D_G�K �)}��<I[G)@C\+TZD_GJW�R7GJFPm�ONd FHW_MSTZD_GJR+Q_R7MSjPR7FSU 8 BFSIcI[GJm F-m GJb;@CB G�m R7@cbPGR ;TZDiF9T)Q<RZM m��<BGJ\^T7D_G-M!� TZQ3� T(T7D<F9Ts@[\(RZG FSm_FSO_IcGuONd D��_U�FHW<\J|{ghDNd�T7D_G-G��;T7R7F7�iIcG�� ]^D_G \7FHU�G-K�(} �! !"$#�%&%')(+*,�<I[G BJFHW O G R7GJFPm O;d m @ � GJRZGJW;TVm GJb;@CB G m R7@cbPGRE\�TZMzQ_RZM m��iB G M!� TZQ��_T MSW F�m MHTVU�F9TZR7@ � Q_R7@[WPT7GR k�FICFS\ZGRQ_R7@[WPT7GR kPFu\7B R7GGJWVbN@[G � GR kHMSR+FuQ_D_MSTZMHTedNQ GJ\ZG TZTZGR |t)W<B G{dPM���D<F bSG{Q<RZM m��<BGJm�FaK �)} �<IcG4TZD<FHTjS@[bSG \T7D_GsRZ@[jSD;T+M!� TZQ3� T{MSWLk \7F dSkNF \7B R7GGJW bN@cG � GJRJk;dSM!� BFSW O G�FP\Z\��_R7GJmVT7D<F9T{dSM!� � @[IcI jSGT�G��_FSB/T7IcdTZD<Ga\ZFSUVG�M!� TZQ��_T4MSW�F�I[FP\5GJR�Q<RZ@[W;TZGR � @cTZD<M�� T4R��_W_W_@[W_jVTZD<Ga] ~�� Q_R7MSjPR7FSU FHjPFS@cW |

]^D_GuQ<RZM B G \Z\�U�F d O G�TZD_M!�_jSD;T{MHX�FS\^Q<RZM B GJGJm @[W_jV@cW T7D_G�X MSI[IcM � @[W_j � F dG�

GJm @cT{TZG��NT-/.

] ~��@[W_Q��_T�iIcG

] ~ � Q_R7MSjPR7FSU-/.

K �(}�<IcG

m GbN@CB Gum R7@cbPGR-0.

RZG FSm_FSO_I[GM�� T7Q�� T

]^D_@C\aU�G FHW<\aTZD<FHT � G m MSW% T \ZGG M!�_RaM!� TZQ��_T @[W @fTE\"�<W<FSIX MPRZU � D_GW @cT @C\aO G@[W_jATedNQ GJm FHTTZD<G�TZGJRZU�@[W<FHI | vL� TV@cW T7D_@C\-BFP\5G F�I[@cT5TZI[G�QiF9TZ@[GWiB G�@C\-FHU�Q_I[d RZG � FSR7m G m k X MPR F�ICFHR7jSG�W��_U-O GR-MHX\Zd;U OiMPI[\+W_MST^F b9FH@[ICFHO_I[G(@[W�U�MP\5T � MPR7m�Q<RZM B G \Z\Z@[W_j-Q_R7MSjPR7FSU�\�OiG B MPUVG�F b9FH@[I[FSO_I[GS| } W FSm<m @fT7@cMPWLkNTZD<GTedNQiG \5GT5T7@cW_j @[\�m MPW_G � @cTZD UVMPRZG(Q_RZG B @C\5@[MSW k;FSW<m�TZD<G(@[W_Q�� TL�<I[GJ\�FHR7G(GJFP\5@[I[dV\ZGW;T+O G T � GGJW�m @ � GJRZGJW;TB MPU�Q�� TZGJR7\^ONd GJIcG B/T7RZMPW_@[BsU�FH@[ILMPR�MPWAF U�FSjSW_GTZ@CB)U�G m @ �<U |

t@�_RX MNB��<\ � @[I[I<O G4MSWVTZD<G$�<RE\eT+\5TZGJQLkHT7D<F9T+@[\Jk;BRZG F9T7@cW_jsT7D_G(] ~ � @cW_Q3� T�<I[G(FSW<m TZD_GJW�R��_W<W_@cW<jTZD<GV] ~ � Q_R7MSjPR7FSU T7M�Q_R7M m��<B GVFHQ_Q<RZMPQ_RZ@CF9T7GuRZG \C�<IfTE\|s]^D_GR7G FSRZGuT � M � F d \4MSXR��_W<W_@cW<j TZD<G ] ~ �Q_R7MSjPR7FSU ��@fT�BFSW OiG R��_W @[W O<FHT7BED U�M m G MSR @cW;TZGJR7FPB/T7@cbPGI[dS| } W O<FHT7BED U�M m G dSM�� \C�_O<UV@cT�dSM��<R] ~ � @cW_Q3� T��<I[G{TZMudPM��_RBMSU�Q�� T7GR �S@cTTZD<GW�R��_W<\yT7D_G(] ~ � Q_RZMPjSREFHU � @cTZD_M!� TX �_RZTZD<GR@[W;TZGR7bSGJW;TZ@[MSWFHWim jP@cbPGJ\�dSM!� TZD_GuR7GJ\��_IcT � D_GW�@cT4@[\R�iW_@[\ZD_G m |} W�@cW;T7GREFSB/T7@cbPG�UVM m G�T7D_GuQ_R7MSjPR7FSU BFHWA\5TZMPQ FSW<mjSGT X �<R5T7D_GR�@[W_Q�� T�X R7MSU�T7D_G��<\5GJRJkTZD<FHT�@C\Jk�TZD_G��<\ZGR�BJFHW @[W;TZGJR7FPB/T � @fT7D T7D_G�Q_RZMPjSREFHU�| `(\Z@cW<j

U

Page 8: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW U��DsGT5TZ@[W_j �;TEFHRZTZG m

] ~�� @[W;TZGJR7FPB/TZ@[bSGJIcdzFHI[IcM � \�\ZMSU�G�GR7RZMPR7\(TZMAO G B MPRZR7GJB TZGJmYONd�TZD<G �<\5GJRJk � D_@cI[G�TZD<G ] ~�� Q_R7MSjPR7FSUU�F��PGJ\)TZD_G BMSR7RZG B/T7@cMPW<\(@[W O<F9TEBEDzU�M m G�FS\�O GJ\5Ta@cT-BFHW | } W;TZGJR7FPB/T7@cbPG @C\sTZD_G�Q<RZGX GR7RZG m�U�M m GSk MHXB M!�_RE\5GP| �4I[I�Q GRE\5MPW<FHI�B MPU�Q�� TZGJRaFHW<mzU�FHWNdAU�FH@[W X REFHU�G�@cU�Q_I[GU�GW;TEF9TZ@[MSWi\sFSRZGV@[WPT7GREFSB TZ@[bSGS|�t)W\ZMSU�G�U�FS@cW_X R7FSUVG \k D<M � GJbSGR kPTZD_GuMPW_Icd Q_REFSB/T7@[BJFHI U�G T7D_M m MSX R��_W_W<@cW_j�] ~ � @[\{@[W�O<F9TEBED U�M m GP|

������ 0i.�� � � ���a*532:_. 0<3 $�=s$�u*e32.+'):�u'): �(: 3�� ��� 8N3 : '�

� r4MHT7G�X R7MSU ?�K ���������������������! �"$#%��#&�'�(�*),+-��./�* +-�* 0�1�2�434���5�! %�6 7���0�8)�9: 0;<9="�9: +>)?9'#7@A�B ��.0"C9-3D�4+E@'#F9�"5��3*9:"HG�;=��+A�:IFJ�� B �*KL� B �* 32���6�M)�9-+A�N�(�O�L�1�A;��L�P��+A�Q�:KR�L���S�*�!3T���5�! E�U�L�2�*"6K�IV���0�KL�!"6"5�<WX�Y AG?"5��3*9:"Z�6 �KL� B )�9A�L�C�: S�P���-;["�+N@A�\�Y Z3]"L;�+-�4+_^`Va �_9��X�Y &�L�L��9=" �'�(��.Z�'b��YKX9: <#cbA�P���A;="�+d@A�1�U9:eA�* f@D#f����� B �D9A+-� B �g��./� B )h�U�i���0� B ;= & ��Y �G��:KH�:j&k9= Z+R#&�-; B "5��3*9="/+-�!l!�L32�m+ B �Ll:� B<n �po4I`>q �<Wr�g� B ;= s�:jAkhI`>q �<Wr�g� B �D9A+S�L���\"C�!G?t�"C�=I`>q �<Wr�g��. B �:l4�5�!WF9: Z+<u-� B . B �6 ��v�L���R+&l!� t�"5�:I������KL�:"Y"5�<WX�6 AGR�]9=)m.0"C�w����9T.�.0"6��329�@:"5�w��� B �v9A�X�L���hxy &�Ll:� B �p�U�6#?�!K0zO9= ��L�(�A@[9&I a ��;[�2�v9�"5�A329:"6"{#W B �L�P�g�* ��4+<�L�(� B�n zN|\J1� jH} oH�! ?9: M|~)Q+c9=��" B ;[ � ��6 AG�z%� }��[�[� )7K�9=� B "{#�3D� B �U9=�Y Q���_9��0�L� � �v�L����WX� B �T�./�:�]�p�g@:"5��329=�2�:I �} WAT7D_@C\(\ZGJB/T7@cMPW � G! I[I \ZGG-D_M � TZM R��_W�] ~ � F9T4T7D_G `(W_@[bSGRE\Z@fTed MHX?�FHW<@fT7MSO<F<|{} T(@[\sFS\7\��_U�GJm

TZDiF9T{TZD<GuRZG FSm GJR�@C\�X FHU�@[Ic@CFHR � @cTZD�?Y�(r(]{~L��FSW<m�BFSW BRZG F9TZGsT7G��NT$�<I[GJ\R�<\Z@cW<jV@cTJ|

x @[R7\5TJk TZD<GR7G FHR7G \ZGbPGREFHI T7D_@[W_jP\)TZDiF9T)U �<\5TsO GVm_MSW_G71_� *O�4��� *,1_���5��|�] M \5T7FSR5T(dPM���U �<\5Tm MVTZD<G�X MSI[IcM � @[W_j?8 dPM�� Ted;Q Gu@[W T7D_GuU�F9T7GR7@[FSIiT7D<F9T4I[MNM�� \^I[@ �PG)TedNQ G � R7@fT7GR^TedNQ G ; �

8 U ; FSIcI[M BF9T7GsTZD_G6�<I[GJ\�T7D<F9T(] ~�� � @cI[I%�<\ZGuONd�TedNQ_@[W_jVTZD_G�X MPIcI[M � @cW<jVI[@[W_GJ\"8 � D_@cI[Gu@[W�?Y�(r(]{~L��; �

l@���-�-�c�&���A�<�_�[�[�A�_�[�w�(���[�F�A�<�:�0�<�A�c�<���]�- -¡/�]¡�¢T£<£l@���-�-�c�&���A�<�-�c�0¤>�A�[�=�0�<�A�c�<���4¢!¥c�<£w�]¡0¢D£-£

8 p�;Al+R7GJFHTZG�F,�<I[GYBFSIcI[GJm n^`(r)]{~ � @[WhdSM��<R ?��(r)]{~ � FHjPjSR7Gj;F9TZG B MPWPTEFH@[W_@[W_j TZD_GAX MPIcI[M � @[W_jK l ���

¦-¦r§-¨=© �-ªp«[¬�­¯®-°-±wª¦-¦ °-±-°A²%®-°c±A²¦-¦c³ «A²%´-´¯´ ³ ­A��µ:�0�[�<�0¤!��¶� ³A¨ ¬�«-²c°w�(®-°<±w��´0· ³[¸ � ³<¹ «¦-¦ ´cº0·>´-´¯´ ³ ­A��µ:�0�[�<�0¤!��¶�(´-º�·y��´0· ³<¸ � ¨<» ´

p

Page 9: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW U��DsGT5TZ@[W_j �;TEFHRZTZG m

]^D_GuWiFHU�G1µ=���[�<�0¤:�A¶a@C\{RZGJQ_ICFSB G m�ONd dSM��<R�M � W��<\ZGR{@Cm k_MSXyBM��_RE\ZGS|�]^D_G"�<\ZGuMHX��_Q_Q GR(BJFS\ZGFHWim T7D_Ga\5QiFSB G \^U)�<\5T4O G�X MSI[IcM � GJm�G��_FSB TZI[dS|

8 o!;Al+R7GJFHTZG F'�<I[G BFSIcI[GJm M�n{}er)]{]{~ � @[WYdPM��_Rs?��(r)]{~ �YFHjSjPRZGJjPFHTZGaB MPW;T7FH@[W_@[W_j�T7D_G-X MPIcI[M � @[W_jK l ���

¦-¦r§-¨=© �-ª ¸ «0·!­-®%®-°c±wª¦-¦ °-±-°A²%®-°c± ¸¦-¦ ´cº0·��0· » °F´-´r´ ³ ­A��µ:�0�[�<�0¤!��¶�(´-º_·y�p´_· ³[¸ � ³[¹ «

t)W<BGudSM!� D<F bPGuB MSU�Q_I[G T7GJm TZD<GJ\ZG�TZD_R7GGa\5TZGJQ<\k<dSM���FHR7G�RZG FSm d TZM�R��_WAF�] ~�� AeMPOL|�]^D_G6�<I[GJ\dSM!� DiF bSG�B R7GJF9T7GJm � @cI[I FSIcI[M � dSM!��T7M�Q_R7MNm��<B GuFHO M��_T�T7GW�Q<FSjSGJ\^MSX MPR7m @[W<FSRZd�T7G��NTJ|

�(GR7G�FSRZGsT7D_Ga\eT7GQ<\^dPM�� �<\ZG *���� (F�4��� *Q�G1��������� 1 0+|

8 U ; BRZG F9TZGuF�?��)r(]{~ � �<I[GaB MPW;T7FH@[W_@[W_jVdSM��<R^] ~ � @[W_Q�� T |

8 p�; \7F bSG�FHW<m�\��_O_U�@cT4dSM��<R �iIcG"�<\Z@[W_jVTZD_GaBMSU�U�FHW<m_\

l@� �=�<���%� ¦ �E���¯�A�c�_�=�[�A���[��(���<�� &�&�[���l@� �4�-�[� ¤!�%�<�� A���<�

8 o!; � D_GJW�dSM�� jSGT4F U�G \Z\7FHjPGs\7F dN@cW_jVT7D<F9T{dSM!�_R�AeMSO @C\R�<W_@C\5D<GJm k_GJW;TZGR^T7D_GaB MPU�U�FSW<m

l@���=�A� µ��-�[�� ��!�0�A¶��Q�&¤c�:�¯�-���A�[�A�} W�T7D_@[\sB MPU�U�FSW<m kZµ��-�[�� &�4�0�A¶ @C\4R7GQ_ICFSBGJm ONd dPM��_R#�i\5GJR4@[m � @fT7D�F m MSI[ICFHR(\Z@cjPW�FHQ_Q GWim GJm |

]^D_@C\E�<I[G�Ic@C\eT7@cW<j � @[I[I�TZGJIcIdPM��zMHX{FHWNdAGR7RZMPR7\)T7D<F9TuU�@cjPD;TaD<F bSGVM BB��<RZR7GJm |V} Ta@C\uFHW FHO_O_R7GbN@CF9T7GJmbSGJR7\Z@[MSW�MSX � DiF9T4@C\4BFSIcI[GJm�TZD_G��ZIcMPj7�<IcG���� � G � @cI[I%�<\ZG�TZD<G�TZGR7U��ZIcMPj)�iIcG��VTZM�RZGX GR^T7M�TZD_G�TZTedSM��_T�<I[GuQ_R7MNm��<B G m�ONd�] ~ � |

} XydSM!� � FHW;TJk<dSM���BFSW BED<GJBY� MPW T7D_Ga\5T7F9T��<\{MSX dSM!�_R�AeMSO � D_@[I[Gu@fT4@C\{G�� G B�� T7@cW_j�ONd'�i\5@[W_j�TZD<GB MPU�U�FSW<m

l@��� µ��-�=�� &�!�0�-¶ghD_GJW dSM!� FSRZG7�<W_@C\ZD_GJm I[M;M!�N@cW_jAFHTuTZD_G�I[MSj �<I[GSk TZD_G�BMSU�U�FHW<m �� ����-�:�A�<����� � @cI[I�TZD<RZM �

F � F d�TZD_GuI[MSj7�<I[G � D_@[IcG�T7D_GaB MPUVU�FSW<md�� ��%���A�c�-���[� � @[IcI \ZGWim�T7D_GuI[MSj7�<I[G�TZM�TZD<GuQ_RZ@[W;TZGJRJk_FSW<m@cT(BFHW TZD<GW�OiGuQ<@[BY�PGJm �_Q � @fT7D dPM��_R4] ~�� M�� T7Q�� T |

o

Page 10: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW U��DsGT5TZ@[W_j �;TEFHRZTZG m

8 SJ; � D_GJWAdSM!�_R{M�� T7Q�� T4X R7MSU n^`(r(]{~ � Q_R7MSjSREFHU @[\{GJRZR7MSR�X R7GGPki] ~�� � @cI[ILD<F bPG�BRZG F9T7GJm�F�IcGJjPFSIK �)}�iIcGP|] M�Q_R7@cW;T4@cTJk��i\5GsTZD<GaB MSU�U�FHWim

l@� �4�-�[� ¤!���-�0¤� A�-�A�<� &�����A�<��)\{@cW�8 o!;/k dPM���BFSW BED_G BY� MSW TZD<Ga\eTEF9T��i\{MHX dSM��<R�AeMSO � D_@cI[Gu@cT4@[\{G�� GJB��_TZ@[W_j<|

85O�; M�@[BY� �<Q dPM��_R�M!� TZQ��_T-F9TuTZD<G�}��St � @[W<m M � k \5@ �NTZD��<MNMSRu~W<jS@[W_GGJRZ@[W_j O��_@[I[m @[W_ji| } T �<\��<FHI[IcdTEF��SG \{FHO M�� T^T � GW;Ted U�@[WJ�_TZGJ\{X MSR^TZD<GuM�� T7Q�� T{TZM�O GuRZG FSm dP|��(\�� X MSR{@cT4ONd��*µ��-�[�� ��!�0�A¶��_|]^D_G=�iIcG \uB R7GJF9T7GJm FHR7G ICFHR7jSGVGW<M��_jPDYX MPRuR��_W<W_@cW<j�] ~�� AeMSO<\�MSX^FSOiM!� T UP Q<FSjSGJ\J|�� AeMSO MHX

TZDiF9T�\Z@:FG � @[IcIiT7F��SG(FSOiM!� T+MPW_G(\ZGJBMSW<m�MSX lLM�` T7@cU�G4T7M-R��_W�TZD<RZM!�_jSD ] ~�� |�} T � @[I[I_T7F��SG(FSOiM!� T@U<O\ZGJB MPW<m_\^MSX�lLM�` T7@cU�G�T7MVQ<RZ@[W;T UP Q<FHjPGJ\^MSW TZD<G � GR7M<� W!Q�P�P)�<\Z@cW_j�T7D_GaB��<RZR7GW;T{m GbN@CB Gam R7@cbPGR |

�M!��BFHW�Q_R7@[WPT4dPM��_R{M � WABMSQNd�MSX T7D_@[\(U�FHW��<FHI��<\5@[W_j�T7D_G-B MPU�U�FSW<m��-�-�&�!�¯���<� |�M��ABFSWFHIC\ZM �iW<m IcMST7\^MHX MHT7D_GR$�<\ZG X �<ILMSW_I[@[W_Gu@cW_X MSR7U�FHTZ@[MSW�FHO M�� T4] ~ � ONd'�<\Z@cW_j��c���<��¤� ��A�i|

���� 3 : � 8 =s. � :�

�NMik<X R7MSU M!�_R(bN@[G � Q MS@[WPT k TZD_G W<FHU�G-MSX�TZD_G jPFSUVG @[\4TZM B R7GJF9T7GuTZD<GV] ~ � �<I[GaT7D<F9T�Q_R7MNm��<B G \TZD<G)R7@cjPD;T�RZG FSm_FSO_I[G4M�� T7Q�� T | ghDiF9T{m MNGJ\�Fa] ~ � �<I[G)I[MNM��VIc@:�SG�� } T�B MPW<\Z@[\5T7\+MHX BED<FSR7FPB/T7GRE\yX RZMPU FSWMSREm @[W<FHR7d�TZGJRZU�@[W<FHI k9T7D<F9T�@C\k!�_Q_Q GRFHWim-I[M � GJR�BFS\ZG^IcGT5T7GRE\kHW��_U OiGJR7\JkSFSW<maT7D_G$�<\��<FHI Q3�_W<B/T��<F9T7@cMPWFHWimzFPBB GJW;TuBEDiFHREFSB/T7GRE\ 8 TZD_G \5G�FSRZG TZD_G �i\C�<FSI�@�<l+}Z}sBEDiFHREFSB/T7GRE\�; |-] G��NTJk X MSR�TZD<GVU�M;\eTuQ<FSR5T kL@[\A �<\5T-TedNQ GJm W_MPRZU�FHI[I[dS|?�NQiG B @CFHI@[W<\5TZR��<B/T7@cMPW<\ �i\C�<FSIcI[dz\5T7FSR5T � @fT7D MSW_G MSX4F X G � \5Q GJB@[FSI+\ZdNU-O MSIC\\��<BEDYFS\�� MSR���8 TZD_G \5G � @cI[IyOiGVm GJ\7B R7@cO GJm�@cW�U�MPRZGVm G TEFH@[I ICF9T7GR ;/|@�(GR7Ga@C\)FSW�G��_FHU�Q_I[G-MSX�F ] ~3�@[W_Q�� T$�<I[G��

¹ �<�A��¤<�s���r��¤4���:���[®��<±��r�[�� A���� 0�[�w��=� �A�

x @[R7\5T(W_MSTZG�TZDiF9T4T7D_G-BED<FSR7FPB/TZGJR7\^@[W�TZD<@[\(G��_FHU�Q_I[GuIcMNM!��I[@ �PGuTedNQiG � RZ@cTZGJR{TedNQiGP|+g G �<\ZGuTZD<GJ\ZGBED<FSR7FPB/TZGJR7\ � @cTZDAFHI[ILG�� FSU�Q_IcG \�TZD<FHT(FHR7G�UVG FHW;T^TZM�O G�TedNQiG m X RZMPU TZD_GaBMSU�Q�� T7GR{T7GR7U�@cW<FSI |� GJB �MSWim kNW_MHT7G4TZDiF9T�TZD_G)O<FSBY� \ZI[FP\5D FSQ_QiG FHRE\�T7D_RZGJG4T7@cU�GJ\�@[W�TZD<G(T7G��NTJ|�g G� IcI \ZM;MPW�\ZGG4T7D<F9T�TZD<@[\+@[\+MSW<GMHX^T7D_G�\ZQiG B @CFHI+\ZdNU-O MSIC\uU�GW;TZ@[MSW<GJm Q_R7GbN@[M��<\ZIcdPk FSW<m @fTV@[\ �<\5G m bSGJRZdYX RZG H!�<GW;TZI[d � D<GW U�F��N@[W_j] ~ � m M B��_U�GJWPTE\|�?�F��SG(F �<I[G)B MPW;T7FH@[W_@[W_juT7D_@[\+G��_FSUVQ<IcGP| `)\5G(TZD_Gs] ~ � Q_RZMPjSREFHU T7M-U�F��PG(F-K�(}�<I[GuFHW<m�F�m GbN@CB Gum R7@cbPGR�TZM�\ZGG � D<FHT^dPM�� D<F bSGsQ_R7M m��<B G m |y} XyFSIcI jPMNGJ\ � GI[I k dPM��% IcI DiF bSG�FV\Z@[W_jSI[GQ<FSjSG � @fT7D TZD_G�X MPIcI[M � @cW<jV\Z@cW<jSI[G�\ZGW;T7GW<BG��

�(GR7Gs@C\{U d �<RE\eT(] ~�� \5GJWPT7GW<BGS|

S

Page 11: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M�8 `a|T� | \5Q GI[Ic@[W_j�; �NGJB TZ@[MSW U��DsGT5TZ@[W_j �;TEFHRZTZG m

]^D_GJRZG � @[I[I FHIC\5M�O GaF�Q<FHjPG�WJ�<U-O GR4F9T{T7D_GaO MHTZTZMSU MHX TZD_GuQiFHjSGP|�} X�dSM��� bPGsjPMHTZTZGW TZD<@[\4X FHR kB MPW_jSREF9T��_ICF9TZ@[MSWi\���t)W<B G{dPM�� BFSW�Q_RZM m��iB G4MPW_G(] ~�� m M B��_U�GW;T kP@cT \%A �i\eT+FaU�FHT5T7GR�MSX TZ@[UVG(OiGX MSR7GdSM!� BJFHW�m M�U�MSR7G�BMSU�Q_I[@[BJF9T7GJm MSW_G \|�r4M � IcGT \4B MPU�Q<FHR7G � DiF9T � G�TedNQ GJm @cW � @cTZD � D<FHT � G�jSMSTM��_TJ|]^D_G�\eT7R7FS@cjPD;T5X MSR � FHREm � MPR7m_\ � GR7GA �<\5T^TedNQiG m�@[W W<MSR7U�FSIcI[dSk FSW<m�] ~ � \ZG T^T7D_GU @[W MSREm @cWiFHR7dTedNQiGP|�v �_T�TZD<G � MSREm �Z] ~�� �_k � D_@CBED�BFSW% T+OiG)TedNQiG m�@cW�MSW FuT7GR7U�@cW<FSI<O GJBJF��<\ZG4T7D_G(I[G TZTZGRE\�FHR7GW% TMSW�T7D_G \7FHU�GuI[@cW<GSk @[\(GW;TZGJRZG m�O;d �<\Z@cW<j�F � MSREm \5T7FSR5T7@cW<j � @fT7DYF�O<FPBY�N\ZICFS\ZDLk<FHWimA] ~ � U�FPm GuTZD<GQ_R7MSQ GR+@cW;TZGJRZQ<RZGT7F9T7@cMPWL| ?�MP\5T�\Zd;U OiMPI[\TZD<FHT+FHR7G4W_MST+MPR7m @[W<FSRZdaI[G TZTZGJR7\JkPW��_U OiGJR7\Jk;MSR�Q3�_W<B/T��<F9T7@cMPWFHR7G^TedNQiG \5GTONd GJWPT7GR7@cW<jaF � MPR7mV\eTEFHRZTZ@[W_j � @cTZD FuO<FPBY� \5ICFS\ZDL| } X � G{IcMNM!� F�I[@fTZTZI[G(B I[MP\ZGR k � G� IcI<W_MHT7GTZDiF9T4T7D_G � MSREm � �<RE\eT �V@[\)FHIC\5M BED<FSW_jSG m | ]^D_G"�iR7\5T4T � M�IcGT5TZGJR7\(D<F bSG�O GGJW AeMS@[W_GJm T7MSjPG TZD<GR(FSW<m �! !"$#�%&%')(��TZD<GR7Gu@[\ZW% T(FV\ZGQiFHREF9TZG�m MST4M9bSGR�T7D_GuIcGT5T7GR �Z@ �<|y]^D<@[\{@C\4\5T7FSW<m_FHREm�TedNQ GJ\ZG TZTZ@[W_j�Q_REFSB/T7@[BG��BGRZT7FH@[WI[G T5T7GR�B MPU-O_@[W<FHTZ@[MSW<\VFHR7G)AeMP@cW<GJm �<Q TZM X MPRZU � D<FHT�FSRZG BFSIcI[GJm�"Y�YG-9��p; B �2�J| ]^D_GR7G @C\�FSB T��<FSIcI[d FjSMNM m GJ\5TZD_GTZ@CB�RZG FS\ZMSW X MSR{T7D_@C\|{l+MSU�Q<FHR7GsTZD_G �<R7\5T{T � M�IcGT5TZGJR7\4MHX � �<RE\eT ��FHW<m �eX @[RE\eT �VTZM \ZGG�TZD<Gm @ � GJRZGJW<B GP|{gzG W_MHT7GuTZDiF9T �=� ��� FHQ<QiG FHRE\{@cW�TZD_Ga@[W_Q��_T9�<I[G � @cTZD�W<M�B MPRZR7GJ\ZQiMPW<m @[W_j � MPR7m @[WATZD<G�<W<FSI BMSQNdS|�]^D_@C\sF TedNQ GJ\ZG T5T7@cW<j�@[W<\eT7R��iB/TZ@[MSWYTZD<FHT(T7GI[I[\�] ~�� TZDiF9TsTZD_GV@cW<Q�� T�@[\@�<W_@C\ZD_GJm |�g G� IcII[GJFHR7W�FHO M�� T{I[MHT7\4MHX m_@�� GR7GW;T{TedNQiG \5GT5T7@cW_j�@[W<\5TZR��<B/T7@cMPW<\{FS\ � G�jSM�FHI[MSW<j<|

� G T \�I[M;M!�YF9T�T7D_G�IcMPj �<I[G�TZDiF9T � FP\�B R7GJF9T7GJm � D_GW � GVREFHW ] ~ � |V} TaU�F dAb9FHR7dY\ZIc@[jSD;T7Icd�FHTdSM!�_R{\5@cTZGPk_O�� T(\ZD_M!�_I[m I[MNM���\ZMSU�G T7D_@[W_j�Ic@:�SGsTZD<@[\�

¢y��w� ®��0¤c�r¤c�E®A�<±w���-º ³ º��<�_�A¤=�� �w����� &�r�-�<�=�0�<���-���A�c�-�<�A�c�� ��� � �0¤[�<� ¸-»�� ·!­H� � �-®rµ ���F´c´A��� �-® » · © �-°��A� ¸A»�� ·!­£H� w��� � �0¤[�<� ³ «A²��(®-°c± µ � �E´-´A� ³ «A²¡w� �'�!���/�(���[���D¢��� � ¨ �-� �-�A���A��¤!�-���� �� ´-º�·��4¢ �&�����X�d�- -¡E� �-�A�&������ � ®-�A�� 0�-�:��¤ �A���A��¤!�-���� ¯�� ®c°-± »�¨�� �

]^D_@C\�@C\sTZD_G7�<I[GVTZD<FHT � @[I[I�B MPWPTEFH@[WzFSW;dAGJRZR7MSRsU�GJ\7\ZFSjSG \|Vt)W I[@cW_G Q<k �'�!���/�(���[� @cW<m_@[BJF9TZG mTZDiF9T ] ~ � D<FS\a\5T7FSR5T7GJm R7GJFSm_@cW_j T7D<F9T �iIcGP| ]^D_G FSQ_QiG FHREFHW<BG�MHX!�2¢��Y@cW<m_@[BJF9TZG \�TZDiF9TaQ<FSjSG?U�D<FP\O GGW�Q_R7M B G \Z\ZGJm |y} X TZD_GJRZG � GR7G�GR7RZMPR7\+MSW�Q<FSjSG7USkNTZD<Gd � M��<I[m OiGuI[@C\eT7GJm�F9T{T7D<F9T4Q MS@[W;TJ|

" ~ � GREB @C\ZG UP| U �(m<m F�\ZGJBMSW<m \ZGW;TZGJW<B GsTZM�dPM��_R{MPRZ@[jS@[W<FHI ] ~�� �<IcG�T7M�jSG T �

¹ �<�A��¤<�s���r��¤4���:���[®��<±��r�[�� A���� 0�[�w�·#�&�&� ���&�¯�� &�����&�%��� ���&�[�<�V¤4�%$�=� �A�

`)\5Ga] ~�� FHW<m IcMNM!��F9T4dPM��_R^M��_TZQ�� T |�}e\^TZD<Ga\5G B MSWim \ZGW;TZGJW<B G�MPW FVW_G � I[@cW<G �

O

Page 12: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW U��DsGT5TZ@[W_j �;TEFHRZTZG m

" ~ � GREB @C\ZG UP| p r4M � FSm_m T7D_@[\4Ic@[W_G�TZMVT7D_GuOiGJjS@[W_W_@[W_j�MHX dSM!�_RL�<IcG!�

�� &� �&������ c�[�&�&�<�_�DE�_G \Z\ � DiF9T � @[IcI D<FHQ_Q GW � D<GWAdSM!� R��_W TZD<GaW_G � �<I[G�TZD<RZM!�_jSDA] ~�� |�r(M � T7RZd @fTsFHW<m�\ZGG � D<FHTD<FSQ_QiGJW<\J|

" ~ � GREB @C\ZG@UP| o �(m<mVTZD_R7GG^MSRyX M!�_R�U�MSR7G{\5GJWPT7GW<BGJ\ T7MsdPM��_R��iIcGP| `)\5G{I[G TZTZGRE\JkHW��_U-O GRE\kSQiGJRZ@[M m_\kB MPU�U�FP\k�HJ�_G \eT7@cMPW U�FSR�� \Jk_FHW<m G��_B ICFHU�FHTZ@[MSW QiMP@cW;T7\Jk O�� T(m_MSW% T#�<\ZGaFHWNd�MHT7D_GR4\ZdNU-O MSIC\|

" ~��NGJR7B@[\ZG?US| S �LG F bSG FAO_ICFHW3�zI[@cW<G�FHW<m FSm_m \ZMSU�G U�MSR7G \ZGW;TZGJW<B G \|��M!� BFHW W<M � jPG T-W<G �Q<FSR7FSjSREFHQ_D<\J|

g G4D<F bPG�W<M � \ZGGJW F�U�F�AeMSR�Q_R7@[W<B @[Q_I[G(B MPW<B GJRZW_@[W_jsTZD<G4Q_R7GQ<FSR7FHTZ@[MSWVMHXL] ~ � @[W_Q��_T�<I[GJ\J| ]^D<GQ_ICFSBGU�GW;T MSX{TZD_G TZG��NTVMPW dSM!�_R BMSU�Q�� T7GR TZGR7U�@cWiFHI^m MNGJ\ W_MHTVW_GJBGJ\7\ZFSRZ@[Icd B MPRZR7GJ\ZQ MSW<mzTZMzTZD<GQ_ICFSBGU�GW;T4MHX TZD_G�T7G��NT(MPW dPM��_R^M��_TZQ�� T | �M��ABJFHW�W_MHT kNX MSR4G��_FHU�Q_I[GSk_FSm<m \ZQ<FPB G�OiGT � GJGW � MPR7m<\@[W�dSM��<R�M�� T7Q�� T�ONd FPm_m @[W_ju\5QiFSB G \�@[WVdPM��_R�@[W_Q��_T��<I[GS|��NGbPGREFHI_BMSW<\ZGJB�� TZ@[bSG{\ZQ<FSBGJ\FSW<mVMSW_G4\ZQ<FSBG� @[IcI Q_R7M m��<BG)G�� FPB/T7Icd�T7D_Gu\ZFSU�G)M!� TZQ��_TJ|�(\ � M��<I[m�OiG�G�� Q GJB TZGJmLk<F � MSREm�FHT^TZD_G�GWim�MSX MSW_G�I[@cW<G� @[IcI OiG�\ZGQ<FSR7FHTZGJmVX R7MSU T7D_G9�iR7\5T � MSREm�MHX T7D_G(X MPIcI[M � @[W_jaI[@cW_GP|y} W X FSB TJk \ZMSU�G T7@cU�GJ\ � D_GW � MPR��N@[W_jMSW F �<I[G�TZDiF9T � @[IcI�OiG D<GJF bN@cI[d�G m @fT7GJm k @cT-@[\-B MSWNbPGW_@[GW;T�TZM�\5T7FSR5TaG FSBED \5GJWPT7GW<BG�MSW FA\ZGQ<FSR7FHTZGI[@cW_GP|�NQ<FPB GJ\{FHT{TZD_GuO GjP@cW<W_@cW<jVMSXyFVI[@cW<GSk_D_M � GbPGR k;FSRZGuFSI � F d \�@[jSW_MPRZG m |

" ~ � GREB @C\ZG UP| O �(m<m�T7D_G�X MSI[I[M � @cW_j�\ZGW;TZGJW<B GuFP\{F W<G � Q<FHREFHjPR7FSQ_DLkNFHW<m TZD<GW TedNQiG \5GT^@cT�

²A�� �-���<�c�&�c�<�0¤=�� 0� $ � �[�r�����[�_¤!���<�%� �c���c�A�¯�c� ¢!¥-¥ �r�� ���=�A� �c�<���&�!��<���4� ¤� &�<��¤=�� v�]^D_G � \Z@cjPW @C\=�<\ZGJm X MSR�B MPUVU�GJWPTE\�@cW dSM!�_R�@cW<Q�� T �<I[GS| ~bPGR7dPT7D_@[W_jYMPW F I[@cW_G X MPIcI[M � @cW<jYT7D_@[\\Zd;U OiMPIi@C\�@cjPW_MSR7GJmL| r(MHTZ@CB G)TZDiF9T^GbSGJW T7D_Gs\ZQ<FPB G4T7D<F9T^W_MPRZU�FHI[I[d�\ZGQiFHREF9TZG \�T7D_G�I[FP\eT � MPR7m�MPW MSW<GI[@cW_GaX RZMPU TZD<G"�<RE\eT � MSREm�MPW�TZD_GuW<G��NT(I[@cW_G-@[\{I[MP\5TJ|�r4M � Q�� T)F O<FSBY� \ZI[FP\5D @cW�X R7MSW;T4MHXyT7D_G � \Z@[jSWTZM�BMSR7RZG B/T^TZD_Ga\ZGW;T7GW<BGS|

" ~ � GREB @C\ZG UP| Q �(m<m�T7D_G�X MSI[I[M � @cW_j�\ZGW;TZGJW<B GuFP\{F W<G � Q<FHREFHjPR7FSQ_D%�

� �[� ����� �0����¢4¥w�p¥-¥¯�� ���¤!�ªD�E�[�&�[�A�%��¤D�0� ���[� �[�� A�7¤!�¯�����0� $

Q

Page 13: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW U��DsGT5TZ@[W_j �;TEFHRZTZG m

]^D_@C\ � @[IcIiQ_RZM m��iB G{FHW�GR7R7MSR�@[WVdPM��_R�I[MSjE�<I[G)8 @fX dSM!�_R�@[UVQ<IcGJUVGJW;T7F9T7@cMPW�MHX ] ~�� @C\�@[WPT7GREFSB TZ@[bSGSkHTZD<FHT@C\k \ZGW<m_\�dPM�� U�GJ\7\7FHjSG \�FSW<m � FH@cT7\�X MSR^FHW<\ � GRE\kA �<\5T�D_@cT�TZD_GuBFSRZR7@CFHjSG{R7G T��_R7W MSR�GW;TZGJRR�SGd � D_GJWdSM!� jSGTaTZD_G GR7RZMPRaU�GJ\7\ZFSjSG<;/|��M�� � @cI[I�jPG T M!� TZQ3� TJk�O��_T W_MST � D<FHT-dSM!� UV@[jSD;TVG�� QiG B/T | �LMNM��F9T�T7D_G�IcMPj �<IcG FSW<m \5GJG � D<GR7G T7D_G�GR7R7MSR�U�GJ\7\ZFSjSGJ\�FSRZGVIc@C\5TZGJmL| K(MPW% T � MPRZR7dAFHO M�� TuT7D_G FSB T��<FSIU�GJ\7\ZFSjSG \|yg G� IcILDiF bSGuF�IcMST{UVMPRZGsT7M \ZF d�FSOiM!� T4GR7R7MSRE\@8 @cW<BI �im @cW<j�TZD_@C\{MPW_G ;+ICF9TZGJRJ|r(M � �3��TZD<GGR7R7MSR�ONd�Q��_T5TZ@[W_j�F O<FSBY� \ZI[FP\5D @[W X R7MSW;T^MHX TZD_G �V\5@[jSW kNFSW<m�Ted;Q GJ\ZG T�TZD<GsR7GJ\��_IcT68 TZD_GJRZG�FHR7G�F-\ZU�FSIcIW��_U-O GR{MSX BED<FSR7FPB/T7GRE\�I[@ �PGsTZD_GuQ GR4BGW;T4FHW<m m MSI[ICFHR{\5@[jSWi\�TZD<FHT{] ~ � �<\ZGJ\�X MSR{@cT7\^M � W Q��_R7Q MP\ZGJ\J|� T7FSO_I[GsMSX T7D_GJ\ZGaBED<FSR7FPB/TZGJR7\ � @[IcILO GuQ_R7M9bN@[m G m�\ZD_MSRZTZI[d�;/|

���� ����� $�8 3��+3 0<>{: �5&�� 's&�=s3 0��L.+&^:_0i.+*

g G(D<F bPG4\5GJGW�T7D<F9TT7D_G(OiFSBY� \5ICFS\ZDVD<FS\+Fa\5Q GJB@[FSI<R7MSI[GS|y�4WNd � MPR7m�\5T7FHRZTZ@[W_j � @cTZD�FaO<FSBY� \ZI[FP\5D� @[IcI OiG jS@[bSGWAF�\ZQiG B @CFHI @cW;TZGJRZQ<RZGT7F9T7@cMPW � D_GW�] ~�� R7GJFSm<\{@fT(X RZMPU dPM��_R4@[W_Q��_T#�<I[GS|9���<BED�F � MSREm@C\uBFHI[I[GJm F�32�! 0� B �:"/�2���A;c�2 Z32�9|�]^D_GR7G�FHR7GSkL@[W X FSB/T k T � M TedNQ GJ\uMSX�BMSW;TZR7MSI�\ZGHJ�_GWiB GJ\�uF�32�! 0� B �:"W� B + @C\(F�OiFSBY� \5ICFS\ZD X MSI[IcM � GJm�ONd IcGT5T7GRE\4MSW<Icd�8 X MPR(G�� FSU�Q_IcGPk �[®��<±�;^FHW<mAF83D�! 0� B �!"��(#�)Q@-�:"�@[\)FO<FPBY�N\ZICFS\ZDAX MSI[IcM � GJmYONd�F \Z@cW<jSI[G W_MPW_I[G T5T7GR'8 X MSR�G��_FHU�Q_I[GSk � �J; | �N@[W<B G�F \5Q<FPB GV@[\uF W_MPW_IcGT5T7GR kLFO<FPBY�N\ZICFS\ZD�X MSI[IcM � GJm�ONd�F�\5Q<FPB Gs@[\{FVI[GjP@fT7@cU�F9T7GsBMSW;TZR7MSI \ZdNU-O MSI | ghD_GW � G � FHW;T^TZM�GJUVQ<D<FS\Z@ FJG �! !"$#�%&%')(��� TZDiF9T+F�\ZQ<FSBG{@[\�Q<RZG \5GJWPT k � G � @cI[I��<\ZG4Fu\ZQiG B @CFHI<\ZdNU-O MSI��uTZMu@[W<m @CBF9T7G^TZD_G)\5Q<FPB GPkPFS\y@[W�TZD<G4B MSW;T7RZMPI\Zd;U OiMPI ���<|�]^D_@C\4BMSWNbSGJWPT7@cMPW�@C\R�<\ZGJm @cW?& ( * & - / 01%1 2zFP\ � GJIcI FP\�@cW TZD<@[\{U�FSWJ�iFHI |

ghD_GJWY] ~ � @C\4R7GJFSm_@cW_j�dSM��<R4@cW<Q�� TE�<IcGVFHW<mABMSU�GJ\4TZM F�O<FSBY� \ZI[FP\5D X MPIcI[M � G m�ONd F�I[G TZTZGJRJk @cT�NW_M � \)TZD<FHTaF BMSW;TZR7MSI � MSREm�@C\�OiGJ@cW<j R7GJFPm |7� M @cTaB MPWPT7@cW��_G \�RZG FSm @[W_j TZD_G�W<FSU�GVMSX�T7D_G�B MSW;T7RZMPI� MSREm'�_W;TZ@[I FVW_MPW_I[G T5T7GR{@C\{R7GJFSmL| � MV@cXydSM��<R �iIcGaBMSW;T7FS@cW<\

·%�&¤���� �[®A�<±%$

TZD<GsBMSW;TZR7MSI � MPR7m �=®��<±V@[\+TZGJRZU�@[W<F9T7GJm�O;d�T7D_GsG��_B ICFHU�F9T7@cMPW Q MS@[WPT |�v �_T�T7D_@C\+Q<RZG \5GJWPTE\+F Q_R7MSO_I[GU@cX dPM�� � FSWPT^T7MVDiF bSGuF�\5Q<FPB GuF9X T7GR4F�B MPW;TZR7MSI � MSREm | } XydSM!� DiF bSGSkNX MPR{G��_FHU�Q_I[GSkNT7D_Ga\ZGW;TZGJW<B G

·¯��¤���� �[®��<±r�� ��¯���[�V¤!�V�-�-�E���&�%�0¤D�0�w�

@[W dSM��<Ru@cW_Q3� T �<I[GSk TZD_G B MSW;T7RZMPI � MPR7m �[®��[±Y@[\�T7GR7U�@cW<FHTZG mzONdzTZD_G \ZQ<FPB G 8 � D<@[BED @C\k MHX{B M!�_RE\5GPkF W_MSW_I[G TZTZGJRY; | vL� T�TZD_GJWqdPM�� � MSW� T�D<F bSG F \ZQ<FPB G OiGT � GJGW T7D_G � MPR7m<\ �7] ~ � � FHWim �ZFSW<m �3�@[W<\5GJR5T7@cW<j U�MSR7G�\5Q<FPB G \ � MPW% T�D_GI[QLk4\Z@cWiB GY] ~�� m MNGJ\ZW% T m @C\eT7@cW<j��_@C\5DhO G T � GGJWhMSW_Gz\5Q<FPB G�FSW<m\ZGbSGJR7FSILB MPW<\5G B�� T7@cbPG-\ZQ<FSBGJ\J|�vL� Ts@fXdPM���Q�� T)TZD_GVB MSW;T7RZMPIL\5dNU-O MSI ����FHX TZGRsF�B MPWPT7RZMPI � MSREm k<dPM��� @[IcILO MHT7D TZGR7U�@cWiF9TZG�T7D_G-BMSW;TZR7MSI � MSREm FSW<m @cW<\ZGRZT4F�\5QiFSB GP|�} T \{R7GJFHI[I[d GJFP\5d�T7MVX MSR7jSG T{T7M�Q�� T(@[W

Page 14: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW U��DsGT5TZ@[W_j �;TEFHRZTZG m

\ZMSU�G T7D_@cW<j-I[@ �PG ���VF9X TZGJR�F B MPWPT7RZMPI � MSREm | }Q_R7MSU�@[\ZG4dPM���T7D<F9T^dSM!� � @cI[I m M @cT�FHT�I[GJFP\eT�MSW<BG � D_@[I[GdSM!�% RZGsIcG FHR7W_@[W_jVTZM=�<\ZGa] ~�� |

" ~ � GREB @C\ZG UP|�� ?�F��SGuFHW @cW<Q�� T#�<I[GsTZD<FHT � @cI[ILQ_R7M m��<BG)T7D_G�X MSI[I[M � @cW_j�Q<FSR7FSjSREFHQ_D��

}sIc@:�SG�] ~ � � t)WiB G�dSM!�zjPG TuTZD<G�D<FHW_j�MSX�@cTJky] ~ � @C\uR7GJFHI[I[dAGJFS\ZdAT7M?�<\5GP|=�M�� A �<\5T-D<F bPG-T7MU�FS\5TZGJR^TZD_Ga] ~ � W_@CBFSI FS\ZQiG B/TE\|

?AM;\eTsB MSW;T7RZMPI � MPR7m<\(FHR7GuW<FSUVG m�\ZM FS\{T7M�jP@cbPGaF�D_@[WPTsMHX�T7D_G@[R9�<\ZGJ\J|R�M��zBFHW?�i\5G � �&�<� T7MU�F��PG�FVW_G � QiFHREFHjSREFHQ<DLkSX MPR{G��_FHU�Q_I[GSk @[W<\5TZG FSm MHX Q�� T5T7@cW<j�@cWAFVO_ICFHW�� Ic@[W_GS|

���� �� $:������ � .�& � : =s.

] ~ � @[\-bSGJRZdzjSMNM m FHT \ZG T5T7@cW<j�Ted;Q GSkyO��_TaTZD_GJRZG FHR7G�TZD_@[W_jP\uTZD<FHTV] ~ � BFHW� T m_M � GJIcI |At)W<G@C\)U�F��;@[W_j �<j��_R7GJ\J| �NQ<FPB G�BFHWYOiG�I[G X TsTZM @cW<\ZGRZTE�<j��_R7GJ\Jk O�� TsTZD_GJRZG�FHR7G-W<M jPR7FSQ_D_@CBuQ_R7MNBGJm��<RZG \O��_@[IcT-@cW;T7M�TZD_G ICFHW<j��<FSjSG�8 F9T Q_RZG \5GJW;TY;/| �NMSU�G�@[UVQ<IcGJUVGJW;T7F9T7@cMPW<\aFSIcI[M � jPR7FSQ_D_@CB @[W<\5TZR��<B/T7@cMPW<\�T7MO G�@cW<\ZGRZTZG m �i\5@[W_j TZD_G ��� �&�&�-¤=�A��B MSW;T7RZMPI � MPR7mYO�� TuTZD<GJ\ZG�FSRZG�G�� BGQ T7@cMPW<FHIFSW<m m G��<W<@fT7GI[dz\Z@fT7Gm GJQiGJW<m GW;T |

] ~ � \5GT7\�TedNQ G�@[WhD_MSR7@ FJMSW;T7FSI4\eT7R7FS@cjPD;T�I[@[W_GJ\ FSW<m W_MST @cW \5TZREFH@[jSD;T�Ic@[W_G \�F9T MSTZD_GJR�FHW<jSI[GJ\J|} WYQiFHRZTZ@CB��_ICFHR k @fTu@C\)jPGW_GJR7FSIcI[d W_MHT�QiM;\Z\Z@[O_IcG TZM U�F��PG-@[W<\5GJR5T7@cMPW<\s@cW �5ICFHW<m<\ZBJFHQ G-U�M m G �<k TZD<FHTs@C\k� @cTZD TZD_G�T7G��NT4R7MHT7FHTZG m�ONd \ZMVTZD<FHT{TZD_GuOiFS\ZGI[@cW_G�@C\{Q<FSR7FSIcI[GI � @cTZD�TZD<GuIcMPW_j�GJm jPGsMSX T7D_GuQ<FSQiGJRJk MPRTZMA@[W<BI �<m_G�TZG��;TuT7D<F9T D<FS\uFAB��_RZbPG�X MSRaF�O<FP\5GJIc@[W_GP| MyGRE\5Q GJB TZ@[bSGVTedNQiG 8 jSREFSm��iFHI[Icd�@[W<BRZG FS\Z@cW_j�MPRm G B R7GJFS\Z@[W_j @[W�D_G@[jSD;T ;�@C\{W_MST4D<FHWim IcG m � GI[ILONd�] ~�� |

g GD<F bPG\5GJGWsTZD<FHTLTZD<GR7G@[\ FHW��5G m @cTJk ] ~�� kJm R7@cbPGR �^B d B I[GyTZD<FHT @C\LW_G B GJ\7\7FHR7d{X MSRLG FSBEDum @ � GJRZGJW;TB MPQNd MSXM�� T7Q�� TJ|s]^D_@C\(@C\4T7R��<G-GbPGW � D<GWAT7D_G-M!� TZQ��_T�m GJbN@[BGa@[\sF�T7GR7U�@cW<FSI |(} WYQ<FSR5T7@[B��_I[FSRJki@fT \W_MST-QiM;\Z\Z@[O_IcG�T7M�TedNQiG�T7D_G @[W_Q�� T)�<IcG FHW<m \ZGG�TZD<G RZG \C�<IfTE\uMSW TZD<G�\ZBRZGJGW @[UVU�G m @[FHTZGJIcd � @fT7D_M��_TjSMP@cW<j TZD<RZM!�_jSDYTZD_GVX �_I[IB d B I[GS|=�NMSU�GV@cU�Q_I[GU�GJWPTEF9T7@cMPW<\sD<F bSGVOiMSTZDzTZG��;TaFSW<m�jPR7FSQ_D_@CB\sm @[\ZQ_ICF d \� @cTZDYR7GJFP\5MPW<FHO<Icd�HJ�_@[BY� T��_RZWiFHR7M��_W<m 8 F�X G � \ZGJBMSW<m_\(X MSRuF \5@[W_jSI[G-QiFHjSG<; �LFP\)DiFHREm � FSRZGuO GJBMSU�GJ\I[GJ\7\^G�� QiGJW<\Z@cbPG�FSW<m Q_R7MNBGJ\7\5MPR7\+O GJB MPU�G)X FP\eT7GR k � GuU�F d \ZGGu@[U�Q_RZM9bPGU�GW;T |

W

Page 15: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

����������� ����J� �����-� � �����)� � ����� �u��� ��� ��� � � �

� �� 14.�� 3 � $0<$ � :_3 0 8 $0i3 � .�0i3 8--3 � �e$+*-: $�& .: 3 0 8

g G \7F � @cW T7D_G�ICFS\5TV\ZGJB TZ@[MSW T7D<F9TVUVM;\eT TZG��;TV@[\ GW;T7GR7GJm F9T TZD_G�TZGJRZU�@[W<FHI^FS\ \5GJWPT7GW<BGJ\-MHXMSREm @[W<FHR7d � MSREm_\+A �<\eT(FP\ � D_GW TedNQ_@[W_j � @fT7DAF-TedNQ G � R7@fT7GR |vL� T � GaFSI[\ZMV\7F � T7D<F9T k_@[W Q<FSR5T7@[B��_ICFHR kTZD<GaO<FSBY� \ZI[FP\5D�B M!�_ICm O G �<\ZGJm X MPR(F9T4I[GJFP\eT(T � M�m @ � GJRZGJW;T(Q��_R7QiM;\5G \|+} T)BFSW�OiG �i\5G m X MSR(\ZdNU-O MSIC\8 MPR�BMSU O_@cWiF9TZ@[MSWi\MHX \ZdNU-O MSIC\�;�TZD<FHT^m_MSW% T�FSQ_QiG FHR+MSW�T7D_G@�PGdNO MPFHREm�\��<BED�FS\TedNQ_@cW<j �[®��[± TZM jSGT] ~ � |u} TaBFHWzFHIC\5M OiG7�<\ZGJmAT7M jP@cbPG ] ~ � \ZQiG B @CFHIy@[W<\eT7R��iB/TZ@[MSWi\s\��<BEDYFP\4TedNQ_@[W_j �=����� TZM @cWim @[BJF9T7GTZD<G)GJW<m�MHX TZD_Gs@cW<Q�� TL�<IcGP|y} W�jSGJW_GREFHI kPF � MPR7m�\eTEFHRZTZ@[W_j � @cTZD F-O<FSBY� \ZI[FP\5D � @[I[I O G(@[W;TZGJRZQ_R7G T7GJm�ONd] ~ � FS\(MSW_GaR7GHJ�_@[R7@cW_j \ZQ GJB @CFHI F9TZTZGW;T7@cMPWL|(]^D_GJRZG-FSRZGa\ZGbPGREFHILD��_Wim RZG m � MPR7m<\^TZD<FHTs] ~ � �NW_M � \JkFHWimzdPM�� BFSW m_G��<W_G�U�MPRZG�dSM!�_RE\5GJIfXek FSW<m \5M T7D_G O<FPBY�N\ZICFS\ZDY@C\ubSGJRZd�@[U�QiMPR5TEFHW;TJ|�gzG! I[I�\ZQiGJW<m FI[MHT{MHXLT7@cU�GuFS\ � G)Q<RZM B GJGJm�IcG FHR7W_@cW<jV\ZMSU�GsMHXLT7D_GJ\ZG � MPR7m_\�PX MSRZT��_W<FHTZGJIcd � G� IcI MPW_I[d�W_GG m T7M �<\ZG�F\ZU�FSIcI W��_U OiGJR4MHX TZD_GJU U�MP\5T4MHX TZD_G�T7@cU�GP|

]^D_GJRZG�FHR7GT7GW BEDiFHREFSB/T7GRE\ � D_@CBEDLk9I[@ �PGTZD<G+O<FPBY� \5ICFS\ZDLk9FHR7G��<\ZGJm-O;du] ~�� X MPRy\ZQ GJB @CFHI;Q��_R7Q MP\ZGJ\JkFHWim � GuW_M � � FSW;T{TZM�jS@[bSG�T7D_GaB MPU�Q_IcGTZGaI[@C\eT |�ghD<FHT(@fX � G � FSW;T{TZM �<\ZGaF�\5GJW;TZGWiB G � @cTZDAMSW<GuMHX � "$#�%&%')(+, � , TZD<GJ\ZGa\5Q GJB@[FSILBED<FHREFSB TZGRE\+@cW�@cT �Agh@cTZD T7D_@[\4@cW�U�@cWim � G� I[ILFS\���TZD_G�X MPIcI[M � @[W_j H!�<GJ\5TZ@[MSW<\�

8 U ; ghD<FHT(FHR7GsTZD_Gam @ � GR7GW;T4\5Q GJB@[FSI BED<FHREFSB TZGJR7\ �8 p�; �(M � m M � G"�<\5GuF�\ZQiG B @CFHI BED<FSR7FPB/T7GR�@fX � G�R7GJFSIcI[d � FHW;T^TZMVTedNQiG \5GT4@fT4@[W�M��_R^T7G��NT �

�(GR7G�@[\aF TEFHO_I[G MSX�G FSBED \5Q GJB@[FSI�BED<FSR7FPB/TZGJRJk @fTE\uQ��_R7QiM;\5GPk FSW<mzTZD_G�UVGTZD_M m MSX+TedNQ GJ\ZG T5T7@cW<jTZD<Ga\5Q GJB@[FSILBED<FHREFSB TZGR^@cT7\ZGIcX @cXydSM�� W_GJGJm @fT �

N

Page 16: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

� ( � �� �[�*���� �B*�� � � �!�L������*��[� �����L���� �� ( � �� �[�*�� � � ��� 1 � * �D�����y���Z1��Q�����*����� 1 � �����y�

� �NQ GJB@[FSI \5dNU OiMPI[\{FSW<m�@[W<\5TZR��<B/T7@cMPW<\ � �=�&��� ���<�c����� �" t)Q GW�jSR7M��_Q � ��� �$ l+I[MP\ZGsjPRZM!�_Q � ��� �� l+MSU�U�GW;TE\ � �� ] FHO<\{FSW<m T7FHO<IcGuFHI[@[jSW_U�GW;TE\ � �� `4WNO_R7GJF��9FHO_I[Gu\5Q<FPB G �������� �;TEFHRZTZ@[W_j�MSR{GWim @cW<j�U�FHTZD TZG��;T � �� ?�FHTZDA\C�<QiGJR7\7B R7@cQ_T7\ � �����

?�FHTZDA\C�<O<\ZBRZ@[Q TE\ � ���� K)G��<W_@[W_j�R7GQ_ICFSBGU�GW;T4\Zd;U OiMPI[\ � �

� ��� �A>~ 3 8N3 : :+�5&�� ���e: $�& $ � � 3y&^:

r(M � � G� RZG�jPMS@[W_j�TZMz\eTEFHRZT �<\5@[W_jY\ZMSU�G�MSX{] ~ � \ajPM;M m @[GJ\�?�NM�X FHR � G! bPG6A �<\eT OiGJGW��<\Z@cW<j] ~ � TZM U�F��PGuM��_R(M�� T7Q�� T)I[MNM�� F9T5T7R7FPB/T7@cbPGSk_O��_T)W_M � � G! I[I \5T7FSR5T{T7M�m M�T7D_@cW<jP\{T7D<F9TsFHR7Gam @ � B��_IfTMSR-@cU�Q MP\7\5@[O_I[G MSW TZD<G TedNQiG � RZ@cTZGJRJ| } W Q<FSR5T7@[B��_I[FSRJk � G! R7G�jSMP@cW<j�TZM�I[MNM��zFHT-FSBJB GW;TE\uW_M � |?�4M �m M dPM���Q_R7M m��<B GaFSW�FSBJB GW;T � D_GJW�TZD_G \5dNU-O MSI m MNGJ\ZW% T)FHQ_Q GJFSR4MSW T7D_G �SGJdNOiM;FHREm+� K��<\5T(FS\ � @fT7DTZD<G�\5dNU OiMPI�] ~�� k @cT-@[\-W_GJBGJ\7\ZFSRZd�T7M�GW;T7GR-F � MSREmz\5T7FSR5T7@cW<j � @fT7D F�O<FSBY� \ZI[FP\5DL| x_MSRaTZD_G � MSREm�5Q<RZGJUV@"!GJRZG��_k�FS\VF �iR7\5TVG��_FHU�Q_I[GSkdPM�� W<GGJm TZMzTedNQiG�@[W �A���4� ¤ �$#]�[����8 dSM!� U�F d D<F bSG�TZM D��_W;TFHR7M��<W<m TZM��<Wim TZD_G �ZO<FSBY� Q_R7@cU�G � MPR��5jPR7F bPG � \5dNU OiMPI%#�MPWhdSM!�_R �SGJd;O MPFSR7mLk�O3� T�@cT \�TZD<GR7G\ZMSU�G � D_GJRZG * ;/| } W jSGW<GREFHI k T7MzQ3� T�FSW FSBJB GJWPTVMSW F�I[G T5T7GR kyTZD_G�FHQ<Q_RZMPQ_R7@[FHTZG�BMSW;TZR7MSI^\5G HJ�_GW<BGQ_R7GJBGJm G \�TZD_GuI[G TZTZGR |* } XydSM!��D<F bPGsFVbSGJRZd�MPI[m�MSR{MPO<\ZB��_R7G@�PGdNOiM;FHREm FHWim T7D_GuO<FSBY��Q<RZ@[U�Gs@C\'&)(+*�,-, . W_MHT^T7D_GR7GSk dPM��

BFSW �<\ZG �c���/���u@[W<\5TZG FSm |��N@[U�@cICFHR7Icd �[� �/���aBJFHW�O GE�<\5G m�X MPR+T7D_G�\5dNU-O MSI�ª| �M�� BFHW�TZD_@[W�� MSXLTZD<G\Zd;U OiMPI[\sFS\sO G@[W_j�FHO_O_R7GbN@CF9T7@cMPW<\{X MPR �ZIcGX T6HJ�_MSTZG�� FSW<m �ZRZ@[jSD;T@HJ�_MSTZGS| � } WzFPm_m @cTZ@[MSWLk �-�����c���/���FHWim �=� ���[� �0���)jP@cbPG{TZD_G@�<\��<FHIGH!�<MHT7FHTZ@[MSW�U�FHR�� \|yvL� T�T7D_@[\ � MPW% T � MSR�� FS\�FuU�G TZD<MNm�TZMaQ_R7M m��<BGFHW�FSBJB GJWPT{M9bPGR�TZD_G�X MPIcI[M � @[W_j�IcGT5TZGJRJk_\ZM�dSM!�% R7G�RZG FHI[Icd�O G TZTZGJR4M � � @cTZDAFVQ_R7MSQ GR$�PGdNOiM;FHREm |

UP

Page 17: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

�(GR7G�FSRZGu\ZMSU�G�G��_FHU�Q_I[GJ\�

&.-%/ �������y� &.-%/ 1 �y�� � ��$#]�r�c���0�c�-� !FVI[FVU�M m G� ��ª]�&�!�[� �/ª]� R��GJ\��_U��G�[�=� � ��� ���[�� \ZM��_Q

�BMSW

­A� ���!�A� r4M��GI &� ��� ��¤ �<��� W<F � �cbPG

g Ga\5GJGa\5GJbSGJR7FSI Q<RZ@[W<B @[Q_I[GJ\{@[I[I �<\5TZREF9T7GJm ONd T7D_GJ\ZGuG��_FHU�Q_I[GJ\J|�?AM;\eT4FPBB GJW;T7\4FSRZG�Q_R7M m��<B G m�ONd�<\Z@cW<j�F�BMSW;TZR7MSI \ZdNU-O MSI � @cTZDAF�\5@[U�@cICFHR4\ZD<FHQ GS|� X G � MSX T7D_GU FHR7G)Q<RZM m��<BGJm ONd�B MPW;TZR7MSI � MPR7m<\B MPW;T7FH@[W_@[W_j FV\Z@cW_jPIcGsI[G T5T7GR |�NMSU�G�BFSRZG)U)�<\5T{OiG6�<\ZGJm�@cW TZD_@C\^BFP\5GPkPX MPR{F \ZQ<FSBG)U �<\5T�O G6�<\5G m�T7MTZGJRZU�@[W<F9T7GsTZD_G-BMSW;TZR7MSI � MSREm |y} X dPM�� D<F bSG1�[�[� � ���-�[�� �@[W dPM��_RL�<I[GSk_X MSR{G��_FSUVQ<IcGPk<] ~ � � @[IcI IcMNM��X MSR^T7D_GaB MPW;TZR7MSI � MPR7m ���-�=�� , | � "$#�%&%')(��* ��,

r(MHTZ@CB GVT7D<F9T�TZD<GR7G @C\uF BMSW;TZR7MSI � MSREm��&¤ FHIC\5Mi|-]^D_@C\sQ_RZM m��iB GJ\)T7D_G�IcGT5TZGJR��5@ � � @cTZD<M�� T�TZD<Gm MST�M9bPGR�@cT� TZD_@C\uFHI[IcM � \�FSW FPBB GJW;TsT7M�OiG�Q��_TaM9bSGR)TZD<G�IcM � GR�Q<FSR5TuMHX+TZD_G�I[G TZTZGR |�]^D_GR7G�@[\uFSWFHWiFHI[MSjSM!�<\�B MSW;T7RZMPI � MPR7m�����TZD<FHT4Q_RZM m��iB GJ\{F�m MSTZI[GJ\7\ � A � X MSR4FPBBGW;TZ@[W_j�Q��_R7QiM;\5G \|

���!*c�0���?�( �A�����<� 0*d�L�>� *���� �A� *c��� �Z1����51� )*�� 0Z� �f� *c�'� *������� * & - / �L���� � & - / 1 � �����y�jPR7F bPG �$#P� !MFSB�� TZG �/ªP� �M

B@cREB��<U �iG�� � �!� �M�_U�I[F�� T �Hm @cGJRZG \5@C\ � TZR��GJU�FHT ���4� �M

T7@cICm G ���:� �MU�FSBRZMPW �<�-� �M

m MHT ���� �M

, g G� IcI�\ZGG TZD<FHT)T7D_GR7G-@C\�FHW_MSTZD_GJR)U�GTZD_M m � D<GW � G-I[MNM��AF9TsTZD<G jPRZM!�_Q_@[W_j�B MPW<B GJQ T)@[W � GJB �TZ@[MSW�Si|

U�U

Page 18: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

���!*c�0��� �B*�� � � �!�L��� ���%�L�0�*���� *-����� � ����� ��*

���&� * &.-+/ �L���� � &.-%/ 1 �y�� � �B GJm_@cI[I[F ���F�

�M

�_W<m_GREm MHT �<� � M |�_W<m GJRZOiFHR �=�V� M

�D �F��B G� �[� � �MO_R7GbPG �=�V� �MT7@cG �[� �-� �MPM

�#�_W<jPFHR7@CFHW �<UVICF��_T � ¹ � �M

] ~ � FHIC\5M�FHI[I[M � \�\ZMSU�G�I[G T5T7GRE\�X RZMPU ICFHW_j!�<FHjPGJ\+MHT7D_GR^T7D<FHWA~W<jSI[@[\ZD�T7M�OiG�TedNQ GJ\ZG TJ|

� ����� ��0/� * �Z1��B*-� ���F� ��� � � �/�G* �T� � 0 1_� �-�� �&� ���5* & - / �L���� � & - / 1 � �����y�

�jPGJFHW k�{\eT7D_G T7@[BJ\ � � °� �<�-� k�� �<b;R7GJ\Jk D_MPR7\{m. "�_bNR7G � ¨ °��c�-� � k�

��4W_j;\eT7RZMPU � � � � �<�-� ��-k �F� R7GSk�>��HO GW_DiF b;W � ¨ � �<� � k���� M m�FSk �I �MPm�� F � » � �c� ��k �I

r9��� ���c� �� �N@ � �$# �� �N@ � $�# �� G �W_MPR ��� �

� ��¤!� � ��� �

]+dNQiG \5GT�T7D_Ga\ZGW;TZGJW<B Gu@[W�GJFSBED MHX TZD_G�X MPIcI[M � @[W_j G�� GREB @C\5G \��

" ~ � GREB @C\ZG�p_| U K)M;G \�A\7BED;dNI:�<\L�_W<m GJR7\5T7FSW<m � m @cQ3�<\ �

" ~ � GREB @C\ZG�p_| p ]^D_Ga\ZU�FHI[IcG \eT{@[WPT7GR7W<FHI.�<W_@fT4MSXy] ~ � @[\(FHO M�� T9OHo<| QPo ��-|

" ~ � GREB @C\ZG�p_| o ]^D_GJd TZMNM!��\5MPU�GsD<MSW_GJd�FHW<m Q_I[GW;Ted�MSX U�MSW<Gd � REFHQ<QiG m �_Q�@[WAF��#O W_MSTZGS|

U p

Page 19: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

" ~ � GREB @C\ZG�p_| S �~I"!GJbSGJ\JkNRZGX �<\ZG�F�bSM;\+I[G�BMSW<\� KSGTZGFubSMP\^BED<F � �[W_GJ\�

" ~ � GREB @C\ZG�p_| O � F �\eT7M-TEF��PM Q MSICF��PM Q_@ AeG T7G �BF�A�

" ~ � GREB @C\ZG�p_| Q ?AGJ@cWA] GGu@C\eT{D_GJ@ �i|

" ~ � GREB @C\ZG�p_|�� MyG��_TC� �G T7RZG6HJ�% @[ILQ_R��GX !GR7G4I[GaBF9X �G)jPI[FPB �GP|

" ~ � GREB @C\ZG�p_| W � MyMSR$HJ� �G�W_M�O GO GJ\{bN@[W_M�O_I[FSW<B M � � MyMSRYH!�<G)G \eT��FVF bN@[W<FHjPR7FPm M3�

" ~ � GREB @C\ZG�p_| N ? �� �� W @[m_GG �GW � MSREm GJW W_@[G T4O G � �cWNbNIcMNG m |

" ~ � GREB @C\ZG�p_| U P#l�FSW dPM�� T7F��SGuF X GR7RZd�X R7MSU �t)I[FSW<m T7M ��4ICFHW<m0�

" ~ � GREB @C\ZG�p_| U!U ] ��<R���B G6�PMSW��

�\7FHW�dPG �jPGW_I[GR^W<FP\5@[IcICFHR&�

� ��� .:<80�u=s$�8 3 80���{'s.:_3y80� �����]+dNQ_@cW<jYD<FP\ FSI � F d \aO GGW FYBMSU�Q_R7MSU�@[\ZG���T7D_G�\5U�FHI[I�WJ�<U-O GRVMHX9�PGd \ 8 B MSU�Q<FSRZG m TZMzTZD<G

W��_U-O GR MHXNTedNQiG \5GT \ZdNU-O MSIC\ F b9FH@[I[FSO_I[G ; D<FP\ X MSREB G mu\5MPU�G�BED<FHW<jSGJ\LMSW�TZD<G�TedNQ_@[\5TJ| ghD_GJWaQ_R7GQ<FSRZ@[W_jU�F9T7GR7@[FSI%�<\Z@cW_j ] ~ � kiTZD<GR7Ga@[\(W_M W_GJGJm T7M OiGV\5M�R7GJ\5TZR7@CB/TZG m |^} WATZD<@[\)\5G B/TZ@[MSW � G� I[I I[M;M!� FHT)\ZMSU�Gm @ � GJRZGJW<B G \^OiGT � GJGW TedNQ_@[W_j�FHW<m �<\Z@cW<j�] ~ � |

]^D_GJRZGuFSRZG)X M��_R�TedNQ GJ\^MHX�m_FP\5D_G \+TZD<FHT{FSRZGE�<\ZGJm |]^D<GsDNdNQ_D_GJW @C\R�<\ZGJm�X MSR4BMSU-O<@cW_@[W_j � MPR7m<\@[WPT7M MPW_G7�_W_@cTuFP\ � @cTZD U�MHT7D_GR�� @[W�� I[F � | ]^D_G�GW�� m_FP\5D�@C\E�<\ZGJmYTZM @cW<m_@[BJF9TZG�F \5G H!�<GW<BG MSX�Q<FHjPG �! !"$#�%&%')(+,���W��_U-O GRE\Jk dSGJFSR7\)MSR�\��<BED�T7D_@cW<jP\J| ]^D_GVGU7� m_FS\ZDY@C\�F�jPR7FSUVU�FHTZ@CBFHIy\Zd;U OiMPI | ]^D_G�UV@[W��<\�\5@[jSWz@[\�<\ZGJm X MSR{W<GjPFHTZ@[bSGsW��_U-O GRE\| �(GR7G�TZD_GJd FHR7G � @fT7D T7D_G@[R#�<\ZGJ\�

UJo

Page 20: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

�Q���*��B*-�0�M�]� � * � 1 � � �/�( *��

����� * & - / ����� � � & - / 1 � �����y� -�� ��� ���5*DNd;Q<D_GW � � ]^D_Ga\ZQ<FSBG)@C\4oB� m @[U�GW<\Z@cMPW<FHI |GJW�� m_FS\ZD � � � n{GJFPm�QiFHjSG \{o���S<|GJU � m_FP\5D � ��� � }�\7F � T7D_GU�� TZD_GJRZG � GR7Guo U�GJW�FSIc@[bSGP|UV@[W��<\4\Z@cjPW � � � - ]^D<G�TZGU�Q GREF9T��_RZGum R7MSQ<QiG m T7M - oVm_GjSR7GG \|

" ~�� GREB @C\5G p_| U p }-GW;TZGJRZG m TZD_G RZMNMPU�FSW<m��hD_MSR7R7MSRE\��h})\7F � OiMSTZD U d X F9TZD<GR�� @[W�� I[F � FHWim U-dU�MHT7D_GR�� @[W�� I[F � |

" ~ � GREB @C\ZG�p_| U o ]^D<G � @[W;TZGJR4MHXLU�S!W�S�VU�S!WJO � FS\�MSW_G�MSXym @C\7B MSW;T7GW;TJ|

�(W_MHT7D_GR�m @�� GR7GWiB G{O G T � GGW�TedNQ_@[W_j-FSW<m7�<\Z@cW_j ] ~ � @C\�T7D_G#�<\ZG4MHX%HJ�_MST7F9T7@cMPW�U�FSR�� \J|yt)Q GW��@[W_j�FHWimAB I[MP\Z@cW_j'HJ�_MST7FHTZ@[MSWAU�FHR�� \4FHR7G�TZD_G \ZFSUVG-MSW�F�TedNQ G � R7@fT7GR |^]^D<Gd�FHR7GuQ_RZM m��iB GJm�@[W�] ~ �ONd �i\5@[W_j T7D_G FSQiM;\eT7RZMPQ_D_GaMPR4Q_R7@cU�G �SGd¯ª)FHW<m�OiFSBY�NQ_R7@cU�G �PGd # |)�4W�MPQiGJW HJ�_MHT7G-@C\4Q_R7M m��<B G mONd # #(FHWim TZD_G�B I[MP\ZG)HJ�_MHT7GaONdrªcª|@� @cU�@[I[FSRZI[d�T7D_G-MPQiGJW_@[W_j \Z@cW<jSI[G)HJ�_MHT7G-@C\(Q_R7M m��<BGJm�ONd #4FSW<m �! !"$#�%&%')(+,TZD<G)B I[MP\Z@[W_ja\5@[W_jPIcG9HJ�_MSTZG)O;d>ª| r(MHT7@[BG4TZDiF9TT7D_GR7G(@C\W_M-W_GG m�TZM �i\5G(TZD_G#�i\C�<FSI<TedNQ_@[W_j)HJ�_MST7FHTZ@[MSWU�FHR�� 8 @cT4W_MPRZU�FHI[I[d�jS@[bSGJ\{F�BIcM;\5G"HJ�_MHT7GSk O��_T(m MSW% T(B M!�_W;T4MSW @fT ;/|

" ~ � GREB @C\ZG�p_| US �(@[\ �eTZD<M��_jPDPTZX �_I[W_GJ\7\ � � FS\^@[UVQ<RZG \Z\Z@cbPGS|

" ~ � GREB @C\ZG�p_| U<O x<R7FSW�� � MSW<m_GR7GJm k��5}e\�T7D_@C\4FVjS@[RZI T7D<F9T(BJFHW% T(\ZF d� r4M � ���

�NMPU�G TZ@[U�GJ\sGI[I[@cQ<\ZGJ\78 T7D_R7GG�m MHTE\�;)FHR7G)�<\ZGJm�TZM @cWim @[BJF9T7GVF�Q<FS\7\ZFSjSGaMSXTZ@[U�G MPR)U�@C\Z\Z@[W_j U�F��TZGJRZ@CFHI |^]�dNQ_@[W_j�TZD<RZGJGaQiGJRZ@[M m_\ � @[IcI jS@[bSG�T7D_RZGJG-m MST7\{bPGR7d B I[MP\ZG�TZMPjSGTZD_GJRJ|�]^D_G-m MST7\ � @cTZDAQ<RZMPQiGJR\ZQ<FSB@cW_j � @[IcI O GuQ_R7M m��<B G m O;d�D<F bN@cW_j �<�A�<�_�u@[W�dSM��<R�@[W_Q��_T#�<I[GS| � "$#�%&%')( 4 ,

" ~ � GREB @C\5G�p |:UQ �4G TZD<M��_jPDPT k �������5FSW<m T7D_@C\�jSMNGJ\ MSW X MSR7GbSGJRJk�Q GR7D<FSQ<\ TZMzTZD_G�ICFS\5TVR7GJBMSREm GJm\Zd;I[ICFHO_I[GS| �

�(W_MHT7D_GRsQ_R7MSO_I[GU � @cTZDzm_MHT7\)@C\4T7D<F9TsTZD_G QiGJRZ@[M mYFHX TZGR�FHWzFHO_O_R7GbN@CF9T7@cMPWAW_MSR7U�FHI[Icd D<FS\)I[GJ\7\\ZQ<FSBGVFHX TZGR�@cT)T7D<FHW m MNGJ\)T7D_G�QiGJRZ@[M mYF9TsTZD<GVGJW<m�MSX�F \5GJW;TZGWiB GS|a]^D<GR7GVFSRZG T � M � F d \(TZM�\5MPIcbPG

U�S

Page 21: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

TZD<@[\�Q_R7MSO_I[GU�� TZD<Gsm MST^BJFHW OiG)X MSI[IcM � GJm O;d�GJ@fT7D_GR���� MSR ��TZM�BED<FHW_jPG4T7D_Gs\ZQ<FPB @[W_j<| ]^D_G�\ZGJB MPW<m � "$#�%&%')(�� 4 ���*FHIcTZGJRZWiF9TZ@[bSG � @cI[I jP@cbPG-FHW?�<W;O<RZG F��9FHO_I[G-\ZQ<FSBG�� � D_GWz\C�<BEDzF \5QiFSB G-@[\)OiGT � GJGWAT � M � MSREm_\Jk_TZD<GJ\ZG� MSREm_\U �<\eT+TedNQiG \5GT+MSW�T7D_G�\ZFSUVG(Ic@[W_GS|�]^D_G)@cW<Q�� T ¸ ���c��� ���� -�A��� � M��<I[m BJF��<\ZG{T7D_MP\ZG{T � M � MPR7m<\TZM�O GuTedNQ GJ\ZG T(MPW MPW_GuI[@cW_GP|�]^D<@[\{@C\(m_GJ\Z@cREFHO_I[GsX MSR4WiFHU�GJ\{I[@:�SG �FHWiB M��<bSGR k<vs| l)| FHW<m�?AR |3KPMSW_G \\ZM T7D<F9T �Z?AR | � FHWim ��KSMPW_GJ\ � m MAW_MHTaGJW<m �_Q MSW \ZGQ<FSR7FHTZG�Ic@[W_G \|�r(MHT7@[BG�TZD<FHTaW_MAO<FSBY� \ZI[FP\5Dz@[\�<\ZGJm � @cTZD TZD_G"�<W;O<RZG F��9FHO_I[G�\5Q<FPB GP|

" ~ � GREB @C\ZG�p_| U � �)F bSGsdSM!� \ZGGJW�?Y\|�KPMSW_G \ �

" ~ � GJR7B@[\ZG4p |:UW MR7MHXe|!�NU�@cTZD FSW<m�K(R |JDsMPI[m �<G � X R7MSU �|S�-|HT7Mag FP\5D<@cW_jSTZMPWLkSK |Nl)|[kPbN@CFux<FHR7jSMikra|iK-|

� ��� � ��� 3 0<3y&^: ,/.�&^:<8

]^D_G�U�MP\5T^MSONbN@cM!�<\^m @�� GR7GWiB G�OiGT � GJGW�Ted;Q G � R7@cT5TZGJW TZG��NT4FHWim�] ~ � M!� TZQ3� T{@[\R�_Wim M��_O_TZGJm_IcdTZD<G�m_@�� GR7GW;T^X MSW;T7\^MPR�Ted;Q GJ\�MSX \Zd;U OiMPI[\L�<\ZGJmL|�ghD_GW�] ~ � \5T7FHRZT7\L�_Q�@cT{D<FS\^\Z@ �NTZGJGW X MSW;T7\^F b9FH@[I �FHO<IcGP|$� MSU�GaMHXyT7D_GJ\ZG-FHR7G"�<\ZGJm X MPR4TZG BED_W_@CBFSILQ��_R7QiM;\5G \kiO�� TsGbSGJWA\5M�T7D_GR7G-FSRZGa\ZGbPGREFHILm @ � GJRZGJW;TTedNQiGX FSBGJ\�F b9FH@[I[FSO_IcG FS\�BFSW O GA\5GJGW @cW TZD_G X MSI[I[M � @cW_jzT7FSO_I[GS| � B MPU�Q_IcGTZG�I[@[\5T�MHX4T7D_GA\5@ �NTZGGJWX MSW;TE\u@[\ajS@[bSGW @[W �4Q_Q GW<m_@ � x MSXR&)(+* & - /'0 1%132�| ?�MP\5TaMHX^TZD_GJU FSRZG=�<\ZGJm F�� TZMPU�FHTZ@CBFSIcI[dV� � "$#�%&%')(�� * � � ,*F�U�F9T7D_GU�FHTZ@CBFHI \C�<O<\ZBRZ@[Q T k<X MPR(G��_FSUVQ<IcGPk<@C\4Q�� T�@[W�\5U�FHI[I[GR4TedNQ GaONd ] ~ � � @cTZDAW<M \ZQiG B @CFHI��i\5GJR@[WPT7GR7bSGJWPT7@cMPWL|

] M BED<FHW_jPG X RZMPU TZD_G?�i\C�<FSI)8 R7MSU�FSW ;-Ted;Q G X FPB G TZM @cT7FSIc@CBHk+TZD<G�B MSW;T7RZMPI � MSREm ��¤!� @C\ �<\ZGJm |] MYBED<FHW<jSG O<FPBY��T7M�TZD<G �<\��<FHI+RZMPU�FHW TedNQiGX FSBGSk��<\ZG �[�:� |�x<MSR-G��_FHU�Q_I[GSkydSM!� B M��<I[m D<F bPG�TZD<GX MSI[I[M � @cW_jA\ZGW;TZGJW<B G!�M·r�:���<�c���c� �Z¤4���r���!�0�� r��� �&�X� �&¤!�7� �Z¤4�����&�c� ���7¤4���A�&¤c�>��� �&�X� �[�:��� ��%���[�c�A�� &�<�F���F���!�0�� r��� �&�i|]^D_@C\ � M��_ICm jS@[bSG�TZD<G�X MSI[IcM � @[W_j3��}�\5T7FSR5T7GJm � @fT7DARZMPU�FHW Ted;Q GSk��� ����� (�� ���� � *�, ���� .���(�� � FHWim R7G T��_R7W_GJm�TZM�R7MSU�FHW TedNQiGP|

]+dNQiGX FSB G \aMSTZD_GJR-T7D<FHW @cT7FSIc@CB�FSRZG FSI[\ZMYF b9FH@[ICFHO_I[GS|Y]^D<MP\ZG jS@[bSGJW OiGJIcM � FSRZG�T7D_G�MPW_GJ\-U�MP\5TB MPU�UVMPW_I[d?�<\5G m | ]^D<GdYFSRZGVF b FS@cICFHO<IcGV@cU�U�GJm_@[FHTZGI[d � D_GJW ] ~ � \5T7FSR5TE\|V� Ic@cT5T7IcG�ICF9TZGJR � G! I[I�\5GJGD_M � TZM=�<\ZGuMHTZD<GR^TedNQiGX FSBGJ\�TZDiF9T(FHR7GW� T4F b9FH@[I[FSO_I[G � D_GJWA] ~�� \5T7FHRZT7\J|��� ������ ( � � * ����� ( ���! � * *!"#� ���$%�'&��(�!� " ��� ( *�& ( " � *�, ��)� .���(� *!"#� ���$%� , ���(*�� * , ��� , ( &�+ ","�..-

/ (�0 ,-, � (+( � � * �1� � ( &)( %� *�" ����� (�& ( � ��� � &�� & ��� *!"32 "32 &�� " ���4�5� (6" � ( � *�, * *.7 ��+8� 2�& ��+ � "32 "9 ( �6�:�� "<;#-

U O

Page 22: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

��1��0��� �&� ���5*��

��1��0��� ��� * & - / � ?�5���<( �*�� � *c� ��* � �&� ���5*�1 �i�*� �*�� � �!*n{MPU�FHW �[�=� ]^D_@C\{@C\{R7MSU�FHW�Ted;Q GS|v�MSICmNX FPB G �=��� & ( � �?� �701�� � � � ��*8�*� �*��} TEFHI[@[B �&¤!� � �8%�)%� � *�, �� � .���((-�NICFHW;T7GJm ���<� �������v�6�~�P"C9: 0�g�!+Q�6#<./�:I]�dNQ G � R7@fT7GR �[�-� ®��Z¤<� ¤<�E��� �&���A�0¤4���<�E��� �&�w�?YF9TZDA\ZdNU-O MSI � �A�[�A� ����� �� �������� ������������(|

]^D_GV\5ICFHW;T7GJmAFHWim�@fTEFHI[@[BaX MSW;T7\)\5GJGU HJ�_@fT7G \Z@cU�@[I[FSR)FHT#�<RE\eT |4} T)@C\(G FS\Zd T7M \ZGGuT7D_G m @ � GR7GW<BGO G T � GGW T7D_G I[G T5T7GR �ZF�� @[W GJFPBED \7FHU�Q_I[GS| ghD_GW BEDiFHW_jP@cW_j X R7MSU FA\5ICFHW;TZG m MSRa@cT7FSIc@CB�X MSW;TuT7M�FR7MSU�FHWzX MSW;TJk TZD<G I[FP\eTaI[G TZTZGJRa@cW T7D_G �<RE\eTuX MPW;T � @cI[I�I[GJFSWzT7M � FSR7m<\(T7D_G �<RE\5TaIcGT5TZGJRaMHX�TZD<G RZMPU�FHWX MSW;T �NTZD_@C\{I[M;M!� \�BR7FSU�QiG m k_FHW<m�TZM BMSU�Q GW<\7F9T7G(T7D_GR7G�@[\4F I[@fTZTZI[GuG��NTZREF�\5Q<FPB G)TZD<FHT(BFSW O GuFSm_m G mBFSIcI[GJm T7D_G �U�U9="Y�L3 3D� B]B �!3T�L�C�: L| ]^D<@[\ @[\ m MSW<G �<\Z@cW<jATZD_G B MPWPT7RZMPI�\Zd;U OiMPI � ¦ | } W T7D_G X MPIcI[M � @[W_j\ZGW;TZGJW<B GPk T7D_GR7G�@C\aW<MY@cT7FHI[@CB B MPRZR7GJB TZ@[MSW F9X T7GR TZD_G �<R7\5T \ZGHJ�_GJW<B G MHX{@fTEFHI[@[B�IcGT5T7GRE\aO�� TVTZD<GR7G @[\F9X T7GR(TZD_GV\5G B MSWimA\5G H!�<GW<BG�� \5GJGuTZD_GVm @ � GJRZGJW<B G!��� & TZD_G @fTEFHI[@[BaBMSR7RZG B/T7@cMPW @C\)W_MHT9�i\5G m TZD_G IcGT5TZGJR7\FHR7G)TZMNMVBIcM;\5G)TZMPjSGTZD_GJRJkNO�� T & T7D_GuB MSR7R7GJB/T7@cMPW @C\R�<\5G m kNTZD<G�\ZQ<FPB @[W_j-@C\^OiGT5T7GR |]^D_GR7G)@C\^W_MVW_GG mX MSR+TZD<G)@cT7FSIc@CB(BMSR7RZG B/TZ@[MSW � D<GW�T7D_G)@cT7FSIc@CB(BEDiFHREFSB/T7GRE\�FSRZG{X MPIcI[M � GJm�ONd�F-B MPU�U�F-MSR^FaQ GR7@cM m k;O�� TdSM!�_R�TZG��;T � @[I[I m G��iW_@fT7GI[d�I[MNM�� O G TZTZGR(@fXydSM!� �<\ZG�@fT4O G X MPRZG HJ�_MST7FHTZ@[MSW U�FSR�� \�MSR{QiFHR7GW;TZD_G \5G \|

} T@C\yQiM;\Z\Z@[O_IcG�T7ME�i\5G�X MSW;TE\yMHTZD<GR TZD<FSWVTZD_M;\5G^@[W_@fT7@[FSIcI[d-m G��<W_G m-@[W�] ~ � � D_GJWVm G \5@[R7GJm 8 FS\7\��_U7�@[W_jaT7D<F9T�TZD_GJd�FHR7G(F b9FH@[I[FSO_IcG(MSW dPM��_R�B MSU�Q��_TZGR^\ZdN\5TZGJU�k;MSX B M!�_R7\ZG ; | K)@ � GJRZGJWPT{\Z@ FJGJ\�BFHW�O GE�<\5G m� @cTZD�TZD<GaFH@Cm MSX T7D_G-BMSW;TZR7MSI � MSREm��4�0�����!��� � | ] M m G��<W_GudSM!�_R{W_G � X MPWPT4dPM�� � @[IcILDiF bSGsTZM �NW_M �@cT7\4WiFHU�GuMSWAdPM��_R4BMSU�Q�� T7GR(\Zd \eT7GU�|�x<MSR4G��_FHU�Q_I[GSk T7D_GaR7MSU�FHW TedNQiGX FSBGu@[\)BFHI[I[GJm �ZBUVR UP��-MPWU�MP\5T�\Zd \eT7GU�\J| } X(dSM!� �<\ZG �<�A�� A���=�Z¤ �-�:� ���'�_� ¢!¥ �c�[�A�c�c� �T�0�����:�A� � ¢PkdPM�� BJFHW T7D_GW �<\ZG�=�Z¤��-�=� @cW�G�� FPB/T7Icd�T7D_Ga\7FHU�G � F d FP\^dSM�� �<\ZG �&¤4��MPR��[�:� | � "$#�%&%')( 4 , � 4

� � @cT7BED<@cW_jhbN@CF �:�Z¤ �-�=� � @[I[IajS@[bSG R7MSU�FHWqTedNQiG T7D<F9T�@C\�I[FSRZjPGR TZDiFHW TZD_G��i\C�<FSIuONd p�P � |�<�A�� A� �=�Z¤��c�Z¤ �-�:�r���'�_� ¢4¥ �-�[�A�c�<���T�0�����:�A� �r� � @[I[I m G��iW_GaFVX MSW;T{TZDiF9T4@C\4FHO M�� T#S!S � ICFHR7jSGJRTZDiFHW T7D_G �<\��<FSI+R7MSU�FHW TedNQ G X FSBGS| ]^D_G \Z@ FJGJ\ �T�0�����:�A� �r¥YTZM��4�0�����!��� �  zFHR7G�F b9FH@[I[FSO_IcGP|zt)WU�MP\5TVBMSU�Q�� T7GRE\ �4�0���_�:��� �����A�<� @[\VFHIC\ZMzF b9FH@[I[FSO_I[G��yTZD<@[\VR7GQ_R7GJ\ZGW;T7\ FHW GJW_ICFHR7jSGU�GJWPT MHX(FHO M��_TN_|TO � | �4GJRZGuFSRZGu\ZMSU�Gu\ZFSUVQ<IcG \{F9T4b9FHR7@cM!�<\^\5@:FG \��

� ]^D_@C\sG��_FHU�Q_I[G-@C\�BED_GJFHTZ@[W_j \Z@[W<B G dSM��YW_GG mATZM �NW_M � F I[@cT5TZI[G�FHO M�� T�U�F9TZD<GU�F9T7@[BJ\)@[W_Q��_T)T7M�<\ZG)@cTJkNO��_T�} � FHW;T7GJm�T7M @[W<B I:�<m Gs@cT^FSW;d � F dS|��M��% IcI O GsFSO_I[G4TZM7�<\ZG(T7D_GJ\ZG(I[G TZTZGJR7\^F9X T7GR�dSM!��\eT��<m dTZD<G"�<\5G�MSX U�F9T7D_GU�FHTZ@CBFHIL\ZdNU-O MSIC\|

UQ

Page 23: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

�Q���*��B*-�0� �+1_�0��� �/�����������A�4� 1����� �/��� ��� ���A�T�51_� � ��� �/� *�T�0�����:�A� � ¥ � FSU�Q_IcGsT7G��NT(F9T4U�FHj;\eT7GQ�P_|�T�0�����:�A� ���&�A�[� ������ ������������������������������� ��! �T�0�����:�A� � ¢ "$#�%'&)(+*-,�*/.$,0#�,0%1#�2435,�*6&8749�T�0�����:�A� � � :<;>=@?�A!BDCEBGFHCI;JCK=L;NMPOCEBQ?SR<T�T�0�����:�A� � UWVYX[Z]\�^`_a^Hbc_dV�_eXfV�gih)_a^jZ kml�T�0�����:�A� �¯£ nporq sutwv xyv{z8x o|x q o'}�~jx�vcs �u��T�0�����:�A� �   ����� ���J� �|���S� ��� � �L�e�m�|�D� ���} T \�FSI[\ZM�QiM;\Z\Z@[O_IcG4TZM"�<\ZG(B MPU�Q_IcGTZGJIcd W_G � TedNQiGX FSBGJ\J| ]^D_G \5G)FHR7G^m_GQ GW<m GJW;T+MSW�\Zd \eT7GU F b FS@cICFHO<@cI �@cTedSk MHX�BM��_RE\5GP|)?�FSWNd�\Zd \eT7GU�\4DiF bSG-F'�<IcG�BFSIcI[GJm l�? ���VU P � D_@CBEDY@C\)F X MSW;T(T7D<F9TuB MPWPTEFH@[W<\(\7FHWi\\ZGR7@fX�I[G TZTZGJR7\J|-`(\Z@[W_j �<�A�� A�����=�F���'�y�-��¢!¥ � @cI[IFHI[I[M � TZD_G�B MPW;TZR7MSI � MPR7m ���=� TZM OiG=�<\ZGJmY@cWzTZD<G\7FHU�G�U�FSW_W_GJR4FS\��=���i| �)F b;@[W_jVU�FSm G�T7D_@[\(m G��<W<@fT7@cMPWLk TZD<Gu@cW_Q3� T

���:� ¹ �<���V¤c�F���[�4� �_�c�%�c� �[�A� &� � ³ �� 0� ³ �<�0¤:�%�-�� A�H�

� @[IcILQ<RZM m��<BG �Q�/����� �����!�6���6� �j�¡ G�E¢£�a¤¥�§¦r¨��6¤¥�©¨��/���  Q ���¤¥ª§«" ~��NGJR7B@[\ZG4p |:UN ghD<FHT�Q_R7MSO_I[GU UV@[jSD;T�DiF bSG4FHR7@C\5GJWV@cX � G(D<FSm=�<\ZGJm ���-�)@[W<\5TZG FSmVMHX ���=�uTZMaT��_R7WMSWYTZD_G'� FSW<\ �NGJRZ@cXX MSW;T&� �(@cW;T �)@cX�T7D_G�FHW<\ � GJRum MNGJ\ZW% T�M BB��_RsTZM�dSM!�zF9TE�<RE\eT k TZD<@cW��zFHO M�� T�TZD<GDsGR7U�FHW�FHI[Q_D<FSOiGT(FHW<m @fT � @[I[I.�<W<FSIcI[d�B MPU�G)T7M�dSM!�L|

" ~ � GREB @C\ZG�p_| p�P ]+dNQiG \5GT4F QiFHREFHjSREFHQ<D�MHX U�FHjSW<@ �<G m \7FHWi\{\5GJRZ@cX T7G��NTJ|

]^D_G�G��;T7R7F X MPWPTE\uF b9FH@[I[FSO_IcG U�F d�b9FHR7d�X RZMPU \5@cTZGVT7M�\Z@cTZGS|�]^D_G�MPW_GJ\�@[WYT7D_G�X MSI[I[M � @cW_j T7FSO_I[GFHR7GuF b9FH@[I[FSO_IcG�F9T{U�MP\5T4Q_ICFSBGJ\J|

U �

Page 24: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�p���4I[I BED<FSR7FPB/TZGJR7\+jSR7GJFHT4FHW<m \5U�FSIcI

-�� � *��!� ������1��0�� ���&� *��

²�� ©�³ � ¢!¥ ²�� © ± ³c» ¢4¥ ²�� © ±-®0·A¢!¥ ²�� © ± ¢4¥ ²�� © ± ¢!� ²�� © ±� ²�� © ±�¡ ²�� © ± � ²�� © ± � ²�� © ±�� ²�� © ¢!¥ ²��-² ³ ²Z¢!¥²��-´[¬�­ ¹ ¢!¥ ²��c°-± ¢!¥ ²������ ¢!¥ ²����0· © � ²�����·�¢!¥ ²���·!®-® ¢!¥²�� ��· © ¢!¥ ²����0·�¢!¥ ²�� �0·�¢!� ²�� �0·=  ²�� ��·=¡ ²����0· �²�� ��· � ²����0· � ²��-« ¢!¥ ²��-« ¢!� ²��-«Z¢ � ²��c«� ²��-«A¡ ²��c« � ²��-« � ²��-«�� ²�� ³<» ®-® ¢!¥ ²�� ³c» ¢!¥²�� ³<» ¢!� ²�� ³c» � ²�� ³c» � ²�� ³-³[© ± ¢!¥ ²�� ³c³ ´A²Z¢!¥ ²�� ³-³ ·�¢!¥²�� ³c³ ·�¢!� ²�� ³-³ ·�¢ � ²�� ³-³ · � ²�� ³-³ · � ²�� ³c³�� · � ²�� ³-³�� �²�� ³c³ ¢!¥ ²�� ³-³ ¢!� ²�� ³-³ ¢ � ²�� ³-³ � ²�� ³c³ � ²�� ³ � ¢!¥²�� ³ �   ²�� ³ � ¡ ²�� ³ � � ²�� ³ � � ²�� ³ � � ²��c®A² ³ ²Z¢4¥²��-®c°-± ¢!¥ ²��c®-°-± � ²��-®-°-±�� ²��-®0·�¢4¥ ²��-®�·�¢!� ²��c®0· �²��-®�· � ²��c®0· � ²��-®-® ¢!¥ ²��-®-® ¢4� ²��-®c® � ²��c®-®��²��<¬y¢!¥ ²��cº-®-® ¢!¥

�4GJRZG! \�F Ic@cT5T7IcGsO<FSBY�NjPRZM!�_W<m�FHO M��_T+T7D_GJ\ZG)WiFHU�GJ\J|�]^D_G9�iR7\5T+T � M-I[G TZTZGJR7\H²�� \eTEFHW<m_\�X MSR4l+MSU�Q��_TZGR?AM m GJRZWLk_TZD_GaWiFHU�GujS@[bSGJW�T7M�TZD_@C\{X MPWPT{X FSU�@cI[d�ONd T7D_G-m G \5@[jSW<GR |]^D_GaW��_U-O GR)F9T{TZD<GuGW<m�@C\^TZD<GQ MS@[WPT(\Z@:FG��RU P Q MS@[W;T^Ted;Q Gu@C\�TZD_GuW_MPRZU�FSIL\5@:FGPk �aQ MS@[W;T4@[\�T7D_GuW_MPRZU�FHI \Z@ FJGsX MSR4\��_O<\7B R7@cQ TE\k_FSW<m�OQ MS@[WPT�@C\(T7D_GVW_MSR7U�FHIy\5@:FG-X MSR�\C�_Oi\ZBRZ@[Q T7\sMSX�\C�_Oi\ZBRZ@[Q T7\Jk�U p QiMP@cW;T�@[\up�P � I[FSRZjPGR4T7D<FHW UP�QiMP@cW;TJkG TEBH|�} X TZD_GuI[G TZTZGRE\i²�� FHR7G(X MPIcI[M � GJm ONd © k @cT{@[\{FVO MSICmNX FSBG)TedNQ GS|�N@[U�@cICFHR7I[d�«�@cWim @[BJF9T7GJ\^R7MSU�FHWLk0·@C\4X MPR)@cT7FSIc@CB\Jk�² ³ ² @[\(X MSR�\5U�FSIcIyBFSQ<\k ³c» @C\)X MSRs\5ICFHW;TZG m k ³-³ @C\4X MPRs\7FHWi\(\ZGR7@fXek ³ � @C\(X MSR�\5dNU-O MSIC\JkFHWim ®-® @C\^X MSR^TedNQ G � R7@fT7GR^TedNQ GS|

" ~��NGJR7B@[\ZGap | p�U x @cWim�TZD_GaX MSW;T7\)F b FS@cICFHO<IcGuMPWAdSM��<R(\5d \5TZGJU k FHWim�Q_RZ@[W;T(M��_T)FHI[ILT7D_GaI[G T5T7GRE\(FSW<mW��_U-O GRE\^@[W�\ZGbPGREFHI MHX TZD_GJU�|

" ~ � GREB @C\5G�p | pSp ]^D_G X MSW;T�²��-«Z¢!�Y@[\ p�P � ICFHR7jSGJR-T7D<FHWF²��c« ¢!¥i| �4IC\5M �4�0�����:��� �7¢AU�FSjSW_@ �<G \TZD<G TedNQ G�O;d p�P � | ] F��PG \ZMSU�G TZG��;T FSW<m Q_R7@[WPT�@cT �<\5@[W_j ²��c« ¢!�YTZD_GJW �i\5@[W_js²��c« ¢!¥z\ZBJFHI[GJm ONd�4�0�����:��� �7¢P|]^D_G�R7GJ\��_IcT7\4FSRZG6HJ�_@fT7Gam @ � GJRZGJWPT �

UW

Page 25: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

�������������� �A� ������� �%��� ���Y�J��� � �����{� � �

} W T7D_@[\ \5G B/T7@cMPW � G � FHW;TuTZMY\ZGG�D<M � T7M�U�F��SG�T7G��NT-D<F bPG�m @�� GR7GW;T \ZD<FSQiG \uMSR-\Z@:FGJ\J|�t)W<GU�F d �<\ZGs] ~ � � @cTZD�TZD_Gum GX F��_IcT4\5@:FG \kNMSX B M!�_R7\ZGSkA �<\5T4FS\ � GsD<F bPG(O GGW�m MP@cW_jV\5M X FHR |ygzG! I[I W_M �O GJB MPU�GaU�MSR7G-B R7GJFHTZ@[bSG � @cTZD�M!�_R(M!� TZQ��_TJ|(} W�m_@[\7B��<\7\Z@cW_j TZD_GV\5@:FGaMSXb9FHR7@cM!�<\{Q<FSR5TE\4MHXF�QiFHjSG-MHXTZG��NTJk T7D_GR7GuFHR7G�\ZGbPGREFHIV�_W_@cT7\4MHX U�G FS\��_RZG � GuBFHW �<\ZGS|

����� & �e:<80�u's& �e:<80��'�& � :<8

] ~�� BJFHWzUVG FS\��_R7G I[GW_jSTZD �<\Z@cW_j U�FHWNd�TedNQiG \sMHX �<W_@fTE\|V]^D_G�U�MP\5T�BMSU�U�MSWzFSRZG TZD<GV@[W<BEDLkTZD<G�BGW;TZ@[U�G T7GR k TZD_G�Q MS@[WPT k TZD<GVQ<@[BJF_| ]^D<GVFSO_O_R7GbN@[FHTZ@[MSW<\(X MSRsT7D_GJ\ZG=�_W_@cT7\uFHR7GQ¤ k��'� k �-� kLFSW<m�0�sR7GJ\ZQ GJB/T7@cbPGI[dS|y]^D_G(Q MS@[W;T�@C\�m_G��<W_G m ONd TZD_GsGHJ�<FHTZ@[MSW?U(@[W<BED��Sp | p �)Q MS@[WPTE\k FSW<mVTZD_GsQ_@CBFuONdU-Q<@[BJF� U p QiMP@cW;TE\|u]^D��<\sF Q MS@[WPT�@C\(REF9T7D_GRs\5U�FHI[I�FHW<m�@[\sFHO M�� TsTZD<GV\Z@ FJG-MSX�F m G B @[U�FHI QiMP@cW;TJ|�4GJRZG�@C\4F�\ZFSU�Q_IcGsT7M�jS@[bSG�FHW�@[m_GJFVMHX TZD_GaBMSU�Q<FHREF9T7@cbPGs\Z@:FGJ\� � "$#�%&%')(��

Uu@[W<BED%�UuBGW;TZ@[U�G TZGJR�p�P-Q MS@[W;T7\�U�Q_@CBF3�

]^D��<\�Q MS@[W;T7\uFHR7G=�<\ZGJmYTZM�U�F��SG7�<W<G�BEDiFHW_jPGJ\� F Q_@[BJF @[\uFSOiM!� TuTZD_G�m @C\5T7FHWiB G�OiGT � GJGW TZD<GO<FP\5GJIc@[W_GJ\)MHX�T � M�B MPW<\5G B�� T7@cbPG-I[@cW<GJ\sMHX@8 �_W_U�FHjPW_@ �<GJm3;)W_MPRZU�FSI T7G��NTJ|a] ~ � @C\6HJ�_@fT7G�G��_FSB TsFHO M��_Tm @[U�GW<\Z@cMPW<\� @[W;TZGJRZW<FSIcI[d @fTE\)\ZU�FHI[IcG \eT9�<W_@fT�@C\(I[GJ\7\{T7D<FHW�MPW_GuX M!�_RC� U�@cI[I[@cMPWPT7D�MHXFSW�@cWiBEDL|@�(GW<BG-@cT@C\�TZD_GuR7GJ\ZMSI:� TZ@[MSW MHX TZD<GuM�� T7Q�� T(m GJb;@CB GsT7D<F9T � @[IcI m G T7GR7UV@[W_GsTZD<GaFSBB��_REFSB d�MSX T7D_GuM��_TZQ�� T |

]^D_GJRZG{FSRZG�T � M)MSTZD_GJR �_W_@cT7\yT7D<F9T�FSRZG^\5MPU�G TZ@[U�GJ\ �i\5GX �_INTZD<FHTD<F bSG{m @ � GR7GW;T\5@:FG \y@cW�m @ � GJRZGJW;TX MSW;TE\|y]^D_G\�<�-@C\�FSOiM!� TT7D_G4D_GJ@cjPDPT+MHX Fa\5U�FSIcI �C� �uFHW<mVT7D_G\�!��@C\�F�I[@fTZTZI[G(\ZU�FSIcI[GRTZD<FSW�TZD_G � @CmNT7DMHX�F�BFSQ_@fTEFHI �7? �_| �! !"$#�%&%')(���

]^D_G \5DiFHQ G MHX{T7D_G�M!� TZQ��_TV@C\ajPGW_GJR7FSIcI[d m_G TZGJRZU�@[W_GJm O;d B MPW;TZR7MSI � MSREm_\J|�]^D_GR7G�FSRZG U�FSW;d\��<BED � MSREm_\�NTZD_G \5GaFSIcI[M � bPGR7d �<W_GaBMSW;TZR7MSI MHX TZD<GuRZG \C�_IcTZ@[W_jVTZG��NTJ|�vL� T4U�MP\5T{MHX TZD_G�T7@cU�GuMPW_Icd F\ZU�FSIcI W��_U OiGJR4MHX TZD_GJU FSRZG�W_G B GJ\7\7FHR7dS|

UN

Page 26: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

������ $�+3 8 $w-3

]^D_GsT7G��NT4MSW�FVQ<FHjPGsBMSW<\Z@[\5T7\�MSX T7D_RZGJG�O<FS\Z@[B)Q<FSR5TE\|�]^D_GJRZG�@C\�TZD_GuD_G FSm I[@[W_GuFHO M9bSG)TZD_G�U�FH@[WTZG��NT� TZD_@C\)MHX TZGJW�B MPWPTEFH@[W<\(F�BED<FHQ T7GR{T7@fT7IcGPk \5G B/TZ@[MSW�T7@fT7IcGPk MSR(F�QiFHjSG-WJ�<U-O GR k FSW<m�U�F d m @ � GR(MPWM m_m�FSW<m GJbSGJW Q<FHjPGJ\J|�v+GJIcM � T7D_@C\+@C\+TZD_GsU�FH@[W T7G��NTJk � D_@CBED�@[W<BI �<m_GJ\^FHWNdVX MNMHTZW<MHTZG \|��(W<m �<WiFHI[IcdTZD<GR7Gs@C\^T7D_G�X MNMHTZI[@[W_G�TZD<FHT4U�@cjPDPT4BMSW;T7FS@cW�FVQ<FHjPGsW��_U OiGJRJ|

} W T7D_G G�� FSU�Q_IcG \ � G D<F bPG \5GJGW \ZMAX FHR k TZD_G D_GJFPm Ic@[W_G DiFS\aO GGJW O_ICFHW�� |�]^D_G X M;MSTZI[@cW<G�D<FP\B MPW;T7FH@[W_G m G@cTZD_GJR FYBGW;TZGJRZG m W��_U-O GR MSR k @cX �� &� �&������ c�[�&�&�<�_��D<FPm OiGJGW �i\5G m kyD<FS\ FHIC\5M�O GGJWO_ICFHW�� |ug G� IcIyD<F bPG-U�MSR7GaT7M \7F dAFHO M�� T�D_G FSm I[@cW<GJ\�FHW<m�X MNMHTZI[@[W_GJ\sICF9TZGJR)@[W�T7D_@C\u\5G B/TZ@[MSW |�x<MSRsTZD<GU�MSU�GW;T4I[G T \{BMSW<BGW;TZREF9T7GsMPW�T7D_GuU�FH@[W�T7G��NTJ|

] M"�<W_@C\ZD MSW_G)Q<FHjPG(FHWim�\eTEFHRZT+FaW_G � MSW_GPk �[�A��¤=�-� �c���-���:�VBFHW�O G9�i\5G m |�]^D_G)BMSW;TZR7MSI � MSREm�c���c�&�:�uX MPR7BGJ\�T7D_G)BMSU�Q_I[G T7@cMPW�MHX TZD<G)B��<RZR7GW;TQ<FSjSGSk � D_@[IcG �[�-��¤[�-��BF��<\ZGJ\FSW;dVI[G X T+M9bPGRbPGRZTZ@CBFSI\ZQ<FSBGaTZM O G j;F9TZD<GR7GJm�FHT)T7D_G O MHTZTZMPU MHXT7D_G QiFHjSG 8 dPM���U�@[jSD;T)T7RZdAI[GJF bN@[W_j M!� T)T7D_G �=�A��¤[�-� FP\FHW G�� Q GR7@cU�GJWPT{T7M�\5GJGsD<M � TZD<GubSGRZTZ@CBFSILFHW<FSIcMPj MSX3A �<\5TZ@ �<G m�D_MSR7@ FJMSW;T7FSI Ic@[W_GJ\^MSX T7G��NT � MSR��N\Y;/|

]^D_G�B��<RZR7GW;T D<MSR7@ FJMSW;T7FSI � @CmNTZD MHX4T7D_G TZG��;T�MSW TZD_G Q<FSjSG�@C\�m G��\7B R7@cO GJm ONd TZD<G�B MSW;T7RZMPI � MPR7m���0�A¤��A�<| } T BJFHW OiG�BED<FSW_jSG m k^\ZF d T7MSA@[W<BED_GJ\Jk ONd �����A¤��A�F�¯£ ¤ �FHT-FHWNdzm_GJ\Z@cR7GJmzTZ@[U�G'�<\Z@cW<jAUVGTZD_M m_\TZM�O G�m GJ\7B R7@cO GJmz@[WYT7D_G�W_G��NT�X G � \5G B/T7@cMPW<\|V]^D_G�b9FHI:�_G�MHX ���0�A¤��-� @[WG�� GJB T � D_GW TZD_G�Q<FSR7FSjSREFHQ_D @C\�B MSU�Q_I[G T7GJm m G T7GR7UV@[W_G \-T7D_G � @[m TZD MHXTZD<GVQiFHREFHjSREFHQ<DL|-�(\uBJFHWzOiG�\ZGGW @[WYT7D_@[\�QiFHREFHjSREFHQ<DLk TZD_GVTZG��NT � @CmNT7DBFSW OiG BED<FHW_jPGJm 8 @[W T7D_@[\ BFP\5G�T7M S�@[W<BED_GJ\Y;sX MPR-F�\Z@cW_jPIcG�QiFHREFHjSREFHQ<DL|v�GJBJF��<\ZGA@fT RZGJQ_R7GJ\ZGW;T7\VT7D_GzB��_RZR7GW;T b9FHI:�_G�MSX�TZD_GzD_MSR7@ FJMSW;T7FSI � @[m TZDLkG�� Q_R7GJ\7\Z@cMPW<\(\��<BEDzFP\ ���0�A¤��-�F� ¥w� �   ���0�-¤��A��BJFHWYU�F��SG F�W_G � b FSI �<GTZDiF9T4@C\^RZGJI[FHTZ@[bSGsTZMVTZD<GuMSICm MPW_GS|

]^D_GubPGRZTZ@CBFSILFHW<FSIcMPjVMSX ���0�A¤��-� @C\��[���-¤��A�ik � D_@[BED�@C\^TZD<G-B��_R7R7GW;T{D_G@[jSD;T4MHX TZD<GaU�FH@[W T7G��NTJ|} T{BFHW�OiGsRZG \5GTJk A �<\5T�I[@:�SG ���0�A¤��-�i| ]^DJ�i\k �[���-¤��A�F� � ¤� BJFHW O G@�i\5G m�TZM�BED<FHW<jSG{T7D_G)bPGRZTZ@CBFSID_GJ@cjPDPT)MHX�TZD<GaU�FH@[WATZG��;T |4r4MSTZGaT7D<F9T �[�_�A¤��A��@C\{TZD<G \Z@ FJGaMHXyTZD<GaTZG��NT)G��_BI �<\Z@[bSGuMHX�FSWNd�D_G FSm I[@cW<GMSR^X MNMSTZI[@cW_GuU�FHTZGR7@CFHI |

] G��NT)BJFHWAFHIC\5M�O G-\ZD_@cX TZGJmAFPB R7MP\7\�TZD_G-Q<FHjPGS|+]^D<G"�_Q_Q GR(I[G X T�B MPRZW_GJR{MHX TZD_GaTZG��NT(@C\4MPW_Gu@[W<BEDm M � WAFHWim MPW_Gu@[W<BEDA@cW�X R7MSU TZD_G)�_Q_Q GR4I[G X T)BMSR7W_GR{MSXyTZD_GaQiFHjSGP|�]^D_G-BMSW;TZR7MSI � MSREm_\����&�c�c�_�[�<�FHWim �[���c�-�&�[�<��FHR7GE�i\5G m�T7M�\5D_@cX T4T7D_G�TZG��;T4D<MSR7@ FJMSW;T7FSIcI[d FHW<m bPGRZTZ@CBFHI[I[dS|�]^D��<\����&�<�-�_�[�<�F� � �  ¤� �FHW<m �[���c�-�&�[�<�¯� ��p V¤� � M!�_ICm�\5D<@fX TsTZD_G TZG��NT�FSWzFSm<m @fT7@cMPW<FHI�| ��O�@[W<BED_G \4T7M T7D_G R7@[jSD;TsFSW<m|TO�@[W<BED_GJ\@�_QL|u?AM;\eT�MHX�T7D_G TZ@[UVGVdSM!�% IcI W_GG mAT7M \ZG T ��&�c�-�_�=�<� k �[���c�c�_�[�<� k<FHW<m��=���A¤��A� F9TsTZD<GO GjS@[W_W_@[W_j�MSX dSM!�_R{m M B��_U�GJWPT4MPW_I[dS| � "$#�%&%')(+* � 4

p�P

Page 27: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

� 1��0� �B1�� 1�� � � �Z1�� ���/� * �T����*��

����� * & - / � 1��0� �B1_��� 1�� � & - / �+*�� � ���5� � ��� �+*��p��� � ( *����D_MPRZ@:FMPWPTEFHI � @CmNTZD ���0�A¤��-� Q_|TObSGJR5T7@[BJFHI � @CmNTZD �[���A¤��-� W_| N

D_MSR7@:FMSW;TEFHI M � \5GT � ��&�c�-�_�=�<� PbSGRZTZ@CBFSI M � \5GT � �=���c�-�_�=�<� P

" ~ � GREB @C\ZG o_|:U ~W;TZGJRaF�QiFHREFHjSREFHQ<D�MHX+TZG��NTuT7D<F9Tu@C\uF�X G � I[@cW<GJ\�I[MSW_ji|V] F��PGV\ZGbPGREFHI�B MPQ_@cG \sMHXdSM!�_RaQ<FSR7FSjSREFHQ_D FHWim Q�� T����0�A¤��-�F�V �¤� �O G X MPRZG�MSW_G�FSW<m ���0�-¤��A�F� ¢4¥V�D� @cW X R7MSW;T-MSX4F\ZGJB MPW<m MSW_GP|y] R7d F X G � MHT7D_GR{b9FHI:�_G \�X MSR����0�-¤��A�i|

" ~ � GJR7B@[\ZG{o_| p M� T ���&�c�c�_�[�<�%� �p �¤� FHWim �=���c�-�_�=�<�%� ¢r¤� OiGX MSR7G^TZD_G#�<R7\5T�Q<FSR7FSjSREFHQ_DMHXydSM!�_R^Q_R7GbN@cM!�<\�G�� GREB @C\ZGS|

" ~ � GREB @C\5G)o_| o ] F��PG)dPM��_R+Q_R7GbN@cM!�<\+G�� GREB @C\5GsFHW<m�Q�� T��[���-¤��A�F� �7¤� O G X MPRZG)TZD_GE�<RE\5T�Q<FSR7F��jSREFHQ<DL|

} W T7D_G�Q_R7GbN@cM!�<\a\ZGJB TZ@[MSW � G \7F � T7D<F9T @fTa@C\aQ MP\7\5@[O_I[G�TZM?�<\ZG�X MSW;TE\uMHX{ICFHR7jSGRu\Z@ FJG�ONd �<\Z@cW<jTZD<G �4�0�����:��� � B MSW;T7RZMPI � MPR7mL|q} T \ FHIC\5M Q MP\7\Z@cO_I[GAT7M U�FHjSW<@fX d TZD_GYGW;TZ@[RZGzm M B��_U�GW;T FHT MPW<B GP|} X��T�0���� Z¤!��¤c�[�<��¤=�� E� �4�������:��� � ¢�FHQ_Q GJFSR7\�F9TuT7D_G�TZMPQ MHX+dPM��_Ram_MNB��_U�GW;TJk TZD_GJW FHI[IMHX�dSM��<RM��_TZQ�� T^@C\+U�FSjSW_@ �<GJm O;d p�P � | ]^D<G)MSTZD_GJR+b9FHI:�_G \�MSX �4�������:��� �VBFHW�OiGE�<\ZGJm k;TZMNMi|$�D� � (+1 � � � 0**-� ��( �/�4���!*�� �( �A� �4�0���� Z¤:��¤<�[�<�0¤=�� ����� 1_���5� 0* ��� *���0*��Z1��B* * �G*c� � �T�L����� * �<( � �� �=� *��� �v�*� �*�� *c� �]^D_@C\LU�FHjPW_@ �iBFHTZ@[MSWaB R7GJFHTZG \LF{Q_R7MSO_I[GU @[W"�_W_@cT7\�H@fX T7D_G+m_MNB��_U�GW;T @C\ T7M(O GU�FHjSW<@ �<G mONd p�P � FHWim ���0�A¤��-�F�  �¤� FSQ_QiG FHRE\�@cW TZD<Ga] ~ � @[W_Q�� T$�<I[GSki\5D_M!�_ICm�T7D_GE�<W<FSILM�� T7Q�� T4D<F bPGsFSW���0�-¤��A�-MHX�O-@[W<BED_GJ\^MPR{\5D_M!�_ICm @cT^O GuU�FHjPW_@ �iGJm ONd�p�P � TZM Q @cWiBED_GJ\ �A`4W<IcG \Z\+TZMPI[m MHT7D_GR � @C\5GPkNFSIcITZD<Gsm @[U�GW<\Z@[MSW<\ � @cI[I OiG)U�FHjSW<@ �<G m \ZMaTZDiF9TJkN@[W T7D_@[\^BJFS\ZGSk���0�A¤��A� � M��_ICm�O GEQ-@cW<BED<GJ\+@cW�T7D_G@�<W<FHIM��_TZQ�� T |�]^D<@[\(UVG FHW<\{TZD<FHT(FHI[ILTZD<G-m @[UVGJW<\Z@cMPW<\ � @[IcI @cW<BRZG FS\ZG6�_W_@cX MSR7UVI[d � D<GW �4�0���� Z¤:��¤<�[�<�0¤=�� @C\ �<\ZGJm | vL� TaX MSRV\5MPU�G \5Q GJB@[FSI�\5@cT��iF9TZ@[MSWi\u@fT UV@[jSD;T-W<MHTaO G�m GJ\Z@[R7FSO_IcG�X MPRuTZD<@[\aTZM�D<FSQ_Q GW%�yX MPRG��_FSUVQ<IcGPk�dSM�� UV@[jSD;T � FSW;T-TZM I[GJF bSG FY\ZQ<FSBG�MHX)G��_FSB TZI[d oz@[W<BED_GJ\-TZM @[W<\5GJR5T�F?�<j!�_R7GS| } W T7D_@[\BFP\5G)FHWNd)�_W<@fT^BFHW�O G(U�M m @ �<GJm O;dh�-�c���-\5MaTZD<FHT �����A¤��A�%�  ¯�-�<�&�V¤� � @cI[I FSI � F d \\ZG TT7D_G(I[@cW<G� @CmNTZD TZM O @[W<BED_G \k R7Gj;FHREm IcG \Z\+MHXyU�FHjPW_@ � BF9T7@cMPWL| � "$#�%&%')(�� � � �� � ]^D_G�T7G��NT4@C\^@cW_@cTZ@CFHI[I[d U�@cWiBED�m_M � W FSW<m U�@[W<BED�@cW X R7MSU �<Q_QiGJR4I[G X T(B MPRZW<GR^MHX TZD_GuQiFHjSGP|

p�U

Page 28: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

" ~ � GREB @C\5GVo_| S M�� T �4�0���� Z¤:��¤<�[�<�0¤=�� F���4�0���_�:��� � ¢�FS\)TZD_G7�<RE\5T�I[@[W_G @[W MSW_GVMHX�dSM��<R)@[W_Q�� T�<I[GJ\4FSW<m \5GJGsD<M � TZD<GuM�� T7Q�� T(BED<FSW_jSG \|

�� � $0i$��0i$ 8 $-3

ghD_GJW�] ~�� @C\yRZG FSm @[W_j)TZD_G^T7G��NT�TZM�O G^Ted;Q GJ\ZG TyX R7MSU dPM��_Ry@[W_Q�� T �iIcGPkS@cTRZG FSm_\ @[W�FsQ<FSR7FSjSREFHQ_DF9TVF TZ@[UVG FHW<m T7D_GW TedNQ GJ\ZG TE\u@fT |A]^D_@[\-U�GJFHWi\�TZD<FHT-T7D_GR7G�@[\ F�IcMST-MHX4BMSW;TZR7MSIM9bPGRuQ<FSR7FSjSREFHQ_D\ZD<FHQ GJ\JkSO��_T+FHIC\5MsT7D<F9T+\ZMSU�G4BJFHR7G�U �<\5T�OiG4T7F��PGWL| g G� bSG4FHI[R7GJFSm_d-\5GJGWVTZDiF9T ���0�A¤ �A��BJFHW�OiG9�<\5G mTZM B MPWPT7RZMPI TZD<G � @CmNTZDYMHX�F�\Z@[W_jSI[GaQ<FSR7FSjSREFHQ_DL|{vL� Tu\C�<Q_QiM;\5GaTZD_G X MSI[IcM � @[W_j FSQ_QiG FHR7GJmAFP\(Q<FSR5T)MHXdSM!�_R^@cW<Q�� T#�<I[G��

���0�-¤��A�F�  7¤� ���[�-�7�c�[�<���%�� A�7�[�[���� ���-�[��� ���������������c���4�����Z¤c�E�-�<�-���v����0�-¤��A�F� ¡w�p �¤�

ghD<FHT @[\VT7D_G � @[m TZD MHX)TZD_GAQ<FSR7FSjSREFHQ_D/� ]^D_G ���0�-¤��A� � FP\�BED<FHW_jPGJm F9T�TZD_G�\5T7FSR5T�MSX(TZD<GQ<FSR7FSjSREFHQ_DAFHWim�FHj;FH@[W�F9T(T7D_GVGW<m |"�N@[W<B G-TZD_GVQ<FSR7FSjSREFHQ_D � FP\4W_MST�BMSU�Q_I[G T7GJm 8 O;d�Q��_T5TZ@[W_j @cWzFO_ICFHW��AI[@[W_G�MSR � ���<��;9�_W;TZ@[IF9X TZGJRsTZD_G \ZGJBMSW<mzBED<FHW_jPGSk TZD<G�Q<FHREFHjPR7FSQ_D � M!�_ICm�O G TedNQ GJ\ZG T � @cTZD F� @CmNTZDzMHX Q<| O @cW<BED<GJ\J|E�(M � GJbSGR k @fX+F�O_ICFHW��AI[@cW<G � GR7Ga@[W<\5GJR5T7GJmYOiGX MSR7G ���0�-¤��A�F� ¡w�p �¤� k TZD_GJWTZD<GsQiFHREFHjSREFHQ<D � M��<I[m�OiGsTedNQiG \5GT � @cTZD�F � @[mNT7D�MSX�Ou@[W<BED_G \|��NMik @cW jSGJW_GREFHI k � D<GW�F-Q<FSR7FSjSREFHQ_D@C\(\ZG TJk<TZD_G b9FHI:�_GJ\(MHXyTZD_G-Q<FHREFHU�G T7GRE\�TZD<FHTsFSRZGu@[WAG�� GJB T � D_GJW�TZD_GaQiFHREFHjSREFHQ<D @C\(BMSU�Q_I[G TZG mAFHR7GTZD<GuMSW_G \�TZD<FHT(FHR7G@�<\ZGJmL|

�(GR7Gs@C\4F T7FSO_I[G � @fT7D�\ZMSU�G�Q<FSR7FSjSREFHQ_D QiFHREFHU�G T7GRE\��

��1_� *%��� ��/�����/� ( �( �0�* ��� ���� *c�*����

� � � �=�4� 1�� & - / � 1��0� �B1���� 1�� � & - / � *�� ��� ���� @CmNT7D ��0�A¤��A� Q_|TO @cW<BED<GJ\

@cW<m_GW;T7FHTZ@[MSW�MSW �<RE\eT{I[@cW_G � �&�<��¤� ��A�� -� p�PVQiMP@cW;TE\m @C\eTEFHW<BGsO G T � GGJW�Ic@[W_GJ\ �=�&�&�=�A�&¤� &��� �0¤ � U p QiMP@cW;TE\

m @[\5T7FSW<B GuO G T � GGJW QiFHREFHjSREFHQ<D<\ � �&�[��� �0¤ � PVQiMP@cW;TE\

]^D_GsB MPWPT7RZMPI � MSREm��� &�_¤� A�A�� A�uU�F d O G9�<\ZGJm�F9TT7D_G(O GjP@cW_W<@cW_j-MHX FuQ<FSR7FSjSREFHQ_D TZMVF bSMP@[m TZD<GF��_TZMSU�FHTZ@CB�@cWim GW;T7FHTZ@[MSW MPW TZD_G �iR7\5T-I[@cW_GP|�]^D_@C\-B MPW;TZR7MSI � MSREm � @cI[I+MPW_I[d F � G B/TaT7D_G�Q<FSR7FSjSREFHQ_D

pSp

Page 29: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

O G@[W_j \ZG T � D_GW @cT+@C\+@cWNbSM!�SG m?8 MHX BM��_RE\ZG�� �&�<�0¤� A�A�� A�%� ¥��A� � @cI[I BF��i\5G)W_Ma@[W<m GW;TEF9TZ@[MSW X MSR+FSIcIQ<FSR7FSjSREFHQ_D<\Y;/|

�qU�MSR7G �<G��N@[O_I[G � F d TZM BMSW;TZR7MSI<TZD_G � @CmNTZD MHX FaQiFHREFHjSREFHQ<DV@C\�TZM)�i\5G �=�0¤ ���A�_� �0¤ �FSW<m �-�c�c�c�_� �0¤ � |6�NGT5T7@cW_j �-�c�c�<��� �0¤ �%� �-¥��A�ABF��i\5G \(T7D_G�IcGX TuU�FSRZjP@cWzMHX+TZD_G�Q<FSR7F��jPR7FSQ_D TZM�O G U�M9bSG mz@[W FHW G��NTZREF T � GJWPTedzQiMP@cW;TE\|�r4GJjPF9T7@cbPG�b9FHI:�_GJ\-U�F dzOiG FS\7\5@[jSW_G mT7M �-�c�<�c��� �0¤ �AT7MYU�M9bSG TZD_G IcGX TVU�FHR7jS@[W M�� T |z]^D_G B MPWPT7RZMPI � MSREm �[��¤ ���A�����0¤ ��m MNGJ\T7D_Gs\7FHU�G(TZM TZD_GsRZ@[jSD;T^\5@Cm GsMHXLT7D_G)QiFHREFHjSREFHQ<DL| ]^D_G�\Z@cW_jPIcGsB MPWPT7RZMPI � MSREm �� &�[�-�����&�[�-@[\T7D_G�GHJ�_@[b FSIcGJW;T�MSX�\ZG TZTZ@[W_j�OiMSTZD �c�c�c�c�����0¤ � FSW<m �=�0¤ ���A�_� �0¤ � G H!�iFHI TZM � �&�[�0¤� ��A�� A� |]^D_@C\u@C\)HJ�_@cTZG �<\ZG X �<IX MSR-IcMPW_j?H!�<MHT7FHTZ@[MSW<\Jk FSW<mzTZD_@C\aQiFHREFHjSREFHQ<DY@C\aFHW G��_FSUVQ<IcG�MSX�@cT7\�<\ZGS|{�)\ � @cTZD ���0�A¤ �A�ikNTZD<G-b9FHI:�_GaMSX �-�c�c�c�_� �0¤ � FHW<m �[�0¤ ���A��� �0¤ ��@[W�G�� GJB T � D_GJWATZD_GQ<FSR7FSjSREFHQ_D�@[\4BMSU�Q_I[G T7GJm @[\^T7D_GuMSW<G � D<@[BED � @[IcILFSQ_Q_I[d TZMVT7D_G � D_MSI[G�Q<FHREFHjPR7FSQ_DL| � "$#�%&%')( 4

" ~ � GREB @C\5G o_|TO ?YF��SG T � M�Q<FSR7FSjSREFHQ_D<\ � @fT7D�T7D_GVX MSI[IcM � @[W_j \ZQ GJB @ �iBJF9TZ@[MSWi\��{T7D_G�IcGX TuU�FSRZjP@cWYMHXO MHTZDVQ<FSR7FSjSREFHQ_D<\L@[\ @[W<m GW;T7GJm O;d UP| O4@cWiBED_GJ\Jk9TZD<G+R7@cjPD;T U�FHR7jS@[WaMSX_TZD_GL�<RE\5T Q<FSR7FSjSREFHQ_Du@C\ @cWim GW;TZG mONd P_| ��O @[W<BED_G \k_FSW<m T7D_GuR7@cjPDPT{U�FHR7jS@[W MHX T7D_Ga\ZGJB MPW<m Q<FHREFHjPR7FSQ_D @C\{@cWim GW;TZG m O;d US| ��O-@cW<BED<GJ\J|

� @cW_G \4BFSW�OiGuU�FSm_G � @fT7D�m @�� GR7GW;T4I[GW_jSTZD<\ � @fT7D_@cWAMPW_G�Q<FHREFHjPR7FSQ_D�ONd �<\5@[W_j ���&�� �0¤� ��A�� A�FHWim����&�� ����c�c�A�<� |(]^D_G�FHU�M!�_W;TsMSX�TZD_G�@[W<m GW;TEF9TZ@[MSWz@[\�m GTZGJRZU�@[W_GJmYO;dAb9FSI �_GVMHX ���&�� ���¤� ��A�� -� |} X ���&�� ��0¤� ��-�� A��@[\(QiM;\5@cTZ@[bSGPk_T7D_G-@[W<m GJWPTEF9T7@cMPWA@[\(U�FPm GuX R7MSU TZD_G IcGX TJk FHW<m�@fX�@cT)@C\4W_GJjPF9T7@cbPGu@fTs@[\U�FSm G+X R7MSU TZD_G�R7@cjPDPT | ]^D_G�I[@cW_G \ MSW � D<@[BEDuT7D_G^@cWim GW;T7FHTZ@[MSWaM BJB��_RE\ @C\yB MPWPT7RZMPIcI[GJmaO;d ���&�� ���c�c���[� |} X������� ����c�<���<��@[\-QiM;\5@cTZ@[bSG�T7D_GW @fT m_G TZGJRZU�@[W_GJ\aTZD_G�WJ�<U-O GR-MSX�I[@[W_GJ\ F9TaX �_I[I � @[mNT7D OiGX MSR7G�TZD<G@[W<m GW;TEF9TZ@[MSW \5T7FSR5TE\| ]^D��<\u@cX����&�� ���¤� ��A�� -�F� ¢y� �  V¤� FSW<m ������ ����c�<���<�F� ¡ik T7D_GW T7D_G �<RE\5T

\Z@ ��Ic@[W_G \ � @[IcI OiG-FHT4X �_I[I � @CmNT7DYFHW<m T7D_G-R7GJ\5T � @cI[I OiGa@[W<m GJW;TZGJm�ONdUS| ��O)@[W<BED_G \yX RZMPU T7D_G{I[G X TJ|+t)WVT7D_G4MHT7D_GR�D<FHW<mV@cX ��&�� ��0¤ ��A�� A�E���¢y� �  V¤� aFHWim ���&�� ����c�c�A�<�%� �c¡ik TZD<GW TZD_GL�<RE\eT�\Z@ �aI[@cW<GJ\ � @cI[I O G@[W<m GW;T7GJmAONd US| ��OV@[W<BED_GJ\4X RZMPU TZD_G RZ@[jSD;T(FHWim�TZD_G RZG \eT � @cI[I O G FHTX �_I[I � @CmNTZDL|+] ~ � R7GJ\ZG T7\+T7M T7D_Gam GX F��_IcT4b9FHI:�_GJ\����&�� �0¤� ��A�� A�F� ¥�A�AFHW<m ��&�� ����<�c���<�%� ¢�F9X T7GRsGJFPBEDYQ<FSR7FSjSREFHQ_DL|�]^D_G \5GVB MSW;T7RZMPI� MSREm_\ FSRZG �<\ZG X �_I^X MPRVQiFHREFHjSREFHQ<D<\ � @cTZD �5D<FSW_jS@[W_jY@[W<m GJW;T7\ �zFSW<mX MSR �<M � @[W_j F Q<FSR7FSjSREFHQ_D FSRZM!�_W<m \ZQ<FPB G RZG \5GJRZbPGJm X MSRAF �<j��<RZGP|]^D_G(BMSW;TZR7MSI � MSREm���&�� ��-F9T�TZD_G4O GjP@cW<W_@cW<juMHX TZD_G(Q<FHREFHjPR7FSQ_D � @[IcI � "$#�%&%')(+, � �BF��<\ZG4TZD<G#�<RE\eT�Ic@[W_G)TZM OiGsMHX X �_I[I � @[m TZD,8������ ����c�<���<�A�Z¢ ; FHWim�TZD<GR7GJ\5T-MHX^TZD<G Q<FHREFHjPR7FSQ_DzTZM�O G @[W<m GW;T7GJm ONd�T7D_G B��_R7RZGJWPTab9FSI �_G�MHX� �&�[�0¤� ��A�� A� |uvL� TudSM�� m M�D<F bSG TZM��<\ZG �� ��_¤� ��A�� A� @fX^dSM!� � FHW;TTZD<G6�<R7\5T{Ic@[W_G�T7M�G��NTZGJW<m FSIcILTZD_G � F d�TZM�T7D_GuIcGX T4U�FHR7jS@[WL| �! !"$#�%&%')( 4 *

�(GR7GV@C\�T7D_G�Q_R7GbN@cM!�<\�Q<FSR7FSjSREFHQ_D�R7GQ GJFHTZG m � @cTZD ���&�� ����c�c�A�<�%� �c¡AFSW<m ��&�� ��0¤ ��A�� A�E���¢y� �  V¤� |

pHo

Page 30: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

� @cW_G \+BJFHW�O G)U�FPm G � @cTZD m_@�� GR7GW;T+I[GW<jHTZDi\ � @cTZD_@[W MPW_G(Q<FSR7F��jSREFHQ<D ONd �i\5@[W_j ���&�� ���¤� ��A�� -��FSW<m ���&�� ��A�c�c���<� |�]^D<G FSUVM!�_W;TMHX�TZD_GV@cWim GW;T7FHTZ@[MSWz@[\sm G T7GR7U�@cW_G m�ONdAb9FHI:�_GVMHX ���&�� �0¤� ��A�� A� |{} X���&�� ��0¤� ��-�� A�s@[\�Q MP\Z@cTZ@[bSGSkHTZD_G4@[W<m GJW;T7F9T7@cMPW�@[\�U�FPm G^X RZMPU T7D_G{IcGX TJkFHWim @fX4@cT�@[\-W_Gj;F9TZ@[bSG�@fT�@[\ U�FSm G X RZMPU T7D_G�R7@[jSD;TJ|Y]^D<G�I[@cW_G \-MPW� D_@CBED�T7D_G�@cW<m_GW;T7FHTZ@[MSWYM BJB��_RE\(@C\uB MPW;TZR7MSI[IcG mAONd ��&�� ����<�c���<� |(} X���&�� ����c�c�A�<� @C\sQiM;\5@cTZ@[bSG TZD<GWY@cTam G T7GR7U�@cW_G \)TZD_GVW��_U-O GR�MHX+Ic@[W_GJ\�FHT)X �_I[I � @CmNTZD OiGX MSR7G-T7D_GV@cW��m GJWPTEF9T7@cMPW�\5T7FSR5TE\|�]^D��<\{@cX ���&�� ���¤� ��A�� -�F� ¢y� �  V¤� FHWim ��&�� ����<�c���<�E� ¡ik_TZD<GW TZD_G �<R7\5T(\Z@ �I[@cW_G \ � @[IcI+OiG�FHTuX �_I[I � @CmNTZD FSW<mzTZD_G�RZG \eT � @[IcI+OiG�@cW<m_GW;TZG m O;d US| ��O @[W<BED_GJ\uX RZMPU TZD<G IcGX TJ|�t)WTZD<GaMHT7D_GR4DiFHW<m�@cX ��&�� ��0¤ ��A�� A�E� �_¢y� �   ¤� FHWim ��&�� ����<�c���<�E� �c¡<k_TZD_GJW�TZD_G"�iR7\5T)\Z@ � Ic@[W_GJ\� @[IcI�O G�@cW<m_GW;TZG mYONd UP|���O�@[W<BED_GJ\sX R7MSU T7D_G�RZ@[jSD;TuFHW<mYTZD<GVR7GJ\5T � @cI[I�OiG�FHTsX �<IcI � @CmNT7DL|V] ~�� RZG��\ZG T7\�TZM TZD<Gsm GX F��_IcT^b FSI �<GJ\ ��&�� ��0¤ ��A�� A�E� ¥��A��FHW<m���&�� ����<�c���<�E��¢sF9X TZGJR^GJFSBED�QiFHREFHjSREFHQ<DL|]^D_G \5GAB MPW;TZR7MSI � MPR7m_\�FSRZG �<\5GX �_I{X MPRVQiFHREFHjSREFHQ<D<\ � @cTZD �5DiFHW_jP@cW_jz@cWim GW;T7\ � FHW<m X MSR �<M � @[W_j FQ<FSR7FSjSREFHQ_D�FHR7M��_Wim \ZQ<FPB GuR7GJ\ZGR7bSGJm�X MSRsF7�<j��<RZGP|^]^D<G-B MPWPT7RZMPI � MSREm ���&�� ���F9T4T7D_GaO GjP@cW_W<@cW_j�MHX �! !"$#�%&%')(+, � �TZD<GVQiFHREFHjSREFHQ<D � @cI[IBF��<\ZG T7D_G7�<RE\eTuI[@cW_GVT7M O G�MHX+X �_I[I � @[m TZD 8 ���&�� ����c�c�A�<�A�Z¢<;^FHW<mYTZD_G�R7GJ\5T�MHXTZD<GuQ<FHREFHjPR7FSQ_D T7M�OiGa@[W<m GJW;TZGJm ONd T7D_GaB��<RZR7GW;T4b9FHI:�_GuMHX � �&�[�0¤� ��A�� A� | vL� T4dPM��Am M�D<F bPG)T7M �<\ZG�� &�&¤� ��A�� -�V@cX dPM�� � FSWPT^T7D_G6�<RE\eT{I[@cW_G�T7M�G��NTZGJW<m�FHI[I TZD_G � F d�TZMVT7D_GuIcGX T(U�FHR7jS@[WL| �! !"$#�%&%')( 4 *

]^D_G�B MPW;TZR7MSI � MSREm � �&�<�_���&� �&�uBFSW OiGE�<\ZGJm TZMVU�F��SG)Q<FHREFHjPR7FSQ_D<\ � @cTZD FajSR7GJFHTZGJR�b9FHR7@cGTed�MHX\ZD<FHQ GJ\J| �! !"$#�%&%')( 4 4

�(W_MHT7D_GR6�<\ZG X �_IBMSW;TZR7MSI � MSREm�X MSRu\ZG T5T7@cW<j Q<FSR7FSjSREFHQ_Di\4@C\ �&¤!���!� |�} TaBFSWYO G �i\5G m�T7M U�F��PGb9FHR7@cM!�<\sTedNQiG \aMSX^@cTZGJU�@ FJGJm I[@[\5T7\Jk FSW<m @C\a@[W;bPM��PGJm,�<\5@[W_j�T7D_G Q<FHT5TZGJRZW �&¤!���!� � ����� �<| ]^D<@[\ BF��i\5G \TZD<GsW<G��NT4Q<FHREFHjPR7FSQ_D�TZM�O GsX MSR7UVG m � @cTZD�GJbSGR7d�Ic@[W_Gu@[W<m GJWPT7GJm ONd � ���<�0¤� ��-�� A� FSW<m k @[W FPm_m @cTZ@[MSWLkTZD<G"�<RE\eT(I[@[W_G-ICFHO GI[GJm�MPW�TZD_GaI[G X TsONd � D<FHTZGJbSGR(@[\(OiGT � GJGW�TZD<GaO_REFSB G \|�} T)@C\#�i\C�<FSIcI[d �i\5G m � @fT7D� �&�[��� �0¤ �%� ¥ �A� kP\Z@[W<B G(TZD<FHT�B MPW;TZR7MSI � MSREm�m G T7GR7U�@cW_G \�T7D_G(bPGRZTZ@CBFHI \5QiFSB G(OiGT � GJGW�TZD<G)m @ � GJRC�GW;T�@fT7GU�\|]^D<G)B MPW;TZR7MSI � MSREm �&¤!���4� ¤!���!�V@[\+TZD<G)\7FHU�G)FP\ �&¤!���4� G��_B GJQ T�TZD<FHT�TZD<G)@[W<m GJWPTEF9T7@cMPW @[\T � @CB GuFS\�X FSRJk T7D<F9T{@C\k_T � @[BG)T7D_Gub9FHI:�_GuMHX � ���<�0¤� ��-�� A� |��4GJRZGu@C\{FHW G��_FSUVQ<IcG!� �! !"$#�%&%')( 4 *

� �&�[��� �0¤ �%� ¥ �-� � ���<�0¤� ��-�� A�F� ¥��A��� &�&¤� ��A�� -�� 0���&�<�r�A�-�E�����r�A�-�-�c���Z¤ ���<�&���:�0¤=�� �����&¤!�A�!� � �!¢����������<�7¤c� �[�&�&�:�0¤:�� ¢ ��&¤!�A�!� � �*� ���������<�7¤c� �[�&�&�:�0¤:�� r� ��&¤!�A�!� � � ���������<�7¤c� �[�&�&�:�0¤:�� ��&¤!�A�!� ¤!���4� � � � �������&�<�7¤c� �<�&�&�!�0¤=�� � ��&¤!�A�!� ¤!���4� � � � �������&�<�7¤c� �<�&�&�!�0¤=�� � �

� @[IcILQ<RZM m��<BG

pBS

Page 31: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

�4Wi\ � GR4FSIcI T7D_G�X MSI[IcM � @[W_j HJ�_GJ\5TZ@[MSWi\��8CU ; ghD<F9T4@C\$HJ�_GJ\5TZ@[MSW U��8 p�; ghD<F9T4@C\$HJ�_GJ\5TZ@[MSW�p �8 o!; ghD<F9T4@C\$HJ�_GJ\5TZ@[MSWAo �

8 oPF!;�ghD<F9T4@C\#HJ�_GJ\5TZ@[MSW�oSF �8 oSO ; ghD<F9T4@C\#HJ�_GJ\5TZ@[MSW�oHO/�

" ~�� GREB @C\5G4o<| Q ?�F��SG(FuQiFHREFHjSREFHQ<D�\ZGbPGREFHI_I[@[W_GJ\+IcMPW_j-FSW<m �<\ZG(@cT � @cTZD�T7D_G ��¤!���!� BMSW;TZR7MSI � MSREmTZM�\ZGGsTZD<G��5D<FSW_jS@[W_j-@[W<m GJW;TJ| � r(M � TEF��SG)TZD<Ga\ZFSUVG�Q<FSR7FSjSREFHQ_D FSW<m �<\ZGs@cT � @fT7DAm @�� GR7GW;T{b9FHI:�_GJ\MHX � �&�[�0¤� ��A�� A�VFHW<m ���0�-¤��A�i|

r(M � I[G T \�\ZGG^D_M � T7MsQ3� T�\5QiFSB G�O G T � GGWVQ<FSR7FSjSREFHQ_D<\J|L]^D_G4BMSW;TZR7MSI � MPR7m � ���<��� �0¤ ��@C\��<\5G mTZM�m GTZGR7U�@cW<GsD<M � U)�<BED \5QiFSB Gs@C\+W<MSR7U�FSIcI[d�I[G X T{OiGT � GJGW Q<FHREFHjPR7FSQ_D<\J| �NMV@fX dSM!��Q�� T�� �&�<�_� �0¤ �� ¢!� �-�uFHT T7D_G+O GjP@cW<W_@cW<j)MSX_dSM��<R ] ~ � \ZM��_REB G�<I[GSk TZD<GR7G � @[IcINO G@U p{Q MS@[W;T7\ OiGT � GJGW Q<FHREFHjPR7FSQ_D<\�_W_I[GJ\7\�MHT7D_GRu@[W<\5TZR��<B/T7@cMPW<\uFHR7G�jS@[bSGJWL|V]^D<G B MSW;T7RZMPI � MSREm��[��� �0¤ ��BJFHW OiG �<\ZGJmYTZMA@[W<\ZGRZTuG��NTZREFbSGJR5T7@[BJFHI \ZQ<FSBGsO G T � GGJW�Q<FHREFHjPR7FSQ_D<\J| } X �=��� �0¤ � ¢%¤� �MSR��[��� �0¤ � �-¥ �-� FHQ_Q GJFSR7\�O G T � GGW T � MQ<FSR7FSjSREFHQ_D<\JkPTZD_GJW T7D_GuG��NT7R7F�\ZQ<FSBGs@C\^@[W<\5GJR5T7GJm |

]^D_GJRZG�FSRZG�F�B M!�_Q_I[GVMSX+Q GJB��_Ic@CFHR7@cTZ@[GJ\�MHX��[�����0¤ ��TZD<FHT-\5GJGU HJ�_@cTZG \5TZREFHW<jSG�F9T"�<RE\eT |�} X�dPM��D<F bPG �[�����0¤ � ¤� aFHWimuTZD<G�\��N@cQV\eTEFHRZT7\ T � M)@cW<BED<GJ\ X RZMPU2TZD_G�OiMST5T7MSU MHX<TZD_G�Q<FHjPGSk TZD<G�R7GJ\5T MSX_TZD<GQ<FSjSGs@[\^\��;@[Q_Q GJm k O3� T^TZD_G�G��NT7R7F-MSW_Gs@cWiBED @C\1" ��� \C�N@[Q_Q GJm F9T�TZD_GsTZMPQ MSXLTZD<GsW<G��NT�QiFHjSGP|y} W MSTZD_GJR� MSREm_\k �=��� �0¤ � M�L����� 1&�O�L��� *��!� ����� ��* � ���B1 �� � ��� * 01 � � � � �!�5*��S| } W X FPB/T k �[��� ��¤ � ¢¯¤ � @[IcI�D<F bPG W<M G�� G B/TaF9TaFSIcI�@cX+@cTaD<FHQ<QiGJW<\sTZM�FHQ_Q GJFSRaF9TsTZD_G�T7MSQ MHX^F�Q<FSjSG!� x_MPRuU�FHWNd�TedNQiG \�MHXbSGJR5T7@[BJFHIL\ZQ<FSB@cW<j T7D_@C\{@[\9H!�<@fT7GaFHQ_Q_R7MSQ<RZ@CF9T7GS|�]^D_Ga\ZQ<FSBGuOiGX MSR7G�F�\ZGJB TZ@[MSW D_GJFPm @[W_j<k X MPR{G��_FHU�Q_I[GSk\ZD_M��_ICm W_MHT(BMSW;TZ@[W��_GuFSB R7MP\7\�Q<FHjPG)O M��<W<m_FHR7@[GJ\J|

� \Z@cU�@[I[FSR^Q_D_GW<MSU�GW_MPW M BJB��_RE\^F9T^TZD_GuO GjP@cW<W_@cW<jVMSX dPM��_R{m M B��<UVGJW;TJ|�} Xek X MPR{G��_FHU�Q_I[GSk dPM��� FHW;T^F-TZ@cTZI[G�Q<FHjPG � @cTZD TZD_GsT7@fT7IcGuFHO M��_T�D<FSIfX � F d�m M � W�TZD_GsQ<FSjSGSkNdPM�� BJFHW W_MHT^@cWi\5GJR5T�TZD_Gu\ZQ<FSBGF9T^T7D_G�TZMPQ MSX T7D_GuQ<FSjSGE�<\5@[W_j �[��� ��¤ � |

vL� T � DiF9T�@cX dSM���R7GJFSIcI[d � FHW;T�\ZMSU�G4O_ICFHW��V\5QiFSB G4FHTTZD<G{TZMPQ�MHXLF�Q<FHjPG � �M�� BM��_ICm�\eTEFHRZTTZD<GQ<FSjSG � @cTZD�����O�� T)TZD_@C\(@[W�G�� G B/T(TedNQ GJ\ZG TE\)F�MPW_G-I[@[W_GaQ<FSR7FSjSREFHQ_DAB MPW;T7FH@[W_@[W_j F O<I[FSW�� |9�NM � D_@[I[GW_MSTZD_@[W_j @C\^TedNQiG \5GTJk<TZD_G G��NTZREF�\5Q<FPB Gam��<GuTZM�T7D_Gab9FHI:�_G \4MHX �=�&���[�A�&¤� ��&� �0¤ ��FSW<m � �&�<��� ��¤ � � @[IcIFSm<mYG��;T7R7F \ZQ<FSBGS|-�(WzG FS\Z@cGJRsU�GTZD_M mz@[\sT7M �i\5G �[���&�=�&� @cW<\5TZG FSmYMHX �[��� �0¤ � TZM�jPG TsTZD_G m G \5@[R7GJmR7GJ\��_IfT |]^D��<\��[���&�=�&��¢%¤� � @[I[ILIcG F bSGsMSW_G�@[W<BED�MHX O_I[FSW�� \ZQ<FPB GuF9T^TZD<G�TZMSQ�MSX TZD<GuQ<FHjPGS| �! !"$#�%&%')(+, � *

g G BJFHW�W_MSTZG @cW�QiFS\7\5@[W_j�TZDiF9TsTZD_GJRZGa@C\sFHW_MSTZD_GJR(U�MSR7GajSGJW_GREFHI U�G TZD<MNmATZM�Q3� T)U�F9T7GR7@[FSI FHTTZD<G�TZMSQ MHXyF-QiFHjSG6�<\Z@[W_j-T7D_GaB MPW;TZR7MSI � MPR7m<\ �[��� �0¤� 0�[�<�c��FHWim �c�� A��¤� 0�[�[�-� |L} X �[�A� �Z¤� 0�=�<�-� ������c�� A��¤� 0�[�[�-�V@[\9�<\ZGJm � @fT7D_@[W�F�Q<FHjPGSk T7D_GaU�F9T7GR7@[FSI OiGT � GJGW �[��� �Z¤� 0�[�[�-��FHW<m �c�� ��_¤� 0�[�<�c� � @[IcIFHQ<QiG FHR4F9T^T7D_G�TZMPQ MSX T7D_GuQ<FHjPGSk @cX Q MP\7\Z@cO_I[GS|x<MSR{G�� FSU�Q_IcG!�

p�O

Page 32: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

�[��� �Z¤� 0�[�[�-��[�����0¤ � ¢%¤� ���[�� A���<�&��¤� &�0����¤ �c�-�A�r¢ ��c�� A��¤� 0�[�[�-�@C\R�<\5GX �_I X MPR4@cWi\5GJR5T7@cW_j7�<j!�_R7GJ\�MHX�FVQ_RZG \ZBRZ@[O GJm \5@:FGP| �! !"$#�%&%')( 4�4 �

]^D_GJRZG FHR7G FHIC\5M�\ZMSU�G \ZQiG B @CFHI+BMSW;TZR7MSI � MSREm_\�X MPR-U�F��N@[W_j�\ZU�FSIcI+bSGJR5T7@[BJFHI\��;@[Q<\J|A]^D_Gd FHR7G���'���A�-��� ��¤ � k �4�0�c�_���0¤ � kPFSW<m��=�Z¤ �����0¤ � |+�(GR7Gs@C\^T7D_Ga\5@:FG�MSX G FSBED�MPW_G��

���D�0�A�-�����0¤ �.� �4�0�<�_� �0¤ �V� �=�Z¤���� �0¤ �V�

���� � �5&s3 8 $-3

x<MSR-U�M;\eTVU�FHTZGJRZ@CFHI�] ~ � m MNGJ\-FYjSMNM m AeMSO MSX4O_R7GJF��N@[W_j?�_Q FYQ<FHREFHjPR7FSQ_D @cW;TZMzIc@[W_G \| v �_T\ZMSU�G T7@cU�GJ\ @cT \-W_G B G \Z\7FHR7d�T7MzFSm<m X �_RZTZD_GJR @[W<\5TZR��<B/T7@cMPW<\|Y} T \ Q MP\7\Z@cO_I[G�T7M�X MSREB G F�W_G � Ic@[W_G�ONd@[W<\5GJR5T7@cW<j����A��¤[�-� �=�-���-� ��@[W dSM!�_Ra@[W_Q�� T �<IcGP|�} T \VFHIC\5MAQ MP\7\5@[O_I[G�TZMzQ�� T�\5MPUVG TZG��NTVMSW FAI[@cW<GONd�@cT7\ZGIcXL�<\Z@[W_j�T7D_G B MPW;TZR7MSI � MPR7m �-��¤� &�0� ����� �3� TZD_GJWzT7D_G�U�F9TZGJRZ@CFHI�O G T � GGJWYT7D_G�O_REFSB G \ � @cI[IO GR7GJ\5TZR7@[B TZGJm�TZM MSW_GVI[@cW_G�8 FSIfT7D_M��<jSD�T7D_G�RZG \C�<IfT � @cI[I�O GV\ZQ_R7GJFSmYM�� T�M9bSGJR4T7D_G � D_MSI[G I[@[W_G�FHW<mYU�F dO GuD_MSR7RZ@[O_I[G ; |]^D_GaB MPWPT7RZMPI � MPR7m_\��-�c�c�c���&¤� &�0� ����� �<k �[��¤ ���A�&��¤� &�0� ����� �<k<FHWim ���[�� A�A�<�&�&¤� ��0� ����� �� @[IcI kNRZG \5Q GJB TZ@[bSGI[dSkN\ZG T�T7D_GsU�FHTZGJRZ@CFHI OiGT � GJGW�T7D_G(O<R7FPB GJ\+MSW Fa\5@[W_jPIcG)Ic@[W_GsMSW�T7D_G)I[G X T^U�FHR7jS@[WLkSMPWTZD<GuRZ@[jSD;T{U�FHR7jS@[WLkNMSR4B GJW;TZGR7GJmL|y]^D��<\

�-�c�<�c�&�&¤� ��0�&·yªU�r�<���[� �� ����� �<�c�c�H�)����[�� A���<�&��¤� &�0�&· ªU�V¤� ���&� �[�� A���[�H�)��[�0¤����A�&�&¤ &�0�&·yªL� �� ���&�F�0¤����A�H�)��-�&¤ &�0�&· �[���:���[�-�!�V���E�&�V� �A���c�c�¯�[�A� �A�-�%�<���[�r���&� �_�c�&�[��)�Q_R7M m��<B G \�TZD_G�X M!�_R{I[@cW_G \��

} U M9bSGJR^MSW TZD_GuI[G X T |} U @cW T7D_GaB GJWPT7GR |

} U MSW T7D_GuRZ@[jSD;T |} A �<\eT \5GJGU T7M OiG \ZQ_R7GJFPm M!� T FHI[I M9bPGR TZD_G Q<I[FPB GS|

t(T7D_GR(Ted;Q GJ\(MHX\ZQ<FSB@cW_j BJFHW�O G-MSO_T7FH@[W_G m ONd �<\Z@cW_j TZD_G-BMSW;TZR7MSI � MPR7m �����_¤[�<|+]^D<@[\)BF��i\5G \FHI[I_T7D_G4G��;T7R7Fu\ZQ<FPB G{@[W�TZD_G4I[@[W_G4T7MuOiGsFSBB��_U)�<I[FHTZGJm�FHTTZD_G(QiM;\5@cTZ@[MSW � D_GJRZG�������¤[��FHQ_Q GJFSR7\J| ]^D��<\@cX � G FHIcTZGJRaM��<RuI[FP\eTaG�� FSU�Q_IcG�T7M �-��¤� &�0�&· �=�0�:���[�-�!�V���F�&� � �A�A�-�c�¯�[�A� �����_¤[�F�A�-�¯�<���<����&� �_�<�&�[�w�)� � G � @cI[ILjPG T

p�Q

Page 33: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

}+A �<\eT(\ZGGJU TZM�O Ga\ZQ_RZG FSm�M�� T FSIcILM9bPGR+TZD_GuQ<I[FPB GS|

} X � G�DiF bSG�U�MSR7G T7D<FHW MPW_G �����¤[�<k TZD_GJd � @[IcI�m @cbN@Cm G FHWNd�G��NTZREF \ZQ<FPB G�FHU�MSW<j T7D_GU�\ZGI[bSG \GHJ�<FSIcI[dS| �(GW<BG �c�&¤� &�0�c�c�c�c�F�A�<�-� �����_¤[� �[�� A���[�%���<�-� �����¤[����¤ ���A�%���[�-�H�)� � @cI[I Q_R7M m��<B GI[G X T{TZG��NT B GJW;TZGR^T7G��NT R7@cjPD;T�T7G��NTJ|

" ~ � GREB @C\ZGso<|�� ]+d;Q GJ\ZG T{T7D_G�X MSI[I[M � @cW_jVI[@cW_G!�I[G X T4GWim I[G X T{TEFSBY�NI[G I[G X T4j!�<FHREm BGW;TZGJR RZ@[jSD;T^j��<FSR7m R7@cjPDPT�T7FPBY�NIcG R7@cjPDPT{GJW<m

" ~ � GREB @C\5G o_| W ]�dNQ GJ\ZG T�TZD_G X MPIcI[M � @cW<jYI[@cW_G � @cTZD T � @[BG FP\VU)�<BED \5QiFSB G OiGT � GJGW �5I[G X T �zFSW<m�5R7@[jSD;TC� B GJWPT7GR �-FP\^OiGT � GJGW �5R7@cjPDPT�� BGW;TZGJR � FHW<m �ZRZ@[jSD;T �3�I[G X T RZ@[jSD;T�� BGW;TZGJR R7@[jSD;T

} T \{Q MP\7\Z@cO_I[GsTZM�U�M9bSGsD_MPRZ@:FMPWPTEFHI[Icd �i\5@[W_j ����� �0¤ ��@cWAFVU�FHW_W_GJR4FHW<FSIcMPjSM!�<\ � @fT7D �[��� �0¤ � |

" ~ � GREB @C\ZGso<| N ghD<FHT4D<FHQ_Q GWi\ � @fT7D TZD_G�X MPIcI[M � @cW<j @[W_Q�� T ��-�&¤ &�0� ����� �0¤ ��¢¯¤� ¨ ­-°����A��¤[� ® � ¨ �����_¤[� ® ¹ «-°c°��

]^D_GuR7@[jSD;T�A �<\eT7@ � BF9T7@cMPW BJFHW�O GaBFHWiB GI[GJm ONd'�<\Z@cW<j T7D_GaB MPW;TZR7MSI � MPR7m �[����� ���c�c��¤ ���A� |

������ .{.�:<&s.:_3y8

]^D_GujPGW_GJR7FSI Q<F9TZTZGR7W TZM�U�F��PG)X MNMSTZW_MSTZGJ\R�i\5@[W_j�] ~ � @C\��<�A�c�<�� &�<�A�0� ����� ��� ����� �<|]^D_GVX MNMHT7W_MHT7G�U�FHR��AjSMNGJ\s@[W O G T � GGJWYT7D_G=�<RE\eTa\ZG TuMHX�O_REFSB G \| �NMPUVG�F b9FH@[ICFHO_I[G U�FSR�� \�FHR7G

�<�A��� � � �;k �<�-�-��� ��� �Nk � ³ ��� �Nk�FSW<m � ¸ ��� �N| ]^D_G TZG��NT MSX)T7D_G�X MNMHTZW<MHTZG�jPM;G \�OiGT � GJGW TZD<G\ZGJB MPW<m \ZG T�MHX)O_R7FPB G \| ]^D_G �<\ZG MSX(W��_U-O GRE\�FS\ U�FHR��N\V@C\�F�I[@fTZTZI[G I[GJ\7\�\eT7R7FS@cjPD;T5X MSR � FHREm | ]^D<GX MNMHT7W_MHT7G * 4(FHT+T7D_G�OiMST5T7MSU MSX TZD<GsQiFHjSG � FS\+Q_RZM m��iB GJm ONd �<\Z@cW_j �<�A�c�<�� &�<�A�0� ���������c�0¢�� � ���=®��Z¤[�¤c� ���&�%�A�-�[�� &�<���E�<� ���&�E�&�<�-���4� �<�¯���&� �������w�)��FHX TZGJR�TZD_G � MSREm �5X M;MSTZW_MSTZG�� @[W TZD_G�T7G��NTJ|]^D_@C\ BMSW<\5TZR��<B TZ@[MSW @C\ \ZMSU�G � D<F9T�B MSU�Q_I[@CBF9T7GJm.� � G! I[I{\5GJG � DNd @cT \ TZD_@C\ � F d � D_GJW � G �NW_M � FI[@fTZTZI[GuUVMPRZGuFSOiM!� T^Ted;Q GJ\ZG TZTZ@[W_j�U�F9T7D_GU�F9T7@[BJ\|�vL� T{X MPR^TZD_G�U�MSU�GW;T � GuBFHW I[M;M!��F9T{@cT(FS\^F � F dMHX+jSG TZTZ@[W_j TZD_GEAeMSO m MSW<GS|6�M�� U�F d � FSWPTsTZM �<\ZG��[�=� � @fT7D_@[WYT7D_G-X MNMSTZW_MSTZGVTZM GW<\��_R7GaT7D<F9T�TZD<GR7@cjPDPT�X MPW;T�FHQ_Q GJFSR7\J| `)\C�<FSIcI[d-dPM�� � @[IcIiW_MHT � FHW;T�Fu\ZQ<FSBG�O G T � GGJW�TZD_G^T7G��NT+FSW<m TZD_G(BMSW;TZR7MSI � MSREm�A�-�[�� &�<���<| �! !"$#�%&%')( 4�4 * 4z]^D_@C\{@C\�TZD_G�X MNMSTZW_MSTZGaF9T^T7D_GuOiMST5T7MSU MSX T7D_GuQ<FHjPGS|

p �

Page 34: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

M�FHjPG�p�W

" ~ � GREB @C\ZGso<| U P ?YF��SG6�_Q�F�Q<FSjSG � @fT7D�F�R7GICF9T7@cbPGI[d�IcMPW_jVX MNMHTZW<MHTZGu\ZQ<FHW<W_@cW<j�\ZGbPGREFHI I[@cW_G \|

" ~ � GREB @C\ZGso<| U!U ?YF��SG6�_Q�F�Q<FSjSG � @fT7D T � M�m @ � GJRZGJWPT{X MNMSTZW_MSTZGJ\^MPW�@fT |

������ 3 $�=�* �5&s3y8 $�&�= � .{.�:<* �Z&)3y8

]^D_G�Ic@[W_GJ\LX MSR T7@fT7IcG�FHW<m�QiFHjSG�W��_U OiGJR7\ TZD<FHT jSM4FSOiM9bPG�FHW<m�O GI[M � TZD_GU�FS@cW�T7G��NT FHR7G�Q_R7M m��<B G mONd'�<\Z@cW<j ��&�-�c����¤� &�c�/� ����� ��FHWim �<�A�-�<���&¤� &�c�0� ����� �_| �! !"$#�%&%')(+* � * �&* �,

]^D_G{Q<RZ@[W<B @[Q_I[G{@[\�TZD_G4\7FHU�G4FS\��i\5@[W_j�TZD<G4B MSW;T7RZMPI � MPR7m��-��¤� &�0� ����� � � @fT7D_@[W�TZD_G$�<\��<FSI TZG��;TMPWTZD<G�Q<FSjSGS| � D_GI[Q X �_I BMSW;TZR7MSI � MSREm�@[\ � �������� &� � D_@[BEDuR7GQ<RZG \5GJWPTE\ TZD<G+B��<RZR7GW;TLQ<FSjSGW��_U OiGJRJ| ]^D��<\���&�c�c���&¤� ��c�/� ���A��¤[� �[���� -�=� ¸ ����� �[���&� � �&������ &�0� � M��_ICmzBJF��<\ZG TZD_G�Q<FSjSG�W��_U-O GR�T7MAFHQ_Q GJFSR@[W TZD<GE�<Q_QiGJR^RZ@[jSD;T{B MSR7W_GJR+Q_R7GJBGJm G m ONdVTZD_G � MSREm ��M�FSjSG��'8 W_M � I[MNM�� FHT+T7D_G6�_Q_Q GR^RZ@[jSD;T{B MPRZW_GJRMHXiTZD_@C\�Q<FSjSG<;/| } T@[\�\7F9X GJRyTZM�G�� Q_I[@[B@fT7Icd W<FHU�G�TZD<G^X MSW;TyTZD<FHTdSM�� � FHW;T T7M"�<\ZG68 @cWVT7D_@[\�BFS\ZG �=���� A�=�TZM �<\5G�T7D_G U P�QiMP@cW;T(R7MSU�FSW X MPW;TY;/k \5@[W<BGadSM!��FSRZGuW<GbSGJR4j��iFHREFHW;TZGJGJm�TZD<FHT)F�Q<FHRZTZ@CB��<I[FSR{X MSW;T � @[IcIO G�@[W��<\5G � D_GW T7D_G D_G FSm I[@[W_G�MPRuX MNMHTZI[@[W_G @C\ \ZG T |�]^D_G�B MPW;TZR7MSI � MSREm �=���&��TEF��PGJ\�T7D_G�@[W;TZGR7W<FSIb9FHI:�_GVMHX�T7D_G�W_G��NT � MSREmA@fX�@fTu@C\uFHW FHQ_Q_R7MSQ<RZ@CF9T7G B MPW;TZR7MSI � MPR7mzFHW<mYQ_RZ@[W;T7\�@cTaFS\)TZG��;T | �M!�zBFSWFHIC\ZM'�<\ZG-T7D_G BMSW;TZR7MSI � MPR7m �<�A�A�&¤:� @cWi\eT7GJFSm�MHX �[����� � �&������ ��i|(]^D<G m @ � GJRZGJW<B GV@C\4T7D<F9T �[�A�A�&¤=�� @[IcILjP@cbPG)R7MSU�FSW W��_U�GREFHIC\ � D_GJW � �&���A�� &� @[\4W_Gj;F9TZ@[bSGP|

�M!� BFHW FSI[\ZM�FS\7\Z@cjPWzb9FHI:�_G \uTZM � �&������ �� @cX{dSM!� � FSWPTadPM��_R m M B��_U�GW;TaT7M �<\ZG F�m @ � GJRZGJW;T\ZGHJ�_GWiB GAMHXuQ<FSjSG�W��_U OiGJR7\�X RZMPU T7D_G �<\��<FHI | n{MSU�FSW W��_U�GJR7FSI[\ BJFHWhO G�Q_R7M m��<B G m ONd �<\Z@cW<jW_GJjPF9T7@cbPG)W��_U OiGJR7\� � �&������ &�c����¢)F9T^TZD<GuOiGJjS@[W_W_@[W_j�MHX�FVm_MNB��_U�GW;T � @cI[I BJF��<\ZG�Q<FHjPG)W��_U OiGJR7\�T7MO Gu@cW�R7MSU�FHW WJ�<UVGJR7FSI[\J| � "$#�%&%')(+* � *

K)@�� GR7GW;T4D_G FSm I[@[W_GJ\{BJFHW OiGuQ_R7M m��<BGJm X MSR{GJbSGW�FHWim�M m_m Q<FSjSGJ\^@[W TZD_G�X MPIcI[M � @cW<jVU�FSW_W_GR ����&�-�<���&¤� &�<�/� �&¤:�-�c�c� � �&���A�� &� � ����� � �c�-���[� � ����� � �<�_¤��

� D_GJRZG�TZD_G+U�FHTZGJRZ@CFHI;OiGT � GJGWuT7D_G �<R7\5T \ZG T MHX_O_REFSBGJ\ @[\ X MSR TZD_G�R7@cjPDPT�� DiFHW<m�Q<FSjSG \ FHWim�TZD_G�U�F9T7GR7@[FSIO G T � GGW T7D_Ga\5G B MPW<m \ZG T{MSX O_REFSBGJ\�@C\^X MSR^T7D_GuIcGX TC� D<FHWim�Q<FSjSG \|

" ~ � GREB @C\ZG o_|:U p l+D<FSW_jSGVTZD<G X MNMSTZI[@cW_G�\ZM�T7D<F9TuT7D_G�Q<FHjPG W��_U OiGJRu@[\�BGW;TZGJRZG m � @cTZD F GW�� m_FS\ZDMSW G@cTZD<GR(\Z@[m_GS|

p�W

Page 35: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

������ �+3 0i, 's*Z*V$�&�= '�&s=s3 0<, '�*5*1�-.��43y8

t)W_GYMHX�TZD_GYUVM;\eT�X R��<\5TZREF9T7@cW<j G�� QiGJRZ@[GWiB GJ\�X MSR T7D_G�W_G � ] ~ � �i\5GJR @[\ TZD_GYMNBJB��_R7R7GW<BGAMHXM9bSGJR5X �<IcI FHW<m �_W<m GJR5X �<IcI O M<� GJ\J| ]^D_GJd FHR7Gsm��_Icd�W<MHTZG m @[W�T7D_GsIcMPj)�<I[G�FHW<m FHR7G)FHIC\ZM � R7@fTZTZGW TZM TZD<G\7B R7GGW � D_GW�] ~�� @[\yO G@[W_j�R��<W @[W;TZGREFSB TZ@[bSGJIcdP|yt)bSGJR5X �<IcINO M<�NG \�FHR7G�FSI[\ZMsU�FSR��PGJm-MSW TZD_G{M!� TZQ��_TyONdF�\ZI �_j 8 F�I[FSRZjPGE�<IcI[GJm�� @[WAO_ICFSBY� R7GJB T7FHW<jSI[G�TZD<FHT4IcMNM�� \{I[@:�SG�TZD<@[\� ;{@cW TZD<GaRZ@[jSD;T4U�FHR7jS@[WL| �FSRZ@[M��i\MSOi\ZBGW_G)TZGJRZU�\{FHR7G)FSQ_Q_I[@cG m T7MVTZD_@C\{\5I:�_ji| } T4FSQ_QiG FHRE\�GbSGJW T7D_M��_jPD�T7D_GR7G�@[\�W_MSTZD_@[W_j � R7MSW_j � @fT7DTZD<Ga] ~ � @[W_Q�� T | �NM � DNd @[\{TZD_Ga\ZI �<j T7D_GR7GuFHW<m � D<FHT4BFHW�O Gam MSW<G�FSOiM!� T{@fT&�

� jSMNM m � F dsTZMsb;@C\��<FHI[@ FJGT7D_G � F d�] ~ � MSR7jPFSW_@:FGJ\ F(QiFHjSG+@[\ T7M(T7D_@cW3�uMHX_T7D_G^Q_RZ@[W;TZG maU�F9T7GR7@[FSIFS\yO G@[W_juQ��_T�@cW;T7MuOiM<� GJ\J| ]^D<GR7G4FHR7G+T � MsTedNQiG \�MHX OiM<� G \�� �0@A���_�2��FHW<mQlA@A���&�D�| ?AMP\5TMHX TZD<G{TZ@[U�GTZD<GJ\ZG B MSR7R7GJ\ZQiMPW<m�T7MATZD<G�MSR7jPFHW<@ F F9TZ@[MSW MHX^D_MPRZ@:FMPWPTEFHIyT7G��NT-@[WPT7MAIc@[W_G \aFHW<m bPGRZTZ@CBFSI�Q<FHREFHjPR7FSQ_D<\@[WPT7M QiFHjSG \|y} W Q<FHRZTZ@CB��<I[FSRJk;@fT4@C\+TZD_Gu\ZQ<FSB@cW<j MSX TZD<G � MSREm_\+@cW�F D;O M<� BMSR7RZG \5Q MSW<m_@cW_jaTZM�F-I[@[W_G�MHXTZG��NT{TZD<FHT(BF��i\5G \�T7D_Ga\ZI �_j�T7M�FHQ_Q GJFSRJ|

n{G BFSIcIyT7D<F9Ta] ~ � R7GJFPm_\)@cW TZD<G�BMSU�Q_I[G T7GVQiFHREFHjSREFHQ<D�OiGX MSR7GVm_GJB @Cm @[W_j�D_M � T7M O<RZG F��A@cT �_Q@[WPT7M�Ic@[W_GJ\J| ]^D<@[\y@C\yOiGT5T7GRyTZDiFHW � MPR��N@[W_j)F)Ic@[W_G{F9TF(TZ@[U�GSkP\Z@[W<B G^F�\5I[@cjPD;T @[U�Q_RZM9bPGU�GW;T @cWVMSW_G^I[@cW<GU�@cjPD;T�BF��<\ZG4BF9TEFS\5TZR7MSQ_D<@[B4BEDiFHW_jPGJ\yX FSR5T7D_GR�m M � W�@cW TZD_G)Q<FHREFHjPR7FSQ_DL|LghD_GJW � MSREm_\�FSRZG{j;F9TZD<GR7GJmTZMPjSGTZD_GJR+T7MVX MSR7U F I[@[W_GSk_\ZQ<FSBG)@C\{FSm<m GJm OiGT � GJGW TZD_G � MSREm_\+TZMEA �<\5TZ@cX d�TZD<GuRZ@[jSD;T^U�FSRZjP@cW | ��GJRZdICFHR7jSG�\5Q<FPB G \�OiGT � GJGW � MPR7m<\)@C\uMPO;bN@[M��<\ZI[d?�_W<m G \5@[R7FSO_I[G�� TZD_G�O<FPm W_G \Z\�MSX+T7D_G�Ic@[W_G�@C\aF U�GJFS\��_R7GMHXyD_M � O<FSm I[d�T7D_G � MPR7m<\�FSRZGu\ZQ<FSBGJm |�(W��_W<m GJR5X �_I[ILDNO M<��U�GJFHWi\�TZD<FHT{TZD_GJRZG�@C\^TZMNM�U)�<BEDA\ZQ<FSBGO G T � GGW � MPR7m_\J|4?AMPRZGV\5Q GJB@ �iBJFHI[IcdPk<T7D_G-OiFSm W_G \Z\(MHX�FSW;d I[@cW_GV@C\(F W��_U OiGJR)O G T � GGJW P 8 QiGJR5X G B/TY;FHWim�UP!P�P�P?8 D_MSR7R7@cO_I[G ; |s]^D<GR7Ga@[\�F�Q<FHREFHU�G T7GR(BJFHI[IcG m ���-���c�� &�&�c� � D_MP\ZG m GX F��_IcT)b9FSI �_GV@C\)U P�P�P<|�4WNd I[@[W_G � D_MP\ZG�O<FSm W<GJ\7\ @C\�jSR7GJFHTZGJR T7D<FHW ���-���c�� &�&�c� @[\ RZGJQiMPR5T7GJm FP\�FHW �_W<m GJR5X �_I[I4DNO M<� | } XTZD<G b9FHI:�_GVMHX ���-�&�c�� &�&�-�-@C\)@[W<BRZG FS\ZGJm kiTZD_GJW�X G � GJRE�<W<m GRZX �_I[IyD;O M<� GJ\ � @cI[IyOiGVR7GQ MSRZTZGJmL|s} WYX FSB T���-���c�� &�&�c�>��¢4¥-¥-¥-¥ � @cI[I\C�<Q_Q_R7GJ\7\sTZD_G�R7GQ MSRZTZ@[W_j MSX �_Wim GRZX �_I[I�D;O M<� GJ\uFSIfT7MSjSGTZD_GJRJ|7�N@cU�@[I[FSRZI[dSk@cXTZD_G � MSREm_\(U �<\5TsO GV\�HJ�_GGFG mA@cW;T7M F�Ic@[W_G�\5M�TZD<FHT)T7D_GV\ZQ<FPB GJ\sFHR7G-bPGR7d \ZU�FHI[IyMSR(GJbSGJWz\ZM TZD<G� MSREm_\�G��NTZGJW<m�F I[@cT5TZI[Ga@[W;TZMVTZD_GuR7@[jSD;T{U�FSRZjP@cW kPT7D_GW�FSW M9bPGRZX �_I[I DNO M<��R7GJ\��_IfTE\|

} W�F�\5@[U�@cICFHR � F dSkP\5MPUVGTZ@[U�GJ\�] ~ � FSIcI[M � \yF�Ic@[W_G�TZMuO G4\ZIc@[jSD;TZI[daI[MSW_jPGR TZDiFHW �����A¤��A�s@cWVMSREm GJRTZM�FSBED<@cGJbSG+F)U�MSR7G+OiFHICFHW<BGJmaFSQ_QiG FHREFHW<BGS| ]^D<G^BMSW;TZR7MSI � MSREm �[�A�A�c�<���� 0�[�{m GTZGJRZU�@[W_GJ\ � D_GJW-T7D_@[\D<FSQ_QiGJW<\J| } X TZD_G)O<FSm W<GJ\7\�MSX FuIc@[W_Gs@[\+jSR7GJFHTZGJR�TZD<FSW �[���-�c�<���� ��[�ikH] ~ � � @[IcI U�F��SG4TZD_GsIc@[W_G)IcMPW_jSGJRONd FSm<m @cW<j FzW_G � � MPR7m F9TVTZD_GAGJW<m MHX4T7D_GAIc@[W_GPk�GbPGW TZD_M!�_jSD @fT�U�@[jSD;T�G��_B GJGJm T7D_G�b9FHI:�_G�MHX���0�-¤��A�i| �hI[@cW<G � D_@CBED�@[\�MSW_I[d \ZIc@[jSD;T7Icd IcMPW_jSGJR@[\�\5GT � @fT7D_M��_T�OiGJ@cW<jaRZGJQiMPR5T7GJm |y]^D_G(BMSW;TZR7MSI � MSREm�����[� � �sm G T7GR7UV@[W_G \yD_M � U)�iBED-G��_BGJ\7\ @C\yFHI[IcM � GJm%�9TZD_G{m GX F��_IcT�@[\ �����<� � �%� ¥�'¢ �-� | � I[@[W_G�TZD<FHT@C\+U�MPRZG(TZD<FSW \ZIc@[jSD;TZI[d�I[MSW_jPGR+TZD<FSW����0�-¤��A�u@C\�MSONbN@cM!�<\ZIcd�FV\5GJRZ@[M��<\�Q_R7MSO_I[GU��_] ~ � Q�� TE\{F-\ZI �<j @[WTZD<GaU�FHR7jS@[W�T7M�U�F��SG�@cT7\4Q MS@[W;T{X MSREB GX �_IcI[dS|+} T \{Q MP\7\5@[O_I[G�TZM F bSMP@[m M9bSGJR5X �<IcI DNO M<�NG \{FHIcTZMPjSG T7D_GR{ONd@[W<B R7GJFP\5@[W_j�TZD<G4b9FHI:�_G(MSX��[���A�c�[���� 0�[�<| gh@cTZD��=���A�c�<�A�� 0�[����¢!¥c¥-¥-¥�T7D_GR7G � @[IcIiW_GbPGR+OiG4M9bPGRZX �_I[IO M<�NG \^MSR{\ZI �_j;\|]^D<G�m_G X F��<IfT4@C\��[���-�c�<���� ��[� � �-¥-¥i| � "$#�%&%')(+* �

p�N

Page 36: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NGJB TZ@[MSW�o��]^D_Gu\ZD<FHQ GuMHX TZD_@[W_jP\{TZM�B MPUVG

]^D_G � @[mNT7D MHX{T7D_G�\ZI �<j�@[\ m G T7GR7U�@cW_G m ONdYT7D_G�BMSW;TZR7MSI � MSREm �c�[���<�A�<�&�-�[�c�_�<�i|�} W<BI �im @cW<j�c�<�A�<�A�<�_�c�[�c�_�c�>� ¥ �A��@cW dSM��<R��<I[G � @cI[I m GI[G T7G^FSWNd)X �<R5T7D_GRyQ_R7@cW;T7@cW_jsMHX<TZD_G^\5I:�_j;\| ]^D_G+M9bPGRZX �_I[IO M<�NG \ � @cI[I \5TZ@[IcI O G�TZD<GR7GSk_MSXyBM��_RE\5GPk FHW<m�TZD_GJd � @[IcI Q_RZMPO<FHO<Icd�O GuD<FHREm GJR^TZM�\5Q MHT |

�NM � Gu\5GJG � DNd M9bPGRZX �_IcI O M<� GJ\^FHW<m �_W<m_GRZX �_IcI OiM<� GJ\^FSRZGsRZGJQiMPR5T7GJm.� � GuBFHW�FHIC\ZMVBED<FSW_jSG)TZD<GR7GQ MSRZTZ@[W_jYONd BED<FSW_jS@[W_jAT7D_G�b FSI �<GJ\ MHX �=�&�c�� &�&�-� k �����<� � � k�FHW<m��[�A�A�c�<���� 0�[�i|�} W FPm_m @cTZ@[MSWLk+F\ZU�FSIcI b9FHI:�_G4MSX ��0�A¤��A�uMSONbN@[M��<\ZIcd U�F��SG \@cT�U�MPRZG(m_@ � B��<IfT�TZM-\ZG T�Ic@[W_G \+FSW<m BF��<\ZGJ\U�MPRZG4M9bPGRZX �_I[IFHWim �_W<m GJR5X �<IcI DNOiM<� G \�TZM OiGsR7GQ MSRZTZGJmL| ]^D_G \5GsFHR7G � FHR7W_@[W_jP\yT7D<F9T^dSM!��@cjPW_MSR7G(FHT+dSM!�_R�M � W�QiGJRZ@[I5�

�)m_m @[W_j W<G � Q MP\7\5@[O_@[Ic@cTZ@[GJ\�MHXLDNdNQ_D_GJW<F9T7@cMPW � @[IcI \ZMSU�G T7@cU�GJ\+GI[@[UV@[W<FHTZG�FHW M9bPGRZX �_IcI O M<� |y] ~ �D<FP\�F�� T7MSU�F9T7@[B�DNdNQ_D_GWiF9TZ@[MSW�FSW<m)�i\C�<FSIcI[d"�<Wim_\�jSMNM m Q_I[FPB G \yTZM�DNdNQ_D_GWiF9TZG4F � MSREm.�HD_M � GbPGR k9@fT \Q MP\7\5@[O_I[GuTZM�FPm_m�DNdNQ_D_GWiF9TZ@[MSWi\^TZM I[G T)Ic@[W_GJ\(O_R7GJF�� F9T(W<G � Q_ICFSB G \|{x<MSR4G�� FSU�Q_IcGPk_T7D_G F�� TZMPU�FHTZ@CBDNdNQ_D_GWiF9TZ@[MSW � @[I[I W<GbSGJRQ�� T{FuDNdNQ_D_GJW @cW�TZD_G � MPR7m �7m_F9TEFHO<FP\5G��_|L} X dSM���TedNQ G(@[W �A�<�A� � �=�&���[�ik9@cT� @[IcI FHI[IcM � FuDNdNQ_D_GJW�TZM-O G(@[W<\ZGRZTZG m�F9X TZGJRT7D_G)\ZGJBMSW<m�I[G TZTZGR �ZF���@cW�T7D_G � MSREm | ?AMSR7G4jSGJW_GREFHI[I[dSkS@cXdSM!��Q�� T ��� � ������ &�<�0¤:�� �<�A�=��� �:�&���[� �{@cW�T7D_G4O GjS@[W_W_@[W_jaMSX dSM��<R�@cW_Q3� T�<I[GSkPTZD<GW FHI[I<M BJB��_R7RZGJW<B G \MHXyT7D_G � MSREm �7m_F9TEFHO<FP\5G�� � @cI[I FSIcI[M � DNdNQ_D_GJW<F9T7@cMPW�F9X TZGJR{TZD<G-I[G T5T7GR �ZF��<| ]^D<GaIcMPj=�<I[G � @cI[I \ZD_M � � "$#�%&%')(+* TZD<G Q MP\7\5@[O_I[G DNdNQ_D_GJW<F9T7@cMPW<\)MSWAT7D_G�Ic@[W_G�B MSW;TEFH@[W_@cW<j TZD<G M9bPGRZX �_IcI MSRE�_W<m_GRZX �_IcIyO M<� |"� MSU�G T7@cU�GJ\TZD<GaOiG \eT(\ZMSI:� T7@cMPW T7M FHW�M9bSGJR5X �<IcI MPR$�_W<m GJR5X �_I[ILDNO M<� @C\4F�Ic@cT5T7IcG#A �<m @CB @[M��<\{G m @cTZ@[W_j�MHX TZD_G-MSR7@cjP@cW<FSIm M B��<UVGJW;TJ|

t@�_R�m @C\ZB��<\7\5@[MSWAD<FP\(@[WNbSMPIcbPGJm TZD_G�\ZG T5T7@cW<j�MHX�TedNQ G @[W;TZM Ic@[W_GJ\Jk TZD<FHT)@C\k T7D_G-D_MPRZ@:FMPW;T7FHI Q<FHjPG\5TZR��<B/T��_RZGP|V]^D<GR7G�FSRZG�\ZGbSGJR7FSIybSGRZTZ@CBFSI�FHW<FSIcMPjP\J|�t)bSGJR5X �<IcI�FHWim �_Wim GRZX �_I[IDNOiM<� GJ\s@[W<m @CBFHTZG�D_M �� GI[I � MSREm_\VFHR7G j;F9T7D_GR7GJm @[W;TZM Ic@[W_G \| � @cU�@[I[FSRZI[dSk+M9bSGRZX �_I[I�FSW<m �<W<m GRZX �_I[I{bNOiM<� GJ\VFHR7G RZGJQiMPR5T7GJm� D_GJW Q<FHREFHjPR7FSQ_D<\aFSRZG�jPF9T7D_GR7GJm TZM�X MPRZU�Q<FSjSG \| � ICFHR7jSG�TEFHO_I[G T7D<F9T�BFSW% TVOiG O_R7M��PGW @[W TZD<GU�@[m<m IcGPk X MSRaG�� FSU�Q_IcGPk BJFHW Q_R7M m��<B G FHW �_W<m GJR5X �<IcI+b;O M<�YT7D<F9T @[\-RZGJQiMPR5T7GJm @cW T7D_G I[MSj��<I[G � D_GJWTZD<G Q<FHjPG�OiGJ@cW<j�Ted;Q GJ\ZG T @[\aBMSU�Q_I[G T7GJm |�]^D_G�BMSW;TZR7MSI � MSREm �=�c�&�c�� ��&�-� � MPR�� \sX MSRaTZD_G bPGRZTZ@CBFSIQ_ICFSBGU�GW;T{MHX TZG��;T4@[W TZD_Ga\7FHU�G � F d FS\����-���c�� &�&�c� � MSR��N\+X MPR{D_MSR7@ FJMSW;T7FSI TZG��NT |

" ~ � GJR7B@[\ZG�o_|:UJo ] F��SG�F X G � Q<FHREFHjPR7FSQ_D<\�FHW<m Q<RZ@[W;T TZD_GJU �i\5@[W_j b9FHR7@[M��<\?8 \5U�FHI[I ;�b9FHI:�_GJ\ MHX���0�-¤��A�aTZM�\5GJG � D<FHTL�N@[W<m MHX M9bPGRZX �_IcI O M<�NG \�RZG \C�_IcTJ|�n{GJQiG F9T � @cTZD�b9FSRZ@[M��<\+b9FHI:�_GJ\�MSX ���-���c�� &�&�c� k�����[� � � k;FSW<m �[�A�A�c�<���� 0�[�i|

o�P

Page 37: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

�������������� ������� ����� � �+��� ����� " � �Y��� ����� � �+��� ��� $ % '

]^D_G^B MPW<B GJQ TyMHX_jPFHTZD_GJRZ@[W_j(TZG��NTy@cW;T7M)jPRZM!�_Q<\ FSIcI[M � \ ] ~�� @cW_Q3� T+�iIcG \ T7M)O G�jSR7GJF9T7Icdu\Z@cU�Q_I[@ �<GJm |� W_G � jSR7M��_Q-@[\�\5T7FSR5T7GJmaONduT7D_G{BED<FHREFSB TZGJR$��FSW<muT7GR7UV@[W<FHTZGJm ONd�TZD_G{BED<FSR7FPB/T7GR �_|l+D<FSW_jSG \ U�FSm_G� @cTZD_@[W FAjPRZM!�_Q � @cI[I�IcM;\5G�T7D_G@[R-G�� G B/T � D_GW T7D_G�jPRZM!�_Q TZGJRZU�@[W<F9T7GJ\J| �NM<k X MPR-G��_FSUVQ<IcG @fX � �=������A�A�-�E�&�A�<�-�-�&�[� �&�[�A�_� �aFSQ_Q GJFHRE\+@cW dSM��<R�T7G��NTJkNT7D_G�MSQ GW_@[W_jVO_R7FPB Gs\eTEFHRZT7\+TZD_GsjSR7M��<QLk;TZD_G �=�A�B MPW;TZR7MSI � MPR7m BED<FHW<jSGJ\+T7M F O MSICmNX FPB GsX MSW;TJk_FSW<m TZD_GuBIcM;\5@[W_j�O_REFSB G@�<W_@C\ZD_GJ\R�_Q T7D_GujSR7M��_Q |y`(QiMPWB MPU�Q_IcGTZ@[MSW MHX+TZD_G�jPRZM!�_Q�T7D_G�X MSW;TuOiGJ@cW<j?�<\5G mY@C\sTZD<G�MSW_G�@[W G�� G B/TaO G X MPRZGVTZD<GVjPRZM!�_Q \eTEFHRZTZGJmL|]^D_@C\{@C\^TZD_G 8 GJFP\5@[GR ; � F d MHXyD<F bN@cW<j�FVX G ��� MPR7m_\^@[WAF�m @ � GJRZGJWPT{X MPW;TJ|�} T \)FHIC\5M�Q MP\7\5@[O_I[G�TZM�D<F bPGjSR7M��<Q<\�W_GJ\5TZG m � @cTZD<@cW�jSR7M��<Q<\|

�)\�FHW<MHTZD<GR�G��_FSUVQ<IcGPkP\Z@ FJG4BED<FHW_jPGJ\�BJFHW�OiG(U�FPm G{@[W�TZD_G^T7G��NTTZDiF9T+FSRZG^MSW<Icd-TZGU�Q MSREFHR7dS|yx_MPRG��_FSUVQ<IcG

����0�-¤��A�F�¯£ ¤� � �&�[�0¤� ��A�� A�F� ¥ �A��-�c�<�c��� �0¤ �¯��¢%¤� �Z¤[�c� �-���c�<�0�=�%� �&�[�����-��� ���%���&�[� ¤<�E�-�[�A�����P���0¤c�r¤c�E�� ��c�&�� � ¤c�:�A� ���E���>�0� �A� ���� �&�[��

� @[IcI Q_RZM m��iB G-F�Q<FSR7FSjSREFHQ_D TZDiF9T(@C\{X M!�_R4@[W<BED_GJ\ � @[m_G� @cTZD TZD_G^T7G��NT�M � \5GTy@[W;TZMsTZD<G�QiFHREFHjSREFHQ<DaONduMSW_G^@[W<BEDR7GjPFSR7m_IcG \Z\�MHX T7D_Gu\5GT5T7@cW_j;\^@cW G�� GJB T{OiGX MSR7G)T7D_Gu\eTEFHRZTMHXiTZD_G{jPRZM!�_QL| ]^D_@[\Q<FHREFHjPR7FSQ_Da@C\�\5GT � @cTZDVT7D_MP\ZG{b9FHI ��_G \|��{X T7GR�T7D_G�GW<mzMHX�TZD<GVjPRZM!�_QLk T7D_G�MSICmz\ZG TZTZ@[W_jP\FHR7G @cW G�� GJB T�FHjPFS@cW | r4MSTZG TZD<FHT @fT�@C\�W_GJBGJ\7\ZFSRZd T7M@[W<B I:�<m G � �&�<�uMSR�T7M"�<\ZG4F�O_I[FSW��-I[@[W_G{OiGX MSR7G^TZD_G)B I[MP\C�@[W_j O_R7FPB G TZM GJW<m TZD_GAQiFHREFHjSREFHQ<DLk�\Z@cW<BG�MHTZD<GR � @[\ZGTZD<G jPRZM!�_Q � @[IcI^GJW<m FSW<m ] ~ � � @[I[I{jSMYOiFSBY� TZMzTZD<GMSICm Q<FSR7FSUVGTZGJR7\�O G X MPRZG�TZD_GzQ<FHREFHjPR7FSQ_D @C\ FPB/T��<FHI[IcdTedNQiG \5GT)8 T7D_@[\4@[\{FSW G FS\Zd�U�@[\5T7F��SGsTZM�U�F��PG ; |

o�U

Page 38: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; � GJB/T7@cMPW�S3� �.DsR7M��_Q<\Jk! JDsRZM!�_Q<\Jk ����� %#'ghD_GJWYF�B MPW;TZR7MSI � MSREm 8 I[@ �PG ���=�� A���<���&¤� &��;FSB T7\(MSW�TZG��NT4X MSI[IcM � @[W_j�@cT)@[WAO_REFSB G \k_TZD<FHT(TZG��NT

@C\u@cU�Q_I[@CB @cTZI[dz@[W F jPRZM!�_QL| ]^D��<\ ���[�� A�A�<�&�&¤� ��0� �=��� � �&�A�<�%�0¤!���c�0� � @cI[IQ_R7M m��<BG FAB GW;T7GR7GJmO MSICmNX FSBG-I[@cW_GPk FHW<m T7D_G-T7G��NT(X MPIcI[M � @[W_j�TZDiF9T)I[@[W_G � @[IcIyO G-@[W � D<FHTZGbPGR(X MSW;T � FS\(@cW�G�� G B/TsOiGX MSR7GTZD<G �A�[�� A���[�&�&¤� &� � FS\^@[W;bPM��PGJm |

]^D_G�GJU�Q TedYjPRZM!�_Q ��� @C\"�<\ZG X �<I | t)W<G7�i\5G FSIcI[M � \�FSBBGW;T7\sT7MAOiG�TedNQ GJ\ZG T � @cTZD W_MAFPBB MPU7�Q<FSW;dN@[W_j I[G TZTZGR |4x_MPR(G�� FSU�Q_IcGPk ������� � @[IcI Q_R7@cW;T)F�TZ@[I[m G � @cTZD�W_M�IcGT5TZGJR9�_Wim GRs@fT |4} TsBJFHW�FSI[\ZM O G�<\ZGJm T7M�\eT7MSQ�] ~ � X R7MSU GJF9T7@cW<j'�_Q�B MPW<\ZGJB��_TZ@[bSGa\ZQ<FSBGJ\J|R�(GW<BG�· ���[� �[®��<±�� �F�A�-�E���&�%�0¤D�0�� @[IcI I[GJF bSGsF-\ZQ<FSBG)FHX TZGR �7] ~ � � @cW�TZD_GsM��_TZQ�� T |]^D_@C\+@C\^FHW�FSIfT7GR7W<F9T7@cbPG4T7M)�<\Z@cW<j����VFS\ � G�m @Cm @[W�NG B/TZ@[MSW UP| � "$#�%&%')( 4 � � * 4

DsR7M��_Q<@cW_j BFSW FSI[\ZMzO G��<\ZGJm TZM F bSMP@[m \ZQ<FPB GJ\V@[W T7D_G�U�@[m_m_IcG�MHX�F � MSREm � D<GW @cW<BI �im @cW<jFSBJB GJWPTE\|�~�@fT7D_GR��[�[� � ��� �&�[�� �MSR��[�[� � ��� ��� �<�� � @cI[ILQ_R7M m��<B GsT7D_G � MPR7m \ZM��_Q �BMSWL|

" ~ � GJR7B@[\ZG$S<|:U�l+D<FHW_jPG^TZD_G)m @cU�GJW<\5@[MSWi\MHX MSW<G4Q<FHREFHjPR7FSQ_D-MPW F�Q<FHjPG$�<\Z@cW_jaTZD_G4jPRZM!�_Q_@[W_j�@[m_GJF_|

" ~�� GREB @C\5G@S<| p ?YF9TZD<GU�F9T7@[B@[FSW<\+\ZMSU�GTZ@[UVGE�<\ZG(T7D_G � MPR7m �Z@fX X � FP\+FSW FHO<O_RZGJbN@[FHTZ@[MSW�X MSR��5@cX FSW<mMSW<Icdz@fX �<| } W TZD<@[\aBJFS\ZG�@fT-I[MNM�� \�O G T5T7GRa@cX^TZD_G'�<R7\5TaFHW<m \ZGJBMSW<m I[G T5T7GR �5X �AFHR7GM ��-�AeMS@[W_GJm FP\uFI[@cj;F9T��<RZGP|��(M � m M�dPM���m MVTZD_@C\ 8 T7D_GR7GaFHR7Gu\5GJbSGJR7FSI \ZMSI:� TZ@[MSWi\�;�

} T \ R7GJFHI[I[dsG FS\ZdsTZM)X MSR7jSG T TZMsU�F9T7BED O_REFSB G \LQ_R7MSQ GR7I[dS| ]^D<G+G�� G B/T�BFHW OiG^m REFHU�F9T7@[B��H@cX<dSM!�ajSGTM��_TZQ�� T(TZD<FHTs\��<m_m GJW_Icd�BED<FSW_jSG \�TZM�FSWA@fTEFHI[@[B�X MPW;T4X MSR{T7D_GaR7GJ\5T(MHXyT7D_G-m M B��<UVGJW;TJk F�UV@C\ZU�FHT7BED_G mO_REFSBGs@C\4Q<RZMPO<FHO_I[d�T7D_G-BF��<\ZGS|} X�dSM!� DiF bSGaFHW�G��;T7R7F � ] ~�� � @[IcI jS@[bSGuF�U�GJ\7\ZFSjSG�@[W�TZD_GuI[MSj=�<I[G��� �c�� ��r�&�-�!�A�c���c� ¤� ��A¤:�A�%� �-���[� �V�[�V�<�<���A��¢��N|q�4W G��NTZREF � � @[IcI)RZG \C�<IfT @[W TZD_GYUVG \Z\7FHjPG$ ®��-�>�0�� �� ��ªD�/�

�(GR7G� \uF�Ic@cT5T7IcG D<@cW;TuTZMAD<GI[Q dPM�� �SGJGQ TZREFSBY�AMSX+T7D_G O_REFSBGJ\s@cW U�MPRZG�B MPU�Q_Ic@CBFHTZG mYjPRZM!�_Q<\�Q�� T^T7D_G�MSQ GW_@[W_j�O_REFSB GsMSW F-I[@[W_G�O;d�@fTE\5GJIfXyFHW<m m MVTZD_Gu\7FHU�G(X MPR�TZD_GuB I[MP\Z@[W_j O<R7FPB GS| } X TZD_GJRZG�FHR7GO_REFSBGJ\{W_G \eT7GJm � @cTZD<@cWAT7D_G-MPRZ@[jS@[W<FSILMSW_G \kiQ�� T)TZD_GJU MPW�\5GJQ<FHREF9T7GuIc@[W_G \)FSI[\ZM<kiO�� T)@[W<m GJW;T4TZD_GJU FX G � \ZQ<FSBGJ\J| ]^D_G�T7G��NT � @fT7D_@cW T7D_G�W_GJ\5TZG mYO<R7FPB GJ\�BJFHW FHIC\5M OiG�@[W<m GJW;TZGJm \Z@cWiB G�] ~ � @[jSW_MPRZG \)FSIcI\ZQ<FSBGJ\(FHT4TZD<G-O GjS@[W_W_@[W_j MSX�F�I[@cW_GP|(]^D_GaU�FHT7BED_@[W_j O_REFSBGJ\ � @cI[ILT7D_GWY\5T7FSW<mAM!� T � D_GJW�dSM!�AIcMNM��F9T^dSM!�_R+] ~ � \ZM��<R7BG$�<I[GS|�} W X FPB/T k;@cX dPM��_R+GJm @cTZMPR�@C\�\5U�FHRZT+GJW_M��<jSDLk;dSM!��BFSW B R7GJFHTZG{T7D_G)T � M Ic@[W_GJ\� @cTZD�TZD<G-O_REFSBGJ\R�<RE\5T(FHW<m T7D_GW�@[W<\ZGRZT{TZD_GVFHQ_Q<RZMPQ_RZ@CF9T7G�U�FHTZGJRZ@CFHI � @cTZD<@cWAT7D_GU � @cTZDYF�� TZMPU�FHTZ@CB@[W<m GW;T7@cW_ji|

" ~ � GREB @C\ZG,Si| o } W \5G B/T7@cMPW2p � G BED<FHW_jPGJm X MSW;T7\�T7D_G X MSI[I[M � @cW_j U�G T7D_M m.�7·¯�:���<�-�A�c���Z¤!������!���� r��� �&�X� ��¤!��� �Z¤!�����&�c�F���V¤!���-�&¤c����� �&�/� �[�=�7�� ��¯���<�c�-�� &�c�E�A�¯���4�0�� ¯��� ���i|)DsGTTZD<Ga\ZFSUVG�R7GJ\��_IcTR�i\5@[W_j�TZD<Gu@[m G FVMHX jPRZM!�_Q_@[W_j<|

oPp

Page 39: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

����������� �� � � �a��� � �����J�4��� �A�s�����

] ~ � @C\uF9T�@cT7\�O GJ\5T � D_GJWYTedNQ GJ\ZG TZTZ@[W_j�U�FHTZD_GJU�F9TZ@CB\J|-]^D_G�BMSWNbSGJWPT7@cMPW<\{X MPRum MS@[W_j TZD_@C\uFHR7GU�FHWNd�FHW<m�B MSU�Q_I[G�� k FHWim�TZD_G�FHO<@cI[@fTed�MSX ] ~ � TZM-T7F��PG4T7D_GU @[W;TZM FPBBM��_W;T+U�F��SGJ\�TZD<G(Q_R7M m��<B/T7@cMPWMHX D_@[jSD=HJ�<FHI[@fTedPkSF9TZTZREFSB TZ@[bSG^U�F9TZD<GU�F9T7@[BJFHI M��_TZQ�� TQ MP\7\Z@cO_I[GS| } X dSM��VQ_ICFHWVTZM�Q_R7M m��<BG{Q<FHQ GRE\ � @fT7DU�F9T7D_GU�F9T7@[BJFHI_\ZdNU-O MSIC\ @[W TZD_GJU kSTZD_@C\�\ZGJB/T7@cMPW � @[IcI jP@cbPG+dPM���FHI[I;TZD_G{O<FP\5@CB\ W_G B G \Z\7FHR7dsX MSR�B R7GJFHTZ@[W_jO GJF��_TZ@cX �_IyM�� T7Q�� T)@[WYFSIcU�MP\5T)FSIcIyB @[R7B��_U�\eTEFHW<BGJ\� ] ~ � U�F d OiG �<\5G m � @cTZD_M!� TsFSW;d U�F9T7D_GU�F9T7@[BJ\kMHX B M��<R7\ZGSkNFHW<m�@fX TZD_@C\�@[\�dSM!�_R�jSMPFSI kPTZD<GW T7D_G)X MSI[IcM � @[W_jaT � M \��_O<\ZGJB TZ@[MSW<\�FHR7G(Q<RZMPO<FHO_I[d�\C�/��B@cGJW;TX MSR{dPM��_R^W_GJGJm_\J|

� �� � .:<8 .�,�&s3 � 8;>�� �-.+*Z8

?�FHTZD_GJU�F9TZ@CBFSI TZG��NT(@[\4@cW<\ZGRZTZG m @cW;TZM�W<MSR7U�FSI TZG��;T)@cW�T � M�QiM;\Z\Z@cO<IcG � F d \���@cT)BFSW�OiG��6 ��"Y�6 ��NkTZDiF9T^@[\Jk FS\�Q<FHRZT+MSXLTZD<G@�<\��<FSI I[@[W_GJ\�MHX TZG��NT | } T4BJFHW�FSI[\ZM-O GR+<�6�g.0"C9'#��4+ikST7D<F9T{@C\k B GJW;TZGR7GJm @cW F-j;FHQO G T � GGW�T7D_G)�i\C�<FSILT7G��NTJ|4]^D_G RZG \C�<IfTE\{@cW�TZD_GV\5Q<FPB @[W_j FHWim�Q_I[FPB GJUVGJW;T(MHX�\ZdNU-O MSIC\4BFSWAOiG7H!�<@fT7Gm @ � GJRZGJW;T+@[W�GJFPBED BFP\5GP| ]^D_G)@cW�� I[@cW<G(GHJ�<FHTZ@[MSW��� �� 4 4 �� ��� �� @C\+GJFS\Z@[Icd�\5GJGW�T7M-O G)m @ � GR7GW;T�X R7MSUTZD<Ga\ZFSUVG�G H!�iF9TZ@[MSW � D_GJW�m_@[\ZQ_ICF dSGJm%�

�� �� 4

U� * ���

*Q �

�N@[W<BG�TZD_G-\ZQ<FPB @[W_j�FHW<m TZD<GuX MSW;T7\#�<\5G m X MSR4U�F9T7D_GU�FHTZ@CB\4FSRZG"HJ�_@cTZGam @ � GJRZGJW;T{X RZMPU TZD<MP\ZGuMHXMSREm @[W<FHR7dAT7G��NTJk�] ~ � W_GG m_\uT7M�O G�TZMPI[m � D_GJW U�F9T7D_GU�F9T7@[BJ\uREF9TZD<GRuT7D<FHW W<MSR7U�FSI�TZG��NT-@[\-OiGJ@cW<jTedNQiG \5GTJ| ]^D<@[\V@C\�m MSW_G �<\Z@cW<jYT7D_G � \ZdNU-O MSI | ?AMPRZG \5Q GJB@ �iBJFHI[IcdPkU�F9T7D_GU�F9T7@[BJ\�@[\ TedNQ GJ\ZG T�@cW��I[@cW_G ONd�\��_R7RZM!�_W<m @[W_j�T7D_G \ZdNU-O MSIC\{T7M�O G GJWPT7GR7GJm�ONdA\5@[W_jPIcG-m_MSI[I[FSR)\Z@cjPW<\�� � ����� �<k FHW<m�@[\(TedNQiG \5GTm @C\5Q<I[F dPGJm ONd \��_R7RZM!�_W<m @[W_jaT7D_Gu\5dNU OiMPI[\+TZMVO GsGJW;TZGR7GJm�ONd�m M��<O_IcG�m MPIcICFHR^\5@[jSWi\�� � � ����� � �_| �(GW<BG�[� � ���Z¢ � � @[IcILjP@cbPG�� ����� U�@[W�� I[@[W_G � D_@[IcG � �[� � ���Z¢y� � � � @[IcI m @[\ZQ_ICF d

���� � U �

]^D_GA\ZQ<FSB@cW<jYX MPR�OiMSTZD @cW�� I[@cW_GAFSW<m m_@[\ZQ_ICF dSGJm U�F9TZD<GU�F9T7@[BJ\�@[\�BMSU�Q_I[G TZGJIcd B MSW;T7RZMPIcI[GJm ONd] ~ � |u�(m_m @[W_j�\5QiFSB G \{T7M�dSM!�_R(@[W_Q��_T�DiFS\4W<M G�� G B/TsFHT�FSIcI |sghD<F9Ts@fX�dPM���W<GGJmzF \ZQ<FSBG-MSR�\ZMSU�GTZG��NTs@[WATZD<G U�@Cm_m I[G MSX�\5MPUVG U�F9TZD<GU�F9T7@[BJ\ � �M�� BFHWY@cW<\ZGRZT(T7G��NT)ONd�@[W<\5GJR5T7@cW<j�@cTs@[W;TZM FSW�DNOiM<�8 m_MSW% T � MSR7R7d FSOiM!� T T7D_G�m G��<W<@fT7@cMPW MHXsFHW DNO M<� X MPR�W_M � ; � ���-�&�<�/� ����� �<| ]^D_@[\V@C\VQ<FHRZTZ@CB��_ICFHR7I[d

oSo

Page 40: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

�<\ZG X �_IyX MPRam @C\5Q_ICF dSG m�U�F9T7D_GU�FHTZ@CB\J|7�(GW<BG � � � � � U � D_GJW_GbPGR � � � - U � BFSWzO GVTedNQiG \5GT�<\Z@cW<j �[�A�����Z¢ ���-���<��� ���&�� &�<���<� ���A�c� ��¢ �<| r4MSTZG+TZD_G^\ZQ<FSBGJ\LMPWaG@cTZD<GRy\5@Cm G�MHX TZD<G � MSREm � @fT7D_@[WTZD<GaO_REFSB G \|�`(\��<FHI[I[d�@cT)@C\5W% T(W_G B G \Z\7FHR7d�TZM�@[W<\ZGRZT)\ZQ<FSBGJ\^@[WPT7M U�F9T7D_GU�F9T7@[BJFHI T7G��NTJk O�� T)D_GR7GaFHR7GTZD<GaB MSW;T7RZMPI \ZGHJ�_GJW<B G \�TZD<FHT(m MVTZD_GRAeMPOL| �! !"$#�%&%')( 4 �

� ����� ������� �!*d�1s�����( *c� �A�T� �����w�* � �r)FHU�G l+MSW;T7RZMPI��NGHJ�_GJW<B G � � @ FJG .

K)M��_O_I[G"HJ�<FSm �����<�&�c�� �<FSm ���<���c��NQ<FPB G ���

]^D_@[BY� \5Q<FPB G ���?AGJm @:�_U \5Q<FPB G �-¶]^D_@[WA\5Q<FPB G �/�

r4GJjPF9T7@cbPGsTZD_@[WA\5Q<FPB G � $

} X dSM��VI[M;M!�aB I[MP\ZGI[daF9TyTZD<G�W<GjPFHTZ@[bSG+TZD_@[W�\5Q<FPB GPkHdSM!�% I[INW_MHT7@[BG�TZD<FHTJk��_W<Ic@:�SG�TZD<G�MSTZD_GJR�GW;TZR7@[GJ\JkTZD<G-T � M FSRZU�\)M9bSGR7ICFHQL|�]^D_@C\)@C\sOiG BF��<\5G-TZD_GVW_GJjPF9T7@cbPG \ZQ<FSBG-@C\sMSW_GV@cWYTZD_GVMSQ<QiM;\5@cTZGVm @cR7GJB TZ@[MSWLkTZDiF9T@C\k � D_@cI[G{T7D_G{MHT7D_GR�BMSW;TZR7MSI_\ZGHJ�_GJW<B G \y@cWiB R7GJFS\ZG�TZD_G4FSU�M��_W;TMHX \ZQ<FSBG�O G T � GGJWVT � Ma\ZdNU-O MSIC\O G@[W_j TedNQ GJ\ZG TJk T7D_G-W<GjPFHTZ@[bSG-TZD_@[Wz\ZQ<FSBG-m G B R7GJFS\ZGJ\4TZD_G�\ZQ<FSBGaOiGT � GJGWYTZD_GJU k GJbSGJWA@fX�@cTuBF��i\5G \TZD<GU T7M�M9bSGJRZICFHQL|

" ~ � GREB @C\5G7O |:U ]+dNQiG \5GT)T7D_G X MSI[IcM � @[W_j3���=8�����; ��� � ��8�J� 8�� - B;�� ; |-r4MSTZG TZD_G�\ZQ<FSB@cW_j @cWzTZD<Gm GJW_MSU�@[W<F9T7MSR |

�M!�a\5D_M!�_ICm W% T D<F bPGFHWNd)O<I[FSW��)I[@[W_GJ\ OiGT � GJGW�TZD<G+m MPIcICFHR \Z@[jSW<\ m GI[@cU�@cTZ@[W_j4T7D_GU�F9T7D_GU�FHTZ@CBFHITZG��NTJ|] ~�� FP\Z\��_U�GJ\+T7D<F9T4FHI[I TZD<GsU�FHTZD_GJU�FHTZ@CBFSI TZG��NT4O G@[W_jVTedNQiG \5GT^@C\^@[W MPW_G�Q<FHREFHjPR7FSQ_DLkNFHW<m FO_ICFHW�� I[@cW_GV\eTEFHRZT7\)F�W_G � QiFHREFHjSREFHQ<D%�<B MPW<\ZGHJ�_GW;T7IcdPk_TZD<@[\ � @cI[I jSGW<GREF9TZG FHWAGR7R7MSR4U�GJ\7\7FHjSGP|{]^D_@[\T��<RZW<\+M��_TTZM OiG@�<\5GX �_I kPX MPR�MPW_G(MSX TZD_G)GJFS\Z@[GJ\5T�GR7RZMPR7\ T7M-U�F��PG4@C\T7MaX MSR7jSGTTZM-Q�� T^@cW�T7D_G4T7R7FS@cI[@[W_jm MPIcICFHRs\5@[jSW�8 \�;(F9X T7GR4T7D_GVU�FHTZD_GJU�F9TZ@CBFSI @[W_Q��_T78 }(Q_RZMPU�@[\ZGuTZDiF9T)dPM��% I[I m M�@fTuF9TsIcG FS\5T(MSW<BG � D_@[I[GI[GJFHR7W_@[W_j�] ~ � ; � @fX(] ~ � FSIcI[M � G m UVMPRZG TZD<FSW MSW_G QiFHREFHjSREFHQ<DYT7M�OiG OiGT � GJGW T7D_G m MPIcICFHRE\a\Z@cjPW<\JkTZD<GW MSW_G�MSU�@cT5T7GJm�TZREFH@[Ic@[W_j�m MSI[ICFHR^\5@[jSW U�@cjPDPT4BJF��<\ZG(T7D_G�RZG \eT{MSX TZD<G�m_MNB��_U�GW;T^TZM�O G�Ted;Q GJ\ZG T4FP\U�F9T7D_GU�F9T7@[BJ\|

?AM;\eTU�FHTZD_GJU�FHTZ@CBFSI TZG��;T@C\�GJWPT7GR7GJmV@[WVG��_FSB/T7IcdaTZD_G(\7FHU�G � F duX MSR@[W�� Ic@[W_G^TedNQ GJ\ZG T5T7@cW<jaFS\yX MPRm @C\5Q<I[F dPGJm TedNQiG \5GT5T7@cW_j 8 G�� BGQ TsX MSR)TZD<G \��_RZR7M��<W<m @[W_j�m MPIcICFHRs\5@[jSW<\Jk MHX�B M!�_RE\5G<;/|)]^D<G G�� BGQ T7@cMPW<\Jk\��<BED�FS\+FHI[@cjPW_@[W_j-U �_IfT7@cI[@[W_Gsm_@[\ZQ_ICF dN\+FHW<m Q_I[FPB @[W_jaG H!�iF9TZ@[MSW�WJ�<U-O GRE\+FHT�TZD<G(I[G X T^MSR�RZ@[jSD;T�U�FHR7jS@[W� @[IcILO Gam @C\ZB��<\7\5G m�@[W TZD_GuICFS\5T{Q<FHRZT{MHX TZD_@C\4\ZGJB/T7@cMPWL|

o�S

Page 41: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

?�FSWNd W_G � \5dNU OiMPI[\)BFHWzFHQ_Q GJFSR � D_GJWATedNQiG \5GT5TZ@[W_j U�FHTZD_GJU�F9TZ@CB\J|(?AM;\eTsMHXyTZD<G MPW_GJ\4TZD<FHTFSB T��<FSIcI[d FHQ<QiG FHR^MSW TZD_G6�PGdNOiM;FHREm BFSW O G6�<\ZGJm m @cR7GJB TZI[dS|]^D_Gu\ZdNU-O MSIC\ � � ¦ �F� ª��Sµ ¶ �FHWim �VFHR7GsFSIcILGJW;TZGR7GJm m @[RZG B/T7IcdP|��(GR7G�TZD_GJd�FHR7GuFS\^U�F9T7D_GU�FHTZ@CB\� � - ��� ������� 83;/|

" ~ � GREB @C\ZG=O_| p ]+d;Q GJ\ZG T�T7D_G�GHJ�<FHTZ@[MSW � ������� -�� � �� �������AFS\�@[W�� I[@[W_G FHW<m m @C\5Q<I[F dPGJmU�F9T7D_GU�F9T7@[BJFHI T7G��NTJ|

" ~�� GREB @C\5GO_| o ]+d;Q GJ\ZG T TZD_G+GHJ�<FHTZ@[MSW'8�����;�� ������� � ����PFS\L@[W�� Ic@[W_G�FHW<mam_@[\ZQ_ICF dSGJmsU�F9T7D_GU�FHTZ@CBFHITZG��NTJ|

?�FSWNd MSTZD_GJRV\ZdNU-O MSIC\kFP\-dPM�� � M��<I[m G�� QiG B/TJk+FHR7G Q_R7GJm G��<W_GJm B MPWPT7RZMPI � MSREm_\J| �(IcI#DsR7GG��I[G T5T7GRE\{FHR7GuF b FS@cICFHO<IcGP|��(GR7G�@[\{F T7FSO_I[GuMHX TZD_GJU � �! !"$#�%&%')(�� , �

! �B*J*J2F� *c�'� *�� �

" �c�A� ���&� # �=�&�<�A� $ �����!�c�0� % �<�A�-�[���& �c� ���A¤[�c�� ' �[���<�A� �0�A¤[�<�� ( � �A�<�A� ) �c�<�A�* �[�����<��� + �[���<�c���&�<��� , �&¤=�<�A� - � ��� � �&�. �-�c�4�&���A� / �4�&� 0 �� -� 1 �[�0¤2 � � � �Z¤ 3 �[���&� 4 �[���[�-���&�5 ���A¤��=�0� 6 �[���<�_�A¤ �=�0� 7 �[���[� 8 �=� ���A¤[�c�� 9 � ���0¤ : �[���<� ���Z¤ ; �����Z¤ < � �0�-¤= �c�!������� > � � �!�c�0� ? �[´��A�=��� @ �[®����<���A � » �4�&���A� B �[±0¤ C � ¸ ¤ D � ³ ¤��=�0�E �:¬ ���A¤[�c�� F � ¸ �Z¤ G � ¸ �A¤ H � ¨ �������

" ~ � GREB @C\ZG6O_| S#]+d;Q GJ\ZG T " # �I$ �J%VFS\^@[W�� Ic@[W_GaFHWim m @C\ZQ_I[F dPGJm U�F9TZD<GU�F9T7@[BJFHI TZG��NTJ|

" ~ � GREB @C\ZG6O_| O ]+d;Q GJ\ZG TK> 8���; � 8�� - U<; �<FP\^@cW�� I[@cW<G�FSW<m�m @C\5Q_ICF dSG m U�F9T7D_GU�FHTZ@CBFHILTZG��NT |

�NMPU�G TZ@[U�GJ\+FSBBGW;T7\�FHR7G�Q3� T+FHO M9bSG{MPRO GI[M � \ZdNU-O MSIC\|y]^D_G4B MPW;TZR7MSI � MSREm_\��<\ZGJmVX MPR�FSBJB GW;TE\@[W U�F9T7D_GU�FHTZ@CB\yFHR7G+m @ � GR7GW;T X R7MSU2T7D_MP\ZGL�<\5G muX MPR W<MSR7U�FSIST7G��NTJ|y]^D_G^W_MPRZU�FHIPTZG��NT�BMSW;TZR7MSI � MPR7m<\U�F d W_MST^O G"�<\ZGJm X MSR{U�FHTZD_GJU�FHTZ@CB\{FSW<m b;@CB G�� bPGRE\ZF<| �! !"$#�%&%')( 4 , � � 4 , �

o!O

Page 42: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

� �A� (+*-�����T� ����� � ���!*c�0���

�2 ��&�<�r� �2 �����&�&� �r� �2 �=�0¤[�<�A�%��2 �<�&�!�A���%� !2 ���c���<���%� �2 �[�A�<� ��2 �[�-�A�<�r� �2 �=�-���<���%� �2 �:�&�<� ��2 �=���&� � ��� � � �0¤:�A���&�[� �c�[�0��� �� � � � �Z¤:�A�<��¤[�<�A� �<�[�0� �

v�@[W<FHR7d�MSQ GREF9TZMPR7\sB MPU-O_@[W_G T � M U�F9T7D_GU�F9T7@[BJFHIyMSO�AeGJB/TE\)TZM jSG TaFSW_MHT7D_GRsMSO�AeG B/T |�t)REm @cWiFHR7dFSm<m @fT7@cMPW FHW<m�U �_IcTZ@[Q_Ic@CBFHTZ@[MSWLkPX MSR�G��_FHU�Q_I[GSkNB MPU-O_@[W_G^T � MuWJ�<U-O GRE\�TZM-jSG T�FHW_MSTZD_GJRW��_U-O GR kPFSW<m\ZM T7D_Gd FHR7G O<@cW<FSRZdYMSQ GREF9TZMPR7\J|-ghD<GW F�O_@[W<FHR7dAMSQ GREF9T7MSRu\C�iBED FP\ � MSR��q@[\sTedNQ GJ\ZG T k F Ic@cT5T7IcGG��NT7R7F�\ZQ<FSBGs@C\^Q�� T(FSRZM!�_W<m @fT |��4GJRZG�@C\4FVIc@C\eT4MSX \ZMSU�G�MHX TZD_GaF b9FS@cICFHO_I[GsO_@cWiFHR7d MSQ GREF9T7MSRE\�� � "$#�%&%')(�� , �

�1�L� � �4� 1�� *���A� 1����

� ���:�A�<� � �[�0¤D�0��� � �c���:� � ���:���[�� ���-¤!��� ` �=�-�_�-�<�<� �<�_¤!� �<��¤=�4�0�� ��� ���=� � � ���!� � �[�A�-� � � �&�c������ �c� �_�=�0� � �c�!� ¤� c�0� � �c�[�0¤D�0�&� � �c�c�A�[�

~�IcI[@cQi\5G \�FSRZGsB MPUVU�MPW_Icd �i\5G m � @cTZD O_@cWiFHR7d�MSQ GREF9TZMPR7\J|y]^D_GsBMSW;TZR7MSI � MSREm ���=�-�<��� � @cI[I R7FS@[\ZGTZD<G�m MHTE\ \5M T7D<F9T T7D_Gd FHR7G�IcGJbSGI � @cTZD T7D_GAO_@[W<FHR7d MPQiGJR7FHTZMSR | ]^D��<\ �c� � �A�=�A�<��� � � � � @[IcIQ_R7M m��<B G � � ����� ���i|�]^D_G�B MPW;TZR7MSI � MSREm �-�[�A�<��� � @[IcI�Q�� T TZD_G�m_MHT7\ MSW T7D_G�OiFS\ZGI[@cW_GPk FSW<m \ZM��¢ �c�<�A�<��� �VQ<RZM m��<BGJ\6U ����� ��|

" ~ � GREB @C\ZG6O_| Q ]+d;Q GJ\ZG T � ��� 8 �� ��; �X8 ��� ��;� 8 ��� �J; |

" ~ � GREB @C\ZG6O_|�� ]+d;Q GJ\ZG T ��p ��S�� Q � ����� � p � � ��8�� � U<;/|

� RZGJI[FHTZ@[MSW @[W<m @CBF9T7GJ\ FAQ_R7MSQ GRZTedYMHX{T � M�U�F9T7D_GU�FHTZ@CBFHI+MSO�AeG B/TE\|Ag G FSIcR7GJFPm d �NW_M � D_M �TZMA\ZD_M � T � M MPO�AeGJB T7\�G H!�iFHI kLMSR�D_M � T7MA\5D_M � MSW_G�W��_U-O GRuI[GJ\7\)TZD<FSWzMPRujSR7GJFHTZGR)TZDiFHW FHW_MSTZD_GJRW��_U-O GR 8 \Z@cW<BG�TZD<GJ\ZG FHR7G�\ZdNU-O MSIC\uMSW U�MP\5TuTZGJRZU�@[W<FHI�SGdNO MPFSR7m_\Y;/| ] MAW_GJjPFHTZG F�R7GICF9TZ@[MSW kLTZD<GB MPW;TZR7MSI � MPR7m �� &�[��@C\^Q�� T4@[W X RZMPW;T^MSX T7D_GuR7GICF9TZ@[MSW |��(GR7GuFHR7G�\ZMSU�G�R7GICF9TZ@[MSWi\�� � "$#�%&%')(�� , �

o�Q

Page 43: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

� *-� �A�4� 1����

� �-�<��� �� �� &�<���-�<��� � ������� �� �� &�<�����A���� �c���<�Z¤!� �� �� &�<���c���<�Z¤!� � ���A¤D� �� �� &�<�����-¤D�� ���-¤D�0��� �� �� &�<�����-¤D�0��� � �c� � �A�A�<� �� �� &�<���c� � �A���<�� ���4�-�0�[�<� ���!�-���[�<����� ���!� �0�=�<� � ���!� ���[�<������ �&¤ �� Z¤ � � �&�<���-�-�c�A� � � �&�<� �

" ~ � GREB @C\ZG6O_| W ]+d;Q GJ\ZG T � �� � �� � PV@cXyFSW<m MSW_I[d @cX ���� �� |

" ~ � GREB @C\ZG6O_| N ]+d;Q GJ\ZG T � �� � ����� PV@cXyFSW<m MSW_I[d @cX ����� �� |�(GR7G�FSRZGu\ZMSU�G�MHT7D_GR4F b9FH@[ICFHO_I[G)U�FHTZD_GJU�FHTZ@CBFSIL\5dNU-O MSIC\� �! !"$#�%&%')(�� , � � � ,

�7� ����*-��� ��� *J1 � � �T� � 0 1_� �

� �c�A�c� ��� � �c�A�-� � �[«A� � �&·D�� � �&�<�-��¤=�A� � �&¤� ��<��� � � � � �c�� ��&�<�� �� &�[�_�<� � �=�&�&�����<�c�&��� � �<�-�<���A�-� � �c�<�0¤c�!���� �� &��� � �<���c�[� � �����&�<� � �� &�<�c�-���A�

" ~ � GREB @C\ZG6O_| U P ]+dNQiG \5GT�#8!� � � �$;�8"��� � �$; � � |

� ����� 0i$ � :+�5.+&�8

]^D_GJRZGVFHR7GaT � M�U�G T7D_M m_\)MHXTedNQ GJ\ZG T5T7@cW<j F X R7FPB/TZ@[MSW��{@fTuBFSW�OiG TedNQiG \5GTsGJ@fT7D_GR�@[WATZD<G-X MPRZUU �Sp MSR @[WhT7D_G�X MPRZU 4* | ]^D<G �<RE\eT BFS\ZGA@C\ A �<\5T GJW;TZGR7GJm � @cTZD W_M \ZQiG B @CFHI)BMSW;TZR7MSI)\5G H!�<GW<BGJ\JkTZDiF9T�@[\Jk ��¢ ¦ � �<|Y]^D_G \5G B MSWim BFP\5G �<\5G \aT7D_G BMSW;TZR7MSI � MPR7m �<�<���<�zFSW<m TZD<G�X MPIcI[M � @cW<j�Q<F9TZTZGJRZW%��-µ� c�[�0�<���[���<�&¶ �c�<���<� µ[�A�� &�!�y¤� &�<���[�&¶��<|.�4GWiB G � ���<� �<���c�<�A�<��� �-�/�� � �ajS@[bSG \

� ���� � �

�o��

Page 44: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

�! !"$#�%&%')( 4 ,�� � 4 �

" ~ � GREB @C\ZG6O_| U!U ]+dNQiG \5GT^TZD_G�X MPIcI[M � @cW<j3�������� ���� � 4������� � �� 4� � 4 � � 4 � |

" ~ � GREB @C\ZG6O_| U p ]+dNQiG \5GT��ghD<FHT4FHR7G)T7D_GuQ MS@[WPTE\ � D_GJRZG�� ��8 � � ��; � �� ��8 � � ��; � P �

� � 1('���8 �L00��s:<8 $+&s= 8 '\ 3 0 8 � 00�ps:<8

���<O<\ZBRZ@[Q TE\{FHW<m \C�<QiGJR7\7B R7@cQ_T7\{FHR7GsQ<FHRZTZ@CB��_ICFHR7I[d�GJFS\Zd�T7MVGJW;TZGR$�i\5@[W_j�] ~�� |]^D_GaBED<FHREFSB TZGJR7\FHWim �^FHR7G�<\ZGJm�T7M)@[W<m @CBFHTZG�TZD<FHT T7D_G+W<G��NT BED<FSR7FPB/T7GR @C\ F(\��_O<\7B R7@cQ T MSRyF(\��_Q GRE\ZBRZ@[Q TJ| ]^D��<\ �[� �:� �jS@[bSG \ � * FHW<m �[� � � jS@[bSGJ\�� * |�] M jSGTu\ZGbPGREFHIyBED<FHREFSB TZGJR7\)FS\uF \C�_Oi\ZBRZ@[Q TuMSR�\C�<QiGJR7\7B R7@cQ_TJk T7D_GdFHR7G{jSR7M��<QiG maT7MSjSGTZD_GJR � @cTZD_@[W�O_REFSB G \|��4GJW<B G � G(BJFHW=�<\ZG �=� ���c�0¢ � �4TZM-jSG T � * 44FHW<m �[� �c�0¢ � �(T7MjSGT � * 4 |^r4MSTZ@CB G�T7D<F9T4T7D_G-\��_Q GRE\ZBRZ@[Q T7\{FSW<mA\��_O<\7B R7@cQ TE\4FHR7GuF�� T7MSU�F9T7@[BJFHI[Icd�TedNQiG \5GT4@cW�F�\ZU�FHI[IcGJRTedNQiG�\Z@ FJGS|a]^D_G�\Z@fT��<F9T7@cMPWY@C\sMSW_I[d�\5I[@[jSD;TZI[dAU�MSR7G B MPU�Q_Ic@CBFHTZG mAX MSRuF \5G B MPW<m�ICF dSGJR(MHX^\C�<O<\ZBRZ@[Q TE\MSR^\��_QiGJR7\7B R7@[Q T7\J|��M!� BJFHW� ��A� �<\ZG �[� � �-\Z@[W<B G)TZD_@C\^B M!�_I[m D<F bSG(T � M QiM;\Z\Z@cO<IcG)@cW;TZGJRZQ<RZGT7F9T7@cMPW<\JkW<FSUVGJIcdPk �[� �c� � � MSR ���[� �0� �3�LT7D_@C\ujS@[bSG \(T � M�m @�� GR7GW;TuR7GJ\��_IfTE\�� � *�� FHWim � * , kLTZD<G �iR7\5TuMHX� D_@CBED @[\aTZD_G'�i\C�<FSIU�F9T7D_GU�F9T7@[BJFHI�\��_O<\7B R7@[Q TaW_MHTEF9T7@cMPWL| ]^D��<\adSM�� U �<\eTaQ3� T-@[W TZD_G�BMSU�Q_I[G T7GO_REFSBGJ\+TZM�m GJ\7B R7@[OiG�U)�<IfT7@cQ_I[G�I[F dPGRE\�MSX \��_O<\7B R7@cQ_T7\^FHW<m \��_QiGJR7\7B R7@[Q T7\J|�]^D_Gd�U�F d�O Gam MSW_G)TZM�FSW;dI[GbSGJI | � "$#�%&%')( 4 * � 4 ,�

] M?�<\ZGVO MHT7D \C�<O<\ZBRZ@[Q TE\uFHW<m \��_QiGJR7\7B R7@[Q T7\�MPWzMPW_G \5dNU OiMPI k dSM�� �<\ZG�OiMSTZD TZD<G FHW<m � @[WG@cTZD<GR{MSREm GJRJ|�]^D��<\^G@cTZD<GR �[� � �-¢ � MPR �=� �A¢ � � � @cI[I jS@[bSG �.4* |

" ~ � GREB @C\ZG6O_| U o ]+dNQiG \5GT{GJFSBED MHX TZD<G�X MSI[IcM � @[W_j3��� � ��� � ��� � � U � P � � * � * p ��� |

" ~ � GREB @C\ZG6O_| US ]+dNQiG \5GT� � * ��8 � � ��; � ����� � � ����� � |

� \5@[U�@cICFHR)U�G TZD<MNmY@[\@�<\ZGJm�X MPRs\��_U�U�F9T7@cMPW<\)FSW<mA@[W;TZGjPR7FSI[\J|(]^D_G @cW<Q�� T�MHX � ���!�=� � �A�0¢�� � � �:� � � @[I[ILjS@[bSG �� � 4 � * k<FHWim � �&¤� -� ¥ �4� � �P�� �<� � � @[IcI jS@[bSG�� � ��8��C; � �/| �! !"$#�%&%')( 4 � � � 4 � �

�(W_MHT7D_GR �<\ZGzMSXuTZD_@C\ Ted;Q GYMSX-@[W_Q�� T�@[\�X MSR G�� Q_R7GJ\7\Z@cMPW<\ @[WNbSMSI[bN@cW<j Ic@[U�@fTE\| �M!� BFSW �<\ZG� �-��¤D� �� �[��� �&¤� ��<����� � � �Z¢ �c�<���<� ���0� r�V� �VTZM�jSGT^I[@[U �! � 8 � � 4� ; � ���;|

" ~ � GREB @C\ZG6O_| U<O ]+dNQiG \5GT^TZD_G�X MPIcI[M � @cW<jVG�� Q_RZG \Z\Z@[MSW%� Ic@[U � 8CU � �V;#"� ���P|

o�W

Page 45: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

" ~ � GREB @C\ZG6O_| U Q ]+dNQiG \5GT�]^D_GuBJFHREm @cWiFHI[@fTed MSXL8 - � � � ;�@C\ � 4 |

" ~ � GREB @C\ZG6O_| U ��]+dNQiG \5GT��I[@cU � �� � � ��UP|

�(GR7G� \ F D_@[W;T�TZM U�F��SG @[WPT7GjPR7FSI[\ I[M;M!� F I[@cT5TZI[G W_@CB GJR� IcMNM!� F9T�TZD_G m @ � GR7GW<BG O G T � GGJW� � ��8 �C; � �VFSW<m � � ��8��C; � �/| } W T7D_GA\5G B MSWim BJFS\ZG�T7D_GR7G�@[\�F I[@fTZTZI[GAG��NTZREFz\ZQ<FPB GAF9X T7GR ��8��C; k�FSW<m@cT4IcMNM�� \^W_@CB GJR� �/� � FS\L�<\ZGJm T7M�FPm_m TZD_GaFPm_m @cTZ@[MSW<FSIL\5QiFSB GP|

" ~ � GREB @C\ZG6O_| U W ]+dNQiG \5GT^TZD_G�X MPIcI[M � @cW<jV@[W;TZGJjSREFHI ��� 4 o � * � ��XUS|

� ����� .{.�:<80�a8 �{')$�0<3 $�&�= .�: 3 00���Z8N3] MuTedNQiG \5GT+Fa\�HJ�<FHR7G{RZMNMST@fT�@C\MPW_I[d W_G B G \Z\7FHR7duTZM)�<\5G4TZD_GsB MSWi\eT7R��<B TZ@[MSW �����<�-��� ����� �<| �(GW<BG

� ����c�-���[� �:� ��� �!�0� � � @cI[I{jS@[bSG�� � * � � * | r(MHT7@[BG T7D<F9T ] ~ � TEF��PGJ\�BFSRZG MHX)TZD_G�Q_ICFSBGU�GW;T�MHX\Zd;U OiMPI[\^FSW<m T7D_G�D_G@[jSD;T4FHWim I[GW_jSTZD MHX T7D_G�R7FPm @CBFHI |y] M�U�F��PGsB��_OiG�MPR�MSTZD_GJR^RZMNMHTE\k;T7D_GuB MSW;T7RZMPI� MSREm_\ �[���-�[�sFHW<m �c�c�sFHR7G��<\ZGJm |��M��ajPG T��� U � � � X R7MSU TZD_G+@cW<Q�� T � �[���-�<� �c�c� ��¢ �<� � � �_| �! !"$#�%&%')( 4 , � 4 , 4

� QiM;\Z\Z@[O_IcG FHIcTZGJRZWiF9TZ@[bSGY@[\ TZM �<\ZG�T7D_G BMSW;TZR7MSI � MSREm �A�!�A�A�G�)T7D_G @cW_Q3� T � ���!�A�A�¯� � � @[IcIQ_R7M m��<B G � p |

" ~ � GREB @C\ZG6O_| U N ]+dNQiG \5GT^TZD_G�X MPIcI[M � @cW<j3� � p � � �� � ��� UP �� � |

" ~ � GREB @C\ZG6O_| p�P ]+dNQiG \5GT� � � � � � � � � |

" ~ � GREB @C\ZG6O_| p�U ]+dNQiG \5GT� 9 8��C; � 4 * � � � ��� ���� *� � |

� ��� � �5&s3y80�s$w�-. ��3 $�&�= � 3 *5.��

`)\5G+TZD_G�B MPW<\eT7R��iB/TZ@[MSWi\ �c�<���[�&�&¤� &��� ����� �)FHW<m �=�� ��A�[�&�&¤� &��� ����� �(TZM(Q3� T I[@[W_GJ\yFHO M9bSG�MSR O GI[M �U�F9T7D_GU�F9T7@[BJFHIG�� Q_RZG \Z\Z@[MSW<\J| �4GWiB G � �c�[���<�&�&¤ &�0�[�������<���[�<���[����¤� &� ��� �<�<���<�&��¤� &� � � jS@[bSG \� � � � � � �i|�vL� T-W<MHTZ@CB G TZD<FHT-TZD<G Ic@[W_G \aM9bSGJRuTZD<G IcGT5T7GRE\-FHR7G F9TVm @�� GR7GW;T-D<G@[jSD;T7\Jk�FHW<m \ZM

o�N

Page 46: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

\ZMSU�GVBJFHR7G-@C\�W_GJBGJ\7\ZFSRZdP|a]^D_G7�<\5G�MSX �c�[���<�&�&¤ &�0� ���!�-�c�A�>��� � @cI[I�REFH@C\5G-TZD_G�D_GJ@cjPDPT�MHX+TZD_G�I[@cW<GM9bSGJR � | �! !"$#�%&%')( 4 , � 4 , 4

] M=�_W<m GJRZI[@cW<GuW_MSW�� U�F9T7D_GU�F9T7@[BJFHI T7G��NTJk��i\5G �=�� A�A�<�c�&�[��� ����� �_|

" ~ � GREB @C\ZG6O_| pPp ]+dNQiG \5GT^TZD_G�X MPIcI[M � @cW<j3� � � � � � |

� ����� 3 *�p� � :_3 0i8 *e$0_��3 $�&�= 8A� $+*5*

]^D_G�U�MP\5T4B MPUVU�MPW_Icd �<\5G m�U�FHTZD_GJU�FHTZ@CBFSILm GI[@cU�@cTZGJR7\{FSRZGsO_REFSBY�SGT7\JkNO_R7FPB G \k FHWim�Q<FSRZGJW;TZD_G��\ZGJ\J| �)\ � G�DiF bSG \ZGGJWLkyTZD<Gd U�F d OiG Q_R7MNm��<B G m ONd �i\5@[W_j �!����� � � �#� TZMzjSGT � ��"�$)8�;^|�NMPUVGTZ@[U�GJ\{ICFHR7jSGJR�m GJIc@[U�@fT7GRE\{@[W<B R7GJFP\5G)TZD_GaBI[FSRZ@cTed MSX U�F9T7D_GU�F9T7@[BJFHI G��NQ<RZG \Z\Z@cMPW<\JkNFP\^@cW

� � � 8�� �J�;�� � 8�� � ��; ����� �] MsU�F��SG^I[FSRZjPGRyI[G X T+m GJIc@[U�@fT7GRE\ TZD_G)B MSW;T7RZMPI � MSREm_\ �=�Z¤��&�<k � © ¤��&�<k �=�Z¤�� �&�<k9FHW<m � © ¤�� �&�)FHR7GR�<\5G m@[W�X RZMPW;T�MHX T7D_G)m GJIc@[U�@fT7GR � \5@[U�@cICFHR7IcdPk �=�Z¤ �-� k � © ¤ �-� k �=�Z¤�� �-� kSFHWim � © ¤ � �-� FHR7G#�<\ZGJmVX MPR�T7D_G(R7@[jSD;Tm GJIc@[U�@fT7GRE\|��(GW<BG � � © ¤ �&� � �-FHW<m � � © ¤ �-��� � � @[I[ILQ_R7MNm��<B G�� FSW<m��N| �! !"$#�%&%')( 4 � � � 4 �

�(GR7Gs@C\4F T7FSO_I[G�TZM�B MPUVQiFHR7G(T7D_Ga\5@:FGuMSX \ZMSU�G�MHX TZD_Gam_GI[@cU�@cTZGRE\J|

� *-�L���>���*����)1 � � � �:� 1 ��� �4���!* �

" ��� $ � � 8 � ; �

�=�Z¤ �&� ��� % �:�Z¤ �-� � � � �:�Z¤ �&� � � �=�0¤ �-� �� � © ¤ �&� ��� ' � © ¤ �-� � � � � © ¤ �&� � � © ¤ �-� �

�=�Z¤ � ��� ��� � �:�Z¤ � �-����� � �:�Z¤ � �&� � �=�0¤ � �-� ��

� © ¤ � ��� ��� � � © ¤ � �-����� � � © ¤ � �&� � � � © ¤ � �-� �

S!P

Page 47: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

} X^dSM!� � FHW;TJk dSM�� BFSW IcGT-] ~�� BED_MNMP\ZG TZD_G \Z@ FJG�MHX^m GI[@cU�@cTZGJRaONd �<\Z@cW<j T7D_G B MPW;TZR7MSI � MPR7m<\�-�c�<�c� FHW<m �[�0¤ ���A� O G X MPRZG dSM!�_R(m GJIc@[U�@fT7GRE\|(]^D��<\ �-�<�c�c�%� ����� �[�0¤ ���-��� � @[I[I BJF��<\ZGuTZD<G-U�F9T7GR7@[FSI �! !"$#�%&%')( 4 � TZMzOiG GWiB I[MP\ZGJm ONd O_R7FPBY�SGT7\uT7D<F9T�FHR7G FSQ_Q_R7MSQ_R7@[FHTZGJIcdzO_@cji| �?1_�* )*-�L����G FSBED �i\5G MHX(F��-�c�c�c�m GJIc@[U�@fT7GR4U �<\eT)D<F bSGuF�U�F9TEBED_@cW<j �=�0¤ ���A� m GI[@cU�@cTZGJR)8 FSIfT7D_M��_jPD TZD_G-m_GI[@cU�@cTZGRE\^T7D_GU�\ZGI[bSGJ\4U�F dO Gam @�� GR7GW;T ;/|��4GJW<B G � � �-�c�<�c� � �c� �<� �c�[���<�V� �-�0� �[�0¤ ���A� �[� � ��jS@[bSGJ\

����� ���� � �

�����

� �A�( *-���A�4� ���&� � *-�������5�*����

8 � ; � � �� � " ��� $ ���� �-�[���c�-�<� � �[�-���c�-�<� � �-���[�_¤=�� �[�_�[�_¤[� � �-�<�� ��&�c� � �[���� ����c�� ¦ � �=���&� ���<�<�&��� � �� � � �=� �&�<�-��� � �:¬ �&�<�c������ �<�-���� &�<�c����� � �[´A���� &�<�c����� �=� ���A� �� &�<�-�A���� �:¬ ���A���� ��<�-�����

" ~ � GREB @C\ZG6O_| pSo ]+dNQiG \5GT�� � ����� ��� � � ��� |

� ��� � .+8N3 8- 3 � �5$�*V, '�& � :+�e.+&�8

]^D_GJRZG�FSRZG�\5GJbSGJR7FSI TedNQ GJ\�MHX�X �_W<B TZ@[MSW<\sT7D<F9T-FSQ_Q GJFHRsX R7GHJ�_GJWPT7IcdY@cW U�F9TZD<GU�F9T7@[BJFHIyTZG��NTJ|�} WFHW G HJ�<F9T7@cMPW I[@:�SG �Z\Z@[W * � �hBMP\ * � � U � TZD<G�TZR7@cjPMSW_MPU�G TZR7@CB-X �<W<B/T7@cMPW<\ �7\5@[W��AFHWim �ZB M;\ ��FSRZG�@[WR7MSU�FHWAREF9T7D_GR(TZD<FSW�@fTEFHI[@[BaTedNQiGP|)]^D_@C\4@C\4T7D_G7�<\C�iFHI U�FHTZD_GJU�FHTZ@CBFSI BMSWNbSGJWPT7@cMPW TZM�@[W<m @CBFHTZG-TZD<FHT@cT)@C\)F X �_W<B/T7@cMPW�O G@[W_j m G \ZBRZ@[O GJm�FSW<mAW_MST(TZD<G-Q_R7M m��<B/TsMHX�T7D_RZGJG-b9FHR7@CFHO_I[GJ\J|(]^D_GVB MSW;T7RZMPI � MPR7m<\���A¤ �FSW<m ���=�&� � @[I[I%�<\ZG�TZD_GaR7@[jSD;T^Ted;Q G X FPB GaF�� TZMPU�FHTZ@CBFSIcI[dS|��(GR7Gu@[\4FVTEFHO_I[GuMHX TZD<GJ\ZGaFHW<m�\ZMSU�GMHT7D_GR4\ZQ GJB @CFHI X �<W<B/T7@cMPW<\�� �! !"$#�%&%')( 4 � *

� �*��<� ���H���A� (+*-���A�4� ����� � ��� �[�T� 1�� �

���A¤� �A�[�&� �[�A�� ���=�<� �A�[�&� �A�-�-� �c�[���-�A¤� �c�<���c�[�&��c�<���!���� �A�A¤� �� ���=�&��� �[�A�� �� �A�[�<��� �c�&¤D� ���4� � �&¤� ���-�&¤D� �!� � �c�&¤D� ¤� A� �-�<��� �-� �c��� �<�<� � �<�-�<� �<�A����<��¤D� ��&�!� � �A�<� �4���<� �T� ¤� �<�<� � ���_�=� � ¸ �

S3U

Page 48: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

" ~ � GREB @C\ZG6O_| p�S ]+dNQiG \5GT�\Z@cW%8 p * ; � p�\Z@[W * BMP\ * B M;\�8 p * ; �qp�B M;\ * * - US|

" ~ � GREB @C\ZG6O_| p!O ]+dNQiG \5GT�

� B\7B * � � �� - B MHT � � � I[@cU� \5@[W ""

� U Ic@[U� �\5@[W ""

� P �

" ~ � GREB @C\ZG6O_| p�Q ]+dNQiG \5GT�TEFHW�8 p * ; � pyT7FHW *

U - T7FHW * *�

� ����� 3 $0 >+3H� 3 $0 >+3

]^D_GJRZG�@C\uF�Q<FSR5T7@[B��_I[FSRuU�FSB R7M TZD<FHT-@[\ �<\5G mY@[W FHI[U�MP\5TuGbSGJRZdYU�FHTZD_GJU�F9TZ@CBFSI�Q<FHQ GR k FSW<m @[\m @ � GJRZGJW;T(GW_M!�_jSD�T7M R7GHJ�_@[RZG-F�\ZQ GJB @CFHI G�� Q_ICFHW<FHTZ@[MSWL|4]^D<@[\(@[\4TZD_G�� �A���&�<�<�_¤D� U�FSB R7M<|^} Ts@[\9�<\5G m� D_GJW \eTEF9TZ@[W_j T7D_GMPRZGJU�\Jk^B MSR7MSI[ICFHR7@cG \k+Q_RZMPQiM;\5@cTZ@[MSWi\k^FHW<m T7D_G�I[@ �PGS|2]^D_GAQ<FHREFHjPR7FSQ_D X MPIcI[M � @[W_j� �A�A�&�<�c�_¤2� @[\^O<RZM!�SGW @cW;T7M-T � M QiFHRZT7\� T7D_GE�<RE\eT{Q<FSR5T{jSMNG \�_Q T7MVFSW<m�@[W<BI �<m_@cW_jVT7D_G6�<RE\eT^QiGJRZ@[M mTZDiF9Tu@[\)X MPIcI[M � G mAONd�F \ZQ<FPB GSkLFSW<mAT7D_G�\5G B MPW<m�Q<FSR5T�@C\(T7D_G�RZG \eT�MHX�TZD_G�Q<FSR7FSjSREFHQ_DL|u]^D_GV@Cm GJF @[\ �! !"$#�%&%')(+*� * �&* ,TZDiF9TaT7D_G=�<RE\eT-QiFHRZTu\ZD_M!�_I[m O G \ZMSU�G T7D_@cW<jAIc@:�SG �7]^D_GMPRZGJU US| � MSR��/l+MSR7MSI[I[FSRZdAvs| �A]^D_G�\ZGJB MPW<mQ<FSR5T{@C\^TZD_Ga\5T7FHTZGJUVGJW;T^MSX T7D_G�TZD<GMSR7GU MSR4B MPRZMPIcICFHR7dS| �4GJRZG�@C\4FHW G��_FHU�Q_I[G��

� �A�A�&�<�c�_¤2� ®��&�-�[���!� ¢ � ¹ � � � � � �&�A�c������� ·� ���&� �[�=�� A�-���r�<�r�����F�&�&¤� ������&�¯�� ����c�����<�>�0�� ¤c� �0¤� ��H�jS@[bSG \

& ( *�1��B*-��� ��� � ! � � *-��� ��� � � �����R3D�-;= 0� B #d�:Kw�L���h@:"6�Y Z+&by�������: �� �g�P#&�4+M)�9: Q�6�ie-�6 AG�I

]^D_Ga\5T7FHTZGJUVGJW;T^MSX T7D_G�TZD<GMSR7GU U�F d B MSW;TEFH@[W U�F9T7D_GU�FHTZ@CBFHI G�� Q_RZG \Z\Z@[MSW<\JkNMHX BM��_RE\ZGS|

S;p

Page 49: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� ] ~ � @cW;TZR7M?8 `-| � | \5Q GI[I[@cW_j�; �NG B/TZ@[MSW O��yr(M�U�FHTZDAFHW��N@[G Ted�D_GR7G��

" ~ � GREB @C\ZG6O_| p���]+dNQiG \5GT�

& ( *�1��B*-� � - � �[��� � � �N����� B ��� �A�6�T�w9: Q�6 �t� ��U�g�\ 0;=)Q@-� B �!K0. B �6) �2�4I

" ~ � GREB @C\ZG6O_| p�W ]+dNQiG \5GT�

� �B1�� 1 �4�5�4� 1�� ��� �� � �� ����� � � �� �� ����� � W���L�� �A;<9:"���6#����X9: Z+ �! &"{#������ � � ��� � ��� � I

� ����������� � ��� �!�"$#&%('�)+*-,."$%(*/#10324*5,6*+#.78,&'�9�:;)+<>=@?8'�98"$#&'�<>98,A<$B�#(C�*D">E�'�:>98=D*-9F#G)HC8">%("I)J#&*-%LKM"$98NM#&C�*D)O<>9F#(%&<IEP <>%HNRQ�SUT�#(<M'�94NV'�)-"U#(*W#&C�*;*+98NX<>BY#&C�*ZE�'�9�*>[�\F#H"$%&# P ']#(C_^3^FQ$`>acbIdFTce f8g8h+h+h i3^3^�[�jk9F#&<M#(C�*l,&28">)+*?m*O# P *+*+9_#&C8*M?�%("I)O*5,@:I<n#(C�*�%&< P ,D<>BA#&C8*�=W"$#&%(']o�pq*5">)HC_<>9�*�*+94NV*-Nr?30_Q�S Tc[tsYC�*�*+9F#&%('�*-,u"$%(*,&*+28">%("$#&*-Nl?30Z#&C8*vKm[�w8<>%x*Oo�">=D28E�*G#&C8*v'�9�287V# y+z+{c| }J}&~-� �1� �1� �6�&�

^3^3QU`>acbId3Tme f8gb�K���K�S_K���Q�SUT��K�b�K�S �F��K�SI�I��Q�SUT� K � K�b �>��K�bV�$��Q�SUT� K � K�b>��K�S$��Q�SUTi��&^F^:>'��>*5,Y">,Y2�%('�9F#(*-N�<>7V#(2�7V# �

��� � � �� � �q��� �Y�X�� � ����� �/� �� � � � �O�

�+�� h

sYC�*u=W"U#(%&'�o�*+9F#(%&'�*-,.'�9�<>78%G*+o�"$=u2�E�*-,GC8" �>*D"$E�E ?4*-*+9X)O*+9F#(*+%(*-N P '�#&C8'�9n#&C�*-'�%v)+<>E�7�=u98, P ']#(C"ZE�'�#6#&E�*�,&28"I)O*/<I9�*-"I)HC�,6' NV*>[GsYC�*+0M)-"$9M?m*�=W">N�*v¡878,&C¢%('�:ICF#A<>%A¡878,&C�E�*+B£#.?30�'�94,6*-%6#('�9�:�QU¤�¥me>¦3¦?m*OB§<>%(*�<>%W"UB£#(*+%u#(C�*M*+9F#&%(0>[t¨L<>#&' )O*�#&C8*�N�']©c*+%(*+98)+*-,u?m*O# P *+*-9�#(C�*�B§<>E�E�< P '�9�:�*Oo�"$=u2�E�*M"$98N�#&C8*2�%(*+�3'�<>78,ª<>98*>[^3^3QU`>acbId3Tme f8gb�K���K�S�Q$¤�¥me$¦3¦_K�QU¤�¥me>¦3¦r��Q�SUT��K�b�K�S �F��K�SI�I��Q�SUT� K � K�b �>��K�bV�$��Q�SUT

«I¬

Page 50: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�: \3*5)J#&'�<>9��� ¨A<u=u"$#&CM"$9�o3'�*O#10lC�*+%(*��� K � K�b>��Q$¤V¥me>¦3¦rK�Q$¤�¥me>¦F¦�S$��QVSUTi��&^F^:>'��>*5,Y">,Y2�%('�9F#(*-N�<>7V#(2�7V#

���� � � �� � �q��� �Y�X�� � ����� �/� �� � � � �+�

� �� h

� � oV*+%H)O' ,&*���[ ��� s 0324*5,6*+#�����

���� � � �� � � �� � � �� � � �

� ��

j�#�� ,;24<F,&,&'�?�E�*¢#&<_C8" �>*�=W"$#&%('�)+*-,W#(C8"U#�78,&*¢<$#(C�*+%�NV*-E�'�=u']#(*+%H,+[��A,&'�9�:�Q5ambId3Tce f '�94,1#(*-">N�<$BQ$`>ambId3Tce f P '�E�E E�*5" �>*G<$©�#(C�*v28">%&*-9I#(C�*-,&*-,-p�,&<�#(C�*/NV*-E�'�=u']#(*+%H,x=@78,6#L?m*v*OoV2�E�'�)+']#(E�0;'�98)+E�74NV*-N�78,&'�98:Q3¦��I¥FdZ">98N�Q>Tce �F¤3dc["!L*-%&*�' ,YC�< P�P *v)+"$9M)HC8">9�:>*.#&C8*v=u"$#&%(']o;<$B <>7�%$#8%H,1#L*+o�"$=u2�E�*>[^3^�Q3¦��F¥Id&%Q5acb>d3Tce f8gb�K���K�S_K���Q�SUT��K�b�K�S �F��K�SI�I��Q�SUT� K � K�b �>��K�bV�$��Q�SUT� K � K�b>��K�S$��Q�SUTiQ>Tce��F¤Vd&%;^3^:>'��>*5,Y">,Y2�%('�9F#(*-N�<>7V#(2�7V#

�������

� � � �� � ��� � �ª���� � ����� �@� �� � � � �O�

�������

j�#�� ,.*+�I*+9�2m<I,(,6'�?�E�*/#(<Z78,&*uQ3¦��I¥Fdª�;">98NnQ>Tce��F¤Vdª�W#&<;'�98N�'�)-"U#&*@#&C8"$#.#(C�*@<I24*-9�'�9�:l<I%.)OE�<I,&'�9�:NV*-E�'�=u']#(*+%L' ,xNV*+E�*O#(*-N'�§98<$#&*�#(C�*v78,&*�<$B�#&C�*v2m*+%('�<VN�O[

«>«

Page 51: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(< ���/[ \c[m,62m*+E�E�'�9�: \3*5)J#&'�<>9��� ¨A<u=u"$#&CM"$9�o3'�*O#10lC�*+%(*��� � oV*+%H)O' ,&*���[ ¬ � �.,6*v"u=W"U#(%&'�o;)+<>98,6#&%(78)J#('�<I9Z#(<u#10F2m*-,&*O#

� � ��� � � � �� � � � �sYC�' ,�*+oV*+%H)O' ,6*L">98Nu=u<>%(*x:>*+98*+%H"$E�)O<I98,6#&%(78)J#('�<I98,�<$Bc#(C�'�,�#10324*L=W" 0u"$E ,6<v?m*x#1032m*-,&*O#q78,&'�9�:v#&C8*Q�S>b � � � =W">)O%(<8[ y z {c| }J}&~-� �1���\3<I=u*O#&'�=u*-,.*+E�E�'�28,&*-,�"$%(*/78,&*-N P ']#(C�'�9n=W"U#&%(' )O*-,-[�sYC�*D)+<>9F#&%(<>E P <I%(N8,GQ�S$���Id � pmQ��V���Id � p4">98NQI�3���Id � )+">9;?m*v78,&*-N;#&<u'�98,6*-%6#LC8<>%('�-<>9F#(">Ep3�>*-%6#('�)-"$E pV"$98N�NV' "$:I<>98">EcN�<$#(,-[sYC378, P */)+">9;78,&*

^3^�Q3¦��F¥Id�Q5acb>d3Tce f8gb3b�K�QVS$���Id � K�b� �Q�SUTQ��V���Id � K�QI�3���Id � K�Q��V���Id � Q�SUT Vb�K�QVS$���Id � K� � �Q�SUTiQ>Tce��F¤Vd���^3^#&<u:I*O#A">,Y28%&'�9F#&*-N;<>7�#&2�7V# ������ ���������[[[ [ [ [ [[[��� ���������

��

!�"$#&%('�)+*-, =W" 0Z"$E ,6<�?4*.#10324*5,6*+#ª'�9���E�'�9�*>pV?87V#Y#&C�*-0Z"$%(*A2�%(*O#&#10W7�:>E�0W7�9�E�*-,(, #&C�*-0WC8" �>*G"@,&=u">E�E937�=@?m*+%x<>B�%(< P ,-[ "!$#&%('*) ��+-, �/. �10 �3254 ����)76"8 �

� E�E�<>B #(C�*Z=W"U#(C�*+=W"$#&' )+,v)O<U�I*+%(*-Nn,6<�B ">%vC8">,�' NV*+9F#('�)-"$E�'�9�2�7V# P C�*O#(C�*+%/'�#/' ,�#&<M?m*u#10324*5,6*+#'�9�� E�'�9�*�<>%WNV' ,62�E " 0>*5N�[ � #u#&C8'�,u2m<>'�9F# P *�� E�ExE�<3<�9 "$#u,&<>=u*M,&']#(78"U#('�<I98,�#&C8"$#W">2�2�E�0X#&<RNV' ,628E�" 0I*-N*�:F78"$#&'�<>98,Y<I9�E�0>[sYC�* #8%H,1#�'�, #&C8"$#�<>B8"$E�'�:I9�'�9�:L=@78E]#('�E�'�98*ªNV' ,&2�E�" 0V,-[�sYC�' ,�'�,�NV<>98* P '�#&C/#(C�* ">E�'�:>98=D*-9F#�)HC8">%("I)J#&*-%Kv"$98N/#&C�*ª)O<I9I#(%&<IE P <>%HN�, QVSUT�"$98NuQ���;VbV¦8e ��<�[ \F#H"$%&#&'�9�: P '�#&CW^F^3Q���;Vb3¦8e ��<4g�h-h+h i3^F^8p5#&C8* *=:I74"U#&'�<>94,#&<�?m*L"$E�'�:I9�*-N�"$%(*Y*+9F#&*-%&*5N P '�#&CD*-"I)HC�<I9�*ª#&*+%(=u'�94"U#&*5N@?30DQ�SUTc[ jk9D*-"I)HC�*=:I74"U#&'�<>9�#&C8*+%(*Y,&C�<I7�E�N�?m*

«��

Page 52: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�: \3*5)J#&'�<>9��� ¨A<u=u"$#&CM"$9�o3'�*O#10lC�*+%(*��<>98*/"$E�'�:I9�=u*+9F#L,603=@?m<>E KW#&<W'�98NV' )+"$#&* P C�*-%&*�#(C�*/"$E�'�:I9�=u*+9F#A,&C�<>7�E N;#("�9>*�2�E ">)O*I[qsYC�' ,x' ,x78,&78"$E�E�0NV<I9�*v"U#x#&C8*v*�:F78"$E ,&'�:>98,-p�"$E�#&C�<I7�:>C�'�#L'�,Y9�<>#L9�*-)+*-,(,&">%&0u#(<WNV<W,6<4[�w�<>%x*+o�"$=u2�E�* y z {c| }J}&~-� ����� � �����^3^3Q ��;VbV¦8e���<4gb��I��K��S�3��Q�S Tf�K��� ��� �� �Q�S Ta���<��*����`�K� ;�QVSUTi3^3^03'�*-E�N8, � ��� ����� �

� ���_����� �� ���W���L��� ���

.'�,&2�E " 0>*5N *�:F78"$#&'�<>98,D)+">9�?m*�9F78=@?m*+%(*-N�"$#W*+'�#&C�*-%�#(C�*�%&'�:>CF#u<>%DE�*+B£#W=u">%&:I'�9 [�!�C�*+9_#&C8*)O<I9F#&%(<>E P <>%HNXQ���;�<��M"$2�2m*-">%(,/'�9 "�N�'�,&2�E " 0>*-Nn*�:F78"$#&'�<>9 p�*+�I*+%(0F#&C�'�9�:�"UB£#(*+%@#&C�*l)+<>9F#&%(<>E P <>%HN�'�,2�7V#A"$#x#&C�*v%('�:>CF#x=u">%&:I'�9 [ !A*+98)+*�^F^�f�"��� � Q ��;�<��$#&%('>^3^�03'�*-E�N8,� ��� � � h � �

s�<D937�=�?4*-%A"$9�*�:F78"$#&'�<>9�"U#Y#&C8*vE�*+B£#A=W"$%(:>'�9 p378,6*�Q3¦���;�< ��'�9�2�E�"I)O*�<$B�Q���;�<��4[j�#�� ,A24<F,&,&'�?8E�*�#(<Z937�=@?m*+%A">E�'�:>98*-N�*�:F78"$#&'�<>98,x?30�78,&'�9�:u#(C�*@)+<>9F#&%(<>E P <>%HN�Q ��;VbV¦8e���<�<��4[ sYC8*"$E�'�:>9�=u*+9F#L)HC8">%("I)J#&*-%YKZ'�,Y74,6*5Nl#(<W,6*-28"$%H"U#(*.#(C�*v*�:F78"$#&'�<>9;B§%&<I=�#&C8*v*�:F78"U#('�<I9;937�=�?4*-%-[

^3^3Q ��;VbV¦8e���<�<��Vgb��I��K��S�3��K)#&%"'rQ�SUTf�K��� ��� �� �Q�S Ta���<��*����`�K� ;�K�*�Q�SUTi3^3^03'�*-E�N8,

� ��� ����� � � � � ���_����� �

� ���W���L��� ��� +

�.,6*�Q3¦���;3bV¦8e ��<�<��v#&<u2�7V#x#(C�*v*�:F78"$#&'�<>9�9F78=@?m*+%H,x<>9;#&C�*vE�*OB£#5[ y+z+{c| }J}&~-� ���,� � ����-

«".

Page 53: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�: \3*5)J#&'�<>9��� ¨A<u=u"$#&CM"$9�o3'�*O#10lC�*+%(*��w�'�98"$E�E�0IpV,67�2824<F,6*G,6<I=D*L#&*Oo3#Y9�*+*5N�,q#&<�">2�2m*-"$% '�9Z#&C�*G=u'�N�N�E�*G<$B "�NV'�,&2�E " 0>*5Nu*�:F78"U#('�<I9 [ sYC�'�,)+">9¢?m*DN�<>9�*D?30�287V#6#('�9�:�'�#G'�9X"$9�C3?m< oc[ !�* P '�E�E�NV*-,()O%('�?m*DCF?m< oV*-,.'�9n=u<>%(*�NV*+#("$'�E '�9n#&C8*�9�*+o3#,&*-)J#('�<I9 [Zw�<I%v9�< P�P * P ">9F#G#(<�78,6*u#(C�*+= #&<�#(*+=u24<I%(">%&'�E�0M%&*5,67�=u*u78,&'�98:�<I%(N�'�98">%&0M%(<>=W">9¢#1032m*"$94N/#(<�">E�,&<�"$E�E�< P #(C�*x'�98,6*-%6#('�<I9�<>Bm,&28">)+* ?m*O# P *+*-9 P <I%(N�,$�§%(*+=u*-=@?m*+% #&C4"U#q"$E�E�,&28">)+*-, "$%(* '�:>98<>%(*-NP C�*-9l#1032m*-,&*O#6#('�98:W=u"$#&C�*-=W"U#&' )+, J[ !A*+98)+*�^F^ � ����Q$¤F���If8g�eU¥�b�<�����<4¦��eU¥�i$f���ª�&^F^ P '�E�E�:I'��I*

�&��� '�B ">98Nl<I9�E�0l'�B � ���ch¨L<>#&*/)-"$%(*OB§7�E�E�0Z#&C�*/,&28">)+*-,ª'�9;#(C�*vC3?4< o�[� � oV*+%H)O' ,&*���[ ¬ � .<W,6<I=u*G<>B�#(C�*/)HC8">E�E�*+9�:I*.28%&<I?�E�*-=W,Y<>9�28"$:I*-, ���I� ����� <$B�sYC�*/s � �.?4<3<�9c[

«��

Page 54: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

������������ ����������������

j�#�� , 9�<$#ª7�98)+<>=u=u<>9u#&< P ">9F#�#&</287V#Y"v#("$?8E�*.'�9W#(C�*A=u' N�NVE�*A<>B ,6<I=D*L#&*Oo3#5[ w8<>%&#&7�94"U#&*-E�0us � �=W" 9I*-, '�#�*-">,&0/#(<vNV<�#&C�' ,-[�jk9DB "I)J#�#&C8*+%(*L"$%(* # P </,&*+28">%("$#&*ª=D*+#&C�<VN�,�<$B�"$E�'�:I9�'�98:�#&*Oo3#5[�sYC�* #4%(,6#�'�,?30Z78,&'�98:u#&C�*�#H"$?�?�'�9�:W*-9F�3'�%&<I9�=u*+9F#-[�sYC�' ,x' ,x,6'�=u'�E "$%Y#(<Z,6*+#6#('�9�:u#(C�*�#(">?M,1#(<>28,Y<I9�"D#1032m* P %(']#(*+%5[� "I)HC;E�'�9�*v'�,LC8"$98N�E�*5N;'�98NV'��3'�N�78"$E�E�0Ip8">)-)O<I%(NV'�9�:D#&<Z,&*O#x#H"$?M)O<IE�78=D94,+p�?87V# P ']#(CM:>%(*-"$#&*+%ª¡8*+oV'�?�'�E�']#10#&C4"$9�#&C8"$#/2�%(<U�F' NV*5N¢?30n";#1032m* P %(']#(*+%5[ZsYC�*Z,6*5)O<I98N¢' ,�#(C�*WC�<>%(' �+<>9F#H"$E�"$E�'�:>9�=u*+9F#v*+93�3'�%&<I9�=u*+9F#P C�' )HC�#10F2m*-,&*O#H,ª#&C�* P C8<>E�*.#H"$?�E�*/"U#x<I98)O*�78,&'�98:Z"�28%&*5,&)+%&'�?4*5Nl24"U#6#(*+%(9 [�5!$#�� )��! ) 8#" 4 + �%$ � ����&

s�<;">E�'�:>9�=W"$#&*+%(' "$E�78,6'�9�:l#&C�*�#(">?�?�'�9�:;*-93�F'�%(<>9�=u*+9F#5p40I<>7�=�78,1#�#8%H,1#�,6*+#.#(C�*�#("$?n24<F,6'�#&'�<>94,78,&'�98:@#(C�*vQ � �Id3dVb>� � )+<>9F#&%(<>E P <>%HN�[ !A" �3'�98:�NV<I9�*A#(C�' ,+p�"�E�'�9�*.#&<D78,&*A#(C�*-,&*G#("$?4,ª,6#(">%6#H, P '�#&C;#&C8*)O<I9F#&%(<>E ,&03=@?m<>E�Q(� "$98NM*-98N�, P ']#(C�Q�S T �§%(*+=u*+=�?4*-%L#(C8"U#.#&C�*D">)J#(78"$E�,624">)O'�9�:Z<I9ME�'�9�*5,A'�9M#&C8*'�9�2�7V# #8E�*v'�9�789�'�=u2m<>%&#(">9I#�J[sYC�*x*5">,&'�*5,1# P " 0�#&<v78,&*Y#&C8*.Q � �Id3d�b$� � )O<I9I#(%&<IE P <I%(N@'�,�#&<v2�7V#�#(C�*Y#&*+o3#�'�9F#&<v*=:F78"$E�)+<>E�7�=u98,+[

�A,&'�9�:�Q � �>d3d�b>� �(' Q�S��3¦*)>a�< ��P '�E�E�,&*O#L#(C�*v#(">?8,x#(C8"U# P '�E�E 2�%(<VNV78)+*�B§<>7�%.*�:F78"$E�)O<>E�7�=u98,-[ªsYC8* y z {c| }J}&~-� ��-J�#(">?�?�'�9�:W' ,Y#&C�*-9�NV<>98*v?F0;78,&'�9�:u#(C�*/"$E�'�:>9�=u*+9F#A)HC8">%("I)J#(*+%YKZ#(<W=D<U�I*G#&<u#&C8*/9�*Oo3#L#H"$?M,6#&<>2 [ \3<8pB§<>%x*+o�"$=u2�E�*>pQ � �>d3d�b>� �(' Q�S �V¦*)>a�< �Q"�,+VTce dme � ¤.-��3¦*)>a8��eUbrK0/8¦U���IT3d�brK213b �43 bIdmS ¤��(�8b�<_K25�b <�e d �>��b�Q�SUTQ"�26 <Vd�b>Tce �_K87*)��>����S K09���:+3T;)�< � �ceFS 3 K:9 ����b.18S �Idce$b�Q�S TQ"��K0<FTce=<cS��>=3�"�8bITV�@? � ¦Fb�<��tK:9��(�V¥��A)�<��V¦Fb�<��tQ�SUTP '�E�E 28%&<VNV78)+*G#&C�*�#H"$?�E�*Bª%&'�#&' ,&CDC <IE�7�=�?�' " � E�?m*+%&#(" \V"I, 9U"U#H)HC�* P "$9 !�">9�']#(<>?8"E 9F#(">%&'�< F.7�*-?4*5) ¨L* P Bª%(7�98, P '�) 9 ¨L<U�U"W\V)+<$#&' "

G�%('�98)O* � N P ">%(Nlj1,6E "$98Nr¨L* P B§<>7�94NVE�">98N¨A<$#&' )O*l#&C8"$#�'�#�' ,@2m<I,(,&'�?�E�*W#(<n,$9F'�2 <U�I*+%@,&<>=u*W#H"$? 2m<I,&']#('�<I98,-p ">98NX'�#D' ,/9�<>#�9�*5)O*5,&,("$%(0�#(<78,&*Z"$E�E�<$Bª#&C8*u#("$?4,v'�9 "�:I'��I*+9XE�'�9�*I[ls <M=W"�9>*D#&C�*;,&">=D*D#H"$?�E�*W78,&'�9�: #4�>*Z)O<IE�78=D94,+p�']#/' ,v<>98E�09�*5)O*-,(,("$%(0M#&<n78,6*�Q � �Id3d�b$� �IH Q�S��V¦*)$a�< � #&<¢%&*5,6*+#/#&C�*l#(">? ,1#(<>28,�J #&C�*-9R#&C8*l,&">=u*W#&C�%(*+*lE�'�9�*-,B§%(<>=�#(C�*vE�"I,1#L*+o�"$=u2�E�* P '�E�E 2�%(<3N�78)O*

« �

Page 55: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�: \3*-)O#&'�<>9 .� � E�E '�9M"�%(< PBª%&'�#&' ,&CDC <IE�7�=�?�' " � E�?m*+%&#(" \V"I, 9U"U#H)HC�* P "$9 !�">9�']#(<>?8"E 9F#(">%&'�< F.7�*-?4*5) ¨L* P Bª%(7�98, P '�) 9 ¨L<U�U"W\V)+<$#&' "

G�%('�98)O* � N P ">%(Nlj1,6E "$98N¨L* P B§<>7�94NVE�">98Njk9M#(C�' ,A*+oV">=u2�E�*Ip�#(C�*�)+<>E�7�=u98,A">%&*@,&=W"$E�E�*-%-p4<$B�)O<I7�%H,6*I[xjk9�B ">)J#.#&C�*-%&*�"$%(*v# P <W<U�I*+%(E�">2�2�'�9�:*+9F#(%&'�*-, '�9l#&C�*GE ">,6#ª%(< P [�sYC8'�,ª' ,q?m*-)-"$78,&*Gs�� � P '�E�E4#H"$?l#&<�#&C�*G9�*Oo3#ª#(">?l2m<I,&']#('�<I9Z*+�I*+9l'�B � 7�9�E�'9I*"�#10324* P %&'�#&*-% ª'�#L=u*-"$94,Y:><>'�9�:D?8">) 9 P "$%HNZ<I9l#(C�*v28"$:I*>[sYC�*-%&*n'�,;"$9�'�9F#&*-%&*5,1#('�9�:_%&*-E�"$#&'�<>98,&C�'�2�?4*+# P *-*+9�:I%&<I7�2�'�9�: "$94Nt#(">?�?�'�9�:8[ sYC�*XQ � �IdFd�b>� ��U"$E�7�*-,."$%(*v<>9�E�0�"$2�2�E�' )+"$?8E�*v#(<W#&C8*@:>%(<>782�'�9 P C�' )HCM'�#.' ,ANV* #89�*-N pm"I, P <>7�E N�?4*�*OoV2m*-)J#(*-N�[LsYC378,'�# ' ,q2m<I,(,6'�?�E�*L#(<v#&*-=D2m<>%H"$%('�E�0u)HC8"$98:>*x#(C�*L#H"$?l,&*O#&#&'�9�:I, ?30�:I%&<I7�2�'�9�: P '�#&C�'�9Z?�%H">)+*-,-[�jk9l"IN�NV'�#&'�<>9 p*-"I)HCM#(">?�E�*@*+9F#(%&0�' ,A'�9¢"Z:I%&<I7�2M<$B ']#H,A< P 9 [�!L*-98)O* P *�=W" 0�=W"�9>*@";,6'�9�:>E�*@*-9F#&%(0�?m<>E N3B "I)O*>pmB§<I%*Oo�">=D28E�*Ip ?30�78,&'�98:�Q$��¥ P '�#&C�<I7V#/?�%H">)+*-,-[�jk9R">N8NV']#('�<I9 p B§<I%/"$930¢)+<>E�7�=u9n?�7�#/#&C�*WE ">,6#v<>9�*u'�#/'�,2m<I,(,6'�?�E�*Y#&</)O*-9F#&*+%�#&C�*L*-9F#&%(0@<>% #(</"$E�'�:I9u']#q*-']#(C�*+%q<>9D#&C�*AE�*+B£#q<>%�<I9�#(C�*L%('�:ICF#-p><I% #&<�#8E�E4"v)+<>E�7�=u9P '�#&CX"lE�'�98*�<I%�N�<$#(,-[ � "I)HC�*+9F#(%&0MC8"I,�"$9¢'�=u2�E�'�)+']#�Q$¤�¥4e>¦l"U#G#&C�*u*-98N¢,&<l#(C8"U#v'�# P '�E�E�?4*W"U#G#&C8*E�*OB£#Y<$B�#&C8*.)O<IE�78=D9l?F0WNV*+B "$7�E�#-[ � N�NV'�9�:uQ$¤�¥me>¦v"U# #&C�*.?4*-:>'�9�9�'�9�:@<>B�#&C�*G*+9F#(%&0 P '�E�Em#&C�*-9l)+">78,&*A'�##&<;?4*D)O*-9I#(*+%(*-N�p��178,6#G">, P ']#(C�#(C�*uQ3¦8e=<��Z)O<>9F#(%&<IE P <>%HN�[ � N�N�'�9�:�QU¤�¥me>¦3¦D#&<Z#&C�*�?4*-:>'�9�9�'�9�: P '�E�E)+">78,&*v#&C�*D*+9F#(%&'�*-,L#&<l?m*@2878,6C8*-N�#(<Z#&C8*@%('�:ICI# � Q$¤�¥me$¦3¦u"I)J#H,��178,6#.E�' 9>*uQ$¤�¥me>¦u'�9M#&C8"$#.'�#�">?8,&<>%(?8,*Oo�)+*-,(,x,628"I)O* J P C�*+9�?4<>#&C¢Q$¤�¥4e>¦D">98N�Q$¤�¥me>¦F¦D">2�2m*-"$%5pF#&C�*�Q$¤�¥me>¦F¦@#H" 9I*-,ª2�%(*-)O*5NV*+94)O*�O[

Q � �>d3d�b>� �(' Q�S �V¦*)>a�< �Q"��Q$¤�¥me$¦I+VTce dce � ¤:-��V¦*)$a8��e$b_K�Q$¤�¥4e>¦3¦>/8¦$���>T3d�b�Q�;�; )8bF�tK�Q$��¥013b � 3 bIdmS ¤���8b�<K:5�b�<�e d��>�8b�Q�S TQ"��Q$¤�¥me$¦,6 <Vd�bITme �rK�QU¤�¥me>¦3¦,7 )��>���8SrQ�;�; )8bF�tK�Q$��¥,9��(�.+VT )�< � ��eIS 3K:9 ����b.18S��>dce$b�Q�SUTQ"��Q$¤�¥me$¦��3�3�tK�Q$¤V¥me>¦3¦�*�Q�;�; )�bF�tK�QU��¥:9 �(��¥��A)�<���¦Fb�<V�K:<3Tce=<cS �>=V�"�8bIT3�@? � ¦Fb�<V��Q�SUTQ"��QI���Id3¥me>¦3¦�KFK�Q$¤3T;)4¦��F¥4e>¦3¦ K�Q�SUTP '�E�EL28%&<VNV78)+*M"¢#H"$?�E�* P ']#(Cr#&C�* #8%H,6#W)+<>E�7�=u9�)O*+9F#(*+%(*-N�pq#&C�*�,&*-)+<>98Nr)O<IE�7�=u9_¡878,&Ct%&'�:>CF# P ']#(C" Q�;�; )8bF�¢<>B.28"IN�NV'�9�:8pY"$94N #(C�*�#&C�'�%(Nr)O<IE�78=D9r?m<>E N3B ">)+*>[�sYC�*M)O<I9I#(%&<IE P <I%(N�,WQI���>dV¥me>¦3¦�">98NQ$¤VT )4¦��F¥me$¦3¦/:>'��>*�"$E�#&*-%&98"$#&'��>*v)O<IE�78=D9�*+9F#(%&'�*-,-[Bª%(']#('�,&C C <>E�7�=@?�' " � E�?4*-%6#H" ������������ �������� !�">9�']#(<>?8"

E 9F#("$%('�< F.7�*-?4*5) ������������������� �!� ¨L<U�U"W\V)+<$#&' "" # ������$&%'����(�) ����( G�%('�98)O* � N P ">%(Nlj1,6E "$98Nh+hOh-h+h-h+h+h-h+h-h+hOh-h+h+h-h+h-h+h+h+h

� � oV*+%H)O' ,6* .�[ � s�"�9>*�#&C�*D#(">?�E�*D<>B Cª"$94">NV' "$9n2�%&<U�3'�98)O*5,.">?4<U�I*�">98Nn)+*+9F#&*-%�*-">)HC¢*+9F#&%(0 P ']#(C�'�9'�#(,L)+<>E�7�=u9 [« �

Page 56: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�: \3*-)O#&'�<>9 .� � E�E '�9M"�%(< PsYC�*Z#("$?�24<F,6'�#&'�<>98,�)+">9R?4*l,&*O# P ']#(CR=@78)HC�=D<I%&*u¡4*OoV'�?8'�E�']#10�#(C8"$9 �178,6#�'�9R*�:F78">E )+<>E�7�=u98,+[sYC�*v:I*+9�*-%(">E�28"U#&#&*+%(9M' ,Y#&<W78,&*@"W,("$=u2�E�*vE�'�9�*v<>B�#(C�*�B§<>%(= Q � �Id3dVb>� � Q"��h-h+hLK h+h+h.K�h-h+hGQ�SUTc[sYC�*W,&28">)+'�9�:�?m*O# P *+*+9n#&C8*Z"$E�'�:I9�=u*+9F#�)HC4"$%H">)J#(*+%H,AKnNV*O#(*+%(=D'�9�*5,G#&C�*u2m<I,&']#('�<I9n<>Bq#&C8*u#("$?4,+[uw�<I%*Oo�">=D28E�*Ip�Q � �IdFd�b>� � Q"��Q$¤ �43 e5` %�e=<�K�Q$¤ �43 e5` � e=<�K�Q$¤ �43 e5` % � H e=<�K�Q�SUT P <I7�E�N¢,6*+##&C8*�#8%(,6#x#(">?�<>9�*�'�98)HC�B§%&<I= #&C8*vE�*+B£#L=u">%&:I'�9 p3#&C�*v9�*+o3#."$9�<>#&C�*-%ª# P <W'�98)HC�*5,ªB§7�%6#(C�*+%A'�9 p4"$98N;#&C8*#&C8'�%HN � [ �/'�98)HC8*-,ª=u<>%(*>[�j�# � ,x"$E ,6<�24<F,&,&'�?8E�*A#&<D78,6*.#&*+o3# #(<DNV*+#&*-%&=u'�9�*A#(C�*vNV' ,1#H"$98)+*A?m*O# P *+*+9l#(">?8,+[\3<4p�B§<>%D*Oo�"$=u2�E�*>p�">9�<$#(C�*+%D2m<I,(,6'�?�E�*�,("$=u2�E�*lE�'�98*;' ,ZQ � �Id3d�b$� � Q"��Q�; )8bI�.<FT ���ce=<mS���Q�; )�bF�tKQ�; )�bF�,< �>` )4¦IbIdce ��<�Q�; )8bI�tK�Q�; )�bF��/3T��3b�Q�;A)8bF��K�QVSUTc[XsYC�*l#H"$?r)O<>E�7�=u9 P <>78E�NX#(C�*+9r?m*

�178,6# P ' NV*/*-9�<>7�:IC�#&<l"I)+)+*+2V#x#(C�*@C�*5">NV'�9�:F, P ']#(C¢" :F78"IN;<>Bq,624">)O*v<I9M*-"I)HC�,&' NV*>[ !A*+%(*�� ,L"W=u<>%(*)O<I=u2�E�*+#&*v*+oV">=u2�E�* Q � �>d3d�b>� � Q"��Q�; )8bF�����3b>T�Q�; )8bF��K�Q�; )8bI�.<FTceFS���Q�;A)8bF�K�Q�; )8bF���ce=�ceU� ��<V�rK�QVSUTQ"��Q$¤�¥me$¦3¦ ���3bIT�Q�;A)8bF�tK�Q�; )8bF�,<3TmeFS�� Q�;A)8bF��K�Q�; )8bF���ce=�ceU� ��<V��Q�SUTQ"��Q$¤�¥me$¦3¦�%���� %�Q�;A)8bF�tK�Q�; )8bF� ' % �3� H ' Q�;A)8bF��K�Q�;�; )8bF��^ � � � Q�SUTQ"��Q$¤�¥me$¦3¦ � Q�;A)8bF�tK�Q�; )8bF� ' % �3� H ' Q�;A)8bF��K�Q�;�; )8bF��^ � �� � Q�S TQ"��Q$¤�¥me$¦3¦�� Q�;A)8bF�tK�Q�; )8bF� ' 3�3� H H Q�;A)8bF��K�Q�;�; )8bF��^ � �����Q�S TQ"��Q$¤�¥me$¦3¦ ' Q�;A)8bF�tK�Q�; )8bF� ' � �3� H ��Q�;A)8bF��K�Q�;�; )8bF��^ �q� � ' Q�S TQ"��Q$¤�¥me$¦3¦ H Q�;A)8bF�tK�Q�; )8bF� ' H �3� H � Q�;A)8bF��K�Q�;�; )8bF��^ �q� ' � Q�S T:>'��>*5, y+z+{c| }J}&~-� � � ���*-"$% G�%('�)+* A'��3'�NV*-98N� ��� � « � �U« ���V[ . �

� « � �U« ���V[ � �¬ «". ��� ���V[ � �« « � �$¬ �$¬�[ �U«� «�� ��� �$¬�[ « �

� � oV*+%H)O' ,&* .8[ � s�" 9>*G#(C�*�#(">?�E�*�:I'��I*+9�"$?m<U�>*�"$98N�=u<U�>*G']#A)+E�<F,6*-%Y#&<D#&C8*/)O*+9F#(*+%x<$B�#&C8*v28"$:I*>[� � oV*+%H)O' ,6* .�[ ¬ E 98* P " 0n#(<n)+*+9F#&*-%u"¢?�E�<3) 9X<>BL#&*+oF#5p�2m<I,(,6'�?�E�0 ,6*-�>*+%H"$E E�'�9�*5,�E�<>98:8p�' ,/#(<n78,&*� ^3^3Q �F���If8g�h-h+h i3^3^8[ �A,&*�#&C�' ,x#(<Z)O*+9F#(*+%Y#&C8*v#(">?�E�*v:I'��I*+9�"$?m<U�>*I[ A<3*5,Y#&C�*uQ � �Id3d�b$� � E�'�9�*/98*+*-N;#(<?m*v'�98)+E�74NV*-N�'�9;#(C�*�Q��F� �If��� � o3*-%()+'�,&* .�[ « jk=D28%&<U�I*D0I<>7�%@E�"I,1#@%(*-,&7�E�#@?30¢2�7�#6#&'�9�:�"�E�'�9�*Z7�94NV*+%@#&C�*�)O<>E�7�=u9RC�*5">N�,-[�sYC8*)O<I9F#&%(<>E P <I%(N�Q$¤3T;)4¦�� P '�E�E�'�94,6*-%6#L"DC�<>%(' �+<>9F#H"$EcE�'�9�*�'�B�'�9F#&%(<3N�78)O*5Nl?m*O# P *+*-9l# P <�%(< P ,ª<$B "@#H"$?�E�*>[¨L< P %(*+2m*-"$# P '�#&C¢#&C�*u)O<I9F#&%(<>E P <>%HNnQ � d3T )Vd�"UB£#&*-%G#&C�*ZQ"� <$Bq#&C�*DE�'�9�*u)O<I9I#H"$'�9�'�9�:Z#(C�*D)+<>E�7�=u9

� �

Page 57: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(< ���/[ \c[m,62m*+E�E�'�9�: \3*-)O#&'�<>9 .� � E�E '�9M"�%(< PC�*5">N�,-[ � � Q � d3T;)3du*+©m*5)J#&'��>*-E�0;=W" 9>*5,ª#&C�*/,&28"I)O'�9�:u?4*+# P *-*+9�E�'�9�*5,L"DE�'�#6#(E�*/:I%&*5"U#(*+%5[ sYC8*/,6' �+*v)+">9?m*/"$E�#&*+%(*-NlB§%(<>=�#(C�*/NV*OB ">7�E�#-[ u¨L<$#(*G#&C�*v*+oF#(%("u,&28">)+*G#&C8"$#L%&*5,67�E�#(,-[ y z {c| }J}&~-� ���� � oV*+%H)O' ,&* .�[ � !�" 9I*A#(C�*�B§<>E�E�< P '�9�:�#(">?�E�* P '�#&C�NV*5)O'�=u">E "$E�'�:I9�=u*+9F#-p3#(C8"U#x' ,+p P '�#&C�#(C�*vNV*-)+'�=W"$E2m<>'�9I#H,�"$?m<U�>*ª*-"I)HCu<$#&C8*+% �£#(C�'�9 9�<>B4#(C�*LNV<IE�E "$%"#8:I7�%(*Y"I, ?4*-'�98:v%&'�:>CF#q"$E�'�:>9�*5N�">98N�#&C�*L)+*+9F#(,"#4:>7�%(*">,Y?m*+'�9�:WE�*OB£#A">E�'�:>9�*5N;">:I">'�98,6#ª#&C�*/NV*5)O'�=W"$E 2m<>'�9F# �

G�E�7�=W, � � [ ���C <$©c*+* � [ � �� %H"$9�<IE�" � [ � �!M78,&C�%(<3<>=W, [ .>¬��' P 'cB§%&7�'�# [ ¬��E %H"$9�:I* �17�' )O* � [ � �s�7�98" � [ � ��m78)-)HC�'�9�' [ .$«� %H"$2m*-, � [ .��\3=u<�9I*-N;?4*-*OB [ � �Bª%&<V)-)O<>E�' � [ � �s�<$#(">E � � �F[ ���

� � o3*-%()+'�,&* .�[ . A*-�3'�,&*@"W=u*O#(C�<VN�#&<l=u"�9>*@"Z%&<I7�:>C�#(">?�E�*/<$Bq)+<>9F#&*-9I#H,L?30�78,6'�9�: � �Id3d�b$� � ">98NC8" �3'�9�:u*+9F#&%('�*5,ªE�<3<�93'�9�:W,6<I=u*O#&C8'�9�:uE�'9I*� � �IdFdce=< �:1IdVbIT3d��F��QI���IdV¥4e>¦3¦_K�Q$¤�¥me>¦F¦�%/8¦3¦�-I¤�bIT�b8SUd �IT � � T �3bId�b�<��01 acb3¦3¦�QI���Id3¥me>¦3¦�K�Q$¤�¥me$¦3¦��q��5!���� 6q� )�� 6"8Y��� , � , )�" 8 � 8Y��� )k�%$ 6 � � � 6 + $ ) � ��)�� ��� �10 + ���V� � � 8 �

sYC�*vQ � �Id3d�b>� � *+93�3'�%(<>9�=u*-9I# '�, 9�<$#YNV'��W)+7�E�# #(<@78,&*��3"$98NZ<>98)+*L#&C8*A28"$#6#&*-%&9l'�,ª,6*+#��3'�#ª)+">9Z?m*78,&*-Nl%&*-24*5"U#&*5NVE�0W'�9�NV'�©m*-%&*-9I#Y2m<>%&#&'�<>98, <$B�#&C�*.#&*+oF#Y#(C8"U#YB§<>E�E�< P ,+[�j�#LNV<3*-,ªC8" �>*G,6<I=u*.NV%H" P ?8">) 9V,��C�< P *+�I*+%5[;w�<I%/<>98*���#&C�*l)+<>E�7�=u9 ,6' �+*l=@78,6#/?4*�,6*+#@?m*OB§<>%(*u#&C8*Z*+9F#&%('�*-,@">%&* 939�< P 9 [ � E ,&<�� *+�I*+9#&C8<>7�:ICD'�9W<>98*A)+"I,6* P * P ">9F#&*-N�#(C�*x#&C8'�%HNu)O<>E�7�=u9u#&<@?4*L?m<>E N3B "I)O*��I']# C8">ND#(<v?4*A,&2m*-)O' #8*5Nu'�9W*5">)HCE�'�9�*I[�sYC�*-,&*�2�%(<>?�E�*+=W,x)+">9;?m*vC8">98NVE�*-N�=u<>%(*G*5">,&'�E�0Z?30Z78,&'�9�:D#&C�*�Q$¤8bV¦�e ��<W*+93�3'�%(<>98=D*-9F#-[ y z {c| }J}&~-� ��-�� � �,-&�sYC�*v:I*+9�*-%(">Ec28"U#&#&*+%(9�'�9�#&C8*�QU¤8bV¦8e ��<W' ,x">,ªB§<IE�E�< P ,

Q$¤8b3¦8e ��<4g��>d�� a8`8¦FbId���¦�e=<�����Q�SUT�I¥me5T � d��me � `4¦Fb"��¦8e�<�����Q�SUT� � ��S���<����me � `4¦Fb"��¦8e=<�����Q�S T

� �

Page 58: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�:�� \3*-)O#&'�<>9 .� � E�E '�9M"�%(< P����3¦Fb � d��me � `4¦Ib"��¦8e=<�����Q�SUTi

Bª<$#(CZ#(C�*G#&*+=u2�E "U#(*.E�'�9�*v"$98NZ#&C�*�NV' ,62�E " 0WE�'�9�*5,Y"$%(*.NV'��3'�NV*5Nl'�9F#&<D,6*5)J#&'�<>94, ?30u#(C�*v"$E�'�:I9�=u*+9F#,&0F=�?4<IE�Kc[�jk9�#(C�*G#&*+=u2�E "U#(*vE�'�9�*v*5">)HC;,&*-)O#&'�<>9�78,&*-,x)O<I9F#&%(<>E P <I%(N8, '�9�#&C�*v,("$=u*�=W"$9�9�*-%L">,YNV<3*-,Q3¦8e�<��Vg3i8[ sYC�*L)O<I9I#(%&<IE P <I%(NWQ$¤�¥4e>¦�� B§<>%�*+o�"$=u2�E�*��>)-"$9u?4*x74,6*5N@#(</NV' ,62�E " 0v¡874,6CuE�*OB£#��I¡878,&Cu%&'�:>CF# �<>%�)O*+9F#(*+%(*-N�[lw8<>9F#(,�)+">9�?m*l)HC8">9�:>*5N¢74,6'�9�:nQ$��¥ ��Q8e5d ��*O#()>[;s�*Oo3#@=W" 0n">E�,&<�?4*l*+9F#&*-%&*5Nn'�9X#&C8*#&*-=u2�E�"$#&*;E�'�9�*>[¢jk9 ">N�NV'�#&'�<>9 #&C�*l,&2m*-)O' "$EY,&0F=�?4<IE��n=@78,6#�">2�24*5"$%�<>98)+*Z'�9R*5">)HC ,&*-)O#&'�<>9 [ � ">)HCNV' ,628E�" 0DE�'�9�*L' ,�#(C�*+9;,6*+# ?30D,&7�?8,6#&'�#&7�#&'�9�:@*5">)HCW,6*5)J#('�<I9W<$Bc#&C�*GNV' ,62�E " 0DE�'�9�*L'�9F#&</'�#(,ª)O<I%&%(*-,&24<I98NV'�9�:,&*-)J#('�<I9;<>B�#(C�*�#&*-=u2�E�"$#&*vE�'�98*�"$#x#&C�*v<V)-)O7�%(%&*-98)O*G<$B�#&C8*��4[C <I98,6' NV*-%Y#&C�*�B§<IE�E�< P '�98:�*+oV">=u2�E�*

Q$¤8b3¦8e ��<4gFQ$¤ � 3 e-` � e=<�^���^>K�Q$¤�¥4e>¦�Q�; )8bI����Q$¤�¥4e>¦_K�Q�;�; )8bF��^��V^K�Q$¤�¥me>¦�Q�;A)8bF���Q$¤�¥me>¦�Q�S TQFbV¦U`3¤8brK�bV¦$`3¤8btK�Q$���IdVbrK����IdVb�QVSUTQ���b5a3acbrK ��b a3acbtK�QI� �V¦$d�brK���V¦>d�b�Q�SUTQ��>` � e>¦���<tK �>` � e>¦���<�K�Q� �>d�btK* �>d�b�Q�SUTisYC�*v#(*+=u2�E "U#(*vE�'�9�*/'�98NV' )+"$#&*-,L#&C8"$#x#&C�* #8%(,6#.,&*-)O#&'�<>9�<$B�#&C�*/#10F2m*-,&*O#A#&*Oo3# P '�E�E�"$E P " 03,ª?m*@,&*O#L# P <'�98)HC�*-,Y'�9;B§%&<I= #&C�*vE�*OB£#L"$94N;">E�,&<�?m*v,6*+#L">,ª=W"U#&C8*+=W"U#('�)-,+[�sYC�*�,&*-)O<I98N�,6*5)J#&'�<>9 P '�E�E�?m*/)O*+9F#(*+%(*-N"UB£#(*+%�"IN�NV'�9�:v"-:I74">N�<$Bm,&28"I)O*Y<>9�#&C�*xE�*OB£#5[�sYC�*Y#&C�'�%HND">98N@B§<>7�%&#&CW,&*-)J#('�<I98,�"$%(*ªC8"$98N�E�*5ND,&'�=D'�E "$%(E�0I[!L*-%&*�' ,Y#&C8*v%&*5,67�E�#

"$E�2�C8" � ?4*+#("� :F"$=u=W" NV*+E�#("� *+28,&'�E�<>9 � �+*+#("

jk9;#&C�' ,x)+"I,6*.#&C8* #4%(,6#YN�'�,&2�E " 0WE�'�9�*�'�,ªB§<I%&=u*5NZ?30l,&7�?8,6#&'�#&7V#('�9�:lQFbV¦$`F¤8b/B§<>%Y#(C�*�#8%(,6#��W'�9;#&C8*#&*-=u2�E�"$#&*ZE�'�9�*���bV¦U`3¤8b�B§<I%v#&C�*;,6*5)O<>94N�� ��Q$���Id�b�B§<I%v#&C�*Z#&C�'�%(NR">98N����IdVb�B§<>%v#(C�*WB§<>78%6#(C [�sYC8*P C�<IE�*�E�'�9�*v' ,Y#(C�*+9M,(" �>*-NlB§<>%L,&*O#&#&'�9�:8[ sYC�'�,x)+<>9F#&'�937�*-,Y789I#('�E�"$E�Ec#&C�*vE�'�9�*-,L">%&*v"I)+)O78=@7�E "U#(*-N ��">98N#&C8*+9u#&C8*+0u"$%(*L,6*+# P ']#(CZ*-"I)HCD)+<>E�7�=u9W?4*-'�9�:�">, P ' NV*A"I,�9�*-)+*-,(,&">%&0�#(<@">)-)O*-2V#q"$E�E8<>Bm'�#(,q*+9F#&%('�*5,�� ">9'�=D28E�' )+"$#&'�<>9�<>B�#(C�' ,."I)+)O78=@7�E "U#('�<I9M2�%&<V)+*-,(,x'�,A#&C4"U#G"W#("$?8E�* P ']#(CM#&<3<Z=W"$930�*+9F#&%('�*-,A)+<>7�E N�)-"$78,&*s � � #&<M%(7�9R<>7V#/<>Bx=D*-=u<>%(0���'�# � ,/?m*O#6#(*+%�9�<$#v#(<¢,6*+#v#(">?�E�*5,�#&C4"U#�">%&*u=u<>%(*u#&C8">9 "�28"$:I*u<>%@,&<E�<>9�:��J[!A*+98)+*Z#&C8*W#&*-=D28E�"$#&*lE�'�9�*l*5,1#H"$?�E�'�,&C�*5,v#&C8*l28"$#6#&*-%&9XB§<I%/#(C�*Z#H"$?�E�*Z*+9F#(%&'�*-,�"$98N�#(C�*;NV' ,&2�E�" 0E�'�9�*5,x'�98,6*-%6#Y#(C�*v'�94NV'��3' NV78">E *+9F#&%('�*-,-[

���

Page 59: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(< ���/[ \c[m,62m*+E�E�'�9�:�� \3*-)O#&'�<>9 .� � E�E '�9M"�%(< P\3<I=u*O#&'�=u*-,GC�<I%&' �+<I9I#H"$E�"$98N¢�>*+%&#&' )+">E�E�'�9�*-,G"$%(*@78,&*-N�#&<�NV*+E�'�=D'�#v*+9F#&%('�*-,.'�9�"W#(">?�E�*>[/s�<l2�7V#'�9�C�<>%(' �+<>9F#H"$E E�'�98*-,�� P *@78,&*DQ$¤VT;)8¦�� ���178,6#v">, P *@NV' NM'�9M#&C8*uQ � �>d3d�b>� � *+93�3'�%(<>98=D*-9F#-[ !L< P *+�I*+% �P *�N�<>9 � # P ">9I#Y#(C�*�%&7�E�*G#&<u?m*/"$E�'�:I9�*-N�">)-)O<>%HNV'�9�:/#(<D#&C�*�#(*+=u2�E "U#&* ��,6< P *�78,6*G#(C�*v)O<>9F#(%&<IE P <>%HNQ <��FbV¦8e ��<c[ !L*-98)O*�C�<I%&' �+<I9I#H"$EmE�'�9�*5,L"$%(*.'�98,&*+%&#&*5Nl?30Z2�7�#6#&'�9�:lQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��Vi � �>*+%&#&' )+">EcE�'�9�*-,"$%(*L'�98,&*+%&#&*-Nl?30D287V#6#('�9�:ZQ��3T )4¦��v'�9l*-']#(C�*+% #&C8*A#(*+=u2�E "U#&*G<>%q#&C�*�NV' ,628E�" 0uE�'�9�*I[ B 7�#Y,6#&'�E�E�">E�Em'�, 9�<>#)O<I=u2�E�*+#&*-E�0�,1#(%(">'�:ICI#&B§<>% P ">%(N [�\V7�2�2m<I,&* P *�#H" 9>*v<I7�%xE ">,6#L*Oo�"$=u2�E�*/"$98N�)HC8">9�:>*G#(C�*v#&*-=u2�E�"$#&*�#(<:>*+#x�>*+%&#&' )+">E�E�'�9�*5,x"$98N�"$E ,&<�'�98,&*+%&#LC�<>%('�-<>9F#(">EcE�'�9�*-,-[

Q$¤8b3¦8e ��<4gFQ$¤ � 3 e-` � e�<4Q��3T;)8¦��VQ�; )�bF�t^ ��^3Q�; )�bF�rK�Q��3T;)4¦ ��Q$¤�¥me>¦FQ�; )8bF� ��Q$¤V¥me>¦K�Q�; )8bF��Q��FT;)4¦���Q�;A)8bF��^���^FQ�; )8bF�K�Q��3T;)4¦ �VQ$¤�¥me$¦rQ�; )�bF� ��Q�;A)8bF��Q$¤�¥4e>¦�Q��3T;)4¦ ��Q�SUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��ViQFbV¦U`3¤8brK�bV¦$`3¤8btK�Q$���IdVbrK����IdVb�QVSUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��ViQ���b5a3acbrK ��b a3acbtK�QI� �V¦$d�brK���V¦>d�b�Q�SUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��ViQ��>` � e>¦���<tK �>` � e>¦���<�K�Q� �>d�btK* �>d�b�Q�SUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��ViiNV<3*-,&9 � #L:>'��>*G*Oo�">)O#&E�0 P C8"$# P * P "$9F#-[

">E�2�C4" � ?4*+#("� :I">=D=W" N�*+E�#("� *-28,6'�E�<>9 � �+*+#("

sYC�*-%&*W">%&*W,&*+�>*-%(">E�NV* #4)+'�*-98)O'�*-, �#&C8*W=D<F,1#v<I?F�3'�<>78,�' ,G#&C8*W*Oo3#&*-98NV*-N�C�<I%&' �+<I9F#("$E E�'�98*-,�� ?�7V#"$E ,&<A#(C�*Y#&*+oF#�E�<3<�9V, ,6<I=D* P C8"U#�,�:F78">,&C�*-N@'�9F#(<.#(C�*x?m< o3*5,+[�jk9D"IN�NV'�#&'�<>9 �>#&C�*ª#(*Oo3#�C8">, "GE�']#&#&E�*x*Oo3#&%H",&28">)+*/<>9M#(C�*@%('�:>CF#A%H"U#&C8*+%L#(C8"$9¢?4*-'�9�:;24*-%6B§*5)J#(E�0M)O*-9F#&*+%(*-N [ � ,.'�9�#&C�*WQ � �Id3d�b$� � *-93�F'�%(<>9�=u*+9F# �E�'�9�*5,�)+"$9¢?4*D=W">NV*�#(">E�E�*+%G?30M'�98)+E�74NV'�98:l#(C�*D)+<>9F#&%(<>E P <>%HN¢Q � d3T;)Vd;'�9�#(C�*@#(*+=u2�E "U#(*>[ � B§7�%6#(C�*+% y+z+{c| }J}&~-� ���2�%(<>?�E�*+= )+"$9�<V)+)O78% P C�*+9�#&C�*x24"$:>*ª' ,�,6*+#�,&'�98)O*xs�� ��=W" 0/,&2�%(*-">N�E�'�9�*5,�"$28">%6#�,&E�'�:>CF#&E�0�#&<�'�=u2�%&<U�I*#&C8*A"$2�2m*-">%(">98)O*x<>B4#(C�*A24"$:>*I[�sYC�' , P <>78E�NuE�*-" �I*Y"/:I"$2u?m*O# P *+*-9u#&C�*L�I*+%&#&' )+">E�E�'�9�*5, �F,6< P *L78,&*x#&C8*)O<I9F#&%(<>E P <I%(NMQ��F¥F¥me=<Vd��>T8¦8e=<�� � 3 e-` P ']#(C�'�9;#(C�*�Q$¤8b3¦8e ��<u#&<W" �><I'�NZ#&C�' ,+[ w�'�98">E�E�0 P */)+"$9�:>*+#x%&' N<$B #&C�*.E�'�9�*-,Y,6#&' ) 93'�9�:�<>7V#ª<>9l#&C�*GE�*+B£#ª?30WNV*-E�*+#&'�9�:@#(C�*/QU¤ � 3 e5` � e=<uB§%&<I= #(C�*.#&*+=u2�E "U#(*.E�'�9�*>[�s�<=u<U�>*G#&C8*�#("$?8E�*�#(<�#(C�*/,("$=u*v24<F,6'�#&'�<>9 P *v78,6*@Q5a ��� �ITce �F¤3dc[�w�'�98">E�E�0�� P *v)+">9�,&*+*vC�< P #&<Z)+*+9F#&*-%#&C8*u#&*Oo3#/?30�9�<>#&'�9�:�#&C4"U#v#&C8*W*Oo3#&%H";,&28"I)O*u<V)+)O78%(,�'�9�#&C�*u#(*+=u2�E "U#&*WE�'�9�*Z"UB£#(*+%�#&C8* � P C�*-%&*D#&C8*#&*+o3#L'�,Y'�98,&*+%&#&*-N [ !L*+94)O* P *�)-"$9�'�=u2�%(<U�>*G<>78%x%&*5,67�E�#L?30Z78,&'�98:Q5a �����ITce �I¤Vd � e=<Q��F� �If8g3Q��I¥3¥me=<Vd �IT8¦�e�<�� � 3 e5`Q$¤8b3¦8e ��<4gFQ � d3T;)3d�Q��FT;)4¦���Q�;A)8bF��^���^FQ�; )8bF�tK�Q��3T;)4¦ ��Q$¤�¥me$¦�Q�; )8bF���Q�; )8bF��Q$¤�¥4e>¦K8Q��FT;)4¦���Q�;A)8bF��^���^FQ�; )8bF�_K8Q��3T;)8¦���Q$¤�¥me$¦�Q�; )8bF���Q�; )8bF��Q$¤V¥me>¦�Q��3T;)8¦���Q�SUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��Vi

�$¬

Page 60: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�:�� \3*-)O#&'�<>9 .� � E�E '�9M"�%(< PQFbV¦U`3¤8brK�bV¦$`3¤8btK�Q$���IdVbrK����IdVb�QVSUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��ViQ���b5a3acbrK ��b a3acbtK�QI� �V¦$d�brK���V¦>d�b�Q�SUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��ViQ��>` � e>¦���<tK �>` � e>¦���<�K�Q� �>d�btK* �>d�b�Q�SUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��Vii3i#&<u:I*O#

">E�2�C4" � ?m*O#("� :I">=D=W" NV*-E]#H"� *-28,6'�E�<>9 � �-*O#("

jk9n:>*+98*+%H"$E �m'�B P * P "$9F#.#&<�)O<>94,1#(%&78)O#�"Z#(">?�E�* P '�#&C�?4< oV*-N�*+9F#&%('�*5,L#(C8"U#v' ,�)O*+9F#(*+%(*-NM<I9�#&C8*28">:>*�� P *�)+"$9�NV<W,&<D?30Z287V#6#('�9�:u#(C�*@Q��I���If P '�#&C�'�9M"uQ�S���<3d��IT8¦8e�<��Vg3i8[ B 7�#YC8*+%(*G' ,x"�#&%('�) 9Z#&C8"$#P '�E�E 2�%&<VNV74)O*Z"�9�' )O*-%v%&*5,67�E�#-[;j�BY#&C�*�Q��F���IfM'�,@2�7V#@'�9X?4*+# P *-*+9 NV<I7�?�E�*ZNV<>E�E�">%/,6'�:>94, ��']# P '�E�Eq?m*#10324*5,6*+#�">,�N�'�,&2�E " 0>*-NG=W"U#(C�*+=W"$#&' )+,-[ E BV)O<>78%(,&*��+#&C�*-%&*�' ,�9�<L"I)J#(78"$E$=W"$#&C�*-=u"$#&' )+,�?m*+'�9�:AN�'�,&2�E " 0>*-N �?�7V#/s � � P '�E�E�2�7V#v'�9X";E�'�#6#(E�*W*+oF#(%(";,624">)O*u"$?m<U�>*D"$98Nn?m*+E�< P #&C�*D#H"$?�E�*D"I,G'�,v">2�2�%(<>2�%('�"$#&*vB§<I%v"NV' ,628E�" 0I[ !L*-98)O*W"�)O*-9I#(*+%(*-N�#("$?8E�* P '�#&Cn#&C�' ,�9�' )O*W,624">)O'�9�:�=W" 0M?4*DB§<>%(=u*-Nn78,&'�9�:;#&C8*�B§<IE�E�< P '�9�:B§<>78%�,6#&*+24, � � �/2�7V#�"�Q �F���If�?m*O# P *+*+9 N�<>7�?�E�*lNV<IE�E "$%�,6'�:>98,�� � � �/2�7V#�">9_Q��I¥3¥me=<Vd �IT8¦8e=<�� � 3 e+`"$94Nn">9XQ$¤8b3¦8e ��< P '�#&C8'�9�#&C8*ZQ��F���If � �¬��G'�9¢#(C�*lQU¤8bV¦8e ��<�2�7V#@"l#&*-=u2�E�"$#&*uE�'�9�* P '�#&CX"MQ � d3T;)Vd'�9l#(C�*.?m*+:I'�989�'�98:���"$94Nl"WQ �3T;)4¦��@,&7�%(%&<I7�98NV'�9�:@*5">)HC;*+9F#&%(0�� �§«���*5">)HC;%&< P <>B #&C�*G#H"$?�E�*v,6C�<I7�E NZ?m*2�%(*-)+*-NV*5N;">98N;B§<>E�E�< P *-Nl?F0�Q <��3bV¦8e���<4g3Q$¤3T;)4¦��Vi�[!A*+%(*G' ,Y#(C�*v28"U#&#&*-%&9;#&<W?m*�B§<>E�E�< P *-N

^3^3Q �F���If8gQ��F¥F¥me=<Vd��>T8¦8e=<�� � 3 e-`Q$¤8b3¦8e ��<4gQ � dFT;)Vd�Q��3T )4¦�� ��K�Q��3T )4¦�� ��K h+h-h6K�Q��3T;)4¦ � ��Q��FT;)4¦���Q�S TQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��Vi�I¥me5T � d�S��V¦ )>a�< ��<VdFT ���_K � � �8S�� <���S��V¦*)$a�< ��<Vd3T����_K h+h-h1K �3¦Fb � d�S �V¦*)>a�< � <Vd3T ����QVSUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��Vih+h-hQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��Vi�I¥me5T � d�S��V¦ )>a�< ��<VdFT ���_K � � �8S�� <���S��V¦*)$a�< ��<Vd3T����_K h+h-h1K �3¦Fb � d�S �V¦*)>a�< � <Vd3T ����QVSUTQ <��FbV¦8e ��<8g3Q$¤VT;)8¦��Viii3^3^

�U«

Page 61: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

����������� �� ��������������D� �� �

jk9�#&C�' ,�,&*-)O#&'�<>9 P * � E�E�)O%(*-"$#&*ª9�* P )O<>9F#(%&<IE P <>%HN�,-[�sYC�*Y=W" 93'�9�:�<$B4#&C�*5,6*Y9�* P NV* #89�'�#&'�<>98,��>">E�,&<)+">E�E�*-N�=W">)+%&<F, �V' ,L<I9�*v<$B #(C�*v=u<I,6#A24< P *+%&B§7�E�#(*-)HC�98' :F7�*5,L" �U"$'�E�">?�E�*�'�9�s�� ��[ªw8<>%x#(C�* #8%H,1#A">2�2�E�' �)+"$#&'�<>9Z<>B #&C8'�, B ">)+'�E�'�#10�� P * � E�E�,6*-*AC�< P "�9�* P NV* #49�']#('�<I9;)-"$9l,(" �>*G"/E�<$#Y<$B #1032�'�9�:@?30Z,&7�?8,6#&'�#&7V#('�98:,&C�<>%&#L,1#(%&'�9�:I,ªB§<I%xE�<I9�:D<>9�*5,+[� !$# $�� , 6"8 "� 8 0�� $ 6���� 6�� )��

sYC�*M)+<>9F#&%(<>E P <>%HNrQI� �I¥�' ,u78,&*-N�#&<RNV* #49�*M9�* P )O<I9I#(%&<IE P <I%(N�,-[�sYC�*�,&'�=D28E�*5,1#uB§<>%(= B§<I%NV<I'�9�:�#(C�'�,@'�,DQ>� �F¥�Q <��(��<8b a �Vg8h+h-h i8[lsYC�*-9 P C�*+9�*-�>*-%�Q <��(��<8b5a ��"$2824*5"$%H,.'�9R0><I7�%�'�982�7V# #8E�*���'�#P '�E�E�?m*u%&*-2�E�"I)O*5N�?30 P C8"$#&*+�I*+%�' ,.?m*O# P *+*-9¢#(C�*W?�%H">)+*-,.'�9n#&C�*ZN�* #89�'�#&'�<>9 [ E BY)O<>78%(,&*uQ <��(��<8b a �=@74,1#;,("U#('�,6B§0_#&C�*¢)+<>93�>*-9F#&'�<>9rB§<>%;98"$=u'�9�: )O<I9I#(%&<IEA,&*�:F7�*+94)O*-,��ª#&C8"$#;' , �x'�#l=�78,1#;?4*�"R)O<>9F#(%&<IEP <>%HN � ">E�EcE�*O#6#(*+%H, �q<>%Y"D)O<>9F#(%&<IEm,&03=@?m<>E �§*Oo�"I)J#&E�0W<>98*.9�<I9�E�*O#6#(*+% �J[�\3< �3B§<>%ª*Oo�"$=u2�E�*��V,&7�2�2m<I,&*.0I<>7P %(']#(*;"�NV<V)+7�=u*+9F#@#(C8"U#u)O<>9F#H"$'�98,v#(C�*l2�C8%("I,6*�� �L9�'��>*-%(,&'�#10¢<$BA!¢"$9�'�#&<I?8"��M=W">9F0n#&'�=u*-,-[nsYC�*-9QI� �I¥�Q*)>a�g���<�e ���>T � e5d�� �I¥:5�b <�e d �>��bVi�N�* #89�*5,u"¢9�* P )O<I9F#&%(<>EY,6*=:I78*+98)+*�Q*)>a P C8'�)HCr)+"$9�#&C�*-9?m*;78,&*-N�"U#D">930n#('�=u*I[XsYC8*;,&*+9F#&*-98)O* ?�d�b 3 ��S �A)VT � � � bId�dI¤���Q*)>aA�.#(C�*+9_=W" 9>*5,@,&*+98,&*>[�j�B#&C8*�)O<I9F#&%(<>E P <>%HN�*OoV'�,6#(,��80I<>7�%A9�* P NV* #89�'�#&'�<>9 P '�E�E�%(*+2�E ">)+*v']# �£#&C8'�,A'�98)+E�74NV*-,A#&C�*�)O<>9F#(%&<IE P <I%(N8,NV* #89�*-NX?30�s�� � ��,6<�"�E�'�#6#&E�*l)-"$%(*D=�78,6#@?4*Z#(" 9I*+9X'�9n#(C�*l)HC�<I'�)+*W<$BY98"$=u* �J[ � 930nNV* #89�'�#&'�<>9R' , �C�< P *+�I*+% �FE�<V)+">Ec#&<D#&C�*v:I%&<I7�2l'�9 P C�' )HC�'�#L' ,xNV* #898*-N�[qw8<>%x*+oV">=u2�E�* �QI� �I¥�Q*)>a�g���<�e ���>T � e5d�� �I¥:5�b <�e d �>��bVi?�d ��� 3 a ��¥me T � d�S��A)VT � ��bId�dI¤���Q )>aA�gQI� �I¥�Q*)>a�g���<�e ���>T � e5d�Q�� �R� �,5 ��<VdFT8Q�� �3b3¦3i ¤�� < ?�d ��� 3 a � <��>f3d�S��A)VT � ��bId�dI¤���Q*)>aA�i! e=<�bV¦3¦(�8?�d ��� 3 a ��¦Fb � d�S��A)VT � ��b>d�dI¤���Q )>aA�:>'��>*5,

jq#&<3<�9W=�0 #8%(,6#L)O<I7�%(,&*."$#Y#&C�* �L98'��I*+%H,6'�#10W<$B�!¢"$9�'�#&<I?8"�[ sYC�*+9;j�#(<F<�9W=@0Z98*Oo3#L)O<>78%(,&*."$##&C8* �L9�'��>*-%(,&']#�"*�NV*/!M<>9F#(%�"*5"$E [�w�'�98">E�E�0ljq#&<3<�9;=@0ZE ">,6#L)O<>78%(,&*v"U#Y#&C�* �A9�'��>*+%H,&']#10Z<>B�!�">9�'�#&<>?4"�[

���

Page 62: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�:�� \3*5)J#&'�<>9�� ��L<>E�E�'�9�:u0><I7�%Y< P 9�x*-=u*+=@?m*+%.#&C4"U#.">E�E ,624">)O*5,L"UB£#(*+%�"Z)O<I9F#&%(<>E P <>%HNM"$%(*/"$?8,&<>%(?m*-N �4#&C�' ,.'�98)+E�74NV*-,L#&C�*D)O<>9F#(%&<IEP <>%HN�,/#(C8"U#W0I<>7_N�* #89�*I[_jk9_#&C8*�28%&*-�F'�<>74,@*+oV">=u2�E�* � ">9F0 ,&28"I)O*�"UB£#&*-%lQ )>a P <>7�E N ?m*�'�:I9�<>%(*-N [

!L< P *+�I*+% ��#&C�*M,&28">)+*;"UB£#(*+%�#&C�* #8%H,6#�2m*+%('�<VN�">98NR#(C�*�,628"I)O*�"UB£#(*+%�#&C�* #8%H,1#D<>2m*+9�'�9�:�?�%H">)O*�"$%(*NV'�©m*-%&*-9F# �F']B�0><I7�E�<3<�9D)OE�<I,&*+E�0�"U#�#(C�*L*-98ND<$Bc#&C�* #4%(,6#q,6*-9F#&*+94)O*Y#10324*5,6*+#q78,&'�98:�#&C�*L*+o�"$=u2�E�*��>0I<>7 � E�E,&*+*;,&<>=u*Z*+o3#&%H"�,624">)O*I[¢sYC�' ,�)-"$9R?m*;*-E�'�=u'�94"U#&*5NR?30n287V#6#('�9�:X"��X"UB£#(*+%@#&C�*�<>2m*+9�'�9�:�?8%("I)O*W#(<=W" 9I* #(C�*L%(*-,6#�<$Bm#&C�*xE�'�9�*A"�)O<I=D=u*-9I#5[�sYC�*L,&">=u*ªC8<>E N�, B§<>%�#&C�*xE�'�98* P ']#(CD#&C�*LE ">,6#q)OE�<I,&'�9�:�?�%("I)O*I[Cª"$%(*OB§78E )O<I9F#&%(<>E�<>Bx,&28"I)O*-,/<$B£#&*-9 )+">E�E ,vB§<I%v#&C�* �&)+<>=u=u*+9F#&'�9�:M<>7�# �M<>Bª#(C�*l*-98NX<$BxE�'�98*-,/'�9R#(C�'�,=W"$9�98*+%5[

E 98)+*G"@9�* P )O<>9F#(%&<IEm,&*�:F7�*-98)O*.C8">,ª?m*+*+9�NV* #49�*-N �V'�#Y=u" 0u?m*�78,6*5NW'�9;9�* P NV* #89�'�#&'�<>98,-[�sYC�'�,' ,Y<>9�* P " 0W<$B =W" 93'�98:D,&'�=u2�E�*�B§<>%(= E�*O#&#&*+%H,-[�w�'�%H,1#LE�*O#�� ,xNV* #89�*/"u,&'�=u2�E�*vE�*+#6#(*+%5[QI� �I¥�Q3¦��IdFd��IT8gQ$`8b>T�Q <��4e=<����<Vd���3b>T�Q <8b a ��� ¤ce � e � b�¦8e5d3d8¦�� <��Id �rd ��¦ �Id ���A) 3 <��(��dF¤8b>d����A)VT <8b a ��e � Q <�b a �q�Q$¤ � 3 e5` � e=<@14e=<cS��>T��V¦(��� �A)VT � �Q�� �43 e5` � Q$��b � �V¦8e�<�� � 3 e-`Q$¤ �43 e5` � e=< ¤���9�b a � 9��Id��ITQ � ambV¦3¦ � 3 e5`�Q$¤3T;)4¦��i

¨A< P #&C�' ,�E�*O#6#(*+%�78,&*-,.#&C8*u)+<>9F#&%(<>E P <>%HN�Q <8b5a � � P C�'�)HCn'�,�7898NV* #49�*-N�"U#G#&C�' ,�2m<>'�9I#5[ !�C�*-9Q3¦��>d3d��ITu'�,Y78,&*-N �V#&C�*/)+7�%(%&*-9I#x�U"$E�7�*�<$BqQ <8b5a � P '�E�E ">2�2m*-"$%x'�9�#&C�*v?m<VNV0Z<>B�#(C�*vE�*+#6#(*+%5[ !L*+94)O*QI� �I¥�Q <8b a �VgA5ceFS5¤8b�3¦ +�e � ¤��>`4iQ3¦��>d3d��ITQI� �I¥�Q <8b a �VgA5ceFS5¤��V¦F¦ ���VQ�� ���8Q ��; )��3iQ3¦��>d3d��ITP '�E�E�2�%(<3N�78)O*@# P <l)+<>2�'�*-,A<$B�#(C�*@E�*O#&#&*+% �m*-">)HC P '�#&C¢#&C�*D)O<I%&%(*-)O#A98"$=u* �8B§<IE�E�< P *5N�?30�"lC�<>%('�-<>9F#(">E%(7�E�* .*-"$%L!�'�)HC8">*+E Bª' ,6C�<I2 �

sYC�' ,x' ,x"DE�'�#6#(E�*/98<$#&*G#(<WE�*+#Y0I<>7 939�< P #(C8"U#L0I<>7�%Y98">=D*v' ,x!M' )HC8"$*-E Bª'�,&C�<>2 [\3'�98)+*+%(*+E�0Z0><I7�%(,��

sYC�*/¨."$=u*-¨A<$#(*+%�.

Page 63: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�:�� \3*5)J#&'�<>9�� ��L<>E�E�'�9�:u0><I7�%Y< P 9 .*-"$%L!�'�)HC�*-E�E�*�� "*-���*�:F7�* �

sYC�' ,x' ,x"DE�'�#6#(E�*/98<$#&*G#(<WE�*+#Y0I<>7 939�< P #(C8"U#L0I<>7�%Y98">=D*v' ,x!M' )HC�*+E�E�*�� "*-���*�:F7�*>[\3'�98)+*+%(*+E�0Z0><I7�%(,��

sYC�*/¨."$=u*-¨A<$#(*+%!�*G)+<>7�E NZC4" �>*L2�7�#Y">9F0F#(C�'�98:@?m*O# P *+*+9l#&C�*G?�%H">)+*-, '�9�QI� �F¥�Q <8b a �Vg�h-h+h i �3']#x)O<I7�E�Nl?4*�,&*+�>*-%(">E28">%(">:>%H"$2�C8,�E�<>98:¢"$98N 78,6*l<$#&C8*+%u)O<>9F#(%&<IEq,6*=:F7�*+98)+*-, � "$E�#&C8<>7�:ICR'�9R#(C�' ,�)+<>9F#&*+oF#D']# P <I7�E NX?4*�"E�']#&#&E�*l,1#(%(">9�:>* �J[ E BY)+<>7�%H,6*W'�#@' ,v2m<I,(,6'�?�E�*u#&<M78,&*�Q��V¥4e>¦3¦�Q������8SUd�">,/28"$%&#/<$Bª#&C�*;NV* #898']#('�<I9R<$BQ3¦��>d3d��ITD#&<u* �1*5)J#x#&C8*v28"$:I* P C8*+9�#&C�*vE�*O#&#&*-%x'�,L)+<>=u2�E�*O#(*-N�[

� � oV*-%()+'�,&* �3[ � !¢" 9>*W"�B§<I%&= E�*+#6#&*-%/#(C8"U#@74,6*5,�#&C�*Z)+<>9F#&%(<>E P <>%HN�,@Q <8b a � ��QFbF�3�FT � ��� ��Q�S3e d � �Q � dVbId�� �F">98N�Q� 4e5`cS��F��4[� � oV*+%H)O' ,6* �3[ � � 9�789�937�=@?m*+%(*-N@E�' ,1#�<>B8']#(*+=W,�'�,�<>B£#&*+9D=W">NV*ª78,&'�98:�Q8e d � a�g3^3QU� )4¦3¦��>d8^3i8[ .* #898*"W=W">)+%&<;Q$��e d��5a�#&C8"$#GNV<3*-,L#&C�' ,��c">98N�78,&*/'�#AB§<>%G,6*-�>*-%(">E 28"$%H"$:I%(">2�C8,-[ ¨A< P )HC4"$9�:I*/*-"I)HC�?87�E�E�*O##&<;"ZN�">,&C �§9�<>#&*@#&C8"$#."Z,&'�=u2�E�*@)HC8">9�:>*v'�9�#&C�*�=W">)O%(<W2�%(<>28">:I"$#&*-,Y">E�E #&C�*�9�*-)+*-,(,&">%&0l)HC4"$9�:I*-,x'�9"$E�E�<$B�#&C8*v28"$%H"$:I%(">2�C8, �J[� � o3*-%()+'�,&* �3[ ¬ \37�2�2m<I,&*L#(C8"U# 0><>7Z">%&*A:><>'�9�:�#(</C8" �>*L#&<vB§<I%&=W"U#ª,6*-�>*+%H"$E828"$%H"$:I%(">2�C8, '�9Z"/28">24*-%78,&'�98:�Q$¤�b�< �ce=<V� ��<Vd � � � `Vd ��Q$¤8b�< �VbF¥Fd��IT � ' ��">98N�QI¥me$¦$�VT��3b 3 �NV<>9 � # P <I%&%(0n">?4<I7V# P C8"$##&C8*-,&*�)+<>9F#&%(<>E�,&*�:F7�*-98)O*5,ª"I)J#(78"$E�E�0;NV< �3#(C�*�<>9�E�0Z'�=D2m<>%&#(">9F#ª#(C�'�9�:DB§<>%Y9�< P ' ,ª#&C4"U#x<>98)+*G#&C�*-0l"$%(*,&*O#��I#&C8*+0u%&*-=W"$'�9W'�9W*+©m*5)J#qB§<I%q<I9�E�0D<>98*L28"$%H"$:I%(">2�C �O[ .* #89�*G"/,&'�9�:IE�*.)O<>9F#(%&<IE8,6*=:F7�*+98)+*GQ � �>dF`8bITP C�' )HCM)+"$9;#&C8*+9�?4*v287V#L'�9�B§%(<>9F#x<$B *-"I)HCl28">%(">:>%H"$2�Cl#&C8"$#Y98*+*-N8,Y#&<u?m*/,6<DB§<>%(=W"U#&#&*-N [� !���� ) , , ) 8#" ) 8 � )��%$ + �� � ��� � �

j�#�� ,D2m<I,(,6'�?�E�*l#(<n78,&*l=W"I)O%(<I,�'�9_=@78)HC_:>%(*-"U#(*+%�:>*+98*+%H"$E�']#10�?30 "$E�E�< P '�9�:¢24"$%H"$=u*O#(*+%H,v#&<�?m*28"I,&,&*-N�[XsYC�*�'�N�*-"�' ,u,6<I=u* P C8"$#D,&'�=u'�E�">%@#(<�#&C8*l#(*+=u2�E "U#&*�E�'�9�*�'�9 #&C8*MQ$¤8bV¦�e ��<n*-93�F'�%(<>9�=u*+9F#5[w�'�%H,6#��VE�*O# � ,YE�<F<�9l"U#Y#(C�*v)+">,&* P C�*+%(*G#&C�*-%&*�' ,Y<>9�*G28"$%H"$=u*+#&*+%5[�jk9;#(C�' ,x)+">,&*�"D)+<>9F#&%(<>E�,&*�:F7�*-98)O*G'�,NV* #89�*-N�?F0�QI� �I¥�Q <��(�����ITV��� %Ug8h+h-h i8[LsYC�*D,603=@?m<>E � %v=W" 0�">2�2m*-"$%.?4*+# P *-*+9�#(C�*@?�%H">)+*-, � ,&*+�>*-%(">E#&'�=u*-, � '�9;#&C�*�NV* #89�'�#&'�<>9�<$B Q <��(�����ITV�m[�sYC�*G=W"U#&*-%&' "$Ec?m*O# P *+*-9Z#&C8*G?8%("I)O*-,ª">)O#(,ªE�'9I*G"@#&*-=D28E�"$#&*>[!�C�*-9_Q <��(� ���>TV��g8h+h-h i�"$2�2m*-">%(,/'�9�#&C8*W#&*+oF# ��'�# P '�E�E 78,&*u#&C�*lN�* #89�'�#&'�<>9R<>BLQ <��(� � �ITV� P '�#&CX#&C8*

� �

Page 64: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�:�� \3*5)J#&'�<>9�� ��L<>E�E�'�9�:u0><I7�%Y< P 9=W"U#(*+%('�">Eª?m*O# P *+*-9 #(C�*�?�%("I)O*5,�'�98,&*+%&#&*5N '�9I#(<�#&C�*�#&*-=u2�E�"$#&*M"U#u*+�I*+%(0R<V)+)O78%&%(*+98)+*l<>B � %�'�9_#&C8*<>%('�:>'�98"$ELNV* #89�'�#&'�<>9 [�� �� ������� � ��� � � � �� %������'� ����) (���� ��� �� % � � � ��������� ��) ������ � �� ���� ���� � ����% ������� � ��� � $&% ����� ���%� � ��� �������������m[

� ,L"$9�*Oo�"$=u2�E�*�� P *v)O<I7�E�N�78,&*G#&C�*�B§<I%&= E�*+#6#(*+%x<$B�#&C8*vE�"I,1#L,&*-)J#('�<I9;'�9�#&C�*�B§<IE�E�< P '�9�: P " 0 QI� �I¥�Q3¦��IdFd��IT � % gQ$`8b>T�Q <��4e=<����<Vd���3b>T � % � ¤�e � e � b�¦8e d3d�¦�� <��Id��td ��¦��Id�� �*) 3 <��(��dF¤8bId�� �*)VT <8b a ��e � � % �Q$¤ �43 e5` � e=<818e=<cS��IT �V¦(� � �*)VT � �Q�� �43 e5` � Q$��b � �V¦8e�<�� � 3 e-`Q$¤ �43 e5` � e=< ¤���9�b a � 9��Id��ITQ � ambV¦3¦ � 3 e5`�Q$¤3T;)4¦��i

¨A< P�P *�)-"$9�78,&*Q3¦��>d3d��IT8g*5ceFS ¤8b��V¦ +�e � ¤��$`4iQ3¦��>d3d��IT8g*5ceFS ¤��3¦3¦�� ��Q�� ���8Q ��;A)��Vi#&<u:I*O# .*-"$%L!�'�)HC8">*+E Bª' ,6C�<I2 �

sYC�' ,x' ,x"DE�'�#6#(E�*/98<$#&*G#(<WE�*+#Y0I<>7 939�< P #(C8"U#L0I<>7�%Y98">=D*v' ,x!M' )HC8"$*-E Bª'�,&C�<>2 [\3'�98)+*+%(*+E�0Z0><I7�%(,��

sYC�*/¨."$=u*-¨A<$#(*+%

� �

Page 65: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�:�� \3*5)J#&'�<>9�� ��L<>E�E�'�9�:u0><I7�%Y< P 9 .*-"$%L!�'�)HC�*-E�E�*�� "*-���*�:F7�* �

sYC�' ,x' ,x"DE�'�#6#(E�*/98<$#&*G#(<WE�*+#Y0I<>7 939�< P #(C8"U#L0I<>7�%Y98">=D*v' ,x!M' )HC�*+E�E�*�� "*-���*�:F7�*>[\3'�98)+*+%(*+E�0Z0><I7�%(,��

sYC�*/¨."$=u*-¨A<$#(*+%

¨L< P E�*+# � , NV* #89�*ªQI� �F¥VQI�me � `8¦Fb"�3d��>f3d�� %5g3^F^FQ��I���$f8g3Q ¤ � e ���� % � S+a � %Ui3^F^3i">,G"Z9�* P =W">)O%(<W#(<�NV' ,&2�E�" 0�#(*Oo3#-[vsYC�*-9XQI�me � `4¦Fb"�Fd��If3d8g�h-h+h i P '�E�E�)+"$74,6*@#&C�*D=W" �#&*+%(' "$E ?m*O# P *+*-9M#&C�*@?�%("I)O*5,Y#&<Z?m*@287V#.'�9�"W28">%(">:>%H"$2�C P ']#(C P ' N3#&C � �W)O*-9I#('�=u*+#&*+%H,"$98N¢#&C�*-9�)+*+9F#&*-%&*5N P '�#&CX,&<>=u*W,628"I)O*u">N�N�*-N�"$?m<U�>*�">98Nn?4*-E�< P ">,G'�,v">2�2�%(<>2�%(' "U#&*B§<>%L"uNV' ,62�E " 0>[�sYC�' ,x28">%(">:>%H"$2�C P "I,ª,&*O#L74,6'�9�:D#&C�' ,.QI�me � `4¦Fb"�3d �If3d@=W"I)O%(<8[sYC�*Y28">%(">=u*O#&*-% <$Bm"G=W">)+%&<�)+">9�?m*Y9�<�=u<>%(* #(C8"$9D<>98*ª24"$%H"$:>%H"$28CvE�<I9�:8[�j�Bm"G9�* P 28">%(">:>%H"$2�C' ,L*+94)O<>789I#(*+%(*-NM"I,L28">%6#L<>Bq"W28"$%H"$=u*+#&*+% �8">9M*+%(%&<I% P '�E�E ?m*@:I*+9�*-%("$#&*5N�[xsYC�'�,A'�,G"Z,("UB§*+#10ZB§*-"$#&7�%(*��B§<>%x<>#&C�*-% P ' ,&*A#(C�*v">)+)+'�N�*+9F#(">Em<I=u'�,(,6'�<>9;<$B "D)+E�<F,6'�9�:D?�%H">)O* P <>7�E N;)-"$78,&*�s�� ��#&<u*5"U#x7�2;#&C�*v%(*-,6#<$B�#&C8*�#8E�*v"I,ª#&C�*v28">%(">=u*O#&*-%-[

� � oV*+%H)O' ,6* �V[ « .* #898* "L=W"I)O%(<GQ(���A)VT�3TVbF� �Y,&<L#&C4"U#�Q(� �A)VT��3T�bF� �3g ���Vi P '�E�EF)-"$78,&*�#(C�*�B§<IE�E�< P '�9�:,&*+9F#&*-98)O*G#&<W?m*�#10324*5,6*+# �sYC�*v:I%("INV*G0><>7�%(*-)O*-'��I*-N;'�, � ���l[�j�#A,&C�<>7�E N;?4*/">?�E�*�#(< P <I%$9 P '�#&CM">9F0<$#(C�*+%x2m*+%H)O*-9F#("$:I*��3<$B�)O<I7�%H,6*I[j�#�� , 9�<$# %(*-">E�E�0.">9F0.C8"$%HNV*-%c#&<L78,&*�=u<>%(* #&C8">9v<>9�*�24"$%H"$=u*O#(*+%5[ sYC�* B§<>%(=�78,6*5N.#&<ANV* #89�*q"Y98* P)O<I9F#&%(<>E P <I%(N P '�#&Cn# P <;28"$%H"$=u*+#&*+%H,L' ,/QI��F¥�Q <��� ���ITV� � % � � g8hOh-h i8[/sYC�*uNV* #49�']#('�<I9¢?m*O# P *+*-9�#&C8*?�%H">)+*-, =W" 0�C8" �I*�� %ª"$98N�� � <V)+)+7�%&%('�9�:L'�9@'�#��U2m*+%(C8"$28,�,&*+�>*-%(">E$#('�=u*-,-[ !�C�*+9WQ <��(� ���>TV��g8h+h-h i3g8h+h-h i"$2824*5"$%H,�'�9W#&C�*.#&*+o3#��F#&C�*G=W"U#(*+%('�">E8?m*O# P *+*+9Z#&C�* #8%H,1#Y,6*+# <$B ?8%("I)O*-,q%&*-2�E ">)O*5, � %.'�9Z#&C�*�NV* #49�']#('�<I9"$94N�#&C�*/=W"$#&*+%(' "$E�?m*O# P *+*+9�#(C�*@,&*-)+<>98N�,&*O#A<>B ?8%("I)O*-,Y%(*+28E�"I)O*-, � � '�9�#(C�*@NV* #89�'�#&'�<>9 [ !L*-%&*@'�,L">9*Oo�">=D28E�*GB§<>E�E�< P *5Nl?30Z'�#(,x%(*-,&7�E�#

QI� �I¥�Q>d�bV¦ 3 � � % � � g�� %Md�bV¦ 3 � d � � � �&iQ>d�b3¦ 3 � g����>¤�<4i3g��Fb�<��3iQ>d�b3¦ 3 � g��Ib�<��Vi3g����>¤�<8iQ>d�b3¦ 3 � g����>¤�<4i3g-a �ViQ>d�b3¦ 3 � g;1$¤��Vi3g��Ib�<��3i� �

Page 66: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s�����'�9F#&%(<����@[ \c[m,62m*+E�E�'�9�:�� \3*5)J#&'�<>9�� ��L<>E�E�'�9�:u0><I7�%Y< P 9�I<>C�9����>E9V,��(<����>9�*>[���$9�*���>E9V,��(<��I<>C89 [��><IC�9����$E 9V,��&<u=u*>[q\3C8* ���$E 9V,��&<���$9�*I[

� � oV*+%H)O' ,&* �V[ � jk9���=��$9�9�*-%/,6'�=u'�E��$% �(<��&C�*W28%&*-�F'�<>74,�*OoV*+%H)O' ,6* � NV* #89�*���=��>)+%&<�Q(���A)VT�3TVbF� �,&<��(C�����Q(� �A)3T�3T�bF��Vg ���ViFg � H iD)��$74,6*5,�&C�*DB§<>E�E�< P '�9�:M,&*+9�&*-98)O*��&<M?m*��10324*5,6*�� ��<>7�%(*-)O*-'��I*-N��:>%��>N�*.<>B � ��� <I9;0I<>7�%$#8%H,��L*+o��$=��>98N��D:I%��INV*�<$B � � � <I9;0I<>7�%L,&*-)+<>98N;*Oo��>=�[� � oV*+%H)O' ,&* �V[ . !�%&'��&*��D=��>)+%&<lQI¥FTVb8S/,&<��(C����GQI¥FT�b8S>gFbVi3g$�8i P '�E�E��1032m*-,&*�� �&C8*�B§%��I)!�&'�<>9#"$�[

j%��� ,x'�=u24<I%&���$9�L9�<'� �&<W2�7(�)�>930l,62*�>)O*5,Y?4*+B§<>%(* �&C�*�#4%(,&�L?�%��>)O*�'�9+�&C�*/NV* #89�'��&'�<>9 [ j�B�0I<>7�NV<��s � � P '�E�Eq'�9�&*-%&2�%(*��,�&C�*�NV* #898'-�('�<I9 NV']©c*+%(*+9�(E�0�B§%(<>=.�&C�* P � 0nN�*-,()O%('�?m*-NXC�*-%&*I[�w�<I%/=u<>%(*��&C��>9� P <M2��$%��$=u*��(*+%H, �/�&C�*l=D*��&C�<VNR<>BLNV* #898'-�('�<I9R'�,�,6'�=u'�E��$%5[�s�<¢NV* #89�*0�M)+<>9�&%(<>E P <I%(N P '��&C1�&C8%&*-*2��>%��>=D*��&*-%(,��F,&���>%&� P '��&C�Q>� �F¥�Q <��(� ���IT3��� % � � � �3g�h-h+h i�[�sYC�*-9 � % � � � �>98N � �D=�� 0u<V)+)O78%ª?m*�� P *+*-9�&C8*v?�%��I)O*5,+[ !�C�*-9nQ <��(� ���IT3��g8h+h-h iFg8h-h+h i3g8h+h-h i��$2�2m*2�>%(,Y'�9+�&C�*3�(*Oo4�����&C�*/=��5�&*+%('��$E�?m*�� P *+*+9�*6�>)HC,&*��v<$Bª?�%��I)O*5,A%(*+2�E��>)+*-,G'��(,v)O<I%&%(*-,&2m<>98NV'�9�:l,&03=@?m<>E�'�97�(C�*WNV* #49�'-�('�<I9n<>B8�(C�*W)O<>9�(%&<IE P <>%HN�[@sYC8*2��>%��>=D*��&*-%(,ª=�� 0Z:><D7�2+�&< � �4[� !%9;: . 8 . 6 �%$�� � 8 �

\3<I=�<��>=�=�<2?@=�� � ?�AO<>93��<+9�=B<+9�/�(<�?*< �$?8E�<C�&<G:'=��'<��DA+<>9�>E(<>E P <'EHN��$9��$E��><�E(9��5�>=��'<q9*�$=�<>[ w�<�E@<+o���$=�F�EB<��G=�B�H><I73F�E><+BI<�E/�AN(=]©J<�E�<+9�K?&FL<+E�E�=�9�: �6HI<>7v=�=�:>C� P �$9�M�&<DA��$E�E5�(C�<CA+<>9�>E(<>E P <�E(N@Q�S���<3d��IT8¦8e�<��?4H��&C�<.9��$=�<A<>B�QVS���<Vd3T �V¦8e=<��8[ sYC�=B?�A��>9W?*<�NV<>9�<L?4HD7*?&=�9�:3�(C�<vQ3¦��Id�A+<>9�>E(<>E P <�E(N�[�sYC�<A7*?&<.<$BQ3¦��>d�QVS���<Vd3T �V¦8e=<�����QVS���<Vd��>T8¦8e=<��q98< P =���9'<6?M�L9�< P �N�'? P <+E�E��'?M�&C�< <>E N �MA+<>9�>E(<>E P <�E(N � ���5=�E��$?8E�<I[/sYC�=B? A2�$97�>EB?&<l?L<u7�?&<5N P =��&Cn=��5�&C�<-=����>=�A��>E 9��$=�<2?�'? P =��&CRQF¦��Id�Q>d���< � �IT���Q��IdceOa � � [j%�O=�?��&C�<-9PF4<?>?>=�?8E�<�&<u7�?>< y z {c| }J}&~-� ����Q � ���(�^3^ # /�Q>d���< � �IT>+ ' # -�Q>d���< � �IT�� '��:/ -�Q>d ��< � �IT�+��ª��^3^�&<u:�<��

�SRUTWV � �YXZT\[ � �]RDX#T\V,[Mh� � o(<2E�A�=B?>< �3[ � )< #89�<8A+<>9�>E(<>E5?><�:F7�<-9�A�<6?�Q3¦F¦��$Q�S>¦��6�$98N@Q>T8¦��(C����^�'E><K<=:I7�=����$EB<+9�M�(<GQ3¦��I¥Fd8¦8e=<�� �Q�S�� <Vd��IT8¦�e=<�� �'�$94NMQ>Tce �F¤3d8¦8e=<��8[

. �

Page 67: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =�9�>E(<����@[ \c[L?&FL<+E�EB=�9�:�� \4<6A!�>=�<>9�� ��L<>E�E�=�9�:�H><I7�EY< P 9sYC�<WQ3¦ �Id+AO<>9��E&<IE P <�E(N��>E�E�< P ?x7�?><�E�? �(<Z9��$=�<,�&C�<2=�E.< P 9 AO<>9��E&<IE/?&<=:F7�<+9�A�<2?-[LsYC�=�?)�$E�E�< P ?

��F*<2E�?&<>9��>E�= ��<5NP?&<��G<>BCAO<I9�>E(<>EK?&<=:I7�<+9�A�<2?)�&C��5�G=��GHM?L<�7�?><-N7=�9�F�E��'A�<D<$B8�&C�<D<>9�<6?)F�E&<U�4= N(<-NM?4Hs�� � P C�<+9MN(<2?>=BE><5N�[

. �

Page 68: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

����������� �� � � � ����� ��� � �

jk9�?&<>=�< P �GH(? s � �#=B?�98<5�8AO<I=�F�E�<��><-E�HDN(=��4=�9�<>[�s � � P =�E�E�E�<2?>F4<I98N,�&<3=�9F���>E�= N�=�9�F87(�q?4H@:�=��4=�9�:�$9Z<2E>E(<'EW=�<2?�?��$:'<+�(<1�&C�<7?�A�E�<�<-9Z=]B3H><I7 �'E><M7*?&=�9�:�=��0=�9��<�E��'A!��=���<+EBH\�$94N#�$E�?6< �&<1�(C�<�E�<>:'#8EB<>[B�<2A2�$7�?><.s � � =�?ª�'<2E>H�AO<I=�F�E�=�A��5�><5N ��&C�<3�'A��&7��>EJF4<�=�9� P C�<�E�<)�(C�< <�E�E&<�E8=�?YN(<���<2A!��<-N;=��GHD?L<vN(<�<2FP =��&C�=�90�(C�<F�E&<I:'E��$= ��?&<��vB§7�E�E�E><2F4<�E&�ª<$BM�(C�< <�E�E&<�Eq=��GHu?*<E����&C�<�EªE�<I9�:��>98N�=�93�><>E��'<5N�[ ¨L<5�Y<>98E�H�&C*�����Fs � � P =�E�E(�>E�H3�&<3E�<2A+<U�'<2E�BIE(<>= <�E�E&<�E�?��5�$98N P =�E�E�E><2F4<�E&� P C��5� P ��?�NV<>9�< =�9��&C��5�8F�E(<4A�<2?�?+[�w�<�E�&C�=B?E�<2�'?&<>9��(C�<�E><6�>N(=�9�:Z<>B8<�E�E(<'EA=�<6?>?��$:�<2?.=��GH�?L<��lE�=��&�(E�<WN(=���AO7�E���B§<'ED�&C�<D7�9�=�9�=��>=�����<-N�[@sYC�<9'<2H�=B?8�&< 9F98< PrP C*��� =B?C=�=�Fm<'E>���>9�� BIE&<I=;H><>7�E8FL<�E�?&FL<2A��>=��'<D�>98N P C��5��A2�$9Z?L<?��UBI<-E�H�=�:>9�<�E><5N�[ \V<EB<�� � ?xE�<3<�90�5� ?&<>=�<��H4F�=�A��$E�<2E>E(<'E�? �$98N0�&C�<v=�<6?>?��$:�<2?C�&C*��� �&C�<�Hl:�<+9�<2E��5�><I[�5!$# $�� � 6��!" 6 � ���38 &5. �

sYC�< #�E�?��A=�=�?���� 9�<3�&C��5� P <�� E�E�E�<3<�9+�5�)=B?A<>9�<,�&C��5�)<+��<�E�H><I9�<v=�� 9'<6?O��� ?6<I=�<3�>=�=�<��m9��$=�<+EBH���&C�<v<>=�=B?�?>=�<I9;<>B�Q$�� ���5� �&C�<3<-98N;<$B@�&C�<�#8EB<>[�j�BKH><I7 � E><G7�?>=�9�:Zs � � =�9��<�E��'A!��=���<+EBH��(�$9P��?���<�E�=B?$9*P =�E�E�?*<�F�E>=�9�><-N�<I9��(C�<,?�A�E�<�<-9��>98N�9�<5�(C�=�9�: P =�E�E C*�5F�FL<+9 ?>=�9*A�<��8C�� �4=�9�:W98<5�L?L<�<+9��(<>E N��&< #89�=B?&C7�F �Vs � � =�? P �5=��>=�9�:@B§<'E�=�9�F87(� �§BIE&<I=;H><>7�E 9'<2H3?4<�5EHN �J[ !�C�����<+��<�E�H><>7���H4FL<D=�9 P =�E�Ec?L<�'F�FL<+98N(<5N�&< P C*���><-�'<2ExC��'?Y?L<�<-9P=�9�F87(�LBIE(<>=�HI<>7�E #4E�<6?+[qsYC�<v7�?67*�$EME�<2?>F4<I9�?><=�? �(<���HFL<�Q$�� ��� -�� � ?&=�9�A�<�&C*��� P =�E�E #49�=B?&C+�&C�=�9�:?Y7�F [�5!�� $�� ) � ��+ � ,$, � 0 6�� 4 8# 8 6 � 8 � 6"8 ����6 ,�� � 254 �38�� �

�D?&=�9�:P��=�=�?�?&FL<+E�E�<5N¢<�Ev<5�(C�<�E�A+<>9�>E(<>EK?&<=:F7�<+9�A�<u7�9 939�< P 9��&<Ms�� � =�?3��AO<>=u=u<>9 <�E�E(<'E5[@j�Bs�� � =�?A?L<�=�9�:0E(7�97��?)�l?�����AHC��1<>? ���>9 <�E�E&<�EL=�<2?�?>�>:'<�=�?DF�E>=�9�><5N �$98NP�&C�< �1<>?¢:I<4<2?L<I9 =�:>9�<�E>=�9�:�&C�<DAO<I9�>E(<>E�?><�:F7�<-9�A�<I[ !�C�<-9Z7�?>=�98:@s � � =�9�><2E���A!��=���<+EBH��'=��C=�?�Fm<�?�?>=�?�EB< �(<�E><2F��5=BE�<2E>E(<'E�?��§<>BMAO<>7�E�?><�&C�=B?ZN�<<6?u9�<5��AHC��>9�:'<+�(C�<M<'E�=�:�=�9*�$E�=�9�F87(� #8EB<�� ?6< �(C����W=@7*?��Z?L<�NV<>9�< P C�<+9 �&C�<�s � � �1<>? =B?AO<I=�F�E�<��><5N �J[q\37�F�F4<?&< P <�C�� �'<3�us � � =�9�F�7�� #8E�<�A+<>9�?>=�?���=�9�:u<>B/�&C�<�B§<>E�E�< P =�9�:�� P <uEB=�9�<2? Q3¦8e�<��Vg ¤���¦��F¥Fd � e � ��Q$¤�¥�¦8eRdI¤���Tme �F¤Vd � e � �ViQ$�� �� � -��D=B?K�(C�<59'<2H/7�?><-N��&<3<-98N��GE�=�9�<x<$BJ=�9�F�7(�5[�j%��=�=�:>C��?L<OA��$E�EB<-N��&C�<OA2�5E�E>=��$:�<8E�<��(7�E&9 �'<+9��<�E �<'EO?>=�=�F8E�H��(C�<3E�<��&7�E&9 9'<2HZ<>9�H><I7�E��><2E&=�=�9��$E [q\3<>=�<��>=�=�<6? =-�O=�? =�98N(=�A��5�><-N;?4H��DE��5E(:'<GE�<+B �)�5E�E&< P [

. �

Page 69: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =�9�>E(<����@[ \c[L?&FL<+E�EB=�9�:�� \4<6A!�>=�<>9 � �s�<�<�E�E =B?xC37�=��>9sYC�<�AO<>9��E&<IE P <�E(NP?&C�<I7�E�N�?L<DQ$¤�¥me$¦���<>B�AO<>7�E�?><>[ !O<2E><,=B?O�&C�<�=�<6?>?��$:�< �&C��5� P <>7�E N�?L<,?&<-9�

�&<�HI<>7�E ��<�E(=�=�9��>E � ��<�� �I¥me=<��F� S���<3d3T �V¦ � ��; )���<cS �q�¦�� %�Q3¦�e=<��Vg ¤���¦��I¥Fd � eU� ��Q$¤�¥V¦8e dF¤���Tce �F¤3d � eU� �Vi�

sYC�< #�E�?��GE�=�9�<�?����5E>��? P =��&C � �>98NM:�=���<2? �(C�<,<2E>E(<'EA=�<6?>?��$:�<>[A¨)<Oo4�3AO<>=�<6? �&C�<�EB=�9�<@9���=@?L<�E<>9 P C�=�AHCP�&C�<�<2E>E(<'E.<4A2A���E�E�<-NP�$94NP�&C�<�F��'E&��<$B��(C�<uE�=�9�<��&C��5� P �'?DE�<2�>N7?���A2A�<6?>?6B���E�E�HI[�sYC�<�9�<+o4�EB=�9�<A:'=��'<2?@�(C�<OAO<I9�>=�9��*���>=�<>9u<>B*�(C�<LEB=�9�<O�$B �><2E��&C�<)<�E�E&<�E-[ � ���&C�=�?�Fm<'=�9���&C�< :���<6?���=�<I9u=��'E$9�=�<2�$9*?�&C*���As � � =�? P �5=��>=�9�:�B§<'E)��E�<2?>F4<I9�?&<I[�sYC�<�E�<3�5E�<?><+��<�E��$EcE�<-:��>E�<>9�<6?

� � ��� %'���!� ��!%���� � ����% � � � ���!� �'� �

� �!� ��� ( ��� ��� %'���!� � ������ �% � � � � �!��)

!O<+EBF ¤ � -�� �O<2�'?&<>9lB§<'E)?&�&<�F�F�=�9�:uE�=�?&�><-N�<I90��<�E(=�=�9��>E[jk9*?&<2E&� e�� -�� ¨)<Oo4�LEB=�9�<3=�9�?><�E>�><5N0=�9�&<Ws���� =�9�F��(� #8E�<I[� o(=�� f�� -�� � o(=-�YBIE(<>= s����@[ C <I=�F8E�<��><-N+F��>:'<6?8�(< ��Aj #8EB<>[\(A�E&<IE�E � � -�� �/=B?&�L=�<2?�?>�>:'< �$98N+AO<I9�>=�9���< �$B �><2Ex=�=�9�<�EO<�E�E&<�E�?-[���89 T�� -�� �/=B?&�L=�<2?�?>�>:'< �$98N+AO<I9�>=�9���< �$B �><2EO�$94H�<�E�E(<'E�?+[F���=B<�� ; � -�� � E�EM�><�E(=�=�9*�$E�EB=B?&�>=�9�:�?)?���F�F�E><6?>?><-N [C��5E�E�HW<>9 � -�� s � � AO<I9���=�9���<6? �'?Y?L<2?&�O=-�)A2�$9 [

jk9�<���E.E��'?&�D<+o��$=�F�EB<���E�<2��?6<I9��$?8E�<3E�<2?>F4<I9�?></=�=�:IC���?L<��&<+<+9��<�EL¤ � -����(<l:'<���lC�<+EBF�=�<2?�?>�>:'< ��&C�<+9te��A-����&<+=�9*?&<2E&�v=u<'E�<,��<Oo4��� �N�5� P C�=BAHC F4<�=�9�/s � � E�<2?>Fm<>98N�? P =��&Cte=< � �IT3d�� �$94N�#89*�$E�E�HQ$¤�¥4e>¦���?��&C�<�A+<'E�E><6A!� AO<>9��E&<IE P <'EHN�[ !O<2E>< =�? �&C�<E�<2?���E�� � ¤ �A-�� ¤���S�� <Vd3T �V¦ � ��; )���<mS��tbId�dF¤�� ��<����F¥�dF¤��td �>`�¦8e�<���F¥�� �A)VT �ITFT �IT�a � ��� b �����8b � <������IT�QI� �I¥ � �F� � ?U¥ � �A)�¤8b����a�e ��� `��V¦3¦ �F��e d # �q� �ª� ���HQ$¤ �>�Vf�� ' �ld �F`����? ��b <���dI¤���S��IT3T���SUd� `��3¦3¦8e=< �$# �q� �ª� ���?>Q$¤3� �If�� '�� 6>dF¤��IT���e � � �A) � d�S�� <Vdce=< )����b�<��8? �(¦3¦t¥��IT���>d�b>���A)Vd �3¤�bId������>T �8b � )�<�� �I¥me=<��F�q�� e �A-��e=< � �IT3d��3QU¤�¥me>¦ %=�

sYC�< #89��>E %=�D=�<2�>9�?C�&C��5���(C�< #�E�?&� �N�$94Nl<I9�E�H �8F��$:�<AC���?ª?*<2<+9�A+<>=�F�EB<���<-N+�$98N�?&<-9����&<��&C�< ��.j #8EB<>[�sYC�<v<'E�=�:�=�9��>EJ=�9�F��(� #8EB<�?���=�E�E 9�<2<-N�?��(<W?*<�#�o(<5N �V<$B�AO<���E�?><>[

.>¬

Page 70: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =�9�>E(<����@[ \c[L?&FL<+E�EB=�9�:�� \4<6A!�>=�<>9 � �s�<�<�E�E =B?xC���=��>9�5!%9� $�� ) � 8� � 0 � 6 8 �

� =�=B?�?>F*<-E�EB<-N�B§<>9�u9��$=�<�=B?��>9\<�E�E(<'E�?&=�=�=�E��5E��&<��&C�<�=�=�?>?>FL<+E�E�<5NUA+<>9�>E(<>E ?&<=:���<+9�A�<>[�sYC�<<�E�E(<'Ex=�<2?�?>�>:'< =�?AN(=�©L<2E><-9�D�$98NP�ZE�=��&�(E�<,A+<>9VB��*?&=�9�:0�5� #�E�?&�-[L\���F�F4<?&</B§<'EO<+o(�>=�F�E�<��&C�<vB§<IE�E�< P =�9�:�5F�F*<6�5E�?C=�9�H><���E =�9�F��(� #8EB<� QI¥�� <Vd8Q � ¥ ��S+a ��� � %

j%��?&C�<���E�N�?L<MS+a ��� % � ���&C*���,=�? �^�&C�<Z9���=@?L<�E�?vC�� ��<D?L<�<-91�>E��$9�?>Fm<�?><-N�[ !O<�E�<��5E�<��&C�<�<�E�E&<�E�$94NlC�<-E�F�=�<2?�?��$:'<6? � ! ��<Vd�Q � ¥ �4S+a ��� � % < �Id�¦��3bF�Vb$�4¦���� 5��Id3TceIS # ! 5 '�¥me$¦�� <��Id�¥��A)�<V� ��>d �r����T��3bI��b���b4e=< � QU`8bITQ$�� ��� �3Q$`8bIT Q �V¥me>¦3¦�Q � )3`��IT ����8SUd�Q���<��¦�� � Q$� ���� ¤ �A-��?��8b � <��1d�b>�4¦��td ��T��3bF��dF¤�� � e ���VbId�b�¥��>T�dI¤�e � ¥���<Vd��� �8?��ce>¦3¦�e ��<��>T��rdF¤���¥���<3d � `��8SVeU¥4eFS>bIdce ��<Y����e VbITV� � S>b�<�¥me f ! 5�¥me>¦ � � ) � e=< � ! d � < ���A< �Fd � ! �7�� �A)ra�e��F¤Vd�d3T ��e=< � �IT3dce=<��b��4eU¥3¥ �IT ��<Vd�¥�� <Vd � `��8S���q� � � ��d �F`�� �?$QI¥���<Vd � � b a ��¥���<Vd�eU���"� � � )F� � dce d )Vd��R¥���<Vd <8b5a �������

sYC�<.sxw� �s � ��B§<I9��=�<��>E�=BA � #8EB<O=�?��$9�� �Vo(=�EB=B�'E>H #8E�< �(C����C=B? ��?&<5ND?HDs � ��[�\V<3�&C�=�?�?&�>E��$9�:�<=�<2?�?>�>:'< =�? � �*?��C�><+E�EB=�9�:�H><����&C��5�8�&C�<LB§<>9��H>< �ZN�< #89�<5NZNV<4<2?&9 � �C<+o4=�?&�q<>9�HI< ��E�AO<>=�F����><�E�?&H(?&�><-=�[�5!� � ) � �%� $�� 0 �%$ � ��) � �

� 9�<5�(C�<�E�AO<>=u=u<>9�<2E>E(<'E�=�?��(< ��?><G^�<�Eª^3^�&<�?����5E>�C��=����&C�<+=�����=BA2�$E�<+o(F�E><6?>?>=�<>9��$98N��(C�<+9��(<B§<'E(:'<����&C�<�?&<6AO<I98N/^x<�E�^3^ P C�<-9�#89�=�?6C�<5N�[�sYC�<��><+o�^�&C��5� B§<>E�E�< P ?�=B?M�&C�<-9 �>E�<2�5�><-N3��?�=����(C�<+=�����=BA2? ��$94NP�&<;=�� 9'<�=����&��<�E�? P <'E�?><��L=]Bq=u<�E><�=��5�&C�<-=����>=�A�?=�?D?&���'E&��<-NM?4H �l9�< P ^l<�Ev^3^��J=-� P =�E�E@�&C�<-9?L< �>E�<2����<-N��'?Y<�E(N�=�9��'E>H���<Oo4�-[ ¨O<�<5NVEB<2?�?��&<�?��GH��(<�E�E(<'EY=�<2?�?>�>:'<2?ª:�$E�<'E�<.=��GHZ?L<v:'<-9�<�E�����<-N�[�s����P =�E�E��5�&�><-=�F(�3�&<PAO<�E>E�<2A��D�(C�<�F�E(<>?�EB<+= ?4H =�9�?><�E>�>=�9�:P��9�< P ^�<'E@^3^ �/=�9 �>9H�A��'?><��J�(C�<�F�E(<>?�EB<+==�?OAO<�E>E�<2A��><-N;?4H0�(C�<3<+94N�<$B@�&C�<�F*�5E��$:'E��5F8C�?>=�9�A�<��u9�< P F��'E��>:'E��5F�C P =�E�E^� �(�&<I=����>=�A��>E�EBH0?&���'E&�)��?<'EHN(=�9��5E�H��><+o4�-[

C <I9�?&= N(<2E �&C�<�B§<IE�E�< P =�98:�A+<'E�E><6A!� =�9�F��(�D�$94N0=���?x<��(�>F��(� 14e=<mS���^I¥ #&f '�� � ^ �¢^Fb��U�4^ ��b�<���^I¥ #&f '>^�e � S���<3dce=< )��*) � � ��� 3 < �(��dF¤8bId^3Q8e�<Vd b +��¥ #6f '>Q �&�If � � ^��

.$«

Page 71: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =�9�>E(< ���/[ \c[L?&FL<+E�E�=�9�:�� \4<6A!�>=�<>9 � �s�<�<�E�E =B?xC���=��>9\4=�9�A�<�� � � ��� � � ��� � ���$98N�� � � ��=B?)AO<>9��=�9���<���? � P < 9F98< P �&C*����� $" � � � ��� � � � [j�B P <�< P E�<6� �'<u< ����(C�<�?><2AO<�8N�NV<>E�EB�'E�?&=�:� = ^I¥ #&f '$^ P <��&C�<��:�<��3�(C�<DB§<>E�E�< P = �:�<�E�E&<�E

��4NlC�<-E�F�=�<2?�?��$:'<6? � 5ce ��� e=< ��^�e=< � �ITFd��F� ��8e=< � �IT3d��I�rd��If3d � ^�>d �r����T��3bI��b���b4e=< � Q8e=<3d �>`Q8e=<3d�� �3Q8e=<Vd��>` Q <��V¦8eJa�e d �¦�� � ^3Q�e=<Vd b -��¥ #&f '>Q �&�Ff � � ^��� ¤ �A-��? � � ��e�< � �IT3d �F��bt��� �ce=<8�5acbIdF¤ ����<����-acb>dF¤ � �Ua8���V¦ � e�<cS��@?_dI¤�e=< 3� �A)�¦��I¥Fd���<�� �A)Vdª� <FT �8S���I��� ��e dI¤�¥4e=< ���IT � SUT � ��� �F� ��

sYC�<.E�= �< ?����5E>�>= �: P =��&C � �><+E�E�? �*? P C��5� C���?q?L<�<�;NV<��<>[�sYC�<.E�= �< ?����5E>�>= �: P =��&CM¦�� � ?6C8< P ?��? P C�<2E>< P < P <�E�<�=�U�&C�<P=��F��(� #8E�< P C�<�U�&C�<P<2E>E(<'ED<(A�A���E>E�<-N�[ � ?�= t< ��Eu<5�(C�<�E�<+o��$=�F�EB<2?���&C�< F*�5E>�;<$B,�&C�<XEB=��<1?���A�A�<2?�?1B���E�EBH#E><6�>N �)�&C��5�+=�? �)�&C�E(< �8:>C�Q8e=<Vd �)�5F�FL<2�'E�?;<��<��<nE�= �< ���8N�&C�<+A+<��>= �������=�<�W�5F�FL<2�'E�?@<���(C�<��<+o4�DEB=��<>[XsYC�<0E�<+=��5= �= �:�=�����<�E�=B�>Eq=��GH�?&<2<+= ?&<>=�< P C��5�<>?*?>A ��E><I[�sYC�<2?><3= ���<�E(=�<-N(=�����<v=�<6?>?��$:�<2? ?&C�< P�P C��5� P ��?YC��5F�F*<��=�8:uB���E&�(C�<�E)=�+�&C�</: �(��?x<$B@�&C�<s � � F�E&<I:'E��$= P C�<���(C�< <�E�E&<�EY<4A2A���E�E�<-N�[�sYC�<��< P <2E ��?&<2Ex=��GH�=�:��<'E�<D�&C�<-=�[

!)<�E�<=�? P C��5� H>< ��:'<��)�'?ª< ���>F��(��UB �><2ELs�� � ��E>=B<2?��(<�E><6AO<U�'<2EqBIE(<>= �&C�<3<2E>E(<'E5[\4= �A�<�� � � ��� � � ��� � ����8N�� � � ����� � �&����� ��� ������������� � �&���! � �"� $" � � � �V� � � � [sYC�<2E>< =�? ��?���E><���AHC�<$B/��<Oo4� �&C*���O=�? =-���$EB=BA P =��&C#�<�?&F*�'A�= �:4[ sYC�=B? =�? ��H4F�=�A��$EcB§<�E$�<'E(=��$EJ�><+o4�?L<�= �:�F�E&<(A�<6?>?><-NP��?G=��5�&C�<-=����>=�A�? ��=�B8H><��7?&<2<��(C�=B?= 7HI< ��EG< �(��F��(� ��H>< �¢C�� �'<��$E�=D<?�� A�<2E&���5= �E�HEB<OB �L< ���)�W^u<'E.^3^8[

�5!7 � ) � �%� $�� 0 & � �� � �j%��� ?8<2�'?>H��&<vB§<�E&:�<���<'Eq=�=�?&=��5��AHC��(C�<DA+E�<?&= �:v?�E��'A�<2? P C�<�W=�� 94=�8:v:'E(< ��F�?-[ sYC�<OE�<2?���E-� =��GH?L<+�7E><-EB�5�>=��'<+EBH�?*<��=�:�\<2E>E(<'E � <'E,=��u=��GHX?L<+A2�����'?&�>E(<'F�C�=�A$[R\���F�F4<?&< � B§<'E�<Oo��$=�F�EB<���HI< � C�� ��<g3Q$�V¥./����V¦>��dme d8¦�� =�PHI< ��E ��<Oo4� P =��&C��(C�<,AOE�<�?>= �:�E>=�:>C�x?�E��'A�<v<>=�=-�>�><5N�[xsYC�<3E><6?��8E-� P =�E�E ?L<

. �

Page 72: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E(<����@[ \c[L?&FL<+E�EB=��:�� \4<6A!�>=�<� � �s�<�<�E�E =B?xC���=����&C�< ?��$=�<3�'?�=�B �<u<�F*<��=�8:D?�E���A�< P <2E><D�&C�<2E><��4�&C��5� =B?��4�&C�< E�<2?&�x<$BM�(C�<3F��5FL<�E P =�E�E�?L<v?m<>E N3BN�'A�<=�B�<u<5�(C�<�EYB§<��)AHC����:�<2? �5E�<�=��>N(<I[ ��<�� P =�E�E :'<�� �&C�<�B§<IE�E�< P =�8:D=�<6?>?��$:�<�5���(C�<3<�4N;<>B^�(C�<�#8EB<�

#JQ���<V����S3S4)VT3T �F��e=< � eU� ��b �3T �A)3`�bId�¦������V¦ %"'j�BMHI< �WC��INW=��>N(<)�&C�<?>�>=�<A=�=�?&��� 9�< � P =�A�<����&C�<���(C�<�E�< P < ��E NW?L<O� P </=u<'E�<L<'FL<��=��:@?�E���A�<6?

�&C*��PAOE�<�?>=�8:�?�E��'A�<2?�����8N�H><�� P < �8E�N;:'<�� �&C�<�=�<2?�?>�>:'< #JQ���<V����S3S4)VT3T �F��e=< � eU� ��b �3T �A)3`�bId�¦������V¦ � '

s � � NV<4<2? � � 9 �< P �&C��5���&C�< AOE�<�?>=�8:R?�E���A�<P=�?Z=�=�?>?>=�8: �"�>=�E)=���E�<2��AHC�<2?��(C�< <�4N�<$B �&C�<= �F��(� #8E�<I[ !O<��A�<��&C�<;=�<6?>?��$:�<ZNV<4<2? � �,�><-E�ECH><�� P C�<�E�<�H><�� P <�� P E&<��:8[�j�B �(C�<ZE�<4A2����=�<�R<$B�&C�<l=�=B?�?>=��:n?�E��'A�<0=B? � �D<I?F�4=�< ��?��@=-��� ?��$E P �GH4?�F4<?>?>=�?8E�<0�&<7= �?><�E>�WQ$����MC��>E]B P �GH7�(C�E(< ��:IC�H>< ��ENV<(A��8=�<��-[����" �=�8:�s � � �>:��5= P =�E�E A2� ��?><l<��E�H �(C�< #�E�?&��C*�$E�BO�&<�?*<+F�E(<(A�<2?�?><-N ����8N�=�B)�&C�<<�E�E(<'Eª=�<6?>?��$:�<)FL<�E�?&=�?&��?��HI< � P =�E�E 9 �< P �&C*��� �&C�< <2E>E(<'EC=B? = 0�(C�<�#�E�?��YC��$E�B�<>B/�(C�<vNV<(A���=�<��5[ B�H=u<U�4=��:��&C�<�QU����,�&<WN(=�©L<2E><��OF�EB��A�<6? ��&C�<3<�E�E&<�E�A2���?*<vE�<(A��$EB= ��<-N [ � EB?&<��VE�<3<�94= �:��5� �&C�<v<��(�>F����<$B ��<��E�<+�'<6�$E�? P C����xC���?Y:><��< P E(<�8:8[

�P=�?�?&= �:�<'FL<��= �:l?�E���A�<2?�5E�<@= ��AHC7<6�'?>=�<2E)�(<+?>Fm<5�-[ !O<�E�<,=�? ��� P <lEB= �<�=��F��(� #4E�<���4NP�&C�<E�<2?���E-��=�8:�<2E>E(<'E ��8NlC�<+EBF�=�<6?>?��$:�<2? Q$��¥ � �>T���e � dI¤�� � d�bIT3d�i �l� )Vd�dF¤��>T���e � dI¤���¥me=<�e � ¤Y�Q$�� �� ��� acb�< ��i � � �¦�� %�Q$�V¥ � �>T���e � dF¤�� � d�bIT3d�i

��� )Vd�dF¤��>T���e � dF¤���¥me=<�e � ¤Y�� ¤ �A-��� �A)�� ����SI¦�� � �F� a �IT � �FT �A)3` � dI¤8b�<�� �A) �>`���<��F� �1A)cS5¤�� ���>����� � bIT�� ����<��>T�bV¦3¦(�_¤8bIT$a�¦ � ��� � � � 3 ��>` � �4e=<�ª�

j%��� ? :���=��><0Fm<�?�?>=�?�EB<���<>B)AO<���E�?><��K�(C������&C�<�EB=��<0�&C��5��=�?�?���F�F4<?&<5N1�&<�C�� �'<��&C�<�=�=B?�?&= �:�EB<OB �?�E��'A�< P =�E�E��<5�L?L<v<���&C�<vEB= �< P C�<�E�<vs�� � A2����AHC�<2?��&C�<3<�E�E&<�E-[� =�=B?&=�����AHC�<-N�?�E��'A�<C=���&C�<YN�< # �=��>=�<�u<>B*� �< P A+<��>E(<>E(?><�:���<��A�< A����A�� ��?><��.=����1<'EK<2E>E(<'E5[\4= �A�<�?���AHC��MN(< # �=��>=�<�R=��GH = �AOE �8N(<0?><+��<�E��$EKF��'E��>:'E��5F�C�?���=��@=��GH �<5�/?L<0A2� ��:IC��v?4H �(C�<�<�8N<$B)�7F��5E��$:�E��'F�C ��?��(� ��E��5�&C�<2E P =�E�E�� ��?&� 9'<�<2FWF�=�E�= �:n=D<�E><���8N�=D<�E><��><Oo4��=��(< �&C�< �"�# �=�?6C�<5NN(< # �=��>=�<� [tj%� � ?�<+��<�UF4<?>?>=�?8E�<�B§<'EWs � � �&<1E�� _<��(�W<$B.=�<-=D<�E>HW��?�=-� 9�<�<�F*?�<6����=��: ��Fr=u<'E�<

�><+o4� �@sYC�=�?=B? A2�$E�E�<5N7� �&E �"�� P �GH;N(< # �=��>=�<� �8[ !)<�E�<�=�? ��� P <lEB= �<�= �F�����#4E�< P =��&C1��E �"�� P �GH y z {c| }J}&~-� ����QN(< # �=��>=�<�

.(.

Page 73: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E(<����@[ \c[L?&FL<+E�EB=��:�� \4<6A!�>=�<� � �s�<�<�E�E =B?xC���=���QI� �I¥�Q <��(�����ITV��g$dF¤��R� �F¥Q <��� ���ITV�Q$�� �

!)<�E�< �'E><�(C�<3E><6?��8E-��=��:�<2E>E(<'E ��4NlC�<-E�F�=�<2?�?��$:'<6? ;)�<�b(�8b"��� �I¥me=<�e dme ��< �� �>dI¤���� �F¥� ! �ITF�ceU�3� ��<�S���<Vd3T��V¦ � ��;A)���<cS��t¥��A)�<�� �3¤ce>¦�� � S>b�<�<�e=< ����F¥me=<�e5dce ��< �F¥�Q <��(� ���>TV� ��8e=< � �IT3d��I�rd��If3d � i�>d �r����T��3bI��b���b4e=< � QU����¦����Q$� ���� ¤ �A-��? � ) � `���SUd � �A)�¤8b�� ��¥��IT� �IdFd���<�b �Hi�� �nS>b*) � e=< ��a �d ��T��3bF�t`8b � d �3¤��IT�� ���A)��8b�<Vd��I�_a ��d�� � d��>`Y�? �H¦F¦tdFT ��d ��T �8S������>T��Z� )Vd�eU¥�dF¤�� �IT3T��IT�e � � �ITce �*) � �� �A)��&�t���Id3d��>T�d �F`�����=�� �IT � � � <����b <���¥4e f�� �A)VT�¥me>¦ �q�� � -��9 �t`8b ��� � �F¥*�*)VdF` )Vd �

sYC�=�?@=B? <I?3�=�< �*?6EBH3�D?><�E�=�<���?^<�E�E&<�E-[ j�BL=-��<(A�A ��E�?^�5�^�(C�<Y?*<-:'= "�= �:�<$B*� #8EB< �S�'?@= ��&C�<�F�E><-�=�< �*?<Oo��>=�F8E�< � �(�(C�<�E�< P =�E�E ?L<��<u< �(��F��(�)���)�>E�E �

j�B*�AOE�<�?>= �:A?�E��'A�<�=�?�EB<OB ��<��(� P C�=�EB< �*?&= �:D�A=��'A�E(< P =��&C�F��5E��$=�<��><�E�?��2�(C�<�E��"*� P �GH�N(< # �=-��=�<�P =�E�EV?L<��><�E(=�=�*���><5N��5�^�(C�< <�8N�<$B*�&C�< F��'E��>:'E��5F�C [�\3<=]B Q>� �F¥�Q <��(� ���IT3��� %Ug8h+h+h i.C��'? ?L<�<�DN�< # �<5N��4N�H>< � �*?&<DQ <��(� � �ITV��g8h+h+h P =-�(C�< ���O�&C�<�AOE�<�?>=�8:W?�E���A�< ���&C�<�7�5�A=u<�?&�A<��<3F*�5E��$:'E��5F8C P =�E�E�?L<E ��=��<-N�[ y+z+{c| }J}&~-� ��� �

j�W?&C�<'E>��� P C�<�\���<2E>E(<'Ev<(A�A ��E�? ��=�� 9'<�� �<5��<Z<$B �&C�<lEB=��<���8=@?L<�E��(<7?><�<ZC�< P = �*AHCR<$B�&C�<�= �F��(��#8EB<@C���?A?L<�<�7E�<2�IN �L��8N �>EB?&<��&C�<�EB=��<�?&���5E>�>= �: P =-�(C���7<Oo�AOE��$=�����=�<�PF4<�=��D�&<l:�<�� �?&C�<'E>�GN(<6?>A�E>=BF(��=�<��<$B��(C�<�<�E�E&<�E-[Gj�B��&C�<�<2E>E(<'ED=B??&�>=�E�E �<'� A+E�<6�5E �J��? 9Ms�����B§<�EG=u<�E><�=�VB§<�E&=��5�>=�<�?4H���H4F�=�8:;¤ � -���[/w8<'E3?&=��>E�E�<2E>E(<'E�?��ms���� A��� A��'E>E�H�<� :���=-��<�� P �GHP=]B�H>< � � ��?&� 9�<�<2FnC�=��&��=�8:�&C�< �A-��8[

. �

Page 74: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

�������������� � � ������� � ��� � �������D� ��� �#�

j���(C�=B?C?&<6A!��=��� P <xE���9����8��BI< P ���'F�=�A�?��&C��5�C�$E�E� P s����#���/?L< �*?&<5N P =��&C� 'E�<2����<�E ¡�<+o(=�?�=�EB=-��H�'E�< ��A�=B<�*A�H>[ � ?��(C�<;N��4A ��=�<���?@?*<2=�� 7F�E��VN ��A�<5N� '<���E��� �<�E ��N(=�©J<�E�<����><6AHC"�= :���<2?�A���RC�<+EBF=�� 9�<D�(C�<�=BEOA�E�<2�5�>=��+<2��?&=B<�E5[�5!$# : )�"�� , � ��� , )�� � , ��� , � �

s � �\A���3E><6�>N ��8N P E�=��><"#8EB<2?^�'?�=��^E �"�?-[ sYC�=�? =�� 9�<2?�=��/F���?�?&=�?�EB<������*?&< #4E�<6?��&C*���^�'E><�?&=��$E�E�<2E��4NM=��'E�<,A���F��<��=B<�� ���lC���8NVEB<@?4HPA�E�<2����=�� ��Z=��'?&�><2E #8EB<��(C����E><6�>N�?O�&C�<�?6=��$E�EB<�E #4E�<6?)= P�&C�<F�E��'FL<�E��'EHN(<�E5[�sYC�=�?ªN��4A ��=�<����3B���E <Oo��$=�F�EB<��(A����?>=B?&��?��$B^�><�+?&<6A!��=����?�F�E �*? ��0= �>E��VN ��A!��=��� [ j��>N8N(=-��=��� ���(C�<�E�<��'E><D=��'A�E��?)�(C������'E>< ��?><-NMB���E��$E�E�?&<6A!�>=��*?+[DsYC�<u=���A�E���?A���n?L<�F��(�3=�1� #8EB<A��>E�EB<-N �^?��GH��8acb8S T � � �kd �If �*�&C�<�= �>E��3N���A!��=���1A2���?*<�F��(��=�te=<Vd3T��q�kd��If �J��4N7<6�'AHC1?&<6A!�>=�� F��(�= =-��?�� P #4E�<I[.sYC�<�A�����E��IE P ��E(N¢Q8e=<3` )3d0=B?)�&C�<� ��?><-N����0E�<2�IN�= �� #8E�<I[Aj�� �<��<2E��>E ��Q�e=<3` )Vd¥me>¦ ��<8b a � P =�E�EMA2� ��?><D�&C�<�#8EB<3A��$E�EB<-N�¥4e>¦���<8b5a �q�kd��>f����u?*< E�<2�IN�= +��8N0F�E��(A�<6?>?><-N0=�=u=�<-N�=B�5�><+EBH��� ��?&���?O=�B@�(C�<���<Oo4� �>B�¥4e>¦���<8b5a �q�kd��>fDC��IN�?*<2<� F��'E&� �$BK�&C�< #8EB<3�&C��5�DE�<2�IN�=��D= [LsYC�=�? #4E�<�=��GH= �F��(���5�(C�<�E #8E�<6?+[¢j� BN�'A���=�� � ?!�>B �><�\A���F��<��=B<��3���¢=�� 9�<0�7?>=�� >EB< #8EB<��&C*����E�<2�IN�?�= \?&=��$E�E�<2EF�=B<2A�<2?��(F*<2E&C��'F�? �'?ªB��IE�E� P ? Q8e=<F` )Vd�acb8S T � �Q8e=<F` )Vd�e=<VdFT �Q8e=<F` )Vd � �8S %Q8e=<F` )Vd � �8S �Q8e=<F` )Vd � �8S �Q8e=<F` )Vd � �8S 'Q8e=<F` )Vd � �8S HQ8e=<F` )Vd � �8S Q8e=<F` )Vd � �8S �Q8e=<F` )Vd � �8S �Q8e=<F` )Vd � �8S �Q8e=<F` )Vd � �8S % �

!�C�=�EB<��&C�<��><+o4��=�?,?&�>=�E�Eª?L<�= � ¢C�<6� �4=�EBH�<5N(=��><-N ��=-��� ?�F"�?>?>=�?�E�<����7F�E��(A�<6?>?!���EBH1?#�I=�<��$B �&C�<#8EB<2?.?4H�F����&�>= � �� �+���)�(C�<@?L<$ �=� �=�� ��$B�<6�'AHCMEB=��<��&C*���A$�����'=�*?)� #8EB<����l?L<�?$94=�F�FL<-N � �&C�=B?D=B??��>=�<���=�=�<2? A2�$E�E�<5N ��A��I=D=�<����=�� %���(� ���(C�< �" P ���><-N #8EB<2? �J[

. �

Page 75: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<+E�EB=�� �� \4<2A��>=����� D=� '= � ��uE�=��&�(E�</N(<2<�FL<�EsYC�<�Q8e=<3` )3d�A$���>E��>E P �'EHN��>EB?����$E�E�� P ?��(C�< ��?>< �$BKF�E�<-N(<6?&= ��<5Nl=���A�E���?-[�sYC�<v=��'A�E���? B���EO�=�<+=��'E���4N ��= �>B���EC<+o��$=�F�EB<��F=�= >C�ª?*<DF��(� =�0� #8EB<DA��>E�EB<-N�a � a �q�kd �Ifc[ sYC�<6?&<.=��'A�E���?�=�= >C� ?&<��

��F1�(C�<�E>= >C�DQ$¤ � e � ��Q�� � e ����4N �'�&C�<2E3F��5E��$=�<��><�E�?��/��8N�=�= >C��?&���$=�F �&C�<��>=�=�<���8NXN��5�><>[E �A�<O�&C�=B?ªC���?q?L<�<�0?&<�� ��F �(�$E�E4=�<+=���E���8N��v=��GHu?*< ?&���5E>�><5N P =��&C�Q8e=<3` )3d�a � a �3���@=�� 9�<O�(C�<+=A��I=�<����(� P =��&CP��A��>=u=���;B��'E(=����5[

B�< ?���E�<��(C����KH ���@N �� � ��C�� ��<��&C�< A$���>E��>E P ��E(NDQU����)=��H ����E/= �F��(�"#8EB<��'E^�&C�<xs�� � F�E�� �E��>=P =�E�E/?&����F+�5� �&C��5�OF"��=��5[� � o4<2E�A�=B?>< �8[ � � ��9'<)�/s � �]= �F��(�$#8EB<O�(C�����E><6�>N�?8=�0�,?&<6A���4N #8E�<I[�s/E�H�E><6�>N(= � 3= ��&C�<D?><2A���8N#8EB< � P =BA�< ��?&= � ��&C�<�Q�e=<3` )Vd�A�����E��IE P �'EHN�� P =�A�<I[�5!�� � �%"�� � � ��6 + ��! � �"�� �

D<2?>=� ��= � W=��'A�E���?C�(C����DA2���?*< ��?&<5N P =-�(C�=���H0��H4F*<6? �$B�N �(A���=�<����? =�? �>?3�4=�����?&E�H �*?&<+B���E[���?�� �"�=��'<�E�?>=-��=�<6? �FB��'E�<Oo��>=�F8E�< �FC*� �'<)?>F*<6A�= #*A��8N��$B �><��A$�>=�F�EB=BA2���><5NuB��'E(=�����E><=:���=�E�<+=�<���?�B���E�&C�<2?><2?-[ � A��IE�EB<2A��>=����$B�=��'A�E��? ���&C��5�)=�? �J�W=��'A�E���F���A 9�� '<�(C����G=�<2<���?)�$E�EM�(C�<2?><�?>FL<2A�= #*A2���>=��*?A�����E Nl?L<,?��>=�< P C��5� �>=�=�<�A$���?���=�= � ����WN(<2?>= ����8N�A�����E Nl?L< :���=-��<vE���� 8[�j%�O=�? F���?�?&=�?�EB< ��� ��?><�&C�</Q8e=<3` )3d�A��I=u=���8N0��� ��?&<3?���AHC���=��'A�E���F��'A 9�� '<���� ��?&�O�'?�=-� =�? F"�?>?>=�?�E�<D��� ��?><=-� P =��&C+H � ��E� P �=���A�E���?-[ B �(�As�� ��C��'? �u?L<��>�><2ExBN�'A�=�EB=-��HZB��'ExE��5E� '<�E F���A 9�� '<6?+[

� =���A�E���F��'A 9�� �<�A����?L<,F��(�D= ��?>F*<6A�=��$E�B���E&= �&C��5�A2���?*< :���=BA 93EBH0E�<2�IN;?4H�s � ��[LsYC�=B?=�?�A2�$E�E�<5N0��������� ������� ����8N��&C�< <+o(��A!�ªB��'E(= =B?��>BM�><6AHC"�=�A��$EJ= �><�E�<2?&� ���EBH>[�sYC�< =�=�F��'E>�����C�(C�=�� =�?C=�� �$E�E�� P ?ªs � � ���D?*< E �" P =��&C�=���4H�< P A$���>E��>EJ?><�:���<�*A�<2?CF�E�<-N(< # �<5N�[�CC<�E>���5= �A$�>=u=���8N�?A��>E�EB<-N��������������������'E><F��'E&� �$B@�&C�</N(< # �=-��=��� �>B s � �@[

!�C��5� P <�C�� ��<GN(<6?>A�E>=�?L<-N�=���&C�=�?Y=�������>E�=B? ?��>=�<���=�=�<6?�A2�$E�E�<5N���� !��"$#&% ' ����8N+A���*?&=�?���?��$B�&C�<ls�� � F�E>=)(�=-��=���<2?3F�E ��?��P?&<��!�$B*(��'A�E��? =�W��B���E+(���� #4E�< �I�&C��5�,=�? ��?����$E�E�H�=�*AOE �8N(<-NW=�Rs����� �����,(��5�>=�A��$E�EBH � A2�$E�E�<5Nn`8¦Fb4e=<Y�k¥Ua4dc[Zw���E3�&C�<�A���E�=�����?��^��4H A�����E��IE P ��E(N1A���.-*<Z�4=B< P <-N ��?>=�� Q � ¤ �(��[ sYC�<�A��/(�(���8N�Q � ¤��(�8Q�S���<Vd �IT8¦8e=<�� P =�E�E N(=�?&F�E��GH��Q�S���<Vd �IT8¦8e=<����Uacb8S T � �� %U� �3Q3¦8e=<���g3Q$¤ ��� � %UQ$¤ ��� i���� �(C�<0?�A�E�<�<����8N =�1�(C�<ZE� #8EB<>[ � � ��A��� ��?><;Q � ¤��(� P =��&C�H ����E � P .(��'A�E���?������ �4[;j10 H � �<�4N ��F �*?&= � �?><+��<�E��$E�(���A�E���F��'A 9�� '<2?��'H � �0A2�� �*?&<)�+2�</Q � ¤��(��A$�,(�(���8N�����?><�<D=30@�3F��5E>�>=�A��8EB�'E(��'A�E���=B?AN(< # �<-N�[

.��

Page 76: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<+E�EB=�� �� \4<2A��>=����� D=� '= � ��uE�=��&�(E�</N(<2<�FL<�E� ��4H�A��/(�F��(�><2E�A�<����<�E�? 2�� ��<C�2�< � � s � � (��'A�E�� F��'A 9�� '<>[�s 2�=B?8F��'A 9�� '< �$E�E�� P ?@�2�< ��?><�EK���

A�E�<2�5�>< ���= 8N(<Oo �����!-8E�< �,0LA����><���? ���8N�� -�=)-�E�=� �E��'F�24H�� �(���,(�����=BA2�$E�E�HI[ j%�8�>EB?�� 2��'?@�2�<O�!-�=�EB=-��H���7=��?><�E>�,?��,(�<�<+EB< (�<�����5E�H �E��'F�2�=�A #" ��E�<2?�?���A 2W��?�A�=BE�A+E�<6? � �U���$E�? ��E�= �<6? ����4N��5E�E�� P ?-[ � � s � ��$E�?�� ��?><2?)?>FL<2A�=��$E^F�E�<-N(= # �<5N #8EB<2?)A2�$E�E�<5N � ��� � � ��� � �3���0?><�� ��F7?>F*<6A�= #*A�F�� '<3F��'E��,(�<��><2E�?-[ � ��HN(=�©L<2E><��,?���H��B< #���<6?��5E�<�� ���5=��B�,-���<��^?��,(�< � � ��E ����B? P =�����'A2A�<�F�� F*�5FL<�E�? ��1� (�� ��<��>=�A�(�<-N(= ��(0��'EGN(=BE><6A!�)F�E��(A�<6?>?>=�� �=30��2�<�HP�5E�<�F�E�<�F*�5E�<-N ��?>=�� � � s � � ��8NP�ZN�<2?>=� ������<-NP?&��H�B< #��B<>[Aj%�D=�? ��'�N(=���A����������P?+2�=�0 � 0IE��/( s�� �;��� � � s � ��[ � ��?><�E�� ? ���=�N�<�-4H7�+2�<�� �(�+2���E �!0��+2�< (��'A�E���F���A 9�� '< ��M<6?��B=B< �^�!(�F��'E>���(=�?O� ���5=��B�,-���< � � s � � ��� (�% ��� � � � ������� � ��� !� %'� ��� ���� �

� [s 2�< � (�<2E>=�A��� � �5�+2�< (��5�>=�A����V\ �4A�=�<���H ��?><2?^�+2�<������ ��s���� (���A�E��)F���A 9G� '< 0��'EK=-��? � � ��E �����?-[j%�)=�? E�<2����=�BH�� ���5=����!-��B< 0IE��/( �+2*���G\�(A�=�<���H�������+F��5FL<�E�?*(��GH -L<,?���-�(�=-�>�><��+�����+2�<�=BE�� � ��E ����B? ��

��(�� ��<��>=�A (�<��(= ��( ��?&= � �� � � ��s � �@[ � (�����*����-4H �P=�A 2��'<�� \4F�=���� 9 � � ���� %�� % $ � �� ��=B?

� ���5=��B�,-��B< 0IE��,(��+2�< � (�<2E>=�A��� �7���+2�< (�����=BA2��� \�(A�=B<���HI[E �2�<�E (��'A�E��F��'A 9�� '<2?^<Oo(=�?�� �'���� �"���� ��-(��<�� �BH (��'E�< P =��� -*<!��<+�'<�����F*<���[�s 2�<�H,�'E>< ��?���������H

�!0 (%� �(<6?���A$��?&������\A��� -L<��'<�E�H1<O©J<2A��>=��'<+=�Z?#�/(�<�A�=BE�A���(�?&����*A�<2?-[ s 2�<�s���� �)?><�E�? � E�����F�� �� �"*A�<2?��2�<3<Oo(=�?���<��A�< �!0 �< P (���A�E���F��'A 9�� �<2?C=��=���? F���-��B=BA2���>=��*?+[�5!%9 � 6�� )�� 6"8 �� , 8 0#" � � ��)�� , , ) 8�� �

� ��94=�� 2��'E�= �$�������^����M��<�E>�>=�A����$��= �<6?D=�?D<2�'?>H ��?>=�� �s�����[ ! 2�<�7��HF�=�� �=�7�><+o� � QU¤VT;)4¦��% =���)A2� ��?><+�+2�< A ��E�E><����F��'E�� 'E��5F�2W����<��� � % =����&�(E�� % � 2��'E�= �$����������= �< % 2��?&< % ='�4�+2Z=�?��+2�<A���E>E�<��A����� ��< �!0YQ$¤ � e � ��������+2�<� % =����@A$���>= ���<!�� % =-�2�� �< % F��'E�� 'E��5F�2 [xj%� � ?)F���?�?&=)-��B<����?>F*<6A�=�0IH��2�< % ='�4�+2 �!0K�+2�<�2�E ����<��'?���0��'ED<Oo��!(�F��B<�� % =-�2�Q$¤VT )4¦�����eU�IdF¤ H SOa �J����?#��H � �PA��� ��?><Q�� �43 e5` �'E.Q$��e � � 3 e5`�����F��(�)?��,(�<3?&F*�'A�<3�,-"�U��< ��E*-*<���� % �+2�< 2�E ���B<>[ !)<�E�<=�? ���<+o(�,(�F���<

Q$`8b>Tce=<�� � <Vd � � `Vd�Q$`8b>T � 3 e5` � % � `Vd� �IT ��e � dF¤���d �If3d����F¥��>T��rdF¤��r¤VT;)8¦��q�Q$��e�� � 3 e5`Q$¤VT )4¦�����eU�IdF¤ ��e=</�<��t¤��>T���e ��� � a �td��If3d�bF¥Id��IT�dF¤��t¤VT;)8¦��q��+2*���OF�E�� � ��A�<6?

� � ���(=�?#���� ! <2?(�B<�H�� �O<2����=�� � � �'?�?��'A 2���?><��&��? � � � � .��3j6\ BY¨ � � � ��� � � � � � � � �@[� � (�<2E>=�A��� �7���+2�< (�����=BA2��� \�(A�=B<���H � � � � .��Ij6\ BY¨ � � � � ��� � ����� � � �� �

Page 77: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<2A��>=����� D=� '= � �� ��=��&� ��< �(<2<�FL<�E

!O<2E>< =�? �+2�< �><Oo4� -L<�0���E><�+2�< 2�E�����<I[� �� 2�<�E�<=�?O?��,(�<�><+o�)�!0 �><2E �+2�< 2�E ���B<>[

j� 0N�'A!�D�+2�=�? 2�E ����< ��5������BH 2��'? % ='�4�+2 �!0��+2�E><2<�= �A 2�<6? � -��(�3����?#� -4H���<�0N� ���-� 2��'?D��2�<2=� /2�� �2�<��!(����"� -4H % 2�=BA 2��+2�< 2�E����B< <Oo4�><����? �,-"�U��<)�2�< -��'?><��B= �< �� % 2�=BA 2��+2�< ��HFL< =B? -L<�= � �?><�� ��!0 � [ «�F"��=���?�����1� �(<2F(�+2 �I�+2�<��!(�� �"� -4H % 2�=�A 2 �+2�< 2�E�����<�<Oo4��<����? -*<���� % �+2�< -��'?><��B=��<%��% 2�=�A 2��+2�<,��H4F*<�=�? -L<�= � 0?><�� � �,0 � F��'= ��?-[ � ��A 2 �,0K�+2�<6?&<�F*�5E��!(�<���<�E�?OA��� -L<,= ��(=��4=�����������H�?><��-[s 2���? =�0 % <�A 2���� '<D�+2�< ���'?&� <Oo��!(�F��B< ����?��GH

Q$¤VT;)8¦�����eU�FdI¤ ��e=<�¤��4e �I¤Vd � `3d�� �$`VdF¤ �t`Vd % < '<��

!O<2E>< =�? �+2�< �><Oo4� -L<�0���E><�+2�< 2�E�����<I[� �� 2�<�E�<=�?O?��,(�<�><+o�)�!0 �><2E �+2�< 2�E ���B<>[

s 2�< �2�E�<�< F��5E��!(�<��><�E�? ��e �FdF¤ �F¤��4e �F¤Vd �4����;� �>`VdI¤�(��GH�-L< '=��'<��= ���4H �'E �(<2E-[ y+z+{c| }J}&~-� ��� � � �,���� �4E ���B< (��GH -L< �(< # �<��P������� � ��?(��H����0�� 2�E ���B< -4H�?>F*<6A�=�0IH4=�� ��+2�< ��eU�FdF¤ ��¤��4e �F¤Vd �(����� �>`3dF¤\=�0 �(<6?&=BE><���[ B �(����� ���= 9'< �+2�< 2�E�����< �C�2�<¢�4E ���B< % =������5��� �(���/(��5�>=�A�����BHU?&���'E&�0� �< % y z {c| }J}&~-� ��� � � �,���

F��'E�� 'E��5F�2 % 2�<��=��C�'F�F*<6�5E�?+[ B�H �(< 0N� �������2�<A�4E ����< % =���� -L< � [ «3F��'= ���? % ='�(<��4���� % =���� -L<)�'? 2�=� /2�'?��2�< �B=��< �� % 2�=BA 2�=��O=B? -L<�= � �?><��-[ !)<��A�<� �IT ��e ��� �5a �td��If3d����F¥��IT��rdF¤�� �3T )4¦��Q��3T )4¦��VQb�<���dF¤ce � ¥��V¦3¦��� � dF¤�� �3T;)8¦��q�% =��� �=���<

!)<�E�<=�?O?��,(�<�><+o� -L<�0���E><�2�<v�4E����B< ����0�2�=�? 0�������� % ?��2�<v�4E����B<>[� � o4<2E�A�=B?>< ��[ � � � 9�< �+2�E�<�< 2��'E�=� ���������B=��<6?��2���� �5E�< � �F��'= ���?C�'F��5E>���F¬3= �A 2�<2?8=� �B<�� 5�+2 ��������<= �A 2�= 0IE��,( �+2�< �B<�0 � (��5E� '= [

� �-�2�� �� /2 % < �*?�������BH �2�= 9 �,0 2�E����B<2?,������4E�����<6?��'? 2��'E�=� �������K����X�'<2E&��=BA2�����B=��<2?��/�2�<�H�<2<�� ��5� �<6A�<6?>?��5E�=�BH -L< ��?&<����+2��5� % �GHI[�w��'E <Oo��,(�F���<

Q <��8e=<�� ��<3d9�b a ��� Q��3T )4¦��_¤��4e��F¤Vd � `Vd���>`VdF¤ � � ' `Vd���eU�IdF¤ ��e=<

� �

Page 78: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<2A��>=����� D=� '= � �� ��=��&� ��< �(<2<�FL<�E

% =��� �=���<¨)�,(�<�

� � o(<�E�A�=�?><��8[ ¬ � ��9'<�+2�< 0�� ��� % = � � 'E�=�� �I<2��A 2 -�� o�=�? � A�<����=�(�<��><�ED?$:����'E>< ��

�5!� : 6�� � � � )��%$ )$8 & 6�� � �! < 2*� �'<�����E�<2� �(H1?&<2<���N=� � ��E �(=�?>A ��?>?>=�� �,0&��= �<�? 2*�5FL<2? � �+2*���u� -�� o(<2?����� 2 -�� o(<2?��5E�<

�,-���<2A!��?D�+2��5� (��GH -L<��U�'<�E+0������ �'E �"��(<2E 0����� [@j���+2�=�?3?><2A!��=��� % < % =��� �����9 �5� �+2�<6?&<�-�� o4<6?=� �-�=��*(%��E>< �(<����5=�� [�s 2�<�H (��GH -L< ?&����A 9'<�� �'E �B=��<�� ��F0��������� % �D���5E�=�<���H%�,0^F���?>=-��=����? 0��'E��><+o4� ���+2�<3F�� �<>[

� 2 -"� o�=�? 0���E+(�<��$-4H �*?&= � XQ$¤3���If�g8h-h+h i8[ E *A�<��2�< (��5�><2E>=���� -*<�� % <2<�W�2�< -�E���A�<2?�2���?-L<�<��F����O=������� 2 -�� o �(=-�O=�? ?&<��)����+A��� ��5� -L< 0���E&�2�<�EO?>F��B=-� �I�+2�=�?*(�<2���?��+2*��� (�����<�E�=B���J�+2��5�( �*?��% � �� ���< ��= �<�A2��$-L<0F�����= ���7�� 2 -"� o ������1=�� % =���8�2�<�\E>< (��'=�W��? ���< �"�=-� �J[¢j%��� ?F���?�?&=)-��B<3���0?>FL<2A�=�0IH��+2�<,?>= ��< �,0��� 2 -"� o�[Ys 2��*?GQ$¤3� �If�d � H S+acg�S���<Vd ��<Vd � �F¥�dI¤��r���If8i % =��� y+z+{c| }J}&~-� Q � � Q>QF�E�� � ��A�<��� 2 -�� o�<+o(��A!� ��H #4�'<�A�<��>=)(�<��><2E�? % ='�(<�A������5= �= � ��+2�< ��H4FL<2?><��O��<Oo4� �>A$���><���? �!0@�+2�<-�� o �8[;j%��� ?�<2��?&H7��� �<��,�� �"��(<2E 0��������'E �U��<�E+0����� -"� o =���2�=�? % �GH>[ � �"��(<�E+0������ -�� o1A2��$-L<� � ��=���<���-4H ��?>= � lQU¤�¥me>¦������!-�?��'E-��2�<3<Oo4�>E���?&F���A�<I[ ! 2�<� �� �(=�(�<��?&=��+=�? '=��'<� �4�� 2 -�� o�=B?0��'E(�<��0�+2��5�O=B? � ��?�� % ='�(<3<��� �� /20����2����'���2�<3<�*A ���?><��0�><Oo4�5[

\4=)(�=���5E �BH���� -�� o4<6? �5E�< 0��'E(�<�� ��?&= � ;Q��F���>f8g8h+h-h i8[ ! 2���� (���9'<2?��2�<2?>< -�� o(<2? = ���<�E�<2?&�>= � �=B?�+2*��� % 2�<�+�@� -�� o0A�������5= �? 2 -�� o(<2?���+2�<6?&< 2 -"� o(<2?��5E�< ?����'A 9'<�� ���<�,-"�U��<O�+2�< �'�+2�<2E ����0?><��O��?� �"�=��-[ \(=�(�=��B�'E(�BH����� 2 -�� o�A����A$�����'=�;� -"� o(<2?�� % 2�=�A 2 % =����-*<�?&<�� = P��E�� % [�\���F�F"�?&< % <��� 9�<�+2�E><2< 2 -�� o(<2? ����0F����O�+2�< (�= P��� -�� o Q��F� �If8g Q$¤3���If�g -���<Vd ��<Vd � �F¥����If %UiQ$¤3���If�g -���<Vd ��<Vd � �F¥����If � iQ$¤3���If�g -���<Vd ��<Vd � �F¥����If �Vi

� �

Page 79: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<2A��>=����� D=� '= � �� ��=��&� ��< �(<2<�FL<�E

i '=��'<6?C�����<���? �,0�-�� o �C�����<���? �,0�-�� o �C�����<���? �,0�-�� o;¬

¨�� % ?���F�F���?>< % < ����9'<3����5�+2�<�EY� -"� o Q��F� �If8g Q$¤3���If�g -���<Vd ��<Vd � �F¥����If ' iQ$¤3���If�g -���<Vd ��<Vd � �F¥����If H ii

s 2�<6?&<�� % �l� -"� o(<6?DA2�� -L<�F��(�3=������� 2 -�� o �J�+2�=�? % =����A�� ��?&<,�+2�< ( ��� -L<�F����'A�<���?&='�(< -4H?>=��(<I[�j� �5�+2�<�E % �'E ��?Q$¤3� �If8gQ �F���If8g Q$¤F���If8g -���<Vd���<3d � �I¥����>f % iQ$¤F���If8g -���<Vd���<3d � �I¥����>f � iQ$¤F���If8g -���<Vd���<3d � �I¥����>f �3iiQ �F���If8g Q$¤F���If8g -���<Vd���<3d � �I¥����>f ' iQ$¤F���If8g -���<Vd���<3d � �I¥����>f H iii '=��'<6?C����><����? �!0�-"� o �C����><����? �!0�-"� o �C����><����? �!0�-"� o;¬ C����><���? �!0 -�� ol«

C����><���? �!0 -�� o �

¨��5�>=�A�<��2����,�+2�<�� % ��� -�� o(<2?��'E><�����= ��<���?����+2*���3�+2�<�-"�'�&���,(�?��5E�< ��<-�'<�� �K����?#���2�<�E�<�=B?,��B=-�>�(�B<�?&F���A�< ��� �+2�< -*< '= "�= � ��!0^<6�'A 2 ��= �<3����+����?���-L<�� % <�<���2�<�� -"� o(<2?-[ � A���������BH��4�2�<3E><6�'?����+2�<2?>< ?>F���A�<2? �'F�F*<6�5E =�? E��5�+2�<2E ?���-��(�B<>[ � ���<6?>? � �B=��< <����? = +��A$���>E���� % �'E � ��+2�<2E>< =�? ��� % �GH(?��?>F��'A�< -*<�� % <2<�P�2�< �B��?��)<��>E�H+= ���< �B=��<�������+2�< #�E�?������<�=�P�2�<��<Oo4� �B= �<>[Gw��'E)�+2�=�?E><6�'?����+2�<�?>F��'A�<�-L<�� % <�<� �2�<�� -�� o(<2?A��,(�<6? 0IE��,( �2�<�<��� �,0��+2�< �B= �<�A$�����'=��=�� 0�+2�<�A ���?>= � -�E��'A�<�!08�+2�< #�E�?���� -"� o�[@\4=)(�=���5E ��H �L�+2�<�?>F��'A�<2?���)�2�<�-*< '= "�= � �!0��2�< �B= �<�=�? A�� ��?&<�� -4H+�+2�<�?>F��'A�<

�U¬

Page 80: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<2A��>=����� D=� '= � �� ��=��&� ��< �(<2<�FL<�E

�&0 ��<�EC�+2�< �'FL<��= � �-�E���A�< �,0��+2�< 2 -"� o�[�s 2�<2?><D?>F���A�<2?CA��� -*< � � ��=��(<���-H ��A��,(�(�<���=�� !� �(� �3�+2�<<��� �,0/�2�< ��= �< �(�+2��5�O=B?�� -4H�F��(�>�>= � �� ��=)(�(�<��(=����><���H��&0 �><2E �+2�<�A����?&= � �-�E��'A�< �,0^�2�<�#�E�?&�L� -"� o�'EO�+2�< ��F*<��= � �-�E��'A�<��,0K�+2�< 2 -�� o�[ j10�H ���+�>E�H0����F��(�?��,(�<v� -�� o4<6? ��� '<��+2�<2EO����P��A�A�='�(<����������H '<��O<Oo4�>E���?>F��'A�< -H 0��'E� '<��&�>= � ����0A��/(�(�<��� ���(�O�2�<�<��� �!0@�+2�< ��= �<��*H ��� � E�< =�� �����A$�,(�F���4HI[\�/(�<���<�E�H0�!-��B<3����+<+o4FL<�E�=B<��A�<���s � � ��?><�E�? 2�� �'< � ���<�+2�<�?��!(�<�+2�= � �

� o��E���?&F*�'A�< �M?>�GH ���<�A�<��>=)(�<���<�E �/A��� -L<�� ���(<�� -4HPF��(�>�>= � P�� QU¤ � 3 e5` %tS+a -L<�� % <�<��+2�<ª� -�� o(<2?-[�s 2�<2H�A����-L<O���B=� ��<���?#��2����K�+2�<C���'F�?��'E>< �B<+�'<�� -4H ��?>=�� /Q��3d��>` =�*?���<2��� �!0 Q��I���Ifc[� ��9= � ��+2�<2?><D� % ��A 2���� '<2?�E�<2?�������? = C����><����? �!0�-"� o �C����><����? �!0�-"� o �C����><����? �!0�-"� o;¬

C����><����? �!0�-"� ol«C����><����? �!0�-"� o �

! <�A2��7A$�,( -�=��<�� -"� o(<2?�� 2 -�� o(<2?��8�4E ����<6? �J���� 2�E ����<6?O���� �<�� -�� o(<��+��<Oo4�-[�! � % (�=� /2� % <A����?&�>E ��A!�D?���A 27� -"� o � E �< % �GH�=�?)������� 9�<3�+2�<�(�����<�E�=B���M��� -*<�-"� o(<�� ���� F��(�D=�� =�7�� 2 -"� oF�E�<2A�<��(<������� 0�������� % <�� -H+�D�E ���B<>[�s 2�<�+F��(� �+2�=�? = P��� -�� o % =��+2 2�E ����<6?O�!-��U�'< ���� -L<��� % =��-[s 2�=�? '=��'<6? ��? Q��F� �If8g Q$¤VT;)4¦ �Q$¤3���If�g3Q��3T;)8¦�� ¤��td��If3d�d �t���t���If��F��Q �3T;)4¦��3iQ$¤VT;)4¦ �i% 2�=�A 2�E><6?�������? =

s 2�< ��<Oo4� ����-L< -"� o(<��s 2�=�?3F�E�� � ��A�<2? -�� o4<�� (��5�><�E�=���� � -��(�3�2�<�E�<�=�? �� (��5E� '= ��5E�� � ��7=��,���� ?���=-� ����9(?��'<2E>H

A�E��!(�FL<�� � �!0�A�����E�?></s � � =B?�� ��?��� '=��4=�� �*? % 2��5� % <��'?$9'<�� 0���E �O[ ! <,A2��P=)(�F�E��U��< �+2�<,?>F���A�= � -4H�F��(�&��=�� ��uQ � d3T;)Vd,���C�+2�< -*< '= "�= � !�,0��+2�< 2 -"� o���� (�� 9�<O=-� � �B=��&�(�B<O��������<2E�������(<2<�FL<�E5[�s 2�=B? '=��'<6? ��? s 2�< ��<Oo4� ����-L< -"� o(<��� � o(<�E�A�=�?&<���[ « ! 24H�=B?�=�� �+2��5� % < % <2E>< 0��'E�A�<�������� ����<Oo4�>E���?>F���A�< �!-��U�'<D���� -*<���� % �2�< �><+o4�-��(� ��5� -L<�0��'E�<3������!0 �><�E =�� �

� «

Page 81: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<2A��>=����� D=� '= � �� ��=��&� ��< �(<2<�FL<�E

� � o(<�E�A�=�?&< ��[ � �D?&<��+2�< (�<��+2�� � �,0 -�� o4= � (��5�><2E>=����C��� F��(���><+o4��A�<��><2E><��W= U� -"� o % 2�=�A 2<Oo4��<����?*0IE��/( �+2�< �B<�0 � �����+2�<3E�= ,2� (��'E� �=� [� � o(<�E�A�=�?><��8[ . B�H�?&����A 9= � �= �< ��=��&� ��< -�� o(<2?�� (�� 9'<�2�< 0�������� % = � �(�� '=�A ?$:����'E><

. � �� � ¬� � «

� � o4<2E�A�=B?>< ��[ � ¨ �'�>=�A�< �2����C�+2�< (�� '=�AO?�:��*�5E�< =���2�<)F�E�<+�4=� ��?�<Oo(<�E�A�=�?&< 2��'?8=��><2E *�����B=��<2?8�+2��5��5E�< � % =�A�<��'? �+2�=�A 9+��? �+2�< � �(��?&='�(< ���<2?-[ � �B?������+2�<2E><3=�?)����=�4H�?&F���A�<��5� �+2�<�= �><2E�?><2A��>=�� �!0K�+2�<= ���<�E ���� �B= �<2?-[�w@=]o ��F0�2�< (�� �=BA ?�:��*�5E�< ?����+2�=�? � �4<2? � � 2��5F�F*<� [� � o(<�E�A�=�?&< ��[ � ! E�=-��< � (��'A�E���Q$� �If3d��IfFd � %Ug8h+h+h i % 2�=�A 2 % =������ 9'<C�+2�<8��<Oo4� -*<�� % <2<���2�< -�E���A�<6?�����F��(�D��-"� o��5E�� �"��0=��-[ªs/<6?��OH � ��E*(��'A�E���-4H (�� 94= � ��FP��?><��><��A�< % =��+2P<+��<�E�H �5�2�<�E % �'E �-�� o4<���[@j�� ( ��'� :���=��>< ?���E�< % 24H ?#�/(�<$���<

% ������� � � �2�=B? ?>=�*A�< �2�< E�<2?������ =�? F�E><��&��H ?���E���� '<I[¨ �'�>< 2�� % �+2�< -*�'?><��B=��<3������2�< -��5�&���,( �!0@�+2�<�?���E�E����"��(= � �-"� o(<2? ����= � [j%��� ? <6�'?>H���� (��U�'<�-"� o(<2? ��F �$� � % � �B<�0 � � ��EE�= ,2����7�2�<�F�� '<>[ � Q �F���IfPA��� -L<�(��U��<��

���+�2�<�E>= ,2� ���<�= �A 2 -4H �*?&= � �Q-a �����ITme �F¤Vd�%�e=<�Q��F���>f8g8h+h-h6i�[Ds � (��U�'<�=�����+�+2�< �B<�0 ������?><Q5a �����V¦��F¥Idc[�\(=�(�=��B�'E(�BH������Q$¤3���If�A2�� -L< (%�U��<�� ��F �'E!� � % ��?>=�� lQ>T�b4e � � �'E.Q3¦��(���>Tc[� � o(<�E�A�=�?&< ��[ � � < % E�=-��<,�2�<ZQU���If3d��>f3d (���A�E���0IE��,( �2�<�F�E><-�4=�����?)<+o(<�E�A�=�?&<�?#���+2��5� ���� �,08�+2�<�><+o4��=B?�����= ��<�� � 2�= � -4H ��<�0N� ���-���2�< �(<�F��+2 �!03�1?���E�����=B?Z¬8[ ��F��'= ��? �J[�s 2�=�? % � ���'� '=��'<��?><��><��A�< �B=9�<��+2�< 0�������� % = � /j�� ( ��5� :���=-��< ?���E�< % 24H ?��,(�<$���< % �����'� � � �+2�=�? ?>=��A�< �+2�<E><6?����-� =�? F�E><��&��H ?���E���� '<I[

j%��� ?^F"�?>?>=)-���<���� #����4�*-"� o % =��+2�<2=-�2�<�EK�� 2�E ���B< �'E % =-�2 � �'��?-[�s 2�<C=��(<6� =�?�������?><ªQ$¤3T;)4¦��F¥4e>¦3¦�'E.QI���IdV¥4e>¦3¦ = +�+2�< 2 -�� oc[Q$¤3� �If�d � H e=<8g � �Id3dme=< �.1IdVbIT3d��F�VQ$¤VT;)4¦ �F¥me>¦I¦�% iQ$¤3� �If�d � H e=<8gA/8¦3¦�-I¤8b>T�b8SUd��>T � � T �3bId�b�<��:1 acb3¦3¦3Q$¤VT )4¦��F¥me$¦3¦ �ViQ$¤3� �If�d � H e=<8g ¤��.1>¤8b$`�� �F¥ ¤�e=< � � d ��S � a �VQ$¤3T;)4¦��F¥4e>¦3¦ %��ViQ$¤3� �If�d � H e=<8gA9 ��5�bIdF¤:/�<3fce �Id � � �IT�� � QU¤VT;)4¦��I¥me>¦3¦ � � i '=��'<6?

� �

Page 82: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<2A��>=����� D=� '= � �� ��=��&� ��< �(<2<�FL<�E

� <��>�>= � l\���5E>�><�� �� ��� C 2��'E���A!��<�E�? � E�<2�5�O�����\ (������ �s 2�<@\ 2*�5FL<��,0 s 2�=�� ?�����A$�,(�< � �¨ � � �5�+2 � �o4=B<���H !O<2E>< � ¬ �

j10qQ$¤3T;)4¦��F¥4e>¦3¦�=B? E�<�F����'A�<�� -4H�QI���IdV¥me>¦F¦ % < '<��� <��>�>= � l\���5E>�><��uh-h+h-hOh+h-h+h+h-h+h-h+h+h+h+h+h-h+h-h+h+h-h+hOh-h+h-h+h+h-h+h-h+hOh-h+h+h-h+h-h+h+h+h+h+h-h+h-h+h+h-h+hOh-h+h-h+h+h-h+h-h+hOh �� ��� C 2��'E���A!��<�E�? � E�<2�5�O�����\ (�������h+h-h+h+h-h+h-hOh+h-h+h+h-h+h-h+h+h+h+h+h-h+h-h+h+h-h+hOh-h+h-h+h+h-h+h-hOh+h-h+h+h-h+h-h+h+h+h �s 2�<@\ 2*�5FL<��,0 s 2�=�� ?�����A$�,(�<vh+h-h+h+h-hOh+h-h+h-h+h+h-h+h-hOh+h-h+h+h-h+h-h+h+h+h+h+h-h+h-h+h+h-hOh+h-h+h-h+h+h-h+h-hOh+h-h+h � �¨ � � �5�+2 � �o4=B<���H !O<2E>< �Fh+h+h+h-hOh+h-h+h-h+h+h-h+h-hOh+h-h+h+h-h+h-h+h+h+h+h+h-h+h-h+h+h-h+hOh-h+h-h+h+h-h+h-h+hOh-h+h+h-h+h-h+h+h-h5¬ �� � o4<2E�A�=B?>< ��[ �-� � ��9'<,� -�� o(<�� 2�<6��� �B= �<,�5F�F*<6�5E)�5�O�+2�<,����F��!0��+2�<�F�� �<3�+2*���D=�?!�B= 9'<3�2�< ���<��?><��+= 0�2�=B? (��������� [

� .

Page 83: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

����������� ���� �� � ���� � ������� � �

!)<�E�<=�?O� �B=B?&� �!0^�+2�<�A$���>E���� % �'E ��? '=��'<�0= ��2�=�?*(��������� [ j10@H � � % ��� (���E>< �(<����5=��M�!-�� ����+2�<2?>< % ��E ��?C�2����=�? '=��'<� 2�<2E>< ��A 2�<2A 9��2�<3= ��(<Oo �!0 � �� � � � %�%���[

C����>E����M?>H ( -�����?

Q�� ' Q � � ' Q���% % Q���% %Q � � ' Q�� % % Q ��%� Q � � 'Q"� % % Q � � ' Q�� % � Q3^ Q � Q� % � Q3g�% � Q3i�% �Q % � Q ��% % Q� % � Q % �Q$% ' �C����>E���� % �'E ��?

QA/ / % � QFb3b�% � QFb8S�)Vd����� QA/ = % �QFb��% � QFbV¦ �>`3¤ ��� QFbV¦U`3¤8b�� H QFb�<�8¦������QFb>`F`VT �If ��� QFbIT4S3S�� � ' % QFbIT4S � e=< ' % QFbIT4SUd�b�< ' %QFbIT�� ' % QFb � d � Q$� % � Q$�8b�S 3 � ¦Fb � ¤ ���Q$�8b>T � Q$�8b � �V¦8e=<�� � 3 e5` ��� Q$���>d�b � H Q$��¥ %�Q$��e���8¦ ' � Q*+�e���8¦ ' � Q$��e���3T ' � Q*+�e���3T ' �Q$��e��8¦ ' � Q*+�e��8¦ ' � Q$��e��3T ' � Q*+�e��3T ' �Q$��e�� � 3 e5` � Q$�VT �3b 3 � Q$�VT �������� Q$� )8¦3¦��Id ��Q$�� � ' Q�S�% � Q�S>b$` � Q�S$���Id ��Q�S�� <Vd��IT8¦�e=<�� � Q�S�� <Vd3T��V¦�e=<�� � Q�S ¤��8S 3 �� Q�S ¤ce � HQ�SVe5TmS � H Q�S��3¦*)>a�< �(' � Q�S�� � ' % Q�S�� � ¤ ' %Q�S��>d ' % Q�S��>dF¤ ' % Q�S � S ' % Q�S4)F` � QI� % � QI�3�3b � � � QI�3���Id �� QI� �I¥ H;HQI� ��� ' % QI� �3¦>d�b�� H Q ���3¦>d�b�� H QI� �>d ' %QI�meUb a ��<����� QI�meJa ' % QI�me=� � QI���>d � QI���>dV¥me>¦3¦ ' � QI���>d � % ' QI�����<8bIT3T��(� ' % Q � ���<8bIT3T��(� ' %Q������8SUd �3� Q��V¦F¦ � � Q���<V�me=< � �>T3d � Q��>` � e>¦���< � HQ���;3bV¦8e ��< ' H Q���;3bV¦8e ��<�<�� ' Q���;�<�� ' Q���;A)�e � ���Q��IdVb � H Q��Ifme � d � ��� Q��IfI` ' % QI¥�¦IbId ���QI¥��3¦8e � � � QI¥�� <Vd %� QI¥����Id8¦8e=<�� � � QI¥����Id�<��Id � � �

� �

Page 84: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E�� ���/[ \c[L?&FL<�����= � �� \4<6A!��=��� �5� �C�����E�� � % �'E ���B=�?��

QI¥��>T�bV¦3¦���� Q���b5a3acb�� H Q � b5a3acb�� H Q��mSU� ' %Q�����; � � Q��3TVb������� Q � % � Q$¤8b3¦8e ��< H %Q$¤8b < � � � Q$¤8b < ��bF¥Fd �IT � � Q$¤8b < �ce=<����<Vd � � Q$¤8b>d � Q$¤3��bF��<�� ��� � � Q$¤3� �If � � Q$¤��FbF��¦8e=<�� � � Q$¤�¥4e>¦ � �Q$¤�¥4e>¦3¦ � Q$¤�¥A) � � � Q$¤��I¥3¥ � �Id �3� Q$¤��5a ' %Q$¤VT )4¦���� % Q$¤VT )4¦��F¥me$¦3¦ ' � Q$¤ � e � �3� Q$¤ �43 e5` � �Q$¤�I`3¤���<8b>dce ��<�� � Q8e % % Q%?Oa ��� Q8e=< ���Q8e=<V¥ ' % Q8e=<V¥Fd � ��� Q8e=<F` )Vd �� Q8e=<3d � �Q8e �>d�b � H Q8e d %� Q8e d � a � ' Q8e d � a�e d��5a � 'Q � % % Q 3 b$`3`8b�� H Q 3 �>T ' % Q � % �Q3¦�% � Q3¦Fb5a8���Vb�� H Q �Vb5a8���Vb�� H Q3¦Fb < �8¦�� ' %Q3¦�S �4e>¦ ' % Q3¦��I¥Fd ' ' Q3¦��I¥Fd8¦8e=<�� � Q3¦��I¥Fd � 3 e-` � �Q3¦���; � � Q3¦���;VbV¦8e ��<�<�� ' Q3¦���;�<�� ' Q3¦��>d %Q3¦I¥V¦����IT ' % Q3¦�� ' % Q3¦8eJa � � Q3¦8eJa�e=<�¥ ' %Q3¦8eJa � )3` ' % Q3¦8e�<�� � Q3¦ < ' % Q3¦���� ' %Q3¦�����IT � H Q5acb���<�eU¥meIS>bIdce � < � % Q5acb�� � d��>`�%� Q5acb>d3Tce f ' 'Q5acb>f ' % Q5a �I� � 3 e5` � Q5a�e�< ' % Q5a �����V¦��F¥Id � HQ5a �����ITce �I¤Vd�� H Q5a%) � H Q <8b$�4¦Fb���� Q <8b>T3T �(���>T � �Q <8b>d;)VT�bV¦ ��� Q <���� � � Q <�e ��� Q <��FbV¦8e ��< H �Q <��8e=<�� ��<3d ��� Q <��$`8b ����<;)>a8���IT � H Q <��>d � Q < ) � HQ 6�% � Q�� % � Q��F���Id �� Q 6A= % �Q����% � Q��F¥F¥me=<Vd��>T8¦8e=<�� � 3 e-` H � Q�� a � ��b�� H Q 65a � ��b�� HQ�� a e=< ) � �� Q��>`8¦*) � �� Q��IdmeOa � � �� Q���� �IT ���Q���� �ITV¥ )4¦F¦>T;)4¦�� � � Q���� �IT8¦8e=<������ QA< � � Q$`8b�����<�� � �Q$`8b>T � Q$`8b>T�bV¦3¦��3¦ ��� Q$`8b>Tce=<�� � <Vd � � Q$`8b>T � ¤8b>`�� � 'Q$`8b>T � 3 e5` ��� Q$`8b>T3dce$bV¦ ��� Q$`��>TF` ��� Q$`3¤ce � HQA<F¤ce � H Q$`�e � H QA<ce � H Q$`>ambId3Tce f ' �QA<3T ' % Q$`VT��8SI¦Fb4eJa ' � Q$` � e � H QA< � e � HQ�;�;A)8bF� � ' Q�; )�bF� � ' Q>T�b�����F�FTme �F¤Vd � � Q>T�b8e � ��� HQ>T�b < �8¦�� ' % Q>TmS �4e>¦ ' % Q �� ��� Q>TV¥V¦����IT ' %Q>TF¤ � � H Q>Tce��F¤Vd ' ' Q>Tce��F¤Vd8¦8e�<�� � Q>Tce��F¤Vd � 3 e5` � �Q>T$a %� Q>T ���Id ��� Q;1 � � � S>b3¦��F��%�Q � ��S ' % Q � �>d3d�b>� �(' � Q � ¤�bITF` ��� Q � e��$acb�� HQ;14e��$acb�� H Q � eJa � � Q � eJa ��; ��� Q � e�< ' %Q � e�<3¤ ' % Q � ¦ %� Q � ambV¦3¦ � 3 e5` � Q � ;IT ���Id ���Q ��� % � Q � dVbIT �� Q � dFT;)Vd H � Q � )F� � �Id ���Q � )F� � �Id���;���� Q � )$a � � Q � )F` ' % Q � )F` � �Id ���Q � )F` � �Id���;���� Q � )3TV� ��� Q>d % � Q>d�b < ' %Q>d�b <3¤ ' % Q>d�b*) � H Q>d�� < � �IT � Q � � HQ>d�� < � �IT � Q>dF¤�� � � Q>dF¤��Id�b�� H Q ¤��Id�b�� HQ>dce$¦I� ���� Q>dceJa � � �� Q>d �3¦��IT�b�<mS�� � � Q>d �$`�e=< � �>T3d � Q>d3d %� Q*) % � Q*)�<V� �ITF�8b>T ��� Q*)�<V� �IT8¦8e�<�� ���

� �

Page 85: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<6A!��=��� �5� �C�����E�� � % �'E ���B=�?��

Q*)3`�bIT3T �(� ' % Q �V`�bIT3T �(� ' % Q*)3`V���(��<8b>T3T �(� ' % Q �V`V���(��<8b>T3T �(� ' %Q*)3` � e>¦���< � H Q �V` � e>¦���< � H Q�� % � Q���b>T��>` � e$¦���< � HQ���b>TF`3¤�e � H Q���b>T3TF¤���� H Q���b>T � e �$amb�� H Q���b>T3dF¤��IdVb�� HQ��F��bF��<�� ��� � � Q��F� �If � % Q�����S�� Q������ � Q��V¥4e>¦3¦ �3� Q����¦*)�� � H Q�� �I¥3¥ � �Id �3� Q��3T )4¦���� %Q�� � e � �3� Q��3d��>` � ' Q���I�������� Q��e � �>¤8bId���Q��e � �Idce>¦>� � �� Q>fce � H Q � e � H Q� �>d�b � H

� �

Page 86: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

����������� � �� � � ��� � � � � � � ��� � ���� �D��� �

� ��4H!�!0L�+2�<O<Oo(<�E�A�=�?><2?KA����-L<)���? % <�E�<���= �?&<-�'<�E���� % �GH(?+[�j10JH � � ��= 9'< H � ��E % �GH -L<��>�><�E8�+2����+2�< % �GH �=���<� -*<���� % � -4H������(�<6���? ��?><3=�� �

?D¦8e 3 �ZQ � � �6 <cS � � �A) ���IdZdF¤���¤8b�< � �F¥Me d��AQ � � g3iZe � T��3bV¦3¦� �3b � �Wd�� ) � �q�� �A) �*) � du¤8b�� �Dd �/acb � d��>TudF¤��lQ � � <�eFS>bV¦ub � `��8SUd � �j ��= 9'<vs � � � E �A�<H � � '<����2�< 2���� ��!0K=-� �8s � � =�? E�<2�����BH�<2�'?>H���� �*?&<I[ � � � � ��?�� 2�� �'<D����(��'? ��><2E �+2�</s������=BA2���M�'?>FL<2A!��?+[� �� � QA/ = � S ¤ �8¦*) � )�<�� �IT � d�b�<��uQ 6A=Z�me5`;) � � �<6?��P?�A 2H�� ��? �"��(<2E�?&�������� ��=�F��*? �

¤�� � acbV¦3¦�� � d�e=<Vd �IT�<8bV¦�)�<�e d �I¥�Q � � g3iZe � b>���A)Vd H �q���VQ*/ /ª�s 2�<�?+(�������<6?�� = ���<�E ����� �=-� �,0 s � � =B? �,-"���(� �$¬8[ .I¬�� [ ¤��(�Wd ��� 3 � �5a ��¤���<��(�lb�<��D`4¦�� <Vd � �F¥@a � <��"� �VT�b$`3`��F� )3`¢e=<�b;gFQ8e d;Q3^3i H <��Id��q�s 2�<2H������9+?#�/(�< 2����<2H0�����F��B<���H��,0 (����<�H % E��5F�FL<�� ��F+= ��� � ��'�><>[Q���=�¦3Q � ��� � � � T��F¥ ) � �� � � � ¦ �VQ�SWS���< � � ���Id �� � � � S ¤�bVQ $Q8e <�� � �"� � �<-�'<2?��E>< 0���?&<���� ��?��B<��A$���? � �'<��><��G� ��? A 2�� � ���<2? �� bVQ � � d �Dd�b 3 ��`��V¦Fb 3 ��`�e ��Id �WQ��MS>b�� ��J���?�������� 9 ��F������ 9 ��F�= ��<���<��A�� � �

�>�

Page 87: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<6A!�>=�� � � Yj �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

5��4e�< ���e � dW¤��8e>Q ��� ��P<2=�Ms^<�< =B?&� 2�<2=��4[<��A)3d8�3Q �>d3T�� ; )��+e>¦@`3T8Q�� �F¥VQ � �IT���¦���S>bF¥VQ�� � �8¦Ib8SIQ�� ���GK< ��� � �<���E>< :�� � =��MF�E�"<�0 �<�E�<&�B<�A��&0�"< �B��A "<I[� < �>T ; ) ��� � < �����>��� � �me=<����4¦Fb <cS�� ��� < �IT�;A)�� � � d ���(bWb��me=<8b �3TVbF��� �� G �'E5:����� < ���-*< -*<6?L�4= ���-��B���A����� G ��E�:���<D<2?&�� � ��� �4=�*� 'E��������58Q��(Q8e>Q��HQ � <¢eU� ��3Q�� ��< � �ITV�Fd <ce �Idu���VQ �UQ8e <���¦���F� ���"��"� �=��(<2< �<� % �'E �4� �=B<�� -L<�� � 3�����4<�� [-Vb�< ���A)ld�b 3 �WbW¥ �ITFT �Z¥FT � a�Q � 63¦Fb�<V�Dd �ZQA/ /�¦Fb <�� �C���+H ���0��� 9�< ��0I<2E>E�H 0IE��,( �E ������0��� �� �B���� �

Q�� )VT 3 Q�S�S�� 3 ��< )8Q�S � b�< ���3Q*) ����<4¦ �IT <8b � e>¦3¦FbIT �s����E�9 �A�< 9 ���� �?>��0H'<�� '<����<2E$��'?>=�����5E �? ��<Vd��>T��F�DdF¤��DT ��� aMb�<V���3�3�$¤ �IT3T �IT � �3�3�%? � b(�Z���IdF¤�a �Z¥3bIdF¤��IT��8e=<4�3¦Ib(�Wb <��/a �a �IdI¤��IT8�8e�<4�3¦Fb(�ª�j�<��><2E><����2�<3E���/( ���� " 2���E>E��'E�? " j�?�� % -��5�+2 (�H 0N���2�<�E$�Y= �� �B� % ���� (,H (%�'�+2�<2E �%= �� ��� % [ ¤�� �ce=<Vd��IT �I¥ % ' � ' �F� % ' � H �8b � ��<�� �I¥l�4e � S���<3d���<Vdª�s 2�< % = �><�E �,0 � « � « � « � � % ��?����< �!0��(=�?>A$���><���5[� e � ���6dF¤��A)�F¤VdV¥ )8¦ <�� ��� � � �8b � eOa�`VT�� ��� e ���q�!O=�?��&�+2����� ,2� 0������<6?>? � % ��? =�(�F�E�<2?�?&=��'<I[

���

Page 88: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<6A!�>=�� � � Yj �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

! T�b < 3 ����<���IT��F��� ���? � dI¤�e � b �ce T8¦�dI¤8bId�S>b�<��6d � b"� ��9�� � � � � �w�E����9 % ����(<2E><�� ���6j�?��+2�=B?O�% �=�E �J�+2��5�)A��� � �)?��GH�� ¨ ��� � � �� �udF¤��*) �F¤Vd � ���HQI���Id � b�<V�udF¤�e � � ��� � ��<;¥��IT������IT ��`��ITF¤8b>` � d �udF¤��l¦Fb � dWT��8S��>TV� �F�� �8¦F¦Fb>�4¦���� � �!O< �2�� �� ,2��� �-h+h+h>������+2�=B? �4<2?��� 0��'E�<+��<�E �4F*<2E+2��'F�?������2�< �B��?�� E�<2A$�'E �(<��+?&H����B�,-��B<>[ �� b�� � � �A) � �� < 5 � � ����<�� � �!)� ��< H � �+?&<2<� � ?-[�� ���<2? �<3T �I¥ � *1 a e dF¤ub�<�� �3Tª� � �V¦I��¥�¦��(�l¥FT�� a� bV¦�eU¥VbIf 9 � *1q��d���5���<Vd3T8Q � �3bV¦ � <ª� *7�� �ce$b 5 � <cSUd ��< ��9ª� �+ª�G�E��!01[8\ (�=��+2P���� )E5[ � ���'�;¡�< % 0IE��/( !)����=�0N�Uo�¨/[4\c[���� ������E�"<6��� � G [!F�[V�=�� ����*A!���� �8¨@[%BG[Q3¦8e�<��Vg3¦��I¥Fd ��<V�lQ$¤�¥me>¦W¦ �F¥FdWd�b8S 3 ¦��WQ$¤V¥me>¦u¦��I¥Fd �;)8bIT3�lQ$¤�¥me>¦lS ��<Vd��IT�Q$¤�¥me>¦Tce �I¤Vd �;)8bIT3�ZQ$¤�¥me$¦�Tce �F¤VdDd�b8S 3 ¦ �ZQ$¤�¥me>¦/Tce �F¤Vd � <���i�B<�0 �O<��� �B<�0 � ���'A 9��B< �B<�0 � ����5E � A�<��><2E E>= ,2� ���'E � E�=� /2�������A 9���< E�=� /2�� <���

Q3¦8e�<��Vg3¦��I¥FdZQ$¤V¥me>¦uQ$¤V¥me>¦�Tce �I¤Vd8��S�� <Vd��IT8QU¤�¥me$¦.Tme �F¤Vd8i�B<�0 � E>= ,2�$�%A�<��><2E E�= ,2�

Q3¦8e�<��Vg3Q$¤ � 3 e5` %ue=< 6A9 =;Q$¤�¥4e>¦ �!6WQ$¤V¥me>¦ � ;= =8iE ¨ � s ! E s ! � � �

e>gI¥ViI¥�eU¥�g3i>¥�eU¥�gI¥Vi=�0�0@=�0�0�=30�0

� �

Page 89: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������@[ \c[L?&FL<����B=�� �� \4<6A!�>=�� � � Yj �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

? � d�bITFd��F� ��e5dF¤ZT � acb <Zd �F`��Zg3Q�e d � ��e d4S ¤��F�@d ��e d�bV¦8eISvd �F`��3i �ªb�<��T��Id )VT�<��F�@d �uT � acb <Zd �F`��q�j ?����5E>�><�� % =��+2�E��/(������H4FL<���������� �������������������������� �������E><�����E �<��0����E��,(������H4F*<��

^ - #7< � � ' � < � � #!� � " ��# <4�#� ' � '>^X � � �!$ � � � ��% ��$� � ���&$ ��� �

^Fb��>� �('I�I���Ff ��"� �� �^^3^Fb"�I� �('I�>� �Ff ��(� �� V^F^� ��� ���ª�X� � � � ���)% � � ��� ���ª�X� � � � ���)% �^ #(¥ � ' � �Z¥ � � �Z¥����(^^3^ #&¥�� ' � �Z¥ � � �;¥�� �H^3^� �(* �,+ � �-+.*�� �(*/+

� �(* � + � � + *v� �(* +

^ " b3¦$`3¤8b " ���Id�b�� " ��b5aFacb"� " � �3¦$d�b3^^3^ " bV¦$`3¤8b " ���Id�b"� " �Vb5a3amb�� " ��3¦>dVbV^I^ � � � �

� � � � ^ " � b a3acb #7< ' ��# <4� %"' � ^^3^ "�� b a3acb # < ' ��#7<4� %"' � ^3^0 � � � � � ��� � ���

0�� � � � � ��� � ���

� ¬

Page 90: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������ � � �L?&FL<����B=�� �� � <6A!�>=�� � � Yj �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

^>f " ���F����� #�� " � �� ' ��#&f " ���I����� � ' " ���� #&f " ���F����� '>^��� � ��� � � � � ��� � ��� � ��� � �^ � � ' � �� " '$���Id � � � < � < #7< � %"'>^�L� «.��.A� ����� � ���� � � �l� � �

^ " � ��'/f " '$���Id " ��� ' � � � ^�eU¥lb�<V� ��<4¦(�MeU¥;^ " ����'/f " `����I` " ����' �8^���� � �� � � =�0K���� ����BH0=�0 �� ��-�

^ " � ��'/f " '$���Id " ��� ' � " <��Id� � ^�eU¥Zb <�� ��<4¦(�MeU¥;^ " ����'vf " <��>d " `����I` " ��� ' �8^���� � ����� � =�0K���� ����BH0=�0 �� � ��-�

^ # " ¥�����bV¦F¦/f " e�< " �� ' # " �Ifce � d � � " e=< " � '>^D^���>f8^���� ����� � ��� � ��� � ��� � �

^3gFb"�I� " ��� ��� 'Ii " ; )8bF�ugFb " �������D� ��'Ii " ; )�bF�Wg % " �������Wb��I� �('>i " <��Id �lg % " ��� ���WbVi(�g % " �������D�8i"��g % " ������� 'Ii3^��"�� $� "$ � �

"�� $ � � ���

"� � $x� �

� �

�3¤8b>dlb����DdF¤��D`��8e=<Vd � �F¤������Z^3g " `8b��3dme$bV¦ " ������� " `8b��3dceUbV¦/f8iu¥ #6f ��� ' �;g " `8b��3dceUbV¦ " �������" `8b#�3dce$bV¦ �8iu¥ #&f ��� ' � � ^ �! 2��5�)�5E�<D�2�< F"��=���? % 2�<�E�<����� � � � ��� � ������ � � � ��� � � � �^�� -f " ; )8bF� � $g3�>f8i " ; )8bF� � $g8e " `�e>i"� % � ��" ; )8bF�uf � � " ; )8bF�uf!� � �" ; )�bF�lg>f � � i ��" ; )8bF� � Ug>f 5f8iF^��� � �#" � �%$'&/� � � � � � �

�� � �� � �%( �

� «

Page 91: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������ � � �L?&FL<����B=�� �� � <6A!�>=�� � � Yj �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

^ " <�b>�4¦Fb � ¥ #&f���� ' �;g " `�b��3dce$b3¦ � ¥ " ������� " `�b��3dce$b3¦�f � i"�lg " `8b��3dceUbV¦ � ¥ " �������" `8b#�3dce$bV¦ � � iF^��� � � � � ��� � � �������� � � ������ � � �

� " ¦�e�� �3g>f " � � i #&% �Ff ' $g % " �������/f8i"� � � ��B=�( ���� � � � � ���( � � �

¤�� '����V���=<��V¦�� � �F¥ � #J� " �=<�¥ � � " ��<�¥ � ' � � � � " �3¦���3¤ � % � �s 2�<�A2�5E �(=�*���B=-��H �,0 �6��� ��� �C=�?����

� " ¦���� �3g� " ��g � &��iFi�� �� � % � ��B=�( ���� �� � � � � �

� " ��< � � % � � � " �&�!� � % � �� � ¬ � � � � � � �

� " � ; � �� " ; )��F� " � ; � g� ��� " ��� ���"�8��8i " ; )��I� " � ��� � " �F¥;g % � i � " ; )��F� � � $g " � ; � ��i � �# � $ � � �� " � %# �-� �'& � �

� " %(� " % � " � ;�� g� " '$��� �8i � �) � ) � # � � � �� " �F¤*� # ' ��g % " ������� " � ; � g � " �*�>iFi " ��< � � � $gF�� � � � i " �&� � � �+ � � � � �& � & �-, � " ����.

� � � �

� �

Page 92: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

� s���� =��>E������ � � �L?&FL<����B=�� �� � <6A!�>=�� � � Yj �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

� " )�<�� ���8¦��=<�� � " ; )��F� " �������8¦���<�� � " ; )��F� " )�<�����8¦��=<��Vg " ��� ����¦���<��Vg'��"�8iIi � �� � � � � �� " � � �8¦ " ¦ '�� �>¦ " ¦I¥�¦����#� � " �V¥�¦������ " �*���/� " � '����>¦ " ¦���; " �*� �8¦ " ¦I¥�¦����#� " ¦ ' � �>¦ � " � '����>¦" �*���/� " �V¥�¦������ � ���� ��������� �� �� �

� " � �=< # � "� ¤�� � ' � � " � �=< " ¤�� � " '�� � " ¤�� �" ; )��F� " '�� � # � " ¤�� � ' � � " '�� � � " ¤�� �@� % � �?>=� � � * � � ��?>=� * A$��? * A��? � � * � � ��A��? � * � � �

� � " �=< " ' � ' � � " �q�!� �;� " ' � �� -" ;�;A)��F� " ¦���� �3g " �V¦��3¤�� " � � iWg " � �=< " �V¦'�3¤�� " ������� " �V¦��3¤��3i � %" ;�;A)��F� " ¦���� �3g " �V¦��3¤�� " � " �=<�¥ �8iDg " � �=< " �V¦��3¤�� " �����#� " �V¦��F¤��Vi � � � �!�

� A�?�A � � � � ���PA��5� � �\X �B=�(� �� ?&=

� � ��=)(� ���?&=

� ���

� � "� ��< # �/" ¤�� � ' ��� � " ��< " ¤�� � " ������� %U� " ��< � " ¤�� ����� � ����� � � * � � �K���� *

� ������ � * �

" � ����'I¦!� ��� ¤���������� #�=;)-'I¦�� � '�� ¤������ � � � � � < ��<�¥��=<*� � < )��8����� �I¥ �/� ��� � � �� �� %���� ��� ����) � (���� # � � ��� �"!�# � � !"$#)"���"�#��1� "&%!�(' � � �������"#�� � �*)

� .

Page 93: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

��� ��� =��>E������ � � �L?&FL<����B=�� �� � <6A!�>=�� � � �� �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

" � ����'I¦!� ����</� ����� � � � ��< %��� " ����� < " �F¥$� " � � ���!� ��� � % ��< � ��� � " ¦ ��;� % " ��� ��� < � " � )�� � ��� � % � �< � ��� � � � ¤ ��; )��V¦�� � �U¥ ��<�� ��<4¦� �U¥ � � � % � " '��� � � � � < � � ��% � % �!� !� %'��� �� � ���$�� �� $ � ���� �$�� �

� $�� #�� � ����%/&� #����$#�� &"����&"�� �(#�� ��� ����� � � � )

� � ?#� ' � " ���� � �����% ��� ��� ��� " ' �� � % ��� ��� " ' �� ��� � % ��� " ' �� ��� ��� � % " ' ��� � �

� � ���� � � � �� � � �� � � �� � � �

� ��

� � % � % � " ¦��I¥ �" � " � � �������� � � " � ��� " ' � � � � " ¦��!� " ' ��� " ��� �F¤ � � �" � " �$# � �&% �� � � � �

" � � �(' � " � " ¤ � 3 ��� � �=< � " ¤ � 3 ���)�� H �=< � " ¤ � 3 ��� %�' � � " ' �" � � <8¦ )� � � " ¤�¥��>¦3¦ " � % �*� ��� " ' �" � � -��I¥3¥ �� � " ¤�¥��>¦F¦ % �*�� � " ' �" � � � ����<��V¦!� � " ¤�¥ �>¦3¦ % �+���� " ' �" � � 5;) � ¤ � ����� � � �*� � " ' �" � ���(,�� �*�v¥ � )*� � � �*� ��� " ' �" � ��� 6�����< ��� �A)*� ' ��� � " ¤V¥��>¦3¦ % �*�-��� " ' �" � � )�<�� � " ¤V¥��>¦3¦ % �*� � � " ' �" � � � ) '/' ¤*�=< ��� �*� ' " ' �" � � � ������ � � " ¤�¥��>¦F¦ % �*� � " ' �" � ���;1�� � 3 ����'���F¥�� � �+�� H " ' �

� �

Page 94: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

��� ��� =��>E������ � � �L?&FL<����B=�� �� � <6A!�>=�� � � �� �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

" � �;+ ����'/'��V¦���� " ¤V¥��>¦3¦ " )�<�� ��� '������ "�" %��� " )�< � ����'��#��� �-��� � " ' �" � � � �V¦ � " ¤�¥��>¦3¦ " � % � �+� H H " ' �

G � ��(�? � � � ���C��$©J<�< � � � �� E����� �B� � � � �� ��?+2�E���,(�? � .>¬� = % =�0IE���=�� � ¬��E E���� �< � ��=�A�< � � � �� �"�� � � � �� ��A2A 2�= �= � .$«� E��5FL<2? � � .��� (���9�<�� -*<2<�0 � � �B�E��(A2A����B= � � � �� �5����� � � � � ���

" � � �(' � " � " ¤ � 3 ��� ' � H �=< � " ' �" � � � �=<��1 �#� ��� " ��� ¥��$¦3¦ � % " ' �" �;/�¦3¦ -I¤�������' ��� � � � � � ��<�� 1�� �V¦3¦ " ��� ¥��>¦F¦ ��� " ' �� <��>�>= � � ���5E>�><�� ����������� ������������������� ������������������������������������� ������������������� ������������������������ ��� C 2��'E���A!��<�E�? � E�<2�5�O���� � (������ ��������� ������������������� ������������������� ������������������� ����������� �" � � �(' � " � " ¤ � 3 ��� %#' ��� " ¤ � 3 ��� %�' � � " ¤ � 3 � � %�' � � " ' �" � ������� � �I¤ � �=<" ��' � ���" ¤ � )4¦�� �*� � ¤ � ' �" � " �/� )4¦��@¤���� �F¤ %�' � � " �/�;)8¦��@¤�� ���F¤ %�' � � " �/�;)8¦��@¤�� ���F¤ %�' �� " �/�;)8¦��@¤�� ���F¤ %�' � " ' �" ¤ � )4¦�� �*� � ¤ � ' �" � " �/� )4¦��@¤���� �F¤ %�' � � " �/�;)8¦��@¤�� ���F¤ %�' � � " �/�;)8¦��@¤�� ���F¤ %�' �� " �/�;)8¦��@¤�� ���F¤ %�' � " ' �" ¤ � )4¦�� �*� � ¤ � ' �" � " �/� )4¦��@¤���� �F¤ %�' � � " �/�;)8¦��@¤�� ���F¤ %�' � � " �/�;)8¦��@¤�� ���F¤ %�' �� " �/�;)8¦��@¤�� ���F¤ %�' � " ' �" ¤ � )4¦�� �*� � ¤ � ' �

� �

Page 95: A Gentle Introduction to T)X A Manual for Self-study Michael Doob

��� ��� =��>E������ � � �L?&FL<����B=�� �� � <6A!�>=�� � � �� �<�� -4H % =��+2P� ��=��&� ��< 2�<���F

" � �I¥ " '�� � � � � % � �" ��' � ��� �" ¤ � )4¦��" ¤ ' � ��� " � �;) �" �/�;)8¦���� ��� % " �/�;)4¦ ��� �" ¤ � )4¦��� ��" � ������� � �I¤ � �=< " ��' � ��� " �I¥3¥��=< ����¦���<�� ��3 ���" ¤ ' � ��� " ' � � � � � � " ' � � �� � % � " '���� � � � ��� �" ¤ ' � ��� " ' � � � � � � � " ' � � �� � H � " '���� � � � � � �" ¤ ' � ��� " ' � � � � � � � " ' � � �� � ��� " '���� � � � ' � ��

. � �� � ¬� � «

��������� �������� ��� ������������ ������������� �� �"!���# � � $ ��,��-

% ��&� � � � '(�

� �