an introduction to hidden markov models and bayesian networks

25

Upload: vubao

Post on 27-Jan-2017

226 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: An Introduction to Hidden Markov Models and Bayesian Networks

����������� ���������������������������� �!��"#%$&�' ���)(+*��,�-�/.0��12�)*3�4�,�657�8�:9;#��"<*

=?>A@BDCFEHGJI8KLIDM4KLNOKLEDCGPK:Q4R4BTSHU2>ANWVD@QXK:QXCY>AE8KLZ?[�\]@M4>AR_^]CF\`ED^]\ba�ECYQ

acEDCYdL\]M4R_CYQ+SHU2>LZFZF\`eA\Pf%>AEDgD>LEf%>AEDg>AEihjU�kl[nmLo�prq8s�EDeLZtKLEDg

u3v�vTw<x4y�y{z�z�z<|~}��Lv�������|�������|���!|����8yL���8�����)����y�D���3�)����T}�Lv��l���2|����T��|���!|��3�

�_���������~�����`�:� �T� �t¡4¢X¢]£4¤P¥_�W¦���§4��¨_©4ª`«�§��4¨��W§�¨r¬���©X©�­_� ®��_�_¯`¨�°±®�¨_©�­�²X³±����© ´���µ�­�³X�4���·¶�­4§4¸�¨��_¯]³L��¹_º�»X¼+½4º�¾�»X¿�À�º�¾lÁ À�ÃX½4º�¾lÁ-À�ÄbÅ�¾�»X»X¼~½4ºJÆL¼_Ç_À+È�º�¿X»4¿�À�ºÉ¾�º�Ê�Ë]½]»X¿ÌÄ:¿�Ç�¿�¾lÁ�¹4º]»X¼`ÁXÁ�¿ÍÈ�¼~º`Ç�¼�ÎÐÏ�Ñ��£4¤{ÒYÓ�Ô_Õ�¡A�

ÖØ×AÙ~Ú~Û�Ü�Ý4ÚÞ�ß�à`áÌâ�ã�äæå�ß?çéèÌê�èÌâ_áÌäëç_ìlâ_í�ìëß~ç�áÌí]äîí`ï!ç�í�å�äîí`ðñß�áÌß~í]ò~ß�äîí#ó]äëå]å�ß~íØô<ç�áÌõXâ�ã�ö�â�å�ß~ìî÷äîí�èÌó]ß�ò~â_í�èÌß�ø�è�â_ð{èÌó]ß�áÌß~ò~ß�í�èìîäùèÌß�áÍç�èÌê`áÌß2â_írúDç~û�ß~÷üäëç_írí]ß�èYýDâ�áÌõ�÷~þ-ÿDó]äî÷�àlß�áÌ÷üàlß�ò�èÌäîãXß�ö#ç�õXß~÷,äîè!àlâ4÷ü÷üä��]ìîß2èÌâ ò~â_í]÷üäëå`ß�á�í]â�ãXß~ìï4ß~í`ß�áÍç_ìîä��+ç�èÌäîâ_í]÷â�ð�ó]äëå]å�ß~íPô<ç�áÌõ4â�ã�ö�â�å`ß~ìî÷ ý�äîèÌóPö,ê]ìùèÌäîà]ìîß#ó]äëå]å�ß~í-÷tèÍç�èÌßØã_ç�áÌäëç��`ìëß�÷��ö,ê]ìùèÌäî÷üò+ç_ìîß�áÌß~à`áÌß�÷üß~í�èÍç�èÌäîâ4í`÷��Dç�í�å-ö�äùø�ß+åå�äî÷üò�áÌß�èÌßDç�í�å ò~â4í�èÌäîí�ê]â_ê]÷Aã_ç�áÌäëç��`ìîß~÷~þ��)ìùèÌó`â4ê]ï_ó,ß�ø]ç�ò�èTäîí`ð ß�áÌß~í`ò~ßDäîí èÌó`ß~÷üßDï_ß~í]ß�áÍç�ìîä��~ç�èÌäîâ4í`÷3äî÷Tê`÷üê�ç_ìîìùû äîí�èüáÍç_ò�èÍç�]ìîß�â_í]ß%ò+ç�í ê]÷üß ç_à`à`áÌâ+ø�äîö#ç�èÌß%äîí`ð ß�áÌß~í]ò�ß,ç�ìîï4â_áÌäùèÌó`ö�÷)÷üê`ò�ó ç�÷éô<ç�áÌõXâ�ã�òÍó�ç�äëí ÷Ìç�ö�à]ìîäîí]ï#ç�í�å2ã_ç�áÌäëç�èÌäîâ_í�ç_ìLö�ß�èÌó]â�å�÷~þÞ�ßDò~â_í]ò~ìîê�å�ß8èÌó]äî÷TáÌß~ã�äëß�ýbý�äùèÌó#çéå�äë÷üò�ê]÷ü÷üäîâ4í�â�ðLúç+ûXß~÷üäëç_í�ö�ß�èÌó`â�å`÷Aðñâ�áö�â�å�ß~ì�÷üß~ìîß~ò�èÌäîâ4í#äîí�ï4ß�í]ß�áÍç�ìëä��~ß~å��%ô ô2÷~þ

������������������?û�í�ç�ö�äëò)úDç~û�ß~÷üäëç�í<í]ß�èYýDâ�áÌõ�÷���ó`äæå`å`ß~í2ô<ç�áÌõ4â�ã#ö�â�å�ß~ìî÷��`÷tèÍç�èÌßé÷üà�ç�ò~ß%ö�â�å`ß�ìë÷�����ô;ç_ìîï4â�áÌäùèÌó]ö�÷��ã_ç�áÌäëç�èÌäëâ_í�ç�ìLö�ß�èÌó`â�å`÷�� �?ä�� �]÷8÷Ìç�ö�à]ìîäîí]ï�þ

! "�#%$'&)(+*-,/.0$)12(3#4658797;:�<>=@?BA�CEDGFIHJD;7;:�KML/NO4P=-=-L�QJ?BA�:R?@S9T958U�SV5�W�DESVLJW�D D�KYXZD�A%HJD;7;:�K[KM5M<9\@W�5[H%:]L�:A�5[:L379?BW�?V^`_ba9:c`?EA�:RSVLd:7`5M<?BKMH%D�LdWe?BKMKgf2S9A�A�:�< WeLdhi::f�a+A�:�f2D�\E<95[W�5MDE<jL�c;LkW�:HjLl 5M<+<mS9H%:A�DESVLe?Bh9h9KM58f?GW�5[D�<VLn5M<ofDEH%h9S;W�?GW�5MDE<p?BKiHJD�K[:f2S9K8?BAYT95[D�K[D�\Ec�l5M<I79?BW�?/f2D�H%h9A�:L�L�5MDE<�l�?E<V7@5M<IDBW�aV:Aq?BA�:�?�LPDEX0?EAdW�5�rpf5M?EK)5[< W�:KMK[5M\E:�<Vf2:j?B<p7@hV?BWdW�:A�<sA�:�fDE\E<V5�W�5[D�<�^3tu:f2:�<�W�K[cs4P=-=-LaV?vF�:P?BK8LdDwTi::�<oSVL�:�7%5M<ofDEH%h9S;W�:A0F 58L�5[D�<+?Bh9h9KM58f?GW�5[D�<VLkx>W�a9:uW�D�h958f6DBXyW�a958LeL�hp:f258?BKp5ML�LdSV:zx{LdSVf�a+?�LY5MHj?B\�:PLd:U S9:<Vf:H%D;7;:KMK[5M<9\-?E<V7@D�T;|k:�f2WwW�A�?Ef�Cm5M<9\V^%_ba9:j\ED ?BK}DBX0W�aV5MLwhp?Bhi:Aw58L�W�D]?B<pLd~0:A�W�aV:%XZDEKMK[DG~u5M<9\]U S9:�LdW�5MDE<VLw?ETpD�S;W�4P=@=-Ll5M<V7;:hi:<p7;:< W�KMcoDEX'~uap?GW6?Bh9hVK[58f?BW�5MDE<RW�a9:q4�=-=�5MLbSpLd:7oXZD�A��

�`� aV?GW6?BA�:�a958797;:<]=-?EA�C�DGFjH%Dm79:K8L��/4�=-=-Lu~u5MK[K�Tp:q7;:rV<9:7R5M<]Ld:fzW�5[D�</�9^� 46DG~�7;D3W�aV:cjA�:K8?GW�:�W�D%DEW�a9:�Ab=@?BA�CEDGFJHJD;7;:�KMLb?E<V7R�b?vc�:�L�5M?E<j<9:2Wk~0DEA�C;LY5M<R\�:<9:�A�?EK8�/�m5MH%h9KMcoLkW�?GW�:�7yl;a958797;:�<=-?BA�CEDGF3HJD;7;:�KML0?BA�:P?�hV?BA�W�58f2S9K8?BAeCm5[<V7oDBX��b?vcE:Ld58?B<%<9:Wk~eD�A�Cg^'��<RL�:�f2W�5MDE<+�q~0:P~u5MKMKihVA�DGFm587;:P?�L�a9D�AdWeW�S;W�DEA�5M?EKDE</�0?vc�:�L�5M?E<+<9:Wk~eD�A�C;Lb?B<V7/7;:L�fA�5MTi:�aVDG~�4P=@=-L6?B<p7oDEW�a9:�A6=-?BA�CEDGFjH%D;7;:K8LbA�:K8?GW�:�W�D3W�a9:H/^

�`� aV?GW}?BA�:)W�a9:b?BKM\ED�A�5[W�aVH%L�XZDEA�5[<;XZ:�A�:�<Vf2:b?B<p7wK[:?BA�<95M<9\65M<�4P=-=@L'?E<V7q�b?vcE:Ld58?B<�<9:Wk~eD�A�C;L��j��<qD�A�79:A�W�DPSVL�:e?E<4P=-=�W�D�W�A�?�f�Cq?B<%DET9|k:�fzWl�L�:\�HJ:�< W)L�hi::�f�a�lEDEA)\�A�D�S9h%?BH%5[<VDB��?Ef2587�L�:�U S9:�<Vf2:L}5[< W�Dwh9A�DEW�:�5[<JX�?BH%5MK[5M:�L�lB~0:u<9::7LdD�K[S;W�5[D�<VLbW�D+W�aV:�5M<;XZ:A�:<Vf:�?B<p7]K[:?BA�<95M<9\jh9A�DET9KM:HjL�^u��<@Ld:fzW�5[D�<]�+~e:�~u5[KMK'79:�L�f2A�5[Ti:q5M<;XZ:A�:<Vf:3?E<V7/K[:?BA�<95M<9\?BKM\EDEA�5[W�a9HjL�XZDEA�4�=-=-Lq?E<V7Ia9DG~�W�a9:csA�:�KM?BW�:%W�D/W�a9:j\�:<9:�A�?EK)Tp:�K[5M:2Xuh9A�DEhV?E\�?BW�5MDE<@?E<V7��Y=�?BKM\ED�A�5[W�a9HjL�XZD�A�0?vc�:�L�5M?E<+<9:Wk~eD�A�C;L�^

�`� aV?GW�?EA�:�W�a9:�KM5[H%5[W�?BW�5MDE<VLuDEXn4P=-=-L�?B<V7/aVDG~�f�?B<�W�a9:Ld:�Tp:qDGF�:A�f2D�HJ:v� � a95MKM:3?%KMDBWPDEX'H%5MK[:?B\E:wap?EL6Ti::�<DET;W�?B5M<9:�7�DES9WPDBX)4P=-=@LlpW�a9:Ld:�HJD;7;:�KMLP?BA�:qU�SV5�W�:qK[5MH%5�W�:�7y^b��<-L�:�f2W�5MDE<-�%~0:q7;5ML�f2SpL�LbW�a9:�L�:qKM5[H%5[W�?BW�5MDE<VL�lp?E<V7LdD�HJ:�\�:<9:�A�?EK[5M��?BW�5MDE<VLbDEX}4�=-=-LuW�aV?GW6DGF�:A�f2D�HJ:�W�aV:�L�:qK[5MH%5�W�?GW�5[D�<VL^0�6<;XZD�AdW�S9<V?BW�:KMcElpH%DEA�:�fDEH%h9KM:2��HJD;7;:�KML?BK8LdDJA�:U S95[A�:PH%D�A�:wf2D�H%h9K[:�@N�?E<V7/LdD�HJ:W�5MH%:�Lb?Bh9hVA�Dv�;5MH%?BW�:vQY?EK[\�DEA�5�W�a9HjLnXZD�Au5[<;XZ:�A�:�<Vf2:w?E<V7oKM:�?EA�<V5[<9\p^'_baV:�L�:~u5[KMKyTp:q79:�L�f2A�5[Ti:�7�5M</L�:�f2W�5MDE</�9^

� 46DG~�7;Dm:LbDE<9:w?vFED�5M7+DGFE:A�r9W�W�5M<9\J?E<V7�Ld:�K[:fzWuH%Dm79:K�LdW�A�SVfzW�S9A�:L05[</4P=-=@L��I��<9:�DEX�W�a9:wKM?�LkWbXZA�DE< W�5M:A�Le5[<�W�aV:LkW�SV7;coDEX}4�=-=-LP5MLuaVDG~{W�D+L�:KM:�f2W6H%Dm79:K�LdW�A�SVf2W�S9A�:�Lu?E<V7�a9DG~�W�D%r9W�?%f2D�H%h9K[:�RH%D;7;:K�W�D+?%L�H%?EK[K�79?GW�?jLd:W

Page 2: An Introduction to Hidden Markov Models and Bayesian Networks

S 3 

Y3 

S 1

Y1

S 2

Y2¡

S T¢

YT¢

£'5M\ES9A�: � �)¤¥�b?vcE:Ld58?B<R<9:2Wk~0DEA�C+Ldhi:�f5�XZcm5M<9\+f2D�<V7;5[W�5MDE<V?EKy5[<p7;:hi:<V79:<Vf:wA�:�KM?BW�5MDE<VLeXZDEA6?Ja958797;:�<-=-?BA�CEDGF%H%D;7;:K¦^

~u5�W�a9DES;WurVWdW�5M<9\j<9D�5ML�:w5M<RW�a9:q79?BW�?9^e¤¥�0?vc�:�L�5M?E<RL�DEKMS;W�5MDE<�W�D%W�a9:Ld:�Wk~0D]N�f2KMD�L�:KMc+A�:K8?GW�:�7VQ0h9A�DETVK[:�H%Lb58Lu\�5[F�:<5[</Ld:fzW�5[D�<-§;^

� a95MK[:eW�aV:A�:eaV?vF�:YTi::�<3L�:FE:�A�?EKBW�S;W�D�A�58?BK8L�?E<V7qA�:Fm5M:~`?EAdW�5MfK[:L�~uA�5�W�W�:�<3?BTiDES9W}4�=-=-LbNZ:�^ \p^'t6?ET95M<9:A}?B<V73¨ESp?B<9\pl��©�ª � QzlgDES9A�S9<p7;:A�LkW�?B<V795[<9\�DBXb4P=-=@L�ap?ELwf�aV?E<9\E:7-f2D�<VLd587;:�A�?ET9K[c]L�5[<pf2:JW�a9:%A�:�?EK[58L�?BW�5MDE<]W�aV?GW�W�a9:c-?EA�:%?oCm5M<V7sDBX�b?vcE:Ld58?B<3<9:2Wk~0DEA�C+« �B�G¬�^'­�?BH%:KMcEl�~e:uf?E<3<VDG~®A�:K8?GW�:0W�a9:H¯W�DwH%DEA�:uf2DEH%h9KM:2�J?B<V735[< W�:A�:�LdW�5M<9\�HJD;7;:�KML�l�?E<V73~e:uf?E<7;58L�fSVL�Ln\E:�<9:A�?BKpLdD�K[S;W�5[D�<VL)W�DqW�a9:Ph9A�DETVK[:�H%LYDBX�?Eh9h9A�Dv�m5MHj?GW�:u5[<;XZ:�A�:�<Vf2:�l�hp?BA�?BH%:2W�:AnKM:�?EA�<95M<9\pl�?B<p7jH%Dm79:KpL�:KM:�f2W�5MDE<�^_ba9:wa9D�hp:�58LbW�ap?GWuW�aV5ML6?EAdW�5MfK[:�~u5MK[K�5M< W�A�D;7;SVf2:�W�a9:wA�:?E7;:�AbW�Dj?%LkW�?GW�:2��DBX°�¦W�a9:��?EAdWbS9<V7;:�A�LdW�?E<V7;5M<9\%DBX)4P=-=@L^

± ² ³/´�$µ´w&)¶¸·¸12*]*]¶P#º¹ ´w&)»�(�¼¾½¿(+*]¶PÀÁn¤Ãa95M7V7;:<I=-?BA�CEDGF�H%Dm79:K'5ML�?jW�DmDEK'XZDEA�A�:�h9A�:�L�:< W�5M<9\+h9A�DETp?BT95MK[5[Wkc]7;58LkW�A�5MT9S;W�5[D�<VLPDGF�:A�Ld:U�SV:<Vf:�L�DBXYD�TVLd:�A�FG?BW�5MDE<VL�^Ä�:WeSVL07;:�<9DBW�:6W�aV:�D�TVLd:�A�FG?BW�5MDE<+?GWeW�5MH%:PÅnTmc3W�a9:�FG?BA�5M?ET9K[:�ÆVÇz^)_ba958Lef�?B<+Ti:�?3LdcmH3TpD�KVXZA�DEHÈ?�7;58L�f2A�:2W�:�?BKMh9aV?ETp:W�lm?A�:�?BK[��Fv?EK[SV:�7jFG?BA�58?BT9KM:El;?B<�5M<�W�:\�:Al D�Au?B<mc%DBW�aV:AuDET9|k:�fzWl;?EL0K[D�<9\%?EL0~e:wf�?B<R79:2rV<9:w?3h9A�DETV?ET95[KM5[Wkc+7;5MLdW�A�5MT9S;W�5MDE<�DGFE:�A5[W�^ � :%?EL�L�S9H%:wW�aV?BW�W�a9:JDETVL�:A�FG?GW�5MDE<pLP?BA�:�L�?BH%h9KM:�7-?BW�7;58L�f2A�:2W�:�lg:�U SV?BKMKMc���L�hV?Ef:�7�W�5MH%:35M< W�:�A�FG?BK8L�liL�DoÅ6f�?B<@Ti:3?E<5M<�W�:\�:A��¦FG?BKMS9:7jW�5MH%:w5[<p7;:2�y^

_ba9:+aV5M7979:<`=-?EA�C�DGF-H%Dm79:K0\E:2W�Lw5[W�L3<V?BH%:%XZA�DEHÉWk~eD@79:2rV<95M<9\-hVA�D�hp:�AdW�5[:L^/£'5[A�LkWl}5�W%?EL�LdS9H%:L�W�aV?BWqW�aV:oDET9�L�:A�Fv?BW�5MDE<®?BW3W�5[H%:/Å�~b?EL3\E:�<9:A�?GW�:�7ÊTmc`L�DEH%:�h9A�D;f:�L�L�~ua9D Ld:/LdW�?GW�:/Ë Ç 5MLoÌ;Í�ÎEÎEÏÐ�XZA�DEH�W�aV:RD�TVLd:�A�F�:A^`�m:�fDE<V7yl5[W3?EL�LdSVHJ:L�W�ap?GW�W�a9:oLdW�?BW�:+DEX0W�a958Lqa958797;:�<Êh9A�D;f:�L�LqL�?BW�58Lkrp:�L�W�a9:]Ñ@ÒGÓ�Ô�ÕGÖ%×gÓ�Õ�×VÏÓzØOÙG�3W�aV?BW�58Ll}\E5MFE:�<IW�a9:+FG?EK[S9:oDBXË Ç�Ú�Û l9W�a9:qf2SVA�A�:< W6LkW�?GW�:�Ë Ç 58Lu5M<V7;:�hp:�<V7;:< WPDEX}?EK[K�W�a9:qLdW�?BW�:�L6h9A�5MDEAbW�DjÅ}Ü � ^ Û ��<]DEW�a9:�Au~eD�A�79L�lmW�aV:�LkW�?GW�:q?GWPL�DEH%:W�5MH%:w:<Vf�?BhVL�S9K8?GW�:�Lb?BKMK�~0:�<V::�7oW�D%Cm<9DG~�?BTiDES;WbW�aV:wa95MLdW�D�A�coDBX�W�a9:wh9A�D;f2:�L�L05[</D�A�7;:�A0W�D%h9A�:�7;58fzWuW�a9:�XZS;W�S9A�:wDBX'W�aV:h9A�D;f2:�L�L�^}_baV:�D�S;W�hVS;W�L6?EKML�DjL�?BW�58LkXZcR?J=@?BA�CEDGFjh9A�DEhi:A�Wkcj~u5�W�a/A�:Ldhi:�f2WuW�DJW�a9:qLdW�?BW�:L�)\�5[F�:<]ËgÇ�lVÆVÇe5MLb5M<V7;:�hp:�<V7;:�<�WDBX'W�aV:qLkW�?GW�:Lu?B<V7RDETpLd:�A�FG?GW�5[D�<VLb?GWP?EK[KyDEW�a9:�AbW�5MHJ:w5M<V7;58f2:L^

_'?BCE:�<IW�DE\�:2W�a9:Al'W�a9:Ld:�=-?BA�CEDGFsh9A�D�hp:�AdW�5[:LwH%:�?E<ÊW�aV?BW�W�a9:q|kD�5[< WJ795MLdW�A�5[TVS;W�5MDE<`DEXP?-L�:�U S9:<pf2:+DEXPLkW�?GW�:L�?E<V7DETpLd:�A�FG?GW�5[D�<VLbf?E<RTi:�X�?Ef2W�DEA�:�7R5M<RW�a9:�XZDEKMKMDG~u5[<9\J~b?vci�

ÝjN¦Ë�Û�Þ ßYà�ÆyÛ�Þ ß}Qná{ÝjN¦Ë�Û2QdÝjN�ÆyÛEâ Ë�ÛQßãÇZä�å ÝjN¦ËgÇ2â ËyÇ�ÚyÛ2QdÝjN�ÆpÇâ ËyÇdQzà N � Q

~ua9:�A�:b~0:uaV?vFE:0SVL�:�73W�a9:u<VDBW�?BW�5MDE<JæoÛ�Þ ß�W�DwH%:?B<%æoÛvàç�çç2à�æjßn^)_ba958L'X�?EfzW�DEA�5[�?GW�5[D�<3DEXVW�aV:)|kDE5M< Wnh9A�D�TV?BTV5[KM5�Wkcqf�?B<%Ti:7;A�?v~u<+\EA�?BhVa95Mf�?BKMK[cJ5M<+W�aV:PXZD�A�HèL�a9DG~u<+5M<R£'5M\ES9A�: � ^}_baV5ML0\EA�?BhVa�l�Cm<9DG~u<R?EL0?��b?vcE:Ld58?B<j<9:Wk~eD�A�Cgl Tp:�K[5M:2X�<9:2Wk~0DEA�Cglh9A�DETV?ET95MK[58LkW�5Mf3\EA�?BhVa95Mf�?BK'H%Dm79:K¦lyDEA�h9A�DETV?ET95[KM58LkW�5Mf35[<p7;:hi:<V79:<Vf:J<V:2Wk~0DEA�CilyL�a9DG~6LPW�a9:j7;:�hp:�<V7;:<pf25M:�L�Ti:2Wk~0::<sW�aV:FG?BA�5M?ET9KM:�Lb5M<RW�a9:wH%D;7;:K¦^ � :w~u5[KMK�7;:rV<9:q�b?vcE:Ld58?B<R<9:2Wk~0DEA�C;LeH%D�A�:�XZS9KMK[c�5M<RW�a9:�XZDEKMKMDG~u5[<9\jL�:�f2W�5MDE<�l9TVS;WuXZDEAu<9DG~�5[W58LYL�S;é+f25M:< WYW�Dq<9DBW�:uW�ap?GWe:?Ef�ajFG?BA�58?BT9KM:u5MLeA�:h9A�:�L�:< W�:7JT c%?w<9D;7;:P5[<jW�a9:P\�A�?Eh9a�l�:�?Ef�aj<VDm79:6A�:f2:�5[F�:�Ln7;5MA�:�fzW�:�7j?EA�f�LXZA�DEHè<9D;7;:Lu~ua958f�aR5[W658L6f2D�<V7;5[W�5MDE<V?EK[KMco7;:�hp:�<V7;:< W6D�<R5M<�W�a9:�X�?�fzW�D�A�5M��?BW�5MDE<RDBX'W�a9:b|kD�5[< W67;58LkW�A�5MT9S;W�5[D�<�^

¤êW�a95MA�7+?�L�L�S9H%h;W�5[D�<+DBXyW�a9:Pa958797;:�<R=-?EA�C�DGF�H%D;7;:Ki58LnW�aV?GWeW�a9:�a958797;:<RLkW�?GW�:�FG?BA�5M?ET9K[:P5ML�ÎGÍ8ëìÓ�Ï2Ø�Ï�YË Ç f?B<+W�?BC�:DE</íîFG?BKMS9:�Lu~uaV5Mf�a�~e:�~u5MK[K�7;:<9DEW�:wTmcjW�a9:w5[< W�:\E:�A�L�ï � àç�çç2à�íÊð ^

_�DP7;:2rp<9:e?Ph9A�D�TV?BTV5[KM5�Wkc�7;58LkW�A�5MT9S;W�5[D�<qDGFE:�A�L�:�U S9:<pf2:�L�DBX9D�TVLd:�A�FG?BW�5MDE<VL�l?EK[KEW�aV?BW�58L�KM:2X°W'W�D�Ldhi:�f5�XZc�58L�?6h9A�D�TV?BTV5[KM5�Wkc7;58LkW�A�5MT9S;W�5[D�<qDGFE:�AyW�aV:Y5M<95�W�5M?EK�LdW�?BW�:eÝjN¦Ë Û Q2lvW�a9:0í�ñeíèLdW�?BW�:)W�A�?E<VLd5[W�5MDE<wHj?BW�A�5��w7;:2rp<95[<V\�ÝjNOË Ç â Ë Ç�Ú�Û Q�?E<V7�W�a9:YD�S;W�h9S9WH%D;7;:K97;:rV<95M<9\�ÝjN�Æ Ç â Ë Ç Q2^'4�=-=-L}SVL�SV?BKMKMcq?EL�LdS9H%:eW�aV?BW}W�a9:uLdW�?GW�:0W�A�?B<VL�5�W�5[D�<�Hj?GW�A�58f2:L�?E<V73DES;W�h9S;W)H%Dm79:K8L'?EA�:0<9DEW7;:�hp:�<V7;:< W6D�<RŦxê5[<�DBW�a9:Au~0DEA�79LYW�a9:wH%D;7;:�Ky5ML�ئͰò%Ï�Í°ÐVÖGÒGÓzÍ�ÒBÐVØYN�:2�9f2:�h;WbXZDEAbW�a9:�5[<95[W�58?BK�LkW�?GW�:vQz^)��X�W�a9:wD�TVLd:�A�FG?ET9K[:L?BA�:e795ML�f2A�:2W�:0L�cmH�TiDEK8L�W�?BCm5M<9\PD�<�DE<V:eDEXpó@FG?EK[S9:LlvW�a9:bDES;W�h9S;W)H%D;7;:K;f?E<�Ti:0XZS9K[KMc�L�hp:f25[rV:�7�Tmcq?�íÃñPó-D�TVL�:A�Fv?BW�5MDE<NZD�Au:H%58L�L�5[D�<pQeHj?GW�A�5[�g^

ôkõ�ö÷ùøy÷ùøyú}ûpü�ý�þMÿ��zü�����ü��wú�� ��������� �����������������! "�Oö�� ��#����$�wú�� ���������&%��kø¦øy÷ùø'� ���'÷(��)�öv÷(%¦ö+*-,�.z÷ ���/�0* ,�1 ô32�2/2 * ,�154 ÷ùøy÷(��#6�/������#�������7�*!8�79� �$:<;>=3?@�A�

Page 3: An Introduction to Hidden Markov Models and Bayesian Networks

£9D�A�A�:�?EK���FG?BKMS9:�7�DETVL�:A�FG?GW�5[D�<qFE:fzW�D�A�L�lGÝjN�Æ Ç â Ë Ç Q'f�?B<�Ti:bH%Dm79:KM:�735[<JHj?B<mcq7;5CBi:�A�:�<�W'XZDEA�HjLl�LdSVf�aJ?EL}?+D�?BSVL�Ld58?B<�lH%5��mW�S9A�:�DBXED�?BSVL�L�5M?E<VLl)D�Aj?@<9:�S9A�?BK0<9:2Wk~0DEA�Cg^`£9DEA%a95M\Ea9��7;5MH%:<VL�5MDE<V?EKeA�:�?EK���FG?BKMS9:�7ÊD�TVL�:A�Fv?BW�5MDE<VL�ln?sFE:A�cÊSVL�:2XZS9KDES9W�h9S;W%H%D;7;:Kb58L�D�T;W�?E5[<9:7`Tmc�A�:�h9K8?Ef25M<9\]W�a9:FD�?BSVL�Ld58?B<®T cÊ?@X�?Ef2W�DEAJ?B<V?EK[c;L�:A�« �-Gv¬¦^`£p?Ef2W�DEAJ?B<V?EK[c;L�5MLRN�£;¤�Q�58LJ?H%:2W�a9D;7-XZD�A�H%D;7;:KM5M<9\�fDEA�A�:�KM?BW�5MDE<VLP5[<sa95M\Eas795[H%:<pLd5MDE<V?EK)79?GW�?9ly?B<V7@5ML�fK[D Ld:�K[c/A�:K8?GW�:7]W�DRh9A�5M<Vf25MhV?BK)fDEH%hpD�<9:< W�L?B<p?BKMcmL�58LYN�H�I0¤�Q2^B_ba9:YA�:K8?GW�5[D�<VLdaV5[hVL�Ti:2Wk~0::<J£;¤qlJHKI0¤�lvHJ5[�mW�S9A�:YH%D;7;:�KML�lB4P=-=@LlE?E<V7qDEW�a9:�A�H%D;7;:�KML'?BA�:YA�:Fm5M:~0:�75M<�« � ª ¬¦^

4P=@=-LYf�?B<jTi:�?BSV\EH%:< W�:73W�D�?EK[KMDG~®XZD�AY5M<9h9S;W0FG?BA�5M?ET9K[:Ll5L}Ç�l 5[<+L�SVf�a+?w~b?vcqW�aV?GWnW�a9:A�:658LY?E<j5[<9hVS;W07;:�hp:�<V7;:�<�WLdW�?GW�:qW�A�?E<VLd5[W�5MDE<@h9A�D�TV?BTV5[KM5�Wkc�liÝjN¦Ë Ç â Ë Ç�ÚyÛ àL Ç Q�« © ly�;li�MGv¬�^�_ba9:%L�cmLdW�:�H W�a9:�<@H%D;7;:K8L6W�a9:%f2DE<p7;5�W�5[D�<V?BK}7;58LkW�A�5MT9S;W�5[D�<DBXw?�Ld:U S9:<Vf:]DBX�DES;W�h9S;WoD�TVLd:�A�FG?BW�5MDE<VLJ\E5MFE:�<>?�L�:�U S9:�<Vf2:]DEX�5M<9h9S;WoD�TVL�:A�Fv?BW�5MDE<VL�^ê4P=-=@LjaV?vFE:/Ti::�< ?Eh9h9KM5[:7:2�mW�:<VL�5[F�:KMcjW�D%h9A�DETVK[:�H%Lb5M<]Ldhi::f�aRA�:�fDE\�<95�W�5[D�<I« ���v¬¦l9fDEH%h9S;W�?GW�5MDE<p?BKyT95MDEKMDE\�c@« ���;l9�G¬�lV?E<V7+X�?ES9K[WP7;:2W�:�fzW�5[D�<Ê« �E�v¬¦^

� :J<VDG~¥W�S9A�<IW�D/�b?vcE:�L�58?B<-<9:Wk~eD�A�C;L�l�?�HJD�A�:J\E:�<9:A�?BK�XZA�?BH%:~0DEA�C�W�aV?E<IaV5M7979:<�=-?BA�CEDGF/H%D;7;:K8L�~ua958f�as~u5MK[K?BKMKMDG~�SVL�TpDEW�asW�D/S9<V79:A�LkW�?B<V7-W�a9:j?BKM\ED�A�5[W�aVH%L�XZD�A�5M<;XZ:�A�:�<Vf2:j?B<p7-KM:�?BA�<95M<9\�5[<�4P=-=@Lw?B<V7-W�D�XZDEA�H�S9K8?GW�:3<p?GW�SVA�?EK:2�mW�:<VL�5[D�<VL0W�DJW�a9:q4P=-=`^

N O Pè´RQ3¶PÁ'1´q# #/¶b$�S (3&)» $},R$}(�&n1´qÀ¤>�0?vc�:�L�5M?E<w<9:2Wk~0DEA�C�5ML}?P\EA�?Bh9a958f?EK�H%D;7;:�K�XZD�A�A�:hVA�:Ld:�<�W�5[<V\�f2D�<V7;5[W�5MDE<V?EK�5M<V7;:�hp:�<V7;:�<Vf25M:�L}Ti:2Wk~0::�<3?PL�:2W}DBXpA�?E<V7;DEHFG?BA�5M?ET9KM:�L�^+IeDE<pLd587;:A�XZDESVA�A�?B<V79DEH Fv?EA�58?BTVK[:Ll'T lyæ`lgÆ+ly?B<V7VUw^�£9A�DEHµTV?�Ld58fqhVA�D�TV?BT95MKM5�WkcRW�a9:�DEA�c/~e:3C <VDG~ W�aV?BW~0:�f�?B<RX�?Ef2W�DEAbW�a9:b|kDE5M< W6h9A�DETV?ET95[KM5[Wkc+?ELu?%h9A�D;7;SVfzWuDEX}fDE<V7;5[W�5MDE<p?BKyh9A�DETV?ET95MK[5[W�5M:�L��

ÝjN�T�à�æ-à�ÆeàU�Q)á{ÝjN�T¥QkÝjN�æ â T¥QdÝjN�Æoâ T�à�æsQkÝjNWU�â T�àdæ@à�Æ�Q2ç_ba958L)X�?�fzW�D�A�5M��?BW�5MDE<j7;Dm:�LY<9DBWeW�:�K[KpSVLe?E<mc�W�a95M<9\qSVL�:2XZS9Ki?BTiDES;WeW�a9:n|kDE5M<�W0h9A�DETV?ET95[KM5[Wkc37;58LkW�A�5MT9S;W�5[D�<��}:�?�f�aJFG?EA�58?BT9KM:6f?E<hiDBW�:�< W�58?BKMK[co79:hi:<V7/D�<R:�FE:A�cjDBW�a9:AuFG?EA�58?BT9KM:E^)4PDG~e:�FE:Al;f2D�<VLd587;:�AeW�a9:�XZDEKMKMDG~u5[<9\JX�?�fzW�D�A�5M��?BW�5MDE<��

ÝjN�T�àdæ-à�ÆYà UPQ)á�ÝjN�T¥QdÝjNZæsQdÝjN�ÆRâ T¥QkÝjNWU�â æ-à�Æ�Qzç NO��Q_ba9:�?ETpDGF�:�X�?EfzW�DEA�5[�?GW�5[D�<R5MH%h9K[5M:�L�?jLd:W6DBXnf2D�<V7;5[W�5MDE<V?EKy5[<p7;:hi:<V79:<Vf:�A�:K8?GW�5MDE<pL^Y¤�Fv?EA�58?BTVK[:jNZD�APL�:2WPDEX'FG?BA�58?BT9KM:�L�QX 58Lqì�ÕBÐiÎBÍ°ØOÍ�ÕBÐiÒJY�Y�ÙoÍ°ÐiÎ�Ï�×VÏÐiÎEÏÐVØ�XZA�D�H[Z \E5MFE:<F\¯5�X}ÝjN X à]ZRâ \wQYá�ÝjN X â \wQkÝjN�ZRâ \wQ0XZDEA6?EK[K X l Z ?E<V7^\¯L�SVf�aRW�aV?BWÝjN�\wQ`_áaGV^I£VA�D�HÉW�a9:/?BTiDGFE:jX�?�fzW�D�A�5M��?BW�5MDE<Ê~0:Rf�?B<®L�a9DG~ W�aV?BWJ\�5[F�:<�W�a9:RFG?EK[S9:L�DEX6æ¿?B<p7`Æ+lbT ?E<V7cU ?BA�:5M<V7;:hi:<p7;:< W��

ÝjN�T�à U�â æ-à�Æ3Q á ÝjN�TÊàdæ-à�ÆYà UPQÝjNZæ@à�Æ�Q

á ÝjN�T¥QdÝjNZæsQdÝjN�Æ�â T¥QdÝjN�U3â æ-à�Æ�Qd ÝjN�T¥QdÝjNZæsQdÝjN�Æoâ T¥QkÝjNWU�â æ-à�Æ3QfegTheJUá ÝjN�T¥QdÝjN�Æ/â T¥QdÝjN�U3â æ@à�Æ�Q

ÝjNOÆ3Qá ÝjN�T â Æ3QdÝjN�U3â æ@à�Æ3Q2ç

¤ �0?vc�:�L�5M?E</<9:2Wk~0DEA�CR58L�?+\EA�?BhVa95Mf�?BK�~0?vcRW�DRA�:�h9A�:Ld:�< W�?+hV?EAdW�5MfS9K8?BA6X�?�fzW�DEA�5[�?GW�5MDE<]DEXe?w|kD�5[< W�7;5MLdW�A�5MT9S;W�5MDE<�^��e?Ef�aFG?BA�5M?ET9KM:+5MLJA�:h9A�:�L�:< W�:�7�TmcÊ?-<9D;7;:�5[<®W�a9:R<9:2Wk~0DEA�Cg^s¤ 7;5MA�:fzW�:7®?EA�fj58LJ7;A�?v~u<`XZA�D�Hî<VDm79: X W�DI<9D;7;:iZÉ5�X0Z58Lwf2DE<p7;5�W�5[D�<9:�7sDE< X 5M<sW�a9:JX�?Ef2W�DEA�5M��?GW�5[D�<@DEXeW�a9:�|kDE5M<�W�795MLdW�A�5[TVS;W�5MDE<�^j£VDEAw:2�9?EHJhVK[:�lyW�D/A�:h9A�:�L�:< W�W�a9:%X�?�fzW�D�A�5M��?B�W�5MDE<ÊN¦�EQ0~0:�~0DESVKM7/7;A�?v~�?E<�?EA�f�XZA�DEHjT W�D+ÆÈT9S9W6<9DBWuXZA�DEHjT W�DiUq^n_ba9:q�b?vcE:Ld58?B<R<9:2Wk~0DEA�CjA�:h9A�:�L�:< W�5M<9\JW�aV:X�?Ef2W�D�A�5M��?BW�5MDE<sN¦�EQ058LuLdaVDG~u<R5M<]£�5M\ESVA�:q�;^

�mD�HJ:RTV?EL�58fR7;:rV<95[W�5MDE<VL3XZA�DEH \�A�?Eh9aÊW�aV:DEA�c�~u5[KMKbTp:/<9:f2:L�L�?BA�cI?BW3W�a958L3hiDE5M< W�^®_baV:R<9D;7;: X 5MLJ?-×9ÒBÓ�Ï2ÐpØbDBX?B<VDBW�aV:AY<VDm79:kZÃ5�XyW�a9:A�:P58Le?37;5MA�:fzW�:7+?BA�fbXZA�DEH X W�DlZnm 5[X�L�DVlgZ�58Le?Rì�Ì;Í�Y[Î�DBX X ^n_baV:JÎEÏ2ëì�Ï2ÐgÎEÏÐVØOë}DEX�?q<9D;7;:�?BA�:5[W�Lbf�a95MKM7;A�:<�lmf�aV5[K87;A�:<$o Lef�aV5[K87;A�:<�lm?B<V7RLdD3DE<�^)¤ÈÎGÍ°Ó�Ï�ìØ�Ï�Î�×VÒGØZÌwXZA�D�H X W�DlZÃ5MLb?�L�:�U S9:�<Vf2:�DBX�<VDm79:�LbLkW�?BA�W�5M<9\wXZA�DEHX ?B<V7@:<V7;5M<9\�5[<pZ�L�SVf�a@W�aV?BW�:?Ef�a-<9D;7;:J5M<-W�aV:JL�:�U S9:�<Vf2:J5ML�?ohV?BA�:< W�DEXnW�aV:�XZD�K[KMDG~u5[<V\o<9D;7;:J5[<@W�a9:jL�:�U S9:�<Vf2:�^¤6<`q;ÐiÎGÍ°Ó�Ï�ìØ�Ï�Î6×VÒGØZÌ�XZA�DEH X W�DrZ¯5ML0?�L�:�U S9:�<Vf2:6DEX�<9D;7;:�LeLkW�?BA�W�5M<9\wXZA�DEH X ?E<V7j:�<V7;5M<9\q5M<nZ¯L�SVf�ajW�aV?GW0:�?Ef�aj<VDm79:5M<RW�a9:qL�:�U S9:<pf2:�5MLu?%hp?BA�:< WwÕBÓ3ì�ÌmÍ�Y[Î�DEX�W�a9:�XZDEKMKMDG~u5[<9\J<9D;7;:�^

_ba9:%Ld:�Hj?B< W�58fL�DBX0?R�b?vcE:Ld58?B<]<V:2Wk~0DEA�C/?EA�:JLd5MH%h9KM:E��:�?Ef�as<9D;7;:J5ML�f2D�<V7;5[W�5MDE<V?EK[KMc]5M<V7;:hi:<p7;:< W�XZA�D�H 5�W�L�<9DE<9�7;:L�f:<V7;:�< W�L�\E5MFE:�<-5�W�L�hV?BA�:< W�L�^ å =]D�A�:3\E:�<9:A�?BKMK[c�liWk~eD�7;5ML�|kDE5M< W�L�:2W�L�DBXY<9D;7;:L X ?E<V7`Z ?BA�:3fDE<V7;5[W�5MDE<p?BKMK[c/5M<V7;:2�s t�÷(��%����Oö������}÷ùø�úb� ���u "��� "� ���v%�� �����kø��-� �6#�����%��vw-�u��)'�����0�6�&#��kø�ú��#��zú�¦÷�úw6x(�dø/y&)���)�÷(x(x-�7z���/���¦úx(6úw-� {&�|%�� ��#÷ �¦÷(� �Gúx�÷(��#���������#�����%������x�ú]�O÷(� �vø}w-�u��)'�����+���~#��kø��R�dú�v÷(�6.K%�� ��#v÷ �O÷(� �Gúxm÷(��#6�/������#�����%�������x�ú]�¦÷(� �ø}w��u��)'�����+�¦ö6�f�zú�¦÷�úw6x(�dø�ú�ø¦ø��&%k÷�ú]����#0)�÷ �¦ö��¦ö6�b�6�&#��kø/�

Page 4: An Introduction to Hidden Markov Models and Bayesian Networks

W�

X�

Y�

Z�

£'5[\�S9A�:ê�9� ¤ 795[A�:�f2W�:�7È?�f2c;f2KM5Mf \EA�?BhVa�N��P¤�DwQÊf2D�<VLd58LdW�:< W�~u5�W�a W�a9:{fDE<V7;5[W�5MDE<p?BKj5M<V7;:hi:<p7;:<Vf:êA�:�KM?BW�5MDE<VLI5M<ÝjN�TÊàdæ-à�ÆYà UPQ2^hi:<V7;:�< Wb\�5[F�:<i\Jlm5[Xf\èÎ���ëÏ�×VÒGÓ�ÒBØ�Ï2ë X ?B<V7iZ+lmW�aV?GWb5ML�lm5�X}?BKMDE<9\�:FE:�A�c%S9<p7;5[A�:�f2W�:7+hV?BW�aoTi:2Wk~0::�<R?3<9D;7;:�5[< X ?E<V7?�<9D;7;:u5M<>Z�W�a9:�A�:u58Ln?�<9D;7;:�� L�SVf�aJW�ap?GW��bN � Qf� aV?ELnfDE<mFE:�A�\�5[<V\�?EA�A�DG~6L��0?B<p73<V:5[W�a9:�Ab� <9DEAn5[W�LY7;:�L�f2:�<V7;:< W�Ln?BA�:5M<`\JlpD�A3NO��QR� 7;Dm:�LP<9DBW�aV?vFE:qfDE<mFE:�A�\�5[<9\j?EA�A�DG~�?E<V7F�µ5MLP5[<p\�« �E�B¬¦^6£VA�D�H�Fm58LdSV?EK�5M<VL�hp:fzW�5MDE<]DEX}W�a9:3\EA�?Bh9a958f?EKH%D;7;:K)5[Wq5ML�W�a9:A�:2XZD�A�:%:?EL�c/W�D/5[<9XZ:AwHj?B<mc-5M<V7;:�hp:�<V7;:<pf2:jA�:K8?GW�5MDE<pL�~u5[W�aVDES;Wq:�mhVK[58f25[W�KMc-\EA�5M<V7;5M<9\oW�a9A�DES9\�aI�b?vcE:LA�S9K[:�^6£9D�AP:2�9?EHJhVK[:�l�T 5ML�f2D�<V7;5[W�5MDE<V?EK[KMco5M<V7;:�hp:�<V7;:�<�W�XZA�DEH æî\�5[F�:</W�a9:3L�:2W0\ÃáÃïÆeàUwð�lVL�5M<Vf2:�Æj��\ 58LP?EK[D�<9\W�aV:�DE<VK[c/hV?BW�a-Ti:2Wk~0::�<�Tº?B<V7-æ`li?E<V7-Æ�7;Dm:�L6<VDBW�ap?vFE:�fDE<mFE:�A�\�5[<9\+?EA�A�DG~6L�^b4PDG~e:�FE:�A�lp~e:Jf?B<V<9DBWP5M<;XZ:�APXZA�DEHW�aV:w\EA�?Bh9aoW�aV?BWkT 58Luf2D�<V7;5[W�5MDE<V?EK[KMc+5M<V7;:hi:<p7;:< W6XZA�DEHèæî\E5MFE:�<FUq^

­6DEW�58f2:3W�aV?BWqLd5M<Vf2:J:�?�f�a-X�?�fzW�D�A�5M��?BW�5MDE<-5MH%h9KM5[:Lw?RLdW�A�5Mf2WwDEA�7;:A�5[<V\oDBXYW�a9:%FG?BA�5M?ET9KM:�L�lgW�a9:jf2D�<9<9:fzW�5MDE<pLPD�T;W�?E5[<9:75M< W�a958LjHj?B<9<9:�Ao7;:rV<9:-?�7;5MA�:fzW�:7¥ÒEìÙEì�Y�Í�ìo\EA�?BhVa3�B^�£VS9AdW�a9:A�H%DEA�:ElYW�a9:�A�:-?EA�:�Hj?B<mc®~b?vc;L�W�D�X�?Ef2W�DEA�58Ld:]?R|kDE5M< W7;58LkW�A�5MT9S;W�5[D�<�lP?E<V7êf2D�<VLd:U S9:< W�KMc W�a9:�A�:@?EA�:]Hj?E< c �b?vcE:Ld58?B< <9:Wk~eD�A�C;L+fDE<VL�5MLdW�:�< Wo~u5�W�a�?ÊhV?EAdW�5MfS9K8?BAw|kD�5[< W�^ä�b?vcE:Ld58?B<�<9:Wk~eD�A�CV�µ5ML%L�?B587IW�DsTp:/?B<`5M<V7;:�hp:�<V7;:�<Vf2cÊHj?Bh�� ��òjÒ�×sXZD�AJ?s7;58LkW�A�5MT9S;W�5[D�<®Ýµ5�X�:FE:�A�cVeE��L�:hV?EA�?BW�5MDE<7;58LdhVKM?vc�:�7]5M<p� f2DEA�A�:�L�hpD�<V79LPW�D/?oFG?BKM587@f2D�<V7;5[W�5MDE<V?EK}5[<V79:hi:<V7;:�<Vf2:JA�:K8?GW�5MDE<s5[<IÝ%^r�è58L�?@òJÍ°ÐVÍ°òjÒJY}����ò%Ò�×-5�XY<VD?BA�f�f?E<RTi:q7;:KM:2W�:�7RXZA�DEH[�Ã~u5�W�a9DES9W6A�:�HJDGFm5M<9\3W�a9:r����ò%Ò�×oh9A�D�hp:�AdWkc�^

_ba9:@?ETVL�:<Vf:-DBXq?BA�fLo5[<{?®�0?vc�:�L�5M?E< <9:2Wk~0DEA�C®5MH%h9K[5M:�L�f2D�<V7;5[W�5MDE<V?EKP5M<V7;:�hp:�<V7;:<pf2:@A�:K8?GW�5[D�<VLj~ua958f�a�f�?B<êTi::2�;h9KMDE5[W�:7`W�DsD�T;W�?E5[<>:2é+f5[:�<�Wj?BKM\ED�A�5[W�aVH%L3XZD�A%fDEH%h9S;W�5[<V\IHj?EA�\�5[<V?EK0?E<V7>f2DE<p7;5�W�5[D�<V?BKbh9A�DETp?BT95MK[5[W�5M:�L�^®£VDEA�ëzÍ°ÐM�-Y�Ùì�ÕGÐpÐiÏ�ì2Ø�Ï�Îu<9:Wk~eD�A�C;L�l�5M<+~ua958f�a+W�a9:�S9<V7;:�A�KMcm5[<9\�S9<V7;5MA�:fzW�:�7+\�A�?Eh9ajaV?�LY<9D3K[DmD�hVLl W�a9:A�:P:�m58LdW�L0?q\E:�<9:A�?BKi?BKM\ED�A�5[W�a9Hf?EK[KM:�7���Ï~Y�Í�Ï��w×gÓ�Õ�×VÒ~� ÒGئÍ�ÕGÐê« ���ml'�E�G¬�^s£VDEARòlq5Y�Ø¦Í ×�Y�ÙIì�ÕGÐpÐiÏ�ì2Ø�Ï�Îj<9:Wk~eD�A�C;L�l�5M<`~ua958f�a�W�aV:A�:Rf?E<ÊTp:�H%DEA�:jW�ap?B<ÊDE<V:S9<V795[A�:�f2W�:�7@hV?GW�a@Ti:2Wk~0::�<I?E< c�Wk~0Do<9D;7;:LlgW�a9:A�:J:2�;5MLdW�L�?oHJD�A�:J\E:�<9:A�?BK'?BKM\ED�A�5[W�a9HµCm<9DG~u<I?ELPW�a9:+� q;ÐiìئÍ�ÕGÐÊئÓ�Ï�ÏÒJY ��ÕBÓzÍ°Ø°Ì;ò « �m§ l�� © ¬�^��u~u5MKMK'hVA�DGFm587;:wW�aV:3:L�L�:<Vf:�DEX)W�a9:JTp:�K[5M:2Xeh9A�D�hV?B\ ?GW�5[D�</?EK[\�DEA�5�W�a9H�N�L�5[<Vf:�W�a9:�:�9?EfzW�5[<9XZ:A�:<Vf:H%:2W�a9D;79L�SVLd:7/W�aVA�D�S9\Ea9D�S;W6W�a95ML�hV?Ehp:�A�?EA�:�TV?EL�:�7]D�<-5[W�Q�?B<V7]A�:2XZ:�APW�a9:�A�:�?�7;:APW�DRA�:�K[:�Fv?E< WPW�:�mW�LJ« ���9l�� ª ly�G�G¬}XZD�A7;:W�?B5MK8L^

¤PL�L�S9H%:s~0:@D�TVLd:�A�F�:@L�DEH%: ÏÖÍ�ÎEÏÐiì�Ï2� W�aV:sFG?BKMS9:IDBX3L�DEH%:sFv?EA�58?BTVK[:Lo5M<{W�a9:s<V:2Wk~0DEA�Ci^ _ba9:I\ED ?BK�DBX�Ti:KM5[:Xh9A�DEhV?E\�?BW�5MDE<-58L�W�D/S9hg79?BW�:%W�aV:jH%?EA�\�5[<p?BK)h9A�DETV?ET95MK[5[W�5M:�L�DBXu?BKMK}W�aV:jFv?EA�58?BTVK[:L�5M<IW�a9:j<V:2Wk~0DEA�C/W�D]5M<Vf2D�A�hiDEA�?GW�:�W�a95ML<9:�~¥:Fm5M79:<Vf:E^�_ba95ML�58L�?�f�a95M:FE:7/Tmc�KMD;f?EK�H%:�L�L�?B\E:whp?EL�Ld5M<9\V�u:?Ef�a]<9D;7;:�l��`Ld:�<V79L�?+H%:�L�L�?E\E:wW�Do5[W�L�hV?EA�:�<�W�LP?E<V7W�D�5[W�L+f�aV5[K87;A�:<�^��m5M<Vf:RW�a9:]\EA�?BhVa 58LjLd5M<9\�K[c®fDE<9<V:�fzW�:�7ylK��L�:hp?BA�?GW�:L3W�a9:]\�A�?Eh9a�le?E<V7 W�a9:�A�:XZDEA�:oW�a9:]:Fm587;:<pf2:El5M<�W�D�Wk~eD�H�S;W�SV?BKMKMc-:2�9f2KMSVL�5[F�:JL�:2W�L�E���uN���Q2l�fDE<VL�5MLdW�5M<9\�DBXeW�a9:%hV?EA�:�<�W�L�DBX��)l�W�a9:%<9D;7;:Lwf2D�<9<9:�f2W�:7-W�D��®W�a9A�DESV\Ea5[W�L�hV?BA�:< W�L��Gl�?B<V7`�`5�W�Ld:�K�Xkl�?E<V7`� Ú N���Q�f2DE<pLd58LkW�5[<V\oDBXYW�a9:%f�a95MKM7;A�:<sDBXb� ?B<V7-W�a9:%<9D;7;:L�fDE<9<V:�fzW�:�7-W�D��ÊW�a9A�DESV\Ea5[W�Lqf�a95MK87;A�:�<>NO£'5[\�S9A�:+� Qz^+_ba9:%H%:�L�L�?B\E:JXZA�DEH�� W�D/:?Ef�aIDBXb5�W�Lqf�a95MKM7;A�:<I58L�W�a9:+hVA�D�TV?BT95MKM5�Wkc]DEX0:?Ef�a�Ld:WdW�5M<9\]DEX��\E5MFE:�<@W�a9:j:Fm587;:<pf2:jDETpLd:�A�F�:�7s5[<IW�aV:+Ld:Wr�6�uN���Qz^+��X��>5MLq?]í-�¦FG?EK[S9:7s795ML�f2A�:2W�:JFG?EA�58?BT9KM:El�W�a9:�<�W�a958LwH%:�L�L�?E\E:%58Lw?í]��7;5MH%:<VL�5[D�<V?BKYFE:�f2W�D�A�^]£9D�A�A�:�?EK���FG?BKMS9:�7IFG?BA�5M?ET9KM:�L�l�W�aV:oH%:�L�L�?E\E:j58L�?]hVA�D�TV?BT95MKM5�Wkc�7;:<pLd5[WkcsDGF�:A�W�a9:R7;D�Hj?B5M<ÊDBXFG?BKMS9:�Lk�®f�?B<]W�?BCE:�^w_ba9:3H%:L�L�?B\�:wXZA�D�H��ÊW�DR:�?Ef�a@DBXY5[W�L�hV?EA�:�<�W�LP58LPW�a9:Jh9A�DETV?ET95[KM5[WkcElg\E5MFE:�<-:F�:A�c�L�:2W�W�5M<9\RDEXnW�aV:hV?EA�:�<�Wl;DBX�W�a9:w:�F 587;:�<Vf2:wD�TVLd:�A�F�:�7o5[<RW�a9:qL�:2W<� Ú N���Q'�@ï&�}ð�^)_ba9:wHj?EA�\�5[<V?EKgh9A�D�TV?BTV5[KM5�WkcjDEX}?J<9D;7;:�58Luh9A�DEhiDEA�W�5MDE<V?EKW�D@W�a9:Rh9A�Dm79SVfzWJDBXbW�a9:�H%:�L�L�?E\E:LwDET;W�?B5M<9:�7IXZA�DEH�5[W�L3hV?BA�:< W�Ll'~e:�5[\�a W�:�7�TmcIW�aV:Rf2D�<V7;5[W�5MDE<V?EKYh9A�DETp?BT95MK[5[WkcIDBXuW�aV:<9D;7;:w\�5[F�:<�5�W�LuhV?BA�:< W�Ll9?E<V7+W�a9:wH%:�L�L�?E\E:�DET9W�?B5M<9:7+XZA�DEH�5�W�L6f�a95MKM7;A�:<�^)��X�W�a9:whV?BA�:< W�LbDBXf�s?BA�:Jï�� Û àç�çç2à���� ðq?E<V7  õ�övú]��÷ùø/y�¡`÷ùø�ú�%�öv÷(x(#0�73w���Oö0�Oö��v�����u��÷(� {vø�ú��#k7C� x(x(��)�÷(��.����&#6�dø�÷(�<�Oö��v�Gú]�OöM�¢ £ ��#v÷(����%�����#0. �¦ú�vöv÷(%dúxM�R�~#���xùøf¤"�wú�� ���<���u��)'� ���øW¥�ú���)ú����Oö�����÷(�R��� ���¦ú���'���~� x!7C� �$���������kø��/���O÷(��.K����� wGúwv÷(xù÷ ���<#v÷ùø����O÷(w�{6�O÷(� �vø�yú��#öGú����eú�#v÷ ¦-�/�����~��ø��u�}�79ø����6ú���¦÷(%køb§ ¨6yM©�ª�«��3¬r�f)�÷(x(xM#��dúxg�u­&%/x({ø¦÷ ����x ��)�÷ �Oö0#÷(����%u����#0. �¦ú�vöv÷(%dúxg�R�~#���xùø�÷(�<�Oöv÷ùø}�Gú���/�/�®�õ�övú]��÷ùø/y6�Oö��¯���~#��kø}7C� �')�ö÷(%�ök�Oö��v{���#÷(����%u����#+�Gú]�Oö0�����@. �&�kø}�¦ö���� {�.zö�ú��Gú���������73�A�

Page 5: An Introduction to Hidden Markov Models and Bayesian Networks

p1° p2°p3°

c1±c2 c3

e ³ (n)+´

e ³ (n)-

£�5M\ESVA�:w�9�Y�;:hV?EA�?BW�5MDE<oDEX':�Fm5M7;:�<Vf2:�5M<]Ld5M<9\EKMcofDE<9<9:fzW�:�7R\EA�?Bh9aVL�^

W�aV:qf�a95[K87;A�:<�DBXf�s?EA�:Jï6µÛvàç�çç2à]µ¶ð lmW�a9:�<ÝjN��Yâ �GQ¯·¹¸º¼»½u¾&¿ À(Á(Á(Á À ¾~Â6à ÝjN��Yâ � Û à�çççà����EQ �ãÄ ä'Û ÝjNÅ� Ä â � � NÅ� Ä QdQWÆÇ ¶

ãÈ ä�Û ÝjN�µ È à]� Ú N�µ È Q�â ��Q N�� Q

~ua9:�A�:uW�a9:�LdS9H%Hj?GW�5[D�<-NZD�AeH%DEA�:6\�:<9:�A�?EK[KMcqW�a9:P5M< W�:\�A�?EK8Q):2�mW�:�<V79LeDGFE:Ae?BKMKiL�:2W�W�5M<9\�LYDBX)ï��yÛvà�çççà�� � ð�^}£9DEAe:2�9?BH%h9KM:ElXZDEAbW�a9:q�b?vcE:Ld58?B<R<9:2Wk~0DEA�Cj5[<]£'5M\ES9A�:q�;l;\E5MFE:�<oW�a9:w:Fm587;:<pf2:E��á ï�æ áÊÉ�àU{áÌË9ð l

ÝjN�ÆRâ æ áÊÉ�àU{áÌË QÍ· Î�Ï ÝjN�ÆRâ T¥QdÝjN�T¥QvegTÑÐbÝjNWU{áÊËpàdæ áÒÉ}â Æ%Q NZ�mQ· ÝjN�ÆJQ}ÝjN�U{á�Ëiâ æ á�É�à�Æ3Q}ÝjN�æ áÊÉiQ NO��Q

~ua9:�A�:qÝjN�T¥Qb5ML6W�a9:�HJ:L�L�?B\�:�hV?EL�Ld:7RXZA�D�HaT W�D+ÆèL�5M<Vf2:@���uN�T¥Q0áÔÓ;lp?E<V7/ÝjN�U�áÑËVà�æ áÑÉ}â ÆJQb58LbW�a9:3H%:�L�L�?E\E:hV?�L�L�:�7oXZA�D�HaU�W�DjÆo^�Õn?EA�58?BTVK[:Lb5[<RW�a9:w:�Fm5M7;:�<Vf2:wL�:2WP?EA�:�A�:XZ:A�A�:7jW�D+?ELwÕ-�2ëÏ2ÓzÖGÒ-�~Y[ÏPFv?EA�58?BTVK[:Llm~ua95MK[:�W�a9D�L�:�<9DBW65M<W�aV:w:Fm5M79:<Vf:�L�:2WP?EA�:�A�:2XZ:�A�A�:�7+W�Dj?ELPÌ;Í�ÎEÎEÏÐoFG?EA�58?BT9KM:�L�^

Ö�×/Ø ÙÒÚ�Û�ÜvÝßÞ/àÑáVÜ'Úbâ}ãgÞ/ÜfÛ�Û<â'ä�åVæ¯ç3èRã4658797;:�<�=@?BA�CEDGFJHJD;7;:�KMLeX�?EK[Ky5M<R?JLdSVTifKM?�L�L0DBX'�0?vc�:�L�5M?E<+<9:Wk~eD�A�C;LnCm<9DG~u<�?ELb7;cm<V?EHJ58f��0?vc�:�L�5M?E<j<9:2Wk~0DEA�C;Ll ~ua958f�a?BA�:3L�5MHJhVK[c]�b?vcE:Ld58?B<]<9:Wk~eD�A�C;L6XZDEA�HJD;7;:�K[5M<9\oW�5MHJ:%L�:A�5[:L�79?BW�?V^���<@W�5MHJ:%L�:A�5[:LPH%D;7;:KM5M<9\VliW�aV:J?�L�L�S9H%h;W�5MDE<-W�aV?BW?B<®:FE:�< WJf?E<®f?ESVL�:R?B<VDBW�aV:AJ:FE:�< W35M<ÊW�a9:RXZS;W�S9A�:�lnT9S;W%<9DEWJFm58f2:2��FE:�A�L�?9l}L�5[H%h9KM5�rp:�L3W�a9:/7;:Ld5M\E<`DEXuW�a9:/�b?vcE:Ld58?B<<9:Wk~eD�A�Cg��7;5[A�:�f2W�:7s?EA�f�L�L�a9D�S9KM7`éVDG~¯XZDEA�~0?EA�7@5[<sW�5MH%:E^+¤PL�L�5[\�<95[<V\/?oW�5MH%:j5[<p7;:2�IÅ6W�D/:?Ef�aIFv?EA�58?BTVK[:�lyDE<9:%DBX0W�aV:L�5[H%h9KM:�LdWPf?ESVL�?EKgHJD;7;:�KMLuXZDEA6?%Ld:U S9:<Vf:�DBX'7V?GW�?RïvÆgÛGàçç�çà�Æpßnð�58LbW�a9:�rVA�LkW��¦D�A�7;:�A0=@?BA�CEDGF%H%Dm79:K�~0:�aV?vFE:w?BKMA�:�?E79cH%:< W�5MDE<V:�7yl95M</~ua958f�aR:?Ef�a�Fv?EA�58?BTVK[:�5MLP7;5[A�:�f2W�KMc+5M<5éVS9:�<Vf2:7RD�<9KMc+Tmc+W�aV:wh9A�:�Fm5[D�SVL0Fv?EA�58?BTVK[:jN�£'5M\ES9A�:�� Q2�[�

ÝjN�Æ Û�Þ ß Qná{ÝjNOÆ Û QkÝjN�Æ å â Æ Û Q'ê~ê~ê�ÝjN�Æ ß â Æ ß�ÚyÛ Q4P?vFm5M<9\�DETVL�:A�FE:7+ïvÆgÛà�çç�çà�ÆpÇ�ð�lEW�a9:uH%D;7;:KV~u5[KMK9DE<VK[cqHj?ECE:bSVL�:uDBXiÆpÇ�W�D�h9A�:�7;58fzW)W�a9:uFG?BKMS9:uDBXyÆVÇ � Ûv^n��<9:6Ld5MH%h9KM:

~b?vc@DBXu:� W�:<V795[<9\s=-?BA�CEDGF-H%D;7;:�KML�5ML�W�D@?EK[KMDG~ a95[\�a9:A�DEA�7;:Aq5M< W�:�A�?�fzW�5MDE<pLwTp:Wk~e:�:<ÊFG?BA�58?BT9KM:�L�l�XZD�A�:�;?EH%h9K[:�l'?E<��ë�ìG��DEA�7;:�A�=@?BA�CEDGF]H%D;7;:KY?EK[KMDG~6Lw?BA�fL�XZA�DEH ïÆpÇ�Ú�ígà�çççà�ÆpÇ�ÚyÛðjW�D-ÆVÇz^R¤6<9DEW�a9:�Aq~0?vc-W�D]:2�mW�:<V7�=-?EA�C�DGF]HJD;7;:�KML58LuW�DRhpD Ld5[W6W�aV?GW�W�a9:3DETVL�:A�FG?GW�5MDE<pLu?BA�:�7;:hi:<p7;:< W�D�<-?ja958797;:�<-FG?BA�5M?ET9K[:�lV~ua958f�a]~0:q~u5[KMK}f?BKMK�W�a9:+ëzØ�ÒGØ�Ï2lg?B<p7�W�aV?BWW�aV:�L�:�U S9:�<Vf2:�DBXeë�Ø�ÒGØ�Ï2ën5MLb?J=-?BA�CEDGFJh9A�Dmf:�L�L�NO£'5[\�S9A�: � Q2^)4658797;:</=-?EA�C�DGF3H%D;7;:K8L0X�?BKMKg5[< W�D�W�a95MLufKM?�L�LeDBX'7;cm<V?BH%58f�b?vcE:Ld58?B<s<9:2Wk~0DEA�Cg^+¤6<9DEW�a9:�AqFE:�A�c-~0:KMK[�¦Cm<9DG~u<IH%Dm79:Kn5M<�W�a958LqfKM?�L�L�58L�W�aV:+K[5M<9:?BA��uD�?ESVL�L�58?B<sLdW�?BW�:��L�hV?Ef:%HJD;7;:�KOl?BK8L�DJCm<9DG~u<�?EL0W�a9:@îw?BKMHj?B<RrVK�W�:Al9~ua958f�a�f�?B<�Tp:�W�a9DESV\Ea W6DBX}?EL0W�aV:qf2DE< W�5[<mS9D�SVLk��LdW�?GW�:�F�:A�Ld5MDE<RDBX)4P=-=@L^

Page 6: An Introduction to Hidden Markov Models and Bayesian Networks

Y3ïY1 Y2 YT

£'5[\�S9A�:��p�n¤¥�0?vc�:�L�5M?E<+<9:Wk~eD�A�C+A�:hVA�:Ld:�<�W�5[<V\J?3rVA�LkW��¦D�A�79:Ab=-?BA�CEDGFjh9A�D;f2:L�L�^

Ö�×�ð ñ�ä5Ü�ä5â�ò�ãMókÜfà�âôÝõæRö�â|÷/ã��<oLdW�?BW�:2��L�hV?Ef:6H%Dm79:K8Llm?�L�:�U S9:�<Vf2:6DEX}�%��7;5[H%:�<VLd5MDE<p?BKVA�:�?EK���FG?BKMS9:�7%D�TVL�:A�Fv?BW�5MDE<jF�:�fzW�DEA�LbïÆyÛvà�çç�ç2à�Æißnð l�58LeHJD;7;:�K[:7TmcJ?�L�L�S9H%5M<9\�W�aV?BW0?GWn:?Ef�aJW�5MH%:�LdW�:�h+ÆVÇ'~0?�L)\E:�<9:A�?GW�:�7�XZA�D�H ?wí-��795[H%:<pLd5MDE<V?EK9A�:�?BK[��Fv?EK[SV:�73a95M7V7;:<+LdW�?BW�:6FG?BA�58?BT9KM:æ Ç lV?B<V7oW�ap?GWuW�aV:qLd:U�SV:<Vf:�DEX'æøo Lb7;:rV<9:q?3rVA�LkW��¦D�A�7;:�Au=-?BA�CEDGF%h9A�D;f2:�L�L��

ÝjNZæ Û�Þ ß à�Æ Û�Þ ß Qná{ÝjN�æ Û QkÝjNOÆ Û â æ Û QßãÇZä�å ÝjN�æ Ç â æ Ç�ÚyÛ QkÝjN�Æ Ç â æ Ç Q2ç N�� Q

_ba958L'X�?Ef2W�DEA�5M��?GW�5[D�<qDBXVW�a9:'|kDE5M< W)h9A�D�TV?BTV5[KM5�Wkc�H%:�?E<VL'W�ap?GW'W�a9:u�b?vcE:Ld58?B<q<V:2Wk~0DEA�C�XZD�A)LkW�?GW�:��L�hV?�f2:YH%D;7;:�KML}58L'5M7;:�< W�58f?BKW�DJW�aV?GW6DEX}4�=-=-LqNO£�5M\ESVA�: � Q0:�9f2:h9W0W�aV?GWuW�a9:wa958797;:�<]Ë®FG?BA�5M?ET9KM:�Lu?BA�:�A�:�h9KM?�f2:7oTmc+a958797;:�<]æÉFG?EA�58?BT9KM:�L�^

_ba9:�LdW�?BW�:wW�A�?E<VL�5�W�5[D�<�hVA�D�TV?BT95MKM5�Wkc/ÝjNZæ Ç â æ Ç�Ú�Û Q6f�?B</Ti:37;:f2DEH%hiD�L�:�7/5M< W�Do7;:W�:�A�H%5M<95MLdW�58fq?E<V7]LkW�D;f�aV?ELdW�58fqf2D�HJ�hiDE<9:�<�W�L�

æ%Ç)áÌùvÇ�NZæ%Ç�Ú�ÛQ$úüûbÇ~ua9:�A�:lùGÇe58LuW�a9:37;:W�:�A�H%5M<95MLdW�58f�W�A�?E<VLd5[W�5MDE</XZSV<VfzW�5[D�<@7;:2W�:A�H%5[<95M<9\jW�a9:qH%:�?E<-DBX)æ%Ç0\E5MFE:<]æ%Ç�Ú�Ûvlp?E<V7^ûbÇb5ML�?j�:�A�DE�H%:�?E<RA�?B<V79DEHè<9D�5ML�:�FE:fzW�D�A�^n�m5MH%5[K8?BA�KMcElmW�aV:wDETVL�:A�FG?GW�5MDE<Rh9A�DETV?ET95[KM5[WkcoÝjN�ÆpÇ2â æ%ÇkQbf?E<RTi:q7;:�fDEH%hiD�L�:�7�?EL

Æ Ç á�ý Ç NZæ Ç Q}úüþ Ç ç��XeTiDBW�aIW�a9:JW�A�?B<pLd5[W�5MDE<I?B<V7sDES;W�h9S;W�XZS9<Vf2W�5MDE<VLw?EA�:JKM5[<9:?BAq?E<V7]W�5[H%:2��5M< FG?EA�58?B< Ww?B<V7@W�a9:j7;58LdW�A�5[T9S9W�5MDE<IDBXYW�a9:jLkW�?GW�:?B<p7oD�TVLd:�A�FG?BW�5MDE<�<9DE58Ld:�FG?BA�58?BT9KM:�L058L�D�?BSVL�Ld58?B<�lmW�a9:wH%D;7;:K�Tp:f2DEH%:Lu?3KM5M<9:�?EAd��D�?BSVL�L�5M?E<RLdW�?GW�:2��Ldhp?Ef2:�H%D;7;:K¦�

æ Ç á X æ Ç�ÚyÛ úüû Ç N¦§EQÆ Ç á \�æ Ç úÿþ Ç N ª Q

~ua9:�A�: X 58L0W�a9:qLdW�?BW�:�W�A�?B<pLd5[W�5MDE<�Hj?GW�A�5[�R?B<V7^\¯5MLbW�a9:wDETpLd:�A�FG?GW�5[D�<oHj?GW�A�5[�y^�PX°W�:�<�lvW�aV:eD�TVLd:�A�FG?BW�5MDE<VL'f?E<qTp:b7;5MFm5M7;:7�5M< W�D�?�L�:2W}DBXV5M<9h9S9WbN�DEA}h9A�:�7;58fzW�DEAzQyFG?BA�5M?ET9KM:�L�?E<V7qD�S;W�hVS;W6NZDEA'A�:�L�hpD�<VLd:vQ

FG?BA�5M?ET9KM:�L�^}¤P\�?E5[<�l9?�L�L�S9H%5M<9\3KM5M<9:�?EA�5[Wkco?B<p7^D�?ESVL�Ld58?B<R<9DE58Ld:�~0:qf?E<R~uA�5�W�:�W�a9:qLdW�?BW�:�W�A�?B<pLd5[W�5MDE<oXZS9<VfzW�5[D�<-?ELæ Ç á X æ Ç�ÚyÛ úøZ L Ç úüû Ç à N © Q

~ua9:�A�: L}Çu58LPW�a9:%5[<Vh9S;WwDETVL�:A�FG?GW�5[D�<]FE:�f2W�D�A�?E<V7`Z�5ML�W�a9:35M<9h9S9W�Hj?BW�A�5��y^w_ba9:j�b?vcE:�L�58?B</<9:2Wk~0DEA�C]f2D�A�A�:�L�hpD�<V7;5M<9\W�D/W�a958LqH%D;7;:Kn~0DESVKM7I5M<Vf2KMSV7;:+?]L�:�U S9:�<Vf2:jDEX0<9D;7;:LlL Û�Þ ß :�?�f�aIDEX0~uaV5Mf�a�58Lq?/hV?BA�:< WqDEXeW�a9:of2D�A�A�:�L�hiDE<V7;5M<9\�æ Ç ^Ä�5M<9:?BA��uD�?ESVL�L�58?B<oLdW�?BW�:2��L�hV?Ef:�H%D;7;:�KMLu?EA�:�SVL�:�7R:2�mW�:�<VL�5[F�:KMc+5[<]?EK[K�?EA�:?EL0DBX)f2D�<�W�A�D�Ky?B<V7�Ld5M\E<p?BKyh9A�D;f2:�L�L�5[<9\p^

� aV?BWbHj?ECE:�LbaV5M7979:<]=-?BA�CEDGF%H%D;7;:K8L6?E<V7RLdW�?BW�:��L�hV?Ef:�H%D;7;:�KML6L�hi:�f258?BKy58LbW�aV?GWbW�aV:5MA6a958797;:<]LdW�?BW�:qL�hV?Ef:�Lb?BA�:f2KMD�L�:�7%SV<V7;:AYW�a9:�5[A0A�:�L�hp:fzW�5MFE:6LdW�?BW�:PW�A�?B<VL�5�W�5[D�<%h9A�D�TV?BTV5[KM5�W�5[:LY?E<V7%DES;W�h9S;W0HJD;7;:�KML�^}��<o4P=@=-Ll�W�aV:Pa958797;:�<oLkW�?GW�:65ML?EL�L�S9H%:�7�W�D�aV?vFE:b?�í]��FG?BKMS9:�7J7;58L�fA�:W�:�N�?9^ Cg^ ?V^�H3S9K[W�5M<9DEH%58?BK°Q}7;5MLdW�A�5MT9S;W�5MDE<�^'�P<V7;:An?�íÈñ�íèW�A�?E<VL�5�W�5[D�<3Hj?GW�A�5[�qDE<V:DET9W�?B5M<VLw?E<9DBW�a9:Aqí-�¦FG?BKMS9:7-H�SVK�W�5[<9D�H%5M?EKY7;58LkW�A�5MT9S;W�5[D�<�^j��<`�9�;=-L�W�a9:ja958797;:�<�LdW�?BW�:%58Lq?EL�LdSVHJ:7-W�D/Tp:nD�?ESVL�L�58?B<7;58LkW�A�5MT9S;W�:�7y^ê¤6X°W�:AR7;cm<V?BH%58fLjf2D�<VL�5MLdW�5M<9\IDBX�?IKM5[<V:�?BA%W�A�?E<VLdXZDEA�H%?BW�5MDE<`~u5[W�a�D�?ESVL�L�58?B<®<VDE58Ld:]?E7V7;:�7yleDE<9:]?E\�?B5M<DET9W�?B5M<VLb? D�?BSVL�Ld58?B<�7;58LkW�A�5MT9S;W�:�7Ra95M7V7;:</LkW�?GW�:E^)_ba958Luf2KMD�L�:�7jh9A�DEhi:A�WkcjDBX'4P=-=-Lu?E<V7/�9�;=-L0Hj?BC�:�L05[<9XZ:A�:<Vf:�?E<V7KM:�?BA�<95M<9\JhV?BA�W�58f2S9K8?BA�KMcoLd5MH%h9KM:�?E<V7/?Bh9hi:�?EK[5M<9\%5M<RW�a9:�L�:�H%Dm79:K8L^

� � ¶6´w&n#]1#�� ´q#/* "�#��B¶6&)¶P#/.u¶¤È�b?vcE:�L�58?B<@?Eh9h9A�D�?Ef�a-W�D/K[:?BA�<95M<9\�LdW�?EAdW�L�~u5�W�a�L�DEH%:]Ò3×iÓzÍ�ÕBÓzÍ}C <VDG~uK[:7;\E:%?BTiDES;W�W�a9:%HJD;7;:�KnLkW�A�SpfzW�SVA�:2x>W�a9:jLd:WDBXY?EA�f�L65M<]W�aV:3�b?vcE:Ld58?B</<9:Wk~eD�A�C�x{?B<V7/H%D;7;:K'hV?EA�?EHJ:W�:�A�L�^6_ba958LP5M<95[W�58?BK'C <VDG~uK[:7;\E:q58L�A�:�h9A�:Ld:�< W�:�7/5M<]W�a9:qXZD�A�HDBXY?+h9A�5MDEA�h9A�DETV?ET95[KM5[WkcR7;58LkW�A�5MT9S;W�5[D�<-DGFE:�A6H%D;7;:K}LkW�A�SpfzW�SVA�:LP?B<p7/hV?BA�?BH%:2W�:A�Lli?B<V7-5MLPS9hi7V?GW�:7]SVL�5[<V\+W�aV:379?BW�?%W�DDET9W�?B5M<`?]hiD�LdW�:�A�5MDEAqhVA�D�TV?BT95MKM5�WkcI7;5MLdW�A�5MT9S;W�5MDE<ÊDGF�:AwH%D;7;:K8LJ?B<V7�hV?EA�?EH%:2W�:�A�L�^/=]DEA�:%XZDEA�Hj?BKMK[c�l'?�L�L�S9H%5[<V\-?]h9A�5[D�A

Page 7: An Introduction to Hidden Markov Models and Bayesian Networks

7;58LkW�A�5MT9S;W�5[D�<+DGFE:�AnH%D;7;:K8LeLdW�A�SVf2W�S9A�:�LeÝjN�� Qn?E<V7j?qhVA�5MDEAY795MLdW�A�5[TVS;W�5MDE<+DGF�:Anhp?BA�?BH%:2W�:A�L}XZDEA0:�?�f�ajHJD;7;:�KiLdW�A�SVf2W�S9A�:ÝjN�iâ � Q2lV?%79?GW�?JL�:2W� 58LuSVL�:�7oW�D%XZD�A�H ?JhiD�LdW�:�A�5MDEAu7;58LkW�A�5MT9S;W�5[D�</DGFE:AbH%D;7;:K8LbSVL�5[<V\%�b?vc�:�L0A�SVK[:

ÝjN��¸â JQná d ÝjN �â �9à�� QkÝjN�iâ � Qve��qÝjN�� QÝjNJQ N � G Q

~ua958f�aI?vF�:A�?B\�:�L6DGF�:A�W�a9:jSV<Vf2:�AdW�?B5M<�Wkc]5M<sW�a9:%hV?EA�?EHJ:W�:�A�L�^3£VDEAw?�\E5MFE:<sH%Dm79:KYLdW�A�SVfzW�S9A�:Ely~0:%f�?B<�f2D�HJhVS;W�:JW�aV:hiD�LdW�:A�5MDEAu7;58LkW�A�5MT9S;W�5[D�<�DGF�:A0W�aV:whV?BA�?BH%:2W�:A�L�

ÝjN�iâ ��à�JQná ÝjN�â �9à�� QdÝjN�pâ � QÝjN �â � Q ç

��X�W�a9:@7V?GW�?ÊL�:2WR5ML+L�DEH%:-L�:�U S9:�<Vf2:]DEX�D�TVLd:�A�FG?BW�5MDE<VL�¿á ïÆ Û à�ççç�à�Æ ß ð@?E<V7 ~e:]~u58L�a W�D`h9A�:�7;58fzWjW�a9:-<9:�mWDETpLd:�A�FG?GW�5[D�<�l;Æpß � Û�TV?�Ld:7�DE<�DES9A679?BW�?%?B<p7oH%D;7;:K8L�l;W�a9:�<�W�a9:q�b?vcE:Ld58?B<oh9A�:7;58fzW�5MDE<

ÝjNOÆpß � Û�â JQeá Ï ÝjNOÆpß � Û�â �Và���à�%QkÝjN�iâ ��à�JQkÝjN��¸â JQ¯e��@e��?vFE:�A�?E\E:LwDGFE:�AqTpDEW�a®W�a9:�S9<Vf:A�W�?B5M< Wkc�5[<®W�a9:�H%Dm79:KuLkW�A�SpfzW�SVA�:�?B<V7Ê5M<`W�a9:�hV?BA�?BH%:2W�:A�L^�_ba958L�58LJCm<9DG~u<®?EL�W�aV:×iÓ�Ï�ÎBÍ�ì2ئͰÖGÏJÎBÍ8ëzØOÓzÍ��~q;ØOÍ�ÕBÐjXZDEAbW�a9:wH%D;7;:K¦^

� :RD�T;W�?E5[<>?sL�DEH%:~uap?GW35MH%hpDGF�:A�5ML�a9:7ÊTmcÊ<9DE<9:W�a9:�K[:L�LJSVL�:2XZSVK0KM5MHJ5[W�5M<9\Êf?�Ld:RDBX6W�a9:]�b?vcE:�L�58?B<`?BhVh9A�D ?Ef�a�W�DKM:�?BA�<95M<9\+5[Xn~e:J?EL�LdSVHJ:3?+Ld5M<9\�K[:3HJD;7;:�K'LdW�A�SVf2W�S9A�:�� ?B<p7]~e:�:�LdW�5MH%?BW�:�W�a9:3hV?BA�?BH%:2W�:A�FE:�f2W�D�A���+W�aV?GW�H%?B�;5[H%58Ld:LW�aV:�KM5MCE:KM5Ma9DmDm7®ÝjN �â �9à�� Q3S9<p7;:AJW�ap?GWjH%Dm79:K¦^`��<`W�a9:RKM5MHJ5[WjDBX�?sK8?BA�\E:R7V?GW�?IL�:2Wj?B<V7 ?B<®SV<95[<9XZDEA�H%?BW�5MFE:INZ:E^ \V^S9<95[XZDEA�H+Qbh9A�5[D�AuDGFE:�AbW�a9:whV?EA�?EH%:2W�:�A�L�lmW�aV:qhpD LkW�:A�5[D�A6ÝjN�pâ ��à�%Qb~u5[KMK�Ti:�L�aV?BA�h9KMc+hi:�?BC�:�7/?BA�DESV<V7RW�a9:wHj?G�;5MHj?%DBXW�aV:�KM5[C�:KM5[a9DmD;7ylg?B<V7�W�a9:A�:2XZD�A�:qW�a9:3h9A�:7;58fzW�5MDE<pL6DBXY?oLd5M<9\EKM:qHj?G�;5MH�S9HµKM5[C�:KM5[aVD D;7ÊNO=-Ä�QPH%Dm79:K�~u5MKMK�Ti:3L�5[H%5MKM?EA6W�DW�aVD�L�:�D�T;W�?E5[<V:�7�Tmco�b?vcE:�L�58?B<+5M< W�:\�A�?BW�5MDE<�DGFE:�AYW�a9:whV?BA�?BH%:W�:A�L�^

£9D�A�<VDG~�~e:�XZD;f2SVL�DE<@W�a9:%h9A�DETVK[:�H DEXe:LkW�5[Hj?GW�5[<V\R=-Ä>hV?EA�?EHJ:W�:�A�L6XZDEAw?+\�5[F�:<@H%D;7;:�K}LdW�A�SVf2W�S9A�:E^q¤PK�W�a9DES9\�aW�aV5MLj58L%W�a9:-H%D�LdW+~u5M79:KMc®SVL�:�7 ?BhVh9A�D ?Ef�a®W�DÊKM:�?BA�<95M<9\�a958797;:<{=@?BA�CEDGFÊH%D;7;:K8Ll05[WoDE<9KMc®fA�SV79:KMc ?BhVh9A�Dv�;5MHj?GW�:L�b?vcE:Ld58?B<]KM:�?EA�<95M<9\plg?E<V7@f�?B<shp:�AdXZD�A�H f�?GW�?�LkW�A�D�h9a958f?EK[KMcR~uaV:<s7V?GW�?R58L�L�f?EA�f:3?E<V7��vD�APW�a9:JHJD;7;:�K)5ML�fDEH%h9KM:2�y^w��<h9A�?Ef2W�58f2:�?E<o:�;?�fzWu�b?vcE:�L�58?B<+?B<p?BKMcmL�58LnDBX'4P=-=-Lb58L05[H%h9A�?Ef2W�58f?EKOl ~ua958f�ao58Le~uamcjH%D�LdWbA�:Ld:?BA�f�ajaV?ELYXZD;f2SVL�:�7oDE<R=@Ä?BhVh9A�D ?Ef�a9:L�DEAqA�:\�S9KM?EA�58L�:�7I=-Ä{?BhVh9A�D ?Ef�a9:L^j��<`L�:�f2W�5MDE<®§�~0:j~u5[KMKnW�?Ef�CmKM:jh9A�?�fzW�5Mf�?BKn?BhVh9A�D ?Ef�a9:L�W�D/XZS9KMK[��éV:7;\E:7�b?vcE:Ld58?B<RK[:?BA�<95[<V\V^��×/Ø �����Fã!ä3Þ/ÝõÜ�ä5Þ/æbÛ å�Þuä! #"pæbÝõók÷�â$ägâÔÙÊÜ�ä5ܤPL�L�S9H%:Y~0:Y?BA�:)\E5MFE:�<q?679?GW�?6L�:2W�DEX;5[<V79:hi:<V7;:�< W}?E<V7�5M79:< W�58f?EK[KMc�795MLdW�A�5[TVS;W�:7wDETVL�:A�FG?GW�5[D�<VL$ á�ïvÆ&% Û�' àç�ççà�Æ(%*) ' ð�l:�?�f�a-DBXe~ua95Mf�aIf?E<@Ti:J?RFE:fzW�D�A�D�APW�5[H%:%Ld:�A�5M:�L�DBXeFE:�f2W�D�A�L�^w_ba9:3KM5MCE:KM5Ma9DmDm7@DBXnW�a9:%79?GW�?RL�:2W�5ML�?oXZS9<VfzW�5[D�<sDEXnW�aV:hV?EA�?EHJ:W�:�A�L0DBX�W�a9:wH%D;7;:�KO�

ÝjN�â �9à�� QYá )ãÄ ä�Û ÝjNOÆ % Ä ' â �Và�� Q

£9D�A�<9DBW�?GW�5MDE<p?BK)f2D�< F�:<95M:<pf2:�~0:Ja9:<Vf:2XZD�AdW�aI7;A�DEh@W�a9:%5MH%h9K[58f25[W�f2D�<V7;5[W�5MDE<95M<9\�DE<@W�a9:%H%D;7;:KnLdW�A�SVfzW�S9A�:El+��^3_baV:=-Ä�hV?EA�?EH%:2W�:�A�Lb?EA�:�DET;W�?B5M<9:�7RTmcoHj?G�;5MH%5ML�5[<V\3W�a9:wKM5[C�:KM5[a9DmD;7yl;D�Au:�U S95MFv?EK[:�< W�KMcjW�a9:wKMDE\%KM5[C�:KM5[aVD D;7y�

, N���QYá )» Ä ä'Û KMDE\eÝjN�Æ % Ä ' â ��Qzç��XwW�aV:sD�TVLd:�A�FG?BW�5MDE<êFE:fzW�DEA+5M<Vf2KMSV7;:L/?BKMK6W�aV:sFG?BA�58?BT9KM:�Lo5[<êW�a9:s�b?vc�:�L�5M?E<><V:2Wk~0DEA�CilbW�a9:<�:�?�f�a W�:A�H�5[<{W�a9:IK[D�\KM5[C�:KM5[a9DmD;7oXZS9AdW�a9:A6X�?EfzW�DEA�Lb?EL��

K[D�\YÝjN�Æ % Ä ' â ��Q á KMDE\ ã È ÝjNOÆ % Ä 'È â Æ % Ä '-/. % È ' à�� È Q N �E� Q

á » È K[D�\eÝjN�Æ % Ä 'È â Æ % Ä '-/. % È ' à�� È Q2à N � ��Q

Page 8: An Introduction to Hidden Markov Models and Bayesian Networks

~ua9:�A�:10s5M<V7;:�m:L�DGF�:AwW�a9:o<VDm79:�Lq5M<`W�a9:R�b?vc�:�L�5M?E<s<9:Wk~eD�A�Cgl}hV?pN*0mQw58LwW�a9:�L�:2W3DBX6hV?EA�:�<�W�LqDEX20Vl)?E<V73� È ?BA�:jW�aV:hV?EA�?EHJ:W�:�A�L'W�aV?GWe79:2rV<9:bW�a9:PfDE<V7;5[W�5MDE<p?BK9h9A�DETp?BT95MK[5[Wkc�DEXgÆ È \E5MFE:�<J5[W�LYhV?BA�:< W�L^'_ba9:6KM5[C�:KM5[a9DmD;73W�a9:�A�:XZDEA�:67;:�fDES9hVK[:L5M<�W�DjK[D;f�?BKyW�:A�H%L65[<mFED�K[Fm5M<9\%:�?�f�aR<9D;7;:3?B<V7�5[W�L6hp?BA�:< W�L�l9Ld5MH%h9KM5�XZcm5M<9\jW�aV:q=-ÄÊ:�LdW�5MHj?GW�5[D�<�hVA�D�T9K[:�H/^e£9D�Au:2�9?BH%h9KM:El5[XnW�a9:%ÆèFG?EA�58?BT9KM:�L�?BA�:37;58L�f2A�:2W�:J?B<V74� È 5MLPW�a9:%f2D�<V7;5[W�5MDE<V?EK�hVA�D�TV?BT95MKM5�Wkc�W�?ET9KM:qXZDEA�Æ È \E5MFE:�<-5�W�LPhp?BA�:< W�L�liW�a9:�<-W�aV:=-Ä�:LkW�5[Hj?GW�:�DBX5� È 58LuLd5MH%h9K[c�?%<9DEA�Hj?BKM5ML�:�7+W�?ET9K[:qfDE< W�?E5[<V5[<9\%f2D�S9< W�LuDEX�:?Ef�a/Ld:WdW�5M<9\jDEX}Æ È \�5[F�:<R:�?Ef�a/L�:2WdW�5[<V\jDBX5[W�LuhV?EA�:�< W�L05[<�W�a9:q79?GW�?%Ld:W�^��×�ð �����Fã!ä3Þ/ÝõÜ�ä5Þ/æbÛ å�Þuä! 76ÔÞ/ökö�â}Û78`ÜfçAÞ/Ü59k÷�â|ã�:4;< �â=�>� Üf÷�?¯æ¯çAÞ�ä! <Ý� 5[W�a/a958797;:<]FG?EA�58?BT9KM:�LeW�a9:wK[D�\%K[5MCE:�K[5Ma9DmD;7Rf�?B<9<9DEWuTp:q7;:f2D�HJhiD�L�:�7�?ELb5M<ÊN � �EQz^)t6?BW�a9:�A�lV~e:�rV<V7��, N���QYá{K[D�\YÝjN�Æ�â � QYá KMDE\K» @ ÝjNOÆYà�æ â � Q N � � Q

~ua9:�A�:næ 58LyW�a9:eL�:2W�DBX;a958797;:<�Fv?EA�58?BTVK[:Llv?B<V7�A @ 58LyW�a9:eL�S9H NZD�A�5M<�W�:\�A�?EK8QgDGF�:Ayæ A�:�U S95MA�:7�W�D6D�T;W�?E5[<�W�a9:YHj?EA�\�5[<V?EKh9A�DETV?ET95MK[5[Wkc]DBX0W�a9:+7V?GW�?V^�N � :oaV?vFE:%7;A�DEh9hi:�7@W�a9:+L�S9hi:A�L�fA�5Mh;W+NBkQ�5M< N � � QPTmc-:�FG?BKMSV?GW�5[<9\�W�a9:jK[D�\/K[5MCE:�K[5Ma9DmD;7-XZD�A?/Ld5M<9\�K[:JDETVL�:A�FG?GW�5[D�<�l�?B\ ?B5M<-XZDEAw<VDBW�?BW�5MDE<V?EK)f2DE<mF�:<95M:<Vf:E^ùQÊ=-?B�m5MH%5ML�5M<9\ÊN � � QP795[A�:�f2W�KMc-5ML�DEX°W�:�<�795�é+f2SVK�WwTi:�f?ESVL�:W�aV:�KMDE\jDBX}W�a9:3L�S9Hµf?B<]hiDBW�:< W�58?BKMKMc�fDES9h9KM:�?EK[K�DBX}W�a9:3hV?BA�?BH%:W�:A�LuDEX'W�a9:�H%D;7;:�KO^ � :�f?E<-Ld5MH%h9KM5�XZc�W�aV:�h9A�DET9KM:HDBX)Hj?G�;5MH%5ML�5[<V\ , ~u5[W�a-A�:�L�hi:�fzWPW�DC�+Tmc�Hj?BCm5[<V\+SVL�:qDBX)W�a9:qXZD�K[KMDG~u5[<V\j5[<VL�5M\Ea W�^6¤P< c/7;58LkW�A�5MT9S;W�5[D�<EDjN�æsQbDGFE:�AuW�aV:a958797;:�<�FG?EA�58?BT9KM:�Lb7;:rV<9:L6?�Y[ÕGFYÏÓl��ÕJq;ÐgÎ�DE< , �

KMDE\K» @ ÝjNOÆYà�æ â � Q á KMDE\�» @ DjN�æsQ ÝjNOÆYà�æ â � QD+NZæsQ N � �mQ

H » @ DjNZæIQmK[D�\ ÝjNZæ@à�Æoâ ��QDjN�æsQ N � ��Q

á » @ DjNZæIQmK[D�\YÝjNZæ@à�Æoâ ��Q}Üü» @ DjNZæsQ;K[D�\IDjNZæsQ N � � Qá J/N�D%à���Q N � §EQ

~ua9:�A�:YW�a9:e5[<9:U SV?BKM5�Wkc�58L�Cm<9DG~u<3?EL�¨�:<pLd:�<$o L�5M<9:�U SV?EK[5[Wkcw?B<V7�XZD�K[KMDG~6LyXZA�DEH�W�a9:YX�?�fzW�W�aV?BW�W�a9:YKMDE\�XZS9<Vf2W�5MDE<�58L'f2DE<pf?vFE:�^��Xn~0:37;:rV<9:qW�a9:�ÏÐiÏÓ��EÙwDBXY?o\EKMDETV?EK�f2D�<;rV\�S9A�?BW�5MDE<ÊNZæ@à�Æ�Q6W�D+Ti:JK[D�\YÝjNZæ-à�Æoâ ��QzliW�aV:<sL�DEH%:qA�:�?�7;:A�LuHj?vc�<9DBW�5Mf:W�ap?GW�W�a9:JKMDG~e:�A�TiDES9<p7KJ/N�D%à���QML , N��Q�58L�W�a9:%<9:�\�?GW�5[F�:�DEXe?RU SV?E< W�5[Wkc]C <VDG~u<@5M<sLdW�?GW�5MLdW�58f?EK}h9amcmL�58fL�?EL�W�aV:+��Ó�Ï�ÏÏÐiÏÓ��BÙG��W�a9:o:2�;hp:fzW�:�7I:<9:�A�\�c@S9<p7;:A1D�H%5M< SpLwW�aV:j:< W�A�DEhmc@DEX�Dî« � �¬�^/_ba9:+�)�;hi:�fzW�?GW�5[D�<;��=@?G�;5[H%5M��?BW�5MDE< N��Y=sQ?BKM\ED�A�5[W�aVH « �pl � �v¬'?BK[W�:�A�<p?GW�:LbTp:Wk~e:�:<]Hj?G�;5MH%5ML�5[<V\(Jè~u5�W�a]A�:Ldhi:�f2WuW�DNDÈ?E<V7O�9lVA�:�L�hp:fzW�5[F�:KMcEl9a9D�KM795[<9\%W�a9:qDEW�a9:�Ar9�;:�7�^Y� W�?EAdW�5[<9\JXZA�DEH L�DEH%:�5M<95�W�5M?EK�hV?EA�?EHJ:W�:�A�LP�RQE�SUTWVWX�YPZ D@� � Û�[ ?BA�\nHj?G�D J�N\D%à����GQ N ��ª Q]^T/V_X�Y2Z � � � Û [ ?EA�\YH%?B�� J/N�D � � ÛBà���Q N ��© Q

��WP58Lu:�?�Ldc+W�D+L�a9DG~{W�aV?GW6W�a9:qHj?G�;5MH�S9H�5[<�W�a9:�� LkW�:h]58LuDET9W�?B5M<9:7RTmc�Ld:WdW�5M<9\ND@� � Û N�æsQYá�ÝjNZæ â Æeà����GQzli?GW6~ua958f�ahiDE5M<�W�W�a9:%TpD�S9<V7sTp:f2DEH%:Lw?B<@:U SV?BKM5�Wkcg�`J�N\D@� � Û à����BQ�á , N���BQ2^J_baV:JHj?B�m5MH�SVH 5[<sW�a9:j= LkW�:hI5ML�D�T;W�?E5[<V:�7-TmcHj?G�;5MHJ58L�5[<9\JW�a9:�rVA�LkWbW�:�A�H�5[<ÊN � ��Q2l9Ld5M<Vf:�W�a9:w:< W�A�D�h coDBX5D 7;Dm:Lb<9DBW67;:�hp:�<V7/DE<O�9�]^TWVWX�Y2Z �J� � Ûa[ ?EA�\YH%?B�� » @ ÝjNZæ>â Æeà����GQmKMDE\YÝjN�æ-à�ÆRâ ��Q2ç_ba958L658L6W�a9:�:�;h9A�:L�L�5MDE</H%D�LdWPDBX°W�:<@?�L�L�D;f258?GW�:7�~u5�W�a]W�a9:J�Y= ?EK[\�DEA�5�W�a9Hî« � �v¬¦liT9S;W�5�W�DETVL�f2S9A�:�LuW�a9:3:KM:\�?E< WP5[< W�:A��h9A�:2W�?GW�5MDE<]DEXn�Y= ?EL�f2DmDEA�7;5M<V?GW�:q?EL�f2:�<�W65M<4J�^P�m5M<Vf2:1Jèá , ?GW6W�a9:�Ti:\�5[<V<95[<V\+DBX):�?�f�a-= LkW�:h�lg?B<p7-Ld5M<Vf:wW�a9:3�LdW�:h]7;Dm:Lb<9DBWPf�aV?E<9\E:`�9l9~0:w?BA�:�\ESV?EA�?E<�W�::7+<9DEW0W�D+7;:�fA�:?EL�:PW�a9:wKM5[C�:KM5[a9DmD;7�?GX°W�:�Au:�?�f�a�fDEH�TV5[<9:7/�Y=îLkW�:h�^

��W�58L�~0DEA�W�am~ua95MKM:}W�DPhiDE5M< W�DES9W�W�ap?GW�5[W�58L�SpLdSV?EK[KMc�<9DBW�<V:�f2:L�L�?BA�c6W�D6:2�;h9KM58f25[W�KMc�:�FG?BKMSV?GW�:)W�a9:ehpD LkW�:A�5[D�A�7;58LkW�A�5MT9S;W�5[D�<ÝjNZæ>â Æeà�� � Qz^��m5[<pf2:]KMDE\YÝjN�æ-à�Æ�â ��Q%fDE< W�?E5[<pL%TpDEW�aêa958797;:�< ?E<V7>DETVL�:A�FE:7`FG?BA�58?BT9KM:�L%5M<>W�a9:-<V:2Wk~0DEA�Cile5�Wof�?B< Ti:X�?Ef2W�D�A�:7J?�L}Tp:XZDEA�:P?EL'W�a9:PL�S9H DBXgK[D�\wh9A�D�TV?BTV5[KM5�W�5[:L)DBXg:�?�f�a%<9D;7;:u\E5MFE:�<J5[W�LnhV?BA�:< W�L�^¯IeDE<VL�:�U S9:�<�W�K[c�lBW�a9:6U SV?B< W�5[W�5M:�LA�:�U S95MA�:7wXZDEA'W�a9:u= LdW�:h%?BA�:nW�a9:b:2�;hi:�fzW�:�73FG?BKMS9:�L�lBS9<V79:A'W�a9:bhiD�LdW�:�A�5MDEA}7;58LkW�A�5MT9S;W�5[D�<JÝjN�æ â Æeà����GQ2lBDBX9W�a9:u?B<V?EK[D�\ED�SVLL�S;é+f25M:< WPLkW�?GW�5MLdW�58fLbA�:�U S95MA�:7+XZD�A6=-ÄI:�LdW�5MHj?GW�5MDE</5M<�W�a9:qfDEH%h9KM:2W�:w79?BW�?%f?�Ld:�^

Page 9: An Introduction to Hidden Markov Models and Bayesian Networks

��×�Ö �ObRÜfÝõó0÷�âßØc:K�@â}Ü�ç�Û<Þ/Ûd?e <Þ/ökö�â}Ûf� Üfç3èbæhg�Ý æRö<â}÷/ãjikãgÞ/Ûa?k�>�_�D�79:A�5[F�:oW�a9:-�Y= ?BKM\ED�A�5[W�a9H�XZD�AjK[:?BA�<95M<9\@W�a9:/hV?BA�?BH%:W�:A�LJDBX�?B< 4P=-= ~0:RrpA�LdWj<9::7`W�DI~uA�5[W�:/DES;W%W�a9:]K[D�\h9A�DETV?ET95MK[5[Wkc+DBX�W�a9:waV5M7979:</FG?BA�5M?ET9K[:Lu?B<V7RDETpLd:�A�FG?GW�5[D�<VL��

KMDE\YÝjN¦Ë Û�Þ ß à�Æ Û�Þ ß QnáêKMDE\eÝjNOË Û Q}ú ß» ÇZä'Û KMDE\YÝjNOÆ Ç â Ë Ç Q}ú ß» ÇZä�å KMDE\eÝjNOË Ç â Ë Ç�ÚyÛ Qzç N¦��G QÄ�:WjSVL%A�:�h9A�:�L�:< W3W�a9:]í]��FG?BKMS9:�7 7;5ML�f2A�:2W�:�LdW�?BW�:-ËgÇqSpLd5M<9\Êí]��7;5MHJ:�<VL�5[D�<V?BK0S9<95[Wof2D�K[S9H%<>FE:fzW�D�A�L�l):E^ \V^}W�a9:]LkW�?GW�:?GWJW�5MH%:/ÅqW�?ECm5[<9\IDE<®W�a9:/FG?BKMS9:ml���n-58L3A�:hVA�:Ld:�<�W�:�7 ?EL%ËgÇ%á « G � Guç�çç�GB¬ ob^ �Y?Ef�a®DBXPW�a9:�W�:�A�HjLJ5[<�NO�-G�QJf?E<®Ti:7;:f2DEH%hiD�L�:�7R5[< W�D%L�S9H%Hj?GW�5[D�<VLuDGFE:�AbËu^n£9DEAu:�9?BH%h9KM:ElmW�aV:�W�A�?B<VL�5�W�5[D�<RhVA�D�TV?BT95MKM5�Wkc+58L

ÝjN¦Ë Ç â Ë Ç�Ú�Û QnáqpãÄ ä'Û pãÈ ä�Û N\r ÄÅÈ Q�sGtu v\sGtw ¿ u x~ua9:�A�:�r ÄÅÈ 58LbW�aV:wh9A�D�TV?BTV5[KM5�WkcjDEX�W�A�?E<VL�5�W�5[D�<95[<V\�XZA�DEH LkW�?GW�:a0jW�DjLkW�?GW�:MB�l9?EA�A�?B<V\E:�7+5[<]?%í�ñ�íîHj?GW�A�5[��r�^n_ba9:�<

KMDE\YÝjN¦Ë Ç â Ë Ç�ÚyÛ Q á p» Ä ä�Û p»È ä�Û Ë Ç À Ä Ë Ç�Ú�Û À È KMDE\Pr ÄÅÈ N¦� � Q

á Ë oÇ N�K[D�\PrbQdË Ç�ÚyÛ N¦�E��QSVL�5[<V\�Hj?BW�A�5��@<VDBW�?BW�5MDE<�l�~ua9:A�:Co{58L�W�a9:jHj?GW�A�5[�-W�A�?B<VL�hiD�L�:�N�<9DBWwW�D�Ti:+f2D�<;XZSVL�:�7I~u5[W�aIW�a9:+L�:�U S9:�<Vf2:%KM:<9\EW�azy�Q2l?B<p7+KMDE\�?EA�5[W�aVH%LeDBX'FE:fzW�D�A�L0?B<p7+Hj?GW�A�58f2:L0?EA�:PW�?ECE:<R:KM:H%:< Wk~u58Ld:�^n�m5[H%5MKM?EA�KMcEl;5[X�W�a9:�5[<95[W�58?BK�LdW�?BW�:�h9A�DETV?ET95[KM5[W�5M:�Lb?BA�:?BA�A�?B<9\�:�7j5M<]?3F�:�f2W�DEA�{�l;W�a9:<

KMDE\YÝjN¦Ë Û Qná�Ë oÛ KMDE\|{�ç N¦�B� Q£'5[<p?BKMK[c�lmW�a9:w:�HJ58L�Ld5MDE<�h9A�DETV?ET95[KM5[W�5M:�Lb7;:hi:<p7RD�<oW�a9:�XZDEA�HèDEX�W�aV:wDETVL�:A�FG?GW�5MDE<pL^'��X}Æ Ç 58Lu?%7;58L�fA�:W�:�FG?BA�5M?ET9K[:�~ua958f�af?E<oW�?BC�:�D�<�� FG?BKMS9:LlmW�a9:<]~0:w?B\�?E5[<RA�:�h9A�:�L�:< W05[WPSVL�5M<9\ �%��795[H%:<pLd5MDE<V?EKyS9<95[W6FE:fzW�D�A�Lb?E<V7oD�T;W�?E5[<

KMDE\eÝjN�Æ Ç â Ë Ç Qná�Æ oÇ N�K[D�\2}�Q�Ë Ç~ua9:�A�:M} 5MLu? �µñ/íî:H%5ML�L�5[D�<Rh9A�DETp?BT95MK[5[Wkc+Hj?GW�A�5[�y^)_ba9:whV?BA�?BH%:W�:AuL�:2WbXZDEAbW�a9:q4P=@=�5ML~��á¥ïGr�à�{�à�}%ð�^

�m5M<Vf2:nW�a9:0LkW�?GW�:YFv?EA�58?BTVK[:L�?BA�:)a958797;:<�~e:Yf�?B<9<VDBW�f2D�H%h9S;W�:�NO�-G�Qy7;5MA�:�fzW�K[c�^�_ba9:e�Y= ?BKM\ED�A�5[W�aVH�l~ua958f�aw5[<�W�a9:ef�?EL�:DBXy4P=@=-Ln58L)Cm<9DG~u<%?EL}W�a9:6�b?BS9HJ� � :�KMf�aj?BKM\ED�A�5[W�aVH « �E¬¦l ?BKMK[DG~6L}SpL}W�Dqf5[A�f2S9H3FE:�<�W}W�a95MLYh9A�DET9KM:HÃT cJf2D�HJhVS;W�5M<9\�W�aV::2�;hi:�f2W�?GW�5[D�</DBXuNO��G Q0S9<V7;:�AuW�aV:whpD LkW�:A�5[D�A67;5MLdW�A�5MT9S;W�5MDE</DEX�W�a9:wa958797;:<-LdW�?BW�:Lb\E5MFE:<�W�a9:wDETVL�:A�FG?GW�5[D�<VL^ � :q7;:�<9DBW�:W�aV:w:2�;hp:fzW�:�7�FG?BKMS9:�DBX)LdD�HJ:wU SV?E<�W�5�Wkc�ù}NZæsQe~u5[W�a/A�:Ldhi:�f2WuW�DJW�aV:whpD LkW�:A�5[D�Ab795MLdW�A�5[TVS;W�5MDE</DBX'æÉTmc<��ù}NZæIQ��zl�Wù}NZæsQ��ná Ï @ ù}NZæsQ}ÝjN�æ â Æeà�� QfeEæ-ç N¦�G�mQ

_ba9:�:2�;hi:�fzW�:�7®Fv?EK[SV:oDBXJNO��G Qqf�?B<®Ti:�:2�;h9A�:�L�Ld:7Ê?ELJ?]XZS9<Vf2W�5MDE<>DBX��¦Ë Ç ��?E<V7��¦Ë Ç Ë|oÇ�ÚyÛ �oN � L ÅNL�y�Q2^Ê_ba9:+rVA�LdWW�:�A�H/l��OË Ç �2l058Lj?IFE:fzW�D�A+f2D�<�W�?B5M<95M<9\@W�a9:]h9A�DETV?ET95MK[5[Wkc�W�aV?BWjW�a9:-4�=-= ~0?�L%5[<>:�?�f�a DEX�W�a9:-í LkW�?GW�:�Lj?GW%W�5[H%:]Å\E5MFE:�< 5[W�LRf2S9A�A�:< WjhV?BA�?BH%:2W�:A�L%?B<V7 W�aV:]:< W�5MA�:-L�:�U S9:�<Vf2:]DEX�D�TVL�:A�Fv?BW�5MDE<VL��v^�_baV:-Ld:f2DE<p7`W�:A�H�lM�¦Ë Ç Ë oÇ�ÚyÛ �zlu58Lj?Hj?GW�A�5[�/fDE< W�?E5[<V5[<9\+W�a9:�|kDE5M< W�h9A�DETV?ET95MK[5[WkcoW�aV?GW�W�a9:J4P=-= ~0?�Lu5M<@:�?�f�a]DBX)W�a9:3í å hV?E5[A�L6DEX)LdW�?BW�:L�?BWPW�5MH%:�L�Å)Ü �?B<p7sÅz^j��<IW�a9:o4P=@= <VDBW�?BW�5MDE<IDBXw« �m�¬�lP�¦ËgÇ���f2DEA�A�:�L�hpD�<V79L�W�D��mÇ�?E<V7��OËgÇkË|oÇ�Ú�Û ��f2D�A�A�:�L�hiDE<V79L�W�D>�2Çz^nD�5[F�:<IW�aV:�L�::2�;hi:�f2W�?GW�5[D�<VL�l;W�a9:3= LkW�:h]58L6LkW�A�?E5[\�a WdXZDEA�~b?BA�7y�}~e:�W�?BCE:w7;:�A�5MFG?GW�5[F�:�LuDEXbN¦��G�Qu~u5�W�a]A�:Ldhi:�f2WuW�D%W�aV:qhV?BA�?BH%:W�:A�L�l9Ld:WW�D@�:A�DVl}?B<p7ÊLdD�K[F�:+LdS9T9|k:�fzW�W�D]W�a9:oL�S9HJ�OW�DB��DE<9:+fDE<VLdW�A�?B5M< W�L�W�aV?GW�:�<VL�S9A�:oFv?EK[587IW�A�?B<pLd5[W�5MDE<�l':H%58L�L�5MDE<`?B<p7�5[<95[W�58?BKLdW�?GW�:wh9A�DETV?ET95[KM5[W�5M:�L�^}£VDEA67;58L�f2A�:2W�:qÆpÇefD;7;:�7�5M<RW�a9:qL�?BH%:�~0?vco?�L6ËgÇ�N�5O^ :E^eÆVÇe5ML6fD;7;:�7�?ELu? �%��7;5MH%:<VL�5[D�<V?BKyTV5[<V?EA�cS9<95[W6FE:fzW�DEAzQzlmW�aV:q=îLdW�:�hR58L��

r ÄÅÈ · ß» ÇZä�å �¦Ë Ç À Ä Ë Ç�ÚyÛ À È � N¦�E��Q�]¬�ö�����x(��ú���v÷(��.}79��� �sú}#Gú]�¦ú'ø��u�3%�� �~�¦ú�÷(�v÷(��.��K{�x �O÷(��x(�iø����&{�����%��kø�y �Oöv÷ùø!�~{Gú�~�O÷ ���YöGú�ø5����w-��%/� �R�6{6����#eø����Gú��ú]����x �v79� �5�dú%�öeø����~{�����%����� � �$%�x�ú�¦÷ ����y�)'�f)�÷(x(x-#��kø�%��¦÷(w��f�Oö��)ø¦÷(��. x(�)ø����&{�����%��¯%dú�ø��¯� ��x ���

Page 10: An Introduction to Hidden Markov Models and Bayesian Networks

[ A ßÇZä�å �OËgÇ À Ä ËyÇ�ÚyÛ À È �A ßÇZä�å �¦ËgÇ�ÚyÛ À È � N¦�B� Q{ Ä [ �OË�Û À Ä � N¦��§EQ}d� Ä [ A ßÇZä�Û Æ Ç À � �OË Ç À Ä �A ßÇZä�Û �¦Ë Ç À Ä � ç N¦� ª Q

_ba9:w<9:f2:L�L�?BA�c%:2�;hp:fzW�?GW�5MDE<pL6?BA�:�fDEH%h9S;W�:�7�SVL�5[<V\3W�a9:�XZDEA�~b?BA�7�� TV?�f�Cm~0?EA�7j?EK[\�DEA�5�W�a9H/^��×� ;< �â=�æ¯ç5åVÜ�ç�öP�P9kÜfàAèKåpÜfçAö Üv÷�?¯æ¯çAÞ�ä� kÝ_ba9:uXZD�A�~b?BA�7��mTV?Ef�Cm~b?BA�7q?BKM\ED�A�5[W�a9H 58LY?B<j5M<VLdW�?E<Vf2:6DEXyTp:�K[5M:2X�h9A�DEhp?B\�?BW�5MDE<j?BhVh9K[5M:�7JW�DwW�aV:��b?vcE:Ld58?B<J<9:2Wk~0DEA�C3fDEA�A�:�L�hpD�<V7;5M<9\�W�Dw?�a958797;:�<%=@?BA�CEDGF�H%Dm79:K�NOLd:�:q« �B�G¬9XZDEAn?�A�:�f:< W}W�A�:�?BW�H%:< W�Q2^'_baV:bXZDEA�~0?EA�7�hV?EL�L}A�:f2S9A�L�5[F�:KMcqf2DEH%h9S9W�:�L� Ç lp7;:2rV<V:�7/?EL0W�a9:b|kDE5M< W6h9A�D�TV?BTV5[KM5�WkcjDEX)Ë Ç ?B<p7+W�a9:qLd:U S9:<Vf:�DBX}DETVL�:A�FG?GW�5MDE<pL0Æ Û W�DjÆ Ç �� Ç á ÝjNOËyÇ�à�ÆgÛ�Þ ÇkQ N¦� © Q

á ¸º »s t�w ¿ ÝjN¦ËgÇ�ÚyÛGà�ÆyÛ�Þ Ç�ÚyÛQkÝjN¦ËgÇ2â ËgÇ�Ú�ÛQ ÆÇoÝjN�ÆpÇâ ËgÇkQ NO�-G Qá ¸º »sGt�w ¿ � Ç�ÚyÛ ÝjNOË Ç â Ë Ç�ÚyÛ Q�ÆÇ ÝjN�Æ Ç â Ë Ç Q2ç NO� � Q

_ba9:wTV?�f�Cm~0?EA�7jhp?EL�Luf2DEH%h9S9W�:�L0W�a9:qf2D�<V7;5[W�5MDE<V?EKyh9A�DETV?ET95[KM5[Wkc+DBX�W�a9:wD�TVLd:�A�FG?BW�5MDE<VLbÆ Ç � Û W�DjÆ ß \E5MFE:�</Ë Ç �� Ç á ÝjNOÆVÇ � Û�Þ ßeâ ËgÇdQ NO����Qá »s t�� ¿ ÝjN�Æ Ç � åzÞ ß â Ë Ç � Û QkÝjNOË Ç � Û â Ë Ç QkÝjNOÆ Ç � Û â Ë Ç � Û Q NO�E� Q

á »s t�� ¿ � Ç � ÛzÝjNOËyÇ � ÛBâ ËgÇdQkÝjNOÆVÇ � ÛEâ ËgÇ � ÛQzç NO�B�mQ

£9A�DEHèW�a9:Ld:w5[W65MLb:?EL�cjW�DjfDEH%h9S;W�:�W�a9:w:�mhi:�f2W�?BW�5MDE<VLb<9:�:�7;:7RXZDEA6�Y=`��OËgÇ À Ä �ná�� Ç Ä á � Ç À Ä � Ç À ÄA È � Ç À È � Ç À È NO����Q

�OËgÇ À Ä ËgÇ�Ú�Û À È �ná��2Ç ÄÅÈ á � Ç�ÚyÛ À È r Ä(È ÝjN�ÆpÇzâ ËgÇ À Ä Q � Ç À ÄA � À ¶ � Ç�Ú�Û À ��r�� ¶ ÝjNOÆ Ç â Ë Ç À ¶ Q � Ç À ¶ ç NO�E� Q

��<+h9A�?Ef2W�58f2:PXZDEAYKMDE<V\�Ld:U S9:<Vf:�LeTpDEW�ajW�a9: � Ç ?B<p7 � Ç Ti:�f2D�H%:PFG?B<958L�a95[<V\EKMc%L�Hj?BKMKp?�LnW�a9:PA�:�fS9A�L�5MDE<VLYh9A�D�\EA�:�L�L^�_ba9:c?BA�:bW�aV:A�:2XZDEA�:6SVL�SV?EK[KMc3A�:<VDEA�H%?EK[58L�:�7�W�D�L�S9H W�DqD�<9:P?BWY:�?�f�a+LkW�:hjDBXgW�a9:PA�:�fS9A�L�5MDE<VL�^�_ba958LnHj?ECE:�LnW�a9:�f2DEH%h9S9W�?GW�5[D�<DBX�W�a9:wA�:KM:FG?E<�Wu:�mhi:�f2W�?BW�5MDE<VLbH3SVf�aRH%D�A�:�<mS9H%:A�5Mf�?BKMK[cj~0:KMK[�¦Ti:aV?vF�:�7yl;?E<V7�aV?EL0W�a9:�<95Mf:qLd587;:�¦:~Bi:fzWbW�aV?BWuW�a9:qL�S9HDBX'W�aV:wK[D�\3<9D�A�Hj?EK[5M��?BW�5MDE<VL05M<RW�a9:�XZDEA�~b?BA�7+hV?�L�Lb58L0W�a9:wKMDE\%KM5[C�:KM5[aVD D;7RDBX'W�a9:wD�TVL�:A�Fv?BW�5MDE<�Ld:U�SV:<Vf:E^

��ff�?EL�5[D�<V?BKMKMcEl95[W�58L�?BK8LdD+SpLd:XZS9K'W�DRfDEH%h9S;W�:�W�a9:3L�5M<9\EKM:�H%D�LdW�hVA�D�TV?BT9KM:�LdW�?BW�:3L�:�U S9:�<Vf2:�^�_baV:3L�DEKMS;W�5MDE<]W�D+W�a95MLh9A�DET9KM:H�5ML�\E5MFE:�<wT cPW�a9:���Í°Ø�Ï2Ó~�ÍiÒ�Y � ÕGÓzÍ°ØZÌmò¥« � §�¬�l~uaV5Mf�aw58LyFE:�A�c�Ld5MH%5[K8?BA�W�DuW�a9:nXZD�A�~b?BA�7�� Tp?Ef�Cm~0?EA�7u?EK[\�DEA�5�W�a9H�:�9f2:h9WW�ap?GWPL�DEH%:�DBX'W�a9:qL�S9H%Hj?GW�5MDE<pLu?BA�:�A�:hVKM?�f2:�7RTmc+Hj?G�;5MHJ58L�?GW�5MDE<pLwN�L�::j« �m�v¬yXZD�AP?3W�S;W�DEA�5M?EKyDE</4P=-=-L�lV:Ldhi:�f5M?EK[KMco?�L?BhVh9K[5M:�7RW�D%L�hi::�f�a�A�:�f2D�\E<95[W�5MDE<iQz^��×�� �ObRÜfÝõó0÷�â ð~:K�@â}Ü�ç�Û<Þ/Ûd? ã-ä5Ü�ä5â�ò�ãMókÜfà�â ÝõæRö�â}÷�ãji<ãgÞ�Ûa?k����PL�5M<9\3:U SV?GW�5[D�<@N�� Qzl W�a9:�KMDE\3h9A�D�TV?BTV5[KM5�Wkc%DEXyW�a9:�a958797;:�<RLdW�?GW�:�L0?B<V7oDETVL�:A�FG?GW�5[D�<VL)XZD�A0KM5M<9:�?EAd��D�?BSVL�L�5M?E<%LdW�?BW�:��L�hV?Ef:H%D;7;:K8L6f?E<RTi:w~uA�5�W�W�:<]?�L

KMDE\eÝjNZæoÛ�Þ ßYà�ÆyÛ�Þ ß�Qná{KMDE\YÝjN�æ+ÛQ}ú ß» ÇZä�Û KMDE\eÝjN�ÆpÇzâ æ%ÇkQ}ú ß» ÇZä�å KMDE\YÝjN�æ%Çzâ æ%Ç�ÚyÛQzç NO� §EQ

Page 11: An Introduction to Hidden Markov Models and Bayesian Networks

�Y?�f�a�DBXmW�a9:e?BTiDGFE:}h9A�DETV?ET95[KM5[Wkc�7;:�<VLd5[W�5M:�L�5ML�D�?BSVL�L�5M?E<�l?E<V7�W�aV:A�:2XZDEA�:}W�aV:nDGFE:�A�?EK[KG:�mhVA�:L�L�5[D�<�58L�?uL�S9H�DBX9U SV?E79A�?BW�58fL�^£9D�Au:2�9?BH%h9KM:El;SpLd5M<9\%:�U SV?BW�5MDE<�N ª Q2�

KMDE\0ÝjN�Æ Ç â æ Ç Qná¥Ü �� NOÆ Ç Üÿ\�æ Ç Q oc� ÚyÛ N�Æ Ç Üÿ\�æ Ç Q)Ü �

� â � â&úøµ����h��Å NO� ª Q~ua9:�A�: � 58LbW�aV:qf2DGFG?BA�5M?E<Vf2:�DBX'W�a9:wD�TVL�:A�Fv?BW�5MDE<R<9DE58Ld:+þ Ç ?B<V7Êâ�êmâ 5MLbW�a9:wHj?GW�A�5[�R7;:W�:A�H%5[<p?B< W�^

��XV?BKMK�W�a9:eA�?E<V7;DEH�FG?BA�5M?ET9KM:�L�~0:A�:nD�TVLd:�A�F�:�7yl�W�aV:<qW�a9:e=@Ä+hV?EA�?EHJ:W�:�A�L�fDES9K87wTi:0L�DEKMFE:7�XZDEA�T c�Hj?G�;5MH%5ML�5[<V\�N��m§BQz^_'?BCm5[<V\-7;:A�5[FG?BW�5MFE:�L�DEXqN�� §EQ�~e:jD�T;W�?E5[<Ê?/KM5[<V:�?BA3Ldc;LdW�:HjLwDEXu:�U SV?GW�5[D�<VL�^R£9D�Aq:2�9?EHJhVK[:�l�W�aV:o=-Äê:LkW�5[Hj?GW�:jDBXbW�aV:Hj?GW�A�5[��\¯5ML

\ [�� » Ç Æ Ç æ oÇ`� � » Ç æ Ç æ oÇd� Ú�Ûç

�m5M<Vf2:qW�a9:JLkW�?GW�:L6?BA�:q5M</X�?Ef2WPa958797;:<�lp5M<]W�aV:�=¸LdW�:h]~0:qSVL�:q:�mhi:�f2W�:7/Fv?EK[SV:�L6~uaV:A�:FE:�Au~e:37;DE<$o WPaV?vF�:q?Ef�f2:�L�LbW�DW�aV:q?EfzW�SV?BKyD�TVL�:A�FE:�7oFG?BKMS9:�L�^n_ba9:<�lmW�a9:q=�LdW�:h�XZD�A<\�58L

\ [�� » Ç Æ Ç ��æ Ç � o � � » Ç � æ Ç æ oÇ�¡�� ÚyÛ ç�m5MH%5[K8?BAP= LdW�:�hVL6f�?B<]Ti:q7;:A�5[F�:�7RXZDEA�?BKMK�W�aV:wDBW�aV:A6hV?EA�?EH%:2W�:�A�LbTmcRW�?EC 5M<9\+7;:�A�5MFG?GW�5[F�:�LbDBX'W�aV:q:2�;hi:�fzW�:�7/KMDE\jh9A�DET9�?BTV5[KM5�Wkc�« �E�ml � �;lg��Gv¬�^ ¢���<]\E:<V:A�?BK�~0:qA�:�U S95MA�:�?EK[K�W�:�A�HjL6DEX}W�a9:3C 5M<V73��æJÇ��2l£��æ%Ǧæ oÇ �u?B<p73�Zæ%Ç�æ oÇ�ÚyÛ �2^6_ba9:�L�:wW�:A�H%Lf?E<RTi:qf2D�H%h9S;W�:7�SVLd5M<9\JW�aV:@îw?BKMH%?E<�L�H%DmDBW�aV5[<9\j?EK[\�DEA�5�W�a9H/^��×�¤ ¥ÑÜf÷�ÝõÜfÛ�ãgÝõæ�ævä! <Þ/Ûd?_ba9:@îw?EK[Hj?B</L�HJDmDEW�a9:�A6LdD�K[F�:�L0W�aV:wh9A�D�T9KM:H DEX':LkW�5[Hj?BW�5M<9\JW�a9:�LdW�?BW�:q?BW0W�5[H%:qÅ0DBX)?%KM5[<9:?BA��uD�?ESVL�Ld58?B<oLdW�?BW�:��L�hV?Ef:H%D;7;:Kn\�5[F�:<@W�a9:jH%D;7;:KYhV?BA�?BH%:2W�:A�L�?B<V7I?/Ld:U�SV:<Vf:JDEX0D�TVL�:A�Fv?BW�5MDE<VL3ïvÆ Û àçç�ç2à�Æ Ç àç�çç2à�Æ ß ð�^%��W�fDE<VL�5MLdW�L�DEXeWk~0DhV?EAdW�L�}?�XZDEA�~b?BA�7%A�:f2S9A�Ld5MDE<%~ua958f�a+SVL�:�LYW�aV:PDETpLd:�A�FG?GW�5[D�<VL)XZA�DEHÈÆ Û W�D3Æ Ç lmCm<9DG~u<+?�LnW�a9:`¦%ÒJY�ò%ÒBШ§¯Y�Ø�Ï2Ó6« �E�G¬¦l;?B<p7j?TV?�f�C ~b?BA�7RA�:f2S9A�Ld5MDE<�~ua958f�a]SVL�:�LuW�a9:qD�TVLd:�A�FG?BW�5MDE<VL0XZA�DEHµÆ ß W�DoÆ Ç � Û « ���G¬¦^ © � :qap?vFE:q?BKMA�:�?E79coLd:�:</W�aV?GWP5M<]DEA�7;:�AW�D/f2D�H%h9S;W�:3W�aV:JHj?EA�\�5[<V?EK�hVA�D�TV?BT95MKM5�Wkc/DBX0?oFG?BA�58?BT9KM:�5M<I?��b?vcE:Ld58?B<]<9:Wk~eD�A�C/D�<9:�H3SVLkW�W�?BCE:35[< W�D�?�ff2D�S9< W�TiDBW�aW�aV:+:Fm587;:<Vf:+?BTiDGFE:j?B<p7�Tp:�K[DG~ÃW�a9:oFv?EA�58?BTVK[:�^+��<�X�?Ef2W�l�W�a9:nîw?EK[Hj?E<�L�H%DmDBW�aV:Aw58L�L�5[H%h9KMcs?]L�hp:f258?BK0f?EL�:%DBXbW�aV:Ti:KM5[:Xeh9A�DEhV?E\�?BW�5MDE<-?BKM\ED�A�5[W�aVH ~0:JaV?vFE:J?BKMA�:?E7;c/:<pf2DESV<�W�:A�:�7-XZDEA��0?vc�:�L�5M?E<-<9:Wk~eD�A�C;L�^�_baV: îw?EK[Hj?B<ILdH%DmDBW�a95M<9\?BKM\ED�A�5[W�aVHî?E<V7ÊW�a9:oXZD�A�~b?BA�7��mTV?Ef�Cm~b?BA�7@?BKM\ED�A�5[W�aVHî?EA�:�f2DE<pf2:h9W�SV?EK[KMcs587;:�<�W�5Mf�?BK¦lY?BK[W�aVDES9\�a`DBXPfDES9A�Ld:+W�a9:/7;:2W�?B5MKML7;5CBi:�A6Ld5M<Vf:�5M<�DE<9:ED�?BSVL�L�5M?E<R7;:�<VLd5[W�5M:�Lu?EA�:�h9A�DEhV?E\�?BW�:�7o?B<V7R5[<RW�aV:�DEW�a9:�A67;58L�fA�:W�:�7;5MLdW�A�5MT9S;W�5MDE<pLu?BA�:�h9A�DEhp?B\�?BW�:7y^

ª � 1½¿1z$'´�$)12(3#/Á (1�{· ¹ ¹ Á�´q#/*^«É¶P#/¶6&)´qÀ�12Á'´�$}12(J#/ÁÄ�5M<9:?BA��uD�?ESVL�L�58?B<®LdW�?BW�:2��L�hV?Ef:RH%D;7;:K8L+?E<V7®aV5M7979:<ê=-?BA�CEDGF�H%D;7;:K8L%h9A�DGFm5M7;:]?E< 5M< W�:A�:�LdW�5M<9\�LkW�?BA�W�5M<9\�hpD�5[< WjXZD�A7;:Ld5M\E<95M<9\>7;cm<V?BH%58f@�b?vcE:Ld58?B< <9:Wk~eD�A�C;L�^Ã46DG~0:F�:Al0W�a9:�c{LdS5Bg:ARXZA�DEH�5[H%hiDEA�W�?E<�W�K[5MH%5�W�?GW�5[D�<VLo~uaV:<�5[W]f2DEH%:LW�DsH%Dm79:KM5[<9\sA�:?BKe~eD�A�K87IW�5MH%:�L�:A�5[:L^@��<`W�aV:Rf?�Ld:oDBXPKM5[<V:�?BA���D�?BSVL�Ld58?B<ÊLdW�?BW�:2��L�hV?Ef:jHJD;7;:�KML�W�aV:RKM5[H%5[W�?BW�5MDE<VLJ?BA�:?E79FE:A�W�58L�:�7-5M<IW�a9:j<p?BH%:E�w5M<sHj?E< c@A�:?BKM5MLdW�58f%?Bh9h9KM58f?GW�5[D�<VL�l�TpDEW�aIW�aV:+LkW�?GW�:j7;cm<V?EH%5Mf�Lw?B<V7sW�aV:jA�:�KM?BW�5MDE<@Ti:2Wk~0::�<LdW�?GW�:�L}?B<p7qDETpLd:�A�FG?GW�5[D�<VL'f?B<3Tp:0<9D�<9K[5M<9:?BAlB?B<V7qW�a9:b<9D�5ML�:0f�?B<3Tp:0<9DE<9�uD�?ESVL�L�58?B<�^'£9DEA'a958797;:�<J=-?EA�C�DGF�H%D;7;:�KML�lGW�aV:L�5�W�SV?GW�5[D�<-5ML�H%DEA�:�L�S9T;W�K[:�^�4�=-=-L�?BA�:�?R7;cm<V?BH%58f?BK':2�mW�:<VL�5[D�<-DBXeHJ5[�mW�S9A�:�H%D;7;:�KML�ly?B<V7@S9<Vf2D�<VLdW�A�?B5M<9:�7/H%5[� W�S9A�:H%D;7;:K8L�f�?B<`Ti:+SVL�:�7�W�D-H%D;7;:Kb?B<mc�7;5MLdW�A�5MT9S;W�5MDE<Ê5M<ÊW�a9:oKM5[H%5[W3DEXP?B<Ê5M<;rV<95[W�:R< SVH�Ti:AJDBXuH%5��mW�SVA�:�f2DEH%hiDE<9:�< W�L�^£9SVAdW�a9:A�H%DEA�:Eli5�X)W�a9:JLdW�?BW�:�W�A�?B<VL�5�W�5[D�<]Hj?GW�A�5[��58LPSV<Vf2D�<VLkW�A�?E5[<V:�7ylg?B<mc/?BA�T95�W�A�?EA�cR<9DE<VK[5M<9:�?EA�7;cm<V?EH%5Mf�L�f�?B<@?EKML�D+Ti:H%D;7;:KM:�7y^Y�;DJ~uaV:A�:�79D :LbW�aV:wK[5MH%5�W�?GW�5MDE</KM5[:v�IeDE<pLd587;:A0W�a9:qh9A�DET9KM:H DBX}HJD;7;:�K[5M<9\JW�aV:wHJDGF�:H%:< WuDBX)L�:FE:�A�?EKgDET;|k:fzW�Lb5M<]?jLd:U S9:<Vf:�DBX}5[Hj?B\�:�L�^}��X�W�a9:A�:q?BA�:¬ D�T;|k:�f2W�L�lB:�?�f�a�DEXp~ua958f�aJf�?B<JD;ff2SVh cqí hiD�L�5�W�5[D�<VL)?B<p7�D�A�5M:< W�?BW�5MDE<VL�5M<�W�a9:u5[Hj?E\E:ElvW�a9:A�:u?BA�:0í<­ÈhiD�L�Ld5MT9KM:bLdW�?BW�:LDBXbW�a9:RL�c;LkW�:HîS9<V7;:�A�KMcm5[<9\-?E<Ê5[Hj?E\E:E^]¤ a95M7V7;:<®=@?BA�CEDGF-H%D;7;:Ke~eD�S9K87�A�:U�SV5[A�:+í ­ 7;5MLdW�5M<Vf2WJLdW�?GW�:�LqW�D-H%D;7;:KW�aV5MLbL�cmLdW�:�H/^n_ba95ML0A�:h9A�:�L�:< W�?GW�5MDE<j58L0<9DBWbDE<VK[cj5M<9:2é+f5[:�<�WbT9S;W67;5[é+f2S9K[WbW�DJ5[< W�:A�h9A�:W�^ � :�~0DES9K87jH3SVf�aoh9A�:2XZ:�A0W�aV?BW® õ�ö6�v�Gú��ú�R�u���/�Oø|�7Vú�xù÷(�6��ú�� �¯}ú{vøOø¦÷�ú�Pø��¦ú]���u °ø��Gú%����R�~#���xM%dú��úxùø���w��¯�dø��¦÷(�6ú]����#0{vøO÷(��.��R�u�Oö��&#ø}7C��� �ø� �6 �xù÷(��������%�{��¦øO÷ ���)÷(#����~�O÷ ° %dú]�O÷(� � § ±³²]«��´ õ�ö6�<7C� ��)�ú��#%ú��# wGú%W�)�ú��#>����%�{��Oø¦÷(� �vø¯��� . �u�Oö����6ú���Púxùø��E~���/)|�+ú�øb�¦ö6�`µ�ú{�%�ö6 8õ5{���. �t~�����k÷(w���xv¤¶µ;õ|t�¥Yø��R�&��Oö������qõ�ö�� ��� {�.zö�����dú]���R�����¦ø}�7�·)úx(�6ú� ° x �����O÷(��.uú��#�ø��R�~��¦öv÷(�6.�%dú�0w��f79� {6��#�÷(�r§ © yG¸³±«��

Page 12: An Introduction to Hidden Markov Models and Bayesian Networks

DESVACl�4�=-=4n+fDES9K87]f?Eh;W�S9A�:�W�aV:qS9<V7;:�A�KMcm5[<V\oLkW�?GW�:qLdhV?�f2:qTmcRSVLd5M<9\�¬¾7;5CBg:A�:< W�í]��7;5MH%:<VL�5[D�<V?BKyFG?EA�58?BT9KM:�L�^b=]DEA�:L�:A�5[D�SVLdKMcEly?E<sS9<pf2DE<pLkW�A�?E5[<9:7@4�=-= ~u5[W�a�í ­ LdW�?BW�:L�ap?EL�DBX0DEA�7;:A�í å ­ hV?EA�?EHJ:W�:�A�LP5[<sW�a9:%W�A�?E<VL�5�W�5[D�<@Hj?GW�A�5[�y^�6<VK[:L�L3W�aV:�79?BW�?ILd:W%f�?Bh;W�S9A�:�LJ?BKMKeW�a9:�L�:�hpD L�L�5[TVK[:RW�A�?B<VL�5[W�5MDE<VL3DEA%?-h9A�5MDEA�5eCm<9DG~uKM:�7;\�:o58LJSVLd:7ÊW�DIfDE<VLdW�A�?B5M<ÊW�aV:hV?EA�?EHJ:W�:�A�L�l;Ld:�FE:A�:�DGFE:A��¦r9WdW�5[<9\JHj?vc+A�:�L�S9K�W^

��< W�aV5MLRLd:fzW�5MDE<�lu~e:-7;:L�fA�5MTi:]W�a9A�::@~0?vc;L%5M<ê~ua95Mf�a{4�=-=-L�?B<V7 LdW�?BW�:2��L�hV?Ef:]HJD;7;:�KMLRf?E<êTp:-:�mW�:<p7;:�7>W�DDGFE:�A�fDEH%:PL�DEH%:�DBX�W�a9:�L�:�K[5MH%5�W�?GW�5MDE<pL^n_ba9:�rVA�LkWuDEX�W�a9:Ld:�A�:h9A�:�L�:< W�LnW�a9:�a95M7V7;:</LkW�?GW�:�DEX'?B<�4P=-=ÉSVL�5[<V\J?%L�:2WbDBX7;58LkW�5[<pfzWYLdW�?GW�:uFG?BA�5M?ET9K[:L^ � :6f�?BKMKmW�a958Ln4�=-= ~u5�W�a%?�7;58LdW�A�5[T9S9W�:�7jLdW�?BW�:bA�:h9A�:�L�:< W�?BW�5MDE<�lB?��2Ò�ì2Ø�ÕGÓzÍ�Ò�Y9Ì;Í�ÎEÎ�Ï2ÐRÑ@ÒGÓ�Ô�ÕGÖòjÕ�Î�Ï�Y�« �E�¬�^��×/Ø �Ob�ägâ|Û<ãgÞ�æbÛ Øc:E¹RÜvà�ägæbçAÞ�Üv÷�6º��� ã� :w\E:<V:A�?BKM5ML�:PW�a9:q4P=@=ÉTmc+A�:hVA�:Ld:�<�W�5[<V\�W�a9:qLkW�?GW�:wSVLd5M<9\j?%f2D�K[KM:�f2W�5MDE<�DBX)7;5ML�f2A�:2W�:wLkW�?GW�:�FG?BA�58?BT9KM:�L

Ë Ç á�Ë % Û�'Ç àç�çç�Ë %*» 'Ç àçç�ç2à�Ë % ­ 'Ç à NO� © Q:�?�f�aRDEX�~ua958f�a]f?E<oW�?BCE:�DE<]íj%*» ' FG?BKMS9:�L�^n_ba9:wLkW�?GW�:qLdhV?�f2:�DBX'W�a958LuH%D;7;:K�fDE<VL�58LkW�LbDBX�W�a9:qf2A�D�L�L0h9A�Dm79SVfzW6DEX�W�aV:�L�:LdW�?GW�:6FG?BA�5M?ET9KM:�L�^'£VDEAYL�5[H%h9KM58f25[WkcEl ~e:6~u5MKMKi?�L�L�S9H%:uW�ap?GWeíj%*» ' á{í`l�XZDEAe?EK[K�¼slm?BK[W�aVDES9\�a3W�a9:�?EK[\�DEA�5�W�a9HjL)~0:6h9A�:�L�:< Wf?E</Tp:wW�A�5MFm5M?EK[KMco\�:<9:�A�?EK[58L�:�7oW�D%W�aV:�f?�Ld:wDEX)795zBg:A�5[<V\+í3%*» ' ^�D�5MFE:�</W�aV?BW6W�aV:�LkW�?GW�:qLdhV?�f2:wDEX�W�a95ML6X�?Ef2W�DEA�58?BK�4�=-=f2D�<VL�5MLdW�L'DBXi?BKMKmí ­ f2D�H�T95M<V?GW�5[D�<VL'DBX9W�a9:6Ë %*» 'Ç FG?BA�58?BT9KM:�L�lGh9K8?Ef25M<9\�<9D�f2DE<pLkW�A�?E5[< W�L�DE<�W�a9:uLdW�?BW�:0W�A�?B<VL�5[W�5MDE<3LdW�A�SVf2W�S9A�:~0DES9K87-A�:�L�S9K[W�5M<I?�í ­ ñ-í ­ W�A�?B<VL�5�W�5[D�<@Hj?GW�A�5[�y^3�mSVf�aI?B<sS9<Vf2D�<VLdW�A�?B5M<9:�7sLdc;LdW�:H 58L�S9<95M< W�:A�:�LdW�5M<9\RXZDEAwL�:FE:�A�?EKA�:�?EL�DE<pL�e5�W�5MLP:�U S95MFG?BKM:< WPW�DR?B<-4�=-=¸~u5[W�así ­ LkW�?GW�:L~mi5[W�58L6S9<VK[5MCE:�K[c�W�D�7;58L�fDGFE:A6?E<mcR5M< W�:A�:�LdW�5M<9\�LkW�A�SVf2W�S9A�:q5M<W�aV:�í�LkW�?GW�:wFG?EA�58?BT9KM:�L�l9?ELP?BKMK�FG?BA�5M?ET9K[:Lu?BA�:w?BKMK[DG~0:�7oW�Dj5M< W�:A�?Ef2W6?BA�T95�W�A�?EA�5MKMc�m9?E<V7�TpDEW�a�W�aV:wW�5MH%:�f2D�HJhVK[:�m5[Wkco?E<V7L�?BH%h9KM:�fDEH%h9KM:2�;5[Wkc+DBX'W�a9:w:LkW�5[Hj?BW�5MDE</?BKM\EDEA�5[W�a9H ?EA�:�:2�;hiDE<9:�< W�58?BKy5M<>¬ ^

� :/W�a9:�A�:XZDEA�:/XZDmfSVLjD�< X�?EfzW�DEA�5M?EK64P=-=@Lj5[<ê~uaV5Mf�a W�a9:]S9<V7;:�A�KMcm5[<V\`LkW�?GW�:-W�A�?B<VL�5�W�5[D�<VLj?BA�:]f2D�<VLkW�A�?E5[<V:�7y^�¤<V?BW�S9A�?BKyLdW�A�SVfzW�S9A�:�W�DjfDE<VL�5M79:Ab5ML0D�<9:�5[<�~ua958f�aR:?Ef�aRLdW�?BW�:�FG?BA�5M?ET9K[:�:F�DEKMFE:Le?�ff2D�A�795[<9\�W�D%5[W�LbDG~u<R79c <p?BH%5Mf�Ll;?E<V758LqÒ�×gÓzÍ�ÕGÓzÍgS9<VfDES9h9KM:�7RXZA�DEH W�a9:wDBW�a9:A6LdW�?BW�:�FG?BA�5M?ET9KM:�L��

ÝjNOË Ç â Ë Ç�ÚyÛ QYá ­ã» ä�Û ÝjNOË %�» 'Ç â Ë %*» 'Ç�Ú�Û Q2ç N��!G Q¤ �0?vc�:�L�5M?E<]<9:2Wk~0DEA�C/A�:�h9A�:�L�:< W�5M<9\jW�a95ML�H%D;7;:K}58L�Lda9DG~u<@5[<I£�5M\ESVA�:%�;^q_ba9:3W�A�?B<VL�5[W�5MDE<@LdW�A�SVfzW�S9A�:qXZDEA�W�a95ML�H%D;7;:Kf?E<RTi:whV?EA�?EHJ:W�:�A�58Ld:7+SVL�5M<9\C¬ 7;58LdW�5M<VfzWPí�ñ/íîH%?BW�A�5Mf:�L�^

¤PL}L�a9DG~u<q5M<3£'5M\ES9A�:0�9lvW�a9:0DETVL�:A�FG?GW�5[D�<�?GW'W�5MH%:0LdW�:�h�Å�f�?B<379:hi:<V7�DE<3?EK[K W�a9:0LdW�?BW�:0FG?BA�5M?ET9K[:L�?BW�W�aV?GW'W�5MH%:bLdW�:�h5M<�?RX�?�fzW�D�A�58?BK)4�=-=Ê^�£VDEA�A�:?BK[�¦FG?EK[S9:7-D�TVLd:�A�FG?BW�5MDE<VL�lyDE<9:jL�5[H%h9KM:%XZDEA�H XZD�A�W�a958Lq7;:hi:<p7;:<Vf:j5ML�KM5M<9:�?EAd��D�?BSVL�L�5M?E<$mW�ap?GWn58LlGW�a9:uDETpLd:�A�FG?GW�5[D�<3ÆpÇ�58L)?ED�?BSVL�L�5M?E<3A�?B<V79DEH¥FE:fzW�DEA)~ua9D Ld:bH%:�?E<358L)?�K[5M<9:�?EA}XZS9<Vf2W�5MDE<%DBXiW�a9:6LdW�?BW�:bFG?BA�5M?ET9KM:�L�^� :�A�:hVA�:Ld:�<�WeW�a9:�LdW�?GW�:�FG?EA�58?BT9KM:�L0?ELbí ñ � F�:�fzW�DEA�Ll ~ua9:�A�:�:�?Ef�aRDBX�W�a9:wí 7;58L�f2A�:2W�:�FG?BKMS9:�LbfDEA�A�:LdhiDE<V7VL)W�D%? � 5M<DE<V:�hiD�L�5[W�5MDE<]?B<V7�GJ:K8Ld:�~ua9:A�:E^)_ba9:wA�:�L�S9K[W�5M<9\%h9A�DETV?ET95[KM5[Wkc+7;:<VL�5[Wkc+XZDEA6? �µñ � DETVL�:A�FG?GW�5MDE<RFE:fzW�D�AuÆ Ç 5ML

ÝjNOÆ Ç â Ë Ç QnáÃâ � â ÚyÛ�½�å N¦�G¾�Q ÚÀ¿I½�å :2�;h&ÁeÜ �� NOÆ Ç Ü<Â Ç Q o � ÚyÛ N¦Æ Ç ÜEÂ Ç QGÃoà N�� � Q

~ua9:�A�: ÂyÇná ­»» ä�Û T %*» ' Ë %*» 'Ç ç N�� ��Q�Y?�f�aVT %�» ' Hj?GW�A�5[�s58Lq?F�îñ@í�Hj?GW�A�5[�s~uaVD�L�:+f2DEKMS9H%<VLq?EA�:%W�a9:ofDE< W�A�5[TVS;W�5MDE<VL�W�D]W�aV:+H%:�?B<pL�XZDEAq:?Ef�aIDBXbW�aV:L�:2WdW�5[<V\�LbDBXnË %*» 'Ç l9?E<V7 � 5MLP? � ñ^�µf2DGFG?BA�5M?E<Vf2:�Hj?GW�A�5[�g^

��<9:+~b?vc-W�D@S9<p7;:A�LkW�?B<V7ÊW�a9:RDETVL�:A�FG?GW�5MDE<�H%D;7;:K05M<`:�U SV?BW�5MDE<VLRNZ� � Qw?B<p7{NZ�m�EQ�58LqW�DsfDE<VL�5M79:AwW�a9:RHj?EA�\�5[<V?EK7;58LkW�A�5MT9S;W�5[D�<`XZD�A%Æ Ç lYD�T;W�?E5[<9:7`Tmc`L�S9H%HJ5M<9\IDGFE:�A�W�a9:RhiD�L�L�5[T9KM:/LkW�?GW�:L^ _ba9:A�:R?EA�:/í¿L�:2W�W�5M<9\�L3XZDEA%:?Ef�a`DEXPW�aV:¬ºLdW�?GW�:�FG?BA�58?BT9KM:�L�lp?E<V7/W�amSVLPW�aV:A�:3?BA�:3í ­ hiD�L�L�5[T9KM:�H%:?B<-F�:�fzW�DEA�LuDET9W�?B5M<9:7]TmcRXZD�A�H%5M<9\oL�S9HjLPDEXP¬¾f2D�K[S9H%<VL~ua9:�A�:3DE<9:%f2D�K[S9H%<s5ML�f�a9D Ld:�<]XZA�D�Hµ:�?Ef�a@DBXnW�a9: T %�» ' H%?BW�A�5Mf:�L�^w_ba9:3A�:�L�S9K[W�5M<9\�H%?EA�\�5[<p?BK�79:<VL�5�Wkc]DEXeÆpÇu5ML�W�amSVL?øD�?ESVL�L�58?B< H%5��mW�SVA�:-H%D;7;:�K�~u5[W�a�í ­ H%5[� W�S9A�:@f2D�HJhiDE<V:< W�Lo:�?Ef�aêap?vF 5M<9\`?`fDE<VLdW�?E< Wof2DGFG?BA�5M?E<Vf2:]Hj?BW�A�5�� � ^_ba958LjLkW�?GW�5MfRH%5��mW�SVA�:/H%D;7;:K¦lY~u5[W�a9D�S;Wj5[<pf2KMSVLd5MDE< DBX�W�a9:�W�5MH%:/5[<V79:2� ?E<V7`W�a9:]=-?BA�CEDGF�7;cm<V?EHJ58fL�ln58Lj?-X�?�fzW�DEA�5M?EKhV?EA�?EHJ:W�:�A�5M��?BW�5MDE<oDEX�W�a9:qLkW�?B<V7V?BA�7oH%5[� W�S9A�:�DEXvD�?ESVL�Ld58?B<VL0H%D;7;:K�W�aV?BW6aV?ELb5M< W�:A�:�LdWu5[</5[W�LuDG~u<RA�5M\Ea Wq« � © lp���ml �ª ¬¦^_ba9:jH%D;7;:KY~e:jaV?vF�:�|kSVLkWqhVA�:Ld:�<�W�:�7I:2�mW�:<V79LwW�a9:+LdW�?BW�58f%HJD;7;:�KnTmcs?EK[KMDG~u5[<V\/=@?BA�CEDGF]7;cm<V?BH%58fLw5M<IW�a9:R7;5ML�f2A�:2W�:LdW�?GW�:�Fv?EA�58?BTVK[:LeSV<V7;:A�KMc 5M<9\JW�aV:�H%5[�mW�S9A�:E^n¤ H%D;7;:KyDEX�W�aV?GWPfDEH�TV5[<9:LeXZ:�?GW�S9A�:�LbDBX�W�a9:�X�?�fzW�DEA�5M?EKg4�=-=�?B<V7oX�?Ef2W�D�A?B<p?BKMcmL�58Leap?ELbTi::</A�:�f:< W�KMco?BhVh9K[5M:�7RW�D%?E</5[Hj?B\�:PW�A�?�f�Cm5[<9\%h9A�DETVK[:�Hè~u5�W�a/5[H%h9A�:�L�Ld5MFE:�A�:�L�S9K�W�Lw« � �G¬

Page 13: An Introduction to Hidden Markov Models and Bayesian Networks

S(1)t

S(2)t

S(3)t

Yt

S(1)t+1

S(2)t+1

S(3)t+1

Yt+1

S(1)t-1

S(2)t-1

S(3)t-1

Yt-1

£'5[\�S9A�:w�9�)¤¥�0?vc�:�L�5M?E<+<9:Wk~eD�A�CjA�:h9A�:�L�:< W�5[<9\�W�a9:qfDE<V795�W�5[D�<V?BKg5M<V7;:hi:<p7;:<Vf:wA�:�KM?BW�5MDE<VL05M<]?�X�?�fzW�DEA�5M?EKg4�=-=î~u5�W�a¬ áê�%S9<V79:A�K[cm5M<9\j=-?BA�CEDGFjf�aV?E5[<VL�^uN � :qDE<VK[coL�a9DG~�a9:A�:w?3hiDEA�W�5MDE<�DBX'W�aV:q�0?vc�:�L�5M?E<+<9:Wk~eD�A�Co?EA�D�S9<V7+W�5MHJ:qL�KM5Mf:Åz^ùQ

S(1)t-1

S(2)t-1

S(3)t-1

S(1)t

S(2)t

S(3)t

S(1)t+1

S(2)t+1

S(3)t+1

Yt-1 Yt Yt+1

X t-1 X t X t+1

£'5[\�S9A�:w�V�}_�A�::wLkW�A�SpfzW�SVA�:7RaV5M7979:<]=-?BA�CEDGF%H%D;7;:K8L�^

��×�ð �Ob�ägâ|Û<ãgÞ�æbÛ ð~:E;lçAâ$âÔã!ä5çÄikà�ä�i<ç3â}öf6Å��� ã��<sX�?EfzW�DEA�5M?EK'4�=-=-L�lyW�aV:JLdW�?BW�:%FG?BA�5M?ET9K[:L�?BW�D�<9:3W�5MHJ:jLdW�:�hI?EA�:J?EL�LdS9H%:7]W�D�Ti:]ÒJ×iÓzÍ�ÕGÓzÍ'5M<V7;:hi:<p7;:< Ww\E5MFE:�<-W�aV:LdW�?GW�:oFG?BA�58?BT9KM:�LJ?GW3W�a9:�h9A�:Fm5[D�SVLwW�5[H%:/LkW�:h�^Ê_ba958L%?EL�LdSVHJh9W�5MDE<®f�?B<`Ti:RA�:K8?G�;:7Ê5[<®H%?E<mcI~b?vc;LqTmcÊ5M<�W�A�D;7;Spf25M<9\f2D�S9h9KM5[<V\+Tp:Wk~e:�:</W�a9:3LdW�?BW�:qFG?BA�58?BT9KM:�Lu5M<@?+L�5M<9\EKM:wW�5MH%:3LdW�:�h`« � © ¬¦^���<V:�5M<�W�:A�:�LdW�5M<9\j~b?vc+W�D�f2D�S9h9KM:wW�a9:�Fv?EA�58?BTVK[:L58L�W�D]D�A�7;:�A�W�a9:�H/l}L�SVf�aIW�ap?GW3Ë %*» 'Ç 7;:hi:<p79LqD�<ÊË % íÆ'Ç XZDEA � L �ºÇȼI^R£VS9AdW�a9:A�H%DEA�:El�5�X6?BKMK)W�a9:+LkW�?GW�:jFv?EA�58?BTVK[:L?B<p7�W�a9:qD�S;W�hVS;W�?BK8L�D+7;:hi:<V7/D�<-?B</DETpLd:�A�FG?BTVK[:w5M<9h9S;W�Fv?EA�58?BTVK[:�l9æ Ç li~0:wDET;W�?B5M</W�a9:��b?vc�:�L�5M?E<o<9:Wk~eD�A�C�Lda9DG~u</5M<£'5[\�S9A�:��V^

_ba958Ln?BA�f�a95[W�:fzW�SVA�:6f�?B<jTi:65[< W�:A�h9A�:W�:7J?�Ln?wh9A�DETp?BT95MK[58LdW�58fu7;:�f5ML�5[D�<JW�A�::6~u5[W�a+=-?EA�C�DGFm5M?E<J7;cm<V?EH%5Mf�L)K[5M<9Cm5M<9\wW�aV:7;:f258Ld5MDE<]FG?BA�58?BT9KM:�L�^RIeD�<VL�5M7;:�A6a9DG~�W�aV5MLPHJD;7;:�K�~0DESVKM7�\E:�<9:A�?GW�:q79?GW�?+?GWPW�a9:�rVA�LdW6W�5[H%:�LdW�:�h�lpÅbá � ^�D�5[F�:<]5M<9h9S;Wæ Û lmW�a9:PW�DEhR<9D;7;:�Ë % Û�'Û f?B<oW�?ECE:PD�<RíÉFG?BKMS9:�L�^)_ba95MLbLdW�D;f�aV?�LkW�5Mf�?BKMK[c%hV?EAdW�5�W�5[D�<VLYæ-��L�hV?Ef:65M<�W�DJíî7;:f258Ld5MDE<RA�:�\E5MDE<VL�^_ba9:�<9:2�mW0<9D;7;:�79DG~u<jW�a9:�a95M:A�?BA�f�amcEl Ë % å�'Û l;L�S9Tg7;5[Fm587;:�L0:?Ef�a+DEXyW�a9:Ld:�A�:�\E5MDE<VLY5[< W�D3í L�S9T9A�:\�5[D�<VL�l ?E<V7+L�D�DE<�^}_baV:DES9W�h9S;W�ÆgÛ�58Lu\�:<9:�A�?BW�:�7RXZA�DEH W�a9:w5M<9h9S;W�æoÛ�?B<V7�W�a9:qí]��~0?vcR7;:�f5ML�5[D�<VLu?GW�:�?Ef�a�DBX}W�a9:1¬ a95M7V7;:<]<9D;7;:L^0¤0W6W�aV:<9:� WuW�5[H%:�LdW�:�h�lV?%L�5[H%5MKM?EAuh9A�D;f:�7;S9A�:�5ML6SVLd:7RW�Dj\E:�<9:A�?GW�:�7V?GW�?JXZA�DEHèW�a9:qH%D;7;:�KOl9:�9f2:h9WuW�aV?BW6<9DG~�:?Ef�a]7;:�f5ML�5MDE<5M<jW�a9:6W�A�::658Le79:hi:<V7;:�< WeDE<%W�a9:�79:�f258L�5[D�<%W�?BC�:<j?GWeW�aV?BWY<9D;7;:�5[<%W�a9:Ph9A�:Fm5MDESVL)W�5MHJ:�LkW�:h�^)_ba958LnH%D;7;:�Kp\�:<9:�A�?EK[58Ld:LW�aV:�lda95M:A�?BA�f�a958f?BK0H%5��mW�S9A�:/DEX�:2�;hi:A�W�L�n « � � ¬P?B<V7>DEW�a9:�AjA�:�KM?BW�:�7 7;:�f5ML�5MDE< W�A�::/H%Dm79:K8L+LdSpf�a>?�L I0¤�t}_É« ª ¬P?E<V7=-¤�tP�®« � �v¬}Tmc]\�5[Fm5M<9\+W�a9:j7;:�f5ML�5[D�<VL�=-?BA�CEDGFm58?B<-7;cm<V?EHJ58fL�^q_�A�:�:JLdW�A�SVfzW�S9A�:�7-4�=-=-L�h9A�DGFm5M7;:J?+SVL�:2XZSVKnLkW�?BA�W�5M<9\hiDE5M<�WwXZD�A�HJD;7;:�K[5M<9\/W�5[H%:+L�:A�5[:L�~u5[W�a�TiDBW�asW�:H%hiDEA�?BK)?B<V7�L�hV?GW�5M?EK)LkW�A�SVf2W�S9A�:j?GWqH3S9K�W�5[hVK[:jA�:�L�DEKMS;W�5MDE<pL^ � :jaV?vF�::2�;h9KMDEA�:�7oW�aV5MLu\�:<9:�A�?EK[5M��?BW�5MDE<+DEX�X�?�fzW�DEA�5M?EKg4�=-=-Lu5M<Ê« �!Gv¬�^

Page 14: An Introduction to Hidden Markov Models and Bayesian Networks

X(M)2

S 2

Y2

X(M)3

S 3

Y3

X(M)1

S 1

Y1

X(1)2 X

É (1)3X

É (1)1

£'5[\�S9A�:u§;���b?vcE:�L�58?B<w<9:Wk~eD�A�C�A�:h9A�:�L�:< W�?BW�5MDE<wXZD�A'L�~u5[W�f�a95M<9\�LkW�?GW�:��L�hV?�f2:YH%D;7;:�KML�^}Ë Ç 5ML'W�a9:0795ML�f2A�:2W�:0L�~u5�W�f�a�FG?BA�58?BT9KM:?B<p7oæ %�» 'Ç ?BA�:�W�a9:wA�:�?EK���FG?BKMS9:�7RLkW�?GW�:wF�:�f2W�DEA�L�^

��×�Ö �Ob�ägâ|Û<ãgÞ�æbÛ Ö~:ÿñ�åcÞ�ä5à� <Þ�Ûa? ñKä5Ü|ä5â ãMó<Üvà�â Ý æRö<â}÷/ã�0DBW�a/X�?EfzW�DEA�5M?EK�4P=@=-L�?E<V7�W�A�::��LdW�A�SVf2W�S9A�:�7/4P=@=-LPSpLd:�795ML�f2A�:2W�:qa958797;:<sLkW�?GW�:�A�:�h9A�:Ld:�< W�?GW�5[D�<VL�^0_�D+H%D;7;:K�W�5MH%:L�:A�5[:L%~u5�W�a fDE< W�5M<mS9DESpL3TVS;W+<9DE<VK[5M<9:�?EA+7;cm<V?BH%58fL�le5[W+58L%hpD L�L�5[TVK[:/W�D�fDEH3T95[<V:RW�a9:]A�:�?BK[��Fv?EK[SV:�7 a95M7V7;:<êLdW�?GW�:/DBXKM5[<9:?BA��uD�?ESVL�Ld58?B<>LkW�?GW�:��L�hV?�f2:�HJD;7;:�KMLj?E<V7 W�a9:-795ML�f2A�:2W�:/LdW�?BW�:]DEX�4P=@=-L^ ��<9:/<V?GW�S9A�?EKu~0?vc�W�D`7;DIW�a958Lj58L%W�aV:ë³F)Í°Ø�ì�ÌmÍ°Ðg�oë�Ø�ÒGØ�Ï~��ëO×VÒEì�Ï�ò%ÕÎEÏ~Yy« � � ¬�^

��<oL�~u5�W�f�a95M<9\JLdW�?BW�:��L�hV?Ef:6H%D;7;:K8Ll W�a9:�L�:�U S9:�<Vf2:�DBX�D�TVL�:A�Fv?BW�5MDE<VLeÆ Û�Þ ß 58L0H%Dm79:KM:�7+SpLd5M<9\3?�a958797;:<�LkW�?GW�:�L�hV?Ef:f2D�H%h9A�58L�5[<9\C¬ A�:�?BK[��Fv?EK[SV:�7�LkW�?GW�:�FE:�f2W�D�A�L�l;æ %*» 'Ç lp?E<V7/DE<9:q795ML�f2A�:2W�:qLkW�?GW�:�FE:�f2W�D�APË Ç ^0_ba9:37;5ML�f2A�:2W�:qLkW�?GW�:EliË Ç lp5MLP?H�SVK�W�5[<9D�H%5M?EK�FG?BA�5M?ET9KM:�W�aV?GW�f?B</W�?BC�:wDE<4¬ FG?EK[S9:L�bË Ç ��ï � àçç�ç2à�¬ÃðMm9XZD�A6A�:?EL�DE<VL0W�aV?GW�~u5[KMK�Ti:�f2D�H%:qDETmFm5[D�SVLb~0:A�:2XZ:AbW�D%5�WP?�L0W�a9:Jë³F)Í°Ø�ì�ÌJFG?BA�58?BT9KM:E^}_ba9:b|kDE5M< W6h9A�DETV?ET95[KM5[WkcjDBX�D�TVL�:A�Fv?BW�5MDE<VLb?E<V7oaV5M7979:<]LkW�?GW�:�Luf?E<RTi:�X�?Ef2W�D�A�:7R?�L

ÝjN¦Ë Û�Þ ß àdæ % Û�'Û�Þ ß à�çç�ç2àdæ % ­ 'Û�Þ ß à�Æ Û�Þ ß Q á ÝjN¦Ë Û QßãÇZä�å ÝjN¦Ë Ç â Ë Ç�ÚyÛ Q ­ã» ä'Û+Ê ÝjNZæ %*» 'Û Q

ßãÇZä�å ÝjNZæ %*» 'Ç â æ %*» 'Ç�Ú�Û Q\Ë

ñßãÇZä�Û ÝjN�Æ Ç â æ % Û�'Ç àç�çç2à�æ % ­ 'Ç à�Ë Ç Q2à N���� Q

~ua958f�a�fDEA�A�:LdhiDE<p79Ln\�A�?Eh9a958f?BKMKMc3W�DJW�a9:wf2D�<V7;5[W�5MDE<V?EKg5[<V79:hi:<V7;:�<Vf25M:�LbA�:hVA�:Ld:�<�W�:�7oT c+£'5M\ES9A�:q§m^�IeDE<p7;5�W�5[D�<9:�7oDE<�?L�:2WdW�5[<V\+DBX)W�a9:3L�~u5�W�f�a-LkW�?GW�:ElyËgÇeáżIl9W�aV:�DETpLd:�A�FG?BTVK[:w58LPH3S9K[W�5MFv?EA�58?GW�:lD�?BSpL�L�5M?E</~u5�W�a-DES;W�h9S;W�:�U SV?GW�5[D�<]\E5MFE:�<�TmcLdW�?GW�:2��Ldhp?Ef2:�H%D;7;:K+¼I^)��</DBW�a9:Au~0DEA�79L�l�W�a9:wh9A�DETV?ET95MK[5[Wkc+7;:<pLd5[WkcoDEX�W�aV:wDETVL�:A�FG?GW�5MDE<�FE:fzW�DEAuÆVÇe5ML

ÝjN�Æ Ç â æ % Û�'Ç à�çç�çàdæ % ­ 'Ç à�Ë Ç áN¼]Q á N¦�G¾�Q Ú�Ì Í â � â Ú ¿Í ñ:2�;h£Î Ú ¿Í�ÏÑÐ t Ú$Ò£ÓÕÔ×Ö @ ÓÕÔhÖt�Ø oÚÙ w ¿ Ï\Ð t ÚÀÒ£ÓÛÔhÖ @ ÓÛÔhÖt�ØÚÜ N��E�mQ

~ua9:�A�:R�Ã5ML'W�a9:67;5MHJ:�<VL�5[D�<3DEXVW�aV:0D�TVL�:A�Fv?BW�5MDE<3FE:�f2W�D�A�l � 58L'W�aV:uDETVL�:A�FG?GW�5MDE<�<9DE58Ld:ufDGFv?EA�58?B<pf2:YHj?BW�A�5��ylE?E<V7 \1%�» ' 5MLW�aV:�D�S;W�h9S9W0Hj?GW�A�5[�jXZDEAbLdW�?GW�:2��Ldhp?Ef2:PHJD;7;:�K$¼�NOfzXk^):U�Sp?GW�5MDE<sN ª QnXZDEAb?�L�5M<9\EKM:�KM5M<9:�?EAd��D�?BSVL�L�5M?E<%LdW�?BW�:��L�hV?Ef:PH%D;7;:K°Qz^�Y?�f�a A�:?BK[�¦FG?BKMS9:7êLkW�?GW�:@FE:�f2W�D�A+:F�DEKMFE:�Lo?EffDEA�7;5M<9\�W�DÊW�a9:@KM5M<9:�?EAd��D�?BSVL�L�5M?E< 79c <p?BH%5Mf�L+DEXw? LkW�?GW�:2��LdhV?�f2:]H%D;7;:K~u5[W�a-7;5CBi:�A�5M<9\+5M<95[W�58?BK'LkW�?GW�:�l;W�A�?B<pLd5[W�5MDE</Hj?GW�A�5[�ylp?B<p7�LdW�?BW�:q<VDE58Ld:+N�:�U SV?GW�5[D�<ÊN¦§BQ�Qz^u_ba9:�L�~u5[W�f�a]LkW�?GW�:q5�W�Ld:�K�X):�FEDEKMFE:L?Ef�f2D�A�7;5M<9\�W�DqW�a9:�7;5ML�f2A�:2W�:6=-?BA�CEDGF37;cm<V?BH%58fLnL�hp:f25[rV:�7+T c35[<V5�W�5M?EKiLdW�?BW�:uh9A�DETV?ET95MK[5[W�5M:�LeÝjNOË�ÛQ)?B<V7j?E<N¬�ñ1¬ LkW�?GW�:W�A�?B<pLd5[W�5MDE<�Hj?GW�A�5[�RÝjNOËgÇ2â ËgÇ�ÚyÛQz^

_ba958L�H%Dm79:KYf�?B<�Tp:+L�::�<Ê?ELw?B<I:2�mW�:<VL�5[D�<�DBX0W�a9:3l�HJ5[�mW�S9A�:%DBXb:2�;hi:A�W�L�n�?EA�f�aV5�W�:�fzW�S9A�:3XZD�AwH%Dm79S9KM?EAwK[:?BA�<95M<9\5M<I<V:S9A�?BKn<V:2Wk~0DEA�CmL%« ��§ l © l��MGv¬¦^��Y?�f�aILdW�?BW�:2��L�hV?Ef:JH%D;7;:�Kn5ML�?/K[5M<9:�?EAw:2�;hi:A�Wq~u5�W�aøD�?BSVL�Ld58?B<IDES9W�h9S;W3<9DE58Ld:j?E<V7KM5[<9:?BA��uD�?ESVL�Ld58?B<+7;cm<V?EH%5Mf�L^}_ba9:�Ld~u5[W�f�aoLdW�?BW�:Old\ ?GW�:L�nwW�a9:�DES;W�h9S;W�LYDEX�W�a9:M¬ LdW�?GW�:2��Ldhp?Ef2:�H%Dm79:K8Ll;?B<p7%W�a9:�A�:XZDEA�:h9K8?vc;L0W�a9:wA�DEKM:�DEX}?J\ ?GW�5M<9\%<9:Wk~eD�A�Cj~u5[W�a]=-?EA�C�DGF 58?B<R7;cm<V?BH%58fLw« © l;�!GG¬¦^

Page 15: An Introduction to Hidden Markov Models and Bayesian Networks

Ý OßÞ>Þ/&)(aà/1½ ´�$}¶¸"�#��B¶6&)¶�#/.u¶ ´q#/*º"�#J$'&)´w.0$}´¨á]1À�1�$�Q_ba9:]h9A�DETVK[:�H ~u5[W�a{?BKMKuW�a9:-:2�mW�:<VL�5[D�<VL%DBX�a958797;:�<{=-?BA�CEDGFÊH%D;7;:K8L+?E<V7 LkW�?GW�:��L�hV?�f2:/H%Dm79:K8L+h9A�:�L�:< W�:7®5M< W�aV:h9A�:Fm5MDESVLwL�:�f2W�5MDE<I5ML�W�aV?GWl�\�5[F�:<�?/Ld:U�SV:<Vf:jDBXbDETVL�:A�FG?GW�5MDE<pLlyH%D�LdWqh9A�DETV?ET95MK[5[W�5M:�L�DEX05M< W�:A�:�LdWq?BA�:%5[< W�A�?Ef2W�?ET9K[:JW�Df2D�H%h9S;W�:�^IeDE<pLd587;:Al0XZDEAR:2�9?BH%h9KM:ElPfDEH%h9S;W�5[<V\ÊW�a9:sK[5MCE:�K[5Ma9DmD;7 DBX�?�X�?�fzW�DEA�5M?EK�4P=@=�x>W�a9:@Hj?EA�\�5[<V?EK6h9A�DETV?ET95MK[5[Wkc DEXq?L�:�U S9:<pf2:+DEX6DETVL�:A�FG?GW�5MDE<pLw\E5MFE:�<�W�a9:RhV?BA�?BH%:2W�:A�Ll}ÝjN�Æ Û�Þ ß â ��Qz^I_ba95ML�5ML�W�aV:RL�S9H�DGFE:A3?BKMKehiD�L�Ld5MT9KM:+a958797;:�<®LkW�?GW�:L�:�U S9:<pf2:�LbDEX�W�a9:b|kDE5M< W6h9A�D�TV?BTV5[KM5�WkcoDBX�W�a9:qL�:�U S9:<pf2:w?B<V7RW�a9:wDETVL�:A�FG?GW�5[D�<VL�

ÝjN�Æ Û�Þ ß â ��Qnáß»s ¿ãâ ä ÝjN¦Ë Û�Þ ß à�Æ Û�Þ ß â ��Q2ç_ba9:�A�:+?EA�:jí ­ hpD L�L�5MT9K[:+LdW�?BW�:Lq?GWq:?Ef�asW�5MHJ:RLkW�:h�l}?B<V7sW�a9:A�:2XZD�A�:+í ­ ß a95M7V7;:<ÊLdW�?GW�:oL�:�U S9:<pf2:�L�DEX0KM:<V\BW�a3y�l?EL�L�S9H%5[<9\R<9DE<V:3DEXnW�a9:3W�A�?B<pLd5[W�5MDE<sh9A�D�TV?BTV5[KM5�W�5[:LP58L�:2�9?Ef2W�KMcFG9^q_ba9:JT9A�S;W�:�OXZD�A�f:3?BhVh9A�D ?Ef�a]DEXY:FG?BKMSV?BW�5M<9\�?EK[K}L�SVf�aL�:�U S9:<pf2:�LRf?E<êTp:I?vFEDE587;:7 Tmc>Hj?BCm5[<V\`SVL�:-DBXwW�a9:@f2D�<V7;5[W�5MDE<V?EKP5M<V7;:�hp:�<V7;:<pf25M:�LRA�:�h9A�:Ld:�< W�:�7 5M< W�aV:s�b?vcE:Ld58?B<<9:Wk~eD�A�Cg^+£9D�Aq:2�9?EHJhVK[:�l�7;5MA�:fzW�K[cI?Bh9h9KMcm5[<V\/W�a9:jXZD�A�~b?BA�7-hp?EL�LwDBX0W�a9:%XZD�A�~b?BA�7��mTV?Ef�Cm~b?BA�7]?BKM\EDEA�5[W�a9H D�S;W�KM5M<9:�7�5M<L�:�fzW�5[D�<R�p^ �pl;~e:wf�?B</f2DEH%h9S9W�:�W�aV:wK[5MCE:�K[5Ma9DmD;7oTmcRL�S9H%H%5[<V\3W�a9: � o L6?BWuW�a9:wK8?ELdWbW�5MH%:qLkW�:h

ÝjN�Æ Û�Þ ß â ��Q á » s ä ÝjNOË ß à�Æ Û à�çççà�Æ ß â ��Q N�� ��Q

á » s ä � ß ç N���� Q

£9D�A0W�a9:�X�?Ef2W�DEA�58?BKy4P=-=`l � Çn58Lb?�F�:�fzW�DEA0DBX}Ld5M�:�:�U SV?EKVW�D3W�a9:�XZS9K[K�LdW�?BW�:�Ldhp?Ef2:�?GW0W�5MH%:�Åzl;5O^ :E^m5[Wbap?ELbí ­ :KM:H%:�<�W�L^_ba958LuA�:�L�S9K�W�Lb5[<]?JA�:�f2SVA�L�5[F�:�?EK[\�DEA�5�W�a9H W�aV?GWPfDEH%h9S;W�:�L0W�aV:qK[5MCE:�K[5Ma9DmD;7oSpLd5M<9\Cå%NyPí å ­ Q0D�hp:�A�?BW�5MDE<VL�^)_ba95MLuf�?B</Ti:XZS9A�W�a9:�Ae5MH%h9A�DGFE:�7+S9hpD�<+TmcjSVL�5[<9\�W�a9:�X�?Ef2WYW�aV?GW0W�a9:�LdW�?GW�:6W�A�?E<VLd5[W�5MDE<pLe?EA�:�7;:2rV<V:�7jFm58?1¬ Hj?GW�A�58f2:LnDEX�Ld5M�:�í ñjíA�?GW�aV:A'W�aV?E<J?�L�5[<9\�K[:uí ­ ñ�í ­ Hj?BW�A�5��ylGA�:�L�S9K�W�5[<V\�5M<j?PA�:�fS9A�L�5MFE:e?EK[\�DEA�5�W�a9H¥SVL�5[<V\Må%N�yæ¬ í ­ � Û Q'DEhi:A�?GW�5MDE<pLeNOLd:�:« �E�¬�lV?BhVhp:�<V7;5[���uQz^V�P<;XZDEA�W�SV<V?GW�:KMcEl;W�a95MLuW�5MHJ:3f2DEH%h9KM:2�;5[Wkcof?E<9<9DEWbTi:q5MH%h9A�DGF�:�7oS9hpD�<�^�D�5MFE:�<RW�a9:wDETpLd:�A�FG?GW�5[D�<R?BWW�5MH%:qÅzlpW�a9:�í-�¦FG?EK[S9:7/LkW�?GW�:�Fv?EA�58?BTVK[:LbTp:f2DEH%:�fDES9hVK[:7/5[<-?E<K¬Ñë�ì%DEA�7;:A65M< W�:�A�?�fzW�5MDE<�^e��WP58L6<VDBWPhiD�L�Ld5MT9KM:�W�DoL�S9HDGFE:�A6:�?�f�a]FG?BA�5M?ET9K[:�5[<V79:hi:<V7;:�< W�KMcE^�Ä�5MCE:wW�a9:3KM5MCE:KM5Ma9DmDm7�lifDEH%h9S;W�5[<9\oW�a9:3hpD LkW�:A�5[D�APh9A�DETp?BT95MK[5[WkcoDEXY?oL�5[<V\EKM:�LkW�?GW�:FG?BA�5M?ET9KM:q\E5MFE:�</W�a9:3DETVL�:A�FG?GW�5MDE<]L�:�U S9:�<Vf2:�liÝjN¦Ë %*» 'Ç â Æ Û à�çç�çà�Æ ß Q2lg5ML�?BK8LdD+:�;hpD�<9:< W�58?BK�5[<<¬ ^��m5MHJ5MK8?BA�:2�;hpD�<9:< W�5M?EKW�5MH%:�fDEH%h9KM:2�;5[WkcIA�:�L�S9K[W�L3a9DEK87�XZD�A�W�a9:oKM5[C�:KM5[aVD D;79LJ?B<p7ÊhpD LkW�:A�5[D�A�h9A�DETp?BT95MK[5[W�5M:�L3DBXuW�A�:�:2��LkW�A�SpfzW�SVA�:7`4P=-=@L3?E<V7L�~u5�W�f�a95[<V\%LdW�?BW�:��L�hV?Ef:�H%D;7;:�KML�^¤�×/Ø çÒó<ókç3æ×bRÞ�ÝõÜ|ä3Þ/æbÛ Ø|:zèÊÞ�9d90ãüãMÜfÝõó0÷/Þ/Ûd?��<9:q?Eh9h9A�D�?Ef�aRW�D+fDEH%h9S;W�5[<V\+?Bh9h9A�Dv�;5[Hj?BW�:�Hj?BA�\E5M<V?BKyh9A�DETp?BT95MK[5[W�5M:�Lb58LuW�DjHj?BCE:wSpLd:wDEX}=]D�< W�:lI0?BA�KMDJ5M< W�:�\EA�?GW�5MDE<�^�m5M<Vf2:�W�a9:wKMDE\%K[5MCE:�K[5Ma9DmD;7Rf�?B<�Tp:w:�;h9A�:L�L�:�7R?EL

KMDE\YÝjNOÆgÛ�Þ ßeâ ��QYá »s ¿ãâ ä ÝjNOË�Û�Þ ßeâ ÆgÛ�Þ ßYà���Q�é�K[D�\YÝjNOË�Û�Þ ßeà�ÆyÛ�Þ ßnà���Q}ÜIK[D�\YÝjNOË�Û�Þ ßeâ ÆyÛ�Þ ßeà���Qãê0àTmc-L�?EH%h9K[5M<9\oXZA�D�HµW�a9:JhpD LkW�:A�5[D�A�7;58LdW�A�5[T9S9W�5MDE<�l�ÝjN¦Ë�Û�Þ ß0â ÆyÛ�Þ ßeà���Q2lgW�a9:%KMDE\RK[5MCE:�K[5Ma9DmD;7-f?E<@Ti:J?Eh9h9A�Dv�m5MHj?GW�:�7/SVL�5[<V\W�aV:b?ETpDGF�:Y:�mhVA�:L�L�5[D�<�lv~ua958f�a358Lp|kSVLkW)W�a9:b<9:\ ?GW�5[F�:YDBXVW�a9:0XZA�::b:<9:�A�\�cjN � � Qz^}_�D�KM:�?BA�<qW�a9:bhV?BA�?BH%:W�:A�L�DEXVW�a9:bHJD;7;:�KOlL�?BH%h9KM:�LYXZA�D�HÈW�a9:�hiD�LdW�:A�5MDEAe?EA�:�SVL�:�7jW�D3:�FG?BKMSV?GW�:PW�a9:�:�;hp:fzW�?BW�5MDE<VL0A�:�U S95MA�:7%XZDEAb�Y=`^9�PX'f2DESVA�L�:El XZDEA05M<�W�A�?�fzW�?BT9KM:H%D;7;:K8L)L�?EH%h9K[5M<9\w7;5MA�:fzW�K[cwXZA�DEH�W�a9:bhiD�LdW�:A�5MDEA)7;58LkW�A�5MT9S;W�5[D�<VL}5MLYf2DEH%h9S9W�?GW�5[D�<V?BKMKMcwh9A�D�a95MT95�W�5[F�:E^}46DG~0:F�:Al5[Wn58L}DBX°W�:�<:�?�LdcqW�D�L�:2WnS9h+?w=@?BA�CEDGFqf�aV?E5[<JW�ap?GWY~u5MK[Kif2D�< F�:A�\E:eW�DqL�?BH%h9KM:�L}XZA�DEH¯W�a9:PhpD LkW�:A�5[D�A�^)��<9:uDBXiW�a9:�Ld5MH%h9K[:LkWeHJ:W�a9D;79LW�D�?Ef�aV5[:�FE:jW�a95MLJ58L D�5[T9TpLJL�?BH%h9KM5M<9\>NZXZDEA%?@A�:Fm5M:~ DEX0D�5[TVTVL%L�?EHJhVK[5M<9\s?E<V7`DEW�a9:�AJ=@?BA�CEDGF�f�aV?B5M<®=]D�<�W�:^I0?EA�KMDH%:2W�a9D;79LlpLd:�:%« � � ¬°Q2^

£9D�A0?3\E5MFE:�<+DETpLd:�A�FG?GW�5[D�<+Ld:U S9:<Vf:�Æ Û�Þ ß lAD�5[TVTVLbL�?EHJhVK[5M<9\3LdW�?EAdW�LY~u5[W�a/?3A�?E<V7;DEH L�:2W�W�5M<9\3DEX�W�aV:�a958797;:�<�LdW�?BW�:LË Û�Þ ß ^]¤0W�:�?�f�aÊLkW�:h�DBXbW�aV:oL�?EH%h9K[5M<9\-hVA�D;f2:L�L�l�:?Ef�aÊLdW�?GW�:jFG?BA�5M?ET9K[:j58LqSVhi79?BW�:7ÊLkW�Dmf�ap?ELdW�58f?BKMKMc@?Ef�f2DEA�7;5M<9\�W�D-5[W�Lh9A�DETV?ET95MK[5[Wkc]7;5MLdW�A�5MT9S;W�5MDE<If2D�<V7;5[W�5MDE<9:7-DE<@W�a9:jL�:2W�W�5M<9\RDEXe?BKMK'W�a9:%DEW�a9:�A�LdW�?BW�:JFG?BA�5M?ET9K[:L^w_ba9:J\EA�?BhVa95Mf�?BK'H%Dm79:K}5ML?B\ ?B5M<ÊSVL�:2XZS9Kba9:�A�:�lY?EL3:�?�f�aÊ<9D;7;:R58L%f2D�<V7;5[W�5MDE<V?EK[KMcs5M<V7;:�hp:�<V7;:�<�WjDEXP?BKMK0DEW�a9:�A3<VDm79:�L3\E5MFE:<®5�W�LoÑ@ÒBÓ�ÔEÕBÖ���YMÒGÐmÔ�ÏØOl7;:rV<9:�7@?ELuW�a9:�L�:2W�DBXnf�a95MKM7;A�:<�lphV?EA�:�< W�L�lV?B<V7-hV?BA�:< W�L6DBX}W�a9:Jf�a95MKM7;A�:<]DEXY?j<9D;7;:�^6£9DEA�:2�9?BH%h9KM:ElVW�DoL�?BH%h9KM:wXZA�DEH

Page 16: An Introduction to Hidden Markov Models and Bayesian Networks

?oWkc hV5Mf�?BK)LkW�?GW�:3FG?BA�58?BT9KM:JË %�» 'Ç 5[<I?+X�?�fzW�D�A�58?BK}4P=@= ~0:3D�<9KMc]<9::7]W�D�:2�9?EHJ5M<9:3W�a9:jLdW�?BW�:�L�DEXe?+XZ:�~�<9:�5[\�a TiDEA�5M<9\<9D;7;:L�

Ë %*» 'Ç ë ÝjNOË %�» 'Ç â�ïvË % íÆ'ì �Æíp_á ÅOî �ø_á�¼@ð à�Æ Û�Þ ß Q N��m§EQá ÝjNOË %�» 'Ç â�ïvË % íÆ'Ç ���ø_á�¼@ð à�Ë %�» 'Ç�Ú�Û à�Ë %*» 'Ç � Û à�Æ Ç Q N�� ª Q· ÝjNOË %�» 'Ç â Ë %*» 'Ç�Ú�Û Q}ÝjN¦Ë %*» 'Ç � Û â Ë %*» 'Ç Q}ÝjN�Æ Ç â Ë % Û�'Ç à�çççà�Ë %*» 'Ç à�çççà�Ë % ­ 'Ç Q2à N�� © Q

~ua9:�A�: ë 7;:�<9DBW�:�Ljl�L�?EH%h9K[:7 XZA�D�H&nV^ �9?BH%h9KM5[<9\®DE<Vf:]XZA�D�H :?Ef�a DBX�W�a9:4yæ¬ a958797;:<êFG?EA�58?BT9KM:�L+5[< W�a9:@H%D;7;:KA�:�L�S9K�W�L65M<@?+<V:~�L�?BH%h9KM:qDBX)W�a9:�a958797;:�<sLdW�?BW�:�DEX}W�a9:JH%Dm79:K}?B<V7/A�:�U S95MA�:Læå%N�yæ¬ ísQbD�hp:�A�?BW�5MDE<VL�^P_ba9:JLd:U S9:<Vf:DBX�LkW�?GW�:LJA�:LdS9K[W�5M<9\sXZA�D�H :�?�f�a®hV?�L�L3DBXED�5[T9TpLJL�?BH%h9KM5M<9\I79:2rV<9:L%?s=-?EA�C�DGFIf�ap?B5M<®DGFE:�A�W�a9:]LkW�?GW�:�L�hV?Ef:oDEXPW�aV:H%D;7;:K¦^j_ba95MLw=@?BA�CEDGF]f�aV?B5M<I5ML�\�SV?BA�?B< W�:�:�7-W�D]f2D�< F�:A�\E:�W�D�W�a9:%hiD�LdW�:�A�5MDEA�h9A�DETV?ET95MK[5[W�5M:�L�DEXYW�aV:%LdW�?BW�:L�\E5MFE:<sW�aV:DETpLd:�A�FG?GW�5[D�<VL6« � §�¬y?ELYK[D�<9\3?�Ln<9D�<9:6DEXyW�a9:�h9A�DETV?ET95[KM5[W�5M:�Ln5M<jW�a9:PH%D;7;:Ki58LY:�;?�fzW�K[cJ�:�A�D�ïG^)_ba SpLlm?GX°W�:AbLdD�HJ:�LdS95[W�?ET9KM:W�5MH%:El9L�?BH%h9KM:�LYXZA�D�HÈW�a9:�=-?EA�C�DGF3f�aV?E5[<�f?B<oTp:�W�?ECE:�<o?EL0?Bh9hVA�Dv�;5MH%?BW�:PL�?BH%h9KM:�LeXZA�DEH W�aV:�hiD�LdW�:�A�5MDEA0h9A�DETV?ET95[KM5[W�5M:�L�^_ba9:JrVA�LkWq?E<V7sL�:�fDE<V7;�¦D�A�7;:�A�LdW�?BW�58LkW�5Mf�L�<9::7;:�7sW�D/:LkW�5[Hj?GW�:>�OË %*» 'Ç �2lI�OË %�» 'Ç Ë % íÆ'ðÇ ��?E<V7m�OË %*» 'Ç�Ú�Û Ë %�» '�ðÇ ��?BA�:JfDEKMK[:fzW�:7SVL�5[<V\]W�a9:�LkW�?GW�:�LqFm58Ld5[W�:7`?B<p7IW�a9:Rh9A�D�TV?BTV5[KM5�W�5[:Lq:LkW�5[Hj?GW�:�7`79S9A�5M<9\]W�a958L3L�?BH%h9KM5[<V\-h9A�Dmf:�L�Lq?B<p7`?BA�:jSVL�:�7Ê5M<ÊW�aV:?BhVh9A�Dv�;5MHj?GW�:J��LdW�:�hsDEXe�Y=`^ Û�Q =]DE< W�:>I0?BA�KMDoH%:2W�a9D;79L�XZDEA�KM:�?BA�<95M<9\�5[<�7;cm<V?BH%58f3�b?vc�:�L�5M?E<]<9:2Wk~0DEA�C;LPaV?vF�:3Ti::�<:2�;h9KMDEA�:�7RTmc@« �E� lV�E�9l � G;lV�E�¬�^¤�×�ð çÒó<ókç3æ×bRÞ�ÝõÜ|ä3Þ/æbÛað�:>8`ÜfçAÞ�Ü�ä3Þ�æ�Û�Üv÷�� â$ä� <æRö<ã¤6<VDBW�aV:A�?Eh9h9A�D�?Ef�a@W�D]?BhVh9A�Dv�;5MHj?GW�5M<9\/?/h9A�DETV?ET95[KM5[Wkc-7;5MLdW�A�5MT9S;W�5MDE<ÊÝ�5MLwW�D]7;:2rp<9:+?/hV?BA�?BH%:W�:A�58Ld:7@7;58LkW�A�5MT9S;W�5[D�<D ?E<V7`FG?BA�c�5�W�LJhV?BA�?BH%:2W�:A�L�L�Ds?�LqW�DsH%5M<95[H%58Ld:RW�aV:�7;58LdW�?B<pf2:�Tp:Wk~e:�:<mD ?B<V7 Ý%^I��<®W�a9:/f2D�< W�:2�mWJDBX6W�a9:��e=?BKM\ED�A�5[W�aVH�li~0:�aV?vF�:�?BKMA�:?E7;c/L�::<-W�aV?BW�W�a9:�KMDE\RK[5MCE:�K[5Ma9DmD;7 , N���Q658L�K[DG~0:APTpD�S9<V7;:7-Tmc�W�a9:J<9:\ ?GW�5[F�:wXZA�:�:�:�<9:A�\Ec�lJ/N�D%à���Qz^%_ba9:j7;5CBi:�A�:�<Vf2:JTp:Wk~e:�:< , ?B<V7EJ 5ML�\�5[F�:<@Tmc]W�a9: î�S9KMK[TV?�f�C ��Ä�:5MT9K[:�A�795[F�:A�\E:<pf2:�Ti:2Wk~0::�<zD ?B<V7@W�aV:hiD�LdW�:A�5MDEAu7;58LkW�A�5MT9S;W�5[D�<�DEX�W�a9:wa958797;:<]FG?EA�58?BT9KM:�L��, N��Q}Ü<J/N�D%à���Q á îwÄ Ï DjN¦Ë�Û�Þ ß0â ñgQaòÝjNOË�Û�Þ ßYâ ÆgÛ�Þ ßYà���Q Ø N¦��G Q

á »s ¿Ñâ ä DjNOË Û�Þ ß â ñgQ�KMDE\`Î D+NOË�Û�Þ ßeâ ñiQÝjN¦Ë Û�Þ ß â Æ Û�Þ ß à�� Q Ð N¦� � Q

~ua9:�A�:¨ñ-?EA�:�W�a9:whV?BA�?BH%:W�:A�L0DBX�W�a9:q7;58LdW�A�5[T9S9W�5MDE<4D%^_ba9:3Fv?EA�58?GW�5[D�<V?BK'?Bh9hVA�D ?Ef�a]SVL�:�L�?jW�A�?�fzW�?ET9KM:�D W�D�?Eh9h9A�Dv�m5MHj?GW�:�W�a9:J5[< W�A�?�fzW�?ET9KM:�hiD�LdW�:A�5MDEA^�_ba9:3W�A�?Ef2W�?BTV5[KM5�Wkc

DBXuf2D�H%h9S;W�5M<9\]:�mhi:�f2W�?BW�5MDE<VLw~u5[W�a�A�:�L�hp:fzWwW�DKD�79:hi:<V79L�TpDEW�a�DE<�5[W�Lwhp?BA�?BH%:2W�A�58f3XZDEA�HÉ?B<p7sD�<s5[W�L3f2D�<V7;5[W�5MDE<V?EK5M<V7;:hi:<p7;:<Vf:oA�:K8?GW�5[D�<VL^ Û�Û _baV:R?BA�W�58LqW�D@f�a9D Ld:o?]X�?BH%5[KMc�DBXdDwLqW�aV?BW3aV?vF�:o?B<`?E<V?BKMc W�58f%XZDEA�Hî?E<V7`?/W�A�?�fzW�?BT9KM:LdW�A�SVfzW�S9A�:2xê?��0?vc�:�L�5M?E<%<9:2Wk~0DEA�CqW�aV?GWb:KM5[H%5M<V?GW�:�L0LdD�H%:6DBXyW�a9:�7;:�hp:�<V7;:�<Vf25M:�Le5[<�Ý�x TVS;WYW�aV?GWbf?B<R?Bh9h9A�Dv�;5[Hj?BW�:6Ý?E79:�U SV?GW�:KMcE^vD�5[F�:<jW�a958LeLdW�A�SVfzW�S9A�:El�W�a9:�hV?BA�?BH%:2W�:A�L)DBX×D ?EA�:PFv?EA�5M:�7jL�D�?�L)W�D3DET;W�?B5M<%W�a9:PW�5M\Ea W�:LkW0hpD L�L�5MT9K[:�TpD�S9<V7yl~ua958f�a-H%5[<V5[H%58Ld:L3N¦� � Q2^ � :3~u5MK[K'A�:2XZ:APW�DoW�a9:3\E:<V:A�?BK�LdW�A�?GW�:\�coDBXnSpLd5M<9\R?+hV?BA�?BH%:2W�:A�5ML�:�7/?Eh9h9A�Dv�m5MHj?GW�5[<9\R7;5MLdW�A�5[�T9S;W�5[D�<@?EL�?]ÖGÒGÓzÍ�ÒGئÍ�ÕGÐgÒJYYÒ�×E×iÓ�Õ/ó�Í°ò%ÒBØOÍ�ÕBЮ?B<p7/A�:XZ:A6W�D+W�a9:qXZA�::qhp?BA�?BH%:2W�:A�LuDBX)W�a9:�D 795MLdW�A�5[TVS;W�5MDE<@?�LqÖGÒGÓzÍ�ÒBØOÍ�ÕBÐiÒJY×VÒGÓ�ÒBò%ÏØ�ÏÓ�ëz^¤�×�Ö �ObRÜfÝõó0÷�âßØc:K� â$ÜvÛõô0â}÷/öf�æ¯çm�Üfà�ä5æ¯ç�Þ�Üv÷16Å��� ã� :�5MKMK[SVLdW�A�?GW�:�W�a958Lj?Bh9hVA�D ?Ef�a`SVL�5M<9\@W�a9:]Ld5MH%h9KM:�LdW%FG?EA�58?GW�5[D�<V?BKu?BhVh9A�Dv�;5MHj?GW�5MDE<`W�DsW�a9:]hiD�LdW�:�A�5MDEA%7;58LkW�A�5MT9S;W�5[D�< 5M<X�?Ef2W�D�A�58?BKy4P=@=-L�e?BKMK�LkW�?GW�:�FG?BA�58?BT9KM:�Lb5M<�D ?EA�:�5[<p7;:hi:<V79:< W3N�£'5M\ES9A�: ª N�?�Q�Qz�

DjN¦Ë Û�Þ ß â ñgQYá ßãÇZä�Û

­ã» ä�Û DjNOË %�» 'Ç â ñ %*» 'Ç Qzç N¦�E��Qö ��%u��{vúx(x �~y6�¦ö��f)���ú ���'ú�ø¦ø�{6�R�6�¦÷(� �<�73����. �~#v÷(%k÷ ����÷ùø�ø�{_÷R%k÷(���~�$�������vø�{����v%�� �~������. ����%��ô�ø �F�R� ���×ùyú/���kø¦÷�ú�������dú]���R�����$�7g�¦ö6�fx(�dú���v÷(��.b����� w�x(���+y�÷(�R)�öv÷(%�ö��Oö��f�Gú�¦ú�R�������¦ø�ú���}úxùø��b%�� �vø¦÷(#6�/����#�öv÷(#6#����k�¦ú��#�� �ÿ�zú�O÷�úw�x(�kø�y%dú�Rw���öGú�6#�x(��#Rw~��¯'÷(w�wvøiø¦ú�R��xù÷(��.fw���������x�ú%k÷(��.v�¦ö��PúW� ø������Rûv)�÷ �¦öuø¦ú�R��xù÷(��.�7C��� �`�¦ö��}%�� ��#v÷ �O÷(� �Gúx-#v÷ùø����¦÷(w�{&�¦÷(� ���7-�Oö��|�vú��ú�R�u�����Oø.z÷ �����k�Oö��¯��¦ö6�/��öv÷(#�#6�/�<�zú�O÷�úw�x(�køb¤z79� �$�u­ú�R��x(� yvø����R§ ü ¨«C¥W�ô�ô ¬l�¯)�÷(x(xmø����¯x�ú]���/�'ö���)`%�ö��~�zø¦÷(�6.��Oö��b%�� ��#v÷ �O÷(� �Gúx9÷(��#������/�6#�����%�������x�ú]�O÷(� �vø��7$ýIø�� �R�u�O÷(�R�dø}#��u���/���u÷(���kø}�Oö��b� �6�O÷(�6úx5�Gú��ú�R�u���¦÷(%7C� ���ø�7�ý��Võ�öv÷ùø�÷ùø2ú�����{���ûK�zú�O÷�ú]�¦÷(� �vúxg� �6�O÷(�u÷ùø�ú]�O÷(� �MyvøO÷(��%��v%�úx(%�{�x({ø|�75��ú�¦÷�ú]�O÷(� �vø�÷ùø${vø���#k����� �6�O÷(�u÷ùø��f�/���/��úx(xM#÷ùø����¦÷(w�{6�O÷(� �vø£ýK�

Page 17: An Introduction to Hidden Markov Models and Bayesian Networks

S(1)t

S(2)t

S(3)t

S(1)t+1

S(2)t+1

S(3)t+1

S(1)t-1

S(2)t-1

S(3)t-1

S(1)t

S(2)t

S(3)t

S(1)t+1

S(2)t+1

S(3)t+1

S(1)t-1

S(2)t-1

S(3)t-1

N�?�Q NZTpQ

£'5[\�S9A�: ª �PNO?�Qu_ba9:qfDEH%h9KM:2W�:KMcoX�?�fzW�D�A�58L�:�7RFv?EA�58?GW�5[D�<V?BK�?Eh9h9A�Dv�;5[Hj?GW�5[D�<�?�L�L�S9H%5M<9\%W�aV?BWP?BKMK�W�a9:�LdW�?GW�:wFG?BA�5M?ET9K[:Lu?BA�:5M<V7;:hi:<p7;:< W6N�fDE<V7;5[W�5MDE<p?BK DE<qW�a9:0DETVL�:A�FG?GW�5MDE<qL�:�U S9:�<Vf2:vQz^bNZTpQ�¤>LkW�A�SVf2W�S9A�:�7�FG?BA�5M?BW�5MDE<V?EK�?BhVh9A�Dv�;5MHj?GW�5MDE<q?�L�L�S9H%5M<9\W�ap?GWbW�a9:qLdW�?BW�:�FG?BA�5M?ET9K[:L0A�:W�?B5M<RW�a9:�5[A6=-?EA�C�DGFJLdW�A�SVf2W�S9A�:�~u5�W�a95[<�:�?�f�a�f�ap?B5M<�lmT9S;WP?BA�:�5[<V79:hi:<V7;:�< WP?Ef2A�D�L�L0f�aV?B5M<VL�^

_ba9:RFv?EA�58?GW�5[D�<V?BKehV?BA�?BH%:W�:A�L�lcñ{áþÎ$ñ %�» 'Ç Ü ln?BA�:jW�a9:�H%:�?E<VL�DEXuW�a9:/LdW�?GW�:oFG?BA�58?BT9KM:�L�l}~ua9:A�:Eln?�LqTi:2XZDEA�:Eln?sLkW�?GW�:FG?BA�5M?ET9KM:]Ë %*» 'Ç 58LjA�:�h9A�:�L�:< W�:7 ?�Lj?Êí]��7;5[H%:�<VLd5MDE<p?BKbFE:fzW�D�Aj~u5�W�aê? � 5M<>W�a9:<ÿMë�ìIhpD Ld5[W�5MDE<ê?B<p7cG�:�KML�:~ua9:�A�:�le5[XW�aV:C¼në�ì-=-?BA�CEDGF-f�aV?E5[<�58Lq5M<`LkW�?GW�:Nÿ�?GWwW�5MH%:oÅz^/_ba9:+:�K[:�HJ:�< W�LwDEX0W�a9:+F�:�fzW�DEA�ñ %*» 'Ç W�a9:�A�:XZDEA�:+7;:2rp<9:jW�aV:oLkW�?GW�:D;ffS9hV?GW�5[D�<RhVA�D�TV?BT95MKM5�W�5[:LbDBX�W�a9:wH�SVK�W�5[<9D�H%5M?EK�FG?BA�5M?ET9K[:wË %*» 'Ç S9<V7;:�AbW�a9:�D 7;58LdW�A�5[T9S9W�5MDE<��

DjNOË %�» 'Ç â ñ %*» 'Ç Qná pã� ä�Û � ñ %*» 'Ç À ��� s ÓÕÔhÖt�u  ~uaV:A�: Ë %*» 'Ç À � �sï�G9à � ð!m p»� ä�Û Ë %�» 'Ç À � á � ç N¦�B� Q

¤ f2D�HJhVK[:W�:KMc%X�?Ef2W�D�A�58Ld:7o?Eh9h9A�Dv�m5MHj?GW�5[D�<+DBX�W�a958LbC 5M<V7R5ML0DEX°W�:<�SVL�:�7o5[</LkW�?GW�5MLdW�58f?EKihVa c;L�5Mf�Ll;~uaV:A�:�5[Wuh9A�DGFm587;:�LYW�aV:TV?�Ld58L0XZDEA6L�5[H%h9KM:wcE:WuhpDG~0:A�XZS9K)òjÏ�ÒBÐ1§0Ï�Y[ÎRÒ�×�×iÓ�ÕWóEÍ°òjÒGئÍ�ÕGÐVëwW�D+LdW�?BW�58LkW�5Mf�?BKyH%:�f�aV?E<958f?BKyL�c;LkW�:HjLq« ���v¬�^

_�DsHj?BC�:oW�a9:/TpD�S9<V7>?EL3W�5M\Ea W+?ELJhiD�L�Ld5MT9KM:/~e:�FG?BA�c ñêLd:�hV?BA�?GW�:KMcIXZDEAj:�?�f�a`DETpLd:�A�FG?GW�5[D�< L�:�U S9:�<Vf2:/LdD�?EL3W�DH%5[<V5[H%58Ld:�W�a9: îwÄ`7;5MFE:A�\E:�<Vf2:�^u_�?EC 5M<9\%W�a9:37;:�A�5MFG?GW�5[F�:�LuDEXPNO� � Qb~u5[W�a-A�:�L�hp:fzW6W�D�ñ %*» 'Ç ?B<V7]L�:2W�W�5M<9\+W�a9:H W�D+�:�A�Dpl~0:�D�T;W�?E5[<�W�a9:qLd:WuDBX'r9�;:�7RhpD�5[< W6:�U SV?BW�5MDE<VLu79:2rV<9:7�T cñ %*» '�����Ç á�4Á¯T %*» ' o � ÚyÛ �Æ %*» 'Ç Ü �

��� %�» ' ú�NZKMDE\~r %�» ' Qcñ %*» 'Ç�Ú�Û ú�NZKMDE\Pr %*» ' Q o ñ %�» 'Ç � Û Ã N¦�G�mQ

~ua9:�A�: �Æ %�» 'Ç 58LbW�a9:wA�:�fDE<VLdW�A�SVf2W�5MDE<�:A�A�D�A05M<]ÆVÇ0\E5MFE:�<oW�a9:wh9A�:�7;58fzW�5[D�<VLbXZA�DEH ?EK[K�W�a9:qLdW�?BW�:wFG?BA�5M?ET9KM:�Lb<9DEW65[<VfK[Sp7;5[<V\¼I� �Æ %*» 'Ç � ÆpÇ�Ü ­»¶��ä » T % ¶ã' ñ % ¶ã'Ç à N¦�E��Q

� %*» ' 58LbW�a9:qFE:fzW�DEAbDBX)7;58?B\ED�<V?BKy:�K[:�H%:< W�LuDEXvT %�» ' o � Ú�Û T %*» ' lp?E<V7�eï!ê[ð�58LbW�a9:qLdDEX°W�Hj?G��DEhi:A�?GW�DEAl ~uaV5Mf�a/Hj?BhVL?JFE:fzW�D�A��/5[< W�Dj?JFE:fzW�DEA��`DBX'W�aV:qL�?EHJ:wL�5[��:El;~u5[W�a/:KM:H%:�<�W�L� Ä á :2�;hyï�� Ä ð» È :2�;hyï�� È ð à N¦�B� Q

?B<p7@KMDE\�rd%*» ' 7;:�<9DBW�:�L�W�aV:j:KM:H%:< Wk~u58Ld:%KMDE\�?EA�5[W�aVH DBXeW�a9:%W�A�?E<VLd5[W�5MDE<IHj?GW�A�5[�zrd%*» ' N�L�::+?BhVhp:�<V7;5[�VI¥5M<ê« ���¬nXZD�A7;:W�?B5MK8LbDBX'W�a9:q7;:�A�5MFG?GW�5[D�<pQz^

_ba9:0rVA�LkW)W�:A�H¯DEX'NO�B� Q'58L}W�aV:uh9A�DE|k:�f2W�5MDE<JDBXVW�a9:6A�:�fDE<VLdW�A�SVfzW�5[D�<�:�A�A�DEA}DE< W�D�W�a9:u~0:5M\Ea W�L}DEXgLdW�?BW�:bFE:fzW�D�Ac¼+x W�aV:H%DEA�:q?jhV?EAdW�5MfS9KM?EAPL�:2WdW�5[<V\+DBXn?+LdW�?BW�:qF�:�fzW�DEAPf�?B<]A�:�7;Spf2:�W�aV5ML�:A�A�D�A�l9W�a9:qK8?BA�\E:�Au5�W�L�?�L�L�D;f258?GW�:�7�FG?BA�5M?BW�5MDE<V?EKyHJ:?B<�^_ba9:-L�:�fDE<V7®W�:�A�H ?BA�5ML�:�L3XZA�DEH¸W�a9:/X�?Ef2WjW�aV?BWjW�a9:-L�:�fDE<V7 DEA�7;:�A+f2DEA�A�:K8?GW�5MDE<Å�OË %�» 'Ç Ë %*» 'Ç �J:�FG?BKMSV?GW�:�7>S9<V7;:�AjW�aV:FG?BA�5M?BW�5MDE<V?EK97;58LkW�A�5MT9S;W�5[D�<+5MLY?q7;58?B\ED�<V?BKVH%?BW�A�5��%f2D�HJhiD�L�:�7JDEXiW�a9:P:�K[:�H%:< W�LYDBXhñ %*» 'Ç ^}_baV:6KM?�LkWYWk~eD�W�:A�H%Ln5[< W�A�D;7;SVf:7;:�hp:�<V7;:<pf25M:�LRXZDEA�~0?EA�7ê?E<V7{Tp?Ef�Cm~0?EA�7 5M<{W�5[H%:�^ Ûdå _ba9:A�:2XZD�A�:�lP?BK[W�aVDES9\�aêW�a9:IhiD�LdW�:A�5MDEA/7;5MLdW�A�5MT9S;W�5MDE<�DGFE:�A+W�aV:a958797;:�<RFG?BA�58?BT9KM:�Le5MLb?Eh9h9A�Dv�m5MHj?GW�:�7j~u5[W�a/?�fDEH%h9KM:2W�:�K[c%X�?�fzW�DEA�5ML�:�7R7;5MLdW�A�5MT9S;W�5MDE<�l�W�a9:�r9�;:�7ohpD�5[< Wu:�U SV?BW�5MDE<VL0f2D�S9h9KM:ô�s õ�ö6� ° �¦ø��}�������®÷ùø$������x�ú%���#+w~�<x(� .������! �7C� �'=#" ©f�¦ö6�)ø���%�� ��#0���/����#��~�kø|�6��'ú�6�-�dú�}79� �$=$"&%¯�

Page 18: An Introduction to Hidden Markov Models and Bayesian Networks

W�aV:6hV?BA�?BH%:W�:A�L)?EL�L�Dmf5M?BW�:7�~u5[W�aj:?Ef�a%<9D;7;:6~u5[W�a%W�a9:6hV?EA�?EHJ:W�:�A�L}DEXi5[W�Le=-?BA�CEDGFwT9K8?B<VCE:2W^���<%W�a958LYL�:<VL�:ElEW�a9:urV�m:7hiDE5M<�W�:�U SV?BW�5MDE<VLPh9A�D�hV?B\ ?GW�:w5[<;XZD�A�Hj?BW�5MDE<-?BKMDE<V\jW�a9:JL�?EH%:qhV?GW�am~0?vc;L6?�LuW�aVD�L�:37;:rV<95M<9\+W�a9:�:�;?�fzW�?EK[\�DEA�5�W�a9HjLuXZD�Ah9A�DETV?ET95MK[5[Wkc+h9A�DEhV?E\�?BW�5MDE<�^

_ba9:JXZDEKMKMDG~u5[<9\/Hj?vc-h9A�DGFm5M79:%?E<s5M< W�S95[W�5MFE:j5M< W�:�A�h9A�:2W�?GW�5[D�<sDEXeW�a9:+?Bh9hVA�Dv�;5MH%?BW�5MDE<sH%?�7;:%Tmc-W�aV5MLq795MLdW�A�5[TVS;W�5MDE<�^D�5MFE:<I?+hV?EAdW�5MfS9K8?BA�DETVL�:A�FG?GW�5MDE<sLd:U�SV:<Vf:EliW�a9:%a958797;:�<sLdW�?BW�:JFv?EA�58?BTVK[:L6XZD�APW�a9:C¬º=-?BA�CEDGF/f�aV?B5M<VL�?GW�W�5MH%:%LdW�:�hÅ3?EA�:/LdW�D;f�aV?ELdW�58f?EK[KMcÊf2D�S9h9KM:�7y^>_ba95MLjLdW�D;f�aV?�LkW�5Mf�f2D�S9h9KM5[<V\s58L%?Bh9h9A�Dv�;5[Hj?BW�:�7®Tmc`?sL�c;LkW�:H¸5M< ~uaV5Mf�a®W�a9:]a958797;:�<FG?BA�5M?ET9KM:�Lu?BA�:wS9<VfDEA�A�:�KM?BW�:7oT9S9WPaV?vFE:wfDES9h9KM:�7/H%:?B<VL�^e_ba9:�Fv?EA�58?GW�5[D�<V?BKyD�A(ldH%:�?E<;�¦rV:K87!n%:�U SV?BW�5MDE<VLuL�DEKMFE:�XZD�AuW�aV:7;:W�:A�H%5[<V5MLdW�58fwf2D�S9h9KM5[<9\%DEX�W�aV:wHJ:?B<VLuW�aV?BWbTi:�LdW�?Eh9h9A�Dv�m5MHj?GW�:�LYW�a9:qLdW�D;f�aV?�LkW�5Mf�?BKMK[c+fDES9h9KM:�7/L�c;LkW�:H/^

�Y?�f�a a95M7V7;:<�LdW�?BW�:sFE:�f2W�D�A+5MLoS9hg79?GW�:�7{5M<êW�S9A�<êSpLd5M<9\ N¦�G� Q2l6~u5[W�a�?�W�5[H%:If2DEH%h9KM:2�;5[Wkc DEX1å%Nyæ¬ í å Qjhi:A5[W�:A�?GW�5[D�<�^fIeD�<mFE:A�\E:�<Vf2:}58L�7;:W�:�A�H%5M<9:�7wTmc�H%DE<95[W�D�A�5M<9\bW�aV:�îwÄ+7;5MFE:�A�\�:<Vf:)5[<qW�a9:eFv?EA�58?GW�5[D�<V?BK�7;5MLdW�A�5MT9S;W�5MDE<wTi:2Wk~0::�<L�SVff:�L�Ld5MFE:�W�5[H%:3LdW�:�hVL&mp5M<-h9A�?Ef2W�58f2:qf2D�<mFE:A�\E:�<Vf2:�58L6F�:A�cRA�?Bh9587�N�?ETpD�S;W��JW�D � G+5�W�:A�?GW�5MDE<pLuDBX6NO�B� Q�Qz^kIeDE<mF�:A�\E:<pf2:W�D+?%\�K[D�TV?BKyH%5M<95MH�S9HµDBX'W�aV:rîwÄÊ7;5MFE:A�\E:�<Vf2:�58L6<9DEW6A�:U�SV5[A�:�7ylp?B<V7�5M<]\E:<V:A�?BKgW�aV5MLuhVA�D;f2:7;S9A�:w~u5[KMK�fDE<mFE:�A�\�:PW�D+?KMDmf�?BKpHJ5M<95MH�S9H/^Y��<Vf:6W�aV:ur9�;:�7jhiDE5M< We:U�Sp?GW�5MDE<pL)aV?vFE:�f2DE<mF�:A�\E:�7�lvW�a9:�:2�;hp:fzW�?GW�5MDE<pLnA�:�U S95MA�:7JXZDEAnW�a9:��®LkW�:h+f?E<Ti:wDET;W�?B5M<9:�7�?ELu?%L�5[H%h9KM:�XZS9<Vf2W�5MDE</DBX'W�a9:whp?BA�?BH%:2W�:A�L�« �E�v¬¦^¤�×� �ObRÜfÝõó0÷�â ð~:Vñ�ä5çÄikà�ä!i�ç3â}öaÜfó<ókç3æ×bRÞ�ÝõÜ|ä3Þ/æbÛ �æ¯ç��Üvà�ä5æ¯çAÞ�Üv÷�6º�þ� ã_ba9:@?Eh9h9A�Dv�;5[Hj?GW�5[D�<®h9A�:�L�:< W�:�7>5[< W�a9:-h9A�:Fm5MDESVLjL�:�f2W�5MDE<>X�?Ef2W�D�A�L%W�a9:-hiD�LdW�:�A�5MDEAjh9A�DETp?BT95MK[5[Wkc`5M< W�D®?�h9A�D;7;SVf2W+DBXLdW�?GW�5MLdW�58f?EK[KMc�5[<p7;:hi:<V79:< Wn7;5MLdW�A�5MT9S;W�5MDE<pL�DGF�:A�W�a9:bLkW�?GW�:0FG?BA�5M?ET9KM:�L�^�46:�A�:e~e:0h9A�:�L�:< W'?E<9DBW�a9:A'?Bh9h9A�Dv�;5[Hj?BW�5MDE<w~ua958f�a58L0W�A�?EfzW�?BT9KM:�cE:WbhVA�:Ld:�A�F�:�LeH%?E<mcjDBX'W�a9:�h9A�DETV?ET95MK[58LkW�5Mf�7;:�hp:�<V7;:�<Vf25M:�Lb5M<�W�a9:wD�A�5M\E5M<V?BKgL�cmLdW�:�H/^)��<oW�a95MLPL�f�a9:�H%:ElmW�aV:hiD�LdW�:A�5MDEA�7;58LdW�A�5[T9S9W�5MDE<qDEX W�a9:nX�?�fzW�DEA�5M?EK�4P=@= 5ML�?Bh9hVA�Dv�;5MH%?BW�:7�Tmc¨¬ S9<VfDES9h9KM:�7�4P=-=-L�?EL�Lda9DG~u<w5M<�£'5M\ES9A�: ª N�TpQz^� 5[W�a95M<R:?Ef�a�4P=-=Êl;:é+f25M:< Wb?E<V7R:2�9?Ef2W05M<;XZ:A�:<pf2:�5ML05MHJhVK[:�HJ:�< W�:�7RFm5M?�W�aV:�XZD�A�~b?BA�7��mTV?Ef�Cm~b?BA�73?EK[\�DEA�5�W�a9H/^}�m5M<Vf:W�aV5MLn?Eh9h9A�Dv�;5[Hj?GW�5[D�<358Ln?EK[KMDG~e:7wW�DwaV?vFE:u7;:�hp:�<V7;:<pf25M:�L)Ti:2Wk~0::�<3W�a9:6a958797;:�<jFG?BA�5M?ET9K[:L'5�WY~u5MKMK9\E:�<9:A�?BKMK[c�Tp:6L�S9hi:A�5[D�AW�DRW�aV:JfDEH%h9KM:2W�:�K[c�X�?�fzW�D�A�58L�:�7]H%:�?E<;�¦rV:K87-?BhVh9A�Dv�;5MHj?GW�5MDE<]hVA�:Ld:�<�W�:�7]5M<-W�a9:Jh9A�:�Fm5[D�SVL�L�:�f2W�5MDE<�liW�aV?GW�5ML�lgW�aV:3KMDG~e:�ATiDES9<V7R~u5MK[KgTi:�aV5[\�a9:Au?B<p7jW�aV:+îwÄy��7;5MFE:�A�\�:<Vf:PKMDG~e:�A�^}_ba9:�?Bh9hVA�D ?Ef�a+DEX�:2�;h9KMDE5[W�5M<9\%LdSVf�aoW�A�?Ef2W�?BTVK[:�LdSVTVLkW�A�SpfzW�SVA�:L~b?EL0rVA�LkW6L�S9\E\�:�LdW�:7+5M<RW�a9:wHj?Ef�a95M<9:�KM:�?BA�<95M<9\%K[5[W�:�A�?BW�S9A�:�TmcR�;?BSVK�?B<V7�¨�DEA�79?B<IN ��©�© � Qz^

� :w~uA�5[W�:�W�aV:qLkW�A�SVf2W�S9A�:�7RFG?BA�5M?BW�5MDE<V?EKy?Bh9h9A�Dv�;5[Hj?BW�5MDE<R?�LD+NOË Û�Þ ß â ñiQeá �U!' ­ã» ä�Û DjNOË %*» 'Û â ñgQ ßãÇZä�å DjNOË %*» 'Ç â Ë %�» 'Ç�Ú�Û à ñiQ2à N¦��§EQ

~ua9:�A�:�U('µ5MLs?ê<9D�A�Hj?BKM5M��?GW�5[D�<�fDE<VLdW�?E< W-:<VL�S9A�5[<9\{W�aV?BW<D�LdSVH%L-W�D{D�<9:E^ _ba9:®hV?BA�?BH%:2W�:A�L/DBXND�?BA�: ñ áïW¾5%�» ' à³rd%*» ' à*) %*» 'Ç ð2x W�a9:0DEA�5[\�5[<p?BKEhVA�5MDEA�L�?E<V7qLdW�?GW�:YW�A�?E<VL�5�W�5[D�<qHj?GW�A�58f2:�L�DBX9W�a9:eX�?EfzW�DEA�5M?EK�4�=-=�?E<V7q?6W�5MHJ:�¦FG?EA�cm5M<9\T958?EL0XZD�Au:�?Ef�a/LdW�?GW�:�Fv?EA�58?BTVK[:�^}_baV:wh9A�5MDEAu?E<V7RW�A�?B<VL�5�W�5[D�<RhVA�D�TV?BT95MKM5�W�5[:LYXZD�AdD ?BA�:DjNOË %*» 'Û â ñgQ á pã� ä�Û � ) %*» 'Û À � ¾ %*» '� � s ÓÕÔhÖ¿ u  N¦� ª Q

DjN¦Ë %*» 'Ç â Ë %*» 'Ç�ÚyÛ à�ñgQ á pã� ä�Û +, ) %*» 'Ç À � p»È ä�Û r %*» '� À È Ë %*» 'Ç�Ú�Û À È�-. s ÓÕÔhÖt�u Âá pã� ä�Û +, ) %*» 'Ç À � pãÈ ä'Û � r %*» '� À È � s ÓÕÔhÖt�w ¿ u x -. s

ÓÕÔhÖt�u Âà N¦� © Q

~ua9:�A�:�W�aV:wKM?�LkWu:�U SV?EK[5[WkcjXZD�K[KMDG~6L0XZA�D�H W�aV:�X�?EfzWuW�aV?GWPË %�» 'Ç�Ú�Û 58Lu?3F�:�f2W�DEAu~u5[W�a]? � 5[</D�<9:�hpD Ld5[W�5MDE</?B<V7^GJ:K8L�:~ua9:�A�:�^IeDEH%hV?EA�5M<9\`:U SV?GW�5[D�<VLsN¦��§EQ\�gN¦� © QJW�D>:�U SV?BW�5MDE<¯N � Qzl�~e:If?E<�L�::-W�aV?GW�W�aV:Ií ñ � FE:�f2W�D�A�) %*» 'Ç h9K8?vcmLoW�aV:sA�DEKM:DBX�W�a9:]hVA�D�TV?BT95MKM5�Wkc`DEX�?E<>D�TVL�:A�Fv?BW�5MDE<�N�ÝjN�ÆpÇ2â ËyÇdQJ5[< N � QdQ3XZDEAj:?Ef�a>DBX�W�a9:-í L�:2WdW�5[<V\�LjDEX�Ë %*» 'Ç ^{£VDEA%:2�9?BH%h9KM:ElDjN¦Ë %*» 'Û À È á � â ñiQ0á/) %�» 'Û À È ÝjN¦Ë %*» 'Û À È á � â ñgQb5MLP:�U S95MFG?BKM:< WuW�D+ap?vF 5M<9\j?B<]D�TVL�:A�Fv?BW�5MDE</?GW6W�5[H%:qÅeá � W�aV?GW�S9<V7;:�APLkW�?GW�:Ë %*» 'Û À È á � aV?�Lbh9A�DETV?ET95[KM5[Wkc&) %*» 'Û À È ^��< W�S95[W�5MFE:�K[c�l}W�a958L%?Bh9hVA�Dv�;5MH%?BW�5MDE<�S9<VfDES9hVK[:LqW�a9:�¬ =@?BA�CEDGFsf�ap?B5M<VL3?E<V7`?BWdW�?�f�a9:�LqW�Ds:�?Ef�a LkW�?GW�:RFG?BA�5M?ET9K[:R?7;58LkW�5[<pfzW6rpf2W�5[W�5MDESVL6DETVL�:A�FG?GW�5MDE<�^n_ba9:wh9A�DETV?ET95[KM5[Wkc+DBX}W�aV5MLbrifzW�5[W�5MDESpLuDETVL�:A�FG?GW�5[D�<�f�?B</Tp:wFG?EA�5M:�7/L�D%?�LbW�DjH%5M<95MHJ58L�:W�aV:@îwÄI795[F�:A�\E:<pf2:�Tp:Wk~e:�:<4D¯?E<V7/Ý%^

Page 19: An Introduction to Hidden Markov Models and Bayesian Networks

¤6hVh9K[cm5M<9\JW�a9:3L�?EHJ:w?EA�\�S9H%:< W�Lb?ELbTi:2XZD�A�:�l9~0:�D�T;W�?E5[<]?%L�:2W6DBX�r9�;:�7�hiDE5M<�W6:U SV?GW�5[D�<VL0XZDEA0) %*» 'Ç W�aV?GW6H%5M<95MHJ58L�:îwÄnN\DCò2ÝqQ2� ) %�» '��1��Ç á :�mh Á T %*» ' o � ÚyÛ �Æ %*» 'Ç Ü �� � %*» ' à à NO�-G Q

~ua9:�A�: � %*» ' 58Lu7;:rV<9:�7/?�LbTp:XZDEA�:ElV?E<V7o~uaV:A�:�~0:�A�:7;:2rp<9:�W�a9:wA�:�L�587;SV?BKg:�A�A�DEA0W�D%Ti:�Æ %*» 'Ç � ÆpÇ�Ü ­»¶2�ä » T % ¶ã' �OË % ¶Ñ'Ç �2ç NO� � Q

_ba9:6hp?BA�?BH%:2W�:A3) %*» 'Ç DET;W�?B5M<9:�7JXZA�DEHÃW�a9:Ld:6r9�;:�7jhiDE5M< WY:�U SV?BW�5MDE<VLY5MLnW�a9:�DETVL�:A�FG?GW�5MDE<Jh9A�DETV?ET95MK[5[WkcJ?�L�L�D;f258?GW�:�7J~u5�W�aLdW�?GW�:wFG?BA�5M?ET9K[:qË %�» 'Ç 5M<�aV5M7979:<-=-?EA�C�DGFJH%D;7;:�Kh¼I^Y�PL�5[<V\%W�a9:Ld:wh9A�DETp?BT95MK[5[W�5M:�L�lmW�aV:wXZDEA�~0?EA�7Ú� TV?�f�C ~b?BA�7%?BKM\ED�A�5[W�a9H58LoSVL�:�7êW�D f2DEH%h9S9W�:s?®<9:~ L�:2W/DBXq:�;hp:fzW�?BW�5MDE<VLoXZDEAz�OË %*» 'Ç �2lP~ua958f�a�?EA�:-XZ:�7{Tp?Ef�C>5[< W�D�N��!G�Q+?E<V7�NO� � Q2^ _baV:XZDEA�~b?BA�7�� TV?�f�Cm~0?EA�7%?BKM\ED�A�5[W�aVHè5ML0W�a9:A�:2XZD�A�:�SVL�:�7�?ELu?jL�S9T9A�DES9W�5M<9:�5[<�W�aV:wHJ5M<95MH%5ML�?GW�5[D�<RDEX�W�a9:@îwÄ�7;5[F�:A�\E:�<Vf2:�^

­6DEW�58f2:�W�a9:�L�5[H%5MKM?EA�5[WkcoTi:2Wk~0::�<�:U SV?GW�5[D�<VLqN��!G�QÑ�gN�� � Q0?B<p7/:�U SV?GW�5[D�<VLwNO�B� QÑ�gNO���EQeXZD�AuW�a9:3f2DEH%h9KM:2W�:KMc+X�?�fzW�D�A�58L�:�7?BhVh9A�Dv�;5MHj?GW�5MDE<�^e��</W�a9:3fDEH%h9KM:2W�:�K[cRX�?Ef2W�D�A�58Ld:7/?Bh9h9A�Dv�;5[Hj?BW�5MDE<�lVL�5M<Vf2:N�¦Ë %*» 'Ç �bá=ñ %�» 'Ç lVW�a9:wr9�;:�7-hpD�5[< WP:U�Sp?GW�5MDE<pLf?E<{Ti:@~uA�5�W�W�:<�:2�;h9KM5Mf5�W�K[cê5M<êW�:�A�HjLRDBXwW�a9:@FG?BA�58?GW�5MDE<p?BKPhp?BA�?BH%:2W�:A�L^¥��<êW�a9:�LkW�A�SVf2W�S9A�:�7ê?Eh9h9A�Dv�;5[Hj?GW�5[D�<�lbW�aV:7;:�hp:�<V7;:<pf2:IDBXN�OË %*» 'Ç �oDE<4) %*» 'Ç 58LofDEH%h9S;W�:�7{Fm58?�W�aV:@XZD�A�~b?BA�7�� Tp?Ef�Cm~0?EA�7®?BKM\EDEA�5[W�a9H/^¯¤PKML�DVluW�a9:sr9�;:�7êhiDE5M< W:�U SV?BW�5MDE<VL3N��!G�Qu7;Do<9DBW�fDE< W�?E5[</W�:A�HjL65M< F�DEKMFm5[<9\%W�a9:�hVA�5MDEAlľ %*» ' liDEAuW�A�?E<VL�5�W�5[D�<]H%?BW�A�5��yl r %*» ' ^P_ba9:�L�:wW�:A�H%L�?BA�:aV?E<V7;KM:�7�:2�9?Ef2W�KMc+Tmc+DESVA6f�a9DE58f2:�DBX)?Bh9hVA�Dv�;5MH%?BW�5MDE<�^

_ba9:RDBW�aV:AJ5[< W�A�?Ef2W�?ET9K[:�7;cm<V?BH%58fo�b?vcE:Ld58?B<Ê<V:2Wk~0DEA�CmL�~e:RaV?vFE:oh9A�:Ld:�< W�:�7®?BA�:R?BK8L�D@?BH%:<p?BT9KM:+W�DsLdW�A�SVfzW�S9A�:7FG?BA�5M?BW�5MDE<V?EKP?BhVh9A�Dv�;5MHj?GW�5MDE<pL^���< W�a9:If?�Ld:]DEX�W�A�:�:2��LkW�A�SpfzW�SVA�:7ê4P=-=-L+W�a9:�A�:s?BA�:]Wk~eDÊ<p?GW�SVA�?EK�f�a9D�5Mf:�L%XZD�A+W�aV:L�S9TVLdW�A�SVfzW�S9A�:L)W�DqA�:W�?E5[<j5M<jW�aV:�?BhVh9A�Dv�;5MHj?GW�5MDE<�^}��<9:Pf�aVDE58f2:658L)W�D�A�:H%DGFE:bW�a9:�?EA�f�L)~u5�W�a95M<o?�W�5MH%:�LdW�:�h+?B<V7+A�:W�?B5M<W�aV:%W�:H%hiDEA�?BKn7;:�hp:�<V7;:�<Vf25M:�L�l�A�:�L�S9K[W�5M<9\/5[<IW�a9:+�b?vcE:�L�58?B<@<V:2Wk~0DEA�C-Lda9DG~u<I5M<�£'5M\ES9A�: ª NZTpQ2^o_ba9:jDBW�a9:Aqf�aVDE58f2:%5MLW�DRA�:W�?E5[</W�a9:J?EA�f�L¨F)Í°ØZÌmÍ°Ð/?%W�5MH%:JLdW�:�h@?B<p7]:KM5[H%5M<V?GW�:qW�a9:J?EA�f�LuTi:2Wk~0::<sf2DE<pLd:f2S;W�5[F�:wW�5MH%:JLdW�:�hVL^��0DBW�a@DBX)W�aV:�L�:?BhVh9A�Dv�;5MHj?GW�5MDE<pLl;?BKMDE<V\3~u5[W�a]?B</?BhVh9A�Dv�;5MHj?GW�5MDE<RTV?EL�:�7RDE<RW�aV:EÕP5[W�:A�T95¦lV?BKM\ED�A�5[W�aVH ?BA�:�hVS9A�L�S9:7R5M<Ê« �!Gv¬�^

£9D�A'L�~u5[W�f�a95M<9\�LkW�?GW�:��L�hV?�f2:YH%D;7;:�KML�lvW�a9:b<V?BW�S9A�?BKm?BhVh9A�Dv�;5MHj?GW�5MDE<w58L�W�D�Hj?BC�:nW�aV:�¬�LdW�?BW�:��L�hV?Ef:YH%D;7;:K8LbNO�9�9=-L�Q?B<p7jW�aV:�795ML�f2A�:2W�:�=-?EA�C�DGF3hVA�D;f2:L�L0f2D�< W�A�DEKMK[5M<9\qW�a9:�Ld~u5[W�f�a�FG?BA�5M?ET9K[:�LkW�D;f�aV?ELdW�58f?EK[KMc%5[<V79:hi:<V7;:�< W�^n¤6\ ?B5M<�l W�a9:�FG?BA�5[�?GW�5[D�<V?BK�?Eh9h9A�Dv�;5[Hj?GW�5[D�<RfDES9h9KM:�Lu?EK[KgW�a9:��9�;=@L6?B<V7RW�a9:qLd~u5[W�f�a/FG?BA�58?BT9KM:�79:2W�:�A�H%5M<958LkW�5Mf�?BKMK[c�l9T9S;WuW�a95MLPf2DESVh9K[5M<9\jf?E<Ti:/fDEH%h9S;W�:�7®W�A�?Ef2W�?BTVK[cÊSVL�5M<9\pîw?EK[Hj?E< L�HJDmDEW�a95M<9\IDE<>:�?Ef�a>LkW�?GW�:2��LdhV?�f2:RHJD;7;:�K6Ld:�hV?BA�?GW�:KMc`?B<V7`W�a9:�XZD�A�~b?BA�7��TV?�f�C ~b?BA�7�?EK[\�DEA�5�W�a9H DE<�W�aV:`=-?BA�CEDGF{L�~u5�W�f�a95M<9\ h9A�D;f:�L�L^ _ba9:ÊFG?BA�58?GW�5MDE<p?BK�hV?BA�?BH%:W�:A�L/?BA�:@W�a9:ÊA�:�?BK[��Fv?EK[SV:�7ldA�:�L�hiDE<VL�5[TV5[KM5�W�5[:L�n-DBX6:�?�f�a®LdW�?GW�:2��Ldhp?Ef2:oHJD;7;:�K0XZDEAJ:�?Ef�a®DETVL�:A�FG?GW�5MDE<Ê5M<`W�a9:/Ld:U�SV:<Vf:E^�_�DI7;:2W�:A�HJ5M<9:RW�a9:�Ti:�LdWFG?BA�5M?BW�5MDE<V?EK;hV?BA�?BH%:W�:A�L}~0:6LkW�?BA�W'XZA�DEHÈL�DEH%:bA�:LdhiDE<VL�5MT95[KM5[W�5M:�Ln?E<V7%f2DEH%h9S9W�:uW�a9:6hiD�LdW�:A�5MDEA)h9A�DETV?ET95MK[5[WkcqDBXiW�aV:PLkW�?GW�:5M<>:?Ef�a �9�;= SVL�5[<9\ÿîw?EK[Hj?B< L�HJDmDEW�a95M<9\Vle~u5�W�a>W�a9:-79?BW�?mFYÏÍz�Ì;Ø�Ï�Îø�Ù�Ø°ÌVÏ]Ó�Ï2ë¦×9ÕBÐ9ëzÍ��Í�Y�Í°ØOÍ�Ï2ëz^�¤µ~0:5M\Ea W�5M<9\IDBX �f2D�A�A�:�L�hiDE<V79L0W�D+?Bh9hVK[cm5M<9\jW�aV:q<9DEA�Hj?BK}îw?EK[Hj?E<�L�H%D DEW�a95M<9\j:U�Sp?GW�5MDE<pLlp~ua9:A�:�?�Lu?j~e:�5[\�a W�5M<9\%DBX¯Gjf2D�A�A�:�L�hpD�<V79L0W�D?EL�L�S9H%5[<9\JW�aV?GW6W�a9:q79?BW�?%~b?ELb<9DEWPDETVL�:A�FE:7o?BWP?BKMK�mp5[< W�:�A�H%:7;5M?BW�:�~0:5M\Ea W�5M<9\+?BA�:�5[H%h9KM:H%:�<�W�:�7/TmcR795[Fm587;5[<V\%W�a9: �Hj?GW�A�5[��5M<®NO� ª Q6TmcoW�a9:�A�:�L�hpD�<VL�5[T95MKM5�Wkc�^ � :�W�a9:�<@A�:�fDEH%h9S;W�:qA�:LdhiDE<pLd5MT95MK[5[W�5M:�LPT c/A�S9<9<95M<9\jW�a9:qXZD�A�~b?BA�7��mTV?Ef�Cm~b?BA�7?BKM\ED�A�5[W�aVH D�<-W�a9:jLd~u5[W�f�ash9A�D;f:�L�LPSVL�5M<9\oW�a9:Jh9A�:7;58fzW�5MDE<s:A�A�D�APDEXe:�?�f�as�9�;=`^y��W�:A�?GW�5[<V\+W�aV5ML�h9A�D;f2:7;S9A�:�S9< W�5MK}W�aV:A�:�L�hpD�<VLd5MT95MK[5[W�5M:�L�f2D�<mFE:A�\E:q79:�f2A�:�?�Ld:LuW�a9:lîwÄ���7;5MFE:�A�\�:<Vf:E^<��:2W�?B5MKML�DEX)W�a958L�LkW�A�SVf2W�S9A�:�7-Fv?EA�58?GW�5[D�<V?BK'?Bh9hVA�Dv�;5MH%?BW�5MDE<XZDEA6L�~u5[W�f�a95M<9\jLkW�?GW�:2��LdhV?�f2:�H%Dm79:K8L6?B<V7R:2�;hi:A�5[H%:�<�W�?BKyA�:�L�S9K[W�L6?EA�:�h9A�:�L�:< W�:7o5M<Ê« � � ¬¦^

5 P ´RQ3¶6Á}12´q# · ¹ ¹ Á

� :�<VDG~êW�S9A�<RW�D3Wk~eDJFE:�A�cj5MH%hpD�AdW�?B< W058L�LdS9:L05[<RW�a9:�KM:�?EA�<95M<9\JDBX�4�=-=-Lu?E<V7oDEW�a9:�Ab\EA�?Bh9a958f?EKpH%D;7;:�KML��}DGFE:A�r9W�W�5M<9\?B<p7êH%Dm79:KwLd:�K[:fzW�5[D�<�^ ��F�:A�r9WdW�5[<V\`A�:XZ:A�L+W�D`W�a9:IL�f2:�<V?BA�5MD`~ua9:A�:-W�a9:IHJD;7;:�KPrVW�LRW�a9:sW�A�?B5M<95M<9\ L�:2W�FE:�A�c>~e:�K[KT9S;Wq\�:<9:�A�?EK[58L�:�L�hpDmDEA�KMc/W�D]?RW�:�LdW�L�:2Wqf�a9D�L�:<@XZA�D�H W�aV:+L�?EHJ:%79?BW�?/7;58LkW�A�5MT9S;W�5[D�<�^j��F�:A�r9WdW�5[<V\�58L�H%D�LdWwh9A�:�FG?BKM:< W~ua9:�< W�a9:/W�A�?B5M<95M<9\ÊLd:Wj5ML+L�Hj?BKMKuA�:�KM?BW�5MFE:RW�D�W�a9:-f2D�HJhVK[:�m5[Wkc�N�5O^ :E^n<mS9H3Tp:�AjDBX�XZA�:�:/hV?BA�?BH%:2W�:A�L�Q�DBX�W�aV:]HJD;7;:�KOl?B<p7`W�a9:A�:/5ML%<9DEW�a95M<9\�5M<®W�a9:]Hj?G�;5[H3S9H KM5[C�:KM5[a9DmD;7®r9WdW�5[<9\ÊhVA�D;f2:7;S9A�:R5[W�L�:K[XPW�DÊ?vFEDE587`5[W�^ê=]D;7;:�K6Ld:�K[:fzW�5[D�<�lYD�AKM:�?BA�<95M<9\]H%D;7;:KbLkW�A�SpfzW�SVA�:�l�58LqW�a9:ofK[D Ld:�K[cIA�:�KM?BW�:7�h9A�D�T9KM:HîDBXuh958f�C 5M<9\@?-hV?BA�W�58f2S9K8?BA3LkW�A�SVf2W�S9A�:o?EHJD�<9\�LdW�L�:FE:�A�?EK?BK[W�:�A�<p?GW�5MFE:LwNZD�A6K[:?BA�<95M<9\+?j7;58LkW�A�5MT9S;W�5[D�<]DGFE:AbW�a9:�L�:q?BK[W�:�A�<p?GW�5MFE:L�Q2^Y��</W�a9:�f?�Ld:wDEXn4P=-=-L6W�a9:no H%D;7;:K'LkW�A�SpfzW�SVA�:!o~0DES9K87]5M<Vf2KMSV7;:%:F�:A�c W�a95M<9\jXZA�DEHµW�a9:3<mS9H3Tp:�A�DEXYa958797;:�<ILdW�?BW�:�LPW�DRW�aV:�XZD�A�HµDBXYW�a9:%LkW�?GW�:�W�A�?E<VLd5[W�5MDE<@H%?BW�A�5��-?E<V7DES9W�h9S;WJh9A�DETV?ET95[KM5[W�5M:�L�^/=-Dm79:KbLd:�K[:fzW�5MDE<Ê~0DESVKM7Ê?EKML�D]5[<pf2KMSV7;:o~uaV:2W�aV:AqW�D-DEh9WqXZDEAJ?]A�:�\ES9K8?BA34P=-= D�AwW�aV:oH%DEA�:

Page 20: An Introduction to Hidden Markov Models and Bayesian Networks

f2D�H%h9K[:�qX�?Ef2W�D�A�58?BK94�=-=ÊlGXZD�A):2�9?BH%h9KM:E^}_�D�KM:�?EA�<JH%Dm79:KVLdW�A�SVfzW�S9A�:05[Wn58L)<9:�f:�L�L�?EA�c�W�Dwf2DEH%hV?EA�:bH%D;7;:K8L}DBXy7;5CBi:�A�:�< Wf2D�H%h9K[:�;5�Wkco?E<V7�?B\�?E5[<�lmW�a9:�A�:�58Lu<9DBW�a95M<9\%5[<]=-Ä�hV?EA�?EH%:2W�:�A0r9WdW�5[<9\%W�aV?GWP79D :L0W�a958L6?ES;W�D�H%?BW�58f?EK[KMcE^

_ba9:�A�:J?BA�:qW�aVA�:�:3Hj?B5M<-~b?vc;L6W�D�7;:?BK'~u5�W�a@W�a9:JDGFE:A�r9W�W�5M<9\o?B<p7-H%D;7;:K)L�:KM:�fzW�5[D�<@h9A�DETVK[:�H%L��6f2A�D�L�Ld�¦FG?BKM5879?GW�5[D�<�lA�:\ESVKM?EA�58L�?BW�5MDE<�l9?E<V7-�b?vcE:Ld58?B<�5M<�W�:\�A�?BW�5MDE<�^76}Ó�Õvë�ë ��ÖGÒJY�Í�Î�ÒGئÍ�ÕGÐ/A�:�hp:?GW�:�7;KMc�L�h9KM5�W�L6W�a9:qW�A�?E5[<V5[<9\+7V?GW�?+5[< W�DoWk~eD+L�:2W�L�?j<9:�~�W�A�?B5M<95[<V\+Ld:W�?B<V7]?+Fv?EK[5879?BW�5MDE<-L�:2W�li?B<V7]fDEH%hV?EA�:Lua9DG~¥7;5CBi:�A�:�<�W�HJD;7;:�K�fKM?�L�L�:�Lu~uaV5Mf�a]aV?vF�:wTp:�:</W�A�?E5[<9:7DE<oW�a9:�<9:�~êW�A�?B5M<95M<9\%Ld:W0\�:<9:�A�?EK[58Ld:PW�D3W�a9:�FG?BKM5879?GW�5[D�<RL�:2W�^)_ba958Lbh9A�DGFm5M7;:LY?E<R:LkW�5[Hj?GW�:�DEX�W�aV:�W�A�SV:�\�:<9:�A�?EK[58L�?BW�5MDE<:A�A�DEA�T9S;Wqf?E<sTi:�fDEH%:jf2DEH%h9S9W�?GW�5[D�<V?BKMKMc]h9A�D�a95MT95�W�5[F�:35[XeH%D�A�:3W�aV?E<I?RXZ:�~¯H%D;7;:KnLdW�A�SVfzW�S9A�:3hV?EA�?EH%:2W�:�A�L�aV?vF�:qW�DTi:q7;:2W�:A�HJ5M<9:7y^8PÏW�-q5Y[ÒGÓzÍ8ëÒBØOÍ�ÕBÐ�?BSV\EH%:< W�L�W�a9:eK[5MCE:�K[5Ma9DmD;7�DET;|k:fzW�5[F�:)XZS9<Vf2W�5MDE<q~u5[W�aJ?uhp:�<V?BK[Wkc�W�:A�H�W�aV?BW�X�?vF�DES9A�L�L�5[H%h9KM:A�HJD;7;:�KMLDGFE:�APH%DEA�:3fDEH%h9KM:2�-H%D;7;:K8L�^q£9DEA�XZS9<Vf2W�5MDE<�?Bh9hVA�Dv�;5MH%?BW�5MDE<]h9A�DETVK[:�H%LPW�aV5ML�A�:\�S9KM?EA�58L�:A658L�DBX°W�:�<@DEXnW�a9:JXZD�A�H DEXY?L�HJDmDEW�a9<9:L�L6hp:�<V?BK[WkcRD�</W�a9:qXZS9<VfzW�5[D�<-f2K8?EL�Ld:L^0��</W�aV:�f?�Ld:qDEX'<V:S9A�?BK�<9:2Wk~0DEA�C+H%D;7;:K8LuW�a9:qA�:\ESVKM?EA�58Ld:�Au5MLPSVL�SV?BKMK[c:2�;h9A�:�L�L�:�7q?�L'L�DEH%:bLdD�AdW'DBXV~0:5M\Ea W)7;:�f�?vc�W�:A�H/^ � aV5[KM:0W�a9:�A�:b?BA�:YHj?B<mcq?�7qa9D;fe~0?vc;L�DBXphV5Mf�Cm5M<9\PA�:\�S9KM?EA�58L�:A�Ll5[<3W�aV:f2D�< W�:2�mWbDBX�hVA�D�TV?BT95MKM5MLdW�58f6H%D;7;:KMKM5[<9\J5[W058L0DBX°W�:�<o5MK[KMS9H%5M<V?GW�5[<9\JW�D�Fm5[:�~{A�:\ESVKM?EA�58Ld:�A�LY?BA�:�:�mhVA�:L�L�5[<V\�?�hVA�5MDEAeDGFE:AeW�aV:hV?EA�?EHJ:W�:�A�L�lp?E<V7/W�aV:3A�:\�S9KM?EA�58L�:�7/=-ÄÊrVWdW�5M<9\�h9A�Dmf:�7;SVA�:�?�L6rp<V7;5M<9\oHj?G�;5MH�S9H ?ohpD LkW�:A�5[D�A�50N�=-¤kHeQPhV?BA�?BH%:2W�:A�LS9<V79:AnL�SVf�aj?�hVA�5MDEA^�_bamSVL'W�a9:6f�a9DE58f2:bDEXiA�:\�S9KM?EA�58L�:A}f?B<JTi:6?EL�Ld:L�L�:�73LdS9T9|k:�fzW�5[F�:KMcqTmc�?EL�Cm5[<V\�~uaV:2W�aV:A}W�aV:u5[H%h9KM5Mf5�Wh9A�5[D�AbDGFE:AbhV?EA�?EH%:2W�:�A�L�l�H%?ECE:L0L�:<pLd:_n�W�DJW�a9:wH%D;7;:KMKM:A^

£9D�A64P=-=@Lb~u5�W�a-7;5ML�f2A�:2W�:�DES;W�h9S;W�L�lV?J<V?BW�S9A�?BK�f�a9D�5Mf:�DBX�hVA�5MDEAuDGF�:AeW�a9:whV?EA�?EH%:2W�:�A�L058Lu\E5MFE:�<RTmcjW�a9:@��5[A�5Mf�aVK[:W7;58LkW�A�5MT9S;W�5[D�<�^)_ba9:A�:�?EA�:PWk~eD�H%?E5[<RA�:?EL�DE<VL)XZDEAeW�a958L Û ��^}£'5MA�LdW�l W�a9:0��5MA�58f�a9KM:2W0795MLdW�A�5[TVS;W�5MDE<RaV?ELYW�a9:�Hj?GW�a9:Hj?GW�5Mf�?BKMK[cf2D�<mFE:<V5[:�<�WJh9A�DEhi:A�WkcsDEXPTp:�5[<V\IfDE<G|kS9\ ?GW�:+W�DsW�aV:RH3S9K�W�5[<VDEH%5M?EKu7;5MLdW�A�5MT9S;W�5MDE<�^�¤ X�?BH%5MK[cÊDEXPh9A�5[D�A�L�5ML%L�?B587�W�DITi:ì�ÕGÐ&� q-��ÒBØ�Ï0W�D+?3X�?BH%5[KMc+DEX'KM5[C�:KM5[aVD D;79Lb5[X'W�a9:whiD�LdW�:�A�5MDEAbDET9W�?B5M<9:7oTmcoH3S9K[W�5Mh9K[cm5M<9\%W�aV:�hVA�5MDEAuTmcjW�a9:wK[5MCE:�K[5Ma9DmD;7o58Lu5M<W�aV:PL�?EH%:bX�?BH%5[KMc%?EL}W�a9:6h9A�5[D�A�^}£9D�An:2�9?EHJhVK[:�l�L�5[<Vf:bW�a9:PK[5MCE:�K[5Ma9DmD;7%DBXgW�a9:P5[<95[W�58?BKiLkW�?GW�:u\E5MFE:<JW�a9:6hV?EA�?EHJ:W�:�A)FE:�f2W�D�A{�58LuH3S9K�W�5[<VDEH%5M?EKnN�f2X}:U SV?GW�5[D�<IN¦�B��Q�Qz�

ÝjNOË�ÛEâ {PQnáqpãÄ ä'Û { s ¿ vÄ à

5[X�W�a9:wh9A�5[D�A0hVA�D�TV?BT95MKM5�Wkc+DEX£{�5MLR��5MA�58f�a9KM:2W�lÝjN{PQná �U pãÄ ä�Û {�9 v Ú�ÛÄ

~u5[W�aqamcmhp:�A�hp?BA�?BH%:2W�:A�F�:�fzW�DEA;:sᥫ <yÛ}ççç=< p ¬;?B<V7w<VDEA�H%?EK[58L�?GW�5MDE<wfDE<VLdW�?E<�WvUwlW�aV:<wW�a9:YhiD�LdW�:�A�5MDEA�5ML�?BK8LdD<��5MA�58f�a9KM:2W��ÝjN�{�â Ë�Û2Qná �U?> pãÄ ä�Û {?9 v � s ¿ v Ú�ÛÄ ç

�m5MH%5[K8?BA���5[A�58f�a9K[:W6h9A�5[D�A�Lbf?E<RTi:qL�:2W6S9h�XZDEA6fDEKMS9H%<VLbDBX'W�aV:�W�A�?B<VL�5�W�5[D�<RHj?BW�A�5���r{?B<V7�:�HJ58L�Ld5MDE<�Hj?GW�A�5[��}j^�m:f2DE<p7PW�a9:���5MA�58f�a9KM:2W�7;58LdW�A�5[T9S9W�5MDE<waV?�LyW�aV:Y7;:�L�5MA�?ET9K[:)hVA�D�hp:�AdWkcPW�aV?BW�5[W�L�amcmhi:A�hV?BA�?BH%:2W�:A�Lyf?E<wTp:n5M< W�:�A�h9A�:2W�:�7w?�L

amcmhpDEW�a9:W�58f?BKif2D�S9< W�LnDEXyDETVL�:A�FG?GW�5MDE<pL^���<%W�a9:�?BTiDGFE:u:2�9?EHJhVK[:�lE5[X@< Ä á���?B<V7A< È á � XZD�A£0^_á�B�lBW�a9:�=-¤kHÊ:�LdW�5MHj?GW�:DBX${®58L)587;:< W�5Mf�?BK;W�Dq?B<%=-Ä/:�LdW�5MHj?GW�:uDEXÀ{ ~u5�W�a+?�W�A�?B5M<95[<V\�L�:2WY?ES9\EH%:�<�W�:�73~u5�W�ajDE<9:u?�797;5[W�5MDE<V?EK;DETVL�:A�FG?GW�5MDE<JDBXiW�aV:5M<95�W�5M?EK�LdW�?BW�:qTi:5M<9\o5M<-LdW�?GW�:¨B�^u_ba95MLPHj?BCE:Lu5[W�hiD�L�Ld5MT9KM:wW�D+5MH%h9KM:H%:< W�=-¤kHê:�LdW�5MHj?GW�5[D�<]~u5�W�a`�P5MA�5Mf�a9KM:2W�h9A�5MDEA�L6?�L?%H%5[<VDEAuFG?BA�5M?E< WbDEX�W�a9:q�b?BS9HJ� � :�KMf�a/h9A�D;f2:7;S9A�:E^)��WP?BK8L�DJ\�5[F�:�LuL�DEH%:�W�a9:�DEA�:2W�5Mf�?BK;|kSVLdW�5[rpf�?GW�5MDE<�XZD�AbW�a9:�L�::�H%5[<9\�K[c?E7@a9D;fqT9S9W�F�:A�c]f2DEH%H%DE<@A�:�\ES9K8?BA�5ML�?GW�5[D�<]H%:2W�aVDm7-XZDEA�4P=-=@L�~ua95Mf�a+|kSVLkWq?�7979L�?RL�Hj?BKMK�hiD�L�5�W�5[F�:3<mS9H3Tp:�A�W�DR?EK[K:KM:H%:�<�W�LbDBX'W�a9:whp?BA�?BH%:2W�:AbFE:fzW�D�A�^

¤PL0D�S;W�KM5[<V:�7�?GWbW�a9:�Ti:\�5[<9<V5[<9\JDBX}Ld:fzW�5[D�<o�Vl;?%�b?vcE:Ld58?B<+?Eh9h9A�D�?Ef�a+W�DJK[:?BA�<95[<V\�W�A�:?GW�Lb?EK[KgS9<9Cm<9DG~u<�U SV?B< W�5[W�5M:�L?EL�A�?E<V7;D�HÉFG?BA�58?BT9KM:�L�l)?EL�Ld5M\E<VLqh9A�5MDEA�LwW�D]W�aV:�L�:RU SV?B< W�5�W�5[:Lln?E<V7Ê5M<;XZ:A�LqhiD�LdW�:�A�5MDEA3h9A�D�TV?BTV5[KM5�W�5[:LqaV?vFm5M<9\-D�TVLd:�A�F�:�7W�aV:�7V?GW�?V^}��<oW�a9:wf?EL�:�DBX�4�=-=-L�l;W�a9:Ld:�S9<9Cm<9DG~u</U SV?B< W�5�W�5[:L0fDEH%h9A�5ML�:�W�a9:wLdW�A�SVfzW�S9A�:�DBX�W�a9:q4�=-= N�:E^ \V^m<mS9H�Ti:ADBXqLdW�?BW�:�L�Qzl0W�a9:-hV?EA�?EHJ:W�:�A�L�l0?E<V7 W�a9:@a95M7V7;:<{LdW�?BW�:�L�^ �6<9KM5[C�:-=-Ä�?E<V7ê=-¤<H}lY~ua95Mf�a rp<V7 hpD�5[< Wo:LkW�5[Hj?BW�:�L+DBXW�aV:RhV?EA�?EH%:2W�:�A�L�l)~0:Rf?E<®<9DG~èfDEH%hV?EA�:RTp:Wk~e:�:<®H%D;7;:�KbLdW�A�SVf2W�S9A�:�L�l)T9S;Wj~0:o<9:�:�7ÊW�Ds5M< W�:�\EA�?GW�:RDGFE:�A�TiDBW�a W�aV:hV?EA�?EHJ:W�:�A�Lb?B<p7+W�a9:wa958797;:<]LdW�?BW�:�L�^ � :qf?BKMKgW�aV5ML6?Eh9h9A�D�?�f�a�B�ÒGÙEÏ2ë�Í�ÒBÐsÍ°ÐpØ�ÏW�EÓ�ÒGئÍ�ÕGÐp^

_ba9:�A�:0?BA�:eL�:FE:�A�?EKEH%:2W�a9D;79L'XZDEA}?BhVh9A�Dv�;5MHj?GW�5M<9\uW�a9:bA�:U S95[A�:�7q5[< W�:�\EA�?BK8Llv~ua958f�aqXZD�A'4�=-=-L)?E<V7wW�a9:5MA}:2�mW�:�<VLd5MDE<pL?BA�:j5M<�W�A�?�fzW�?BT9KM:E^ � :+TVA�5M:�éVcsH%:< W�5MDE<�XZD�S9AqDBX0W�aV:�L�:+H%:2W�aVDm7VL^/£'5[A�LkW3K[:W�SVLwHj?BC�:+f2KM:�?EAq~ua958f�aI5M< W�:�\EA�?BKn~0:+?BA�:A�:2XZ:A�A�5[<9\oW�Dp^J_�D�fDEH%hV?EA�:JH%Dm79:K8L�5[Wq58L�<V:�f2:L�L�?BA�c�W�D]f2D�H%h9S;W�:JW�a9:%hpD LkW�:A�5[D�A�h9A�DETp?BT95MK[5[Wkc]DBXb?oH%D;7;:�KOl�~uaV5Mf�aI5MLô� 2C �¦ö����/yJ�R� ���}�¦ö���� �����O÷(%dúx(x �0�R��O÷ �zú]����#0����ú�ø�� �vø�ú���v��������÷(#���#�÷(�r§ ©/¨]«��

Page 21: An Introduction to Hidden Markov Models and Bayesian Networks

h9A�DEhiDEA�W�5MDE<V?EKmW�DwW�a9:6h9A�D;7;SVf2WYDBXgW�aV:6h9A�5[D�An?B<V7JW�a9:6Hj?BA�\E5M<V?BKVK[5MCE:�K[5Ma9DmD;7yl�?EKML�DwCm<9DG~u<j?EL}W�a9:3ÏÖ�Í�Î�Ï2Ðgì�Ï�N�f2X�:�U SV?BW�5MDE<N � G�Q�Qz�

ÝjN��¸â JQ¯·{ÝjN�� Q Î�Ï ÝjN �â �9à�� QkÝjN�iâ � Qve�� Ð ç_ba9:w:�F 587;:�<Vf2:�l;T9A�?�f�CE:W�:�7oa9:A�:El;58L6?Ja95M\Ea]7;5MH%:<VL�5[D�<V?BK¦l;DBX°W�:</H�SVK�W�5[H%D;79?BK¦l;5M<�W�A�?�fzW�?BT9KM:�5[< W�:�\EA�?BK¦^

Ñ@ÕGÐpØ�Ï76nÒBÓ Y[Õ�H%:2W�aVDm7VL0?Eh9h9A�Dv�;5[Hj?GW�:uW�aV:�5M< W�:\�A�?EKpTmc%W�?BCm5[<V\3L�?BH%h9KM:�LYXZA�D�H A�:�\E5MDE<VLYDBX�a95M\EaRh9A�DETV?ET95[KM5[WkcE^}_ba95MLf?E<�5[W�L�:K[XVTi:0ap?BA�7ylGT9S;Wnf?E<qTi:0Hj?�7;:e:?EL�5[:�A�TmcqL�:2W�W�5M<9\�SVh3?�=-?BA�CEDGF�f�aV?B5M<qW�D�fDE<mFE:�A�\�:)W�D�W�aV:0fDEA�A�:fzW�:U S95[KM5MT9A�5MS9H7;58LkW�A�5MT9S;W�5[D�<Ê« �;§�¬¦^D�Ò�×�YMÒEì�Ï3Ò�×E×gÓ�Õ/ó�Í°òjÒGئÍ�ÕGÐ9ëu5M<mFEDEC�:6W�a9:qf2:�<�W�A�?EKyK[5MH%5�WuW�a9:D�A�:�H/l;~ua95Mf�aRXZDEAu~0:KMK[�¦Ti:aV?vF�:�7oh9A�5MDEA�Lb?B<V7�79?BW�?%?EL�Ld:�AdW�LW�ap?GWwW�aV:Jhp?BA�?BH%:2W�:A�hpD LkW�:A�5[D�A�~u5[KMKnf2D�< F�:A�\E:35[<sW�a9:jKM5MHJ5[WqDBX0KM?EA�\�:3<mS9H3Tp:�AwDBXeW�A�?B5M<95[<V\/L�?BH%h9KM:�L�W�D/?FD�?ESVL�L�58?B<?BA�DESV<V7RW�a9:J=-¤<Hê:LkW�5[Hj?BW�:qDEX'W�a9:�hp?BA�?BH%:2W�:A�L^ Û �I_�Do:�LdW�5MH%?BW�:�W�a9:q:�Fm5M7;:�<Vf2:�SVLd5M<9\jW�a9:3Ä�?Bh9K8?Ef:q?Bh9hVA�Dv�;5MH%?BW�5MDE<=-¤kH hV?BA�?BH%:W�:A�L+?EA�:/XZD�S9<V7ê5M<êW�aV:@SVL�SV?BK�DEh;W�5[H%58L�?BW�5MDE<êA�DES;W�5[<V:�L+?E<V7 W�aV:<êW�a9:@f2SVA�FG?GW�S9A�:®N�4P:�L�Ld58?B<pQjDBXwW�aV:KMDE\@KM5MCE:KM5Ma9DmDm7®5ML%fDEH%h9S;W�:�7>?GWJW�a9:]=-¤kH¯:LkW�5[Hj?GW�:E^®_baV:R:�F 587;:�<Vf2:�5ML%?Eh9h9A�Dv�m5MHj?GW�:�7ÊTmcÊ:FG?EK[SV?BW�5M<9\-W�a9:/A�?BW�5MDÝjN�Và�JQ*EGÝjN�iâ JQ%?BW3W�a9:]=-¤<HÃ:�LdW�5MHj?GW�:RDEXd�9lYSpLd5M<9\sW�a9:FD�?BSVL�L�5M?E< ?BhVh9A�Dv�;5MHj?GW�5MDE<Ê5M< W�a9:/7;:<VDEH%5[<p?GW�D�A�^`_baV:Ä�?Eh9K8?Ef2:n?Eh9h9A�Dv�;5[Hj?GW�5[D�<�L�S5Bg:A�LyXZA�DEH�Ld:�FE:A�?BKB795ML�?E7;FG?E<�W�?B\�:�L&m�a9:�A�:Y~e:nH%:�<�W�5[D�<�Wk~eDp^�£'5[A�LdW�lvf2DEH%h9S9W�5M<9\uW�aV:e46:L�L�58?B<Hj?GW�A�5[�qXZDEAnW�a9:uhV?EA�?EH%:2W�:�A�L}58L)SVL�SV?EK[KMcqFE:�A�c3f2DEH%h9S9W�?GW�5[D�<V?BKMKMc�f2D LkW�K[c�^}�m:f2D�<V7ylBW�a9:<D�?BSpL�L�5M?E<J?Eh9h9A�Dv�;5[Hj?GW�5[D�<�58L)<9DEWFE:�A�c�\EDmD;7/XZD�A�H%D;7;:K8L�~u5�W�a@hV?EA�?EH%:2W�:�A�LP~ua958f�a@?BA�:�hiD�L�5�W�5[F�:3?E<V7@L�S9H W�D�DE<9:�lg:�L�hp:f258?BKMK[c/~ua9:�<-W�aV:A�:3?BA�:�Hj?E< chV?EA�?EHJ:W�:�A�LuA�:K8?GW�5[F�:wW�DoW�a9:%L�5[��:qDBX)W�a9:J7V?GW�?oLd:W�^�_�D+D�S9A�C <VDG~uK[:7;\E:�W�a9:JÄ�?Bh9K8?Ef:�?BhVh9A�Dv�;5MHj?GW�5MDE</aV?�LP<VDBW�Ti::�<SVL�:�7RXZDEA64�=-=-L�^

� W�DEKMCE:j?B<V7`��H%DEamS9<p7;A�DÊ« �E�¬eh9A�:Ld:�< W�?B<�5[<V\E:<V5[D�SVL�H%:2W�aVDm7IXZD�Aq?Bh9hVA�Dv�;5MH%?BW�5M<9\RW�a9:o�b?vc�:�L�5M?E<@5M<�W�:\�A�?EKML�XZD�A4P=@=-L^'��XiW�a9:6LdW�?BW�:�L}DEXpW�a9:64P=@=�~0:A�:0DETVL�:A�FE:7qA�?GW�aV:A}W�ap?B<Ja95M7V7;:<j?B<p7�5[XpW�a9:uhV?EA�?EHJ:W�:�A'hVA�5MDEA�L}?BA�:���5MA�58f�a9KM:2W�lW�aV:-hV?BA�?BH%:W�:AjhiD�LdW�:�A�5MDEA�L%?BK8LdD�Ti:�fDEH%:`��5[A�5Mf�aVK[:Wo?B<V7 W�aV:-:Fm587;:<Vf:]5[< W�:\EA�?BKbX�?�fzW�DEA�L%5[< W�D ?shVA�D;7;SVf2WoDBX�:�?�Ldc��5[A�5Mf�aVK[:W�5M< W�:�\EA�?BK8L^��mDRW�aV:J5M< W�A�?Ef2W�?BTV5[KM5�Wkc]DEXYW�a9:%:Fm5M79:<Vf:35M< W�:\�A�?EK�XZD�Aw4P=-=-LwLdW�:�HjL�XZA�D�HµW�a9:JX�?Ef2W�W�aV?BW�TiDBW�aW�aV:�LdW�?BW�:�Lb?E<V7+hV?EA�?EH%:2W�:�A�Le?BA�:Pa958797;:�<�^Y� W�DEK8f�CE:�?B<V7R��H%D�a SV<V7;A�D�SVL�:�7R?rÕ�5�W�:A�T95���KM5[C�:�?BKM\ED�A�5[W�aVHÃW�DJ79:2W�:�A�H%5M<9:�?L�5[<9\�K[:uH%D LkW)KM5[C�:KMc3L�:�U S9:<pf2:bDBXga958797;:<+LdW�?BW�:Ll ?B<V7�W�A�:�?BW�:�73W�a95MLYLd:U�SV:<Vf:6?EL}5[Xg5[WnaV?�73Ti::�<jDETVL�:A�FE:7y^�_ba9:�c3fDES9K87W�aV:<ê7;DsW�a9:]:�F 587;:�<Vf2:/5M<�W�:\�A�?EKML3:�?�Ld5MK[c�^>�0c`5[W�:�A�?BW�5M<9\ITp:Wk~e:�:< W�a9:Ld:/Wk~0DILdW�:�hVLJW�aV:c`5M<Vf2A�:H%:�<�W�?BKMK[c Ld:?BA�f�a9:�7DGFE:�A%HJD;7;:�K6LkW�A�SpfzW�SVA�:LleHJ:�A�\�5[<V\ID�AjLdh9KM5[WdW�5M<9\`LdW�?BW�:�L%Tp?EL�:�7 DE< f2DEH%hV?EA�58L�DE<VLJDBX�W�a958L-NO?Bh9h9A�Dv�;5[Hj?BW�:Q�:Fm587;:<pf2:E^_ba9:�5[A6?Eh9h9A�D�?Ef�a�l�~ua958f�aRW�A�?E7;:LeD-B-5[< W�:\EA�?GW�5[<V\�DGFE:�AeaV5M7979:</FG?BA�5M?ET9K[:LeXZDEAb5[< W�:\EA�?GW�5[<V\3DGF�:A0hV?BA�?BH%:2W�:A�Llm?GW�W�?E5[<9:75MHJhVA�:L�L�5[F�:�A�:�L�S9K[W�LbA�:�fDGFE:A�5M<9\3L�DEH%:wLd5MH%h9KM:�rV<95[W�:qLdW�?GW�:w\EA�?BH%Hj?BA�L^

_ba9:3XZDES9A�W�a�?BhVh9A�D ?Ef�a/W�D�?Eh9h9A�Dv�m5MHj?GW�:3�b?vcE:Ld58?B<-5M< W�:�\EA�?GW�5MDE<@5ML�Cm<9DG~u<@TiDBW�aI?�LjÏ2ÐVë2Ïò ��Y[Ï Y[Ï�ÒGÓzÐVÍ°Ðg�%?B<V7@W�aV:ÖGÒGÓzÍ�ÒGئÍ�ÕGÐgÒJY!BPÒBÙEÏzëzÍ�ÒGÐ@HJ:W�a9D;7y^j_ba9:%TV?�Ld58fJ5M79:�?R5ML�W�D/L�5MH�S9K[W�?E<9:D�SVLdKMc-?BhVh9A�Dv�;5MHj?GW�:3W�aV:%795MLdW�A�5[TVS;W�5MDE<IDGFE:�A�TiDBW�aa958797;:�<+LkW�?GW�:LY?E<V7JhV?BA�?BH%:2W�:A�L}~u5�W�ao?wL�5[H%h9KM:A07;5MLdW�A�5MT9S;W�5MDE<�lESVL�SV?BKMKMc3Tmc3?�L�L�S9H%5M<9\�W�a9:Pa95M7V7;:<+LdW�?BW�:�Le?B<V7JhV?EA�?EHJ�:2W�:A�Le?EA�:�5[<p7;:hi:<V79:< W�^n=]D�A�:�Ldhi:�f5�rpf�?BKMK[c�l W�a9:�:Fm587;:<Vf:�f�?B<+Ti:�KMDG~0:AYTiDESV<V7;:�7oTmc+?Bh9h9KMcm5[<V\3¨�:<VL�:<$o Le5[<9:U SV?BKM5�WkcWk~u58f2:E�

KMDE\YÝjN�â � Q á KMDE\ Ï e��qÝjNoà��iâ � Q NO����QH Ï e���DjN���QmKMDE\ ÝjNoà��iâ � QDjN���Q NO�E� Q

á Ï e���DjN���Q Î KMDE\YÝjN�âR�9à�� Q}úÊKMDE\ ÝjN�pâ � QDjN� Q Ð NO�B�mQ

H Ï e���DjN���Q Ê » s DjN¦ËnQmKMDE\ ÝjN¦Ë}à �âG�9à�� QDjN¦ËnQ úÊKMDE\ ÝjN�pâ � QDjN� Q Ë NO����Q� J/N�DjN���Qzà DjNOËYQdQ NO�E� Q_ba9:�FG?BA�5M?BW�5MDE<V?EKy�0?vc�:�L�5M?E<R?Eh9h9A�D�?Ef�aR5�W�:A�?GW�5[F�:KMcjH%?B�;5[H%58Ld:L~J ?ELu?3XZS9<Vf2W�5MDE<V?EK�DBX'W�aV:�Wk~eDJXZA�::w7;58LkW�A�5MT9S;W�5[D�<VLlDjN¦ËnQn?E<V7�DjN���Qz^)£VA�D�H N�����Q)~0:�f�?B<oL�::PW�aV?BWeW�a95MLeHj?G�;5MHJ58L�?GW�5MDE<o5MLe:�U S95MFG?BKM:< WeW�D�H%5M<95[H%58Ld5M<9\3W�a9:+îwÄ@795[F�:A�\E:<pf2:

Ti:2Wk~0::<4DjN¦ËnQcDjN���Qb?B<V7oW�aV:b|kDE5M<�W6hiD�LdW�:�A�5MDEAbDGF�:Aba958797;:<]LdW�?BW�:�Lu?E<V7RhV?BA�?BH%:2W�:A�LbÝjNOË}à��pâ Rà�� Qz^_ba958L6?BhVh9A�D ?Ef�a�~0?�LbrVA�LkW6hVA�D�hpD Ld:7oXZD�A6DE<V:2��a95M7V7;:</K8?vcE:Au<V:S9A�?BK�<V:2Wk~0DEA�CmLwN�~ua958f�a]aV?vFE:w<9DjaV5M7979:<@LdW�?BW�:Q0Tmc

465M< W�D�<@?B<V7/FG?E<�I0?BH%h`N �©E© � QbSVL�5[<V\jW�a9:�A�:LkW�A�58fzW�5[D�</W�aV?BW�DjN���Qu58LkD�?ESVL�L�58?B<Ê« �E�G¬�^u��W�aV?�LPL�5[<pf2:qTi::�<@?Bh9hVK[5M:�7�W�Dô ¢GF �k7Mú%��/y��Oöv÷ùø�÷ùø}�6�������}�¦ö��v%dú�ø��¯7C� �${���%�� �vø����¦ú�÷(����#IH��E��ø')�öv÷(%�ö�ø�{6¦-���'79��� �>ú��÷(#����~�O÷ ° úwv÷(xù÷ ���k����� w6x(�/�+y�÷"� � �6�Oö��n÷(#����~�O÷ ���<�73�¦ö��ø��¦ú]���døb%dú�lw�����������{6���/#@)�÷ �¦ör���k��¦-��%u�b� �r�Oö���xù÷( ��xù÷ùö��~�&#!��ù���%dú{vø��R�7'�Oöv÷ùø�y!�¦ö6�����zø����/�O÷(� �v79� �(H|�E��øf%�� �~������. �kø¯����ú<�u÷ ­~��{6���K�7¯}ú{vøOø¦÷�ú�vø/�

Page 22: An Introduction to Hidden Markov Models and Bayesian Networks

FG?BA�5[D�SVL�DEW�a9:�A�H%D;7;:�KML'~u5[W�a�aV5M7979:<3LdW�?BW�:L�?E<V7w<9D�A�:LkW�A�58fzW�5[D�<VL�D�<1DjN���Q�?E<V71D+NOËnQ�DBW�aV:A�W�aV?E<qW�aV:0?�L�L�S9H%h;W�5MDE<qW�aV?BWW�aV:c+X�?�fzW�DEA�5ML�:w5[<]L�DEH%:w~b?vc@« � ª li§;lp�;l �© ¬�^ � 5[W�a-D�<9K[c+W�a9:Ld:wX�?�fzW�DEA�5ML�?GW�5[D�<R?EL�L�S9H%h;W�5MDE<VL�l;XZA�::�OXZD�A�H�DEh;W�5[H%58L�?BW�5MDE<~u5[W�a-A�:�L�hp:fzW6W�D+W�a9:37;58LdW�A�5[T9S9W�5MDE<VL`DjN��Q�?B<p74DjNOËnQ65ML�7;DE<V:qSVL�5[<9\�f?EKMfS9K[SpL6DBX)FG?BA�58?GW�5MDE<pLli?B<V7]DEX°W�:�<-A�:LdSVK�W�L65M<-?H%D;7;5�rp:�7/�Y=/��KM5[C�:�?EK[\�DEA�5�W�a9H/^

=-?�f~îw?vc-N �©E© §BQYrVA�LkW6h9A�:�L�:< W�:�7/?%FG?BA�5M?BW�5MDE<V?EK��0?vc�:�L�5M?E<R?Eh9h9A�D�?Ef�aRW�DjKM:�?EA�<V5[<9\%5M<-4P=-=@Lq« � © ¬�^e�0cR?�L�L�S9H%5M<9\W�ap?GWJW�a9:RhV?BA�?BH%:2W�:A3h9A�5MDEAJ~b?ELr��5MA�58f�a9KM:2Wj?B<V7`?Eh9h9A�Dv�;5[Hj?GW�5[<V\/W�a9:�hpD LkW�:A�5[D�AqW�D@aV?vF�:o5M<V7;:hi:<p7;:< W%hV?BA�?BH%:2W�:A�L?B<p7]a958797;:<�LdW�?GW�:�L�lga9:3L�a9DG~0:�7/W�aV?GW�W�a9:JDEh9W�5MH%?EK5D+N��QP~0?�L�?i�P5MA�5Mf�a9KM:2Ww7;58LkW�A�5MT9S;W�5[D�<�^w£9S9A�W�aV:A�HJD�A�:�lga9:3L�a9DG~0:�7W�ap?GWqW�a9:oD�h;W�5MHj?BKPD+NOËnQwfDES9K87�Ti:+DET;W�?B5M<9:�7�Tmc�?Bh9hVK[cm5M<9\/W�a9:oXZDEA�~0?EA�7Ú� TV?�f�C ~b?BA�7]?BKM\ED�A�5[W�aVH W�Ds?B<`4P=@= ~u5�W�ahVL�:SV79DEhV?EA�?EHJ:W�:�A�L�\E5MFE:<®T cz�KJ]á :2�;hyï d e���DjN���QmKMDE\I�9ð�ln~ua958f�a f�?B<`Ti:�:FG?BKMSV?GW�:�7`XZDEA �P5MA�58f�a9KM:2Wj7;58LkW�A�5MT9S;W�5[D�<VL^_bamSVLuW�a9:�~uaVDEKM:qFG?BA�5M?BW�5MDE<V?EK��b?vcE:�L�58?B</?BKM\EDEA�5[W�a9Hµf?E<]Tp:35[H%h9KM:H%:< W�:�7-?�LP?+L�5[H%h9KM:qH%D;7;5[rpf?BW�5MDE<]DBX)W�a9:3�b?ES9HJ�� :K8f�as?BKM\ED�A�5[W�aVH�^�_ba9:JFG?BA�5M?BW�5MDE<V?EK��b?vcE:Ld58?B<]H%:2W�a9D;7@fDE< W�?E5[<VL�?EL�L�hp:f258?BK}f?EL�:�L�TiDBW�a@W�a9:%=-¤kH�?BhVh9A�D ?Ef�a-?E<V7?�Ld5MH%h9K[:JXZD�A�H DEXYW�aV:j�mW�DEKMCE:%?B<p7I��H%DEamS9<V79A�D/?Bh9hVA�D ?Ef�a�^ � a95MKM:JF�:A�c/h9A�D�H%5ML�5[<V\Vly:�L�hi:�f258?BKMKMc]\E5MFE:<@W�aV?BWw5�WwaV?�LTi::<®SVLd:7ÊLdSpff2:L�LdXZS9KMK[cIXZD�A�<9D�<;�OW�A�5MFm5M?EKnH%D;7;:KbLkW�A�SpfzW�SVA�:+KM:�?EA�<V5[<9\]5M<`DEW�a9:�A�H%D;7;:K8Lo« ��© ¬�l)5[W�L3hpDEW�:< W�5M?EKYaV?�Lq<9DEWTi::<�XZS9KMKMco:2�;h9KMDEA�:�7oXZDEA64�=-=-L6?E<V7oW�a9:�5[A6:�mW�:<pLd5MDE<VL�^

L MÈ(3#/.6À�,/Á'1(3#��<3W�a958L)hV?Ehp:�A)~e:baV?vF�:eA�:Fm5M:~0:�7qaV5M7979:<j=-?BA�CEDGF�H%D;7;:K8L}5M<3W�a9:uf2D�<�W�:2�mW)DBXiA�:f2:< Wn?E79Fv?E<Vf2:L}5[<3W�aV:uS9<V7;:�A�LdW�?E<V7;5M<9\DBXV�b?vc�:�L�5M?E<�<9:Wk~eD�A�C;L�^ � :YaV?vF�:YLdaVDG~u<�aVDG~`4P=-=-L'?BA�:n?6Cm5M<V7wDEX;�b?vc�:�L�5M?E<�<V:2Wk~0DEA�Cilv?B<p7w?EL�L�SVf�a�lW�a9:e?EK[\�DEA�5�W�a9HjLXZDEA)KM:�?EA�<V5[<9\�?B<p7�5M<;XZ:A�:<pf2:b5[<j4�=-=-Lnf�?B<�Ti:67;:�A�5MFE:7qXZA�DEH�H%D�A�:0\E:�<9:A�?BK;?BKM\ED�A�5[W�aVH%L�XZD�An�0?vc�:�L�5M?E<q<9:Wk~eD�A�C;L�^���W)5MLhiD�L�Ld5MT9KM:�W�D%5[<mF�:< W6Hj?B<mc+\E:�<9:A�?BKM58L�?BW�5MDE<VL0DBX�W�a9:34P=-=�x{L�SVf�a]?EL0X�?Ef2W�D�A�58?BK�4�=-=-L�l;W�A�::��LdW�A�SVfzW�S9A�:�7�4P=-=-L�lV?E<V7L�~u5�W�f�a95[<V\sLdW�?GW�:2��Ldhp?Ef2:oHJD;7;:�KMLkxê~ua95Mf�a�l)T cISVL�5[<V\@A�5Mf�a9:�A�a958797;:�<®A�:h9A�:�L�:< W�?GW�5MDE<pLl}f?E<`H%Dm79:K0HJD�A�:R5[< W�:A�:�LdW�5M<9\W�:�H%hpD�A�?EK�A�:�KM?BW�5MDE<VL�a95MhVLeW�aV?E<-4P=-=@L^Y4PDG~e:�FE:�A0ap?vF 5M<9\%A�5Mf�a9:�Aua958797;:<-LdW�?BW�:wA�:h9A�:�L�:< W�?GW�5MDE<pLe5M<mFG?BA�5M?ET9K[coK[:?E79L0W�Df2D�H%h9S;W�?BW�5MDE<V?EKV5M< W�A�?EfzW�?BT95MKM5�Wkc35[<jW�a9:P?EK[\�DEA�5�W�a9HjL}XZDEAe5[<;XZ:�A�A�5M<9\wW�aV:6a958797;:<RLkW�?GW�:6XZA�D�HÃD�TVLd:�A�FG?BW�5MDE<VL�^�=]D�< W�:0I0?EA�KMDH%:2W�a9D;79LlpLdSVf�a/?EL�D�5MT9TVLPL�?EHJhVK[5M<9\Vl9?E<V7RFv?EA�58?GW�5[D�<V?BKyH%:W�a9D;79Lu?EA�:�Wk~0DJ~b?vc;L0DBX�ap?B<V7;KM5M<9\%W�a958Lu5M< W�A�?EfzW�?BT95MKM5�Wkc�^

£'5[<p?BKMK[c�l'~0:o7;58L�f2SVL�Ld:7Ê?vFED�5M7;5M<9\/DGFE:�AdrVWdW�5M<9\-?E<V7�K[:?BA�<95M<9\]W�aV:+H%Dm79:KbLkW�A�SVf2W�S9A�:E^ � :+h9A�:�L�:< W�:�7ÊL�:FE:�A�?EKY?Bh9�h9A�D�?�f�a9:�L�lm5[<VfK[Sp7;5[<V\jDE<9:�~ua958f�aRHj?ECE:�Lu?JFG?BA�58?GW�5MDE<p?BKy?Bh9hVA�Dv�;5MH%?BW�5MDE<oW�DJXZS9KMK��b?vcE:�L�58?B<o5M< W�:�\EA�?GW�5MDE<�^çÊà3èRÛ<æ}åc÷/â}öa?bâ}Ýõâ}Û�ä5ã_ba9:�?ES;W�aVDEAP~0DESVKM7/KM5[C�:wW�D+W�aV?E<9C^D�:�D�BgA�:�c��P^p4P5[< W�D�<�lg=]5Mf�ap?B:K��z^i¨�DEA�79?E<�lA��?vF 587]¨p^(I�^i=-?Ef&îw?vcElV?E<V7-Ä�?v~uA�:<pf2:î%^V�;?ES9K�~ua9D%~0:A�:�fDEKMKM?ETpD�A�?BW�D�A�LYDE<]LdD�H%:�DEX�W�a9:w~eD�A�CjA�:Fm5M:~0:�7R5[<�W�a95ML6hV?Bhi:A^

N ¶a�B¶P&)¶P#/.u¶6Á« � ¬q��^3�3^i�3^V¤6<p7;:A�LdD�<�?E<V7�¨V^9��^V=]DmD�A�:�^PO�×gØOÍ°òjÒJY#QYÍ�Y�Ø�ÏÓzÍ°ÐM�E^bHnA�:< W�58f2:��4�?BKMKOl;�Y<9\EKM:~0DmDm7^IeK[5CByLlV­�¨Vl ��© § © ^« �v¬q4�^p¤0WdW�5M?�L^P��<;XZ:A�A�5M<9\jhV?EA�?EH%:2W�:�A�LP?B<V7]LdW�A�SVfzW�S9A�:qDBX)K8?GW�:�< W�FG?BA�5M?ET9KM:wHJD;7;:�KMLPTmcRFG?BA�58?GW�5MDE<p?BK��b?vcE:L^b��<SR0Ó�Õ�ì�TUWV ØZÌX6nÕGÐ6�2TnÕGÐZY�Ðiì�ÏÓzØ�ÒBÍ°ÐVئÙ%Í°Ð�[�ÓzØ¦Í §eìÍ�ÒJY��2ÐVØ�Ï�Y�Y�Íz��ÏÐiì�Ïl ��©�©E© ^« �G¬@H}^m�b?BK87;5OlW\3^AIeaV?ES9Fm5[<�l _�^m46S9<VCv?Eh95MK[KM:Al;?B<V7+=`^ ¤�^m=@f6IeKMS9A�:�^�4658797;:�<o=-?EA�C�DGF�H%D;7;:K8L0DBX�T95MDEKMDE\�5Mf�?BK9h9A�5MH%?EA�c

L�:�U S9:�<Vf2:�5M<;XZDEA�Hj?GW�5MDE<�^(RbÓ�Õ�ì�T^]�ÒBØT@[�ì�ÒEÎWT;_gìÍ`Tba�Y _c[�dGl ©9� NO��Q2� � G�� © � � GE�E�Vl ��©�© �p^« �B¬qÄY^ �P^p�b?BS9H/li_�^�H}:W�A�5[:�l�DJ^g�;DES9KM:�L�li?E<V7]­q^ � :58L�L�^6¤¥Hj?G�;5MHJ5M��?BW�5MDE</W�:�f�a9<958U S9:qD;ffS9A�A�5M<9\j5M<]W�a9:JLkW�?GW�5MLdW�58f?EK

?E<V?BKMc;Ld58L'DBXgh9A�D�TV?BTV5[KM5MLdW�58f0XZS9<Vf2W�5MDE<VLnDBXy=-?BA�CEDGFqf�aV?E5[<pL^�eiÌVÏ�[�ÐVÐiÒ�YùëPÕ��6Ñ-ÒBØ°ÌVÏ2òjÒGئÍ�ì�ÒJY�_pØ�ÒGئÍ8ëzØOÍ�ì2ëzlE� � � � �B�Æ� � § � l�© §JGV^

« �v¬f\J^p�0:<9\�5[D+?E<V7FH}^p£VA�?�L�fDE<95¦^b¤6<-5M<9h9S;W�� D�S;W�h9S9W�4P=@=¸?BA�f�a95[W�:�f2W�S9A�:E^0��<`DJ^p_�:�L�?BSVA�DplA��^y�g^g_�D�S9A�:2W���CmcElV?E<V7_�^3î%^9Ä�::<�l;:�7;5[W�D�A�L�l�[PÎBÖvÒBÐiì�Ï2ë�Í°Ð�]�Ï~q;Ó�ÒJYA�2Ð&�2ÕGÓzòjÒGئÍ�ÕGÐgR0Ó�Õì�Ïzë�ëzÍ°ÐM�A_pÙvëzØ�Ï2ò3ëih�l9hV?E\E:�L0�m��§W�m���E�V^�=-�k_ÑHYA�:L�L�lI0?EH�T9A�5M79\E:El;=-¤�l ��©�© �9^

« �G¬q¨p^n�0:�L�?B\V^{�mhp?GW�58?BKP5[< W�:�A�?�fzW�5[D�<>?E<V7`W�a9:@LdW�?BW�58LkW�5Mf�?BK6?B<p?BKMcmL�58L3DEX�K8?GW�W�58f2:-L�c;LkW�:HjL^kjcT�8PÕBÙEÒJY�_iØ�ÒBØT0_yÕ�ì�T?Bul���9� ��© �R�m� �B�9l ��© §G�V^

«ù§¬lI�^ =Ê^��058LdaVDEh�^'Õn?EA�58?GW�5[D�<V?BKAH�I0¤q^g��<lR0Ó�Õ�ì�T�]qÍ°ÐVØZÌr�2ÐVØmT!6nÕGÐ6�2T�ÕBÐ&[�ÓzØOÍ §0ì2Í�Ò�Y�]3Ï�q;Ó�Ò�Y�]3Ï2Ø\FYÕGÓ�ÔGë�T��n6 [?]0]ql �©E©E© ^

Page 23: An Introduction to Hidden Markov Models and Bayesian Networks

« ª ¬qÄY^0�0A�:5MH%?E<�l6¨p^04�^b£VA�5M:�79H%?E<�lPtw^b¤q^P��K8LdaV:<�lP?E<V7ÑI�^b¨V^u� W�DE<9:�^o6fY[Òvë�ëzÍ §eì�ÒBØOÍ�ÕBЯÒGÐiÎX8�Ï��EÓ�Ï2ë�ë�Í�ÕBÐpe9Ó�Ï�Ï2ë�^� ?E79L�~0DEA�W�ao��< W�:A�<V?GW�5[D�<V?BK}D�A�DES9h�l9�e:�K[H%D�<�Wl�I0¤ql �©Eª �V^

« © ¬q_�^ � ^}I0?Eff5M?BW�D�A�:�?E<V7@�g^y¨p^i­PDG~uKM?E<�^�=-5��mW�SVA�:LPDEXef2D�<�W�A�D�K[KM:A�LbXZD�AY|kS9H%hsK[5M<9:�?EA�?E<V7]<9D�<;��K[5M<9:�?EAPh9K8?B< W�L^���<¨p^���^gIeDG~0?E<�l!DJ^B_�:�L�?BS9A�DVlE?E<V7J¨V^B¤PKML�hp:fzW�DEAlE:�795�W�DEA�LlK[�ÎGÖGÒGÐgì�ÏzëuÍ°Ði]3Ï�q;Ó�ÒJY!�2Ð&�2ÕGÓzòjÒGئÍ�ÕGÐ&R0Ó�Õ�ì�Ï2ë�ëzÍ°Ðg�I_iÙvë�Ø�Ïò�ëq l9hV?B\�:�L6§ �© �V§B�B�V^ =-DEA�\�?B<�îw?BS;XZHj?E<9<�HYS9T9KM5ML�a9:�A�L�l9�;?B<]£9A�?B<pf258L�fDVlAI0¤ql �©E© �V^

« � GG¬lI�^�î%^}I0?BA�W�:A�?B<V7stw^'î�DEa9<�^�=-?EA�C�DGF�f�ap?B5M<@=]DE< W�: I0?EA�KMD+5M<sf2D�<V7;5[W�5MDE<V?EK[KMc D�?BSVL�L�5M?E<@LkW�?GW�:3L�hV?Ef:�H%D;7;:K8L^[kqmëzئÓ�ÒJY�Í�ÒBÐsrbÓ�ÒEÎ�qVÒGØ�ÏI_yì�ÌVÕ�Õ�Y'Õ/��Ñ@ÒGÐiÒ&��ÏòjÏ2ÐpØ`tuY'ÐVÍ°ÖGÏ2Ó�ëzͰئÙoÕ��?]3Ï�Fv_yÕJq;ØZÌvw]ÒJY[Ï2ëzl ��©�© �9^« �E� ¬q_�^v��:�?B<>?B<V7øî%^fîw?E<V?B�?v~0?V^@¤ H%Dm79:K0XZDEAJA�:?EL�DE<95M<9\@?ETpD�S;W%hp:�A�L�5�W�:<Vf:R?E<V7®f�?BSVL�?GW�5[D�<�^x6nÕBò6×�q;Ø�ÒBØOÍ�ÕBÐiÒJY�2ÐVØ�Ï�Y�Y�Íz� ÏÐiì�Ï2li�9N�� Qz� � �m�_� � ��GVl ��©�ªE© ^« � �v¬q¤�^ H}^'��:H%hVLdW�:Al�­q^ =Ê^yÄ�?E5[A�7yly?B<p7`�3^ ��^�tuS9TV5[<�^q=@?G�;5[H3S9H KM5[C�:KM5[a9DmD;7/XZA�DEH 5M<Vf2D�H%h9K[:W�:%79?GW�?oFm58?jW�a9:J�e=

?EK[\�DEA�5�W�a9H/^bjcT^8PÕBÙEÒJY^_iØ�ÒBØOÍ8ëzئÍ�ì�ÒJY^_yÕ�ìÍ�Ï2ئÙ�_yÏ2ÓzÍ�Ï2ëyBulV� © � � �;� ª l ��© §E§;^« � �G¬EÕ3^3�P5M\�?EKM?EC 58L�l ¨p^;tw^9tuDEaVK[58f2:�Cil;?E<V7R=`^9��LdW�:�<V7;D�AdXk^'=-ÄI:�LdW�5MH%?BW�5MDE<RDBX'?%� W�Dmf�ap?ELdW�58f�Ä�5[<9:?BAu�mc;LkW�:Hè~u5[W�aRW�aV:

�e= ¤PK[\�DEA�5�W�a9H�?B<V7�5[W�L3¤6h9h9KM58f?GW�5[D�<�W�Ds�;hp:�:�f�a`tu:f2DE\�<95[W�5MDE<�^F�=z(z{z|e9Ó�ÒGÐVëÒEìØOÍ�ÕBÐ9ëRÕGÐ}_B×VÏ�Ï�ì�Ì ÒGÐiÎg[kqVÎBÍ�ÕR0Ó�Õ�ì�Ï2ë�ëzÍ°Ðg�Bl � NZ�mQz� ��� � � ��� �;l ��©�© �9^« � �B¬q��^p¨p^p£VA�:�cR?E<V7]­q^g¨EDE|k5MfE^u_�A�?B<VLdXZDEA�H%:�7�f2D�HJhiDE<V:< W�?B<p?BKMcmL�58L�0¨ED�5[< W6:�LdW�5MHj?GW�5[D�<]DBXnLdhp?GW�58?BK�W�A�?B<VLdXZDEA�Hj?GW�5[D�<VL

?E<V7q5MHj?B\E:bf2D�H%hpD�<9:< W�L�^;��<AR0Ó�Õì�Ï�Ï�ÎGÍ°Ðg�GëPÕ/�uØ°ÌVÏb�*z(z(zÿ�2ÐVØ�Ï2ÓzÐgÒGئÍ�ÕGÐiÒ�Y@6nÕGÐ6�2Ï2Ó�ÏÐiì�Ï�ÕGÐS6)ÕBò6×�q;Ø�ÏÓ(��Í8ëzÍ�ÕBÐ Un~W~�~ t¦%ÏÓ�ÔGÙGÓ�Ò�t0rbÓ�Ï�Ï�ì�Ïl9Ä�D Lu¤6K8?BH%5[W�D�L�l�I0¤ql ��©E©�© ^m�k�Y�e�ÒIeD�H%h9S;W�:�A��mD;f25M:2WkciHnA�:�L�L^« � �v¬q¨p^94q^V£VA�5M:�79H%?E<�^n=]S9K[W�5MFG?BA�5M?BW�:w?E7V?Bh;W�5[F�:�A�:\�A�:L�L�5MDE<oL�h9KM5[<9:L^�egÌ9ÏI[�ÐpÐiÒJY�ëwÕ/�f_pØ�ÒGئÍ8ëzØOÍ�ì2ëzl ��© � � � � � � l ��©E©V� ^« � �G¬@�3^�D�:5M\E:�Au?B<V7���^p46:�f�C�:A�Hj?B<�^}¤¥f�aV?BA�?Ef2W�:�A�5M��?BW�5MDE<+DEX�W�aV:@�P5MA�58f�a9KM:2W67;58LkW�A�5MT9S;W�5[D�<�W�a9A�DES9\�ao\�K[D�TV?BKy?B<p7RKMD;f?EK

5M<V7;:�hp:�<V7;:<pf2:E^n_�:�f�aV<95Mf�?BK�tu:�hpD�AdWP=s�;tb��_utb� © �B� � �Vl =]58f2A�D�L�DBX°Wutu:Ld:?BA�f�a�l ��©�© �RN�A�:�Fm5ML�:�7 ��©�© ��Q2^« � §¬��g^$D�:�H%?E<s?E<V7`�3^$D�:Hj?B<�^��mW�D;f�aV?ELdW�58f3A�:�KM?B�;?BW�5MDE<�l'D�5MT9TVL�7;58LkW�A�5MT9S;W�5[D�<VLl�?E<V7]W�a9:%�0?vc�:�L�5M?E<]A�:LkW�DEA�?GW�5[D�<]DBX

5MHj?B\E:L^v�=z{z(z�e9Ó�ÒGÐVëÒEìØOÍ�ÕBÐ9ë�ÕGÐgRuÒGئØ�ÏÓzÐ�[�ÐgÒJY�ÙvëzÍ8ë�ÒGÐgÎ%Ñ@ÒEì�ÌmÍ°ÐgÏE�zÐpØ�Ï~Y�Y�Íz� Ï2Ðgì�ÏlV�V�ù§E� � �V§v� � l �©Eª �V^« ��ª ¬��'^'D�aV?Ea9A�?EHj?B<95¦^w£V?Ef2W�D�A�58?BK'K[:?BA�<95M<9\R?E<V7]W�a9:�z0Ñ ?EK[\�DEA�5�W�a9H/^���<VDJ^�_�:L�?ES9A�DVl���^ù�g^�_�DES9A�:2W��CmcEly?B<p7-_�^ î%^

Ä�::<�l;:�7;5[W�D�A�L�l$[PÎBÖvÒBÐiì�ÏzëwÍ°Ð�]3Ï�q;Ó�ÒJY��2Ð&�2ÕGÓzòjÒGئÍ�ÕGÐgR0Ó�Õì�Ïzë�ëzÍ°ÐM�A_pÙvëzØ�Ï2ò3ëih�l9hV?E\E:�Lb� � §W�;���B�V^�=-�k_ÌHnA�:�L�L�l3I0?EHJ�T9A�587;\E:�l9=-¤ql �©E© �;^

« ��© ¬��'^5D�aV?Ea9A�?EHj?B<95i?B<V7j=Ê^;¨p^ �0:?BK¦^'Õn?BA�5M?BW�5MDE<V?EK95[<9XZ:A�:<Vf:6XZDEAb�b?vcE:Ld58?B<%H%5��mW�S9A�:LnDEXyX�?EfzW�DEAb?B<V?EK[c;L�:A�L^i��<l[�ÎGÖ�T]3Ï�q;Ó�T��zÐ6�2T R0Ó�Õì�T�_pÙvë�T U�� ^p=]�k_ÔHnA�:�L�Ll9�-G-G-GV^« ��GG¬��'^-D�ap?Ba9A�?BHj?B<V5m?E<V7 DJ^B�6^B465M< W�D�<�^�H)?EA�?EHJ:W�:�A�:�LdW�5MHj?GW�5[D�<�XZD�A)K[5M<9:�?EA)7;cm<V?BH%58f?BK9L�c;LkW�:HjL�^V_�:f�a9<958f?EKmt6:hiDEA�WI0tRD���_utb� © �G�k�]« a�W�W�h��Û���G~u~u~w^ \ ?GW�LdTmcE^ SVfKO^ ?EfE^ S9CÄ� ë �DESVT95[<$�vhV?Ehp:�A�L³�W�Ad� © �B���m^ hVL�^ \��2¬�l3�P:�hV?BA�W�H%:�<�WwDEXRIeDEH%h9S9W�:A

�;f5[:�<Vf2:�l9�6<95MFE:�A�L�5[Wkc+DBX)_�D�A�D�< W�DVl ��©�© �V^« � � ¬��'^�D�aV?Ba9A�?BHj?E<95y?B<V7FDJ^p�P^9465M< W�DE<�^¯Õn?BA�5M?BW�5MDE<V?EKyK[:?BA�<95M<9\JXZDEA6L�~u5�W�f�a95[<V\+LkW�?GW�:qL�hV?�f2:�H%Dm79:K8L^3]3Ï�q;Ó�ÒJY(6nÕGò �

×�q;Ø�ÒBØOÍ�ÕBÐVl � �;� © �E�G� ©�© �9l ��G-G!G9^« �E�v¬��'^fD�aV?BaVA�?EH%?E<95Y?E<V7`=Ê^��z^'¨�DEA�79?B<�^/£p?Ef2W�DEA�58?BKna958797;:�<®=-?EA�C�DGF-H%Dm79:K8L^�Ñ@ÒEì�ÌmÍ°ÐgÏ&D�Ï�ÒBÓzÐVÍ°Ðg�Bln� © � �B� �R�;��§B�9l

�©E© §;^« �B�G¬rDJ^ÅI�^�D�DmD;7;~u5[</?B<p7�î%^ù�g^V�m5M<�^3[�ÎEÒ�×iئͰÖvÏP§¯Y�Ø�ÏÓzÍ°ÐM�w×iÓ�Ï�ÎBÍ�ì2ئÍ�ÕGÐÊÒGÐgÎoì�ÕGÐpØOÓ�Õ�Y�^¯HnA�:< W�5Mf:2��4P?BKMK¦l �©Eª �V^« �G�B¬@�3^646:f�CE:A�Hj?B<�^è¤ÉW�S;W�D�A�58?BK�DE<�K[:?BA�<95M<9\ ~u5[W�a �b?vcE:Ld58?B<ê<9:Wk~eD�A�C;L�^è_�:f�a9<958f?EK�t6:hiDEA�W]=s�;tb��_utb� © �v�uGE�

« X°W�h��Û���vX°W�h�^ A�:�L�:�?BA�f�a�^ H%5MfA�D LdDEX°W�^ f2DEHN�Gh9S9TÀ�vW�A��G_utb� © �G�WG��;^ H0� ¬�l9=]58f2A�D�L�DBX°W6tu:Ld:?BA�f�a�l ��©E© �9^« �E�v¬rDJ^v�6^465M<�W�DE<�?E<V7qtw^G�g^n�i:H%:�KO^ ¤6S;W�D :�<Vf2D;7;:�A�L�lvH%5[<95MH�SVH 79:�L�f2A�5[h;W�5[D�<wK[:�<9\BW�a�lB?B<p7w46:KMH%a9DEK[W��YXZA�:�:Y:�<9:A�\Ec�^B��<

¨p^ �3^3IeDG~0?E<�l!DJ^m_�:L�?ES9A�Dpl�?E<V7j¨V^m¤6K8L�hp:fzW�D�A�l�:�7;5[W�D�A�L�l�[PÎBÖvÒBÐiì�Ïzë�Í°Ð�]3Ï�q;Ó�ÒJY5�zÐ&�2ÕBÓzò%ÒBØOÍ�ÕBÐ�R0Ó�Õì�Ïzë�ëzÍ°ÐM��_iÙvë�Ø�Ïò�ëq ^V=]DEA�\�?E<iîw?ES;XZHj?B<9<^HnS9TVK[58LdaV:A�LlV�;?E<�£VA�?E<Vf258L�f2DVlAI0¤�l ��©�© �V^« �B�G¬rDJ^ �6^i465M<�W�DE<-?E<V7F��^iFG?B<pI0?EH%h�^Rî�::hV5[<9\o<9:S9A�?BK�<9:2Wk~0DEA�C;LuLd5MH%h9KM:�TmcRH%5M<95MHJ5M�5M<9\oW�a9:�79:�L�f2A�5[h;W�5[D�<]K[:�<9\BW�a

DEX�W�aV:w~e:�5[\�a�W�L^}��<�_pÍ ó�ØZÌA[�6'Ñ�6)ÕBÐ&�2ÏÓ�ÏÐiì�Ï%ÕGÐ}6nÕBò6×�q;Ø�ÒBØOÍ�ÕBÐiÒJY^D�Ï�ÒBÓzÐVÍ°ÐM�XegÌ9Ï�ÕGÓzÙ�t3_gÒBÐVØ�Ò�6}Ó qW�2l ��©E© �9^

Page 24: An Introduction to Hidden Markov Models and Bayesian Networks

« ��§¬qtw^;¤�^9¨�?�f2DETpLlm=Ê^m�z^9¨ED�A�7V?B<�l;�g^;¨V^9­PDG~uKM?E<�lm?B<V7�DJ^9�6^;465M< W�DE<�^'¤�79?Bh;W�5[F�:�H%5[�mW�S9A�:�DEX�KMDmf�?BKg:2�;hi:A�W�L�^;]3Ï�q;Ó�Ò�Y6nÕGòP×�q;Ø�ÒGئÍ�ÕGÐplV�9��§ © � ª §ml ��©E©V� ^« � ª ¬q£0^3Õ3^V¨E:�<VL�:<�^¯�zÐpØOÓ�Õ�Î�qVì2ئÍ�ÕGÐ-Ø�Õ�B�ÒGÙEÏ2ëzÍ�ÒGÐg]�ÏØ�FYÕBÓ�Ôvëz^e�;h9A�5M<9\�:A���Õ):�A�K8?B\pl ­P:~x\nDEA�Cil �©E© �V^« � © ¬q£0^�Õ�^y¨�:<VL�:<�l��g^yÄY^gÄ�?BS9A�5[W��:�<�ly?B<V7`î%^'DJ^���KM:�L�:<�^��b?vcE:Ld58?B<]S9hg79?BW�5M<9\R5M<@A�:�fS9A�Ld5MFE:q\�A�?Eh9a958f?EK�H%D;7;:K8LPTmc

KMD;f?BK�fDEH%h9S;W�?GW�5[D�<VL^f6nÕGòP×�q;Ø�ÒGئÍ�ÕGÐgÒJY _pØ�ÒGئÍ8ë�ئÍ�ì2ë7��qVÒBÓzØ�ÏÓ Y�ÙGl;�V�ù�B� © �9� ª �9l �©E© GV^« �-GG¬q=Ê^}�z^}¨ED�A�7V?B<�l{�'^¯D�aV?Ea9A�?EHj?B<95¦ln?B<V7®Än^vî%^}�9?BS9K¦^Ê4658797;:<>=-?BA�CEDGFI7;:�f5ML�5MDE<ÊW�A�:�:�L�^s��<>=Ê^(I�^)=]D��:�A�ln=Ê^ �

¨�DEA�79?B<�ln?B<V7 _�^fH}:W�L�f�a9:El):7;5[W�DEA�L�lb[PÎBÖvÒBÐiì�Ï2ëoÍ°Ð}]�Ï~q;Ó�ÒJY¯�2Ð&�2ÕGÓzòjÒGئÍ�ÕGÐ�RbÓ�Õ�ì�Ï2ë�ë�Í°Ðg��_pÙvëzØ�Ï2ò3ë ~ ^)=]�k_[HYA�:L�L�lI0?EH�T9A�5M79\E:El;=-¤�l ��©�© §;^« � � ¬q=Ê^i�z^g¨ED�A�79?E<-?B<V7@tw^ ¤�^y¨�?�f2DETpL^P4P5[:�A�?EA�f�aV5Mf�?BK�H%5[� W�S9A�:�L�DBXn:2�;hi:A�W�L�?B<V7]W�a9:J�Y=¸?EK[\�DEA�5�W�a9H/^P]�Ï~q;Ó�Ò�Y36nÕGò �

×�q;Ø�ÒBØOÍ�ÕBÐVlV�V� �ª9� �9� � �Vl �©E© �p^« ���v¬q��^m4q^;¨ESp?B<9\J?B<V7+ÄY^;tw^;t6?BT95M<9:�A�^�4P5M7V7;:<�=-?BA�CEDGFJH%Dm79:K8LnXZD�A0L�hp:�:�f�aRA�:f2DE\�<95[W�5MDE<�^yepÏ�ì�Ì;ÐiÕGòjÏØOÓzÍ�ì2ëzl9�E�9�ù�E� � �

� §B�;l �©E©9� ^« �E�G¬qtw^�6^6îw?BKMH%?E<q?B<V7wtq^v�g^�0SVf2c�^E­6:�~ÊA�:LdS9K[W�L�5[<�K[5M<9:�?EAyrVK[W�:�A�5M<9\P?E<V7�h9A�:�7;58fzW�5[D�<�^�j;ÕJq;ÓzÐgÒJY;Õ��!BPÒGëzÍ�ì{z0ÐM�EÍ°ÐiÏ�ÏÓzÍ°ÐM�a`[P_pÑ�z�dGl ª �-�3� © �_� � G ª l ��© � � ^« �B�B¬@î%^Aîw?E<V?B�?v~0?Vl5��^�î�DEKMK[:�A�lp?B<V7]�g^i¨V^ituSVL�Ld:�K[K¦^b�mW�D;f�aV?ELdW�58fwL�5[H3S9KM?BW�5MDE<-?EK[\�DEA�5�W�a9HjL0XZDEAP7;cm<V?EH%5MfwhVA�D�TV?BT95MKM5MLdW�58f

<9:Wk~eD�A�C;L�^g��<nH}^ �0:Ld<V?EA�7j?E<V7o�g^m4P?E<9C;Ll :�795�W�DEA�Ll3Y�Ðgì�ÏÓzØ�ÒGÍ°ÐVئÙ�Í°Ð�[�ÓzØ¦Í §eìÍ�ÒJY3�2ÐVØ�Ï�Y�Y�Íz� ÏÐiì�Ï1T�R0Ó�Õì�Ï�Ï�ÎBÍ°ÐM�Bë�Õ/��ØZÌ9ÏzKYMÏ2ÖGÏ2ÐpØ°Ì�6nÕGÐ&�2ÏÓ�ÏÐiì�Ï�TMlVhV?E\E:�Lu�E���G�m��� � ^ =]DEA�\�?E<iîw?BS9XZH%?E<9<^HnS9T9KM58Lda9:�A�L�lV�;?E<�£VA�?E<Vf258L�fDVl�I0¤�l ��©�© �;^« ���v¬q¨p^E4q^Mî�5[HÈ?B<p7J¨p^-H}:?BK¦^p¤{fDEH%h9S;W�?GW�5MDE<p?BK9H%D;7;:KVXZDEAYf�?BSVL�?BKp?B<V7%7;58?B\�<9D�LdW�58fbA�:?EL�DE<95M<9\�5[<j5M<;XZ:�A�:�<Vf2:PL�c;LkW�:HjL�^

��<lRbÓ�Õ�ì�Ï�Ï�ÎGÍ°Ðg�GëwÕ��6ØZÌ9Ïu�BØZÌl�2ÐVØ�Ï2ÓzÐgÒGئÍ�ÕGÐgÒJY^j;ÕGÍ°ÐVØ�6nÕBÐ&�2ÏÓ�Ï2Ðgì�ÏqÕGÐ&[�ÓzØ¦Í §eìÍ�ÒJY3�zÐpØ�Ï~Y�Y�Íz� Ï2Ðgì�ÏlmhV?B\�:�L �© GG� ��© �9^ �©Eª �V^« �E�G¬q¤�^6î�A�DE\�a�l�=Ê^v�0A�DG~u<�l��z^G�g^v=]5M?E<�lJî%^�|��D�KM?E<V7;:�A�lG?B<p7E��^v4P?ESVL�L�KM:A^E4658797;:�<�=-?BA�CEDGFPHJD;7;:�KML�5M<�f2D�HJhVS;W�?BW�5MDE<V?EK

T95MDEKMDE\�cg�'¤Ph9h9KM5Mf�?GW�5MDE<pLbW�D%h9A�DBW�:5M<RH%D;7;:KM5M<9\V^?j;ÕJq;ÓzÐgÒJY�Õ/��Ñ@ÕJY[Ï�ì~q5Y[ÒGÓPB6Í�ÕJYMÕ��EÙGlg�E���9� � ��G � � � �B� � l ��©�© �V^« � §¬��g^iÄn^VÄ�?BS9A�5[W��:�<]?B<V7F�3^p¨p^i�mhV5[:�\E:KMaV?EK�W�:A^eÄ�D;f�?BK�fDEH%h9S;W�?GW�5MDE<pLu~u5�W�a]h9A�DETV?ET95[KM5[W�5M:�LuD�<]\EA�?Bh9a958f?EK�LkW�A�SpfzW�SVA�:L

?E<V7+W�a9:5MAP?Eh9h9KM5Mf�?GW�5MDE<RW�D%:�mhi:A�WPL�cmLdW�:�HjL^�jcT^8PÕBÙEÒJY^_iØ�ÒBØOÍ8ëzئÍ�ì�Ò�Y^_gÕìÍ�Ï2ئÙ�BulphV?B\�:�L � � §W�9�E�G�pl �©EªEª ^« � ª ¬qÄY^VÄ;|kS9<V\+?B<V7/_�^i�@�D�7;:�A�LdW�A��DEH/^�egÌ9ÏÕGÓzÙ/ÒGÐiÎ7R0Ó�Ò�ì2ئÍ�ì�Ï%Õ��08�Ï�ì~q;Ó�ëzÍ°ÖvÏ+��ÎEÏÐVØ¦Í §eì�ÒGئÍ�ÕGÐp^e=]�k_ÔHnA�:�L�Ll�I0?EH�T9A�587;\E:�l

=-¤�l ��©�ª �V^« � © ¬@�3^ ¨p^ÅI�^E=-?Ef&îw?vcE^;�n<pLd:�H�T9KM:bK[:?BA�<95[<V\�XZD�A)a958797;:<j=-?EA�C�DGF�HJD;7;:�KML�^p_�:�f�aV<95Mf�?BK;A�:hiDEA�W�lMI0?vF�:<V795ML�a3Ä�?BTiDEA�?GW�D�A�c�l

�P<95[F�:A�Ld5[WkcjDBXbI0?BH3T9A�5M7;\�:El ��©�© §;^« �!GG¬q=Ê^i=]:5MK8?+?B<V7]=`^V�z^p¨�DEA�79?E<�^0Ä�:�?EA�<95M<9\%rV<V:qH%DBW�5MDE<]Tmc/=-?BA�CEDGFoHJ5[�mW�S9A�:�LPDBX):2�;hi:A�W�L�^b��< ��^y�g^p_�DESVA�:W��Cmc�l

=Ê^5I�^ =-DE�:�A�l ?B<V7j=`^ �P^�4P?�L�L�:KMH%DVl�:�7;5[W�D�A�L�l�[�ÎGÖGÒGÐgì�Ï2ëPÍ°ÐA]�Ï~q;Ó�Ò�Yg�2Ð&�2ÕGÓzòjÒGئÍ�ÕGÐ&R0Ó�Õ�ì�Ï2ë�ëzÍ°Ðg�i_pÙvëzØ�Ï2ò3ë0�B^m=]�k_HYA�:L�L�l ��©E© �9^« � � ¬qtw^p=Ê^p­P:�?BK¦^bHYA�D�TV?BT95MKM5MLdW�58f�5[<;XZ:�A�:�<Vf2:wSpLd5M<9\+=-?EA�C�DGF+f�aV?B5M</HJD�< W�:qf?EA�KMD%H%:2W�aVDm7VL^0_�:f�a9<958f?BK�t6:hiDEA�W0I0t�D��

_utb� © �B� � l �©E© �9^« � �v¬qtw^�=`^�­6:?BKn?B<p7pDJ^��P^�465M< W�DE<�^J¤È<9:�~¯Fm5M:~ DBXYW�a9:j�Y= ?BKM\ED�A�5[W�a9H W�aV?BW0|kSpLkW�5�rV:Lw5M<Vf2A�:H%:< W�?BKn?B<p7@DEW�a9:�A

FG?BA�58?B< W�L�^'_�:�f�aV<95Mf�?BKyA�:hiDEA�W�l3��:hV?EAdW�H%:< W6DBX¯IeDEH%h9S;W�:A��;f5[:�<Vf2:�l9�6<95MFE:�A�L�5[Wkc+DBX}_�D�A�D�<�W�DVl ��©�© �V^« ���G¬rDJ^AH)?EA�58L�5O^3_pØ�ÒGئÍ8ëzØOÍ�ì�ÒJY�QnÍ�Ï~Y[ÎXegÌ9ÏÕGÓzÙG^Y¤�797;58LdD�<;� � :�L�KM:cElptu:�7;~0DmD;7^Ie5[WkcEl�I0¤�l ��©�ªEª ^« �E�B¬q¨p^KH}:?BA�KO^�RbÓ�Õ-��Ò-�Í�Y�Í8ëzئÍ�ì�8PÏ�ÒvëÕBÐVÍ°ÐM�>Í°ÐÊ�zÐpØ�Ï~Y�Y�Íz� Ï2ÐpØi_pÙvëzØ�Ïò3ë2�}]�ÏØ�FYÕBÓ�ÔvëIÕ/�lRKYMÒJqmëzÍ���YMÏ �zÐ6�2Ï2Ó�ÏÐiì�Ï^Ã=]D�A�\ ?B<îw?ES;XZHj?B<9<�lV�9?B</=-?GW�:DVl�I0¤�l ��©�ªEª ^« � �v¬qÄY^mtq^9t6?BT95M<9:�Ab?E<V7o��^94�^9¨ESV?E<9\V^'¤6<���< W�A�Dm79SVfzW�5[D�<+W�DJa958797;:�<�=-?EA�C�DGF%HJD;7;:�KML�^v�=z(z(z�[�ì�ÕJqmëzئÍ�ìzëGt�_B×VÏ�Ï�ì�Ì��_iÍz�BÐgÒJY#R0Ó�Õ�ì�Ï2ë�ëzÍ°Ðg�jÑ@Ò~� Ò1�Í°ÐgÏ2lg�9� �G� � �9l ��©�ª �V^« ���G¬q4�^��6^�t6?ESVf�a�^+�mD�K[S;W�5[D�<VL�W�D/W�a9:jKM5[<9:?BAqL�H%D DEW�a95M<9\/h9A�DET9KM:H/^>�=z{z(z�e9Ó�ÒGÐVë2Ò�ì2ئÍ�ÕGÐVëoÕGÐ�[kq;Ø�ÕGòjÒGئÍ�ìg6nÕGÐpØOÓ�ÕJY�l

ª � �m§ � �;� §E�;l �© ���9^

Page 25: An Introduction to Hidden Markov Models and Bayesian Networks

« �m§¬lI�^$H}^�tuD�Tp:�AdWl|DJ^�Ie:�K[:�S;�yl�?B<V7I¨p^$�P5M:TiDEK[W�^+�b?vcE:Ld58?B<@:�LdW�5MH%?BW�5MDE<IDBX0a95M7V7;:<Ê=-?EA�C�DGF/f�ap?B5M<VL��?/LkW�D;f�aV?ELdW�58f5MH%h9K[:�H%:< W�?BW�5MDE<�^�_iØ�ÒBØOÍ8ëzØmT�RbÓ�Õ-��T D�Ï2ئØ�ÏÓ�ëzl � �V�ù§�§W� ª �9l ��©E© �9^

« � ª ¬��g^g_�^gtuDG~e:�5MLP?B<V7S�}^�D�aV?Ea9A�?BHj?B<95¦^6¤�SV<95�XZcm5M<9\oA�:Fm5M:~ DBXnKM5M<9:�?EA0D�?BSpL�L�5M?E<]H%Dm79:K8L^y]3Ï�q;Ó�ÒJYb6)ÕBò6×�q;Ø�ÒBØOÍ�ÕBÐVl��� NO��Qz� �-G �_�m�E� �9l ��©�©E© ^

« � © ¬qÄY^�î%^��;?ES9Kn?B<p7@=Ê^y�z^y¨�DEA�79?B<�^q=-5��;:�7@H%:H%DEA�c-=-?BA�CEDGF�H%D;7;:K8L^���<p�3^�=-?E795[\ ?B<s?E<V7`H}^��mH3c W�a�l�:7;5[W�DEA�L�lR0Ó�Õ�ì�Ï�Ï�ÎGÍ°ÐM�Bë�Õ��wØZÌ9Ï Un~W~ hl6nÕGÐ&�2ÏÓ�ÏÐiì�Ï%ÕGÐg[�ÓzØOÍ §0ì2Í�Ò�Y��zÐpØ�Ï~Y�Y�Íz� Ï2Ðgì�ÏJÒGÐgÎ�_iØ�ÒBØOÍ8ëzئÍ�ìzëz^9£�W�^pÄ�?BSp7;:A�79?BKM:El9£}ÄYl ��©�© §m^« ��GG¬qÄY^$î%^��;?BS9Ke?B<V7I=Ê^�t6?Ea95MH�^j=]D;7;:�K[5M<9\-?�f2DESpLkW�5MfJf2D�A�A�:K8?GW�5[D�<VLPTmc@X�?EfzW�DEAw?B<p?BKMcmL�58L^J��<Ê=Ê^��z^�¨�DEA�79?B<�l�=Ê^�¨V^î�:?BA�<VLl ?B<V7R�g^;¤q^;�mDEKMKM?Vl�:7;5[W�DEA�L�lc[�ÎGÖGÒGÐgì�Ï2ë�Í°Ð&]3Ï�q;Ó�ÒJY5�zÐ&�2ÕBÓzò%ÒBØOÍ�ÕBÐlR0Ó�Õì�Ïzë�ëzÍ°ÐM�7_pÙvëzØ�Ïò3ë�lmF�DEKMS9H%: � GVl�hV?E\E:L

§G� © �V§B���;^�_baV:q=]�k_ÌHYA�:L�L�l ��©E©�ª ^« � � ¬qÄY^ î%^��9?BS9Ki?B<V7j=Ê^ �z^�¨�DEA�79?E<�^p�n�mhVK[D�5�W�5[<9\qW�A�?EfzW�?BT9KM:6L�S9TVLdW�A�SVfzW�S9A�:L)5M<j��<�W�A�?�fzW�?BT9KM:u<9:2Wk~0DEA�C;L^i��<>�3^ �g^m_�DES9A�:2W��

��C c�li=`^(I�^y=]D��:Alg?B<V7-=`^ �P^i4�?EL�Ld:�K[H%DVli:�795�W�DEA�Ll@[PÎBÖvÒBÐiì�Ï2ë3Í°Ð�]�Ï~q;Ó�ÒJY'�zÐ6�2ÕGÓzòjÒGئÍ�ÕGÐSR0Ó�Õ�ì�Ï2ë�ëzÍ°Ðg�l_pÙvëzØ�Ï2ò3ë��B^=]�k_ÑHnA�:�L�Ll �©E© �9^

« �E�v¬qtw^;4�^V�mamS9H�~b?vcj?B<V7���^V�y^;�mW�D�Bg:A^}¤6</?Bh9h9A�D�?�f�ajW�D3W�5MH%:wLd:�A�5M:�L0LdH%DmDBW�a95M<9\J?E<V7jXZD�A�:f?�LkW�5[<9\3SVL�5[<9\JW�a9:��e=?EK[\�DEA�5�W�a9H/^bjcT?e�Í°ò%Ï�_yÏ2ÓzÍ�Ï2ëy[�ÐiÒJY�Ùvë�Í8ëzlV�pNZ�mQz�ù�E�B�G�;�E�B�Vl ��©�ª �;^

« �B�G¬@H}^��mH�c W�a�^¸4658797;:<Ã=-?BA�CEDGF�HJD;7;:�KML-XZDEA@X�?BS9K[WI7;:W�:fzW�5MDE<¥5M<¯7;cm<V?EH%5Mf`L�c;LkW�:HjL�^�RuÒGئØ�ÏÓzÐ48�Ï�ì�Õ]�EÐVͰئÍ�ÕGÐVl� §;N � Qz� � � © � � �B�pl ��©�© �V^

« �G�B¬@H}^��mH3c W�a�l���^�4P:�f�C�:A�H%?E<�l�?B<p7s=Ê^��z^�¨ED�A�79?E<�^ HnA�DETV?ET95[KM58LkW�5Mf35[<p7;:hi:<V79:<Vf:j<9:2Wk~0DEA�C;LPXZD�A�a95M7V7;:<Ê=-?EA�C�DGFh9A�DETp?BT95MK[5[WkcjH%D;7;:K8L^{]3Ï�q;Ó�ÒJY!6nÕGòP×�q;Ø�ÒGئÍ�ÕGÐpl © �ù�E� §W�9�B� © l �©E© §;^

« �E�v¬q¤�^g� W�DEK8f�CE:J?B<V7@�y^y��H%DEamS9<p7;A�Dp^P4658797;:�<s=-?EA�C�DGFoH%D;7;:K}5M<V7;SVf2W�5MDE<-Tmc]�b?vcE:Ld58?B</H%D;7;:K}H%:A�\E5M<9\V^P��<I�g^g¨V^4�?B<VL�DE<�lp¨V^���^'IeDG~0?E<�l9?B<V7`I�^iÄn^�D�5MKM:�L�lV:�795�W�DEA�Ll^[PÎBÖvÒBÐiì�ÏzëqÍ°Ðg]�Ï~q;Ó�Ò�Y��zÐ6�2ÕGÓzòjÒGئÍ�ÕGÐ�R0Ó�Õì�Ïzë�ëzÍ°ÐM�&_pÙvëzØ�Ï2ò3ë V lhV?E\E:L ��� � ��ª ^m=]D�A�\ ?B<iîw?ES;XZHj?B<9<�lp�;?B</£9A�?B<pf258L�fDVlAI0¤ql �©E© �9^

« �B�G¬q=Ê^9¤�^9_�?E<9<9:�Ab?E<V7 � ^p4q^ � DE<9\p^'_ba9:wf�?BK8f2S9K8?GW�5[D�<+DBX'hpD LkW�:A�5[D�A07;58LdW�A�5[T9S9W�5MDE<VLbTmc+79?BW�?%?BS9\�H%:< W�?BW�5MDE<@N�~u5�W�a7;58L�f2SVL�Ld5MDE<iQz^�j;ÕJq;ÓzÐiÒ�Y�Õ���ØZÌ9Ïf[�òjÏ2ÓzÍ�ì�ÒGÐ�_pØ�ÒGئÍ8ëzØOÍ�ì�ÒJY�[�ë�ëÕ�ìÍ�ÒGئÍ�ÕGÐpl ª �9� ��� ª �;�E�-G9l �©Eª §m^

« ��§¬q¤�^m¨p^MÕP5[W�:A�T95¦^��YA�A�DEAnTiDESV<V79LeXZDEAbf2D�< F�DEKMS;W�5MDE<p?BKVfDm79:�L0?B<V7R?B<o?�LdcmH%h;W�DEW�58f?EK[KMc%DEh;W�5[Hj?BKg7;:f2D;7;5M<9\3?EK[\�DEA�5�W�a9H/^�*z(z(z�e9Ó�ÒGÐVë�T'�zÐ&�2ÕBÓzò%ÒBØTyeiÌVÏ�ÕGÓzÙGlV�k_0� � �V� �E�-GG�;�B� © l �© �m§m^« � ª ¬��g^ � ?GW�:A�a9DESVL�:El'�3^ ¨p^ÅI�^�=-?Ef�CG?vcEly?E<V7@_�^ytuD�T95[<pLdD�<�^q�b?vcE:�L�58?B<]H%:2W�a9D;79L�XZDEA�H%5��mW�SVA�:L�DEXY:2�;hi:A�W�L�^w��<X[�ÎGÖ�T]3Ï�q;Ó�T��zÐ6�2T R0Ó�Õì�T�_pÙvë�Tbh^V=-�k_ÑHYA�:L�L�l ��©E© �;^« � © ¬qtw^i�g^��i:�H%:K¦^b[ÈòJÍ°ÐVÍ°ò q;òµÎ�ÏzëìÓzÍ ×iئÍ�ÕGÐVY[ÏÐM�EØ°Ì@��Ó�ÒGòjÏ/FYÕGÓ�Ô0�2ÕGÓrq;Ð9ë q×9ÏÓzÖÍ8ë2Ï�ÎnY[Ï�ÒGÓzÐpÍ°ÐM�E^�Hna�^ �3^V_ba9:Ld58Ll��P:�h;W�^

DEXvIeDEH%h9S9W�:AP�9f25M:<Vf:ElV�P<95[F�:A�Ld5[Wkc+DEX'_�DEA�DE< W�Dplm_�DEA�DE< W�DVlAI0?B<V?�79?9l �©E© �9^