intech-a vlsi architecture for output probability computations of hmm based recognition systems

Upload: viet-vo

Post on 06-Apr-2018

219 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    1/12

    #8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU

    :

    #8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF

    4GEQIPKVKQP5[UVGOU

    .D]XKLUR1DNDPXUD0DVDWRVKL

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    2/12

    8.5+

    )LJ%DVLFVWUXFWXUHRI+00EDVHGUHFRJQLWLRQKDUGZDUH6HFWLRQ %)33 DQG %)33EDVHG 9/6, DUFKLWHFWXUH DUH LQWURGXFHG LQ 6HFWLRQ WKHHYDOXDWLRQRIWKH%)33DUFKLWHFWXUHLVGHVFULEHGLQ6HFWLRQDQGFRQFOXVLRQVDUHSUHVHQWHGLQ6HFWLRQ

    *//DCUGF4GEQIPKVKQP5[UVGOU

    *//DCUGF4GEQIPKVKQP*CTFYCTG

    'XH WR WKHLU HIIHFWLYHQHVV DQG HIILFLHQF\ IRU XVHULQGHSHQGHQW UHFRJQLWLRQ +00V DUHZLGHO\XVHGLQDSSOLFDWLRQVVXFKDVVSHHFKUHFRJQLWLRQOLSUHDGLQJDQGJHVWXUHUHFRJQLWLRQ)LJXUH VKRZVWKHEDVLFVWUXFWXUHRI+00EDVHGUHFRJQLWLRQKDUGZDUH

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    3/12

    #8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU

    )LJ)ORZFKDUWRIRXWSXWSUREDELOLW\FRPSXWDWLRQ

    ORJ

    7W1MRE

    3

    S

    MSWSMSMWM dddd

    PVZ2

    ZKHUHZMVMSDQGPMSDUHWKHIDFWRUVRIWKH*DXVVLDQSUREDELOLW\GHQVLW\IXQFWLRQ

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    4/12

    8.5+

    )LJ)ORZFKDUWRIRXWSXWSUREDELOLW\FRPSXWDWLRQXVLQJ%633HWDO

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    5/12

    #8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU

    )LJ)ORZFKDUWRIRXWSXWSUREDELOLW\FRPSXWDWLRQXVLQJ%)33)LJVDQGDUHLGHQWLFDOEXWLQDGLIIHUHQWQXPEHU/RRS&LQ)LJLVSDUWLDOO\H[SDQGHGLQ

    )LJDQGORJEM2

    WORJEM2

    WDQGORJEM2

    W0DUHFRPSXWHGVLPXOWDQHRXVO\ZLWK03(VLQ/RRS&ZKHUHPMSDQGVMSDUHIHGWRWKH03(VLQ/RRS$,QDGGLWLRQWRWKH0IUDPH SDUDOOHO FRPSXWDWLRQV ORJEM2W0 ORJEM2W0 DQG ORJEM2W0 DUHDOVRFRPSXWHGZLWKWKHVDPH03(V,QWKLVGRXEOH0SDUDOOHOFRPSXWDWLRQWKHVDPH

    +00SDUDPHWHUVPMSDQGVMSDUHXVHGWZLFHEHFDXVHWKHSDUDPHWHUVDUHLQGHSHQGHQWRIW,QDGGLWLRQWRWKH0SDUDOOHOFRPSXWDWLRQV/RRS')LJLVGLYLGHGLQWR/RRSV'DQG')LJ7KHVDPHLQSXWIUDPHV2W2WDQG2W0DUHXVHGUHSHDWHGO\GXULQJ/RRS'EHFDXVHWKHLQSXWIUDPHVDUHLQGHSHQGHQWRIY

    YYM Y Y

    M M

    S

    S S PMSVMS

    3 d S

    7d WPD[

    9d YPD[

    \HV

    \HV

    \HV

    QR

    QR

    QR

    /RRS$

    /RRS%

    /RRS'

    YPD[d

    Y

    \HVQR

    1d M

    \HVQR

    YPD[ /RRS'

    WPD[ W WPD[WPD[ WPD[0Y YPD[ /

    /RRS&

    YPD[ YPD[ /

    ORJEM 2W ORJEM 2W

    GRXEOH0SDUDOOHOFRPSXWDWLRQZLWK03(V

    3( 3(03(

    ORJEM 2W0 ORJEM 2W0ORJEM 2W0

    ORJEM 2W0

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    6/12

    8.5+

    #8.5+CTEJKVGEVWTGHQTQWVRWVRTQDCDKNKV[EQORWVCVKQP2XU %)33 9/6, DUFKLWHFWXUH IRU RXWSXW SUREDELOLW\ FRPSXWDWLRQV LV VKRZQ LQ )LJ 7KHDUFKLWHFWXUHFRQVLVWVRIILYHUHJLVWHUDUUD\VDQG 03(V5HJ2VWRUHV0LQSXWIUDPHV2W

    2W2W05HJPDQG5HJVVWRUH+00SDUDPHWHUVPMSDQGVMSUHVSHFWLYHO\5HJZVWRUHV

    )LJ%)339/6,DUFKLWHFWXUH

    +00SDUDPHWHUZMDQGLQWHUPHGLDWHUHVXOWV5HJGVWRUHVFRPSXWHGRXWSXWSUREDELOLWLHVIRUD9LWHUELVFRUHU(DFK 3(L FRQVLVWVRI WZR DGGHUV DQG WZR PXOWLSOLHUV ZKLFK DUH XVHG IRU

    FRPSXWLQJ 3

    S MSSWMSM R

    PVZ

    )LJXUH VKRZV WKH IORZFKDUW RI RXWSXW SUREDELOLW\ FRPSXWDWLRQV XVLQJ WKH %)33DUFKLWHFWXUH 7KH FRPSXWDWLRQ VWDUWV E\ UHDGLQJ0 LQSXW IUDPHV IURP 5$0 DQG VWRULQJWKHPWR5HJ2LQ/RRS&ZKLFKDUH2W2W2W02W02W02W07KH

    +00SDUDPHWHUVRI YWK +00 DUH UHDG IURP 520 DQG VWRUHG LQ5HJP5HJVDQG5HJZZKLFKDUHPVDQGZ7KHYDOXHRIDOOUHJLVWHUVLQ5HJZLVVHWWRZ)RUWKHILUVWKDOIRIWKH VWRUHG LQSXW IUDPHV2W 2W DQG2W0 0 LQWHUPHGLDWH UHVXOWV DUH

    VLPXOWDQHRXVO\ FRPSXWHG ZLWK WKH VWRUHGPV DQG ZE\03(VZKHUH WKH +00SDUDPHWHUVDUHVKDUHGE\DOO 3(V$WWKHVDPHWLPHDQ+00SDUDPHWHU PMSRIYWK+00

    RWS

    2XWSXWSUREDELOLW\FRPSXWDWLRQFLUFXLW

    5HJ2

    5HJP 5HJV

    520PVZ

    5$02

    5HJG

    3

    5HJZ

    u u3(

    u u3(

    u u3(0

    u u3(0

    2W2W

    2W02W0

    2W02W0

    2W02W0

    0

    0

    0SDUDOOHOFRPSXWDWLRQ

    0 0

    00

    0

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    7/12

    #8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU

    LVUHDGIURP520DQGVWRUHGLQ5HJP7KHQ IRU WKH RWKHUKDOIRIWKHVWRUHGLQSXW IUDPHV2W02W0DQG2W00LQWHUPHGLDWHUHVXOWVDUHVLPXOWDQHRXVO\FRPSXWHGZLWK

    WKHVDPHPVDQGZE\03(V$WWKHVDPHWLPHDQ+00SDUDPHWHU VMSRIYWK

    +00LVUHDGIURP520DQGVWRUHGLQ5HJV,QWKLVGRXEOH0SDUDOOHOFRPSXWDWLRQWKH

    )LJ)ORZFKDUWRIFRPSXWDWLRQVXVLQJWKH%)33DUFKLWHFWXUH

    VDPH +00 SDUDPHWHUV PV DQGZ DUH XVHG WZLFH ,Q WKH QH[W GRXEOH0SDUDOOHOFRPSXWDWLRQ WKH VWRUHG +00 SDUDPHWHUV PMS DQG VMS DUH XVHG WZLFH0 RXWSXWSUREDELOLWLHVORJEM2WORJEM2WDQGORJ EM2W0RIYWK+00DUHREWDLQHGE\/RRS

    YY

    M Y YM M

    S

    S S

    PMSVMS

    3 d S

    7d WPD[

    9d YPD[

    \HV

    \HV

    \HV

    QR

    QR

    QR

    /RRS$

    /RRS%

    /RRS'

    YPD[ d Y

    \HVQR

    1d M

    \HV

    QR

    YPD[ /RRS'

    WPD[

    W WPD[WPD[ WPD[0Y YPD[ //RRS&

    YPD[ YPD[ /

    ORJEM 2W

    GRXEOH0SDUDOOHOFRPSXWDWLRQZLWK03(V

    3( 3(03(

    ORJEM 2W0

    ORJEM 2W0 ORJEM 2W0

    /RDG2W WR5HJ2 WWWWWW003 F\FOHV/RDGP V WR5HJP5HJVUHVSHFWLYHO\F\FOHV

    YYM S

    /RDGZM WR5HJZ F\FOH

    &RS\5HJZ WR5HJG

    /RDGPMSWR5HJP

    /RDGVMS WR5HJV

    ORJEM 2W

    ORJEM 2W0

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    8/12

    8.5+

    $ 7KH REWDLQHG UHVXOWV DUH WUDQVIHUHG IURP 5HJZ WR 5HJG IRU VWDUWLQJ WKH QH[W RXWSXWSUREDELOLW\ FRPSXWDWLRQ ORJEM2W ORJEM2W ORJEM2W0 RI YWK +00 7KH

    VWRUHGUHVXOWVDUHIHGWRWKH9LWHUELVFRUHU7KH01RXWSXWSUREDELOLWLHVRIYWK+00DUH

    REWDLQHGE\/RRS%01/RXWSXWSUREDELOLWLHVRI+00YYY/DUHREWDLQHGE\/RRS'ZLWKWKHVDPH0LQSXWIUDPHV2W2WDQGIUDPHV2W2WDQG2W0

    )LJ%6339/6,DUFKLWHFWXUH

    IUDPHV2W2WDQG2W07KH01/70RXWSXWSUREDELOLWLHVRI+00YY

    Y/DUHREWDLQHGE\/RRS&DQGILQDOO\WKH01/709/RXWSXWSUREDELOLWLHVRIDOO+00VDUHREWDLQHGE\/RRS'

    'XCNWCVKQP

    :HFRPSDUHGWKHSURSRVHG%)33ZLWK%633)LJ9/6,DUFKLWHFWXUH

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    9/12

    #8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU

    )LJXUH VKRZV WKHIORZFKDUW RI WKHFRPSXWDWLRQVRI %633 DUFKLWHFWXUH 7KHFRPSXWDWLRQ

    VWDUWVE\UHDGLQJDOO131+00SDUDPHWHUVRIYWK+00IURP520DQGVWRULQJWKHPWR5HJP5HJVDQG5HJZLQ/RRS')RULQSXWRWSWKHLQWHUPHGLDWHUHVXOWVDUHFRPSXWHGZLWK

    VWRUHG+00SDUDPHWHUVE\13(V1RXWSXWSUREDELOLWLHVORJE 2WORJE 2WORJE12WRIWKH+00DUHREWDLQHGE\/RRS$7KHREWDLQHGUHVXOWVDUHIHGWRD9LWHUELVFRUHU 17

    )LJ)ORZFKDUWRIFRPSXWDWLRQVXVLQJWKH%633DUFKLWHFWXUH

    5HJLVWHUVL]HELW

    %)33RXUV 30[R[P[V0[I%633 13[P13[V1[I

    7DEOH5HJLVWHUVL]H

    3URFHVVLQJWLPHF\FOHV

    %)33RXUV 9/^303/1 70%633 913137

    7DEOH3URFHVVLQJWLPHRXWSXWSUREDELOLWLHVRIYWK+00DUHREWDLQHGE\/RRS&ZLWKWKHVDPH+00SDUDPHWHUV

    7KH179RXWSXWSUREDELOLWLHVRIDOO+00VDUHREWDLQHGE\/RRS'7DEOH VKRZVWKHUHJLVWHUVL]HRI WKH%633DQG%)33DUFKLWHFWXUHVZKHUH[P[V[RDQG[I

    UHSUHVHQWWKHELWOHQJWKRIPMSVMSRWSDQGWKHRXWSXWRI3(UHVSHFWLYHO\13DQG0DUHWKH

    Y

    Y Y

    W W W

    S

    S S

    3 d S

    7d W

    9d Y

    \HV

    \HV

    \HV

    QR

    QR

    QR

    /RRS$

    /RRS&

    /RRS'

    ORJE 2W ORJE 2W

    1SDUDOOHOFRPSXWDWLRQZLWK1 3(V

    ORJE12W3( 3(13(

    /RDGRWS

    /RDGPMS DQGVMS RI+00YWR5HJP DQG5HJVM 1S 313 F\FOHV

    /RDGZM WR5HJZ M 11F\FOHV

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    10/12

    8.5+

    QXPEHURI+00VWDWHVWKHGLPHQVLRQRILQSXWIHDWXUHYHFWRUIUDPHDQGWKHQXPEHURILQSXWIUDPHVLQDEORFNUHVSHFWLYHO\7DEOHVKRZVWKHSURFHVVLQJWLPHIRUFRPSXWLQJRXWSXWSUREDELOLWLHVRI9+00VZLWKWKH

    %)33 DQG %633 DUFKLWHFWXUHV ZKHUH 7 DQG / DUH WKH QXPEHU RI LQSXW IUDPHV DQG WKHQXPEHU RI +00V ZKRVH RXWSXW SUREDELOLWLHV DUH FRPSXWHG ZLWK WKH VDPH LQSXW IUDPHVGXULQJ/RRS'RI)LJUHVSHFWLYHO\

    5HJLVWHUVL]HELW 3URFHVVLQJWLPHF\FOHV 3(V

    %)33RXUV

    %633

    7DEOH(YDOXDWLRQRIWKH%633DQG%)33SHUIRUPDQFH

    )LJ(YDOXDWLRQRIWKH%633DQG%)33SHUIRUPDQFHDQGWKHYDOXHRI 0RIWKH%)331379

    7DEOH VKRZVWKHUHJLVWHUVL]HWKHSURFHVVLQJWLPHDQGWKHQXPEHURI3(VIRUFRPSXWLQJRXWSXWSUREDELOLWLHVRI+00VZKHUHZHDVVXPHWKDW137[P[V[R[IDQG9WKHVDPHYDOXHVXVHGLQDUHFHQWFLUFXLWGHVLJQIRULVRODWHGZRUGUHFRJQLWLRQ

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    11/12

    #8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU

    UHDGLQJGDWDIURP520EHIRUHSDUDOOHOFRPSXWDWLRQV9/30/170WKDQWKH%633DUFKLWHFWXUHZKLFKKDV9131)LJVKRZVWKHSURFHVVLQJWLPHDQGWKHQXPEHURI3(VRIWKH%)33DQG%633DUFKLWHFWXUHV

    DQGWKHYDOXHRI0RIWKH%)33DUFKLWHFWXUH7KHSURFHVVLQJWLPHDQGWKHQXPEHURI 3(VRIWKH%)33DUFKLWHFWXUHDUHOHVVWKDQWKRVHRIWKH%633DUFKLWHFWXUHZKHQ0)LJ)URPDORJLFGHVLJQYLHZSRLQWWKHUHJLVWHUDUUD\VRIWKH%633DQG%)33DUFKLWHFWXUHVDUHGHVLJQHGZLWK)OLS)ORSVRURQFKLS PXOWLSRUW PHPRULHVRIGLIIHUHQWVL]HV'DWDSDWKVDUHGHVLJQHG ZLWK LGHQWLFDO 3(V EXW LQ D GLIIHUHQW QXPEHU 7KH FRQWURO SDWKV RI WKHVHDUFKLWHFWXUHVDUHGHVLJQHGDVVKRZQLQWKHIORZFKDUWV)LJVDQG7KHGDWDSDWKGHOD\LVWKHVDPHIRUERWKWKH%633DQG%)33GHVLJQVHTXDOWRWKHGHOD\WLPHRIRQH 3(7KHGHOD\WLPHVRIFRQWUROSDWKVGLIIHUEHWZHHQWKHWZREXWWKHFRQWUROSDWKGHOD\LVVPDOOFRPSDUHGZLWKWKHGDWDSDWKGHOD\

    %QPENWUKQPU:HSUHVHQWHG%)33IRURXWSXWSUREDELOLW\FRPSXWDWLRQVDQGSUHVHQWHGDQDSSURSULDWH9/6,DUFKLWHFWXUH IRULWVLPSOHPHQWDWLRQ %)33 SHUIRUPVDULWKPHWLF RSHUDWLRQV WR ORFDOO\VWRUHGLQSXW IUDPHV DQG RXWSXW SUREDELOLW\ FRPSXWDWLRQV IRU PXOWLSOH IUDPHV DUH FDUULHG RXWVLPXOWDQHRXVO\&RPSDUHGZLWKWKHFRQYHQWLRQDO%633DUFKLWHFWXUHZKHQWKHQXPEHURI+00VWDWHVLV ODUJHHQRXJKIRUDFFXUDWHUHFRJQLWLRQWKH%)33DUFKLWHFWXUHUHTXLUHVIHZHUUHJLVWHUV DQG3(V DQG OHVV SURFHVVLQJ WLPH ,Q WHUPV RI WKH 9/6, DUFKLWHFWXUH D IDVW DQGPHPRU\ HIILFLHQW 9/6, DUFKLWHFWXUH IRU RXWSXW SUREDELOLW\ FRPSXWDWLRQV RI +00EDVHGUHFRJQLWLRQ V\VWHPV KDV EHHQ SUHVHQWHG $ ORJLF GHVLJQ D 9LWHUEL VFRUHU IRU WKH %)33DUFKLWHFWXUHDQGDUHFRQILJXUDEOHDUFKLWHFWXUHIRUERWKWKH%633DQG%)33DUFKLWHFWXUHVDUHRXUIXWXUHZRUNV

    4GHGTGPEGU

    %0DWKHZ$'DYLV=)DQJD3HUFHSWLRQ&RSURFHVVRUVIRU(PEHGGHG6\VWHPV3URFRI:RUNVKRSRQ(PEHGGHG6\VWHPVIRU5HDO7LPH0XOWLPHGLD(67,0HGLDSS

    %0DWKHZ$'DYLV=)DQJE$/RZ3RZHU$FFHOHUDWRUIRUWKH63+,1;6SHHFK5HFRJQLWLRQ 6\VWHP3URFRI ,QWO&RQIRQ&RPSLOHUV $UFKLWHFWXUH DQG 6\QWKHVLVIRU(PEHGGHG6\VWHPVSS

    6

  • 8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems

    12/12

    8.5+

    ;+XDQJ)$OOHYD+:+RQ0