intech-a vlsi architecture for output probability computations of hmm based recognition systems
TRANSCRIPT
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
1/12
#8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU
:
#8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF
4GEQIPKVKQP5[UVGOU
.D]XKLUR1DNDPXUD0DVDWRVKL
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
2/12
8.5+
)LJ%DVLFVWUXFWXUHRI+00EDVHGUHFRJQLWLRQKDUGZDUH6HFWLRQ %)33 DQG %)33EDVHG 9/6, DUFKLWHFWXUH DUH LQWURGXFHG LQ 6HFWLRQ WKHHYDOXDWLRQRIWKH%)33DUFKLWHFWXUHLVGHVFULEHGLQ6HFWLRQDQGFRQFOXVLRQVDUHSUHVHQWHGLQ6HFWLRQ
*//DCUGF4GEQIPKVKQP5[UVGOU
*//DCUGF4GEQIPKVKQP*CTFYCTG
'XH WR WKHLU HIIHFWLYHQHVV DQG HIILFLHQF\ IRU XVHULQGHSHQGHQW UHFRJQLWLRQ +00V DUHZLGHO\XVHGLQDSSOLFDWLRQVVXFKDVVSHHFKUHFRJQLWLRQOLSUHDGLQJDQGJHVWXUHUHFRJQLWLRQ)LJXUH VKRZVWKHEDVLFVWUXFWXUHRI+00EDVHGUHFRJQLWLRQKDUGZDUH
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
3/12
#8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU
)LJ)ORZFKDUWRIRXWSXWSUREDELOLW\FRPSXWDWLRQ
ORJ
7W1MRE
3
S
MSWSMSMWM dddd
PVZ2
ZKHUHZMVMSDQGPMSDUHWKHIDFWRUVRIWKH*DXVVLDQSUREDELOLW\GHQVLW\IXQFWLRQ
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
4/12
8.5+
)LJ)ORZFKDUWRIRXWSXWSUREDELOLW\FRPSXWDWLRQXVLQJ%633HWDO
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
5/12
#8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU
)LJ)ORZFKDUWRIRXWSXWSUREDELOLW\FRPSXWDWLRQXVLQJ%)33)LJVDQGDUHLGHQWLFDOEXWLQDGLIIHUHQWQXPEHU/RRS&LQ)LJLVSDUWLDOO\H[SDQGHGLQ
)LJDQGORJEM2
WORJEM2
WDQGORJEM2
W0DUHFRPSXWHGVLPXOWDQHRXVO\ZLWK03(VLQ/RRS&ZKHUHPMSDQGVMSDUHIHGWRWKH03(VLQ/RRS$,QDGGLWLRQWRWKH0IUDPH SDUDOOHO FRPSXWDWLRQV ORJEM2W0 ORJEM2W0 DQG ORJEM2W0 DUHDOVRFRPSXWHGZLWKWKHVDPH03(V,QWKLVGRXEOH0SDUDOOHOFRPSXWDWLRQWKHVDPH
+00SDUDPHWHUVPMSDQGVMSDUHXVHGWZLFHEHFDXVHWKHSDUDPHWHUVDUHLQGHSHQGHQWRIW,QDGGLWLRQWRWKH0SDUDOOHOFRPSXWDWLRQV/RRS')LJLVGLYLGHGLQWR/RRSV'DQG')LJ7KHVDPHLQSXWIUDPHV2W2WDQG2W0DUHXVHGUHSHDWHGO\GXULQJ/RRS'EHFDXVHWKHLQSXWIUDPHVDUHLQGHSHQGHQWRIY
YYM Y Y
M M
S
S S PMSVMS
3 d S
7d WPD[
9d YPD[
\HV
\HV
\HV
QR
QR
QR
/RRS$
/RRS%
/RRS'
YPD[d
Y
\HVQR
1d M
\HVQR
YPD[ /RRS'
WPD[ W WPD[WPD[ WPD[0Y YPD[ /
/RRS&
YPD[ YPD[ /
ORJEM 2W ORJEM 2W
GRXEOH0SDUDOOHOFRPSXWDWLRQZLWK03(V
3( 3(03(
ORJEM 2W0 ORJEM 2W0ORJEM 2W0
ORJEM 2W0
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
6/12
8.5+
#8.5+CTEJKVGEVWTGHQTQWVRWVRTQDCDKNKV[EQORWVCVKQP2XU %)33 9/6, DUFKLWHFWXUH IRU RXWSXW SUREDELOLW\ FRPSXWDWLRQV LV VKRZQ LQ )LJ 7KHDUFKLWHFWXUHFRQVLVWVRIILYHUHJLVWHUDUUD\VDQG 03(V5HJ2VWRUHV0LQSXWIUDPHV2W
2W2W05HJPDQG5HJVVWRUH+00SDUDPHWHUVPMSDQGVMSUHVSHFWLYHO\5HJZVWRUHV
)LJ%)339/6,DUFKLWHFWXUH
+00SDUDPHWHUZMDQGLQWHUPHGLDWHUHVXOWV5HJGVWRUHVFRPSXWHGRXWSXWSUREDELOLWLHVIRUD9LWHUELVFRUHU(DFK 3(L FRQVLVWVRI WZR DGGHUV DQG WZR PXOWLSOLHUV ZKLFK DUH XVHG IRU
FRPSXWLQJ 3
S MSSWMSM R
PVZ
)LJXUH VKRZV WKH IORZFKDUW RI RXWSXW SUREDELOLW\ FRPSXWDWLRQV XVLQJ WKH %)33DUFKLWHFWXUH 7KH FRPSXWDWLRQ VWDUWV E\ UHDGLQJ0 LQSXW IUDPHV IURP 5$0 DQG VWRULQJWKHPWR5HJ2LQ/RRS&ZKLFKDUH2W2W2W02W02W02W07KH
+00SDUDPHWHUVRI YWK +00 DUH UHDG IURP 520 DQG VWRUHG LQ5HJP5HJVDQG5HJZZKLFKDUHPVDQGZ7KHYDOXHRIDOOUHJLVWHUVLQ5HJZLVVHWWRZ)RUWKHILUVWKDOIRIWKH VWRUHG LQSXW IUDPHV2W 2W DQG2W0 0 LQWHUPHGLDWH UHVXOWV DUH
VLPXOWDQHRXVO\ FRPSXWHG ZLWK WKH VWRUHGPV DQG ZE\03(VZKHUH WKH +00SDUDPHWHUVDUHVKDUHGE\DOO 3(V$WWKHVDPHWLPHDQ+00SDUDPHWHU PMSRIYWK+00
RWS
2XWSXWSUREDELOLW\FRPSXWDWLRQFLUFXLW
5HJ2
5HJP 5HJV
520PVZ
5$02
5HJG
3
5HJZ
u u3(
u u3(
u u3(0
u u3(0
2W2W
2W02W0
2W02W0
2W02W0
0
0
0SDUDOOHOFRPSXWDWLRQ
0 0
00
0
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
7/12
#8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU
LVUHDGIURP520DQGVWRUHGLQ5HJP7KHQ IRU WKH RWKHUKDOIRIWKHVWRUHGLQSXW IUDPHV2W02W0DQG2W00LQWHUPHGLDWHUHVXOWVDUHVLPXOWDQHRXVO\FRPSXWHGZLWK
WKHVDPHPVDQGZE\03(V$WWKHVDPHWLPHDQ+00SDUDPHWHU VMSRIYWK
+00LVUHDGIURP520DQGVWRUHGLQ5HJV,QWKLVGRXEOH0SDUDOOHOFRPSXWDWLRQWKH
)LJ)ORZFKDUWRIFRPSXWDWLRQVXVLQJWKH%)33DUFKLWHFWXUH
VDPH +00 SDUDPHWHUV PV DQGZ DUH XVHG WZLFH ,Q WKH QH[W GRXEOH0SDUDOOHOFRPSXWDWLRQ WKH VWRUHG +00 SDUDPHWHUV PMS DQG VMS DUH XVHG WZLFH0 RXWSXWSUREDELOLWLHVORJEM2WORJEM2WDQGORJ EM2W0RIYWK+00DUHREWDLQHGE\/RRS
YY
M Y YM M
S
S S
PMSVMS
3 d S
7d WPD[
9d YPD[
\HV
\HV
\HV
QR
QR
QR
/RRS$
/RRS%
/RRS'
YPD[ d Y
\HVQR
1d M
\HV
QR
YPD[ /RRS'
WPD[
W WPD[WPD[ WPD[0Y YPD[ //RRS&
YPD[ YPD[ /
ORJEM 2W
GRXEOH0SDUDOOHOFRPSXWDWLRQZLWK03(V
3( 3(03(
ORJEM 2W0
ORJEM 2W0 ORJEM 2W0
/RDG2W WR5HJ2 WWWWWW003 F\FOHV/RDGP V WR5HJP5HJVUHVSHFWLYHO\F\FOHV
YYM S
/RDGZM WR5HJZ F\FOH
&RS\5HJZ WR5HJG
/RDGPMSWR5HJP
/RDGVMS WR5HJV
ORJEM 2W
ORJEM 2W0
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
8/12
8.5+
$ 7KH REWDLQHG UHVXOWV DUH WUDQVIHUHG IURP 5HJZ WR 5HJG IRU VWDUWLQJ WKH QH[W RXWSXWSUREDELOLW\ FRPSXWDWLRQ ORJEM2W ORJEM2W ORJEM2W0 RI YWK +00 7KH
VWRUHGUHVXOWVDUHIHGWRWKH9LWHUELVFRUHU7KH01RXWSXWSUREDELOLWLHVRIYWK+00DUH
REWDLQHGE\/RRS%01/RXWSXWSUREDELOLWLHVRI+00YYY/DUHREWDLQHGE\/RRS'ZLWKWKHVDPH0LQSXWIUDPHV2W2WDQGIUDPHV2W2WDQG2W0
)LJ%6339/6,DUFKLWHFWXUH
IUDPHV2W2WDQG2W07KH01/70RXWSXWSUREDELOLWLHVRI+00YY
Y/DUHREWDLQHGE\/RRS&DQGILQDOO\WKH01/709/RXWSXWSUREDELOLWLHVRIDOO+00VDUHREWDLQHGE\/RRS'
'XCNWCVKQP
:HFRPSDUHGWKHSURSRVHG%)33ZLWK%633)LJ9/6,DUFKLWHFWXUH
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
9/12
#8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU
)LJXUH VKRZV WKHIORZFKDUW RI WKHFRPSXWDWLRQVRI %633 DUFKLWHFWXUH 7KHFRPSXWDWLRQ
VWDUWVE\UHDGLQJDOO131+00SDUDPHWHUVRIYWK+00IURP520DQGVWRULQJWKHPWR5HJP5HJVDQG5HJZLQ/RRS')RULQSXWRWSWKHLQWHUPHGLDWHUHVXOWVDUHFRPSXWHGZLWK
VWRUHG+00SDUDPHWHUVE\13(V1RXWSXWSUREDELOLWLHVORJE 2WORJE 2WORJE12WRIWKH+00DUHREWDLQHGE\/RRS$7KHREWDLQHGUHVXOWVDUHIHGWRD9LWHUELVFRUHU 17
)LJ)ORZFKDUWRIFRPSXWDWLRQVXVLQJWKH%633DUFKLWHFWXUH
5HJLVWHUVL]HELW
%)33RXUV 30[R[P[V0[I%633 13[P13[V1[I
7DEOH5HJLVWHUVL]H
3URFHVVLQJWLPHF\FOHV
%)33RXUV 9/^303/1 70%633 913137
7DEOH3URFHVVLQJWLPHRXWSXWSUREDELOLWLHVRIYWK+00DUHREWDLQHGE\/RRS&ZLWKWKHVDPH+00SDUDPHWHUV
7KH179RXWSXWSUREDELOLWLHVRIDOO+00VDUHREWDLQHGE\/RRS'7DEOH VKRZVWKHUHJLVWHUVL]HRI WKH%633DQG%)33DUFKLWHFWXUHVZKHUH[P[V[RDQG[I
UHSUHVHQWWKHELWOHQJWKRIPMSVMSRWSDQGWKHRXWSXWRI3(UHVSHFWLYHO\13DQG0DUHWKH
Y
Y Y
W W W
S
S S
3 d S
7d W
9d Y
\HV
\HV
\HV
QR
QR
QR
/RRS$
/RRS&
/RRS'
ORJE 2W ORJE 2W
1SDUDOOHOFRPSXWDWLRQZLWK1 3(V
ORJE12W3( 3(13(
/RDGRWS
/RDGPMS DQGVMS RI+00YWR5HJP DQG5HJVM 1S 313 F\FOHV
/RDGZM WR5HJZ M 11F\FOHV
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
10/12
8.5+
QXPEHURI+00VWDWHVWKHGLPHQVLRQRILQSXWIHDWXUHYHFWRUIUDPHDQGWKHQXPEHURILQSXWIUDPHVLQDEORFNUHVSHFWLYHO\7DEOHVKRZVWKHSURFHVVLQJWLPHIRUFRPSXWLQJRXWSXWSUREDELOLWLHVRI9+00VZLWKWKH
%)33 DQG %633 DUFKLWHFWXUHV ZKHUH 7 DQG / DUH WKH QXPEHU RI LQSXW IUDPHV DQG WKHQXPEHU RI +00V ZKRVH RXWSXW SUREDELOLWLHV DUH FRPSXWHG ZLWK WKH VDPH LQSXW IUDPHVGXULQJ/RRS'RI)LJUHVSHFWLYHO\
5HJLVWHUVL]HELW 3URFHVVLQJWLPHF\FOHV 3(V
%)33RXUV
%633
7DEOH(YDOXDWLRQRIWKH%633DQG%)33SHUIRUPDQFH
)LJ(YDOXDWLRQRIWKH%633DQG%)33SHUIRUPDQFHDQGWKHYDOXHRI 0RIWKH%)331379
7DEOH VKRZVWKHUHJLVWHUVL]HWKHSURFHVVLQJWLPHDQGWKHQXPEHURI3(VIRUFRPSXWLQJRXWSXWSUREDELOLWLHVRI+00VZKHUHZHDVVXPHWKDW137[P[V[R[IDQG9WKHVDPHYDOXHVXVHGLQDUHFHQWFLUFXLWGHVLJQIRULVRODWHGZRUGUHFRJQLWLRQ
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
11/12
#8.5+#TEJKVGEVWTGHQT1WVRWV2TQDCDKNKV[%QORWVCVKQPUQH*//DCUGF4GEQIPKVKQP5[UVGOU
UHDGLQJGDWDIURP520EHIRUHSDUDOOHOFRPSXWDWLRQV9/30/170WKDQWKH%633DUFKLWHFWXUHZKLFKKDV9131)LJVKRZVWKHSURFHVVLQJWLPHDQGWKHQXPEHURI3(VRIWKH%)33DQG%633DUFKLWHFWXUHV
DQGWKHYDOXHRI0RIWKH%)33DUFKLWHFWXUH7KHSURFHVVLQJWLPHDQGWKHQXPEHURI 3(VRIWKH%)33DUFKLWHFWXUHDUHOHVVWKDQWKRVHRIWKH%633DUFKLWHFWXUHZKHQ0)LJ)URPDORJLFGHVLJQYLHZSRLQWWKHUHJLVWHUDUUD\VRIWKH%633DQG%)33DUFKLWHFWXUHVDUHGHVLJQHGZLWK)OLS)ORSVRURQFKLS PXOWLSRUW PHPRULHVRIGLIIHUHQWVL]HV'DWDSDWKVDUHGHVLJQHG ZLWK LGHQWLFDO 3(V EXW LQ D GLIIHUHQW QXPEHU 7KH FRQWURO SDWKV RI WKHVHDUFKLWHFWXUHVDUHGHVLJQHGDVVKRZQLQWKHIORZFKDUWV)LJVDQG7KHGDWDSDWKGHOD\LVWKHVDPHIRUERWKWKH%633DQG%)33GHVLJQVHTXDOWRWKHGHOD\WLPHRIRQH 3(7KHGHOD\WLPHVRIFRQWUROSDWKVGLIIHUEHWZHHQWKHWZREXWWKHFRQWUROSDWKGHOD\LVVPDOOFRPSDUHGZLWKWKHGDWDSDWKGHOD\
%QPENWUKQPU:HSUHVHQWHG%)33IRURXWSXWSUREDELOLW\FRPSXWDWLRQVDQGSUHVHQWHGDQDSSURSULDWH9/6,DUFKLWHFWXUH IRULWVLPSOHPHQWDWLRQ %)33 SHUIRUPVDULWKPHWLF RSHUDWLRQV WR ORFDOO\VWRUHGLQSXW IUDPHV DQG RXWSXW SUREDELOLW\ FRPSXWDWLRQV IRU PXOWLSOH IUDPHV DUH FDUULHG RXWVLPXOWDQHRXVO\&RPSDUHGZLWKWKHFRQYHQWLRQDO%633DUFKLWHFWXUHZKHQWKHQXPEHURI+00VWDWHVLV ODUJHHQRXJKIRUDFFXUDWHUHFRJQLWLRQWKH%)33DUFKLWHFWXUHUHTXLUHVIHZHUUHJLVWHUV DQG3(V DQG OHVV SURFHVVLQJ WLPH ,Q WHUPV RI WKH 9/6, DUFKLWHFWXUH D IDVW DQGPHPRU\ HIILFLHQW 9/6, DUFKLWHFWXUH IRU RXWSXW SUREDELOLW\ FRPSXWDWLRQV RI +00EDVHGUHFRJQLWLRQ V\VWHPV KDV EHHQ SUHVHQWHG $ ORJLF GHVLJQ D 9LWHUEL VFRUHU IRU WKH %)33DUFKLWHFWXUHDQGDUHFRQILJXUDEOHDUFKLWHFWXUHIRUERWKWKH%633DQG%)33DUFKLWHFWXUHVDUHRXUIXWXUHZRUNV
4GHGTGPEGU
%0DWKHZ$'DYLV=)DQJD3HUFHSWLRQ&RSURFHVVRUVIRU(PEHGGHG6\VWHPV3URFRI:RUNVKRSRQ(PEHGGHG6\VWHPVIRU5HDO7LPH0XOWLPHGLD(67,0HGLDSS
%0DWKHZ$'DYLV=)DQJE$/RZ3RZHU$FFHOHUDWRUIRUWKH63+,1;6SHHFK5HFRJQLWLRQ 6\VWHP3URFRI ,QWO&RQIRQ&RPSLOHUV $UFKLWHFWXUH DQG 6\QWKHVLVIRU(PEHGGHG6\VWHPVSS
6
-
8/2/2019 InTech-A Vlsi Architecture for Output Probability Computations of Hmm Based Recognition Systems
12/12
8.5+
;+XDQJ)$OOHYD+:+RQ0