tales & legends of low latency audio on android

28
6CNGU CPF .GIGPFU QH .QY .CVGPE[ #WFKQ QP #PFTQKF D[ 5VGHCPQ $QPGVVC 5GDCUVKCPQ )QVVCTFQ "OWUK:OCVEJ YYYOWUKZOCVEJEQO

Upload: rotxed

Post on 10-Dec-2014

455 views

Category:

Technology


0 download

DESCRIPTION

Slides for the Droidcon presentation that was held on 6th February by Stefano Bonetta and Sebastiano Gottardo

TRANSCRIPT

Page 1: Tales & Legends of Low Latency Audio on Android

6CNGU�CPF�.GIGPFU�QH�.QY�.CVGPE[�#WFKQ�QP�#PFTQKF

D[�5VGHCPQ�$QPGVVC���5GDCUVKCPQ�)QVVCTFQ"OWUK:OCVEJ

YYY�OWUKZOCVEJ�EQO

Page 2: Tales & Legends of Low Latency Audio on Android

$ERXW�PXVL;PDWFK䙘 ���PLOOLRQ�O\ULFV�FDWDORJXH�LQ�PRUH�WKDQ����GLVWLQFW�ODQJXDJHV

䙘 'DLO\�XSGDWHG�ZLWK�PRUH�WKDQ���PLOOLRQ�DUWLVWV�DQG�PRUH�WKDQ����PLOOLRQ�PXVLF�WUDFNV

䙘 &XUUHQWO\�PXVL;PDWFK�LV�WKH�RQO\�O\ULFV�SODWIRUP�DOORZHG�IRU�ZRUOGZLGH�OLFHQVLQJ�DQG�KDV�GHDOV�ZLWK�WRS�0XVLF�3XEOLVKHUV��:DUQHU�&KDSSHOO��8QLYHUVDO��%0*��(0,�3XEOLVKLQJ��6RQ\�$79��3HHU�0XVLF��

䙘 6\QFHG�O\ULFV�

Page 3: Tales & Legends of Low Latency Audio on Android

:RUN�ZLWK�XV

:H�DUH�KLULQJ�D�SDVVLRQDWH�$QGURLG�GHYHORSHU��

&RQWDFW�XV�RU�VHQG�\RXU�&9�DW

]LE\#PXVL[PDWFK�FRP

VHEDVWLDQR#PXVL[PDWFK�FRP

Page 4: Tales & Legends of Low Latency Audio on Android

$XGLR�(QJLQH

Ɣ D�ORW�RI�FKDUDFWHULVWLFV

Ɣ ZH�ZLOO�IRFXV�RQ�WKHVHD� /RZ�/DWHQF\��SOD\EDFN��IHHGEDFN�E� $3,�YLVLELOLW\F� $3,�IOH[LELOLW\

Page 5: Tales & Legends of Low Latency Audio on Android

$XGLR�/DWHQF\

Ɣ SOD\EDFN�ODWHQF\��WLPH�EHWZHHQ�WKH�RNC[�FRPPDQG�DQG�WKH�DXGLR�IHHGEDFN

Ɣ IHHGEDFN�ODWHQF\��VDPSOLQJ�WLPH���SOD\EDFN�ODWHQF\

Page 6: Tales & Legends of Low Latency Audio on Android

$3,�9LVLELOLW\��)OH[LELOLW\

Ɣ FDQ�,�DFFHVV�WR�WKH�DXGLR�EXIIHU��3&0�"Ɣ FDQ�,�HGLW�WKH�DXGLR�EXIIHU�EHIRUH�SOD\�LW"Ɣ FDQ�,�XVH�FRPSUHVVHG�VRXUFHV�DQG�VWLOO�DFFHVV�WKH�

DXGLR�EXIIHU"Ɣ FDQ�,�DSSO\�HIIHFWV�GLUHFWO\�WR�WKH�EXIIHU"Ɣ FDQ�,�JHW�LQIRUPDWLRQ�DERXW�WKH�ZDYHIRUP"�

Page 7: Tales & Legends of Low Latency Audio on Android

2Q�$QGURLG

Ɣ $XGLR7UDFN

Ɣ $XGLR5HFRUG

Ɣ $XGLR�(IIHFW

Page 8: Tales & Legends of Low Latency Audio on Android

([DPSOH��PLF�IHHGEDFN

Page 9: Tales & Legends of Low Latency Audio on Android

([DPSOH��PLF�IHHGEDFN

Page 10: Tales & Legends of Low Latency Audio on Android

6RPH�OLPLWDWLRQV

Ɣ $XGLR7UDFN�RQO\�ZRUNV�XVLQJ�3&0�GDWD�DV�VRXUFHƔ 1R�YLVLEOH�$3,V�WR�JHW�3&0�GDWD�IURP�FRPSUHVVHG�

VRXUFHVƔ /DWHQFLHV�DUH�GHYLFH�GHSHQGHQWƔ 6HWXS�LV���D�PHVV��$FWXDOO\�,WV�QRW�UHDOO\�FOHDU�KRZ�WR�

VHWXS�WKH�SLSHOLQHƔ HWF�

��

Page 11: Tales & Legends of Low Latency Audio on Android

8VH�FDVH��PXVL;PDWFK�6LQJ�$ORQJ

4GOQXG�UQPIŨU�XQECN�HTQO�[QWT�OWUKEŬ

��

Page 12: Tales & Legends of Low Latency Audio on Android

8VH�FDVH��PXVL;PDWFK�6LQJ�$ORQJ

Ɣ GHFRGH�FRPSUHVVHG�IRUPDW��03��

Ɣ DQDO\]H�WKH�DXGLR�EXIIHU

ż ))7��%30��':7��IHDWXUH�GHWHFWLRQ

Ɣ PDQLSXODWH�WKH�DXGLR�EXIIHU

ż 5HVDPSOLQJ��9RLFH�UHPRYDO

Ɣ ORZ�ODWHQF\�PLFURSKRQH�IHHGEDFN��DQDO\VLV

HYHU\WKLQJ���RQ�WKH�IO\���

Page 13: Tales & Legends of Low Latency Audio on Android

PXVL;PDWFK�6LQJ�$ORQJ��FRPSRQHQWV

��

Page 14: Tales & Legends of Low Latency Audio on Android

0DLQ�LVVXHV

�� REWDLQ�GHFHQW�ODWHQFLHV��HVSHFLDOO\�RQ�WKH�PLFURSKRQH�FLUFXLW�

�� GHFRGH�FRPSUHVVHG�IRUPDW�WR�3&0

�� HYHU\WKLQJ�LQ�UHDO�WLPH�

��

Page 15: Tales & Legends of Low Latency Audio on Android

7KH�/DWHQF\�,VVXHƔ 1R�GHGLFDWHG�&52�IRU�DXGLR�SURFHVVLQJ�RQ�$QGURLG�

GHYLFHV��Ɣ /RZ�ODWHQF\�SROLFLHV�H[LVW�DW�#WFKQ(NKPIGT�OHYHO��EXW�WKH\�

FDQ�EH�WULFNHG�E\�PDQXIDFWXUHUV�FRGHƔ 6RPHWKLQJ�LV�FKDQJLQJ��VWDUWLQJ�IURP�$QGURLG��������Ɣ #PFTQKF�%&&�QRZ�GHILQH�.QY�NCVGPE[�CWFKQ�FDSDELOLWLHV�

��������PV�GHOD\�

��

Page 16: Tales & Legends of Low Latency Audio on Android

˼6SHFLDO˽�&OLHQWV�#WFKQ(NKPIGT�VKRXOG�UHVHUYH�D�IDVW�WUDFN��ZKLFK�PHDQV�D�SDWFK�ZLWK�WKH�EHVW�ODWHQF\�IURP�VRXUFH�WR�VLQN��WR�WKH�IROORZLQJ�FOLHQWV�

Ɣ 2SHQ6/�(6Ɣ 6RXQG3RRO�Ɣ 7RQH*HQHUDWRU�

(YHU\WKLQJ�UHOLHV�RQ�$8',2B287387B)/$*B)$67��D�IODJ�WKDW�FDQ�EH�LJQRUHG�IURP�$XGLR)OLQJHU�

��

Page 17: Tales & Legends of Low Latency Audio on Android

��7HVWHG�6ROXWLRQV�� -DYD�QDLYH�� -1,�QDLYH�� -DYD�0XOWLWKUHDG�� 2SHQ6/�EDVLF�LPSOHPHQWDWLRQ�� 2SHQ6/�RSWLPL]HG�� 2SHQ6/�RSWLPL]HG�Y��� OLESG��EDVHG�RQ�2SHQ6/��� SDWFKILHOG��EDVHG�2SHQ6/��D�SURMHFW�E\�*RRJOH��

��

Page 18: Tales & Legends of Low Latency Audio on Android

+ROG�RQ��+RZ�WR�PHDVXUH�ODWHQF\"

6XJJHVWLRQ�-DFN��$XGLR�&RQQHFWLRQ�.LW

��

Page 19: Tales & Legends of Low Latency Audio on Android

5HVXOWV

��

Page 20: Tales & Legends of Low Latency Audio on Android

2XU�FKRLFH��OLESG��3XUH'DWD�Ɣ 3XUH'DWD��D�YLVXDO�SURJUDPPLQJ�

ODQJXDJH�IRU�DXGLR

Ɣ (YHULWKLQJ�LV�D�SDWFK�

Ɣ 3RUWLQJ�IRU�$QGURLG�KWWSV���JLWKXE�FRP�OLESG�SG�IRU�DQGURLG

��

Page 21: Tales & Legends of Low Latency Audio on Android

&RQYHUWLQJ�03��WR�3&0

䙘 03���WKH�PRVW�FRPPRQ�DXGLR�IRUPDW��LV�FRPSUHVVHG

䙘 ,Q�RUGHU�WR�EH�SURFHVVHG��LW�PXVW�EH�GH�FRPSUHVVHG�LQWR�UDZ�GDWD��FDOOHG�3&0��3XOVH�&RGH�0RGXODWLRQ�

��

Page 22: Tales & Legends of Low Latency Audio on Android

$YDLODEOH�DSSURDFKHV

䙘 /$0(��/$0(�$LQW�DQ�03��(QFRGHU�RGTJCRU�VJG�OQUV�EQOOQP�HTGG��UQNWVKQP

䙘 20;��2SHQ�0D[�$FFHOHUDWLRQ�VJG�KPPGT�OWNVKOGFKC�HTCOGYQTM�QH�#PFTQKF

䙘 -8&(��-XOHV�8WLOLW\�&ODVV�([WHQVLRQV�C�ETQUU�RNCVHQTO�OWNVK�RWTRQUG�% �NKDTCT[

��

Page 23: Tales & Legends of Low Latency Audio on Android

䙘 D�IUHH��/*3/��03��HQFRGLQJ�OLEUDU\䙘 WKH�GHFRGLQJ�SDUW�LV�GRQH�E\�ORINKD��W\SLFDOO\�FRPHV�

WRJHWKHU�ZLWK�/$0(�䙘 ZLGHO\�XVHG��PRUH�FKDQFHV�WR�ILQG�VRPHWKLQJ�RQ�

6WDFN2YHUIORZ����

��

Page 24: Tales & Legends of Low Latency Audio on Android

䙘 +LJK�TXDOLW\��FURVV�SODWIRUP��JHQHUDO�SXUSRVH�&���OLEUDU\䙘 2IIHUV�JUDSKLFV�UHQGHULQJ�FDSDELOLWLHV��WRJHWKHU�ZLWK�DXGLR�YLGHR�

SURFHVVLQJ䙘 8VHG�LQ�WRQV�RI�FRPPHUFLDO�VRIWZDUHV䙘 )RU�D�FRPSOHWH�OLVW�RI�IHDWXUHV��WDNH�D�ORRN�GRZQ�KHUH

JVVR���YYY�LWEG�EQO�HGCVWTGU

��

Page 25: Tales & Legends of Low Latency Audio on Android

䙘 $�VHW�RI�&���$3,V��VSHFLILFDOO\�GHVLJQHG�IRU�PRELOH�GHYLFHV��ZKLFK�GHILQHV�D�VWDQGDUG�IRU�VRIWZDUH�DQG�KDUGZDUH�FRGHFV

䙘 7KLV�VWDQGDUG�LV�XVHG�E\�6WDJHIULJKW��WKH�PXOWLPHGLD�IUDPHZRUN�EXQGOHG�RQ�$QGURLG

䙘 ([WUHPHO\�ORZ�OHYHO��DOPRVW�QR�H[DPSOHV�DQG�RU�SRLQWHUV�IRU�RXU�WDVN

KWWS���VRXUFH�DQGURLG�FRP�GHYLFHV�PHGLD�KWPO

��

Page 26: Tales & Legends of Low Latency Audio on Android

:KLFK�RQH�GLG�ZH�FKRRVH"

䙘 :H�FKRVH�/$0(��EHFDXVH�ZH�ZHUH�LQ�D�KXUU\䙘 /DWHU�RQ��ZH�JRW�D�ZRUNLQJ�20;�KDFN�LVK�

LPSOHPHQWDWLRQ䙘 SUHWW\�WPUVCDNG䙘 VWURQJO\�RNCVHQTO�FGRGPFGPV

䙘 :H�GLGQW�XVH�-8&(���-XVW�EHFDXVH�LW�ZDV�DOUHDG\�WRR�ODWH�ZKHQ�ZH�GLVFRYHUHG�LW�

��

Page 27: Tales & Legends of Low Latency Audio on Android

03��'HFRGLQJ�ZLWK�/$0(

.GVŨU�FQ�VJKU�

Page 28: Tales & Legends of Low Latency Audio on Android

:RUN�ZLWK�XV

:H�DUH�KLULQJ�D�SDVVLRQDWH�$QGURLG�GHYHORSHU��

&RQWDFW�XV�RU�VHQG�\RXU�&9�DW

]LE\#PXVL[PDWFK�FRP

VHEDVWLDQR#PXVL[PDWFK�FRP