the new aqm kids on the blockinfocom2014.ieee-infocom.org/gi14-slides/gi14-s2-3.pdfproportion to the...

21
The New AQM Kids on the Block: An Experimental Evaluation of CoDel and PIE Naeem Khademi <naeemk@ifi.uio.no> David Ros <[email protected]> Michael Welzl <michawe@ifi.uio.no> 17th IEEE Global Internet Symposium – 2014 Toronto, ON, Canada N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 1 / 21

Upload: others

Post on 27-Sep-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

The New AQM Kids on the Block: AnExperimental Evaluation of CoDel and PIENaeem Khademi <[email protected]>David Ros <[email protected]>Michael Welzl <[email protected]>

17th IEEE Global Internet Symposium – 2014Toronto, ON, Canada

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 1 / 21

Page 2: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Outline

Outline

AQM

AQM mechanisms consideredCoDelPIEARED

Experimental Setup

A Basic Test

Parameter Sensitivity

Conclusions and Future Work

Q&A

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 2 / 21

Page 3: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

AQM

Active Queue Management (AQM)

I Problem: Standard loss-based TCP’s congestion control plusLarge unmanaged buffers in Internet routers, switches, devicedrivers,... (a.k.a Bufferbloat)

I Cause: Latency issues for interactive/multimedia applicationsI Solution: AQM tries to signal the onset of congestion by

(randomly?) dropping/marking packets

AQM GoalsI Maintain low average queue/latencyI Allow occasional packet burstsI Break synchronization among TCP flows

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 3 / 21

Page 4: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

AQM mechanisms considered

The New AQM Kids on the Block...I Two very recent proposals:

I (FQ_)CoDel (IETF 84)I PIE (IETF 85) mandatory in DOCSIS 3.1 CM

I Some older AQMs dating back to early 90’s/00’s (*RED, REM,BLUE, CHOKe,...)

I Designed to be better than RED, just like CoDel and PIEI Little academic literature available on CoDel and PIE

Literature (bold = peer-reviewed)CoDel PIE FQ_CoDel

Wired, sim [NJ12][GRT+13][WP12] [Whi13] [Whi13][Whi13]

Wired, real-life [GRT+13] X X XWireless (any) X X -

NOTE: [WP12] and [Whi13] are on DOCSIS 3.0 while [GRT+13] has tests withLow-Priority congestion control.

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 4 / 21

Page 5: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

AQM mechanisms considered

The New AQM Kids on the Block (cont.)

AQM Deployment StatusI (W)RED is available on plenty of HW but mostly "turned off"

Mentioned Reasons for Lack of DeploymentI Bad implementation (?)I Hard to tune RED params

I Sally Floyd’s ARED (2001 technical report, available in Linux)adaptively tunes RED params aiming for a certain target queuing=> with fixed BW maps to a "target delay"

I Target delay can be set in ARED, CoDel and PIE

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 5 / 21

Page 6: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

AQM mechanisms considered CoDel

The New AQM Kids on the Block (cont.)

CoDel – Controlling DelayI Tries to detect the standing queue by measuring minimum sojourn

delay (delaymin) over a fixed-duration interval (default 100 ms)I Uses timestampingI If delaymin > target for at least one interval , enters dropping mode

and a packet is dropped from the tail (deque)I Next dropping time: Dropping interval decreases in inverse

proportion to the square root of the number of drops since thedropping mode was entered

I Exits dropping mode if delaymin ≤ targetI No drop when queue is less than 1 MTU

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 6 / 21

Page 7: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

AQM mechanisms considered CoDel

The New AQM Kids on the Block (cont.)

CoDel AssumptionsI 100 ms is nominal RTT assumed typical on the Internet pathsI interval = 100 ms; assures protection of normal packet burstsI A small target standing queue (5% of nominal RTT) is tolerable for

achieving better link utilization

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 7 / 21

Page 8: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

AQM mechanisms considered PIE

The New AQM Kids on the Block (cont.)

PIE – Proportional Integral controller EnhancedI Lightweight as it uses delay estimation instead of timestampingI Uses a Proportional Integral (PI) controller designI Uses trend of latency (increasing or decreasing) over time to

determine the congestion levelI E [T ] as current estimated queuing delay during every tupdate, N as

current queue length and µ is the draining rate

E [T ] = N/µ

I Randomly drops on enque based on probability p

p = p + α ∗ (E [T ] − Ttarget ) + β ∗ (E [T ] − E [T ]old )

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 8 / 21

Page 9: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

AQM mechanisms considered ARED

The New AQM Kids on the Block (cont.)

ARED – Adaptive REDI Tries to solve RED’s main problem of parameter tuning to keep the

average queue length (N̄) around a desired target_queuingI target_queuing = (th_max + th_min)/2I Observes N̄ to make RED more/less aggressiveI Updates RED’s pmax adaptively (every 500 ms by default) using an

AIMD policyI Only useful in fixed-BW scenarios

(target_delay = target_queuing/BW )

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 9 / 21

Page 10: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Experimental Setup

Experimental SetupI Traffic: 60 sec (or 300 sec if RTT=500 ms) of TCP traffic by iperf, repeated for 10 runsI AQM iface: GSO TSO off, BQL=1514, txqueuelen=1000I TCP: Linux default with renoI Topology: Dumbbell with 4 sender-receiver pairs

Model Dell OptiPlex GX620CPU Intel(R) Pentium(R) 4 CPU 3.00 GHzRAM 1 GB PC2-4200 (533 MHz)

EthernetBroadcom NetXtreme BCM5751

RTL-8139 (AQM interface)RTL8111/8168B (Dummynet router)

Ethernet drivertg3

8139too (AQM interface)r8168 (Dummynet router)

OS kernelLinux 3.8.2 (FC14)

Linux 3.10.4 (AQM router) (FC16)

10 Mbps

100 Mbps

100 Mbps

100 Mbps

100 Mbps

100 Mbps

100 Mbps

A Q M

100 Mbps

100 Mbps

Bottleneck routerDummynet router

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 10 / 21

Page 11: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Experimental Setup

Experimental Setup (cont.)

I AQM parameters used unless otherwise noted.

CoDelinterval=100 mstarget=5 ms

PIEparameters in [pie].

PIE Parameter Default valuetupdate 30 msTtarget 20 msα 0.125β 1.25

AREDparameters in [FGS01].

ARED Parameter Default valueinterval 500 msα min(0.01, pmax/4)β 0.9

th_min 0.5 ∗ targetth_max 1.5 ∗ target

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 11 / 21

Page 12: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Experimental Setup

Experimental Setup (cont.)

I RTT is measured on per-packet basis using Synthetic PacketPairs (SPP) tool [spp]

I Gives a very precise distribution of perceived RTT on the pathI Goodput is measured per 5-sec intervals

I long-term throughput/goodput does not reflect AQM performanceover time (e.g. bursts of packet drops are not desired)

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 12 / 21

Page 13: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

A Basic Test

A Basic Test

Single TCP Flow (RTTbase=100 ms)

100 110 120 130 140 150 160 170 180 190 200 210 220 230 240

1 1 1 5 5 5 10 10 10 20 20 20 30 30 30

RT

T (

ms)

Target Delay (ms)

CoDel PIE ARED

(a) Per-packet RTT

3.5

4

4.5

5

5.5

6

6.5

7

7.5

8

8.5

9

9.5

10

1 1 1 5 5 5 10 10 10 20 20 20 30 30 30

Goo

dput

(M

bps)

Target Delay (ms)

CoDel PIE ARED

(b) Goodput

Per-packet RTT and goodput. Bottom and top of whisker-box plots show 10th and 90thpercentiles respectively.

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 13 / 21

Page 14: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

A Basic Test

A Basic Test (cont.)

I A similar trend canbe observed betweenCoDel and RED in adifferent test in[NJ12]

CoDel vs. RED from K. Nichols, “Controlling QueueDelay” [NJ12]

FTP traffic mix w/ and w/o web-browsing and CBRapplications and RTTs from 10∼500 ms.

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 14 / 21

Page 15: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Parameter Sensitivity

Parameter Sensitivity (cont.)

Target Delay

100 110 120 130 140 150 160 170 180 190 200 210 220 230 240 250

1 1 1 5 5 5 10 10 10 20 20 20 30 30 30

RT

T (

ms)

Target Delay (ms)

CoDel PIE ARED

(c) Light

100 110 120 130 140 150 160 170 180 190 200 210 220 230 240 250

1 1 1 5 5 5 10 10 10 20 20 20 30 30 30

RT

T (

ms)

Target Delay (ms)

CoDel PIE ARED

(d) Moderate

100 110 120 130 140 150 160 170 180 190 200 210 220 230 240 250

1 1 1 5 5 5 10 10 10 20 20 20 30 30 30

RT

T (

ms)

Target Delay (ms)

CoDel PIE ARED

(e) Heavy

Per-packet RTT. Light, moderate and heavy congestion scenarios (4 senders andRTTbase=100 ms).

Light, moderate and heavy congestion correspond to 4, 16 and 64 concurrent TCP flows

respectively.

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 15 / 21

Page 16: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Parameter Sensitivity

Parameter Sensitivity (cont.)

Target Delay

5.5

6

6.5

7

7.5

8

8.5

9

9.5

10

1 1 1 5 5 5 10 10 10 20 20 20 30 30 30

Goo

dput

(M

bps)

Target Delay (ms)

CoDel PIE ARED

(f) Light

8.5

9

9.5

10

1 1 1 5 5 5 10 10 10 20 20 20 30 30 30

Goo

dput

(M

bps)

Target Delay (ms)

CoDel PIE ARED

(g) Moderate

8.5

9

9.5

10

1 1 1 5 5 5 10 10 10 20 20 20 30 30 30

Goo

dput

(M

bps)

Target Delay (ms)

CoDel PIE ARED

(h) Heavy

Goodput. Light, Moderate and Heavy congestion scenarios (4 senders and RTTbase=100 ms).

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 16 / 21

Page 17: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Parameter Sensitivity

Parameter Sensitivity (cont.)

CoDel’s Dropping Mode Interval – Target Delay=5 ms

100

110

120

130

140

150

160

170

180

5 5 5 30 30 30 100 100 100

RT

T (

ms)

Interval (ms)

Light Moderate Heavy

(i) Per-packet RTT

8

8.5

9

9.5

10

5 5 5 30 30 30 100 100 100

Goo

dput

(M

bps)

Interval (ms)

Light Moderate Heavy

(j) Goodput

4 senders, RTTbase=100 ms.

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 17 / 21

Page 18: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Parameter Sensitivity

Parameter Sensitivity (cont.)

PIE’s t_update Interval – Target Delay=5 ms

100 110 120 130 140 150 160 170 180 190 200 210 220 230 240

5 5 5 30 30 30 100 100 100

RT

T (

ms)

Interval (ms)

Light Moderate Heavy

(k) Per-packet RTT

8

8.5

9

9.5

10

5 5 5 30 30 30 100 100 100

Goo

dput

(M

bps)

Interval (ms)

Light Moderate Heavy

(l) Goodput

4 senders, RTTbase=100 ms.

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 18 / 21

Page 19: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Conclusions and Future Work

Conclusions

I ARED: Only performed worse than CoDel or PIE with smallnumber of flows

I CoDel: Dropping mode interval can be reduced to lower the delaywithout degrading the goodput much

I PIE (as implemented in Linux): Long distribution tail for lowtarget delays

Future WorkI More realistic traffic types (here, only bulk TCP traffic) including

bursty trafficI Simulations for environment parameters that cannot be produced

with our testbed

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 19 / 21

Page 20: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Q&A

Bibliography[FGS01] Sally Floyd, Ramakrishna Gummadi, and Scott Shenker.

Adaptive RED: An Algorithm for Increasing the Robustness of RED’s Active Queue Management.Technical report, 2001.

[GRT+13] Y. Gong, D. Rossi, C. Testa, S. Valenti, and D. Taht.Fighting the Bufferbloat: On the Coexistence of AQM and Low Priority Congestion Control.2013.

[NJ12] Kathleen Nichols and Van Jacobson.Controlling Queue Delay.Queue, 10(5):20:20–20:34, May 2012.

[pie] PIE Linux code (Cisco).ftp://ftpeng.cisco.com/pie/linux_code/.

[spp] Synthetic Packet Pairs.http://caia.swin.edu.au/tools/spp/.

[Whi13] Greg White.A Simulation Study of CoDel, SFQ-CoDel and PIE in DOCSIS 3.0 Networks.Technical Report, CableLabs, April 2013.

[WP12] Greg White and Joey Padden.Preliminary Study of CoDel AQM in a DOCSIS Network.Technical Report, CableLabs, November 2012.

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 20 / 21

Page 21: The New AQM Kids on the Blockinfocom2014.ieee-infocom.org/GI14-slides/GI14-s2-3.pdfproportion to the square root of the number of drops since the dropping mode was entered I Exits

Q&A

Q&A

More on experimental results: N. Khademi, D. Ros, and M. Welzl,“The New AQM Kids on the Block: Much Ado About Nothing?”,Technical Report 434, Department of Informatics, University of Oslo,23 October 2013, available at http://urn.nb.no/URN:NBN:no-38868

N. Khademi, D. Ros, M. Welzl The New AQM Kids on the Block... April 28, 2014 21 / 21