shannon lab 1at&t – research traffic engineering with estimated traffic matrices matthew...

18
1 AT&T – Research Shannon Lab Shannon Lab Traffic Engineering Traffic Engineering with with Estimated Traffic Estimated Traffic Matrices Matrices Matthew Roughan www.research.att.com/~roughan Mikkel Thorup www.research.att.com/~mthorup Yin Zhang www.research.att.com/~yzhang

Upload: dominic-adams

Post on 28-Dec-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

1AT&T – Research

Shannon LabShannon Lab

Traffic Engineering withTraffic Engineering withEstimated Traffic Estimated Traffic MatricesMatrices

Matthew Roughan www.research.att.com/~roughan

Mikkel Thorup www.research.att.com/~mthorup

Yin Zhang www.research.att.com/~yzhang

Page 2: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Can we do IP route optimization?

A3: "Well, we don't know the topology, we don't know the traffic matrix, the routers don't automatically adapt the routes to the traffic, and we don't know how to optimize the routing configuration. But, other than that, we're all set!“

“A Northern New Jersey Research Lab”

Feldmann et al., 2000 Shaikh et al., 2002

Fortz et al., 2002 Zhang et al., 2003 Zhang et al., 2003

Page 3: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Problem

How well do all of these things work together?If we do TE based on estimated TMs, how well

do the results perform on the real TM?

Question 1Traffic matrices can be estimated from link dataHow important are estimation errors?Simple statistics don’t tell the whole story!

Question 2Route optimization assumes good input dataHow robust are different methods to input

errors?

Page 4: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Methodology

Need realistic testSimulations can produce anything we wantNeed realistic TMs and errors

Random errors quite different from systematicNeed realistic network

Use data from AT&T’s backboneTopology, and 80% TM from Cisco Netflow

Use existing techniques (as blackboxes)TM EstimationRoute optimization (example of TE)

Approachapply optimizer on estimated TMs test performance on actual TMs

Page 5: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Refresher: TM estimation

Have link traffic measurements (from SNMP)Want to know demands from source to destination

A

BC

Atx link measurements

traffic matrix

routing matrix

Page 6: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Methods of TM estimation

Gravity ModelDemands are proportional

Generalized Gravity ModelTake into account hot-potato routing

asymmetry

Tomo-gravity combines Internal (tomographic) link constraints: x=AtGeneralized gravity model

Other methodsNot tested here (MLE, and Bayesian

approaches)Hard to implement at large scale

TE requires at least router-router TM

Page 7: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

TM estimation results Average traffic + |Error|

Page 8: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Route Optimization

Route OptimizationChoosing route parameters that use the

network most efficientlyMeasure efficiency by maximum utilization

MethodsShortest path IGP weight optimization

OSPF/IS-ISChoose weights

Multi-commodity flow optimization Implementation using MPLSArbitrary splitting of trafficExplicit set of routes for each origin/destination pair

Page 9: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

1. Start with real TM: measured using netflow

2. Simulate link measurements: 3. Estimate TM:

Use gravity/tomogravity methods

4. Compute optimal routing: Use MPLS/OSPF methods

5. Apply routing matrix A on real TM

6. Compute

Atx t

)(ˆ xt)ˆ(ˆ tA

i

i

Cx

ittˆ

;ˆ max)n(utilizatiomax

Methodology: details

tAx ˆˆ

Page 10: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

OSPF + tomo-gravity good!Results

Page 11: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

MPLS not as goodResults

Page 12: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Compare to Average traffic + |Error|Results

Page 13: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Errors in TM: magnitude is not the key

Results

Page 14: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Other properties

Other utility functions Global Optimization

Can optimize OSPF weights for 24 (1 hour) TMs

Predictive modeWorks up to 7 days (at least)

Fast convergenceDon’t need as many iterations if speed is

important

Can design for limited no. of weight changesMuch of benefit from a few changes

Can design for failure scenariosWeights that work well for normal + failure

modes

Page 15: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Conclusion

Important to study TE and TM errors togetherSimple statistics of errors don’t indicate resultsBest optimizer doesn’t work best with input

errorsNote: even measured TMs are used predictively

TM Estimation and route optimization can work well togetherIGP weight optimizationRobust Close to optimumStable (predictive performance)

Page 16: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Acknowledgements

Data collectionFred True, Joel Gottlieb, Carsten Lund

TomogravityAlbert Greenberg and Nick Duffield

OSPF SimulationCarsten Lund, Nick Reingold

Page 17: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

TM estimation results

Average value + |Error|Relative mean error

Page 18: Shannon Lab 1AT&T – Research Traffic Engineering with Estimated Traffic Matrices Matthew Roughan roughan Mikkel Thorup mthorup

AT&T Labs – Research

Global optimization