evolution of facebook backbone(pdf)
TRANSCRIPT
Evolving The Backbone
Gaya NagarajanNetwork Engineering
1.28+ billion Monthly active users
Mar. 2014
600+ million Monthly active mobile users
Mar. 2014
200+ million Monthly active Instagram users
Mar. 2014
logical topology
BB BBDR PR
Internet
Datacenter Backbone Edge
MPLS Cloud
Cluster
…
Cluster
Protocols
ISISBGPRSVP-TEAuto-BW
•
•
•
•
Network Traffic
Machine to User
Machine to Machine
64961281601922242562883203523844164485125445761024150064
64
96
96
128
128
160
160
192
192
224
224
256
256
288
288
320
320
352
352
384
384
416
416
448
448
512
512
544
544
576
576
1024
1024
1500
1500
01020304050600
0
10
10
20
20
30
30
40
40
50
50
60
60
Packet Distribution at the Edge
Packet Distribution at the Edge
Packet Size
Packet Size
Traffic Volume %
Traffic Volume %
~810Byte~35% 64Byte
64961281601922242562883203523844164485125445761024150064
64
96
96
128
128
160
160
192
192
224
224
256
256
288
288
320
320
352
352
384
384
416
416
448
448
512
512
544
544
576
576
1024
1024
1500
1500
02040600
0
20
20
40
40
60
60
Packet Distribution at the Data Center
Packet Distribution at the Data Center
Packet Size
Packet Size
Traffic Volume %
Traffic Volume %
~300Byte~59% 64Byte
213
Challenges
Utilization
Capacity
Capacity Planning
Bin Packing
Time LSP Reserved BW
T=1 A <-> C 3G
A
B C
DE
Bin Packing
Time LSP Reserved BW
T=2 A <-> C 3GT=2 E <-> C 3G
A
B C
DE
Bin Packing
Time LSP Reserved BW
T=3 A <-> C 6GT=3 E <-> C 3G
A
B C
DE
Bin Packing
Time LSP Reserved BW
T=4 A <-> C 6GT=4 E <-> C 6G
A
B C
DE
Scheduling
AF4 AF2 BE
solutions
Network global view
Network Global View
CircuitDBAutomateAuditVisibility
•
•
•
•
Ready for Provisioning
Reserve Ports
Port Map Planning
Circuit Testing
AutomatedProvisioning
Configlet Generation
Automated Push to Routers
IP Allocation
Traffic manager
BackboneDatacenterDatacenter
Server
AppTM
Server
AppTM
Bulk TMController
Traffic Manager
Read Usage and Set Limits
Read Usage &Set Limits
Read Usage &Set Limits
Path computation element
OS
Path Computation Element
BackboneDatacenterDatacenter
Server
App
TMServer
App
TM
Bulk TMController
API
App Controller
QOS QOS
Dashboard
Visualization of the solution
Decision Eng
Data
Calendaring PeriodicDurable Demand
Use Cases
Importance of feedback
Utilization
Capacity
Before
Utilization
After
Allocation
Utilization
What more can we do?
Multi-layer PCEStandby TranspondersReconfigurable ROADM
•
•
•
1% Done