datacenter design for high - north american network ... · datacenter design for high capacity web...
TRANSCRIPT
1
Datacenter Design for HighCapacity Web Cache and Streaming
Vijay Gill <[email protected]>
Chris Wright <[email protected]>
Overview
• Problem Space
• Streaming
• Caching
A Moment of Reflection
The irony is that, we subtly contribute to this by helpingto build network and organization infrastructure whichsupports a highly networked economy. We think we'redoing better because our salaries go up and up andup, when in fact, we spend more and more of ourincome at... amazon.com. translation: less moneynow than when I was flat broke.
-Faisal Jawdat
The Internets
BB BB
POPPOP
DataCenter
Complete life cycle in NetOps- Architect, design, implement, and operate
Design Criteria- Diversity of component, paths, logical units- No Single Point of Failure (SPOF)
Redundant capacity to support peak load- Routed topology- System review to ensure performance & survivability goals
Data Center Design PhilosophyData Center Design Philosophy
ATDN Map
OC192/STM64 (10 Gbps)
OC3/STM1 (155 Mbps)
Tokyo
America Online
Internet Operations
12100 Sunrise Valley Drive, Reston, VA 20191
Date:
AOL Transit Data Network
Revision:
Drawn:
March 10, 2004
1.2
Vikas Mehta
Architect:
AOL Proprietary and Confidential
Engineer:
Saö
Paulo
Brazil
London
Frankfurt
Los
Angeles
Atlanta
Vienna
DenverCincinnati
Houston
Kansas
City
Tampa Bay
ChicagoAlbany
CharlottePhoenix
Dallas
Newark
San
Jose
Seattle
Ashburn
Dusseldorf
Lux
Paris
Milan
Zurich
Honolulu
Dublin
Sunnyvale
Brussels
Amsterdam
New York
OC48/STM16 (2.5 Gbps)
OC12/STM4 (622 Mbps)
Traffic Topology
San Jose
Peering
Ashburn
Peering
<- - - - - - - - - - - 70 ms - - - - - - - - - - >
20 ms
Chicago
Peering
Data Centers
q u a c k i 2 - m c 2
iw g 1 - m c 2
iw g 2 - m c 2iw 4 -m c 2
iw 3 -m c 2
iw -m c 1 iw -m c 2
BI 4000
BI 4000q u a c k i 1 -m c 2
A re a 2 1 0 0
BI 8000
BI 8000
o p s -m c 2
o p s - m c 3
A re a 2 0 1 0
BI 8000
BI 8000
in fo 1 -m r 2
A re a 2 1 0 0
in fo 2 -m r 2
BI 8000
BI 8000
in fo - m c 1
A re a 1 0 0 0
in fo 2 - m c 1
A re a 3 1 0 0
BI 8000
BI 8000
in fo 1 - m r 3
in fo 2 -m r 3
A re a 4 1 0 0
BI 8000
BI 8000
in fo 1 -m r 4
in fo 2 -m r 4
BI 4000
BI 4000
A re a 2 0 3 0
p o d - m c 2
p o d 2 -m c 2
BI 8000
BI 8000
in fo 1 - m r 5
A re a 5 1 0 0
in fo 2 - m r 5
BI 8000
BI 8000
A re a 6 1 0 0
in fo 1 -m r 6
in fo 2 -m r 6
o s c a ri 1 - m c 3
o s c a ri 2 - m c 2
A re a 3 0 3 0
o s c a ri 1 a -m c 3
o s c a ri 2 a -m c 2
A re a 3 0 3 0
rib 1 - m c 1 rib 2 - m c 3
BI 8000 BI 8000
A re a 1 0 6 0
a ts i1 -m c 1 a ts i 2 - m c 1
A re a 1 0 5 0
BI 8000 BI 8000
FWS 4802 P
BI 8000
BI 8000
FWS 4802 P
12016
12016
FWS 4802 P
BI 4000 BI 4000
p o d - m c 3 p o d 2 -m c 3
A re a 3 0 0 0
BI 4000
p o d -m c 2
BI 4000
p o d 2 - m c 2
A re a 2 0 3 0
BI 4000
w a d s i1 - m c 2
A re a 2 0 4 0
w a d s i 2 -m r 4
BI 4000
A re a 3 0 1 0
NI 800 NI 800
te s ti 1 -m c 3 te s ti 2 - m c 3
BI 4000 BI 4000
A re a 2 0 2 0
n e w s i 1 -m c 2 n e w s i 2 -m c 2
A re a 1 0 4 0
fo ld r 1 - m c 1 fo ld r 2 - m c 1
12008 12008 12008 12008
fo ld r 1 - m c 2 fo ld r 2 -m c 2
A re a 2 1 0 0
in fo 1 - m r 2
in fo 2 -m r 2
BI 8000
BI 8000
A re a 0
T 640 T 640
D A R
A S 8 1 7 6
d a r1 - m tc d a r 2 - m tc
p o p 1 - rtc
12416
p o p 1 -rtc
12416
Manassas
AS 65220
IC
AS 65003
12016
12016
o p s 1 - g c 1
o p s 2 - g c 2
A re a 1 0 0
NI 400
NI 400
in fo 1 - g r5
in fo 2 - g r5
A re a 7 0 0
NI 400
NI 400
in fo 1 - g r6
in fo 2 - g r6
A re a 8 0 0
NI 400
NI 400
rib 1 - g c 1
rib 2 - g c 2
A re a 1 1 0
NI 400
NI 400
D A R
A S 1 0 5 9 3
d a r 1 - g tc d a r 2 -g tc
Gainesville
AS 65241
M 160 M 160
P O S ( A ll lin k s a re O C - 4 8
u n le s s o th e rw is e n o te d )
iw 1 - g c 1
iw 2 -g c 2
12012
12012
ic q i 1 - m c 2
ic q i 2 - m c 3
ic q i 2 - d r 4 rib 1 -d c 3 rib 2 - d c 4
A re a 3 7 0
q u a c k i1 -d r 2 q u a c k i 2 - d r2
A re a 2 6 0
o p s 1 -d c 2 o p s 2 - d c 5
A re a 2 7 0 / 5
p o d 5 - d r5 p o d 6 -d r 5
A re a 5 6 0
in fo 5 -d r 2 in fo 6 - d r 2
A re a 2 2 0
in fo 5 -d r 3 in fo 6 - d r3
A re a 3 3 0
in fo 5 - d r 4 in fo 6 - d r4
A re a 4 5 0
in fo 5 - d r1 in fo 6 - d r 1 in fo 5 - d r5 in fo 6 - d r 5
A re a 5 4 0 A re a 8 2 0
p o d 3 -d r 3 p o d 4 - d r3
b b 4 - d c 2 b b 5 - d c 5
NI 800 NI 800
FE
A re a 1 2 0A re a 3 2 0 / 4 1 5
b b 6 - d c 3
b b 7 - d c 4
p o d 2 - d r 2
p o d 1 - d r 2
in fo 6 - d r 6
in fo 5 - d r6
a ts i 2 -d c 4
a ts i 1 -d c 3
fo ld r 2 - d r 4
fo ld r 1 - d r3
o s c a ri 2 - d r4
o s c a ri 1 - d r3
iw g 1 - d c 2
iw g 2 -d c 3
D A R
A S 1 6 6 4d a r 1 - d tc d a r 2 - d tc
T 640 T 640
M 20
O L S
T u n n e ls
o ls -tu n n e l - d r 2
RemoteTunnels
(AS 65213 )
rtu n n e l 1 - d r3
rtu n n e l 2 - d r4
M 5
M 5
12008 12008
ic q i1 - d r 3
BI 8000 BI 8000 NI 400 NI 400 NI 400 NI 400 NI 400 NI 400 NI 800 NI 800 NI 800 NI 800 NI 800 NI 800 NI 800 NI 800 NI 400 NI 400
NI 400
NI 400
NI 800
NI 800
A re a 2 5 0
A re a 6 1 5
A re a 3 9 0
NI 400
NI 400
12008
12008
A re a 4 3 0
A re a 3 2 5
DULLES
AS 65210
FWS 4802 P
12016
12016
E th e rn e t (A ll lin k s a re G IG
u n le s s o th e rw is e n o te d )
ICAS 65003
12012
1241612416
12012
iw g 2 -r 8
iw 1 -r 4 iw 2 - r7
IC
AS 65003
fo ld r 2 - r1 0 fo ld r 1 -r 6
A re a 1 0 1 0 A re a 3 8 0
rib 1 - r 3 rib 2 -r 8
A re a 3 2 0
p o d 1 - r3 p o d 2 -r 8
NI 400 NI 400
A re a 3 6 0
in fo 1 - r 3 in fo 2 - r8
NI 800 NI 800
Remote
Tunnels
M 5
M 5
rtu n n e l 3 -r 3
rtu n n e l 4 -r 8
BI 4000 BI 4000
A re a 3 0 0
o p s 1 - r3 o p s 2 -r 8
OLSIAS 65203
OLSE
AS 65202
o ls i 3 - r3
o ls i 4 - r3
o ls e 3 - r 8
o ls e 4 - r3
NOC
OSPF AREA 310
n o c 1 -r 4 n o c 2 - r4
NI 400 NI 400
NI 400 NI 400
12008
12008
12008
12008
A re a 8 2 0
p o d 3 - r3 p o d 4 -r 8
NI 400 NI 400
A re a 8 6 0
in fo 3 - r 3 in fo 4 - r8
NI 800 NI 800
A re a 9 2 0
ta n d e m 1 -r 6 ta n d e m 2 - r9
RESTON
AS 65200
OC -3
OC -3
12012 12012
NI 400 NI 40012008 12008
iw g 1 - r 3
M 40 M 40
M 40
iw g 1 - g c 1
M 40
iw g 2 - g c 2
M 40M 40
M 40
M 40
12016 12016
12016
12016
This thing severely violated the Rule of Complexity. The Rule of Complexity states that if ananswer seems too complicated to be the right answer, it is the wrong answer. -Steve Cutchen
Data Centersg a r 1 - d r2
s a r 1 - d c 2
g a r 2 - d r5
s a r 2 - d c 2
w a r 1 - d r 2
w a r 2 - d r 5
d ia lm is c 1 -d r 5
d ia lm is c 2 - d r5
n s ln s 2 -d r 5
rrln s - d r2
A re a 0
A re a 0
A re a 0
A re a 0
B G P N eighbors :
IB G P - S w ing 1 / S w ing 2
E B G P - N one
Local interfaces are
passive
Local interfaces are
passive
B G P N eighbors :
IB G P - S w ing 1 / S w ing 2
E B G P - N one
S print
A S 4999
A S 6 5 2 1 6
S tre a m in g
N e tw o rk s
A re a 0
A S 6 5 0 1 0
O O B
iptfarm a -dr 1 -sw 0
iptfarm b - dr 2- sw 0
iptfarm c - dr 2- sw 0
iptfarm d - dr 3- sw 0
iptfarm e - dr 4- sw 0
iptfarm f - dr 5- sw 0
iptfarm g - dr 5- sw 0
iptfarm h - dr 6- sw 0
iptfarm i - dr 6- sw 0
7606
VLAN 3
VLAN 4
VLAN 3
VLAN 4
VLAN 3
VLAN 4
7606
7606
7606
VLAN 3
VLAN 4
VLAN 3
VLAN 4
VLAN 3
VLAN 4
VLAN 3
VLAN 4
VLAN 3
VLAN 4
VLAN 3
VLAN 4
7606
7606
7606
7606
7606
1 234567 89101112A B12x6x
8x2x
9x3x10x4x
11x5x
7x1x
Ethernet
A12x6x
8x2x
9x3x10x4x
11x5x
7x1xC
1 23456
7 89101112
A B12x6x
8x2x
9x3x10x4x
11x5x
7x1x
Ethernet
A12x6x
8x2x
9x3x10x4x
11x5x
7x1x
C
1 234567 89101112A B12x6x
8x2x
9x3x10x4x
11x5x
7x1x
Ethernet
A12x6x
8x2x
9x3x10x4x
11x5x
7x1xC
1 23456
7 89101112
A B12x6x
8x2x
9x3x10x4x
11x5x
7x1x
Ethernet
A12x6x
8x2x
9x3x10x4x
11x5x
7x1x
C
1 234567 89101112A B12x6x
8x2x
9x3x10x4x
11x5x
7x1x
Ethernet
A12x6x
8x2x
9x3x10x4x
11x5x
7x1x
C
dar 1-dtc dar 2-dtc
A re a 0
A S 1 1 6 3 1
P T N E
A re a 0
A S 6 5 2 1 0
IW
w c 3 - d r4
w c 4 - d r3
M 160
M 160
A S 6 5 2 1 1
We b
C a c h e
ATDN
12008 12008
w e b 1 - m c 2 w e b 2 - m c 2 te s te x t 1 - m c 3 te s te x t 2 - m c 3
A re a 3 0 2 0
w w w 3 - m c 2 w w w 4 -m c 2
A re a 2 0 0 0
m a ile 1 - m c 2 m a ile 2 -m c 2
A re a 2 6 5 0
n e tfin d - m c 2 n e tfin d 2 -m c 2
A re a 2 0 1 0
b d u -m c 1 b d u 2 -m c 1
A re a 1 0 4 0
o p s e - m c 1 o p s e 2 - m c 1
A re a 1 0 3 0
w w w -m c 1 w w w - m c 3
A re a 1 0 0 0
o s c a re 1 - m c 1 o s c a re 2 -m c 2 iw w w -m c 1 iw w w - m c 3
A re a 1 0 2 0 A re a 2 6 4 0
w a d s e 1 -m c 2 w a d s e 2 - m c 2
o w 1 - m c 1 o w 2 - m c 3
A re a 0
A S 6 5 2 1 5
O u ts id e
Wo rld
BGP Inform ation
DAR Peering IN :route -m ap AllowQuadZero , DenyAll
Perm its 0 .0 .0 .0Denys all others
DAR Peering OUT :route -m ap SendAggregates , SendAll , and SendDirects
Perm its aggregate routesPerm its specifics DAR (learned via iBGP )
Perm its directly connected routes
OW RR Peering :
Denys BGP routes to peersPerm its routes from peers
IGP Inform ation
OSPF :Area 0 Authentication
DefaultOriginate policy redistributes BGP derived / 0 into OSPF
BGP Inform ation
IBGP with OW’s
Redistributes directly connected
IGP Inform ation
Area 0 to OwsArea 0 between web routers
Local interfaces are passive
25 interfaces Active
** web 1 currently has AS
prepends turned on ?
M 160
BGP Inform ation
IBGP with OW’sIndividual “network” statem ents for
each local segm ent
Network statem ents for RIP learned routes
IGP Inform ation
Area 0 to Ows
No cross - connect between routersLocal interfaces are NOT passive
RIP is active ; no redistribution
Default route learned via OSPF asEX type 1
27 Interfaces Active
NI 400 NI 400
BGP Inform ation
IBGP with OW’sIndividual “network” statem ents for
each local segm ent
IGP Inform ation
Area 0 to OwsNo cross -connect between routers
Individual “network” statem ents foreach local segm ent
Local interfaces are NOT passive
Default route learned via OSPF as
EX type 1
14 Interfaces Active
12012 12012
BGP Inform ation
IBGP with OW’sRedistributes directly connected
IGP Inform ation
Area 0 to OwsArea 0 between m aile routersLocal interfaces are passive
Default route learned via OSPF asEX type 1
34 Interfaces Active
M 40 M 40 12012 12008
BGP Inform ation
IBGP with OW’sIndividual “network” statem ents for
each local segm ent
IGP Inform ation
Area 0 to Ows
No cross - connect between routersIndividual “network” statem ents foreach local segm ent
Local interfaces are NOT passive
Default route learned via OSPF as
EX type 1
8 Interfaces Active
BGP Inform ation
IBGP with OW’sIndividual “network” statem ents foreach local segm ent
IGP Inform ation
Area 0 to OwsNo cross - connect between routers
Individual “network” statem ents foreach local segm entLocal interfaces are NOT passive
Default route learned via OSPF asEX type 1
2 Interfaces Active
12008 12008 12008 12012
BGP Inform ation
IBGP with OW’sIndividual “network” statem ents for
each local segm ent
IGP Inform ation
Area 0 to OwsNo cross - connect between routers
Individual “network” statem ents foreach local segm ent
Local interfaces are NOT passive
Default route learned via OSPF as
EX type 1
8 Interfaces Active
12016
BGP Inform ation
IBGP with OW’sIndividual “network” statem ents for
each local segm entIBGP routes sent to OW’s via “sendcom m unity” route - m ap ; not
in use
IGP Inform ation
Area 0 to Ows
No cross -connect between routersIndividual “network” statem ents for
each local segm entLocal interfaces are NOT passive
Default route learned via OSPF asEX type 1
66 Interfaces Active
12016 M 160 M 160
BGP Inform ation
IBGP with OW’sLocal segm ents are distributed inAggregates sent are
205 .188 . 153 .0 /24 and 205 .188 . 179 .0 /24
IGP Inform ation
Area 0 to Ows
Two cross - connect linksLocal interfaces are passive
redistributes Static and RIP ; approxim ately 1000 Static routes ,
1 RIP
Default route learned via OSPF as
EX type 1
12012 12012
BGP Inform ation
IBGP with OW’sIndividual “network” statem ents foreach local segm ent
IGP Inform ation
Area 0 to OwsIndividual “network” statem ents for
each local segm entLocal interfaces are NOT passive
Default route learned via OSPF asEX type 1
9 Interfaces Active
BGP Inform ation
IBGP with OW’sIndividual “network” statem ents foreach local segm ent
IGP Inform ation
Area 0 to OwsNo cross - connect between routers
Individual “network” statem ents foreach local segm ent
Local interfaces are NOT passive
Default route learned via OSPF as
EX type 1
5 Interfaces Active
12012 12012
OC - 48
M 160
A re a 1 0 6 0A re a 1 0 8 0
C / C is in area 0 C/ C is in area 0
A re a 1 0 1 0
BGP Inform ation
IBGP with OW’s
Individual “network” statem ents foreach local segm ent
IGP Inform ation
Area 0 to OwsNo cross -connect between routers
Individual “network” statem ents foreach local segm entLocal interfaces are NOT passive
Default route learned via OSPF asEX type 1
3 Interfaces Active
12012
12012
d m z - m c 1
d m z - m c 2
c s e rv e 1 -m c 3 c s e rv e 2 - m c 3
BGP Inform ation
IBGP with OW’sRedistributes directly connected
IGP Inform ation
Area 0 to OwsNo Cross - connect between routers
Local interfaces are passive
5 interfaces Active
A re a 3 0 1 0
12008 12008
g a r 1 - m c 2
s a r 1 - m c 3
g a r 2 - m c 2
s a r 2 - m c 2
m a r 1 - m c 1
m a r 2 - m c 2
d ia lm is c 1 - m c 1
d ia lm is c 2 - m c 2
A re a 0
A re a 0
A re a 0
A re a 0
A re a 0
A S
1 4 8 5 5
B G P N eighbors :
IB G P - S w ing 1 /
S w ing 2
E B G P -N one
Local interfaces
are passive
Local interfaces
are passive
B G P N eighbors :
IB G P - S w ing 1 /
S w ing 2
E B G P -S print
Local interfaces are passive
B G P N eighbors :
IB G P - S w ing 1 /
S w ing 2
E B G P - U U N E T
Local interfaces
are N O T passive
B G P N eighbors :
IB G P - S w ing 1 /
S w ing 2
E B G P - N one
BGP Inform ation
DAR Peering IN :route - m ap DARtoSWING
Perm its 0 .0 .0 .0Various other networks in 64 .12 .x .x
DAR Peering OUT :
route - m ap DARtoSWINGPerm its AS Path ( s) perm it 4̂999 $
perm it 1̂276 $ perm it _701 _Perm its ACL 67 , sets
com m unity 1664 : 1Perm its ACLs 68 , 69 , 70 ; sets
com m unity8176 : 1[ 2]
OC - 12 OC -12
OC -12
OC - 12
OC - 12
OC - 12
IGP Inform ation
OSPF :Area 0 Authentication
Default Originate
12016
12016
12008
12008
sw in g 1 -m c 1
sw in g 2 - m c 2
12016
12016
Sprint
AS 4999
12012
12012
U U N et
A S 701
OC -48
12016
12016
iw g 1 -m c 2
M 40
*D e ta il o n p a g e la b e le d “IW”
M 40
iw g 2 - m c 3
T 640 T 640
V O IP
O S P F
A re a 0
v o ip 1 - m c 1v o ip 1 - m c 1
s n e 1 - m tc s n e 2 - m tc
M 160 M 160
o o b 2 - m c 3
o o b 1 - m c 112008
12008
12416
12416
12416 12416pop 1-rtc pop 2- rtc
M 160M 160
D N S S e g m e n t
p tn e 1 -m c 1
p tn e 2 -m c 2
D a t e:
CACHE
Streaming
AOL MemberHome/PC
• Distribute the “Right Content”...
Global Backbone MetroLast Mile
Content
Data Center
• To the “Right Place”...
Rich Edge: CDN, dIPT,Distributed Cache, Uvox
• And at the “Right Time”…
AOL TopSpeed
Content Distribution Evolution
10K Foot View
Farmed Design - Dial
DAR1 DAR2
WC1 WC2
FARMCACHE
IPT
XAR1 XAR2
SWG1 SWG2
SPIDERDial Provider
ATDN
LAC
DNS
SMTP
PSTN
1
2
L2TP
BERP
4
L2TP
L2TP
L2T
PL2
TP
L2TP
ATS
3
The day a vendor starts handing out leather jackets with high end products is the day he startsgetting a lot of my business. -Jonathan Hartford
Web Cache
Key
Gigabit Ethernet
10 Gigabit Ethernet
Fast Ethernet
wc3 -dtc wc 4-dtcdar 1-dtcdar 2- dtc
ATDN
Cache
SW
Cache (20)
Cmpmgt (6)
JGcomp (44)
Cache
farms
xx
x/2
6
yy
y/2
6 UVOX
iptfarma - dr 1- sw 0Cisco 7606
Vlan 2( uplink )
Vlan 3 (proxy)
ipt ( 40)
Vlan 4 (dia
l)
Cache (20 )
Cmpmgt (6)
JGcomp (44 ) Cache ( 20)
Cmpmgt (6)
JGcomp (44 )
Spider
Switches
Spider
(12 )
/25
Spider (12 )
/25
Spider (12 )
/25
Spider (12 )
/25
Spider (12 ) Spider (12 )
barn
sw
/26
tuck (5)
unlock ( 3)
rats (2)
bpg (6)
smtp (4)
dns (12 )
ratbroker (1)
tuck (5)
unlock ( 3)
rats (2)
bpg (6)
smtp (4)
dns (12 )
ratbroker (1)
x 4
Spider farms
Barns
iptfarms
Web Requests Served Daily: Over 13 Billion
DNS Load Balancing Architecture
Streaming - Blocks
• Unified Storage – Replicated content storage and distribution
• UVOX – Bedrock servers take content from Unified StorageComplex- Already in correct codec- Place it in UVOX format- Send it to UVOX
• NSV- Store up 6 hours of cached content in Bedrock Servers- Send to Deathstar
spinner.com is the greatest thing to happen to the internet since aol's irc server got klined.
-Faisal Jawdat
Ultravox & NSV
Array
Array
NTC
DTC
FCIP
Unified Storage
Publish
Bedrock
Bryan Blank: overclocking leads to instability, instability leads to hateBill Fumerola: hate leads to filing PRs and using the phrase "it worked in linux"
I lost my CD case. You know how I am when I lose my music. Sucked to be anything in view thatnight. -Jeremy Hartman
GIG SX Ethernet
sne 1-dtc sne2-dtc
AS 65216
ServerIronFO UND RYNE TWORK S
ServerIronFO UND RYNE TWORK S
ServerIronF OUN DRYN ETWOR KS
core 1
ssvc 1 ssvc 2
edge 5 edge 6 edge7
Fibre Channel
Edge Hosts
8 dual 100 attachedhosts per switch
SSVC Hosts
7 dual 100 attached hosts per sw itch
Core Hosts
12 hosts per sw itch
ServerIronFO UND RYNE TWORK S
core 3
ServerIronFOU NDR YNETWORKS
core 5
ServerIronF OUN DRYN ETWOR KS
core 2
ServerIronF OUN DRYN ETWOR KS
ServerIronF OUN DRYN ETWOR KS
core 4
ssvc 3
ServerIronF OUN DRYN ETWOR KS ServerIronF OUN DRYN ETWOR KS
ServerIronFO UND RYNE TWORK S
ServerIronFOU NDR YNETWO RKS ServerIronFOU NDR YNETWO RKS
edge 8 edge 9 edge 10
ServerIronFOU NDR YNETWO RKS
ServerIronF OUN DRYN ETWOR KS
ServerIronF OUN DRYN ETWOR KS
edge 4
edge 2
edge 3
ServerIronFO UND RYNE TWORK S
fcip -dtc0f-1fcip -dtc0f-2
Disk Array
ServerIronFOU NDR YNETWO RKS
100 TX
rib5-dr1-sw 0RIB Net
Unified Storage Complex
Live Content
• Some live content is encoded in the BOC
• BOC sends content to Unified Storage Complexes- Multiple levels of reflection and splitting happens
• Partners (Large News Corp)- Each encoder at LNC transmits both a low and a high bit
video feed to the live transmitters in DTC. From there thefeeds are then forwarded to the transmitters in each datacenter. Then via multicast it is pushed to the edge. (see.USC NTC DTC MTC)
DS 3
Fast Ethernet56kConsole CablesOC192Gigabit Ethernet
10 Ethernet
pop3-nye pop 3- new
sne1-lnc sne2-lnc
lnc1-sw 0
LNC NYC Site
56 k ModemOOB
PSTN
encoders
AOL Transit Data Network
sne 1- dtc
sne 2- dtc
livetrans 1- dr6
livetrans 2- dr6
USC NTC
USC MTCUSC DTC
Live Transmitters
Live Transmitters
Hot Standby
RS CS TR R DT DC DT AL K / DAT ATA LK
Large News Network Live Streaming
BOC
There comes a time in one's life, when you must take a risk, or live forever with yourdreams. - Late Extreme Skier Trevor Petersen
Questions
• Many thanks to Matt Schechtman, John Watson, James Tarry,Daniel Shames, Brenda Rapp, Pat Gunn, Mark Muehl, TeresaDietrich-Gurney