spring 2002u.c. berkeley -- eecs internet pops, telecom hotels, and internet data centers cs 294-3...
TRANSCRIPT
![Page 1: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/1.jpg)
Spring 2002 U.C. Berkeley -- EECS
Internet POPs, Telecom Hotels, and Internet Data
CentersCS 294-3 – The Converged
Network
Spring 2002George Porter
![Page 2: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/2.jpg)
Spring 2002 U.C. Berkeley -- EECS
Internet: collection of networks
• This talk is about connectivity and computation– How do the networks in the Internet
communicate with each other?– What do transit providers do with
their traffic?– Motivation for computation in the
network (Internet Data Centers)
![Page 3: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/3.jpg)
Spring 2002 U.C. Berkeley -- EECS
Computers increasingly connected
![Page 4: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/4.jpg)
Spring 2002 U.C. Berkeley -- EECS
![Page 5: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/5.jpg)
Spring 2002 U.C. Berkeley -- EECS
![Page 6: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/6.jpg)
Spring 2002 U.C. Berkeley -- EECS
NSFnet
• 1987-1995• Managed by Merit
– ANS, IBM, MCI, State of Michigan
• Consisted of T-1 connections• In 1992, moved to T-3 links run by
Advanced Network & Services (ANSnet)
![Page 7: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/7.jpg)
Spring 2002 U.C. Berkeley -- EECS
Post NFSnet
• vBNS (very high-speed backbone network services) run by MCI
• Additional NAPs (Network Access Points)– MAE-East, D.C. – MFS Datanet (now MCI Worldcom)– Ameritech, Chicago – Ameritech– PacBell, San Jose – PacBell– Sprint, Pennsauken, NJ - Sprint
![Page 8: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/8.jpg)
Spring 2002 U.C. Berkeley -- EECS
Many new Commercial NAPs
• ATLnap (Atlanta)• Bellcore
Multimedia exchange
• NY6iX – New York IPv6
• MAE-LA• Seattle IX• MAE-Houston
• PAIX• Equinix• eXchange• Linx (London)• FreeIX (France)• AMS-IX
(Amsterdam)• etc
![Page 9: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/9.jpg)
Spring 2002 U.C. Berkeley -- EECS
Internet POPs: Two Examples
• NeoSoft Inc., Houston Texas
• AMS-IX (Amsterdam)
![Page 10: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/10.jpg)
Spring 2002 U.C. Berkeley -- EECS
Internet POPs: Two Examples
• NeoSoft Inc., Houston Texas
• AMS-IX (Amsterdam)
![Page 11: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/11.jpg)
Spring 2002 U.C. Berkeley -- EECS
• BBS in 1989, became an ISP in 1992
• Founder Karl Lehenbauer (Left)
• I worked there from 1994-1999
![Page 12: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/12.jpg)
Spring 2002 U.C. Berkeley -- EECS
Initial Connectivity
• Originally, NeoSoft connected to NSFnet via Sesquinet @ Rice
• T1 cost $14k up front, $2k/month• Cisco router IGS $10k• 198.??.xx.yy from Sesquinet’s
address space
![Page 13: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/13.jpg)
Spring 2002 U.C. Berkeley -- EECS
New Connectivity
• Eventually bought fractional DS3 from MCI (Sprint wouldn’t route less than /20 due to problems)
• On own CIDR block (128 class C’s: 206.109)
• BGP-4 running on Cisco 7513 Router
• $15k/month
![Page 14: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/14.jpg)
Spring 2002 U.C. Berkeley -- EECS
Peering
• Peered with UUnet for 2 months– NeoSoft had a large webserver, and
served out much more traffic than inbound
• Became member of MAE/Houston• MAGE (Metro Area Gigabit
Ethernet) via Phonoscope ($4k/month!)
![Page 15: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/15.jpg)
Spring 2002 U.C. Berkeley -- EECS
Experiences in Peering
• Many other local providers didn’t have a clue!– INSYNC misconfigured their routes, and
traffic would be outbound through MAGE, inbound through random other routes
– Often advertised incorrect BGP updates
• PSInet: Advertised Dial-up ISDN
![Page 16: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/16.jpg)
Spring 2002 U.C. Berkeley -- EECS
Hops, Multihoming
• In 1994, the Sprint and MCI handoff was in Chicago– 20 hops to next door neighbor– Eventually exchanged in Dallas
• Experimented with Multihoming (DS3 and T1 to Cable & wireless)– Not too good, BGP administration– Plan was for recovery
![Page 17: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/17.jpg)
Spring 2002 U.C. Berkeley -- EECS
NeoSoft Internet America
• In 1999, Internet America buys NeoSoft for $8M
• Houston office closes
• I get laid off
![Page 18: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/18.jpg)
Spring 2002 U.C. Berkeley -- EECS
Internet POPs: Two Examples
• NeoSoft Inc., Houston Texas
• AMS-IX (Amsterdam)
![Page 19: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/19.jpg)
Spring 2002 U.C. Berkeley -- EECS
AMS-IX
• Carrier-neutral peering point• Founded in 1994• 100+ members• 565 Tbytes/month• AT&T, Akamai, Dynegy, Digital
Island, Deutsche Telecom, France Telecom, Global Crossing, UUnet NL, etc
![Page 20: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/20.jpg)
Spring 2002 U.C. Berkeley -- EECS
Organization
![Page 21: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/21.jpg)
Spring 2002 U.C. Berkeley -- EECS
![Page 22: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/22.jpg)
Spring 2002 U.C. Berkeley -- EECS
![Page 23: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/23.jpg)
Spring 2002 U.C. Berkeley -- EECS
How to Join
• Companies apply for membership after agreeing to numerous policies (sometimes voting is involved)
• Cost– 10baseT = 500,00 euro/month– 100baseT = 850,00 euro/month– 1000base T = 1200,00 euro/month
• 1 euro = 0.87 USD (12/26/2002)
![Page 24: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/24.jpg)
Spring 2002 U.C. Berkeley -- EECS
Computation in the network
• It makes sense to move servers and content to places of high connectivity
• By the economics of scale it is cheaper to provide connectivity, power, management, etc to many customers at a central site
![Page 25: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/25.jpg)
Spring 2002 U.C. Berkeley -- EECS
Example: eXchange
• Paul Ave location in SF: 350K sq. ft
• People can rent cabinets, racks, cages
• In addition to being a data center, also a huge connectivity point
![Page 26: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/26.jpg)
Spring 2002 U.C. Berkeley -- EECS
Services
• UPS + generator• Office space• Climate Control• “Meet me” room with carriers and other
service providers• Professional monitoring• Security (hand scanners, guards)• Fire control
![Page 27: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/27.jpg)
Spring 2002 U.C. Berkeley -- EECS
waveExchange
• Unique facility located across the street from eXchange
• 20+ carriers• Near fiber routes/loops• Carriers can meet in “meet me
rooms”• Service between ASPs, ISPs, CDNs…• Opened Nov 2, 2001
![Page 28: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/28.jpg)
Spring 2002 U.C. Berkeley -- EECS
Tenants of waveExchange
• AT&T, Cogent, Enron, Level3, PacBell, Qwest, Sigma, Worldcom, Williams Communications, Xo, PAIX, others
• Network effect• Huge connectivity + Highly
available services
![Page 29: Spring 2002U.C. Berkeley -- EECS Internet POPs, Telecom Hotels, and Internet Data Centers CS 294-3 – The Converged Network Spring 2002 George Porter](https://reader035.vdocuments.site/reader035/viewer/2022081519/56649d0a5503460f949dd77d/html5/thumbnails/29.jpg)
Spring 2002 U.C. Berkeley -- EECS
Summary
• Progression from leased lines to NAPs to peering points gives ISPs options
• I haven’t even mentioned private peering arrangements
• Putting computation in the network at the points of connectivity enables new services that can meet demand