Steve Goldstein – NORDUnet 2003– Reykjavik, IS

NSF and the Internationalization of the [Academic] Internet

Steve Goldstein

(Retired, former NSF Program Director for International Networking)

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

Disclaimer

• These are my personal recollections. They are based on my tenure at the National Science Foundation. My views are private and do not necessarily reflect the views of the Foundation.

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

Overview

• Early Phases (1987-1991)– Few, uncoordinated 56 kbps links

• International Connections Management (ICM) – 56 kbps-45 Mbps; 1991-1996

• Network Startup Resource Center– Grass roots assistance on demand

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

Overview, Cont’d

• “High Performance” Phase – > 45 Mbps, STAR TAP; post-1997

• Most recently– *Lights, Lambdas, “Love-ins”

• Sprinkled with anecdotal remarks– Hopefully, worth the price of admission!

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

NSFNET and ICM (1988-1995+)

The “Older” NSFNET The “Older” NSFNET (1991: T1->T3 Migration)(1991: T1->T3 Migration)

45 Mb/s National Network Facility

CERFNET

••

NYSERNET

PREPNET

SURANET

MIDNET

SESQUINET

NORTHWESTNET

WESTNET

BARRNET

CERFNET

NSFNET Backbone

Geographic Area of Mid-level Network

Mid-level Network Hub

NEARNET

CICNET

Hawaii

Mid-level Connections

Alaska

1988

1991

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

The ICM Program

Growing international communication needs gave rise to the International Connections Management (ICM) program for NSFNET

1991: Award of International Connections Management Cooperative Agreement (Sprint, 5 years) – consolidated management of circuits to France, NORDUnet (and, later, U.K.)

1992: Many countries connect at their own expense; NSF pays “Port Management Fee” for these countries

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

The ICM program – cont’d.

1993: Upgrade 3 circuits to Europe to T1 (Stockholm, London, Paris ) Homestead, FL gateway to Latin America (Ecuador, Costa Rica,...)Other countries continue to connect (Middle East, Pacific)

1994: European T1’s reach full capacity! Upgrading to multiple E1s.

1995: Upgrade to T3/E3 to UK/Stockholm--World’s first transatlantic 45 Mbps IPL!

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

*courtesy: Sprint Corp.

Malaysia

Japan

U.A.E.planned

Sweden(NORDUNet)

FranceE1

Peru India

Turkey

South Africa

Germany

Russia

OtherFederalInternets

SI

OtherFederalInternets

Other Public Commercial Internets

China64k

Philippines64 k

ICM Network and Other Commercial Internetwork Architecture*

Indonesia64 k

Mexico

Canada

512k

512k

Calpurina64k

E1

9.6k Ecuador128 k

64 k planned: 64 k planned: HondurasBoliviaVenezuela

128k

Daemon64k

E1

512k

X.25->192k

x.25

SprintLink Backbone:

T1->T3

64 k

Colombia64 k

Costa Rica64 k

64 k

64 k

64 k

64 kSaudi Arabia

X.25

[PanAmSat Uplink]

U.K.E1

Notes:• All offshore customers pay total

transmission costs except NORDUNet, UK, France , Mexico (cost-shared with NSF).

• NSF pays most port and network management costs.

• SprintLink customer

Kuwait

64 k planned via Inmarsat:64 k planned via Inmarsat:NigeriaSudanTanzaniaSri LankaPakistanBangladesh

64 k recent:64 k recent:UruguayColombia (UNICOL)Argentina (Retina)

Other Public Commercial Internets

NSFNET’s International Connections NSFNET’s International Connections (ca.1994)(ca.1994)

NSF International Connections Manager (ICM) 1991-1996

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

ICM Connections (ca.1996)

• CEENet (Central &Eastern Eur.)

• JANET (UK)

• TURBITAK (Turkey)

• Mongolia

• NACSIS (Japan)

• KREONet (Korea)

• Philnet (Philippines)

• NORDUnet (DK, IS, FI, NO, SE)

• MIMOS (Malaysia)

• IPTEKNET (Indonesia)

• UKWT-NET (Kuwait)

• Univ of West Indies (Jamaica)

• CEENet (Central &Eastern Eur.)

• JANET (UK)

• TURBITAK (Turkey)

• Mongolia

• NACSIS (Japan)

• KREONet (Korea)

• Philnet (Philippines)

• NORDUnet (DK, IS, FI, NO, SE)

• MIMOS (Malaysia)

• IPTEKNET (Indonesia)

• UKWT-NET (Kuwait)

• Univ of West Indies (Jamaica)

• Red Cientifica Peruana (Peru)

• HONDUnet (Honduras)

• BOLNet (Bolivia)

• Paraguay

• Venezuela

• RETINA (Argentina)

• Nicaragua

• ECUAnet (Ecuador)

• CRNET (Costa Rica)

• Uruguay

• Colombia Univ Net (Colombia)

• Red Cientifica Peruana (Peru)

• HONDUnet (Honduras)

• BOLNet (Bolivia)

• Paraguay

• Venezuela

• RETINA (Argentina)

• Nicaragua

• ECUAnet (Ecuador)

• CRNET (Costa Rica)

• Uruguay

• Colombia Univ Net (Colombia)

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

U.S. and NORDUnet E3July, 1995 (in time for IETF)

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

vBNS, STAR TAP, and HPIIS (1995- )

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

HPIIS and STAR TAP

• HPIIS (TransPAC, MirNET, EuroLink)– TransPAC (Asia-Pacific,1998-2003+)– MirNET/NaukaNet (Russia, 1998- 2003+)– EuroLink (NORDUnet, SURFnet, Renater,

CERN, Israel, 1999- 2003+)

• STAR TAP -> StarLight– Chicago interconnect, May 1997 -2003+

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

LEGENDNetwork Service ProvidersRegional and MidlevelNetworksNetwork Access Points (NAPs)Supercomputer Centers

REGIONALREGIONAL

REGIONALREGIONAL

REGIONALREGIONAL

REGIONALREGIONAL

NSP #3

NCARBoulder, CO

NCARBoulder, COPalo Alto, CA

SDSCSan Diego, CA

SDSCSan Diego, CA

New York, NYNew York, NY

Washington, DCWashington, DC

CornellIthaca, NY

PSCPittsburg,

PA

PSCPittsburg,

PANCSA

Champaign, ILNCSA

Champaign, IL

Chicago, ILChicago, IL

“New” 1995NSFNET

Architecture

Courtesy of NSF Network News. Copyright ©1994 General Atomics.

NSP #2

NSP #1

VBNS

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

Proposed NGI Architecture (1996)

Source: http://www.ccic.gov/ngi/implementation-Jul97/g2_hp_conn_spec.html

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

STAR TAP* (1997- 200?)http://www.startap.net

*Science, Technology and Research Transit Access Point, inspired by G-7 GIBN initiative

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

Science Technology And Research Transit Access Point (early 2001)

http://www.startap.net

Japan

Korea

Taiwan

Singapore

Australia

ChinaFrance

Iceland

Sweden

Denmark

Norway

Finland

Netherlands

Israel

Russia

CERN

Canada

US Networks: vBNS, vBNS+, Abilene, ESnet, DREN, NREN/NISN

Chile, Brazil (FAPESP)

Who Was Connected to STAR TAP?

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

What is (was) STAR TAP?Infrastructure• Engineering Support and

Advanced Services– Technology evaluations– Applications support– Performance measurement– QoS testbeds

• Education and Outreach– Documentation– Conference participation– Host annual meetings

• Team Building– Liaison to network consortia– Application communities

Layer 2 ATM Layer 2 ATM Connection PointConnection PointRacks at AADS NAPfront/back views

www.startap.net

Managed by UIC in collaboration with Argonne National Laboratory, Northwestern (MREN/iCAIR) and Indiana University; operated by Ameritech Advanced Data Services

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

STAR TAP Connections – Early 1999

• CA*Net 2 (Canada) 155 Mbps (http://www.canarie.ca )

• vBNS (NSF/MCI) 155 Mbps (http://www.vbns.net )

• DoE (ESnet) and NASA (NREN and NISN) share 155 Mbps connection TAP (http://www.es.net )

• Abilene (UCAID/Internet2) (http://www.ucaid.org)

• SINGAREN (Singapore) 14 Mbps (http://www.singaren.net.sg )

• TransPAC (35 Mbps from Tokyo--Japan, Korea, Singapore, Australia...); potential for doubling capacity in ‘99 (http://www.transpac.org );

• TAnet II (Taiwan, ~15 Mbps of a 45 Mbps link)

• MirNET (6 Mbps link from Moscow) expected by end of Dec 98; (http://www.mirnet.org )

• SURFnet (Netherlands) 155 Mbps to New York, and 45 Mbps split off to STAR TAP

• CA*Net 2 (Canada) 155 Mbps (http://www.canarie.ca )

• vBNS (NSF/MCI) 155 Mbps (http://www.vbns.net )

• DoE (ESnet) and NASA (NREN and NISN) share 155 Mbps connection TAP (http://www.es.net )

• Abilene (UCAID/Internet2) (http://www.ucaid.org)

• SINGAREN (Singapore) 14 Mbps (http://www.singaren.net.sg )

• TransPAC (35 Mbps from Tokyo--Japan, Korea, Singapore, Australia...); potential for doubling capacity in ‘99 (http://www.transpac.org );

• TAnet II (Taiwan, ~15 Mbps of a 45 Mbps link)

• MirNET (6 Mbps link from Moscow) expected by end of Dec 98; (http://www.mirnet.org )

• SURFnet (Netherlands) 155 Mbps to New York, and 45 Mbps split off to STAR TAP

• NORDUnet (backbone connects IS, NO, SE, FI, DK) expected May ‘99; ~45 Mbps will be split off from 155 Mbps to New York (http://www.nordu.net )

• Israel (~45 Mbps via satellite, Inter-University Computation Center) delivery expected May-June '99;

• Renater (~45 Mbps, France) is tendering for 45 Mbps, or greater, link to the U.S., portion to STAR TAP

• CERN (~20 Mbps) direct to STAR TAP; expected May 99

• NORDUnet (backbone connects IS, NO, SE, FI, DK) expected May ‘99; ~45 Mbps will be split off from 155 Mbps to New York (http://www.nordu.net )

• Israel (~45 Mbps via satellite, Inter-University Computation Center) delivery expected May-June '99;

• Renater (~45 Mbps, France) is tendering for 45 Mbps, or greater, link to the U.S., portion to STAR TAP

• CERN (~20 Mbps) direct to STAR TAP; expected May 99

Already Connected: Pending:

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

STAR TAP and StarLight

• STAR TAP: 5-year-old operational cross-connect of the world's high-performance Production R&E Networks 45-622Mb ATM--Phasing out       

• StarLight: optical evolution of STAR TAP – Production Networks at 1Gb

– Experimental Networks at 1Gb, 2.5Gb, and 10Gb

– Research Networks at 10Gb

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

What/Where is StarLight?StarLight is an advanced optical infrastructure andproving ground for network services optimized forhigh-performance applications

710 N. Lake Shore Drive, ChicagoAbbott Hall, Northwestern UniversityChicago view from 710

710 N.

Lake Shore Drive

Northwestern University

• Carriers POPs

• Chicago NAP

Chicago

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

StarLight Service Description

• Gigabit Ethernet exchange point– High-speed peering with large MTU– Available collocation space – 10GigE, other switched services– Multicast support

• Policy-free 802.1q VLANs between peering partners

• Focused on the needs of e-Science and supporting experimental Networks

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

StarLight Replication

• Experimental TransLight collaboration (includes StarLight, NetherLight and some early EuroLink interests)

• Look for these soon in a country near you!

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

HPIIS-TransPAC (U of Indiana)

10/98 35Mbps single link Tokyo to Chicago10/99 70Mbps single link Tokyo to Chicago10/00 155Mbps single link Tokyo to Chicago10/01 1.224Gbps two links OC-12 to Seattle and Chicago10/03 5.00Gbps two links OC-48 to Los Angeles

OC-48(2 xGE) to Chicago

http://www.transpac.org

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

HPIIS-MIRnet/NaukaNet (NCSA)

07/99 Chicago-Moscow ATM Service 6 Mbps

12/01 Chicago-Moscow POS Service 45 Mbps

09/02 Chicago-Moscow POS Service 155 Mbps

http://www.naukanet.org

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

HPIIS Euro-Link (U of Ill. Chicago)

• Original Partners: NORDUnet, SURFnet, Renater, CERN, Israel

• Current partners: SURFnet, CERN– SURFnet 10Gb Chicago-to-Amsterdam– CERN 622Mb link between Chicago and

Geneva/CERN + 2.5Gb circuit between CERN and StarLight (EU DataTAG project)

http://www.startap.net/euro-link

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

The Next Phase(s)

• New regime at NSF

• New “Cyberinfrastructure” architecture

• Your guess is as good as mine

Steve Goldstein – NORDUnet 2003– Reykjavik, IS

Now for the “Good Stuff”(as time permits)

• Guerilla/Stealth Operation– Own-agency problems getting ICM solicitation broadened – Key turning point: U.K. “Fat Pipe” (NSF, NASA, DARPA)– Other agency resistance/sniping

• “Partitioning” of Europe (connections)• STAR TAP

• “One Country at a time” – Examples– Mongolia, Russia, Latin America, South Africa, Sri Lanka,

Peru, Indonesia, T3/E3 London/Stockholm

• Partnerships and “Co-conspirators”– OAS, Soros, NORDUnet, CA*net/CANARIE