introduction topologies extracts from ampath valdivia group report

September 28, 2002A.Santoro

1

• Introduction• Topologies• Extracts from AMPATH Valdivia Group Report• Questionnaire / Responses• General Considerations; Type of Problems• Suggested Solutions

A. SantoroUERJ -BRAZIL


2

I - Introduction

The history of each network appear in the present situation.( Distribution of Bandwidths )

WHY to investigate the Digital Divide?

For High Energy Physics, If we want to get a Grid architecture to work in the LHC experiments, including the collaborators of the present experiments, we have to have a minimum of the compatibility of the links.

We have used in this report (up to now) theTerena CompendiumInformation from Valdivia Groupand responses from our own questionnaire.


3

II - Topologies


4


5

Korea

Malaysia

Indonesia

Tokyo

Taiwan

HongKong

Thailand

Osaka

To AIH100

Singapora

Tp MAE-WEST

USSan Jose

To NY-NAPUS

PennakenIIJ

NY NOC

Kumamoto

Nagoya

Yokohama

Fukuoka

KitaKjustu

HiroShima

Okayamja Kobe

tyamaWestTokyo

Serdnl SapporoKyoto

Hamamtsu

To DIXUS

PaloAlto

1.5

MBPS

5 3 3 3To Wide

1.5

3

5 x 2 31.5

To Wide1.5

To NSPIXP1.5

To NSPIXP2100

45

155455

45

45

1.5

512k768k

To Wide

5 x 2

A topology map of the Internet Initiative Japan(III) backbone, the largest data network in Japan

ASIA REGION


6


7


8


9

FINLANDNorwaySueden


10

CROATIA


11

Yugoslavia


12

HUNGARY


13

CZECH


14


15


16


17


18This is the topology of the Brazilian National Network for Research showing a strong


19


20

NRENs = National Research and Education Networks

Highest Capacity of European Links of NRENS in Mbps – June 2001

TEN-155 backbone


21

National Research and Education Networks

Highest Capacity of European Links of NRENS in Mbps – June 2001

GEANT backbone


22

Connection to TEN-155 Backbone Connection to GEANT Backbone

Rates [Mbps]

Countries Rates [Mbps]

Countries

≥ 600 Germany, Netherland 5000 Denmark, Finland, Sueden, Norway

≥ 300 Denmark, Greece, Italy, Finland, Suden Norway

2500 Belgium, Germany, Spain, France, Italy, Netherland, United Kingdom, Hungary, Poland, Switzerland

≥ 155 Belgium, Spain, France, Austria, United Kingdom, Hungary, Poland, Slovenia, Switzerland

≥ 1000 Czech Republic

≤ 50 Ireland, Luxembourg, Portugal, Croatia, Cyprus, Albania, Czech Republic, Estonia, Georgia, Latvia, Lithuania, FyroMacedonia, Turkey, Slovakia

≥ 500 Austria

≤ 250 Greece, Ireland, Luxembourg, Portugal, Albania, Croatia, Cyprus, Estonia, Geórgia, Latvia, Lithuania, FyroMacedonia, Slovenia, Slovakia, Turkey

Capacity of the Highest European Link of NRENsCapacity of the Highest European Link of NRENs


23

Extracts from AMPATH Valdivia Group Report

We have a lot of information but not for Digital Divide conclusion. Bandwidth rates it is necessary to know.

Perhaps the most important information for today is :

Countries having groups working in HEP-Collaborations

Brazil: Fermilab, CERN, …Argentina: Fermilab, CERN, …México : Fermilab, CERN…Colombia: Fermilab…Equator: Fermilab…Bolivia : Cosmic Rays (only?)Other countries: still not have good information.


24

Questionnaire / Responses

Table I – Respondents

NameInstitution e-mail Notes

Alexandre Sztajnberg

UERJ - Rio de Janeiro State University, Brazil

[email protected] Network support staff

Heriberto Castilla Valdez

Cinvestav-IPN, Mexico [email protected] HEP physicist

Maria Teresa Dova Univ. Nacional de La Plata, Argentina

[email protected] HEP physicist

Andrej Filipcic Jozef Stefan Institute, Slovenia [email protected] network administrator

Hafeez Hoorani QAU - National Centre for Physics at Quaid-iAzam University - Islamabad Pakistan

[email protected] Professor of Physics. Group working for CMS

P. V. Deshpande Tata Institute – Bombay –India [email protected] Network Administrator

Eduardo Gregores IFT-UNESP-Brazil [email protected] HEP Physicist

Panos Razis University of Cyprus – Cyprus [email protected] HEP Physicist

Remark: Respondents are Network Administrators and HEP physicists.

mailto:[email protected]









25

Table II - Connection StatusInstitution

Bottleneck Notes

Internal (1) Regional / National (2) International (3)

UERJ, Brazil 10/100 Mbps (mostly 10)

10 Mbps ATM connection 45 Mbps via IMPSAT RedeRIO, our regional network is supported by the State Government

Cinvestav, Mexico

100 Mbps ethernet + switches

2 x 2 Mbps, shared Not mentioned Cinvestav pays for the link

UNLP, Argentina

10 Mbps, shared, copper links

Copper link to UNLP Computing center, then optical link to Buenos Aires

Private carriers have considerable resources for those who can pay for it

UNLP pays for its link

JSI, Slovenia Fast ethernet, switched, high load, no QoS

1 Gbps, switched, shared w/ ~1000 PCs

622 Mbps, shared, not limited but not sufficient

QAU, Pakistan 128 kpbs or dialup Actual connection and future upgrades supported by Ministry of Science and Technology-100 users Internal Network.

TATA Institute - India

100 Mbps 2 Mbps link to RegionalBackbone

155 Mbps

IFT-UNESP Brazil

LAN to WAN 10 Mbps and 100 Mbps

4 Mbps to Regional Backbone

University of Cyprus - Cyprus

10 Mbps connectionbetween the Comp. Center and building

Daily traffic Slow traffic by GEANT some times

The Main Bottleneck is Internal and/or Last Mile Connection.

(1) Internal problems. Obsolete technology, router problems, networking equipment, intercampus connection(2) Regional and National problems. Last / first mile problem. Last 1000 miles problem. Network /POP Hierarchy connection / bandwidth problems(3) International connection / bandwidth


26

Table III - Connection details

Institution Providers Firewall

Regional / National (2)

International (3)

UERJ, Brazil RedeRio http://www.rederio.br

RedeRio to IMPSAT CISCO ACLs. No BW limitations.

Cinvestav, Mexico

Not mentioned Not mentioned Not mentioned

UNLP, Argentina

Commercial optical fiber

Not mentioned No firewall

JSI, Slovenia Not mentioned Not mentioned Yes, 1Gbps max throughput

QAU, Pakistan ISP-Most via dialup 54 kibps $0.5/hour – Need more bandwidth-Problems with Funds – Not last mile.

TATA, India 2 Mbps via National Carrier VSNL

IFT-UNESP Brazil

4 Mbps via FAPESP 155 Mbps via TERREMARK NAT and Firewall 10 Mbps maximum

University of Cyprus - CYPRUS

34 Mbps via CYNET GEANT

http://www.rederio.br/





27

Tabel IV - Other networking needs

Institution Computing / networking needs related to HEP Other

UERJ, Brazil HEPGRID PROJECT presented for financial support to work on CMS

Waiting for delivering approved budget to build a T3 and Later 2005/6 a T1

Cinvestav, Mexico Dedicated 2 Mbps link for HEP group

UNLP, Argentina a)LAN upgrade to 100 Mbpsb)LAN-to-WAN upgrade to 4 Mbps

JSI, Slovenia Additional bandwidth should be reserved for HEP

QAU, Pakistan In terms of Hardware declared that they have what they really need. In terms of bandwidth need to upgrade but no last mile connection problem.

TATA, India Will have a Tier 3 Grid node

IFT-UNESP Brazil Will maintain a farm for Monte Carlo studies and a Tier 3 Grid node


The HEP group intend to have responsibilities on Monte Carlo Production and build a Grid Unity type T2 or T3. Need to upgrade Network to Gigabit. In principle there is no limits to use the Network. But the daily traffic is the real limitation.

The Bandwidth of 34 Mbps is sponsored by Cyprus Telecommunications Agency via a research Program and GEANT. The University pays for the Network


28

Table V - Most relevant networking related problems

Institution Most relevant networking related problems

UERJ, Brazil UERJ is outside the Rede RIO’s 155 Mbps ATM ring, connected by a 10 Mbps link. Rede RIO has a private International 45 Mbps connection, which is saturated. RNP, the national backbone research network has a 155+42 Mbps International link that could be used by our institution given that the proper configuration was imposed.

Cinvestav, Mexico

2 x 2Mbps links for the whole community is not sufficient

UNLP, Argentina

2 Mbps optical link, shared with well over 1000 people, is not sufficient

JSI, Slovenia LAN-WAN interconnection: high load, no QoS, new infrastructure needed

QAU, Pakistan (2/3) Internet connection bandwidth. In processes of deploying a 64 Kbps leased line (by October) - limited by funding

TATA, India High prices

IFT-UNESP Brazil

(2/3) speed and bandwidth


Last Mile Connections, big traffic on the used network limit the present work. Need to buy more nodes to work for CMS Monte Carlo. Missing of trained people on Network Technologies.

The most relevant Networking related problems are: Internal Networks, Last mile connections, Financial Support, and too low bandwith.


29

Table VI - Presented ideas for prospective solutions

Institution Presented ideas toward a solution for the detected problems

UERJ, Brazil (1) Upgrade internal network as soon as the approved budged is delivered. (2) Upgrade the last mile link with an “almost”-blind fiber and up to 155 ATM Mbps. (3) Upgrade the Rede RIO’s international link or reconfigure our routing tables to forward packets through RNP’s international link (necessary a Rede RIO and RNP agreement). Most of our solutions require non-immediately-available funding.

Cinvestav, Mexico More money would allow them to buy additional links 2 Mbps each.

UNLP, Argentina Better economical support

JSI, Slovenia Better infrastructure: 1 Gbps Giga-Ethernet for LAN and WAN, 10 Gbps SDH for national network and 1 Gbps SDH for international links. Reserved bandwidth for HEP

QAU, Pakistan (2/3) Upgrade Internet connection to 512 Kbps

TATA, India Proposals for progressive upgrades

IFT-UNESP Brazil University should provide funds to increase speed and bandwidth

University of Cyprus – CYPRUS

More effort is needed to include the smaller Institutes and Laboratories in the GRID Projects and not only the well established Research Centers. GRIDs concentrated in HEP programs and not waste limited resources.

Better funding, upgrades, are the main proposals


30

Table VII - Present Computing Facilities Dedicated to HEPA-Mainframe, Clusters, LAN, Networked CPUS

InstitutionMainframe Clusters Networked CPUs LAN Technology

UERJ, Brazil No to be deployed 35 10/10 Ethernet hub/switches

Cinvestav, Mexico

No 25 2-CPUs + File Server

100 Mbps NICs w/ twisted pair

UNLP, Argentina

No No Isolated PCs in a LAN

10 Mbps, shared copper links

JSI, Slovenia

No ~40 CPUs, ~25 Athlon 1500XP equiv + Alpha server, 1 TB disk

100 Mbps ethernet, switched copper links

QAU, Pakistan

No 6 PC Linux 10

TATA, India No No 32 100 Mbps

IFT-UNESP Brazil

No No 100 Mbps


No Linux Clusters with “many” nodes

“few” computers and Workstations


31

B-Firewall, WAN, Hops, Financial Support

InstitutionFirewall WAN connection hops Who pays for the connection ?

UERJ, Brazil No University’s 10 ATM Mbps over fiber

20 Rio de janeiro State Govern

Cinvestav, Mexico

Not mentioned 22 to Fermilab

Cinvestav and/or Conacyt

UNLP, Argentina

No Commercial optical fiber

23 to CERN 22 to Fermilab

UNLP and/or Conicet

JSI, Slovenia Yes 1 Gbps optical fiber, no special links for HEP

12 to CERN

Not mentioned

QAU, Pakistan

TATA, India

IFT-UNESP Brazil

Yes 20 to Fnal University

University of Cyprus – CYPRUS

Local Network to a WAN by CYNET (National Level) and GEANT for international)

Only 1 internet Router. The Second Line is 128Kbps

University of Cyprus


32

General Considerations

How one’s network capabilities affect the ability to “Do Science”?

What are the common problems? Type of Problems

Long Mile Connection, Last Mile Connection, Security, ....

Suggested Solutions

To know better the problems like -Institutional Problems – Internal Networks, old equipments,... -Last mile connection: Institution to Network

To discuss a possibility to present the problem to ONU and/or OEAor to a compatible organization and suggest solutions

IF we want that GRID work beyond Europe, USA and some Region of Asiathen we have to investigate at least the Institutions collaborating with HEPand try to get a minimum required for their needs.


33

CENIC2000Internet2 and Global Development:Institutional ImpactMichael McRobbieVice President for Information Technology and CIOIndiana University

IEEAF UpdatePacific Rim Networking MeetingHonolulu, Hawaii - 2002Dr. Donald R. RileyChair, IEEAF- Vice President and CIOUniversity of Maryland, College Park

The next set of slides comes from :


34


35


36


37


38


39

introduction topologies extracts from ampath valdivia group report

Documents

network administrators

brazilian national network

ampath valdivia group

largest data network

valdivia groupand responses

czech republic

united kingdom

santoronational research