network measurements research group charter discussion bof

NMRG BoF GGF11 Hawaii June 2004

Network Measurements Research GroupCharter Discussion BoF

Chairs: Brian Tierney Richard Hughes-Jones

GGF11 Honolulu


Intellectual Property Policy

I acknowledge that participation in GGF11 is subject to the GGF Intellectual Property Policy. Intellectual Property Notices Note Well: All statements related to the activities of the GGF and addressed to

the GGF are subject to all provisions of Section 17 of GFD-C.1 (.pdf), which grants to the GGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in GGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: the GGF plenary session,

any GGF working group or portion thereof, the GFSG, or any member thereof on behalf of the GFSG, the GFAC, or any member thereof on behalf of the GFAC, any GGF mailing list, including any working group or research group list, or any other list functioning under

GGF auspices, the GFD Editor or the GWD process Statements made outside of a GGF meeting, mailing list or other function, that are clearly not intended to be

input to an GGF activity, group or function, are not subject to these provisions. Excerpt from Section 17 of GFD-C.1 Where the GFSG knows of rights, or claimed rights, the GGF

secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant GGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non-discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the GGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the GGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification. GGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process.


Agenda for NM-RG Meeting 7 Jun 12:30

Agenda bashing Note Takers Please

Presentation of the Proposed Charter : Brian Some examples of possible study areas: Richard Possible topics for NM-RG: Martin The way forward: Discuss topics of interest: All Charter Wordsmithing and Milestones: Brian


The Proposed Charter

The Network Measurements Research Group (NM-RG) will focus on the relationship betweennetwork performance characteristics and Grid middleware. The objective of NM-RG is to explorewhat aspects of the network are most important to Grid middleware, and explore how the knowledge of network behaviour such as bandwidth, latency, or jitter, might be used to build network-aware middleware.

Specific topics of interest include, but are not limited to: What network characteristics are most useful to Grid Applications ? What Characteristics are Network aware Grid applications using at the moment? Are there "derived characteristics" (combinations of characteristics) that are even more useful? When can passive monitoring be used, and when must active monitoring be used? Which Grid services should collect and publish passively collected network monitoring data? How to monitor “Next Generation Grid Networks”.

The role of the NM-RG role is related to, yet quite distinct from that of the Network MeasurementWorking Group (NM-WG). The NM-WG is focused on specific mechanisms for publishing network monitoring data. The NM-RG will provide a forum for discussion of how Grid middleware might utilize such information. This is currently an open research question, and one we feel can best beaddressed by the GGF. We expect any specific conclusions reached by the NM-RG to be then standardized by the NM-WG, so some other WG.


Relations between Characteristics

Can a light-weight observation give good indication of network conditions ?

From the work of EU DataGrid WorkPackage 7 From the work of IEPM And many others …

More studies required


RIPE 1-way & TCP throughput UK-SARA

RIPE 1-way time ms

Sara RAL

20 Oct 01

RIPE 1-way time ms

RAL Sara

TCP Iperf + prediction

Mbit/s

UCL Sara


Ping & UDP throughput MAN-CERNFrom 20 Oct 01

100

80

60

40

20

PingER rtt (ms)

dl – cern

1000 byte packet

Forecast

UDPmon throughput Mbit/s

man – cern

300 * 1400 byte frames


iperf TCP & UDPmon throughput MAN-SARA From 20 Oct 01

Iperf TCP throughput Mbit/s

ucl – sara

262144 byte buffer

Forecast in Green

UDPmon throughput Mbit/s

man – sara

300 * 1400 byte frames

100

80

60


Application scenarios of “Network Cost Functions”

From the Work of EU DataGrid WorkPackage 7 (Tiziana Ferarri) Resource Brokerage :

Identify most suitable Computing Elements (CE) – Storage Elements (SE), according to a combined set of network criteria: packet loss minimization Round Trip Time minimization throughput maximization

Data management: Estimate of the time needed to transfer a file of known size from a source SE to a destination

SE

Aadaptive remote file access: If the file/files needed by a given application are only known at run time, the

Application can optimise access to remote files based on the dynamic selection of the most appropriate Storage Element set.

More studies required


The “Network Cost Functions”

Example 1:File_size (bits) * Throughput (SourceSE, DestinationSE)

Example 2: Closeness Ci,j (pli,j ,r i,j,th i,j ) Given:

ri,j: Round Trip Time between CEi and SEj Rmax: max s,t rs,t for all CEs and SEt in a given setpli,j : packet loss probability on the network path connecting CEi and SEj

’ th i,j : throughput of data transfer between CEi and SEj THmax: max s,t ths,t

– Ci,j (pli,j ,r i,j ,th i,j ) =1 if CEi is local to SEj – Ci,j (pli,j ,r i,j ,th i,j ) =0 if SE unreachable or if pli,j > P where P

is a configurable threshold– Ci,j (pli,j ,r i,j ,th i,j ) = (th i,j / THmax) * ( r

i,j / R rmax

)

where 0 < < 1 otherwise


Closeness Ci,j (pli,j ,r i,j,th i,j )

Fig 1: alpha = 1/2 Fig 2: alpha = 1/10


Getting Involved in NMRG

Network Measurements Working Group (NMWG) is part of the Performance and Information Systems area.

Mailing list is [email protected] Web-pages:

http://www-didc.lbl.gov/NMWGhttp://forge.gridforum.org/projects/nm-wg/

Join mailing list and participate Send an email to [email protected]

with the body "subscribe nm-wg"

network measurements research group charter discussion bof

Documents

ggf secretariat

ggf auspices

ggf meetings

ggf activity

ggf mailing list

relevant ggf documents

ggf plenary session

research group list