Advanced Research in QoS and UPQ Assessment

Razvan Beuran

Mihai IvanoviciMarch 2004

Outline

Background QoS Measurement TCP/IP Performance Analysis VoIP UPQ Assessment PIPPS Network Emulator project

Background

QoS testing and measuring Design & build QoS measuring system

Cost, flexibility, accuracy, long distance tests Measure QoS parameters

User Perceived Quality (UPQ) assessment Define UPQ metrics – application dependent Quantify UPQ metrics Study relationship with QoS parameters

Reproduce results Enable decision taking

DelayThroughput

Loss

UPQ

Collaborations (I)

Degree2 Innovations (now U4EA) – 2002 Testing and measuring QoS

Active QoS measurement (artificial traffic)

Passive QoS measurement (user oriented)

TG & MT

TG & MT

DUT

SW SW DUT APP APP

MT

UMT

TG = traffic generatorMT = measurement toolsDUT = device under test

APP = applicationSW = switchUMT = user perception measurement tools

Collaborations (II)

U4EA – 2003 FlowFusion – GoS technology

Study its characteristics TCP/IP (long-haul tests for ATLAS remote farms)

Quantify performance for various links UPQ assessment for VoIP

Innovative methodology – study the perceived quality in regions of the loss-jitter space

Finalized by a technical report delivered to U4EA

QoS Measurement – switches

Active QoS measurement Studied scheduling

algorithms 8 different priorities

Tested networks

QoS Measurement – WAN

Tests performed using our Alteon Network Tester NUT = Network Under Test

TCP/IP Performance Analysis

Conference paper (SPECTS’03) Lab tests, 100 Mbps UPQ metrics for FTP over TCP/IP

Goodput Transfer time performance

Relationship with QoS parameters (loss & delay)

Long-haul bulk data transfer using TCP/IP Real networks tests, 1 Gbps ATLAS remote farms Memory to memory transfer using iperf

VoIP UPQ Assessment (I)

Custom-designed measurement system ITU-T PESQ score for UPQ quantification

VoIP UPQ Assessment (II)

G.711 codec 3D PESQ surface & horizontal sections

Publications

M. Ivanovici, R. Beuran, N. Davies, B. Dobinson, “Evaluation of the Delivery QoS Characteristics of Gigabit Ethernet Switches”, to be submitted to QoFIS 2004, Barcelona, Spain.

R.Beuran, M. Ivanovici, “User-Perceived Quality Assessment for VoIP Applications”, technical report, January 2004.

R. Beuran, M. Ivanovici, B. Dobinson, N. Davies, P. Thompson, "Network Quality of Service Measurement System for Application Requirements Evaluation" , International Symposium on Performance Evaluation of Computer and Telecommunication Systems, SPECTS'03, Montreal, Canada, July 20-24, 2003, pp. 380-387.

M. J. LeVine, S. Stancu, Ch. Haeberli, L. Tremblet, R. Beuran, C. Meirosu, R. W. Dobinson, B. Martin, E. Knezo, H.-P. Beck, R. Hauser, D. Botterill, "Validation of the ATLAS Trigger/DAQ Network architecture using hardware data emulators", 13th IEEE Nuclear & Plasma Sciences Society Real Time Conference, Montreal, Canada, May 18-23, 2003.

K. Korcyl, G. Sladowski, R. Beuran, R. W. Dobinson, C. Meirosu, M. Ivanovici, M. L. Maia, "Network performance measurements as part of feasibility studies on moving part of the ATLAS Event Filter to off-site Institutes", First European Across Grids Conference, Santiago de Compostela, Spain, February 2003.

K. Korcyl, G. Sladowski, R. Beuran, R. W. Dobinson, C. Meirosu, M. Ivanovici, M. L. Maia, "Network performance measurements for massive data transfers between CERN Geneva and Cyfronet Cracow", Cracow Grid Workshop, Cracow, Poland, December 2002.

F. R. M. Barnes, R. Beuran, R.W. Dobinson, M.J. LeVine, B. Martin, J. Lokier, and C. Meirosu, "Testing Ethernet Networks for the ATLAS Data Collection System", IEEE Trans. Nucl. Sci. 49, No. 2, April 2002, pp. 516-520.