manual - nqdi - kpi users guide

8/13/2019 Manual - NQDI - KPI Users Guide

1/131

WHENQUALITYMATTERS

NQDI KPIsManual

November 2010

SwissQual License AGAllmendweg 8 CH-4528 Zuchwil Switzerland

t+41 32 686 65 65 f+41 32 686 65 66 e [email protected]

Part Number: 16-100-200510 REV 4


2/131

SwissQual has made every effort to ensure that eventual instructions contained in the document are adequate and freeof errors and omissions. SwissQual will, if necessary, explain issues which may not be covered by the documents.SwissQuals liability for any errors in the documents is limited to the correction of errors and the aforementioned advisoryservices.

Copyright 2000 - 2010 SwissQual AG. All rights reserved.

No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system, or translated

into any human or computer language without the prior written permission of SwissQual AG.

Confidential materials.

All information in this document is regarded as commercial valuable, protected and privileged intellectual property, and isprovided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material.

When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo trademarksomewhere in your text.

SwissQual, Seven.Five, SQuad, QualiPoc, NetQual, VQuad, Diversity as well as the following logos areregistered trademarks of SwissQual AG.

Diversity Explorer, Diversity Ranger, Diversity Unattended, NiNA+, NiNA, NQAgent, NQComm, NQDI,NQTM, NQView, NQWeb, QPControl, QPView, QualiPoc Freerider, QualiPoc iQ, QualiPoc Mobile,QualiPoc Static, QualiWatch-M, QualiWatch-S, SystemInspector, TestManager, VMon, VQuad-HD aretrademarks of SwissQual AG.

SwissQual acknowledges the following trademarks for company names and products:

Adobe, Adobe Acrobat, and Adobe Postscript are trademarks of Adobe Systems Incorporated.

Apple is a trademark of Apple Computer, Inc.

DIMENSION, LATITUDE, and OPTIPLEX are registered trademarks of Dell Inc.

ELEKTROBIT is a registered trademark of Elektrobit Group Plc.

Google is a registered trademark of Google Inc.

Intel, Intel Itanium, Intel Pentium, and Intel Xeon are trademarks or registered trademarks of Intel Corporation.

INTERNET EXPLORER, SMARTPHONE, TABLET are registered trademarks of Microsoft Corporation.

Java is a U.S. trademark of Sun Microsystems, Inc.

Linux is a registered trademark of Linus Torvalds.

Microsoft, Microsoft Windows, Microsoft Windows NT, and Windows Vista are either registered trademarks ortrademarks of Microsoft Corporation in the United States and/or other countries U.S.

NOKIA is a registered trademark of Nokia Corporation.

Oracle is a registered US trademark of Oracle Corporation, Redwood City, California.

SAMSUNG is a registered trademark of Samsung Corporation.

SIERRA WIRELESS is a registered trademark of Sierra Wireless, Inc.

TRIMBLE is a registered trademark of Trimble Navigation Limited.

U-BLOX is a registered trademark of u-blox Holding AG.

UNIX is a registered trademark of The Open Group.


3/131

NQDI KPIs Manual

2000 - 2010 SwissQual AG

Contents |

CONFIDENTIAL MATERIALS

ii

Contents

1 Introduction .......................................................................................................................................... 1Related Documentation ......................................................................................................................... 1KPI Overview ......................................................................................................................................... 2

Accessibility ...................................................................................................................................... 2Retainability .................................................................................................................................... 10Integrity ........................................................................................................................................... 13

2 Services .............................................................................................................................................. 21Voice .................................................................................................................................................... 21

GSM/UMTS .................................................................................................................................... 21CDMA ............................................................................................................................................. 22

Data ..................................................................................................................................................... 22TCP/IP ............................................................................................................................................ 22Email ............................................................................................................................................... 23FTP ................................................................................................................................................. 24HTTP .............................................................................................................................................. 26Ping ................................................................................................................................................ 26UDPDL ........................................................................................................................................... 26WAP ............................................................................................................................................... 27

Messages ............................................................................................................................................ 28MMS ............................................................................................................................................... 28SMS ................................................................................................................................................ 28

Mobile TV ............................................................................................................................................. 28DVB-H ............................................................................................................................................ 28

3 Indicators on Layer 3......................................................................................................................... 29Data (PS) ............................................................................................................................................. 29Voice (CS) ........................................................................................................................................... 30

2G ................................................................................................................................................... 303G ................................................................................................................................................... 31

Active set update ............................................................................................................................ 31Cell Update ..................................................................................................................................... 32

4 Indicators on Layer 1......................................................................................................................... 33Scanner Based Measurements ........................................................................................................... 33

Scrambling Code Coverage ........................................................................................................... 33Pilot Pollution .................................................................................................................................. 33

Radio based Measurements ................................................................................................................ 33Radio Link....................................................................................................................................... 33


4/131


5/131


6/131

NQDI KPIs Manual


Contents |


v

Figure A-17 WCDMA Layer 3 Signalling (filtered) ......................................................................................... 114Figure B-1 Probability Density Function (PDF).............................................................................................. 124Figure B-2 Cumulative Density Function (CDF) ............................................................................................ 124Tables

Table A-1 KPI Results Table ........................................................................................................................... 35Table A-2 Error Codes and Status field ......................................................................................................... 122Table B-1 Table for rates and averages ........................................................................................................ 123


7/131

NQDI KPIs Manual


Chapter 1 | Introduction


1

1 Introduction

This document contains a description of all the KPIs (Key Performance Indicators) measured and reportedwith Diversity and QualiPoc data in NQDI. This list of KPIs represents a summary from inputs from theExperts within ETSI, SwissQual KPI definitions and various customer requests.

THhe structure of the KPIs follow the principles of the document ITU P-800 where the accessibility,retainability and integrity are the key aspects of the assessment of quality in telecommunications.

The concept of accessibility has been enlarged to accommodate customer requests for KPIs considering thecompletion of a service. It spans from the request of a service to its successful completion. Since the accessto the service is essential to its completion these KPIs are regarded as belonging to the accessibility group.

The described KPIs are to be found on the KPI sheet of the NQDI Analysis tab and as a report item in theReport Generator. The usage of the Report Generator is described in detail in the NQDI manual.

The calculation of the KPIs is automatically when the trigger points are available. Depending on the datacollection application type and mode used (Diversity, QualiPoc) maybe only a limited choice of KPIs is

available.

Related Documentation

For a description of the NQDI Database Structure, see: Manual-NQDI database structure.pdf

For a description of the Voice Test Measurement Results, see: Manual-Result Description.pdf

For a description of the Data Test Measurement Results, see: Manual-Data Test Resultdescription.pdf


8/131

NQDI KPIs Manual




2

KPI Overview

The following legend is for the KPI tables in this section. The ETSI reference document is TS 102 250 - 2 V.1.7.1

Item Description

* Not implemented as KPI and not available as Report Item

+ Available In Report Generator but no explicit KPI Item

QP Only with QualiPoc available

() ETSI definition almost equivalent

IP Protocol

Layer 3 Message

Phone or log trace Message

Scanner

Accessibility

Accessibility Parameter ETSI Parameter

KPI ID Stratum Type Function Start Trigger Event End Trigger Event Status Value 1 SuccessRate

Time

10100

Service

Voice(CS)

Telephony

Channel Request /RRCConnectionRequest

(MTC Dial) CC: Alerting SuccessRate Duration 6.6.1/6.7.3 6.6.2/6.7.4

10102TelephonyService CM Service Request CC: Alerting SuccessRate Duration


9/131

NQDI KPIs Manual




3


KPI ID Stratum Type Function Start Trigger Event End Trigger Event Status Value 1Success

RateTime

10105Video CallVideo Setup RRCConnectionRequest Video Connect marker SuccessRate Duration

10110TelephonyCompletion

Channel Request /RRCConnectionRequest CC: Disconnect SuccessRate Duration

10141Paging DelayMTC Dial Paging/RRC Paging Type 1 SuccessRate Duration

10150TelephonyMTC Paging CC: Alerting SuccessRate Duration

10151

TelephonyMTCintermediate

Channel Request /RRCConnectionRequest CC: Alerting SuccessRate Duration

10152

TelephonyMTC RequestDelay Paging Channel Request / RRCConnectionRequest SuccessRate Duration

10153

TelephonyRandomAccess Dial Channel Request/RRCConnection Request SuccessRate Duration

10160

Telephony

CompletionMTC Dial Channel Release / RRC ConnectionRelease SuccessRate Duration

10165

TelephonyCompletionMTC Paging Paging

Channel Release / RRC ConnectionRelease SuccessRate Duration

10200

Data

Email send > 25 [SYN] Message Body (after CommandReset) SuccessRate Duration (7.2.11) (7.2.12)

10210Email sendCompletion > 25 [SYN] Message Accepted (or Quit) SuccessRate Duration 7.2.6 7.2.7


10/131


11/131

NQDI KPIs Manual




5



RateTime

10407HTTP Browser(B) > 80 [SYN] Sending of the first GET command SuccessRate Duration 6.8.3 (B) 6.8.4 (B)

10410HTTP BrowserCompletion > 80 [SYN] Last Continuation SuccessRate Duration 6.8.5 6.8.6

10411

HTTP TransferGETCompletion > 80 [SYN] Last Continuation SuccessRate Duration 6.8.5 6.8.6

10412

HTTP TransferPUTCompletion > 80 [SYN]

Reception of [Fin;Ack] after the lastcontinuation SuccessRate Duration

10420

Service AccessHTTP Browser(B) Start RAS Dialup Sending of the first GET command SuccessRate Duration 6.8.1 (B) 6.8.2 (B)

10421

Service HTTPTransfer GET(B) Start RAS Dialup Sending of the first GET command SuccessRate Duration 6.8.1 (B) 6.8.2 (B)

10422Service HTTPTransfer PUT Start RAS Dialup Sending of the first PUT command SuccessRate Duration

10425

Network

Access HTTP

Activate PDP Context

Request HTTP/1.n 200 OK SuccessRate Duration QP

10430

NetworkAccess WAPPortal

Activate PDP ContextRequest Last HTTP/1.n 200 OK SuccessRate Duration QP

10450HTTP NetworkDL Cycle

Channel Request

RRCConnectionRequest

HTTP Get HTTP/1.n complete SuccessRate Duration QP


12/131

NQDI KPIs Manual




6



RateTime

10451HTTP Page DLCycle HTTP Get Last HTTP/1.n complete SuccessRate Duration QP

10452HTTP File DLCycle HTTP Get

Last HTTP/1.n complete before new HTTPGet SuccessRate Duration QP

10500 UDPDL Request:SQUDPDL Source port SuccessRate Duration

10600VideoStreaming

HTTP: HTTP Get orRTSP continuation

RTSP DESCRIBE

RTSP: RTP Payload

Resized, Buffering

SuccessRate Duration

10601VideoStreaming Play

HTTP: HTTP Get or RTSPcontinuation

RTSP DESCRIBE PLAY (RTSP PLAY) SuccessRate Duration

10605

VideoStreaming(Setup)

RTSP: RTSP Setup RTSP: RTP Payload

Resized, Buffering SuccessRate Duration

10610

NetworkAccess VideoStreaming

Activate PDP ContextRequest First Packet SuccessRate Duration QP

10700 WAP WSP Connect WSP Reply/ WSP Result SuccessRate Duration 6.11.1 6.11.2

10710WAPCompletion WSP Connect Last WSP Reply/ WSP Result SuccessRate Duration

10800

Message

MMS Send START TRANSMISSION STARTED SuccessRate Duration

10801 MMS ReceiveNOTIFICATIONRECEIVED TRANSMISSION STARTED SuccessRate Duration


13/131

NQDI KPIs Manual




7



RateTime

10805WAP Gatewayconnect START WSP Connect SuccessRate Duration

10900 SMS Send START SEND SMS START SuccessRate Duration

11000Post Dial DelayActive State SIP INVITE 180 RINGING SuccessRate Duration

11010SIPCallAccess SIP INVITE SIP 200 OK SuccessRate Duration

11500EVDO

Post Dial DelayDormant State

EVDO ConnectionRequest 180 RINGING SuccessRate Duration

11600

DVB-H

Mobile TVDVB-H Menu Service Request Service available (DVB-H Service Available) SuccessRate Duration 6.2.2 6.2.3

11610

Mobile TVDVB-HChannel Channel Request Streaming Started (DVB-H Channel added) SuccessRate Duration 6.2.4 6.2.5

15000 Data (CS) Telephony AT-Command Valid Server Response SuccessRate Duration *

15100

Layer3

Data (PS)

Attach Attach Request Attach Accept or Reject SuccessRate Duration 5.3 5.4

15101 Detach Detach Request Detach Accept SuccessRate Duration

15102AttachCompletion Attach Request Attach Complete SuccessRate Duration

15105 Attach (P3) [AT+ CGATT=1] [OK] SuccessRate Duration

15200Activate PDPContext

Activate PDP ContextRequest Activate PDP Context Accept or Reject

SuccessRate Duration 5.5 5.6


14/131

NQDI KPIs Manual




8



RateTime

15201DeactivatePDP Context

Dectivate PDP ContextRequest Deactivate PDP Context Accept


15202 Access 3G RRCConnectionRequest ActivatePDPContext Accept SuccessRate Duration

15203

DeactivatePDP ContextCompletion

Channel Request /RRCConnectionRequest Deactivate PDP Context Accept


15205Activate PDPContext (P3)

First IPCP ConfigurationRequest Last IPCP Configuration Accept SuccessRate Duration

15250IP ServiceAccess

Activate PDP ContextRequest FirstPacket of accessed service SuccessRate Duration

15300 AuthentificationAuthentification andCiphering Request

Authentification and Ciphering Response orFailure or Reject SuccessRate Duration

15400

CS

Ciphpering Ciphering Mode command Ciphering Mode complete SuccessRate Duration

15500 Authentification Authentification RequestAuthentification Response or Failure orReject SuccessRate Duration

15550 Identity IdentityRequest IdentityResponse SuccessRate Duration

15560Call SetupSignalling 2G Immediate Assignment Assignment Command SuccessRate Duration

15570Call SetupSignalling 3G

RRCConnectionSetupComplete RadioBearerSetup SuccessRate Duration

15600 2G Traffic Channel Assignment Command Assignment Complete or Failure SuccessRate Duration


15/131

NQDI KPIs Manual




9



RateTime

15610Call AccessTraffic Channel CM Service Request

Assignment Complete or Failure/RadioBearerSetupComplete or Failure SuccessRate Duration

16050Traffic ChannelCompletion Channel Request Channel Release SuccessRate Duration

15700 Signal Channel Channel Request Immediate Assignment or IA Reject SuccessRate Duration

16310CDMA

Call AccessTraffic Channel Origination Service Connect Completion SuccessRate Duration

15800

3G

Traffic Channel RadioBearerSetup RadioBearerSetupComplete or Failure SuccessRate Duration

15900 SecurityDCCH-Security ModeCommand DCCH-Security Mode Complete or Failure SuccessRate Duration

16000 Signal Channel RRCConnectionRequest RRCConnectionSetupComplete SuccessRate Duration

16050Signal ChannelCompletion RRCConnectionRequest RRCConnectionRelease SuccessRate Duration

16100

Layer 1 2G

Coverage C1 > 0 SuccessRate 5.1 *

16200GPRSAvailability Selection of new Cell SI 13 on BCCH SuccessRate 5.1


16/131

NQDI KPIs Manual




10

Retainability

Retainability Parameter ETSI Parameter


RateTime

20100

Service

Vo

ice

(C

S) Telephony Alerting Disconnect SuccessRate Duration 6.7.7

20101 Telephony Connect Disconnect SuccessRate Duration 6.6.5

20200

Data

Email send First Message Body Response: Message accepted - half roundtrip SuccessRate Duration (7.2.9)

20201 Email receive Octets - half roundtrip Last Continuation SuccessRate Duration (7.2.9)

20203IMAP EmailReceive FETCH 1 (RFC822)

Response: Cx OK FETCH completed (x mustmatch with id from Request) SuccessRate Duration 7.2.9 7.2.10

20205 Email send First Message Body Response: Message accepted SuccessRate Duration 7.2.9 7.2.10

20206 Email receive octets Last Continuation SuccessRate Duration 7.2.9 7.2.10

20211

IMAP EmailReceiveHeader

FETCH 1(RFC822.HEADER)

Response: Cx OK FETCH completed (x mustmatch with id from Request) SuccessRate Duration 7.2.9 7.2.10

20300 FTP UL FTP Data [FIN;ACK] - half roundtrip SuccessRate Duration

20301 FTP DL FTP Data - half roundtrip Last FTP DATA SuccessRate Duration

20305 FTP UL(V) FTP Data First [FIN;ACK] for the last FTP DATA SuccessRate Duration 6.1.8 (A)

20306 FTP DL(V) FTP Data Last FTP DATA SuccessRate Duration 6.1.8 (A)

20307 FTP UL(B)Reception of [ACK] fromthe [SYN;ACK] [FIN;ACK] - half roundtrip SuccessRate Duration 6.1.8 (B)


17/131


18/131

NQDI KPIs Manual




12

Retainability Parameter ETSI Parameter


RateTime

20801 MMS ReceiveNOTIFICATIONRECEIVED TRANSMISSION FINISHED SuccessRate Duration

20900 SMS SEND SMS START SEND SMS FINISHED SuccessRate Duration 7.4.2 7.4.3

21000

Data

Echo (Ping)request Echo (Ping) reply SuccessRate Duration 6.3

21010SIP CallCompletion SIP 200 OK SIP Request: BYE SuccessRate Duration

21600DVB-H

Mobile TVDVB-HChannel

Streaming Started

DVB-H Channel added

Streaming Stopped

DVB-H service lost SuccessRate Duration

25000Data(CS)

Telephony(Data CS) Valid Server Response Intentional Termination SuccessRate Duration *

25200

Layer3

Data(PS)

PDP ContextActivate PDP ContextAccept Dectivate PDP Context Request SuccessRate Duration 5.7

25201PDP ContextEnd

Activate PDP ContextAccept Dectivate PDP Context Accept SuccessRate Duration

25100 Attach Attach accept Detach Request SuccessRate Duration

25300 2G Resource Assignment Complete Channel Release SuccessRate Duration

254003G

NetworkRRCConnectionSetupComplete RRCConnection Release SuccessRate Duration

26100

3.5G

HSDPAActivity

RadioBearerSetup

RadioBearerReconfiguration

RRCConnectionRelase, CellChangeOrderformUTRAN, RadioBearerReconfiguration


19/131

NQDI KPIs Manual




13

Integrity

Integrity Parameter ETSI Parameter

KPI ID Stratum Type Function Trigger/Measurement Trigger/Measurement Time

30100

Service

Voice

(CS) Telephony Speech Samples SpeechQuality 6.6.4

30101 Telephony Exit CC: Disconnect CC:Release

30200

Data

Email sendTransmission Duration20200 Transferred Data Throughput

30201 Email receiveTransmission Duration20201 Transferred Data Throughput

30203IMAP EmailReceive

Transmission Duration20203 Transferred Data Throughput 7.2.8

30205 Email sendTransmission Duration20205 Transferred Data Throughput 7.2.8

30206 Email receiveTransmission Duration20206 Transferred Data Throughput 7.2.8

30300 FTP ULTransmission Duration20300 Transferred Data Throughput

30301 FTP DLTransmission Duration20301 Transferred Data Throughput

30305 FTP UL(V)Transmission Duration20305 Transferred Data Throughput 6.1.7 (A)

30306 FTP DL(V)Transmission Duration20306 Transferred Data Throughput 6.1.7 (A)

30307 FTP UL(B)Transmission Duration20307 Transferred Data Throughput 6.1.7 (B)


20/131

NQDI KPIs Manual




14



30308 FTP DL(B)Transmission Duration20308 Transferred Data Throughput 6.1.7 (B)

30400 HTTP BrowserTransmission Duration20400 Transferred Data Throughput (6.8.7 (A))

30401HTTP TransferGET

Transmission Duration20401 Transferred Data Throughput 6.8.7 (A)

30402HTTP TransferPUT

Transmission Duration20402 Transferred Data Throughput

30405HTTPBrowser(V)

Transmission Duration20405 Transferred Data Throughput 6.8.7 (A)

30407HTTPBrowser(B)

Transmission Duration20407 Transferred Data Throughput 6.8.7 (B)

30500 UDP Transmission Duration Transferred Data Throughput

30600

Video StreamingRTSP: TDP Payload

HTTP: Resized orBuffering

Displaying

Success Rate Duration 6.5.10 6.5.11

30605Video StreamingFirst Frame

[SYN] Displaying

Success Rate Duration

30606Video StreamingTeardown Time

RTSP : TEARDOWN RTSP/1.0 200 OK

Success Rate Duration 6.5.12 6.5.13

30607Video StreamingSetup

[SYN] Resize

Buffering Success Rate Duration 6.5.4 6.5.5


21/131


22/131

NQDI KPIs Manual




16



34000Routing AreaUpdate

Routing Area UpdateRequest Routing Area Update Accept or Reject Success Rate Duration

34004Routing AreaUpdate Access

Channel Request /RRCConnectionRequest Routing Area Update Complete or Reject Success Rate Duration

34010 TMSITMSIReallocationCommand TMSIReallocationComplete Success Rate Duration

34050

2G

Handover Handover Command Handover Complete or Failure Success Rate Duration

34060Channel Modify2G Channel Mode Modify Channel Mode Modify Acknowledge Success Rate Duration

34070IntracellHandover Assignment Command Assignment Complete or Failure Success Rate Duration

35003

2G/3G

Location Location Update Request Location Updating Accept or Reject Success Rate Duration

35004Location UpdateAccess

Channel Request /RRCConnectionRequest Location Updating Accept or Reject Success Rate Duration

35010 Compress Mode tgps_Status activate

All tgps_Statusdeactivate/HandoverFromUTRANCommand-GSM Success Rate Duration

35020 InterSystemHO Inter System to UTRANHandover Command HandoverToUTRANComplete or Failure Success Rate Duration

35030 InterSystemHOHandoverFromUTRANCommand-GSM

Handover Complete or HandoverFromUTRANFailure Success Rate Duration

35040 InterSystemHOCellChangeOrderFromUTRAN

First GSM SystemInformation afterCellChange Success Rate Duration

35041InterSystemHORAU

CellChangeOrderFromUTRAN Routing Area Update Complete or Reject Success Rate Duration


23/131

NQDI KPIs Manual




17



35042InterSystemHOInterruption

CellChangeOrderFromUTRAN First IP Packet Success Rate Duration *

35050 InterSystemHO

Last GSMSystemInformation beforeCellChange CellChange Success Rate Duration *

35060 InterSystemHO

Last GSMSystemInformation orPaging before CellChange First UMTS RRC Message Success Rate Duration

35070 InterSystemHO Last UMTS RRC MessageFirst GSM SystemInformation or Paging afterCellChange Success Rate Duration

35080 P-TMSIPTMSIReallocationCommand PTMSIReallocatioinComplete Success Rate Duration

35100

3G

Handover ActiveSetUpdate ActiveSetUpdateComplete or Failure Success Rate Duration

35101 Cell Update CellUpdate CellUpdateConfirm Success Rate Duration

35105

3G- InterFrequencyReselection Last old UARFCN report First new UARFCN report Success Rate Duration

35106

3GInterFrequency

Handover

PhysicalChannel/TransportChannel/RadioBeareReco

nfiguration

PhysicalChannel/TransportChannel/RadioBear

eReconfigurationComplete Success Rate Duration

35110HSPA CellChange

RadioBearerReconfiguration withHSDSCH_RL_indicatorfalseand true

RadioBearerReconfigurationComplete


35111

HSPA R99 LinkChange

RadioBearerReconfiguration with falseHSDSCH_RL_indicatorand delete hsdsch channel

RadioBearerReconfigurationComplete



24/131

NQDI KPIs Manual




18



35200 ResourceRadioBearerReconfiguration

RadioBearerReconfigurationComplete orFailure Success Rate Duration

35300Routing AreaUpdate URAUpdate URAUpdateConfirm Success Rate Duration

35400PhysicalChannel

PhysicalChannelReconfiguration PhysicalChannelReconfigurationComplete Success Rate Duration *

35500SignalingChannel

SignalingChannelReconfiguration SignalingChannelReconfigurationComplete Success Rate Duration *

35600TransportChannel

TransportChannelReconfiguration TransportChannelReconfigurationComplete Success Rate Duration *

35700 UTRAN Mobility UTRANMobilityInfo UTRANMobilityInfoConfirm Success Rate Duration *

35800 UE Capability UECapabilityInformation UECapabilityInformationConfirm Success Rate Duration *

Layer1 GPRS

/EDGE

CodingScheme Coding Scheme Duration Change Coding Scheme Duration +

EDGE CodingScheme Coding Scheme Duration Change Coding Scheme Duration +

TimeSlotTime Slot AllocationDuration Change Time Slot Duration +

LLC Transmission Duration Transferred Data Throughput +

RLC Transmission Duration Transferred Data Throughput +

BLER Errorneous Blocks Transferred Blocks Rate +


25/131


26/131

NQDI KPIs Manual




20



Total RSCP Measurement Sample Value +

HO Areas Different Cells Number +

UE TX POWER Measurement Sample Value +

UE RX POWER Measurement Sample Value +

BLER Measurement Sample Value +

Current SIR Measurement Sample Value *

Coverage areaper SC Measurement Sample Value +

Pilot pollution +


27/131

NQDI KPIs Manual


Chapter 2 | Services


21

2 Services

Voice

The performance KPIs for circuit switched (voice) calls are obtained with the help of a set of trigger pointsthat can be found in the layer 3 communication between the MS and the network or as Call markers in thecase of a call from the land unit.

GSM/UMTS

The call setup success rate and time is calculated for UMTS (GSM) by using the RRCConectionRequest(Channel Request in GSM) and the alerting message for the MOCs. The call retained rate and duration iscalculated using the alerting and the disconnect message.

Figure 2-1 Trace and Graph of a CS call on UMTS

The call completion rate is thereby calculated as retained calls divided by the sum of failed and successfulsetups.

Figure 2-2 Trace and Graph of a CS call on GSM

On the layer 3 plane the 3G and 2G calls are comparable, but the request for a signalization resource isdifferent. The former starts with a RRCConnectionRequest, the latter with Channel Request.

In principle a call starts with the dial command (see overview table) or the user pushing the dial button. Inreality this dial command is executed in different ways on different phones. There are phones although fully

integrated into the measurement system, simulating the manual dialling. As a consequence the timesbetween dial command and first request differ significantly on phones from different vendors. To keep thecomparability between different models the start trigger point is the first request for a signalisation channel.


28/131

NQDI KPIs Manual




22

Figure 2-3 Graph of a land originated CS call

For calls originated by the land unit, the trigger point of the call start is represented by the dial command sentto the PSTN or ISDN device.

CDMA

In CDMA there is no layer 3 signalisation that the call is connected with the called party therefore there is no

call setup KPI. However there is one for the access. But since the sequence of layer 3 messages in CDMAvoice service differs from UMTS/GSM it has separate KPIs with respective it trigger points.

Data

The data tests make use of three different protocols: TCP, UDP and WAP. Predominant is the TCP orTCP/IP protocol that supports various known applications. UDP is tested on the protocol level and with WAPthe application and the protocol is identical.

TCP/IP

The TCP/IP connection consists in general of three different phases:

Establishment, transfer and disconnect. In the Data tests individual applications are investigated (such asFTP up- and download, Email sent and receive and HTTP). While FTP has an establishment as well as adisconnect phase, the others maybe doesnt have either.

The connection establishment on the TCP level is shown inFigure 2-4 where the three phases are clearlydistinguishable. Every TCP connection has an establishment phase. However a HTTP server can end aconnection without the exchange of packets with the FIN flag set.


29/131

NQDI KPIs Manual




23

Figure 2-4 The phases of a TCP connection

For performing a HTTP download, the GET command is send right away triggering the establishment of aTCP connection. There is no further exchange of commands on the HTTP protocol level.

The GET command is set in brackets because in the trace, it does not occur at that position. It only shows

itself after the connection is established. The starting point of the access duration is the time the [SYN] issent, triggered by entering the GET command. Therefore the application download duration starts at thattime too.

As the figures suggest, there are two different download and upload times indicated. The TCP down- andupload time is the time, the network needs to actually transfer the desired bytes, which reflects the efficiencyof the connection. The application transfer duration is actually the time, which the user is experiencing. Itsthe time the application needs to execute the desired function.

The size of the file on the hard disk, (HD) divided by the time, indicated in the figure as TCP download time,is the throughput. The calculation for the uplink is analog to the downlink with the difference that anadditional time is added, which reflects the duration the last FTP Data packet needs, to arrive at the server.

EmailThe process of the test is traced on the protocol level, which is presented in the protocol info tab in NQDI.This trace represents the basis of the evaluation of the test. The steps of the Email send test are shownbelow.

Figure 2-5 Email send

The test of the application is divided into service access, service application and service throughput. The


30/131

NQDI KPIs Manual




24

service access is the time between entering the first command and the arrival of the first data packet.

The establishment of the TCP connection is triggered by the invoke of the protocol. E.g. > telnet 110

n the contrary because SMTP is running on the server, the start of the application is the actual uploadcommand to the server.

To obtain the correct TCP download duration, it is necessary to add a half-roundtrip time. This is due to theconsideration, that the last packet needs a finite time to arrive at its destination. This addition may not matchthe exact delay of the packet, but it renders the result more accurate as if there were no additional timeconsidered.

For the Email Receive this additional time is half the time between the request and the first packet.

Figure 2-6 Email receive procedure

FTP

During the FTP tests a secondary data connection is established. (In the figure below, the trace of this

secondary connection is shown with smaller arrows)

The items in brackets like (ftp) reflect commands that may not occur in the trace but have to be executed totrigger the establishment of the TCP connection. In the FTP uplink test the last packet containing data hasthe FIN flag set. This indicates that the client closes the connection.

The trigger points to calculate the TCP throughput are indicated in the following picture. It is calculated fromthe first to the last FTP Data packet and in addition the time, which the first packet needs to arrive at theclient.


31/131

NQDI KPIs Manual




25

Figure 2-7 FTP downlink

The size of the file on the hard disk, (HD) divided by the time, indicated in the figure as TCP download time,is the throughput. The calculation for the uplink is analog to the downlink with the difference that anadditional time is added, which reflects the duration the last FTP Data packet needs, to arrive at the server.

Figure 2-8 FTP uplink


32/131

NQDI KPIs Manual




26

HTTP

According to the RFC 2126 a HTTP server does not need to close the TCP connection with the setting theFIN flag. The browser can identify the end of the HTTP packet sending within the packet itself.

Ping

The ping does not use the TCP protocol but is a command of the ICMP protocol. The round trip time of aping represents the time elapsed between the sending of an ICMP echo request and the answer of the

destination. In the protocol trace, where these events are taken from, it is calculated by the differencebetween a request and the subsequent reply.

Figure 2-9 Ping test

The success rate is the number of request divided by the number of received replies.

UDPDL

The UDPDL test is a pure protocol test. There is no known application used in this test. The access durationis the time between sending the SQUDPDL command to the server and the arrival of the first packet.


33/131

NQDI KPIs Manual




27

Figure 2-10 UDPDL process

The throughput for this test is calculated by dividing the transferred data in bytes (minus the size of the firstpacket) and the time elapsed between the arrival of the first and the arrival of the last packet.

WAP

Contrary to the applications described above the WAP (wireless application protocol) test has no separatetransport protocol.

Figure 2-11 WAP test

The application starts with the connect command. The application is successful accessed when the firstpacket that contains data has arrived. This first packet can either be a result, indicating that there are othersto come, or a reply, indicating that all requested information is transferred. The last data packet is always areply.


34/131

NQDI KPIs Manual




28

Messages

MMS

The multi media messaging service (MMS) is an application of WAP and SMS. The WAP capabilities areused to transfer the data of the message while the SMS serves as the notification. Although is consists ofknown functionalities, this service is highly specific for mobile equipment and is therefore tested individually.

Figure 2-12 MMS trace

The measured parameters are those, which are specified by ETSI in the document TS 102 250-2.

SMS

Like MMS, a SMS is separated in a sending and retrieving part. For the reception it is less evident since wecannot speak of a process here. With the indication of a SMS the actual text is retrieved. There is nodownload- time available.

Figure 2-13 SMS trace

Mobile TV

DVB-H

Digital Video Broadcast (DVB) is a transmission system to delivier digital TV. The H in the name is standingfor the handheld variant, which implements a lot of special techniques particularly addressing the limitationsof mobile. Although DVB-H uses IP as a tranport layer there is no direct access to with the consequencethat the application layer information items are used as trigger events for DVB-H KPIs


35/131

NQDI KPIs Manual


Chapter 3 | Indicators on Layer 3


29

3 Indicators on Layer 3

The desired times and the success rates calculating the layer 3 KPIs are based on the messages that areexchanged between the MS and the network. The phone gives a time wise and exact trace of thesemessages as they are sent and received by the mobile station. The messages can be seen in detail in thecollection of data as well as in their post processing.

Data (PS)

The KPIs for data calls are obtained by using the resource request (RRCConnectionRequest for UMTS andChannel Request for GSM), the PDP context activation accept message and the PDP deactivation acceptmessage. PDP context setup time is the difference between the RRCConnectionRequest and the PDPcontext activation accept message, while the PDP context holding time is the difference between theoccurrence of the PDP context activation accept message and the PDP context deactivation acceptmessage.

Figure 3-1 Trace and Graph of a data call on UMTS

The information about the activation and deactivation times of the PDP context is extracted from the SMmessages, which are embedded in the RRC messages of UMTS.

Figure 3-2 PDP Context


36/131

NQDI KPIs Manual




30

Voice (CS)

Figure 3-3 Authentification and ciphering

2G

The accessibility parameter for the GSM system is the acquisition of the traffic channel and the Signalchannel

Figure 3-4 Signal channel and traffic channel assignment and release on GSM

Besides the establishment messages and the retain ability indicators there are other KPIs for the integrity ofa call.

Figure 3-5 TMSI Reallocation and Handover


37/131

NQDI KPIs Manual




31

3G

Active set update

To change the active set of the MS the network orders an active set update over the DCCH. In case of asuccessful update the MS station sends an active set update complete.

Figure 3-6 Trace of an active set update

The different phases of the call setup on the layer 3 level are shown in the figure below. The occurrence ofthe message has a timestamp that is used to calculate the times between the occurrences of subsequent

messages.

Figure 3-7 Call Setup

The messages for the radio bearer reconfiguration is shown below


38/131

NQDI KPIs Manual




32

Figure 3-8 RadioBearer reconfiguration

Cell Update

The cell update, the location update and the routing area update procedures are also traced via the RRCmessages.

Figure 3-9 Trace of the cell update


39/131

NQDI KPIs Manual




33

4 Indicators on Layer 1

The indicators from layer 1 are used for items of the report generator they are most of the times not explicitKPIs with their own ID but measurements.

Scanner Based Measurements

The desired values for the CPICHs, pilot pollution and the SC coverage are calculated by means of the dataavailable from the scanner. The phones do not provide sufficient data since they only give the Ec/Io of thecells that are monitored.

Figure 4-1 Data available from the scanner

Scrambling Code Coverage

The coverage of the scrambling code shows the percentage of the time a cell with that scrambling code wasthe strongest cell measured by the scanner.

Pilot Pollution

If at a given time more than three CPICHs are stronger than the best CPICH minus a 15 dB threshold thesituation is considered pilot pollution. The report item shows the percentage of time there was pilot pollution.

Radio based Measurements

Radio Link

ualcomm phones provide information about the active set about two times a second. In this information thesize of the active set is provided indicating the handover state. For the calculation of the distribution allsamples that of a call including the set up will be considered.


40/131

NQDI KPIs Manual




34

The information about the changes in the active set is be found the RRC messages where theActiveSetUpdate message indicates the type radio link change ordered by the network. In case a additioninformation list and a removal information list is present in the message the order is a radio link replacementif only the former is present its a radio link addition if only the latter the network orders a radio link removal

Figure 4-2 Addition and removals of radio links

All successful update orders are considered in the calculation.

Power Control

The phone provides information about the UE Tx Power several times a second and about the block error

rate (BLER)in lower frequency. The distribution of the obtained values is calculated using all measuredsamples.

Figure 4-3 Power control values


41/131

NQDI KPIs Manual


Appendix A | KPI Values


35

A KPI Values

All KPI values are stored in the NQDI Database in the KPI Result Table.

KPI Results Table

Table A-1 KPI Results Table

Column Name Type Length Description

SessionId int 4 SessionId

TestId int 4 Link to TestInfo.TestId

NetworkId int 4 Link to NetworkInfo.NetworkId

PosId int 4 Link to Position.PosId

KPIId int 4 Identification of the KPI (see KPI Overview)

StartTime Datetime Timestamp of the start trigger event

EndTime Datetime Timestamp of the end trigger event

Duration Int 4 Duration in ms

ErrorCode Int 4 KPI Status field. Used to calculate the success rate

Sum Float 4 Sum of all the values used for a KPI calculation (like sumof bytes transmitted/received, sum of LQ,

Counter Int 4 Number of values of Sum. Used to calculate the avg

Value1 Int 4 ReservedValue2 Int 4 Reserved

Value3 Varchar 255

Value4 varchar 255

Value5 Varchar 255

Accessibility Records

Voice

Field Value Description

KPIId 10100 Voice(CS) Telephony

StartTime GSM: Timestamp of Channel Request.

UMTS: Timestamp of RRCConncetionRequest.

(With establishment cause originatingconversationalCall)

If not available, then RRCConnectionSetup. If not available, thenRRCConnectionSetupComplete.

ISDN/PSTN: Timestamp of Dial command sent to the board

EndTime GSM/UMTS: Timestamp of CC:Alerting. If not available, then CC:Connect. If notavailable, then CC:ConnectAcknowledge


42/131

NQDI KPIs Manual




36


KPIId 10100 Voice(CS) Telephony

Duration Time in ms between StartTime and EndTime

ErrorCode 0 = OK, see Status in the appendix

Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Direction

Value4 Name of the end event

Value5 Unused

Search scope: Session


KPIId 10102 Voice (CS) Telephony Service

StartTime CM Service Request.




Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Direction


Value5 Unused



KPIId 10105 Voice(CS) Telephony Video Setup time

StartTime Timestamp of RRCConncetionRequest. If not available, thenRRCConnectionSetupComplete.

EndTime Video Connect marker



Sum 0 Unused


43/131

NQDI KPIs Manual




37


Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Name of the start event


Value5 Unused



KPIId 10110 Voice(CS) Telephony Completion

StartTime GSM: Timestamp of Channel Request.

UMTS: Timestamp of RRCConncetionRequest. If not available,thenRRCConnectionSetup. If not available, then RRCConnectionSetupComplete.

ISDN/PSTN: Timestamp of Dial command sent to the board

EndTime GSM/UMTS: CC : Disconnect



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused


Note: Only written on successful access (10100)


KPIId 10141 Voice(CS) Paging Delay MTC

StartTime Dial Command

EndTime GSM: Paging

UMTS: RRC Paging Type1



Sum 0 Unused

Counter 0 Unused


44/131

NQDI KPIs Manual




38


KPIId 10141 Voice(CS) Paging Delay MTC

Value1 Unused

Value2 Unused

Value3 Unused


Value5 Unused


Note: MTC only


KPIId 10150 Voice(CS) Telephony MTC

StartTime Timestamp when the first Paging occured.

GSM: Paging.

UMTS: RRC Paging Type 1




Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Unused


Value5 Unused



KPIId 10151 Voice(CS) Telephony MTC intermediate

StartTime GSM: Channel Request

UMTS: RRCConnectionRequest




Sum 0 Unused


45/131

NQDI KPIs Manual




39


KPIId 10151 Voice(CS) Telephony MTC intermediate

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused



KPIId 10152 Voice(CS) Telephony MTC Request Delay

StartTime GSM: Paging

UMTS: RRCPaging Type 1

EndTime GSM: Channel Request




Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused



KPIId 10153 Telephony Random Access

StartTime Dial Command

EndTime GSM: Channel Request




Sum 0 Unused

Counter 0 Unused

Value1 Unused


46/131

NQDI KPIs Manual




40


KPIId 10153 Telephony Random Access

Value2 Unused

Value3 Unused


Value5 Unused


Note: MTC only


KPIId 10160 Voice(CS) Telephony Completion MTC (Landunit)

StartTime ISDN/PSTN: Timestamp of Dial command sent to the board

EndTime GSM: Channel Release

UMTS: RRCConnectionRelease or RRCConnectionRelease-CCCH



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused



KPIId 10165 Voice(CS) Telephony Completion MTC Paging

StartTime GSM: Paging

UMTS RRC Paging Type 1

EndTime GSM: Channel Release

UMTS: RRCConnectionRelease or RRCConnectionRelease-CCCH



Sum 0 Unused

Counter 0 Unused


47/131

NQDI KPIs Manual




41


KPIId 10165 Voice(CS) Telephony Completion MTC Paging

Value1 Unused

Value2 Unused

Value3 Unused


Value5 Unused


Data Services


KPIId 10200 Data, Email Send

StartTime Timestamp of the TCP message 25 [SYN] which is the TCP connectionestablishment and synchronization of the sequence number for SMTP (Port25)

EndTime Timestamp of the SMTP command Message Body which indicates thebegin of the message transmission



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Varchar Name of the start event

Value4 Varchar Name of the end event

Value5 Unused

Search scope: Test

Figure A-1 IP Trace of Email upload (send)


48/131

NQDI KPIs Manual




42


KPIId 10210 Data, Email Send Completion

StartTime Timestamp of the TCP message 25 [SYN] which is the TCP connectionestablishment and synchronization of the sequence number for SMTP (Port25)

EndTime Messages accepted



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test

Note: Not implemented.


KPIId 10201 Data, Email Receive

StartTime Timestamp of the TCP message 110 [SYN] which is the TCP connectionestablishment and synchronization of the sequence number for POP3 (Port110)

EndTime Timestamp of the POP message Response:+OK and any number octetsor bytes which indicates the begin of the message reception



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test


49/131

NQDI KPIs Manual




43

Figure A-2 IP Trace of an Email download (receive)


KPIId 10203 Data, IMAP Email receive LOGIN

StartTime Timestamp of the TCP message 143 [SYN] which is the TCP connectionestablishment and synchronization of the sequence number on port 143

EndTime Timestamp of the IMAP4 message Response:OK and user andauthenticated



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused


KPIId 10211 Data, Email Receive Completion

StartTime Timestamp of the TCP message 110 [SYN] which is the TCP connectionestablishment and synchronization of the sequence number for POP3 (Port

110)

EndTime Last Continuation



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused




50/131


51/131


52/131

NQDI KPIs Manual




46


KPIId 10301 Data, FTP Downlink

StartTime Timestamp of the TCP message 21 [SYN] which is the TCP connectionestablishment and synchronization of the sequence number for FTP (Port21)

EndTime Timestamp of the first FTP Data message which indicates the firsttransmitted data packet



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test

Figure A-3 IP Trace of a FTP Downlink


53/131

NQDI KPIs Manual




47


KPIId 10308 Data, FTP Downlink (B)


EndTime Reception of [ACK] from the [SYN;ACK]



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test


KPIId 10311 Data, FTP Downlink Completion


EndTime Timestamp of the last FTP Data message which indicates the lasttransmitted data packet



Sum 0 Unused

Counter 0 Unused

Value1 UnusedValue2 Unused



Value5 Unused

Search scope: Test


KPIId 10321 Data, FTP Downlink Service Access

StartTime Start RAS Dialup (ATD Command)


54/131

NQDI KPIs Manual




48


KPIId 10321 Data, FTP Downlink Service Access

EndTime Reception of [ACK] from the [SYN;ACK]



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test


KPIId 10400 Data, HTTP Browser

StartTime Timestamp of the TCP message 80 [SYN] which is the TCP connectionestablishment and synchronization of the sequence number for HTTP (Port

80)EndTime Timestamp of the HTTP/1.1 200 OK message which indicates the

successful connection to the HTTP Server



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 URL Unused

Search scope: Test


55/131


56/131


57/131

NQDI KPIs Manual




51


KPIId 10410 Data, HTTP Browser Completion

StartTime Timestamp of the TCP message 80 [SYN] which is the TCP connectionestablishment and synchronization of the sequence number for HTTP(Port 80)

EndTime Timestamp of the last Continuation message of the connection or theHTTP/1.1 % OK message if no continuation is present. (The download issuccessful if the test as such is marked as successful by the browser)



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 URL Unused

Search scope: Test


KPIId 10411 Data, HTTP Transfer Get Completion

StartTime Timestamp of the TCP connection establishment and synchronization of thesequence number for HTTP (Port 80)

> 80 [SYN]

> http [SYN]

QP: 'TCP Socket Connecting'

EndTime Timestamp of the message which indicates the last packet has beenreceived

HTTP/1.1 200 OK

HTTP/1.0 200 OK

Last ContinuationQP: HTTP Data



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Varchar Unused


Value5 URL Unused


58/131

NQDI KPIs Manual




52

Search scope: Test


KPIId 10412 Data, HTTP Transfer Put Completion

StartTime Timestamp of the TCP connection establishment and synchronization ofthe sequence number for HTTP (Port 80)

> 80 [SYN]

> http [SYN]

QP: 'TCP Socket Connecting'

EndTime Timestamp of the message which indicates the last packet has been sentsuccessfully to the HTTP Server

First [FIN;ACK] after last Continuation

QP: Last packet sent



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 URL Unused

Search scope: Test


KPIId 10420 Data, HTTP Browser Service Access


EndTime Timestamp of the first Get Command



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test


59/131

NQDI KPIs Manual




53


KPIId 10421 Data, HTTP Transfer Get Service Access


QP: GPRS Dial

EndTime Timestamp of the first GET Command



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test


KPIId 10422 Data, HTTP Transfer Put Service Access


QP: GPRS Dial

EndTime Timestamp of the first PUT Command



Sum 0 Unused

Counter 0 Unused

Value1 UnusedValue2 Unused



Value5 Unused

Search scope: Test


60/131

NQDI KPIs Manual




54


KPIId 10500 Data, UDP DL

StartTime Timestamp of the message Request: SQUDPDL% which the connectrequest message for the SwissQual UDP Downlink test

EndTime Timestamp of first packet (Source port) after the ACK message which isthe connect ack message for the SwissQual UDPDL test



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test

Figure A-5 IP Trace of an UDPDL test


KPIId 10600 Data, Video Streaming

StartTime According to the used protocol the timestamp of the RTSP: RTSPDESCRIBE, HTTP: HTTP GET

EndTime According to the used protocol the timestamp of the RTSP: TDP Payload,HTTP: Resized or Buffering



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



61/131

NQDI KPIs Manual




55


KPIId 10600 Data, Video Streaming


Value5 Unused

Search scope: Test


KPIId 10605 Data, Video Streaming (Setup)

StartTime According to the used protocol the timestamp of the RTSP: RTSPSETUP, message

EndTime According to the used protocol the timestamp of the RTSP: TDPPayload or TCP: Loading message



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Varchar Name of the start eventValue4 Varchar Name of the end event

Value5 Unused

Search scope: Test


KPIId 10700 Data, WAP

StartTime Timestamp of the message WSP: Connect which is the connect requestmessage on the WSP/WTP protocol

EndTime Timestamp of the first WSP: Reply or WSP:Result message which is thefirst packet containing application data on the WSP/WTP port



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused


62/131

NQDI KPIs Manual




56

Search scope: Test

Figure A-6 IP Trace of a WAP download


KPIId 10710 Data, WAP Completion

StartTime Timestamp of the message WSP: Connect which is the connect request

message on the WSP/WTP protocol

EndTime Timestamp of the last WSP: Reply or WSP:Result message which isthe last packet containing application data on the WSP/WTP port


ErrorCode 0 = OK, see Status in theappendix

Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test

Messages

For the detailed mapping between the events in the log and the trigger points in the application see Data andVideo Test Scenario Manual section MMS send and MMS receive.


KPIId 10800 Messaging, MMS Send

StartTime Timestamp of the log message START, which indicates the begin of an MMSSend Test.

EndTime Timestamp of the log message TRANSMISSION STARTED, which indicatesthe begin of an MMS transmission


Status 0 = OK, see Status in the appendix

Sum 0 Unused

Counter 0 Unused


63/131


64/131


65/131

NQDI KPIs Manual




59


KPIId 10900 Messaging, SMS Send

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test

Figure A-8 Application trace of an SMS upload (sent)


KPIId 11000 PostDialDelay Active State

StartTime SIP: INVITE

EndTime 180 RINGING



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Varchar UnusedValue4 Varchar Post Dial Delay (Active State)

Value5 Unused

Search scope: Test


KPIId 11010 SIPCall Access

StartTime SIP: INVITE

EndTime SIP: 200 OK



66/131

NQDI KPIs Manual




60


KPIId 11010 SIPCall Access


Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Varchar Start Message

Value4 Varchar End Message

Value5 Unused

Search scope: Test


KPIId 11500 EVDO, PostDialDelay Dormant State

StartTime EvDO Connection Request

EndTime 180 RINGING



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused


Value4 Varchar Post Dial Delay (Dormant State)

Value5 Unused

Search scope: Test


KPIId 11600 DVB-H, Mobile DVB-H Menue

StartTime Service request

EndTime OK: Service available - Menu recognized

DVB-H service available - Service added

Failed: Service request failed - Timeout

Service request failed - User abort

Reset: Streaming started - Audio found



67/131

NQDI KPIs Manual




61


KPIId 11600 DVB-H, Mobile DVB-H Menue


Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test


KPIId 11610 DVB-H, Mobile DVB-H Channel

StartTime Channel request

EndTime OK: Streaming started - Audio found

DVB-H channel added

Failed: Channel request failed - Timeout

Channel request failed - User abort

DVB-H service lost - Coverage lostReset: Service available - Menu recognized



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Test

Data call setup


KPIId 15100 Data (PS), Attach

StartTime Timestamp of the GMM message Attach Request

EndTime Timestamp of the GMM message Attach Accept or GMM message Attachreject or Timeout, whatever comes first


68/131


69/131

NQDI KPIs Manual




63


KPIId 15102 Data (PS), Attach completion

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Timeout within Session


KPIId 15105 Data (PS), Attach (P3)

StartTime Timestamp of the attach command [AT+CGATT=1]

EndTime Timestamp of [OK] to attach command received/ (check success withAttach accept)



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused



KPIId 15200 Data (PS), Activate PDP Context

StartTime Timestamp of the SM message Activate PDP Context request

EndTime Timestamp of the SM message Activate PDP Context accept or Activate PDPContext reject or Timeout, whatever comes first



Sum 0 Unused

Counter 0 Number of requests

Value1 Unused


70/131

NQDI KPIs Manual




64


KPIId 15200 Data (PS), Activate PDP Context

Value2 Unused



Value5 Unused



KPIId 15201 Data (PS), Deactivate PDP Context

StartTime Timestamp of the SM message Deactivate PDP Context request

EndTime Timestamp of the SM message Deactivate PDP Context accept or Timeout,whatever comes first



Sum 0 Unused

Counter 0 Number of Deactivate Requests before the accept

Value1 Unused

Value2 Unused



Value5 Unused



KPIId 15202 Data (PS), Activate PDP Context (Dial up)StartTime Timestamp of the Channel Request on GSM or RRCConnectionRequest on

UMTS.

EndTime Timestamp of the SM message Activate PDP Context accept or ActivatePDP Context reject orTimeout, whatever comes first



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused


71/131

NQDI KPIs Manual




65


KPIId 15202 Data (PS), Activate PDP Context (Dial up)



Value5 Unused



KPIId 15203 Data (PS), Deactivate PDP Context Completion

StartTime Timestamp of the Channel Request on GSM or RRCConnectionRequeston UMTS.

EndTime Timestamp of the SM message Deactivate PDP Context accept orTimeout, whatever comes first



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 UnusedValue3 Varchar Unused


Value5 Unused



KPIId 15205 Data (PS), PDP Context (P3)

StartTime First IPCP Configuration Request message

EndTime Last IPCP Configuration Ack message



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused




72/131

NQDI KPIs Manual




66


KPIId 15205 Data (PS), PDP Context (P3)

Value5 Unused



KPIId 15250 Data (PS), IP Service Access

StartTime Timestamp of the SM message Activate PDP Context request

EndTime First Packet of the accessed service, this is the EndTime trigger of the followingKPIs: 10200, 10201, 10300, 10301, 10400, 10500, 10700



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Varchar Id of the KPI of the end trigger event


Value5 Unused

Search scope: Session (see EndTime KPIs)


KPIId 15300 Data (PS), Authentication

StartTime Timestamp of the GMM message Authentication and ciphering req

EndTime Timestamp of the GMM message Authentication and ciphering resp or GMMmessage Authentication and ciphering rej or GMM message Authenticationand ciphering failure or Timeout, whatever comes first



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused

Search scope: Timeout


73/131

NQDI KPIs Manual




67

Security (CS)


KPIId 15400 CS Ciphering

StartTime Timestamp of the RR message Ciphering Mode Command

EndTime Timestamp of the RR message Ciphering Mode Complete or Timeout,whatever comes first



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused



KPIId 15500 CS Authentication

StartTime Timestamp of the MM message Authentication Request

EndTime Timestamp of the MM message Authentication Response or MM messageAuthentication Reject or

MM message Authentication Failure or Timeout, whatever comes first



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused



74/131

NQDI KPIs Manual




68


KPIId 15550 CS Identity

StartTime Timestamp of the MM message Identity request

EndTime Timestamp of the MM/GMM message Identity response or Timeout,whatever comes first



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused



Value5 Unused



KPIId 15560 Call Setup Signalling 2G

StartTime Timestamp of the RR message Immediate Assignment

EndTime Timestamp of the RR message Assignment Command



Sum 0 Unused

Counter 0 Unused

Value1 Unused

Value2 Unused

Value3 Varchar Start MessageValue4 Varchar End Message

Value5 Unused



KPIId 15570 Call Setup Signalling 3G

StartTime Timestamp of the RRC message RRCConnectionSetupComplete

EndTime Timestamp of the RRC message RadioBearerSetup


manual - nqdi - kpi users guide

Documents