tems investigation kpi definitions -- mms

TEMS Investigation KPI Definitions – MMS

TEMS Investigation KPI Definitions – MMS 2009-05-14

Ascom 2009. All rights reserved.

TEMS is a trademark of Ascom. All other trademarks are the property of their respective holders.

No part of this document may be reproduced in any form without the written permission of the copyright holder.

The contents of this document are subject to revision without notice due to continued progress in methodology, design and manufacturing. Ascom shall have no liability for any error or damage of any kind resulting from the use of this document.

Public

2009-05-14 TEMS Investigation KPI Definitions – MMS

TMS-06:000081 Uen Rev C

Contents

1. Introduction ................................................................1

2. Service Independent KPIs .........................................12.1. Network Unavailability [%] ......................................................12.2. Attach Failure Ratio [%] ..........................................................12.3. Attach Setup Time [s]..............................................................22.4. PDP Context Activation Failure Ratio [%] ...............................22.5. PDP Context Activation Time [s] .............................................22.6. PDP Context Cut-off Ratio [%] ................................................3

3. MMS Specific KPIs .....................................................33.1. MMS Send Failure Ratio (MO) [%] .........................................33.2. MMS Retrieval Failure Ratio (MT) [%] ....................................43.3. MMS Send Time (MO) [s] .......................................................43.4. MMS Retrieval Time (MT) [s] ..................................................43.5. MMS Notification Failure Ratio [%] .........................................53.6. MMS Notification Time [s] .......................................................53.7. MMS End-to-End Failure Ratio [%].........................................53.8. MMS End-to-End Delivery Time (MO/MT) [s]..........................63.9. WAP Activation Failure Ratio [%] ............................................63.10. WAP Activation Time [ms] .......................................................63.11. Signaling Diagram...................................................................7


TMS-06:000081 Uen Rev C 1(7)

1. Introduction

This document describes in detail how KPIs (Key Performance Indicators) for the Multimedia Messaging Service (MMS) are calculated in TEMS Investigation 8.0.

The KPI definitions are based on ETSI TS 102 250-2 V1.4.1.

How input data to KPI calculations is collected is not dealt with in this document.

2. Service Independent KPIs

2.1. Network Unavailability [%]

Denotes the probability that no packet-switched network is available in the cell currently used by the customer.

In GSM, the phone has access to a PS network if it has received System Information 13. This message is read once per KPI measurement cycle, at the beginning of the cycle.

In WCDMA, matters are simpler: the phone is always known to have access to a PS network.

The information element "Mode - System" in TEMS Investigation indicates whether the phone is connected to a WCDMA or a GSM network.

Because of the nature of this KPI, no start or stop triggers can be identified for it in the signaling diagrams.

2.2. Attach Failure Ratio [%]

Denotes the probability that a subscriber cannot attach to the GPRS/UMTS PS network:

Start trigger: Phone sending Attach Request message.Trigger points 1 and 28 in section 3.11

Stop trigger: Phone receiving Attach Accept/Reject message.Trigger points 4 and 31 in section 3.11

# of unsuccessful attempts to access PS networkNetwork Unavailability [%] = -------------------------------------------------------------------- x 100

total # of attempts to access PS network

# of unsuccessful attach attemptsAttach Failure Ratio [%] = ----------------------------------------------- x 100 total # of attach attempts


2(7) Public

2.3. Attach Setup Time [s]

Denotes the length of the time period taken to attach to the GPRS/UMTS PS network:

Start trigger: Phone sending Attach Request message.Trigger points 1 and 28 in section 3.11

Stop trigger: Phone receiving Attach Accept message.Trigger points 4 and 31 section 3.11

2.4. PDP Context Activation Failure Ratio [%]

Denotes the probability that the PDP context cannot be activated. It is the ratio of unsuccessful PDP context activation attempts to the total number of PDP context activation attempts:

Start trigger: Phone sending PDP Context Activation Request message.Trigger points 5 and 34 in section 3.11

Stop trigger: Phone receiving PDP Context Activation Accept message.Trigger points 8 and 37 in section 3.11

2.5. PDP Context Activation Time [s]

Denotes the length of the time period taken to activate a PDP context:

Start trigger: Phone sending PDP Context Activation Request message.Trigger point 5 and 34 in section 3.11

Stop trigger: Phone receiving PDP Context Activation Accept message.Trigger point 8 and 37 in section 3.11

PDP Context Activation Time [s] = tPDP Context Activation Accept – tPDP Context Activation Request

Attach Setup Time [s] = tAttach Accept – tAttach Request

# of unsuccessful PDP context activation attemptsPDP Context Activation Failure Ratio [%] = ---------------------------------------------------------------------- x 100

total # of PDP context activation attempts


TMS-06:000081 Uen Rev C 3(7)

2.6. PDP Context Cut-off Ratio [%]

Denotes the probability that a PDP context is deactivated without this being initiated intentionally by the user:

Start trigger: Phone receiving PDP Context Activation Accept message.Trigger points 8 and 37 in section 3.11

Stop trigger: Phone receiving the last data packet containing content.Trigger points 21 and 50 in section 3.11

PDP context deactivation not initiated intentionally by the user can be caused by either SGSN failure or GGSN failure, so the PDP context may be deactivated either by the SGSN or by the GGSN.

Note: The precondition for measuring this parameter is that a PDP context has been successfully established.

3. MMS Specific KPIs

3.1. MMS Send Failure Ratio (MO) [%]

Denotes the probability that the subscriber cannot send an MMS message despite having requested to do so by pushing the “send” button:

(The chain of operations is: PDP Context Activation Service Access WAP Activation MMS Send.)

Start trigger: Activate PDP Context Request.Trigger point 5 in section 3.11

Stop trigger: MMS Send Confirm received.Trigger point 21 in section 3.11

# of PDP context deactivations (not initiated by user)PDP Context Cut-off Ratio [%] = ------------------------------------------------------------------------ x 100

total # of successfully activated PDP contexts

# of unsuccessful MMS send attemptsMMS Send Failure Ratio [%] = ---------------------------------------------------- x 100

total # of MMS send attempts


4(7) Public

3.2. MMS Retrieval Failure Ratio (MT) [%]

Denotes the probability that the MMS message cannot be downloaded by the receiving party’s phone, although the latter has received an MMS notification:

Start trigger: MMS Send Confirm received.Trigger point 33 in section 3.11

Stop trigger: MMS Notification Indication received.Trigger point 50 in section 3.11

3.3. MMS Send Time (MO) [s]

Denotes the length of time (in seconds) elapsing from the moment the sender pushes the “send” button until the MMS data transfer to the MMSC is completed:


Stop trigger: MMS Send Confirm received.Trigger point 21 in section 3.11

3.4. MMS Retrieval Time (MT) [s]

Denotes the length of time (in seconds) elapsing from the WAP Get Request until the completion of the MMS download from the MMSC:



MMS Retrieval Time (MT) [s] = tMMS from MMSC complete – tWAP Get Request

MMS Send Time (MO) [s] = tMMS to MMSC complete – tMMS sent

# of failed MMS download attemptsMMS Retrieval Failure Ratio (MT) [%] = ----------------------------------------------- x 100

total # of MMS download attempts


TMS-06:000081 Uen Rev C 5(7)

3.5. MMS Notification Failure Ratio [%]

Denotes the probability that the Multimedia Messaging Service is not able to deliver a notification of a successfully sent MMS message to the receiving party’s phone:



3.6. MMS Notification Time [s]

Denotes the length of time (in seconds) elapsing from the moment the MMS data transfer to the MMSC is completed until the receiving party receives the MMS notification:



3.7. MMS End-to-End Failure Ratio [%]

Denotes the probability that an MMS cannot be conveyed successfully from sender to receiver, that is, a failure occurs somewhere along the line after the sender has pressed the “send” button and before the receiver is able to download it:


Stop trigger: MMS Notify Response Indicator received.Trigger point 50 in section 3.11

# of failed MMS transmissionsMMS End-to-End Failure Ratio [%] = ------------------------------------------- x 100

total # of MMS send attempts

MMS Notification Time [s] = tMMS Notification Indication – tMMS to MMSC complete

# of failed MMS notificationsMMS Notification Failure Ratio [%] = ------------------------------------------------------------ x 100

total # of successfully sent MMS messages


6(7) Public

3.8. MMS End-to-End Delivery Time (MO/MT) [s]

Denotes the length of time (in seconds) elapsing from the moment the sender pushes the “send” button until the receiver has completed the MMS download from the MMSC:


Stop trigger: MMS Notify Response Indicator received.Trigger point 50 in section 3.11

3.9. WAP Activation Failure Ratio [%]

Denotes the probability that the subscriber cannot activate the WAP session:

Start trigger: WSP Connect Request sent.Trigger points 9 and 38 in section 3.11

Stop trigger: WSP Connect Reply received.Trigger points 12 and 41 in section 3.11

3.10. WAP Activation Time [ms]

Denotes the length (in ms) of the time period taken to activate the WAP session:

Start trigger: WSP Connect Request sent.Trigger points 9 and 38 in section 3.11

Stop trigger: WSP Connect Reply received.Trigger points 12 and 41 in section 3.11

WAP Activation Time [ms] = tWSP Connect Reply – tWSP Connect Request

# of failed WAP activationsWAP Activation Failure Ratio [%] = ----------------------------------------------- x 100

total # of WAP activation requests

MMS End-to-End Delivery Time (MO/MT) [s] = tMMS from MMSC complete – tMMS sent


TMS-06:000081 Uen Rev C 7(7)

3.11. Signaling Diagram

MO Network

WSP Connect Request

WSP Connect Reply

MMS m-send.req

WTP [ACK]

WTP [ACK]

MMS m-send.conf

WTP [ACK]

WSP Disconnect

MMS m-send.req

WTP [ACK]

1718

20

19

23

13

15

9

12

22

27

25

21

18

26

24

14

16

10

11

Attach Request

Attach Response

PDP Context Activation Accept

PDP Context Activation5

8

1

4

6

7

2

3

PDP

Attach

Send

MT

28

44

47

33

38

37

41

42

31

34

PDP Context Activation Accept

WSP Connect Request

WTP [ACK]

WSP Connect Reply

WSP/HTTP Get Request

WTP [ACK]

MMS m-notifyResp.ind

WTP [ACK]

MMS m-retrieve.conf

WSP Disconnect

45

40

43

36

39

51

55

46

48

52

Attach Request

Attach Response

PDP Context Activation

MMS m-notification.ind32

35

29

30

49

50

53

54

PDP

Receive

Notification

WAP

WAP

Attach

tems investigation kpi definitions -- mms

Documents