Download - TEMS Investigation KPI Definitions -- MMS
TEMS Investigation KPI Definitions – MMS
TEMS Investigation KPI Definitions – MMS 2009-05-14
Ascom 2009. All rights reserved.
TEMS is a trademark of Ascom. All other trademarks are the property of their respective holders.
No part of this document may be reproduced in any form without the written permission of the copyright holder.
The contents of this document are subject to revision without notice due to continued progress in methodology, design and manufacturing. Ascom shall have no liability for any error or damage of any kind resulting from the use of this document.
Public
2009-05-14 TEMS Investigation KPI Definitions – MMS
TMS-06:000081 Uen Rev C
Contents
1. Introduction ................................................................1
2. Service Independent KPIs .........................................12.1. Network Unavailability [%] ......................................................12.2. Attach Failure Ratio [%] ..........................................................12.3. Attach Setup Time [s]..............................................................22.4. PDP Context Activation Failure Ratio [%] ...............................22.5. PDP Context Activation Time [s] .............................................22.6. PDP Context Cut-off Ratio [%] ................................................3
3. MMS Specific KPIs .....................................................33.1. MMS Send Failure Ratio (MO) [%] .........................................33.2. MMS Retrieval Failure Ratio (MT) [%] ....................................43.3. MMS Send Time (MO) [s] .......................................................43.4. MMS Retrieval Time (MT) [s] ..................................................43.5. MMS Notification Failure Ratio [%] .........................................53.6. MMS Notification Time [s] .......................................................53.7. MMS End-to-End Failure Ratio [%].........................................53.8. MMS End-to-End Delivery Time (MO/MT) [s]..........................63.9. WAP Activation Failure Ratio [%] ............................................63.10. WAP Activation Time [ms] .......................................................63.11. Signaling Diagram...................................................................7
2009-05-14 TEMS Investigation KPI Definitions – MMS
TMS-06:000081 Uen Rev C 1(7)
1. Introduction
This document describes in detail how KPIs (Key Performance Indicators) for the Multimedia Messaging Service (MMS) are calculated in TEMS Investigation 8.0.
The KPI definitions are based on ETSI TS 102 250-2 V1.4.1.
How input data to KPI calculations is collected is not dealt with in this document.
2. Service Independent KPIs
2.1. Network Unavailability [%]
Denotes the probability that no packet-switched network is available in the cell currently used by the customer.
In GSM, the phone has access to a PS network if it has received System Information 13. This message is read once per KPI measurement cycle, at the beginning of the cycle.
In WCDMA, matters are simpler: the phone is always known to have access to a PS network.
The information element "Mode - System" in TEMS Investigation indicates whether the phone is connected to a WCDMA or a GSM network.
Because of the nature of this KPI, no start or stop triggers can be identified for it in the signaling diagrams.
2.2. Attach Failure Ratio [%]
Denotes the probability that a subscriber cannot attach to the GPRS/UMTS PS network:
Start trigger: Phone sending Attach Request message.Trigger points 1 and 28 in section 3.11
Stop trigger: Phone receiving Attach Accept/Reject message.Trigger points 4 and 31 in section 3.11
# of unsuccessful attempts to access PS networkNetwork Unavailability [%] = -------------------------------------------------------------------- x 100
total # of attempts to access PS network
# of unsuccessful attach attemptsAttach Failure Ratio [%] = ----------------------------------------------- x 100 total # of attach attempts
TEMS Investigation KPI Definitions – MMS 2009-05-14
2(7) Public
2.3. Attach Setup Time [s]
Denotes the length of the time period taken to attach to the GPRS/UMTS PS network:
Start trigger: Phone sending Attach Request message.Trigger points 1 and 28 in section 3.11
Stop trigger: Phone receiving Attach Accept message.Trigger points 4 and 31 section 3.11
2.4. PDP Context Activation Failure Ratio [%]
Denotes the probability that the PDP context cannot be activated. It is the ratio of unsuccessful PDP context activation attempts to the total number of PDP context activation attempts:
Start trigger: Phone sending PDP Context Activation Request message.Trigger points 5 and 34 in section 3.11
Stop trigger: Phone receiving PDP Context Activation Accept message.Trigger points 8 and 37 in section 3.11
2.5. PDP Context Activation Time [s]
Denotes the length of the time period taken to activate a PDP context:
Start trigger: Phone sending PDP Context Activation Request message.Trigger point 5 and 34 in section 3.11
Stop trigger: Phone receiving PDP Context Activation Accept message.Trigger point 8 and 37 in section 3.11
PDP Context Activation Time [s] = tPDP Context Activation Accept – tPDP Context Activation Request
Attach Setup Time [s] = tAttach Accept – tAttach Request
# of unsuccessful PDP context activation attemptsPDP Context Activation Failure Ratio [%] = ---------------------------------------------------------------------- x 100
total # of PDP context activation attempts
2009-05-14 TEMS Investigation KPI Definitions – MMS
TMS-06:000081 Uen Rev C 3(7)
2.6. PDP Context Cut-off Ratio [%]
Denotes the probability that a PDP context is deactivated without this being initiated intentionally by the user:
Start trigger: Phone receiving PDP Context Activation Accept message.Trigger points 8 and 37 in section 3.11
Stop trigger: Phone receiving the last data packet containing content.Trigger points 21 and 50 in section 3.11
PDP context deactivation not initiated intentionally by the user can be caused by either SGSN failure or GGSN failure, so the PDP context may be deactivated either by the SGSN or by the GGSN.
Note: The precondition for measuring this parameter is that a PDP context has been successfully established.
3. MMS Specific KPIs
3.1. MMS Send Failure Ratio (MO) [%]
Denotes the probability that the subscriber cannot send an MMS message despite having requested to do so by pushing the “send” button:
(The chain of operations is: PDP Context Activation Service Access WAP Activation MMS Send.)
Start trigger: Activate PDP Context Request.Trigger point 5 in section 3.11
Stop trigger: MMS Send Confirm received.Trigger point 21 in section 3.11
# of PDP context deactivations (not initiated by user)PDP Context Cut-off Ratio [%] = ------------------------------------------------------------------------ x 100
total # of successfully activated PDP contexts
# of unsuccessful MMS send attemptsMMS Send Failure Ratio [%] = ---------------------------------------------------- x 100
total # of MMS send attempts
TEMS Investigation KPI Definitions – MMS 2009-05-14
4(7) Public
3.2. MMS Retrieval Failure Ratio (MT) [%]
Denotes the probability that the MMS message cannot be downloaded by the receiving party’s phone, although the latter has received an MMS notification:
Start trigger: MMS Send Confirm received.Trigger point 33 in section 3.11
Stop trigger: MMS Notification Indication received.Trigger point 50 in section 3.11
3.3. MMS Send Time (MO) [s]
Denotes the length of time (in seconds) elapsing from the moment the sender pushes the “send” button until the MMS data transfer to the MMSC is completed:
Start trigger: Activate PDP Context Request.Trigger point 5 in section 3.11
Stop trigger: MMS Send Confirm received.Trigger point 21 in section 3.11
3.4. MMS Retrieval Time (MT) [s]
Denotes the length of time (in seconds) elapsing from the WAP Get Request until the completion of the MMS download from the MMSC:
Start trigger: MMS Send Confirm received.Trigger point 33 in section 3.11
Stop trigger: MMS Notification Indication received.Trigger point 50 in section 3.11
MMS Retrieval Time (MT) [s] = tMMS from MMSC complete – tWAP Get Request
MMS Send Time (MO) [s] = tMMS to MMSC complete – tMMS sent
# of failed MMS download attemptsMMS Retrieval Failure Ratio (MT) [%] = ----------------------------------------------- x 100
total # of MMS download attempts
2009-05-14 TEMS Investigation KPI Definitions – MMS
TMS-06:000081 Uen Rev C 5(7)
3.5. MMS Notification Failure Ratio [%]
Denotes the probability that the Multimedia Messaging Service is not able to deliver a notification of a successfully sent MMS message to the receiving party’s phone:
Start trigger: MMS Send Confirm received.Trigger point 21 in section 3.11
Stop trigger: MMS Notification Indication received.Trigger point 33 in section 3.11
3.6. MMS Notification Time [s]
Denotes the length of time (in seconds) elapsing from the moment the MMS data transfer to the MMSC is completed until the receiving party receives the MMS notification:
Start trigger: MMS Send Confirm received.Trigger point 21 in section 3.11
Stop trigger: MMS Notification Indication received.Trigger point 33 in section 3.11
3.7. MMS End-to-End Failure Ratio [%]
Denotes the probability that an MMS cannot be conveyed successfully from sender to receiver, that is, a failure occurs somewhere along the line after the sender has pressed the “send” button and before the receiver is able to download it:
Start trigger: Activate PDP Context Request.Trigger point 5 in section 3.11
Stop trigger: MMS Notify Response Indicator received.Trigger point 50 in section 3.11
# of failed MMS transmissionsMMS End-to-End Failure Ratio [%] = ------------------------------------------- x 100
total # of MMS send attempts
MMS Notification Time [s] = tMMS Notification Indication – tMMS to MMSC complete
# of failed MMS notificationsMMS Notification Failure Ratio [%] = ------------------------------------------------------------ x 100
total # of successfully sent MMS messages
TEMS Investigation KPI Definitions – MMS 2009-05-14
6(7) Public
3.8. MMS End-to-End Delivery Time (MO/MT) [s]
Denotes the length of time (in seconds) elapsing from the moment the sender pushes the “send” button until the receiver has completed the MMS download from the MMSC:
Start trigger: Activate PDP Context Request.Trigger point 5 in section 3.11
Stop trigger: MMS Notify Response Indicator received.Trigger point 50 in section 3.11
3.9. WAP Activation Failure Ratio [%]
Denotes the probability that the subscriber cannot activate the WAP session:
Start trigger: WSP Connect Request sent.Trigger points 9 and 38 in section 3.11
Stop trigger: WSP Connect Reply received.Trigger points 12 and 41 in section 3.11
3.10. WAP Activation Time [ms]
Denotes the length (in ms) of the time period taken to activate the WAP session:
Start trigger: WSP Connect Request sent.Trigger points 9 and 38 in section 3.11
Stop trigger: WSP Connect Reply received.Trigger points 12 and 41 in section 3.11
WAP Activation Time [ms] = tWSP Connect Reply – tWSP Connect Request
# of failed WAP activationsWAP Activation Failure Ratio [%] = ----------------------------------------------- x 100
total # of WAP activation requests
MMS End-to-End Delivery Time (MO/MT) [s] = tMMS from MMSC complete – tMMS sent
2009-05-14 TEMS Investigation KPI Definitions – MMS
TMS-06:000081 Uen Rev C 7(7)
3.11. Signaling Diagram
MO Network
WSP Connect Request
WSP Connect Reply
MMS m-send.req
WTP [ACK]
WTP [ACK]
MMS m-send.conf
WTP [ACK]
WSP Disconnect
MMS m-send.req
WTP [ACK]
1718
20
19
23
13
15
9
12
22
27
25
21
18
26
24
14
16
10
11
Attach Request
Attach Response
PDP Context Activation Accept
PDP Context Activation5
8
1
4
6
7
2
3
PDP
Attach
Send
MT
28
44
47
33
38
37
41
42
31
34
PDP Context Activation Accept
WSP Connect Request
WTP [ACK]
WSP Connect Reply
WSP/HTTP Get Request
WTP [ACK]
MMS m-notifyResp.ind
WTP [ACK]
MMS m-retrieve.conf
WSP Disconnect
45
40
43
36
39
51
55
46
48
52
Attach Request
Attach Response
PDP Context Activation
MMS m-notification.ind32
35
29
30
49
50
53
54
PDP
Receive
Notification
WAP
WAP
Attach