flow benchmarking - discoverflow.co · flow benchmarking initial benchmarking ... bridgetown 2g...

54
FLOW benchmarking Initial Benchmarking Report All rights reserved. The information in this document is the property of MSI LLC except if specifically authorized in writing by MSI LLC. The receiver of this document shall keep the information contained herein confidential and shall protect the same in whole or in part from disclosure and dissemination to third parties. Disclosure and disseminations to the receiver's employees shall only be made on a strict need to know basis. The information in this document is subject to change without notice and MSI LLC assumes no responsibility for factual inaccuracies or typographical errors Benchmarking Report 1

Upload: trinhhuong

Post on 15-Jul-2018

273 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

FLOW benchmarking Initial Benchmarking Report All rights reserved. The information in this document is the property of MSI LLC except if specifically authorized in writing by MSI LLC. The receiver of this document shall keep the information contained herein confidential and shall protect the same in whole or in part from disclosure and dissemination to third parties. Disclosure and disseminations to the receiver's employees shall only be made on a strict need to know basis. The information in this document is subject to change without notice and MSI LLC assumes no responsibility for factual inaccuracies or typographical errors

Benchmarking

Report 1

08 Fall

Page 2: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

Version Date Change Author

1.0 November 23th, 2015

Original version DBossa

2.0 November 24th, 2015

GArarat

2.1 November 30th, 2015

With zoom GArarat

Page 3: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

Table of Contents

1. GENERAL DESCRIPTION 5

1.1 Report information 5

1.1.1 Equipment 6

2. TEST PROTOCOL 7

3. GEO DISTRIBUTION 8

4. MEASUREMENTS 10

4.1 Short call 11

4.1.1 Band 11

4.1.2 3G – Short Call – Coverage. Map 13

4.1.3 3G – Short Call – Coverage. Stats 15

4.1.4 3G – Short call – Quality. Map 16

4.1.5 3G – Short call – Quality. Stats 18

4.1.6 3G – Short call - UE Tx Power. Map 19

4.1.7 3G -Short Call Events 21

4.2 Long Call 24

4.2.1 3G – Long Call – Coverage. Map 24

4.2.2 3G – Long Call – Coverage. Stats 26

4.2.3 3G – Long Call – Quality. Map 27

Page 4: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.2.4 3G – Long Call – Quality. Stats 29

4.2.5 3G – Long Call - UE Tx Power. Map 30

4.2.6 3G - Long Call Events 32

4.3 3G Idle Mode 35

4.3.1 3G – Idle Mode – Coverage. Map 35

4.3.2 3G –Idle Mode – Coverage. Stats 37

4.3.3 3G –Idle Mode – Quality. Map 38

4.3.4 3G – Idle Mode – Quality. Stats 40

4.3.5 3G - ldle Events 41

4.4 Data Mode (FTP DL) 42

4.4.1 3G – Data FTP DL – Coverage. Map 42

4.4.2 3G – Data FTP DL – Coverage. Stats 44

4.4.3 3G – Data FTP DL – Quality. Map 45

4.4.4 3G – Data FTP DL – Quality. Stats 47

4.4.5 3G – Data FTP DL – Channel Quality Indicator (CQI). Map 48

4.4.6 3G – Data FTP DL – Channel Quality Indicator (CQI). Stats 50

4.4.7 3G – Data FTP DL – Throughput DL. Map 51

4.4.8 3G – Data FTP DL – Throughput DL. Stats 53

4.4.9 Data FTP DL Events 54

Page 5: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

1. General description

1.1 Reportinformation[SB1]

This document contains the DriveTest report, performed along main roads of Barbadosevaluating the data quality services dataand the voice services offered by FLOW and Digicel. 731 km driven in Barbados total route

BRIDGETOWN 2G Oct-24 11:00am – 06:00pm: Bridgetown south St. Lawrence Gap up to center Oct-25 08:00am – 12:00pm: Bridgetown center. Oct-26 08:00am – 12:00pm: Bridgetown north, center up to Paradise Beach 3G Oct-27 03:00pm – 04:00pm: Bridgetown south St. Lawrence Gap up to center Oct-28 12:00pm – 06:00pm: Bridgetown south, St. Lawrence Gap up to center Oct-29 10:00am – 06:00pm: Bridgetown north, center up to Paradise Beach OUTSIDE BRIDGETOWN 2G & 3G Oct-30 01:00pm – 07:00pm: St. Lawrence Gap up to Thicket Gardens Oct-31 09:00am – 05:00pm: Thicket Gardens up to Bathsheba Nov-01 08:00am – 07:00pm: North Barbados, Bathsheba up to Retreat and West Coast Nov-03 01:00pm – 05:00pm: Holetown up to Paradise Beach

Page 6: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

BRIDGETOWN 2G & 3G Nov-06 11:00am – 06:30pm: Bridgetown south St. Lawrence Gap up to center Nov-07 08:00am – 12:00pm: Bridgetown south, St. Lawrence Gap up to center Nov-08 12:00pm – 06:00pm: Bridgetown north, center up to Paradise Beach OUTSIDE BRIDGETOWN 2G & 3G Nov-09 12:00pm – 07:00pm: St. Lawrence Gap up to Thicket Gardens Nov-10 09:00am – 06:00pm: Thicket Gardens up to Belleplaine Nov-11 09:00am – 03:00pm: North Barbados, Belleplaine up to Retreat and West Coast

1.1.1 Equipment[SB2][GA3]

The data collection was performed using TEMS Investigation 17.1:

Samsung Galaxy Note SM-N910F

Page 7: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

2. Test Protocol

Device # Network Technology Frequency ( MHz) Call Test Mode Time configuration

EQ1 FLOW WCDMA 850 Idle 3G forced

EQ2 Digicel WCDMA 2100 Idle 3G forced

EQ3 FLOW WCDMA 850 Short call 5 sec duration traffic + 10 sec

Idle[SB4]

EQ4 Digicel WCDMA 2100 Short call 5 sec duration traffic + 10 sec

Idle[SB5]

EQ5 FLOW WCDMA 850 Long call No LC duration traffic (Continuous)[SB6][GA7]

EQ6 Digicel WCDMA 2100 Long call No LC duration traffic

(Continuous)[SB8]

EQ7 FLOW WCDMA 850 Data download 2 Gb file[SB9]*

EQ8 Digicel WCDMA 2100 Data download 2 Gb file*

* DL location: First round: ftp://209.40.204.212/home/msi02 Second round: ftp://ftp.commpserv.com Currently: ftp://190.24.88.131:21

Page 8: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

3. Geo distribution

Page 9: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 10: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4. Measurements

Follows a full set of maps and charts obtained after post process the logs captured on the field. Raw logs are available

Page 11: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.1 Short Call

4.1.1 Band[SB10][GA11]

Page 12: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 13: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.1.2 3G – Short Call – Coverage. Map

Page 14: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 15: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.1.3 3G – Short Call – Coverage. Stats[SB12][GA13]

FLOW Digicel[SB14][GA15]

% Good coverage (up to -85) 66.473 49.842

% Coverage (up to -110) 97.668 99.687[SB16][GA17]

Page 16: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.1.4 3G – Short Call – QualityMap

Page 17: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 18: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.1.5 3G Short Call – Quality Stats[SB18]

FLOW Digicel[SB19][GA20]

% Good quality (up to -12) 59.02 86.671

% Quality (up to -18) 98.705 98.727

Page 19: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.1.6 3G – Short call - UE Tx Power. Map

Page 20: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 21: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.1.7 3G -Short Call Events

Page 22: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 23: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

EVENTS TABLE SHORT CALL

FLOW DIGICEL

CALL ATTEMPTS 4271 100,00%[SB21][GA22] 3965 100,00%

SUCCESSFUL CALLS 4245 99,39% 3948 99,57%

ACCESS FAIL 26 0,61% 17 0,43%

CALL COMPLETED 4242 99,93% 3946 99,95%

DROPPED CALL 3 0,07% 2 0,05%

HO OK[SB23][GA24] 9227 100,00% 9808 99,99%

HO FAILURE 0 0,00% 1 0,01%

HO ATTEMPTS 9227 100,00%[SB25][GA26] 9809 100,00%

CALL SETUP TIME TABLE[SB27] (seconds) 1,777 2,516

Page 24: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.2 Long Call

4.2.1 3G – Long Call – Coverage. Map

Page 25: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 26: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.2.2 3G – Long Call – Coverage. Stats

FLOW Digicel[SB28][GA29]

% Good coverage (up to -85) 69.63 44.117

% Coverage (up to -110) 99.969 98.612

Page 27: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.2.3 3G – Long Call – Quality. Map

Page 28: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 29: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.2.4 3G – Long Call – Quality. Stats

FLOW Digicel

% Good quality (up to -12) 61.811 85.202

% Quality (up to -18) 99.413 99.381

Page 30: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.2.5 3G – Long Call - UE Tx Power. Map

Page 31: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 32: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.2.6 3G - Long CallEvents

Page 33: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 34: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

EVENTS TABLE LONG CALL[SB30]

FLOW DIGICEL

CALL ATTEMPTS 13 100,00% 57 100,00%

SUCCESSFUL CALLS 13 100,00% 56 98,25%

ACCESS FAIL 0 0,00% 1 1,75%

CALL COMPLETED 4 30,77% 27 48,21%

DROPPED CALL 9 69,23% 29 51,79%

HO SUCCESS 19204 100,00% 28964 100,00%

HO FAILURE 0 0,00% 0 0,00%

HO ATTEMPTS 19204 100,00% 28964 100,00%

CALL SETUP TIME TABLE 1,796 6,098

Page 35: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.3 3G Idle Mode

4.3.1 3G – Idle Mode – Coverage. Map

Page 36: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 37: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.3.2 3G –Idle Mode – Coverage. Stats

FLOW Digicel

% Good coverage (up to -85) 53.739 75.087

% Coverage (up to -110) 98.76 99.807

Page 38: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.3.3 3G –Idle Mode – Quality. Map

Page 39: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 40: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.3.4 3G – Idle Mode – Quality. Stats

FLOW Digicel

% Good quality (up to -12) 62.636 70.478

% Quality (up to -18) 96.45 98.072

Page 41: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.3.5 3G - ldleEvents

EVENTS TABLE IDLE

FLOW DIGICEL

Cell Reselection Attempt 2890 100% 1271 100%

Cell Reselection Fail 0 0% 0 0%

Cell Reselection OK 2890 100% 1271 100%

Page 42: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4 Data Mode (FTP DL)

4.4.1 3G – Data FTP DL – Coverage. Map

Page 43: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 44: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4.2 3G – Data FTP DL – Coverage. Stats

FLOW Digicel

% Good coverage (up to -85) 75.954 48.642

% Coverage (up to -110) 99.389 98.723

Page 45: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4.3 3G – Data FTP DL – Quality. Map

Page 46: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 47: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4.4 3G – Data FTP DL – Quality. Stats

FLOW Digicel

% Good quality (up to -12) 76.306 87.586

% Quality (up to -18) 99.937 99.152

Page 48: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4.5 3G – Data FTP DL – Channel Quality Indicator (CQI). Map

Page 49: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 50: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4.6 3G – Data FTP DL – Channel Quality Indicator (CQI). Stats

Page 51: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4.7 3G – Data FTP DL – Throughput DL. Map[SB31][GA32]

Page 52: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …
Page 53: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4.8 3G – Data FTP DL – Throughput DL. Stats

Page 54: FLOW benchmarking - discoverflow.co · FLOW benchmarking Initial Benchmarking ... BRIDGETOWN 2G & 3G ... EVENTS TABLE SHORT CALL FLOW DIGICEL CALL ATTEMPTS 4271 …

4.4.9 Data FTP DLEvents

EVENTS TABLE[SB33][GA34]

FLOW DIGICEL

FTP DOWNLOAD START 403 100% 2125 100%

FTP DOWNLOAD ERROR 39 9.68% 1839 86.54%

FTP DOWNLOAD END 364 90.32% 286 13.46%