wi-fi and lte 2.3 ghz co-location field testing pdf, 4.5 mb
TRANSCRIPT
Copyright © 2014 7signal Solutions, Inc.
Wi-Fi and LTE 2.3 GHz co-location field testing
25.9.2014
Final report
Version 1.0
Tuomas Aaltonen
Veli-Pekka Ketonen
1
Copyright © 2014 7signal Solutions, Inc.
Table of content
General Test setup Log of changes Mechanisms of possible LTE impact Ethernet performance trending Spectrum analysis SLA analysis of tests during LTE test days Day internal (24h) analysis during LTE test days
– Day 10.9– Day 11.9
Day to day comparison, LTE on/off– Retransmissions between clients and APs– Retransmissions between sensors and APs – Data rates between clients and APs– Retransmissions between sensors and APs
Challenges Observations Conclusions
2
Copyright © 2014 7signal Solutions, Inc.
General This is the final report of 2.3 GHz LTE – Wi-Fi co-location tests at Victoria station Project was a collaborative effort between Ofcom, BSkyB and 7signal Purpose of the project was to determine how much 2.3 GHz LTE transmitter impacts to nearby Wi-Fi operation
Project duration was three weeks – 1st week with LTE, one-two sensor, 2.4 GHz only
– 2nd week with LTE, four sensors, 2.4 GHz only
– 3rd week without LTE, four sensors, 2.4 GHz and 5GHz
Data collection started with one Eye sensor on 2.9. Three more eye sensors were added later to the profile; One sensor on 3.9 and two sensors on 5.9.
5 GHz radios were tested with sensor 8 starting from 5.9 (AP03 and AP06). Rest of the 5G radios were added to the test profile on 15.9 This report includes data from all the weeks e.g. LTE testing results, 2.4 GHz and 5 GHz Wi-Fi performance comparison and analysis and conclusions of the results Conclusions are presented at the end of the report
3
Copyright © 2014 7signal Solutions, Inc.
Test setup
4
Copyright © 2014 7signal Solutions, Inc.
Test setup
A LTE test transmitter and Ruckus WLAN access point were co-located 7signal Sapphire Wi-Fi service assurance and performance optimization product was used to analyze performance variations during the times when LTE transmitter was on and off Two types of 7signal Wi-Fi sensors were used
– Three 1000 series Eyes with beam steering and one smaller Micro Eye sensor were used
7signal measurement engine (Carat) was cloud based. Sensors were connected to cloud server through Ethernet. All collected data was stored to cloud
During active tests 7signal sensors measure against a test end point. This test end point was also in cloud server During the test period, Victoria station Wi-Fi access point were connected to internet through 16/1Mbit/s ADSL connection. Normally a faster multi-ADSL line has been available, but due to failure of aggregating device, only one ADSL line was available for all Wi-Fi traffic in the station
5
Copyright © 2014 7signal Solutions, Inc.Copyright © 2014 7signal Solutions, Inc.
Elements of 7signal Sapphire
Copyright © 2014 7signal Solutions, Inc.
Diagram of test setup elements
Eyes performance active and passive tests Active tests operate over the LAN and WLAN separately Passive tests capture radio packets and calculate metrics from them
Copyright © 2014 7signal Solutions, Inc.
AP and Eye locations
8
Copyright © 2014 7signal Solutions, Inc.
LTE test transmitter
9
LTE test signal was 20 MHz wide QPSK & 16QAM modulated synthesized TDD LTE traffic pattern Test signal center frequency was 2380 MHz Radiated output power levels were varied during the test
– 30, 36, 49 dBm mean EIRP values were tested
Copyright © 2014 7signal Solutions, Inc.
Eye 3 and LTE BTS
10
Copyright © 2014 7signal Solutions, Inc.
Log of changes
11
Copyright © 2014 7signal Solutions, Inc.
Test log from week 1
12
Copyright © 2014 7signal Solutions, Inc.
Test log from week 2
13
Copyright © 2014 7signal Solutions, Inc.
Test log from week 3
14
Copyright © 2014 7signal Solutions, Inc.
Mechanism of possible impact
15
Copyright © 2014 7signal Solutions, Inc.
Key aspects
The key challenge with Wi-Fi and mobile base station co-location is lack of RF filtering in receivers. Wi-Fi access points and end user radios commonly do not have any or only very limited RF filtering preventing out-of-Wi-Fi-band signals entering Wi-Fi receiver RF parts. Effective radiated signal levels from mobile network base stations may be very high (1000’s RF watts) compared signal levels used in Wi-Fi (typically below 0.1 RF watts) Unfiltered RF entering Wi-Fi receivers may degrade Wi-Fi performance in different ways Currently studied LTE band in UK is 2350-2390MHz. Likely deployment scenario is one 20 MHz carrier/base station in one site. This is also the test scenario in this study.
16
Copyright © 2014 7signal Solutions, Inc.
Main scenarios
Scenario 1:– WLAN receiver is de-senzitized due to high level RF entering the receiver– Receiver gain control circuitry may be operating incorrectly under high pout of band
RF signal influence
Scenario 2:– High level RF signals create intermodulation products within WLAN receiver which
lands on the Wi-Fi frequency band. Typically the 3rd order harmonics are most likely causes
– The main third order intermodulation products are generated between two signal as follows
• Carrier 1: Frequency 1• Carrier 2: Frequency 2• Intermodulation products:
– Frequency 2 + (Frequency 1-Frerquency 2)– Frequency 1 – (Frequency 2-Frequency 1)
– Intermodulation product may be caused of signal at different bands or from two signals in nearby band
Scenario 3:– Wide band noise leakage from nearby RF carrier to Wi-Fi band
17
Copyright © 2014 7signal Solutions, Inc.
Wi-Fi and main nearby mobile network frequency bands
18
Copyright © 2014 7signal Solutions, Inc.
3rd order interference generation scenarios: Case 1
19
Copyright © 2014 7signal Solutions, Inc.
3rd order interference generation scenarios: Case 2
20
Copyright © 2014 7signal Solutions, Inc.
3rd order interference generation scenarios: Case 3
21
Copyright © 2014 7signal Solutions, Inc.
Test scenario in this study:LTE 2.3 GHz and Wi-Fi 2.4 GHz
22
Copyright © 2014 7signal Solutions, Inc.
Ethernet performance
Sensor Ethernet port towards the cloud based test end point
23
Copyright © 2014 7signal Solutions, Inc.
Eye Ethernet tests, downlink TP(Against cloud test end point)
24
ADSL line connecting all access points to internet is a remarkable bottleneck
Copyright © 2014 7signal Solutions, Inc.
Eye Ethernet tests, downlink TP(Against cloud test end point)
25
ADSL line connecting all access points to internet is a remarkable bottleneck Wired network throughput towards the internet dropped regularly to 100-200 kbit/s range during busy traffic
Copyright © 2014 7signal Solutions, Inc.
Results and conclusions
Used 16/1 ADSL is not sufficient enough to provide well performing WLAN to Victoria station end users
This bottleneck also impacts test results in this project. Results from active end-to-end tests are mostly not limited by Wi-Fi radio connection but by the internet connection speed
This limitation caused project to focus more on radio metrics than end-to-end performance
26
Copyright © 2014 7signal Solutions, Inc.
2.4 GHz spectrum analysis
Sensors performed spectrum analysis
27
Copyright © 2014 7signal Solutions, Inc.
2.4GHz spectrum, the first week
28
No visible impact from LTE transmitter in spectrum results AP channel changes are visible in the spectrum over time
Copyright © 2014 7signal Solutions, Inc.
2.4GHz spectrum, the second week
29
No visible impact from LTE transmitter in spectrum results Some other strong non- Wi-Fi interference is visible near sensor 1 (“Standard Eye 1”)
Copyright © 2014 7signal Solutions, Inc.
2.4GHz spectrum, the third week
30
No visible impact from LTE transmitter in spectrum results Some other non- Wi-Fi interference is visible near sensor 1 (“Standard Eye 1”) This overlaps significantly with Wi-Fi channels and negatively impacts to Wi-Fi operation
Copyright © 2014 7signal Solutions, Inc.
Spectrum results, 11.9 LTE on/off
31
Copyright © 2014 7signal Solutions, Inc.
Spectrum results and conclusions
No clear impact is visible in the 2.4 GHz band spectrum during the LTE is transmissions. This is the case even when the Tx power is set to maximum (49 dBm) Significant non Wi-Fi interference is present near to Eye 1. Interferer is continuous, non pulsed signal type signal. This causes continuous spikes is spectrum which overlap with Wi-Fi channels and degrade Wi-Fi performance Spectrum results shows that some APs are changing the channel often and they are using all available channels. Some of the APs change their channel more often than others. This seems to be the case especially near to Eye 1 where the interference is high. Ruckus AP Channel Fly tries to avoid the interference, but since its across the band, that’s not helping
32
Spectrum results shows also that there is also other interference. For example Bluetooth signal can be seen in spectrum as narrow 1 or 2 MHz spaced spikes across the whole 2.4 GHz band
Copyright © 2014 7signal Solutions, Inc.
SLA table analysisLTE on / LTE OFF, 9-13.9
Network performance is compared to pre-defined thresholds
33
Copyright © 2014 7signal Solutions, Inc.
SLA thresholds used in this report
34
Copyright © 2014 7signal Solutions, Inc.
9.9 2.4 GHz SLA table, averaged data (All APs)
35
General performance level is modest
Copyright © 2014 7signal Solutions, Inc.
10.9 2.4GHz SLA table, averaged data (All APs)
36
=> No clear impact from LTE
Copyright © 2014 7signal Solutions, Inc.
11.9 2.4G SLA table, averaged data (All APs)
37
=> No clear impact from LTE
Copyright © 2014 7signal Solutions, Inc.
12.9 2.4G SLA table, averaged data (All APs)
38
General performance level is modest
Copyright © 2014 7signal Solutions, Inc.
Single AP SLAs, LTE on times only, 9-13.9
39
• • •
• • •
=> No clear difference between LTE ON days and LTE OFF days
Copyright © 2014 7signal Solutions, Inc.
Single AP SLAs, LTE on times only, 9-13.9
40
=> No clear difference between LTE ON days and LTE OFF days
Copyright © 2014 7signal Solutions, Inc.
24h LTE on/off testing results, 10.9
2.4GHz band AP graphs, 24h history with 10min average
41
Copyright © 2014 7signal Solutions, Inc.
# of clients on AP BSSID
42
Copyright © 2014 7signal Solutions, Inc.
AP signal strenght at Eye
43
Copyright © 2014 7signal Solutions, Inc.
Beacon availability
44
Copyright © 2014 7signal Solutions, Inc.
Radio attach success
45
Copyright © 2014 7signal Solutions, Inc.
Latency
46
Copyright © 2014 7signal Solutions, Inc.
TCP download throughput
47
Copyright © 2014 7signal Solutions, Inc.
TCP upload throughput
48
Copyright © 2014 7signal Solutions, Inc.
Eye retry rates in TCP test
49
Copyright © 2014 7signal Solutions, Inc.
AP retry rates in TCP test
50
Copyright © 2014 7signal Solutions, Inc.
AP retries
51
Copyright © 2014 7signal Solutions, Inc.
Client retries
52
Copyright © 2014 7signal Solutions, Inc.
WLAN utilization
53
Copyright © 2014 7signal Solutions, Inc.
Probe density from AP
54
Copyright © 2014 7signal Solutions, Inc.
24h LTE on/off testing results, 11.9
55
Copyright © 2014 7signal Solutions, Inc.
# of clients
56
Copyright © 2014 7signal Solutions, Inc.
AP signal strenght at Eye
57
Copyright © 2014 7signal Solutions, Inc.
Beacon availability
58
Copyright © 2014 7signal Solutions, Inc.
Radio attach success
59
Copyright © 2014 7signal Solutions, Inc.
Latency
60
Copyright © 2014 7signal Solutions, Inc.
TCP download throughput
61
Copyright © 2014 7signal Solutions, Inc.
TCP upload throughput
62
Copyright © 2014 7signal Solutions, Inc.
Eye retry rates in TCP test
63
Copyright © 2014 7signal Solutions, Inc.
AP retry rates in TCP test
64
Copyright © 2014 7signal Solutions, Inc.
AP retries
65
Copyright © 2014 7signal Solutions, Inc.
Client retries
66
Copyright © 2014 7signal Solutions, Inc.
WLAN utilization
67
Copyright © 2014 7signal Solutions, Inc.
Probe density from AP
68
Copyright © 2014 7signal Solutions, Inc.
LTE testing results, comparing day to day
69
Copyright © 2014 7signal Solutions, Inc.
Retransmission in traffic between clients and APs
70
Copyright © 2014 7signal Solutions, Inc.
AP retries towards clients,7.00-9.00, LTE at 36dBm/OFF
71
Copyright © 2014 7signal Solutions, Inc.
Client retries towards APs,7.00-9.00, LTE at 36dBm/OFF
72
Copyright © 2014 7signal Solutions, Inc.
AP retries towards clients,11.00-14.00, LTE at 49dBm/OFF
73
Copyright © 2014 7signal Solutions, Inc.
Client retries towards APs,11.00-14.00, LTE at 49dBm/OFF
74
Copyright © 2014 7signal Solutions, Inc.
AP retries towards clients,15.00-18.00, LTE at 30dBm/OFF
75
Copyright © 2014 7signal Solutions, Inc.
Client retries towards APs,15.00-18.00, LTE at 30dBm/OFF
76
Copyright © 2014 7signal Solutions, Inc.
Retransmission between Eye and APs during active tests
77
Copyright © 2014 7signal Solutions, Inc.
AP retries towards Eye,7.00-9.00, LTE at 36dBm/OFF
78
Copyright © 2014 7signal Solutions, Inc.
Eye retries towards APs,7.00-9.00, LTE at 36dBm/OFF
79
Copyright © 2014 7signal Solutions, Inc.
AP retries towards Eye,11.00-14.00, LTE at 49dBm/OFF
80
Copyright © 2014 7signal Solutions, Inc.
Eye retries towards APs,11.00-14.00, LTE at 49dBm/OFF
81
Copyright © 2014 7signal Solutions, Inc.
AP retries towards Eye,15.00-18.00, LTE at 30dBm/OFF
82
Copyright © 2014 7signal Solutions, Inc.
Eye retries towards APs,15.00-18.00, LTE at 30dBm/OFF
83
Copyright © 2014 7signal Solutions, Inc.
Data rates/MCSs between clients and APs
84
Copyright © 2014 7signal Solutions, Inc.
AP04, Downlink data rates,AP traffic towards clients, LTE +36dBm
85
Copyright © 2014 7signal Solutions, Inc.
AP04, Uplink data rates,Client traffic towards APs, LTE +36dBm
86
Copyright © 2014 7signal Solutions, Inc.
AP04, Downlink data rates,AP traffic towards clients, LTE +49dBm
87
Copyright © 2014 7signal Solutions, Inc.
AP04, Uplink data rates,Client traffic towards APs, LTE +49dBm
88
Copyright © 2014 7signal Solutions, Inc.
Data rates/MCSs between Eye and APs during active tests
89
Copyright © 2014 7signal Solutions, Inc.
Downlink data rates, active test, AP traffic towards Eye, LTE +36dBm
90
Copyright © 2014 7signal Solutions, Inc.
Uplink data rates, active testEye traffic towards APs, LTE +36dBm
91
Copyright © 2014 7signal Solutions, Inc.
Downlink data rates, active test, AP traffic towards Eye, LTE +49dBm
92
Copyright © 2014 7signal Solutions, Inc.
Uplink data rates, active testEye traffic towards APs, LTE +49dBm
93
Copyright © 2014 7signal Solutions, Inc.
Challenges
94
Certain compromises were made due to very rapid deployment schedule Slow ADSL from Victoria station to internet limited maximum throughputs to very low values (100’s kbit/s during load). Instead of looking at the end-to-end throughputs, more focus was put to observing radio behavior during the active and passive tests when LTE transmitter was turned on and off. This was after all the goal of the project High packet loss in internet connection caused sensors drop off from test profile at times. This caused some delays and at times gaps to data collection, but did not impact accuracy of the gathered data when tests was made No local test end point was available, only cloud. Planned location for Victoria station onsite active test end point (Sonar) did not offer enough space for a planned laptop device Not all planned sensors were online due to placement and available PoE power limitations. Also, some sensors at times rebooted due to voltage drops on power feed Sensor placement was not optimal. Sensors had to get PoE power from access points and they were co-located with access points. Sensors were also positioned less than optimally due to temporary nature of the setup Access point band steering feature delayed access to 2.4 GHz radio measurements. Sensor has capability for 5 GHz band and band steering delayed responses at 2.4 GHz. This slowed down test cycle speed but did not impact accuracy of the relevant test data when tests were performed. Only beacon availability, attach success rate and attach time metrics were negatively impacted Despite the challenges, a lot of valid data was collected and valuable conclusions have been made
Copyright © 2014 7signal Solutions, Inc.
Observations
General Wi-Fi performance level is modest, the main reason being slow ADSL connection from the Victoria station to internet at the time of testing due to ADSL equipment failure before the project. The wired connection alone drops throughputs below 1 Mbit/s in downlink and to 100-200kbit/s in uplink. Wi-Fi is capable of 10’s Mbit/s to even some 100 Mbit/s throughputs in good conditions RF operation is also clearly less than optimal, including very high retry rates and high utilization at 2.4 GHz band and some strong sources of non-Wi-Fi interference Spectrum analysis measurements did not show noticeable impact from LTE traffic Day internal active and passive testing did not show any meaningful correlation with degraded performance and LTE transmitter presence
95
Copyright © 2014 7signal Solutions, Inc.
Conclusion
Tested scenario does not show 2.3 GHz LTE transmitter impacting negatively on Wi-Fi performance
96