validation test scope

1. Latency Test

Site-Lat01 First time network Attach delay( with Authentication & Encryption turned on and No RAB & UE context )

Site-Lat02

Site-Lat03

Site-Lat04

Site-Lat05 TAU update & paging delay

2. Throughput and Capacity Test with multiple users

Site-THR_01

Site-THR_02 No of users scheduled per TTI in a single cell and complete eNB3. RRM

Site-RRM01 Admisson and congestion control feature

Site-RRM02 Load balance in intra/ inter cells /Frequencies

4. QoS & Scheduler TestSite-QoS01 QoS Profile( all QCI support as per 3GPP specifications

Site-QoS02 GBR and Non-GBR priority ( QCI priority)

Site-QoS03 Service differentiations for non-GBR / GBR bearers, EPS bearer

Site-QoS04 Uplink and Downlink Rate Capping

Site-QoS05

Note:- a. Document is based on current visibility of features & roadmap, however the scope defined below will be refreshed after mutual discussion, as in when the new releases/features are available and not specified in the list below b. Pass/Fail criterion of each test to be mutually discussed/agreed and to be included in the VT test document submitted by Partnerc. Functional Testing will be verified in this section however gains quantifications will be done in cluster or lab testing based on agreed test procedure

Paging latency, stationary, target user in cell center/middle/edge, 50% load

Idle to active ( control plane latency) , stationary, target user in cell near/middle/edge at no load & 50% adjacent cell downlink loading

User plane latency- RTT delays to be captured for different ping packet size at no loading and 50% serving cell loading

Average cell throughput with maximum RRC connected/scheduled users distributed in different points uniformly in a cell

QoS parameter provisioning (Support for user traffic classification based on L2, L3, L4 Rules i.e. Physical port, MAC address, IEEE 802.1q tag, IEEE 802.1p tag, TOS/DSCP bit, Ethernet /IP protocol type, Source and destination IP address, Source and destination TCP/UDP/RTP port nos

Site-QoS06 Different IP for MCUS-plane

Site-QoS07 Dynamic Admission control

Site-QoS08 VLAN based traffic separation

Site-QoS09

Site-QoS10

Max C/I

EPF ( enhanced PF which can also factor user Qos profile )

PF

RR

Prioperatory scheduler ( if any)

Site-QoS11 User plane & Control Plane Encryption

5. SONField-SON01 Verify the X2 signaling message exchanges Field-SON02 Auto Discovery & Configuration (Plug & Play integration)Field-SON03 Self Healing Field-SON04 Cell outage detection & compensationField-SON05 Sleeping Cell detection and repair

Field-SON06 ANR ( Automatic Neighbour Relation) - Intra & Inter RAT

Field-SON07 RACH optimization

Field-SON08 Control channel optimisation

Field-SON10 Mobility Robust optimisation (MRO) ( intra & inter frequecny and cells/RATscenario)

Field-SON11 MDT

Field-SON12 Optimized Neighbor relationship ( Auto neigbhor defination by OSS )

Field-SON13 Auto PCI planning

Field-SON14 Auto PCI collision detection

Field-SON15 Auto Alarm Coorelation and Trace

Field-SON16` Mobility load balancing (MLB)

6. Services Test ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )

Field-ST01 Video Streaming, HD Videro Surveillance & Video Call

Field-ST02

Field-ST03 CSFB

Field-ST04 VoLTE

Field-ST05

Verification of Base Station mechanism to prohibit transmission of packets between subscribers registered in same base station.

Data download and upload -- throughput, delay, and jitter to 10 sites around the world, youtube download, etc.

NAAC (Network Assisted Cell Change) - reselection, redirection, active PS HO with data session continuity for different RAT type

Field-ST06 SRVCC & enhancement

Field-ST07

Field-ST08 Location Identification for LBS services

Field-ST09 Support for Multicast & Broadcast Services (eMBMS)

Field-ST10 VLAN configuration/tagging (IEEE 802.1q) capability at CPE level and support by eNB

Field-ST11 No. of VLANs supported per interface (by BSs, CPEs)

Field-ST12 Support for IPv6 & Dual stack IP V4 /IP V6

Field-ST13 Q in Q functionality support by eNB

Field-ST14 TTI Bundling

Field-ST15 SPS scheduling

Field-ST16 Relay ( L1, L2 & L3 type)

Field-ST17 WiFi Public hotspot Integrated services with LTE

Field-ST18 Carrier aggregation ( in same & multi band )

Field-ST19 RRU Daisy chaining

Field-ST20 Cell combination ( Super cell )

Field-ST21 Remote GPS

Field-ST22 TM9 (CL-SU / MU MIMO & multilayer Beamforming)

Field-ST23 4x4 MIMO in Downlink

Field-ST24 Hetnet ( interworking of small cells and macro cells )

Field-ST25 Active RAN sharing

Field-ST26 eScheduler /coordinator

Field-ST27 Hotel BBU

Field-ST28

Field-ST29

Support for VOIP- Class 5 features (Call waiting, Hold, 3 party conferencing etc.) , Call quality with different codecs

TM 7 & TM 8 ( Single layer and Dual Layer Beamforming). Also includes different types of BF like elevation, weight loading adaptive etc

TM -1 to TM-6 testing which includes SISO, SU & MU MIMO , Diversity , Open & closed loop MIMO for 2 port and 4 port scenario

Field-ST30 CoMP ( uplink- intra & inter cell )

Field-ST31 CoMP ( downlink- intra & inter cell )

Field-ST32 Active Antenna Array

Field-ST33 SDR ( dual band dual carrier )

Field-ST34 EWS system

Field-ST35 S1 - Flex

Field-ST36 eNB Co Transmission backhauling capabilities ( 4G , 3G & IP Abis)

Field-ST37

Field-ST38 TOP support on eNB ( 1588v2) & GPS clock Freq. & Phase clock backup

Field-ST39 64 Qam Support on uplink

Field-ST40 Jumbo Frame support

Field-ST41 Robust Header Compression | IP & SCTP transport enhancement

Field-ST42 IPv4/IPv6 dual stack & pur IPv6 support

7. eNB Power Consumption ( to be verified for all confiuration type installed in the network)

Site-Pwr-001

RRU power consumption in no load condition

BBU power consumption in no load condition

8.Service Recovery timing/behaviour in various outage scenarios

Site-NE01 MME

Site-NE02 PDN Gateway

Site-NE03 Serving Gateway

Site-NE04 Transmission

Site-NE05 eScheduler/coordinator

Site-NE06 eNB Hard & Soft reboot

9. Interference Supression Techniques ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )

Field-INT01

Different Configuration support like TDD splits , Special subframe, Cyclic prefix (short , Long) , Channel bandwidth

RRU Power in with 50% & 100% load at room temperature ( RRU transmitting at full power in 100% loading)

BBU Power with 50% load & 100% load( BBU loading is determined by CPU load - max users & throughput load )

Verify Interference mitigation techniques for both uplink & downlink for User traffic a. Static ICIC b. Dynamic ICIC ( pure X2 feedback based c. enahnced ICIC ( X2 & UE CQI / QOS feedback) d. ICIC coordinated using centralized server e. FSS ( Frequence slective scheduling - wide band & sub band CQI feeedback based )

Field-INT02 Interference Control for Control channels CCO, CCLR, CCIA , Control channel power control

Field-INT03 IRC, MRC

Field-INT04 Closed Loop and Open loop power control

10. eNB Hardware Test

Field-FP01

11. Energy Saving ( This heading covers all Opex saving related features that are developed by Partners and should not restrict to specifc mentioned below)

Field-PS01 Automatic PA Shut down ( time based & load based)- Load based power saving

Field-PS02 DRX Long & Short ( smart DRX)

Field-PS03 RS Power boosting & Cell power reduction for control & traffic channels

Field-PS04 DTX

12. Handover ( all handover includes intra & inter cells /RAT type/frequency )

Field-HO01 S1 & X2 Handover & delaysField-HO02 IRAT Handover & delays Field-HO03 Load based handoverField-HO04 Service based HO

Verify the eNB RX sensitivity, Transmit Power, Occupied Bandwidth, Time alignament, ACLR, Filter Rejection, ACS & SEM, Control & Data Channels Powers & RB allocation. OBSAI/CPRI Std measurements

Actual value

1. Latency Test

First time network Attach delay( with Authentication & Encryption turned on and No RAB & UE context )

At cell edges ( RSRP < -110 dbm) At cell center ( RSRP range <-95 to -110) At near cell ( RSRP > -95) At cell edges ( RSRP < -110 dbm) At cell center ( RSRP range <-95 to -110) At near cell ( RSRP > -95)

TAU update & paging delay


No of users scheduled per TTI in a single cell and complete eNB3. RRM

Admisson and congestion control feature

Load balance in intra/ inter cells /Frequencies

4. QoS & Scheduler TestQoS Profile( all QCI support as per 3GPP specifications

GBR and Non-GBR priority ( QCI priority)

Service differentiations for non-GBR / GBR bearers, EPS bearer

Uplink and Downlink Rate Capping

a. Document is based on current visibility of features & roadmap, however the scope defined below will be refreshed after mutual discussion, as in when the new releases/features are available and not specified in the list below b. Pass/Fail criterion of each test to be mutually discussed/agreed and to be included in the VT test document submitted by Partnerc. Functional Testing will be verified in this section however gains quantifications will be done in cluster or lab testing based on agreed test procedure

Planned value(Shall be provided by Partner in advance as per

planning assumptions & global experience)

User plane latency- RTT delays to be captured for different ping packet size at no loading and 50% serving

Average cell throughput with maximum RRC connected/scheduled users distributed in different points

QoS parameter provisioning (Support for user traffic classification based on L2, L3, L4 Rules i.e. Physical port, MAC address, IEEE 802.1q tag, IEEE 802.1p tag, TOS/DSCP bit, Ethernet /IP protocol type, Source and destination IP address, Source and destination TCP/UDP/RTP port nos

Different IP for MCUS-plane

Dynamic Admission control

VLAN based traffic separation

Max C/I

EPF ( enhanced PF which can also factor user Qos profile )

PF

RR

Prioperatory scheduler ( if any)

User plane & Control Plane Encryption

5. SONVerify the X2 signaling message exchanges Auto Discovery & Configuration (Plug & Play integration)Self Healing Cell outage detection & compensationSleeping Cell detection and repair

ANR ( Automatic Neighbour Relation) - Intra & Inter RAT

RACH optimization

Control channel optimisation

Mobility Robust optimisation (MRO) ( intra & inter frequecny and cells/RATscenario)

Optimized Neighbor relationship ( Auto neigbhor defination by OSS )

Mobility load balancing (MLB)


Video Streaming, HD Videro Surveillance & Video Call

CSFB

VoLTE

Verification of Base Station mechanism to prohibit transmission of packets between subscribers registered

Data download and upload -- throughput, delay, and jitter to 10 sites around the world, youtube download,

NAAC (Network Assisted Cell Change) - reselection, redirection, active PS HO with data session continuity

SRVCC & enhancement

Location Identification for LBS services

Support for Multicast & Broadcast Services (eMBMS)

VLAN configuration/tagging (IEEE 802.1q) capability at CPE level and support by eNB

No. of VLANs supported per interface (by BSs, CPEs)

Support for IPv6 & Dual stack IP V4 /IP V6

Q in Q functionality support by eNB

TTI Bundling

SPS scheduling

Relay ( L1, L2 & L3 type)

WiFi Public hotspot Integrated services with LTE

Carrier aggregation ( in same & multi band )

RRU Daisy chaining

Cell combination ( Super cell )

Remote GPS

TM9 (CL-SU / MU MIMO & multilayer Beamforming)

4x4 MIMO in Downlink

Hetnet ( interworking of small cells and macro cells )

eScheduler /coordinator

Hotel BBU

Support for VOIP- Class 5 features (Call waiting, Hold, 3 party conferencing etc.) , Call quality with different

TM 7 & TM 8 ( Single layer and Dual Layer Beamforming). Also includes different types of BF like

TM -1 to TM-6 testing which includes SISO, SU & MU MIMO , Diversity , Open & closed loop MIMO for 2

CoMP ( uplink- intra & inter cell )

CoMP ( downlink- intra & inter cell )

Active Antenna Array

SDR ( dual band dual carrier )

EWS system

S1 - Flex

eNB Co Transmission backhauling capabilities ( 4G , 3G & IP Abis)

TOP support on eNB ( 1588v2) & GPS clock Freq. & Phase clock backup

64 Qam Support on uplink

Jumbo Frame support

Robust Header Compression | IP & SCTP transport enhancement

IPv4/IPv6 dual stack & pur IPv6 support


RRU power consumption in no load condition

BBU power consumption in no load condition


MME

PDN Gateway

Serving Gateway

Transmission

eScheduler/coordinator


Different Configuration support like TDD splits , Special subframe, Cyclic prefix (short , Long) , Channel

RRU Power in with 50% & 100% load at room temperature ( RRU transmitting at full power in 100%

BBU Power with 50% load & 100% load( BBU loading is determined by CPU load - max users & throughput

Verify Interference mitigation techniques for both uplink & downlink for User traffic

c. enahnced ICIC ( X2 & UE CQI / QOS feedback)

e. FSS ( Frequence slective scheduling - wide band & sub band CQI feeedback based )

Interference Control for Control channels CCO, CCLR, CCIA , Control channel power control

IRC, MRC

Closed Loop and Open loop power control



Automatic PA Shut down ( time based & load based)- Load based power saving

DRX Long & Short ( smart DRX)

RS Power boosting & Cell power reduction for control & traffic channels

DTX


S1 & X2 Handover & delaysIRAT Handover & delays Load based handoverService based HO

Verify the eNB RX sensitivity, Transmit Power, Occupied Bandwidth, Time alignament, ACLR, Filter Rejection, ACS & SEM, Control & Data Channels Powers & RB allocation. OBSAI/CPRI Std measurements

Actual value Pass/Fail

1. Latency Test


3. RRM

4. QoS & Scheduler Test

a. Document is based on current visibility of features & roadmap, however the scope defined below will be refreshed after mutual discussion, as in when the new releases/features are available and not specified in the list below

c. Functional Testing will be verified in this section however gains quantifications will be done in cluster or lab testing based on agreed test procedure

5. SON


Remark

1. Latency Test


3. RRM

4. QoS & Scheduler Test

a. Document is based on current visibility of features & roadmap, however the scope defined below will be refreshed after mutual discussion, as in when the new releases/features are available and not specified in the list below

To test paging latency, stationary, target user on cell center/middle/edge under specific load scenario.

Verification that a UE correctly performs a tracking area update (TAU) while moving in idle & acitve mode and correctly re-selects the cell & recird the delay. Also paging delay to be captured

The point named near/middle/far can be define by RSRP and/or SINR. This test can be executed with UE emulator both for uplink and downlink directions. Dnamically CQI changes to simulate different radio scenario is also possible using UE emulator

Each profile would contain a parameter set adapted to the requirements given by the standardized QCI characteristics, this case will offer better service to the customer. Demonstrate QCI1 to QCI 9 characterstics by provisioning multiple traffic streams mapped to different QCI.

To verify the when UE-AMBR switch enable, the UL/DL rate will as close as UE-AMBR UL/DL

To verify that eNB can create Service flows basis on different classification rules as well CPE shall support these service flows.

5. SON


Verfication of Service quality for each service type to be measure

Bind the Control-, User-, Management- and Synch-plane (MCUS-plane) and their applications to different virtual IP addresses as prerequisite for the functionality VLAN based traffic separation

Verify, that traffic on U-,C-plane and M-plane can be separated on different VLANs and routed via different IPSec (optional) tunnels.

To verify whether traffic flow can be restricted between different SS in a given BS. This is essential to avoid unnecessary flow of packets between SS.

The purpose of this test case is to sort the ANR connected events based on 1. Event object id 2. eNB identity 3. Date and Time of the event creation.

Framework allowing handovers of packet data sessions from E‐UTRAN to GERAN, for GERAN networks that do not support PS handover.

To verify working of class5 voice features

To ensure that the all elements of the system support IPv6

To check whether QinQ functionality is supported

To enhance the system performance

Framework allowing the network to handover a voice call from the IM CN Subsystem (PS domain) to the CS domain of a legacy system .•The function allows to perform a PS to CS domain transfer together with a radio link handover•SR‐VCC handovers supported from E‐UTRAN to UTRAN/GERAN

To verify User and Control Plane supports:- A-GPS, OT-DOA & E-CID; verify accuracy of MS position•OTDOA (downlink positioning method based on measured time differences observed by the UE from different eNode Bs)•A‐GPS (satellite positioning: GPS and similar systems)•Enhanced Cell ID methods

To verify if VLAN can be configured on the BS and CPE and check whether tagging and untagging can be done at CPE

To verify what maximum number of VLANS are supported by equipment.Is it 4096 or less



EPC coordination

EPC coordination

EPC coordination

Transmission Cable plug out test


To measure the power consumption of the BS as per the specs on 10% of the sites chosen randomly.

LIST_x000D_AXGP S1 MVI Test List for ZTE Phase2 21 (21)

Prepared: NRJ/ON/XV Shinya MaeharaDate: 2011-06-13

Sheet: VT -Part2 (Cluster & NW AT)Ericsson Confidential

No: 5/153 82-5/FCP 121 7024 Uen_x000D_Rev: PA1

Cluster Field & Optimization Testing

Test Case ID Description Remarks

1. Coverage Tests

Cov-Qual01 %age of samples within the specified values and comparision of predicted vs actual coverage stats

Cov-Qual02 50% loaded scenario to be analyzed

Cov-Qual03 Extensive drive test & OSS parameters fetching to benchmark the cluster performance as per agreed network & service KPIs

Cov-Qual04 Record Average & Peak cell DL & UL throughput for single UE & Multiple UE- Uni & Bidi Data FTP throughput testing

2. Interference Test

Field-INT01 Verify Interference mitigation techniques gains for each feature available for interference supression by conducting cluster wide drive test

Field-INT02 eScheduler/Coordinators based scheduling control

3. Open Loop & Closed Loop, Synchronization, etc

Field-PA01 Record performance for closed Loop and open loop power control & MIMO scenarios in cluster drive test

Field-PA02 Record cluster performance degradation on account of Loss of eNB GPS synchronization

Field-PA03 Record cluster performance for different TDD configuration

4. Handover Test

Field-HO01 S1 Handover- Inter MME / S-GW if applicable

Field-HO02 X2 Handover

Field-HO03 Data session continuity at different mobility speeds ( it should cover multiple TAU, S-GW, MME, serving scenarios as applicable)

Field-HO06 Bidirectonal TCP & Uni-direction uplink & downlink drive test , includes intra-site, inter-site X2 and S1 HO scenarios

Field-HO07 Downlink TCP service handover with speed 30 km/hr,50% DL loaded network, includes intra-site, inter-site X2 and S1 scenarios

Field-HO08 Data Session mobility support (60kmph, verify max speed supported): inter-eNB handovers. To check that data session is maintained while moving between eNBs

Field-HO9 Intra/Inter-eNB handovers success | Inter & Intra frequecny & RAT type HO success

Field-HO10 Performance statistics for cell re-selection & re-direction in acitve and idle mode, active PS handover Based on Drive test

5. Feature Test Gains quantification - Detail testing of pilot features to quantify the gains as per feature availability and agreed procedure

Note:-a. Cluster should be identified with mix cnfiguration of eNB to execute the following tests however not limited to the following testcases b. Pass/Fail criterion of each test to be mutually discussed/agreed and to be included in the VT test document submitted by Partnerc. Gains quantifications/performance statistics to be captured in the cluster testing as per agreed test procedures

These tests to be performed on the cluster after optimization of the various parameters and turning on all the relevant features.Performance to be analyzed by by simulating serving & adjacent cell loading ( 50% ) on both DL and UL . Drivetest route and stationary testing need to be performed on prior agreed test plan. Key parameters to be measured .Tests need to be repeated for device mix from various OEMs.

• Tests to be repeated for devices from different OEMs• In the first cluster tests to be performed for different TDD configuration & different loading condition as required by Bharti

% samples of SINR, RSRP, Throughput , MCS, MIMO (SM & Diversity) as per required boundary conditions and identifiy the acceptable Rx levels.

Atleast 1000 stationary point testing at indoor/outdoor locations as per prescribed formats to correlate SINR, RSRP, Throughput, clutter/penetration loss variations in the unloaded and loaded scenario

Gains due to the different mitigation techniques should be clearly measured and recorded

To test the mobility and handover performance within 0% & 50% load scenario

To test the mobility and handover performance within 100% load trial cluster.

validation test scope

Documents