testing equality of multiple power spectral density matrices · ples are realizations of zero-mean...

13
6268 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 66, NO. 23, DECEMBER 1, 2018 Testing Equality of Multiple Power Spectral Density Matrices David Ram´ ırez , Senior Member, IEEE, Daniel Romero , Member, IEEE, Javier V´ ıa , Senior Member, IEEE, Roberto L ´ opez-Valcarce , Member, IEEE, and Ignacio Santamar´ ıa , Senior Member, IEEE Abstract—This paper studies the existence of optimal invariant detectors for determining whether P multivariate processes have the same power spectral density. This problem finds application in multiple fields, including physical layer security and cognitive radio. For Gaussian observations, we prove that the optimal invari- ant detector, i.e., the uniformly most powerful invariant test, does not exist. Additionally, we consider the challenging case of close hy- potheses, where we study the existence of the locally most powerful invariant test (LMPIT). The LMPIT is obtained in the closed form only for univariate signals. In the multivariate case, it is shown that the LMPIT does not exist. However, the corresponding proof naturally suggests an LMPIT-inspired detector that outperforms previously proposed detectors. Index Terms—Generalized likelihood ratio test (GLRT), locally most powerful invariant test (LMPIT), power spectral density (PSD), Toeplitz matrix, uniformly most powerful invariant test (UMPIT). I. INTRODUCTION T HIS work studies the problem of determining whether P Gaussian multivariate time series possess the same Manuscript received June 28, 2018; revised September 21, 2018; accepted Oc- tober 7, 2018. Date of publication October 15, 2018; date of current version Oc- tober 30, 2018. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Vincent Y. F. Tan. This work was supported in part by the Spanish MINECO under Grants COMONSENS Network (TEC2015-69648-REDC) and KERMES Network (TEC2016-81900- REDT/AEI), in part by the Spanish MINECO and the European Commission (ERDF) under Grants ADVENTURE (TEC2015-69868-C2-1-R), WIN- TER (TEC2016-76409-C2-2-R), CARMEN (TEC2016-75067-C4-4-R), and CAIMAN (TEC2017-86921-C2-1-R) and (TEC2017-86921-C2-2-R), in part by the Comunidad de Madrid under Grant CASI-CAM-CM (S2013/ICE-2845), in part by the Xunta de Galicia and ERDF under Grants GRC2013/009, R2014/037, and ED431G/04 (Agrupacion Estrat´ exica Consolidada de Galicia accreditation 2016–2019), in part by the SODERCAN and ERDF under Grant CAIMAN (12.JU01.64661), and in part by the Research Council of Norway under Grant FRIPRO TOPPFORSK (250910/F20). This paper was presented in part at the 2018 IEEE International Conference on Acoustics, Speech, and Signal Process- ing. (Corresponding author: David Ram´ ırez.) D. Ram´ ırez is with the Department of Signal Theory and Communications, University Carlos III of Madrid, Legan´ es 28915, Spain, and also with Grego- rio Mara˜ on Health Research Institute, Madrid 28007, Spain (e-mail:, david. [email protected]). D. Romero is with the Department of Information and Communication Technology, University of Agder, Grimstad 4879, Norway (e-mail:, daniel. [email protected]). J. V´ ıa and I. Santamar´ ıa are with the Department of Communications Engi- neering, University of Cantabria, Santander 39005, Spain (e-mail:, javier.via@ unican.es; [email protected]). R.L´ opez-Valcarce is with the Department of Signal Theory and Communica- tions, University of Vigo, Vigo 36310, Spain (e-mail:, [email protected]). Color versions of one or more of the figures in this paper are available online at http://ieeexplore.ieee.org. Digital Object Identifier 10.1109/TSP.2018.2875884 (possibly matrix-valued) power spectral density (PSD) at every frequency. This interesting problem has many applications, such as comparison of gas pipes [1], analysis of hormonal times se- ries [2], earthquake-explosion discrimination [3], light-intensity emission stability determination [4], physical-layer security [5], and spectrum sensing [6]. The first work to consider this problem was developed by Coates and Diggle [1]. This work proposed tests, for univariate and real-valued time series, based on the ratio of periodograms. First, they presented non-parametric tests based on the com- parison of the maximum and minimum of the log-ratio of periodograms over all frequencies. Moreover, assuming a parametric (quadratic) model for the log-ratio of the PSDs, they developed a generalized likelihood ratio test (GLRT). These detectors are further studied in [7]. Following similar ideas to [1], [7], the work in [2] proposed a graphical procedure, which resulted in another non-parametric test. The authors of [4] also considered detectors based on the ratio of periodograms for a problem with several time series and are based on a semi-parametric log-linear model for the ratio of PSDs. A different kind of detector is presented in [8], where the GLRT was derived without imposing any parametric model. In particular, they computed the GLRT for testing whether the PSD of two real multivariate time series are equal at a given frequency. The extension to complex time series is considered in [9], where the information from all frequencies is fused into a single statistic. An alternative way of fusing the information at all frequencies is derived in [10], but the proposed detector is not a GLRT anymore. All aforementioned detectors were developed in the frequency domain. However, there are also other works that propose time-domain detectors; see, for instance, [11] and references therein. The problem considered in this work is to decide whether at each frequency all P PSD matrices are identical or not. Thus, the tests for equality of several PSDs may be addressed as an extension of the classical problem of testing the homogeneity of covariance matrices [12]. This allows us to use the statistics for homogeneity at each frequency, which need to be fused into one statistic afterwards by combining the different frequencies. Depending on the chosen combination rule, different detectors (with different performance) may be derived. Every proposed test so far is either based on ad-hoc principles, or on the GLRT, which is optimal in the asymptotic regime [13]. However, their behavior for finite data records is unknown. That is, for finite data records, they may very well be suboptimal. 1053-587X © 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications standards/publications/rights/index.html for more information.

Upload: others

Post on 12-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

6268 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 66, NO. 23, DECEMBER 1, 2018

Testing Equality of Multiple PowerSpectral Density Matrices

David Ramırez , Senior Member, IEEE, Daniel Romero , Member, IEEE, Javier Vıa , Senior Member, IEEE,Roberto Lopez-Valcarce , Member, IEEE, and Ignacio Santamarıa , Senior Member, IEEE

Abstract—This paper studies the existence of optimal invariantdetectors for determining whether P multivariate processes havethe same power spectral density. This problem finds applicationin multiple fields, including physical layer security and cognitiveradio. For Gaussian observations, we prove that the optimal invari-ant detector, i.e., the uniformly most powerful invariant test, doesnot exist. Additionally, we consider the challenging case of close hy-potheses, where we study the existence of the locally most powerfulinvariant test (LMPIT). The LMPIT is obtained in the closed formonly for univariate signals. In the multivariate case, it is shownthat the LMPIT does not exist. However, the corresponding proofnaturally suggests an LMPIT-inspired detector that outperformspreviously proposed detectors.

Index Terms—Generalized likelihood ratio test (GLRT), locallymost powerful invariant test (LMPIT), power spectral density(PSD), Toeplitz matrix, uniformly most powerful invariant test(UMPIT).

I. INTRODUCTION

THIS work studies the problem of determining whetherP Gaussian multivariate time series possess the same

Manuscript received June 28, 2018; revised September 21, 2018; accepted Oc-tober 7, 2018. Date of publication October 15, 2018; date of current version Oc-tober 30, 2018. The associate editor coordinating the review of this manuscriptand approving it for publication was Prof. Vincent Y. F. Tan. This workwas supported in part by the Spanish MINECO under Grants COMONSENSNetwork (TEC2015-69648-REDC) and KERMES Network (TEC2016-81900-REDT/AEI), in part by the Spanish MINECO and the European Commission(ERDF) under Grants ADVENTURE (TEC2015-69868-C2-1-R), WIN-TER (TEC2016-76409-C2-2-R), CARMEN (TEC2016-75067-C4-4-R), andCAIMAN (TEC2017-86921-C2-1-R) and (TEC2017-86921-C2-2-R), in part bythe Comunidad de Madrid under Grant CASI-CAM-CM (S2013/ICE-2845), inpart by the Xunta de Galicia and ERDF under Grants GRC2013/009, R2014/037,and ED431G/04 (Agrupacion Estratexica Consolidada de Galicia accreditation2016–2019), in part by the SODERCAN and ERDF under Grant CAIMAN(12.JU01.64661), and in part by the Research Council of Norway under GrantFRIPRO TOPPFORSK (250910/F20). This paper was presented in part at the2018 IEEE International Conference on Acoustics, Speech, and Signal Process-ing. (Corresponding author: David Ramırez.)

D. Ramırez is with the Department of Signal Theory and Communications,University Carlos III of Madrid, Leganes 28915, Spain, and also with Grego-rio Maranon Health Research Institute, Madrid 28007, Spain (e-mail:, [email protected]).

D. Romero is with the Department of Information and CommunicationTechnology, University of Agder, Grimstad 4879, Norway (e-mail:, [email protected]).

J. Vıa and I. Santamarıa are with the Department of Communications Engi-neering, University of Cantabria, Santander 39005, Spain (e-mail:, [email protected]; [email protected]).

R. Lopez-Valcarce is with the Department of Signal Theory and Communica-tions, University of Vigo, Vigo 36310, Spain (e-mail:,[email protected]).

Color versions of one or more of the figures in this paper are available onlineat http://ieeexplore.ieee.org.

Digital Object Identifier 10.1109/TSP.2018.2875884

(possibly matrix-valued) power spectral density (PSD) at everyfrequency. This interesting problem has many applications, suchas comparison of gas pipes [1], analysis of hormonal times se-ries [2], earthquake-explosion discrimination [3], light-intensityemission stability determination [4], physical-layer security [5],and spectrum sensing [6].

The first work to consider this problem was developed byCoates and Diggle [1]. This work proposed tests, for univariateand real-valued time series, based on the ratio of periodograms.First, they presented non-parametric tests based on the com-parison of the maximum and minimum of the log-ratio ofperiodograms over all frequencies. Moreover, assuming aparametric (quadratic) model for the log-ratio of the PSDs, theydeveloped a generalized likelihood ratio test (GLRT). Thesedetectors are further studied in [7]. Following similar ideas to[1], [7], the work in [2] proposed a graphical procedure, whichresulted in another non-parametric test. The authors of [4]also considered detectors based on the ratio of periodogramsfor a problem with several time series and are based on asemi-parametric log-linear model for the ratio of PSDs.

A different kind of detector is presented in [8], where theGLRT was derived without imposing any parametric model.In particular, they computed the GLRT for testing whether thePSD of two real multivariate time series are equal at a givenfrequency. The extension to complex time series is consideredin [9], where the information from all frequencies is fused into asingle statistic. An alternative way of fusing the information atall frequencies is derived in [10], but the proposed detector is nota GLRT anymore. All aforementioned detectors were developedin the frequency domain. However, there are also other worksthat propose time-domain detectors; see, for instance, [11] andreferences therein.

The problem considered in this work is to decide whether ateach frequency all P PSD matrices are identical or not. Thus,the tests for equality of several PSDs may be addressed as anextension of the classical problem of testing the homogeneityof covariance matrices [12]. This allows us to use the statisticsfor homogeneity at each frequency, which need to be fused intoone statistic afterwards by combining the different frequencies.Depending on the chosen combination rule, different detectors(with different performance) may be derived.

Every proposed test so far is either based on ad-hoc principles,or on the GLRT, which is optimal in the asymptotic regime [13].However, their behavior for finite data records is unknown. Thatis, for finite data records, they may very well be suboptimal.

1053-587X © 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See http://www.ieee.org/publications standards/publications/rights/index.html for more information.

Page 2: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

RAMIREZ et al.: TESTING EQUALITY OF MULTIPLE POWER SPECTRAL DENSITY MATRICES 6269

Actually, to the best of the authors’ knowledge, neither the uni-formly most powerful invariant test (UMPIT) nor the locallymost powerful invariant test (LMPIT) have been studied for theconsidered problem, with the exception of our previous confer-ence paper [14], which considers the particular case of P = 2processes. The conventional approach to derive these optimalinvariant detectors is based on obtaining the ratio of the densitiesof the maximal invariant statistic under each hypothesis [15].The derivation of these distributions is for most problems a verycomplicated task, if possible at all, which in many cases pre-cludes the derivation of optimal invariant detectors. Instead ofpursuing this conventional approach, we may invoke Wijsman’stheorem [16], [17], as we did in our previous works [18], [19].This theorem allows us to derive the UMPIT or the LMPIT, ifthey exist, without identifying the maximal invariant statisticand, more importantly, without computing its distributions. Ex-ploiting Wijsman’s theorem, and assuming Gaussian-distributeddata, this work proves that the UMPIT does not exist for testingequality of the PSD matrices of P (≥2) processes. Moreover,focusing on the case of close hypotheses (similar PSDs), weprove that the LMPIT only exists in the case of univariate pro-cesses, for which we find a closed-form expression; whereas itdoes not exist for the general case of multivariate time series.However, the non-existence proof of the LMPIT in the multi-variate case suggests one LMPIT-inspired detector, which turnsout to outperform previously proposed schemes.

The paper is organized as follows. Section II presents themathematical formulation of the problem. The proof of the non-existence of the UMPIT and the LMPIT for the general case ispresented in Section III, whereas Section IV derives the LMPITfor univariate processes. Due to the non-existence of the LMPITin the general case, we present a LMPIT-inspired detector inSection V. The performance of the proposed detector is illus-trated by means of numerical simulations in Section VI, andSection VII summarizes the main conclusions of this work.

A. Notation

In this paper, matrices are denoted by bold-faced upper caseletters; column vectors are denoted by bold-faced lower caseletters, and light-face lower case letters correspond to scalarquantities. The superscripts (·)T and (·)H denote transpose andHermitian, respectively. A complex (real) matrix of dimensionM ×N is denoted by A ∈ CM×N (

A ∈ RM×N ) and x ∈ CM(x ∈ RM

)denotes that x is a complex (real) vector of dimen-

sionM . The absolute value of the complex number x is denotedas |x|, and the determinant, trace and Frobenius norm of a matrixA will be denoted, respectively, as det(A), tr(A) and ‖A‖F .The Kronecker product between two matrices is denoted by⊗, IL is the identity matrix of size L× L, 0 denotes the zeromatrix of the appropriate dimensions, and FN is the Fouriermatrix of sizeN . We use A−1/2 to denote the Hermitian squareroot matrix of the Hermitian matrix A−1 (the inverse of A),the operator diagL (A) constructs a block diagonal matrix fromthe L× L blocks in the diagonal of A, whereas diag(A) yieldsa vector with the elements of the main diagonal of A, andx = vec(X) constructs a vector by stacking the columns of X.

x ∼ CN (μ,R) indicates that x is a proper complex circularGaussian random vector of mean μ and covariance matrix Rand E[·] represents the expectation operator. Finally, ∝ standsfor equality up to additive and positive multiplicative constant(not depending on data) terms.

II. PROBLEM FORMULATION

We are given N samples of P time series that are L variate,xi [n] ∈ CL , i = 1, . . . , P, and n = 0, . . . , N − 1. These sam-ples are realizations of zero-mean proper Gaussian processesthat are independent and wide-sense stationary. The problemstudied in this work is to determine whether all these P pro-cesses have the same power spectral density (PSD) matrixat every frequency or, alternatively, the same matrix-valuedcovariance function. To mathematically formulate the detec-tion problem, it is necessary to introduce the vector yi =[xTi [0] · · · xTi [N − 1]]T ∈ CNL , which stacks the N samplesof the ith time series, and y = [yT1 · · · yTP ]T ∈ CP NL . Thus,the problem can be cast as the following binary hypothesis test:

H1 : y ∼ CN (0,RH1 ) ,

H0 : y ∼ CN (0,RH0 ) ,(1)

where CN (0,RHi) denotes a zero-mean circular complex

Gaussian distribution with covariance matrix RHi. Taking the

independence into account, the covariance matrices are

RH1 =

⎢⎢⎢⎢⎢⎣

R1 0 · · · 0

0 R2 · · · 0...

.... . .

...

0 0 · · · RP

⎥⎥⎥⎥⎥⎦, (2)

and

RH0 =

⎢⎢⎢⎢⎢⎣

R0 0 · · · 0

0 R0 · · · 0...

.... . .

...

0 0 · · · R0

⎥⎥⎥⎥⎥⎦

= IP ⊗ R0 , (3)

under H1 and H0 , respectively, with

Ri = E[yiyHi

]=

⎢⎢⎣

Mi [0] · · · Mi [−N + 1]...

. . ....

Mi [N − 1] · · · Mi [0]

⎥⎥⎦,

(4)being a block-Toeplitz covariance matrix built from the(unknown) covariance sequence of xi [n], Mi [m] = E[xi [n]xHi [n−m]]. Moreover, under H1 , we do not assume any fur-ther particular structure and, for notational simplicity, we havedefined the common covariance sequence under H0 as M0 [m].

Dealing with block-Toeplitz covariance matrices is challeng-ing, since they typically prevent the derivation of closed-formdetectors, as our previous works in [19]–[21] show. These worksalso presented a solution to overcome this problem, which isbased on an asymptotic (asN → ∞) approximation of the like-lihood. Concretely, this approach performs a block-circulant

Page 3: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

6270 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 66, NO. 23, DECEMBER 1, 2018

approximation of Ri , and results in convergence in the mean-square sense of the asymptotic likelihood to the likelihood [21].

Assume now that M , with M ≥ L,1 independent and identi-cally distributed (i.i.d.) realizations of y, say y(0) , . . . ,y(M−1) ,are available. Then, to obtain the asymptotic likelihood, we mustdefine the transformation z = [zT1 · · · zTP ]T , where

zi =(FHN ⊗ IL

)yi =

[zTi [0] · · · zTi [N − 1]

]T, (5)

with zi [k] being the discrete Fourier transform (DFT) of xi [n]at frequency θk = 2πk/N, k = 0, . . . , N − 1. Exploiting thistransformation, the asymptotic approximation of the likelihoodis [19], [20]

p(z(0) , . . . , z(M−1) ;SHi)

=1

πP NLM det(SHi)M

exp{−Mtr

(S−1Hi

S)}

, (6)

where thePNL× PNL sample covariance matrix of the trans-formed observations is

S =1M

M−1∑

m=0

z(m )z(m )H , (7)

and the covariance matrices under both hypotheses are

SH1 =

⎢⎢⎢⎢⎢⎣

S1 0 · · · 0

0 S2 · · · 0...

.... . .

...

0 0 · · · SP

⎥⎥⎥⎥⎥⎦, (8)

and

SH0 = IP ⊗ S0 . (9)

Moreover, Si is an NL×NL block-diagonal matrix whoseL× L blocks Si,1 , . . . ,Si,N are given by the power spectraldensity matrix, i.e.,

Si,k+1 = Si(ejθk ) =N−1∑

n=0

Mi [n]e−jθk n , (10)

with i = 1, . . . , P, and k = 0, . . . , N − 1. Finally, using theasymptotic likelihood, the detection problem in (1) is asymptot-ically equivalent to

H1 : z(m ) ∼ CN (0,SH1 ) , m = 0, . . . ,M − 1,

H0 : z(m ) ∼ CN (0,SH0 ) , m = 0, . . . ,M − 1.(11)

That is, we are testing two different covariance matrices withknown structure but unknown values.

Although our formulation assumes Gaussian data, as well asthe availability of M realizations each of length N , this is notvery restrictive in practice. First, the Gaussianity assumptioncan be dropped since the transformed observations, zi [k], aresamples of the DFT and it is well known, see [22], that un-der some mild conditions the DFT of large data records yields

1This reasonable assumption is necessary for the derivation of the GLRT.However, for the study of the existence of optimal invariant detectors, onlyPM ≥ L is required.

zi [k] that are independent and Gaussian distributed with co-variance matrix Si(ejθk ). Moreover, if only M = 1 realizationis available, it is possible to split this single realization intoM windows, but keeping in mind that the realizations may nolonger be i.i.d., as the samples in different windows may be de-pendent. This resembles the Welch method for PSD estimation.Moreover, further exploiting on this idea, it would be possibleto increase the number of realizations allowing some overlapamong different windows. However, the study of the side ef-fects (due to a higher correlation among windows) will not beanalyzed in this work. Finally, the case of different numbersMi

of realizations for each process would require a different treat-ment, which would be equivalent to the introduction of furtherstructure (subsets of identical covariance matrices) under thealternative hypothesis. Although this is a very interesting case,which is currently under consideration, the modification of theproblem invariances introduces an additional complexity that isbeyond the scope of this paper.

A. The Generalized Likelihood Ratio Test

The typical approach to solve detection problems with un-known parameters, as (11), is based on the GLRT. Actually, theworks in [8], [9], [11] derived the GLRT for this problem underdifferent assumptions, but they only studied the case of P = 2time series. The GLRT in [11] was derived for univariate realtime series, which was extended to multivariate real signals in[8] and multivariate complex signals in [9]. Here, we present the(straightforward) extension of these GLRTs to P (≥2) complexand multivariate processes. Concretely, the GLRT is given by

log G ∝N−1∑

k=0

P∑

i=1

log

⎢⎢⎣

det(Si(ejθk )

)

det(

1P

∑P

p=1Sp(ejθk )

)

⎥⎥⎦ , (12)

where

Si(ejθk ) =1M

M−1∑

m=0

z(m )i [k]z(m )H

i [k], (13)

is the sample PSD matrix at frequency θk , i.e., an L× L blockof S. Alternatively, the GLRT may be rewritten as

log G ∝N−1∑

k=0

P∑

i=1

log det(Ci(ejθk )

), (14)

where the frequency coherence is

Ci(ejθ ) =(

1P

P∑

p=1

Sp(ejθ )

)−1/2

Si(ejθ )

(1P

P∑

p=1

Sp(ejθ )

)−1/2

.

(15)

Finally, it is important to address how the threshold mustbe chosen. On one hand, we could use Wilks’ theorem [13],which states that the GLRT is asymptotically (as M → ∞)

Page 4: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

RAMIREZ et al.: TESTING EQUALITY OF MULTIPLE POWER SPECTRAL DENSITY MATRICES 6271

distributed as

−2MN−1∑

k=0

P∑

i=1

log det(Ci(ejθk )

)∼ χ2

(P −1)NL2 , (16)

that is, it is distributed as a Chi-squared distribution with (P −1)NL2 degrees of freedom. On the other hand, and for the finitecase, we could take into account that the detector is invariantto MIMO filtering, which allows us to consider that under H0the PSDs are Si(ejθ ) = IL ,∀θ and i = 1, . . . , P . Thus, underthis assumption we could obtain the thresholds using MonteCarlo simulations, which will depend on P,L and M , but willbe independent of the specific values of Si(ejθ ).

III. ON THE EXISTENCE OF OPTIMAL DETECTORS

Since GLRTs are not necessarily optimal for finite datarecords [23], the goal of this section is to study the existence ofoptimal invariant detectors for the hypothesis test in (11). In par-ticular, we will show that neither the uniformly most powerfulinvariant test (UMPIT) nor the locally most powerful invarianttest (LMPIT) exist in the general case.

To derive invariant detectors, such as the UMPIT or theLMPIT, we must first identify the problem invariances [15].Specifically, we must define the group of invariant transforma-tions, which is composed only of linear transformations sinceGaussianity must be preserved. Among those linear transfor-mations, it is clear that applying the same invertible multiple-input-multiple-output (MIMO) filtering to all time series doesnot modify the structure of the hypotheses. That is, if the PSDsare equal, the same MIMO filtering yields also identical PSDsand if they are different, they will stay different. In particular, thistransformation is xi [n] = (H ∗ xi)[n], where H[n] ∈ CL×L isa filtering matrix common to all processes and ∗ denotes con-volution, which when applied to zi becomes

zi = Gzi , (17)

where G is a block-diagonal matrix with invertible L× Lblocks. Additionally, we may label the processes in any arbitraryorder, which may be even done on a frequency-by-frequency ba-sis. The last invariance consists of a frequency reordering. Thatis, we may permute the frequencies, i.e., permute zi [k], providedthat the same permutation is applied to all processes. Then, thegroup of invariant transformations for the hypothesis test in(11) is

G ={g : z �→ g(z) = Gz

}, (18)

where

G = (IP ⊗ G)

(N∑

k=1

PTk ⊗ ekeTk ⊗ IL

)

(IP ⊗ T ⊗ IL ),

(19)with ek being the kth column of IN , Pk ∈ RP ×P and T ∈RN×N. Moreover, the matrix IP ⊗ T ⊗ IL applies a frequencyreordering (permutation) to every process, G is a block-diagonalmatrix with L× L invertible blocks Gk , and Pk is a matrixthat permutes the kth frequency of all processes, i.e., permutesthe position of z1 [k − 1], . . . , zP [k − 1] in z. Then, Pk ∈ Pk ,

T ∈ T , and Gk ∈ G, where Pk and T are the set of permuta-tion matrices formed by Pk and T, respectively, and G is theset of L× L invertible matrices. In Appendix I, we prove that(∑N

k=1 PTk ⊗ ekeTk ⊗ IL

)z corresponds to the relabeling of

the processes at each frequency.Equipped with the transformation group G, it is possible to

study the existence of the UMPIT. The typical approach [15]involves finding the maximal invariant statistic and computingits densities under both hypotheses. An alternative to this pro-cess, which is usually very involved or even intractable, is basedon Wijsman’s theorem [16], [17], and allows us to derive theUMPIT, if it exists, without finding the maximal invariant statis-tic nor its distributions. This theorem directly gives the ratio ofthe distributions of the maximal invariant statistic as follows

L =∑

T ,P1 ,...,PN

GN

|det(G)|2MP exp{−Mtr

(S−1H1

GSGH)}dG

T ,P1 ,...,PN

GN

|det(G)|2MP exp{−Mtr

(S−1H0

GSGH)}dG

,

(20)

where GN = G × · · · × G and dG is an invariant measure onthe set GN and the sum over Pk represents the sum over all per-mutations matrices in the set Pk . If the ratio L , or a monotonetransformation thereof, did not depend on unknown parameters,it would yield the UMPIT. When such dependence is present,the UMPIT does not exist, and in that case it is sensible to con-sider the case of close hypotheses to study the existence of theLMPIT.

In the following, we will simplify the ratio L , show that theUMPIT does not exist, and study the case of close hypotheses.The next lemma presents the first simplification of L .

Lemma 1: The ratio L in (20) can be written as

L ∝∑

T

P1 ,...,PN

GN

exp (−Mα(G))N∏

l=1

β(Gl)dGl , (21)

where

α(G) =N∑

k=1

P∑

i=1

tr(Wi,kGk Cπk [i],Π[k ]GH

k

), (22)

the matrix Cπk [i],Π[k ] is a permutation of the sample coherencematrix

Ci,k =

[1P

P∑

p=1

Sp,k

]−1/2

Si,k

[1P

P∑

p=1

Sp,k

]−1/2

, (23)

with

Si,k+1 =1M

M−1∑

m=0

z(m )i [k]z(m )H

i [k], (24)

being the sample estimate of the PSD matrix of {xi [n]}N−1n=0 at

frequency 2πk/N . Moreover, the scalar β(Gl) is given by

β(Gl) = |det(Gl)|2MP exp{−PMtr

(GHl Gl

)}, (25)

Page 5: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

6272 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 66, NO. 23, DECEMBER 1, 2018

and the matrix Wi,k is

Wi,k =

(1P

P∑

p=1

S−1p,k

)−1/2

S−1i,k

(1P

P∑

p=1

S−1p,k

)−1/2

− IL .

(26)Proof: The proof is presented in Appendix II. �As can be seen in (21), the ratio L depends on the matrices

Wi,k , which are unknown, proving that the UMPIT does notexist. Hence, as previously mentioned, we focus hereafter on thecase of close hypotheses, i.e., the PSD matrices are very similar.In this case, S1 ≈ · · · ≈ SP , which yields Wi,k ≈ 0. Underthis assumption, the exponent term in (21) becomes small andallows us to perform a Taylor series expansion aroundα(G) = 0as follows

exp(−Mα(G)) ≈ 12(2 − 2Mα(G) +M 2α2(G)

), (27)

which yields

L ∝ Ll + Lq , (28)

where the linear and quadratic terms are respectively given by

Ll = −2M∑

T

P1 ,...,PN

GN

α(G)N∏

l=1

β(Gl)dGl , (29)

and

Lq ∝M 2∑

T

P1 ,...,PN

GN

α2(G)N∏

l=1

β(Gl)dGl . (30)

Next, we analyze the linear term Ll .Lemma 2: The linear term is zero, i.e.,

Ll = 0. (31)

Proof: The proof can be found in Appendix III. �Since the linear term is zero, only the quadratic term has to

be taken into account. The final expression is provided in thefollowing theorem.

Theorem 1: The ratio of the distributions of the maximalinvariant statistic is given by

L ∝N∑

k=1

P∑

i=1

∥∥∥Ci,k

∥∥∥

2

F+ β

N∑

k=1

P∑

i=1

tr2(Ci,k

), (32)

where β is a data-independent function of the matrices Wi,k ,which are unknown.

Proof: See Appendix IV. �As Theorem 1 shows, the ratio L depends on unknown pa-

rameters, which are summarized in β. Hence, the LMPIT fortesting the equality of PSD matrices at all frequencies does notexist in the general case. An exception is examined in the fol-lowing section. Moreover, an LMPIT-inspired detector is alsopresented in Section V, and its performance is analyzed usingcomputer simulations.

One final comment is in order. Since the ratio L is given bya linear combination (with unknown weights) of the Frobeniusnorm and the trace of Ci,k , the optimal detector would be afunction of the eigenvalues of Ci,k . This makes sense as the

distributions of these eigenvalues are not modified by any of theinvariances.

IV. THE LMPIT FOR UNIVARIATE TIME SERIES

The case of univariate time series, L = 1, is interesting sincethe LMPIT does exist, as shown in the next corollary.

Corollary 1: For L = 1 the ratio in (32) reduces to

L ∝N∑

k=1

P∑

i=1

∣∣∣Ci,k

∣∣∣2, (33)

which is therefore the LMPIT.Proof: In the univariate case, the coherence matrices Ci,k

become scalar, that is, Ci,k = Ci,k , and consequently∥∥∥Ci,k

∥∥∥

2

F= tr2

(Ci,k

)=

∣∣∣Ci,k

∣∣∣2, (34)

which yields

L ∝ (1 + β)N∑

k=1

P∑

i=1

∣∣∣Ci,k

∣∣∣2∝

N∑

k=1

P∑

i=1

∣∣∣Ci,k

∣∣∣2. (35)

�Interestingly, using (10) and the definition of Ci,k in (23),

the LMPIT in Corollary 1 may be rewritten in a more insightfulform as

L ∝N−1∑

k=0

P∑

i=1

S2i

(ejθk

)

[P∑

i=1

Si(ejθk

)]2 , (36)

or asymptotically (as N → ∞)

L ∝∫ π

−π

P∑

i=1

S2i

(ejθ

)

[P∑

i=1

Si(ejθ

)]2

2π. (37)

Thus, for L = 1, the LMPIT is given by the integral of the sumof the squares of the PSD estimates normalized by the square oftheir sum.

V. AN LMPIT-INSPIRED DETECTOR

Since the LMPIT does not exist in the multivariate case (L >1), we present here an LMPIT-inspired detector. In particular,we could use each of the terms in (32) as test statistics, whichare

LF =N∑

k=1

P∑

i=1

∥∥∥Ci,k

∥∥∥

2

F=

N−1∑

k=0

P∑

i=1

∥∥∥Ci

(ejθk

)∥∥∥

2

F, (38)

and

LT =N∑

k=1

P∑

i=1

tr2(Ci,k

)=

N−1∑

k=0

P∑

i=1

tr2(Ci

(ejθk

)), (39)

Page 6: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

RAMIREZ et al.: TESTING EQUALITY OF MULTIPLE POWER SPECTRAL DENSITY MATRICES 6273

where the frequency coherence, Ci(ejθ ), was defined in (15).Note that in the univariate case (L = 1), both (38) and (39)reduce to the true LMPIT (33). However, for multivariate pro-cesses we only propose LF as a detector and discard LF .To understand why, let us analyze both. Considering the casewhere all PSDs are identical (H0), the coherence matrices areCi(ejθ ) ≈ IL , ∀θ. Actually, for a large number of realizations,M → ∞, they converge to Ci(ejθ ) = IL , ∀θ. Hence, to distin-guish between both hypotheses, the detectors must measure howdifferent Ci(ejθ ) is from IL . This is exactly what the statisticsLF and LT do. The only difference resides in the way theyquantify this difference: while LF uses the Frobenius norm,LT uses the trace. Since the Frobenius norm exploits informa-tion provided by the cross-spectral densities of each multivariatetime series, information which is neglected by the trace operator,one would expect LF to outperform LT .

Finally, as in Section IV, it is possible to write the asymptoticversions of (38) as

LF =∫ π

−π

P∑

i=1

∥∥∥Ci

(ejθ

)∥∥∥

2

F

2π. (40)

A. Threshold Selection

In this section, we study the threshold selection problem forthe LMPIT-inspired detector LF . Similarly to the approachesdescribed for the GLRT, we could consider that the PSDs areSi(ejθ ) = IL ,∀θ and i = 1, . . . , P , and use Monte Carlo simu-lations to obtain the thresholds. Of course, due to the invarianceto MIMO filtering, these thresholds should be valid for otherPSDs. The second approach is also based on Wilks’ theorem,but it cannot be directly applied. Concretely, we will followalong the lines in [18]. First, for close hypotheses, the GLRTmay be approximated by

N−1∑

k=0

P∑

i=1

log det(Ci

(ejθk

))=N−1∑

k=0

P∑

i=1

L∑

s=1

log(1+εi,s

(ejθk

))

≈N−1∑

k=0

P∑

i=1

L∑

s=1

(

εi,s(ejθk

)− ε2i,s(ejθk

)

2

)

, (41)

where 1 + εi,s(ejθk ) is the sth eigenvalue of Ci(ejθk ) and|εi,s(ejθk | � 1. After some straightforward manipulations, theabove approximation becomes

N−1∑

k=0

P∑

i=1

log det(Ci

(ejθk

)) ≈ NPL

2

+N−1∑

k=0

P∑

i=1

L∑

s=1

(

2εi,s(ejθk

)−(1 + εi,s

(ejθk

))2

2

)

,

(42)

Now, using (60), we get

P∑

i=1

L∑

s=1

εi,s(ejθk

)= 0, (43)

which yields

− 2MN−1∑

k=0

P∑

i=1

log det(Ci

(ejθk

))

≈M

N−1∑

k=0

P∑

i=1

∥∥∥Ci

(ejθk

)∥∥∥

2

F−MNPL. (44)

Hence, we obtain the following asymptotic distribution of LF

(MLF −MNPL) ∼ χ2(P −1)NL2 . (45)

VI. NUMERICAL RESULTS

This section studies the performance of the proposed detec-tor using Monte Carlo simulations, and compare it with thatof the GLRT. The performance evaluation is carried out in acommunication setup, where the signals are generated as

xi [n] =T −1∑

τ=0

Hi [τ ]si [n− τ ] + vi [n], i = 1, . . . , P,

which corresponds to a MIMO channel with finite impulse re-sponse. In this expression, the transmitted signals si [n] ∈ CQ

are independent multivariate processes whose entries are in-dependent QPSK symbols with unit energy, the noise vectorsvi [n] ∈ CL are independent with variance σ2 , and spatiallyand temporally white. The channel H1 [n] is a Rayleigh MIMOchannel with unit energy,2 spatially uncorrelated, and with ex-ponential power delay profile of parameter ρ. Finally, Hi [n] =√

1 − ΔhH1 [n] +√

ΔhEi [n], i = 2, . . . , P , with Ei [n] pos-sessing the same statistical properties as H1 [n] and being in-dependent. Under this model, Δh = 0 corresponds to signalshaving the same PSD, that is H0 , and 0 < Δh ≤ 1 measureshow far the hypotheses are, along with the signal-to-noise ratio,which is defined as

SNR (dB) = 10 log(

1σ2

). (46)

Experiment 1: In this first experiment, we have consideredP = 3 processes of dimension L = 3, Q = 1 signals are trans-mitted through MIMO channels with T = 20 taps, the param-eter of the exponential power delay profile is ρ = 0.75, andΔh = 0.1 under H1 . Moreover, to carry out the detection, a re-alization of 512 samples is available, which is then divided intoM = 4 windows of length N = 128. The probability of misseddetection for a fixed probability of false alarm pf a = 10−2 andfor a varying SNR is depicted in Fig. 1 . As this figure shows,the proposed LMPIT-inspired detector, LF , outperforms theGLRT, with an approximate gain of 2 dB.

Experiment 2: The setup of this experiment is equivalent tothat of Experiment 1, with the exception that Q = 3 signals aretransmitted. The results for this scenario are presented in Fig. 2 ,where similar conclusions can be drawn. In this scenario, whichcould be expected to be a bit more favorable for the GLRT,

2Each element of H1 [n] follows a proper complex Gaussian distribution withzero mean and unit variance.

Page 7: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

6274 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 66, NO. 23, DECEMBER 1, 2018

Fig. 1. Probability of missed detection for Experiment 1: P = 3, L = 3,Q = 1, T = 20, ρ = 0.75, Δh = 0.1, M = 4, and N = 128.

Fig. 2. Probability of missed detection for Experiment 2: P = 3, L = 3,Q = 3, T = 20, ρ = 0.75, Δh = 0.1, M = 4, and N = 128.

since the true PSD matrices are full rank, the detector LF stilloutperforms the GLRT.

Experiment 3: The third experiment considers P = 3 pro-cesses of dimension L = 5, and Q = 5 signals are transmitted.The channel parameters remain the same as in the two previousexperiments. However, in this case, 1024 samples are acquired,which are divided into M = 8 windows of length N = 128. Inthis case, the difference between the GLRT and the Frobeniusnorm detector is reduced as Fig. 3 shows. This was expectedsince, in this case, there is a larger M , which reduces the ac-curacy of the second-order Taylor expansion in (27), i.e., theassumption of close hypotheses begins to not hold true.

Experiment 4: The fourth experiment also analyzes the ef-fect of the distance between the hypotheses. In particular, wehave obtained the probability of missed detection (pf a = 10−2)for a varying Δh and two different SNRs, 0 and 5 dBs. In thisexperiment, there are P = 2 processes of dimensionL = 3, andQ = 3 signals are transmitted. The channel parameters remain

Fig. 3. Probability of missed detection for Experiment 3: P = 3, L = 5,Q = 5, T = 20, ρ = 0.75, Δh = 0.1, M = 8, and N = 128.

Fig. 4. Probability of missed detection for Experiment 4: P = 2, L = 3,Q = 3, T = 20, ρ = 0.75, M = 4, and N = 128.

the same as in the previous experiments with the exceptionof Δh , and 512 samples are obtained, which are divided intoM = 4 realizations of length N = 128. The results for this ex-periment are shown in Fig. 4, which demonstrates that the closehypotheses assumption holds for many setups, where the detec-tor LF still outperforms the GLRT.

Experiment 5: In the fifth experiment, we evaluate the effectof N and M . Specifically, we have considered a scenario withthe same parameters of Experiment 1, with the exception of theSNR, which is fixed to 3 dB, the length of the long realization andhow it is divided. Concretely, we have sweptN between 32 and256 in steps of 16 samples, and considered M = 4 and M = 8.Thus, a long realization of the appropriate length is generatedand divided according to the values ofN andM , that is, for eachpoint of the curves the total number of samples may be different.Figure 5 shows the probability of missed detection for pf a =10−2 , which shows that in this setup it is more convenient toreduce the variance of the estimator (increaseM ) at the expense

Page 8: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

RAMIREZ et al.: TESTING EQUALITY OF MULTIPLE POWER SPECTRAL DENSITY MATRICES 6275

Fig. 5. Probability of missed detection for Experiment 5: P = 3, L = 3,Q = 1, T = 20, ρ = 0.75, Δh = 0.1, and SNR = 3 dB.

Fig. 6. ROC curves for Experiment 6: P = 2, L = 30, Q = 3, T = 20,ρ = 0.75, Δh = 0.1, SNR = −8 dB, M = 30, and N = 128.

of a lower resolution (smallN ). This can be seen if we comparethe probability of missed detection forN = 32 andM = 8 withthat ofN = 64 andM = 4. Both have same number of samplesMN = 256, but pm is smaller for M = 8, i.e., for LF wehave pm = 0.1346 against pm = 0.3454. Finally, note that thisanalysis affects both, the GLRT and the proposed detector.

Experiment 6: This experiment evaluates the performanceof the detectors in a larger-scale scenario. Specifically, wehave considered P = 2 processes of dimension L = 30,Q = 3,the MIMO channels have T = 20 taps, ρ = 0.75 and SNR =−8 dB, Δh = 0.1 under H1 , and a long realization of 3840samples is generated, which is then divided into M = 30 win-dows of length N = 128. The receiver operating characteristic(ROC) curve for both detectors is depicted in Figure 6 , whichshows the better performance of the proposed detector even inthis large-scale scenario.

Experiment 7: In this experiment, we evaluate the ac-curacy of Wilks’ approximations for both, GLRT and theLMPIT-inspired detector. Fig. 7 shows the accuracy of these

Fig. 7. Empirical cumulate distribution functions (ECDF) for Experiment 7:P = 3, L = 4, Q = 4, T = 20, ρ = 0.75, M = 10, 20, . . . , 100, N = 64,and SNR = 5 dB.

approximations for a scenario with P = 3 processes of dimen-sion L = 4, andQ = 4 signals are transmitted. The channel pa-rameters are those of Experiment 1 with an SNR = 5 dB. Wehave considered a long realization (of the appropriate length)that is divided into M = 10, 20, . . . , 100 windows of lengthN = 64. As can be seen in the figure, the χ2 distribution ap-proximates much better the distribution of LF than that of theGLRT. That is, it seems to converge faster for the Frobeniusnorm based detector than for the GLRT.

VII. CONCLUSIONS

This work has studied the existence of optimal invariant de-tectors for testing whether P multivariate time series have thesame power spectral density (PSD) matrix at every frequency.Specifically, our derivation shows that the uniformly most pow-erful invariant test (UMPIT) for this problem does not exist.Considering close hypotheses (i.e., similar PSD matrices), weobtained the locally most powerful invariant test (LMPIT) forthe case of univariate time series, and showed that the LMPITdoes not exist in the multivariate case. Nevertheless, our deriva-tion suggested one LMPIT-inspired detector for multivariatetime series, which outperforms previously proposed detectorsas shown by extensive numerical examples.

APPENDIX IDERIVATION OF THE RELABELING MATRICES

Let us start by rewriting z as z = vec (Z), where

Z =

⎢⎢⎣

z1 [0] · · · zP [0]...

. . ....

z1 [N − 1] · · · zP [N − 1]

⎥⎥⎦

=N∑

k=1

ek ⊗[z1 [k − 1] · · · zP [k − 1]

]. (47)

Page 9: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

6276 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 66, NO. 23, DECEMBER 1, 2018

Relabeling the processes at the kth frequency corresponds topermuting the colums of

[z1 [k − 1] · · · zP [k − 1]

], that

is,[z1 [k − 1] · · · zP [k − 1]

]Pk , where Pk is an arbitary

P × P permutation matrix. It is important to note that the per-mutation matrix Pk depends on the frequency since we mayapply different relabelings at each frequency. The observationsafter the N (possibly) different relabelings are given by

Z =N∑

k=1

ek ⊗([

z1 [k − 1] · · · zP [k − 1]]Pk

)

=N∑

k=1

(ek ⊗

[z1 [k − 1] · · · zP [k − 1]

])Pk . (48)

Taking now into account that[z1 [k − 1] · · · zP [k − 1]

]=

(eTk ⊗ IL

)Z, (49)

it is easy to show that

ek ⊗[(

eTk ⊗ IL)Z]

=(ek ⊗ eTk ⊗ IL

)Z

=(ekeTk ⊗ IL

)Z, (50)

which yields

Z =N∑

k=1

(ekeTk ⊗ IL

)ZPk . (51)

Finally, vectorizing Z yields

z = vec(Z) =

(N∑

k=1

PTk ⊗ ekeTk ⊗ IL

)

z. (52)

APPENDIX IIPROOF OF LEMMA 1

Since G and SHiare block-diagonal matrices with block size

L, we may substitute S in (20) by diagL (S) without modifyingthe integrals. Before proceeding, we must define the block-diagonal matrix

Sπ =N∑

k,l=1

(PTk ⊗ ekeTk ⊗ IL

)(IP ⊗ T ⊗ IL ) diagL (S)

× (IP ⊗ TT ⊗ IL )(Pl ⊗ eleTl ⊗ IL

), (53)

and, taking into account the effect of the permutations, it be-comes

Sπ =

⎢⎢⎢⎢⎢⎣

Sπ1 [1],Π[1] 0 · · · 0

0 Sπ2 [1],Π[2] · · · 0...

.... . .

...

0 0 · · · SπN [P ],Π[N ]

⎥⎥⎥⎥⎥⎦, (54)

where πk [·], k = 1, . . . , N, are possibly different permutationsof size P and Π[·] is a permutation of size N . That is, πk [·]is the permutation associated to Pk , Pk → πk [·], and Π[·] isthe permutation associated to T, T → Π[·]. Applying now thechange of variables GΠ[k ] → GΠ[k ] [1/P

∑Pi=1 Si,Π[k ] ]−1/2 to

the integrals in the numerator and denominator of (20), the ratioL becomes

L =

T

P1 ,...,PN

GN

|det(G)|2MP exp (−Mγ1) dG

T

P1 ,...,PN

GN

|det(G)|2MP exp (−Mγ2) dG,

(55)where

γ1 = tr(S−1H1

(IP ⊗ G) Cπ

(IP ⊗ GH

)), (56)

and

γ2 = tr((

IP ⊗ GHS−10 G

)Cπ

), (57)

with

Cπ =

⎢⎢⎢⎢⎢⎣

Cπ1 [1],Π[1] 0 · · · 0

0 Cπ2 [1],Π[2] · · · 0...

.... . .

...

0 0 · · · CπN [P ],Π[N ]

⎥⎥⎥⎥⎥⎦,

(58)where we have used (9). We continue by applying the changeof variables Gk → S1/2

0,k Gk to the integral in the denominator,which simplifies γ2 to

γ2 = tr((

IP ⊗ GHG)Cπ

)

=N∑

k=1

tr

(

GHk Gk

P∑

i=1

Cπk [i],Π[k ]

)

= P

N∑

k=1

tr(GHk Gk

),

(59)

where we have taken into account that

P∑

i=1

Ci,k = P IL . (60)

Since this exponent does not depend on the observations, thedenominator may be discarded from the ratio. Let us now

consider the change of variables G → (1/P

∑i S

−1i

)−1/2 G,which yields

γ1 = tr[(W + I) (IP ⊗ G) Cπ

(IP ⊗ GH

)], (61)

where

W =

⎢⎢⎢⎢⎢⎣

W1,1 0 · · · 0

0 W1,2 · · · 0...

.... . .

...

0 0 · · · WP,N

⎥⎥⎥⎥⎥⎦, (62)

with Wi,k defined in (26). The proof concludes by taking(60) again into account and the block-diagonal structure of allmatrices. �

Page 10: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

RAMIREZ et al.: TESTING EQUALITY OF MULTIPLE POWER SPECTRAL DENSITY MATRICES 6277

APPENDIX IIIPROOF OF LEMMA 2

The linear term Ll can be rewritten as

Ll = − 2MψN−1∑

T

N∑

k=1

P1 ,...,PN

P∑

i=1∫

Gβ(Gk )tr

(Wi,kGk Cπk [i],Π[k ]GH

k

)dGk , (63)

where

ψ =∫

Gβ(Gl)dGl , (64)

does not depend on l. Now, performing the sum overP1 , . . . ,PN , Ll becomes

Ll = − 2[(P − 1)!]NMψN−1∑

T

N∑

k=1

P∑

pk =1

P∑

i=1∫

Gβ(Gk )tr

(Wi,kGk Cpk ,Π[k ]GH

k

)dGk

= − 2[(P − 1)!]NMψN−1∑

T

N∑

k=1

P∑

pk =1

Gβ(Gk )tr

[(P∑

i=1

Wi,k

)

Gk Cpk ,Π[k ]GHk

]

dGk ,

(65)

where for notational convenience

N∑

k=1

P∑

pk =1

=N∑

k=1

P∑

p1 =1

· · ·P∑

pN =1

, (66)

and we have taken into account that

P

f(π[i]) = (P − 1)!P∑

p=1

f(p), (67)

for permutations of size P and any arbitrary function f(·). Theproof follows from

P∑

i=1

Wi,k = 0, ∀k. (68)

APPENDIX IVPROOF OF THEOREM 1

Exploiting the results of Lemma 2, the ratio of distributionsof the maximal invariant statistic simplifies to

L ∝∑

T

P1 ,...,PN

GN

α2(G)N∏

l=1

β(Gl)dGl , (69)

and expanding α2(G) yields

L ∝ L1 + L2 + L3 + L4 (70)

where the expressions of the terms in the right-hand side of(70) are shown at the bottom of this page. After summing overP1 , . . . ,PN and T , L1 becomes

L1 ∝N∑

k,l=1

P∑

pk =1

P∑

i=1

Gβ(Gk )tr2

(Wi,kGk Cpk ,lG

Hk

)dGk .

(75)

L1 = ψN−1∑

T

N∑

k=1

P1 ,...,PN

P∑

i=1

Gβ(Gk )tr2

(Wi,kGk Cπk [i],Π[k ]GH

k

)dGk , (71)

L2 = ψN−2∑

T

N∑

k,l=1k �= l

P1 ,...,PN

P∑

i=1

[∫

Gβ(Gk )tr

(Wi,kGk Cπk [i],Π[k ]GH

k

)dGk

]

×[∫

Gβ(Gl)tr

(Wi,lGlCπl [i],Π[l]GH

l

)dGl

], (72)

L3 = ψN−1∑

T

N∑

k=1

P1 ,...,PN

P∑

i,j=1i �=j

Gβ(Gk )tr

(Wi,kGk Cπk [i],Π[k ]GH

k

)tr(Wj,kGk Cπk [j ],Π[k ]GH

k

)dGk , (73)

L4 = ψN−2∑

T

N∑

k,l=1k �= l

P1 ,...,PN

P∑

i,j=1i �=j

[∫

Gβ(Gk )tr

(Wi,kGk Cπk [i],Π[k ]GH

k

)dGk

]

×[∫

Gβ(Gl)tr

(Wj,lGlCπl [j ],Π[l]GH

l

)dGl

]. (74)

Page 11: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

6278 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 66, NO. 23, DECEMBER 1, 2018

Let us now consider L2 , which after summing over P1 , . . . ,PN ,becomes

L2 ∝∑

T

N∑

k,l=1k �= l

P∑

pk =1

P∑

ql =1

P∑

i=1

×[∫

Gβ(Gk )tr

(Wi,kGk Cpk ,Π[k ]GH

k

)dGk

]

×[∫

Gβ(Gl)tr

(Wi,lGlCql ,Π[l]GH

l

)dGl

]. (76)

Carrying out the summations in pk and ql , and taking (60) intoaccount, the term L2 simplifies to

L2 ∝∑

T

N∑

k,l=1k �= l

P∑

i=1

[∫

Gβ(Gk )tr

(Wi,kGkGH

k

)dGk

]

×[∫

Gβ(Gl)tr

(Wi,lGlGH

l

)dGl

], (77)

which does not depend on the observations and thereforecan be discarded. We shall now focus on L3 , which can berewritten as

L3 ∝∑

T

N∑

k=1

P∑

pk =1

P∑

qk =1pk �=qk

P∑

i,j=1i �=j

×∫

Gβ(Gk )tr

(Wi,kGk Cpk ,Π[k ]GH

k

)

× tr(Wj,kGk Cqk ,Π[k ]GH

k

)dGk , (78)

since

P

f(π[i])g(π[j]) = (P − 2)!P∑

p,q=1p �=q

f(p)g(q), (79)

for permutations of size P , i �= j, and two arbitrary functionsf(·) and g(·). The expression for L3 simplifies to

L3 ∝∑

T

N∑

k=1

P∑

pk =1

P∑

i,j=1i �=j

Gβ(Gk )tr

(Wi,kGk Cpk ,Π[k ]GH

k

)

× tr(Wj,kGk

(P I − Cpk ,Π[k ]

)GHk

)dGk , (80)

after summing in qk and taking into account that

P∑

qk =1pk �=qk

Cqk ,Π[k ] = P IL − Cpk ,Π[k ]. (81)

Finally, expanding the second trace and summing over pk and jyields

L3 ∝N∑

k,l=1

P∑

pk =1

P∑

i=1

Gβ(Gk )tr2

(Wi,kGk Cpk ,lG

Hk

)dGk ,

(82)

which is identical (up to a multiplicative and additive constants)to L1 . Summing over P1 , . . . ,PN , the term L4 becomes

L4 ∝∑

T

N∑

k,l=1k �= l

P∑

pk =1

P∑

ql =1

P∑

i,j=1i �=j

×[∫

Gβ(Gk )tr

(Wi,kGk Cpk ,Π[k ]GH

k

)dGk

]

×[∫

Gβ(Gl)tr

(Wj,lGlCql ,Π[l]GH

l

)dGl

], (83)

which reduces to

L4 ∝∑

T

N∑

k,l=1k �= l

P∑

i,j=1i �=j

[∫

Gβ(Gk )tr

(Wi,kGkGH

k

)dGk

]

×[∫

Gβ(Gl)tr

(Wj,lGlGH

l

)dGl

], (84)

after summing over pk and ql , and taking (60) into account. It isclear that L4 does not depend on the observations and thereforecan be discarded. Then, combining all Li , we obtain

L ∝N∑

k,l=1

P∑

pk =1

P∑

i=1

Gβ(Gk )tr2

(Wi,kGk Cpk ,lG

Hk

)dGk .

(85)Applying the change of variables Gk → Vi,kGkUH

pk ,l, with

Cpk ,l = Upk ,lΣpk ,lUHpk ,l

and Wi,k = Vi,kΛi,kVHi,k being the

eigenvalue decompositions of Cpk ,l and Wi,k , yields

L ∝N∑

k,l=1

P∑

pk =1

P∑

i=1

Gβ(Gk )tr2 (GH

k Λi,kGkΣpk ,l

)dGk .

(86)Now, expressing the trace as

tr(GHk Λi,kGkΣpk ,l

)= σT

pk ,lGkλi,k , (87)

where σpk ,l = diag(Σpk ,l), λi,k = diag(Λi,k ), and [Gk ]m,n =|[Gk ]m,n |2 , the ratio becomes

L ∝N∑

k,l=1

P∑

pk =1

P∑

i=1

σTpk ,l

Ei,kσpk ,l , (88)

where

Ei,k =∫

Gβ(Gk )Gkλi,kλ

Ti,kG

Tk dGk . (89)

The quadratic form σTpk ,l

Ei,kσpk ,l is invariant to permutations3

of the elements of σpk ,l , then Ei,k must be of the form

Ei,k = ei,kI + ei,k11T , (90)

3This permutation is an element of the set G, i.e., particular case of themultiplication by Gk .

Page 12: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

RAMIREZ et al.: TESTING EQUALITY OF MULTIPLE POWER SPECTRAL DENSITY MATRICES 6279

yielding

L ∝N∑

k,l=1

P∑

pk =1

P∑

i=1

σTpk ,l

(ei,kI + ei,k11T

)σpk ,l

=N∑

k,l=1

P∑

pk =1

P∑

i=1

(ei,k

∥∥∥Cpk ,l

∥∥∥

2+ ei,k tr2

(Cpk ,l

))

=N∑

k,l=1

P∑

pk =1

(ek

∥∥∥Cpk ,l

∥∥∥

2+ ek tr2

(Cpk ,l

)), (91)

where

ek =P∑

i=1

ei,k , ek =P∑

i=1

ei,k . (92)

The proof concludes by rewriting L as

L ∝ e

N∑

l=1

P∑

pk =1

∥∥∥Cpk ,l

∥∥∥

2+ e

N∑

l=1

P∑

pk =1

tr2(Cpk ,l

), (93)

where

e =N∑

k=1

ek e =N∑

k=1

ek , (94)

dividing (93) by e and defining β = e/e. �

REFERENCES

[1] D. S. Coates and P. J. Diggle, “Tests for comparing two estimated spectraldensities,” J. Time Ser. Anal., vol. 7, no. 1, pp. 7–20, Jan. 1986.

[2] P. J. Diggle and N. I. Fisher, “Nonparametric comparison of cumulativeperiodograms,” J. Roy. Statist. Soc., Ser. C (App. Statist.), vol. 40, no. 3,pp. 423–434, 1991.

[3] Y. Kakizawa, R. H. Shumway, and M. Taniguchi, “Discrimination andclustering for multivariate time series,” J. Amer. Statist. Assoc., vol. 93,no. 441, pp. 328–340, Mar. 1998.

[4] K. Fokianos and A. Savvides, “On comparing several spectral densities,”Technometrics, vol. 50, no. 3, pp. 317–331, 2008.

[5] J. K. Tugnait, “Wireless user authentication via comparison of powerspectral densities,” IEEE J. Sel. Areas Commun., vol. 31, no. 9, pp. 1791–1802, Sep. 2013.

[6] A. Tani and R. Fantacci, “A low-complexity cyclostationary-based spec-trum sensing for UWB and WiMAX coexistence with noise uncertainty,”IEEE Trans. Veh. Technol., vol. 59, no. 6, pp. 2940–2950, Jul. 2010.

[7] P. J. Diggle, Time Series (Oxford Statistical Sciences Series). Oxford, UK:Clarendon, 1990.

[8] N. Ravishanker, J. R. M. Hosking, and J. Mukhopadhyay, “Spectrum-based comparison of stationary multivariate time series,” MethodologyComput. Appl. Probab., vol. 12, no. 4, pp. 749–762, 2010.

[9] J. K. Tugnait, “Comparing multivariate complex random signals: Algo-rithm, performance analysis and application,” IEEE Trans. Signal Pro-cess., vol. 64, no. 4, Feb. 2016.

[10] C. Jentsch and M. Pauly, “Testing equality of spectral densities usingrandomization techniques,” Bernoulli, vol. 21, no. 2, pp. 697–739, May2015.

[11] R. Lund, H. Bassily, and B. Vidakovic, “Testing equality of stationaryautocovariances,” J. Time Ser. Anal., vol. 30, no. 3, pp. 332–348, 2009.

[12] T. W. Anderson, An Introduction to Multivariate Statistical Analysis. NewYork, NY, USA: Wiley, 1958.

[13] S. M. Kay, Fundamentals of Statistical Signal Processing, Volume II:Detection Theory. Upper Saddle River, NJ, USA: Prentice-Hall, 1998.

[14] D. Ramırez, D. Romero, J. Vıa, R. Lopez-Valcarce, and I. Santamarıa,“Locally optimal invariant detector for testing equality of two power spec-tral densities,” in Proc. IEEE Int. Conf. Acoust., Speech Signal Process.,Calgary, Canada, Apr. 2018, pp. 3929–3933.

[15] L. L. Scharf, Statistical Signal Processing: Detection, Estimation, andTime Series Analysis. Reading, MA, USA: Addison-Wesley, 1991.

[16] R. A. Wijsman, “Cross-sections of orbits and their application to densitiesof maximal invariants,” in Proc. 5th Berkeley Symp. Math. Statist. Prob.,vol. 1, 1967, pp. 389–400.

[17] J. R. Gabriel and S. M. Kay, “Use of Wijsman’s theorem for the ratioof maximal invariant densities in signal detection applications,” in Proc.Asilomar Conf. Signals, Syst., Comput., Nov. 2002, vol. 1, pp. 756–762.

[18] D. Ramırez, J. Vıa, I. Santamarıa, and L. L. Scharf, “Locally most powerfulinvariant tests for correlation and sphericity of Gaussian vectors,” IEEETrans. Inf. Theory, vol. 59, no. 4, pp. 2128–2141, Apr. 2013.

[19] D. Ramırez, P. J. Schreier, J. Vıa, I. Santamarıa, and L. L. Scharf, “De-tection of multivariate cyclostationarity,” IEEE Trans. Signal Process.,vol. 63, no. 20, pp. 5395–5408, Oct. 2015.

[20] D. Ramırez, J. Vıa, I. Santamarıa, and L. L. Scharf, “Detection of spatiallycorrelated Gaussian time series,” IEEE Trans. Signal Process., vol. 58,no. 10, pp. 5006–5015, Oct. 2010.

[21] D. Ramırez, G. Vazquez-Vilar, R. Lopez-Valcarce, J. Vıa, and I. San-tamarıa, “Detection of rank-P signals in cognitive radio networks withuncalibrated multiple antennas,” IEEE Trans. Signal Process., vol. 59,no. 8, pp. 3764–3774, Aug. 2011.

[22] D. R. Brillinger, Time Series: Data Analysis and Theory. New York, NY,USA: McGraw-Hill, 1981.

[23] K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis. NewYork, NY, USA: Academic, 1979.

David Ramırez (S’07–M’12–SM’16) received theTelecommunication Engineer degree and the Ph.D.degree in electrical engineering from the Universityof Cantabria, Santander, Spain, in 2006 and 2011, re-spectively. From 2006 to 2011, he was with the Com-munications Engineering Department, University ofCantabria, Santander, Spain. In 2011, he joined asa Research Associate with the University of Pader-born, Germany, and subsequently became an Assis-tant Professor (Akademischer Rat). He is now anAssistant Professor (Profesor Visitante) with the Uni-

versity Carlos III of Madrid, Madrid, Spain. He was a Visiting Researcher withthe University of Newcastle, New South Wales, Australia, and University Col-lege London, London, UK. His research interests include signal processing forwireless communications, statistical signal processing, change-point manage-ment, and signal processing on graphs and has been involved in several nationaland international research projects on these topics. Dr. Ramırez was the recipientof the 2012 IEEE Signal Processing Society Young Author Best Paper Awardand the 2013 Extraordinary Ph.D. Award of the University of Cantabria. More-over, he currently serves as an Associate Editor for the IEEE TRANSACTIONS

ON SIGNAL PROCESSING and is a Member of the IEEE Technical Committee onSignal Processing Theory and Methods. He was also Publications Chair of the2018 IEEE Workshop on Statistical Signal Processing.

Daniel Romero (M’16) received the M.Sc. and Ph.D.degrees in signal theory and communications fromthe University of Vigo, Vigo, Spain, in 2011 and2015, respectively. From July 2015 to November2016, he was a Postdoctoral Researcher with theDigital Technology Center and Department of Elec-trical and Computer Engineering, University ofMinnesota, Minneapolis, MN, USA. In December2016, he joined the Department of Information andCommunication Technology, University of Agder,Norway, as an Associate Professor. His research in-

terests lie in the areas of machine learning, optimization, signal processing, andcommunications.

Page 13: Testing Equality of Multiple Power Spectral Density Matrices · ples are realizations of zero-mean proper Gaussian processes that are independent and wide-sense stationary. The problem

6280 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 66, NO. 23, DECEMBER 1, 2018

Javier Vıa (M’08–SM’12) received the degree intelecommunication engineering and the Ph.D. de-gree in electrical engineering from the Universityof Cantabria, Santander, Spain, in 2002 and 2007,respectively.

In 2002, he joined the Department of Communi-cations Engineering, University of Cantabria, wherehe is currently an Associate Professor. He has vis-ited Smart Antennas Research Group, Stanford Uni-versity, Stanford, CA, USA, and the Department ofElectronics and Computer Engineering, Hong Kong

University of Science and Technology, Hong Kong. He has actively participatedin several European and Spanish research projects. His research interests in-clude blind channel estimation and equalization in wireless communication sys-tems, multivariate statistical analysis, quaternion signal processing, and kernelmethods.

Roberto Lopez-Valcarce (S’95–M’01) received thetelecommunication engineering degree from the Uni-versity of Vigo, Vigo, Spain, in 1995, and the M.S.and Ph.D. degrees in electrical engineering from theUniversity of Iowa, Iowa City, IA, USA, in 1998 and2000, respectively. In 1995, he was a Project Engi-neer with Intelsis, Santiago de Compostela, Spain. Hewas a Ramn y Cajal Postdoctoral Fellow of the Span-ish Ministry of Science and Technology from 2001to 2006. During that period, he was with the SignalTheory and Communications Department, University

of Vigo, where he is currently an Associate Professor. From 2010 to 2013, hewas a Program Manager with the Galician Regional Research Program on In-formation and Communication Technologies with the Department of Research,Development and Innovation. He has coauthored over 60 papers in leading in-ternational journals and holds several patents in collaboration with the industry.His research interests include adaptive signal processing, digital communica-tions, and sensor networks.

Dr. Lopez-Valcarce was the recipient of the 2005 Best Paper Award fromthe IEEE Signal Processing Society. He was an Associate Editor with the IEEETRANSACTIONS ON SIGNAL PROCESSING from 2008 to 2011, and a Memberof the IEEE Signal Processing for Communications and Networking TechnicalCommittee from 2011 to 2013. Currently, he is the Area Editor for the SignalProcessing Journal.

Ignacio Santamarıa (M’96–SM’05) received theTelecommunication Engineer degree and the Ph.D.degree in electrical engineering from the Universi-dad Politecnica de Madrid (UPM), Spain, in 1991and 1995, respectively. In 1992, he joined the Depart-ment of Communications Engineering, University ofCantabria, Santander, Spain, where he has been aFull Professor since 2007. He has co-authored morethan 200 papers in refereed journals and internationalconference proceedings, and holds two patents. Hiscurrent research interests include signal processing

algorithms and information-theoretic aspects of multiuser-multiantenna wire-less communication systems, multivariate statistical techniques, and machinelearning theories. He has been involved with numerous national and interna-tional research projects on these topics.

He has been a Visiting Researcher with the University of Florida (in 2000and 2004), with the University of Texas, Austin (in 2009), and with the Col-orado State University. Prof. Santamaria was General Co-Chair of the 2012IEEE Workshop on Machine Learning for Signal Processing (MLSP 2012).From 2009 to 2014, he was a Member of the IEEE Machine Learning for SignalProcessing Technical Committee. He served as Associate Editor and SeniorArea Editor of the IEEE TRANSACTIONS ON SIGNAL PROCESSING(2011–2015).He was a co-recipient of the 2008 EEEfCOM Innovation Award, as well asco-author of the paper that received the 2012 IEEE Signal Processing SocietyYoung Author Best Paper Award.