ieee transactions on signal processing, vol. 67, no. 18 ... · sequence design for spectral shaping...

13
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18, SEPTEMBER 15, 2019 4683 Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar , Fellow, IEEE Abstract—The topic of sequence design has received consider- able attention due to its wide applications in active sensing. One important desired property for the design sequence is the spectral shape. In this paper, the sequence design problem is formulated by minimizing the regularized spectral level ratio subject to a peak-to-average power ratio constraint. Then, two algorithms are proposed by combining both the Dinkelbach’s algorithm and the majorization–minimzation (MM) method organically. Specifically, by using the Dinkelbach’s algorithm, the challenging fractional programming problem can be handled by solving a series of sub- problems, which are further solved via the MM method. The numerical experiments verify the effectiveness of the optimiza- tion metric and demonstrate the performance of the proposed algorithms compared with the benchmark. Index Terms—Spectral shaping, sequence design, spectral level ratio, Dinkelbach’s algorithm, majorization-minimization, PAR constraint. I. INTRODUCTION T RANSMIT sequence plays an important role in many active-sensing applications including communications, sonar, radar, and medical imaging [1]–[3]. For instance, in radar systems, well-designed sequences can allow for a more accurate estimation and a reduced computational cost at the receive side. One important task of sequence design is to adapt the spectrum of the sequence to a changing or pre-specified environment. Specif- ically, the transmit sequence should avoid certain frequency bands or try to minimize the spectral power on those bands. The motivation behind can be well understood when considering spectrum sharing among radar and telecommunication systems [4]. Due to the ever growing demand of both wireless com- munication services and accurate remote sensing capabilities, the amount of desired bandwidth is increasing. Consequently, spectral sharing among radar and telecommunications becomes a solution to this significant issue [5], [6]. Signals from other radiation systems on some frequency range of the band can be treated as an interference for radar. In order to avoid the interference or reduce its effect on radar system, it is desired or required that the designed radar waveform has deep notches on Manuscript received August 19, 2018; revised January 29, 2019, May 16, 2019, and June 23, 2019; accepted July 2, 2019. Date of publication July 23, 2019; date of current version August 9, 2019. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Nicolas Gillis. This work was supported by the Hong Kong RGC Theme-based Research Scheme under Grant T21-602/15R. (Corresponding author: Linlong Wu.) The authors are with the Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong (e-mail: [email protected]; [email protected]). Digital Object Identifier 10.1109/TSP.2019.2929468 those frequency bands. Besides, combining several clear bands together can increase the total system bandwidth so as to improve the range resolution [7]. In addition, from the perspective of the radar signal design, several performance metrics [8]–[10] including spectral property may be also considered jointly to meet the waveform requirements. Therefore, spectral shaping has become a hot research topic in sequence design recently and a lot of works have contributed to it as seen in the burgeoning literature. From the perspective of problem formulation, the existing works dealing with spectral shaping can be roughly catego- rized into two categories. In the first category, the spectral requirements are usually formulated as quadratic constraints or quadratic terms of the objective function. As formulated in [11, equation (2)], the quadratic expression represents the spectral energy in certain “forbidden” or stop frequencies. In [12], the total weighted interfering energy transmitted on the stopbands expressed as the weighted sum of quadratic terms was set to be no more than the pre-determined amount of allowed interference. Then the signal-to-interference-plus-noise ratio (SINR) maximization problem including this spectral sharing constraint was solved via semidefinite relaxation (SDR). Then [13] further improved the proposed algorithm by considering a suitable modulation of the transmitted waveform energy. Reference [14] solved the same problem formulated in [12] via the alternating direction method of multipliers (ADMM) with better computational efficiency. Reference [15] extended [12] by jointly considering both the transmit and receive sides. Different from the control on the overall interference energy, [16] enforced a specific control on the interference energy radiated on each shared band. In [17], the weighted stopband power was formulated as a quadratic term of the objective function, then an iterative algorithm based on pattern search was proposed to simultaneously minimize the weighted integrated sidelobe level (ISL) and stopband power. Similarly, [18] aimed at maximizing the SINR and minimizing the stopband power jointly. In the second category of spectral shaping, the spectral re- quirements are usually formulated as (part of) the objective function in the least-square form. Specifically, the spectrum of the designed sequence should be forced to be close to a spectral mask in the sense of the least-square error. The spectral mask in fact is the desired spectrum for the designed sequence. A classical formulation was proposed in [19], where a least-square fitting problem was proposed and then extended by allowing the magnitude of the spectral mask within a range. Compared with [19], [20] considered the weighted least squares form and 1053-587X © 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

Upload: others

Post on 24-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18, SEPTEMBER 15, 2019 4683

Sequence Design for Spectral Shaping viaMinimization of Regularized Spectral Level Ratio

Linlong Wu and Daniel P. Palomar , Fellow, IEEE

Abstract—The topic of sequence design has received consider-able attention due to its wide applications in active sensing. Oneimportant desired property for the design sequence is the spectralshape. In this paper, the sequence design problem is formulatedby minimizing the regularized spectral level ratio subject to apeak-to-average power ratio constraint. Then, two algorithms areproposed by combining both the Dinkelbach’s algorithm and themajorization–minimzation (MM) method organically. Specifically,by using the Dinkelbach’s algorithm, the challenging fractionalprogramming problem can be handled by solving a series of sub-problems, which are further solved via the MM method. Thenumerical experiments verify the effectiveness of the optimiza-tion metric and demonstrate the performance of the proposedalgorithms compared with the benchmark.

Index Terms—Spectral shaping, sequence design, spectral levelratio, Dinkelbach’s algorithm, majorization-minimization, PARconstraint.

I. INTRODUCTION

TRANSMIT sequence plays an important role in manyactive-sensing applications including communications,

sonar, radar, and medical imaging [1]–[3]. For instance, in radarsystems, well-designed sequences can allow for a more accurateestimation and a reduced computational cost at the receive side.One important task of sequence design is to adapt the spectrum ofthe sequence to a changing or pre-specified environment. Specif-ically, the transmit sequence should avoid certain frequencybands or try to minimize the spectral power on those bands.The motivation behind can be well understood when consideringspectrum sharing among radar and telecommunication systems[4]. Due to the ever growing demand of both wireless com-munication services and accurate remote sensing capabilities,the amount of desired bandwidth is increasing. Consequently,spectral sharing among radar and telecommunications becomesa solution to this significant issue [5], [6]. Signals from otherradiation systems on some frequency range of the band canbe treated as an interference for radar. In order to avoid theinterference or reduce its effect on radar system, it is desired orrequired that the designed radar waveform has deep notches on

Manuscript received August 19, 2018; revised January 29, 2019, May 16,2019, and June 23, 2019; accepted July 2, 2019. Date of publication July 23,2019; date of current version August 9, 2019. The associate editor coordinatingthe review of this manuscript and approving it for publication was Prof. NicolasGillis. This work was supported by the Hong Kong RGC Theme-based ResearchScheme under Grant T21-602/15R. (Corresponding author: Linlong Wu.)

The authors are with the Department of Electronic and Computer Engineering,The Hong Kong University of Science and Technology, Hong Kong (e-mail:[email protected]; [email protected]).

Digital Object Identifier 10.1109/TSP.2019.2929468

those frequency bands. Besides, combining several clear bandstogether can increase the total system bandwidth so as to improvethe range resolution [7]. In addition, from the perspective ofthe radar signal design, several performance metrics [8]–[10]including spectral property may be also considered jointly tomeet the waveform requirements. Therefore, spectral shapinghas become a hot research topic in sequence design recently anda lot of works have contributed to it as seen in the burgeoningliterature.

From the perspective of problem formulation, the existingworks dealing with spectral shaping can be roughly catego-rized into two categories. In the first category, the spectralrequirements are usually formulated as quadratic constraintsor quadratic terms of the objective function. As formulatedin [11, equation (2)], the quadratic expression represents thespectral energy in certain “forbidden” or stop frequencies. In[12], the total weighted interfering energy transmitted on thestopbands expressed as the weighted sum of quadratic terms wasset to be no more than the pre-determined amount of allowedinterference. Then the signal-to-interference-plus-noise ratio(SINR) maximization problem including this spectral sharingconstraint was solved via semidefinite relaxation (SDR). Then[13] further improved the proposed algorithm by consideringa suitable modulation of the transmitted waveform energy.Reference [14] solved the same problem formulated in [12]via the alternating direction method of multipliers (ADMM)with better computational efficiency. Reference [15] extended[12] by jointly considering both the transmit and receive sides.Different from the control on the overall interference energy, [16]enforced a specific control on the interference energy radiatedon each shared band. In [17], the weighted stopband power wasformulated as a quadratic term of the objective function, thenan iterative algorithm based on pattern search was proposed tosimultaneously minimize the weighted integrated sidelobe level(ISL) and stopband power. Similarly, [18] aimed at maximizingthe SINR and minimizing the stopband power jointly.

In the second category of spectral shaping, the spectral re-quirements are usually formulated as (part of) the objectivefunction in the least-square form. Specifically, the spectrum ofthe designed sequence should be forced to be close to a spectralmask in the sense of the least-square error. The spectral maskin fact is the desired spectrum for the designed sequence. Aclassical formulation was proposed in [19], where a least-squarefitting problem was proposed and then extended by allowingthe magnitude of the spectral mask within a range. Comparedwith [19], [20] considered the weighted least squares form and

1053-587X © 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

Page 2: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

4684 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18, SEPTEMBER 15, 2019

used the Lagrange programming neural network (LPNN) tosolve the general problem. Different from [19], both frequencystopbands and correlation sidelobes were considered in [21],and an efficient algorithm named SCAN was proposed. In [22],both power spectral density (PSD) and autocorrelation function(ACF) masks were set and then jointly optimized. Note that allproblems optimizing ACF or ISL [23]–[25] are in fact specialcases of this approach since an ideal ACF in time domain corre-sponds to a flat spectrum in frequency domain. Thus, optimizingthe ACF is in fact shaping the corresponding spectrum to be flat.Correspondingly, the spectral mask is set to be the a horizontalline in the whole band [26].

Recently, [27] has proposed an interesting metric for spectralshaping referred as spectral level ratio (SLR), which is the ratioof the maximum stopband level to the minimum passband level.Recall that in the first category of spectral shaping introducedabove, before designing the sequence, the thresholds, i.e., theamounts of allowed interference on each sharing bands need tobe set. An inappropriate setting of the threshold will raise theissue of feasibility [12]. Similarly, in the second category, thespectral mask or its range of each frequency grid point shouldalso be set in advance, which also need to be chosen carefully.Otherwise, the existence of solution is not guaranteed for aspecific spectral shape, and the mask points near sharp spectraljumps need to be carefully reselected or an offset should beused [19]. In addition, in some situations, i.e., the initial stageof the construction of radio environment map (REM) [28], weonly know the stopbands and passbands without any furtherinformation. Consequently, these masks and thresholds are noteasy to set appropriately in advance. Compared with the existingapproaches, the SLR proposed in [27] cleverly circumvents thosesettings of threshold or spectral mask. Thus, this metric andits corresponding algorithms are worth exploring to expand thearsenal for spectral shaping.

In this paper, we adopt this interesting and also quite challeng-ing optimization metric proposed in [27], and modify it to beregularized SLR (RSLR), a more suitable optimization metricfor spectrum shaping. Then, a general problem is formulatedwith consideration of the peak-to-average power ratio (PAR)constraint. For the formulated problem, we propose two iterativealgorithms both based on the Dinkelbach’s algorithm [29] andthe majorization-minimizaiton (MM) method [30], [31]. How-ever, the difference between the two proposed algorithms liesin the approach from the outer Dinkelbach’s algorithm to theinner MM method. In addition, the convergence and complexityof each proposed algorithm is analyzed. Experiments show thatour method is more efficient than the benchmark and can designa sequence with a desired spectrum shape.

The rest of this paper is organized as follows. In Section II, weformulate the spectrally constrained sequence design problemof interest. In Section III, some preliminaries of the Dinkel-bach’s algorithm and the MM method are briefly introduced.Two algorithms are then derived in Section IV and Sections V,respectively. At the end of each section, we give a complete de-scription of the derived algorithm and analyze its computationalcost and convergence. In Section VII, we analyze the numericalperformance of the proposed algorithms and compare them with

the existing benchmark. Finally, the conclusions are given inSection VIII.

Notation: Rn and Cn denote the n-dimensional real and

complex vector space, respectively. Rm×n and Cm×n denote

the m× n real and complex matrix space, respectively. R+0 and

R− denote the set of non-negative real numbers and the set ofnegative real numbers, respectively. Boldface uppercase lettersstand for matrices. Boldface lowercase letters stand for columnvectors. Standard lowercase letters stand for scalars. (x)T and(x)∗ denote the transpose and conjugate of a complex vector x,respectively. Re(x) and arg(x) denote the element-wise real partand the phase of a complex vector x, respectively. (x)T , (x)∗,(x)H , tr(x), vec(x), λmax(x), and λu(x) denote the transpose,complex conjugate, conjugate transpose, trace, vectorization,largest eigenvalue, and upper bound of the largest eigenvalue ofa matrix X, respectively. Diag(x) stands for a diagonal matrixwith its principal diagonal filled with x. IN denotes the N ×Nidentity matrix. 1N denotes the N × 1 vector with all elementsbeing 1.xi denotes the i-th element ofx. | · |denotes the modulusof a complex scalar or the cardinality of a set, the element-wisemodulus of a complex vector, or the number of elements of a set.‖ · ‖ denotes the �2 norm of a vector. ⊗ denotes the Kroneckerproduct.

II. REGULARIZED SLR AND PROBLEM FORMULATION

We aim to design a transmit radar sequence x = [x1, . . . ,xN ]T ∈ C

N with length being N , which should have adesired spectrum and satisfy a specific PAR level. Let Sand P denote the stopband and passband frequency gridset of interest, respectively, which satisfy S ∪ P ⊆ {0, 1, . . . ,N − 1} and S ∩ P = ∅. Denote the discrete Fourier trans-form (DFT) matrix by FDFT = [f0, . . . fN−1] ∈ C

N×N ,where fω = 1√

N[1, ej2πω/N , . . . , ej2πω(N−1)/N ]T ∈ C

N forω = 0, . . . , N − 1. The minimal passband level and the max-imal stopand level can be expressed by min{|fHω x|2|ω ∈ P}and max{|fHω x|2|ω ∈ S}, respectively. In [27], the spectral levelratio (SLR) is defined as

SLR =max

{∣∣fHω x∣∣2 |ω ∈ S

}

min{|fHω x|2 |ω ∈ P

} , (1)

and the problem is formulated as

minimizex

SLR

subject to |xn| = 1 for n = 1, . . . , N. (2)

Intuitively, SLR should be minimized so that max{|fHωx|2|ω ∈ S} becomes as small as possible and min{|fHω x|2|ω ∈P} becomes as large as possible. From the perspective of opti-mization, it is obvious that problem (2) is optimally solved oncemax{|fHω x|2|ω ∈ S} = 0. Correspondingly, the optimal solu-tion to problem (2) is x� ∈ Null(fω|ω ∈ S), i.e., the null spaceof the subspace spanned by {fω}ω∈S . This cannot guarantee thedenominator to be well processed. An extreme example is thatx = fω for ∀ω ∈ P is also an optimal solution, for which the de-nominator min{|fHω x|2|ω ∈ P} might be very small. Note that

Page 3: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

WU AND PALOMAR: SEQUENCE DESIGN FOR SPECTRAL SHAPING VIA MINIMIZATION OF REGULARIZED SPECTRAL LEVEL RATIO 4685

if {fω}ω∈S∪P are not the columns of the DFT matrixFDFT , thenSLR is still a good optimization metric for spectral shaping. Notethat the above case of max{|fHω x|2|ω ∈ S} = 0 only happensfor the N point DFT case. If frequency oversampling (morethan N frequency samples) is considered for the passbands andstopbands, then the proposed SLR is suitable for optimization.

In order to make the SLR more suitable for optimization, wepropose the regularized spectral level ratio (RSLR) as follows:

RSLR =max

{∣∣fHω x∣∣2 |ω ∈ S

}+ c

min{|fHω x|2 |ω ∈ P

} , (3)

where c is a positive constant.1

Therefore, the problem of interest is formulated as

minimizex

RSLR

subject to ‖x‖22 = N,

|xn| ≤ √γ for n = 1, . . . , N, (4)

where γ represents the PAR parameter. For simplicity of nota-tion, problem (4) will be expressed as

minimizex∈X

max{xHFix|i ∈ S

}+ c

min {xHFix|i ∈ P} , (5)

where Fi = fifHi and the constraint set is denoted by X �

{x|‖x‖22 = N, |xn| ≤ √γ for n = 1, . . . , N}.Before proceeding with the design of the algorithm for

problem (5), we make some comments about this problemformulation:

• Compared with the existing approaches, the highlight of thisformulation is that it does not require any spectral settingsin advance except S and P .

• The constraint set is more general than the unit modulusconstraint, which is a special case when γ = 1. In addition,when γ = N , only the first constraint ‖x‖22 = N takeseffect. By increasing the value of γ, we are in fact extendingthe feasible set, and the optimal objective value should benonincreasing.

• Generally speaking, we are facing a challenging optimiza-tion problem. First, the objective function is fractional. Sec-ond, both max{xHFix|i ∈ S} and min{xHFix|i ∈ P}are nondifferentiable. Third, both the objective function andthe constraint set are highly nonconvex. These main diffi-culties will be handled well when we derive our proposedalgorithms.

III. PRELIMINARIES: THE DINKELBACH’S ALGORITHM AND

THE MM METHOD

In this section, we will briefly introduce two algorithmicframeworks which will be used in our algorithm derivation.

1Note that RSLR =max{|fHω x|2 |ω∈S}+c

min{|fHω x|2 |ω∈P} =max{|fHω x|2 |ω∈S}min{|fHω x|2 |ω∈P} +

cmin{|fHω x|2 |ω∈P} . For x ∈ Null(fω |ω ∈ S), the first term becomes 0. Thus,

no matter what value c is, the optimal solution is the one which maximizesmin{|fHω x|2|ω ∈ P} with x ∈ Null(fω |ω ∈ S).

A. The Dinkelbach’s Algorithm

The Dinkelbach’s algorithm, first proposed in [29], is a pow-erful optimization scheme dealing with nonlinear fractionalprogramming problems, which has already been studied in manyapplications [32]. The idea behind it is to convert, by introducingan auxiliary variable, the original nonlinear fractional probleminto a sequence of non-fractional problems to be solved untilconvergence.

Consider a general fractional programming problem

minimizex

f1(x)

f2(x)

subject to x ∈ X .(6)

where f2(x) > 0 for x ∈ X . Suppose the problem is hard to di-rectly minimize. Following the general idea of the Dinkelbach’salgorithm, we need to solve the following problem at the k-thiteration,

minimizex

f1(x)− ykf2(x)

subject to x ∈ X , (7)

where yk is the auxiliary variable updated as

yk =f1 (xk)

f2 (xk). (8)

Assume the optimal solution of problem (7) is xk+1. Oneadvantage of the Dinkelbach’s algorithm is the guarantee ofmonotonicity of the sequence { f1(xk+1)

f2(xk+1)}. Since

f1 (xk+1)− ykf2 (xk+1) ≤ f1 (xk)− ykf2 (xk) = 0, (9)

we have

yk+1 =f1 (xk+1)

f2 (xk+1)≤ yk =

f1 (xk)

f2 (xk). (10)

Thus, by alternatively solving problem (7) and updating yk by(8), the convergence is guaranteed because yk is nonincreasing.Also note that the monotonicity can still be guaranteed as long asf1(xk+1)− ykf2(xk+1) ≤ 0 is satisfied even if xk+1 is not theoptimal solution of problem (7). Specially, if f1(x) is convex andf2(x) is concave in the convex set X , the overall iterative algo-rithm will converge to the global optimum solution of problem(6) [33]. For more details about convergence, interested readersmay refer to [34], [35].

B. The MM Method

The MM method is a powerful optimization scheme, espe-cially when the problem is hard to tackle directly. The ideabehind the MM algorithm is to convert the original problem intoa sequence of simpler problems to be solved until convergence.

Consider a general optimization problem

minimizex

f(x)

subject to x ∈ X . (11)

Suppose the problem is hard to directly minimize. Following thegeneral MM idea at the �-th iteration, we first construct u(x,x�),

Page 4: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

4686 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18, SEPTEMBER 15, 2019

the so-called majorizer of f(x), satisfying the following tworequirements at the point x�:

u (x,x�) ≥ f(x), for all x ∈ X (12)

u (x�,x�) = f (x�) . (13)

Then the MM update is given by

x�+1 = argminx∈X

u (x,x�) . (14)

One interesting and useful property of MM based methods ismonotonicity:

f (x�+1) ≤ u (x�+1,x�) ≤ u (x�,x�) = f (x�) , (15)

where the first inequality follows from (12), the second onefollows from (14) and the last equality follows from (13). Notethat from (15), we see that even if x�+1 is not the minimizerof u(x,x�), the monotonicity can still be guaranteed as longas it improves the function u(x�+1,x�) ≤ u(x�,x�), where theequality means the algorithm has already found a stationarypoint x�+1. Thus, the convergence is guaranteed because f(x�)is nonincreasing after each iteration. For more details about theconvergence of {f(x�)} and {x�}, interested readers may referto [31], [36].

The counterpart for maximization problems is referred to asminorization-maximization, of which the key step is to constructa so-called minorizer. The analysis is straightforward by refer-ring to that of the majorization-minimizaiton case above andthus omitted here.

IV. APPROXIMATE ITERATIVE METHOD FOR

SPECTRUM SHAPING

In this section, based on the introduced algorithmic frame-works, an iterative method is proposed to solve problem (5). Atthe end of this section, we will summarize the derived methodand analyze its complexity and convergence.

A. Approximation of the Point-Wise Maximum

At the k-th iteration of the Dinkelbach’s algorithm, we havethe following problem:

minimizex∈X

max{xHFix|i ∈ S

}− ykmin{xHFix|i ∈ P

}.

(16)

Due to yk =max{xH

k Fixk |i∈S}+c

min{xHk Fixk |i∈P} ≥ 0, problem (16) is equiv-

alent to

minimizex∈X

max{xHFix|i ∈ S

}+ ykmax

{−xHFix|i ∈ P}.

(17)

The objective function is nonconvex and nondifferentiable.Lemma 1: Denote the objective function of problem (17) by

f(x). Then f(x) can be approximated by

g(x) ≈ αlog∑i∈S

exp

(xHFix

α

)+ αyklog

∑i∈P

exp

(−xHFix

α

)

(18)

Fig. 1. Approximation of the point-wise maximum with respect to differ-

ent α. Black: f(x) = max {fi(x)|i = 1, 2, 3}; Red: g(x) = αlog∑3

i=1exp

(fi(x)α ), where f1(x) = x2 − 2x+ 1, f2(x) = x2 − 4x+ 4 and f3(x) =

0.1x2 + 0.3x.

with f(x) ≤ g(x) ≤ f(x) + α(log|S|+ yklog|P|), whereα > 0 is a constant.

Proof: See Appendix A �Note that Lemma 1 provides a differentiable approximation

of the objective function, and the degree of this approximationcan be adjusted by α. Figure 1 shows a toy example for intuitiveillustration of this approximation. It is clear that the smaller thevalue of α, the better the approximation.

By using Lemma 1 and ignoring the constant, the approximateproblem is given by

minimizex∈X

log∑i∈S

exp

(xHFix

α

)

+ yklog∑i∈P

exp

(−xHFix

α

),

(19)

where the objective function is now differentiable but still non-convex. In the next two subsections, we will solve problem (19)by applying the MM method.

B. Majorizer Construction

For the first term log∑

i∈S exp(xHFixα ) in problem (19), we

have

log∑i∈S

exp

(xHFix

α

)

= log∑i∈S

exp

(xH (Fi − (1 + ε) I)x

α+

(1 + ε)xHx

α

)

=(1 + ε)N

α+ log

∑i∈S

exp

(−xH ((1 + ε) I− Fi)x

α

),

(20)

Page 5: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

WU AND PALOMAR: SEQUENCE DESIGN FOR SPECTRAL SHAPING VIA MINIMIZATION OF REGULARIZED SPECTRAL LEVEL RATIO 4687

where ε is a small positive value and we set ε = 1× 10−3

hereafter. Similarly, for the second term, we have

log∑j∈P

exp

(−xHFjx

α

)

=εN

α+ log

∑i∈S

exp

(−xH (Fi + εI)x

α

). (21)

Thus, by defining Fi =1α ((1 + ε)I− Fi) � 0 and Fj =

1α (Fi + εI) � 0, problem (19) is equivalent to

minimizex∈X

log∑i∈S

exp(−xHFix

)

+ yklog∑j∈P

exp(−xHFjx

),

(22)

Since both terms of the objective function of problem (22)have the same structure, we focus on constructing the majorizerof log

∑i∈S exp(−xHFix) for illustration.

Lemma 2: At the �-th iteration, log∑

i∈S exp(−xHFix) canbe majorized by

log∑i∈S

exp(−xHFix

)≤ 2Re

⎡⎣(∑

i∈SA�

ix�

)H

x

⎤⎦+ constant

(23)

with

A�i =

−exp(−xH

� Fix�

)Fi +

1α2

((1 + ε)2 N − 2ε− 1

)x�x

H�

∑i∈S exp

(−xH

� Fix�

) .

(24)

The equality is achieved when x = x�.Proof: See Appendix B. �Same techniques can be applied on the second term of the

objective function of problem (22). we have

log∑i∈P

exp(−xHFix

)≤ 2Re

⎡⎣(∑

i∈PB�

ix�

)H

x

⎤⎦+ constant,

(25)

where the equality is achieved when x = x�, and

B�i = −

exp(−xH

� Fix�

)Fj +

1α2

(ε2N + 2ε+ 1

)x�x

H�

∑i∈P exp

(−xH

� Fix�

) .

(26)

Therefore, the final majorized problem of problem (22) is

minimizex

Re(pH� x)

subject to ‖x‖22 = N.

|xn| ≤ √γ for n = 1, . . . , N, (27)

where

p� =

(∑i∈S

A�i + yk

∑i∈P

B�i

)x�. (28)

C. Optimal Solution of the Majorized Problem

For problem (27) with a linear objective function, an closed-form solution has been constructed in [37], which is rewrittenand presented as follows:

x� = AX (p�) (29)

where

AX (·) = −(1R+

0(N −mγ)

)√γum � ejarg(·)

− (1R− (N −mγ))min{β|z|,√γ1} � ejarg(·),(30)

min{·, ·}, | · | and ejarg(·) are element-wise operations, m is thenumber of nonzero elements of p�,

1A(x) =

{1, if x ∈ A,

0, otherwise,(31)

um =

[1, . . . 1︸ ︷︷ ︸

m

,

√N −mγ

Nγ −mγ, . . . ,

√N −mγ

Nγ −mγ︸ ︷︷ ︸

N−m

]T,

(32)

β ∈{β|

N∑n=1

min{β2 |zn|2 , γ

}

= N, β ∈[0,

√γ

min{|zn| | |zn| �= 0}]}

. (33)

Note that the scalar β can be calculated by the bisection methodin practice, which should be efficient because it is already knownthat β ∈ [0,

√γ

min{|zn| | |zn|�=0} ]. In addition, for the special casewhere γ = 1, the constraint set is reduced to the unit-modulusconstraint. Then the optimal solution is

x� = −ejarg(p�). (34)

For the other special case where γ = N , only the constraint‖x‖22 = N takes effect, and the optimal solution is

x� = −√Np

‖p‖2. (35)

D. Complexity and Convergence Analysis

The complete description of the proposed algorithm namedas Approximate Iterative Method for Spectrum Shaping (AISS)is shown in Algorithm 1. It is clear that the main computation ofeach iteration is the calculation of p�, which consists of A�

ix�

for all i ∈ S and B�ix� for all i ∈ P . Note that both A�

ix� andB�

ix� include fHω x� for ω ∈ S ∪ P , which can be implementedvia the fast Fourier transform (FFT). Thus, the computation costper iteration is O (NlogN).

As illustrated in the preliminary part, both the Dinkelbach’salgorithm and the MM method can guarantee the monotonicity

Page 6: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

4688 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18, SEPTEMBER 15, 2019

Algorithm 1: The Approximate Iterative Method for Spec-trum Shaping (AISS).Require: The stopband S and passband P .1) Set k = 0, initialize x0

2) Repeat3) Set � = 0, s� = xk

4) yk =max{xH

k Fixk |i∈S}+c

min{xHk Fixk |i∈P}

5) Repeat6) Calculate fHω s� for all ω ∈ S ∪ P7)

∑i∈S A

�is� =

[∑i∈S exp

(1α |fHi s�|2

)fHi s�

α∑

i∈S(

exp(

1α |fHi s�|2

)) fi

−(

1+εα +

((1+ε)2N−2ε−1)N |S|exp( 1+εα N)

α2∑

i∈S exp(

1α |fHi s�|2

)

)s�

]

8)∑

i∈P B�is� =

[−

∑i∈P exp

(− 1

α |fHi s�|2)fHi s�

α∑

i∈P(

exp(− 1

α |fHi s�|2)) fi

−(

εα +

(ε2N+2ε+1)N |P|exp( εαN)

α2∑

i∈P exp(− 1

α |fHi s�|2)

)s�

]

9) p� =(∑

i∈S A�is� + yk

∑i∈P B

�is�)

10) Obtain x�+1 according to (29).11) �← �+ 112) Until convergence13) xk+1 = s�14) k ← k + 115) Until convergence

of the sequence of the objective value. However, at the k-thiteration of the Dinkelbach’s algorithm, we in fact solve anapproximate problem instead of the standard one. Thus, theexisting result about the monotonicity cannot be applied directly.In the following lemma, we analyze the monotonicity of theproposed AISS.

Lemma 3: For the generated sequence {yk}, we have

yk+1 − yk ≤ αlog |S|+ yklog |P|

min{xHk+1Fixk+1|i ∈ P

} . (36)

Proof: Let f1(x) = max{xHFix|i ∈ S}, f2(x) = min{xH

Fix|i ∈ P}, and h(x) = log∑

i∈S exp(xHFix/α) + yklog∑i∈P exp(−xHFix/α). According to Lemma 1, we have the

following two inequalities

f1(x) ≤ αlog∑i∈S

exp(xHFix/α

) ≤ f1(x) + αlog |S| ,

(37)

−f2(x) ≤ αlog∑i∈P

exp(−xHFix/α

) ≤ −f2(x) + αlog |P| .

(38)

Thus,

f1(x)− ykf2(x) ≤ αh(x)

≤ f1(x)− ykf2(x) + α(log|S|+ yklog|P|).(39)

Recall that at the k-th iteration, the initial point is xk andyk = f1(xk)

f2(xk). Assume that the output of thek-th iteration isxk+1.

We have two possible situations for xk+1:1) h(xk+1) ≤ 0. Then f1(xk+1)− ykf2(xk+1) ≤ αh

(xk+1) ≤ 0. So f1(xk+1)f2(xk+1)

= yk+1 ≤ yk;2) h(xk+1) > 0. Then f1(xk+1)− ykf2(xk+1) ≤ αh

(xk+1), which is equivalent to

yk+1 =f1 (xk+1)

f2 (xk+1)≤ yk +

αh (xk+1)

f2 (xk+1). (40)

Since xk is the input for the k-th iteration and we are us-ing the MM method which guarantees the monotonicity, wehave h(xk+1) ≤ h(xk). Besides, we have αh(xk) ≤ f1(xk)−ykf2(xk) + α(log|S|+ yklog|P|),which is based on Lemma 1.Thus, (40) can be further relaxed to (also using the equationf1(xk)− ykf2(xk) = 0)

yk+1 ≤ yk +α (log |S|+ yklog |P|)

min{xHk+1Fixk+1|i ∈ P

} . (41)

The proof is complete. �Remark 4: Lemma (3) provides a loose upper bound of

yk+1 − yk, which is related to the parameter α. Specifically,the smaller the value of α, the smaller the upper bound. Inthe extreme, yk+1 ≤ yk is always guaranteed if α→ 0. This isvery intuitive because whenα becomes smaller, the approximatefunction becomes closer to the original one. Thus the procedureof the standard Dinkelbach’s algorithm is strictly conducted andconsequently, the monotonicity is guaranteed.

Remark 5: If h (xk+1) ≤ 0, then yk+1 ≤ yk. But even whenh (xk+1) > 0, yk+1 ≤ yk can probably still hold. In practice, wefind empirically that if α is set to be a small value, the sequenceof {yk} is generally decreasing and finally converges to a smallvalue.

Remark 6: Based on the analysis above, the algorithm canbe modified to be more efficient in practice. The inner loopof Algorithm 1 has no need to run until convergence. In fact,we can stop the inner loop as long as f1(x)− ykf2(x) ≤ 0 issatisfied.

V. MONOTONIC ITERATIVE METHOD FOR SPECTRUM SHAPING

In the previous section, we have derived an algorithm namedAISS to solve problem (4) and analyzed that the monotonicityof AISS can be guaranteed if α→ 0. However, since α isalways a nonzero value in practice, the monotonicity has notheoretical guarantee although it usually converges empirically.Thus, we derive another algorithm with the guarantee of strictmonotonicity in this section.

A. Minorizer Construction of the Max-Min Problem

Recall that the objective function of problem (16) can berewritten as follows:

max{xHFix|i ∈ S

}− ykmin{xHFix|i ∈ P

}

= − (−max{xHFix|i ∈ S

}+ ykmin

{xHFix|i ∈ P

})

Page 7: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

WU AND PALOMAR: SEQUENCE DESIGN FOR SPECTRAL SHAPING VIA MINIMIZATION OF REGULARIZED SPECTRAL LEVEL RATIO 4689

= − (min{−xHFix|i ∈ S

}+ ykmin

{xHFix|i ∈ P

})

= −yk(

min

{− 1

ykxHFix|i ∈ S

}+ min

{xHFix|i ∈ P

}).

(42)

Thus, problem (16) is equivalent to

maximizex∈X

min{xHFix|i ∈ P

}+ min

{−ykxHFix|i ∈ S},

(43)

where yk = 1yk

=min{xH

k−1Fixk−1|i∈P}max{xH

k−1Fixk−1|i∈S}+c.

Furthermore, by introducing an auxiliary variable p ∈ R|S|,we have

min{−ykxHFix|i ∈ S

}= min

p∈S1

{∑i∈S

pi(−ykxHFix

)}

(44)

with S1 � {p|1Tp = 1,p ≥ 0}. The optimal p has onlyone element being 1 corresponding to the minimal value of{xHFix}|P|i=1 and the rest elements are zeros. For the other term,we also have

min{xHFix|i ∈ P

}= min

q∈S2

{∑i∈P

qixHFix

}. (45)

with S2 �{q|1Tq = 1,q ≥ 0

}. Therefore, problem (43) can

be equivalently rewritten as

maximizex∈X

minp∈S1,q∈S2

{∑i∈P

qixHFix− yk

∑i∈S

pixHFix

}.

(46)

We will use the MM method to solve problem (46).A minorizer of minp∈S1,q∈S2{

∑i∈P qix

HFix− yk∑

i∈S pixHFix} is provided by the following lemma.

Lemma 7: At the �-th iteration of the MM method, a mi-norizer of the objective function of problem (46) is given by

�(x) = minp∈S1,q∈S2

{Re{aH� x

}+ u� (p,q)

}, (47)

where

a� = 2

(∑i∈P

qjFj − yk∑i∈S

pi (Fi − I)

)x� (48)

and

u� (p,q) = yk∑i∈S

pi(xH� Fix� − 2N

)−∑i∈P

qixH� Fix�.

(49)

Proof: See Appendix C. �Therefore, the minorized problem of problem (46) is

maximizex

minp∈S1,q∈S2

{Re{aH� x

}+ u� (p,q)

}

subject to ‖x‖22 = N.

|xn| ≤ √γ for n = 1, . . . , N. (50)

The lemma below converts problem (50) to an equivalentproblem, which is relatively easier to solve.

Lemma 8: Solving problem (50) is equivalent to solving thefollowing problem

minimizep,q

(max

‖x‖22≤N,|xn|≤√γRe{aH� x

})

+ u� (p,q)

subject to p ∈ S1,q ∈ S2. (51)

Proof: See Appendix D. �Problem (51) can be solved via the projected subgradient

method, which finds an ε-suboptimal point within a finite numberof iterations [38]. Since this method is well established andthe application on problem (51) is very straightforward, thedetails are omitted. In fact, when applying this method, we canstop running the projected subgradient method once it makesyk+1 ≥ yk, which still guarantees the monotonicity of the wholealgorithm.

B. Two Special Cases

1) The Constant Energy Constraint: If γ = N , then the innerproblem of problem (51) becomes

maximizex

Re{aH� x

}

subject to ‖x‖22 = N, (52)

which has a closed-form solution given by

x� =

√Na�‖a�‖2

(53)

Substituting (53) back into problem (51), we have

minmizep,q

√N ‖a�‖2 + u� (p,q)

subject to p ∈ S1,q ∈ S2, (54)

which can be rewritten as

minmizep,q

2√N ‖A�q−B�p‖2 − cH� q− dH

� p

subject to p ∈ S1,q ∈ S2. (55)

where

A� =[F1x�,F2x�, . . . ,F|P|x�

], (56)

B� =[ykF1x� − ykx�, . . . , ykF|S|x� − x�

], (57)

c� =[xH� F1x�, . . . ,x

H� F|P|x�

]T, (58)

d� =

⎡⎢⎢⎣

yk(2N − xH

� F1x�

)...

yk(2N − xH

� F|S|x�

)

⎤⎥⎥⎦ . (59)

Problem (55) can be rewritten in a second-order cone program-ming (SOCP) form and solved efficiently by any off-the-shelfsolver like SeDuMi, SDPT3 or Mosek.

Page 8: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

4690 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18, SEPTEMBER 15, 2019

2) The Unit-Modulus Constraint: If γ = 1, then the innerproblem of problem (51) becomes

maximizex

Re{aH� x

}

subject to |xn| = 1 for n = 1, . . . , N. (60)

which has a closed-form solution given by

x� = ejarg(a�) (61)

with ejarg(·) being an elementwise operation. Substituting (61)back into problem (51), we have

minmizep,q

‖a�‖1 + u� (p,q)

subject to p ∈ S1,q ∈ S2,which can also be rewritten as

minmizep,q

2 ‖A�q−B�p‖1 − cH� q− dH� p

subject to p ∈ S1,q ∈ S2. (62)

Problem (62) is convex and can be solved efficiently by solvers.

C. Complexity and Convergence Analysis

The DFT matrix is decomposed into two submatrices: thepassband DFT matrixFP = [f1, . . . , f|P|] and the stopband DFTmatrix FS = [f1, . . . , f|S|]. The complete description of the pro-posed algorithm, named as Monotonic Iterative Method forSpectrum Shaping (MISS), is given in Algorithm 2.

From the pseudo code of the proposed MISS, the main compu-tations include FH

P x�, FHS x� and solving problem (55) or (62).

The first four computations can be implemented via fast Fouriertransform and thus require O(NlogN) flops. Assume that bothproblem (55) and (62) are solved by the solver CVX, which willadopts a primal-dual interior point method with the worst-casecomputational complexity being O(N3.5). Therefore, in theworst case, the complexity of each iteration of MISS isO(N3.5).As illustrated in the preliminary part, both the Dinkelbach’salgorithm and the MM method can guarantee the monotonicity.Thus, the monotonicity of the proposed MISS can be guaranteed.Note that the monotonicity of the outer Dinkelbach’s algorithmis still guaranteed as long as f1(x)− ykf2(x) ≤ 0, which meansthat the inner MM method can be run for only several or evenone iteration.

VI. NUMERICAL EXPERIMENTS

In this section, we conduct numerical experiments to evaluatethe performance of the two proposed methods and comparethem with the existing benchmark. Assume that the transmittedsequence has the length N = 162. This sequence is transmittedin multiple electromagnetic service environment, where thestopbands are given by

S = [0, 0.0617] ∪ [0.0988, 0.2469] ∪ [0.2593, 0.2840]

∪ [0.3086, 0.3827] ∪ [0.4074, 0.4938]

∪ [0.5185, 0.5558] ∪ [0.9383, 1] , (63)

Algorithm 2: The Monotonic Iterative Method for SpectrumShaping (MISS).Require: The stopband S and passband P .1) Set k = 0, initialize x0

2) Repeat

3) yk =max{xH

k Fixk |i∈S}min{xH

k Fixk |i∈P}+c

4) Set � = 0, s� = xk

5) Repeat6) A� = FPDiag

(FHP s�

)

7) B� = yk

(FSDiag

(FHS s�

)− 1T|S| ⊗ s�

)

8) c� =[abs(FHP s�

)]29) d� = yk

(2N1− [abs

(FHS s�

)]2)

10) Obtain (p�+1,q�+1) by solving problem(55) or (62)

11) a�+1 = 2 (A�q�+1 −B�p�+1)

12) s�+1 =√Na�+1

‖a�+1‖2 (s�+1 = ejarg(a�+1))13) �← �+ 114) Until convergence15) xk+1 = s�16) k ← k + 117) Until convergence

where the frequency is normalized so that the total range is[0, 1]. The passbands consist of the complementary sets of Swithin [0, 1]. The benchmark method for this design problemis the NSLM (No-Spectral-Level-Mask) method [27], which isfor the unit modulus case. The parameter settings of NSLMfollow the suggestions of [27]. Unless otherwise specified, allthe parameters are the same in the numerical experiments. Allexperiments were carried out on a Window desktop PC with a3.30 GHz i5-4950 CPU and 8 GB RAM.

A. Convergence Performance and Shaped Spectrum

Note that the proposed MISS has the guarantee of monotonic-ity. Figure 2 shows the convergence plot of MISS for the twospecial cases γ = 1 and γ = N for the first 20 s. In fact, all AISScurves will achieve around 1.5× 10−7 after running for 300 s,while the (A)NSLM curve barely decreases after the first 20 s.We can see clearly that MISS can guarantee the monotonicitystrictly but at at the cost of high computational complexity. Con-sidering that neither of the proposed AISS and the benchmarkNSLM has this monotonicity guarantee, a good usage of MISSis to provide good initialization for AISS and NSLM.

Figure 3 shows the curves of the SLR along the CPU time,where the initial point for AISS and NSLM is provided byMISS after a few iterations. From the figure, we can see clearlythat AISS decreases much faster and achieves better SLR thanNSLM. In addition, although neither AISS nor NSLM hasmonotonicity guarantee, both can still decrease the objectivevalue along iterations generally. In fact, by choosing a small α,we can reasonably expect that AISS performs well with onlysmall fluctuations or even no fluctuation. The spectra of the

Page 9: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

WU AND PALOMAR: SEQUENCE DESIGN FOR SPECTRAL SHAPING VIA MINIMIZATION OF REGULARIZED SPECTRAL LEVEL RATIO 4691

Fig. 2. Convergence plot of objective value versus CPU time of MISS.

Fig. 3. Convergence plot of objective value versus CPU time for γ = 1 andα = 1× 10−10.

designed sequences are shown in Figure 4. The AISS can shapedeep notches in these stopbands.

Table I shows the comparison of average performance be-tween AISS and NSLM. For each value of N , we conduct 50random trails. In both columns of SLR and CPU time, eachpresented value is the average of the 50 outcomes. In the lastcolumn named exhaustion, the value represents the percentageof occurrence of the algorithm stopped by meeting the maxi-mum number of iterations. Note that the stopping criterion forboth AISS and MISS is (‖xk+1 − xk‖2/‖xk‖2 ≤ ε or k ≥ K),where ε = 1× 10−8,K = 5× 103 for AISS and ε = 1× 10−8,K = 5× 104 for NSLM. From Table I, we can see that AISSis better than NSLM in terms of both CPU time and SLR (onlyexcept the case N = 50).

B. Parameter Effect on the Performance of AISS

Compared with MISS and NSLM, AISS can deal with thegeneral PAR constraint. Figure 5 shows the effect of different

Fig. 4. Comparison of the spectra of the designed sequences for γ = 1 andα = 1× 10−10.

TABLE IPERFORMANCE EVALUATION OF AISS AND NSLM

value of γ on the SLR performance, where 50 random trialsare conducted for each γ. From this figure, we can see thatthe objective value is generally decreasing as the value of γincreases. From the perspective of optimization, it is reasonablebecause as γ increases, the feasible set extends so that theachieved objective value probably becomes smaller and smaller.However, the improvement of the averaged objective value isvery significant when γ is changed from 1 to 2. After 6, theaveraged objective value does not decrease too much.

In Figure 6, we show the spectra of the designed sequencefor different values of γ, where the AISS uses an randomlygenerated initial sequence. It is clear to see that there are notchesin the stopands and these notches becomes deeper when the valueof γ increases. But for the cases γ = 5 and γ = 7, the spectraare generally the same, which is consistent to the informationprovided by Figure 5.

As illustrated above, an important issue of using AISS is thechoice of α, which controls the degree of approximation. Thesensitivity of AISS on the choice ofα is shown in Figure 7, where50 random trials are conducted. Fortunately, the performance isnot too sensitive to that choice. We can also see that the achievedaverage objective values are around 10−3 when α is within [1×10−8, 1× 10−6].

Page 10: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

4692 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18, SEPTEMBER 15, 2019

Fig. 5. Effect of different γ on the objective value for AISS over 50 trials.

Fig. 6. Comparison of spectra for different PAR levels of AISS. α = 1×10−7.

Fig. 7. Sensitivity of AISS on the choice of α for γ = 1.

Fig. 8. The frequency oversampling case: sequence length:N = 162; numberof frequency points: M = N + 10.

C. Proposed Methods for Frequency Oversampling

As we illustrated previously, if frequency oversampling (morethan N frequency samples) is considered for the passbands andstopbands, then the SLR is suitable for optimization which isthe RSLR with c = 0. The proposed AISS and MISS based onthe RSLR can be applied to the frequency oversampling case,of which the simulation resluts are shown in Figure 8. Note thatfor the convergence plot, we only show the first 30 seconds todemonstrate the fluctuation of AISS. The red curve will finallyconverge to SLR = 5.5514× 10−11 at CPU time = 189.5469 .

VII. CONCLUSION

In this paper, the sequence design problem for spectral shapingis considered, which is formulated as the minimization of theregularized SLR subject to the PAR and constant energy con-straints. We have derived two algorithms named AISS and MISS,

Page 11: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

WU AND PALOMAR: SEQUENCE DESIGN FOR SPECTRAL SHAPING VIA MINIMIZATION OF REGULARIZED SPECTRAL LEVEL RATIO 4693

respectively. Both algorithms are based on the combinationof the Dinkelbach’s algorithm and the MM method, and thedifference between them is that AISS approximates the iterativesubproblem of the Dinkelbach’s framework while MISS solvethat directly. Consequently, the AISS has a lower computationalcomplexity but has no strict guarantee of monotonicity, whilethe MISS is on the contrary. In order to make the best of eachalgorithm, a suggested implementation is to use MISS generatea good initialization, and then use AISS to shape the spectrumbased on this initialization. In the numerical experiments, thecombination of MISS and AISS is verified and AISS showsbetter performance than the benchmark in terms of both SLRand running time.

APPENDIX

A. Proof of Lemma 1

Proof: According to the log-sum-exp approximation [39],

max

{xHFix

α|i ∈ S

}≤ log

∑i∈S

exp

(xHFix

α

)

≤ log |S|+ max

{xHFix

α|i ∈ S

}.

(64)

which is further equivalent to

max{xHFix|i ∈ S

} ≤ αlog∑i∈S

exp

(xHFix

α

)

≤ αlog |S|+ max{xHFix|i ∈ S

}.

(65)

Similarly, for the term max{−xHFjx|j ∈ P}, we have

max{−xHFjx|j ∈ P

} ≤ αlog∑j∈P

exp

(−xHFjx

α

)

≤αlog|P|+ max{−xHFjx|j∈P

}.

(66)

Thus, the objective function of problem (17) can beapproximated by αlog

∑i∈S exp(x

HFixα ) + αyklog

∑j∈P exp

(−xHFjxα ), and the approximation error is at most α(log|S|+

yklog|P|). �

B. Proof of Lemma 2

Proof: At the �-th iteration of the MM method, by using theconcavity of logarithm, we have

log∑i∈S

exp(−xHFix

)

≤∑

i∈S exp(−xHFix

)

∑i∈S exp

(−xH

� Fix�

) + log∑i∈S

exp(−xH

� Fix�

)− 1

(67)

with the equality achieved when x = x�.

The function f(x) = e−x, x ∈ (0,+∞) is β-smooth (i.e., thederivative of f(x) is is Lipschitz continuous) withβ = 1because|f ′′(x)| = e−x < 1 for x ∈ (0,+∞). Thus, for x, y ∈ (0,+∞),f(x) is upper bounded by a quadratic function given by

f(x) ≤ f(y) +∇f(y)T (x− y) +1

2||x− y||2 (68)

with the equality achieved when x = y. Substituting x =xHFix and y = xH

� Fix� into (68), we have

exp(−xHFix

)

≤ exp(−xH

� Fix�

)− exp

(−xH

� Fix�

)(xHFix− xH

� Fix�

)

+1

2

∥∥∥xHFix− xH� Fix�

∥∥∥2

2

=1

2xHFH

i xxHFix−(xH� FH

i x� + exp(−xH

� Fix�

))xHFix

+ constant (69)

with the equality achieved when x = x�.By combining (67) and (69), log

∑i∈S exp(−xHFix) can be

majorized as

log∑i∈S

exp(−xHFix

)

≤∑i∈S

(1

2a�xHFH

i xxHFix− b�ia�

xHFix

)+ constant,

(70)

where

a� =∑i∈S

exp(−xH

� Fix�

)> 0, (71)

b�i = xH� FH

i x� + exp(−xH

� Fix�

)> 0. (72)

Next, the majorizer of 12a�x

HFHi xxHFix− b�i

a�xHFix will

be constructed. Let X = xxH , then xHFHi xxHFix = vec

(x)Hvec(Fi)vec(Fi)Hvec(x). The largest eigenvalue of Fi =

vec(Fi)vec(Fi)H is

λmax

(Fi

)= vec

(Fi

)Hvec

(Fi

)

=1

α2tr(((1 + ε) I− Fi)

H ((1 + ε) I− Fi))

=1

α2

((1 + ε)2 N − 2 (1 + ε) + 1

)(73)

According to [25, Lemma 1], we have

xHFHi xxHFix

= vec(x)Hvec(Fi

)vec

(Fi

)Hvec(x)

≤ 2Re(

vec (X�)H (Fi − λmax

(Fi

)I)

vec(x))+ constant

= 2Re[xH

(tr(X�Fi

)Fi − λmax

(Fi

)X�

)x]+ constant

= 2xH(xH� Fix�Fi − λmax

(Fi

)X�

)x+ constant. (74)

Page 12: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

4694 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18, SEPTEMBER 15, 2019

Thus, we have

1

2a�xHFH

i xxHFix− b�ia�

xHFix ≤ xHA�ix+ constant,

(75)

where A�i is defined by (24). Due to A�

i � 0, the concaveterm xHA�

ix can be further majorized by its first-order Taylorexpansion given by

xHA�ix ≤ 2Re

(xH� A�

ix)+ constant. (76)

We have

xHFHi xxHFix

2a�− b�i

a�xHFix ≤ 2Re

(xH� A�

ix)+ constant,

(77)

Therefore, by combining (70) and (77), we have

log∑i∈S

exp(−xHFix

)≤ 2Re

⎡⎣(∑

i∈SA�

ix�

)H

x

⎤⎦+ constant.

C. Proof of Lemma 7

Proof: Define f1(x) =∑

j∈P qjxHFjx and f2(x) =

∑i∈S

pixHFix. The convex function f1(x) can be lower bounded by

its first-order Taylor expansion as follows∑j∈P

qjxHFjx ≥

∑j∈P

qj[xH� Fjx� + 2Re

(xH� Fj (x− x�)

)].

(78)

According to [25, Lemma 1], for each i ∈ S , we have

xHFix ≤ xHx+ 2Re(xH� (Fi − I)x

)+ xH

� (I− Fi)x�,(79)

where λu(Fi) is an upper bound of the eigenvalues of Fi.Thus, by combining (78) and (79) and doing some algebra

manipulations, we have∑j∈P

qjxHFjx− yk

∑i∈S

pixHFix

≥ Re

⎡⎢⎣xH

⎛⎝∑

j∈P2qjFj − yk

∑i∈S

2pi (Fi − I)

⎞⎠

H

x

⎤⎥⎦

− yk∑i∈S

pi(N + xH

� (I− Fi)x�

)−∑j∈P

qjxH� Fjx�.

(80)

Define a� and u�(p,q) as (48) and (49), then we have

minp∈S1,q∈S2

⎧⎨⎩∑j∈P

qjxHFjx− yk

∑i∈S

pixHFix

⎫⎬⎭

≥ minp∈S1,q∈S2

{Re{aH� x

}+ u� (p,q)

}(81)

with equality achieved when x = x�. �

D. Proof of Lemma 8

Proof: First, problem (50) is equivalent to

maximizex

minp∈S1,q∈S2

{Re{aH� x

}+ u� (p,q)

}

subject to ‖x‖22 ≤ N.

|xn| ≤ √γ for n = 1, . . . , N. (82)

The optimal solution to problem (82) should satisfy ‖x�‖22 = N .Otherwise, we can always scale up some elements of x� with alarger objective value.

For problem (82), the objective function is bilinear in xand (p,q), and the constraint sets for x and (p,q) are bothcompact convex. According to the minimax theorem [40]–[42],the equality is achieved so that max and min can be exchanged.Thus, we have the following equivalent problem

minimizep,q

(max

‖x‖22≤N,|xn|≤√γRe{aH� x

})

+ u� (p,q)

subject to p ∈ S1,q ∈ S2. (83)

REFERENCES

[1] H. He, J. Li, and P. Stoica, Waveform Design for Active Sensing Systems:A Computational Approach. Cambridge, U.K.: Cambridge Univ. Press,2012.

[2] J. Li and P. Stoica, MIMO Radar Signal Processing. Hoboken, NJ, USA:Wiley, 2008.

[3] J. Liang, L. Xu, J. Li, and P. Stoica, “On designing the transmission andreception of multistatic continuous active sonar systems,” IEEE Trans.Aerosp. Electron. Syst., vol. 50, no. 1, pp. 285–299, Jan. 2014.

[4] M. Labib, V. Marojevic, A. F. Martone, J. H. Reed, and A. I. Zaghloul,“Coexistence between communication and radar systems-a survey,” URSI,vol. 2017, no. 362, pp. 74–82, 2017.

[5] M. Wicks, “Spectrum crowding and cognitive radar,” in Proc. IEEE 2ndInt. Workshop Cogn. Inf. Process., 2010, pp. 452–457.

[6] M. E. Davis, “Frequency allocation challenges for ultra-wideband radars,”in Proc. IET Int. Conf. Radar Syst., IEEE, vol. 28, no. 7, 2013, pp. 12–18.

[7] G. Wang and Y. Lu, “Designing single/multiple sparse frequency wave-forms with sidelobe constraint,” IET Radar, Sonar Navigation, vol. 5, no. 1,pp. 32–38, 2011.

[8] A. Aubry, V. Carotenuto, A. De Maio, A. Farina, and L. Pallotta, “Opti-mization theory-based radar waveform design for spectrally dense envi-ronments,” IEEE Aerosp. Electron. Syst. Mag., vol. 31, no. 12, pp. 14–25,Dec. 2016.

[9] G. Cui, X. Yu, G. Foglia, Y. Huang, and J. Li, “Quadratic optimizationwith similarity constraint for unimodular sequence synthesis,” IEEE Trans.Signal Process., vol. 65, no. 18, pp. 4756–4769, Sep. 2017.

[10] J. Li, J. R. Guerci, and L. Xu, “Signal waveform’s optimal under restrictiondesign for active sensing,” in Proc. 4th IEEE Workshop Sensor ArrayMultichannel Process., 2006, pp. 382–386.

[11] M. J. Lindenfeld, “Sparse frequency transmit-and-receive waveform de-sign,” IEEE Trans. Aerosp. Electron. Syst., vol. 40, no. 3, pp. 851–861,Jul. 2004.

[12] A. Aubry, A. De Maio, M. Piezzo, and A. Farina, “Radar waveformdesign in a spectrally crowded environment via nonconvex quadraticoptimization,” IEEE Trans. Aerosp. Electron. Systems, vol. 50, no. 2,pp. 1138–1152, Apr. 2014.

[13] A. Aubry, A. De Maio, Y. Huang, M. Piezzo, and A. Farina, “A newradar waveform design algorithm with improved feasibility for spectralcoexistence,” IEEE Trans. Aerosp. Electron. Syst., vol. 51, no. 2, pp. 1029–1038, Apr. 2015.

[14] B. Tang, J. Li, and J. Liang, “Alternating direction method of multipliersfor radar waveform design in spectrally crowded environments,” SignalProcess., vol. 142, pp. 398–402, 2018.

Page 13: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 67, NO. 18 ... · Sequence Design for Spectral Shaping via Minimization of Regularized Spectral Level Ratio Linlong Wu and Daniel P. Palomar,

WU AND PALOMAR: SEQUENCE DESIGN FOR SPECTRAL SHAPING VIA MINIMIZATION OF REGULARIZED SPECTRAL LEVEL RATIO 4695

[15] A. Aubry, A. De Maio, M. Piezzo, M. M. Naghsh, M. Soltanalian, andP. Stoica, “Cognitive radar waveform design for spectral coexistencein signal-dependent interference,” in Proc. IEEE Radar Conf., 2014,pp. 0474–0478.

[16] A. Aubry, V. Carotenuto, and A. De Maio, “Forcing multiple spectralcompatibility constraints in radar waveforms,” IEEE Signal Process. Lett.,vol. 23, no. 4, pp. 483–487, Apr. 2016.

[17] G. Cui, X. Yu, Y. Yang, and L. Kong, “Cognitive phase-only sequencedesign with desired correlation and stopband properties,” IEEE Trans.Aerosp. Electron. Syst., vol. 53, no. 6, pp. 2924–2935, Dec. 2017.

[18] X. Yu, G. Cui, P. Ge, and L. Kong, “Constrained radar waveform designalgorithm for spectral coexistence,” Electron. Lett., vol. 53, no. 8, pp. 558–560, 2017.

[19] W. Rowe, P. Stoica, and J. Li, “Spectrally constrained waveform design[sp tips &tricks],” IEEE Signal Process. Mag., vol. 31, no. 3, pp. 157–162,May 2014.

[20] J. Liang, H. C. So, C. S. Leung, J. Li, and A. Farina, “Waveform designwith unit modulus and spectral shape constraints via lagrange program-ming neural network,” IEEE J. Sel. Topics Signal Process., vol. 9, no. 8,pp. 1377–1386, Dec. 2015.

[21] H. He, P. Stoica, and J. Li, “Waveform design with stopband and correlationconstraints for cognitive radar,” in Proc. 2nd Int. Workshop Cogn. Inf.Process., 2010, pp. 344–349.

[22] P. Ge, G. Cui, S. M. Karbasi, L. Kong, and J. Yang, “A template fittingapproach for cognitive unimodular sequence design,” Signal Process.,vol. 128, pp. 360–368, 2016.

[23] P. Stoica, H. He, and J. Li, “New algorithms for designing unimodularsequences with good correlation properties,” IEEE Trans. Signal Process.,vol. 57, no. 4, pp. 1415–1425, Apr. 2009.

[24] P. Stoica, H. He, and J. Li, “On designing sequences with impulse-likeperiodic correlation,” IEEE Signal Process. Lett., vol. 16, no. 8, pp. 703–706, Aug. 2009.

[25] J. Song, P. Babu, and D. P. Palomar, “Optimization methods for design-ing sequences with low autocorrelation sidelobes,” IEEE Trans. SignalProcess., vol. 63, no. 15, pp. 3998–4009, Aug. 2015.

[26] J. Liang, H. C. So, J. Li, and A. Farina, “Unimodular sequence designbased on alternating direction method of multipliers,” IEEE Trans. SignalProcess., vol. 64, no. 20, pp. 5367–5381, Oct. 2016.

[27] Y. Jing, J. Liang, D. Zhou, and H. C. So, “Spectrally constrained unimod-ular sequence design without spectral level mask,” IEEE Signal Process.Lett., vol. 25, no. 7, pp. 1004–1008, Jul. 2018.

[28] H. B. Yilmaz, T. Tugcu, F. Alagoz, and S. Bayhan, “Radio environmentmap as enabler for practical cognitive radio networks,” IEEE Commun.Mag., vol. 51, no. 12, pp. 162–169, Dec. 2013.

[29] W. Dinkelbach, “On nonlinear fractional programming,” Manage. Sci.,vol. 13, no. 7, pp. 492–498, 1967.

[30] D. R. Hunter and K. Lange, “A tutorial on MM algorithms,” Amer.Statistician, vol. 58, no. 1, pp. 30–37, 2004.

[31] Y. Sun, P. Babu, and D. P. Palomar, “Majorization-minimization algorithmsin signal processing, communications, and machine learning,” IEEE Trans.Signal Process., vol. 65, no. 3, pp. 794–816, Feb. 2017.

[32] W. Fan, J. Liang, and J. Li, “Constant modulus MIMO radar waveformdesign with minimum peak sidelobe transmit beampattern,” IEEE Trans.Signal Process., vol. 66, no. 16, pp. 4207–4222, Aug. 2018.

[33] K. Shen and W. Yu, “Fractional programming for communicationsystems—Part I: Power control and beamforming,” IEEE Trans. SignalProcess., vol. 66, no. 10, pp. 2616–2630, May 2018.

[34] J. Borde and J.-P. Crouzeix, “Convergence of a Dinkelbach-type algo-rithm in generalized fractional programming,” Zeitschrift für Operat. Res.,vol. 31, no. 1, pp. A31–A54, 1987.

[35] S. Schaible, “Fractional programming. ii, on Dinkelbach’s algorithm,”Manage. Sci., vol. 22, no. 8, pp. 868–873, 1976.

[36] M. Razaviyayn, M. Hong, and Z.-Q. Luo, “A unified convergence analysisof block successive minimization methods for nonsmooth optimization,”SIAM J. Optim., vol. 23, no. 2, pp. 1126–1153, 2013.

[37] J. A. Tropp, I. S. Dhillon, R. W. Heath, and T. Strohmer, “Designingstructured tight frames via an alternating projection method,” IEEE Trans.Inf. Theory, vol. 51, no. 1, pp. 188–209, Jan. 2005.

[38] D. P. Bertsekas, “Incremental gradient, subgradient, and proximal methodsfor convex optimization: A survey,” Optim. Mach. Learn., vol. 2010, no. 1–38, 2011, Art. no. 3.

[39] S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.:Cambridge Univ. Press, 2004.

[40] D. P. Palomar, J. M. Cioffi, and M. A. Lagunas, “Uniform power allocationin MIMO channels: A game-theoretic approach,” IEEE Trans. Inf. Theory,vol. 49, no. 7, pp. 1707–1727, Jul. 2003.

[41] G. Scutari, D. P. Palomar, and S. Barbarossa, “Competitive design ofmultiuser MIMO systems based on game theory: A unified view,” IEEEJ. Sel. Areas Commun., vol. 26, no. 7, pp. 1089–1103, Sep. 2008.

[42] G. Scutari, D. P. Palomar, and S. Barbarossa, “Cognitive MIMO radio,”IEEE Signal Process. Mag., vol. 25, no. 6, pp. 46–59, Nov. 2008.

Linlong Wu received the B.Eng. degree in electronicengineering from the Xi’ an Jiaotong University,Xi’an, China, in June 2014, and the Ph.D. degree inelectrical and computer engineering from the HongKong University of Science and Technology, HongKong, in November 2018. His research interests in-clude optimization algorithms and signal processingwith applications in radar, sensor networks, and fi-nancial engineering.

Daniel P. Palomar (S’99–M’03–SM’08–F’12) re-ceived the Electrical Engineering and Ph.D. degreesfrom the Technical University of Catalonia (UPC),Barcelona, Spain, in 1998 and 2003, respectively.During 2004–2006, he was a Fulbright Scholar withPrinceton University, Princeton, NJ, USA. He is cur-rently a Professor with the Department of Electronic& Computer Engineering and Department of Indus-trial Engineering & Decision Analytics, Hong KongUniversity of Science and Technology (HKUST),Hong Kong, which he joined in 2006. He previously

held several research appointments, namely, at King’s College London, London,U.K.; Stanford University, Stanford, CA, USA; Telecommunications Technolog-ical Center of Catalonia, Barcelona, Spain; Royal Institute of Technology, Stock-holm, Sweden; University of Rome “La Sapienza,” Rome, Italy; and PrincetonUniversity, Princeton, NJ, USA. His research interests include applications ofoptimization theory and signal processing in financial systems and big dataanalytics. He was a recipient of a 2004/06 Fulbright Research Fellowship, the2004 and 2015 (co-author) Young Author Best Paper Awards by the IEEESignal Processing Society, the 2015–16 HKUST Excellence Research Award,the 2002/03 best Ph.D. prize in Information Technologies and Communicationsby the UPC, the 2002/03 Rosina Ribalta first prize for the Best Doctoral Thesis inInformation Technologies and Communications by the Epson Foundation, andthe 2004 prize for the best Doctoral Thesis in Advanced Mobile Communicationsby the Vodafone Foundation and COIT. He has been a Guest Editor for theIEEEJOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING 2016 Special Issueon “Financial Signal Processing and Machine Learning for Electronic Trading”,an Associate Editor for IEEE TRANSACTIONS ON INFORMATION THEORY andIEEE TRANSACTIONS ON SIGNAL PROCESSING, a Guest Editor for the IEEESIGNAL PROCESSING MAGAZINE 2010 Special Issue on “Convex Optimizationfor Signal Processing,” the IEEE JOURNAL ON SELECTED AREAS IN COMMUNI-CATIONS 2008 Special Issue on “Game Theory in Communication Systems, andthe IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS 2007 SpecialIssue on “Optimization of MIMO Transceivers for Realistic CommunicationNetworks.”