on stability of cellular neural networks
Post on 02-Aug-2016
Embed Size (px)
Journal of VLSI Signal Processing 23, 429435 (1999)c 1999 Kluwer Academic Publishers. Manufactured in The Netherlands.
On Stability of Cellular Neural Networks
PIER PAOLO-CIVALLERI AND MARCO GILLIDipartimento di Elettronica, Politecnico di Torino, Corso Duca degli Abruzzi 24, I-10129 Torino, Italy
Abstract. The main results about stability of cellular neural networks (CNNs) are reviewed. Some of themare extended and reformulated, with the purpose of providing to the CNN designer simple criteria for checkingthe stability properties. A particular emphasis is given to the conditions for the stability of CNNs described byspace-invariant templates.
Cellular neural networks (CNNs) are analog dynamicprocessors, suitable for solving all the computationalproblems that can be formulated in terms of local in-teractions among signals placed on a regular structure. The fundamental property that distinguishes aCNN from a general neural network is the local con-nectivity, that has allowed the realization of severalhigh-speed complex VLSI chips .
From a mathematical point of view a CNN can beconsidered as a dynamical system described by a largeset of nonlinear differential equations, that may exhibitseveral kinds of attractors: equilibrium points, limitcycles and also non-periodic attractors (like for exam-ple a chaotic behavior) . A design techniquefor CNNs would require to determine, for given sets ofparameters, all the attractors of the network and theirdomains of attraction. This is practically impossiblefor actual CNNs, composed of far more than 2 or 3cells . In most applications (like for examplein image-processing tasks) it is required that the CNNbe stable, i.e. that after a transient all trajectories tendto a constant value.
In this paper we review the main stability resultsavailable in the literature and reformulate and extendsome of them, with the purpose of giving to the CNNdesigner simple and practical tools for checking CNNstability. We restrict our attention to the original modelof CNN, introduced in .
The manuscript is organized as follows. In Section IIwe review the mathematical model of a CNN (witha particular emphasis on CNNs described by space-
invariant templates, that represent the most commoncase in applications). In Sections IIIV we discuss thevarious types of stability of a CNN: complete stabil-ity in Section III, stability almost everywhere in Sec-tion IV and global asymptotic stability in Section V.We rigorously define each kind of stability in relationwith its impact on applications; then we provide a setof theorems, that represent useful and simple criteriafor checking CNN stability.
2. Mathematical Model of a CNN
We consider CNNs composed by N M cells arrangedon a regular grid. We denote the position of a cell withtwo indexes .i; j/ with the assumption that cell .0; 0/is located in the lower left corner and cell .N ;M/ islocated in the upper right corner.
Such a CNN is described by the following normal-ized state equations
Pvx.i j/ D vx.i j/ CX
.kl/2Nr .i j/QAi j;klvy.kl/
.kl/2Nr .i j/QBi j;klvu.kl/ C Ii j (1)
where vx.i j/ and vu.i j/ represent the state-voltage andthe input voltage of cell .i; j/; vy.i j/ is the output volt-age, defined through a bounded monotonic Lipschitzfunction f ./,
vy.i j/ D fvx.i j/
430 Paolo-Civalleri and Gilli
In most applications f ./ has the following piecewiselinear expression:
f vx.i j/ D 12flflvx.i j/ C 1flfl flflvx.i j/ 1flfl (3)Finally Nr .i; j/ is the neighborhood of order r of cell.i; j/ defined in ; QA and QB are linear templates andIi j is the bias term.
A CNN is said to be space-invariant if the two tem-plates do not depend on cell .i; j/. In such a case thetemplates are described by two .2rC1/ .2rC1/ realmatrices OA and OB, satisfying QAi j;kl D OAki;l j , QBi j;kl DOBki;l j .
The state Eq. (1), using the commutative property ofthe convolution, can be written in the simplified form:
Pvx.i j/ D vx.i j/ CX
jpjr;jqjrOBpqvu.iCp; jCq/ C Ii j (4)
An alternative and useful expression for the state equa-tion of a CNN is obtained by ordering the cells in someway (e.g. by rows or by columns) and by repacking thestate, the input and the output variables into the vectorsx , u and y. If we call .i; j/ the invertible ordering,we have:
x.i; j/ D vx.i j/; u.i; j/ D vu.i j/; y.i; j/ D vy.i j/ (5)
The state equations can be written in the following com-pact form:
Px D x C Ay C Bu C QI (6)
where matrices A and B are obtained through the tem-plates ( QA or OA) and ( QB or OB), as explained in  andQI.i; j/ D Ii j .
Hereafter we assume that the inputs vu.i j/ (and there-fore vector u) are constant and hence that the CNN isan autonomous dynamical system.
3. Completely Stable CNNs
In image processing applications the input image isloaded either as the initial state x0 or as a constant in-put u. The output image is obtained through the timeevolution of the network and is extracted from the out-put voltage y. In order to ensure a proper working of
the network it is needed that the CNN be completelystable or stable almost everywhere (i.e. stable with theexception of a set of initial conditions of measure zero).A rigorous definition of the complete stability of an au-tonomous system is reported below:
Definition 1. An autonomous dynamical system, de-scribed by the state equation:
Px D f .x/; x 2 Rn; f : Rn ! Rn (7)
is said to be completely stable (or convergent) if foreach initial condition x0 2 Rn
limt!1 x.t; x0/ D const (8)
where x.t; x0/ is the trajectory starting from x0.The following properties hold for a convergent
each trajectory converges towards an equilibriumpoint; almost all trajectories converge towards a stable equi-
librium points, whereas those starting from a set ofinitial conditions of measure zero converge towardssaddle points of various indexes; the domains of attraction of the stable equilibrium
points are separated by the stable manifolds of thesaddle points .
The main results concerning the complete stabilityof CNNs are summarized in the theorems stated below.
Theorem 1. A sufficient condition for the completestability of a CNN described by state equations .6/;with the output function .3/; is that the matrix A besymmetric.
Proof: It is based on the introduction of suitable Lya-punov functions. The fundamental ideas are reported in. A rigorous proof can be found in , by assumingthat the diagonal matrix D, introduced in Theorem 1,be the identity matrix. 2
Theorem 2. A sufficient condition for the completestability of a CNN described by state equations .6/;with a differentiable and invertible output functionf ./; is that the matrix A be symmetric and that allthe equilibrium points are isolated.
Proof: Reported in [20, Theorem 1]. 2
On Stability of Cellular Neural Networks 431
Theorem 3. A sufficient condition for the completestability of a CNN described by state equations .6/;with the output function .3/; is that there exists a posi-tive diagonal matrix D, such that the product D A is asymmetric matrix.
Proof: See [21, Theorem 1]. 2
Theorem 4. A sufficient condition for the completestability of a CNN described by state equations .6/;with a differentiable and invertible output functionf ./; is that there exists a positive diagonal matrix D;such that the product D A is a symmetric matrix andthat all the equilibrium points are isolated.
Proof: See [20, Corollary 1]. 2
Note that the condition given in [20, Corollary 1],(i.e. the existence of two diagonal matrices D1 and D2,such that D1 AD2 be symmetric, and D1 D2 positive def-inite) is equivalent to that of Theorem 4 above. In fact,if D1 AD2 is symmetric, then also D12 D1 AD2 D
D12 D1 A is symmetric. Hence there exists a positivediagonal matrix D D D12 D1, such that D A is symmet-ric, that is exactly the condition of stability providedby Theorem 4 above.
Note also that the proof of [21, Theorem 1] canbe easily extended to CNNs with bounded monotonicLipschitz output functions (that not necessarily are dif-ferentiable and invertible), without requiring that all theequilibrium points are isolated. Therefore Theorems 14 above can be replaced by the following theorem.
Theorem 5. A sufficient condition for the completestability of a CNN described by state equations .6/;with a bounded monotonic Lipschitz output functionf ./; is that there exists a positive diagonal matrix D;such that the product D A is a symmetric matrix.
Proof: It is sufficient to observe that the time-derivative of the output vector y.t/ can be written as:
Py.t/ D N .x/ Px.t/; N .x/ D diagfnh.xh/g (9)where nh.xh/ is equal to f 0.xh/ 0 if the derivativeexists and is not defined if the derivative does not exist.Then the proof can be carried out as shown in [21,Theorem 1], by simply noting that the inequality (12)of  holds because f ./ is a bounded monotonicLipschitz function and that the Lyapunov function V .t/(4) introduced in  is bounded, due to the fact thatf ./ is assumed to be bounded. 2
As we have already pointed out, in most of the appli-cations CNNs are defined by space invariant templatesOA and OB. As a consequence it is important to express
the stability conditions reported above in terms of thetemplate elements. This is trivial for Theorems 1 and2 (the symmetry of matrix A implies the symmetry ofthe OA template, OApq D OAqp). For what concerns The-orems 35, the following result holds:
Theorem 6. If a CNN is described by a space-invariant template OA such that:
two couples of entries satisfy OArs OAr;s >