a group-theoretic construction with spatiotemporalwavelets for the analysis of rotational motion

30
Journal of Mathematical Imaging and Vision 17: 207–236, 2002 c 2002 Kluwer Academic Publishers. Manufactured in The Netherlands. A Group-Theoretic Construction with Spatiotemporal Wavelets for the Analysis of Rotational Motion JEAN-PIERRE LEDUC  Department of Mathematics, University of Maryland, 1301 Mathematics Bldg, College Park,  MD 20742-4015, USA  [email protected] Abstract. Thi s paper pre sen ts a group- the ore tic app roa ch for the ana lys is of rot ati ona l mot ion in ima ge se que nce s. This method relies on Lie algebras, Lie groups and Lie group representations to provide not only the continuous wavelets but also the related tools of harmonic analysis. This approach can be referred to research works presented in J.S. Byrnes et al. (W avelets and their Applications, Kluwer Academic Publishers, 1994) who strongly inuenced this topic. For the purpose of modeling motion transformations, this paper introduces the concepts of Lie algebras and Lie groups as theactualmat hemati cal founda tions of alltheobservabl e kin ematics emb edd ed in spa tio-te mpo ral signa ls. Rotat ional motio n analy sis focus es on the estimationof angul ar velo city and angul ar accelerationsembedded in image sequences. Rotational motion is usually carried on a trajectory, the complete problem at hand consists in estimating not only the angular velocity and its temporal derivatives but also the position, the translational velocity and its temporal derivatives along the carrier trajectory. The paper starts with the usual afne and Galilei groups and proceeds by successive extensions and sections to the rotational group. The theory of group representations is central to provide families of continuous wavelets, special functions, PDE’s, ODE’s and integral transforms as new mathematical tools of motion analysis in image sequence to perform optimal and selective detection, estimations, tracking, and reconstructions. This paper denes rotational wavelets and proposes a structured approach to perform est ima tion and tra cki ng in ima ge se que nce s which ts to Kal man lt ers . Simula tions on rea l dig ital ima ge seq uen ces are also presented with tracking and estimation. Keywords: Lie group theory, motion analysis, tracking, continuous wavelet transforms, image sequence analysis 1. Intr oducti on This paper addresses new applications of Lie group repre senta tion theory for digit al image processin g. More precisely, the purpose of this work is the anal- ysis of rotational motion in digital image sequences. To achieve this goal, a theoretical framework is built on the followin g struc tural steps: construc t the ap- propriate Lie groups and Lie algebras that model the physics and the kinematics [1, 3] of rotational mo- tion, construc t the relat ed group represen tatio ns in the function spaces of signa ls, dene new famili es of spatio-temporal continuous wavelets, develop the re- lated harmonic analysis and design the related track- ing algorithms. In this context, continuous wavelets are dened from square-integrable unitary irreducible representations of Lie groups. Following this vein, this pap er der iv es rot ati ona l wa vel ets from a Lie group con - struction that starts with the multidimensional afne group and the Galilei group. The multidimension al afne group is a homogeneous extension of the uni- dimensional af ne gro up. The Gal ile i group is the group of classical mechanics which deals with veloc- ity transformation. The construction proceeds to the denition of rotational wavelets as families of con- tinuous wavelets indexed by the following kinemat- ical parameters: scale, spatial and temporal position, translational velocity , angular position and angular ve- locity. In this construction, any family of continuous wavelets stems from the action of a Lie group G onto

Upload: ssbarpanda8473

Post on 07-Apr-2018

218 views

Category:

Documents


0 download

TRANSCRIPT

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 1/30

Journal of Mathematical Imaging and Vision 17: 207–236, 2002

c 2002 Kluwer Academic Publishers. Manufactured in The Netherlands.

A Group-Theoretic Construction with Spatiotemporal Wavelets

for the Analysis of Rotational Motion

JEAN-PIERRE LEDUC

 Department of Mathematics, University of Maryland, 1301 Mathematics Bldg, College Park,

 MD 20742-4015, USA

 [email protected]

Abstract. This paper presents a group-theoretic approach for the analysis of rotational motion in image sequences.

This method relies on Lie algebras, Lie groups and Lie group representations to provide not only the continuous

wavelets but also the related tools of harmonic analysis. This approach can be referred to research works presented

in J.S. Byrnes et al. (Wavelets and their Applications, Kluwer Academic Publishers, 1994) who strongly influenced

this topic. For the purpose of modeling motion transformations, this paper introduces the concepts of Lie algebras

and Lie groups as the actual mathematical foundations of all the observable kinematics embedded in spatio-temporal

signals. Rotationalmotion analysis focuses on the estimationof angular velocity and angular accelerations embedded

in image sequences. Rotational motion is usually carried on a trajectory, the complete problem at hand consists in

estimating not only the angular velocity and its temporal derivatives but also the position, the translational velocity

and its temporal derivatives along the carrier trajectory. The paper starts with the usual affine and Galilei groups

and proceeds by successive extensions and sections to the rotational group. The theory of group representations is

central to provide families of continuous wavelets, special functions, PDE’s, ODE’s and integral transforms as newmathematical tools of motion analysis in image sequence to perform optimal and selective detection, estimations,

tracking, and reconstructions. This paper defines rotational wavelets and proposes a structured approach to perform

estimation and tracking in image sequences which fits to Kalman filters. Simulations on real digital image sequences

are also presented with tracking and estimation.

Keywords: Lie group theory, motion analysis, tracking, continuous wavelet transforms, image sequence analysis

1. Introduction

This paper addresses new applications of Lie group

representation theory for digital image processing.More precisely, the purpose of this work is the anal-

ysis of rotational motion in digital image sequences.

To achieve this goal, a theoretical framework is built

on the following structural steps: construct the ap-

propriate Lie groups and Lie algebras that model the

physics and the kinematics [1, 3] of rotational mo-

tion, construct the related group representations in

the function spaces of signals, define new families of 

spatio-temporal continuous wavelets, develop the re-

lated harmonic analysis and design the related track-

ing algorithms. In this context, continuous wavelets

are defined from square-integrable unitary irreducible

representations of Lie groups. Following this vein, this

paper derives rotational wavelets from a Lie group con-

struction that starts with the multidimensional affinegroup and the Galilei group. The multidimensional

affine group is a homogeneous extension of the uni-

dimensional affine group. The Galilei group is the

group of classical mechanics which deals with veloc-

ity transformation. The construction proceeds to the

definition of rotational wavelets as families of con-

tinuous wavelets indexed by the following kinemat-

ical parameters: scale, spatial and temporal position,

translational velocity, angular position and angular ve-

locity. In this construction, any family of continuous

wavelets stems from the action of a Lie group G onto

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 2/30

208 Leduc

operators in the functional space of the signals. This

action is defined in terms of a homomorphism i.e. aone-to-one mapping from the group elements g ∈ G

to linear and invertible operators T g. These operators

are built as Unitary Irreducible Representations (UIRs)

of a Lie group fulfill square integrability under ad-

ditional conditions. Square-integrable representations

define continuous wavelet transforms. These continu-

ous wavelets are endowed with more properties than

those rooted in an usual cross-correlation function or

a matched filter [31]. The continuous wavelet trans-

form is an isometry defined on the Hilbert space of 

observation H o = L2(Rn , d  x) whose range is a closed

subspace of the Hilbert space of the state parameters

 H s = L2(G, dg ). The set of kinematical parameters gdefines a Lie group G and characterizes the state of the

moving system. dg is an invariant Haar measure on G

tobe defined. The continuous wavelet transform is also

optimal to many regards; it performs Minimum-Mean-

Square-Error (MMSE) motion estimation [31], edge

detection, image noise rejection, motion jitter smooth-

ing, frame decompositions, interpolations, predictions,

and motion-selective reconstructions [2, 26, 30].

The definition of rotational motion [3] depends upon

the position of the axis around which the motion takes

place. If the axis is the center of inertia of the object, the

motion refers to a spin. If the object revolves aroundan external axis, the motion refers to an orbit. Fur-

thermore, the rotations are expressed through unitary

matrices of transformation namely

 R(θi τ i ) =

cos(θi τ i ) − sin(θi τ i )

sin(θi τ i ) cos(θi τ i )

with x 2

1 + x 22 -invariance for circular rotations and

R(φi τ i ) =

cosh(φi τ i ) −sinh(φi τ i )

sinh(φi τ i ) cosh(φi τ i )

with x 2

1 −  x 22 -invariance for hyperbolic rotations. This

paper will focus on both rotational aspects and illus-

trate the first case within image sequences. Rotational

motion composes with translational motion. This pa-

per shows how estimation and tracking of translational

and rotational parameters can be dissociated from each

other.

The approach developed in this paper is based on

Lie group representations for signal processing as orig-

inally developed by Antoine et al. in [2] where the

prime focuswas mathematical physics and the wavelets

on the Galilei, Poincare and de Sitter groups and by

Caelli et al. in [11] where the interest was human vi-sion modeled by the Lorentz group. Segman and Zeevi

in [38, 41, 42] stepped on Caelli approach and recog-

nized the relevance of the group-theoretic methods for

computer vision. Duval-Destin and Murenzi [12] have

also been focusing on perceptive aspects of the hu-

man visual system to design the first spatio-temporal

continuous wavelets parametrized with speed. Let us

also remark that the concept of rotating wavelets has

been mentioned in a different context by O.A. Barut

[4]. Barut’s wavelet functions are solutions of the Dirac

and wave equations. Let us also mention the early work 

of Fleet and Jepson [13] who developed without any

group-theoretic support the first orientation and veloc-ity selective filters. This paper proceeds fromAntoine’s

original point of view to develop new extensions of 

the Galilei group [33] based on observable kinemat-

ics in the functional spaces of the signals. The author

prefers to start from the Lie algebra. Indeed, Lie al-

gebras provide an easy and general way to define the

kinematic and geometry. The construction proceeds to

the calculation of the Lie group and its representations

[28, 29, 31]. At that stage, all the concepts of harmonic

analysis [27] may be revisited and related to the kine-

matics at hand. As a major property of this approach,

all the relevant concepts can be analytically computedand numerically estimated in the signal. The concepts

of interest in harmonic analysis are as follows: the anal-

ysis of uncertainty relations, ODE’s, PDE’s, special

functions and integral and wavelet transforms, exis-

tence of frames and orthogonal bases. Moreover, con-

tinuous wavelet transform on motion transformations

fits perfectly to important theory like Kalman filtering

[30, 31] and irregular sampling [27]. Moreover, con-

tinuous wavelet transform provides a Wold decomposi-

tion of the signal considered as a wide-sense stationary

stochastic processes [15], maximum likelihood estima-

tions, and links to stochastic calculus and Ito integrals

[27]. From this point of view, the group-theoretic ap-

proach presented in this paper differs fundamentally

from other techniques [32] that have been proposed so

far in the literature [13] such as those based on opti-

cal flow, pel-recursive, block matching and Bayesian

models and addresses the actual physics acting upon

the signal. Continuous wavelet transforms also provide

motion estimations that are robust not only against im-

age noise and blur but also against motion jitter [31].

Moreover, as a result of their spatio-temporal filter-

ing and interpolation properties, the wavelet technique

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 3/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 209

can resolve temporary occlusions problem supply by

interpolation the objects at the occluded positions.This paper presents a tracking algorithm based on a

Kalman filter which relies on the exponentiation of the

Lie algebra to generate the state equation of the sys-

tem. The Galilean and rotational wavelets perform se-

lective motion estimation and selective reconstruction

by means of a gradient-based technique which provides

an optimal search of parameters. The wavelet transform

eventually contributes as a motion-selective filter in the

observation equation.

The structure of the paper is as follows. Lie groups

and algebras for rotational motion are developed in a

constructive way along with the related wavelets, and

admissibility conditions. This constructive approachproceeds by successive extensions and sections on al-

gebras and groups. This technique provides an use-

ful way to create many other variants of interest for

applications (for instance, deformations instead of ro-

tations, accelerations instead of velocity). The UIRs

are constructed using the Mackey’s theory of induced

representations and imprimitivity [34] on semi-direct

products [5, 14], and the Kirillov’s method of orbits. It

is shown how the characters of these new groups gen-

erate special functions similar to Bessel functions [8].

Thespecial functionsdefine thekernel of integraltrans-

forms similar to Hankel transforms and the samplingof rotational motion which is related to the symmetries

of the system. The connection with the harmonic oscil-

lator in the group SU (2) and S L(2,C) is investigated

to relate this approach to some physical concepts. An

alternative Lie algebraic approach is finally proposed

for motion tracking and estimation in order to build

the motion trajectories. Simulations on real image se-

quences illustrate how to build the rotational wavelets

and how to perform the parameter estimation. To help

the interested reader, four appendixes sketch compu-

tational techniques that are classically related to the

group constructions.

2. Lie Group Representations and Continuous

Wavelet Transforms

This section contains the main purpose of this pa-

per: the construction of group representations for the

analysis of both translational and rotational motion.

These representation provides the related continuous

wavelets which support the motion estimation filter-

ing and tracking. To clarify the construction, a brief 

description of Lie group representation theory is first

provided with some useful references in this field. In

each case of study, we adopt a similar structure whichproceeds with the construction of Lie groups of inter-

est, their Lie algebras, their group representations and

their associated wavelets. The group construction pro-

gresses by successive extensions and sections. Exten-

sions add new group parameters of interest. Sections

add a constraint on the parameters i.e. diminish the

dimension of the parameter space. For the shake of 

clarity, our procedure will start from two well-known

groups: theaf fine group in multidimensional space,and

the extended Galilei group which introduces the trans-

lational velocity. The construction will proceed as fol-

lows. A section on the extended af fine-Galilei group

provides the appropriate representations for image se-quence processing. The next step consists of an new

extension followed by a section to add the angular po-

sition and velocity on the later version of the af fine-

Galilei group. This procedure is fairly general; similar

extension-section procedures enable to incorporate

any additional temporal derivative of translational,

rotational and deformational motion.

2.1. Group Representations

Let S(

 x, t ) be the spatio-temporal signal under anal-

ysis and ( x, t ) the analyzing function in the Hilbert

space of observation H o = L2(Rn × R, d n  xdt ). The

conditions of existence of such an analyzing func-

tion , called a wavelet, are examined latter in this

section. The spatial dimension is n = 2 when con-

tinuous wavelets are discretized to process image

sequences. The continuous wavelet transform W  is

defined [10, 20, 21, 26, 30, 31] as a linear map W  :

 L2(Rn × R, d n  xdt ) → L2(G, dg) as follows

[W  S](g) = g, S (1)

=  Rn×R¯

g( x, t )S( x, t )d 

n

  x dt  (2)

where ., . is an inner product which expresses the

correlation between two functions defined in H o and

the overbar symbol “ ” stands for the complex con-

 jugate. Let us denote g ∈ G as an element of the Lie

group G that models the motion transformations. The

element g ∈ G carries all the motion parameters of in-

terest. Hence, g is precisely the state of the moving sys-

tem. Therefore, H s = L2(G, dg ) is clearly the Hilbert

state space. The family of wavelets g is generated as

an orbit with dense span in H o through the action of an

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 4/30

210 Leduc

operator T g such that g( x, t ) = [T g]( x, t ). The map

g → T g is a group representation i.e. a homomorphismthat maps the group elements g ∈ G to operators T gacting in H o. This mapping is such that T g1◦g2

= T g1T g2

and T e = I  H o . I  H o defines the unit operator in H o and

e the identity element in G. The symbol ◦ stands for

the group composition in G. In the following, all the

group representations T g are constructed as UIRs and

calculated by the technique of induced representations

that invokes the Mackey’s theory of induced represen-

tations [5, 34, 36, 37] and the Kirillov’s method of 

orbits [23]. The existence of continuous wavelet trans-

forms is further derived under the condition that the

UIRs be square-integrable. This condition of square-

integrability is equivalently known as the condition of wavelet admissibility and as the condition for the linear

mapping defined in Eq. (1) to be invertible. This third

point of view is referred as the Calderon reproducing

formula [39]. The inverse transform of Eq. (1) yields

the perfect reconstructions of the signal. This reads in

terms of operators I  H o = W −1 W  and in functional

forms as

S(x) = 

G

T g , S(T g)(x)d µl (g) with x = ( x, t )

(3)

The measure d µl (g) is the left-invariant Haar measure

on G. Let us remark that x = ( x, t ) may alternatively

be defined in the Fourier domain as k = (k , ω) where

the variables k  and ω are the dual of the translations

i.e. respectively the spatial and temporal frequencies.

In this brief introduction, we have seen how the linear

mapping definedinEq.(1)definesan isometry between

the Hilbert space H o and a sub-space H sr  of the Hilbert

space H s . Let us notice that H sr  is a reproducing kernel

space [2]. In fact, if the signal is a wide-sense stationary

stochastic process, the isometry operator provides a

Wold decomposition wherethe signal, an unpredictable

process, is decomposed into a regular process and anorthogonal predictable process [15]. The predictable

belongs to H sr  and the former process belongs to the

complementary Hilbert space ( H sr  )⊥.

Let us now restart with the construction of left-

regular UIRs. They read in H o

[T g](x) = λ( x, g)1/2(g−1x) with f  ∈ H o (4)

The function λ( x , g)1/2 is usually a one-dimensional

representation that contains the characters and the nor-

malization factor that provides unitarity. These UIRs

[T g](x) are usually calculated by the technique of in-

duced representations [23, 34]. The representation T g isindeed induced from the representation L K  of a closed

subgroup K  of G in the Hilbert space H o. G is a locally

compact group and K ⊂ G. Let us define X  as the ho-

mogeneous space of left cosets X = G\K ={g K , g ∈G} and denote µ a quasi-invariant measure in X . The

group representations constructed with the technique

referenced here above are derived in a dual space

(Appendix 1). The dual space ˆ X  is a Fourier domain

known as the phase space made of patial and temporal

frequencies, k  and ω, as respective duals of the spatio-

temporal translations. When the Lie group admits a

non-trivial central extension [40], the phase space also

contains the associated dual parameter which is de-noted m in the sequel and known as the dual of the

phase φ in the group. Eventually, Eq. (4) reads as the

following mapping

IND ↑GK  L K  : g → [T (g)](k)

= χ 1/2(g)ρ(b, k) L K (g−1k) with

k = (k , ω, m) ∈ ˆ X  and b = (b, τ , φ) ∈ X  (5)

which defines an induced representation IND ↑GK  of G

by L K  in L2( ˆ X , d µ). In this equation, χ (g) = µ(g−1k)

µ(k)is

the Radon-Nikodym derivative continuous on G

×X ,

K  is a stability sub-group (also called little group) of 

G whose representation is L K , ρ (b, k) are the char-

acters related to the dual group ˆ X , g−1k is the left

group action on X  expressed by the co-adjoint action

of the group [23]. Therefore, L2( ˆ X , d µ) = H o. We

also know that H o on space and time corresponds to

the Fourier space. If there exists a system of imprim-

itivity defined as the triple (T g, X , µ) and if  K  ⊂ G

is a commutative stability subgroup, then for any UIR

 L K , (IND ↑GK  L K ) is also UIR [34]. It turns out that all

semi-direct products G = N S where N  is commu-

tative, have a system of imprimitivity [5]. The group

representations treated in this paper belong to thiscategory.

The additional condition for unitary irreducible rep-

resentations to fulfill square-integrability provides a set

of important properties that are not rooted in standard

unitary irreducible representations [2]. For instance,

the condition of square-integrability the condition for

continuous wavelet admissibility, sets up the isometry

as defined above in Eq. (1) with a reproducing ker-

nel sub-space of  H sr  = L2(G, d µl (g)). The projection

from L2[G, d µl (g)]) onto H o is the integral operator

with reproducing kernel K (g, g) = g, g, that is,

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 5/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 211

the autocorrelation function of . For a given non-zeroˆ

∈ H 

o

, the condition reads

C (, η) = 

G

|T g, η|2d µl (g) < +∞ ∀η ∈ H o

(6)

where d µl (g) is the left invariant Haar measure on G

and C (, η) is some finite real constant. The functions

that fulfill the condition are said to be admissible as

a mother wavelet. As a consequence of irreducibility, g defines an orbit with dense span in H o. The orbit

is defined as S g = {

 g = T g | g ∈ G; ,

 g ∈ H o}

i.e. a family of continuous wavelets indexed by the

motion parameters in g. Hence, square-integrability isa well-defined property of a pair (T g ,O), where T gis a representation and O is an orbit. The condition

of wavelet admissibility is calculated from Eq. 6 by

integrating over G with dg an invariant Haar measure

for G. This construction yields the state space as a sub-

space of  L2(G, dg ) with reproducing kernels [2], and

the map W ψ with all the properties of the isometry i.e.

the perfect reconstruction [2], the MMSE estimations

[30]. In Section 6, the Morlet wavelets will be chosen

as admissible rotational wavelets (k , ω) to perform

the numerical simulations. The subsequent sections are

devoted to the characterization of the parameter setsg, the calculation of the UIRs and the conditions of 

wavelet admissibility.

2.2. The Multidimensional Affine Group

The n-dimensional af fine group is similar to the one-

dimensional case. In n-dimensional space, a rotation

matrix can be introduced to provide an additional

parameter for the estimation of spatial orientation.

This generalizes the one dimensional case of reflec-

tion which is never used for the practical purpose of 

motion analysis. As a result of the small amount of parameters carried by this group, the af fine group is

a best place to start and illustrate the technique. Let

us also remark that the rotations addressed in this pa-

per primarily consist of circular rotations. Hyperbolic

rotations also fit to this approach and will be briefly

discussed in this paper. To distinguish among the suc-

cessive Lie groups and related Lie algebras to be pre-

sented, we adopt the generic notation Gi and Gi re-

spectively for each group and algebra. The integer

i ≥ 1 determines the position the sequence of group

definitions.

The n-dimensional af fine group, denoted here G1 =SIM(n), is an ordered 3-tuple of elements

g = {b, a, R} (7)

where the parameters b ∈ Rn , a ∈ R+\{0} and R ∈

SO(n) stand respectively for translation in space (the

Cartesian position), dilation (the scale) and rotation

in n-dimensional space (the angular orientation). This

group is a subgroup of GL(n +1,R) with the following

matrix representation

g

= a R b

0 1 (8)

Let g = {b, a, R} and g = {b, a, R} be elements of 

G1. Consequently, the associative law of composition

and the inverse element may be immediately identified

from matrix multiplication and inversion. These are as

follows

g ◦ g = {b + a Rb, aa , R R} (9)

and

g−1 = {−a−1 R−1b, a−1, R−1} (10)

Let us notice that the Lie group G1 has the following

semi-direct group structure

G1 = Rn[R∗

+ × SO(n)] (11)

where the symbols × and stand respectively for the

direct and the semi-direct group products.

The left and right Haar invariant measures, respec-

tively d µl (g) and d µr (g) for G1 are easily computed

through infinitesimal variations of volumes in the mul-tidimensional space of group parameters {gi}n

i=1 and

are given for the left-invariant measure by the general

form

d µl (g) = det

∂g ◦ g

∂g

−1

g=e

dg1 ∧ dg2 ∧ · · · ∧ dgn

(12)

where ∧ is the exterior product, and for G1, by

d µl (g) = da d b dm( R)

|an+1| (13)

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 6/30

212 Leduc

The right-invariant measure is given in its general form

as

d µr (g) = det

∂g ◦ g

∂g

−1

g=e

dg1 ∧ dg2 ∧ · · · ∧ dgn

(14)

and for G1 as

d µr (g) = da d b dm( R)

|a| (15)

where dm ( R) is the left and right Haar measure for

SO(n). Equations (12) and (14) are easily demonstrated

see in [5, 21].Let us now derive the Lie algebra related to G1 =

SIM(n). Let { J i}n(n−1)

2

i=1 be the standard generators for

so(n), the Lie algebra of  SO(n). Then, the Lie alge-

bra G1 of  G1 is generated by the elements {P j , Q, J i}where j = 1, . . . , n and i = 1, . . . , n(n−1)

2and the

commutator relations are given as follows

[Pk , P j ] = 0, [Q, P j ] = P j , [ J i , P j ] = k i j Pk ,

[Q, J i ] = 0 ∀i, j, k  (16)

where k 

i j

is theantisymmetric tensor. It is easy to verify

that these generators form a Lie algebra i.e. all the com-

mutators fulfill anti-symmetry and Jacobi relations. Let

us recall that the Lie algebra is the vector space tangent

to thegroup at identity andendowedby theLie product.

G1 is generated by the set of infinitesimal generators

{P j , Q, J i }. The Lie product is the commutator prod-

uct [ A, B] = AB − B A where A and B are any two

generators. See [5, 17] to read all the major properties

of Liealgebras. It is clear that theLie algebra hasmatrix

representations (Ado’s theorem [5]). We can now ob-

tain the generic group element g = {b, a, R} ∈ G1 and

the composition law by exponentiating a point Y 

∈G1.

It is known that the exponential map is a local diffeo-morphism of G onto G. We may denote an element of 

G by

 X  = b P + s Q + r J  = {b, s, r } ∈ G. (17)

Thereafter, with g = E ( X ) and E  the exponential map,

we have

 E ( X ) = exp(b P) exp(s Q) exp(r J ) (18)

with a = es ∈ R+\{0}, R = exp(r ) ∈ SO(n).

The UIRs T g of G1 in the Hilbert space L2(Rn , d nk )

can be thoroughly calculated using the machinery de-veloped in [4, 6, 23, 24, 37, 43]. This computation

requires to proceed through a set of new definitions.

The procedure is sketched in Appendix 1 for this case

which requires the smallest amount of computations.

The UIRs of  G1 = SIM(n) are eventually given in the

forms of Eq. (5) in the Fourier space L2(Rn , d nk ) as

[T g](k ) = an2 eib·k (k ) (19)

with

=a R−1

k  (20)

By construction (see Appendix 1, Eq. (99)), the param-

eter k  stands for the dual parameter of   x in the duality

defined in Eq. (99). The parameter k has to be interpre-

tated as a Fourier variable for the spatial frequency [2].

In this representation, it is easy to see that the normaliz-

ing factor an2 provides unitarity, and the characters ei b·k 

of Rn define the Fourier kernel. The change of variable

to k  stems from the action of the group on ˆ X  = {k }dual of  X  = { x}, this is clearly g−1 ˆ X .

At this stage, the function (k ) ∈ L2(Rn , d nk ) can

be considered as a template to be used as a matched

filter but thefunction (k ) requires more to be admittedas a continuous wavelet. To define a matched filter for

a signal S(k ) ∈ L2(Rn, d nk ), the function T g(k ) has

 just to fulfill the following well-known condition =¯S to yield the equality in Cauchy-Schwarz inequality.

In this approach, we have defined the cross-correlation

function on the group as [C  S](g) a linear map, i.e. the

following function g

[C  S](g) = T g , S (21)

In order to obtain the continuous wavelet transform

from this cross-correlation function, the linear 21 map

has to become an isometry. According to Eq. (6), the

condition of square-integrability reads in this case Rn

 +∞

−∞|T g , |2 da d nb

an+1< +∞ (22)

and, eventually after some computations and changes

of variables, continuous wavelets do exist under the

condition ∈ L2(Rn , d nk ) such that +∞

−∞|(ξ )|2 d n ξ

|ξ | = C ψ < +∞ (23)

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 7/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 213

and the representation T g is bounded for all g. The

variable ξ ∈ Rn

is still a Fourier variable.Let us remark that the Weyl-Heisenberg group is an-

other important group which is not related to motion

analysis but can be treated in a similar way. The inter-

ested reader may find the corresponding calculations

in [2, 20].

2.3. The Af  fine-Galilei Group

The Galilei group, referred here as G2 = GAL(n),

is the group of physics that describes the motion of 

rigid objects with constant velocity v, in the Euclidean

spacetime. An element, g ofthe Galilei group isdefinedto be an ordered 4-tuple of elements, g = {b, τ, v, R};

 R ∈ S O(n); b, v ∈ Rn, τ  ∈ R realized a subgroup of 

S L(n + 2,R) according to this matrix representation

g = {b, τ, v, R} =

 R v b0 1 τ 

0 0 1

∈ S L(n + 2, R).

(24)

Let us now combine the multidimensional af fine group

G1 = SIM(n) and the Galilei group G2 = GAL(n)

to define the af fine-Galilei group G3 = aff-GAL(n) asan ordered 6-tuple of elements g = {b, τ, v, a, a0, R}with R ∈ SO(n); b, v ∈ R

n , τ  ∈ R, a, a0 ∈R

+\{0}. The associated Lie Algebra G3 is a real vec-

tor space of dimension n(n−1)

2+ 2n + 3 spanned by

the elements {Pi , H , K i , Q, Q0, J  j ; i = 1, . . . , n; j =1, . . . , n(n−1)

2} where the infinitesimal generators are

definedin therespectiveorderof theparameters defined

in g. In this case, we have

exp(r ) = (0, 0; 0, 1, 1, R)

expi

bi Pi =(

b, 0;

0, 1, 1, I )

exp

i

vi K i

= (0, 0; v, 1, 1, I ) (25)

exp(τ  H ) = (0, τ ; 0, 1, 1, R)

exp(s Q) = (0, 0; 0, a, 1, I )

exp(s0 Q0) = (0, 0; v, 1, a0, I )

where r  = i αi J i ∈ so(n), es = a ∈ R+\{0} is

the spatial dilation and es0 = a0 ∈ R+\{0} is the tem-

poral dilation. By matrix multiplication, we can check 

that

g = {b, τ, v, a, a0, R} ≡ E ( X )

= exp(b P) exp(τ  H ) exp(v K ) exp(s Q)

exp(s0 Q0) exp(r ) (26)

where Y  ∈ G3.

The attempt to construct continuous wavelets on

the af fine-Galilei group G3 = aff-Gal(n) fails in the

case n > 1 as a result of the divergence of square-

integrability. Fortunately, the af fine-Galilei group may

still be naturally extended with a central parameter φ.

By definition, this additional parameter is such that

its infinitesimal generator M  commutes with all theother generators of the af fine-Galilei algebra. This

extension, called a central extension, is not rooted

in the af fine group. This new property will allow

our construction to solve the problem of wavelet ex-

istence in the n-dimensional af fine-Galilei case. In

fact, a dimension-matching change of variables from

(a0, a, v) to (m, ω, k ) can now be applied to yield the

condition of admissibility (see Theorem 1 below and

Appendix 1). The central parameter φ is a phase on

the group; its dual m can be interpretated exactly as

the uncertainty parameter between position and veloc-

ity sharing a whole theoretical similarity with the un-certainty in Weyl-Heisenberg group (for instance the

construction of the harmonic oscillator).

The structure of the extended af fine-Galilei group,

referred to as G4, is a semi-direct product of the form

G = N S with N  = Rn+2, S = R

n[R∗

+ × R∗+ ×

S O(n)] where R∗+ means R+\{0}. A typical element,

 x ∈ N  is of the form  x = (φ, b, τ ; 0; 1, 1, I n ) and a

typical element s ∈ S is s = (0, 0, 0; v; a, a0, R).

The extended af fine-Galilei algebraG4 = {G3, M } is

defined by the infinitesimal generators as follows

[ M , Z ]=

0∀

 Z ∈G3 [K 

i, P

 j

]=

δi j

 M  [K , Z ]=

0

[K i , P j ] = δi j M  [ J i , P j ] = k i j Pk  [ J i , K  j ] = −k 

i j Pk 

[ H , K i ] = Pi [Q0, H ] = H  [Q0, K i ] = −K i

[Q0, M ] = − M  [Q, M ] = 2 M  [Q, Pi ] = Pi

[Q, K i ] = K i [ J i , J  j ] = k i j J k  (27)

Let us remark that the commutator [ H , K i ] = Pi

between time and position generate velocity in formb = vt  with an uncertainty generated by the com-

mutator [K i , P j ] = δi j M . This structure will be ex-

ploited below to generate the angular velocity from the

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 8/30

214 Leduc

angular position in whole similarity. All the other com-

mutators not mentioned in this collection are equal tozero. Then, this set of generators defines a Lie algebra.

The af fine-Galilei group G3 consists of all elements

of the form E ( X ) where X  ∈ G3. These elements are

g = {φ, b, τ ; v; a, a0, R} with φ the parameter of cen-

tral extension. The law of composition of the group can

be computed from the Lie algebra by exponentiating

the product of two elements X , X  ∈ G3 i.e. computing

g ◦g = E ( X ) E ( X ) ∈ G3 and repeatedly applying the

Baker-Campbell-Hausdorff formula [44]. An example

of how to treat this kind of computation is provided in

[33]. A matrix representation for the extended af fine-

Galilei group G4 is still available and reads

g = {b, τ, v, a, a0, R}

=

a2

a0vT  a

a0 R v2 1

2a0φ

0 a R v b0 0T  a0 τ 

0 0 0 1

(28)

and allows the computation of the associative law in

an easier way. The law of composition in the extended

af fine-Galilei group G4 is therefore given as

g ◦ g = φ + a2

a0

φ + vT  · vτ 2a0

+ aa0

 Rb,

b + a Rb + a0vτ , τ  + a0τ ;

v + aa−10 Rv, aa , aa

0, R R

(29)

and the inverse element as

g−1 =−a0

a2φ + a−2v ·

a0vτ 

2− b

,

− a−1 R−1(b − a0vτ ), −a−10 τ ;

−a0a−1 R−1v, a−1, a−10 , R−1 (30)

The left and right-invariant Haar measure of  G are

given by

d µl = an−10 a−(2n+3)d φ dm( R) d b d v d τ  da da0

(31)

and

d µr  = a−10 a−1d φ dm( R) d b d v d τ  da da0 (32)

We see that the group is not unimodular since the left

and right-invariant measures are not equal. In fact, it iseasy to see that the dilation parameters stretch neigh-

borhoods of the identity differently on the left and on

the right which causes unimodularity to fail.

The UIRs of  G4, that is the the extended af fine-

Galilei group, arise in L2(Rn+2, d nkd ωdm) using the

method of orbits and the induced representation tech-

nique in the extended spatio-temporal space of dual

variables ˆ X  = (m, k , ω). The variable ω stands for the

temporal frequency dual of the parameter τ . The UIRs

of  G4 read as

[T g](m, k , ω) = an+2

2 ei(mφ+b·k +τ ω)(m, k , ω)

(33)

with

m = a2

a0

m

k  = a R−1(k + mv) (34)

ω = a0

ω − mv2

2− v · k 

for ∈ L2( X , dm d kd ω). Let us remark that the factor

an+2

2 provides unitarity; it arises as a Radon-Nikodym

derivative which can be equivalently calculated fromeither the co-adjunct action or the normalizing factor.

The factor ei (mφ+b·k +τ ω) comes from the monomial rep-

resentation which induces the UIRs and plays the role

of characters. The variable m measures the Heisenberg

uncertainty between velocity and position. m is a non-

zero real constant whose effect canbe actually observed

in image sequences [31].

Theorem 1 . The UIRs of G 4 the extended af  fine-

Galilei group, in the space L2(Rn+2, dmd kd ω)

which are given by the mapping g → T g are square-

integrable. For a given non-zero

∈ L2(Rn+2, dm d 

d ω), the condition of square-integrability is equiva-

lent to the statement that the following two integrals be

 finite Rn+2

|(m, k , ω)|2 m[|k |2 + 2mω]2

dm d k d ω < +∞ (35)

and  Rn+2

|(m, k , ω)|2 dm d k d ω

(m)n [|k |2 + 2mω]3< +∞ (36)

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 9/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 215

This theorem is proved in Appendix 2. Eventually, a

section is performed in the dual spaceˆ

 X  = (m, ω, k )on m fixing uncertainty and on the parameter space on

a0 fixing the time scale as follows

m = m0 = 0 a0 = 1 (37)

This section addresses the applications in image se-

quence processing and fulfills the condition for wavelet

admissibility with a dimensional-matching change of 

variables from (a, v) to (ω, k ). Let us now apply on

G4 the section referred in Eq. (37) to define a group G5

that provides representations in L2(Rn+1, d nkd ω) with

n

=2 for image sequences. These UIRs are

T gm0

(k , ω) = a

n2 ei (b·k +τ ω)(k , ω) (38)

with

k  = a R−1(k + m0v)(39)

ω =

ω − m0v2

2− v · k 

Theorem 2 . The UIRs of G 5 (the group obtained 

by sectioning the extended af  fine-Galilei group) in

the space L2

(Rn

+1

, d n

kd ω) which are given by themapping g → T g are square-integrable. For a given

non-zero ∈ L2(Rn+1, d kd ω), the condition of 

square-integrability is equivalent to the statement that 

the following two integrals be finite

c= Rn+1

m0(k , ω)

2 I m0

(k , ω) d k d ω < +∞ (40)

where

 I m0(k , ω) =

 Rn+1 m0

(k , ω)

2

× [|k |2 + 2m0(ω − ω)]n−1

|k |2n mn−10

d k  d ω

< +∞ (41)

This demonstration theorem is sketched at the end

of Appendix 2 as a variant of Theorem 1. At this

stage, a comprehensive construction of Lie groups,

Lie algebras and associated continuous wavelets has

been completed for the description of translational mo-

tion in image sequences. Appendix 3 presents an al-

ternative way of computing the wavelet admissibility

through Calderon reproducing formula. With the tech-

nique developed so far and Appendixes 1–3, we arefully equipped to proceed to the main construction of 

this section, i.e., Lie groups that includes rotational

motion.

2.4. Groups for Rotational

and Translational Motion

This section proceeds one step further to extend the

af fine-Galilei group G5 to take into account rotational

motion. In this work, we focus on image process-

ing. Therefore, in the sequel, we set n = 2. The trans-

formation of rotational motion is described as fol-lows in R2 × R applied on a spatial function f [ x]:

R2 → R. We also suppose that the function f ( x , t ) is

C ∞ is compactly supported in the spacetime: f ( x , t ) ∈ L2(Rn ×R, d  xdt ). Let us apply the rotational transfor-

mation to the function f ( x , t ) that is characterized by

a spin around the origin at uniform angular velocity

θ1 ∈ R. Potential angular accelerations θn ∈ R; n > 2

can also be taken into account. The function f ( x) trans-

forms as

˜ f ( x, t ) = f [ R(φ) x, t ] (42)

φ ∈ R may be expanded into a temporal Taylor series

as

φ(t ) = θ0 + θ1t  +k =∞k =2

θk 

k !t k  (43)

where θ0 is the orientation in space. The construc-

tion of the Lie group, to be referred to as G6, for

rotational motion with angular position θ0 and uni-

form angular velocity θ1 requires a trick to provide

the correct law of composition with the property

to be associative, to fit within rotations as in ma-trix R ∈ SO(2) and to provide a physical law of 

composition for the angular coordinates in the form

θ0 + θ 0 + θ1τ  which is similar to the translational

version without scaling. The construction proceeds

from the af fine-Galilei group G3 = aff-GAL(n) in two

steps: a group extension with new parameters θ0

and θ1 different from R() followed by a section

that re-establishes the rotational nature of the new

parameters.

Therotational extension of theaf fine-Galileigroupis

denoted G6 = aff-ROT(2) is defined by ordered 7-tuple

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 10/30

216 Leduc

of elements, g, and the matrix representation

g = {b, τ ; v, θ0, θ1, R[], a}

=

1 0T  θ1 θ0

0 aR[] v b0 0 1 τ 

0 0 0 1

∈ (S L(5), R). (44)

where ∈ [0, 2π), and θ0, θ1 ∈ R. The associated Lie

algebra is given by

G6 = {P, H ; K ; J 0, J 1, J , S} (45)

where the infinitesimal generators are defined in therespective order of the elements in g. The additional

commutators of the Lie algebra G6 fulfill

[ J 1, H ] = J 0 [ J 0, J 1] = 0 [ H , J 0] = 0(46)

[P, H ] = 0 [ J 0, P1] = +P2[ J 0, P2] = −P1

where the commutator [ J 1, H ] = J 0 acts as the com-

mutator [K , H ] = P to generate the velocity as in the

Galilei group. The angular velocity is related to the an-

gular position according to the usual law θ0 = θ1τ . Ex-

ponentiation from this Lie algebra determines that the

elements in G6 = aff-ROT(2) compose in the followingmanner

g ◦ g ={b + aR[]b + vτ , τ  + τ ; v + aR[]v;

θ0+ θ 0 + θ1τ , θ1 + θ

1, R[ + ], aa }.

(47)

The inverse element reads

g−1 = {−a−1R[−](b − a0vτ ), −τ ; a−1R[−]v;

− θ0(1 − θ1τ ), −θ1, R[−], a−1} (48)

The group structure is a semi-direct product N S with N  = R

n ×R and S = R×R× S O(2)×R+∗ . After this

extension, a section on the group parameters space

= [θ0 + θ1τ ]mod 2π (49)

leads to the appropriate group of rotational motion. Let

us remark that this construction clearly differs from a

one-parameter subgroup since θ0, θ1 and τ  have their

own Lie generator. The one-parameter construction

would consist in generating a trajectory as function of 

a dummy variable t  out of one single parameter θ0.

A central extension can be defined on the af fine-

rotational group G6 =

aff-ROT(2) to generate an ex-

tended af fine-rotational group, referred to as G7 in thesequence. This extension is totally similar to that from

G3 = aff-GAL(n) to G4, the central extension of aff-

GAL(n). The Lie algebraG7 is given by elements of the

form G7 = { M , P, H ; K ; J 0, J 1, J , S}, and the group

elements G7 compose as

g ◦ g =

φ + a2

a0

φ + vT  · vτ 

2a0

+ a

a0

R[θ0 + θ1τ ]b

,

b + aR[θ0 + θ1τ ]b + vτ , τ + τ ; v + aR[θ0 + θ1τ ]v;

θ0 + θ 0 + θ1τ , θ1 + θ

1, R[θ0 + θ1τ + θ 0 + θ

1τ ], aa

.

(50)

The left and right-invariant Haar measures on G7 are

given by

d µl = an−10 a−(2n+3)d φ dm(θ0) dm(θ1) d b d v d τ  da

(51)

and

d µr  = a−10 a−1d φ dm (θ0) dm (θ1) d b d v d τ  da (52)

The group is not unimodular.

If we proceed with sections on the extended af fine-

rotational group G7 that are similar to those described

in Eqs. (37) and (49), we get the group G8 with UIRs

in L2(R2 × R, d kd ω) expressed asT (g)m0

(k , ω) = an/2ei [ R−1[θ1τ ]b·k +ωτ ]m0

(k , ω)

n = 2 for image sequence (53)

where k  and ω represent the same group actions

as those computed in Eq. (39). As rotations are of 

concern, it is natural to rewrite these IURs in po-lar coordinates. In this transformation, we denote

= ωθ1

, w = −θ1τ , k  = (k , κ), b = (r , β), α = β − κ

and χ − π2

= w − α, successively. We further let v =0 and m0 = 0, to get

[T (g)](k , κ , ) = aθ1ei (α− π2

)ei [χ+kr  sin χ ]

× (ak , κ − θ0, θ1) (54)

with the polar decomposition b = (r , β), k  = (k , κ).

The character ei [ R−1(θ1τ )b·k +ωτ ] of the UIRs in Eq. (53)

introduces a special function derived by integration on

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 11/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 217

τ . In this case, we reach the following form

 J (k ) = 1

 2π

0

ei [u+k sin u]du (55)

which is not a Bessel function except for ∈ Z. In-

deed, the Bessel function has an analytic extension for

n ∈ C [19, 22, 25, 45] given by

 Z n( z) = 1

 +π

−π

ei (nθ− z sin θ)d θ

− sin nπ

π

 +∞

0

e(−nt − z sinh t ) dt .

For n ∈ Z, J n ( z) coincides to Z n . The complexificationof u → i y in Eq. (55) gives rise to hyperbolic rotations

and the special function

 H (k ) = i

 +∞

0

e−( y+k sinh y) d y (56)

A theorem of additivity for these special functions can

be deduced from the composition of the translations.

In this case, it reads after some computations

 +∞

−∞ J [1−l](kr 1) J [l−2](kr 2)dl

=J [1−2][k (r 1

+r 2)]

(57)

The special functions defined in Eq. (55) further lead to

integral transforms where the special function is taken

as kernel; the first example is

[ H  f ](k ) = ∞

0

 f (r ) J (k r ) rdr n = 2 (58)

Further properties involving those special functions

and integral transforms will be considered in Section 3.

Let us first formally suppose that [aR−1

(θ1τ )k , ω] = [aR(−θ1τ )k , ω] = −1θ1 [F ](k ). Bysimilar arguments as those developed for the proof of 

Theorem 2 in Appendix 2, Eq. (127), we reduce the

condition of square-integrability to showing that there

is some non-zero ∈ L2(R× T, d 2  xdt ) such that R4

1

θ1

F m0

(k )

2da d v dm(θ1)

a3< +∞ (59)

Let us remark that the integration on dm (θ1) requires

that the limit of the integrand be zero when θ1 → 0.

This limit corresponds to → ∞. This requires that

F m0= O(|θ1|1+ ) be of compact support on θ1 to

avoid the integration in Eq. (59) to diverge. This state-ment remains a formal wish. The condition to achieve

convergence [39] is reached if we consider the con-

vergence of an (inner) product of  F  with a compact

supported function. This leads to a weak topology of 

convergenceand reconstruction and therefore to a weak 

definition of continuous wavelet transforms.

Theorem 3 . The UIRs of G8 in the space

 L2(R2+1, d 2kd ω) which are given by the mapping g →T g are square-integrable. The condition of square-

integrability requires that the following integral be

 finite

c = Rn+1

F m0

(k )

2 I m0

(k , )d k d  < +∞(60)

where

 I m0(k , ) =

 Rn+1

F m0

(k )

2

×

[|k |2 + 2m0( − ]n−1

|k |2nmn−10

d k d  < +∞ (61)

This demonstration theorem is as sketched in

Appendix 1 as a variant of Theorem 2. A similar dis-

cussion can be conducted for hyperbolic rotations and

the related wavelets. In this case, the convergence of 

the integral is neatly obtained through the negative real

exponential function.

2.5. Further Extensions to New Kinematics

Two avenues for further extensions and sections on the

af fine-Galilei group have been opened in this paper.

These potentialities demonstrate the general founda-tion of the approach developed in this paper.

The first direction concerns all the variant of exten-

sions with the triple [R(), θ0, θ1; R ∈ S O(n)] defined

in Eq. (44) where the matrix R is a matrix of spatial

transformation, θ0 and θ1 are destined to correspond

to the 0th and 1st order coef ficient of the transforma-

tion after the appropriate section. The matrix R which

has been considered as the group S O(2) can be re-

placed by another group of spatial transformation. For

instance, let us first mention the complexification of 

in R() ∈ S O(2) which leads to hyperbolic rotations

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 12/30

218 Leduc

asdefinedin Section 1. A second example is to consider

a deformation matrix of the form A 0

0 A

(62)

and the section A = a0 +a1τ  which describes a scaling

action with temporal evolution. A third example is to

take the matrix of shear of the form1 S

0 1

(63)

andthe section S = s0+s1τ . Eachcase ofstudy leads toits own group representation, special functions related

to the characters, a specific harmonic analysis with

PDE’s and ODE’s, and a complete discussion about

the existence of continuous wavelets suited for image

sequence processing.

The second path for extensions is to add columns in

thematrix of Eq.(44) to introducefurther ordersof time

derivative i.e. the angular accelerations θm , associated

with the translational acceleration γ m , and the temporal

translations of higher order τ m ; m > 1. For instance,

the first acceleration will yield the following matrix

representation

g = {b, τ , τ  2; v, γ 1, θ0, θ1, R[], a, a0}

=

1 0T  θ2 θ1 θ0

0 aR[] γ 2 v b0 0 1 0 τ 

0 0 2τ  1 τ 2

0 0 0 0 1

∈ S L(n + 4), R).

(64)

Rigorously, according to the extension technique that

has been developed, the parameter τ n; n > 1 shouldbe thought first as an independent parameter η which

is sectioned afterwards as η = τ n where τ  is the usual

temporal translation. Once again, each additional or-

der of time derivative leads to its own group represen-

tation, special functions related to the characters, the

associated harmonic analysis for PDE’s and ODE’s,

and, again, a complete discussion about the existence

of continuous wavelets for image sequence process-

ing. Moreover, the first and the second paths can be

combined one with the other in a similar discussion.

Our technique of construction reaches in this manner a

complete description of all the observable kinematics

in the Euclidean spacetime.

3. Special Functions and Symmetries

To get more insight on the special functions related to

motion, let us revisit the Fourier transform of a func-

tion ˜ f ( x, t ),  x ∈ Rn rotating with the angular velocity

θ1 in a two-dimensional plane. If we first consider the

group representation in Eq. (53) with v = 0, a = 1,

a0 = 1, θ0 = 0 and extend the functions to distribu-

tions to take the function as a Dirac measure along a

trajectory from time t  = 0 to t  = 1, the integration on

the character leads to the special function in Eq. (55).Let us further assume without loss of generality

that the functions are separable in terms of magnitude

and orientation i.e. f ( x, t ) = f r (r , t ) f s ( x u , t ) where we

consider the polarcoordinates inRn ·r  = | x| isthe mag-

nitude in Rn and  x u ∈ Sn−1 belongs to the unit sphere

in Rn, Sn−1 = { x u ∈ Rn : | x u| = 1}. We then observe

that

ˆ f (k , ω) = Rn×T

dt d n  x f [ R(θ1t ) x]e−i (k · x+ωt )

=  Rn×Tdt d n

 x f (

 x ) e−i [ R(θ1t )k ·  x +ωt ]

ˆ f (k , k u , ω) = R

∗+×Sn−1×Tdr d σ ( x

u ) dt r n−1  f r (r )

× f s ( x u ) e−i [kr R(θ1t )k u ·  x

u+ωt ]

Sn−1

d σ ( x u ) f s ( x

u )

 +∞

0

dr r n−1  f r (r )

× 1

θ1

 2π

0

du e−i

( ω

θ1)u+kr R(u)k u ·  x

u

ˆ f (k , k u , ) = 1

θ1

 Sn−1

d σ ( x u ) f s ( x

u )

 +∞

0

dr r n−1

× f r (r ) J (kr 

k u

·  x

u

)

= 1

θ1

 Sn−1

d σ ( x u ) f s ( x

u ) H [ f r , k  k u ·  x u ]

= 1

θ1

F [ f s , f r ; k  k u ] (65)

where d σ  is the Lebesgue measure on the sphere Sn−1.

In this calculation, we have successively applied a

change of variable  x = R(θ1t ) x i.e.  x = R(θ1t )T   x , achange from CartesianRn ×T to general polar coordi-

nates Sn−1 ×T in the space domain. The spatial Fourier

domain is changed to polar coordinates with k  ∈ R+

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 13/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 219

and k u ∈ Rn, |k u| = 1. We also let = ωθ1

. Then, anin-

tegration is taken on u that generates special functionsof real index J . The integration on variable r  modified

the Fourier transform into an integral transform H . In

turn, this transform becomes the kernel of an integra-

tion on the sphere Sn−1. Clearly, f ( x , t ) ∈ C ∞c (Rn ×T)

is compactly supported by assumption and we have

F [ f s , f r ; k ]

≤ 2π n/2

(n/2)sup

 x u∈Sn−1

 f s ( x u ) H [ f r , k  ·  x

u ] < +∞ (66)

where 2π n/2

(n/2)

=µ(Sn−1). The construction of ODE’s

and PDE’s as equations of the wavelet motion is anadditional topic related to the group representation.

Reference [27] presents one way to derive and com-

pute those equations that play an important role for

motion tracking.

The derivation of new motion-based special func-

tions as substitute of the Fourier kernel requires to

revisit the sampling theorem. It is clear indeed that

the sampling of rotational motion [22] requires to state

some new remarks related to symmetries. Without any

particular symmetry, the critical sampling is obtained

at ω = π i.e. θ1 = π rad/image. At this rate the

object is orbiting at one half-round turn per consec-utive image. If the object is shaped with one or several

axes of symmetry, then the finite group of symmetries

[43] brings its characters on the functions f ( x, t ), J and H  and involutions that reduce the periodicity at

sampling. One may easily verify that the first com-

ponent of the expansion of the spectrum along the

ω-axis is located at 2mθ1 with m axes of symmetry.

In the case of a square, the integration in Eq. (65) is

performed from −π4

to +π4

. The critical sampling cor-

responds to an angular velocity of  θ1 = π4

rad/image.

This reaches the Shannon sampling bound. Similarly,

a spinning 2m-gons reach the bound at π

2m

rad/image.

If  m tends to ∞, the polygon tends to a circle whose

shape is rotational invariant. Hence, any angular ve-

locity is potentially admissible and motion becomes

ambiguous.

4. Rotational Motion and Harmonic Oscillator

It is instructive to examine how the rotational mo-

tion is intimately connected with the harmonic oscilla-

tor [46, 47], the groups SU (2) and S L(2,C). In fact,

the existence of an harmonic oscillator may be evi-

denced in the extended Galilei group when consid-

ering its Lie algebra restricted to position, velocityand central extension. Simple analytic computations

lead then to an analysis which is step by step similar

to the classic theory developed for the harmonic os-

cillator in the context of the Weyl-Heisenberg group

[7]. Numerous Lie groups lead to harmonic oscillators

[46, 47]. In the particular case of performing rotational

motion analysis with angular parameters defined on

the real line R, we show from the Hamiltonian that

SU (2) is appropriate to describe the spinning or or-

biting in a plane around the orthogonal axis. SU (2)

is locally isomorphic to the group S O(3) of the ro-

tations in three-dimensional space (Euler angles not

motion). In fact, both algebras su (2) and so(3) are iso-morphic but the group S O(3) is the quotient of  SU (2)

by its center Z 2 = { I , − I } i.e. S O(3) ≡ SU (2)/ Z 2.

SU (2) is the group of the 2 × 2 unimodular, unitary

matrices i.e.

g =

a b

−b a

with |a|2 + |b|2 = 1 (67)

SU (2) is a three-parameter group, a UIR is given below

in Eq. (75).

Let us consider the Hamiltonian of the one-

dimensional harmonic oscillator [3]

 H  = p2

2m+ 1

2m θ 2

1 q2 (68)

where θ1 =√ k /m, k > 0 is usually known as the

spring constant, m is the mass of the system, and p

and q are momentum and position respectively. This

Hamiltonian gives rise to the equation of motion i.e.

the ODE for the position of the system, q , which

reads

q

+θ 2

1

q

=0 (69)

In the phase space of coordinates (q, p), classi-

cal mechanics shows how the time evolution op-

erator can be obtained from the Poisson brackets

[3]. The standard theory [3] in n dimensions fur-

nishes the correspondence between smooth functions

 A(  p, q) of   p and q and the differential operator as

follows:

 A →  A =n

i=1

∂ A

∂ pi

∂qi

− ∂ A

∂qi

∂ pi

(70)

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 14/30

220 Leduc

In this case, the evolution operator  H  related to the

Hamiltonian H  in Eq. (68) reads

= −i 2θ1 J 2 with J 2 = −i

 x

∂ p− p

∂ x

2.

(71)

Let us restate the dual space as a two-dimensional com-

plex plane ( z1, z2) = (q, p) and define the operators

 X i j = zi ( ∂∂ zi

) with i, j ∈ (1, 2). Hence, the operators

defined by the following relations

 J 1 = ( X 12 + X 21)/2; J 2 = −( X 12 − X 21)/2;

 J 3 = ( X 11 − X 22)/2 (72)

i.e. the standard commutation relations read [ J i J  j ] =i jk  J k , with i jk  the anti-symmetric tensor. The above

Lie algebra generated by J i ; i = 1, 2, 3 is the algebra

of so(3). However, since S O(3) and SU (2) are locally

isomorphic about the identity, we immediately see that

 J i ; i = 1, 2, 3 istheLiealgebraof SU (2). This is easily

seen if the J i are re-written in terms of matrices

 J 1 = i

2

0 1

1 0

, J 2 = 1

2

0 1

1 0

, J 3 = i

2

1 0

0 −1

(73)

Let us consider the one-parameter subgroup of 

SU (2) generated by the flow of the infinitesimal gen-

erator J 3 to represent the rotation about the z-axis or-

thogonal to the sensor plane x– y. The exponential map

yields the sub-group G[3,su (2)] ⊂ SU (2) generated by

 J 3 as the set of matrices

exp[i θ1 J 3] =

eiθ1 0

0 e−i θ1

(74)

Hence, the basic harmonic oscillator of interest isa group G[3,SU (2)] generated by J 3 as being the set

{eit J 3 | − ∞ < t  < +∞}.

The next problem is to find the appropriate UIRs of 

SU (2) in L2(C×R, d µ). The group SU (2) is a subset

of  S L(2,C) which is the group of the 2 × 2 matrices

g =

α γ 

β δ

∈ S L(2,C)

i.e. with det = 1 and α , β , γ , δ ∈C. The UIRs of 

S L(2,C) are indexed by pairs (k , i v) with k  ∈ Z and

v ∈ R. The representations in L2(C× R, d µ) is given

by [24]

[T g]( z, t ) = |−β z + δ|−2−iv

−β z + δ

|−β z + δ|−k 

×

α z − γ 

−β z + δ, t 

(75)

with z ∈ C. SU (2) is part of the bilinear transforma-

tion thatdescribesthe stereographic projectionof three-

dimensional rotations in the two-dimensional plane. If 

we let α = e j φ , δ = e− jφ , β = γ  = 0, we effec-

tively yield the UIRs of  G[3,SU (2)] in L2(C × R, d µ).

As a compact group, L2[SU (2)] possesses a countable

orthonormal basis according to Peter-Weyl theorem

[9] made of Bessel functions generated by the char-

acters. Let us remark that the bilinear transformations

in Eq. (75) can be built as self-maps of the com-

plex disk (i.e. a Mobius transformation with a rota-

tion). This link leads to considering Bergman spaces

of complex functions in a spacetime approach. We al-

ready know the existence of continuous wavelets in

these spaces. The harmonic oscillator generalizes in

n-dimensions, n > 2, by taking m ≤ n independent

copies of the preceding version. For example, let us

consider n

=3 involving three orthogonal axes of ro-

tation: Gt  = SU (2) × SU (2) × SU (2). The functionspace of these oscillators is the tensor product of the

original space

V n =n

⊗i = 1

V .

The resulting group is still compact and corresponds to

the direct group product

Gt  =n

×i = 1

SU (2).

In fact, this mathematical structure corresponds to

the usual addition of angular momenta. The group

representation is the product of the characters of 

the different SU (2)’s. Moreover, these multidimen-

sional isotropic harmonic oscillators seem to be rich

in structure since there exist many distinct complete

admissible sets of commuting/non-commuting oper-

ators whose eigenvectors span the tensor product

space.

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 15/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 221

5. Tracking Rotational Motion

It has been shown in [30, 31] that the Galilean wavelets

perform MMSE motion estimations. This property es-

sential to track the velocity along a trajectory. The same

propertieshold for accelerated waveletson acceleration

parameters under the condition that thevelocity param-

eter be fixed i.e. be previously estimated [27]. In this

approach, translational motion estimation starts with

the spatio-temporal location (i.e. the spacetime trans-

lation parameters in the af fine wavelets) and proceeds

with the velocity (Galilean wavelets). On enough small

spatio-temporal neighborhoods, motion is assumed to

be linear and Galilean wavelets are always appropriate.

The estimation process proceeds with the estimation of the acceleration parameters (accelerated wavelets) on

a larger span of scene. This leads to the construction of 

optimal trajectories that can be buit with algorithms

derived from dynamic programming and Bellman’s

principle of optimality (Viterbi algorithms). The as-

pects of this construction dealing with Lagrangians

and dynamic programming have already been exam-

ined in [31]. In this section, we develop the specific

part that performs the separate tracking of the rotational

motion.

The technique developed in this section is based on

Kalman filters, an alternative point of view of Lie alge-bra, and rotational continuous wavelet transforms. The

Kalman filter is used as a recursive minimum variance

estimator which introduces an alternative approach to

the formulation and solution of linear MMSE estima-

tion problems. This alternative is particularly useful to

deal with non-stationary processes and to approach the

estimation of dynamic motion problems. We adopt a

structure of Lie algebras in forms of a set of differen-

tial operators that describe the motion. These opera-

tors are derived from the equation of motion i.e. the

equation that relates the kinematical parameters of po-

sition, velocity and accelerations. In this application,

the motion equation superposes rotational motion on a

translational carrier trajectory.

The Kalman filter is based on twoequations, thestate

equation and the observation equation, along with an

optimization algorithm. The state equation is a linear

predictor which provides a prediction of the state of 

the sytem at time t  + τ  from the state of the sytem at

time t . The state q of the system is composed of all the

relevant motion parameters that exhaustively explain

the local behavior on the trajectory. These parameters

under study are known to be position, velocity, and ac-

celerations for translational and rotational motion. As

a matter of fact, the infinitesimal local evolution of thesystem is linear and described by d qdt 

. Expanding the

total derivative into its partial derivatives associated to

the equation of motion leads to a set of differential op-

erators whose closure defines a Lie algebra. The state

equation can be seen as a one-parameter sub-group cal-

culated from the Lie algebra which provides the lo-

cal transformation in terms of an evolution operator.

At each step of this prediction, an optimization takes

place after the prediction to optimally estimate the ac-

tual parameters. The difference between predicted and

estimated parameters provides the innovation of the

system. This step is implemented with either gradient

or dynamic programming algorithms. The observationequation may have two implementations. It is either

a convolutional filtering of the image sequence with

continuous wavelets tuned to the optimum parame-

ters or a frame-based reconstruction technique based

on the inverse wavelet transform (see Appendix 3).

The former technique selectively captures and extracts

the moving pattern of interest moving along its tra-

 jectory in form of an image sequence. The later tech-

nique reconstructs a motion compensated sequence

where motion has been frozen or cancelled. or a recon-

struction out of the inverse wavelet transform. Partial

selective reconstruction is achieved from the wavelettransform that performs a motion-selective band-pass

filtering on the entire scene. The wavelet family is

generated by the action of a group representation

that describes the global motion transformation under

estimation.

5.1. State Equation and Lie Algebras

Let us consider the infinitesimal transformation of the

Lie algebra given by

q = d qdt  = A q (76)

where A is the matrix representation of a Lie algebra

of differential operators and q is the state vector of 

the system. Some examples of matrix A are computed

below in this section and in Appendix 4. One can also

see that the state equation that updates the state of the

Kalman filter is a one-parameter subgroup obtained

by exponentiation of operators in the Lie algebra. The

algebra is of  finite dimension, the operator t  of the

state space equation is the matrix A in Eq. (76) and is

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 16/30

222 Leduc

defined as

q(t  + τ ) = eτ t q(t ) = eτ AT  q(t ) (77)

The goal is now to build the Lie algebras, define the

states and construct the representation A from given

equation of motion.

The trajectories can be described in terms of Taylor

expansions. The coef ficients of the expansions are the

parameters of motion. Let x(t  + τ ) be the position at

time t  + τ , the trajectory can be expressed as

 x(t  + τ ) =∞

=0

τ k 

k ! d k  x(τ )

d τ k  τ 

=t 

(78)

In this method, we also assume to know how many

orders in the expansion are relevant to describe the lo-

cal motion transformation. Let us remark that the mo-

tion parameter estimation performed by the continuous

wavelets enables the determination of how many rele-

vant parameters exhaust the expansion [27]. Newton’s

equation of classical dynamics limits the expansion to

the first-order of acceleration γ 1. This is no longer true

for motion taking place within two-dimensional signal

generated from the projection onto the sensor plane.

The expansion may need higher orders of acceleration.

These aspects are treated in [28]. Hence, the equationof motion captured in the camera can be stated as

γ n (t ) = F [ x (t ), v(t ), γ 1(t ), . . . , γ  n−1(t ); t ] (79)

where v(t ) = dxdt 

, γ 1(t ) = d vdt 

, and γ n−1(t ) = d γ n−2

dt .

From Eqs. (77) and (78), it becomes possible to char-

acterize the differential operator as an infinitesimal

generator that produces the evolution operator

eτ t  =∞

k =0

τ k 

k !

t  (80)

and the operator t  is clearly a time differential op-erator whose expansion into the partial derivatives is

calculated from the equation of motion (79)

t  = d 

dt 

= v(t )∂

∂ x+ γ 1(t )

∂v+ · · · + γ n (t )

∂γ n+1

+ ∂

∂t 

(81)

It is now possible to break  t  into a sum of elemen-

tary differential operators and to derive a Lie algebra.

Since any Lie algebra is closed under the Lie multi-

plication, new generators arise to yield the algebraicclosure.

By Ado’s theorem [5], Lie algebras have matrix rep-

resentations in gl(n,R) meaning that it exists a homo-

morphism between any Lie algebra and the matrices

A of  n × n dimension. The matrix A of the evo-

lution operator is a representation of the differen-

tial operator t  defined in the algebra gl(n,R). Let

us now consider two examples of equation of mo-

tion where a harmonic oscillator is superposed on

a carrier trajectory F 1[ x(t ), v(t ); t ] and F 2[ x(t ), v(t ),

γ 1(t ); t ]

F 1 : γ 1(t ) = a1 x(t ) + a2v(t ) + b1 cos(θ1t ) (82)

F 2 : γ 2(t ) = a1 x(t ) + a2v(t ) + a3γ 1(t )

+ b1 cos(θ1t ) + b2 cos

θ2

2t 2

(83)

These examples are thoroughly treated in Appendix 4.

As an illustration of how to proceed, the appendix

presents the corresponding operators t , the infinites-

imal Lie generators X i j involved in t . The closure

of the Lie algebra of operator t  is calculated under

the Lie multiplication. We adopt the operator nota-

tion X i j = qi∂

∂q j. The new closure operators are de-

rived from visiting all the commutation relations in the

Jacobi equations. The non-zero commutators are even-

tually presented in Appendix 4 respectively for tra-

 jectory F 1 and F 2. Interesting cyclic properties of the

Lie multiplication can be evidenced in both cases as

a result of the derivation properties: [ X i j , X  jk ] = X ik 

and [ X i j , X kl ] = 0 for any {i j} = {kl}. As a further

consequence of cyclicity, all the Jacobi equations are

also satisfied. Finally, the matrix A is defined in both

cases F 1 and F 2 and belong respectively to gl (4,R) and

gl (7,R). The corresponding Lie groups are GL(4,R)

and G L(7,R).Let us remark that there is no actual obstacle to con-

sider multidimensional spaces, this just requests an in-

crease of size of the Lie algebra. The differential oper-

ator in Eq. (81) reads now

t  = v · ∇ x + γ 1 · ∇v +· · ·+ γ n · ∇γ n+1+ ∂

∂t (84)

and both equations of trajectory 78 and of motion 79

become vector equations.

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 17/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 223

5.2. Diagonalization and Reducibility

of the State Equation

In this section, we showthe reducibility of the Lie alge-

bra representations presented in the previous section.

It turns out that the representations are reducible into

subspaces one for the carrier trajectory and one for

each rotational parameter. It would be interesting to ex-

amine this property with more details since it enables

splitting estimation and tracking into several dedicated

parts. The splitting results from diagonalization and

reducibility as follows:

1. The diagonalization of matrix A. The matrix sup-

ports a (n + m)-dimensional vector space made of n + m eigen-values and eigen-vectors. This means

that AT  = P−1ΛP whereΛ = diag [λ1, . . . , λn+m ].

It is also clear that diagonalizing matrix A leads to

diagonalizing the state equation eτ AT  = P−1eτ ΛP

2. The matrix representation AT  may be written in

forms of 

AT  =

A1,1 A2,1 A3,1 . . . Am+1,1

0 A2,2 0 . . . 0

0 0 A3,3 . . . 0

0 0 0 . . . Am+1,m+1

.

where A1,1 is a n ×n matrix, A2,1, A3,1, . . . , Am+1,1are 2 × n matrices, A2,2, A3,3, . . . , Am+1,m+1 are

2 × 2 matrices. The matrix AT  is reducible into

m + 1 complementary closed sub-spaces. The first

subspace is of dimension n and corresponds to the

parameters of the carrier trajectory  x , v, γ i ; i =1, . . . , m − 2. The others are of dimension 2 and

correspond to rotational motion. The structure of re-

ducibility in the representation provides the motion

analysis with a hierarchical structure of estimation

and tracking. This approach splits the carrier trajec-

tory from its rotational motions (velocity and ac-

celerations). In the following, we will consider the

expansion up to rotational acceleration of order 2.

As a consequence of items 1 and 2, we can decom-

pose the matrix P in Q and R as follows

AT  = (QR)−1Λ QR with Q =

U 0 0

0 V 0

0 0 W

;

R =

In C1 C2

0 I2 0

0 0 I2

(85)

where In is the n-dimensional unit matrix. We let P =QR and P−

1

= R−1

Q−1

, then

P =

U UC1 UC2

0 V 0

0 0 W

,

P−1 = U−1 −C1V−1 −C2W−1

0 V−1 0

0 0 W−1

,

Λ =

Λ1 0 0

0 Λ2 0

0 0Λ

3

. (86)

Matrix U contains n eigen-vectors of the sub-matrix

A11 since A11 = U−1Λ1U, Λ1 = diag [λ1, . . . ,λn ].

Matrix V contains two eigen-vectors, those of 

sub-matrix A2,2 since A2,2 = V−1Λ2V, with Λ2 =

diag [λn+1, λn+2], λn+1 = i θ1, λn+2 =−i θ1, and

V = 1√ 2

1 i

1 −i

.

Similarly, matrix W contains two eigen-vectors, those

of sub-matrix A3,3 since A3,3

=W

−1Λ3W,

Λ3 = diag [λn+3, λn+4], λn+1 = i θ2/2, λn+2 = −i θ2/2.

Let the state equation of the system be given by

u(t ) =

 x (t ), v(t ), γ 1(t ), cos[θ1t ], sin[θ1t ],

cos

θ2

t 2

2

, sin

θ2

t 2

2

.

The evolution is given by the prediction equation

u(t 

+τ ) = eτ t u(t ) = eτ A

u(t ). We have also

u(t + τ ) =

 x(t  + τ ), v(t + τ ), γ 1(t + τ ),

cos [θ1(t  + τ )], sin[θ1(t + τ )],

cos

θ2

(t  + τ )2

2

, sin

θ2

(t + τ )2

2

.

As a result of the diagonalization of matrix eτ AT 

,

we yield an interesting closed form of the prediction

equation that splits carrier trajectory from rotational

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 18/30

224 Leduc

motion. The derivation of the one-parameter subgroup

expression with i = e

τ Λi

; i = 1, 2, 3 and 4 = e

τ 2Λ3

leads to three relations  x(t + τ )

γ 1(t + τ )

v(t  + τ )

= (U−11U)

 x (t )

γ 1(t )

v(t )

+ [(U−11U)C1 − C1(V−12V)]

cos[θ1t ]

sin[θ1t ]

+ [(U−11U)C2 − C2(W−13W)]

cos

θ2

t 2

2

sin

θ2

t 2

2

(87)

and alsocos[θ1(t + τ )]

sin[θ1(t + τ )]

= (V−1

Λ2V)

cos[θ1t ]

sin[θ1t ]

cos

θ2(t +τ )2

2

sin

θ2

(t +τ )2

2

= (W−13W)(W−14W) (88)

×

cos

θ2t 2

2

sin

θ2

t 2

2

For quite evident reasons described in [27], the restora-

tion of the double product in (t  + τ )2 comes from acontribution of the exponent of the first order in τ .

The tracking strategy is based on combining both

Kalman filters and wavelet transform. The state of the

system defines the state of the Kalman filter. This state

is given by the set of the wavelet parameters. These

parameters defined in Sections 2.3 and 2.4 are nothing

but the group parameters. Without any major change

in the reasoning, the scale parameter can be added in

the state vector of Eq. (77). A whole tracking algorithm

is described in [31] that exploits the wavelet transform

as state parameter estimator and the Bellman theory

of dynamic programming to build the trajectory on the

span of the scene.

5.3. Observation Equation and Wavelet Transform

The estimation of the motion parameters i.e. the group

elements, and the motion-based feature extraction and

reconstruction are based on two concepts: a variational

principle that provides an optimal estimation of motion

and a motion-based filtering that extracts the pattern

with motion of interest. These processes are part of 

the Kalman filter and are iteratively performed along

a trajectory. At step 0, all the inital conditions i.e. the

motion parameters are provided by an external device(RADAR or satellite). This allows the Kalman filter to

start computing.

The observation equation is based on the wavelet

transform where the optimum wavelet T gopt( x, t ) per-

forms the motion-based extraction of the object in mo-

tion. gopt corresponds to the state parameters at step n,

it is estimated by a gradient algorithm in L2(G, d µl (g))

to yield

gopt = argg

max |g | S|2 (89)

or by a dynamic programming approach [31]. The

wavelet gopt tuned to the estimated state parametersact as a motion-oriented band-pass filter. The contin-

uous wavelet transform discretized on the grid of the

signal captures and isolates the selected objects from

the scene S to provide a display I ,

 I (b, τ ) = gopt

S + V . (90)

 I  is the segmented image of the selected object, dis-

played alone at its correct location; S is the original sig-

nal under analysis,and V (b, τ ) isthe noise producedby

the optical sensors. The estimation of state parameters

in the next section is performed with Morlet wavelets.

An alternative way of reconstructing a relevant in-

formation from the inverse wavelet transform consists

of generating a motion-compensated sequence S( x, t )

S( x , t ) = 

G

S | T g(T g)( x, t ) d µl (g) (91)

Appendix 3 shows how this technique compensates the

motion to produce a frozen object.

6. Applications and Simulation Results

The applications presented in this paper are based on

Morlet wavelets. An anisotropic Morlet wavelet is ad-

missible as an continuous wavelet in the rotational and

translational family. In this case, the wavelet is struc-

turally a non-separable filter meaning that it can not be

completely factorized in terms of thespatial andtempo-

ral variable. The numerical computation is performed

in the Fourier domain. The Morlet wavelet reads in the

Fourier domain

(k) = |detC |1/2

e− 12(k−k0) | C (k−k0) − e− 1

2k0 | C k0

×e− 12k | C k

(92)

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 19/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 225

i.e. a Gaussian function shifted to the point of coordi-

nates k0 = (k 0, ω0). Moreover, k = (k , ω) ∈R

2

×R

andC is a positive-definite matrix. For two-dimensional

spatio-temporal signals, we haveC =

k  x 0 0

0 k  y 0

0 0 ω

where the factors introduce anisotropy in the

wavelet shape. Figures 1–3 presents three configura-

tions of four-symmetrical rotational Morlet wavelets.

TheShannon sampling bound is at π4

rad/image. The in-

terested reader should read [26, 31, 35] to compare thespectrum of the Galilean wavelets in G4 and compare

to the spectrum of pure rotational motion presented in

these figures.

Figure4 presentsthe sequencecalled “Caltrain” with

a ball simultaneously in translation and rotation along

a track. Detection and estimation of the angular ve-

locity and acceleration is made possible by the texture

on the rotating ball made of four white dots acting as

the corner of a square in rotation. Figure 4 presents

the sequence at images 1 and 32. The scene to be

analyzed is made of 32 images, each of 256 × 256

−4

−2

0

2

4

−4

−2

0

2

40

2

4

6

8

10

12

14

16

18

omega (temporal frequency)

SPECTRUM OF ROTATIONAL WAVELET

k1 (horizontal frequency)

Figure 1. Four symmetrical rotational Morlet wavelet functions close to θ1t  = (π/4)t , and v = (0, 0) pix/image: square modulus in plane of 

the (ω, k  x ) axes i.e. k  y = 0. This yields critical temporal sampling.

pixels. The ball is traveling from right to left; the cen-

ter is located at x ≈ 150 in image 1 and at x ≈ 95 inimage 32.

Figure 5 presents the global analysis of velocity per-

formed with Galilean wavelets from group G4 ina win-

dow B of size 60 × 60 centered on the ball at image

18. The square modulus of the wavelet transform is

computed on the window as a function of  v x , v y

 f (v x , v y ) =

b∈B,τ =18

g1

S2

g20, with

g1 = {v, θ0, a, b, τ }, g20 = {a = a0, θ0 = θ00}(93)

provides the analysis with a representation of the lo-

cal spatio-temporal content in terms of its velocity

content. Figure 6 presents the estimation of the mean

angular velocityand thescaleof theball at velocitywith

rotational wavelet tuned to velocity v = (−1.7, 0.1).

Figure 7 proceeds to the estimation of the angular ac-

celeration, the measurement shows a deceleration of 

−0.0028 rad/image2. Figure 8 presents the tracking

of the ball in the scene and the carrier trajectory. The

algorithm exploits the Galilean wavelets from group

G4. The square modulus of the wavelet transform is

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 20/30

226 Leduc

−3 −2 −1 0 1 2 3

−3

−2

−1

0

1

2

3

SPECTRUM CONTOUR OF ROTATIONAL WAVELET

   k   2   (  v  e  r   t   i  c  a   l   f  r  e  q  u  e  n  c  y   )

omega (temporal frequency)

Figure 2. Four symmetrical rotational Morlet wavelet function at θ1t  = (π/10)t , and v = (0, 0) pix/image: contours of the square modulus

in plane of the (ω, k  y ) axes i.e. k  y = 0. This yields 4 × π/10 on the temporal frequency axis. The Fourier signature of this rotational motion

is a ball of energy located on the frequency axis. The Fourier signature of a translational motion is located on a so-called velocity plane. As

described in [26, 31], this plane is orthogonal to the velocity vector v = (v, 1).

−3 −2 −1 0 1 2 3

−3

−2

−1

0

1

2

3

SPECTRUM CONTOUR OF ROTATIONAL WAVELET

   k   1   (   h  o  r   i  z  o  n   t  a   l   f  r  e  q  u  e  n  c  y   )

omega (temporal frequency)

Figure 3. Four symmetrical rotational Morlet wavelet functions at θ1t  = (π/8)t , and v = (1, 0) pix/image: square modulus in plane of the

(ω, k  x ) axes i.e. k  y = 0. In this sketch of the energy, translational motion and rotational motion compose each to the other. The Fourier signature

is two distinct components. One is odd in the velocity plane around the origin and the other is even on the temporal frequency axis tilded by the

velocity. Each signature may be estimated independently of the other.

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 21/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 227

Figure 4. Image 1 and 32 in the Caltrain sequence ([256× 256] × 32 images): motion analysis of the ball, more precisely of four white spots,

which arespinning, and moving on a quasi-horizontal trajectory. There is a deceleration fromimage and moving on a quasi-horizontal trajectory:

deceleration from images 1 to 14 followed by acceleration from images 15 to 32.

−3−2

−10

12

3

−3

−2

−1

0

1

2

30

50

100

150

200

250

300

350

400

vx

ENERGY OF GALILEAN WAVELET TRANSFORM

vy

Figure 5. Analysis of translational velocities contained in the ball at image 18 on a window that contains the ball: the square modulus of the

wavelet transform (the energy) is computed using the Galilean wavelet of group G4. The energy density is integrated on a window at image

18. Two signatures are visible; two symmetric peaks result from the rotational motion estimated with group G4 which is suited for translational

motion alone and a “domed wall” testifies of the spreading of translational velocities which results from accelerated motion. This treatment is

instructive for the shape of the Fourier signature but not well suited for precise estimations.

successively maximized on the velocity as processed

in [30, 31]. The gravity center of the ball is computed

from the maxima of the square modulus of the wavelet

transform within a window B of size 60 × 60 which

is sliding according to the velocity estimations. These

maxima are located along the contours of the ball in

translational motion. The corresponding reconstruction

is presented in Fig. 9.

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 22/30

228 Leduc

0

0.02

0.04

0.06

0.08

0.1

1

2

3

4

50

1

2

3

4

5

x 1011

angular velocity: theta (radian/image)

ESTIMATION OF SCALE AND ANGULAR VELOCITY

scale a

Figure 6 . Estimation of the angular velocity and the scale of the rotating ball in Caltrain sequence with rotational wavelets. The diagram

sketches the square modulus of the wavelet transform at v = (−1.7, 0.1) pix/image. The component at θ1 = 0 stands for the non-rotating

structures. The component at θ1 = 0.045 rad/image, a = 3.3 is the actual ball contribution which is observed rotating of  π/2 over 32 images.

The component at θ1 = 0.09 rad/image is the first harmonic.

−0.02 −0.015 −0.01 −0.005 0 0.005 0.01 0.015 0.0220

22

24

26

28

30

32

34

  s  q  u  a  r  e   d  m

  o   d  u   l  u  s  o   f   t   h  e  w  a  v  e   l  e   t   t  r  a  n  s   f  o  r  m    |  <     Ψ    |  s  >   |   2

angular acceleration θ2

Figure 7 . Estimation of the angular acceleration of the rotating ball in Caltrain sequence on image 4 with rotational wavelets from an extended

version of group G7 which contains θ2. The diagram sketches the square modulus of the wavelet transform at v = {−1.7, 0.1} pixel/image,

a = 3.3. The maximum at θ2 = −0.003 rad/image2 corresponds to the angular deceleration. The ball is indeed observed decreasing speed and

rotational motion from image 1 to 14 in the tracking presented in image 7.

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 23/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 229

0 5 10 15 20 25 30 3590

100

110

120

130

140

150

160

TRAJECTORY TRACKING OF THE BALL

  x  −  c  o  o  r   d   i  n  a   t  e  s

image number

Figure 8. Tracking the moving-ball position in the Caltrain sequence with Galilean wavelets from group G4. At image 15, the ball is pushed

and keeps constant speed. The x -coordinates decrease as a result of the motion steering to the left.

Figure 9. Reconstruction of the rotating ball at image 4 in the Caltrain sequence; the scene is filtered by rotational wavelets from group G7

traveling at velocity v = (−1.7, 0.1) pix/image, the scale a = 0.5 to trace all the contours with fine resolution, t  = 10 to be more accurate in

position and θ1 = 0.045 rad/image. As a result of the uncertainty between velocity and angular orientation, the intensity of the ball boundaries

depends upon the orientation. This explains the fading of the edge intensities on the upper and lower arcs. The isolation of the moving object of 

interest is eventually performed by a Gaussian filter of standard radius of 50 (aball = 3.3) centered on the maximum intensity.

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 24/30

230 Leduc

7. Conclusions

In this paper, we have developed new families of 

continuous wavelets to analyze rotational motions (an-

gular velocity and accelerations) in spatio-temporal

digital signals. It has been shown how rotational pa-

rameters superpose and combine with translational pa-

rameters when travelingalong thecarrier trajectory and

how the motion estimation and tracking of parameters

can be performed quasi-independently. Simulations re-

sults have presented the practical capabilities of these

wavelet estimation process.

Appendix 1

This appendix provides some guidelines and outlined

ideas on how Lie group representationshave been com-

puted in this paper. As an example, the multidimen-

sional af fine group SIM(n) is sketched here below. The

reason of this choice is the small amount of compu-

tations involved for this case. The Galilei and rota-

tional cases proceed exactly on the same sketch but

involve more machinery. For all definitions, theorems,

properties, the interested reader is invited to consult

the following references [4, 6, 9, 14, 23, 24, 34, 37].

The construction of UIRs may proceed from two ap-

proaches namely Mackey’s Methodof Induction[5, 34]

and the Kirillov’s Method of Orbits [23]. Both methods

can also be intertwined.

In the case where G is structured as a semi-direct

product G = H K  where K  and H  are subgroups.

Let φ be a group homorphism from K  into AUT( H ).

G is the set of the ordered pairs (k , k ) with h ∈ H 

and k  ∈ K . We have now the following strategy to

determine all the unitary representations of  G.

1. Determine the set H ∗ of all the irreducible charac-

ters of  H .

2. Search for the orbitsOK (ω∗) in the dual group H ∗;ω∗ ∈ H ∗. Classify all the orbits.

3. From each orbit, select an element ω0 ∈ OK (ω∗)

and determine the form of the stability subgroup

K (ω0) ⊂ K .

4. Take a representation L K  of  K (ω0) and induce the

representation T gψ as IND ↑GK  L K  in Eq. (5).

The interested reader should read Glimm’s theorem

[18]. The importance of this theorem lay in its ability to

guarantee the irreducibility of induced representations.

Basically, Glimm’s theorem allows us an easy way to

check for the existence of a system of imprimitivity for

a representation [5, 34]. Let G = H 

K , and let theorbits of  G in H ∗ satisfy the conclusions of Glimm’s

theorem. Then

1. For each orbitOK (ω∗) ∈ H ∗, and for each UIR L K 

of the stability subgroup, there exists an induced

representation for G defined as IND ↑GK  L K  in

Eq. (5).

2. The carrier space of the induced UIR IND ↑GK  L K 

is the Hilbert space H IND↑GK  L K 

= L2(OK , d µ).

The form of these induced representations has been

presented in Eq. (5) and their computation required to

derive the adjoint and coadjoint actions. Let us treatthe case G1 = SIM(n) for the shake of simplicity. If g,

g ∈ G1, then the conjugation on the group is given by

gg g−1 = (b + a Rb − a R R R−1b, a, R R R−1)

(94)

and, thus, the adjoint action of G on G (computed from∂gg

g−1

∂g |g

=e is given by

 Ad g X  = X  = (b, s , r ), X , X  ∈ G (95)

withb = a Rb − (sI  + Rr R−1)b (96)

s = s (97)

r  = Rr R−1 (98)

We further consider G∗ to be the algebraic dual of G

in the usual manner, and let X ∗ ∈ G∗ to be X ∗ =( p∗, s∗, r ∗) with  p∗ = k defined in Eq. (5). The duality

between G and G∗ is expressed by

 X , X ∗ =  p ·  p∗ + ss ∗ + tr (rr ∗) (99)

where tr  is the trace. We can proceed to the coadjoint

action of  G on G∗ which is computed as Ad ∗g = Ad T g

and is given by

 Ad ∗g X ∗ = ˜ X ∗ = (  p

, s , r ), X ∗, ˜ X  ∈ G∗ (100)

with

 p = a R−1  p ∗ (101)

s = s∗ − b ·  p ∗ (102)

r  = R−1r ∗ R + R−1b ⊗ r −1  p ∗ (103)

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 25/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 231

Let G(k ) = H  H (k ) denote the stabilizer of point k 

in H ∗ where H (k ) is called the little group (stabilitysubgroup). For G = SIM(n), V ∗ Rn. Let us fix the

point e = (0, 1) in Rn (0 ∈ Rn−1). The stabilizer of  eis G(e) = SIM(e) = R

n H (e) = R

n SO(n − 1). In

this example, the little group is H (e) =SO(n − 1) and

then

 L H (s) = D[ j ](s), ∀s ∈ S O(n − 1) (104)

where the D[ j ] are the representations of SO(n − 1) [5,

16]. The Radon-Nikodym derivative is computed from

the coadjoint action det

a R−1

= an . For applications

in signal processing, we let D[ j ](s

) = 1 = L H (s

) (nospinor representations are required). Following Eq. (5),

the UIRs T g of  G1 in the space L2(Rn , d x) are then

given by

[T g](  p) = an2 ei b·  p(  p) (105)

with

 p = a R−1  p (106)

These UIRs are unitary and irreducible.

Appendix 2

Theorem 1 . The UIRs of G3 in the space L 2(Rn+2,

d x) given by g → T g are square-integrable.

Proof: Let usrecall thatthe UIRs g → T g are square-

integrable if and only if  G

|T g, |2d µl (g) < +∞ (107)

Let us denote the element (m, k , ω) by ξ and denote

the measure dm d k d ω by d ξ . Then, we may interpret

ξ as an element of  ˆ N , the dual vector space of  N , and

we may consider the integration over ˆ N  in the inner

product in Eq.(107) to be an inverseFourier Transform.

We let

d  x = d φ d b d τ, ds = d v da da0 dm ( R)

a2n+3a−(n−1)0

(108)

so that d µl (g) = d  xds.

The integration in Eq. (107) proceeds as follows

 G

|T g, |2 dg

S

  N 

 ˆ N 

[T g](ξ )(ξ )d ξ

2

d  xds (109)

S

[ I  N ] ds (110)

Moreover, we let

V (ξ ) = [T g](ξ )(ξ ) (111)

and calculate I  N  as follows (the symbols ˆ and ˇ stand

respectively for direct and inverse Fourier versions).

Since V (ξ ) contains the ei x·ξ in T g, the integral on ˆ N 

is an actual inverse Fourier transform. Therefore,

 I  N  = 

 N 

|V ( x)|2 d x (112)

= V ( x )2 L 2( N ,dx ) (113)

= V (ξ )2

 L 2( ˆ N ,d ξ )(114)

ˆ N 

|V (ξ )|2 d ξ (115)

=   N  |[T 

g](ξ )

|2

|(ξ )

|2 d ξ (116)

At this point, the Fubini’s theorem applied to Eq. (110)

grants S

[ I  N ] ds = 

ˆ N 

|(ξ )|2

 S

|T g](ξ )|2ds

d ξ

(117)

Thus, if there exists a non-zero ∈ L2(Rn+2, d  x ) so

that

c

=   N  |(ξ )

|2 S |

[T g ](ξ )|

2 dsd ξ <+∞

(118)

the theorem is proved. Let us first observe that SO(n) is

a compact group, the integration over R can be pushed

outside of Eq. (118). So as long as the remaining inte-

grals are finite, c will also be finite. Next, Eq. (118)

may be rewritten as

c = Rn+2

|(m, k , ω)|2 I 1 dm d k d ω < +∞,

(119)

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 26/30

232 Leduc

where

 I 1 =  Rn+2

|(m, k , ω)|2 d v da da0

an+1a−(n−1)0

< +∞.

(120)

At this stage, the change of variable dm d k  d ω = J (d v da da0) is required to eliminate the parameters

from S. The Jacobian is given by

 J =

det

∂m∂a0

∂k ∂a0

∂ω ∂ a0

∂m∂a

∂k ∂a

∂ω ∂a

∂m∂

v

∂k ∂

v

∂ω ∂

v

(121)

=det

−a2

a20

0T  a0ω

2 aa0

[a−1k ]T  0

0 am I n −a0a−1 Rk 

(122)

= an−1mn−1

a0

[|k |2 + 2mω]. (123)

Thus, I 1 yields after the change of variables

 I 1 = Rn+2

|(m, k , ω)|2 m dm d k  d ω

a2n mn

an0

a4[|k |2 + 2mω]

(124)

But

a2 = |k |2 + 2mω

|k |2 + 2mω, m = a2m

a0

(125)

Therefore, Eq. (124) may be rewritten as Rn+2

|(m, k , ω|2 m[|k |2 + 2mω]2

(m)n[|k |2 + 2mω]3dm d k  d ω

(126)

Hence, c < +∞ in Eq. (118) if the following pair of integrals is finite Rn+2

|(m, k , ω)|2m[|k |2 + 2mω]2 dm d k d ω < +∞(127)

and Rn+2

|(m, k , ω)|2 dm d k d ω

(m)n [|k |2 + 2mω]3< +∞

(128)

Since there exist non-zero functions in L2(Rn+2, d  x)

which fulfill these two conditions, the theorem isproven.

Theorem 2 . The UIRs of G4 in the space

 L2(Rn+1, d nkd ω) which are given by the mapping

g → T g are square-integrable.

Proof: In this case, following the same path as in

Theorem 1, we want to examine the boundness of 

 I 2 = Rn+1

m0

(k , ω)

2 da d van+1

(129)

Therefore, we reach a change of variables from (a, v)to (k , ω) given by d k  d ω = J da d v, where

 J  =det

∂k ∂a

∂ω ∂a

∂k ∂v

∂ω ∂v

(130)

=det

a−1(k )T  0

am 0 R−1 −a−1 Rk 

(131)

= an−3mn−10 |k |2 (132)

Thus, Eq. (129) becomes

 I 2 = Rn+1

m0(k , ω)

2 d k  d ω

a2n−2mn−10 |k |2

(133)

Therefore, we obtain the condition of square-

integrability (129) which requires that the following

integral be finite

c = Rn+1

m0(k , ω)

2 I m0

(k , ω) d k d ω < +∞(134)

where

 I m0(k , ω) =

 Rn+1

m0(k , ω)

2

×

[|k |2 + 2m0(ω − ω)]n−1

|k |2n mn−10

d k  d ω

< +∞(135)

There are many functions for which the integral will

be finite. For > 0, the following ∈ L2(R × R)

will be admissible as Galilean wavelets: (ξ , ω) =

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 27/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 233

O(|ξ |−(3n+2+)), |ξ | → ∞, ∀ω ∈ R, (ξ , ω) =O(|ξ |

n

+

), |ξ | → 0, ∀ω ∈ R, (ξ , ω) =O(|ω|−(2n−1+)), |ω| → ∞, ∀ξ ∈ Rn, (ξ , ω) =

O(|ω|−1+ ), |ω| → 0, ∀ξ ∈ Rn .

Appendix 3

In this appendix, the condition of wavelet admissibility

is examined with Calderon’s point of view. In this ap-

proach, we look for the condition to yield an invertible

wavelet transform i.e. an isometry. The example to be

considered is the Galilei group with g = {b, τ , v , a}in a one-dimensional spacetime; so we may consider

m0 = 0. To illustrate this technique developed byCalderon, we will refer to the spacetime version of the

group representation in (38). The inner product

F , T g = R×R

 y

ρ

a−1/2

× 1

a[ y − b − v(ρ − τ )]

ρ − τ 

d y d ρ

is the wavelet transform defined in Section 2. The func-

tional version of the operator statement of the isometry

 I  H o

= W −1

W  reads as follows

F , T g = R×R

 y

ρ

a−1/2

× 1

a[ y − b − v(ρ − τ )]

ρ − τ 

d y d ρ

read as follows

F ( x , t ) = 

G

F , T g(T g)( X )d µl (g)

=  R R R R+  

R×R F   y

ρ a−1/2

× 1

a[ y − b − v(ρ − τ )]

ρ − τ 

d y d ρ

a−1/2

× 1

a[ x − b − v(t  − τ )]

t  − τ 

db d τ  d v da

a3

= R

 R+

 R×R

 y

ρ

 R

 R

a−1

× 1

a[ x − b − v(ρ − τ )]

ρ − τ 

a−1

×1a

[ y − b − v(t  − τ )]

t − τ  d y d ρ db d τ × d v da

a2

= R

 R+

 R×R

 y

ρ

 R

 R

a

×

 x − y − u − v(t − ρ − w)

t − ρ − w

a

×

u − vw

w

d y d ρ du d w

d v da

a2

=  R  R+  R×R F   y

ρ (a ∗˜

a )

×

( x − y) − v(t − ρ)

t − ρ

d y d ρ

d v da

a2

= R

 R+

{F  ∗ (a ∗ a)}

 x

d v da

a2

where we have let τ  = ρ + w, b = y + u and also

( x, t ) = (− x , −t ) and a ( x , t ) = a−1( xa

, t ).

Let us also remark that the introduction of the spatio-

temporal convolution denoted ∗. Spatial and temporal

translations are related to each other through the veloc-

ity v along a Galilean frame moving at constant velocityv. In this case, the convolution defined on the Galilei

group is twisted andperformedalong this displacement

(i.e. along the trajectory) in order to reconstruct the

still signal F ( x, t ). This is a reminiscence of the tech-

nique of motion-compensated filtering. Eventually, we

moved to the Fourier domain to retrieve the condition

of admissibility of the Galilean wavelet as described

in [26]. We have introduced in the second equation the

left-invariant Haar measure d µl (g) which satisfies by

definition

 G

F (g−1

h) d µl (h) =  G

F (h) d µl (h) ∀g, h ∈ G

(136)

The left-invariant Haar measure can be calculated from

the law of composition as an infinitesimal variation of 

volume in the parameter space

d µl (g) =det

∂ge ◦ g

e

∂ge

−1

ge=e

db d τ  d v da (137)

= 1

a3db d τ  d v da (138)

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 28/30

234 Leduc

Proceeding further with F ( x, t ) in the Fourier domain,

we get

F (k , ω) = F (k , ω)

 R

 R+

|(a k , ω − k v)|2 d v da

a2

(139)

which leads to the usual condition of square-

integrability of the Galilean wavelet in one-

dimensional spacetime R

 R

|(k , ω)|2

|k |2dk d ω = 1 (140)

We have illustrated an alternative way of determiningthe condition of wavelet admissibility. Taking into ac-

count the spacetime domain, we have learned that the

motion-based wavelet analysis performs the motion-

compensated filtering.

Appendix 4

This appendix illustrates the way of how to compute the

Lie algebras G and the matrix representation A defined

in Eqs. (76) and (77). We proceed successively from

equations of motion F 1 and F 2.

Equation of motion F 1 is given by

γ 1(t ) = a1 x(t ) + a2v(t ) + b cos[θ1t ] (141)

The time differential operator reads

1 = v∂

∂ x+ a1 x

∂v+ a2v

∂v+ b cos[θ1t ]

∂v+ ∂

∂t (142)

The state of the dynamical system is composed as fol-

lows: q1 = x; q2 = v; q3 = cos θ1t ; q4 = sin θ1t . The

infinitesimal Lie generators in 1 are given by

 X 12 = x∂

∂v; X 21 = v

∂ x; X 22 = v

∂v;

 X 32 = cos[θ1t ]∂

∂v; X 43 = 1

θ1

∂t 

The additional Lie generators for closure are as follows

 X 11 = x∂

∂ x; X 31 = cos[θ1t ]

∂ x; X 41 = sin[θ1t ]

∂ x;

 X 42 = sin[θ1t ]∂

∂v

A generic element Y  ∈ G becomes

Y  = a X 11 + b X 21 + c X 22 + d X 32 + e X 43

+ f X 31 + g X 41 + h X 42

The representation in the parameter state reads

 A = X 21 + a1 X 12 + a2 X 22 + b X 32 + θ1( X 34 − X 43)

(143)

Eventually, matrix A reads

0 a1 0 0

1 a2 0 0

0 b 0 θ1

0 0 −θ1 0

(144)

The construction of the Lie algebra G and the matrix

representation A from equation of motion F 2 proceeds

as follows. The equation of motion F 2 is given by

γ 2(t ) = a1 x(t ) + a2v(t ) + a3γ (t ) + b1 cos[θ1t ]

+ b2 cos

θ2

t 2

2

(145)

The time differential operator is

2 = v∂

∂ x+ γ 

∂v+ a1 x

∂γ + a2v

∂γ + a3γ 

∂γ 

+ b cos[θ1t ]∂

∂γ + ∂

∂t (146)

The state of the dynamical system is as follows:q1 = x; q2 = v, q3 = γ ; q4 = cos θ1t ; q5 = sin θ1t ; q6 =cos θ2

t 2

2; q7 = sin θ2

t 2

2. The infinitesimal Lie genera-

tors in 2 are given by

 X 32 = γ ∂

∂v; X 21 = v

∂ x; X 13 = x

∂γ ; X 23 = v

∂γ ;

 X 33 = γ ∂

∂γ ; X 42 = cos[θ1t ]

∂γ ; X 54 = 1

θ1

∂t 

 X 76 = 2

θ2

∂t 2

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 29/30

A Group-Theoretic Construction with Spatiotemporal Wavelets 235

The additional Lie generators for closure follow as

 X 11 = x∂

∂ x; X 12 = x

∂v; X 22 = v

∂v; X 23 = v

∂γ ;

 X 31 = γ ∂

∂ x; X 41 = cos[θ1t ]

∂ x; X 42 = cos[θ1t ]

∂v;

 X 51 = sin[θ1t ]∂

∂ x; X 52 = sin[θ1t ]

∂v;

 X 53 = sin[θ1t ]∂

∂γ ; X 61 = cos

θ2

2t 2

∂ x;

 X 62 = cos

θ2

2t 2

∂v; X 71 = sin

θ2

2t 2

∂ x;

 X 72 = sin θ2

2 t 

2 ∂

∂v ; X 73 = sinθ2

2 t 

2 ∂

∂γ 

A general element Y  ∈ G reads

Y  = a X 11 + b X 12 + cX 22 + d X 23 + e X 31 + f X 41

+ g X 42 + h X 51 + X 52 + j X 53

The representation in the parameter state is given by

 A = X 21 + X 32 + a1 X 13 + a2 X 23 + a3 X 33 + b X 42

+ θ1( X 45 − X 54) + θ2

2( X 67 − X 76)

Eventually, matrix A comes as follows

0 0 a1 0 0 0 0

1 0 a2 0 0 0 0

0 1 a3 0 0 0 0

0 0 b1 0 θ1 0 0

0 0 0 −θ1 0 0 0

0 0 b2 0 0 0 θ2

2

0 0 0 0 0 − θ1

20

(147)

Acknowledgments

The author wishesto express his gratitude to the anony-

mous reviewer who provided substantial and construc-

tive details to improve the paper presentation, and to

Prof. B. Blank and J. Corbett, PhD student, both in the

Mathematics Department of Washington University in

Saint Louis for helpful discussions on thetopic. Theau-

thor also thanks Prof. B.K. Ghosh in the Department of 

Science Systems and Mathematics, Washington Uni-

versity in Saint Louis for providing the computing

support.

This material is based upon work supported by the

US Air Force under grant F49620-99-1-0068.

References

1. R. Abraham and J. Marsden, Foundations of Mechanics,

The Benjamin/Cummings Publishing Company: Reading, MA,

1978.

2. S.T. Ali, J.-P. Antoine, J.-P. Gazeau, and U.A. Mueller, “Coher-

ent states and their generalizations: A mathematical overview,”

 Review of Mathematical Physics, Vol. 7, pp. 1013–1065, 1995.

3. V.I. Arnold, Mathematical Methods of Classical Mechanics,

Springer-Verlag, New York, 1978.

4. A.O. Barut, “Localized rotating waveletswith half integer spin,”

Physics Letters A, Vol. 189, pp. 277–280, 1994.

5. A.O. Barut and R. Raczka, Theory of Group Representationsand Applications, PWN—Polish Scientific Publishers, 1985.

6. P. Bernat, N. Conze, M. Duflo, M. Levy-Nahas, M. Rais, P.

Renouard, and M. Vergne, Repr   esentations des groupes de Lie

r   esolubles, Dunod: Paris, 1972.

7. R.E. Blahut, W. Miller, and C. Wilcox, Radar and Sonar , Part I,

Springer Verlag: New York, 1991.

8. C. Bretin and Gazeau, “Generalized bessel series and multiplic-

ity problem in complex semisimple lie algebra theory,” Journal

of Mathematical Physics, Vol. 22, No. 10, 1981.

9. Th. Brocker and T. Dieck, Representations of Compact Lie

Groups, Springer-Verlag: New York, 1985.

10. J.S. Byrnes et al., Wavelets and their Applications, Kluwer

Academic Publishers, 1994.

11. T. Caelli, W. Hoffman, and H. Lindman, “Subjective Lorentz

transformations and the perception of motion,” Journal of theOptical Society of America, Vol. 68, No. 3, pp. 402–411, 1978.

12. M. Duval-Destin and R. Murenzi, “Spatio-temporal wavelets:

Application to the analysis of moving patterns,” Progress in

Wavelet Analysis and Applications (Proc. Toulouse 1992), Y.

Meyer and S. Roques (Eds.), Frontieres: Gif-sur-Yvette, France,

1993, pp. 399–408.

13. D.J. Fleet and A.D. Jepson, “Hierarchical construction of ori-

entation and velocity selective filters,” IEEE Transactions on

Pattern Analysis and Machine Intelligence, Vol. 11, No. 3, pp.

315–325, 1989.

14. G.B. Folland, A Course in Abstract Harmonic Analysis, CRC

Press: Boca Raton, 1995.

15. W.A. Gardner, Introduction to Random Processes, Macmillan

Publishing Company, 1986.

16. I.M. Gel’fand, R.A. Minlos, and Z.Ya. Shapiro, Representation

of the Rotation and Lorentz Groups and their Applications , The

Macmillan Company: New York, 1963, part I, pp. 1–153.

17. R. Gilmore, Lie Groups, Lie Algebras, and Some of Their Ap-

 plications, John Wiley: New York, 1974.

18. J. Glimm, “Locally compact transformation groups,” Transac-

tions of the American MathematicalSociety, Vol. 101, No. 1, pp.

124–138, 1961.

19. K.I. Gross, “Bessel functions and representation theory I, Jour-

nal of Functional Analysis, Vol. 22, pp. 73–105, 1976,.

20. C. Heil and D. Walnut, “Continuous and discrete wavelet trans-

forms,” SIAM Review, Vol. 31, No. 4, pp. 628–666, 1996.

21. M. Holschneider, Wavelets: An Analysis Tool, Clarendon Press:

Oxford, England, 1995.

8/6/2019 A Group-Theoretic Construction With SpatiotemporalWavelets for the Analysis of Rotational Motion

http://slidepdf.com/reader/full/a-group-theoretic-construction-with-spatiotemporalwavelets-for-the-analysis 30/30

236 Leduc

22. A. Jerri andI. Joslin, “Truncationerror for the generalizedbessel

typesamplingseries,” Journal of FranklinInstitute, Vol.314,No.

5, pp. 323–328, 1982.

23. A.A. Kirillov, Elements of the Theory of the Representations,

Springer Verlag: New York, 1976.

24. A.W. Knapp, Representation Theory of Semisimple Groups,

Princeton University Press: Princeton, 1986.

25. N. Lebedev, Special Functions and their Applications, Trans-

lated by R. Silverman, Dover Publications: New York, USA,

1972.

26. J.-P. Leduc, “Spatio-temporal wavelet transforms for digital sig-

nal analysis,” Signal Processing, Elsevier, Vol. 60, No. 1, pp.

23–41, 1997.

27. J.-P. Leduc,“Harmonic analysis associatedwith spatio-temporal

transformations,” in Proceedings of ICASSP-2000, Istanbul,

Turkey, Vol. 4, 2000, pp. 2298–2301.

28. J.-P. Leduc, “Continuous and discrete wavelets for acceleration

kinematics: A motion estimation based on Lie groups and vari-

ational principles,” Journal of Applied and Computational Har-

monic Analysis, Vol. 11, 2001, pp. 347–386.

29. J.-P. Leduc,J. Corbett, and V. Wickerhauser, “Rotational wavelet

transforms for motionanalysis, estimationand tracking,” in Pro-

ceedings of ICIP-98, Chicago, 1998, p. 4.

30. J.-P. Leduc, F. Mujica, R. Murenzi, and M.J.S. Smith, “Spatio-

temporal wavelet transforms for motion tracking,” in Proceed-

ings of ICASSP-97 , Munich, Germany, Vol. 4, 1997, pp. 3013–

3017.

31. J.-P. Leduc, F. Mujica, R. Murenzi, and M. Smith, “Spatio-

temporal wavelets: A group-theoretic construction for motion

estimationand tracking,” SIAM Journal of Applied Mathematics,

Vol. 61, No., pp. 596–632, 2001.

32. R. Lenz and K. Homma, “Constructing iterative matching algo-

rithmswith theuse of Lietheory: Three-dimensional orientation

example,” Journal of the Optical Society of America A (Optics,

Image Science andVision), Vol.14, No.8, pp.1734–1741, 1997.

33. J.-M. Levy-Leblond, “Galilei group and Galilean invariance,” in

Group Theory and its Applications, Vol. II, E.M. Loebl (Ed.),

Academic Press: New York, 1971, pp. 221–296.

34. G.W. Mackey, The Theory of Group Representations, Depart-

ment of Mathematics, University of Chicago, 1955.

35. F. Mujica, J.-P. Leduc, R. Murenzi, and M. Smith, “A new pa-

rameter estimation algorithm based on the continuous wavelet

transform,” IEEE Transactions on ImageProcessing, Vol. 9,No.

5, pp. 873–888, 2000.

36. A.M.Perelomov, “Coherentstates for arbitrary lie group,” Com-

munications in Mathematical Physics, Vol. 26, pp. 222–236,

1972.37. S.R. Quint, Representations of Solvable Lie Groups-Lecture

 Notes, Department of Mathematics, University of California at

Berkeley, 1972.

38. J. Rubinstein, J. Segman, and Y.Y. Zeevi, “Recognition of dis-

tortedpatterns by invariance kernels,” in Proceedings of the10th

 International Conference on Pattern Recognition, Vol. 2, 1990,

pp. 159–164.

39. S. Saeki, “On thereproducing formula of calderon,” The Journal

of Fourier Analysis and Applications, Vol. 2, No. 1, pp. 15–28,

1995.

40. H. Samelson, Notes onLie Algebras, Springer Verlag: NewYork,

1998.

41. I. Segall and Y.Y. Zeevi, “Application of wavelet-type functions

in image processing,” in Proceedings of the SPIE-The Interna-

tional Society for Optical Engineering, Vol. 1, 1991, pp. 1048–

1058.

42. J. Segman and Y.Y. Zeevi, “Image analysis by wavelet-

type transforms: Group theoretic approach,” Journal of Math-

ematical Imaging and Vision, Vol. 3, No. 1, pp. 51–77,

1993.

43. J.-P. Serre, Linear Representations of Finite Groups, Springer

Verlag: New York, 1977.

44. V.S. Varadarajan, Lie groups, Lie Algebras and their Represen-

tations, Springer Verlag: New York, 1984.

45. N.J. Vilenkin, Special Functions and the Theory of Group Rep-

resentations, American Mathematical Society: Providence, RI,

1968.

46. K. Wodkiewicz andJ.H.Eberly, “Coherent states, squeezed fluc-

tuations, and the SU (2) and SU (1, 1) groups in quantum-optics

applications,” Journal of the Optical Society of America B, Vol.

2, No. 3, 1985.

47. C.E. Wulfman and B.G. Wybourne, “The Lie group of New-

ton’s and Lagrange’s equations for the harmonic oscillator,”

 Journal of Physics A: Math. Gen., Vol. 9, No. 4, pp. 507–518,

1976.

Jean-Pierre Leduc received the degree of Electrical Engineer at

the Faculte Polytechnique de Mons (Mons, Belgium) in 1978. He re-

ceivedhis Masterdegree at Columbia University (New York)in 1987

and his Doctorate degree at the Universite Catholique de Louvain

(Louvain-la-Neuve, Belgium) in 1993, both in Electrical Engineer-

ing (Signal Processing and Telecommunications). He also earned

a degree in Operations Research and in Theoretical Physics from

the Faculte Polytechnique de Mons and theUniversite Catholique de

Louvain, respectively. He has been successivelyat the Laboratoire de

Telecommunications et de t   el´ ed   etection of the Universite Catholiquede Louvain, from 1988 until 1993, at the Institut de Recherche en

Informatique et Systemes Aleatoires in Rennes, France, from 1993

until 1996, at theGeorgia Instituteof Technology from 1996to 1997,

and at Washington University in Saint Louis (Math dept.) from 1997

to 2000. Since September 2000, he is with the Mathematics Depart-

ment of the University of Maryland, College Park.

His present research interests include spatio-temporal signal pro-

cessing, discrete and continuous wavelet transforms, group repre-

sentation theory and optimal control. He is also interested in motion

analysis, detection and tracking.