meeting the need for robustified nonlinear system theory concepts daniel liberzon coordinated...

54
MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng., Univ. of Illinois at Urbana-Champaign nary lecture, ACC, Seattle, 6/13/08 1 of 36

Upload: russell-west

Post on 24-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

MEETING THE NEED FOR ROBUSTIFIED

NONLINEAR SYSTEM THEORY CONCEPTS

Daniel Liberzon

Coordinated Science Laboratory andDept. of Electrical & Computer Eng.,Univ. of Illinois at Urbana-Champaign

Plenary lecture, ACC, Seattle, 6/13/08 1 of 36

Page 2: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK OVERVIEW

ContextConcept

Control withlimited information

Input-to-statestability

Adaptive controlMinimum-phaseproperty

Stability of switched systems

Observability

2 of 36

Page 3: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK OVERVIEW

ContextConcept

Control withlimited information

Input-to-statestability

Adaptive controlMinimum-phaseproperty

Stability of switched systems

Observability

2 of 36

Page 4: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Plant

Controller

INFORMATION FLOW in CONTROL SYSTEMS

3 of 36

Page 5: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

INFORMATION FLOW in CONTROL SYSTEMS

• Limited communication capacity

• Need to minimize information transmission

• Event-driven actuators

• Coarse sensing

3 of 36• Theoretical interest

Page 6: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

[Brockett, Delchamps, Elia, Mitter, Nair, Savkin, Tatikonda, Wong,…]

• Deterministic & stochastic models

• Tools from information theory

• Mostly for linear plant dynamics

BACKGROUND

Previous work:

• Unified framework for

• quantization

• time delays

• disturbances

Our goals:

• Handle nonlinear dynamics

4 of 36

Page 7: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Caveat:

This doesn’t work in general, need robustness from controller

OUR APPROACH

(Goal: treat nonlinear systems; handle quantization, delays, etc.)

• Model these effects as deterministic additive error signals,

• Design a control law ignoring these errors,

• “Certainty equivalence”: apply control

combined with estimation to reduce to zero

Technical tools:

• Input-to-state stability (ISS)

• Lyapunov functions

• Small-gain theorems

• Hybrid systems

5 of 36

Page 8: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION

Encoder Decoder

QUANTIZER

finite subset

of

is partitioned into quantization regions

6 of 36

Page 9: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36

Page 10: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

– assume glob. asymp. stable (GAS)

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36

Page 11: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36

no longer GAS

Page 12: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

quantization error

Assume

class

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36

Page 13: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Solutions that start in

enter and remain there

This is input-to-state stability (ISS) w.r.t. measurement errors

In time domain: [Sontag ’89]

quantization error

Assume

class

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36class , e.g.

Page 14: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Solutions that start in

enter and remain there

This is input-to-state stability (ISS) w.r.t. measurement errors

In time domain: [Sontag ’89]

quantization error

Assume

class

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36class , e.g.

Page 15: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

LINEAR SYSTEMS

Quantized control law:

9 feedback gain & Lyapunov function

Closed-loop:

(automatically ISS w.r.t. )

8 of 36

Page 16: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

DYNAMIC QUANTIZATION

9 of 36

Page 17: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

9 of 36

Page 18: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

9 of 36

Page 19: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Zoom out to overcome saturation

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

9 of 36

Page 20: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

After the ultimate bound is achieved,recompute partition for smaller region

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

Can recover global asymptotic stability

9 of 36

Page 21: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION and DELAY

Architecture-independent approach

Based on the work of Teel

Delays possibly large

QUANTIZER DELAY

10 of 36

Page 22: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION and DELAY

where

hence

Can write

11 of 36

Page 23: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

SMALL – GAIN ARGUMENT

if

then we recover ISS w.r.t. [Teel ’98]

Small gain:

Assuming ISS w.r.t. actuator errors:

In time domain:

12 of 36

Page 24: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

FINAL RESULT

Need:

small gain true

13 of 36

Page 25: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

FINAL RESULT

Need:

small gain true

13 of 36

Page 26: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

FINAL RESULT

solutions starting in

enter and remain there

Can use “zooming” to improve convergence

Need:

small gain true

13 of 36

Page 27: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

EXTERNAL DISTURBANCES [Nešić–L]

State quantization and completely unknown disturbance

14 of 36

Page 28: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

EXTERNAL DISTURBANCES [Nešić–L]

State quantization and completely unknown disturbance

14 of 36

Page 29: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Issue: disturbance forces the state outside quantizer range

Must switch repeatedly between zooming-in and zooming-out

Result: for linear plant, can achieve ISS w.r.t. disturbance

(ISS gains are nonlinear although plant is linear; cf. [Martins])

EXTERNAL DISTURBANCES [Nešić–L]

State quantization and completely unknown disturbance

After zoom-in:

14 of 36

Page 30: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK OVERVIEW

ContextConcept

Control withlimited information

Input-to-state stability

Adaptive controlMinimum-phase property

Stability of switched systems

Observability

15 of 36

Page 31: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

OBSERVABILITY and ASYMPTOTIC STABILITY

Barbashin-Krasovskii-LaSalle theorem:

(observability with respect to )

observable=> GAS

Example:

is glob. asymp. stable (GAS) if s.t.

• is not identically zero along any nonzero solution

• (weak Lyapunov function)

16 of 36

Page 32: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

SWITCHED SYSTEMS

Want: stability of for classes of

Many results based on common and multiple

Lyapunov functions [Branicky, DeCarlo, …]

In this talk: weak Lyapunov functions

• is a collection of systems

• is a switching signal

• is a finite index set

17 of 36

Page 33: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

SWITCHED LINEAR SYSTEMS [Hespanha ’04]

Want to handle nonlinear switched systems

and nonquadratic weak Lyapunov functions

Theorem (common weak Lyapunov function):

• observable for each

Need a suitable nonlinear observability notion

Switched linear system is GAS if

• infinitely many switching intervals of length

• s.t. .

18 of 36

Page 34: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

OBSERVABILITY: MOTIVATING REMARKS

Several ways to define observability

(equivalent for linear systems)

Benchmarks:

• observer design or state norm estimation

• detectability vs. observability

• LaSalle’s stability theorem for switched systems

No inputs here, but can extend to systems with inputs

Joint work with Hespanha, Sontag, and Angeli

19 of 36

Page 35: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

STATE NORM ESTIMATION

This is a robustified version of 0-distinguishability

where

(observability Gramian)

Observability definition #1:

where

20 of 36

Page 36: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

OBSERVABILITY DEFINITION #1: A CLOSER LOOK

Initial-state observability:

Large-time observability:

Small-time observability:

Final-state observability:

21 of 36

Page 37: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

DETECTABILITY vs. OBSERVABILITY

Observability def’n #2: OSS, and can decay arbitrarily fast

Detectability is Hurwitz

Observability can have arbitrary eigenvalues

A natural detectability notion is output-to-state stability (OSS):

[Sontag-Wang]where

22 of 36

Page 38: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

and

Theorem: This is equivalent to definition #1 (small-time obs.)

Definition:

For observability, should have arbitrarily rapid growth

OSS admits equivalent Lyapunov characterization:

OBSERVABILITY DEFINITION #2: A CLOSER LOOK

23 of 36

Page 39: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

STABILITY of SWITCHED SYSTEMS

Theorem (common weak Lyapunov function):

• s.t.

Switched system is GAS if

• infinitely many switching intervals of length

• Each system

is observable:

24 of 36

Page 40: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

MULTIPLE WEAK LYAPUNOV FUNCTIONS

Example: Popov’s criterion for feedback systems

Instead of a single , can use a

family with additional

hypothesis on their joint evolution:

linear system observable

positive real

See also invariance principles for switched systems in: [Lygeros et al., Bacciotti–Mazzi, Mancilla-Aguilar, Goebel–Sanfelice–Teel]

Weak Lyapunov functions:

25 of 36

Page 41: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK OVERVIEW

ContextConcept

Control withlimited information

Input-to-state stability

Adaptive controlMinimum-phase property

Stability of switched systems

Observability

26 of 36

Page 42: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

MINIMUM-PHASE SYSTEMS

[Byrnes–Isidori]

Nonlinear (affine in controls): zero dynamics are (G)AS

Robustified version [L–Sontag–Morse]: output-input stability

Linear (SISO): stable zeros, stable inverse

• implies minimum-phase for nonlinear systems (when applicable)

• reduces to minimum-phase for linear systems (SISO and MIMO)27 of 36

where for some ;

Page 43: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

UNDERSTANDING OUTPUT-INPUT STABILITY

uniform over :OSS (detectability) w.r.t. extended output,

28 of 36

Output-input stability detectability + input-bounding property:

Sufficient Lyapunov condition for this detectability property:

Page 44: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

CHECKING OUTPUT-INPUT STABILITY

For systems affine in controls,

can use structure algorithm for left-inversion

to check the input-bounding property

equation for is ISS w.r.t.

Example 1:

can solve for and get a bound on

can get a bound onOU

TPU

T-IN

PU

T S

TAB

LE

29 of 36

Detectability:

Input bounding:

Page 45: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

CHECKING OUTPUT-INPUT STABILITY

Example 2:

30 of 36

For systems affine in controls,

can use structure algorithm for left-inversion

to check the input-bounding property

Does not have input-bounding property:

can be large near

while stays bounded

zero dynamics , minimum-phase

Output-input stability allows to distinguish

between the two examples

Page 46: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

FEEDBACK DESIGN

Output stabilization state stabilization

( r – relative degree)

...

Output-input stability guarantees closed-loop GAS

In general, global normal form is not needed

Example: global normal form

GAS zero dynamics not enough for stabilization

Apply to have with Hurwitz

It is stronger than minimum-phase: ISS internal dynamics

31 of 36

Page 47: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

CASCADE SYSTEMS

For linear systems, recover usual detectability

If: • is detectable (OSS)

• is output-input stable

then the cascade system is detectable (OSS)

through extended output

32 of 36

Page 48: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

Linear systems

Controller

Plant

Designmodel

If: • plant is minimum-phase• system inside the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough (“tunable” [Morse ’92])

33 of 36

Page 49: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

If: • plant is minimum-phase• system inside the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough e (“tunable” [Morse ’92])

Nonlinear systems

Controller

Plant

Designmodel

34 of 36

Page 50: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

If: • plant is output-input stable• system inside the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough e (“tunable” [Morse ’92])

Nonlinear systems

Controller

Plant

Designmodel

34 of 36

Page 51: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

Nonlinear systems

If: • plant is output-input stable• system in the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough e (“tunable” [Morse ’92])

Controller

Plant

Designmodel

34 of 36

Page 52: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

Nonlinear systems

If: • plant is output-input stable• system in the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough and its derivatives (“weakly tunable”)

Controller

Plant

Designmodel

34 of 36

Page 53: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK SUMMARY

ContextConcept

Control withlimited information

Input-to-statestability

Adaptive controlMinimum-phaseproperty

Stability of switched systems

Observability

35 of 36

Page 54: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ACKNOWLEDGMENTS

• Roger Brockett

• Steve Morse

• Eduardo Sontag

• Financial support from NSF and AFOSR

• Colleagues, students and staff at UIUC

http://decision.csl.uiuc.edu/~liberzon

• Everyone who listened to this talk

Special thanks go to:

36 of 36