stable manifold approach for hamilton -jacobi equations in...

29
Stable manifold approach for Hamilton-Jacobi equations in optimal control theory with applications Noboru Sakamoto Nanazan University Nagoya University 9th CDPS 2015 at Beijing July 3rd 2015

Upload: others

Post on 09-Feb-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

  • Stable manifold approach for Hamilton-Jacobi equations in optimal control theory with applications

    Noboru Sakamoto Nanazan University Nagoya University

    9th CDPS 2015 at Beijing July 3rd 2015

  • Outline of talk

    Hamilton-Jacobi equation and stable manifold

    Stable manifold algorithm

    Applications

    Non-uniqueness of solution for HJE

    Summary

    • DC motor over-current avoidance

    • Swing-up and stabilization of inverted pendulum

    • Swing-up and stabilization of flexible inverted pendulum

  • HJE and optimal control

    Optimal control problem

    Solution

  • Problem 0

    HJE & stable manifold

    Problem 1

  • Stable manifold

    Stable manifold

    Invariance property

  • FACT

    FACT

    HJE & stable manifold

  • Problem 0

    Problem 1

    HJE & stable manifold

  • Stable manifold algorithm

    Stable manifold algorithm (Sakamoto & van der Schaft 2008)

  • The idea of this iteration

  • How to compute optimal control?

    No computation for V(x)

  • Computation : a numerical example

  • Computation of solution on SM Numerically obtain SM Interpolation/functional fitting

    Summary of stable manifold approach

    High accuracy Fast convergence (exponential) Iterative, suitable for computer impl. Non-analytic function can be handled (saturation)

    Advantages

    Challenges Higher dimensional systems (6

  • Applications (Experimental verifications)

  • Model of DC motor

    Stabilization & (overcurrent prevention)

    Control objective

    DC motor over-current avoidance

  • DC motor over-current avoidance

  • 0.02 0.04 0.06 0.08 0.1 0 Time [s]

    Stable manifold approximation

    Optimal control

    Experimental result

    DC motor over-current avoidance

  • How much can we enlarge the domain of attraction of the closed loop system

    Compute large stable manifold Real implementation Robustness

    Challenging issues

    Swing up & stabilization of inverted pnedulum

    Upright position (equilibrium)

    Pending position (to be included in the domain of attraction)

  • (Eq. for the body)

    (Eq. for the pendulum)

    Modeling

    Swing up & stabilization of inverted pnedulum

  • What if sat(u) = 7[V] ?

    Swing up & stabilization of inverted pnedulum

  • HJ equation (Hamiltonian system)

    Stable manifold computation

    Swing up with 2 swings !

    Swing up & stabilization of inverted pnedulum

  • saturation

    HJ equation

    2 swing control

    = Original HJ equation ???

    2 swing control ? 1 swing 2 swing

    Pending pos.

    dθ/d

    t

    θ

    Non-uniqueness and curvature of SM

  • θ

    dθ/d

    t 1 swing, 2swing, 3swing solutions coexist in one HJE

    1 swing

    2 swings

    3 swings 4 swings

    Non-uniqueness and curvature of SM

  • Stable manifold including 1swing, 2swing, 3 swing solution

    Non-uniqueness and curvature of SM

  • φencoder DC motor

    θencoder

    Spring steel flexible beam

    ©JAXA

    Light weight

    Agility

    Nonlinear control of flexible structure

    Swing up & stabilization of flexible IP

  • LQ control causes spillover instability

    Frequency-dependent LQ control can stabilize the system

    Swing up control with filter?

    No switching is allowed!

    Swing up & stabilization of flexible IP

  • φencoder DC motor

    θencoder

    Cut-off filter Delay compensation Spring steel flexible beam

    Controller structure

    Swing up & stabilization of flexible IP

  • Optimal controller:

    Swing up & stabilization of flexible IP

  • Other applications

    2.Optimal control for Burgers eq

    3.Optimal control for input delay system

    1.Swing-up of the Acrobot

  • Summary

    Numerical computation method for HJE

    Computation of stable manifold

    Non-uniqueness of solution for HJE

    Experimental verifications

    • DC motor over-current avoidance • Swing-up control for inverted pendulum • Swing-up control for flexible inverted pendulum

    A. J. van der Schaft (Univ. Groningen), Y. Umemura (Aishin AW, Co, Ltd), students of Control System Lab of NUAE Matlab programme is available upon request: [email protected]

    Acknowledgement

    Thank you !

    Slide Number 1Outline of talkHJE and optimal controlHJE & stable manifoldStable manifoldHJE & stable manifoldHJE & stable manifoldStable manifold algorithmThe idea of this iterationHow to compute optimal control?Computation : a numerical exampleSummary of stable manifold approach Applications� (Experimental verifications)DC motor over-current avoidanceDC motor over-current avoidanceDC motor over-current avoidanceSwing up & stabilization of inverted pnedulumSwing up & stabilization of inverted pnedulumSwing up & stabilization of inverted pnedulumSwing up & stabilization of inverted pnedulumNon-uniqueness and curvature of SMNon-uniqueness and curvature of SMNon-uniqueness and curvature of SMSwing up & stabilization of flexible IPSwing up & stabilization of flexible IPSwing up & stabilization of flexible IPSwing up & stabilization of flexible IPOther applicationsSummary