optimal control
DESCRIPTION
Optimal control. T. F. Edgar Spring 2012. Optimal Control. Static optimization (finite dimensions) Calculus of variations (infinite dimensions) Maximum principle ( Pontryagin ) / minimum principle Based on state space models Min S.t. is given General nonlinear control problem. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/1.jpg)
Optimal control
T. F. EdgarSpring 2012
![Page 2: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/2.jpg)
2
Optimal Control• Static optimization (finite dimensions)
• Calculus of variations (infinite dimensions)
• Maximum principle (Pontryagin) / minimum principle
Based on state space models
Min
S.t.
is given
General nonlinear control problem
![Page 3: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/3.jpg)
3
Special Case of
• Minimum fuel:
• Minimum time:
• Max range :
• Quadratic loss:
Analytical solution if state equation is linear, i.e.,
![Page 4: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/4.jpg)
4
“Linear Quadratic” problem - LQP• Note is not solvable in a realistic sense ( is
unbounded), thus need control weighting in • E.g., • is a tuning parameter (affects overshoot)
![Page 5: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/5.jpg)
5
Ex. Maximize conversion in exit of tubular reactor
: Concentration
: Residence time parameter
In other cases, when and are deviation variables,
Objective function does not directly relate to profit
(See T. F. Edgar paper in Comp. Chem. Eng., Vol 29, 41 (2004))
![Page 6: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/6.jpg)
6
• Initial conditions
(a) , or
Set point change, is the desired
(b) , impulse disturbance,
(c) , model includes disturbance term
![Page 7: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/7.jpg)
7
Other considerations: “open loop” vs. “closed loop”
• “open loop”: optimal control is an explicit function of time,
depends on -- “programmed control”
• “closed loop”: feedback control, depends on , but not on .
e.g.,
Feedback control is advantageous in presence of noise,
model errors.
Optimal feedback control arises from a specific optimal
control problems, the LQP.
![Page 8: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/8.jpg)
8
Derivation of Minimum Principle
,
have continuous 1st partial w.r.t.
Form Lagrangian
Multipliers: adjoint variables, costates
![Page 9: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/9.jpg)
9
• Define (Hamiltonian)
()
• Since is Lagrangian, we treat as unconstrained problem with variables: , ,
• Use variations: , , (for => original constraint, the state equation.)
![Page 10: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/10.jpg)
10
• Since , are arbitrary (), then
(n equations. “adjoint equation”)
, “optimality equation” for weak minimum
, (n boundary conditions)
If is specified, then
Two point boundary value problem (“TPBVP”)
![Page 11: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/11.jpg)
11
• Example:
(1st order transfer function)
LQP
,
(but don’t know yet)
![Page 12: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/12.jpg)
12
• Free canonical equations (eliminate )
(1) ( is known)
(2) ,
Combine (1) and (2),
for , initially correct to reduce
![Page 13: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/13.jpg)
13
• Another example:
(double integrator)
![Page 14: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/14.jpg)
14
• Free canonical equations
(, coupled)
Char. Equation:
(4 roots, apply boundary condition)
![Page 15: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/15.jpg)
15
• Can motivate feedback control via discrete time, one step ahead
Set , ( fixed)
Feedback control
![Page 16: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/16.jpg)
16
Continuous Time LQP
,
,
()
![Page 17: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/17.jpg)
17
• Free canonical equations
( given)
( given)
Let (Riccati transformation)
, let (feedback control)
Then we have ODE in
(1)
(2)
![Page 18: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/18.jpg)
18
Substitute Eq. (1) into Eq. (2):
(Riccati ODE)
( backward time integration)
At steady state, for , solve steady state equation.
is symmetric,
![Page 19: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/19.jpg)
19
• Example
,
, ,
Plug into Riccati Equation (Steady state)
Feedback Matrix:
![Page 20: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/20.jpg)
20
• Generally 3 ways to solve steady state Riccati Equation:
(1) integration of ode’s steady state;(2) Newton-Raphson (non linear equation solver);(3) transition matrix (analytical solution).
![Page 21: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/21.jpg)
21
• Transition matrix approach
Reverse time integration (Boundary Condition: at ):
Let
When ,
Partition exponential
![Page 22: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/22.jpg)
22
(1)
(2)
Combine (1) and (2), factor out
Fix integration , is fixed
Boundary condition:
Backward time integration of , then forward time integration
![Page 23: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/23.jpg)
23
Integral Action (eliminate offset)
• Add terms or to objective function
Example:
Augment state equation
(new state variable)
(new control variable)
Calculate feedback control
Integrate:
![Page 24: Optimal control](https://reader033.vdocuments.site/reader033/viewer/2022061514/56815ab3550346895dc8665a/html5/thumbnails/24.jpg)
24
• Second method:
;
Optimal control:
With more state variables, PID controller