Feedback Minimum Principle for Impulsive Processes
We consider an optimal impulsive control problem with a terminal functional and trajectories of bounded variation. The control system we consider has a bilinear structure with respect to the state and control variables and is governed by nonnegative vector Borel measures under constraints on their total variation. This problem is the impulsive-trajectory extension for the corresponding classical optimal control problem, which, in general, does not have optimal solutions with measurable controls. We do not posit any commutativity assumptions guaranteeing the well-posedness property for the impulsive extension. The so-called singular space-time transformation is used to define an individual trajectory and transform the impulsive system to an auxiliary ordinary control system.
The aim of this paper is to prove a nonlocal necessary optimality condition for impulsive processes. This condition is based on feedback controls providing descent directions for the functional. This necessary condition is called the feedback minimum principle. It is a generalization of the corresponding principle for classical optimal control problems. The feedback minimum principle is formulated within the framework of the generalized maximum principle for impulsive processes. An example illustrating the optimality condition is considered.
Vladimir A. Dykhta, Dr. Sci. (Phys.–Math.), Head of the Optimal Control Laboratory, Matrosov Institute for System Dynamics and Control Theory SB RAS, 134, Lermontov st., Irkutsk, 664033, Russian Federation, tel.: (3952)453036, e-mail: email@example.com
Olga N. Samsonyuk, Cand. Sci. (Phys.–Math.), Senior Research Scientist, Matrosov Institute for System Dynamics and Control Theory SB RAS, 134, Lermontov st., Irkutsk, 664033, Russian Federation, tel.: (3952)453151, e-mail: firstname.lastname@example.org
1. Gurman V.I. Vyrozhdennye zadachi optimal’nogo upravleniya [Degenerate problems of optimal control]. Moscow, Nauka Publ., 1977, 304 p. (in Russian)
2. Dykhta V.A. Weakly monotone solutions of the Hamilton-Jacobi inequality and optimal conditions with positional controls. Autom. Remote Control, 2014, vol. 75, no. 5, pp. 829–844. (in Russian). https://doi.org/10.1134/S0005117914050038
3. Dykhta V.A. Nonstandard duality and nonlocal necessary optimality conditions in nonconvex optimal control problems. Autom. Remote Control, 2014, vol. 75, no. 11, pp. 1906–1921. (in Russian). https://doi.org/10.1134/S0005117914110022
4. Dykhta V.A. Variational necessary optimality conditions with feedback descent controls for optimal control problems. Doklady Mathematics, 2015, vol. 91, no. 3, pp. 394–396. (in Russian). https://doi.org/10.1134/S106456241503031X
5. Dykhta V.A., Samsonyuk O.N. Optimal’noe impul’snoe upravlenie s prilozheniyami [Optimal impulsive control with applications]. Moscow, Fizmatlit Publ., 2000, 256p. (in Russian)
6. Dykhta V.A., Samsonyuk O.N. Optimal’noe impul’snoe upravlenie s prilozheniyami [Hamilton-Jacobi inequalities and variational optimality conditions]. Irkutsk, Irkutsk State University Publ., 2015, 150 p. (in Russian)
7. Zavalishchin S.T., Sesekin A.N. Impul’snye processy: modeli i prilozhenija [Impulsive processes: models and applications]. Moscow, Nauka Publ., 1991, 256 p. (in Russian)
8. Krotov V.F., Gurman V.I. Metody i zadachi optimal’nogo upravleniya [Methods and problems of optimal control]. Moscow, Nauka Publ., 1973, 448 p. (in Russian)
9. Miller B.M. Optimality condition in the control problem for a system described by a measure differential equation. Autom. Remote Control, 1982, vol. 43, no. 6, part 1, pp. 752–761.
10. Miller B.M. Conditions for the optimality in problems of generalized control. I, II, Autom. Remote Control, 1992, vol. 53, no. 3, part 1, pp. 362–370; no. 4, pp. 505–513.
11. Miller B.M. Method of discontinuous time change in problems of control of impulse and discrete-continuous systems. Autom. Remote Control, 1993, vol. 54, no. 12, part 1, pp. 1727–1750.
12. Miller B.M., Rubinovich E.Ya. Optimizatsiya dinamicheskikh sistem s impul’snymi upravleniyami [Optimization of dynamic systems with impulsive controls]. Moscow, Nauka Publ., 2005. 430 p. (in Russian)
13. Miller B.M., Rubinovich E.Ya. Discontinuous solutions in the optimal control problems and their representation by singular space-time transformations. Autom. Remote Control, 2013, vol. 74, no. 12, pp. 1969–2006. (in Russian). https://doi.org/10.1134/S0005117913120047
14. Samsonyuk O.N. Monotonicity of Lyapunov type functions for impulsive control systems. The Bulletin of Irkutsk State University. Series Mathematics, 2014, vol. 7, pp. 104–123. (in Russian).
15. Samsonyuk O. Invariant sets for nonlinear impulsive control systems. Autom. Remote Control, vol. 76, no. 3, pp. 405–418. (in Russian). https://doi.org/10.1134/S0005117915030054
16. Filippova T.F. Differential equations for ellipsoidal estimates for reachable sets of a nonlinear dynamical control system. Proceedings of the Steklov In- stitute of Mathematics, 2010, vol. 271, no. S1, pp. 75–84. (in Russian). https://doi.org/10.1134/S0081543810070072
17. Arutyunov A.V., Karamzin D.Yu., Pereira F.L. On constrained impulsive con- trol problems. J. Math. Sci., 2010, vol. 165, pp. 654–688. (in Russian). https://doi.org/10.1007/s10958-010-9834-z
18. Bressan A., Rampazzo F. Impulsive control systems without commutativity assumptions. Optim. Theory Appl., 1994, vol. 81, no. 3, pp. 435–457. https://doi.org/10.1007/BF02193094
19. Clarke F.H., Ledyaev Yu.S., Stern R.J., Wolenski P.R. Nonsmooth analysis and control theory. Springer-Verlag, New York, 1998, 277 p.
20. Daryin A.N., Kurzhanski A.B. Dynamic programming for impulse control. Ann. Reviews in Control, 2008, vol. 32, pp. 213–227.
21. Dykhta V., Samsonyuk O. Applications of Hamilton-Jacobi inequalities for classical and impulsive optimal control problems. European Journal of Control, 2011, vol. 17, pp. 55–69. https://doi.org/10.3166/EJC.17.55-69
22. Fraga S.L., Pereira F.L. On the feedback control of impulsive dynamic systems, In: 47th IEEE Conference on Decision and Control, 2008, pp. 2135–2140.
23. Karamzin D.Yu. Necessary conditions of the minimum in impulsive control problems with vector measures. J. of Math. Sci., 2006, vol. 139, pp. 7087–7150. https://doi.org/10.1007/s10958-006-0408-z
24. Miller B.M. The generalized solutions of nonlinear optimization problems with impulse control. SIAM J. Control Optim., 1996, vol. 34, pp. 1420–1440. https://doi.org/10.1137/S0363012994263214
25. Motta M., Rampazzo F. Space-time trajectories of nonlinear systems driven by ordinary and impulsive controls. Differential Integral Equations, 1995, vol. 8, pp. 269–288.
26. Pereira F.L., Silva G.N. Necessary conditions of optimality for vector-valued impulsive control problems. Syst. Control Lett., 2000, vol. 40, pp. 205–215. http://dx.doi.org/10.1016/S0167-6911(00)00027-X
27. Sorokin S., Staritsyn M. Feedback necessary optimality conditions for a class of terminally constrained state-linear variational problems inspired by impulsive control. Numerical Algebra, Control and Optimization, 2017, vol. 7, no. 2, pp. 201–210. https://doi.org/10.3934/naco.2017014
28. Vinter R.B., Pereira F.L. A maximum principle for optimal processes with discontinuous trajectories. SIAM J. Control Optim., 1988, vol. 26, no. 1, pp. 205–229. https://doi.org/10.1137/0326013