«THE BULLETIN OF IRKUTSK STATE UNIVERSITY». SERIES «MATHEMATICS»
«IZVESTIYA IRKUTSKOGO GOSUDARSTVENNOGO UNIVERSITETA». SERIYA «MATEMATIKA»
ISSN 1997-7670 (Print)
ISSN 2541-8785 (Online)

List of issues > Series «Mathematics». 2025. Vol 51

Exact Formulas for the Increment of the Cost Functional in Optimal Control of Linear Balance Equation

Author(s)
Elena V. Goncharova1, Nikolay I. Pogodaev1, Maksim V. Staritsyn1

1Matrosov Institute for System Dynamics and Control Theory of SB RAS, Irkutsk, Russian Federation

Abstract
We study a state-linear optimal control problem for a transport equation with a source term in the space of finite signed Borel measures. For this problem, a version of the classical Pontryagin principle (in the form of the minimum principle) is obtained for the first time. In addition, we propose an approach to enhance the latter based on a certain unconventional procedure of variational analysis, namely, on exact increment formulas, representing the difference in values of the objective functional for any pair of admissible controls, without neglecting residual terms of any expansion. The approach relies on the standard duality and results in a series of necessary optimality conditions of a non-classical, “feedback” type. A constructive consequence of the feedback optimality conditions is a method of successive approximations, devoid of any parameters of “descent depth”.
About the Authors

Elena V. Goncharova, Cand. Sci. (Phys.-Math.), Leading Researcher, Matrosov Institute for System Dynamics and Control Theory SB RAS, Irkutsk, 664033, Russian Federation, goncha@icc.ru

Nikolay N. Pogodaev, Cand. Sci. (Phys.-Math.), Leading Researcher, Matrosov Institute for System Dynamics and Control Theory SB RAS, Irkutsk, 664033, Russian Federation, nickpogo@gmail.com

Maksim V. Staritsyn, Cand. Sci. (Phys.-Math.), Leading Researcher, Matrosov Institute for System Dynamics and Control Theory SB RAS, Irkutsk, 664033, Russian Federation, starmax@icc.ru

For citation

Goncharova E. V., Pogodaev N. I., Staritsyn M. V. Exact Formulas for the Increment of the Cost Functional in Optimal Control of Linear Balance Equation. The Bulletin of Irkutsk State University. Series Mathematics, 2025, vol. 51, pp. 3–20. (in Russian)

https://doi.org/10.26516/1997-7670.2025.51.3

Keywords
nonlocal balance law, optimal control, feedback control, necessary optimality conditions, numerical algorithms
UDC
517.977
MSC
49J20
DOI
https://doi.org/10.26516/1997-7670.2025.51.3
References
  1. Ambrosio L., Gigli N., Savare G. Gradient Flows: In Metric Spaces and in the Space of Probability Measures. Lectures in Mathematics ETH Zurich. Birkhauser, Boston, 2005.
  2. Ambrosio L., Mainini E., Serfaty S. Gradient flow of the Chapman-RubinsteinSchatzman model for signed vortices. Ann. Inst. H. Poincar´e Anal. Non Lin´eaire, 2011, vol. 28, no. 2, pp. 217–246. https://doi.org/10.1016/j.anihpc.2010.11.006
  3. Antonik V.G., Srochko V.A. The projection method in linear-quadratic problems of optimal control. Comput. Math. Math. Phys. 1998, vol. 38, no. 4, pp. 543–551. [Transl. from Russian (Zh. Vychisl. Mat. Mat. Fiz., 1998, vol. 38, no. 4, pp. 564– 572)]
  4. Arguchintsev A.V., Dykhta V.A., Srochko V.A. Optimal control: nonlocal conditions, computational methods, and the variational principle of maximum. Russian Math.. 2009, vol. 53, no. 1, pp. 1–35. https://doi.org/10.3103/S1066369X09010010 [Transl. from Russian (Izv. Vyssh. Uchebn. Zaved. Mat., 2009, no. 1, pp. 3–43)]
  5. Arguchintsev A.V., Poplevko V.P. Optimal control of initial conditions in canonical hyperbolic system of the first order based on nonstandard increment formulas. Russian Math., 2008, vol. 52, no. 1, pp. 1–7. https://doi.org/10.3103/S1066369X08010015 [Transl. from Russian (Izv. Vyssh. Uchebn. Zaved. Mat., 2008, no. 1, pp. 3–10)]
  6. Aubin J. P., Cellina, A. Differential Inclusions. Set-Valued Maps and Viability Theory. Springer-Verlag, Berlin-Heidelberg-New York-Tokyo, 1984.
  7. Aubin J. P., Frankowska H. Set-valued Analysis. Set-Valued Analysis. Birkhauser, Boston, 1990.
  8. Averboukh Y. Nonlocal Balance Equation: Representation and Approximation of Solution. J. Dyn. Diff. Equat., 2024. https://doi.org/10.1007/s10884-024-10373-8
  9. Averboukh Y., Khlopin D. Pontryagin maximum principle for the deterministic mean-field type optimal control problem via the Lagrangian approach, 2022. https://doi.org/10.48550/arXiv.2207.01892
  10. Bongini M., Fornasier M., Rossi F., Solombrino F. Mean-field Pontryagin maximum principle. J. Optim. Theory Appl., 2017, vol. 175, pp. 1–38. https://doi.org/10.1007/s10957-017-1149-5
  11. Bonnet B. A Pontryagin maximum principle in Wasserstein spaces for constrained optimal control problems. ESAIM Control Optim. Calc. Var., 2019, vol. 25, no. 52. https://doi.org/10.1051/cocv/2019044
  12. Bonnet B., and Frankowska H. Necessary optimality conditions for optimal control problems in Wasserstein spaces. Appl. Math. Optim., 2021, vol. 84, pp. 1281–1330. https://doi.org/10.1007/s00245-021-09772-w
  13. Buldaev A.S. Projection procedures for the nonlocal improvement of linearly controlled processes. Russian Math.. 2004, vol. 48, no. 1, pp. 16–22. [Transl. from Russian (Izv. Vyssh. Uchebn. Zaved. Mat., 2004, no. 1, pp. 18–24)]
  14. Cardaliaguet P., Delarue F., Lasry J.-M., Lions P.-L. The master equation and the convergence problem in mean field games. Ann. Math. Stud., 2019, vol. 201, Princeton University Press, Princeton, NJ.
  15. Carrillo J. A., Fornasier M., Toscani G., Vecil F. Particle, kinetic, and hydrodynamic models of swarming. In Mathematical modeling of collective behavior in socio-economic and life sciences. Birkhauser, Boston, MA, 2010, pp. 297–336. https://doi.org/10.1007/978-0-8176-4946-3_12
  16. Colombo R.M., Herty M., Mercier M. Control of the continuity equation with a non local flow. ESAIM Control Optim. Calc. Var., 2011, vol. 17, no. 2, pp. 353–379. https://doi.org/10.1051/cocv/2010007
  17. Cristiani E., Frasca P., Piccoli B. Effects of anisotropic interactions on the structure of animal groups. Journal of mathematical biology, 2011, vol. 62, pp. 569–88. https://doi.org/10.1007/s00285-010-0347-7
  18. Cucker F., Smale S. Emergent behavior in flocks. IEEE Trans. Autom. Control, 2007, vol. 52, no. 5, 852–862. https://doi.org/10.1109/TAC.2007.895842
  19. Dykhta V.A. Feedback Minimum Principle: Variational Strengthening of the Concept of Extremality in Optimal Control. The Bulletin of Irkutsk State University. Series Mathematics, 2022, vol. 41, pp. 19–39. (in Russian) https://doi.org/10.26516/1997-7670.2022.41.19
  20. Krasovskii N.N., Subbotin A.I. Game-Theoretical Control Problems, Springer Verlag, Berlin, 1988.
  21. Mainini E. On the signed porous medium flow, Netw. Heterog. Media, 2012, vol. 7, no. 3, pp. 525–541. http://cvgmt.sns.it/paper/1902/
  22. Piccoli B., Rossi F. Measure-theoretic models for crowd dynamics. In Modeling and Simulation in Science, Engineering and Technology. Springer, Basel, 2018, pp. 137–165. https://doi.org/10.1007/978-3-030-05129-7_6
  23. Pogodaev N. Program strategies for a dynamic game in the space of measures. Optim. Lett., 2019, vol. 13, pp. 1913–1925. https://doi.org/10.1007/s11590-018-1318-y
  24.  Pogodaev N., Staritsyn M. Nonlocal balance equations with parameters in the space of signed measures. Sbornik: Mathematics, 2022, vol. 213, no. 1, pp. 69–94. https://doi.org/10.1070/sm9516
  25. Pogodaev N.I., Staritsyn M.V. Exact formulas for the increment of the objective functional and necessary optimality conditions, alternative to Pontryagin’s maximum principle. Matematicheskii Sbornik, 2024, vol. 215, iss. 6, pp. 77– 110. https://doi.org/10.4213/sm9967 (in Russian, to appear in Sbornik Mathematics)
  26. Pontryagin L.S., Boltyanskii V.G., Gamkrelidze R.V., Mishchenko E.F. The Mathematical Theory of Optimal Processes. New York, John Wiley and Sons, Inc., 1962. [Transl. from Russian (Fizmatgiz, Moscow, 1961)]
  27. Srochko V.A. Iterative methods for solving optimal control problems. Fizmatlit, Moscow, 2000 (in Russian).
  28. Staritsyn M., Pogodaev N., and Lobo Pereira. F. Linear-quadratic problems of optimal control in the space of probabilities. IEEE Control Systems Letters, 2022, vol. 6, pp. 3271–3276. https://doi.org/10.1109/LCSYS.2022.3184257
  29. Staritsyn M.V., Pogodaev N.I., Goncharova E.V. Pontryagin’s Maximum Principle and Indirect Descent Method for Optimal Impulsive Control of Nonlocal Transport Equation. The Bulletin of Irkutsk State University. Series Mathematics, 2023, vol. 46, pp. 66–84. (in Russian) https://doi.org/10.26516/1997-7670.2023.46.66

Full text (russian)