An optimal control problem for discrete systems is considered. A method of successive improvements along with its modernization based on the expansion of the main structures of the core algorithm about the parameter is suggested. The idea of the method is based on local approximation of attainability set, which is described by the zeros of the Bellman function in the special problem of optimal control. The essence of the problem is as follows: from the end point of the phase is required to find a path that minimizes functional deviations of the norm from the initial state. If the initial point belongs to the attainability set of the original controlled system, the value of the Bellman function equal to zero, otherwise the value of the Bellman function is greater than zero. For this special task Bellman equation is considered. The support approximation and Bellman equation are selected. The Bellman function is approximated by quadratic terms. Along the allowable trajectory, this approximation gives nothing, because Bellman function and its expansion coefficients are zero. We used a special trick: an additional variable is introduced, which characterizes the degree of deviation of the system from the initial state, thus it is obtained expanded original chain. For the new variable initial nonzero conditions is selected, thus obtained trajectory is lying outside attainability set and relevant Bellman function is greater than zero, which allows it to hold a non-trivial approximation. As a result of these procedures algorithms of successive improvements is designed. Conditions for relaxation algorithms and conditions for the necessary conditions of optimality are also obtained.

MSC

49J15

DOI

https://doi.org/10.26516/1997-7670.2017.19.75

1. Baturin V.A., Goncharova E.V. An improvement method based on an approximate representation of the attainable set. A relaxation theorem. Avtomat. i Telemekh., 1999, no 11, pp. 19-29(in Russian).

2. Goncharova E.V., Baturin V.A. An iterative method for solving discrete problems of optimal control. Computational Technologies, 2003, vol. 8, pp. 269-275 (in Russian).

3. Gurman V.I., Konstantinov G.N. Attainability sets of control systems. The relation with the Bellman equation. All-Russian Institute for Scientific and Technical Information, 1981, no 4038-81 (in Russian).

4. Gurman V.I., Baturin V.A. Improved algorithm based on estimates for attainability set. All-Russian Institute for Scientific and Technical Information, 1985, no 651-85 (in Russian).

5. Gurman V.I. Printsip rasshireniya v zadachakh upravleniya [The Extension Principle in Control Problems], 2nd edition. Moscow, Fizmatlit, 1997 (in Russian).

6. Gurman V.I., Rasina I.V. Sufficient optimality conditions in hierarchical models of nonuniform systems. Automation and Remote Control, 2013, vol. 74, issue 12, pp. 1935-1947.

7. Gurman V.I., Rasina I.V., Fesko O.V., Usenko O.V. Methods for improving the control of hierarchical models of systems with network structure. Izv. Irkutsk. Gos. Univ. Ser. Mat., 2014, vol. 8, pp. 71-85 (in Russian).

8. Konstantinov G.N. Normirovanie vozdeystviy na dinamicheskie sistemy [Rationing effects on dynamic systems]. Irkutsk, Irkutsk State Univ., 1983 (in Russian).

9. Krotov V. F., Bulatov A. V., Baturina O. V. Optimization of linear systems with controllable coefficients. Automation and Remote Control, 2011, vol. 72, issue 6, pp. 1199-1212.

10. Lotov A.V. On the concept of generalized attainability sets and their construction for a linear control system. Doklady Academy of Sciences, 1980, no 5, pp. 1081-1083 (in Russian).

11. Baturin V.A., Goncharova E.V. An optimal control algorithm based on reachability set approximation and linearization. Autom. Remote Control, 2002, vol. 63, issue 7, pp. 1043-1050.

12. Pescvardi Т., Arenda K.S. Reachable sets for linear dynamic systems. Inform. and Control, 1971, vol. 19, no 4, pp. 319-344.

13. Vinter R. A characterization of the reachable set for nonlinear control systems. Siam J. Contr. and Optim., 1980, vol. 18, no 6, pp. 599-610.