A new approach for searching of extremal controls in nonlinear problems of optimization of control functions and parameters of dynamical systems is considered on basis of the solution of special fixed point problems for constructed operators in the space of controls. Approbation and comparative analysis of the developed approach is carried out within the framework of the known Zermelo problem.
A common approach to solving optimal control problems is to search for controls that satisfy the necessary [Pontrjagin et al., 1976]-[Vasilev, 1994] or sufficient [Gurman et al., 1987]-[Baturin & Urbanovich, 1997] optimality conditions. In this case, the classical approach consists in constructing a boundary value problem of the maximum principle, the difficulties of solving which are well known [Pontrjagin et al., 1976],[Ashepkov et al., 1984]. Another approach consists in successively solving the problems of local improvement, as a result of which a relaxation sequence of controls is constructed, converging under certain conditions to extremal control. This type includes, for example, known gradient methods [Ashepkov et al., 1984],[Vasilev, 1994]. In [Gurman et al., 1987]-[Srochko, 2000], prospective nonlocal methods for improving control based on non-standard approximations of problem functionals are proposed. The higher quality of the functional approximations, compared with the standard ones, makes the non-local methods more effective.
In [Srochko, 2000], in the classes of linear and quadratic optimal control problems, formulas for the increment of the functionals of problems that do not contain the remainder terms of the expansions are constructed. The complexity of one improvement in control is determined by solving a special Cauchy problem for phase or conjugate variables. The constructed nonlocal methods are characterized by the fact that improvement of control is guaranteed not only in a sufficiently small neighborhood of the improved control, in contrast to local methods such as gradient ones. The methods do not contain a procedure for searching for improving control in a sufficiently small neighborhood of the improved control and have the opportunity to improve non-optimal controls that satisfy the maximum principle. On the basis of the methods, new necessary optimality conditions are obtained, which strengthen the maximum principle in the classes of problems under consideration.
In [Buldaev, 2008]-[Buldaev & Khishektueva, 2013], the nonlocal approach [Srochko, 2000], based on the construction of formulas for the increment of functionals without residual terms of the expansions, was developed and generalized to problems that are polynomial with respect to state and general nonlinear optimal control problems. In this case, the construction of formulas for the increment of the functionals of problems without residual terms of the expansions is achieved by means of differential-algebraic modifications of the standard conjugate system. The complexity of one improvement in control is determined by solving a special boundaryvalue problem in the state space or an equivalent operator equation in control space interpreted as a fixed point problem for a special control operator.
Standard methods for the numerical solution of boundary value problems of the maximum principle and special boundary value problems of improving control (the shooting method, the linearization method, the finite-difference method), even in the case of smoothness and uniqueness of the right-hand parts of problems, as a rule, are computationally unstable due to the presence of positive real values of the eigenvalues of the corresponding Jacobi matrix. These problems can be resolved by proceeding to the solution of equivalent operator equations in the space of controls interpreted as the fixed point problems for constructed control operators [Buldaev, 2016],[Buldaev, 2017]. The proposed approach for searching for extremal controls makes it possible to apply the developed theory and fixed-point methods.
In this paper, the nonlocal approach being developed is illustrated in an important class for applications of optimization of non-linear systems with respect to control functions and parameters. 2
In a generalized form, the class of problems under consideration is represented in the following form: Φ(σ) = φ(x(t1), ω) + ∫
T
F (x(t), u(t), ω, t)dt → inf , 2Ω x˙ (t) = f (x(t), u(t), ω, t), x(t0) = a, u(t) ∈ U, ω ∈ W, a ∈ A, t ∈ T = [t0, t1], in which x(t) = (x1(t), ..., xn(t)) – state vector, u(t) = (u1(t), ..., um(t)) – vector of control functions, ω = (ω1, ..., ωl) a = (a1, ..., an) - vectors of control parameters. Sets U ⊆ Rm, W ⊆ Rl, A ⊆ Rn are compact and convex. Interval T is fixed. As admissible control functions, we consider a set V of piecewise-continuous functions on T with values in the set U . σ = (u, ω, a) - admissible control with values in the set Ω = V × W × A. The function φ(x, ω) is continuously differentiable on Rn × W . Functions F (x, u, ω, t), f (x, u, ω, t) and their partial derivatives with respect to x, u, ω are continuous in the set of arguments on the set Rn × U × W × T .
The Pontryagin function with the conjugate variable ψ ∈ Rn and the standard conjugate system have the form:
H(ψ, x, u, ω, t) = ⟨ψ, f (x, u, ω, t)⟩ − F (x, u, ω, t), ψ˙ (t) = −Hx(ψ(t), x(t), u(t), ω, t), t ∈ T, ψ(t1) = −φx(x(t1), ω).
For an admissible control σ ∈ Ω we denote x(t, σ), t ∈ T - the solution of the system (2); ψ(t, σ), t ∈ T - the solution of the standard conjugate system (3) for x(t) = x(t, σ) and the arguments u, ω, corresponding to the control components σ.
In [Buldaev, 2016],[Buldaev, 2017], the conditions for improving and optimizing control in the form of fixedpoint problems are constructed on the basis of operations on the maximum of Pontryagin’s control function and on the basis of control design operations on an admissible set of values.
The necessary conditions for optimal control in problem (1), (2) in the form of the maximum principle [Buldaev, 2016] have the form: u(t) = arg max H(ψ(t, σ), x(t, σ), u˜, ω, t), t ∈ T,
u˜2U ω = arg max !˜2W ⟨ −φ!(x(t1, σ), ω) + ∫
T
⟩
H!(ψ(t, σ), x(t, σ), u(t), ω, t)dt, ω˜ , a = arg ma˜2aAx ⟨ψ(t0, σ), a˜⟩ .
Weakened necessary conditions (the differential maximum principle) by means of the projection operator PY on the set Y ⊂ Rk in the Euclidean norm
PY (z) = arg my2iYn(∥y − z∥), z ∈ Rk can be represented [Buldaev, 2017] in the following projection form with the parameter α > 0: u(t) = PU (u(t) + αHu(ψ(t, σ), x(t, σ), u(t), ω, t)), t ∈ T, ω = PW (ω + α(−φ!(x(t1, σ), ω) +
H!(ψ(t, σ), x(t, σ), u(t), ω, t)dt)), ∫
T a = PA(a + αψ(t0, σ)).
Conditions (4) - (6) and (7) - (9) are considered as fixed point problems of the maximum principle in control space for a uniquely determined operator defined by right-hand sides of these conditions. The methods proposed in this paper for the search for extremal controls consist in solving the fixed point problems under consideration. 3
We consider an arbitrary operator G : Z → Z, acting on a set Z in a complete normed space with norm ∥·∥z.
To solve the fixed-point problem
v = G(v), v ∈ Z vk+1 = G(vk), v0 ∈ Z. it is possible to apply the method of successive approximations known in computational mathematics and its modifications [Samarskiy & Gulin, 1989]. In particular, the method of simple iteration for k ≥ 0, having the form:
To improve the convergence of the iterative process, problem (10) can be transformed to an equivalent fixedpoint problem with parameter δ ∈ R (7) (8) (9) (10) (11) on the basis of which the modification of the iteration process (11) is constructed:
v = v + δ(v − G(v)), v ∈ Z, δ ̸= 0, vk+1 = vk + δ(vk − G(vk)), v0 ∈ Z, δ ̸= 0.
When choosing a parameter δ ̸= 0, it is possible to regulate the convergence of the modification of the simple iteration method under consideration.
The fixed-point problems of the maximum principle (4) - (6), (7) - (9) generate the corresponding simple iteration methods. In particular, for the solution of the fixed point problem of the differential maximum principle (7) - (9), the following iterative process for k ≥ 0 with initial control σ0 ∈ Ω can be used: uk+1(t) = PU (uk(t) + αHu(ψ(t, σk), x(t, σk), uk(t), ωk, t)), t ∈ T, ωk+1 = PW (ωk + α(−φ!(x(t1, σk), ωk) +
H!(ψ(t, σk), x(t, σk), uk(t), ωk, t)dt)), ∫
T ak+1 = PA(ak + αψ(t0, σk)).
To analyze the convergence of the iterative processes under consideration to solutions of fixed point problems for sufficiently small design parameters, the known principle of contracting mappings is applied [Buldaev, 2008],[Buldaev, 2016]. 4
Many problems of optimal control with non-fixed time control of changing the time variable can be reduced to a class of optimization problems for control functions and parameters with a fixed time to which the proposed fixed point methods can be applied. Let us demonstrate this approach on a specific model problem with non-fixed time.
In [Gornov, 2009], the well-known optimal speed problem (Zermelo problem) is reduced by the penalty method to the following optimal control problem with non-fixed control time: x˙ 1 (t) = cos x3 (t) ,
x˙ 2 (t) = sin x3 (t) , x˙ 3 (t) = u (t) , x1 (0) = 0, x2 (0) = 0, x3 (0) = 0, Making the replacement of time by rule this problem reduces to a problem with a fixed time:
t ∈ [0, t1] , |u (t)| ≤ 0, 5.
G (u) = t1 + 1000 (x1 (t1) − 4)2 + (x2 (t1) − 3)2) → min .
( t (τ ) = t0 + (t1 − t0) τ = ωτ, τ ∈ [0, 1] ,
ω = t1 ≥ 0, v (τ ) = u (t (τ )) , y (τ ) = x (t (τ )) ,
σ = (v, w) , y˙1 (τ ) = ω cos y3 (τ ) ,
y˙2 (τ ) = ω sin y3 (τ ) , y˙3 (τ ) = ωv (τ ) ,
For an admissible control σ = (v, ω) ∈ Ω, we denote ψ(τ, σ), τ ∈ [0, 1] - the solution of the conjugate system for y(τ ) = y(τ, σ) and with the corresponding components v, ω.
The fixed point problem of the differential maximum principle in the projection form according to the rule (7) - (9) takes the form:
To realize the obtained fixed point problem, the following explicit iterative process is considered for k ≥ 0 with a given initial approximation σ0 = (v0, ω0) ∈ Ω: v (τ ) = PU (v (τ ) + αωψ3 (τ, σ)) , τ ∈ [0, 1] ,
( ( ∫ 1 ω = PW ω + α −1 +
(ψ1 (τ, σ) cos y3 (τ, σ) + 0 +ψ2 (τ, σ) sin y3 (τ, σ) + ψ3 (τ, σ) v (τ )) dτ )) , α > 0.
vk+1 (τ ) = PU (vk (τ ) + αωψ3 (τ, σk)), τ ∈ [0, 1] , ωk+1 = PW
ωk + α ( ( −1 + ∫ 1 0
(ψ1 (τ, σk)cos y3 (τ, σk)+ +ψ2 (τ, σk)sin y3 (τ, σk)+ ψ3 (τ, σk)vk (τ ))dτ )), α > 0.
The numerical solution of the phase and conjugate Cauchy problems was carried out by the fifth-order or sixthorder Runge-Kutta-Werner method using the Fortran PowerStation 4.0 IMSL library. The values of controllable, phase and conjugate variables were memorized at the nodes of a fixed uniform grid with a discretization step ∆τ = 10 3. In the intervals between neighboring grid nodes, the value of the control function was assumed constant and equal to the value in the left node. A numerical calculation of the fixed point problem was carried out until the condition was satisfied
Φ (σk+1)− Φ (σk) ≤ Φ (σk) · ε, where ε > 0 is the specified accuracy of the calculation. In the quality ε > 0, the value of the “machine epsilon” calculated according to [Forsyth et al., 1980] was chosen, which turned out to be equal 10 16 when calculating with double-precision variables.
Table 1 gives the comparative results of the calculation of the Zermelo problem under consideration by the proposed fixed-point method (FPM) with methods [Gornov, 2009], which in the indicated work are conventionally designated by numbers from 1 to 8. Φ 5,85 5,26 5,13 5,18 5,26 6,41 5,33 5,11 5,117
In the table Φ - the calculated value of the functional, N - the number of calculated phase and conjugate Cauchy problems.
Table 2 shows the results of the calculation of the FPM algorithm for various values of the projection parameter and the initial permissible approximation σ0 = (v0, ω0) ∈ Ω.
The calculations showed that the algorithm does not converge for α > 10 5. When the value α is lower 10 5, the convergence of the algorithm slows down significantly and the number of computed Cauchy problems increases accordingly. The computational efficiency of the algorithm, estimated by the number of computed Cauchy problems, depends significantly on the choice of the initial approximation.
The projection method of fixed points for the calculation of the Zermelo model problem is characterized by a relatively high computational efficiency, a sufficiently wide range of convergence of the iterative algorithm with respect to the initial approximation and the ease of adjusting the projection parameter determining the rate of convergence of the iterative process. 5
The proposed fixed-point methods for searching for extremal controls do not guarantee relaxation by the objective functional, in contrast to the gradient methods, but compensate for this property by the nonlocality of successive
N 70619 control approximations due to the fixed design parameter; the absence of an operation of varying the control in the neighborhood of the current approximation; obtaining the necessary conditions for the optimality of control in a new constructive form of the fixed point problems of the control operators defined in the class of problems under consideration, which makes it possible to effectively apply the well-known apparatus of fixed-point theory and methods to search for extremal controls.
The projection method of fixed points is characterized by the fact that the extremal controls are determined by the solutions of the corresponding fixed point problem for any value of the design parameter α > 0. In particular, for sufficiently small α > 0, for which convergence of the constructed iterative processes of successive approximations to solutions of fixed point problems is provided.
The main difference between the projection method of fixed points and the standard method of gradient projection is that the design parameter α > 0 is fixed in the iterative process of successive approximations. In the gradient projection method, this parameter varies at each iteration to provide improvement of control.
In general, the optimization of controls based on the calculation of the constructed fixed point problems by iterative methods of successive approximations reduces to computationally stable calculation of alternating Cauchy problems for phase and conjugate variables.
These properties of the proposed fixed point methods are important factors in improving the computational and qualitative efficiency of solving optimal control problems and determine the perspective direction of the development of optimization methods for nonlinear dynamical systems.
Acknowledgements This work has been supported by the Russian Foundation for Basic Research, project 15-01-03680-a; The Ministry of Education and Science of the Russian Federation, draft 1.5049.2017 / Basic Part.