In this paper, a differential game based method is adopted for the aircraft trajectory tracking task in the presence of wind. Under this differential game based approach the trajectory tracking task for a given reference is formulated as a game between the aircraft controls (first player) and wind (second player). This method is integrated in a realistic flight simulator model including a nonlinear plant, actuator as well as sensor models by means of a cascaded control architecture. The controller, responsible for the rotation and attitude control, is based on the method of Nonlinear Dynamic Inversion (NDI). This controller is extended by a trajectory loop which allows to track reference trajectories under the consideration of external disturbances (wind) using the differential game based approach. The illustrative examples provided in this paper consider a realistic aircraft trajectory for the approach phase which, besides departure, can be considered one of the most critical phases of flight. The approach trajectory is determined based on the solution of an appropriate optimal control problem using a reduced model of the flight simulator. It is shown that the proposed approach can effectively be used for tracking trajectories without a-priori knowledge regarding the wind field.
? The work has been supported by the DFG grant TU427/2-2 and HO4190/8-2. ?? Copyright c 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
Tracking aircraft trajectories in adverse conditions, in particular under strong winds, can be considered a challenging task for aircraft control. This is especially critical during departure and the terminal phases of flight. First of all, these phases need to be performed in crowded airspace and ground proximity. Furthermore, they exhibit more dynamic maneuvers compared to other phases, such as cruise flight. Thus, robust tracking performance is vital for safe operation in these phases.
The investigation of methods for aircraft trajectory tracking has been the subject of numerous studies in the last decades (see e.g. [4, 7, 8, 11, 12, 14, 15]). In this paper, we follow a differential game based approach developed in [2, 10]. It is particularly noteworthy that this approach can be applied without prior knowledge regarding the disturbance (wind). We show that the application of this algorithm in a realisitic flight simulator model is feasible and yields good tracking performance in rather severe wind conditions. The effectiveness and general applicability of this method is demonstrated for an approach trajectory which starts after the alignment turn from the holding pattern and terminates at the end of the glide-slope. In this study the reference trajectory is determined through the solution of an optimal control problem which minimizes the fuel consumption using direct optimal control methods (cf. [1, 6]). This approach seems appealing as, even though, the primary goal of the trajectory tracking algorithm is to follow the reference as close as possible under adverse wind conditions the desired properties of the trajectory to be tracked are, to a certain extent, transferred to the control of the flight simulator.
This paper is structured as follows: First, the models used for the generation of optimal reference trajectories and the tracking algorithm are presented in Section 2. The following Section 3 describes the generation of a fuel optimal reference trajectory for the approach phase based on a multi-phase optimal control problem. In Section 4 the integration of the tracking algorithm with the NDI control architecture in a realistic flight simulator model is outlined. Finally, the approach is illustrated in Section 5 for tracking a reference trajectory in wind conditions. 2
The dynamics implemented in the flight simulator model represent a realistic regional transport aircraft model. This model consists of a plant model with detailed aerodynamic and propulsion models as well as actuator and sensor models. For the controller we use the control architecture described in [5, 9]. This architecture is based on a Nonlinear Dynamic Inversion (NDI) [13] controller with two cascaded loops, considering the attitude dynamics as middle loop and the rotation dynamics as the inner loop. Both loops feature reference dynamics of relative degree one which are modified by hedging signals and error controllers. These hedging signals represent the difference between the dynamics of the reference model and the expected reaction of the flight simulator model. It is noteworthy that in the implementation for this study we consider the Euler body angles as attitude states for the middle loop and the rotational body rates for the reference models of the innermost loop.
For the tracking algorithm and the generation of the optimal reference
trajectory a reduced model is derived which contains a simplified model of the
translational dynamics and the reference model of the middle (attitude) loop.
The state vector of the simplified model
x = [x, y, h, VK , γK , χK , ΦRM , ΘRM , ΨRM , T, M ]0 ,
(
For the propagation of the position states we use the kinematic relations x˙ uK,O cos(χK ) cos(γK ) y˙ = vK,O = ROK (VK )K = sin(χK ) cos(γK ) VK ,
− h˙ wK,O − sin(γK ) with (VK )K = [VK , 0, 0]0 and the transformation matrix ROK from the kinematic (K) frame to the NED (O) frame.
The propagation of the translational dynamics is expressed as
(
The propagation of the attitude states is performed using first order models for the Euler angles and the dynamic model for the thrust is approximated by a first order lag (time constant τT ) ˙ ΦRM = KΦ(VK , h)(uΦ − ΦRM ) ˙ ΘRM = KΘ(VK , h)(uΘ − ΘRM ) ˙ ΨRM = KΨ (VK , h)(uΨ − ΨRM )
T˙ = τT−1(uT − T ), where the gains KΦ(VK , h), KΘ(VK , h), and KΨ (VK , h) are scheduled over kinematic velocity VK and height h. Moreover, the control vector for the model is defined as u = [uΦ, uΘ, uΨ , uT ]0.
It should be mentioned that from an engineering point it is advisable to schedule these gains over the aerodynamic velocity VA and height h (or similar quantities such as the dynamic and static pressure). However, note that the aerodynamic velocity depends on the disturbance inputs v = (VW )O = [(uW )O , (vW )O , (wW )O]0 through the wind equation:
VA = kROK (VK )K − (VW )O k.
Here and below the notation k · k means the Euclidean norm. By taking the kinematic velocity instead of the aerodynamic velocity for scheduling the gains in the reference model this dependency is removed and the dynamics can be written in the form g
g˙ (x) ddt ct = ct˙˙((xx,, vu)) = f (x, u, v),
M
M˙ (x, v) with c = [ΦRM , ΘRM , ΨRM , T ]0, the disturbance vector v = (VW )O, and the control vector u. Moreover, the time derivative of the aircraft’s mass depends on the states and disturbances, i.e. is of the form ddt M = M˙ (x, v), and models the fuel consumption by the engines. This dynamic equation is rather complicated as it includes tabulated data and depends on quantities such as the Mach number, thrust level, and height, which however are not directly influenced by the controls. Thus, the right-hand side is additive regarding the influence of the control and the disturbance vector
f (x, u, v) = f u(x, u) + f v(x, v), which implies that the Isaacs saddle point condition [10] is automatically fulfilled min max `0f (x, u, v) = max min `0f (x, u, v).
u∈P v∈Q v∈Q u∈P
This property is desirable for the application of the differential game based
tracking algorithm described in [2]. For the approach trajectory two different
configurations are considered. The first configuration models the clean configuration
which is used for the regular operation and is expressed as
(
x˙ = f l(x, u, v).
the high lift devices and the gears (front and main gears) are deployed. This
configuration is used in the terminal part of the approach. The model structure (
Generation of Optimal Reference Trajectories In order to generate smooth reference trajectories an optimal control based approach is applied. This strategy is preferred as it does not only guarantee that the trajectory is in fact feasible regarding the aircraft dynamics but also allows for the consideration of a performance index and additional constraints. The reduced model introduced in Section 2 is employed to generate these trajectories. The whole time interval of the problem P = t(i), t(np) is split into np = 4 time intervals (phases)
P(i) := ht(i−1), t(i)i , i = 1, . . . , np,
(
The optimal control problem for the approach is defined as follows:
minimize
u(t) ∈ U
subject to
− M (t(
2 t ∈ [
i=1
t ∈ P(
P
(i), i = 0, . . . , np − 1,
Note that the optimal control problem is formulated for the nominal case
(without wind), i.e. v = 0. Moreover, the admissible control set U is defined by the
following inequalities:
(
0 % ≤ uT ≤ 100 %.
At the horizontal start position [x, y]0 = 0 m the aircraft with initial mass M0 is assumed to leave the alignment turn after the holding pattern with VK = 102.89 m/s at a course angle χK = 227◦ φ0(x) = [x, y, VK − 102.89 m/s, χK − 227◦, ΦRM , ΨRM − 227◦, M − M0]0 = 0, (19) and heads over the waypoint defined by
φ1(x) = [x + 23839 m, y + 11197 m, χK − 227◦]0 = 0, to the next waypoint imposed through: φ2(x) = [x + 25766 m, y + 73978 m, VK − 82.31 m/s, χK − 137◦]0 = 0. At this point, the aircraft switches from the clean configuration to the landing configuration. For the study considered in this paper this switch is assumed to happen instantaneously. In the last phase the aircraft in landing configuration intercepts the glide-slope with the following final boundary constraint φ3(x) = [x + 22956 m, y + 12592 m, VK − 72.02 m/s, χK − 82◦, γK + 3◦]0 = 0. (22) The numerical solution of the optimal control problem is achieved by a direct method using the optimal control toolbox Falcon.m 3 which discretizes the problem for each phase (index i) at time points: t(ji), j = 1, . . . , N (i) = 103. For the application under consideration a full discretization approach using the Backward Euler method is used which introduces equality constraints for the transcribed dynamics of the form x(ji+)1 − x(ji) − (tj+1 − tj ) f c/l x(ji+)1, u(ji+)1, 0 = 0.
Note that the optimal control problem (
P
(
P
(
P
(
2 xˆ(ti+1) = 3ai,i+1Δi,i+1 + 2bi,i+1Δi,i+1 + ci,i+1, with Δi,i+1 = si+1 − si, the optimal state values xˆ(ti) and d ds
xˆ(ti) = f (xˆ(ti), uˆ(ti), 0) /VK (ti). 4
Integration of the Tracking Approach in the Flight Simulator Model Within the closed-loop flight simulator model the tracking algorithm is executed at a sampling time δu in the outermost control loop. At the beginning of each tracking step the value of the traveled distance sk at a base-point on the reference trajectory, which is defined as the closest point to the position states, needs to be determined. This point is defined by the relation (31) with ζg(s) = [ζx(s), ζy(s), ζh(s)]0 which may by solved numerically in each step, e.g. using Newton type iterations. In order to facilitate the search for the basepoint a predictor-corrector scheme is used. First, a predictor is created by propagating the base-point from the last time step sk−1 s˜k = sk−1 + (tk − tk−1)
s(tk−1), d dt using d dt This predictor is corrected by at most 10 Newton-type steps using (31) starting with s˜k. The last iterate is then taken as the distance covered at the base-point sk in the current step.
Besides the current base-point ζk = ζ(sk), the base-point ζp = ζ(sp) at the end of the prediction horizon with the prediction time-step δp is required (see Alg. 1). Here, we assume that our control objective to closely follow the reference trajectory is, in fact, achievable which allows for the exact determination of the predicted base-point as sp = s(tk + δp).
The tracking algorithm uses a guide model (uW )O ∈ {−5 m/s, 5 m/s}, (vW )O ∈ {−5 m/s, 5 m/s}, (wW )O ∈ {−5 m/s, 5 m/s}. .
(32) (33) (34) (35) (36) w˙ = f c/l(w, u, v), which has exactly the form of the reduced model and is initialized as This guide model represents an auxiliary model which first chooses a disturbance at the current sampling time in order to remain close to the states of the primary model xk. Then it chooses a control to aim at the reference trajectory in the end of the current sampling interval (cf. [2, 10]). For the application to the flight simulator model it should be mentioned that the states xk of the primary model are taken as the measurements of the respective flight simulator states. The steps of the tracking algorithm are presented in Alg. 1.
For the application under consideration the admissible set Q of the wind disturbances v = [(uW )O, (vW )O, (wW )O]0 which are used to evaluate the maxoperator is defined by . Reset guide model, if tolerance 0 is exceeded
. Tracking algorithm . compute optimal wind . compute optimal control . propagate w with uˆ and v∗
Algorithm 1 Tracking 1: procedure Track(tk, ζp, xk, wk, δp, δu, 0) 2: if kxk − wkk > 0 then 3: wk ← xk 4: end if 5: v∗ ← arg max min(xk − wk)0f c/l(xk, u, v)
v∈Q u∈P 6: uˆ ← arg mu∈iPn kw(tk + δp; u, v∗) − ζpk 7: wk+1 ← wk + δuf c/l(xk, uˆ, v∗) 8: return wk+1, uˆ 9: end procedure Regarding the controls, the following procedure has shown to be effective for the application at hand: the input set P for each of the controls ui, i ∈ {Φ, Θ, Ψ, T } is restricted to values which are either the current value of the corresponding state (e.g. a good choice in case of a stationary flight condition), maximal or minimal dynamic limits u¯i and ui, or values ui− and ui+ leading to smaller incremental changes.
The dynamic limits are defined as ui = max{ui,min, zi − δui}, u¯i = min{ui,max, zi + δui}, (37) (38) and are bounded from below and above by the absolute limits ui,min and ui,max. Note that these dynamic limits are relative to the current value zi of the measured states corresponding to the respective control quantity, i.e. the roll angle zΦ = Φ, pitch angle zΘ = Θ, yaw angle zΨ = Ψ , and the thrust zT = T . The respective δ-values and the absolute (minimum and maximum) limits for all controls are defined in Table 1. Note that in Table 1 the minimum and maximum values for the roll angle (uΦ,min and uΦ,max) differ from the limits imposed in the optimal control problem (cf. (16)). This is contributed to the fact that in the case with wind the roll angle is observed to saturate during simulations which does not occur in the nominal case. As such, the limits uΦ,min and uΦ,max of the roll angle are increased to ±30◦ instead of ±25◦ in order to provide additional control authority for compensating the wind disturbance. The incremental changes are defined based on these dynamic limits as ui− = max{zi − (u¯i − ui) /10, ui}, ui+ = min{zi + (u¯i − ui) /10, u¯i}, (39) (40) i.e. at most a ±10% change regarding the dynamic limits w.r.t. the corresponding state value is allowed.
In particular, this choice of the controls appears to be less prone to the typical effect of control chattering, which is very often observed for differential game applications and is undesirable for most practical applications from an engineering viewpoint.
Let the optimal control returned from a step in the tracking procedure be denoted with uˆ = [uˆΦ, uˆΘ, uˆΨ , uˆT ]0. The optimal thrust command uˆT is directly fed to the engine model of the flight simulator. However, the optimal attitude commands uˆΦ, uˆΘ, and uˆΨ generated by the tracking procedure are used as reference command signal rΦΘΨ = [uΦ, uΘ, uΨ ]0 for the middle loop of the NDI controller in the flight simulator model. This controller uses a modified reference model with the states ΦˆRM , ΘˆRM and ΨRM . The structure of the modified ˆ reference model in the attitude loop of this NDI controller is illustrated in Fig. 2 rΦΘΨ uΦ Modified Reference Model Middle Loop Φ˙
Reference Model ˆ ΦRM Φ
PI Error Controller
KΦ KeP,Φ KeI,Φ
Hedging νh,Φ ˙ ˆ ΦRM νRM,Φ
R ˙ ΦRM,e
R νe,Φ νm
Fig. 2. Structure of the modified reference model for the attitude loop.
For the propagation of the modified reference model states we use with Φˆ˙RM Θˆ˙RM = νRM,Θ − νh,Θ , Ψˆ˙RM νRM,Ψ νh,Ψ νRM,Φ
νh,Φ νRM,Φ KΦ(h, VK )(uΦ − ΦˆRM )
ˆ νRM,Θ = KΘ(h, VK )(uΘ − ΘRM .
νRM,Ψ KΨ (h, VK )(uΨ − ΨˆRM )
(41)
(42)
(43)
(44)
(45)
(46)
Here, the gains KΦ(h, VK ), KΘ(h, VK ) and KΨ (h, VK ) are exactly the same gains
used for the attitude dynamics in the reduced model (cf. (
˙ νh,Ψ Ψ˙RM,e − Ψ˙ The pseudo commands Φ˙ RM,e, Θ˙ RM,e and Ψ˙RM,e in (43) are defined as the sum of the modified reference states dynamics and the error dynamics νe,Φ, νe,Θ and νe,Ψ : Φ˙ RM,e νRM,Φ νe,Φ
˙ νm = ΘRM,e = νRM,Θ + νe,Θ .
Ψ˙RM,e νRM,Ψ νe,Ψ The contribution from the error dynamics is defined as νe,Φ νe,Θ = KeP,Θ · (ΘˆRM − Θ) + KeI,Θ · R (ΘˆRM − Θ)dt , νe,Ψ KeP,Ψ · (ΨˆRM − Ψ ) + KeI,Ψ · R (ΨˆRM − Ψ )dt
KeP,Φ · (ΦˆRM − Φ) + KeI,Φ · R (ΦˆRM − Φ)dt where KeP,i i ∈ {Φ, Θ, Ψ } are the proportional and KeI,j j ∈ {Φ, Θ, Ψ } are the integral gains, respectively. The pseudo command νm of the middle loop is then used in the inverted strap-down equation
1 0 − sin(Θ) rpqr = 0 cos(Φ) sin(Φ) cos(Θ) νm,
0 − sin(Φ) cos(Φ) cos(Θ) to obtain the reference command rpqr for the rotational body rates p, q, and r. These commands are then fed to the inner loop, which has the same form illustrated in Fig. 2. Step responses for the Euler angle commands are provided in Fig. 3.
30 0 -30
0 20 10 0 -10 0 5 0 -5 0 5 5 5 This section shows numerical results of the trajectory tracking approach using the differential game based tracking method for the realistic flight simulator model. The simulation was performed with the Euler forward method and a step size of δs = 0.005 s. A sampling time of δu = 0.02 s, prediction time of δp = 2 s, and tolerance 0 = 0.01 was used to compute the optimal controls, see Alg. 1. For all states noisy measurements were used and the outputs of the flight simulator which need to be measured are estimated using an Extended Kalman Filter (EKF). The states considered for the tracking task are the position states x, y, and h as well as the kinematic velocity VK . A Dryden disturbance model [3] is used to test the implementation.
The comparison of the reference and the flight simulator trajectory are depicted in Fig. 4 and the wind velocities are presented in Fig. 5. The values of the individual trajectories regarding the states to be tracked are shown in Fig. 6 and the deviations from the reference values are provided in Fig. 7. Moreover, a comparison of the optimal controls obtained from the tracking algorithm, the corresponding reference model states, as well as the flight simulator states are depicted in Fig. 8. All flight simulator states presented in these figures represent measured states using the EKF. The deviation in the height exhibits a prominent peak around t ≈ 300 s (see Fig. 7). This peak may be explained by the switch from the clean to the landing configuration which occurs approximately at this time point. Moreover, it is noteworthy that also the wind produced by the Dryden disturbance model exhibits its maximum absolute value of VW ≈ 20.19 m/s shortly before at 290.53 s. The deviations of the horizontal position states δx and δy are within ≈ 5 m and the deviation in the kinematic velocity δVK is within ≈ 3 m/s as can be seen in Fig. 7. 100 200 300 400 500 600 100 200 300 400 500 600 100
200 300 400 Fig. 5. Dryden wind disturbances.
500 600 1500 1000 5000 110 85 600 100 200 300 400 500 600 100 200 300 400 500 600 100 200 300 400 500 600 100 200 300 400 500 Fig. 6. Tracked states of the reference trajectory. 600 100 200 300 400 500 600 100 200 300 400 500 600 Fig. 8. Comparison between the optimal controls computed by the tracking algorithm and the corresponding states.
Conclusions and Outlook In this paper it is shown that the differential game tracking approach developed in [2, 10] can be applied in a realistic context for the robust trajectory tracking task in wind conditions. This trajectory tracking approach is integrated in the control architecture of a flight simulator model using reference models of relative degree one. For testing our implementation in realistic conditions an example problem for the approach flight phase featuring a switch from clean to landing configuration is considered. The wind disturbances imposed in this example are generated from a Dryden model and exhibit a maximum absolute value of VW ≈ 20.19 m/s. The numerical results of this numerical experiment indicate that the differential game based trajectory tracking approach can be employed for the tracking task under rather severe wind conditions.
It should be noted that reference trajectory for this example problem is computed using a direct optimal control method. This approach for the generation of optimal reference trajectories is found to be very versatile for this task as it allows for the inclusion of features such as model switches (e.g. from clean to landing configuration) and the modeling of operational (path-)constraints in combination with typical performance indices (such as fuel consumption). Moreover, the properties of these optimal references implicitly transfer, to a certain extent, to the aircraft control through the robust tracking procedure.
Nevertheless, regarding future research it would be worthwhile to investigate if the tracking algorithm can be extended in such a way that constraints and performance indices can be included explicitly (e.g. in the min-operator computing the optimal control).