<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>International Journal of Aerospace and
Mechanical Engineering</journal-title>
      </journal-title-group>
      <issn pub-type="ppub">1613-0073</issn>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.30929/1995-0519.2019.5.90-96</article-id>
      <title-group>
        <article-title>Methodology  for  Control  of  Helicopters  Aircraft  Engines  Technical State in Flight Modes Using Neural Networks   </article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Serhii Vladov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yurii Shmelov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ruslan Yakovliev</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Kremenchuk Flight College of Kharkiv National University of Internal Affairs</institution>
          ,
          <addr-line>vul. Peremohy, 17/6, Kremenchuk, Poltavska Oblast, Ukraine, 39605</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2021</year>
      </pub-date>
      <volume>9</volume>
      <issue>4</issue>
      <fpage>11</fpage>
      <lpage>23</lpage>
      <abstract>
        <p>   In this work, the creation of a methodology for control the technical state of helicopters aircraft engines using recurrent neural networks, which, unlike other types of neural networks, have a more optimal method for training a neural network, and also after training allows you to get a lower percentage of errors in comparison with a convolutional neural network and multilayer perceptron. A mathematical description of the methodology for control the technical state of helicopters aircraft engines in flight mode using neural networks based on the numerical solution of a discrete optimal control problem has been implemented. The quality of the trained neural network is assessed, including the calculation of the testing error, which is no more than 1.2 % of the deviation from the a priori correct result on the vectors of the test set of sets. With an allowable value of 2 %, this allows us to speak about the efficiency of the method.</p>
      </abstract>
      <kwd-group>
        <kwd> 1  Aircraft engine</kwd>
        <kwd>recurrent neural network</kwd>
        <kwd>testing error</kwd>
        <kwd>optimal control</kwd>
        <kwd>backpropagation method</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction </title>
      <p>In recent decades, the development and improvement of aircraft gas turbine engines (GTE),
including helicopters, has been accompanied by toughening requirements for the reliability and
efficiency of their automatic control systems (ACS). Modern helicopters gas turbine engines are
complex technical devices that differ in the variety of physical processes occurring in them and are
characterized by multidimensionality, multi-connectivity, nonlinearity, non-stationary work
processes, a significant influence of operating modes and external conditions on the characteristics of
their functioning. The listed features lead to the formation of a stable trend in the development of
ACS for gas turbine engines of helicopters, characterized by a constant increase in the complexity and
the number of tasks solved with their help. One of the important tasks is to improve the methods and
algorithms for controlling the helicopters gas turbine engine in the conditions of a helicopter flight in
terms of thermogasdynamic parameters, which is due to the presence of strict requirements for
ensuring the safety and efficiency of flights [1, 2].</p>
    </sec>
    <sec id="sec-2">
      <title>2. Literature review </title>
      <p>Modern approaches to control of aircraft gas turbine engines technical state are described in [3–5].
The main factors that must be taken into account in the helicopter flight mode include uncertainty
factors, such as incompleteness of a priori and operational information, inaccuracy of mathematical
models of GTE, errors of sensors and actuators, changes in engine characteristics during operation,
occurrence of possible failures of GTE functional elements [6, 7].</p>
      <p>In recent years, their construction in the class of intelligent control systems providing robustness,
adaptability and fault tolerance of GTE control processes in conditions of uncertainty have been
considered as a promising direction in solving problems of monitoring the technical state of gas
turbine engines.</p>
      <p>Despite a significant amount of research in the development of GTE control algorithms, the
existing information technologies for controlling GTE parameters are not perfect for a number of
reasons. On the one hand, this is a weak informational "linkage", the absence of elements of
"intelligence", allowing to quickly, efficiently and effectively support decision-making in emergency
situations in flight.</p>
      <p>On the other hand, it is the complexity of the processes occurring in GTE ACS, the complexity of
their mathematical description, the limited composition of the measured parameters, their technological
spread, etc. These lead to the need for comprehensive automation and intellectualization of
decisionmaking processes of GTE ACS technical state [7] under conditions of uncertainty, including using the
control method according to the FDI (Fault Detection and Identification) model [8–11].</p>
      <p>Thus, the development of intelligent algorithms for automatic control of helicopters gas turbine
engine technical state, as well as the study of the features of their practical application, taking into
account the limitations on the available computing resources of an onboard digital computer, is an
urgent scientific and practical task.
3. The  use  of  neural  networks  in  the  problems  of  control  of  aircraft  gas 
turbine engines technical state  </p>
      <p>The implementation of the FDI method [8–11] allows maximum consideration of the individual
characteristics of a gas turbine engine by using a mathematical model that adapts (adjusts) to the
individual characteristics of the latter [12]. When using neural networks to solve the problems of
monitoring the technical state of a gas turbine engine of helicopters, the available a priori information
is presented to the neural network in the form of ready-made solutions (problem books), on the basis
of which the process of its training (additional training) is carried out. When assessing the quality of
the network, data from the test sample are fed to its input, on the basis of which it calculates the
vector of deviations (the difference between the output of the neural network and the desired
characteristics) [11, 12].</p>
      <p>Let us consider the problem of control of helicopters GTE technical state in flight mode based on
neural networks in the following formulation [13, 14]. We will assume that all possible states of the
gas turbine engine can be divided into two classes S0 (all serviceable states of the gas turbine engine)
and S 0 (all faulty states, characterized by the presence of at least one defect in the operation of the
gas turbine engine), uniting related states that are close to each other according to certain integral
indicators. Required based on the results of a limited number of measurements of the vector of engine
output parameters Y ti  , ti T (where ti – discrete moments of time; T – observation interval), make
a decision on whether the GTE belongs to one of the specified classes of states. The solution of this
problem in general form is reduced to finding a certain separating function (hypersurface) in the space
of controlled parameters of the gas turbine engine. To solve this problem, in this work, an approach is
implemented based on the construction of the specified decision rule using neural networks.
4. Development  of  a  methodology  for  control  of  helicopters  aircraft  gas 
turbine engines technical state in flight mode using neural networks 
Based on the above, within the framework of the task of control of helicopters gas turbine engine
technical state, in this work, neural network algorithms are investigated, a formalized formulation of
problems is given, recommendations for solving this spectrum of problems are formed, and an
engineering methodology is proposed.</p>
      <p>The general scheme of the methodology is shown in fig. 1. The main thermogasdynamic parameters of
the aircraft engine (recorded by sensors and calculated using a mathematical model) are fed to the input.</p>
      <p>REenpvrIMeinrsopoednunemttla:etinotn eDveavlunealeottipwvmeorenknetuaranl Neutrraalinnientgwork Trerdgapunaacssriedatdymiontnehatemetorrimscthoe- GTOEusttteapctehunt:ical</p>
      <sec id="sec-2-1">
        <title>Development of a mathematical model of a neural network</title>
      </sec>
      <sec id="sec-2-2">
        <title>Choice of architecture</title>
      </sec>
      <sec id="sec-2-3">
        <title>Implementation</title>
      </sec>
      <sec id="sec-2-4">
        <title>Development of a training set</title>
      </sec>
      <sec id="sec-2-5">
        <title>Conducting training</title>
      </sec>
      <sec id="sec-2-6">
        <title>Testing and getting an assessment</title>
        <p>At the first stage, a model of an aircraft engine is formed by systematizing the data. Then a neural
network is created – in view of the fact that neural networks have the property of non-universality, it
is necessary to carry out procedures for choosing an architecture for each new task. For each task, it is
necessary to select several types of architectures, conduct testing in the context of a specific task.
Accordingly, it becomes necessary to train / retrain the newly created neural network. Then, for the
convenience of further use and displaying the graphical representation, the transition to the reduced
thermogasdynamic parameters [15, 16]. This stage is necessary for human control of the neural
network, in the case when there is an additional stage of control.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>5. Review and selection of neural network architecture </title>
      <p>The architecture of neural networks most often used to solve problems of monitoring the technical
state of complex dynamic objects is a feedforward network, the input neurons of which are fed with
the values of the attributes of the classified object, and the output is a label or a numeric code of the
class. Multilayer perceptrons are commonly used. In such networks, the elements of the feature vector
arrive at the input neurons and are distributed to all neurons of the first hidden layer of the neural
network, and as a result, the dimension of the problem changes [17, 18].</p>
      <p>A convolutional neural network processes the data not entirely, but in fragments, but the data is
not split into parts, but a kind of sequential run is carried out. Then the data is transferred further
along the layers [19, 20]. In addition to convolutional layers, union layers are also used. Combine
layers are compressed with depth (usually a power of two). Several perceptrons (feedforward
network) are added to the final layers for further data processing.</p>
      <p>In the process of implementing a convolutional neural network, technical problems often arise
related to the format of the input data and the model used, which did not allow the implementation of
this network and adequately assess the capabilities of this architecture for solving the problem of
monitoring the technical condition of an aircraft engine.</p>
      <p>The use of a recurrent neural network can significantly reduce the computational complexity of the
backpropagation method, which will be used to train the neural network [21, 22]. To train the neural
network, we will use the error backpropagation algorithm, this algorithm is optimal for the
classification problem using a neural network. It is also worth noting that this neural network needs
long-term training on a larger number of training sets than a multilayer perceptron.</p>
      <p>Comparing the proposed architectures, we can conclude that for the task at hand, the optimal
option would be a recurrent neural network, which, after training, makes it possible to obtain a lower
percentage of errors in comparison with a convolutional neural network and a multilayer perceptron
(comparison graphs are shown in fig. 2), in addition, it possesses a simpler implementation than a
convolutional neural network.</p>
      <p>This architecture assumes a more optimal method for training a neural network. As a disadvantage,
there will be a larger number of training sets and a longer training time, which is compensated by the
higher accuracy of calculations (fig. 3).</p>
      <p>It is also worth noting that a recurrent neural network of the LSTM structure [23] has been
successfully applied to solve the problem of identification of an aviation GTE. Therefore, in this
work, a recurrent neural network of the LSTM structure is used to solve the problem of monitoring
the technical state of aircraft GTEs of helicopters in flight mode. At the same time, increasing the
accuracy of the GTE model as a control object by modifying the architecture of the LSTM network.
6. Mathematical  description  of  the  methodology  for  control  of  helicopters 
gas turbine engine technical state in flight mode using neural networks 
Let us solve the optimal control problem that simulates the dynamics of the considered artificial
neural network in the notation given below. The dynamics of a network of n neurons is described by a
system of differential equations with delay:</p>
      <p>n
xl t    i xi t   ij t  g  xj t   ui t ; i, j 1, N;
j1
gi  zi t  </p>
      <p>From the point of view of a biological prototype, i.e. neural network, we can say that the equation
describes the accumulated potential (electrical impulse) of a neuron at a given time, as well as its
change over time. The potential of a neuron is formed and changes under the influence of many
factors: xi(t) – own potential of a neuron at a given time; γi – intrinsic attenuation of the i-th neuron,
describes the effect on the neuron of its own forces, which negatively affect the potential, as well as
n
signal attenuation during transmission from one neuron to others. Sum ij t  x j t  h can be
j1
called the sum of the potentials of an ensemble of neurons. This is the sum of the impact of all
n
neighboring neurons on the i-th neuron. Sum ij t  x j t  h is the main element in the formation
j1
of the potential of the i-th neuron, so this sum will be called the body of the i-th neuron  ij t  x j t  .
Element xj(t – h) shows the lag of the neural network signal. Thus, the potential of the i-th neuron is
sufficiently influenced by the residual impulse of neurons at the previous moment in time.</p>
      <p>Control functions ωij(t) describe the axons of neurons – an electrical or chemical impulse that is
transmitted from one neuron to another, thereby changing the potentials, is the most important
connecting element of the neural network, since responsible for the interaction and performance of the
entire network. In this case, this is the impact on the i-th neuron, j-th neuron.</p>
      <p>The activation function gi  zi t  transforms the accumulated potential of the neuron according to
some functional dependence. The prototype is the processes occurring in the body of a neuron,
caused, for example, by signals or impulses from the peripheral nervous system of the body (due to
any changes in the external environment).</p>
      <sec id="sec-3-1">
        <title>The intrinsic potential of neurons should not go beyond the limits:</title>
      </sec>
      <sec id="sec-3-2">
        <title>The characteristics of neurons at the initial moment of time are known:</title>
        <p>xi t  Bi ; i 1,n.</p>
        <p>xi 0  ai; i 1,n; xi t  i t ; i  h,0.</p>
        <p>The control function ui(t) characterizes the external influence on the i-th neuron. These can be any
changes in the environment to which the body reacts by changing the rate of transmission of electrical
and chemical impulses of the nervous system. Restrictions on control functions are known:
 ij  b; ui  c.</p>
        <p>The goal of controlling the dynamics of a neural network is to train the network, which implies the
following tasks (criteria):
1) At the final moment of time, the characteristics of the neurons must coincide with the input data Ai;
2) During the execution of the process, the characteristics of neurons should not go beyond the
specified range of Bi values.</p>
      </sec>
      <sec id="sec-3-3">
        <title>3) Control ui should strive for the minimum value for the given process.</title>
      </sec>
      <sec id="sec-3-4">
        <title>4) Control ωij should also tend to the minimum value for this process.</title>
      </sec>
      <sec id="sec-3-5">
        <title>Control tasks can be formalized in the form of the following target functional:</title>
        <p>
          I  x, ,u ,t   S n  xi T   Ai 2  n T M i max 0; xi t   Bi 2 dt  Ln T ui2 t  dt 
i1 i1 0 i1 0
n n T
 K   i2j t  dt  inf; i 1,n. (
          <xref ref-type="bibr" rid="ref5">5</xref>
          )
j1 i1 0
        </p>
        <p>
          The main practical goal is to obtain optimal process controls, with the help of which the minimum
of the target functional is achieved.
(
          <xref ref-type="bibr" rid="ref2">2</xref>
          )
(
          <xref ref-type="bibr" rid="ref3">3</xref>
          )
(
          <xref ref-type="bibr" rid="ref4">4</xref>
          )
        </p>
        <p>We obtain the optimal process controls by the gradient descent method (back propagation of the
error) [24].</p>
        <p>
          To solve the optimal control problem (
          <xref ref-type="bibr" rid="ref2">2</xref>
          )–(
          <xref ref-type="bibr" rid="ref5">5</xref>
          ), we use the Pontryagin maximum principle [25]. We
introduce the Pontryagin function:
        </p>
        <p>H  x, ,u,t  0 n Mi max 0; xi  Bi 2  Lui2   0K n ni2j  n pi t  
i1 j1 i1 i1


  i xi 


where yk  xk t  h; thus,
n
pk t   20M k max 0; xk  Ak   pk t  k    pi t  h ik
i1</p>
        <p>The maximum principle allows us to reduce the problem of optimal process control to solving a
boundary value problem:
Wherein xi 0  ai; i, j 1...n; where  ij , uij – optimal controls.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>7. Numerical solution of a discrete optimal control task </title>
      <p>q
t </p>
      <p>Let us obtain a numerical solution to the discrete optimal control problem. For this, we will reduce
the original problem to a discrete form. We split the segment [0, T] into q segments. Sampling step
T
. Let us approximate the system of differential equations according to the Euler scheme [26]:
xl1  xil .
xl tl   i</p>
      <p>t</p>
      <sec id="sec-4-1">
        <title>We denote</title>
        <p>xi t   xil ;
h  vt;</p>
        <p>xi t  h  xilv , after that we approximate the integrals
T 2 T T
 M i  max 0; xi t   Ai  dt ,  ui2 t  dt and  i2j t  dt by the method of rectangles:
0 0 0</p>
        <p>T 2 q1 n 2
 M i  max 0; xi t   Ai  dt    M i  max 0; xi t   Ai  t;
0 l 0 i1</p>
        <p>T q1 n
 ui2 t  dt    uil 2 t;
0 l0 i1
T q1 n n
i2j t  dt     ilj 2 t.</p>
        <p>0 l0 i1 j1
We get the recurrence expression for calculating the phase trajectory:


xil1  xil    i xil 

</p>
        <p>1
 nilj xljv
1  e j1


 uil  t;


where</p>
        <p>n
zil  ilj xljv ;
j1</p>
        <p>gil  zil  
wherein  glwilj  </p>
        <p>Initial values:</p>
        <p> nilj xljv
e j1
xlv</p>
        <p>j
  nilj xljv 
1  e j1
 
 
xil1  xil    i xil  gil  zil   uil  t;</p>
        <p>1
 nilj xljv
1  e j1
2 ;  gl xkm 
;</p>
        <p>
          thus,
 n imk xkmv
e j1
  n imk xkmv 
1  e j1 
 
 
 mv
ik
xi 0  ai ; xi t  i t ; t  h,0.
(
          <xref ref-type="bibr" rid="ref6">6</xref>
          )
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>The objective function will take the form:</title>
        <p>
          n 2 q1 n 2 q1 n q1 n n
I  S   xiq  Ai     M i  max 0; xil  Bi  t  L  uil 2 t  K    ilj 2 t  inf . (
          <xref ref-type="bibr" rid="ref7">7</xref>
          )
i1 l0 i1 l0 i1 l0 i1 j1
        </p>
        <p>Using the Lagrange multiplier method, we obtain the necessary optimality condition. Let us
compose the Lagrange function [27]:</p>
        <p>n 2 q1 n 2 q1 n q1 n n
L  0S   xiq  Ai     M i  max 0; xil  Bi   L  uil 2 t  K    ilj 2 t 
i1 l0 i1 l0 i1 l0 i1 j1</p>
        <p> 
q1 n  
  pil1  xil1  xil  t   i xil 
l0 i1  </p>
        <p> 
Let us write down the stationarity conditions:
1
 nilj xljv
1  e j1
 
 
 uil  .</p>
        <p> 
 
L n
xkm  pkm  pkm1  pkm1 k t  t pim1
i1</p>
        <p> 2M k0t  max 0; xkm  Bm   0;
k 1...n; m  0...q 1.
L n
xkm  pkm  pkm1  pkm1 k t  t  pimv1imkv
i1</p>
        <p>2  2M k0t  max 0; xkm  Bm   0;
gkm  zkm 
xkm
 n imk xkmv
e j1
  n imk xkmv 
1  e j1 
 
 </p>
        <p> nksmxmsv
e m1
  nksmxmsv 
1  e m1
 
 </p>
        <p> nimk xkmv
e k1
  nimk xkmv 
1  e k1
 
 
pkq  20 S  xkq  Ak .</p>
        <p>  n imjxmjv 
1  e j1
 
 
k 1...n; m  0...q 1; .</p>
        <p>Let's write down the gradient values:</p>
        <p>L gkm  zkm 
ksm
  pks1
L
xkq
ksm
 20S  xkq  Ai   xkq  0; k 1...n.</p>
        <p>t  2K tksm ; k 1...n; s 1...n; m  0...q 1;
L
ksm
 tpks1xsv
m</p>
        <p>2  2K tksm ;
L
ukm  2Lukmt  pkm1t; k 1...n; m  0...q 1.</p>
        <p>
          Let us express the impulses in terms of these equations pkm and pk :
q
n
pkm  pkm1  pkm1 k t  t pimv1imkv
i1
2  2M k0t max 0; xkm  Bk ; (12)
(
          <xref ref-type="bibr" rid="ref8">8</xref>
          )
(9)
(10)
(11)
(13)
pkm1  pkm  pkm1 k    mv pmv1
        </p>
        <p>n
t i1 ik i</p>
        <p>After completing the passage to the limit, then we check the correspondence with the boundary
value problem, thereby checking the correctness of the solution:
n
 imjxmjv
e j1
2  2M k0  max 0; xkm  Bk ;
passing to the limit lim pkm1  pkm , we get:
t0 t</p>
        <p>n
pk t   20M k max 0; xk  Bk   pk t  k    pi t  hik t  h
i1
pkq  20S  xkq  Ak ;
pk T   20S  xk T   Ak .</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>8. Development of an algorithm for finding a numerical solution </title>
      <p>Let's formalize the resulting algorithm:
1) We set the parameters of the model.</p>
      <p>2) We set the parameters of the method: ε – calculation accuracy, α – gradient descent step, q –
number of dividing points of the segment and the initial set of controls u 0 and  0 .
n
calculate I 0 by the expression s   xi2  wi , setting M 1 .</p>
      <p>i1
4) Using expressions (12) and (13), starting from the q-th layer, we calculate  p k  , k = 0, 1, ...
 L L 
 ksm : uks 
We calculate 
k</p>
      <p>by expressions (10) and (11).
5) Improving control at k + 1 steps: uk1  uk 
6) We calculate  x k 1 , then  I k 1 .
u
L , wk1  wk  L</p>
      <p>.
w
</p>
      <p>N
7) Compare the values  I k  and  I k 1 . If  I k 1  I k  , then we decrease the step of the
gradient descent  
, where N </p>
      <p>
        we go to step (
        <xref ref-type="bibr" rid="ref5">5</xref>
        ) of the same iteration, otherwise go to step (
        <xref ref-type="bibr" rid="ref8">8</xref>
        ).
      </p>
      <p>
        8) We check the condition  I k1   I k   , if it is satisfied, then we assume that the optimal
solution for a given parameter M 1 has been found and go to step (9). Otherwise, go to the next
iteration k = k + 1 and go to step (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ).
      </p>
      <p>9) Checking the conditions:
q1 n 2
  M il  max 0; xil  Ai    ;
l1 i1
q n q n n
  xilk  xilk1 2   ;   iljk iljk1 2   .</p>
      <p>l0 i1 i0 i1 j1</p>
      <p>
        If all conditions are met together, we assume that the solution has been found; otherwise, we
determine a new penalty coefficient M 1   M 0 and go to step (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ).
      </p>
    </sec>
    <sec id="sec-6">
      <title>9. Algorithm for training a formalized neural network </title>
      <p>The next step in the methodology for control of helicopters aircraft GTE technical state is training
an artificial neural network. It is necessary to choose a training algorithm suitable for a specific task.
According to the research results, the best results were obtained using the error backpropagation
algorithm. This is primarily due to the fact that the backpropagation algorithm has been created and
optimized for the selected neural network architecture and activation function, which makes it
possible to maximize its potential [22, 23].</p>
      <p>Its main idea is that the change in the weights of synapses takes into account the local gradient of the
error function. The difference between the real and correct responses of the neural network, determined
on the output layer, propagates in the opposite direction (fig. 4) – towards the flow of signals.</p>
      <sec id="sec-6-1">
        <title>Direction of data dissemination</title>
      </sec>
      <sec id="sec-6-2">
        <title>Direction of error dissemination</title>
        <p>As a result, each neuron is able to determine the contribution of each of its weights to the total
network error. The simplest learning rule corresponds to the steepest descent method, that is, changes
in synaptic weights are proportional to their contribution to the total error [28].</p>
        <p>Of course, with such a training of a neural network, there is no certainty that it has trained in the
best way, since there is always a possibility of the algorithm falling into a local minimum. For this,
special techniques are used to "knock" the found solution out of the local extremum. If, after several
such actions, the neural network converges to the same solution, then we can conclude that the
solution found is most likely optimal [29].</p>
        <p>The algorithm for training a neural network using the backpropagation procedure is constructed as
follows [24, 30]:</p>
        <p>1. Apply one of the possible images to the network inputs and, in the normal functioning of the
neural network, when signals propagate from inputs to outputs, calculate the values of the latter.</p>
        <p>2. Calculate the difference between the ideal and the obtained output values for the output layer.
Calculate changes in layer weights.</p>
        <p>3. Calculate the difference between the ideal and the obtained values of the output and change in
weights for all other layers.</p>
        <sec id="sec-6-2-1">
          <title>4. Adjust all weights to the neural network.</title>
          <p>5. If the network error is significant, go to step 1. Otherwise, end. At step 1, all training images are
alternately presented to the network in a random order so that the network, figuratively speaking, does
not forget some as it memorizes others.</p>
          <p>When the output value goes to zero, the training efficiency decreases markedly. With binary input
vectors, on average, half of the weight coefficients will not be corrected; therefore, it is desirable to
shift the range of possible values of neuron outputs [0, 1] within the limits [–0.5 ... 0.5], which is
achieved by simple modifications of logistic functions. For example, an exponential sigmoid
  x   1 1e x is converted to a kind   x   0.5  1 1e x .</p>
          <p>w  1000 .</p>
          <p>N y</p>
          <p>Now let's touch on the issue of the capacity of a neural network, that is, the number of images
presented to its inputs that it is able to learn to recognize. For networks with more than two layers, it
remains open. For a neural network with two layers, that is, an output and one hidden layer, the
deterministic capacity of the network is estimated as follows:</p>
          <p>Nw  C N Nw ;
d N</p>
          <p>w  log</p>
          <p>N y y N y
where Cd – deterministic capacity of the network; Nw – number of adjustable weights; Ny – number of
neurons in the output layer.</p>
          <p>It should be noted that this expression was obtained with some restrictions. First, the number of
inputs Nx and neurons in the hidden layer Nh must satisfy the inequality Nx + Nh &gt; Ny. Secondly,
N</p>
          <p>The adjective “deterministic” appearing in the name of the capacity means that the obtained capacity
estimate is suitable for absolutely all possible input patterns that can be represented by Nx inputs. In reality,
the distribution of input images, as a rule, has some regularity, which allows the neural network to
generalize and thus increase the real capacity. Since the distribution of images, in the general case, is not
known in advance, we can talk about such a capacity only conjecturally, but usually it is twice the
deterministic capacity.
10.LSTM structure recurrent neural network modification </p>
          <p>According to [23], in this work it is advisable to apply an LSTM network based on a dynamic model
of a gas turbine engine based on the classical LSTM structure (fig. 5, a) or LSTM structure with variable
memory (fig. 5, b) proposed by Georgy Makaryants and Alexander Kuznetsov. Each cell has one output
neuron for predicting some parameter (for example, the gas generator r.p.m.). A collection of cells is a
network for predicting multiple parameters. The main difference between LSTM networks and other
recurrent networks is the memory tensor. A memory tensor is a variable, information into which can be
record or erased during the operation of the network. The operation of the LSTM network (fig. 5) is
based on the principle of memory tensor control using memorization and forgetting nodes:
ct  ft  ct1  it  cct ; (14)
where сt – memory tensor representing a vector of weighted inputs in a step t; ft – tensor at the exit
from the forgetting node in the step t, representing the sum of the weighted inputs and outputs in the
previous step t 1; ct1 – step memory tensor t 1; it – tensor at the output of the input node at step t,
which is the sum of the weighted inputs at the current step and outputs at the previous step; cct –
candidate tensor to write to memory tensor [23].</p>
          <p>ct–1 ct
ht–1
xt</p>
          <p>Whf
Wxf
Whi
Wxi
Whc
Wxc
Who
Wxo</p>
          <p>Forget gate</p>
          <p>(sig)
Input gate</p>
          <p>(sig)
Cand. cell
state (tanh)
Output gate
(sig)
ft
it
cct
ot
tanh
ht
ct–1
ht–1
xt</p>
          <p>Wcn
Whn Control gate
Wxn (sig)
Whr Recording
Wxr gate (tanh)
nt
rt</p>
          <p>1–u
Wch
Whh
Wxh</p>
          <p>Output gate
(sig)</p>
          <p>As mentioned above, to solve the problem of dynamic monitoring of aircraft gas turbine engines, a
special architecture of a recurrent neural network with long-short-term memory (LSTM) was
developed, presented in [23]. When using LSTM networks, the problem of the vanishing gradient of
the LSTM network arises, which the filter mechanism allows to resist. This mechanism makes it
possible to regulate the flow of new information into the state vector ct of the network, as well as the
output of the state ht of the network and updating its state ct. The network filter vectors are determined
according to the expressions [31]:
it   Ui  xt  Wi  ht1 ;
ft   U f  xt  Wf  ht1 ;
ot    Uo  xt  Wo  ht1 ;
gt    U g  xt  Wg  ht1 ;
1 ez  ez
where   z   0.5  1  ez – sigmoidal function; tanh  z   ez  ez – hyperbolic tangent function;
x – input sequence; h – hidden state vector of the network cell; Ui, Uf, Uo, Ug, Wi, Wf, Wo, Wg –
network filter weight matrices i, f, o, g; t – index of the element of the training sequence.</p>
          <p>Based on the values of the network filters, its internal state (internal memory) and hidden state
vectors are determined [31]:
ct  tah it  gt  ft  ct1 ;</p>
          <p>ht  ot  ct ; (20)
where tc – vector of the internal state of the network cell; th – vector of the hidden state of the network
cell;  – elementwise product operation.</p>
          <p>Expressions (15) – (20) correspond to the stage of direct signal propagation through the network.
This mechanism allows the LSTM network to deal with the vanishing gradient problem when
working with long sequences. By training filter parameters (Ui, Uf, Uo, Ug, Wi, Wf, Wo, Wg) LSTM
network "tunes" its "memory". In this paper, to solve the problem of saturation of the activation
function, it is proposed to use an activation function that does not saturate. This approach will allow
make network training faster and more accurate. The activation function based on the logarithm, in
contrast to [32], avoids saturation when processing large values and is defined by the expression:
ct
ht
(15)
(16)
(17)
(18)
(19)
0.5  ln  x  1, x  0
f  x  
0.5  ln  x  1, x  0
(21)</p>
          <p>The advantage of the proposed activation function compared to the hyperbolic tangent function is
its "unsaturation" and therefore its application will improve the efficiency of training the LSTM
network. The sigmoid activation function is also subject to the saturation problem, but it is not
possible to replace it with the proposed one, since it cannot serve as a gateway due to the fact that it
does not scale the input values in the range from 0 to 0.5.
11.Formation of training and test subsets </p>
          <p>The training set consists of a sufficient number of vectors (10000 vectors are enough for the task at
hand), which are input data sets with the correct result. The sets included the main thermodynamic
parameters of TV3-117 aircraft engine according to table 1 [33, 34]. Each of these parameters has
been assigned a corresponding priority required for the functioning of the neural network. To form the
training and test subsets in the work, cross-validation was used [35] to estimate the values of the
parameters of TV3-117 aircraft GTE, the results of which are shown in fig. 6.</p>
          <p>Table 1 
Fragment of the training set </p>
          <p>Engine unit  Parameter 
Input device </p>
          <p>Compressor 
Combustion chamber 
Compressor turbine </p>
          <p>Free turbine 
Output device 
Pin*  
Tin*  
Pc*omp  
Tc*omp  
Pg*as  
Tg*as  
Pc*omp.turb  
Tc*omp.turb  
Pf*reeturb  
Tf*reeturb  
Po*ut  
To*ut  </p>
          <p>As an example, a test version of a recurrent neural network was developed in the Matlab
environment, illustrating the solution to the problem of TV3-117 aircraft GTE technical state control.
The neural network was trained according to the following rule [22, 23]. First, all 10000 vectors of the
training set were sequentially fed to the network input, with the help of which training was performed
using the backpropagation algorithm. Each time, after training, a training test was performed for 2000
sets – the error was checked on 100 arbitrary sets of those already passed (test error control). Then,
after completing the entire training, the error was checked for 1000 (10 % of the training set) – the
stage of final control. At this stage, the erroneous estimate did not exceed the predetermined threshold
of 1.2 % (fig. 7), which is a good result.
yi log  yi   1  yi  log 1 yi ;
(22)
where yi – true class label; yi – response of the classifier (calculated class label) on the i-th object;</p>
        </sec>
        <sec id="sec-6-2-2">
          <title>N – number of classes.</title>
          <p>To assess the quality of neural network training, various quality indicators can be used, in
particular, such indicators as Accuracy, Precision, Recall, F-measure.</p>
          <p>In the case of a binary classification based on the errors matrix of inaccuracies (errors), a 2×2 table
can be drawn up (table 2), in which the following designations are used: TP – true-positive solution;</p>
        </sec>
        <sec id="sec-6-2-3">
          <title>TN – true negative decision; FP – false positive decision; FN – false negative decision.</title>
          <p>Table 2 
Errors matrix </p>
          <p>Classification 
Class labels exposed by 
the neural network </p>
          <p>Positive grade label 
Negative grade label </p>
          <p>Class labels in the dataset 
Positive grade label  Negative grade label </p>
          <p>TP  TN 
FP  FN </p>
          <p>The Accuracy indicator determines the proportion of objects for which the classifier made the right
decision:</p>
          <p>Accuracy </p>
          <p>N FP  FN  TP  TN</p>
          <p>The Precision indicator within a class determines the proportion of objects correctly assigned by
the classifier to the class, to the total number of objects assigned by the classifier to the class in the
training (test) sample. The higher the Precision score, the fewer false positives.</p>
          <p>The Recall indicator within a class determines the proportion of objects correctly assigned by the
classifier to the class to the number of objects of this class in the training (test) sample. The higher the
value of the Recall indicator, the less false-negative decisions.</p>
        </sec>
        <sec id="sec-6-2-4">
          <title>In the case of binary classification, Precision and Recall are defined as:</title>
          <p>TP
Precision 
Recall </p>
          <p>TP  FP
TP</p>
          <p>.</p>
          <p>F  2</p>
          <p>Precision  Recall
;</p>
          <p>TP  FN</p>
          <p>In the simplest case, the F-measure is defined as the harmonic average between Precision and
Recall:</p>
          <p>Precision  Recall</p>
          <p>The results of training the neural network according to the Accuracy and Loss indicators are shown in
fig. 9 and 10 respectively. As can be seen from fig. 8 and 9, the Accuracy indicator approaches one, and
Loss indicator – tends to zero, which indicates the high accuracy of the model and its minimal error.
(23)
(24)
(25)
(26)</p>
          <p>Table 3 shows the averaged values of the model learning outcomes, as well as the mean and
variance values for the Accuracy indicator.</p>
          <p>Table 3 
Average values of neural network testing indicators 
Accuracy  F‐measure  Precision  Recall  Average time, s 
Average Accuracy </p>
          <p>In fig. 10 shows a graph of the hypersurface in the space of the controlled parameters of helicopters gas
turbine engine in flight modes (for example, the TV3-117 aircraft engine). As a result of its work, the
trained neural network divided all the values of the degree of increase in the total pressure in the
compressor fed to its inputs into 3 regions (fig. 10), corresponding to the serviceable (blue), faulty (red)
and indefinite states where it is difficult to perform separation of parameter values due to their mutual
overlap (green). The proposed neural network, integrated into the GTE control system, is capable of
realtime correlating the value of the monitored parameter (the degree of increase in the total pressure in the
compressor) with one of the areas and, if it enters the area of a faulty state, to give a signal about an
incipient malfunction. This information (depending on the degree of danger) can be issued to the crew for
timely adoption of the correct decision or to GTE automatic control system the power plant as a whole.</p>
          <p>In this work, a methodology for control of helicopters aircraft engines technical state in flight
modes has been developed, based on the operation of artificial neural networks and the transition to
the given indicators of engine thermogasdynamic parameters. The scientific novelty of the result lies
in the use of a neural network specially designed and trained on the originally formed a priori sets of
engine thermogasdynamic parameters by a neural network, which makes it possible to increase the
speed of systems and reduce the load on hardware resources, as well as to topologize the results of
evaluating of engines technical state, which makes it possible to more clearly display problem engine
nodes (input device, compressor, combustion chamber, compressor turbine, free turbine, output
device) and simplify the optimization processes of solutions at a specific node (by reducing the
number of engine thermogasdynamic parameters).</p>
          <p>The proposed neural network was trained and tested on the practical task of control of TV3-117
aircraft engine technical state, based on the flight data of the Mi-8MTV helicopter. The testing error is
calculated, which is no more than 1.2 % of the deviation from the a priori correct result on the vectors of
the test set of sets. With an allowable value of 2 %, this allows us to speak about the efficiency of the
method.</p>
          <p>The use of such on helicopter board system, in contrast to the existing system for control the
parameters of a gas turbine engine, will allow control of helicopters gas turbine engine technical state in
flight in real time and recognize the failure at an early stage and inform the crew or the engineering staff
about it. Becoming, which will be the guarantee of the correctness of the decision on the possibility of
using all the potential of the gas turbine engine and will lead to an increase in the level of flight safety.</p>
          <p>Thus, as can be seen from the results of experimental studies, recurrent neural networks
demonstrate their high efficiency in solving the problem of monitoring the probable class of errors in
the operation of equipment in complex dynamic systems (control of helicopters aircraft engines
technical state in flight mode).</p>
        </sec>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>B.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.-P.</given-names>
            <surname>Zhap</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.-B.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <article-title>Unilateral alignment transfer neural network for fault diagnosis of aircraft engine</article-title>
          ,
          <source>Aerospace Science and Technology</source>
          , vol.
          <volume>118</volume>
          (
          <year>2021</year>
          )
          <fpage>107031</fpage>
          . Doi:
          <volume>10</volume>
          .1016/j.ast.
          <year>2021</year>
          .107031 URL: https://www.sciencedirect.com/science/article/abs/pii/S1270963821005411
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>S. N.</given-names>
            <surname>Vassilyev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Yu</surname>
          </string-name>
          . Kelina,
          <string-name>
            <given-names>Y. I.</given-names>
            <surname>Kudinov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. F.</given-names>
            <surname>Pashchenko</surname>
          </string-name>
          ,
          <source>Intelligent Control Systems, Procedia Computer Science</source>
          , vol.
          <volume>103</volume>
          (
          <year>2017</year>
          )
          <fpage>623</fpage>
          -
          <lpage>628</lpage>
          .
          <fpage>10</fpage>
          .1016/j.procs.
          <year>2017</year>
          .
          <volume>01</volume>
          .088
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>E. L.</given-names>
            <surname>Ntantis</surname>
          </string-name>
          ,
          <article-title>Diagnostic methods for an aircraft engine performance</article-title>
          ,
          <source>Journal of Engineering Science and Technology</source>
          , vol.
          <volume>8</volume>
          , no.
          <issue>4</issue>
          (
          <year>2015</year>
          )
          <fpage>64</fpage>
          -
          <lpage>72</lpage>
          . Doi:
          <volume>10</volume>
          .25103/jestr.084.10
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>I. A.</given-names>
            <surname>Krivosheev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K. E.</given-names>
            <surname>Rozhkov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. B.</given-names>
            <surname>Simonov</surname>
          </string-name>
          ,
          <article-title>Complex Diagnostic Index for Technical Condition Assessment for GTE, Procedia Engineering</article-title>
          , vol.
          <volume>206</volume>
          (
          <year>2017</year>
          )
          <fpage>176</fpage>
          -
          <lpage>181</lpage>
          . Doi:
          <volume>10</volume>
          .1016/j.proeng.
          <year>2017</year>
          .
          <volume>10</volume>
          .456
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S. V.</given-names>
            <surname>Zhernakov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. T.</given-names>
            <surname>Gilmanshin</surname>
          </string-name>
          ,
          <article-title>New algorithms for on-board diagnostics of aircraft gas turbine engine based on fuzzy networks</article-title>
          ,
          <source>Bulletin of USATU</source>
          , vol.
          <volume>19</volume>
          , no.
          <volume>2</volume>
          (
          <issue>68</issue>
          ) (
          <year>2015</year>
          )
          <fpage>63</fpage>
          -
          <lpage>68</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>S. V.</given-names>
            <surname>Zhernakov</surname>
          </string-name>
          ,
          <article-title>Algorithms for control and diagnostics of an aviation gas turbine engine under conditions of onboard implementation based on neural network technology</article-title>
          ,
          <source>Bulletin of USATU</source>
          , vol.
          <volume>14</volume>
          , no.
          <volume>3</volume>
          (
          <issue>38</issue>
          ) (
          <year>2010</year>
          )
          <fpage>42</fpage>
          -
          <lpage>56</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>S.</given-names>
            <surname>Kiakojoori</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Khorasani</surname>
          </string-name>
          ,
          <article-title>Dynamic neural networks for gas turbine engine degradation prediction, health monitoring and prognosis</article-title>
          ,
          <source>Neural Computing &amp; Applications</source>
          , vol.
          <volume>27</volume>
          , no.
          <issue>8</issue>
          (
          <year>2015</year>
          )
          <fpage>2151</fpage>
          -
          <lpage>2192</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>S. V.</given-names>
            <surname>Enchev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. S.</given-names>
            <surname>Tovkach</surname>
          </string-name>
          ,
          <article-title>Diagnostic of the Technical Condition Aviation Engines is Based on Fuzzy logic, Scientific Bulletin Kherson State Maritime Academy, no 1 (8) (</article-title>
          <year>2013</year>
          )
          <fpage>216</fpage>
          -
          <lpage>224</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>