<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>ORCID:</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Method for Trend Analysis of Helicopter Turboshaft Engine Parameters at Flight Modes</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Serhii Vladov</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yurii Shmelov</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ruslan Yakovliev</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Marina Petchenko</string-name>
          <email>marinapetcenko@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Kharkiv National University of Internal Affairs</institution>
          ,
          <addr-line>L. Landau Avenue, 27, Kharkiv, Ukraine, 61080</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Kremenchuk Flight College of Kharkiv National University of Internal Affairs</institution>
          ,
          <addr-line>vul. Peremohy, 17/6</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Kremenchuk</institution>
          ,
          <addr-line>Poltavska Oblast, Ukraine, 39605</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2003</year>
      </pub-date>
      <volume>000</volume>
      <fpage>0</fpage>
      <lpage>0001</lpage>
      <abstract>
        <p>The article discusses the use of expert systems with neural network knowledge bases for the process of helicopters turboshaft engine parameters at flight modes information monitoring. The method for determining the trend of aircraft gas turbine engine parameters based on neural networks, adapted to helicopters turboshaft engines that implement the dynamic knowledge base of an expert system during engine operation, has been further developed. A modified Jordan neural network with dynamic stack memory has been developed, which, through the use of dynamic stack memory, makes it possible to detect the appearance of a trend in the parameters of helicopters turboshaft engines at flight modes, increase the accuracy to 0.999 and reduce the trend recognition error to 0.056. A hybrid algorithm consisting of adaptive and genetic training of recurrent neural networks has been improved, adapted to Jordan modified neural network with dynamic stack memory, which made it possible to optimize its training process in relation to the problem of helicopters turboshaft engines at flight modes parameters trend recognizing. The modified method for determining the trend of parameters has been tested in the onboard neural network expert system for the integrated monitoring of helicopters turboshaft engines operational status. network, trend analysis Aircraft engine, expert system, neural network, operational status, modified Jordan neural</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>The process of monitoring and aircraft gas turbine engines (GTE) operation control is carried out
by expert systems (ES) [1, 2]. The use of it allows taking into account a number of factors that
contribute to the qualitative improvement of their functioning [3, 4]. The presence of close
information interaction of the control system (aircraft GTE) with the environment using specially
organized information communication channels; fundamental openness of the system in order to
increase its intelligence and improve its own behavior. The presence of mechanisms for predicting
changes in the environment and the behavior of the system; development a control system based on a
multi-level hierarchical structure. It satisfies the following rule: as the rank of the hierarchy increases,
the intelligence of the system increases and the requirements for its accuracy decrease, and vice versa;
persistence of functioning in case of partial rupture of links or loss of control actions from higher
levels of the hierarchy of the control system. Despite the weighty evidence base of the relevance of
the use of ES in aircraft GTE on-board monitoring systems [5, 6], there are currently no such ES in
relation to helicopters turboshaft engines (TE).</p>
      <p>Thus, an urgent scientific and practical task is the development of an on-board ES for monitoring
helicopters TE operational status, which, in the process of monitoring and their operation control, is
able to fully control the parameters, analyze (simulate) the current situation with a predict of its
development in the engine (information from sensors).</p>
      <p>2022 Copyright for this paper by its authors.</p>
      <p>One of the classic tasks of monitoring the parameters of helicopters TE is the disorder
(determining the trend of controlled data). In the general case, trend analysis allows you to control the
time series formed by the sequence of values of controlled indicators, and determine the presence of a
trend: changes (disorder) in this series. The value of trend analysis in modern active ES is very high,
as it allows you to identify defects at an early stage of their development (even if the values of the
controlled parameters are within acceptable limits).</p>
      <p>In connection with the foregoing, the purpose of this work is to develop and modify methods for
determining the trend of controlled data (trend analysis) of helicopters TE, which will be part of
monitoring helicopters TE operational status onboard ES.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Literature review</title>
      <p>Under the current conditions, along with the traditional classification of ES: static and dynamic,
recently, in domestic and foreign periodicals, a class has been distinguished – active ES [7, 8]. From
dynamic ES (real-time ES – RT ES), active ES differ in the participation of the human factor in the
control loop. So, if in RT ES the share of a human operator in the decision-making process can be
30... 50 %, then in active ES this percentage of participation is reduced to a minimum of 5...10 % or
completely eliminated [9].</p>
      <p>It is quite obvious that with such an approach to the organization of active ES and its
implementation in the management process, it is necessary to take into account a number of factors
that contribute to the qualitative improvement of its functioning [10, 11]:</p>
      <p>– presence of close information interaction of the control system with the environment using
specially organized information communication channels;</p>
      <p>– fundamental openness of the system in order to increase its intelligence and improve its own
behavior;</p>
      <p>– presence of mechanisms for predicting changes in the environment and the behavior of the
system;</p>
      <p>– construction of a control system based on a multilevel hierarchical structure that satisfies the
following rule: as the rank of the hierarchy increases, the intelligence of the system increases and the
requirements for its accuracy decrease, and vice versa;</p>
      <p>– persistence of functioning in case of partial breakage of connections or loss of control actions
from the highest levels of the hierarchy of the control system.</p>
      <p>Thus, the developed ES should be easily reconfigurable (adaptable) to external changes, for which
it requires the presence of the following subordinate levels [12]: training, self-organization
(restructuring), predicting (recognition) of events (situations), working with event databases
(databases) (DB) and knowledge bases (KB), decision making (DM); planning operations for the
implementation of the formed solution, adaptation.</p>
      <p>The listed levels form the strategic level of the active ES (fig. 1), the rest perform its tactical
functions. The solver (logical output machine) of an active ES is complex. It is with known methods
and knowledge (logic of predicates, semantic networks, frames, production output). The methods
based on soft computing (fuzzy logic (FL), genetic algorithms (GA), neural networks (NN), cognitive
networks (CN), probabilistic output (PO) – heuristics). The combination of methods and their
extension with elements of soft computing increases the mobility of the computational process by the
active ES solver and as a result, the quality of the decisions making with the connection to the
planning of banks of algorithms and models. Having a powerful solver, the active ES is relatively
easy to adapt to an external dynamic model, allowing you to set and solve direct, inverse and mixed
problems. In the process of monitoring and operation control of helicopters turboshaft engines at
flight modes, the ES is able to fully control the parameters, analyze (simulate) the current situation
with a predict of its development in the engine (information from sensors).</p>
      <p>Active ES knowledge bases store declarative and procedural knowledge. Procedural ones include
conceptual knowledge bases (CKB): concepts in the form of formulas, dependencies, tables,
procedures, etc. Declarative ones include expert knowledge bases (EKB) that are descriptive
(qualitative) in nature. At the same time, CKB and EKB closely interact with each other, constantly
checking for consistency (redundancy) of knowledge. In the process of interaction with the object and
its own heterogeneous KB, the active ES performs training and self-training. Real-time scanning tests
facts and knowledge. The new situation "forms" a precedent and is stored in the knowledge base.
Elements of traditional modeling tools in the active ES carry out mathematical (simulation) modeling
of the engine, as well as storage of a priori and a posteriori data in the active ES database (initial
information and test results). Additional "flexibility" and mobility of the knowledge base in the active
ES is achieved by pairing the artificial intelligence models and the mathematical model (MM) of the
engine [11, 12].</p>
      <p>Dynamic Knowledge Base
Neural Neural Neural
network network ... network</p>
      <p>1 2 n</p>
      <sec id="sec-2-1">
        <title>Expert</title>
        <p>User
Interface</p>
      </sec>
      <sec id="sec-2-2">
        <title>Knowledge base and precedents</title>
      </sec>
      <sec id="sec-2-3">
        <title>Knowledge base management system</title>
      </sec>
      <sec id="sec-2-4">
        <title>Explanatory subsystem</title>
      </sec>
      <sec id="sec-2-5">
        <title>Algorithms Bank</title>
      </sec>
      <sec id="sec-2-6">
        <title>Solver</title>
      </sec>
      <sec id="sec-2-7">
        <title>Model bank</title>
        <p>...</p>
      </sec>
      <sec id="sec-2-8">
        <title>Sensors</title>
        <p>...</p>
      </sec>
      <sec id="sec-2-9">
        <title>Executive mechanisms</title>
      </sec>
      <sec id="sec-2-10">
        <title>Database</title>
      </sec>
      <sec id="sec-2-11">
        <title>Database management system</title>
      </sec>
      <sec id="sec-2-12">
        <title>Scheduler</title>
      </sec>
      <sec id="sec-2-13">
        <title>Predict block</title>
      </sec>
      <sec id="sec-2-14">
        <title>Knowledge replenishment subsystem</title>
        <p>During the operation of helicopter TE, the active ES connected to it allows real-time modeling,
forecasting and evaluation of the efficiency of helicopter power plant.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Formulation of the problem</title>
      <p>It is assumed that х(t), t = 1…N is a sequence of discrete observations х(t) = f(t) + ξ(t) in the
background of interference ξ(t) with zero mean and variance σ2. A set of polynomials are used as
trend models according to [13]</p>
      <p>j1
f t   csjt s , j = 1…N;</p>
      <p>s0
with unknown coefficients csj, where j – model type index.</p>
      <p>
        With the current estimation, model (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) according to [13] is represented as
      </p>
      <p>
        j1 t s
f j t  t    f js t   ; (
        <xref ref-type="bibr" rid="ref2">2</xref>
        )
      </p>
      <p>
        s0 s!
where Δt – time counted from the present moment of time. f js t  – s-th derivative of the function
fj(t), the values of which are determined by the sliding x(t – N + 1), x(t – N + 2), ..., x(t) observations
sample of a constant volume N, which makes it possible to track the change in the coefficients csj of
the model (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ). Regular data correspond to the presence of a certain regularity, the violation of which
occurs when the coefficients change csj in (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ).
      </p>
      <p>
        The task of this work research is to construct a neural network detector (dynamic knowledge base
of an active ES), which allows, as a result of the observations x(t) processing, to establish the facts of
violation of the regularity and the time of these violations (trends) appearance.
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
At the same time, the KB of the active ES stores the following information:
– assessment of the randomness of the discrepancy between the given mathematical expectation
and the sampling mean (parametric methods that require knowledge of a priori information about the
helicopter TE), usually the standard deviation of the parameter under study);
      </p>
      <p>– assessment of the belonging of two samples to the same general population (non-parametric
methods that do not require a priori information, classical criteria: Hald-Abbe and its modifications
[14]);
– trend analysis of controlled parameters based on neural networks.</p>
      <p>An important task in the process of analyzing experimental data, which reflects the recognition of
the “appearance” of helicopters TE, is to determine the discord in the measured parameters of the time
series, i.e. analysis of statistical characteristics of the results of registration of controlled parameters in
order to determine their stationarity. The main task of trend analysis is to identify regularity in a
sequence of data. The most complete description of trend detection methods is given at [14], among
which the most common "classical" methods of trend analysis are: parametric, non-parametric and
mixed methods. Of the parametric methods, according to [13], an integral criterion is used, which
consists in the following sequence of operations:</p>
      <p>– preliminary processing of the numerical series (measurement data) {Y1, ..., YN} is carried out in
order to convert it to a form convenient for subsequent evaluation;</p>
      <p>– logic and physics of the process is analyzed, which has a significant impact on both the choice of
the type of approximating function and the determination of the limits of its parameters.</p>
      <p>Preliminary processing of the initial number series within the time interval T t1,...,tN  is aimed
at reducing the influence of the random component ε(t) in the initial number series {Y1, ..., YN} (i.e.,
bringing it closer to the trend). The presentation of the information contained in the numerical series
in such a way as to significantly reduce the difficulties of the analytical description of the trend.</p>
      <p>The main methods for solving these problems are the procedures for smoothing and leveling the
statistical series. In this case, the smoothing procedure is aimed at minimizing random deviations of
points from some smooth curve of the assumed process trend. Smoothing is performed using
polynomials that approximate groups of points measured during the experiment using the least
squares method (LSM). Even in a simple linear version, the smoothing procedure is very effective in
identifying a trend when superimposed on an empirical numerical series of random interference and
measurement errors. If smoothing is aimed at the primary processing of a number series to eliminate
random fluctuations and identify a trend, then alignment serves the purpose of a more convenient
presentation of the original series while maintaining its values. In the simplest case, this procedure
can be carried out by approximating the initial series of processed experimental points.</p>
      <p>The choice as the criterion of optimality of the measure of the deviation of the points of the
empirical series from the approximating function is carried out according to the expression (LSM):
where Yj – points of the empirical series (measured values); η – approximating function; tj – time
component; α1…αN – approximated points.</p>
      <p>According to [13], the following functionals are used as one of the integral criteria for evaluating
the trend:</p>
      <p>
        N 2
Yj  t j ,1,..., N   min;
j1
  N Yj  Yn  j 
j1 Yn  j 
;
(
        <xref ref-type="bibr" rid="ref3">3</xref>
        )
(
        <xref ref-type="bibr" rid="ref4">4</xref>
        )
Where Yj – experimental data, j  1, N ; Yn(j) – data calculated by the model; N – number of points
measured during the experiment; δ – trend estimate.
      </p>
      <p>
        The application of this criterion (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ) in the process of evaluating experimental data is shown in fig. 2a.
In fig. 2a four characteristic sections can be distinguished: I – from 0 to 1.5 hours; II – from 1.5 to 1.75
hours; III – from 1.75 to 2.25 hours; IV – from 2.25 to 2.5 hours of engine operation. The trend is absent
in sections I and III, but is evident in sections II and IV. In fig. 2a four characteristic sections can also be
observed: I – from 0 to 1.5 hours; II – from 1.5 to 2.05 hours; III – from 2.05 to 2.25 hours; IV – from
2.25 to 2.5 hours of engine operation. It is obvious that the trend is absent only in the first run-in section,
and in the other three there is a noticeable tendency to change the gas temperature in front of the
compressor turbine, that is, the presence of a trend. At the same time, if only in the second section the
temperature rises slowly, then in the third and fourth its change has a clearly expressed character.
      </p>
      <p>
        Another integral criterion for evaluating the trend is a functional of the form [13]:
(
        <xref ref-type="bibr" rid="ref5">5</xref>
        )
      </p>
      <p>
        The application of criterion (
        <xref ref-type="bibr" rid="ref5">5</xref>
        ) in the process of analyzing the gas generator rotor r.p.m. is shown
in fig. 2b, where four characteristic sections are also visible: I – from 0 to 0.35 h; II – from 0.35 to
1.75 hours; III – from 1.75 to 2.25 hours; IV – from 2.25 to 2.5 hours of operation of the helicopter
control systems (HCS). The first area of work is characterized as part-time work; the second area of
the normal period of operation; the third and fourth are areas of intensive wear and aging.
      </p>
      <p>In the process of studying the trend by classical methods, it can be concluded that the "classic" integral
criteria are very effective in express analysis, have accuracy, clarity and are able to determine with a high
degree of certainty the moment the trend begins to appear. However, in order to apply these criteria in the
onboard (expert) system for monitoring helicopters TE, it is necessary to develop an appropriate method.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Neural network development</title>
      <p>Among the numerous methods of trend analysis, the following are noted [14, 15]: the linear
filtering method, the Kalman filter, extrapolation methods, which are most simply implemented in a
neural network basis, since they are based on smoothing and equalizing statistical series procedures.</p>
      <p>Smoothing and equalization procedures can be implemented on the basis of neural networks in the
form of two series-connected filters – low frequency (LF) and high frequency (HF), while in [13]
their implementation based on recurrent neural networks was proposed. In this case, the low-pass
filter “passes” the constant component fj(t) and filters the noise ξ(t), and the high-pass filter passes
f js t  and filters fj(t) and the noise ξ(t). Implementation of low-pass and high-pass filters based on
recurrent neural networks is shown in fig. 3. These options differ in that they are implemented by the
corresponding external filters. The structure of the external filter is shown in fig. 4.</p>
      <p>It is known from the theory of neural networks [16, 17] those static architectures of neural
networks are capable of approximating multidimensional, non-linear static functions. The
identification of dynamic systems, on the other hand, requires a model with appropriate storage
elements. Therefore, static full-sized neural networks should be extended with dynamic structures.
One of the possibilities of dynamic extension is the addition of external filters that implement a
dynamic model outside the network. Such neural networks with external dynamics include [18, 19]:
– non-linear models with output feedback;
– non-linear models with finite impulse response;
– non-linear orthogonal models of basic functions.</p>
      <p>During preprocessing, it is considered that the functions f(t) and ξ(t) are not correlated. It is
required that the vector Outx(t) of the output values of the filter Outlx t  , l  1, N , which is a
response to an external influence, approaches the desired function of the useful signal:
where F = (Fl) is some vector operator that describes the mapping of the set of useful signals into the
output signals of the filter [20, 21].</p>
      <p>As a measure of approximation Outx(t) to Ff(t) in the general case, one can choose the functional:</p>
      <p>Out x t   Ff t ;</p>
      <p>J  J   Ff t   Out x t ;
where φ[•] – some measure of a vector function.</p>
      <p>In the simplest case [20, 21] (fig. 2), the input signal is applied to a set of serially connected
functional elements with a delay Z–1 (in synapses). Their input values are represented as signals Inx(t –
kZ-1), k = 1, N with weights Wjk, forming a vector of estimates of useful signals  x j t  , on the basis
of which, with the help of a network that implements the matrix of operators (Flj), a vector of output
signals is formed:</p>
      <p>
        Outlx t   Flj  Wjk Inx t  kZ 1  . (
        <xref ref-type="bibr" rid="ref8">8</xref>
        )

 k 
      </p>
      <p>
        The task of filtering is to reproduce the useful signal against the background of noise and perform
the required transformation. To solve this problem, it is necessary to minimize the standard deviation
of the estimate of the useful signal xj(t) from the expected j – useful signal fj(t), characterizing the
corresponding useful result of the neural network filter, i.e. find:
min M  f j t   Wjk Inx t  kZ 1  2 ; (
        <xref ref-type="bibr" rid="ref9">9</xref>
        )
      </p>
      <p> </p>
      <p>Wjk  j  k  
where M – mathematical expectation.</p>
      <p>According to this criterion, classical filter adaptation algorithms can be implemented using a priori
information about the useful signal and noise.</p>
      <p>To solve the given problem, Professor Serhii Zhernakov [22] proposed to use a perceptron as a
dynamic (recurrent) neural network that implements a low frequency filter; for high frequency filter –
RBF (radial basis function) neural network. Ensemble neural network learning algorithm – complex
back propagation.</p>
      <p>A signal having N samples x = (x1, …, xn) can be approximated by a neural network with G
neurons in the hidden layer by the following equations:
– for perceptron:
– for RBF:</p>
      <p>G
f t   Wi0q W ihT </p>
      <p>t ;
i0  
f t   Wi0 Ri t,W ih ;</p>
      <p>
        G
i0
(
        <xref ref-type="bibr" rid="ref10">10</xref>
        )
(
        <xref ref-type="bibr" rid="ref11">11</xref>
        )
(
        <xref ref-type="bibr" rid="ref6">6</xref>
        )
(
        <xref ref-type="bibr" rid="ref7">7</xref>
        )
where q(•) – different types of multilayer perceptron basis functions that have a scalar argument (the
original N-dimensional approximation problem is decomposed by weight superposition into simple
scalar basis functions. The compression of the N-dimensional input space to a one-dimensional input
f(•) is carried out by means of a scalar products W ihT t ); R(•) – weighted basis functions of the RBF
(each basis function is implemented by a separate neuron).
      </p>
      <p>In order to carry out helicopters TE parameters trend analysis at flight modes, that is, in real time,
it is proposed to use a recurrent neural network with a dynamic stack memory, built on the basis of the
Jordan neural network, the basis of which is a multilayer perceptron. Feedback is implemented by
supplying to the input layer not only output data, but also network output signals with a delay of one
or more cycles, which allows you to take into account the background history of the observed
processes and accumulate information to develop the correct control strategy. Jordan’s modified
neural network is obtained by adding a delay to the feedback signals of the hidden layer by several
cycles, that is, by adding a dynamic stack memory to the layer [23, 24].</p>
      <p>The outputs of the hidden layer c1, c2, …, ck are fed to the input neurons with weighting
coefficients {wij}–t, where i – index of the neuron to which the signal is given (i = 1, 2, …, n); j –
index of the output signal of the hidden layer neuron (j = 1, 2, ..., k); t – time delay index (t = 1, 2, ...,
m). We will change the number of time delays from 1 to m. Thus, the Elman network is obtained at m
= 1, and the multilayer perceptron is obtained at m = 0. A detailed examination of the architecture of
the neural network (fig. 5) shows that the inverse of the hidden layer or the output of the network can
be excluded by adding signals to the training sample feedback.</p>
      <p>Jordan modified neural network is described by a system of recurrent equations:
or in matrix form:</p>
      <p>p N
vj n 1   wj1iui n   wcji yi n  yi n 1  bj1 ;</p>
      <p>i1 i1
x j n 1  F1 v j n 1; j = 1, 2, … , N;</p>
      <p> N
y j n 1  F2   wji2 xi n 1  bj2 ; j = 1, 2, … , M;</p>
      <p> i1
Xn 1  F1 W1Un  Wc Yn  Yn 1  B1 ;</p>
      <p>
        Y n 1  F2  W2Xn 1  B2 ;
where U(n) – vector of external input signals at time n; p – number of external network inputs; X(n + 1)
– vector of the output signals of the hidden layer at the moment of time (n + 1); N – number of signals
in the context layer. W(
        <xref ref-type="bibr" rid="ref1">1</xref>
        ), Wс, W(
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) – matrices of synaptic weights of external input signals, context
and output layer signals, respectively. B(
        <xref ref-type="bibr" rid="ref1">1</xref>
        ), B(
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) – vectors of shift weights in neurons of the hidden and
output layers, respectively; F1, F2 – vectors of activation functions in the hidden and output layers,
respectively; Y(n + 1) – vector of output signals of the network at the moment of time (n + 1); M –
number of network outputs.
      </p>
      <p>The decision rule for a modified Jordan neural network with dynamic stack memory implementing
low-pass and high-pass filters is as follows [13, 22]:</p>
      <p>N
 f  j1t   f j t 
  j1</p>
      <p>2
t
 C;
where the numerator of expression (17) means the accumulation of the sum of deviations of the
controlled parameters (C – activation threshold (sensitivity) of the neural network; when C = 0
(normal operation mode), when α ≥ C (trend)).</p>
    </sec>
    <sec id="sec-5">
      <title>5. Experiment</title>
      <p>Consider the process of transformation of the training sample to solve the problem of trend
analysis of the time series of the gas temperature parameter in front of the compressor turbine (fig. 2a)
using a modified Jordan neural network with a dynamic stack memory (table 1).</p>
      <p>It is assumed that in modified Jordan neural network, the hidden layer contains three neurons, the
output contains one neuron, the dynamic memory stack contains feedback signals of the hidden layer
with a delay of two cycles. Since the number of neurons of the hidden layer with feedback to the input
layer is three, the size of the input vector when training the modified Jordan neural network by
remembering the previous output signal one step back will increase by three, by remembering two
previous output signals – by six. We denote the input signals of the training sample that change during
the transformation as x1, x2, x3, and the feedback signals as x4, x5, x6, x7, x8, x9. We transform the time
series (for example, the values of the integral criterion, which are in the range from 1.375 h to 2.0 h)
using the sliding window method (table 2).
(12)
(13)
(14)
(15)
(16)
(17)</p>
      <p>Inputs x4, x5, x6 – fed output signals of the hidden layer with a delay of one cycle с1-1, c2-1, c3-1,
inputs x7, x8, x9 – output signals of the hidden layer with a delay of two cycles с1-2, c2-2, c3-2. In fig. 6,
the layer memory is represented as a stack of layer output signals y1, y2, …, yn, where n – size of the
stack.</p>
      <p>Dynamic
memory
Temporary</p>
      <p>dela (-1)
Temporary
delay (-2)
Temporary
delay (-m)
{wij}-1
{wij}-2
{wij}-m
+
+
+
1
1
1</p>
      <p>F2 c1
F2
F2
y1(n+1)
yM(n+1)
c2</p>
      <p>yN(n+1)
ck</p>
      <p>Outputs
u1(n)
u2(n)
up(n)</p>
      <p>External
outputs
...</p>
      <p>y1
y2
yn
y
r
o
m
e
m
r
e
y
a
L</p>
      <p>Context layer</p>
      <p>z-1
1</p>
      <p>The algorithm and software implementation of the hybrid training method for recurrent neural
networks were developed by the authors Hryhorii Bieliavskyi, Volodymyr Lila, Yevhenii Puchkov
[25]. The result of their work is to obtain a parametric training model for recurrent neural networks
that contains a wide range of known training algorithms (adaptive and genetic algorithms) and allows
you to adjust the parameters for the best solution to the problem of time series analysis. In this work, a
modification of the developed algorithm was carried out, which consists in clarifying the choice of the
best individuals from the population, as well as introducing a correction factor into the crossing
procedure, which takes into account the probability of a stochastic change in engine parameters under
current operating conditions (table 3). To conduct an experiment, namely, training a neural network,
committees of 10 modified Jordan neural networks were built using each algorithm. The number of
neurons in the hidden layer is 9 (according to the Kolmogorov-Arnold-Hecht-Nielsen theorem). The
criterion for stopping training of the modified Jordan neural network is the root mean square error
with a value of 0.001, the step size ηk = 0.05, training epoch threshold – 1000. Examples from the
training sample, which was formed according to fig. 2, a, were submitted by chance. Sigmoidal
1  ex
1  ex
functions of the form f  x </p>
      <p>were used as the neuron activation function.
Training the neural network with an adaptive algorithm (table 4) until the transition criterion to
the genetic training method is reached
Creation of a population of N–1 individuals. A neural network trained by an adaptive algorithm
is added to the first population
Individuals are crossed with the probability of choosing a pair Pc, while each pair produces S
offspring. Determination of the genes of the descendant is made according to the expression:
Gi  D  Random?0.5?Gia : Gi ;
b
where Gi – gene of the new chromosome; Ga and Gb – genes of parental chromosomes; i – serial
number of the gene in the chromosome; Random – function that generates a uniform random
value on the segment of real numbers [0; 1]; D – correction factor for introducing randomness
into the value of the gene, the introduction of which is a modification of the existing algorithm,
which makes it possible to take into account the “instant” change at helicopter flight engine
parameter
Selection of the best N individuals from the new population, giving the smallest recognition
error, determined according to the expression:
y0
where y0 – output signal reference value; y – output signal value when recognizing the
reference value of the thermos-gas-dynamic parameter of the engine from the training sample
with a given set of weight coefficients (output signal reference value in this problem is the value
of engine thermos-gas-dynamic parameter in the absence of defects under normal operating
conditions).</p>
      <p>If the best representative of the individual corresponds to the given quality of training, the
transition to step 9 is performed.</p>
      <p>A mutation is carried out for individuals selected with a probability Pm. For each gene of the
selected individual with probability Pg, the gene is mutated according to the expression:</p>
      <p>Gi  Gi  Gi  Km  2  Random 1;
where Gi – chromosome gene; i – serial number of the gene in the chromosome; Random –
function that generates a uniform random value on the segment of real numbers [0; 1]; Km –
mutation coefficient (as a rule, Km∈[0; 1]).</p>
      <p>If the best representative of the individual corresponds to the specified training quality, go to
step 9, if not, return to step 4.</p>
      <p>Finish
Finding the initial values of the parameters: w0 – starting point, p0 – initial direction of
movement, η0 – step
Choosing the next vector from the training set and feeding it to the input of the neural network
Determining the direction of movement pk according to the expression:</p>
      <p>mink1,m
pk  g k    i  g ki ;</p>
      <p>i1
where pk – direction of movement; g j – direction of the anti-gradient at the j-th iteration; βi
– coefficient that determines the weight of the i-th gradient; m – number of memorized
gradients; k – serial number of the current iteration.</p>
      <p>Stop criteria computation – root mean square error</p>
      <p>If the stop condition is met, go to step 6, if not, go to step 2
Step
1</p>
      <p>According to the results of the comparison, the adaptive algorithm converges faster than the
genetic and hybrid ones. The threshold of 0.001 for 1000 epochs has not been overcome by any
gradient method. From this it follows that it is most expedient to use an adaptive method at the
beginning of training, which quickly finds a solution with a root-mean-square error of 0.003, and then
apply the genetic algorithm. In terms of the number of epochs, the genetic algorithm is in some cases
faster than the hybrid one. But for this task, the time of one epoch of the genetic algorithm is much
higher (200 milliseconds) than the average time of one epoch of the improved hybrid one (140
milliseconds). Therefore, we can conclude that the hybrid algorithm of the “improved adaptive +
genetic” option is best suited for this task. Fig. 10 shows the diagram of the change in the mean
b
Number
of epochs
550
640
400
1000
580
930
960
1000
980
1000
square error function according to the number of training epochs for "improved adaptive + genetic"
algorithm.</p>
      <p>The statistics of the approximation of the result to the reference value by the improved hybrid
algorithm in the problem of trend recognition is shown in fig. 11, which shows the values of the output
signal of the best chromosome in the current epoch. Experiments have shown that in order to achieve the
best recognition result with the resulting set of weights, the crossover probability is Pc = 0.64, Pm = 0.01.</p>
    </sec>
    <sec id="sec-6">
      <title>6. Results and discussion</title>
      <p>We will analyze the presence of a trend (fig. 2, a) in sections I and II using the neural network
apparatus. The implementation of low-pass and high-pass filters based on a modified Jordan neural
network with dynamic stack memory is shown in fig. 8. Analysis of the trend in the first section is
shown in fig. 9. The determination of the trend of the neural network on the second characteristic area
is shown in fig. 10. At the same time, one cell corresponds to half an hour of operation of the
helicopter’s control system. It can be seen that the emergence of a trend is noticed by the neural
network after the sixth cell. To complicate the process of trend recognition and to get as close to the
real situation as possible, an obstacle is "superimposed" on the input signal identified by the neural
network.</p>
      <p>In the process of mathematical modeling on a modified Jordan neural network with a dynamic stack
memory that implements recurrent filters, in comparison with the classic criteria for detecting the trend of
parameters. For example, of the TV3-117 engine, the results shown in fig. 11, where 1 – neural network
criterion (using a modified Jordan neural network with dynamic stack memory); 2 – neural network
criterion (using an ensemble of neural networks consisting of a perceptron and an RBF network); 3 –
scriterion; 4 – S'-criterion; 5 – Halden-Abbe r-criterion; 6 – modified r-criterion; 7 – u-criterion [14].
a
a
b
b
b</p>
      <p>Figure 10: Determination of the trend using a modified Jordan neural network knowledge base: a
– signal at the filter input; b – signal at the filter output</p>
      <p>In the work, a comparative assessment of the effectiveness of trend analysis of neural network and
classical criteria was carried out. A comparative study of the criteria was carried out on the basis of
simulation modeling, which made it possible to check a wide range of changes in measurement errors
and the intensity of trend manifestation. The value of the controlled parameter is equal to the sum of the
deterministic basis and random normally distributed interference with variance ξ. The deterministic
component is constant in the interval [0, t0], and then changes linearly with the rate a = tg(α) (1/s)
(where α – intensity of the trend). During the simulation, the value of a varied in the range [0.01; 1]; and
the value of ξ is in the range [0.001; 1]. During modeling, a sample variance calculated on the
stationarity interval [0, t0] was used to adjust the mathematical model of the helicopter TE. Starting from
the moment t0, the values of the criteria were calculated and the presence of a trend was checked. The
effectiveness of the criteria was evaluated by the time of activation of the criteria from the beginning of
the trend τ0 to the moment of time corresponding to the detection of the trend τlate [13, 22].</p>
      <p>The results of numerical modeling (table 7) indicate the possibility of solving the problems of
information monitoring of helicopter aircraft engines operational status, which allow, along with the
classical criteria for detecting the trend of parameters, to apply qualitatively new neural network
criteria that expand and complement the classical criteria. That increases the reliability of information
at helicopters TE operational status monitoring and at the stages of decision-making.</p>
      <p>Similar research was conducted using other architectures of neural recurrent networks as
implementing low-pass and high-pass filters (table 8). From the table 8, it can be seen that Jordan’s
modified neural network with dynamic stack memory is appropriate for use as an implementation of
low-pass and high-pass filters for the purpose of solving the task of helicopters TE parameters trend
analysis at flight modes, i.e., in real time.</p>
      <p>The technique of helicopters TE parameters complex monitoring at flight modes in a neural
network basis:</p>
      <p>1. Obtaining a training sample in N modes of a normally operating engine at a real-time rate under
normal operating conditions.</p>
      <p>2. Obtaining a training sample in N engine modes with a parameter trend in real time at the current
operating conditions.</p>
      <p>3. Choice of neural network architecture.
4. Choice of training algorithms.</p>
      <p>5. Training, testing and real-time trend recognition of engine parameters under current operating
conditions.</p>
      <p>6. Monitoring of helicopters TE parameters at flight modes by neural networks.</p>
      <p>7. Adaptation of neural networks in the environment of an active expert system [27, 28].</p>
      <p>Under the conditions of on-board implementation of the developed neural network method for
trend analysis of helicopter turboshaft engine parameters, the expediency of using the 64-bit Intel
Neural Compute Stick 2 neuro processor using a Python programming language (using the Keras
open-source library) was proved in [29] (fig. 12).</p>
      <p>Neuro processors of this series are widely used in modern digital automatic control systems,
including in aviation. The presence of a multiplier-accumulator module in the core of this
microprocessor makes it possible to increase the speed of calculating the algorithm by combining
multiplication and addition operations with weighted summation in the neuron adder.
7. Conclusions</p>
      <p>1. The neural network method for analyzing aircraft engine parameters trend has been further
developed, which, through the use of a modified Jordan neural network with dynamic stack memory,
makes it possible to detect the appearance of helicopters turboshaft engines parameters trend at flight
modes, improve accuracy to 0.995 and reduce the trend recognition error to 0.056.
2. The hybrid algorithm (adaptive + genetic) for training recurrent neural networks, in particular,
the Jordan neural network, has been improved, which, by refining the criterion for choosing the best
individuals from the population, as well as introducing a correction factor into the crossing procedure.
It takes into account the probability of a stochastic change in engine parameters in the current
conditions, allowed to optimize the training of the modified Jordan neural network with dynamic
stack memory to solve the task of helicopters turboshaft engines at flight modes parameters trend
recognizing.</p>
      <p>3. The results of numerical simulation indicate the possibility of solving the problems of integrated
monitoring of helicopters turboshaft engines operational status at flight modes based on active expert
systems [27, 28], which allow, along with the classical criteria for identification of parameters trend,
to apply qualitatively new neural network criteria that expand and supplement the classical criteria. It
increases the reliability of information up to 100 % in the control and diagnostics of helicopters
turboshaft engines parameters and at the decision-making stages.</p>
      <p>4. The technique developed and described in this work has been tested in the environment of
active expert systems [27], has shown high efficiency in solving the problems of integrated
monitoring of the operational status and operation management (parameters control, diagnostics,
debugging and predicting) of helicopters turboshaft engines in flight modes.</p>
      <p>5. The operation of aircraft gas turbine engines of the 5th–6th generations, including helicopters
turboshaft engines, the complication of their technical systems and subsystems, as well as the
increased requirements for flight safety, have led to the need to create intelligent systems capable of
performing certain functions of a human expert. To assist in the search of the optimal solution, to
issue advice and recommendations in real time in the process of integrated monitoring and operation
management of helicopters turboshaft engines.
8. References
[12] J. Raffort, C. Adam, L. C. Duy, M. Carrier, F. Lareyre, Application of Artificial Intelligence for
Automatic Vascular Segmentation: Development of a Hybrid Method Combining Expert System
with Deep Learning, European Journal of Vascular and Endovascular Surgery, vol. 63, issue 2
(2022) e42–e43. doi: 10.1016/j.ejvs.2021.12.033
[13] S. Vladov, L. Pylypenko, N. Tutova, I. Dieriabina, A. Yanitskyi, Control and diagnostics of
TV3-117 aircraft engine technical state by analysis of its parameters trend, Visnyk of Kherson
National Technical University, no. 1 (76) (2021) 141–154. doi:
10.35546/kntu20784481.2021.1.11
[14] A. Oseni, B. Dzwairo, Trend analysis and artificial neural networks forecasting for rainfall
prediction, Environmental Economics, no. 7 (4-1) (2016) 149–160. doi:
10.21511/ee.07(41).2016.07
[15] F. Prado, M. C. Minutolo, W. Kristjanpoller, Forecasting based on an ensemble Autoregressive
Moving Average – Adaptive neuro – Fuzzy inference system – Neural network – Genetic
Algorithm Framework, Energy, vol. 197 (2020) 117159. doi: 10.1016/j.energy.2020.117159
[16] A. Y. Alanis, N. Arana-Daniel, C. Lopez-Franco, Artificial Neural Networks for Engineering</p>
      <p>Applications, London, Academic Press (2019) 176 p. doi: 10.1016/C2018-0-01649-7
[17] S. Herzog, C. Tetzlaff, F. Worgotter, Evolving artificial neural networks with feedback, Neural</p>
      <p>Networks, vol. 123 (2020) 153–162. doi: 10.1016/j.neunet.2019.12.004
[18] R. V. Williams-Garcia, S. Nicolis, Chaos, Solitons &amp; Fractals, vol. 165, part 1 (2022) 112739.</p>
      <p>doi: 10.1016/j.chaos.2022.112739
[19] H. Robinson, S. Pawar, A. Rasheed, O. San, Physics guided neural networks for modelling of
non-linear dynamics, Neural Networks, vol. 154 (2022) 333–345. doi:
10.1016/j.neunet.2022.07.023
[20] X. Lai, S. Tong, G. Zhu, Adaptive fuzzy neural network-aided progressive Gaussian approximate
filter for GPS/INS integration navigation, Measurement, vol. 200 (2022) 111641.
doi: 10.1016/j.measurement.2022.111641
[21] Z. Yan, T. Guo, A. Zhao, Q. Kong, J. Zhou, Reliable exponential H∞ filtering for a class of
switched reaction-diffusion neural networks, Applied Mathematics and Computation, vol. 414
(2022) 126661. doi: 10.1016/j.amc.2021.126661
[22] S. Zhernakov, R. Ravilov, Trend analysis of aircraft GTE parameters based on neural networks
technology, Bulletin of USATU, vol. 15, no. 4 (44) (2011) 25–32.
[23] A. Wysocki, M. Ławryńczuk, Jordan neural network for modelling and predictive control of
dynamic systems, Conference: 2015 20th International Conference on Methods and Models in
Automation and Robotics (MMAR), 24–27 August 2015. doi: 10.1109/MMAR.2015.7283862
[24] V. Lila, Ye. Puchkov, Methodology of training recurrent artificial neural network with dynamic
stack memory, Software &amp; Systems, no. 4 (108) (2014) 132–135. doi:
10.15827/0236235X.108.132-135
[25] H. Bieliavskyi, V. Lila, Ye. Puchkov, Algorithm and software implementation of the hybrid
method training artificial neural network, Software products and systems, no. 4 (2012) 96–100.
[26] S. Vladov, Y. Shmelov, R. Yakovliev, Methodology for Control of Helicopters Aircraft Engines
Technical State in Flight Modes Using Neural Networks. The Fifth International Workshop on
Computer Modeling and Intelligent Systems (CMIS-2022), May, 12, 2022, Zaporizhzhia,
Ukraine. CEUR Workshop Proceedings (ISSN 1613-0073), vol. 3137 (2022) 108–125.
doi: 10.32782/cmis/3137-10
[27] Y. Shmelov, S. Vladov, Y. Klimova, M. Kirukhina, Expert system for identification of the
technical state of the aircraft engine TV3-117 in flight modes, System Analysis &amp; Intelligent
Computing : IEEE First International Conference on System Analysis &amp; Intelligent Computing
(SAIC), 08–12 October 2018 77–82. doi: 10.1109/SAIC.2018.8516864
[28] S. Vladov, Y. Shmelov, M. Petchenko, A Neuro-Fuzzy Expert System for the Control and
Diagnostics of Helicopters Aircraft Engines Technical State. ICTERI 2021: ICT in Education,
Research, and Industrial Applications, 28 September – 02 October 2021, Kherson, Ukraine.</p>
      <p>CEUR Workshop Proceedings (ISSN 1613-0073), vol. 3013 (2021) 40–52.
[29] S. Vladov, K. Kotliarov, S. Hrybanova, O. Husarova, L. Chyzhova, On-board information
restoring method in case of failure of one of the sensors of the aircraft engine TV3-117 based on
neural network technologies, Transactions of Kremenchuk Mykhailo Ostrohradskyi National
University, issue 6/2019 (119) (2019) 91–98. doi: 10.30929/1995-0519.2019.6.91-98</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D.</given-names>
            <surname>Burini</surname>
          </string-name>
          , S. De Lillo, L. Gibelli,
          <article-title>Collective learning modeling based on the kinetic theory of active particles</article-title>
          ,
          <source>Physics of Life Reviews</source>
          , vol.
          <volume>16</volume>
          (
          <year>2016</year>
          )
          <fpage>123</fpage>
          -
          <lpage>139</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.plrev.
          <year>2015</year>
          .
          <volume>10</volume>
          .008
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>C. B. R.</given-names>
            <surname>Ng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Sardina</surname>
          </string-name>
          ,
          <string-name>
            <surname>T.</surname>
          </string-name>
          <article-title>O'bree, Designing an expert system to support aviation occurrence investigations</article-title>
          ,
          <source>Expert Systems with Applications</source>
          , vol.
          <volume>207</volume>
          (
          <year>2022</year>
          )
          <article-title>117994</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.eswa.
          <year>2022</year>
          .117994
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>U. A.</given-names>
            <surname>Rooh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.-J.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>M. Ali, Fuzzy, neural network and expert systems methodologies and applications: A review</article-title>
          ,
          <source>Journal of Mobile Multimedia</source>
          , Vol.
          <volume>1</volume>
          , no.
          <issue>1&amp;2</issue>
          (
          <year>2015</year>
          )
          <fpage>157</fpage>
          -
          <lpage>176</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J. L. G.</given-names>
            <surname>Rosa</surname>
          </string-name>
          ,
          <article-title>Artificial neural networks - models and applications</article-title>
          ,
          <source>InTechOpen</source>
          (
          <year>2016</year>
          ) 414 p.
          <source>doi: 10.5772/61493</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Shen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Khorasani</surname>
          </string-name>
          ,
          <article-title>Hybrid multi-mode machine learning-based fault diagnosis strategies with application to aircraft gas turbine engines</article-title>
          ,
          <source>Neural Networks</source>
          , vol.
          <volume>130</volume>
          (
          <year>2020</year>
          )
          <fpage>126</fpage>
          -
          <lpage>142</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.neunet.
          <year>2020</year>
          .
          <volume>07</volume>
          .001
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>B.</given-names>
            <surname>Li</surname>
          </string-name>
          .
          <string-name>
            <given-names>Y.-P.</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <article-title>Group reduced kernel extreme learning machine for fault diagnosis of aircraft engine</article-title>
          ,
          <source>Engineering Applications of Artificial Intelligence</source>
          , vol.
          <volume>96</volume>
          (
          <year>2020</year>
          )
          <article-title>103968</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.engappai.
          <year>2020</year>
          .103968
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Carver</surname>
          </string-name>
          , G. Rothermel,
          <string-name>
            <given-names>T.</given-names>
            <surname>Menzies</surname>
          </string-name>
          ,
          <article-title>Assessing expert system-assisted literature reviews with a case study</article-title>
          ,
          <source>Expert Systems with Applications</source>
          , vol.
          <volume>200</volume>
          (
          <year>2022</year>
          )
          <article-title>116958</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.eswa.
          <year>2022</year>
          .116958
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J.</given-names>
            <surname>Straub</surname>
          </string-name>
          ,
          <article-title>Automating the design and development of gradient descent trained expert system networks</article-title>
          ,
          <source>Knowledge-Based Systems</source>
          , vol.
          <volume>254</volume>
          (
          <year>2022</year>
          )
          <article-title>109465</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.knosys.
          <year>2022</year>
          .109465
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>E.</given-names>
            <surname>Lughofer</surname>
          </string-name>
          ,
          <article-title>Evolving multi-user fuzzy classifier systems integrating human uncertainty and expert knowledge</article-title>
          ,
          <source>Information Sciences</source>
          , vol.
          <volume>596</volume>
          (
          <year>2022</year>
          )
          <fpage>30</fpage>
          -
          <lpage>52</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.ins.
          <year>2022</year>
          .
          <volume>03</volume>
          .014
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>J. Y.</given-names>
            <surname>Shin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Kim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. J.</given-names>
            <surname>Hwang</surname>
          </string-name>
          ,
          <article-title>Prior preference learning from experts: Designing a reward with active inference</article-title>
          ,
          <source>Neurocomputing</source>
          , vol.
          <volume>496</volume>
          (
          <year>2022</year>
          )
          <fpage>508</fpage>
          -
          <lpage>515</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.neucom.
          <year>2021</year>
          .
          <volume>12</volume>
          .042
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Cao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z. J.</given-names>
            <surname>Zhou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. H.</given-names>
            <surname>Hu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. W.</given-names>
            <surname>Tang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <article-title>A new approximate belief rule base expert system for complex system modelling, Decision Support Systems</article-title>
          , vol.
          <volume>150</volume>
          (
          <year>2021</year>
          )
          <article-title>113558</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.dss.
          <year>2021</year>
          .113558
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>