<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Diagnostic signal nonstationarity reduction to predict the helicopter transmission state on the basis of intelligent information technologies</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Zaporizhzhia National Technical University</institution>
          ,
          <addr-line>Zhukovsky str., 64, Zaporizhzhia, 69063</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Motor Sich” JSC</institution>
          ,
          <addr-line>Motorostroiteley avenue, 15, Zaporizhzhia, 69068</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0001</lpage>
      <abstract>
        <p>Analysis process and transformation of non-stationary diagnostic signals to reduce the degree of their non-stationarity and the subsequent synthesis of neural network predictive model based on them are considered. The software which allows to apply the developed methods for processing of signals of diagnostics of transmission of the helicopter and on their basis to build the forecasting model for the solution of practical problems of technical diagnostics is developed.</p>
      </abstract>
      <kwd-group>
        <kwd>nonstationary signal</kwd>
        <kwd>diagnosis</kwd>
        <kwd>Dickey - Fuller criterion</kwd>
        <kwd>neural network</kwd>
        <kwd>dimension reduction</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Preventing machinery failure is an important component of the maintenance activities
of most engineering systems. For quality control of a technical product, at the end of
its production and during design tests technical diagnostics is carried out.</p>
      <p>Automation of decision-making in the process of technical diagnosis is an urgent
task, as it helps to reduce the load on the human operator, as well as provides
efficiency and speed of decision-making and reduces the dependence of complex
technical systems on the negative impact of the human factor.</p>
      <p>A promising basis for solving the problems of automation of diagnosis are
intelligent information technologies that are able to build models for examples –
experimental observations "input - output" and extract knowledge from the data in the
learning process.</p>
      <p>The paper considers the process of diagnosing the helicopter transmission. The
helicopter is a complex and valuable technical product. Therefore, after designing the
test sample is tested on the stand for a large number of hours. During these tests,
changes in the vibration level of the sample are monitored. As a result of such tests, a
large amount of data is accumulated in the form of diagnostic signals.</p>
      <p>A sharp increase in vibration negatively affects the sample, which can lead to its
failure. This entails material costs and the need to suspend testing. Therefore, having
a system that can predict the vibration level for a certain time in advance will help to
improve the testing process.</p>
      <p>
        The basis of such a system can be used an intelligent model of data-driven [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ],
for example, as one of the most powerful ones - the neural network model, by
teaching it to predict the future level of vibration based on historical data collected.
However, incoming signals are characterized by a high degree of non-stationary,
which makes complex and long-time synthesis and training of such models.
      </p>
      <p>The goal of the work is to develop methods for converting diagnostic signals to
reduce their dimension, allocating the necessary component and reducing the degree
of their non-stationary for further synthesis of neuromodels based on them.</p>
      <p>The objective of this study is to predict these signals using neural network models.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Formal problem statement</title>
      <p>
        Consider the problem of diagnosing the helicopter transmission [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Preventing
machinery failure is an important component of the maintenance activities of most
engineering systems. Helicopters are constantly exposed to periodic loads and
vibrations that initiate and propagate the occurrence of damage in many components
of the equipment. This is due to the design of the helicopter and the presence of
complex mechanical systems, such as the inventive rotor, control rotor, main gearbox
and other transmission elements. In most cases, the failure of these systems lead to
catastrophic situations.
      </p>
      <p>
        For monitoring the technical condition of the helicopter used systems like Health
and Usage Monitoring Systems (HUMS) [
        <xref ref-type="bibr" rid="ref5 ref6">5-6</xref>
        ]. These systems make it possible to
detect damage in the transmission components and predict their residual life.
      </p>
      <p>Important in HUMS is the ability to assess the technical condition of critical
elements of the transmission, using the data of vibration signals that were recorded
during the flight or ground tests.</p>
      <p>A neural network model will be used as a predictive model. Formally, the
problem of neuromodels synthesis can be presented in this form.</p>
      <p>Suppose given the original sample as a set of prece-dents (instances) &lt;xt, yt&gt; is a
set of S precedents characterizing dependence yt(xt), at the moment t, t = 1, 2, …, T,
where xt={xst}, y={yst}, s = 1, 2, ..., S, characterized by the set of N input features
{xtj}, j = 1, 2, ..., N, where j is a number of feature, and output feature y. Each s-th
precedent can be noted as &lt;xst, yst&gt;, where xst={xstj}.</p>
      <p>Then the problem of model synthesis of dependence yt(xt) will be considered in
search of such structure F() and adjusting such values of parameters w of a model
which will satisfy the model quality criterion f(F(), w, &lt;xt, yt&gt;) → opt, where opt – is
a symbol of optimum. Usually, the criterion of learning quality of neuromodels is
defined as a function of model error (1):
Е 
1 S</p>
      <p> ( y5  F ( , x5 ))2  min .
2 s1
(1)
3</p>
    </sec>
    <sec id="sec-3">
      <title>Analysis of the level of nonstationarity of the signals of the diagnostic process</title>
      <p>In most research methods, it is assumed that the signal, and in General, any time
series is stationary, and the time dependence is considered possible to take into
account a variety of non-statistical methods. For example, the series is decomposed
into three components: trend, cyclic and random. A trend is a component of a series
that changes over a long period of time due to the influence of fundamental factors.
The cyclic component changes in time with a certain period according to the course of
repetitive processes. The random component includes all the last components that can
not be assigned to one of the first two groups. The use of such separation for technical
diagnostic signals may not provide optimum results due to the following factors.</p>
      <p>First, the component can be quite complicated. For example, its trend
characteristics may be nonlinear and non-linear, as predicted in most trend allocation
methods. Secondly, in the tasks of technical diagnostics there is always a "white
noise", the smallest error of forecasting which is equal to its dispersion. Thus, the
series is divided into three parts, although this separation is fuzzy, the cyclic
component can become a trend at intervals of less than a period, and the trend and the
cyclic component can go into the category of random component.</p>
      <p>
        The solution of the problem of stationary signaling of technical diagnostics is
possible, but in most cases it entails a significant change in the structure of the signal
itself. And the evaluation of the technical product on the received signal can not
provide the necessary level of its quality. Metrics that are based on the components of
its internal structure, for example, based on its wavelet decomposition [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], can be
applied to a non-stationary signal to assess the quality of a technical product on a
diagnostic signal. However, before switching to the application of such methods of
constructing forecasting models, it is necessary to make sure that all possible
procedures have been carried out to minimize the unsteadiness of the series, which
does not lead to a significant change in its initial structure.
      </p>
      <p>
        To estimate the degree of unsteadiness of the signal, we will use the dilated
Dickey-Fuller criterion [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], the number of shifts will be calculated based on the data
minimization of the information criterion (AIC - metric). This criterion is used to test
the hypothesis of stationarity of the time series. Also, this criterion can be used to
estimate the degree of nonstationarity of the time series. The closer the criterion value
to the boundary, the lower the degree of nonstationarity has the signal. The values of
the Dickie-Fuller criteria for the obtained values are given in Table 1.
      </p>
      <p>From the results it is possible to observe a sufficiently high degree of unsteadiness
of the studied signals. To find the relationship between the current and the previous
signal values, we use the auto-correlation function. Autocorrelation is a correlation of
the function itself with a certain variable of an independent variable. The
autocorrelation function is defined as:

</p>
      <p>R f ( )   f (t) f * (t  )dt ,
where the function f (t ) integrates into a product with a complex conjugate and a
function displaced by a certain value .</p>
      <p>The graph of the signal received on the intermediate gearbox (axial direction of
measurement), which characterizes the state of the first gear drive of the intermediate
gearbox is shown in Fig. 1. The graph also contains a 95% confidence interval to
determine the statistical significance of the autocorrelation coefficient.</p>
      <p>The carried autocorrelation analysis confirmed the proposed assumption of the
presence of cyclicity in the signal. The presence of auto-correlation complicates the
use of a number of methods of analysis of time series. Therefore, to reduce
autocorrelation, elimination is used to shift from correlation of levels to correction of
deviations from trends - residues (for example, the conversion of a time series into a
number of values of differences between its adjacent members). This approach can
not be applied in this case due to the above reasons for impossibility to change the
initial structure of the diagnostic signal.</p>
      <p>Another solution to this problem is to split the signal into several components,
which will eliminate cyclicity and maintain the original signal strength.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Reduction of the nonstationarity of the signals based on information about the operating modes in the cycle of diagnosis</title>
      <p>
        To reduce the non-stationary time series, methods can be applied that will lead to its
breakdown into a certain number of smaller time series, in such a way that they are
absent, explicitly, as a component of cyclicity [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. When applying such a
breakdown, the problem is to find the period of the cycle (which can change over
time). For qualitative partitioning of a series it is necessary to use knowledge of the
subject area of the investigated process. Apply expert knowledge in the field of
aircraft engineering for breaking the signal of diagnosis. Fig. 2 shows a graph of
signal of rotation of the turbocharger rotor left engine.
      </p>
      <p>We process the processing of these signals to obtain the values of the rotational
frequency by counting the number of times the signal changes in 1 second (the
discretization frequency of the rough signal 7200 Hz). The graph of the signal
received on the intermediate gearbox (axial direction of measurement), which
characterizes the state of the first gear drive of the intermediate gearbox is shown in
Fig. 3.</p>
      <p>After processing the signal, you can observe the progress of 18 cycles of diagnosis.
You can also observe the change in operating modes. In one mode of operation, the
speed does not change significantly. The processed signals of rotation of the
turbocharger rotor right engine demonstrate similar results. This is because the left and
right engines duplicate each other to increase reliability.</p>
      <p>It is proposed to allocate from the general signal of diagnosing the intervals during
which the diagnosis took place in one mode of operation. For example, we isolate
from the general signal for diagnosing the intervals during which the diagnosis took
place in the second mode of operation. It is proposed to perform autocorrelation
analysis for the received signals.</p>
      <p>The graph of the signal received on the intermediate gearbox (axial direction of
measurement), which characterizes the state of the first gear drive of the intermediate
gearbox in the second mode of operation of turbochargers is shown in Fig. 4 The
graph also contains a 95% confidence interval to determine the statistical significance
of the autocorrelation coefficient.</p>
      <p>Fig. 4. Autocorrelogram of signal received on the intermediate gearbox (axial direction of
measurement) in the second mode of operation of turbochargers</p>
      <p>The performed autocorrelation analysis demonstrates the absence of expressed
cyclicity in the signal. This indicates a qualitative breakdown of diagnostic signals,
which should help to reduce the unsteadiness of newly formed signals.</p>
      <p>To quantify the degree of non-stationarity of the signals, we calculate the values of
the Dickey - Fuller criterion for them. Table 2 contains the values of the extended
Dickey - Fuller criterion for part of the signals obtained from the signals of
diagnosing the helicopter transmission by the proposed methods gearbox in the
second mode of operation of turbochargers.</p>
      <p>There is a significant decrease in the values of the Dickey - Fuller criteria, which
indicates a decrease in the degree of signal non-stationarity after the proposed
partition. Also, there is a much smaller scope of the test values than in table 1, this
makes it possible to assume that the degree of non-stationarity of the signals
corresponds to the non-stationarity of the diagnosis process in this mode. All this
makes it possible to better use the signals for the synthesis of predictive models.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Experiments and results</title>
      <p>A four – layer recurrent neuron network with an input layer, two hidden layers with
GRU-cell (Fig. 5) and an output layer with one linear neuron was chosen as a neu-ral
network model. GRU [15] is a simplified model of a well – known LSTM cell with
significantly fewer parame-ters. Through this, learning GRU is easier than LSTM, so
it is gaining popularity in many real-world tasks.</p>
      <p>ht-1
reset
gate</p>
      <p>Whr
Wxr</p>
      <p>x
rt</p>
      <p>Whh
Wxh cand. cell</p>
      <p>state tanh
Whu
Wxu
update
gate
h't
ut
+
x
1ht
xt</p>
      <p>Fig. 5. The structure of the GRU-cell</p>
      <p>At the input of the GRU-cell receives a vector x, which contains the current values
of the signals. The output of the cell is calculated by the following formulas (3)-(6):
ut   (Wxu xt  Whu ht1  bu ) ,
rt   (Wxr xt  Whr ht1  br ) ,
ht  tanh(Wxh xt  Whh (rt  ht1 )) ,
(6)
(7)
(8)
ht  (1  ut )  ht  ut  ht1 .</p>
      <p>(9)</p>
      <p>The synthesized neural network model was tested and optimized on a sampling of
signals during the diagnosis of the helicopter transmission at the second mode of the
turbochargers of the engines. The total initial sample contained data collected in total
for 1010 seconds for 22 diagnostic signals. She was divided into a training sample - 1
- 800 seconds, and the test - 801 - 1010 seconds.</p>
      <p>As the input data of the models, the data for all signals for a given time window
width were used. Data on one of the 22 signals with a given forecasting horizon, that
is, a forward shift in the time scale of 120 seconds, were used alternately as initial
data. The neural network error was calculated by formula 1. Neural network training
was conducted over 250 epochs.</p>
      <p>To improve the quality of the forecast, optimization of neural network
hyperparameters was carried out. The results are given in tables 3 - 5.</p>
      <p>The prediction error is 0.0167 for the second mode of operation of turbochargers,
which is 13.45 % in percentage terms. The forecast error for a signal without division
into operating modes is 0.1096, which is 28.56% in percentage terms.</p>
      <p>Therefore, if it is necessary to predict the state of the helicopter transmission for all
modes, it is recommended to divide the signal by the proposed method, to predict
each part of the signal using a predictive model and combine them on the basis of
information about the duration of the operating modes.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>In the conducted research of methods of analysis and transformation of non-stationary
signals of diagnosing the method of reducing the degree of non-stationarity of the
received signals based on expert information about the modes of operation during the
diagnosis cycle was proposed.</p>
      <p>The effectiveness of the method of reducing the degree of unsteadiness of signals
based on expert information about the modes of operation during the diagnosis cycle
is evidenced by a significant optimization of the value of the Dickey-fuller criterion
after its application. This method, unlike most, does not require changing the internal
structure of the signal, and works only by splitting the signal into several other
signals, which can then be combined.</p>
      <p>On the basis of processed signals, a neural network was synthesized to predict the
state of the helicopter transmission and its hyperparameters were configured.</p>
      <p>The results are planned to be used to improve the diagnostic quality of the
helicopter transmission.</p>
      <p>The method of transformation of nonstationary signals and the construction of
neural network models developed and applied in the investigated method can be used
to solve problems in which it is necessary to predict the future state of the object, by
its diagnostic signals.
14. MacKinnon, J. G.: Critical Values for Cointegration Tests. In: R. F. Engle and C.</p>
      <p>W. J. Granger, eds., Long-Run Economic Relationships: Readings in
Cointegration, Oxford University Press, pp. 267–276 (1991)
15. Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning, MIT Press (2016)
http://www.deeplearningbook.org</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Shin</surname>
            <given-names>Y. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xu</surname>
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Intelligent systems: modeling, optimization, and control</article-title>
          . CRC Press, Boca Raton (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Bishop C. M.:</surname>
          </string-name>
          <article-title>Pattern recognition and machine learning</article-title>
          . Springer, New York (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Giurgiutiu</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cuc</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goodman</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Review of vibration-based helicopters health and usage monitoring methods</article-title>
          .
          <source>In: 55th Meeting of the Society for Machinery Failure Prevention Technology - Proceedings, Virginia Beach, VA, 2-5 April</source>
          <year>2001</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Lymariev</surname>
            <given-names>I. O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Subbotin</surname>
            <given-names>S.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oliinyk</surname>
            <given-names>A. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drokin</surname>
            <given-names>I. V.</given-names>
          </string-name>
          :
          <article-title>Methods of large-scale signals transformation for diagnosis in neural network models</article-title>
          .
          <source>Radio Electronics</source>
          , Computer Science, Control, vol.
          <volume>4</volume>
          , pp.
          <fpage>63</fpage>
          -
          <lpage>71</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Kazlas</surname>
            <given-names>P. T.</given-names>
          </string-name>
          , Monsen P. T,
          <string-name>
            <surname>LeBlanc M. J.:</surname>
          </string-name>
          <article-title>Neural network-based helicopter gearbox health monitoring system</article-title>
          .
          <source>In: Neural Networks for Signal Processing, Proceedings of the IEEE-SP Workshop</source>
          , 6-
          <fpage>9</fpage>
          September 1993 : proceedings, pp.
          <fpage>431</fpage>
          -
          <lpage>440</lpage>
          (
          <year>1993</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Dempsey</surname>
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewicki</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Le</surname>
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Investigation of current methods to identify helicopter gear health</article-title>
          .
          <source>In: 7 IEEE Aerospace Conference, 3-10 March</source>
          <year>2007</year>
          : proceedings. - Montana. pp.
          <fpage>81</fpage>
          -
          <lpage>87</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Subbotin</surname>
            <given-names>S. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oliinyk</surname>
            <given-names>A. A.</given-names>
          </string-name>
          :
          <article-title>The dimensionality reduction methods based on computational intelligence in problems of object classification and diagnosis</article-title>
          .
          <source>Advances in Intelligent Systems and Computing</source>
          , vol.
          <volume>543</volume>
          , pp.
          <fpage>11</fpage>
          -
          <lpage>19</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Jensen</surname>
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shen</surname>
            <given-names>Q.</given-names>
          </string-name>
          :
          <article-title>Computational intelligence and feature selection: rough and fuzzy approaches</article-title>
          . John Wiley &amp; Sons, Hoboken (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Lee</surname>
            <given-names>J. A.</given-names>
          </string-name>
          :
          <article-title>Nonlinear dimensionality reduction</article-title>
          . Springer, New York (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Guyon</surname>
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Elisseeff</surname>
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>An introduction to variable and feature selection</article-title>
          .
          <source>Journal of machine learning research</source>
          , vol.
          <volume>3</volume>
          , pp.
          <fpage>1157</fpage>
          -
          <lpage>1182</lpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Tverdohleb</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Limarev</surname>
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Logominov</surname>
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dubrovin</surname>
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Wavelet analysis of complex nonstationary oscillatory signals</article-title>
          .
          <source>In: 4-th IEEE International ScientificPractical Conference “Problems of Infocommunications. Science and Technology.” - Proceedings</source>
          , Ukraine, Kharkiv,
          <string-name>
            <surname>NURE</surname>
          </string-name>
          ,
          <year>2017</year>
          . pp.
          <fpage>17</fpage>
          -
          <lpage>20</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Ukil</surname>
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Intelligent systems and signal processing in power engineering</article-title>
          . Springer, Berlin (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Dickey</surname>
            ,
            <given-names>D. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fuller</surname>
            ,
            <given-names>W. A.</given-names>
          </string-name>
          :
          <article-title>Distribution of the Estimators for Autoregressive Time-Series with a Unit Root</article-title>
          .
          <source>Journal of the American Statistical Assiciation</source>
          , vol.
          <volume>4</volume>
          , pp.
          <fpage>427</fpage>
          -
          <lpage>431</lpage>
          (
          <year>1979</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>