<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Intelligent time series forecasting system</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>V V Borisov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>P I Komarov</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>V S Luferov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>The Branch of National Research University «Moscow Power Engineering Institute» in Smolensk</institution>
          ,
          <addr-line>Smolensk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>455</fpage>
      <lpage>461</lpage>
      <abstract>
        <p>The developed intellectual system for forecasting time series based on artificial neural networks, adaptive neural-fuzzy models and models based on the decomposition of fuzzy time series is considered. The developed system is designed for modeling time series by various methods in order to select the best model in terms of accuracy for operation in forecasting tasks. The system provides ample opportunities and convenient interface for acquiring knowledge, skills in creating, teaching, comparing the results of applying intelligent models and methods for solving theoretical and practical problems of analyzing and forecasting time series in different subject areas.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Currently, there is a large number of time-series (TS) forecasting systems [
        <xref ref-type="bibr" rid="ref1 ref2">1-2</xref>
        ], which, as a rule, are
oriented toward the implementation of two classes of methods for forecasting TS: statistical and
intellectual. In contrast to statistical methods, intelligent methods for predicting TS are characterized
by the ability to take into account mutually influencing (in not only correlating) different-quality
factors.
      </p>
      <p>At the same time, for these models there is a problem of determining their type, structure. In
addition, IT professionals, rather than domain specialists, who often do not have the required skills in
the field of information systems design, carry out the creation of intelligent forecasting systems (IFS).
This leads to a more complicated process and a justified increase in the development time of the IFS.</p>
      <p>
        Currently, the most popular language tools for creating intelligent systems are R, Python
programming languages using the capabilities of mathematical packages such as MatLab [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
However, to forecast time series based on intelligent models, domain specialists need to know the
relevant software tools.
an intuitive interface that allows domain specialists to create, configure, modify and use
intelligent models quickly and easily to forecasting time-series;
ease of specifying interdependencies between input and output parameters, taking into account
the required «depth» of autoregression;
automatic generation and verification of training samples for intelligent models of various
types;
flexible change in the structure and parameters of intellectual models in the process of
forecasting TS.
      </p>
      <p>An intelligent time series forecasting system is proposed, the structure of which is shown in Figure
User
e
c
a
f
r
e
t
n
i
r
e
s
U</p>
      <sec id="sec-1-1">
        <title>The module for learning sample generation</title>
      </sec>
      <sec id="sec-1-2">
        <title>Module for choosing the type of intellectual model</title>
      </sec>
      <sec id="sec-1-3">
        <title>Module for building and teaching intelligent models</title>
      </sec>
      <sec id="sec-1-4">
        <title>Module for forecasting time series</title>
      </sec>
      <sec id="sec-1-5">
        <title>A comparison module for the results of forecasting time series</title>
      </sec>
      <sec id="sec-1-6">
        <title>The module for analysis and accounting of the influence of time series</title>
      </sec>
      <sec id="sec-1-7">
        <title>Module for time series generation</title>
      </sec>
      <sec id="sec-1-8">
        <title>The database module</title>
        <p>TБhБаeзаазbамaмsоeодoделfелейей
intellectual
models</p>
      </sec>
      <sec id="sec-1-9">
        <title>The module for the formation of the resulting calculations</title>
        <p>The database module accumulates data from external sources. External data sources can be
enterprise database management systems, data tables, specialized data files, expert opinions, etc. The
time series generation module converts unstructured data into time series with varying degrees of
discretization. Time series can be changed at any stage of the work of the intellectual time series
forecasting system If necessary, a time series can be specified by entering data through the user
interface.</p>
        <p>The module for analyzing and accounting for time series interactions allows the user to perform
time series analysis, determine correlation, autocorrelation, etc. The analysis of time series allows
specialists to substantiate the correctness of the construction of models, to find out trends and patterns
that are subsequently accumulated and used to account for the relationship between input and output
variables. When analyzing time series, the user interacts with the module through an intuitive
interface.</p>
        <p>When the module for forecasting time series predicts, the following steps are performed:
1. construction of linguistic variables based on the clustering algorithm;
2. formation of fuzzy rule base based on clustering algorithm;
3. training model based on retrospective data obtained from the fuzzy partitioning module, and
the output of training results
4. forecasting electric load potential forecast horizon.</p>
        <p>After the implementation of forecast verification data occurs, if there is reference data, and output
the results.</p>
        <p>From the set of time series using the module of training sample formation for time series, the
relationships between output and input variables are formed and selected with allowance for
autoregression:</p>
        <p>P(t 1)  f  P(t), P(t 1), U (t 1), U (t),...  ,
where P(t 1) – forecasted value of time series; P(t) – the previous value of the forecasted time series;
U (t 1), U (t) – time series that have a direct or indirect effect on the forecasted time series.</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>3. Libraries of intelligent time series forecasting system</title>
      <p>The subject domain expert selects and configures the models presented in the model database that
contains three types of intelligent models from the following libraries:
 FANN (Fast Artificial Neural Network);
 FL (FuzzyLogic);
 FTSD (Fuzzy Time Series Decomposition).</p>
      <p>FANN (Fast Artificial Neural Network) is a library for constructing and using artificial neural
networks for forecasting time series. This library provides an interface for tuning and subsequent use
of artificial neural networks (ANN) such as multilayer perceptron. The library is available on the
Internet at: http://leenissen.dk/fann/wp/.</p>
      <p>This library has the following features:
 ANN training on back propagation of the error;
 transformation of the ANN structure in the learning process;
 comes with open source;
 library is cross-platform.</p>
      <p>
        FL (FuzzyLogic) is a library for using fuzzy inference models based on the Mamdani and Sugeno
algorithms for forecasting time series. The library was developed by one of the authors of this article
and is available on the Internet at: https://github.com/Luferov/FuzzyLogic. Based on the Sugeno fuzzy
inference algorithm, an adaptive network-based fuzzy inference system output is implemented. The
model is trained by back propagation of the error [
        <xref ref-type="bibr" rid="ref4 ref5">4-5</xref>
        ].
      </p>
      <p>
        The library has the following features:
 use of Mamdani and Sugeno fuzzy inference algorithms;
 implementation of the «mountain» clustering algorithm for model training;
 implementation of the algorithm for fuzzy expansion of time series for flexible separation of
time series into trend and residual components, depending on the specified «step» of the fuzzy
partition [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>FTSD (Fuzzy Time Series Decomposition) is a library for building forecastion models based on
fuzzy time series decomposition. The peculiarity of forecasting time series based on time series
decomposition consists in isolating the trend component from the time series at each prediction step
and in tracking the dynamics of the process in forecasting.</p>
      <p>The module for building and teaching intelligent models initializes the intellectual model chosen by
the expert (it`s type and structure). Based on the established relationship, the model is trained, its
adequacy is estimated and the reliability of the time series forecasting.</p>
      <p>After training, time series forecasting is performed using the module for forecasting time series. In
the process of forecasting, the expert can perform structural and parametric adjustment of the model.</p>
      <p>The results of the forecast, obtained with the use of different intellectual models, can be compared
with each other and with reference values by means of the comparison module for the results of
forecasting time series. Depending on the results of the comparison, the decision is made to choose the
best or correct the models used, using the module for generating the resulting calculations.</p>
      <p>To demonstrate the efficiency of the developed intelligent time series forecasting system, consider
the operational and short-term time series forecasts.</p>
      <p>As an operational forecast (for 24 hours), let's consider use of ITSFS developed on the example of
comparison of the results of the electrical load of the Smolensk region in December 2017 with the use
of intelligent models of various types: artificial neural network (from the FANN library), neuro-fuzzy
model (from the FL library), models based on fuzzy time series decomposition (from the FTSD
library). The graphs of the electric load forecasts obtained using these models are shown in figure 2.
The operational projections are presented in table 1 and the comparative evaluation is presented in
table 2.
32716,33
33109,36
33342,39
33575,44
33556,03
33365,72
33171,02
32909,38
32612,72
32161,64
31681,77
31244,32
30908,3
30658,4
33763,95
33867,82
33793,18
34109,01
34530,65
34562,23
34828,68
35047,84
35338,31
34801,14
33882,99
32525,8
30951,73
29766,65
34335,99
34017,17
33992,74
34192,62
34280,33
34209,4
34005,97
33843,16
33675,62
33419,44
33099,67
32749,12
31976,78
31027,17</p>
      <p>As a short-term forecast (for 31 days), let's consider the use of the developed ISP BP by comparing
the results of the electrical load of the Smolensk region in December 2017 with the use of intelligent
models of various types: artificial neural network (from the Fann library), neuro-fuzzy model (from
the FL library), models based on fuzzy time series decomposition (from the ftsd library). The graphs
of the electric load forecasts obtained using these models are shown in figure 3. The results of the
comparative evaluation are presented in table 3.</p>
      <p>The forecasting of time series is carried out on the basis of intellectual models according to the
general algorithm. First, the final resultant sample is constructed, depending on the relationship
established between the input and output time series by the expert. Then the data is normalized, i.e. all
values of the initial data of the training sample are reduced to a single hypercube. This is important for
comparing time series to bring them to a single scale. If normalization is not necessary, the training
sample is applied to the model in a «raw» form. Then the validation of the intellectual model is carried
out, the horizon of possible forecasting is specified and the time series in the training sample is
compared. After that, the intellectual model is trained on a trained training sample. As a result, a
forecasted series is formed, which can be presented either in the form of a report, or used when
compared with the results of forecasting by other models.</p>
      <sec id="sec-2-1">
        <title>The application of the normalization</title>
        <p>factor to the training sample</p>
      </sec>
      <sec id="sec-2-2">
        <title>The use of training samples in the</title>
        <p>forecast model</p>
        <p>Building a training sample based on a specified relationship
[time series normalization is used]
[Yes]</p>
      </sec>
      <sec id="sec-2-3">
        <title>Entering a normalized training sample into the forecast model</title>
      </sec>
      <sec id="sec-2-4">
        <title>Validation of the forecast model</title>
      </sec>
      <sec id="sec-2-5">
        <title>Training of intellectual forecast model</title>
      </sec>
      <sec id="sec-2-6">
        <title>Output of forecasting results and report</title>
        <p>generation
[Validation errors occurred]
[Validation passed successfully]</p>
      </sec>
      <sec id="sec-2-7">
        <title>The output of the error message</title>
        <p>The developed ITSFS can be recommended as a teaching system for students in the field of
«Informatics and Computer Science», and will also be useful for students of other areas and specialists
engaged in the analysis and modeling of complex systems and processes under uncertainty, the
creation of intelligent information systems and technology.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>4. Conclusion</title>
      <p>The paper presents the developed intellectual time-series forecasting system that provides ample
opportunities and convenient interface for acquiring knowledge, skills and skills in creating, teaching,
comparing the results of applying intelligent models and methods for solving theoretical and practical
problems of time series analysis and forecasting in various subject areas. The developed system is
designed for modeling time series by various methods in order to select the best model in terms of
accuracy for operation in forecasting tasks.</p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgment</title>
      <p>The work was supported by the Russian Science Foundation, project No. 16-19-10568.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Averkin</surname>
            <given-names>A N</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kosterev</surname>
            <given-names>V</given-names>
          </string-name>
          <article-title>V Triangular norms in systems of artificial intelligence // Izvestiya Akademii Nauk</article-title>
          .
          <source>Theory and control systems</source>
          ,
          <year>2000</year>
          . №5. - PP.
          <fpage>106</fpage>
          -
          <lpage>109</lpage>
          . (in Russian)
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Halliwell</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Keppens</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shen Q Linguistic</surname>
          </string-name>
          <article-title>Bayesian networks for reasoning with subjective probabilities in forensic statistics/</article-title>
          <source>/ Proc. of the 5th International Conference on AI and Law</source>
          ,
          <year>2003</year>
          . - PP.
          <fpage>42</fpage>
          -
          <lpage>50</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Leonenkov</surname>
            <given-names>A V</given-names>
          </string-name>
          <string-name>
            <surname>Fuzzy</surname>
          </string-name>
          <article-title>modeling in MATLAB and fuzzyTECH</article-title>
          . -
          <string-name>
            <surname>St</surname>
          </string-name>
          .-Petersburg: BHVPetersburg,
          <year>2003</year>
          . -736 p.
          <article-title>(in Russian)</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Borisov</surname>
            <given-names>V V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kruglov</surname>
            <given-names>V V</given-names>
          </string-name>
          ,
          <article-title>Fedulov A S Fuzzy models</article-title>
          and networks. 2-nd ed. stereotype. - Moscow: Hot line-Telecom,
          <year>2012</year>
          . -284 p.
          <article-title>(in Russian)</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Borisov</surname>
            <given-names>V V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fedulov</surname>
            <given-names>A S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zernov M M Basics</surname>
          </string-name>
          <article-title>of hybridization of fuzzy models</article-title>
          .
          <source>Series “Fundamentals of fuzzy mathematics”. Book 9</source>
          .
          <article-title>Textbook for high schools</article-title>
          . - Moscow: Hot Line-Telecom,
          <year>2017</year>
          . -100 p.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Afanasyeva</surname>
            <given-names>T V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Namestnikov</surname>
            <given-names>A M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perfilieva</surname>
            <given-names>I G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Romanov</surname>
            <given-names>A A</given-names>
          </string-name>
          and
          <string-name>
            <surname>Yarushkina N G</surname>
          </string-name>
          <article-title>Forecasting time series: fuzzy models; under the scientific</article-title>
          . Ed.
          <string-name>
            <given-names>N.G.</given-names>
            <surname>Yarushkina</surname>
          </string-name>
          . - Ulyanovsk: UlSTU Publishing House,
          <year>2014</year>
          . - 145 p.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>