<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>About Designing an Intelligent System for Forecasting Electric Power Consumption Based on Artificial Neural Networks*</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>National University of Science and Technology MISIS</institution>
          ,
          <addr-line>4, Leninsky Prospekt, Moscow</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This article examines the problem of forecasting electric power consumption of central heating stations based on the data of a Moscow heating supply company. The features of the proposed neural-network forecasting model include historical data of electricity consumption, and average monthly temperature as a meteorological variable. The intelligent system for forecasting total electricity consumption of central heating supply stations proposed in this work is based on the dual forecasting method. The system consists of three predictor units, which allow to produce several complementary projection variants that can be combined, so the most rational of them can be selected.</p>
      </abstract>
      <kwd-group>
        <kwd>intelligent control of power systems</kwd>
        <kwd>electricity consumption</kwd>
        <kwd>neural-network models</kwd>
        <kwd>time series forecasting</kwd>
        <kwd>artificial neural networks</kwd>
        <kwd>machine learning</kwd>
        <kwd>automated electricity metering systems</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Electricity consumption forecasting is critical for the modern energy industry. Energy
enterprises in Russia are interested in an adequate evaluation of electricity
consumption for their facilities because the reasonableness of settlements with electricity
suppliers is dependent on that evaluation.</p>
      <p>Over the last decade, the digital transformation of the Russian fuel and energy
complex has stimulated the domestic industrial enterprises to implement automated
commercial electricity metering systems, or Automated System for Commercial
Accounting of Power Consumption (ASCAPC) for their facilities. ASCAPC smart
energy meters collect time series data of electricity consumption that are used for
forecasting electric power consumption of production facilities.</p>
      <p>To achieve a desired level of forecast accuracy, it is proposed to use artificial
neural networks for forecasting time series electricity consumption of central heating
supply stations.
* Copyright © 2021 for this paper by its authors. Use permitted under Creative Commons License
Attribution 4.0 International (CC BY 4.0).</p>
    </sec>
    <sec id="sec-2">
      <title>Materials and methods</title>
      <sec id="sec-2-1">
        <title>Description of the automated electricity metering system</title>
        <p>The ASCAPC is a two-level system with dedicated distributed functions for each of
the levels. Figure 1 shows the structure of the ASCAPC of a Moscow heating supply
company.</p>
        <p>The data processing complex comprises:
─ the existing data collection, processing, and storage servers of the existing district
heating stations’ ASCAPC of the heating supply company branches;
─ a workstation for daily generation of data for dispatching to the System Operator
(JSC “SO UPS”) and affiliated facilities of the wholesale energy and capacity
market (the OREM);
─ the existing common timing system of the above-mentioned ASCAPC.</p>
        <sec id="sec-2-1-1">
          <title>The information-measuring complex comprises: ─ multiple-tariff energy meters with load profile storing and event logging functions; ─ current transformers and voltage transformers with the defined accuracy class; ─ channeling equipment (a GSM module).</title>
          <p>The ASCAPC complies with the technical requirements of the OREM and
provides accurate measurements of the amount of consumed electric power and energy.
2.2</p>
        </sec>
      </sec>
      <sec id="sec-2-2">
        <title>Statistics of electric power consumption of the central heating stations</title>
        <p>Seasonality is present in electric power consumption of central heating supply
stations. As can be seen from the graph in Figure 2, the amount of electric power
consumed by heating stations evidently increased in October, with the beginning of the
heating season, and decreased in May.</p>
        <p>
          It is evident that electricity consumption trends are influenced by seasonal
fluctuations in meteorological factors [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ].
        </p>
        <p>The graph in Figure 3 shows data that are not clearly seasonal yet has similar
structure.</p>
        <p>In this work, the meteorological factor, which is average monthly temperature in
Moscow, is a feature variable in the forecasting model.
Extrapolation method based on exponential smoothing is one of the widely used
statistical methods for time series forecasting. The exponential smoothing is
implemented through the exponential filter, which weights past observations with
exponentially decreasing weights to forecast future values (1).</p>
        <p>~ ~ ~
X smth (1)  X smth (i  1)   ( X M (i)  X smth (i  1) ,
(1)</p>
        <p>Wherein X̃smth(i–1) is the past value, smoothed by the filter; α is the smoothing
parameter; XM is the initial time series value.</p>
        <p>As an example, the time series electricity consumption of CHS No9274 was
smoothed by the exponential filter with α set to 0.7. To lower the influence of external
disturbances, the three implementations of the exponential filter for the time series
from 2016 to 2018 were averaged (Figure 4).</p>
        <p>
          The resulting forecast for CHS No9274 for 2019 is shown in figure 5. As can be
seen from the graph (Figure 5), the extrapolation method based on exponential
smoothing can produce forecast for data that have seasonality [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ].
        </p>
        <p>However, unlike neural network approaches, this statistical method does not
consider the influence of the external factors. Moreover, to forecast by extrapolation, the
process must be monotone and without sharp short-term jumps.
2.4</p>
      </sec>
      <sec id="sec-2-3">
        <title>Forecasting using artificial neural networks</title>
        <p>
          Creating the training datasets. For time series with the seasonal component, the
training datasets for the “winter” season (October–April) (Figure 6) and the “summer”
season (May–September) were created [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. The input feature variables are data of
actual electricity consumption (k), historical data of electricity consumption (in the
two previous months, k-1 and k-2), and average temperatures of the corresponding
months [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. Because the forecast is made for the next month, the output variable is the
month-ahead electricity consumption (k+1).
        </p>
        <p>Training datasets that do not consider the historical data were also created.</p>
        <p>Choosing the artificial neural network architecture. Multilayer perceptron (MLP) is
one of the most widely used neural-network models in neural network approaches.
MLP consists of artificial neurons located parallelly in one or multiple hidden layers
and an output layer. For building our neural-network model (Figure 7), we used
Statistica Neural Networks software.
─ N input neurons. N=2 for the model that takes the actual electricity consumption of
the central heating station and the meteorological factor as feature variables
(Figure 7, left), and N=4 for the model that additionally takes historical data as feature
variable (Figure 7, right);
─ 2N+1 neurons in the hidden layer that processes the inputs;
─ one output neuron that produces the forecast.</p>
        <p>To avoid the saturation behavior, the logistic, or sigmoid, function was chosen as
the activation function for the hidden layer in the MLP.
2.5</p>
      </sec>
      <sec id="sec-2-4">
        <title>Multivariant forecasting</title>
        <p>
          ANNs can function as the tool for multivariant forecasting [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. In this work, we
develop a multivariant forecast for the estimator, which is the total electricity
consumption for several central heating stations.
        </p>
        <p>
          Forecasting by the dual forecasting method (Figure 8) [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] can be executed using
the two methodological “branches”, which are:
─ AI – forecasting the behavior of the initial values, calculating the estimate by the
forecasted values;
─ AII – calculating the estimator by the actual initial values data, with forecasting the
behavior of the estimator.
        </p>
        <sec id="sec-2-4-1">
          <title>Wherein XCHSn is the measured initial values.</title>
          <p></p>
          <p>Wherein R is the forecasted estimate that was predicted by the respective
forecasting model; β1+β 2+β 3=1.</p>
          <p>For ANN-based forecasting model, the MLP was tuned with the data from the
training dataset and trained using the backpropagation algorithm. The quality of the
resulting neural-network model was evaluated by its scatter diagram (Figure 10). As
can be seen from figure 10, almost all deviations of the predicted values are inside the
confidence interval.</p>
          <p>Forecasted and measured values of electricity consumption are shown in Figure 11.
As indicated in the graph (Figure 11), the resulting neural-network model has high
approximation capabilities. The values of the initial time series have a high
correlation with the forecasted time series.</p>
          <p>To study the created forecasting model, the neural network was tuned with the data
from training dataset and verified with verification dataset. Both datasets with and
without historical data as feature variable were used for the MLP training.</p>
          <p>
            To produce a multivariate forecast [
            <xref ref-type="bibr" rid="ref7 ref8">7–8</xref>
            ], three copies of the MLP were made.
Each copy was trained with different starting conditions, i.e., the initial weights were
generated randomly. Multivariant forecast for central heating station No 9274 for
April 2019 is shown in figure 12 (left), and averaged forecast is in figure 12 (right).
          </p>
          <p>To achieve a desired level of forecast accuracy, it is recommended to consider
historical data as feature variable.</p>
          <p>Forecasted estimates for data with seasonality were calculated separately for each
of the seasons (“winter” and “summer”). The graphs in Figure 13 and Figure 14
compare the changes in measured values and forecasted total electricity consumption
values for “winter” and “summer” season, respectively.</p>
          <p>The graphs (Figures 13 and 14) indicate that both variants of the forecasted
estimate can take the data seasonality into consideration and confirm one another, which
allows to develop a more accurate forecast of the estimator, i.e., total electricity
consumption.</p>
          <p>To achieve a desired level of forecast accuracy, it is recommended to take both
variants of the forecasted estimate into consideration.
4</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Discussion</title>
      <p>
        The digitalization rate of the Russian energy sector and the economy in general
dictates the requirements for the quality of forecasts. This, in return, causes the transition
to modern intelligent technologies in forecasting, and wide implementation of the AI
methods in intelligent control systems [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], including time-dependent forecasting
systems.
      </p>
      <p>Due to the characteristics of the analyzed electricity consumption time series of
central heating stations, it is recommended to combine both statistical and intelligent
forecasting methods for developing intelligent systems for forecasting. In the core of
such systems are several predictor units that can produce multiple forecast variants.</p>
      <p>
        In one paper [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] formulated were the principles and application of predictive
analytics methods in intelligent systems. Because one or few dozens of cases is not
enough to achieve high forecasting accuracy, for correct application of predictive
analytics methods and identification of future trends, it is recommended to create
databases and knowledge bases that contain a great number of incidents [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
5
      </p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>The efficiency of the multivariant approach for forecasting is evident; it allows to
produce several complementary forecast variants that can be combined, so the most
rational of them can be selected.</p>
      <p>The proposed intelligent system for forecasting electricity consumption of the
facilities connected to the ASCAPC can be also applied in forecasting for other
industrial facilities as well as for housing and utilities infrastructure objects.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Choi</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jeon</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>A hybrid neural network model for power de-mand forecasting</article-title>
          .
          <source>Energies</source>
          ,
          <volume>12</volume>
          (
          <issue>5</issue>
          ),
          <volume>931</volume>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Jónsson</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pinson</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nielsen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Madsen</surname>
          </string-name>
          , H.:
          <article-title>Exponential smoothing approaches for prediction in real-time electricity markets</article-title>
          .
          <source>Energies</source>
          ,
          <volume>7</volume>
          (
          <issue>6</issue>
          ),
          <fpage>3710</fpage>
          -
          <lpage>3732</lpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Tso</surname>
            ,
            <given-names>G.K.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yau</surname>
            ,
            <given-names>K.K.W.</given-names>
          </string-name>
          :
          <article-title>Predicting electricity energy consumption: a comparison of regression analysis, decision tree and neural networks</article-title>
          .
          <source>Energy</source>
          ,
          <volume>32</volume>
          (
          <issue>9</issue>
          ),
          <fpage>1761</fpage>
          -
          <lpage>1768</lpage>
          (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Kazakidis</surname>
            ,
            <given-names>S.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kokkosis</surname>
            ,
            <given-names>A.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moustris</surname>
            ,
            <given-names>K.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paliatsos</surname>
            ,
            <given-names>A.G.</given-names>
          </string-name>
          :
          <article-title>Electricity consump-tion prognosis with the combination of smart metering and artificial neural networks</article-title>
          .
          <source>In: 8th Mediterranean Conference on Power Generation</source>
          , Transmission, Distribution and
          <string-name>
            <surname>Energy Conversion (MEDPOWER</surname>
          </string-name>
          <year>2012</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . IET,
          <string-name>
            <surname>Cagliari</surname>
          </string-name>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Trofimov</surname>
            ,
            <given-names>V.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kulakov</surname>
            ,
            <given-names>S.M.:</given-names>
          </string-name>
          <article-title>Generalized structure of an intelligent control system for technological objects and experience of its use</article-title>
          .
          <source>In: Optoelectronics, Instrumentation and Data Processing</source>
          ,
          <volume>47</volume>
          (
          <issue>3</issue>
          ),
          <fpage>313</fpage>
          -
          <lpage>320</lpage>
          (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Petrov</surname>
            ,
            <given-names>E.V.</given-names>
          </string-name>
          , Bondar',
          <string-name>
            <surname>N.F.:</surname>
          </string-name>
          <article-title>Prediction in the personnel management systems at melallurgical ìnterprises</article-title>
          .
          <source>Steel in Translation</source>
          ,
          <volume>36</volume>
          (
          <issue>6</issue>
          ),
          <fpage>24</fpage>
          -
          <lpage>29</lpage>
          (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Bai</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xie</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , Liu,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Tao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            ,
            <surname>Zeng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          :
          <article-title>Regression modeling for enterprise electricity consumption: A comparison of recurrent neural network and its variants</article-title>
          .
          <source>International Journal of Electrical Power and Energy Systems</source>
          ,
          <volume>126</volume>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Chae</surname>
            ,
            <given-names>Y.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horesh</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hwang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>Y.M.</given-names>
          </string-name>
          :
          <article-title>Artificial neural network model for forecasting sub-hourly electricity usage in commercial buildings</article-title>
          .
          <source>Energy and Buildings</source>
          ,
          <volume>111</volume>
          ,
          <fpage>184</fpage>
          -
          <lpage>194</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Vassilyev</surname>
            ,
            <given-names>S.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Novikov</surname>
            ,
            <given-names>D.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bakhtadze</surname>
            ,
            <given-names>N.N.</given-names>
          </string-name>
          :
          <article-title>Intelligent control of industrial processes</article-title>
          .
          <source>IFAC Proceedings Volumes</source>
          ,
          <volume>46</volume>
          (
          <issue>9</issue>
          ),
          <fpage>49</fpage>
          -
          <lpage>57</lpage>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Temkin</surname>
            ,
            <given-names>I.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klebanov</surname>
            ,
            <given-names>D.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Deryabin</surname>
            ,
            <given-names>S.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konov</surname>
            ,
            <given-names>I.S.</given-names>
          </string-name>
          :
          <article-title>Construction of intelligent geoinformation system for a mine using forecasting analytics techniques</article-title>
          .
          <source>In: Mining Informational and Analytical Bulletin</source>
          ,
          <year>2020</year>
          (3),
          <fpage>114</fpage>
          -
          <lpage>125</lpage>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Temkin</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klebanov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Deryabin</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konov</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>Predictive Analytics in Mining. Dispatch System Is the Core Element of Creating Intelligent Digital Mine</article-title>
          .
          <source>In: Communications in Computer and Information Science</source>
          ,
          <volume>1201</volume>
          CCIS,
          <fpage>365</fpage>
          -
          <lpage>374</lpage>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>