<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Short-term Electricity Price Forecasting Using Generalized Additive Models</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Chan Le</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Kiel University of Applied Sciences</institution>
          ,
          <addr-line>Sokratesplatz 2, 24149 Kiel</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>1810</year>
      </pub-date>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>If one examines the spot price series of electrical power over the course of time, it is striking that the electricity price across the day takes a course that is determined by power consumption following a day and night rhythm. The daily course changes in its height and temporal extent in both, the course of the week, as well as with the course of the year. This study deals methodologically with this intra-day and seasonal behaviour. We contribute the usage of Generalized Additive Models (GAM) and apply these models with European data.</p>
      </abstract>
      <kwd-group>
        <kwd>electricity prices</kwd>
        <kwd>forecasting</kwd>
        <kwd>generalized additive models</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Since the come about of energy deregulation in the 1990s, the electric power industry
has undergone significant restructuring, driving the market away from its natural
monopoly and opening chances for thriving competition and reduction in prices through
privatization. As a result, the last two decades have seen a remarkable rise in
importance of electricity price forecasting (EPF). Invaluable inputs are provided in aid
of optimal decisions and responses from both producers and retailers in the
poolbased market.</p>
      <p>
        Electricity, though conforming to the definition of a commodity [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], is a special
case with very distinct characteristics: non-storability of electricity, inelasticity of the
short-term demand, wide spectrum of cost, and oligopolistic behavior of the
generators [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. Without any loss-free form of storage, it is crucial that great effort is needed
to ensure and maintain the stability of a balanced supply and demand [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Hence,
there are many challenges in modeling electricity prices.
      </p>
      <p>
        In comparison to the time series of the electricity load, Aggarwal et al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
mentioned that the series of the electricity price oftentimes contains patterns of much
greater complexity, including non-constant mean and variance, strong seasonality and
various calendar effects. Moreover, EPF models must effectively cope with numerous
abrupt large jumps in the course of the time series. This phenomenon is attributable to
problems with transmission infrastructure and unforeseeable, non-proportional or
inverse fluctuations in demand and supply [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Ziel et al. [28] also pointed out that the
existence of a universal model for electricity price forecasting is highly improbable
due to vast differences among countries, such as their individual political and climatic
circumstances. Thus, not all the findings and methodologies successfully employed to
one country are applicable to another country or region.
      </p>
      <p>For these reasons, many different approaches to electricity price forecasting have
been proposed to various extents of effectiveness and success. Papers published by
Weron [24, 26] summarize the current methods of EPF, reviewing their strengths and
weaknesses, effectiveness and potential, as well as providing an outlook on this topic
over the next decade. For more than 15 years, various solutions and fitting models can
be categorized into the following groups of methodology: fundamental/structural
methods, reduced-form quantitative, stochastic models, statistical approaches, and
computational intelligence; many of which being hybrid of two or more of these
groups. These papers also emphasize the importance of appropriate inputs and
predictors, along with the possibility of capturing different levels of seasonality in the
models. Moreover, the author suggests extensions of the methodology going far beyond
point forecasting: interval forecasting, density forecasting, threshold forecasting, and
their combinations.</p>
      <p>
        This paper proposes the use of the Generalized Additive Models (GAM) in attempt
to improve the quality of the electricity spot price forecasting by applying a
nonparametric estimation of multiple seasonal predictors. In the case of multivariate
analysis, the key problem is to fit a d-dimensional model to the observed data, which
leads to the exponential increase in the model’s complexity as more variables or
features are added to the dataset [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. To combat this so-called “curse of
dimensionality”, a term coined by Bellman [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], the Additive Model method deals with each
dimension separately, treating them as individual univariate smooth functions and
adding up their approximations. This allows for an interpretable solution in which the
marginal impact of a single variable could be explained independently of the other
variables. Following this, the GAM method takes a major step forward where the
response variable may be derived from any exponential family distribution, thus
removing even further constraints and allowing greater flexibility, capturing nonlinear
patterns that a classic linear model would otherwise miss [27]. Moreover, with the
utilization of tensor product smooth interactions, the degree of smoothness in each
direction can be controlled independently, resulting in an overall anisotropic penalty.
      </p>
      <p>
        A comparable GAM was introduced by Pierrot and Goude [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] based on the hourly
electricity load data in France from 2000 to 2005. Twenty-four separated time series
regarding the daily observations are considered and fitted by the correspondent
models. These models are set up to account for various levels of seasonality: daily,
weekly, monthly, and a yearly global trend, so that a summer break (a large downturn in
electricity demand during summer holidays) could be incorporated. Additionally,
hourly meteorological data is included, e.g. the temperature, the cloud cover and the
wind speed. A semi-parametric approach is adopted to these models, comprising a
regressive part with explanatory variables and an autoregressive part with lagged
loads. In the end, the residuals of the models are examined to detect remaining
autocorrelation. The best model selection was conducted based on the comparison of the
Generalized Cross Validation (GCV) scores. The forecasting results from this model,
measured using the Root Mean Square Errors (RMSE), were significantly better than
the unspecified benchmark model used by the authors.
      </p>
      <p>
        In addition to point forecasting, Serinaldi [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] introduced the GAM for Location,
Scale and Parameter (GAMLSS) for short-term price forecasting, based on the work
of Stasinopoulos and Rigby [
        <xref ref-type="bibr" rid="ref22 ref23">22, 23</xref>
        ]. The aim of this paper is to reduce uncertainty of
EPF by explicitly incorporating a wide range of distribution functions into the model,
where the parameters of these distribution functions change dynamically in the course
of a day, week, and year. According to this paper, the use of a position parameter,
reflecting daily and weekly periodicity, a scale parameter, encompassing daily price
standard deviation, and a shape parameter in form of a constant value is emphasized.
The GAMLSS performance was put to test against many statistical benchmarks, from
the naïve method [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], the classical linear Autoregressive model (AR) and
Generalized Autoregressive Conditional Heteroskedastic model (GARCH) [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], to the
Threshold Autoregressive (TAR) models [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. In some instances, the performance of
GAMLSS outstood the reference models and proved to be a reliable method for the
comparison among different forecasting procedures.
      </p>
      <p>
        Fan and Hyndman [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] took a semi-parametric additive approach with the aim of
developing short-term forecasting models for regions in the National Electricity
Market (NEM) of Australia from 1997 to 2009. In order to predict half-hourly demand
loads, 48 sets of model parameters were estimated for each half-hour slice. For the
point forecasting, the proposed additive regression model framework allowed
nonlinear and non-parametric terms to be accounted for the fit of the electricity load.
Within the model setup, three mains effects were determined. Calendar effects include
annual, weekly and daily seasonality, with public holidays also being recorded.
Temperature effects from two sites are considered, whose average temperature and the
differences between the daily maximums and minimums were incorporated into the
model. Lagged demand effects were added to capture the autocorrelations within the
demand time series, as well as its variance throughout the time. Prior to execution, a
piece-wise backwards variable selection process was implemented to identify the best
model, using the Mean Average Percentage Error (MAPE) as the selection criterion.
In addition to the point forecasting, the forecasting outcome distribution was also
estimated, providing a further indication of the forecast accuracy. Since the
parametric method of delivering the forecasting distribution and prediction intervals would
assume an i.i.d. error with zero mean and finite variance, the alternative of using
bootstrapping as a non-parametric approach is encouraged, which is robust against
violations of the normality assumption. Due to heavy computational tasks, a modified
bootstrap method was conducted, constructing the empirical prediction intervals by
centering the simulated forecast residuals around the original predicted point values.
      </p>
      <p>The remainder of the paper is organized as follow. Section 2 provides a brief
exploratory analysis to the data used in this study. Section 3 introduces GAM, as well as
the model setup. Section 4 shortly introduces the structure and setup of the benchmark
models. Season 5 evaluates the forecasting results. Finally, conclusion closes the
study.</p>
    </sec>
    <sec id="sec-2">
      <title>Sample and Methodology</title>
      <p>This study focuses on the course of the hourly day-ahead spot price of the EEX
Phelix-DE contract at the EPEX SPOT market of the European Power Exchange
(EEX). This day-ahead spot contract is considered as a benchmark contract for
European electricity. The exchange operates, among other trading activities, the power
spot market for Germany, Austria, Luxembourg, France, the United Kingdom, the
Netherlands, Belgium, and Switzerland. Purchase and sale orders are placed hourly
for power which will be delivered the following day. The daily cycle ends at 12:00
pm, at which time the EPEX SPOT calculates the market clearing price. The
visualization of the data used in this study can be seen in Figure 1.</p>
    </sec>
    <sec id="sec-3">
      <title>The Generalized Additive Model</title>
      <sec id="sec-3-1">
        <title>The GAM theory</title>
        <p>
          Generalized Additive Model (GAM) [
          <xref ref-type="bibr" rid="ref9">9, 27</xref>
          ] is a non-parametric extension of the
Generalized Linear Model (GLM), in which the relationship between the response
and predictors are expressed by several smooth functions in order to capture the
nonlinearities underlying the data. The GAM can be formally expressed as:
(1)
where i = 1,…,N, g is a link function (identical, logarithmic or inverse, etc.), y is a
response variable, ,…, are independent variables, is an intercept,
,…, are unknown non-parametric smooth functions, and ε is an i.i.d.
random error.
        </p>
        <p>
          One way of determining these smooth functions is through the use of smoothing
splines [
          <xref ref-type="bibr" rid="ref9">9, 27</xref>
          ]. These piecewise polynomial functions join many polynomials to
generate a smooth curve through a set of points. The polynomials connect at certain
points, called knots. At these knots, the joint polynomials share the same derivatives
up to several degrees. The level of model smoothness depends on the degree of the
polynomials, the number of knots, and their location. The locations of these knots are
typically evenly-spaced. In this case, the smooth function is estimated by minimizing
the penalized sum of squares:
(2)
        </p>
        <p>The first half of the function, , is the standard residual sum of
squares, representing how closely the fitted values are in alignment with the observed
values, whereas the second half, , penalizes the “roughness”, or the
“wiggliness” of the data. Minimizing the integrated square of the second derivative
would smooth out the data towards linearity. The key here is the smoothness
parameter λ, which controls the trade-off between model fit and model smoothness. Wood
[25] postulates, that the natural cubic splines are the smoothest interpolators, making
the cubic smoothing splines (a natural cubic spline with knots at every data point) the
best choice regarding the polynomial degree of the smooth term. However, this
procedure has one major disadvantage: if the number of knots is approximately equal to
the number of data records n, this will lead to model overfitting, and furthermore to a
computational waste. Since λ, in most cases, obviously shrinks down the roughness at
many knots, this will result in a spline that is much smoother than n degrees of
freedom.</p>
        <p>Another alternative to the presentation of the smooth functions is the penalized
regression spline [27]. It can be expressed as a linear combination of a family of basis
functions:</p>
        <p>where are the basis functions, are the associated
coefficients with the basis dimension q, so that a linear relationship between the predictor
and the smooth function is formed through the basis functions, with being the
model matrix of the basis functions, and being the vector of regression coefficients.
These coefficients applied to the basis functions act as amplifiers of the curvature of
the spline. Like in the case of the above-mentioned smoothing spline, it is also
possible to apply a penalty in the course of estimating the basis function coefficients of the
regression spline to produce smoothness. Hence, in lieu of solving for the estimated
with a standard linear model, the penalized sum of squares can be minimized:
where is the penalty matrix, imposing smoothness by directly penalizing the
difference among the adjacent coefficients. This method is called the Penalized
Iteratively Reweighted Least Squares method (P-IRLS), that for any given λ, the regression
coefficients can be obtained.</p>
        <p>Hence, the problem has shifted from measuring the degree of smoothness for the
model to determining the smoothing parameter λ. Since there is a trade-off between
overfitting and oversmoothing the data, one option of determining the optimal degree
of smoothness is by implementing backwards selection. This method is rather
computationally expensive and can also result in relatively poor model accuracy due to
uneven knot spacing. Instead, the smoothing parameter λ can be estimated using either
the Generalized Cross Validation criteria (GCV) or the mixed model approach via
Restricted Maximum Likelihood (REML).
(3)
(4)</p>
        <p>With regard to the available choices of regression splines, GAM offers a wide
range of smoothing bases, including cubic regression splines, cyclic regression
splines, thin plate regression splines, P-splines, etc. These models differ in the choice
of number of knots, the spacing of the knots, the level of rank and order, as well as the
number of predictors in the model. Moreover, the interactions among the predictors
play a critical role in the regression model. The inclusion of interactions extends from
the most basic form of multiplication to the tensor product, allowing the possibility of
implementing different smoothing bases for variables while applying penalization in
different ways, resulting in an anisotropic penalty. In this paper, the use of tensor
product smooth and the choice of cyclic penalized cubic thin plates regression spline
are emphasized through the model setup below.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Model setup</title>
        <p>
          Aggarwal et al. [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] classified the factors that have possible impact on the electricity
prices in five different categories: market characteristics, nonstrategic uncertainties,
other stochastic uncertainties, behavioral aspects, and temporal effects. As shown in
the data analysis, there are three main seasonal patterns: the daily effect, weekly
effect, and yearly effects which are represented by the dichotomous explanatory
variables hour of the day, day of the week, and month of the year.
        </p>
        <p>The goal of this model is to produce short-term forecasts for 12 randomly chosen
weeks (one in each month) within the year 2017. For this setup, each model receives
260 weeks (approximately five years) of training data prior to the forecasted week.
We begin setting up the model structure by determining the smooth function
components for the daily, weekly and yearly pattern separately. Thus, in model M1 the
individual effects form three different univariate smooths additively:</p>
        <p>Cubic regression splines were applied for all individual components. The number
of knots is equal to the number of unique values in each predictor, in this case 24, 7,
and 12, respectively. This initial model treats the three predictors individually,
assuming that all effects are independent. This assumption is not realistic, since in the
exploratory data analysis it could be observed that the effects are mutually dependent.</p>
        <p>To account for the interaction among the predictors, thin plate regression splines
are recommended by the extant literature [27]. Here, a truncated version of the thin
plate splines is applied, using the thin plate spline penalty to acquire a low-rank
smoother that has far fewer coefficients than there is data to smooth. Moreover, it can
deal with any number of predictors and tends to give the best MSE performance [27].
Accordingly, the same isotropic smoothing base is used for all three predictors in one
smooth function:
(5)
(6)</p>
        <p>In this case, only one single value of the smoothing parameter λ is applied in all
directions. The problem with this isotropic penalty is, that its result is only reliable
when the predictors are approximately on the same scale. In other words, the
discrepancy among the different units of the different explanatory variables could result in a
false integration of the second derivative due to their disproportional contribution to
the overall integration. Hence, the use of tensor product smooths is proposed [27].</p>
        <p>Tensor product smoothing is a type of multivariate smoothing base that derives the
multivariate bases from individual univariate marginal bases. In other words, the
nonseparable smooth function can instead be approximated
by the tensor product of its component, and . Each
of the basic functions is smoothed in its corresponding dimensions individually, so
that the correspondent coefficient matrix is obtained. Then the tensor product ( ) of
the three matrices is computed, as shown in model M3:
(7)
(9)</p>
        <p>As a result, each component represents a unique combination of the three marginal
basis functions. This allows for an overall anisotropic smoothing penalty, with the
possibility of using different smoothing bases for every predictor and penalize it in
many different ways. Each smoothing parameter , and is
individually determined through the same method as the single smoothing parameter for
the univariate smoothing, which results in an overall tensor product smooth that is
indifferent to the rescaling of its independent variables.</p>
        <p>Although this method proves to yield significantly better results, it also becomes
significantly more computationally expensive as the dimensionality of the tensor
product increases by the introduction of more predictors. Within the framework of
this paper, this issue is addressed by using the pairwise bivariate tensor product
smooths for the three predictors, resulting in model M4:
(8)</p>
        <p>Finally, the combination of the three individual effects and their three mutual
interactions enables the decomposition of the model, analyzing to what extent each
individual predictor influences the response individually, as well as each of the pairwise
interactions. Accordingly, the ultimate model M5 can be annotated as follows:</p>
        <p>
          In the extant literature a variety of model accuracy measures are discussed. The
trade-off between model accuracy and model complexity is often in the focus of the
consideration. Accuracy measures that penalize for model complexity are proposed by
Akaike (Akaike Information Criterion, AIC) [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] and Schwarz (Bayes Information
Criterion, BIC) [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. However, the AIC and the BIC are typical in-sample accuracy
measures. Since this study deals with forecasting accuracy and not with model fitting,
an out-of-sample / forecasting accuracy measure needs to be applied. A popular
choice among the forecasting accuracy measures, the Mean Absolute Percentage
Error (MAPE) fails in the context of price forecasting, since the spot prices for
electricity are oftentimes negative, which leads to a possible erroneous interpretation.
Moreover, when the prices are high, MAPE is rather indifferent to a considerable absolute
change, whereas it would scale up drastically to the same price difference, when the
prices are close to zero. In line with extant literature, the weekly Root Mean Square
Errors (RMSE) is used for the evaluation of the forecasting accuracy here [26].
4
4.1
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Statistical benchmark models</title>
      <sec id="sec-4-1">
        <title>Autoregressive Integrated Moving Average model with external regressors (ARIMAX) with seasonality</title>
        <p>
          The benchmark ARIMAX model in this paper, as derived by Meier et al. [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], is an
extension of the classical ARIMA model [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. The X-term of the model comprises the
external regressors, accounting for various level of seasonality in form of
dummycoded variables, including hour of the day, day of the week, and month of the year.
The Hyndman-Khandakar algorithm [
          <xref ref-type="bibr" rid="ref12 ref13">12, 13</xref>
          ] is utilized to achieve the optimal
ARIMAX parameterization. This step includes the determination of the number
differentiations (d) needed to achieve stationary using the KPSS tests as well as the
simultaneous determination of the number of lags for the autoregressive (p) and the
moving average (q) term, applying Akaike Information Criterion (AIC). Since the data
sample is identical with Meier et al. [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] in both analyses, the original ARIMAX
(3,1,3) model with 40 dummy variables is adopted as the benchmark model for this
paper.
4.2
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Naïve forecasts</title>
        <p>
          The similar-day method estimates the electricity price of a certain day on the basis of
the electricity price of the same weekday of the previous week [
          <xref ref-type="bibr" rid="ref21">21, 24</xref>
          ]. Further
adaptations of this method match characteristics like the hour of the day, the day of the
week, the month of the year by applying linear combinations or regression
procedures. One of the variations of the similar-day method, is the naïve method. Here the
forecast is based on the previous day, with the exception of the Saturdays, Sundays,
and Mondays. These are forecasted by looking back to values of the previous week
[
          <xref ref-type="bibr" rid="ref16">16, 24</xref>
          ]. Despite its simplicity, this “naïve test” proves its effectiveness in identifying
inept forecasting models, thus turning it into one of the most popular benchmark
models in EPF [
          <xref ref-type="bibr" rid="ref16 ref5 ref6">5, 6, 16</xref>
          ].
5
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Assessment of the model performance</title>
      <p>Figure 3 represents three seasonal smoothed effects of the electricity price time series
which originate from model M5: daily, weekly and yearly. As seen in the data
analysis, these plots confirm that there is a difference in price throughout the course of a
day, throughout the course of a week, and throughout the course of a year. The first
daily peak around 10:00 am could be due to the morning working routines, and the
second one around 8:00 pm accounts for the heating and lighting needs in winter, as
well as extra activities in summer, where there is a longer period of daylight. The
electricity price is fairly stable at a higher level from Tuesday to Friday, and sinks at
the weekend to rise again at the Monday, confirming the higher need for electricity on
working days. Regarding the yearly pattern, the prices in fall and winter are higher
than in the other two seasons, emphasizing the heating and lighting demands.</p>
      <p>Figure 4 shows the tensor product smooths of the effects in pairs, so that the
interaction among the effects are easier to spot. It can be observed from the daily and
weekly smoothing, that the daily peaks around 10 am and 8 pm are still prominent
throughout the week, although at a remarkably lower level at the weekends. The
middle graphs show the relationship between the weekly and the yearly effect: the daily
peaks are now smoothed along different months, with the prices in summer lower
than in winter, showing peaks at the morning and evening time in December and
January. Lastly, the tensor product between the weekly and yearly effect showcases a
minimum price on Sundays in May, as opposed to the maximum on Mondays in
January.</p>
      <p>These figures demonstrate one of the most decisive advantages of GAM in
comparison to other methods: interpretability with visualization. GAM takes on the nature
of an additive regression model, in which the interpretation of the marginal impact of
a singular variable, the partial derivative, is not contingent on the values of the other
variables in the model. Looking at Figure 3, one could intuitively draw conclusion on
the effects the temporal predictors have on the electricity prices, each of which is
accounted for separately by an individual smoothed function; so that the daily peaks,
the weekend cutback, and the decrease of prices in summer months are appointed to
the right temporal effects accordingly. Moreover, GAM is able to isolate the
individual effects from the predictors alone from the intercorrelated influences among them
upon the response variable; for instance, in our final model, the influence of the
hourly variable alone, the interaction between the hourly and the weekly variable, as well
as the one between the hourly and the monthly variable, are all accounted for
separately. Figure 4 shows the interactions being plotted, so that the original patterns
could be revealed, even though the dataset at hand may suggest a noisier relationship.
Hence, by simply taking a glance at the output and its visualization of the model, one
can make intuitive statements about the effects of the predictors which is
comprehensible to a nontechnical person.</p>
      <p>Fig. 3. Pairwise tensor product interactions (with flipped graphs), model 1</p>
      <p>Figure 5 illustrates the forecasting accuracies of the GAM, ARIMAX and naïve
models applied using the months of March and April of the 2017 forecast period as
examples.</p>
      <p>For checking the robustness of the presented GAM models, the outliers were
identified and substituted by applying the seasonal and trend decomposition method Loess
(Locally Weighted Least Squares Regression). Loess smoothing calculates an average
of the data around the vicinity, giving more weight to data near the vicinity and less
weight to data further away from the vicinity. Given the identical model set up, the
GAM model fitting process shows little difference in results when fed with the
original or the modified input data. Accordingly, the GAM model is robust towards
outliers. Nevertheless, the identified outliers are not measurement inaccuracies but real
clearing prices and reflect the stark fluctuation of the electricity price time series.
Thus, they should be included in the model.</p>
      <p>Furthermore, it was examined whether the length of the training data time series
has an influence on the forecasting accuracy. Hypothetically, the quality of the model
would monotonically rise as the number of training data records increases. We were
not able to find an optimum length of the training time series that could be applied for
all months. This indicates that a large number of structural breaks make a perfect
adaptation of the model impossible. These structural breaks are mainly due to the
strong promotion of renewable energies in Germany, which over time are
accompanied by a strong increase in volatility and are predominantly politically driven.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>
        In this study, the use of Generalized Additive Model (GAM) [
        <xref ref-type="bibr" rid="ref9">9, 27</xref>
        ] is proposed as an
alternative stochastic method to conduct one-week ahead forecasting of electricity
market prices. Overall, GAM is an extension of the Generalized Linear Model,
demonstrating its superiority in terms of flexibility, in which the relationships
between the predictor and the response variables are assumed to be non-linear. A model
using isolated additive smoothing components according to our model M1 could
therefore not exploit the advantages of GAM, since the interactions between the
dimensions are not taken into account. The complete consideration of all interactions of
the predictors in only one smoothing function lead to the best prediction accuracies,
but is so computationally intensive that, so that its practical applicability is rather
limited. A significant improvement was the use of tensor smoothing function in our
model M3, where the single smoothing functions were connected via the tensor
product. In order to be able to work out the interactions between the dimensions even
better without running the risk of achieving high computing capacities again, we
developed the models M4 and M5. These models combine the tensor products between the
smoothing functions pairwise, so that an excessive computing load is avoided and the
interaction effects can still be reproduced with sufficient accuracy.
24. Weron, R., Misiorek, A. Short-term electricity price forecasting with time series models: A
review and evaluation. In Mielczarski, W. (Ed.), Complex electricity markets, 231-254
(2006).
25. Weron, R., Misiorek, A. Forecasting spot electricity prices: A comparison of parametric
and semiparametric time series models. International Journal of Forecasting, 24, 744-763
(2008).
26. Weron, R. Electricity price forecasting: A review of the state-of-the-art with a look into the
future. International Journal of Forecasting, 30(4), 1030-1081 (2014).
27. Wood, S. N. Generalized Additive Models: An Introduction with R. 2nd ed. Chapman &amp;
      </p>
      <p>Hall, London (2017).
28. Ziel, F., Steinert, R., Husmann, S. Efficient modeling and forecasting of electricity spot
prices. Energy Economics, 47, 99 (2015).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Aggarwal</surname>
            ,
            <given-names>S. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Saini</surname>
            ,
            <given-names>L. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kumar</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <article-title>Electricity price forecasting in deregulated markets: a review and evaluation</article-title>
          .
          <source>International Journal of Electrical Power &amp; Energy Systems</source>
          ,
          <volume>31</volume>
          (
          <issue>1</issue>
          ),
          <fpage>13</fpage>
          -
          <lpage>22</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Akaike</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          <article-title>Information theory and an extension of the maximum likelihood principle</article-title>
          .
          <source>Second International Symposium on Information Theory</source>
          ,
          <fpage>267</fpage>
          -
          <lpage>281</lpage>
          (
          <year>1973</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bellman R.E. Adaptive</surname>
          </string-name>
          <article-title>Control Processes</article-title>
          . Princeton University Press, Princeton, NJ (
          <year>1961</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Box</surname>
            ,
            <given-names>G. E. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jenkins</surname>
            ,
            <given-names>G. M.</given-names>
          </string-name>
          <article-title>Time series analysis: forecasting and control</article-title>
          .
          <source>Holden-Day</source>
          , San Francisco (
          <year>1971</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Conejo</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Contreras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Espínola</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Plazas</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. A.</surname>
          </string-name>
          <article-title>Forecasting electricity prices for a day-ahead pool-based electric energy market</article-title>
          .
          <source>International Journal of Forecasting</source>
          ,
          <volume>21</volume>
          (
          <issue>3</issue>
          ),
          <fpage>435</fpage>
          -
          <lpage>462</lpage>
          (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Contreras</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Espínola</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nogales</surname>
            ,
            <given-names>F. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Conejo</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          <article-title>ARIMA models to predict nextday electricity prices</article-title>
          .
          <source>IEEE Transactions on Power Systems</source>
          ,
          <volume>18</volume>
          (
          <issue>3</issue>
          ),
          <year>2003</year>
          ,
          <fpage>1014</fpage>
          -
          <lpage>1020</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Fan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hyndman</surname>
            ,
            <given-names>R. J.</given-names>
          </string-name>
          <article-title>Short-Term Load Forecasting Based on a Semi-Parametric Additive Model</article-title>
          .
          <source>IEEE Transactions on Power Systems</source>
          ,
          <volume>27</volume>
          (
          <issue>1</issue>
          ),
          <fpage>134</fpage>
          -
          <lpage>141</lpage>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Geman</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roncoroni</surname>
            ,
            <given-names>A. Understanding</given-names>
          </string-name>
          <article-title>the fine structure of electricity prices</article-title>
          .
          <source>Journal of Business</source>
          ,
          <volume>79</volume>
          (
          <issue>3</issue>
          ),
          <fpage>1225</fpage>
          -
          <lpage>1261</lpage>
          (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Hastie</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tibshirani</surname>
          </string-name>
          , R. Generalized Additive Models. Chapman &amp; Hall, London (
          <year>1990</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Hong</surname>
          </string-name>
          , T. Energy Forecasting: Past, Present, and
          <string-name>
            <surname>Future</surname>
          </string-name>
          . Foresight: The
          <source>International Journal of Applied Forecasting</source>
          ,
          <volume>32</volume>
          ,
          <fpage>43</fpage>
          -
          <lpage>48</lpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Hope</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rud</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Singh</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <article-title>Electricity futures market</article-title>
          . In Lesourd, J.-B.,
          <string-name>
            <surname>Percebois</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Valette</surname>
            ,
            <given-names>F</given-names>
          </string-name>
          . (eds.),
          <article-title>Models for Energy Policy</article-title>
          . Routledge, London, New York,
          <fpage>238</fpage>
          -
          <lpage>249</lpage>
          (
          <year>1996</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Hyndman</surname>
            ,
            <given-names>R. J.</given-names>
          </string-name>
          : R Package “forecast”:
          <source>Forecasting Functions for Time Series and Linear Models</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Hyndman</surname>
            ,
            <given-names>R. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khandakar</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <article-title>Automatic Time Series Forecasting: The forecast package for R</article-title>
          .
          <source>Journal of Statistical Software</source>
          ,
          <volume>27</volume>
          (
          <issue>3</issue>
          ),
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Meier</surname>
            ,
            <given-names>J.-H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schönfeldt</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schüller</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wanke</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Electricity Price</surname>
          </string-name>
          <article-title>Forecasting: A methodological ANN-based Approach with special Consideration of Time Series Properties</article-title>
          . ICTERI Conference Kiev.
          <source>Proceedings of the 14th International Conference on ICT in Education, Research and Industrial Applications</source>
          . Integration, Harmonization and
          <string-name>
            <given-names>Knowledge</given-names>
            <surname>Transfer</surname>
          </string-name>
          .
          <source>Volume II: Workshops. Part I: 6th International Workshop on Information Technologies in Economic Research (ITER), Paper 5</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Misiorek</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Trueck</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weron</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>Point and interval forecasting of spot electricity prices: linear vs. non-linear time series models</article-title>
          .
          <source>Studies in Nonlinear Dynamics &amp; Econometrics</source>
          ,
          <volume>10</volume>
          (
          <issue>2</issue>
          ),
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Nogales</surname>
            ,
            <given-names>F. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Contreras</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Conejo</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Espínola</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>Forecasting next-day electricity prices by time series models</article-title>
          .
          <source>IEEE Transactions on Power Systems</source>
          <volume>17</volume>
          ,
          <fpage>342</fpage>
          -
          <lpage>348</lpage>
          (
          <year>2002</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Pierre</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goude</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nedellec</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>Semi-Parametric Models and Robust Aggregation for GEFCom2014 Probabilistic Electric Load and Electricity Price Forecasting</article-title>
          .
          <source>International Journal of Forecasting</source>
          ,
          <volume>32</volume>
          (
          <issue>3</issue>
          ),
          <fpage>1038</fpage>
          -
          <lpage>1050</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Schimek</surname>
            ,
            <given-names>M. G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Turlach</surname>
            ,
            <given-names>B. A.</given-names>
          </string-name>
          <article-title>Additive and generalized additive models: A survey</article-title>
          .
          <source>SFB 373 Discussion Papers</source>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Schwarz</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <article-title>Estimating the dimension of a model</article-title>
          .
          <source>Annals of Statistics</source>
          <volume>6</volume>
          ,
          <fpage>46</fpage>
          -
          <lpage>464</lpage>
          (
          <year>1978</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Serinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <article-title>Distributional Modeling and Short-Term Forecasting of Electricity Prices by Generalized Additive Models for Location, Scale and Shape</article-title>
          .
          <source>Energy Economics</source>
          ,
          <volume>33</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1216</fpage>
          -
          <lpage>1226</lpage>
          (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Shahidehpour</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yamin</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          <article-title>Market operations in electric power systems: forecasting, scheduling, and risk management</article-title>
          . Wiley, New Jersey (
          <year>2002</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Stasinopoulos</surname>
            ,
            <given-names>M. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rigby</surname>
            ,
            <given-names>R. A.</given-names>
          </string-name>
          <article-title>Generalized additive models for location scale and shape</article-title>
          .
          <source>Journal of the Royal Statistical Society</source>
          ,
          <volume>54</volume>
          (
          <issue>3</issue>
          ),
          <fpage>507</fpage>
          -
          <lpage>554</lpage>
          (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Stasinopoulos</surname>
            ,
            <given-names>M. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rigby</surname>
            ,
            <given-names>R. A.</given-names>
          </string-name>
          <article-title>Generalized additive models for location scale and shape (GAMLSS) in R</article-title>
          .
          <source>Journal of Statistical Software</source>
          ,
          <volume>23</volume>
          (
          <issue>7</issue>
          ),
          <fpage>744</fpage>
          -
          <lpage>763</lpage>
          (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>