<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>AHP-Based Comparative Analysis of Electricity Generating Portfolios for the Companies in EU and Ukraine: Criteria, Reliability, Safety</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Volodymyr Zaslavskyi</string-name>
          <email>zas@unicyb.kiev.ua</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Maya Pasichna</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Taras Shevchenko National University of Kyiv</institution>
          ,
          <addr-line>Volodymyrska st.64, Kyiv 01033</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The article presents a model for evaluating different electricity generating sources at the leading electricity production companies in the EU and Ukraine as well as the main criteria, which have to be considered when taking decisions on diversification of the energy portfolio. The objective of this approach is to improve understanding of how to diversify, and, thus, increase reliability of the energy portfolio in order to follow the process of transformation of the energy sector. The study utilizes the method of Analytic Hierarchy Process (AHP), which allows explaining which energy technology best meets the needs and preferences of the companies from both an expert point of view and through the mechanism of quantitative assessment.</p>
      </abstract>
      <kwd-group>
        <kwd />
        <kwd>Energy Portfolio</kwd>
        <kwd>Diversification</kwd>
        <kwd>Reliability</kwd>
        <kwd>AHP</kwd>
        <kwd>Key Terms</kwd>
        <kwd>Decision Support</kwd>
        <kwd>Mathematical Modeling</kwd>
        <kwd>Industry</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Problem statement. Introduction of innovative energy-generating technologies and
the creation of reliable and secure structure of electricity generation are based on
diversification of the energy portfolio (mix), that is the structure of electricity generation
broken down by fuel type. The deficiencies in analyzing energy portfolio, which is
supposed to contain both conventional and renewable energy sources (RES), can delay
the development of countries and regions.</p>
      <p>
        The European Union (EU), whose share in the global demand for energy accounts
for almost 14% [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], is one of the main participants in the transformation of the global
energy system. For Ukraine, as one of major strategic partners of the EU,
modernization of its energy industry is one of the key measures to reduce vulnerability
in energy supply.
      </p>
      <p>
        Given that energy supply system refers to the critical infrastructure (CI) [
        <xref ref-type="bibr" rid="ref2 ref3">2,3</xref>
        ],
Ukraine should have a thorough understanding of the European practices of its
protection and reliability, as the threat to its functioning is a threat to national security.
      </p>
      <p>The article presents a model for evaluating different electricity generating sources
(technologies) within the energy portfolios of the leading electricity production
companies in EU and Ukraine. Understanding of these trends would contribute to an
optimal trade-off between different energy technologies or creation of an optimal
electricity generation portfolio, aimed to maximize the value of the portfolio, e.g.
ensure energy security and minimize its environmental footprint.</p>
      <p>
        Literature review. Given that energy planning is to be delivered as finding the
optimal solutions based on several (either conflicting or synergetic) criteria and under
certain restrictions, Multi-Criteria Decision Making (MCDM) techniques are very
popular. These days the combinations of different methods are gaining popularity. In
2015 the research utilizing MESSAGE model combined with Multi-Criteria Model
Analysis (computing a Pareto-efficient solution) was conducted to assess the role of
nuclear power against seven criteria [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In 2016 there was a study on a grey based
MCDM for the evaluation (not planning) of the RES for Turkey which integrates
three MCDM methods - Decision Making Trial and Evaluation Laboratory, Analytic
Network Process and Multi-Criteria Optimization and Compromise Solution [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        AHP is one of the most popular set of MCDM tools. In 2014-2016 AHP was
applied for conducting the reliability and risk assessment analysis of energy systems and
their components at the nuclear power plants [
        <xref ref-type="bibr" rid="ref6 ref7">6,7</xref>
        ]. In 2015-2016, there were
researches on the rational choice for the location of power stations [
        <xref ref-type="bibr" rid="ref10 ref8 ref9">8,9,10</xref>
        ]. The
problem of choosing an alternative electricity generation source and ensuring economic
security of energy enterprises through AHP application while addressing the
modernization of Ukraine’s energy system are currently under research [
        <xref ref-type="bibr" rid="ref11 ref12">11,12</xref>
        ].
      </p>
    </sec>
    <sec id="sec-2">
      <title>Novelty and future use of the research. Although the use of AHP is not new, the</title>
      <p>comparison of its application to both EU and Ukrainian energy generation systems has
not been covered before. The findings of the research can be used by electricity
utilities in other countries and/or regions while taking decisions on the energy portfolio,
by the governments while developing energy and environmental strategies.</p>
      <p>The paper is organized into three sections, elaborating on methods of the research,
its results and conclusions.
2</p>
      <sec id="sec-2-1">
        <title>Application of AHP for Evaluation of the Electricity</title>
      </sec>
      <sec id="sec-2-2">
        <title>Generating Sources</title>
        <p>
          A general description of AHP model. The AHP model by T. Saaty [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] has been
applied. Its course of action contains the following: 1. Formulation of the problem –
weighting and ranking of the electricity generating sources of diversified energy
portfolio of the companies; 2. Selection of electricity generating sources to be considered
as alternatives or focus of the research; 3. Identification of the criteria and factors
which determine selection of the electricity generation sources at the level of the
energy company; 4. Construction of AHP hierarchy and evaluation of its components.
        </p>
        <p>Methods of data collection. Library and field methods of data collection were
engaged. Whereas the first is based on analysis of the relevant academic literature and
companies’ annual, financial and Corporate Social Responsibility (CSR) reports, the
latter is conducted through expert interviews.</p>
        <p>The reports (that cover the period 2007-15) from eight leading EU electricity
production companies and one leading Ukrainian energy company were considered. The
energy experts interviewed were from three leading EU energy companies (and
different countries) and one from the leading energy company in Ukraine; they were senior
level managers with engineering degree and from 15 to 30 years of experience in
energy area. Semi-restrictive, open-ended interviews were conducted and closed,
fixed-response questionnaires were filled in. The interviews were conducted in the
period from April 2015 to March 2017.</p>
        <p>
          Seven electricity generating sources were considered, which are responsible for
97% of generated electricity in EU-27 in 2014 [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. 8 assessment criteria and 19
relevant factors were determined to make evaluation of the electricity sources.
        </p>
        <p>To sum up, Table 1 below presents which data from the literature, company
reports and surveys were necessary for application AHP in accordance with T. Saaty for
evaluation of the electricity generating sources and how it was collected.</p>
        <p>Data processing. The constructed by authors (and in accordance to T. Saaty) AHP
hierarchy (Fig. 1) consists of four levels (top to down): 1. Objective; 2. Criteria
( 1 −  8); 3. Criteria-relative factors ( 11 −  82). 4. Sources of electricity generation
or alternatives ( 1 −  7).</p>
        <p>Given that Z1 − Z – a set of alternatives,  = 7, consisting of: coal ( 1), natural gas
( 2), hydro-energy ( 3), wind energy ( 4), solar energy ( 5), biomass energy ( 6),
and nuclear energy ( 7). And given that F1 − F8 are eight complex multi-type criteria
and F11 − F13; F21 − F22; F31 − F32; F41 − F43; F51 − F52; F61 − F62; F71 −
F73; F81 − F82 are their 19 parent factors then AHP is presented by a set of the
following equations - matrix А of paired-wise comparisons:</p>
        <p>11
  = ( …
  1
…
…
…
 1
… ) ,
 
where  – number of matrix,  = 1,28 ;
calculation of vector of local priorities:
calculation of   - normalized vector of ak:</p>
        <p>i
aki = n√∏jn=1 aij , i = 1, n,
(1)
(2)</p>
        <p>F12 F13</p>
        <p>F21</p>
        <p>F22</p>
        <p>F31 F32 F41</p>
        <p>F42 F43</p>
        <p>F51 F52 F61 F62 F71 F72 F73 F81</p>
        <p>F82</p>
        <p>Z2-Z7 - like Z1
Z1</p>
        <p>Z2</p>
        <p>Z3</p>
        <p>Z4</p>
        <p>Z5</p>
        <p>Z6</p>
        <p>Z7
k
calculation of λmax - eigenvalue of matrices:
checking 
- consistency of matrices (≤ 0,1):
  = 




∑ =1 

 ;</p>
        <p>∑ =1</p>
        <p>= 1 ,
λmax = ∑in=1 λik ; 
k
 =
∑ =1</p>
        <p>
          ,
,
where  - consistency index of the matrix; 
– values of random index of
consistency for random matrix of dimension n × n [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ].
calculation of    - global priority vectors of the alternatives:
  
= ∑8=1 ∑19   0 ∙     ∙     , m = 1,7 ,
        </p>
        <p>=1
where   0– normalized vector of priorities of the matrix of judgements against the
main objective;     – normalized vector of priorities of the matrix of judgements of
the factors against complex criteria;</p>
        <p>– normalized vector of priorities of the
matrix of pair-wise comparison of alternatives against factors.
3</p>
      </sec>
      <sec id="sec-2-3">
        <title>Results of AHP Application to Evaluate Electricity Sources</title>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Ranking of criteria, factors and alternatives. Conducted interviews and matrix</title>
      <p>calculations derived from the constructed AHP hierarchy have provided the following
set and rankings of criteria, its relative factors and alternatives (Table 2, Fig.2-5).</p>
      <p>From Table 2 the visible differences are observed within the prioritization of the
factors of criteria F1, F4, F6-F8. It reveals that EU company has long-term outlook
for its generation capacity and Ukrainian company is more interested in short-term
(3)
(4)
(5)
(6)
developments (e.g. whereas EU company prioritizes low-cost new technologies,
Ukraine company prefers low-cost modernization of the existing capacities).</p>
    </sec>
    <sec id="sec-4">
      <title>F1.Clear and stable governmental support and regulation in place:</title>
      <p>F11.Lgislation and regulation, aimed at the development or new construction
of the power stations
F12.Lgislation and regulation, aimed at the energy efficiency, emissions
reduction and environmental protection
F13.Legislation and regulation, aimed at the development or new construction
of the power stations and is not limited by environmental protection measures</p>
    </sec>
    <sec id="sec-5">
      <title>F2.Stable national economy:</title>
      <p>F21.Economic growth in the country, characterized by GDP growth, stable
electricity prices and stable electricity demand
F22.Resistance to high CO2 and fuel prices (with, at the same time, stable
economic situation in the country: GDP growth, stable demand, etc.).</p>
    </sec>
    <sec id="sec-6">
      <title>F3.Internal policy of the company aimed at portfolio diversification:</title>
      <p>F31.Ambitious energy efficiency and emission reduction policy
F32.Practice on mergers and acquisitions, divestments of the power plants</p>
    </sec>
    <sec id="sec-7">
      <title>F4.Competitive costs to generate electricity:</title>
      <p>F41.Relatively low costs of the new energy technologies
F42.Relatively low costs of modernization of existing energy technologies
F43.High profitability of the projects</p>
    </sec>
    <sec id="sec-8">
      <title>F5.Social acceptance and cooperation with stakeholders:</title>
      <p>F51.Support of the energy projects by public and NGOs (non-governmental
organizations)
F52.Cooperation with stakeholders (international organizations, industry,
academia, etc.) and different levels of the government</p>
    </sec>
    <sec id="sec-9">
      <title>F6.Reliable fuel suppliers for electricity generation:</title>
      <p>F61.Relatively low costs for fuel supply for electricity generation
F62.Stable fuel supply for electricity generation</p>
    </sec>
    <sec id="sec-10">
      <title>F7.Satisfaction of the electricity customers:</title>
      <p>F71.Electricity source is known to consumers and meets their requirements
F72.Relatively low price for generated electricity
F73.Reliable, uninterrupted supply of electricity</p>
    </sec>
    <sec id="sec-11">
      <title>F8.Security and safety of electricity generation:</title>
      <p>F81.Operation of the power station has strict and unlimited liability in case of
accidents or malfunctions
F82.The ability to assess the reliability of the power plant (power plant meets
all the requirements of safety at work, its staff is highly qualified and able to
assess the possibility of malfunctions / failures)
Ranking
EU UA
10
4
18
13
5
15
16
8
12
2
19
11
6
17
9
3
14
1
7
3
10
15
7
6
8
16
12
5
1
18
13
11
4
19
14
17
9
2</p>
    </sec>
    <sec id="sec-12">
      <title>Ukraine</title>
      <p>EU</p>
    </sec>
    <sec id="sec-13">
      <title>Ukraine</title>
      <p>Ranking for the electricity generation sources indicate that RES have the highest
value for the portfolio within EU with nuclear energy and natural gas taking the last
positions (Fig. 2). By contrast, for Ukraine coal, biomass and uranium have the
highest priority, leaving the RES and natural gas far behind (Fig. 3).</p>
      <p>For both EU and Ukraine’s energy company the cost and safety of electricity
generation are the most important criteria in selecting sources of electricity generation
(Fig. 4-5). Whereas for the EU these two criteria are equally important, for Ukraine
the cost is twice as important as security and safety of electricity generation. For the
EU company “the satisfaction of the customers” is the third important criterion, for
Ukraine company this criterion is ranked the last. Support from the state and the
economic stability are in the middle of the ranking for both regions with the
governmental support being more important than the economic stability.</p>
      <p>Discussions on improving reliability and safety through diversity. The
abovementioned set of criteria and factors are aimed to account for different aspects of
delivering a common goal - electricity product of the company. Since it is usually
argued that different components in a system improve its redundancy and reliability,
thus avoiding common-cause failure, it is important to understand the optimal
diversity of the components, e.g. to what extent the diversity should be integrated into
energy portfolio and for which companies and/or countries it can be beneficial.</p>
      <p>On the other hand the “optimal” energy portfolio is a complex issue as it is mainly
driven by the electricity production costs over the timeframe. Thus, it should be a
clear understanding of the implications of reliance on alternative energy sources and
whether there is a fuel diversity and not the diversity of the attributes inherent in
usage of specific fuel that improves reliability and safety of electricity generation.
4</p>
      <sec id="sec-13-1">
        <title>Conclusions</title>
        <p>The presented model shows the prioritization of the electricity generation sources
against different aspects of portfolio decision process. Comparison of two regions –
EU and Ukraine - reveals a number of differences in decision making process at the
corporate level. This can be explained by slow path of energy reforms in Ukraine,
presence of ineffective state-owned enterprises, low level of competition and energy
services for the consumers, etc.</p>
        <p>The results generated by the AHP method cannot be taken by granted without
accounting for specifics of a situation, for which the study was conducted. It is
recommended to make an insight into the optimal level of diversity within energy portfolio,
e.g. the optimal shares of different electricity generation sources.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>1. Eurostat, http://ec.europa.eu/eurostat/statistics-explained/</mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Zaslavskyi</surname>
          </string-name>
          , V.:
          <article-title>Type variety principle and peculiarities of study of complex systems with a high cost of failure</article-title>
          .
          <source>Bulletin of Kyiv National Taras Shevchenko Univ</source>
          ,
          <volume>1</volume>
          ,
          <fpage>136</fpage>
          -
          <lpage>147</lpage>
          (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Zaslavskyi</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ievgiienko</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Risk analyses and redundancy for protection of critical infrastructure</article-title>
          .
          <source>Monographs of System Dependability. Oficyna Widawnicza Politechniki Wroclawskiej</source>
          ,
          <fpage>161</fpage>
          -
          <lpage>173</lpage>
          (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Lehtveer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Makowski</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hedenus</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCollum</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Strubegger</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>Multi-criteria analysis of nuclear power in the global energy system: Assessing trade-offs between simultaneously attainable economic, environmental and social goals</article-title>
          .
          <source>Energy Strategy Reviews</source>
          .
          <volume>8</volume>
          ,
          <fpage>45</fpage>
          -
          <lpage>55</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Celikbilek</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tuysuzb</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>An integrated grey based multi-criteria decision making approach for the evaluation of renewable energy sources</article-title>
          .
          <source>Energy</source>
          .
          <volume>115</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1246</fpage>
          -
          <lpage>1258</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Zubair</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>A hybrid approach for reliability analysis based on analytic hierarchy process and Bayesian network</article-title>
          .
          <source>Frontiers in Energy Research</source>
          .
          <volume>2</volume>
          ,
          <issue>1</issue>
          -
          <fpage>5</fpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Shin</surname>
            ,
            <given-names>D-W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shin</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>G-H.</given-names>
          </string-name>
          :
          <article-title>Comparison of Risk Assessment for a Nuclear Power Plant Construction Project Based on Analytic Hierarchy Process and Fuzzy Analytic Hierarchy Process</article-title>
          .
          <source>Journal of Building Construction and Planning Research</source>
          .
          <volume>4</volume>
          ,
          <fpage>157</fpage>
          -
          <lpage>171</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kang</surname>
            ,
            <given-names>H-Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>C-Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shen</surname>
          </string-name>
          , K-C.
          <article-title>: An Integrated Decision-Making Model for the Location of a PV Solar Plant</article-title>
          . Sustainability.
          <volume>7</volume>
          (
          <issue>10</issue>
          ),
          <fpage>13522</fpage>
          -
          <lpage>13541</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Alavipoor</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karimi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Balist</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khakian</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>A geographic information system for gas power plant location using analytical hierarchy process and fuzzy logic</article-title>
          .
          <source>Global Journal of Environmental Science and Management</source>
          .
          <volume>2</volume>
          (
          <issue>2</issue>
          ),
          <fpage>197</fpage>
          -
          <lpage>207</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Abudeif</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moneim</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Farrag</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Multicriteria decision analysis based on analytic hierarchy process in GIS environment for siting nuclear power plant in Egypt</article-title>
          .
          <source>Annals of Nuclear Energy</source>
          .
          <volume>75</volume>
          ,
          <fpage>682</fpage>
          -
          <lpage>692</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Dyuzhev</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Suslikov</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Justification of modern priorities of innovative susceptibility to non-conventional renewable energy sources based on the analysis of socio-economic, ecological and technological factors using analytic hierarchy process</article-title>
          .
          <source>Bulletin of NTU “KHPI”: Technical progress and production efficiency</source>
          .
          <volume>66</volume>
          (
          <issue>1039</issue>
          ),
          <fpage>3</fpage>
          -
          <lpage>12</lpage>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Chernyak</surname>
          </string-name>
          , G.:
          <article-title>Mechanism of selection strategy of economic security of energy enterprises</article-title>
          .
          <source>Effective Economics</source>
          .
          <volume>3</volume>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Saaty</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>The Analytic Hierarchy Process, Planning, Priority Setting, Resource Allocation</article-title>
          .
          <string-name>
            <surname>McGraw-Hill</surname>
          </string-name>
          , New York (
          <year>1980</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <article-title>The Shift Project Data Portal, Energy and Climate Data. www.tsp-data-portal</article-title>
          .org
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Boie</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ragwitz</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Held</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>A composite indicator for short-term diffusion forecasts of renewable energy technologies -</article-title>
          the
          <source>case of Germany. Energy and Environment</source>
          .
          <volume>27</volume>
          (
          <issue>1</issue>
          ),
          <fpage>28</fpage>
          -
          <lpage>54</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Grafakos</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ensenado</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Flamos</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Developing an integrated sustainability and resilience framework of indicators for the assessment of low-carbon energy technologies at the local level</article-title>
          .
          <source>International Journal of Sustainable Energy</source>
          .
          <fpage>1</fpage>
          -
          <lpage>27</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Hirschberg</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burgherr</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Sustainability Assessment for Energy Technologies</article-title>
          .
          <source>Handbook of Clean Energy Systems</source>
          .
          <volume>1</volume>
          -
          <fpage>22</fpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Binder</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Muehlemeier</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wyss</surname>
            ,
            <given-names>R.:</given-names>
          </string-name>
          <article-title>An Indicator-Based Approach for Analyzing the Resilience of Transitions for Energy Regions</article-title>
          .
          <article-title>Part I: Theoretical</article-title>
          and
          <string-name>
            <given-names>Conceptual</given-names>
            <surname>Considerations</surname>
          </string-name>
          . Energies.
          <volume>10</volume>
          ,
          <issue>36</issue>
          ,
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>RWE</given-names>
            <surname>Facts</surname>
          </string-name>
          &amp; Figures, http://www.rwe.com
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>20. E.ON Facts &amp; Figures, http://www.eon.com</mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>21. EDF Activity Reports, https://www.edf.fr</mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>22. Fortum Annual Reports, https://www.fortum.com</mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>GDF-Suez Environmental</surname>
          </string-name>
          Reporting, http://www.engie.com
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <given-names>Vattenfall</given-names>
            <surname>Annual</surname>
          </string-name>
          and Sustainability Reports, https://corporate.vattenfall.com
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>25. Iberdrola Integrated Reports, https://www.iberdrola.com</mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>26. Enel Annual Reports, https://www.enel.com</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>