<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Sustainability Profiling of Long-living Software Systems</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Ahmed D. Alharthi, Maria Spichkova and Margaret Hamilton RMIT University</institution>
          ,
          <addr-line>Melbourne</addr-line>
          ,
          <country country="AU">Australia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2016</year>
      </pub-date>
      <fpage>12</fpage>
      <lpage>19</lpage>
      <abstract>
        <p>-This paper introduces a framework for software sustainability profiling. The goal of the framework is to analyse sustainability requirements for long-living software systems, focusing on usability and readability of the sustainability profiles. To achieve this goal, we apply a quantitate approach such as fuzzy rating scale-based questionnaires to rank the sustainability requirements, and the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) to analyse the results of questionnaires and to provide a basis for system profiling. The core profiling elements provided by our framework are (1) a sustainability five-star rating, (2) visualisation of the five sustainability dimensions as a pentagon graph detailing combination for individual, social, technical, economic and environmental dimensions, and (3) a bar graph of overall sustainability level for each requirement. To ensure sustainability, the proposed profiling framework covers the five dimensions of sustainability to quantify the sustainability of any software system not only during the requirement gathering phase but also during maintenance phase of software system lifecycle.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>I. INTRODUCTION</p>
      <p>
        Addressing the impacts of software systems on
sustainability is a first-class quality concern beside usability, safety and
security [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. A number of studies showed that if a software
system is developed without taking sustainability requirements
into account, the system could have negative impacts on
individual, social, technology, economic, and environment
sustainability, cf. [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]–[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Environmental awareness is crucial
for software engineering, especially in the case of large-scale
systems having many thousands of users.
      </p>
      <p>
        The analysis of system sustainability has to be initiated on
the requirements engineering (RE) phase [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Based on
this idea, Becker et al. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] emphasised that the importance of
identifying stakeholders whose outside interests are affected,
and the use of long-life scenarios techniques during
requirements elicitation could forecast potential impacts. Duffy [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]
highlighted that sustainability could be achieved especially
in the social dimension through usability, which is a
nonfunctional requirement, and its traditional methodologies.
      </p>
      <p>This question is especially important for long-living
systems, where the stakeholders requirements and preferences
might change over the time the system is in use. For example,
a system that can be seen as sustainable today, might be
rated as environmentally unsustainable in few years, while
new techniques to increase environmental sustainability are
developed. To solve this problem, we require an easy-to-use
profiling framework based on quantitate approaches that would
allow to analyse the up-to-date system sustainability profiles,
based on system characteristics and the up-to-date ratings
(quotations) of the corresponding requirements. Usability and
readability of the approach is crucial to make it applicable
for real software development processes, as the quotation
process and the generated profiles have to be easy-to-use by
all stakeholders.</p>
      <p>
        Contributions: To ensure the sustainability of long-living
software systems over their eitire live-cycle, we propose a
framework for sustainability profiling. The framework allows
to analyse sustainability requirements for long-living software
systems. The up-to-date profiles could be generated both
during the RE and the maintenance phase of the software
system lifecycle. The framework workflow is presented in
Figure 1. First of all, stakeholders are assigned to a group
to rate requirements from the different perspective of
sustainability dimensions (individual, social, technical, economic
and environmental). Then, a fuzzy rating scale is used to
avoid imprecision for answering quantitative questionnaires
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. As the next step, the Technique for Order of Preference
by Similarity to Ideal Solution (TOPSIS, cf. [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]) is utilised
to find alternatives that are the nearest distance from the
positive ideal solution and farthest distance from the negative
ideal solution. The software sustainability profiling includes
an overall picture of how sustainable a software system really
is. The profile is presented as three core elements: (1) a
fivestar rating, (2) five dimensions of sustainability in a pentagon
graph, and (4) an overall measure of sustainability for each
requirement in a bar graph.
      </p>
      <p>Outline: The rest of the paper is organised as follows. In
Section II we discuss the background and related work.
Section III introduces our framework for software sustainability
profiling. Section IV introduces an example scenario to show
how the framework can be used to profile software systems.
Section V summarises the core contributions of our work.</p>
    </sec>
    <sec id="sec-2">
      <title>II. BACKGROUND AND RELATED WORK</title>
      <p>
        In this section we discuss the research directions and
approaches that provide a background for our framework: RE
for sustainable systems, the idea of the sustainability profiling,
quantitative approaches, approaches using the fuzzy rating
scale, and the TOPSIS framework for requirements analysis.
We selected TOPSIS for our sustainability profiling
framework, as this technique has been successfully used for
prioritising requirements and solving conflict among non-functional
requirements, cf. [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]–[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Previously, TOPSIS was used
without taking into account the sustainability aspects, but the
extension to evaluate sustainability requirements is possible
and easy to implements. In the sustainability dimensions we
have the same kind of relations among requirements: (1) each
requirement has impacts on other requirements, and (2) each
requirement has positive or negative impacts on sustainability
dimensions that could be maximised or minimised during the
TOPSIS procedure.
      </p>
      <sec id="sec-2-1">
        <title>A. Requirements engineering for sustainable systems</title>
        <p>
          The RE phase of software development focuses on
discovering, developing, tracing, analysing, qualifying, communicating
and managing system requirements, cf. e.g., [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. Lami et al.
[
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] proposed to define a sustainable software process as one
which meets realistic sustainability objectives, taking into
account not only direct but also indirect impacts of the software
on economy, society, human beings, and environment.
        </p>
        <p>
          Penzenstadler [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] defined RE for sustainability as “the
concept of using requirements engineering and sustainable
development techniques to improve the environmental, social
and economic sustainability of software systems and their
direct and indirect effects on the surrounding business and
operational context”.
        </p>
        <p>
          Sustainability in software has various dimensions. Goodland
[
          <xref ref-type="bibr" rid="ref17">17</xref>
          ] suggested to distinguish the following four dimensions:
human (individual), social, economic and environmental
sustainability. Penzenstadler and Femmer [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] as well as Razavian
et al. [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ] added to the new dimension of technical
sustainability.
        </p>
        <p>In our framework, we analyse the system sustainability
using the five dimensions:</p>
        <p>Individual sustainability: Individual needs should be
protected and supported with dignity and in a way that
developments should improve the quality of human life
and not threaten human beings;
Social sustainability: Relationships of people within
society should be equitable, diverse, connected and
democratic;
Technical sustainability: Technology must cope with
changes and evolution in a fair manner, respecting natural
resources;
Environmental sustainability: Natural resources have to
be protected from human needs and wastes; and
Economic sustainability: A positive economic value and
capital should be ensured and preserved.</p>
      </sec>
      <sec id="sec-2-2">
        <title>B. Sustainability Profiling</title>
        <p>
          Sustainability profiling has been used mostly for software
energy and data centre consumption, as well as in cities
and urban settlements. James [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] highlighted that a holistic
and integrated understanding of urban life is essential. He
presented an urban profile framework for cities sustainability
including four main domains ecology, economics, politics
and culture as well as seven sub-domains for each main
domain. The framework was also applied to the sustainability
of eLearning by Stewart and Khare [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ]. This framework was
providing a nine-point scale rating that is imprecise and has to
be extended to fit software development process and to cover
the corresponding sustainability dimensions.
        </p>
        <p>
          Gmach et al. [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ] proposed a profiling approach for the
sustainability of data centres, to quantify energy during design
and operation of data centres. Similarly, Jagroep et al. [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]
demonstrated a software energy profiling to analyse
software changes in energy consumption between releases of a
software product. Although both studies focused on energy
consumption that could impact environmental and economic
dimensions of sustainability, individual and social dimensions
were ignored in the measurement. Our approach covers the
five dimensions of sustainability to quantify the sustainability
        </p>
        <p>Step 3 Determining a support response to be considered as
compatible to some extent; and
Step 4 Creating a trapezoidal fuzzy number from the two
intervals, which are linearly interpolated, as T ra(a; b; c; d),
where 0 a b c d 1.
of any software system, starting from the requirements phase
and continuing over the phase of maintenance.</p>
      </sec>
      <sec id="sec-2-3">
        <title>C. Quantitative Approach</title>
        <p>
          Quantitative approaches are used to analyse data and to
measure qualities in software engineering [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ], [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]. For instance,
goal-oriented requirements and user experience are analysed
and measured via quantitative techniques having a rating scale
of probability between satisfaction and denial of satisfaction.
The rating scales and data analysis techniques vary from one
quantitative approach to another. Some approaches use a
fivelevel Likert scale while others employ a nine-point scale to
present people’s attitudes by scaling their responses. Notably,
the Likert rating scales and the nine scales that are giving
a number of options are closed format. For example, if a
questionnaire has a closed five Likert scale, participants can
only express their opinion through one of the five choices.
These closed format options are imprecise, difficult to choose
between and limited. A solution to overcome drawbacks of
closed formatted scales are the fuzzy rating scale [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], cf.
Section II-D for more details.
        </p>
        <p>
          The quantitate approaches can be applied to several types of
data, and the type of data to analyse might influence the choice
of the approach. Tullis and Albert [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ] suggest to distinguish
the following four types of data:
        </p>
        <p>Nominal data is categorised or classification data, which
it is not in any particular order, e.g., gender or hair colour;
Ordinal data is ordered classified data, but the
differences between them are not meaningful, e.g., product and
movie ratings;
Interval data is classified data where the difference
between two data items is meaningful, but without natural
zero points, e.g., temperature units;
Ratio data is interval data with absolute zero, e.g., weight
and height.</p>
        <p>To analyse sustainability requirements, we will create from the
provided by stakeholders ranking the corresponding ratio data.
This transformation will be done using TOPSIS, cf. Section
II-E. The ratio data will be then further explored to build the
system profile.</p>
      </sec>
      <sec id="sec-2-4">
        <title>D. The Fuzzy Rating Scale</title>
        <p>
          A fuzzy rating scale (FRS) allows the capturing of the
diversity of individual responses in questionnaires, also
avoiding imprecision while rating a questionnaire [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]. For our
sustainability profiling, stakeholders will be required to rate the
corresponding sustainability dimensions. For example, as an
alternative of stakeholders choice from a five classified rating
scale, they can select their range and extend it between a range
of two extreme poles.
        </p>
        <p>
          To implement an FRS, we adopt the fuzzy rating scale
method proposed by Lubiano et al. [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]:
Step 1 Considering a representative rating on the bounded
interval;
Step 2 Determining a core response to be considered as fully
compatible;
Green
(Vibrant)
0
Green
(Vibrant)
Green
(Vibrant)
Green
(Vibrant)
        </p>
        <p>Fig. 2. Fuzzy Rating Scale for Sustainability Profiling</p>
      </sec>
      <sec id="sec-2-5">
        <title>E. TOPSIS</title>
        <p>
          Technique for Order of Preference by Similarity to Ideal
Solution (TOPSIS) is an effective technique to evaluate
sustainability requirements which change over time is utilising.
TOPSIS is one of the multiple criteria decision analysis
approaches to identify the best alternative that is nearest to
an ideal solution and farthest from negative ideal solution
[
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. The principles of TOPSIS are simple, and positive ideal
solutions and negative ideal solutions formed [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. The benefit
criteria in the positive ideal solution are maximised, and the
cost criteria are minimised, while the cost criteria in the
negative ideal solution are maximised, and the benefit criteria
are minimised [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ].
        </p>
        <p>
          The following is the stepwise procedure of TOPSIS
according to Behzadian [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]:
Step 1 Construct normalised decision matrix rij
rij =
        </p>
        <p>xij
qPm
i=1 xi2j
;
f or i = 1;
; m;
j = 1;
; n
(1)
Step 2 Construct the weighted normalised decision matrix vij</p>
        <p>Similarly, the separation from negative ideal is
Step 5 Calculate the relative closeness to the ideal solution
Ci</p>
        <p>S0
Ci = (S + S0 ) ;
0 &lt; Ci &lt; 1; i = f1;
; mg (7)
Ci = 1
Ci = 0
if Ai solution has the best condition,
if Ai solution has the worst condition.</p>
        <p>III. FRAMEWORK FOR SUSTAINABILITY PROFILING
The general idea of the framework workflow is presented
in Figure 1. To measure the sustainability aspects of the
requirements, we adopted the FRS approach. Requirements
are rated against sustainability dimensions, which gives an
input to the TOPSIS procedure. The provided by TOPSIS
results will create a basis for sustainability profiling: using
these results, our framework determines (1) the sustainable
of each system requirement, (2) sustainability of the software
system as whole. This will be presented in a five-star rating
within each level of sustainability dimensions and the overall
sustainability of each requirement. The analytical approach
consists of the following five steps, cf. also Figure 1.</p>
      </sec>
      <sec id="sec-2-6">
        <title>A. Assigning Stakeholders</title>
        <p>Requirements engineers should assign stakeholders to one
of the three stakeholder groups having end-users,
administrators, and developers and providers groups. For instance,
in eLearning systems the learner and instructor are in the
end-users group while ITs support could be assigned to the
administrator group.
(2)
; vng</p>
        <p>(3)
; vn0g
(4)
(5)
(6)</p>
        <p>The framework will generate a questionnaire including
related questions (instructions) for each requirement with
regard to the sustainability dimensions and stakeholders
groups. Thus, for each requirement k questions will be
created, where 1 k 5. Each question should present a
single sustainability dimension perspective, which is covered
by the requirement, and have a form</p>
      </sec>
      <sec id="sec-2-7">
        <title>Rate the influence of the requirement on the X sustainability,</title>
        <p>where X is belongs to the set
findividual; social; technical; environmental; economicg.
The generated questionnaire can be further revised and
adapted by both requirements engineers and sustainability
experts, before continuing with the next step.</p>
        <p>For example, requirement R1 has to have five questions,
covering each dimension of the sustainability.</p>
      </sec>
      <sec id="sec-2-8">
        <title>C. Rating Requirements</title>
        <p>Each stakeholder has to answer allotted question from vary
views of certain sustainability dimension by using the FRS.
For example, stakeholders, who are in the learners and
instructors group, will answer two questions for each requirement:
from the individual and from the social sustainability point
of view. and another time for the social sustainability. Each
answer, also, will be in a form of trapezoidal fuzzy number
from the two intervals as T ra(a; b; c; d), where 0 a b
c d 1.</p>
      </sec>
      <sec id="sec-2-9">
        <title>D. Analysing Sustainability Using TOPSIS</title>
        <p>After all stakeholders answered the questionnaire, the results
of the FRS approach become inputs for TOPSIS. The data will
be normalised and weighted according to Equations 1 and 2,
and after that the steps 3, 4 and 5 of TOPSIS need to be
applied twice:</p>
        <p>First round: Applying requirements as criteria to
determine overall sustainability within the separation of
requirements’ impacts for each requirement; and
Second round: Applying sustainability dimensions as
criteria to analysis each dimension within all requirements
and overall sustainability rating for the software.</p>
      </sec>
      <sec id="sec-2-10">
        <title>E. Generating Software Sustainability Profiling</title>
        <p>The result of TOPSIS analysis including two rounds helps
to generate software sustainability profiling which is visualised
representing the result. The profiling includes:</p>
        <p>Sustainability five-star rating Presenting the average of
P C in the both rounds of sustainability dimensions and
requirements;
Five sustainability dimensions Illustrating each
dimension level combined in pentagon or bar graph (optional)
for the software having all rated requirements; and
Bar graph Showing an overall sustainability for each
requirement.</p>
        <p>An example of a sustainability profile for a software system,
which is created using the proposed framework, is presented
in the next section (cf. Figure 5).</p>
        <p>Considering a different information in the profiling, we
simplify and visualise the result by creating a key chart with
five categories as shown in Table I. This key chart includes
numeric variables in percentage, colour codes for visualisation,
and linguistic variables as a description.</p>
        <p>
          Figure 3 demonstrates how the proposed framework can be
uses during the RE activities (we follow the definition of the
RE activities introduced by [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ]–[
          <xref ref-type="bibr" rid="ref30">30</xref>
          ]):
        </p>
        <p>Requirements elicitation is the practice of understanding
and determining stakeholders’ needs and constraints.
To rate the sustainability requirements using the proposed
framework, at this phase two actions are necessary:
(A) the stakeholders have to be assigned, (B) the
questionnaires have to be generated.</p>
        <p>However, taking into account the long-living nature of the
system, re-iteration of these steps might be necessary on
the management phase, to ensure the sustainability over
the software system lifecycle: (A0) new stakeholders can
be assigned, (B0) the questionnaires can be updated.
Requirements analysis is the practice of refining
stakeholders’ needs and constraints by defining the process,
data and object of the required system.</p>
        <p>On this phase, we conduct the following steps of our
framework:
(C) the stakeholders rate the requirements, (D) the
sustainability of the system is analyses using TOPSIS,
(E) the sustainability profile is generated.</p>
        <p>To ensure longevity of the system, these steps also can
be repeated during the management phase.</p>
        <p>Requirements specification is the practice of writing
down stakeholders’ needs and constraints, and this
documentation should be unambiguous, complete, correct,
understandable, consistent, concise, and feasible.</p>
        <p>The sustainability profile could be seen as one of the input
to the specification phase.</p>
        <p>Requirements validation is the practice of checking that
the specification captures users’ needs and constraints.
The proposed framework does not cover the validation
activities, which might be one of the future work
directions.</p>
        <p>Requirements management is the practice of
scheduling, controlling changes and tracking requirements over
time. In the case of long-living systems, the management
activities are crucial to keep the software system
sustainable. The steps (A) (E) have to be repeated to provide
an up-to-date sustainability profile of the system.</p>
        <p>IV. APPLICATION OF THE PROPOSED FRAMEWORK
Let us discuss an example scenario with five requirements
R1, . . . , R5. The aim of this scenario is to illustrate application
of the proposed framework, without going into the technical
details like generating of questions within real questionnaires.
In this scenario, we will go through all framework steps and
present the created sustainability profile as the final result.</p>
      </sec>
      <sec id="sec-2-11">
        <title>A. Assigning Stakeholders</title>
        <p>Let us assume that the requirements will be rated by ten
assigned stakeholders: four in the end-users group, three in
administrators group, and three in developers and providers
group.</p>
      </sec>
      <sec id="sec-2-12">
        <title>B. Defining Questions</title>
        <p>This step is omitted in the example, as the rating activities
will be simulated.</p>
      </sec>
      <sec id="sec-2-13">
        <title>C. Rating Requirements</title>
        <p>To simulate the rating activities where each stakeholder rates
requirements against sustainability dimensions by answering
defined questions, we generate random numbers between [0:1]
(0 corresponds to a critical value, 1 corresponds to a green
value) for the fuzzy rating scales. Figure 4 shows the results
of application of the FRS approach to the requirement R1,
from the prospective of ten assigned stakeholders.</p>
        <p>As follows from Figure 4, Stakeholder S2, who is assigned
to individual and social sustainability dimensions, rates R1 for</p>
        <p>A Representative Rating
ilcaoS CSri ti5cal 0          10          20         30         40          5.0         60         70          80         90        100( GVirberaennt )
iccoonEmCSri ti5cal 0          10          20         30         40          5.0         60         70          80         90        100( GVirberaennt )
individual perspective as T ra(0:51; 0:66; 0:856; 1:00) while
social perspective as T ra(0:60; 0:66; 0:75; 0:9). We calculate
fuzzy values from each fuzzy rating by mean measurement,
so individual and social means of R1 for S2 are 0:754 and
0:727, respectively.</p>
      </sec>
      <sec id="sec-2-14">
        <title>D. Analysing Sustainability</title>
        <p>In the next step, all the FRS outputs become inputs for
TOPSIS, cf. Table II. These data are normalised according to
Equation 1 for the five system requirements R1, . . . , R5 within
the individual, social, technical, economic and environmental
dimensions of sustainability. The result of normalisation step
presented in Table III.</p>
        <p>The weighted normalisation that was constructed according
to Equation 2 is showed in Table IV. Following the TOPSIS
procedure, we calculate for both rounds the separation
measures from positive ideal S and negative ideal solutions S0 , as
well as the relative closeness C . The results are summarised
in Tables V and VI. Noteworthy, we could calculate the
negative impact of economic and environmental sustainability
dimensions via the negative ideal solution that maximises the
cost criteria and minimises the benefit criteria.</p>
      </sec>
      <sec id="sec-2-15">
        <title>E. Sustainability Profiling</title>
        <p>The generating software sustainability profiling is presented
in Figure 5 within an overall of 49% sustainability which is the
mean of P C in the two rounds (in Table V and VI). Among
R1
R2
R3
R4
R5</p>
        <p>Dimension
Individual
Social
Technical
Economic
Environment
Individual
Social
Technical
Economic
Environment
Individual
Social
Technical
Economic
Environment
Individual
Social
Technical
Economic
Environment
Individual
Social
Technical
Economic
Environment</p>
        <p>S1
0.573
0.276</p>
        <p>idual
div
In</p>
        <p>Socia
l
l
a
c
i
n
h
c
e
T</p>
        <p>R 5
R 4
R 3
R 2
R 1</p>
        <p>Environmental
Overall 10
30
50
70</p>
        <p>90
the five requirements, R1 meets the highest level as satisfactory
as well as environmental dimensions. Also, individual, social,
technical and economic dimensions become basic as the lowest
level of software sustainability including the five requirements
in this example.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>V. DISCUSSION AND CONCLUSIONS</title>
      <p>In this paper, we introduced a framework for software
sustainability profiling. We also presented and example scenario
to provide a numerical illustration on how the framework can
be applied. The framework allows to create the following
profiling elements:</p>
      <sec id="sec-3-1">
        <title>1) Sustainability five-star rating for overall sustainability</title>
        <p>ranking of entire software requirements;</p>
      </sec>
      <sec id="sec-3-2">
        <title>2) Visualisation of the five sustainability dimensions as a</title>
        <p>pentagon graph (and, optionally, also a bar graph) for all
dimension levels of the entire software requirements; and
3) Bar graph for overall sustainability of each requirement.</p>
        <p>In our framework we apply a quantitative approach to
measure sustainability of the software systems. The fuzzy
rating scale is utilised to overcome inexplicit choices in
questionnaires and increase the usability of the framework. The
TOPSIS approach for requirements analysis is used to analyse
ranking within the best ideal solution and the worst ideal
solution among requirements that could assist to recognise the
positive and negative impacts on sustainability via maximising
or minimising the benefit or cost.</p>
        <p>In the case of long-living systems, it is crucial to keep the
software system sustainable over the whole lifecycle of the
system. The stakeholders requirements and preferences might
change over the time the system is in use, and proposed
framework allows to analyse the up-to-date system sustainability
profiles, based on system characteristics and the up-to-date
ratings (quotations) of the corresponding requirements.</p>
        <p>One of the core features of the framework is readability
of the sustainability profiles, which also implies the usability
of the proposed framework. For example, we apply the
fivestar rating to present sustainability ratings, as this rating is
perceived as a common one in other areas: the five-star rating
has become a standard for electricity consumption labelling
in electronic appliances such as air conditioners and computer
monitors, allowing an energy efficient choice by reducing
energy use and emissions (i.e., to increase environmental
sustainability).</p>
        <p>We follow the traffic lights colouring schema, where
critical values are marked red and green (vibrant) are marked
green to increase readability and graphic visualisation. These
colours and their descriptions have been used in Green IT and
Sustainability Developments. To increase accessibility of our
approach, we also provide another colouring option for
colourchallenged people, where the red colour is replaced by blue.
Finally, there are two options to present the five sustainability
dimensions as a pentagon or bar graph because it might be
argued that the pentagon graph could be harder to read and
need more effort to analyse represented data than the bar
graph, so we provide the bar graph option for representing
the five sustainability dimensions.</p>
        <p>
          Future work: The main direction of our future work on
the proposed framework is to develop a tool for software
sustainability profiling, allowing to perform the framework
steps within a single platform. We also would like to apply
the proposed framework to our earlier work on the analysis
of the RE aspects of ELearning systems [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ] as well as of
geographically distributed systems and within global product
development [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ]–[
          <xref ref-type="bibr" rid="ref34">34</xref>
          ].
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>ACKNOWLEDGEMENT</title>
      <p>The first author is supported by a scholarship from Umm
Al-Qura University, Saudi Arabia.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Raturi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Richardson</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Tomlinson</surname>
          </string-name>
          , “
          <article-title>Safety, security, now sustainability: The nonfunctional requirement for the 21st century,” Software</article-title>
          ,
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          , vol.
          <volume>31</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>40</fpage>
          -
          <lpage>47</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>F.</given-names>
            <surname>Berkhout</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Hertin</surname>
          </string-name>
          , “
          <article-title>Impacts of information and communication technologies on environmental sustainability: Speculations and evidence,” Report to the OECD, Brighton</article-title>
          , vol.
          <volume>21</volume>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.</given-names>
            <surname>Jansen</surname>
          </string-name>
          , “
          <article-title>Creating environmental awareness in service oriented software engineering,” in Service-Oriented Computing</article-title>
          . Springer,
          <year>2011</year>
          , pp.
          <fpage>181</fpage>
          -
          <lpage>186</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S.</given-names>
            <surname>Naumann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dick</surname>
          </string-name>
          , E. Kern, and T. Johann, “
          <article-title>The greensoft model: A reference model for green and sustainable software and its engineering,” Sustainable Computing: Informatics and Systems</article-title>
          , vol.
          <volume>1</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>294</fpage>
          -
          <lpage>304</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Femmer</surname>
          </string-name>
          , “
          <article-title>A generic model for sustainability with process- and product-specific instances</article-title>
          ,”
          <source>in Proceedings of the 2013 Workshop on Green in/by Software Engineering</source>
          , ser.
          <source>GIBSE '13</source>
          . New York, NY, USA: ACM,
          <year>2013</year>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>8</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>G. G.</given-names>
            <surname>Calienes</surname>
          </string-name>
          , “
          <article-title>Requirements prioritization framework for developing green and sustainable software using anp-based decision making</article-title>
          ,”
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          , “
          <article-title>Infusing green: Requirements engineering for green in and through software systems</article-title>
          ,” Christopher Arciniega,
          <string-name>
            <surname>Birgit Penzenstadler TechReport UCI-ISR-</surname>
          </string-name>
          14-2 June,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>C.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Betz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chitchyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Duboc</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. M.</given-names>
            <surname>Easterbrook</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Seyff</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C. C.</given-names>
            <surname>Venters</surname>
          </string-name>
          , “Requirements: The key to sustainability,
          <source>” IEEE Software</source>
          , vol.
          <volume>33</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>56</fpage>
          -
          <lpage>65</lpage>
          , Jan.
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>V. G.</given-names>
            <surname>Duffy</surname>
          </string-name>
          , Improving Sustainability through Usability. Cham: Springer International Publishing,
          <year>2014</year>
          , pp.
          <fpage>507</fpage>
          -
          <lpage>519</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10] S. de la Rosa de Sa´a,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Gil</surname>
          </string-name>
          , G. Gonza´lez-Rodr´ıguez, M. T. Lo´pez, and
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Lubiano</surname>
          </string-name>
          , “
          <article-title>Fuzzy rating scale-based questionnaires and their statistical analysis</article-title>
          ,
          <source>” IEEE Transactions on Fuzzy Systems</source>
          , vol.
          <volume>23</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>111</fpage>
          -
          <lpage>126</lpage>
          ,
          <year>Feb 2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>M.</given-names>
            <surname>Behzadian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. K.</given-names>
            <surname>Otaghsara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Yazdani</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Ignatius</surname>
          </string-name>
          , “
          <article-title>A state-of the-art survey of TOPSIS applications,” Expert Systems with Applications</article-title>
          , vol.
          <volume>39</volume>
          , no.
          <issue>17</issue>
          , pp.
          <volume>13</volume>
          <fpage>051</fpage>
          -
          <lpage>13</lpage>
          069,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>D.</given-names>
            <surname>Mairiza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Zowghi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>V.</given-names>
            <surname>Gervasi</surname>
          </string-name>
          , “
          <string-name>
            <surname>Utilizing</surname>
            <given-names>TOPSIS</given-names>
          </string-name>
          :
          <article-title>A Multi Criteria Decision Analysis Technique for Non-Functional Requirements Conflicts,” in RE, ser</article-title>
          . Communications in Computer and Information Science,
          <string-name>
            <given-names>D.</given-names>
            <surname>Zowghi</surname>
          </string-name>
          and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Jin</surname>
          </string-name>
          , Eds. Springer,
          <year>2014</year>
          , vol.
          <volume>432</volume>
          , pp.
          <fpage>31</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>P.</given-names>
            <surname>Achimugu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Selamat</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Ibrahim</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. N.</given-names>
            <surname>Mahrin</surname>
          </string-name>
          , “
          <article-title>A systematic literature review of software requirements prioritization research</article-title>
          ,
          <source>” Information and Software Technology</source>
          , vol.
          <volume>56</volume>
          , no.
          <issue>6</issue>
          , pp.
          <fpage>568</fpage>
          -
          <lpage>585</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>E.</given-names>
            <surname>Hull</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Jackson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and J.</given-names>
            <surname>Dick</surname>
          </string-name>
          , Requirements engineering. Springer Science &amp; Business
          <string-name>
            <surname>Media</surname>
          </string-name>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>G.</given-names>
            <surname>Lami</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Fabbrini</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Fusani</surname>
          </string-name>
          ,
          <article-title>Software Sustainability from a Process-Centric Perspective, ser</article-title>
          .
          <source>Communications in Computer and Information Science</source>
          . Springer Berlin Heidelberg,
          <year>2012</year>
          , vol.
          <volume>301</volume>
          , ch.
          <source>Systems, Software and Services Process Improvement</source>
          , pp.
          <fpage>97</fpage>
          -
          <lpage>108</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          , Green in Software Engineering. Cham: Springer International Publishing,
          <year>2015</year>
          , ch. From Requirements Engineering to Green Requirements Engineering, pp.
          <fpage>157</fpage>
          -
          <lpage>186</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>R.</given-names>
            <surname>Goodland</surname>
          </string-name>
          , “
          <article-title>Sustainability: human, social, economic and environmental,” Encyclopedia of Global Environmental Change</article-title>
          . John Wiley &amp; Sons,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>M.</given-names>
            <surname>Razavian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Procaccianti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. A.</given-names>
            <surname>Tamburri</surname>
          </string-name>
          et al.,
          <string-name>
            <surname>“</surname>
          </string-name>
          Four-dimensional
          <string-name>
            <surname>sustainable</surname>
          </string-name>
          e-services,” EnviroInfo, Sep,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>P.</given-names>
            <surname>James</surname>
          </string-name>
          ,
          <article-title>Urban sustainability in theory and practice: circles of sustainability</article-title>
          .
          <source>Routledge</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>B.</given-names>
            <surname>Stewart</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Khare</surname>
          </string-name>
          , “
          <article-title>elearning and the sustainable campus</article-title>
          ,” in Transformative Approaches to Sustainable Development at Universities. Springer,
          <year>2015</year>
          , pp.
          <fpage>291</fpage>
          -
          <lpage>305</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>D.</given-names>
            <surname>Gmach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Shah</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Rolia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bash</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Christian</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Sharma</surname>
          </string-name>
          , “
          <article-title>Profiling sustainability of data centers,”</article-title>
          <source>in Proceedings of the 2010 IEEE International Symposium on Sustainable Systems and Technology, May</source>
          <year>2010</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>E. A.</given-names>
            <surname>Jagroep</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. M. van der Werf</surname>
            , S. Brinkkemper, G. Procaccianti,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Lago</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Blom</surname>
          </string-name>
          , and R. van Vliet, “
          <article-title>Software energy profiling: Comparing releases of a software product</article-title>
          ,”
          <source>in Proceedings of the 38th International Conference on Software Engineering Companion</source>
          , ser.
          <source>ICSE '16</source>
          . New York, NY, USA: ACM,
          <year>2016</year>
          , pp.
          <fpage>523</fpage>
          -
          <lpage>532</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>T.</given-names>
            <surname>Tullis</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Albert</surname>
          </string-name>
          ,
          <article-title>Measuring the User Experience</article-title>
          , 2nd ed.,
          <source>ser. Interactive Technologies</source>
          . Boston: Morgan Kaufmann,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>J.</given-names>
            <surname>Horkoff</surname>
          </string-name>
          and
          <string-name>
            <given-names>E.</given-names>
            <surname>Yu</surname>
          </string-name>
          , “
          <article-title>Analyzing goal models: Different approaches and how to choose among them</article-title>
          ,”
          <source>in Proceedings of the 2011 ACM Symposium on Applied Computing</source>
          , ser.
          <source>SAC '11</source>
          . New York, NY, USA: ACM,
          <year>2011</year>
          , pp.
          <fpage>675</fpage>
          -
          <lpage>682</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Lubiano</surname>
          </string-name>
          , S. de la Rosa de Sa,
          <string-name>
            <given-names>M.</given-names>
            <surname>Montenegro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Sinova</surname>
          </string-name>
          , and M. ngeles Gil, “
          <article-title>Descriptive analysis of responses to items in questionnaires. why not using a fuzzy rating scale?” Information Sciences</article-title>
          , vol.
          <volume>360</volume>
          , pp.
          <fpage>131</fpage>
          -
          <lpage>148</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>J. R. S</surname>
          </string-name>
          . C. Mateo, TOPSIS. London: Springer London,
          <year>2012</year>
          , pp.
          <fpage>43</fpage>
          -
          <lpage>48</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>R. H.</given-names>
            <surname>Thayer</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Dorfman</surname>
          </string-name>
          , Software Requirements Engineering. Wiley-IEEE Press,
          <year>2000</year>
          , ch. Introductions, Issues, and Terminology, pp.
          <fpage>3</fpage>
          -
          <lpage>40</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>B.</given-names>
            <surname>Nuseibeh</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Easterbrook</surname>
          </string-name>
          , “Requirements engineering: A roadmap,”
          <source>in Proceedings of the Conference on The Future of Software Engineering</source>
          , ser.
          <source>ICSE '00</source>
          . New York, NY, USA: ACM,
          <year>2000</year>
          , pp.
          <fpage>35</fpage>
          -
          <lpage>46</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>P.</given-names>
            <surname>Sawyer</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Sommerville</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Viller</surname>
          </string-name>
          , “
          <article-title>Requirements process improvement through the phased introduction of good practice</article-title>
          ,
          <source>” Software Process: Improvement and Practice</source>
          , vol.
          <volume>3</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>19</fpage>
          -
          <lpage>34</lpage>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>I. Sommerville</given-names>
            , Software Engineering, 9th ed. USA:
            <surname>Addison-Wesley Publishing</surname>
          </string-name>
          Company,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <surname>A. D. Alharthi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Spichkova</surname>
            , and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Hamilton</surname>
          </string-name>
          , “
          <article-title>Requirements engineering aspects of elearning systems</article-title>
          ,”
          <source>in Proceedings of the ASWEC 2015 24th Australasian Software Engineering Conference. ACM</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>132</fpage>
          -
          <lpage>133</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>M.</given-names>
            <surname>Spichkova</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          , “
          <article-title>Requirements engineering aspects of a geographically distributed architecture,” in 10th International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE</article-title>
          <year>2015</year>
          ),
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>M.</given-names>
            <surname>Spichkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. W.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. R. I.</given-names>
            <surname>Nekvi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N. H.</given-names>
            <surname>Madhavji</surname>
          </string-name>
          , “
          <article-title>Structuring diverse regulatory requirements for global product development,” in Requirements Engineering and Law</article-title>
          . IEEE,
          <year>2015</year>
          , pp.
          <fpage>57</fpage>
          -
          <lpage>60</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>M.</given-names>
            <surname>Spichkova</surname>
          </string-name>
          , H. Liu, and
          <string-name>
            <given-names>H.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          , “
          <article-title>Towards quality-oriented architecture: Integration in a global context</article-title>
          ,
          <source>” in European Conference on Software Architecture Workshops. ACM</source>
          ,
          <year>2015</year>
          , p.
          <fpage>64</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>