<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Utility Model for Designing Environmentally Sustainable Software</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sedef Akinli Kocak</string-name>
          <email>sedef.kocak@vectorinstitute.ai</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gulfem Isiklar Alptekin</string-name>
          <email>gisiklar@gsu.edu.tr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Computer Engineering Department, Galatasaray University</institution>
          ,
          <addr-line>Istanbul</addr-line>
          ,
          <country country="TR">Turkey</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Vector Institute for Artificial Intelligence</institution>
          ,
          <addr-line>Toronto</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>-Software systems play an increasingly central role in sustainability, since many aspects of our lives and society as a whole are mediated through software systems. Hence, the design of these systems requires attention from sustainability perspective. Recent interest in sustainability as a requirement has given rise to broader definitions in terms of technical, economic, environmental and individual perspectives. In this sense, there is a need for additional quality requirements to include sustainability concerns, as well as to examine the market equilibrium where stakeholders and customers meet. In Most cases, software development companies do not consider the explicit representation of sustainability requirements such as resource utilization, or customers concerns on sustainability. In this work, we focus on the relationship between customers, who require energy efficient software products, and software development companies, who offer these software products. The proposed introductory model aims to determine the demand and payoff functions by satisfying both sides with the quality level of the product and its price. Index Terms-Environmental Sustainability, Utility Model, Software Quality, Market Equilibrium, Green Software.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>I. INTRODUCTION</title>
      <p>
        Sustainability, the “capacity to endure” [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] is a key issue
facing society on multiple levels, from individuals and social
groups to large socio-technical systems and the planet earth.
As a concept, it concerns a specific system and has to be
considered along multiple dimensions such as environmental,
economic, social, technological and individual [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. Humanity
faces many complex challenges that present risks to
societies, including the rise of CO2 emission, biodiversity loss,
cybersecurity, inequality and unfairness. Environmental risks
have grown in prominence in recent years. It is fundamentally
a systemic property, and any effort to address sustainability
involves integrating concepts, principles, and methods from a
range of disciplines.
      </p>
      <p>
        In the context of software engineering, sustainability is often
defined as to “preserve the function of a system over an
extended period of time” [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. As many aspects of our lives
and society as a whole are mediated through software systems,
sustainability is becoming a challenge for requirements and
software professionals [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Although requirements engineering
(e.g., [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ]) and software architecture researchers (e.g.,
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]) have been devoting effort to define the basis of the
notion of sustainability-aware software, there are still a lack of
suitable approaches to design software-intensive systems that
enable sustainability goals.
      </p>
      <p>
        In software engineering, sustainability is mostly related to
technical impact (e.g., [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]), economic interests (e.g., [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ],
and recently environmental concerns (e.g. [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ], [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]). Recent
interest in sustainability as a requirement has given rise to
broader definitions in terms of technical, economic and
environmental perspectives [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ]. In this sense, sustainability may
lead to have additional quality requirements. New instruments
(e.g., [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ], [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]) have designed framing the design
concerns around the four sustainability dimensions- technical,
economic, social and environmental sustainability. We believe
that decision-oriented models are one of the significant ways
of examining the sustainability concerns of stakeholders.
      </p>
      <p>
        In this paper, we present an introductory model which is part
of a continuous work on designing decision-oriented model
focusing on relevant quality requirements and contributing to
the sustainability dimensions of software-intensive systems.
In the proposed model, we assume that the software product
customers have two main decision variables, when buying
a software product: Price and quality. It is obvious that
the buyers may have various other concerns when making
the decision of buying, but for the sake of constructing a
manageable demand function, we only select the most two
important ones. The quality variable comprises all non-functional
requirements of the offered software. As the price of the
product increases, the customer‘s willingness to buy decreases,
while the quality of the product increases, the customer‘s
willingness to buy increases. Accordingly, we introduce a
linear demand function for software development companies.
Moreover, we introduce an acceptance probability variable for
customers, that is maximized when the price of the product
decreases, while it‘s quality increases. We propose that this
approach may be suitable in the context of software quality
requirements, since they are always subject to negotiation
between customers/users and development company. In our
model, the quality requirements involve sustainability
concerns. The proposed introductory model is based on interactive
multi-criteria decision making theory [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ] which focuses
on the structure of multi-criteria or multi-attribute alternatives,
usually in the presence of conflicting criteria. Therefore, the
strategic interaction of customer and development company
as well as the interdependencies of quality attributes and
sustainability requirements are essential. The rest of this paper
is structured as follows: Section 2 gives a more detailed
description of what motivates this study and introduces the
corresponding background. Section 3 describes the basic elements
of the introductory model. We present a green software product
scheme in Section 4, and we conclude the paper in Section 5
with a summary of the study and continuing directions of the
research.
      </p>
    </sec>
    <sec id="sec-2">
      <title>II. RELATED WORK AND MOTIVATION</title>
      <p>In this section, we have categorized the works related to
our research topic under two categories: quality models in
software engineering and software engineering and
sustainability. Researchers have been studying sustainability in software
engineering from different perspectives such as hardware
energy efficiency in terms of power consumption; optimization
of algorithms and / or software architecture; effective and
efficient design and usage of software intensive system, and
models to support decision making including sustainability.</p>
      <p>
        There are rising attention and increasing research works in
the field of software engineering and sustainability focusing on
specific software sustainability aspects. For example, Hindle
[
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] related the direct impact of software change on energy
consumption; Procaccianti et al. [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ] related software code
metrics and software architecture for assessing the impact of
best practices for achieving software energy efficiency; Cai et
al. [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] investigated the notion of design rules to detect flows
at the software architecture level over extended periods; Lago
et al. [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ], [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] introduced a decision map can be used to
frame the concerns of each of the sustainability dimensions to
support decision making.
      </p>
      <p>
        The recent quality model/standards are introduced by ISO
(ISO/9126 and ISO/IEC 25010) [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. In these standards, the
sustainability issues are not considered as a separate criteria.
Several sustainability related issues may be the consumption
of energy, memory requirements, efforts (in terms of energy)
required during its development, etc. In the software
engineering literature, the first quality model for green and sustainable
software was developed by Kern et al. [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. The model
considers the product quality factors, however, the quality aspects
standardized in ISO /IEC 25000 are also related to the quality
of software in use. Calero and Bertoa [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] considered
sustainability as a new factor that affects software product and process
quality. They presented a new quality model (ISO 2510+S)
based on ISO/25010. In their model, they differentiated the
quality factors concerning the sustainability impact and they
described related and unrelated sub-characteristics. A
crossdisciplinary initiative to create a common ground and develop
a focal point of reference in software and sustainability is
proposed by Becker et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. They discuss different
interpretations of sustainability. Akinli Kocak et al. [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] analyzed
the correlation between the standardized quality attributes and
environmental sustainability attributes to identify their effects
on environmental sustainability. Recently, Condori-Fernandez
and Lago [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] developed a Software Sustainability-Quality
Model to characterize the contribution of quality requirements
to software sustainability. All these studies point out that the
product, as well as the quality in use needs to be considered
when assessing the sustainability of the software. However,
knowledge about designing and configuring software in an
environmental manner is not sufficient today [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Moreover,
assessment based on the notion of sustainability as a software
quality property is still emerging and poorly understood [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>Companies are increasingly aware of many potential
benefits provided by customer-oriented business strategies. Besides,
environmental requirements are becoming indispensable
regarding environmentally friendly product development. In our
literature review, we examined that there is still a gap on
explicit representation of sustainability requirements (e.g energy
efficiency and resource efficiency) and stakeholders‘ concerns
on the environmental sustainability of software products. In
most cases, software development companies do not consider
the explicit representation of sustainability requirements such
as resource utilization, or customer‘s concerns on
sustainability.</p>
      <p>In this work, we focus on the relationship between
customers, who require energy efficient software products, and
software development companies, who offer these software
products. The proposed introductory model aims to determine
the demand and payoff functions by satisfying both sides with
the quality level of the product and its price.</p>
    </sec>
    <sec id="sec-3">
      <title>III. THE PROPOSED INTRODUCTORY MODEL</title>
      <p>
        The goal of this introductory model is to find the equilibrium
to meet the stakeholders needs and required quality attributes,
while taking into account the environmental sustainability of
the software product. This model is based on the theory
of interactive decision-making model. It provides general
mathematical techniques for analyzing situations in which
two or more individuals make decisions that will influence
one another‘s welfare [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. These situations are referred to
interactive decision processes. It consists of a collection of
models. A model is an abstraction that we use to understand
our observations and experiences [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. In this section, the
concepts and the elements of the proposed model are briefly
presented.
      </p>
      <p>
        The decision-making entities are considered as the
individuals of the interactive decision process. In this model, we
assume that the individuals are software development company
and a customer and they are rational and intelligent [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The
strategy of the one individual is a complete contingent plan
of action for whatever situation might arise. The payoffs for
an individual should capture everything in the outcomes that
the individual cares. In many cases, the payoff function is
represented by a utility function, which assigns a quantifiable
value to each possible outcome, with higher utilities
representing the more desirable outcomes. In an interactive
decisionmaking model, it is assumed that each individual knows which
strategy s/he prefers or which strategies are equally desirable
for her/him.
and development and the design of the product. This fixed cost
is assumed to be independent from the quality attributes‘ level.
Total product quality is represented by the quality attributes
(Ai) and related importance weights (wi). The product quality
is calculated by multiplying the quality attributes level with
corresponding importance weight:
      </p>
      <p>Q =</p>
      <p>X wiAi;
Then, the companys demand function is:
(2)
(3)
(4)
(5)
(P; Q) = a</p>
      <p>b1P + b2Q(Ai);</p>
      <p>P = d + eQ(Ai);
with
and accordingly
where d&gt;0 and e&gt;0.</p>
      <p>When we substitute the price with quality attributes, then
the demand is:
(P; Q) = (a
b1d) + (b2
b1e)Q(Ai);</p>
      <sec id="sec-3-1">
        <title>A. The Basic Model and its Components</title>
        <p>We consider a differentiated market in which customers
differ in their willingness to pay for the environmental quality
of the software product. Each customer has a reservation price
and preferences over the product‘s quality attributes. In such
a market, the software development company‘s objective is
both to determine the optimal price for its product and the
optimal environmental quality attributes‘ level with respect to
customers‘ requirements. The software development industry
is generally concentrated. The up-front cost of developing
software products is prohibitively high. Presumably, product
design is mainly achieved via R&amp;D-related expenditures (fixed
costs) with little to no increase in marginal cost. In our model,
the interacting individuals are software development
companies. They build a strategic interaction with their customers.
In the model, it is assumed that there are interdependencies
among quality attributes and environmental attributes. All the
necessary notations are given in I.</p>
        <p>The Software Development Company</p>
        <p>
          Similar to the model presented at [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], the software
development company wants to maximize its own profit. The
decision variables of the companys utility function are product
price (P ) and quality Q(Ai). Q(Ai; i = 1; : : : ; n) is assumed
to be uniformly distributed on [0; 1]. We assume the existence
of a normalized upper bound for quality, 1. The demand that
the company faces is represented with (P; Q). We follow a
common assumption and define a linear demand function:
=
(P; Q)P
        </p>
        <p>DC;
(1)
where the development cost is defined as DC = F C +
e:Q(Ai). The parameter FC is the fixed cost tied to research
F C + eQ(Ai)P;
(6)
(P; Q) = [(a b1d) + (b2</p>
        <p>b1e)Q(Ai)]P
The Customer</p>
        <p>Let us now describe the customers utility. A customers
utility depends on the price and quality attributes levels of the
software product s/he is using. In this model, the customer is
assumed to require maximizing the environmental quality of
the software product at minimum expense. A customer accepts
an offer, if the price asked is reasonable and the quality level is
satisfying. Hence, we can introduce an acceptance probability
A (U, P), where U is the utility of the customer and P is the
associated price of the software. The acceptance probability
should be an increasing function of U for a fixed P, while
decreasing function in P for fixed U:</p>
        <p>A(U; P ) = 1
e 1CU Q(b2P b1)
(7)</p>
        <p>The acceptance probability function can be differentiated
among customers through the above parameters. The objective
is to maximize the acceptance probability of each customer.
In our software product, the energy efficiency and resource
efficiency are the quality attributes in which the companys
sustainability effort can be observed. Constant, C, which can
be used to control the rate of feature perturbation, is set to 1
by default.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>IV. A GREEN SOFTWARE PRODUCT SCHEME</title>
      <p>In this section, we introduce a green software scheme
based on the characteristics of the environmental sustainability
requirements of the customers. A desired level of quality
for software may be achieved by defining appropriate quality
characteristics, taking into account the purpose of usage of
the software product. Developing green software necessitates
identification of the traditional quality attributes as well as
and environmental attributes. The software development
companies can show their effort to support sustainability by using
these attributes and metrics.</p>
      <sec id="sec-4-1">
        <title>A. Selection of the Quality Attributes</title>
        <p>
          Software product quality attributes were selected from the
ISO/IEC 25000 (SQuaRE) [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] series. ISO/IEC 25010 is a
part of Square series that is composed of a quality in use
and a product quality model. The criteria defined by model
are relevant to all software product and computer systems.
Considering the scope of our study, we adopted ISO/IEC
25010 product quality model that categorizes product quality
properties into eight characteristics: functional suitability,
reliability, performance efficiency, usability, security,
compatibility, maintainability and portability. While functional
suitability, reliability, performance efficiency, usability, security and
compatibility are defined as internal quality characteristics;
maintainability and portability are external characteristics. In
their survey study Akinli Kocak et al. [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] showed that security
and compatibility has negligible impact of the
environmentally sustainable software product quality. Therefore, in this
work, we only adopted functional suitability, performance
efficiency, reliability and usability as quality attributes. As
for the environmental attributes, we adopted energy efficiency
and resource efficiency from Akinli Kocak et al. [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ].
Environmental sustainability aims at improving human welfare
while protecting natural resources. If the software product is
considered, this dimension aims at addressing environmental
requirements. When designing software intensive systems,
immediate features and effects, longer-running, aggregate and
cumulative impact of these systems have to be considered
[
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. However, for simplicity we considered only energy and
resource efficiency as environmental attributes which have
direct effects (first order effects [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]) on the environmental
sustainability. Computing resources (memory, processing,
network bandwidth, and storage) are the principal sources of
consumption within the software system. Given a monitoring
of energy consumption over certain period, energy efficient
resource usage possibilities may be spotted and subsequently
applied. For this reason, energy efficiency and resource
efficiency are chosen as characteristic of environmental quality of
the product. Table II summarizes all the selected attributes of
software quality.
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>B. Determining the Importance Weights (wi)</title>
        <p>
          The quality attributes of software products may impact
costumer‘s perceived value with various levels of intensity.
We classified software products by characterizing them as
high-intensity (a high), medium-intensity (a medium) and
lowintensity (a low). High-intensity software products contain
attributes that have biggest contribution on sustainability and
are critical to achieve the purpose of the software. For the level
of intensity, we use 1 to 5 scale [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. In that scale, the high
product intensity (scale: 1-2) means that this product will be
accepted (as accept). Similarly, the medium product intensity
(scale: 3-4) means that it will be reviewed (review) and the
low product (scale: 5) means that it will be rejected. These
levels of quality attributes (Ai) are used when calculating the
total quality of the product that is given in the Equation 2.
        </p>
        <p>
          General constraints of the attributes is 0 Ai 1:0 (i =
1; : : : ; n). Table III shows the adopted attributes, their related
metrics and level of intensity. In order to obtain the levels of
quality, we widely use the Pareto principle often referred to
as the 20-80 rule [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ]. In the literature, this rule is widely
used (e.g., [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]). For the energy efficiency, we adopted Intels
holistic approach for energy star ratings across the broader
range of products [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. The energy efficiency of a computer
with 100% workload has given as 82-85%. In order to use
the same scale, we normalized them into [
          <xref ref-type="bibr" rid="ref1">0-1</xref>
          ] interval. We
also used the power consumption measurements of a database
software obtained by Akinli Kocak et al. [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
        </p>
        <p>
          The importance weights of the quality attributes are also
fundamental to set the priority, both for the customer and the
company. Prioritizing is a process of managing the relative
importance and determination of different requirements within
the limited resources. Quality attributes weights and
environmental attributes weights of software product can be obtained
from evaluation of the criteria using multi-criteria decision
making methodologies. In one of our works [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], we have
used a well-known multi- criteria decision-making approach:
Analytical Network Process (ANP) [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ] to calculated the
relative weights (wi) of the quality attributes.
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>V. CONCLUSION AND FUTURE WORK</title>
      <p>Many disciplines have been facing challenges in how to
sustain economic, social and ecological systems. The design of
environmentally sustainable software product is a challenging
task, when it is compared to develop traditional software
product, since an environmentally sustainable software has
different quality attributes (especially in terms of quality
requirements). In this work, we introduce a software
classification scheme using standard software quality requirements
and introducing environmental attributes. Accordingly, we
propose a way of determining demand in terms of price and
quality, and utility of a software development company. We
derive customer‘s and development company‘s payoffs. As
a continuation of this work, the proposed simple demand
functions need to be elaborated by quantifying the sensitivity
coefficients. These demand functions may be integrated into
the given green software scheme to build a green decision
support tool. Our contribution will serve as a normative guide
to software development companies for the design of green
product with handling environmental sustainability as a quality
objective. As next step, we plan to examine the theoretical
introductory model with simulation and find the equilibrium
to meet the both development company and customer needs
within the necessary quality attributes.</p>
    </sec>
    <sec id="sec-6">
      <title>ACKNOWLEDGMENT This research has been financially supported by the Galatasaray University Research Fund, project number: 19.401.005.</title>
      <p>The level of energy performance of the software and the amount of energy resources used, under stated conditions.
E6: Resource Efficiency</p>
      <p>How efficiently the resources used by the product when performing its functions and/or serving useful workload.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Oxford</given-names>
            <surname>English Dictionary Online</surname>
          </string-name>
          ,
          <article-title>2nd edition</article-title>
          . http://www.oed.com/,
          <year>July 2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M. Al</given-names>
            <surname>Hinai</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Chitchyan</surname>
          </string-name>
          .
          <article-title>Engineering requirements for social sustainability</article-title>
          .
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>P.</given-names>
            <surname>Avgeriou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Stal</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Hilliard</surname>
          </string-name>
          . Architecture sustainability [guest editors' introduction].
          <source>IEEE Software</source>
          ,
          <volume>30</volume>
          (
          <issue>6</issue>
          ):
          <fpage>40</fpage>
          -
          <lpage>44</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>C.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Betz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chitchyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Duboc</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S</given-names>
            <surname>Easterbrook</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Seyff</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C. C.</given-names>
            <surname>Venters</surname>
          </string-name>
          . Requirements:
          <article-title>The key to sustainability</article-title>
          .
          <source>IEEE Software</source>
          ,
          <volume>33</volume>
          (
          <issue>1</issue>
          ):
          <fpage>56</fpage>
          -
          <lpage>65</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>C.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chitchyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Duboc</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S</given-names>
            <surname>Easterbrook</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mahaux</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. R.</given-names>
            <surname>Navas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Salinesi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Seyff</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. C.</given-names>
            <surname>Venters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Calero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Koc</surname>
          </string-name>
          <article-title>¸ak, and</article-title>
          <string-name>
            <given-names>S.</given-names>
            <surname>Betz</surname>
          </string-name>
          .
          <article-title>The Karlskrona manifesto for sustainability design</article-title>
          .
          <source>CoRR</source>
          , abs/1410.6968,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>R. B.</given-names>
            <surname>Myerson</surname>
          </string-name>
          .
          <source>Game Theory: Analysis of Conflict</source>
          . Harward University Press,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Cai</surname>
          </string-name>
          , Lu. Xiao,
          <string-name>
            <given-names>R.</given-names>
            <surname>Kazman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Mo</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Q.</given-names>
            <surname>Feng</surname>
          </string-name>
          .
          <article-title>Design rule spaces: A new model for representing and analyzing software architecture</article-title>
          .
          <source>IEEE Transactions on Software Engineering</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>C.</given-names>
            <surname>Calero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. F.</given-names>
            <surname>Bertoa</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Moraga</surname>
          </string-name>
          .
          <article-title>Sustainability and quality: Icing on the cake</article-title>
          .
          <source>In Second Int. Workshop on RE for Sustainable Systems (RE4SuSy)</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>N.</given-names>
            <surname>Condori-Fernandez</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          .
          <article-title>Characterizing the contribution of quality requirements to software sustainability</article-title>
          .
          <source>Journal of Systems and Software</source>
          ,
          <volume>137</volume>
          :
          <fpage>289</fpage>
          -
          <lpage>305</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>N. Condori</given-names>
            <surname>Fernandez</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          .
          <article-title>A Sustainability-quality Model</article-title>
          .
          <source>VU Technical Report, 11 2018. Version 1</source>
          .0.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>L.</given-names>
            <surname>Fang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K. W.</given-names>
            <surname>Hipel</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D. M.</given-names>
            <surname>Kilgour</surname>
          </string-name>
          .
          <article-title>Interactive decision making: the graph model for conflict resolution</article-title>
          , volume
          <volume>11</volume>
          . John Wiley &amp; Sons,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Fauge`re and</article-title>
          <string-name>
            <given-names>G. K.</given-names>
            <surname>Tayi</surname>
          </string-name>
          .
          <article-title>Designing free software samples: a game theoretic approach</article-title>
          .
          <source>Information Technology and Management</source>
          ,
          <volume>8</volume>
          (
          <issue>4</issue>
          ):
          <fpage>263</fpage>
          -
          <lpage>278</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>N. E.</given-names>
            <surname>Fenton</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.</given-names>
            <surname>Ohlsson</surname>
          </string-name>
          .
          <article-title>Quantitative analysis of faults and failures in a complex software system</article-title>
          .
          <source>IEEE Transactions on Software engineering</source>
          ,
          <volume>26</volume>
          (
          <issue>8</issue>
          ):
          <fpage>797</fpage>
          -
          <lpage>814</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>L.</given-names>
            <surname>Hilty</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Aebischer</surname>
          </string-name>
          .
          <article-title>Ict for sustainability: An emerging research field</article-title>
          .
          <source>In ICT Innovations for Sustainability</source>
          , pages
          <fpage>3</fpage>
          -
          <lpage>36</lpage>
          . Springer,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>Hindle</surname>
          </string-name>
          .
          <article-title>Green mining: a methodology of relating software change and configuration to power consumption</article-title>
          .
          <source>Empirical Software Engineering</source>
          ,
          <volume>20</volume>
          (
          <issue>2</issue>
          ):
          <fpage>374</fpage>
          -
          <lpage>409</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16] ISO/IEC25010:2011.
          <article-title>Systems and software engineering - systems and software quality requirements and evaluation (square) - system and software quality models</article-title>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>E.</given-names>
            <surname>Kern</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Naumann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Guldner</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Johann</surname>
          </string-name>
          .
          <article-title>Green software and green software engineering-definitions, measurements, and quality aspects</article-title>
          .
          <source>Hilty</source>
          et al.(
          <year>2013</year>
          ), pages
          <fpage>87</fpage>
          -
          <lpage>94</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Koc</surname>
          </string-name>
          <article-title>¸ak, G. I. Alptekin, and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Bas</surname>
          </string-name>
          <article-title>¸ar Bener Bas¸ar. Evaluation of software product quality attributes and environmental attributes using anp decision framework</article-title>
          .
          <source>In Proceedings of the Third International Workshop on Requirement Engineering for Sustainable Systems</source>
          (pp. pp.
          <fpage>37</fpage>
          -
          <lpage>44</lpage>
          ).
          <source>Karlskrona: Central Europe Workshop Proceedings</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Koc</surname>
          </string-name>
          <article-title>¸ak, G. I. Alptekin, and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Bas</surname>
          </string-name>
          <article-title>¸ar Bener Bas¸ar. Integrating environmental sustainability in software product quality</article-title>
          .
          <source>In RE4SuSy@ RE</source>
          , pages
          <fpage>17</fpage>
          -
          <lpage>24</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>S. A</surname>
          </string-name>
          . Koc¸ak,
          <string-name>
            <given-names>G. I.</given-names>
            <surname>Alptekin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Miranskyy</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          <article-title>Bas¸ar Bener Bas¸ar, and</article-title>
          <string-name>
            <surname>E. Cialini.</surname>
          </string-name>
          <article-title>An empirical evaluation of database software features on energy consumption</article-title>
          .
          <source>In ICT4S</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>R.</given-names>
            <surname>Kolappan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Wong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Duggiralam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kaplan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Haines</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Bolioli</surname>
          </string-name>
          .
          <source>Energy star version 5</source>
          .
          <article-title>0 system implementation</article-title>
          ,
          <source>technical report</source>
          , intel, (
          <year>2009</year>
          ). http://www.energystar.gov/ia/partners/product specs/ program reqs/Computers Intel Whitepaper Spec5.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          .
          <article-title>A software sustainability assessment method</article-title>
          .
          <source>Technical report, Technical Report</source>
          , figshare,
          <year>2014</year>
          . http: //goo.gl/HuY6tf,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          .
          <article-title>Architecture design decision maps for software sustainability</article-title>
          .
          <source>In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Society</source>
          , pages
          <fpage>61</fpage>
          -
          <lpage>64</lpage>
          . IEEE Press,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Koc</surname>
          </string-name>
          <article-title>¸ak, I. Crnkovic, and</article-title>
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          .
          <article-title>Framing sustainability as a property of software quality</article-title>
          .
          <source>Commun. ACM</source>
          ,
          <volume>58</volume>
          (
          <issue>10</issue>
          ):
          <fpage>70</fpage>
          -
          <lpage>78</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          .
          <article-title>Reality check for software engineering for sustainabilitypragmatism required</article-title>
          .
          <source>Journal of Software: Evolution and process</source>
          ,
          <volume>29</volume>
          (
          <issue>2</issue>
          ):e1856,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>R.</given-names>
            <surname>Likert</surname>
          </string-name>
          .
          <article-title>A method of constructing an attitude scale. Scaling: A sourcebook for behavioural scientists</article-title>
          , pages
          <fpage>233</fpage>
          -
          <lpage>243</lpage>
          ,
          <year>1974</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>F. A.</given-names>
            <surname>Moghaddam</surname>
          </string-name>
          , G. Procaccianti,
          <string-name>
            <given-names>G. A.</given-names>
            <surname>Lewis</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          .
          <article-title>Empirical validation of cyber-foraging architectural tactics for surrogate provisioning</article-title>
          .
          <source>Journal of Systems and Software</source>
          ,
          <volume>138</volume>
          :
          <fpage>37</fpage>
          -
          <lpage>51</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>M. J. Osborne</surname>
          </string-name>
          et al.
          <article-title>An introduction to game theory</article-title>
          . Oxford university press New York,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          et al. Safety, Security, Now Sustainability:
          <article-title>The Nonfunctional Requirement for the 21st Century</article-title>
          .
          <source>IEEE Software</source>
          ,
          <volume>31</volume>
          (
          <issue>3</issue>
          ):
          <fpage>40</fpage>
          -
          <lpage>47</lpage>
          , May
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>E. R.</given-names>
            <surname>Poort</surname>
          </string-name>
          and H. van Vliet.
          <article-title>Architecting as a risk-and cost management discipline</article-title>
          .
          <source>In 2011 Ninth Working IEEE/IFIP Conference on Software Architecture</source>
          , pages
          <fpage>2</fpage>
          -
          <lpage>11</lpage>
          . IEEE,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>G.</given-names>
            <surname>Procaccianti</surname>
          </string-name>
          , H. Ferna´ndez, and
          <string-name>
            <given-names>P.</given-names>
            <surname>Lago</surname>
          </string-name>
          .
          <article-title>Empirical evaluation of two best practices for energy-efficient software development</article-title>
          .
          <source>Journal of Systems and Software</source>
          ,
          <volume>117</volume>
          :
          <fpage>185</fpage>
          -
          <lpage>198</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>T. L.</given-names>
            <surname>Saaty</surname>
          </string-name>
          .
          <article-title>Decision making with dependence and feedback: The analytic network process</article-title>
          , volume
          <volume>4922</volume>
          .
          <source>RWS publications Pittsburgh</source>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>G. G.</given-names>
            <surname>Schulmeyer</surname>
          </string-name>
          and
          <string-name>
            <surname>J. I. McManus.</surname>
          </string-name>
          <article-title>Handbook of software quality assurance</article-title>
          . Van Nostrand Reinhold Co.,
          <year>1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>C. C.</given-names>
            <surname>Venters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Capilla</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Betz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Crick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Crouch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. Y.</given-names>
            <surname>Nakagawa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Becker</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Carrillo</surname>
          </string-name>
          .
          <article-title>Software sustainability: Research and practice from a software architecture viewpoint</article-title>
          .
          <source>Journal of Systems and Software</source>
          ,
          <volume>138</volume>
          :
          <fpage>174</fpage>
          -
          <lpage>188</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35]
          <string-name>
            <given-names>C. C.</given-names>
            <surname>Venters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Lau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Griffithsa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Holmes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Ward</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Jay</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Dibsdale</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Xu</surname>
          </string-name>
          .
          <article-title>The Blind Men and the Elephant: Towards an Empirical Evaluation Framework for Software Sustainability</article-title>
          .
          <source>Journal of Open Research Software</source>
          ,
          <volume>2</volume>
          (
          <issue>1</issue>
          ),
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>C. C.</given-names>
            <surname>Venters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Seyff</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Betz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chitchyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Duboc</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>McIntyre</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          .
          <article-title>Characterising sustainability requirements: A new species red herring or just an odd fish</article-title>
          ? In
          <source>2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering in Society Track (ICSE-SEIS)</source>
          , pages
          <fpage>3</fpage>
          -
          <lpage>12</lpage>
          . IEEE,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>J.</given-names>
            <surname>Wallenius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. S.</given-names>
            <surname>Dyer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. C.</given-names>
            <surname>Fishburn</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. E.</given-names>
            <surname>Steuer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Zionts</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Deb</surname>
          </string-name>
          .
          <article-title>Multiple criteria decision making, multiattribute utility theory: Recent accomplishments and what lies ahead</article-title>
          .
          <source>Management science</source>
          ,
          <volume>54</volume>
          (
          <issue>7</issue>
          ):
          <fpage>1336</fpage>
          -
          <lpage>1349</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>