<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Position Paper: The Social Dimension of Sustainability in Requirements Engineering</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Timo Johann</string-name>
          <email>johann@informatik.uni-hamburg.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Informatics, MOBIS University of Hamburg Hamburg</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Figure 1: Wordle of the last RE4SuSy Workshop</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>- Nowadays mobile phones and smartphones are common not only in mega cities in developed countries but also in rural areas in emerging and developing countries. Technological progress will enable more and more people from different socio-cultural backgrounds and with different needs to use software services with up-to-date technical devices. End users are increasingly expecting to use software services in their “own way”. They expect to customize the functionality, contribute to the content, and share information with others. The requirements of users differ drastically depending on the socio-cultural context. This is why we must raise the following questions: What is the impact of a society or an economy on software and vice versa? Do we need new approaches in requirements engineering to deal with the social dimension of sustainability? In this paper we aim to bringing forth a discussion about social sustainable software.</p>
      </abstract>
      <kwd-group>
        <kwd>-component</kwd>
        <kwd>sustainability</kwd>
        <kwd>requirements engineering</kwd>
        <kwd>social sustainable software</kwd>
        <kwd>sustainable informatics</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>THE LACK OF SOCIAL ASPECTS IN REQUIREMENTS</title>
      <p>ENGINEERING</p>
      <p>
        Definitions of sustainability are mainly based on three
pillars, the economical, ecological, and social: the so-called
triple bottom line [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Software systems have an influence on
each one of the three pillars [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]:
 They changed economical processes and play a central
role in our globalized economical system.
 It has been shown that they can have positive or
negative impacts on the environment.
 The way we communicate and socialize today is based
on software systems.
      </p>
      <p>We claim that Sustainable Informatics research must take
into account all aspects of sustainability, in particular the
social aspect, which has been neglected so far.</p>
      <p>
        Looking at recent publications in the field of Social
Informatics, we found that social aspects are only mentioned
in passing, while the clear focus has been placed on
environmental aspects. The Sustainable Informatics
community is developing processes, models, methods, and
tools, mainly to minimize resource and energy consumption.
Figure 1 depicts the most frequent terms of the proceedings
of the last RE4SuSy workshop in order of their occurrence
[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The ‘biggest’, i.e., most frequently used term is
“energy”. Terms such as "social”, “user”, “community”, and
“human factors” do not occur at all.
We think that the inclusion of users and their
communities in the engineering processes has a high
potential to support sustainable software engineering [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
The aim of this paper is to initiate a discussion about social
sustainability in requirements engineering towards providing
a foundation for holistic sustainable software systems.
      </p>
      <p>
        Requirements engineering for sustainable systems must
take into account all sustainability aspects, although these
might seem contradicting. When searching for social or
sustainable software we will find opposing views, ideas, and
definitions. Sustainable software is often understood as
software that is easy to maintain or reuse, without any
reference to ecological or social aspects, e.g. in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <sec id="sec-1-1">
        <title>Tomlinson et al. define “Sustainable software engineering</title>
        <p>
          aims to create reliable, long-lasting software that meets the
needs of users while reducing environmental impacts” [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. In
our opinion, this definition of sustainable software is
incomplete and can be misleading. Naumann et al. [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] gave a
definition that covers all aspects of sustainability in software.
        </p>
      </sec>
      <sec id="sec-1-2">
        <title>They define Sustainable Software as software “whose direct</title>
        <p>and indirect negative impacts on economy, society, human
beings, and environment that result from development,
deployment, and usage of the software are minimal and/or
which has a positive effect on sustainable development.”
This definition distinguishes between two types of
sustainable software:
1. Software with positive impact on sustainable</p>
        <p>development.
2. Software that minimizes its own negative impact on</p>
        <p>sustainable development.</p>
        <p>Taken from http://www4.in.tum.de/~penzenst/re4susy/2013/
Copyright © 2013 for the individual papers by the papers' authors. Copying permitted only for private and academic purposes.
This volume is published and copyrighted by its editors.</p>
        <p>The second type of sustainable software should receive
particular attention in requirements engineering, since we
believe it applies to every software system. Sustainability
should become a relevant concern for requirement
engineering as a basic non-functional requirement.</p>
        <p>Naumann et al. definition also shows that optimizing the
impact of software is not enough. Impacts of development
and deployment must also be associated with the software
sustainability. Consequently the focus of future research in
the field of social sustainable software should cover the users
as well as the developers, their communities, and the
interactions between them.</p>
        <p>II.</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>EXAMPLES OF SOCIAL IMPACTS OF SOFTWARE</title>
      <p>Social aspects of software involve many fields of interest
that are directly or indirectly linked to social sustainability.
In this section, we discuss a few examples of social
sustainability in software. These examples can be used to
discuss the characteristics for developing a uniform quality
model for social sustainable software.</p>
      <sec id="sec-2-1">
        <title>A. Data Access and Transparency</title>
        <p>Freedom of information is a fundamental human right. 65
countries around the world have passed freedom of
information laws and anchored them in their constitutions.</p>
        <p>This positive development will facilitate participation in
democratic processes. For example, in the field of
EGovernment, access to governmental data is often provided
via software systems. Currently there are two basic problems
in this field. First, the means to access these data are
heterogeneous and often embedded in complex processes.
Second, the access to data is unequal to access to
information.</p>
        <p>
          The Infrastructure for Spatial Information in the
European Community (INSPIRE) provides a good
illustration to these problems. INSPIRE is “an EU initiative
to establish an infrastructure for spatial information in
Europe that will help to make spatial or geographical
information more accessible and interoperable for a wide
range of purposes supporting sustainable development” [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
        <p>
          A portal has being developed to grant access to the data
[
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. The data contain, e.g., measures of water quality, air
pollution, demographics, and historical water levels. These
are stored in various formats such as PDF, CSV, or XML.
Only few Europeans know about this project. Users with no
expertise in IT or geographical information systems will
encounter difficulties in finding specific information among
this huge amount of data. A simple question like “Can I go
swimming in the lake close to my hometown?” cannot be
answered easily. This becomes even worse for questions
like: “Where is the next source of clean drinking water?”
Applying a system like this in rural areas in developing
countries, where people rarely own computers, the
requirements change drastically. When users only have
mobile phones, they expect direct, location-based
information about the surroundings. An excel file with
complete historical data about the water quality of a river
will not help much. In the current version of the system,
users cannot easily add data and make it immediately
accessible to others. However, this will be an important
feature during natural disasters, when conditions drastically
change within a short period of time.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>B. Reliability and Resilience</title>
        <p>
          Another question about the characteristics of social
sustainable software is: How do software systems react to
collapsing infrastructures? Tomlinson et al. showed that
“understanding how to design ICT and sociotechnical
systems […] enable social wellbeing in times of collapse
could benefit many” [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. They proposed the research field
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>Collapse Informatics.</title>
        <p>
          A collapse can occur globally or locally. A collapse is a
“rapid, significant loss of sociopolitical complexity which in
itself constitutes an event whose impacts exceed the
responsive capacities of [those] affected” [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. A collapse
can be triggered among others by natural disasters.
        </p>
        <p>
          Important software systems should be designed in a way
that they are still available even in an unreliable
infrastructure. Natural disasters create a great need for
communication. Companies like Inveneo 2 specialize in
quickly building broadband infrastructures, which were used
e.g. after the earthquake in Haiti in 2010. With this
infrastructure emergency and rescue forces, victims, family
members, and friends were able to quickly connect to each
other, share, and access important information, through the
participation of a huge, globally connected community.
Participants quickly organized themselves to support
emergency teams on-site. People from all over the world
contributed to the Crisis Mapping [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. They traced roads
and damaged buildings and entered camps of displaced
people into OpenStreetMap. They gathered data from
manifold sources and combined them with the help of
OpenStreetMaps. This case shows that we “should also
consider the design context to be a world radically altered by
environmental damage. Solutions that fit into today’s
lifestyles risk irrelevance” [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. This case also provides
evidence that requirements not only change depending on the
socio-cultural context, but also that the socio-cultural context
itself can change. Requirements engineering needs to be
adjusted to these possible changes.
        </p>
      </sec>
      <sec id="sec-2-4">
        <title>C. Civic Participation and Software Socialness</title>
        <p>Civic participation is another aspect of involving social
groups, where the influence of software is continuously
growing. In recent years social media, like Facebook or
Twitter have been used by the youth of different countries to
form a protest in order to change the political system.
Software can play an important role for enabling democratic
processes.</p>
        <p>
          Facebook, Twitter, Wikis, or Blogs are utilized for civic
participation in political decision processes. Other software
systems such LiquidFeedback [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] explicitly focus on
political opinion formation. Every user can make a proper
proposal, which can be supported, discussed and extended by
others. This process provides a way to create a democratic
image that is not distorted by hierarchies, discrepancy in
knowledge or other constraints. The German Pirate Party,
with elected members in several German regional
parliaments, successfully uses this software. Other parties are
currently running trials.
        </p>
        <p>
          Also companies have an immense interest in user
feedback to improve or even invent products and services.
The SYNAXON AG is, e.g., a large company that uses
LiquidFeedback for internal decision making and customer
involvement. Vice versa, users have an interest in
communicating their opinions. In requirements engineering
we must take up this trend and find ways to build adequate
systematic feedback methods [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. This will help to gather
requirements of a heterogeneous group of users and to meet
the needs of people that will otherwise be out of scope.
An other essential approach that will support sustainable
software is its socialness. Maalej and Pagano define the
socialness of software systems “as the degree of involvement
of its users and their communities in the software lifecycle”
[
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. The involvement of users in the software life cycle can
be an important step towards social sustainable software.
This can be archived by Social Software Engineering. Social
software engineering is “the application of processes,
methods, and tools to enable community-driven creation,
management, deployment, and use of software in online
environments” [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. Sustainable informatics can benefit from
the ongoing research in the fields of social software
engineering. A recently presented social software
engineering process called SNAIL is an example for a
mature solution in this field. SNAIL “thoroughly and
continuously involves users by establishing interaction
channels and integrating user communities” [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. The
challenge is to find ways to involve users from different
backgrounds. Further analyses of the heterogeneous ways
users are able and willing to communicate their requirements
and feedback is necessary. Furthermore we have to study
approaches to conflate the feedback and make it accessible in
a standardized way.
        </p>
      </sec>
      <sec id="sec-2-5">
        <title>D. Accessibility</title>
        <p>
          Accessibility, especially for handicapped users is an
important concern. Many countries have laws that guarantee
direct accessibility for everybody. In software engineering
there are no uniform rules for whether and how accessibility
is implemented. The majority of modern operating systems
are equipped with integrated accessibility options like screen
readers, display zooms or specialized color settings. The
W3C encourages web developers to build barrier-free
websites and gives out the Web Content Accessibility
Guidelines [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. These are limited to the physical conditions
of individuals. It is however important to bear in mind that
accessibility requirements differ depending on the social
environment, and the social environments are responsible for
access conditions.
        </p>
        <p>
          One major problem is the digital gap between developed
countries and emerging and developing countries. In some
rural areas, people have very limited access to
communication services. Internet is often slow or not
available at all. Devices are usually old. An example for the
inclusion of specific requirements is Esoko, a software that
provides market information, mainly from commodities
markets. Although this example does not sound innovative at
first, it shows how information has been made accessible in
specific social environments. Users can sign up via SMS or
E-Mail to receive prices of the world markets by SMS. This
simple ‘innovation’ granted thousands of farmers in rural
areas in Africa access to important information. This made
farmers no longer dependent on resellers. They can make
better decisions about selling their goods for the offered
prices. A survey conducted by the French National Institute
for Agricultural Research (INRA) found that maize,
groundnut, and cassava farmers, recorded a 10% increase in
revenues after receiving and utilizing the Esoko [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ].
        </p>
      </sec>
      <sec id="sec-2-6">
        <title>E. Privacy, Safety and Security</title>
        <p>
          Privacy is a major concern in the information age. It is
part of a worldwide public discussion. Opinions diverge
widely and the topic has become crucial for governments,
companies, lawyers, and software engineers. Especially
when it comes to surveillance by authorities, the issue
becomes highly problematic. In many countries police and
intelligence use surveillance and monitoring software for
crime protection. Most countries adopted strict laws for the
use of said software. For example, in Europe a court order is
required prior to the utilization of monitoring software.
Private companies with commissions of governments
develop monitoring software. In the past, this software has
also fallen into the hands of repressive regimes. An example
is the surveillance software FinFisher. The tool was
developed and marketed by a German and British subsidiary
of the Gamma Group. During the Egyptian Revolution of
2011, dissidents discovered a contract with Gamma
International for €287,000 for a license to run FinFisher [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
Last year, FinFisher was found on the computer of human
rights activists in Bahrain. Citizen Lab, based at the
University of Toronto, confirmed that the Trojan was
installed on the laptops of several journalists and activists.
Gamma Group denies that they sold the software to these
regimes. In February 2013 a consortium of different NGO
(Privacy International, European Centre for Constitutional
and Human Rights, the Bahrain Center for Human Rights,
Bahrain Watch, and Reporters without Borders) officially
filed a complaint with the OECD [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. Even if this example
primarily seems to be a political issue, it also demonstrates
the importance of the socio-cultural context, when it comes
to requirements of software systems.
        </p>
        <p>III.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>RESEARCH AGENDA</title>
      <p>There is a need to discuss whether requirements
engineering for sustainable systems is different from
traditional requirements engineering. For this discussion we
should first identify the fundamental characteristics of social
sustainable software.</p>
      <p>Requirements engineers and analysts are still missing the
overall scope of social sustainable software. Social aspects
are already scattered across many fields of interest that are
directly or indirectly linked to social sustainability. We think
that there is a lack of the social aspect of sustainability in the
current research on Sustainable Informatics and propose a
further discussion of the topic.</p>
      <p>First the community should define the characteristics that
support the development of a uniform quality model for
social sustainable software.</p>
      <p>This requires extracting different examples of software
that affect social sustainability. Based on these examples we
can derive basic characteristics of social sustainable
software. By now functional as well as quality requirements
often lack awareness of the socio-cultural context. We need
to include the socio-cultural context. This might play an
important role for the requirements engineering of
sustainable systems.</p>
      <p>
        Software systems are usually developed in the “western
world”. Software engineers are running the risk of being
unaware of the manifold conditions under which their
software is used. We think further studies are needed to
identify ways how users can participate in requirements
and software engineering processes Therefore we must
apply modern approaches that involve users and their
communities, e.g., as suggested in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>Furthermore, field studies in ongoing and future software
projects in unconventional domains represent a way to reveal
insights and help us to learn more about requirements in
different socio-cultural contexts. The knowledge about
possible conditions will also help us in developing a quality
model for social sustainable software.</p>
      <p>In order to collect more information about sustainability
in software systems we propose the development of a
database. The purpose of this database is to create an
overview of software with positive or negative, direct or
indirect impacts on society as well as the context in which
these impacts occur. Interested parties can access the data
and add entries to the database. We believe that the collected
data will help us to refine requirements for sustainable
systems over time. As a result we hope to get enhanced
insights into the social aspects of software.</p>
      <p>A long term future goal is to develop recommender
systems for software engineers and analysts. These systems
will foster the awareness of possible impacts of software and
thereby support the development of more sustainable
software.</p>
      <p>IV.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <source>[1] UN, "Report of the World Commission on Environment and Development</source>
          .
          <article-title>Our common future</article-title>
          .
          <source>UN document no. A/42/427,"</source>
          New York,
          <year>1987</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>L.</given-names>
            <surname>Hilty</surname>
          </string-name>
          ,
          <article-title>"Information technology and sustainability. Essays on the relationship between ICT and sustainable development</article-title>
          .,
          <source>" Books on Demand, Norderstedt</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>S.</given-names>
            <surname>Naumann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Kern</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.</given-names>
            <surname>Johann</surname>
          </string-name>
          ,
          <article-title>The GREENSOFT Model: A Reference Model for Green and Sustainable Software</article-title>
          and its Engineering,
          <source>Sustainable Computing: Informatics and Systems</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>B.</given-names>
            <surname>Tomlinson</surname>
          </string-name>
          ,
          <article-title>Greening through IT: Information Technology for Environmental Sustainability</article-title>
          , MIT Press,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <source>[5] "Proceedings of the First International Workshop on Requirements Engineering for Sustainable Systems," in Requirements Engineering: Foundation for Software Quality, Essen</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>W.</given-names>
            <surname>Maalej</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Pagano</surname>
          </string-name>
          ,
          <article-title>On the Socialness of Software, 21st</article-title>
          . IEEE International Requirements Engineering Conference ed., IEEE.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>W.</given-names>
            <surname>Maalej</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Pagano</surname>
          </string-name>
          ,
          <article-title>"User feedback in the AppStore: An Empirical Study</article-title>
          .,
          <article-title>" in 21st</article-title>
          . IEEE International Requirements Engineering Conference,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>K.</given-names>
            <surname>Tate</surname>
          </string-name>
          , Sustainable Software Development,
          <string-name>
            <surname>Addison-Wesley</surname>
          </string-name>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>N.</given-names>
            <surname>Amsel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Ibrahim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Malik</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Tomlinson</surname>
          </string-name>
          ,
          <article-title>"Toward sustainable software engineering,"</article-title>
          <source>in 33rd International Conference on Software Engineering (ICSE)</source>
          ,
          <year>Honolulu</year>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>K.</given-names>
            <surname>Benoit</surname>
          </string-name>
          ,
          <article-title>Infrastructure for Spatial Information in the European Community</article-title>
          , Cede Publishing,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <article-title>"Inspire Geoportal,"</article-title>
          <source>European Commission</source>
          , [Online]. Available: http://inspire-geoportal.ec.europa.eu/.
          <source>[Accessed 25 April</source>
          <year>2013</year>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>B.</given-names>
            <surname>Tomlinson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. M.</given-names>
            <surname>Silberman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Petterson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Pan</surname>
          </string-name>
          and
          <string-name>
            <given-names>E.</given-names>
            <surname>Blevis</surname>
          </string-name>
          ,
          <article-title>"Collapse informatics: augmenting the sustainability &amp; ICT4D discourse in HCI,"</article-title>
          <source>in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems</source>
          , New York,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>a</article-title>
          . T. B.
          <string-name>
            <surname>Silberman</surname>
          </string-name>
          ,
          <article-title>"Precarious infrastructure and postapocalyptic computing.," in Examining Appropriation, Re-use, and Maintenance for Sustainability</article-title>
          ,
          <source>workshop at CHI</source>
          <year>2010</year>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>P.</given-names>
            <surname>Meier</surname>
          </string-name>
          ,
          <article-title>"nationalgeographic.com,"</article-title>
          <source>National Geographic</source>
          ,
          <year>2012</year>
          . [Online]. Available: http://newswatch.nationalgeographic.com/
          <year>2012</year>
          /07/02/crisismapping-haiti/.
          <source>[Accessed 24</source>
          <volume>4</volume>
          <fpage>2013</fpage>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>J.</given-names>
            <surname>Wong</surname>
          </string-name>
          ,
          <article-title>"Prepare for Descent: Interaction Design in our New Future.," in Defining the Role of HCI in the Challenges of Sustainability</article-title>
          , workshop at CHI ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <article-title>"liquidfeedback.org," Verein zur Förderung des Einsatzes elektronischer Medien für demokratische Prozesse</article-title>
          , [Online]. Available: http://liquidfeedback.org/.
          <source>[Accessed 20 April</source>
          <year>2013</year>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>I.</given-names>
            <surname>Hammouda</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bosch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Jazayeri</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.</given-names>
            <surname>Mikkonen</surname>
          </string-name>
          ,
          <article-title>"</article-title>
          <source>1st International Workshop on Social Software Engineering and Applications," in Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <fpage>W3C</fpage>
          ,
          <article-title>"Web Content Accessibility Guidelines (WCAG) 2.0,"</article-title>
          <source>W3C</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <article-title>"</article-title>
          http://www.esoko.com/,
          <source>" INRA</source>
          ,
          <fpage>15</fpage>
          <lpage>12</lpage>
          2011. [Online]. Available: http://www.esoko.com/about/news/pressreleases/2011_15_12_Esoko _INRA.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <article-title>"f-secure,"</article-title>
          <string-name>
            <surname>F-Secure</surname>
            <given-names>Lab</given-names>
          </string-name>
          , [Online]. Available: http://www.fsecure.com/weblog/archives/00002114.html.
          <source>[Accessed 25 April</source>
          <year>2013</year>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <article-title>"privacyinternational</article-title>
          .org," Privacy International, [Online]. Available: https://www.privacyinternational.org/blog/our-oecd
          <article-title>-complaintagainst-gamma-international-and-trovicor</article-title>
          .
          <source>[Accessed 22 April</source>
          <year>2013</year>
          ].
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>