<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Improving ICT4D projects with Agile software development</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Joost Dijkers</string-name>
          <email>J.J.G.Dijkers@students.uu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sietse Overbeek</string-name>
          <email>S.J.Overbeek@uu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sergio España</string-name>
          <email>S.Espana@uu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Utrecht University, Faculty of Science, Department of, Information and Computing Sciences</institution>
          ,
          <addr-line>Utrecht</addr-line>
          ,
          <country country="NL">the Netherlands</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <abstract>
        <p>ICT4D seeks to bridge the digital divide in developing countries. Important requirements of ICT4D projects are a demand-driven approach and participation of the local community. The fact that user collaboration is a principle of Agile software development (Agile), triggers our interest on whether Agile practices can improve ICT4D projects. This paper aims to investigate if and how Agile can contribute to the success of ICT4D projects. In order to achieve this, existing literature was consulted and an interview was held. This paper provides an overview of the critical success factors for ICT4D projects and Agile, as well as of the advantages of Agile. Agile can only work successfully when ICT4D projects are demand-driven, and when both a cultural understanding and trust are built. Notable ways in which Agile can improve ICT4D projects are by facilitating user collaboration, improving team communication, enhancing organizational learning, and by frequently delivering software.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>INTRODUCTION</title>
      <p>
        The use of ICT in developing countries is the focus of an academic
ifeld called information and communication technology for
development, or ICT4D for short [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. ICT4D is aimed at how the benefits
of ICT can be evenly divided between society to bridge the gap
between the rich and poor. For example, ICT can improve creating,
sharing, and enhancing knowledge, make production and
transactions more eficient and cost-efective, and stimulate networking
amongst parties (e.g. firms) [
        <xref ref-type="bibr" rid="ref13 ref2">2</xref>
        ]. However, high rates of failure exist
for ICT4D projects [
        <xref ref-type="bibr" rid="ref3 ref4 ref54">3, 4</xref>
        ].
      </p>
      <p>Permission to make digital or hard copies of all or part of this work for personal or
classroom use is granted without fee provided that copies are not made or distributed
for profit or commercial advantage and that copies bear this notice and the full citation
on the first page. Copyrights for components of this work owned by others than ACM
must be honored. Abstracting with credit is permitted. To copy otherwise, or republish,
to post on servers or to redistribute to lists, requires prior specific permission and/or a
fee. Request permissions from permissions@acm.org.</p>
      <p>Conference’17, July 2017, Washington, DC, USA
© 2018 Association for Computing Machinery.</p>
      <p>ACM ISBN 978-x-xxxx-xxxx-x/YY/MM. . . $15.00
https://doi.org/10.1145/nnnnnnn.nnnnnnn</p>
      <p>
        Agile Software Development (henceforth referred to as Agile)
is a methodology for developing software and was found to
increase the success rate of ICT projects [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Agile is collaborative,
incremental, and iterative [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Collaborative development means
that work is performed in teams rather than individually. For Agile,
this also means that users should be included in the work process.
Incremental development is a development approach in which the
system is developed in a series of small steps. Iterative
development means that the development activities, such as requirements
engineering and software testing, are performed cyclically rather
than sequentially. Furthermore, Agile is adaptive, which means
that rapid change is supported [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Agile practices are summarized
by Highsmith [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] as follows: ‘short iterations, continuous testing,
selforganizing teams, constant collaboration (. . . ), and frequent
replanning based on current reality’.
      </p>
      <p>
        However, agile methods that have harvested success in western
countries cannot be directly applied in ICT4D projects [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. There
exist multiple reasons for this. For example, increased user
participation has proven to be essential in order to achieve ICT adoption [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
Additionally, inhabitants of poor communities in developing
countries often have no ICT or project management skills [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
Furthermore, cultural barriers can limit or even prevent the cooperation
of the local community [
        <xref ref-type="bibr" rid="ref11 ref12">11, 12</xref>
        ]. Research is thus necessary on to
what degree Agile methods are compatible with ICT4D projects. In
addition, research on the efects of using Agile methods in ICT4D
projects is limited, as it is mainly focused on benefits of user
collaboration. For example, using an Agile method was reported to allow
developers to change the system in a natural way in response to
unexpressed requirements and changes in business environment [
        <xref ref-type="bibr" rid="ref14">13</xref>
        ].
Furthermore, Agile methods make ICT more demand-driven and
improve the involvement of users [
        <xref ref-type="bibr" rid="ref15 ref16">14, 15</xref>
        ]. This increased user
participation of Agile methods also allows requirements to be elicited
and knowledge to be created [
        <xref ref-type="bibr" rid="ref15 ref17">14, 16</xref>
        ]. To address these two
problems, the following research question is formulated:
RQ: To what degree can Agile software development improve ICT4D
projects?
      </p>
      <p>The research question is answered by first performing a literature
study on the critical success factors for ICT4D projects, the critical
success factors for Agile methods, and the advantages of Agile
methods. Then, the results of the literate study are analyzed.</p>
      <p>The structure of this paper is as follows. In section 2 related
work on Agile methods for ICT4D projects is discussed to find out
why Agile is used in frameworks for ICT4D projects. In section
3 the method for arriving at an answer to the research question
is given. In section 4 the results from the literature study on the
critical success factors for ICT4D projects and Agile methods, and
on the advantages of Agile methods are presented. In section 5
these results are analyzed to determine how suitable Agile methods
are for ICT4D projects and in what ways they can improve ICT4D
projects. In section 6 the analysis is discussed and related to existing
literature. Finally, in section 7 an answer is given to the research
question and suggestions for future research are given.
2</p>
    </sec>
    <sec id="sec-2">
      <title>RELATED WORK</title>
      <p>
        Bon, Akkermans, and Gordijn developed an ICT4D framework that
is partially based on Agile [
        <xref ref-type="bibr" rid="ref19">18</xref>
        ]. Other inspirations of the framework
are: Living Labs, use case analysis, and requirements engineering.
The framework is specifically designed to address several ICT4D
concerns, such as a lack of understanding of the local needs and the
context. The discussed benefits of Agile are that it fosters creativity,
personal commitment, and collaboration with the user.
      </p>
      <p>
        Distributed Agile Methodology Addressing Technical Ictd in
Commercial Settings (DRAMATICS) is an Agile method for
commercial ICT4D projects [
        <xref ref-type="bibr" rid="ref20">19</xref>
        ]. The discussed benefit of Agile is the
collaboration with users.
      </p>
      <p>
        Speedplay is a framework for ICT4D projects which takes
inspiration from Agile, Action Research, and Participatory Design [
        <xref ref-type="bibr" rid="ref21">20</xref>
        ].
Some of the inspirations from Agile are iterative development,
flexibility, and collaborative development. The discussed benefit of Agile
is the user collaboration.
      </p>
      <p>
        The Nordic Model is a framework for ICT4D based on Nordic
socio-cultural background and shared values, and is described as
an Agile method [
        <xref ref-type="bibr" rid="ref22">21</xref>
        ]. The reasons for using an Agile method were
frequent and immediate feedback from the users and informal
communication to achieve equality and inclusion of all users.
      </p>
      <p>
        These frameworks difer in terms of other inspirations (e.g.
Participatory Design for Speedplay) or application (e.g. business ICT
projects for DRAMATICS). However, all these frameworks have
been tested in ICT4D projects with success. The success of Agile
or Agile inspired frameworks suggests that Agile methods can be
beneficial to ICT4D projects [
        <xref ref-type="bibr" rid="ref23">22</xref>
        ]. The primary reason for using
Agile methods for ICT4D seems to be improved collaboration with
the user.
3
3.1
      </p>
    </sec>
    <sec id="sec-3">
      <title>METHOD</title>
    </sec>
    <sec id="sec-4">
      <title>Research sub-questions</title>
      <p>
        This paper aims to answer the main research question: ‘To what
degree can Agile software development improve ICT4D projects?’.
It does so by answering the following research sub-questions (SQ):
SQ1: Can Agile methods successfully work in an ICT4D project?
An analysis is performed to determine if Agile can work
successfully in ICT4D projects. It is essential for Agile to work successfully
in order for the ICT4D project to succeed [
        <xref ref-type="bibr" rid="ref25">24</xref>
        ]. In order to analyze
this, critical success factors for ICT4D projects and Agile are
gathered. Critical success factors (CSF) are defined by Alias, Zawawi,
Yusof, and Aris [
        <xref ref-type="bibr" rid="ref24">23</xref>
        ] as: ‘Inputs to project management practice
which can lead directly or indirectly to project success’. As such,
CSFs give a good impression of where Agile methods might have
an important efect.
      </p>
      <p>SQ2: How can ICT4D projects benefit from an Agile approach?</p>
      <p>The benefits Agile methods can bring specifically to ICT4D
projects are discussed in order to understand how Agile can
improve ICT4D projects. Data regarding the advantages of using Agile
is gathered to answer this research sub-question.
3.2</p>
    </sec>
    <sec id="sec-5">
      <title>Data gathering</title>
      <p>These sub questions are answered by using existing literature.
Google Scholar was primarily used as search engine, as well as
IEEE Computer Society Digital Library and SpringerLink. Some
common search terms that were used are: ‘Agile software
development’, ‘Agile software development advantages’, ‘Agile software
development critical success factors’, ‘ICT4D’, ‘ICT4D critical
success factor’, and ‘ICT4D Agile’. The forward snowballing technique
was used as well.</p>
      <p>CSFs for ICT4D projects were in literature referred to with the
following terms: critical success factor, lesson learned, step (to
ensure sustainable development), and activity (that led to success).
For Agile, the following two terms were found and used to describe
CSFs: critical success factor, lesson learned. Advantages of using
Agile were sometimes also called benefits.
3.3</p>
    </sec>
    <sec id="sec-6">
      <title>Data analysis</title>
      <p>To answer the first research sub-question, the CSFs for Agile are
discussed in the context of ICT4D projects and by relating these
to the CSFs for ICT4D projects, resulting in a series of steps that
need to be taken in setting up an ICT4D project before Agile can be
applied. To answer the second research sub-question, a comparison
between the advantages of Agile and the CSFs for ICT4D projects
was made. For each CSF for ICT4D projects it was determined if
Agile can improve the degree to which that CSF is satisfied.
3.4</p>
    </sec>
    <sec id="sec-7">
      <title>Interview</title>
      <p>
        In order to attain a greater insight into how Agile can improve
ICT4D projects, an interview with ICT4D and Agile experts was
held. A semi-structured interview is a good choice when the
purpose of the interview is to elicit a person’s viewpoint regarding a
specific matter [
        <xref ref-type="bibr" rid="ref26">25</xref>
        ]. In a semi-structured interview, there are
predetermined questions, but there is flexibility in asking these questions.
For example, new questions can be added ad hoc. The results from
the interview were used to validate the findings from the literature
study, and are thus discussed in the Analysis section.
      </p>
      <p>
        The interviewees are all part of the organization W4RA, of which
the name stands for the Web alliance for Regreening in Africa. On
its website, W4RA gives its mission as follows [
        <xref ref-type="bibr" rid="ref27">26</xref>
        ]: ‘to support
farmer-managed regreening activities specifically by enhancing
information, communication, and knowledge sharing for rural
development’. An example of an ICT4D project done by W4RA is
RadioMarché [
        <xref ref-type="bibr" rid="ref28">27</xref>
        ], which is a voice-based market information
system that allows farmers to advertise their products to
communities in their local language. The interview was held with: prof. dr.
Akkermans, who is the director; ms. drs. Bon, who is the program
manager; and with ms. drs. Tuijp, who is the communication oficer.
When referring to their expertise, all three interviewees will be
collectively referred to as ‘the interviewees’.
4
4.1
      </p>
    </sec>
    <sec id="sec-8">
      <title>RESULTS</title>
    </sec>
    <sec id="sec-9">
      <title>Critical success factors for ICT4D projects</title>
      <sec id="sec-9-1">
        <title>Monitor and evaluate project progress regularly (ICT4D</title>
        <p>
          CSF1) [
          <xref ref-type="bibr" rid="ref10 ref29 ref30">10, 28, 29</xref>
          ]. Monitoring and evaluating project progress
allows for the team members to measure the efects of ICT on
development [
          <xref ref-type="bibr" rid="ref30">29</xref>
          ]. The goal of evaluation should be to discern
changes in the welfare of the members of the local community, and
to adapt the project accordingly. Evaluation should be an iterative
and adaptive process. Monitoring and evaluating also allows for
problems to be identified earlier, which, if acted upon, can ensure a
more efective and eficient project [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
        <p>
          An ICT4D project must be demand-driven (ICT4D-CSF2)
[
          <xref ref-type="bibr" rid="ref29 ref30 ref31 ref32 ref33">28–32</xref>
          ]. The ICT4D project must satisfy the present needs while
also allowing for the needs of future generations [
          <xref ref-type="bibr" rid="ref32">31</xref>
          ]. Furthermore,
implementing an ICT4D project in an area where there is not
suficient demand will not result in a sustainable ICT4D project [
          <xref ref-type="bibr" rid="ref29">28</xref>
          ]. A
critical element in achieving this is making sure that the
stakeholders have ownership over the ICT4D project (ICT4D-CSF5) so as to
increase their involvement in and acceptance of the ICT4D project.
        </p>
        <p>
          Relevant skills must be built and trained (ICT4D-CSF3) [
          <xref ref-type="bibr" rid="ref10 ref29 ref30 ref31 ref32 ref34">10,
28–31, 33</xref>
          ]. Project management, implementation, and ICT skills are
scarce in developing countries and need to be taught [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]. Illiteracy
is also an important problem [
          <xref ref-type="bibr" rid="ref35">34</xref>
          ]. Building and training these skills
can be expensive however, so mechanisms for knowledge
sharing to reduce costs are recommended [
          <xref ref-type="bibr" rid="ref32">31</xref>
          ]. ICT training also helps
overcome technophobia [
          <xref ref-type="bibr" rid="ref36">35</xref>
          ]. Finally, this training be a continuous
process [
          <xref ref-type="bibr" rid="ref29">28</xref>
          ].
        </p>
      </sec>
      <sec id="sec-9-2">
        <title>Eforts must be made to retain staf (ICT4D-CSF4) [10, 31].</title>
        <p>
          The efects of talented staf leaving can be disastrous [
          <xref ref-type="bibr" rid="ref32">31</xref>
          ]. Other
than traditional intrinsic (e.g. praise) and extrinsic (e.g. salary)
rewards, project ownership (ICT4D-CSF5) can be a major motivational
incentive due to the involvement it brings.
        </p>
      </sec>
      <sec id="sec-9-3">
        <title>Project ownership must be given to local parties (ICT4D</title>
        <p>
          CSF5) [
          <xref ref-type="bibr" rid="ref29 ref30 ref32">28, 29, 31</xref>
          ]. Local ownership is defined as the active
participation of the local community in all phases of the development
process [
          <xref ref-type="bibr" rid="ref32">31</xref>
          ]. Successful local ownership will result in the
community viewing the ICT as an integral part of their daily lives [
          <xref ref-type="bibr" rid="ref29">28</xref>
          ].
Local ownership is related to two others CSFs: it improves the
alignment of the ICT4D project to the needs of its stakeholders
(ICT4D-CSF2) and it improves the motivation of staf (ICT4D-CSF4).
        </p>
        <p>
          An ICT4D project must be economically self-sustainable
(ICT4D-CSF6) [
          <xref ref-type="bibr" rid="ref10 ref12 ref29 ref30 ref31 ref32 ref33">10, 12, 28–32</xref>
          ]. Many ICT4D projects rely on donor
money for their continued survival, which means these projects
risk falling apart as soon as enthusiasm and funding from outside
partners disappears [
          <xref ref-type="bibr" rid="ref33">32</xref>
          ]. Economic self-sustainability is therefore
important to ensure the long-term success of ICT4D projects.
However, donor money is important initially, because due to the
experimental nature of many ICT4D projects it cannot be expected for
these projects to be profitable from the get-go [
          <xref ref-type="bibr" rid="ref19 ref33">18, 32</xref>
          ]. One
particular important aspect to ensure economic self-sustainability is
marketing, because the inability to inform the community about the
benefits of ICT4D projects is one of the main reasons why ICT4D
projects fail [
          <xref ref-type="bibr" rid="ref29">28</xref>
          ]
        </p>
      </sec>
      <sec id="sec-9-4">
        <title>Local partnerships must be built to achieve synergies</title>
        <p>
          (ICT4D-CSF7) [
          <xref ref-type="bibr" rid="ref10 ref29 ref30 ref32">10, 28, 29, 31</xref>
          ]. Ferguson and Ballantyne (2002)
argue for the importance of building local partnerships (ICT4D-CSF7).
        </p>
        <p>
          A network of local partnerships will allow for the participants to
gain access to resources they might otherwise not have had access
to, such as skilled people or financial mechanisms [
          <xref ref-type="bibr" rid="ref30 ref32">29, 31</xref>
          ].
        </p>
      </sec>
      <sec id="sec-9-5">
        <title>The creation of local content must be facilitated (ICT4D</title>
        <p>
          CSF8) [
          <xref ref-type="bibr" rid="ref10 ref30 ref31 ref33 ref34">10, 29, 30, 32, 33</xref>
          ]. Local content is content being in local
language as well as having inspiration from local culture, created
by locals [
          <xref ref-type="bibr" rid="ref33">32</xref>
          ]. The reason for the importance of local content is that
only a select portion of the population will be able to understand
content from, for example, The United Kingdom, due to language
and cultural barriers. An example of what local content can be is
information for farmers regarding which vegetables can be grown
on their fields [
          <xref ref-type="bibr" rid="ref31">30</xref>
          ].
        </p>
        <p>
          The political context must be analyzed and considered
(ICT4D-CSF9) [
          <xref ref-type="bibr" rid="ref10 ref30 ref32 ref33 ref34">10, 29, 31–33</xref>
          ]. The political situation in a
country can afect an ICT4D project on two levels: micro and macro
level [
          <xref ref-type="bibr" rid="ref32">31</xref>
          ]. On a micro level issues regarding ownership can arise
due to a lack of defined ownership over processes and resources, or
from unsuccessful transfers of ownership. On a macro level issues
can arise due to increased bureaucracy or because the project is
turned into a political statement.
        </p>
      </sec>
      <sec id="sec-9-6">
        <title>An ICT4D project must have a project champion (ICT4D</title>
        <p>
          CSF10) [
          <xref ref-type="bibr" rid="ref10 ref29 ref30 ref37">10, 28, 29, 36</xref>
          ]. Renken and Heeks [
          <xref ref-type="bibr" rid="ref37">36</xref>
          ] define an ICT4D
project champion as follows: ‘Any individual who makes a decisive
contribution to the ICT4D project by actively and enthusiastically
promoting its progress through critical stages in order to mobilise
resource and/or active support and cooperation from project
stakeholders’. Multiple ICT4D project champions are necessary, to reduce
the risk of the project falling apart if an ICT4D project champion
leaves the project [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
      </sec>
      <sec id="sec-9-7">
        <title>The right technology must be chosen (ICT4D-CSF11) [10,</title>
        <p>
          29–31, 33]. Ferguson and Ballantyne (2002) argue that the
technology chosen plays an important role in the long-term success of
ICT4D projects (ICT4D-CSF11). The reliability of ICT infrastructure,
the availability of technology, and the maintenance and upgrading
of ICT are key factors [
          <xref ref-type="bibr" rid="ref32">31</xref>
          ]. Technology also needs to be afordable
for the people involved with the ICT4D project [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
        <p>
          A cultural understanding of the local community must be
developed (ICT4D-CSF12) [
          <xref ref-type="bibr" rid="ref11 ref34">11, 33</xref>
          ]. Cultural understanding can
be necessary to avoid conflicts during the constant interaction
between outsiders and the local community [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. Cultural
understanding can also be necessary to become accepted within the local
community and gain their trust, as well as to gain access to their
resources [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
        </p>
        <p>
          Trust between the local community and outside parties
must be built (ICT4D-CSF13) [
          <xref ref-type="bibr" rid="ref11 ref12">11, 12</xref>
          ]. Trust can be a
contributing factor to the willingness to cooperate with another party, and
becomes necessary if that cooperation results in the trustor being
put at risk [
          <xref ref-type="bibr" rid="ref38">37</xref>
          ]. In an ICT4D project the local community would
be the trustor, and the outside party the trustee. There are two
factors that determine the level of trust [
          <xref ref-type="bibr" rid="ref38">37</xref>
          ]: the trustor’s propensity
to trust and the trustee’s perceived trustworthiness. The
propensity to trust difers among individuals, but factors that influence
the propensity are history with development, personality, and the
culture. Trustworthiness has ability, benevolence, and integrity as
antecedents. Ability refers to the skills and expertise of a party
within a domain (e.g. knowledge about ICT). Benevolence refers to
what degree the party desires to help the trustor without regard to
extrinsic rewards. Finally, integrity refers the trustee’s adherence
to principles.
4.2
        </p>
      </sec>
    </sec>
    <sec id="sec-10">
      <title>Critical success factors for Agile software development</title>
      <p>
        A survey study to the CSFs of Agile projects on four dimensions
to project success revealed six CSFs for Agile methods [
        <xref ref-type="bibr" rid="ref25">24</xref>
        ]. These
four dimensions are quality (the quality of the delivered product),
scope (to what degree the product meets the user’s requirements),
timeliness (whether the product is delivered on time or not), and
cost (whether the real costs and efort put in were as projected).
The six CSFs are discussed below.
      </p>
      <sec id="sec-10-1">
        <title>Team environment (Agile-CSF1). A good team environment</title>
        <p>
          contributes positively to the quality of the product [
          <xref ref-type="bibr" rid="ref25">24</xref>
          ]. The entire
team should be located in a single place, the team should be small,
and the team should be self-organizing. If a project has multiple
teams they should work collaboratively rather than independently.
Teams should be small because as a team has more members,
coordination becomes more dificult [
          <xref ref-type="bibr" rid="ref39 ref40">38, 39</xref>
          ].
        </p>
        <p>
          Team capability (Agile-CSF2). Team capability positively
contributes to the timeliness and cost of a project [
          <xref ref-type="bibr" rid="ref25">24</xref>
          ]. A good team
member should have high competence, expertise, and motivation.
A good manager should have an adaptive management style and
possess knowledge on Agile. Additionally, relevant technical
training should be provided to the team members. Highly competent
team members are important to compensate for the smaller team
size [
          <xref ref-type="bibr" rid="ref39">38</xref>
          ]. Finally, developers must possess domain knowledge in
order to be able to communicate with the users [
          <xref ref-type="bibr" rid="ref41">40</xref>
          ].
        </p>
      </sec>
      <sec id="sec-10-2">
        <title>User involvement (Agile-CSF3). User involvement positively</title>
        <p>
          contributes to the scope of the product [
          <xref ref-type="bibr" rid="ref25">24</xref>
          ]. To achieve good user
involvement, a positive user relationship should be built. The user
should have complete authority regarding the project. Finally, the
user should have a strong commitment and presence.
        </p>
        <p>
          Project management (Agile-CSF4). Project management
processes positively contributes to the quality of the product [
          <xref ref-type="bibr" rid="ref25">24</xref>
          ].
Requirement management processes, project management processes,
and configuration management processes should all be Agile. A
working schedule should be put in place and followed. Progress
should be tracked. There should be a strong focus on
communication, for example with daily face-to-face meetings.
        </p>
      </sec>
      <sec id="sec-10-3">
        <title>Agile software engineering techniques (Agile-CSF5). Agile</title>
        <p>
          software engineering techniques positively contribute to the
quality and scope of the product [
          <xref ref-type="bibr" rid="ref25">24</xref>
          ]. These techniques are: coding
standards, simple design, refactoring, limited but suficient
documentation, and integration testing.
        </p>
      </sec>
      <sec id="sec-10-4">
        <title>Delivery strategy (Agile-CSF6). Delivery strategy positively</title>
        <p>
          contributes to the scope of the product, and the timeliness and cost
of the project [
          <xref ref-type="bibr" rid="ref25">24</xref>
          ]. A good delivery strategy prioritizes the
important features of the product first. Furthermore, software should be
regularly delivered.
4.3
        </p>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>Advantages of Agile software development</title>
      <sec id="sec-11-1">
        <title>More robust to changing requirements (Agile-ADV1). Require</title>
        <p>
          ments are inherently variable because both the developer and user
acquire more knowledge about the domain of the application [
          <xref ref-type="bibr" rid="ref42">41</xref>
          ].
Requirements also change because the business environment in
which the user is positioned is dynamic [
          <xref ref-type="bibr" rid="ref43">42</xref>
          ]. Agile methods are
more robust to change than traditional methods because of two
reasons [
          <xref ref-type="bibr" rid="ref42">41</xref>
          ]. First, Agile firms typically use a more simple software
architecture, postponing any complex and binding changes as much
as possible. This makes the architecture more robust to change.
Second, Agile firms typically allow for requirements variability in the
contract between the developer and the user. In those situations,
users can specify or adjust requirements at the beginning of each
iteration.
        </p>
      </sec>
      <sec id="sec-11-2">
        <title>Improved communication with the user (Agile-ADV2). In</title>
        <p>
          Agile methods, face-to-face communication with the user instead
of rigorous documentation is the norm [
          <xref ref-type="bibr" rid="ref43">42</xref>
          ]. The iterative nature of
Agile allows for more frequent communication with the user.
Furthermore, this more frequent face-to-face-communication allows
for an improved elicitation and validation of requirements, which
reduces the likelihood of requirements changing later on [
          <xref ref-type="bibr" rid="ref43 ref44">42, 43</xref>
          ].
        </p>
      </sec>
      <sec id="sec-11-3">
        <title>Higher quality of software (Agile-ADV3). Software quality</title>
        <p>
          principles that quality professionals have been preaching for are
included in Agile methods [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. An example of such a principle is
test driven development, which is an approach that suggests
writing automated tests first, and code afterwards if the tests fail [
          <xref ref-type="bibr" rid="ref45">44</xref>
          ].
Frequent user feedback is also mentioned as a reason for improved
software quality [
          <xref ref-type="bibr" rid="ref40">39</xref>
          ].
        </p>
      </sec>
      <sec id="sec-11-4">
        <title>Increased user satisfaction (Agile-ADV4). There are several</title>
        <p>
          factors that contribute to this [
          <xref ref-type="bibr" rid="ref46">45</xref>
          ]: improved communication with
users (Agile-ADV2), increased user involvement (Agile-CSF3), and
the improved quality of software (Agile-ADV3).
        </p>
      </sec>
      <sec id="sec-11-5">
        <title>Good, internal communication (Agile-ADV5). The required</title>
        <p>
          strong focus on internal communication (Agile-CSF4) results in an
improved understanding of the requirements, tasks, project status,
and resource allocation among all team members [
          <xref ref-type="bibr" rid="ref44">43</xref>
          ].
        </p>
        <p>
          Improved employee job satisfaction (Agile-ADV6). Job
satisfaction is higher for Agile methods for six reasons [
          <xref ref-type="bibr" rid="ref47">46</xref>
          ]: employees
experienced less stress, felt more productive, enjoyed the internal
communication (Agile-ADV5), found the job environment more
pleasant and comfortable, were more motivated, and were more
willing to continue using their software development method. The
improved software quality (Agile-ADV3) also contributed to a higher
job satisfaction [
          <xref ref-type="bibr" rid="ref46">45</xref>
          ].
        </p>
      </sec>
      <sec id="sec-11-6">
        <title>A higher return on investment (Agile-ADV7). The return</title>
        <p>
          on investment (ROI) is higher in projects done with Agile methods
for several reasons [
          <xref ref-type="bibr" rid="ref48">47</xref>
          ]: higher software quality (Agile-ADV3),
increased user satisfaction (Agile-ADV4), lower costs, and higher
productivity.
        </p>
        <p>
          Increase in successful projects (Agile-ADV8). The more of
the principles of the Agile approach is applied in the project, the
higher the project success [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. Hayes’ study (as cited in [
          <xref ref-type="bibr" rid="ref40">39</xref>
          ])
attributed this occurrence to the iterative nature of Agile. An iterative
cycle instead of a sequential cycle supposedly increases the
visibility of the project. With this increased visibility the potential success
of the project would then become clearer, which gives insight into
whether adjustments can or have to be made, or if the project has
to be cancelled entirely.
        </p>
      </sec>
      <sec id="sec-11-7">
        <title>Improved control over projects (Agile-ADV9). Hayes (as</title>
        <p>
          cited by Mahanti [
          <xref ref-type="bibr" rid="ref40">39</xref>
          ]) argues that Agile methods improve the
control over projects due to several reasons: ‘Short iterations,
multidisciplinary teams, knowledge sharing, continuous integration, and
feedback’.
        </p>
      </sec>
      <sec id="sec-11-8">
        <title>Improved organizational learning (Agile-ADV10). Agile meth</title>
        <p>
          ods focuses on teamwork and foster organizational learning within
those teams [
          <xref ref-type="bibr" rid="ref49">48</xref>
          ], for example with pair programming [
          <xref ref-type="bibr" rid="ref50">49</xref>
          ].
5
5.1
        </p>
      </sec>
    </sec>
    <sec id="sec-12">
      <title>ANALYSIS</title>
    </sec>
    <sec id="sec-13">
      <title>Suitability of Agile software development for ICT4D projects</title>
      <p>The suitability of Agile for ICT4D projects is analyzed by comparing
the CSFs for Agile methods and for ICT4D projects.</p>
      <p>A good team environment (Agile-CSF1) is also necessary in
order for an ICT4D project to be successful. For ICT4D projects it is
beneficial for all the team members to be located near each other,
because an active presence within the local community can
contribute to developing a cultural understanding (ICT4D-CSF12), and
because ownership over the project by the local community
requires their active participation (ICT4D-CSF5). However, this is
not always possible for ICT4D projects. For example, according to
the interviewees, members of W4RA go several times a year for
extended periods. The goal is to do as much work as possible in
those time frames, because it is not financially doable to remain
there during the entire project. Another aspect of the team
environment is that teams should be small, which fits with ICT4D projects
because of budget restrictions.</p>
      <p>User involvement (Agile-CSF3) requires cooperation with the
local community, which is also important for ICT4D projects
(ICT4DCSF2). From the ‘Critical success factors for ICT4D projects’ section,
important prerequisites for cooperation can be identified:
developing a cultural understanding (ICT4D-CSF12) and building trust
(ICT4D-CSF13). Multiple factors contribute to developing a cultural
understanding. These factors are cultural interpreters, local
partnerships, and a strong presence within the local community. For
building trust the trustor’s propensity to trust and the trustee’s
perceived trustworthiness are of importance.</p>
      <p>
        An incremental Agile delivery strategy delivers software
regularly, and prioritizes the most important features first (Agile-CSF6).
Such a strategy allows for more user involvement [
        <xref ref-type="bibr" rid="ref52">51</xref>
        ], which
subsequently means that cooperation is an important prerequisite.
      </p>
      <p>
        The following three CSFs for Agile can be challenging to
satisfy for similar reasons: team capability (Agile-CSF2), project
management processes (Agile-CSF4), and Agile software engineering
techniques (Agile-CSF5). Project management and ICT skills are
often lacking in developing countries (ICT4D-CSF3). If people from
the community are actively included in the software development
process, they will need to be educated on Agile. This relates to
both Agile processes in project management and Agile software
engineering techniques. Furthermore, because ICT4D is a
multidisciplinary field [
        <xref ref-type="bibr" rid="ref51">50</xref>
        ], not every team member may have a
background in ICT. It is thus possible that people assigned to roles such
as cultural interpreter or business strategy (to ensure economic
self-sustainability) are not familiar with Agile either, and will also
have to be educated. However, teaching Agile may not be dificult,
or even necessary. According to the interviewees, it is not Agile that
needs to be taught, but rather the principles behind Agile. So for
example, the concepts of collaboration and iterations. Furthermore,
according to the interviewees, these principles are shared with
ifelds of science relevant for ICT4D, for example social sciences.
If that is the case, teaching Agile (or rather, the principles behind
Agile) to team members without an ICT background may not be
a problem. After the training is done, Agile project management
processes and Agile software engineering techniques need to be
applied. One possible dificulty that can arise here is the
interference of donors. According to the interviewees, the commitment of
the team is stronger to the donors (who are the customers) than to
the local community (who are the users). In the experience of the
interviewees, managers of donor companies prefer contracts, clear
roadmaps, and traditional software development.
      </p>
      <p>Team capability (Agile-CSF2) requires two further
considerations to be made. First, the team members need to possess domain
knowledge, or gain domain knowledge through interaction with
the local community. The latter method will require cooperation.
Second, in satisfying the CSFs demand-driven (ICT4D-CSF2), local
ownership (ICT4D-CSF5), and local partnerships (ICT4D-CSF7),
motivation of the local community for the project is built. Both
domain knowledge and motivation are important aspects of team
capability.</p>
      <p>
        In summary, several CSFs for ICT4D projects have to be
considered before Agile can be used in ICT4D projects. First, the ICT4D
project needs to be demand driven (ICT4D-CSF1). Second, Agile
practices need to be taught to the local community members
involved as well as to team members without an ICT background
(ICT4D-CSF3). Third, a cultural understanding must be developed
(ICT4D-CSF12). According to the interviewees, an ICT4D project
should start out by looking at what the local community has, and
by letting the local community explain what they do. Field research
is important in this initial step, and the goal is to determine in what
ways ICT could be used. In this initial step a cultural understanding
can be developed, thus allowing Agile to be used once
development initiates. Fourth, trust must be built (ICT4D-CSF13). Similarly
to developing a cultural understanding, trust can be built in that
initial step. However, trust cannot be fully built, because it is in
iterative and dynamic process [
        <xref ref-type="bibr" rid="ref38">37</xref>
        ], which is also echoed by the
interviewees. If a demand-driven approach does not build enough
motivation within the local community, local ownership
(ICT4DCSF5) and building local partnerships (ICT4D-CSF7) also becomes
a prerequisite for using Agile. Building local partnerships may also
help building a cultural understanding (ICT4D-CSF7). According
to the interviewees, local partnerships may also help building trust.
Finally, one incompatibility between Agile and ICT4D exists. Agile
may be incompatible for ICT4D projects because it is not always
possible to work on location.
5.2
      </p>
    </sec>
    <sec id="sec-14">
      <title>How Agile software development can improve ICT4D projects</title>
      <p>The efects of Agile on ICT4D projects are determined by analyzing
which advantages or characteristics of Agile can influence which
CSFs for ICT4D projects.</p>
      <sec id="sec-14-1">
        <title>Monitor and evaluate project progress regularly (ICT4D</title>
        <p>CSF1). The improved control over projects (Agile-ADV9) suggests
that Agile can contribute. In particular, the good internal
communication of teams can be of benefit here (Agile-ADV5). The frequent
meetings can (and should) be used to discuss the current progress of
the ICT4D project. Furthermore, the frequent delivery of project
deliverables (Agile-CSF6) and the feedback from users (Agile-ADV2)
can help with regular evaluation.</p>
      </sec>
      <sec id="sec-14-2">
        <title>An ICT4D project must be demand-driver (ICT4D-CSF2).</title>
        <p>
          Agile has several advantages that can contribute to ensuring an
ITC4D project is demand-driven. First, user collaboration is one of
the key pillars of Agile, and as a result Agile has good
communication with the user (Agile-ADV2). Elicitation of requirements is done
iteratively and frequently, ensuring that the ICT fits the demand
of the users. Second, should requirements change, which occurs
more than normally for ICT4D projects [
          <xref ref-type="bibr" rid="ref18">17</xref>
          ], then Agile has the
advantage of being robust to change (Agile-ADV1). According to
the interviewees, demos, prototypes, workshops and movies make
the local community familiar with ICT and helps them understand
how ICT could help them in their lives.
        </p>
      </sec>
      <sec id="sec-14-3">
        <title>Relevant skills must be built and trained (ICT4D-CSF3).</title>
        <p>One result from section 5.1 is that skills pertaining to Agile have
to be built and taught as well, thus making this CSF more time
consuming to achieve. However, Agile might also help building
and training Agile related skills and other ICT skills, because Agile
methods foster organizational learning (Agile-ADV10). For example,
pair programming helps build programming skills. The net efect of
Agile upon building and training relevant skills is thus unknown.</p>
        <p>
          Eforts must be made to retain staf (ICT4D-CSF4) . Two
benefits of Agile that can help are the increased job satisfaction
of employees (Agile-ADV6) and increased organizational learning
(Agile-ADV10). One research found that job satisfaction is
negatively correlated to turnover intention, which is to say that
increasing job satisfaction will reduce the intention to leave the firm (or the
project) [
          <xref ref-type="bibr" rid="ref53">52</xref>
          ]. Furthermore, that same research found that an
organizational learning culture is strongly, positively correlated with job
satisfaction. Finally, the correlation between learning culture and
turnover intention was not significant. However, organizational
learning culture is still a good construct to increase employee
retention, because organizational learning culture is indirectly linked
to turnover intention through job satisfaction [
          <xref ref-type="bibr" rid="ref53">52</xref>
          ].
        </p>
      </sec>
      <sec id="sec-14-4">
        <title>Project ownership must be given to local parties (ICT4D</title>
        <p>
          CSF5). An important antecedent for user participation is the user’s
perceived support by the organization [
          <xref ref-type="bibr" rid="ref55">53</xref>
          ]. This can be achieved by,
for example, listening to the problems of the users and solving these
problems [
          <xref ref-type="bibr" rid="ref56">54</xref>
          ]. Agile can indirectly increase participation of the local
community due to the positive efect of Agile for ensuring an ICT4D
project is demand-driven. Furthermore, the good communication
with users (Agile-ADV2) can help with facilitating participation.
        </p>
      </sec>
      <sec id="sec-14-5">
        <title>A cultural understanding of the local community must</title>
        <p>
          be developed (ICT4D-CSF12). A strong presence within the
local community helps develop a cultural understanding [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], which
Agile contributes to by focusing on user collaboration and by
improving user communication (Agile-ADV2). Furthermore, the good,
internal communication (Agile-ADV5) and the improved
organizational learning (Agile-ADV10) of Agile can help disseminate the
cultural understanding throughout the organization.
        </p>
        <p>
          Trust between the local community and outside parties
must be built (ICT4D-CSF13). To summarize how trust is built,
there are two important concepts: the trustor’s propensity to trust
and the trustee’s perceived trustworthiness [
          <xref ref-type="bibr" rid="ref38">37</xref>
          ]. Agile cannot
inlfuence the trustor’s propensity to trust, because there is no reason
to believe Agile can influence factors such as personality or
culture. Agile also cannot initially influence the trustee’s perceived
trustworthiness, because there is no reason to believe Agile can
inlfuence the ability of the trustee (although skills and expertise, such
as domain knowledge, are required to make Agile work successfully,
Agile-CSF1), the benevolence of the trustee, or the integrity of the
trustee. However, the perceived trustworthiness of the trustee is
dynamic and afected by the results of trust-taking behaviour of the
trustor. In the context of ICT4D projects, trust-taking behaviour
of the trustor can be considered as letting an organization into
the local community or allowing them to develop ICT that will
impact their lives. The iterative nature of Agile and the frequent
delivery of working software (Agile-CSF6) will allow for more
frequent outcomes of trust-taking behaviour. And the increased user
satisfaction when using Agile methods (Agile-ADV4) suggests that
these outcomes will be more frequently positive.
        </p>
        <p>Agile might have some small efects on the following CSFs for
ICT4D projects. By contributing to other CSFs for ICT4D projects,
Agile helps ensure the continued use of and therefore the demand
for the ICT. Sustainable demand is one of the pillars of an
economically self-sustainable ICT4D project (ICT4D-CSF6). Additionally, by
focusing on working software and by frequently delivering software
(Agile-CSF6), local content (ICT4D-CSF8) can be created earlier on
in the ICT4D project. Finally, because Agile contributes to ensuring
a demand-driven ICT4D project, an improved understanding of
the local community’s needs is gained. This will allow the right
technology to be chosen with greater accuracy (ICT4D-CSF11).</p>
        <p>Agile was not believed to have any significant impact on three
CSFs for ICT4D. The collaborative nature of Agile (see the
Introduction) might improve the communication with and satisfaction
of partners (ICT4D-CSF7) and project champions (ICT4D-CSF10),
similar as to how it improves the communication with and
satisfaction of users (Agile-ADV2, Agile-ADV4). However, it cannot help
with seeking partners and building partnerships, or with finding
project champions. Finally, Agile was not believed to be able to
analyse and consider the political context (ICT4D-CSF9). However,
the adaptive nature of Agile (see the Introduction) and the
subsequent robustness to changing requirements (Agile-ADV1) allows
an ICT4D project to respond to changes in the political context.</p>
        <p>Additionally, in terms of frequency, the most important
advantages and characteristics of Agile can be identified. Improved
communication with the user (Agile-ADV2) has a positive efect on four
CSFs for ICT4D, improved organizational learning (Agile-ADV10)
on three, and good communication within the team on two.
Furthermore, while not defined as an advantage, the focus on frequent
delivery (Agile-CSF6) has a positive efect on three CSFs.
6</p>
      </sec>
    </sec>
    <sec id="sec-15">
      <title>DISCUSSION</title>
      <p>
        ICT4D projects have high rates of failure [
        <xref ref-type="bibr" rid="ref3 ref4 ref54">3, 4</xref>
        ] and the Agile
methodology was found to increase the success rate of ICT projects [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
However, Agile methods successful in western countries cannot
carelessly be applied in ICT projects for developing countries [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
Examples of why are the worse or lack of ICT and management
skills [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and cultural barriers [
        <xref ref-type="bibr" rid="ref11 ref12">11, 12</xref>
        ]. Furthermore, current
research on why to apply Agile methods is mainly limited to the
benefit of improved user collaboration [
        <xref ref-type="bibr" rid="ref15 ref16 ref17">14–16</xref>
        ].
      </p>
      <p>
        The main value of this research lies in the insight it gives into
how Agile can improve ICT4D projects and in what ways. This
is important both for Agile frameworks as (for example [
        <xref ref-type="bibr" rid="ref20 ref22">19, 21</xref>
        ])
and for frameworks using Agile elements (for example [
        <xref ref-type="bibr" rid="ref19 ref21">18, 20</xref>
        ]),
because there might be additional aspects of Agile that could further
improve the frameworks discussed in the related works section
or form the theoretical basis of new ICT4D frameworks. Existing
literature mainly focuses on user collaboration as a reason for
why Agile methods can improve ICT4D projects [
        <xref ref-type="bibr" rid="ref15 ref16 ref17">14–16</xref>
        ], whereas
this paper found other aspects of Agile as well that can improve
ICT4D projects. Most notable are organizational learning, team
communication, and frequent delivery.
      </p>
      <p>However, several limitations to this research must be addressed.
First, a limitation regarding the ICT4D literature. In the interview
that was held, the interviewees raised a potential problem in ICT4D
literature. On one end there are case studies. While interesting, the
question is what their findings mean for ICT4D as a whole. On the
other end there is desk research. Such research attempts to create
policy for ICT4D as a whole, but lacks a link to real ICT4D projects.
The interviewees’ opinion thus suggests that the ICT4D literature
used in this paper is inadequate to provide a conclusive answer
to the research question. Furthermore, literature for the CSFs for
ICT4D and Agile and for the advantages of Agile was not collected
in a systematic way, thus providing no guarantee that the CSFs
of ICT4D and Agile and the advantages of Agile are exhaustive. A
ifnal limitation is that the findings of this research have not been
validated in practice or through rigorous expert interviews.</p>
    </sec>
    <sec id="sec-16">
      <title>7 CONCLUSION</title>
      <p>The relationship between Agile and ICT4D was explored largely
due to the focus of Agile on user collaboration. Theory postulated
that there are additional variables to consider in an ICT4D project,
and as such an answer to the following research question was
sought: ‘To what degree can Agile software development improve
ICT4D projects?’. This paper arrived at an answer to the research
question by answering two sub-questions, the answers of which are
summarized below. Collectively, these answers provide an answer
to the main research question.</p>
      <p>SQ1: Can Agile methods successfully work in an ICT4D project?
Four critical success factors for ICT4D need to be satisfied before
an Agile method can work: the projects needs to be demand-driven,
skills pertaining to Agile need to be taught to the stakeholders
actively involved in the development, a cultural understanding
must be developed, and trust must be built. Though not necessarily
prerequisites, local ownership and building local partnerships can
also play an important role in ensuring that Agile can work
correctly by increasing the motivation of the local community. Local
partnerships can also contribute to developing a cultural
understanding and building trust. The advice for parties who seek to set
up a demand-driven ICT4D project is to select an Agile method for
ICT4D projects that allows for a substantial pre-development phase,
in which relevant skills can be taught and developed, a cultural
understanding can be developed, and trust can be built. However,
the parties must also consider that all those three critical success
factors are iterative processes. Therefore, the Agile method must
also allow for eforts to be made towards satisfying those three
critical success factors in later stages of the project.</p>
      <p>SQ2: How can ICT4D projects benefit from an Agile approach?
Agile can positively contribute towards satisfying all but four
critical success factors for ICT4D: monitor and evaluate the project
regularly, ensure a demand-driven ICT4D project, make eforts to
retain staf, give local owernship to the local community, ensure
economic self-sustainability, create local content, choose the right
technology, develop a cultural understanding, and build trust. For
three critical success the efect is insignificant: build local
partnerships, understand the political context, and ensure a project
champion. For the remaining critical success factor, building and
training skills, there is both a positive and negative efect, thus
resulting in an uncertain net efect. The most important advantages
or characteristics of Agile, in terms of frequency, are the improved
communication with the user, improved organizational learning,
good communication within the team, and the focus on frequent
delivery.</p>
      <p>As addressed in the discussion, the results of this research have
not been validated in practice. Case studies are thus necessary in
which Agile methods are used, so that the proposed benefits can
be assessed. Furthermore, as ICT4D is a multi-disciplinary field, it
might prove worthwhile to investigate the efects of other software
engineering techniques or approaches from other sciences, which
can then be used to design an ICT4D framework.</p>
    </sec>
    <sec id="sec-17">
      <title>8 ACKNOWLEDGEMENTS</title>
      <p>The authors wish to thank prof. dr. Akkermans, ms. drs. Bon, and
ms. drs. Tuijp for sharing their expertise during the interview.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Geof</given-names>
            <surname>Walsham</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>ICT4D research: reflections on history and future agenda</article-title>
          .
          <source>Information Technology for Development 23</source>
          ,
          <issue>1</issue>
          (
          <year>February 2017</year>
          ),
          <fpage>18</fpage>
          -
          <lpage>41</lpage>
          . DOI:http://dx.doi.org/10.1080/02681102.
          <year>2016</year>
          .1246406
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Nagy</surname>
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Hanna</surname>
          </string-name>
          .
          <year>2010</year>
          . E-Transformation: Enabling New Development Strategies, New York, NY: Springer-Verlag New York.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Richard</given-names>
            <surname>Heeks</surname>
          </string-name>
          .
          <year>2002</year>
          .
          <article-title>Information Systems</article-title>
          and Developing Countries: Failure, Success, and
          <string-name>
            <given-names>Local</given-names>
            <surname>Improvisations</surname>
          </string-name>
          .
          <source>The Information Society 18</source>
          ,
          <issue>2</issue>
          (
          <year>2002</year>
          ),
          <fpage>101</fpage>
          -
          <lpage>112</lpage>
          . DOI:http://dx.doi.org/10.1080/01972240290075039
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Independent</given-names>
            <surname>Evaluation Group</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <source>Capturing Technology for Development: An Evaluation of World Bank Group Activities in Information and Communication Technologies</source>
          Volume
          <volume>1</volume>
          . (
          <year>2011</year>
          ).
          <source>Retrieved March 6</source>
          , 2018 from https://openknowledge.worldbank.org/bitstream/handle/10986/2370/653750 PUB0v10B0BLIC00ict0evaluation.pdf
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Pedro</given-names>
            <surname>Serrador and Jefrey</surname>
          </string-name>
          <string-name>
            <given-names>K.</given-names>
            <surname>Pinto</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Does Agile work? - A quantitative analysis of agile project success</article-title>
          .
          <source>International Journal of Project Management</source>
          <volume>33</volume>
          ,
          <issue>5</issue>
          (
          <year>2015</year>
          ),
          <fpage>1040</fpage>
          -
          <lpage>1051</lpage>
          . DOI:http://dx.doi.org/10.1016/j.ijproman.
          <year>2015</year>
          .
          <volume>01</volume>
          .006
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Scott</given-names>
            <surname>Ambler</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Quality in an agile world</article-title>
          .
          <source>Software Quality Professional</source>
          <volume>7</volume>
          ,
          <issue>4</issue>
          (
          <year>2005</year>
          ),
          <fpage>34</fpage>
          -
          <lpage>40</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Jim</given-names>
            <surname>Highsmith</surname>
          </string-name>
          .
          <year>2002</year>
          .
          <article-title>What is Agile Software Development? Crosstalk -</article-title>
          <source>The Journal of Defense Software Engineering</source>
          <volume>15</volume>
          ,
          <issue>10</issue>
          (
          <year>2002</year>
          ),
          <fpage>4</fpage>
          -
          <lpage>9</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Joerg</surname>
            <given-names>doerflinger and Tom</given-names>
          </string-name>
          <string-name>
            <surname>Gross</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Bottom billion architecture</article-title>
          .
          <source>Proceedings of the 4th ACM/IEEE International Conference on Information and Communication Technologies and Development - ICTD</source>
          <volume>10</volume>
          (
          <year>2010</year>
          ). DOI:http://dx.doi.org/10.1145/2369220.2369228
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Joerg</given-names>
            <surname>Doerflinger</surname>
          </string-name>
          and
          <string-name>
            <given-names>Tom</given-names>
            <surname>Gross</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Technical ICTD - A User Centered Lifecycle</article-title>
          . Communications:
          <article-title>Wireless in Developing Countries and Networks of the Future IFIP Advances in Information</article-title>
          and Communication
          <string-name>
            <surname>Technology</surname>
          </string-name>
          (
          <year>2010</year>
          ),
          <fpage>72</fpage>
          -
          <lpage>83</lpage>
          . DOI:http://dx.doi.org/10.1007/978-3-
          <fpage>642</fpage>
          -15476-
          <issue>8</issue>
          _
          <fpage>8</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Tina</given-names>
            <surname>James</surname>
          </string-name>
          .
          <year>2004</year>
          .
          <article-title>Information and communication technologies for development in Africa</article-title>
          , Ottawa: International Development Research Centre (IDRC).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>Kirstin</given-names>
            <surname>Krauss</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Demonstrating Critically Reflexive ICT4D Project Conduct and ICT Training in Rural South Africa</article-title>
          .
          <source>Proceedings Annual Workshop of the AIS Special Interest Group for ICT in Global Development at AIS Electronic Library</source>
          , paper
          <volume>13</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.S.</given-names>
            <surname>Sandeep</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.N.</given-names>
            <surname>Ravishankar</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Impact sourcing ventures and local communities: a frame alignment perspective</article-title>
          .
          <source>Information Systems Journal</source>
          <volume>26</volume>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <volume>2</volume>
          (
          <issue>2015</issue>
          ),
          <fpage>127</fpage>
          -
          <lpage>155</lpage>
          . DOI:http://dx.doi.org/10.1111/isj.12057
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Punita</surname>
            <given-names>Bhatt</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Ali J.</given-names>
            <surname>Ahmad</surname>
          </string-name>
          , and Muhammad Azam Roomi.
          <year>2016</year>
          .
          <article-title>Social innovation with open source software: User engagement and development challenges in India</article-title>
          .
          <source>Technovation 52-53</source>
          (
          <year>2016</year>
          ),
          <fpage>28</fpage>
          -
          <lpage>39</lpage>
          . DOI:http://dx.doi.org/10.1016/j.technovation.
          <year>2016</year>
          .
          <volume>01</volume>
          .004
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Rüdiger</surname>
            <given-names>Heimgärtner</given-names>
          </string-name>
          , Alkesh Solanki, and
          <string-name>
            <given-names>Bernd</given-names>
            <surname>Hollerit</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Enhancing Usability Engineering in Rural Areas Using Agile Methods. Design, User Experience, and Usability</article-title>
          . Theories, Methods, and
          <source>Tools for Designing the User Experience Lecture Notes in Computer Science</source>
          (
          <year>2014</year>
          ),
          <fpage>445</fpage>
          -
          <lpage>452</lpage>
          . DOI:http://dx.doi.org/10.1007/978-3-
          <fpage>319</fpage>
          -07668-3_
          <fpage>43</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Degif</surname>
            <given-names>Teka</given-names>
          </string-name>
          , Yvonne Dittrich, and
          <string-name>
            <given-names>Mesfin</given-names>
            <surname>Kifle</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Usability challenges in an Ethiopian software development organization</article-title>
          .
          <source>Proceedings of the 9th International Workshop on Cooperative and Human Aspects of Software Engineering - CHASE</source>
          <volume>16</volume>
          (
          <year>2016</year>
          ). DOI:http://dx.doi.org/10.1145/2897586.2897604
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>Anna</given-names>
            <surname>Bon</surname>
          </string-name>
          and
          <string-name>
            <given-names>Hans</given-names>
            <surname>Akkermans</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Rethinking technology, ICTs and development: Why it is time to consider ICT4D 3.0</article-title>
          . (
          <year>2014</year>
          ).
          <source>Retrieved March 8</source>
          , 2018 from https://w4ra.org/wp-content/uploads/2015/01/ICT4D3.pdf
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>Matt</given-names>
            <surname>Haikin</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Reflections on applying iterative and incremental software development methodologies (Agile, RAD etc</article-title>
          .)
          <article-title>to aid and development work in developing countries</article-title>
          .
          <source>Retrieved March 8</source>
          , 2018 from http://www.hiidunia.com/wp-content/uploads/downloads/2013/07/agileblarticle-part-
          <volume>11</volume>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Anna</surname>
            <given-names>Bon</given-names>
          </string-name>
          , Hans Akkermans, and
          <string-name>
            <given-names>Jaap</given-names>
            <surname>Gordijn</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Developing ICT Services in a Low-Resource Development Context</article-title>
          .
          <source>Complex Systems Informatics and Modeling Quarterly</source>
          ,
          <volume>9</volume>
          (
          <year>2016</year>
          ),
          <fpage>84</fpage>
          -
          <lpage>109</lpage>
          . DOI:http://dx.doi.org/10.7250/csimq.2016-
          <volume>9</volume>
          .
          <fpage>05</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>Joerg</given-names>
            <surname>Doerflinger</surname>
          </string-name>
          and
          <string-name>
            <given-names>Andy</given-names>
            <surname>Dearden</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Evolving a Software Development Methodology for Commercial ICTD Projects</article-title>
          .
          <source>Information Technologies &amp; International Development 9</source>
          ,
          <issue>3</issue>
          (
          <year>2013</year>
          ),
          <fpage>43</fpage>
          -
          <lpage>60</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>Maria</given-names>
            <surname>Angela</surname>
          </string-name>
          <string-name>
            <surname>Ferrario</surname>
          </string-name>
          , Will Simm,
          <string-name>
            <given-names>Peter</given-names>
            <surname>Newman</surname>
          </string-name>
          , Stephen Forshaw, and
          <string-name>
            <given-names>Jon</given-names>
            <surname>Whittle</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Software engineering for social good: integrating action research, participatory design, and agile development</article-title>
          .
          <source>Companion Proceedings of the 36th International Conference on Software Engineering - ICSE Companion</source>
          <year>2014</year>
          (
          <year>2014</year>
          ). DOI:http://dx.doi.org/10.1145/2591062.2591121
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Henrik</surname>
            <given-names>Hansson</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Peter</given-names>
            <surname>Mozelius</surname>
          </string-name>
          , Jarkko Suhonen, Erkki Sutinen, Mikko Vesisenaho, and
          <string-name>
            <given-names>Gunnar</given-names>
            <surname>Wettegren</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>ICT4D with a Nordic flavor - A stepwise and multithreaded approach</article-title>
          .
          <source>In IST-Africa 2009 conference proceedings. IIMC International Information Management Corporation</source>
          ,
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [22]
          <string-name>
            <surname>Aaron</surname>
            <given-names>Ciaghi</given-names>
          </string-name>
          , Adolfo Villafiorita, and
          <string-name>
            <given-names>Lorenzo</given-names>
            <surname>Dalvit</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Understanding Best Practices for ICTD Projects: Towards a Maturity Model. In ICTs for Inclusive Communities in Developing Societies</article-title>
          .
          <source>Proceedings of the 8th International Development Informatics Association Conference</source>
          ,
          <volume>349</volume>
          -
          <fpage>360</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>Zarina</given-names>
            <surname>Alias</surname>
          </string-name>
          , E.m.a. Zawawi, Khalid Yusof, and
          <string-name>
            <given-names>N.m.</given-names>
            <surname>Aris</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Determining Critical Success Factors of Project Management Practice: A Conceptual Framework</article-title>
          .
          <source>Procedia - Social and Behavioral Sciences</source>
          <volume>153</volume>
          (
          <year>2014</year>
          ),
          <fpage>61</fpage>
          -
          <lpage>69</lpage>
          . DOI:http://dx.doi.org/10.1016/j.sbspro.
          <year>2014</year>
          .
          <volume>10</volume>
          .041
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>Tsun</given-names>
            <surname>Chow</surname>
          </string-name>
          and
          <string-name>
            <surname>Dac-Buu Cao</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>A survey study of critical success factors in agile software projects</article-title>
          .
          <source>Journal of Systems and Software 81</source>
          ,
          <issue>6</issue>
          (
          <year>2008</year>
          ),
          <fpage>961</fpage>
          -
          <lpage>971</lpage>
          . DOI:http://dx.doi.org/10.1016/j.jss.
          <year>2007</year>
          .
          <volume>08</volume>
          .020
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Edwin Van Teijlingen</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Semi-structured interviews</article-title>
          . (
          <year>2014</year>
          ). https://intranetsp.bournemouth.ac.uk/documentsrep/PGR%20Workshop%
          <fpage>20</fpage>
          -
          <lpage>%</lpage>
          20Interviews%
          <fpage>20Dec</fpage>
          %
          <fpage>202014</fpage>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <source>[26] W4RA. About W4RA. Retrieved March</source>
          <volume>11</volume>
          ,
          <year>2018</year>
          from https://w4ra.org/w4ra/
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [27]
          <fpage>W4RA</fpage>
          .
          <article-title>RadioMarché, Voice-based market information system</article-title>
          .
          <source>Retrieved March</source>
          <volume>11</volume>
          ,
          <year>2018</year>
          from https://w4ra.org
          <article-title>/radiomarche-voice-based-market-informationsystem/</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>M.E.Kutu</given-names>
            <surname>Mphahlele</surname>
          </string-name>
          and
          <string-name>
            <given-names>Maisela E.</given-names>
            <surname>Maepa</surname>
          </string-name>
          .
          <year>2003</year>
          .
          <article-title>Critical success factors in telecentre sustainability: a case study of six telecentres in the Limpopo Province</article-title>
          .
          <source>Communicatio</source>
          <volume>29</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>2</lpage>
          (
          <year>2003</year>
          ),
          <fpage>218</fpage>
          -
          <lpage>232</lpage>
          . DOI:http://dx.doi.org/10.1080/02500160308538028
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>United</given-names>
            <surname>Nations Development Programme</surname>
          </string-name>
          (UNDP).
          <year>2001</year>
          .
          <article-title>Essentials: Information communication technology for development</article-title>
          . (
          <year>2001</year>
          ). http://web.undp.org/evaluation/documents/essentials_5.pdf
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>David</given-names>
            <surname>Pieter Conradie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Morris</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.J.</given-names>
            <surname>Jacobs</surname>
          </string-name>
          .
          <year>2003</year>
          .
          <article-title>Using information and communication technologies (ICTs) for deep rural development in South Africa</article-title>
          .
          <source>Communicatio</source>
          <volume>29</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>2</lpage>
          (
          <year>2003</year>
          ),
          <fpage>199</fpage>
          -
          <lpage>217</lpage>
          . DOI:http://dx.doi.org/10.1080/02500160308538027
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [31]
          <string-name>
            <surname>Julie</surname>
            <given-names>Ferguson</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Peter</given-names>
            <surname>Ballantyne</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Galin</given-names>
            <surname>Kora</surname>
          </string-name>
          .
          <year>2002</year>
          .
          <article-title>Sustaining ICT-enabled development practice makes perfect? In Sustaining ICT-enabled development practice makes perfect? The Hague: International institute for communication and development (IICD).</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>Kenneth</given-names>
            <surname>Keniston</surname>
          </string-name>
          and
          <string-name>
            <given-names>Deepak</given-names>
            <surname>Kumar</surname>
          </string-name>
          .
          <year>2003</year>
          .
          <article-title>The Four Digital Divides</article-title>
          , Delhi: SAGE Publishers.
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [33]
          <string-name>
            <surname>Almamy</surname>
            <given-names>Touray</given-names>
          </string-name>
          , Airi Salminen, and
          <string-name>
            <given-names>Anja</given-names>
            <surname>Mursu</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>ICT Barriers and Critical Success Factors in Developing Countries</article-title>
          .
          <source>The Electronic Journal of Information Systems in Developing Countries</source>
          <volume>56</volume>
          ,
          <issue>1</issue>
          (
          <year>2013</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>17</lpage>
          . DOI:http://dx.doi.org/10.1002/j.1681-
          <fpage>4835</fpage>
          .
          <year>2013</year>
          .tb00401.x
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>Aaron</given-names>
            <surname>Ciaghi</surname>
          </string-name>
          and
          <string-name>
            <given-names>Adolfo</given-names>
            <surname>Villafiorita</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Crowdsourcing ICTD best practices</article-title>
          .
          <source>In International Conference on e-Infrastructure and e-Services for Developing Countries</source>
          ,
          <fpage>167</fpage>
          -
          <lpage>176</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [35]
          <string-name>
            <given-names>Arul</given-names>
            <surname>Chib</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.l.e</given-names>
            <surname>Komathi</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Extending the TechnologyCommunity-Management model to disaster recovery: Assessing vulnerability in rural Asia</article-title>
          .
          <source>2009 International Conference on Information and Communication Technologies and Development (ICTD)</source>
          (
          <year>2009</year>
          ). DOI:http://dx.doi.org/10.1109/ictd.
          <year>2009</year>
          .5426694
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>Jaco</given-names>
            <surname>Renken</surname>
          </string-name>
          and Richard Heeks.
          <year>2013</year>
          .
          <article-title>Conceptualising ICT4D project champions</article-title>
          .
          <source>Proceedings of the Sixth International Conference on Information and Communications Technologies and Development Notes - ICTD 13 -</source>
          volume
          <volume>2</volume>
          (
          <year>2013</year>
          ). DOI:http://dx.doi.org/10.1145/2517899.2517928
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [37]
          <string-name>
            <surname>Roger</surname>
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Mayer</surname>
          </string-name>
          ,
          <string-name>
            <surname>James H. Davis</surname>
            , and
            <given-names>F. David</given-names>
          </string-name>
          <string-name>
            <surname>Schoorman</surname>
          </string-name>
          .
          <year>1995</year>
          .
          <article-title>An integrative model of organizational trust</article-title>
          .
          <source>Academy of management review 20</source>
          ,
          <issue>3</issue>
          (
          <year>1995</year>
          ),
          <fpage>709</fpage>
          -
          <lpage>734</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          [38]
          <string-name>
            <given-names>Mikael</given-names>
            <surname>Lindvall</surname>
          </string-name>
          et al.
          <year>2002</year>
          .
          <article-title>Empirical Findings in Agile Methods</article-title>
          .
          <source>Extreme Programming and Agile Methods - XP/Agile Universe 2002 Lecture Notes in Computer Science</source>
          (
          <year>2002</year>
          ),
          <fpage>197</fpage>
          -
          <lpage>207</lpage>
          . DOI:http://dx.doi.org/10.1007/3-540-45672- 4_
          <fpage>19</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          [39]
          <string-name>
            <given-names>Aniket</given-names>
            <surname>Mahanti</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Challenges in Enterprise Adoption of Agile Methods - A Survey</article-title>
          .
          <source>Journal of Computing and Information Technology</source>
          <volume>14</volume>
          ,
          <issue>3</issue>
          (
          <year>2006</year>
          ),
          <fpage>197</fpage>
          . DOI:http://dx.doi.org/10.2498/cit.
          <year>2006</year>
          .
          <volume>03</volume>
          .03
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          [40]
          <string-name>
            <given-names>Hilkka</given-names>
            <surname>Merisalo-Rantanen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Tuure</given-names>
            <surname>Tuunanen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Matti</given-names>
            <surname>Rossi</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Is Extreme Programming Just Old Wine in New Bottles</article-title>
          .
          <source>Journal of Database Management</source>
          <volume>16</volume>
          ,
          <issue>4</issue>
          (
          <year>2005</year>
          ),
          <fpage>41</fpage>
          -
          <lpage>61</lpage>
          . DOI:http://dx.doi.org/10.4018/jdm.2005100103
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          [41]
          <string-name>
            <surname>Alberto</surname>
            <given-names>Sillitti</given-names>
          </string-name>
          , Martina Ceschi,
          <source>Barbara Russo, an Giancarlo Succi</source>
          .
          <year>2005</year>
          .
          <article-title>Managing Uncertainty in Requirements: A Survey in Documentation-Driven and Agile Companies</article-title>
          .
          <source>11th IEEE International Software Metrics Symposium (METRICS05)</source>
          . DOI:http://dx.doi.org/10.1109/metrics.
          <year>2005</year>
          .29
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          [42]
          <string-name>
            <given-names>Lan</given-names>
            <surname>Cao</surname>
          </string-name>
          and
          <string-name>
            <given-names>Balasubramaniam</given-names>
            <surname>Ramesh</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Agile requirements engineering practices: An empirical study</article-title>
          .
          <source>IEEE software 25</source>
          ,
          <issue>1</issue>
          (
          <year>2008</year>
          ),
          <fpage>60</fpage>
          -
          <lpage>67</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          [43]
          <string-name>
            <surname>Minna</surname>
            <given-names>Pikkarainen</given-names>
          </string-name>
          , Jukka Haikara, Outi Salo, Pekka Abrahamsson, and
          <string-name>
            <given-names>Jari</given-names>
            <surname>Still</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>The impact of agile practices on communication in software development</article-title>
          .
          <source>Empirical Software Engineering</source>
          <volume>13</volume>
          ,
          <issue>3</issue>
          (
          <year>2008</year>
          ),
          <fpage>303</fpage>
          -
          <lpage>337</lpage>
          . DOI:http://dx.doi.org/10.1007/s10664-008-9065-9
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          [44]
          <string-name>
            <given-names>David</given-names>
            <surname>Janzen</surname>
          </string-name>
          and
          <string-name>
            <given-names>Hossein</given-names>
            <surname>Saiedian</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Test-driven development concepts, taxonomy, and future direction</article-title>
          .
          <source>Computer</source>
          <volume>38</volume>
          ,
          <issue>9</issue>
          (
          <year>2005</year>
          ),
          <fpage>43</fpage>
          -
          <lpage>50</lpage>
          . DOI:http://dx.doi.org/10.1109/
          <string-name>
            <surname>mc</surname>
          </string-name>
          .
          <year>2005</year>
          .314
        </mixed-citation>
      </ref>
      <ref id="ref46">
        <mixed-citation>
          [45]
          <string-name>
            <given-names>Chris</given-names>
            <surname>Mann</surname>
          </string-name>
          and
          <string-name>
            <given-names>Frank</given-names>
            <surname>Maurer</surname>
          </string-name>
          .
          <article-title>A case study on the impact of scrum on overtime and customer satisfaction</article-title>
          .
          <source>Agile Development Conference (ADC05)</source>
          . DOI:http://dx.doi.org/10.1109/adc.
          <year>2005</year>
          .1
        </mixed-citation>
      </ref>
      <ref id="ref47">
        <mixed-citation>
          [46]
          <string-name>
            <surname>Katiuscia</surname>
            <given-names>Mannaro</given-names>
          </string-name>
          , Marco Melis, and
          <string-name>
            <given-names>Michele</given-names>
            <surname>Marchesi</surname>
          </string-name>
          .
          <year>2004</year>
          .
          <article-title>Empirical Analysis on the Satisfaction of IT Employees Comparing XP Practices with Other Software Development Methodologies</article-title>
          .
          <source>Extreme Programming and Agile Processes in Software Engineering Lecture Notes in Computer Science</source>
          (
          <year>2004</year>
          ),
          <fpage>166</fpage>
          -
          <lpage>174</lpage>
          . DOI:http://dx.doi.org/10.1007/978-3-
          <fpage>540</fpage>
          -24853-8_
          <fpage>19</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref48">
        <mixed-citation>
          [47]
          <string-name>
            <surname>David</surname>
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Rico</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>What is the Return on Investment (ROI) of Agile Methods?</article-title>
          . (
          <year>2008</year>
          ). http://ww.davidfrico.com/rico08a.pdf
        </mixed-citation>
      </ref>
      <ref id="ref49">
        <mixed-citation>
          [48]
          <string-name>
            <surname>Sridhar</surname>
            <given-names>Nerur</given-names>
          </string-name>
          , Radhakanta Mahapatra, and
          <string-name>
            <given-names>George</given-names>
            <surname>Mangalaraj</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Challenges of migrating to agile methodologies</article-title>
          .
          <source>Communications of the ACM 48</source>
          ,
          <issue>5</issue>
          (
          <year>January 2005</year>
          ),
          <fpage>72</fpage>
          -
          <lpage>78</lpage>
          . DOI:http://dx.doi.org/10.1145/1060710.1060712
        </mixed-citation>
      </ref>
      <ref id="ref50">
        <mixed-citation>
          [49]
          <string-name>
            <given-names>Harald</given-names>
            <surname>Holz</surname>
          </string-name>
          and
          <string-name>
            <given-names>Frank</given-names>
            <surname>Maurer</surname>
          </string-name>
          .
          <year>2003</year>
          .
          <article-title>Knowledge Management Support for Distributed Agile Software Processes</article-title>
          .
          <source>Advances in Learning Software Organizations Lecture Notes in Computer Science</source>
          (
          <year>2003</year>
          ),
          <fpage>60</fpage>
          -
          <lpage>80</lpage>
          . DOI:http://dx.doi.org/10.1007/978-3-
          <fpage>540</fpage>
          -40052-
          <issue>3</issue>
          _
          <fpage>7</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref51">
        <mixed-citation>
          [50]
          <string-name>
            <given-names>Devinder</given-names>
            <surname>Thapa</surname>
          </string-name>
          and
          <string-name>
            <given-names>Mathias</given-names>
            <surname>Hatakka</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Introduction to ICT4D: ICTs and Sustainable Development Minitrack</article-title>
          .
          <source>In Proceedings of the 50th Hawaii International Conference on System Sciences, 2579</source>
        </mixed-citation>
      </ref>
      <ref id="ref52">
        <mixed-citation>
          [51]
          <string-name>
            <given-names>Amy</given-names>
            <surname>Law</surname>
          </string-name>
          and
          <string-name>
            <given-names>Raylene</given-names>
            <surname>Charron</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Efects of agile practices on social factors</article-title>
          .
          <source>Proceedings of the 2005 workshop on Human and social factors of software engineering - HSSE</source>
          <volume>05</volume>
          (
          <year>2005</year>
          ). DOI:http://dx.doi.org/10.1145/1083106.1083115
        </mixed-citation>
      </ref>
      <ref id="ref53">
        <mixed-citation>
          [52]
          <string-name>
            <given-names>Toby</given-names>
            <surname>Marshall</surname>
          </string-name>
          <string-name>
            <surname>Egan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Baiyin</given-names>
            <surname>Yang</surname>
          </string-name>
          , and
          <string-name>
            <surname>Kenneth</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Bartlett</surname>
          </string-name>
          .
          <year>2004</year>
          .
          <article-title>The efects of organizational learning culture and job satisfaction on motivation to transfer learning and turnover intention</article-title>
          .
          <source>Human Resource Development Quarterly</source>
          <volume>15</volume>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref54">
        <mixed-citation>
          <volume>3</volume>
          (
          <issue>2004</issue>
          ),
          <fpage>279</fpage>
          -
          <lpage>301</lpage>
          . DOI:http://dx.doi.org/10.1002/hrdq.1104
        </mixed-citation>
      </ref>
      <ref id="ref55">
        <mixed-citation>
          [53]
          <string-name>
            <given-names>Cedric</given-names>
            <surname>Hsi-Jui Wu</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>A re-examination of the antecedents and impact of customer participation in service</article-title>
          .
          <source>The Service Industries Journal</source>
          <volume>31</volume>
          ,
          <issue>6</issue>
          (
          <year>2011</year>
          ),
          <fpage>863</fpage>
          -
          <lpage>876</lpage>
          . DOI:http://dx.doi.org/10.1080/02642060902960768
        </mixed-citation>
      </ref>
      <ref id="ref56">
        <mixed-citation>
          [54]
          <string-name>
            <surname>Albert</surname>
            <given-names>O.</given-names>
          </string-name>
          <string-name>
            <surname>Hirschman</surname>
          </string-name>
          .
          <year>1970</year>
          .
          <article-title>Exit, voice and loyalty: Responses to decline in ifrms, organizations, and states</article-title>
          . Cambridge, MA, Harvard University Press
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>