<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>and enterprise architecture. He has published more
than 100 articles in numerous journals and leading conferences. Dr. Pekkola is Associate Editor for Business
Information Systems and Engineering and Digital Government: Research and Practice</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Who is the Target User of a Patient Record System?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Pasi Raatikainen</string-name>
          <email>pasi.raatikainen@tuni.fi</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Samuli Pekkola</string-name>
          <email>samuli.pekkola@tuni.fi</email>
        </contrib>
      </contrib-group>
      <pub-date>
        <year>2003</year>
      </pub-date>
      <fpage>104</fpage>
      <lpage>117</lpage>
      <abstract>
        <p>Information systems aim to serve different users and their varying needs. This emphasizes user centered development because users, as experts of their work practices and contexts, have insights how the future system should serve their needs. However, it is ambiguous what is meant by the user centeredness, or who actually are the users. The issue is emphasized in large-scale public sector information systems, that are used by and influence myriad of individuals, some of who may be perceived as users or end-users. These users may not necessarily share a common interest towards the system. Under the circumstances the identification and definition of a user is exemplified since the system may not serve all the user groups in a similar manner or at the same quality level. We aim at identifying the users in a large-scale information systems project, namely a patient record system, in a single qualitative case study. Our identification of different levels of users provides a base for conceptualizing the user, and for explicitly addressing them either proactively in the development or later when conducting a postmortem analysis.</p>
      </abstract>
      <kwd-group>
        <kwd>Users</kwd>
        <kwd>Information systems development</kwd>
        <kwd>Public sector Information Systems</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Public organizations provide different services to citizens
        <xref ref-type="bibr" rid="ref25">(Lindgren &amp; Jansson, 2013)</xref>
        . Several public
information systems (IS) are used to support the authorities and institutions and their employees,
i.e. individual actors providing the services (Sundgren, 2012). While it is common to speak of a
citizen receiving public services as a customer
        <xref ref-type="bibr" rid="ref4">(Alford, 2002; Jansson et al., 2012)</xref>
        , the notion of a user
is not discussed explicitly in context of large-scale public sector IS. Traditionally, and implicitly, the
IS users have been assumed to be those who actually use the system
        <xref ref-type="bibr" rid="ref16 ref8">(Gulliksen et al., 1999; Bano &amp;
Zowghi, 2015)</xref>
        . Yet there is a fundamental difference here: public services target citizens
        <xref ref-type="bibr" rid="ref25 ref7">(Axelsson
et al., 2010; Lindgren &amp; Jansson, 2013)</xref>
        while information systems serve their users
        <xref ref-type="bibr" rid="ref14">(Delone &amp;
McLean, 1992)</xref>
        . These two are not necessarily the same, meaning the ultimate target actors of the
system not being evident or trivial.
      </p>
      <p>
        For a long time, IS research has explored addressing the users in IS development (ISD)
        <xref ref-type="bibr" rid="ref1 ref19 ref20 ref29 ref30">(Swanson,
1974; Iivari &amp; Iivari, 2006; Iivari &amp; Iivari, 2011; Abelein et al., 2013; Oo Tha, 2019; Martikainen et al.,
2020)</xref>
        . Despite the early taxonomy of end-users
        <xref ref-type="bibr" rid="ref12">(Cotterman &amp; Kumar, 1989)</xref>
        explicit definitions or
methods in identifying the IS user in different situations are rare. In fact, IS user has remained largely
untouched in detailed inspection
        <xref ref-type="bibr" rid="ref21 ref6">(Iivari et al., 2010; Amrit et al., 2013)</xref>
        , although, for example, the
interests are intrinsic
        <xref ref-type="bibr" rid="ref15">(Donaldson &amp; Preston, 1995)</xref>
        . While a high-level compatibility of different
interests could be shared, the stakeholders do not necessarily agree on ends and means
        <xref ref-type="bibr" rid="ref24">(Vidgen,
1987; Kirsch &amp; Haney, 2006)</xref>
        . While some stakeholder needs may be fulfilled, some others may not
be addressed with a similar emphasis or at all. This underlines the importance of identifying the
users and their types
        <xref ref-type="bibr" rid="ref2 ref26 ref8">(Bano &amp; Zowghi, 2015; Lukyanenko et al., 2016; Abusamhadana et al., 2019)</xref>
        ,
making the question of who is the IS user relevant.
      </p>
      <p>
        User involvement in ISD is ambiguous
        <xref ref-type="bibr" rid="ref19 ref20">(Iivari &amp; Iivari, 2006; Iivari &amp; Iivari, 2011)</xref>
        . Practical
instructions on how to consider the users are superficial or contradictory (Pekkola et al., 2006).
Different ISD methods address the users differently
        <xref ref-type="bibr" rid="ref20">(Iivari &amp; Iivari, 2011)</xref>
        and the developers
conceptualize the users in different ways (
        <xref ref-type="bibr" rid="ref22">Isomäki, 2002</xref>
        ). Despite this diversity, addressing the users
is said to be a key to success
        <xref ref-type="bibr" rid="ref17 ref18 ref2 ref28 ref29 ref30 ref36">(He and King 2008; Hsu et al. 2012; Wing et al., 2017; Oo Tha, 2019;
Abusamhadana et al., 2019; Martikainen, 2015; Martikainen et al., 2020)</xref>
        . The users are experts in
their domain and have insights about their work and work practices which should be leveraged in
ISD
        <xref ref-type="bibr" rid="ref1 ref11">(Cherry &amp; Macredie, 1999; Abelein et al., 2013)</xref>
        . User participation generates psychological
buyin among the participants, result in superior systems requirements, improves the relationship
between the developers and the users
        <xref ref-type="bibr" rid="ref27">(Markus &amp; Mao, 2004)</xref>
        , and eventually produces
usersatisfaction
        <xref ref-type="bibr" rid="ref1">(Abelein et al., 2013)</xref>
        . However, who is the ultimate user is not always explicit as different
actors have different interests towards the system
        <xref ref-type="bibr" rid="ref13">(Damodaran, 1996)</xref>
        .
      </p>
      <p>
        In the context of public e-service development, discussion on the user participation is scarce
        <xref ref-type="bibr" rid="ref23">(Karlsson et al., 2012)</xref>
        even though an in-depth exploration of the user engagement in IS
implementation has been urged
        <xref ref-type="bibr" rid="ref10 ref11">(Cherry &amp; Macredie, 1999; Chan &amp; Pan, 2008)</xref>
        . In this paper, we seek
      </p>
      <p>
        Who is the target user of user-centred development of a large-scale IS
address the question by conducting a case study in the largest ISD project of Finland. We adopt the
grounded theory approach
        <xref ref-type="bibr" rid="ref33">(Urquhart, 2012)</xref>
        to inspect how the developers in the patient record
system development project define IS users and how they address them.
      </p>
      <p>The paper is organized as follows: in section 2 we discuss the theoretical background. In section
3 research settings and methods are presented. In section 4 we show our findings. The paper ends
with discussion and concluding sections.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Theoretical Background</title>
      <p>
        Being user-centered in ISD is a wide concept. User-centeredness could mean e.g. user focus,
workcenteredness, or user-participation
        <xref ref-type="bibr" rid="ref19">(Iivari &amp; Iivari, 2006)</xref>
        . User involvement has also been defined as
ychological state reflecting the importance and personal relevance of a system to
consequently does not mean that the users
necessarily participate in the development tasks
        <xref ref-type="bibr" rid="ref36 ref8">(Thakurta, 2014; Bano &amp; Zowghi, 2015; Wing et al.,
2017)</xref>
        . User involvement has been characterized on the continuum of informative, consultative, or
participative user-involvement
        <xref ref-type="bibr" rid="ref13">(Damodaran, 1996)</xref>
        . It can be summarized that effective user
involvement is argued as users having possibilities to influence the development process
        <xref ref-type="bibr" rid="ref13">(Damodaran, 1996; Pekkola et al., 2006)</xref>
        .
      </p>
      <p>
        In ISD, the target user has usually been defined as a person who will use the system for
performing tasks that are part of his or her work activities
        <xref ref-type="bibr" rid="ref16 ref8">(Gulliksen et al., 1999; Bano &amp; Zowghi,
2015)</xref>
        . This connotes with the definition of a first level user or an end-user
        <xref ref-type="bibr" rid="ref12 ref13">(Cotterman &amp; Kumar,
1989; Damodaran, 1996)</xref>
        . Yet the concept of the user of a socio-technical IS is much broader. The
second category of users are those who do not interact with the system but either benefit from the
outcomes of its use
        <xref ref-type="bibr" rid="ref13">(Damodaran, 1996)</xref>
        or use the system through an intermediary
        <xref ref-type="bibr" rid="ref5">(Alsos &amp; Svanaes,
2011)</xref>
        .
        <xref ref-type="bibr" rid="ref13">Damodaran (1996)</xref>
        for example argues that also users who do not directly use the system
should be included in a systematic user analysis, as their interests may significantly differ. Further,
it has been argued that the needs of those whose lives may be affected by a system should also be
considered (
        <xref ref-type="bibr" rid="ref22">Isomäki, 2002</xref>
        , p. 16). Although this has been acknowledged, those users not directly
interacting with the system are often overlooked
        <xref ref-type="bibr" rid="ref5">(Alsos &amp; Svanaes, 2011)</xref>
        .
      </p>
      <p>
        Technological evolution and certain development methods (Taylor et al., 1998;
        <xref ref-type="bibr" rid="ref22">Isomäki, 2002</xref>
        )
have blurred the distinction between the developers and the users (Pouloudi, 1999). It has become
increasingly difficult to distinguish IS users
        <xref ref-type="bibr" rid="ref21">(Iivari et al., 2010)</xref>
        . In complex contexts, such as public
sector
        <xref ref-type="bibr" rid="ref3">(Alanne et al., 2015)</xref>
        and large-scale systems
        <xref ref-type="bibr" rid="ref32">(Tuunanen &amp; Rossi, 2004)</xref>
        , the task is even less
trivial as the number of stakeholders rapidly increases and their knowledge becomes scattered.
Public e-services may be developed for nationwide user groups
        <xref ref-type="bibr" rid="ref7">(Axelsson et al., 2010)</xref>
        . Involving all
possible users individually is a daunting task
        <xref ref-type="bibr" rid="ref11 ref2">(Cherry &amp; Macredie, 1999; Abusamhadana et al., 2019)</xref>
        .
The complexity of the context and limitation of resources makes the question of who to address in
user-centered IS development very arduous.
      </p>
      <p>
        Addressing the users in ISD is consequently a multidimensional concept, varying in how it is
applied in real life systems development. In general, it is rarely comprehensively defined who the
developers consider as the target system users
        <xref ref-type="bibr" rid="ref5">(Alsos &amp; Svanaes, 2011)</xref>
        . Most often they are the first
level users i.e. those who use the system hand-on while working
        <xref ref-type="bibr" rid="ref18 ref2 ref29">(e.g. Hsu et al., 2012;
Abusamhadana et a., 2019; Martikainen et al., 2020)</xref>
        . Consequently, they and their needs,
expectations, desires are elicited and addressed. What is not often explicitly discussed is if and how
are the needs of the more indirect users considered.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Research Setting</title>
      <p>Our case focuses on an ultra large-scale IS renewal project for a group of health care and social care
organizations in Finland. They include a set of municipalities and specific agencies. The patient
record system is estimated to serve around 35.000 social and healthcare professionals and influence
around 1.6 million citizens. The system is estimated to cost approximately 200 , and the total
project around 600 . Project is thus one of the largest IS projects ever in Finland.</p>
      <p>The decision to renew the patient record system was based on a need to integrate data from
hundreds, if not thousands, of individual systems to raise the service level back to an acceptable
level. Previous problems include the use of numerous non-integrated systems, and poor usability
and maintenance. Healthcare and social care were also operating in separate silos. While healthcare
was the initial driver of the project, social care was decided to be involved and included. The aim
was to connect these separate fields of practice through a single system so that the service experience
to the citizens is improved and standardized no matter what service they needed.</p>
      <p>
        Our study follows an interpretative qualitative single case study approach
        <xref ref-type="bibr" rid="ref35">(Walsham, 1995)</xref>
        where the focus is on human interpretations and meanings, embracing the importance of social
issues in ISD. This approach was chosen in order to draw implications from a large IS project
        <xref ref-type="bibr" rid="ref35">(Walsham, 1995)</xref>
        . The case was selected because of its unique nature in size and complexity.
      </p>
      <p>Data collection was conducted between November 2019 and February 2020 by interviewing the
main actors in the project organization. They were assumed to have the best information about the
development practices and processes, and the users. The interviewees were selected through
snowballing sampling (Morgan, 2008). First three interviewees were assigned by our contact person.
Later we asked each interviewee to name the next potential person. The list of the interviewees is
presented in Table 1 with their corresponding expertise.
Management [M2]; [M3]; [M10]
Management [M4]
Management [M5]
Clinical Leadership [Clin1]
Management [M6]
Management [M7]
Consultant [C1]
Management [M8]
Management [M9]</p>
      <p>Expertise</p>
      <sec id="sec-3-1">
        <title>Technology</title>
      </sec>
      <sec id="sec-3-2">
        <title>Development</title>
      </sec>
      <sec id="sec-3-3">
        <title>Product</title>
      </sec>
      <sec id="sec-3-4">
        <title>Operational</title>
      </sec>
      <sec id="sec-3-5">
        <title>Clinical and Social Care</title>
      </sec>
      <sec id="sec-3-6">
        <title>Usability</title>
      </sec>
      <sec id="sec-3-7">
        <title>Customer and Product</title>
      </sec>
      <sec id="sec-3-8">
        <title>Social Care</title>
      </sec>
      <sec id="sec-3-9">
        <title>Product</title>
      </sec>
      <sec id="sec-3-10">
        <title>Unit</title>
        <p>The interviews followed a thematic open interview protocol where the interviewer does not steer
the discussion. The interview questions dig into the case details and events, as perceived by the
interviewees. All interviews, approximately an hour each, were conducted by two interviewers and
face-to-face in the case organization premises. All interviews were recorded and analyzed in Finnish.
Only illustrative quotations are translated into English.</p>
        <p>
          Data analysis followed Grounded Theory Approach
          <xref ref-type="bibr" rid="ref33">(Urquhart, 2012)</xref>
          . Data was analyzed by the
first author line by line without any initial theoretical framework. We were interested in how the
interviewees define the user and the development principles, and how they describe the project
practices. For instance, the interviewees described the project, and all issues were taken as
significant. Each incident was named with a descriptive code. Similar codes then were grouped into
larger groups to represent collective conceptions. Finally, the relationships between the groups of
codes were drawn. An example of the coding procedure is presented in table 2.
-users are
healthcare and social care -users as citizens who use Those who directly use the
professionals, and those citizens -users as those system are perceived as the
[M2]. in direct use-relationship to the system's end users. Professionals
system"´. and management use the IS
        </p>
        <p>-users as organizational directly through its user interface.
management, who uses -users as those Also, the end-users who use the
different reports and in direct use-relationship to the client portal have a direct
usemanagement functionalities system". relationships to the system, and are
and such. They, again, are end- thus perceived as end-users.
users" [M2].</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Findings</title>
      <sec id="sec-4-1">
        <title>4.1. IS Users Defined</title>
        <p>Citizens not using the client portal are not perceived as
are rather
use-relationship</p>
        <p>while they are
endmanagement, on the other hand, were perceived as being direct end-users as they receive
information and use the management support functions provided by the system. All this resulted in
user experience including all the professionals using the system
handsuser-experience, the system is only used by the socia</p>
        <p>However, when talking about the person whose needs were to be fulfilled, the customers were
-users are</p>
        <sec id="sec-4-1-1">
          <title>They</title>
          <p>-on use
the citizens. We have around 1.5 million citizens getting their things done</p>
          <p>gh the citizen
from the system
that work of [healthcare or social care] professionals become easier and they treat patients
The logic of serving professionals was also apparent in the implementation goals. Initially the
Later, it was defined as</p>
        </sec>
        <sec id="sec-4-1-2">
          <title>Also a more high-level entioned. To achieve this, streamlining the work of professionals was seen essential. This issue of goal levels indicates that the work of direct users has a causal relation to producing the benefits to indirect, yet the main group of stakeholders.</title>
          <p>The user viewpoint was strongly emphasized through the direct users' critical role. Serving the
end-users was seen as a key for fulfilling the project -users] to
relationship with the system. It was assumed that their needs are addressed by involving the direct
users (aka pr</p>
          <p>All this underlines a perception that the direct use-relationship directs the definition of end-users,
i.e. whose needs the system targets in the first place. Citizens and other indirect users enjoy the
system through its services. They benefit the system indirectly, through its direct users. The
relationship with the system also seems to define which stakeholders are mostly focused.
4.2.</p>
        </sec>
      </sec>
      <sec id="sec-4-2">
        <title>Addressing Users in Development</title>
        <p>It is apparent that the system was designed with a strong emphasis on professionals who are its
direct users. This is visible in the practice of involving
comparing [this case] to other IS acquisition projects, the viewpoint of what the users need is
ed candidate systems. They also
defined the work processes and aligned them with the system functionalities.</p>
        <p>The users were later granted with a possibility to give feedback and propose development ideas.
endchanges quickly.
put a need for a centralized decisions-making mechanism to coordinate different proposals and
change initiatives. This also points out the emphasis on listening hands-on users. They were
continuously involved in the development in various ways.</p>
        <p>Serving direct end-users is apparent also on the usability efforts. An improved usability was a
significant selection criterium in the tendering. In fact, the chosen system was described having the
best usability compared to its challengers. This led the usability professionals becoming integrated
in the ISD process so that they could analyze the needs and system usability, and perform usability
tests. Direct end-users were participating in those tests.</p>
        <p>Some citizens participated in the development of the client portal. For instance, after the client
portal had been introduced, the citizen feedback initiated new development actions. For example,
to enter th
a small action, it exemplifies the influence of the direct users, citizens in this case.</p>
        <p>The focus on direct users was also explicit in the user stories. They were used in evaluating the
system candidates. The user stories narrated typical scenarios, through which the systems were
demonstrated. This exemplifies the professionals being the main target stakeholders. The
professionals themselves also used their experiences to create the stories. Altogether the stories were
perceived useful as they conveyed information, which could have been easily otherwise ignored.</p>
        <p>It was apparent the direct users' needs were not aligned. In a large and complex project these
diverse needs may have not been treated entirely equally. Social care workers were complaining
about the
the basis [in social care] is that even though the system would enable modern booking
functionalities, we should not take them into use immediately because we have to first learn how to
healthcare professionals. The functionalities, perceived as unsuitable by the others, were still taken
strongly stuck with the healthcare sector model. I just heard that this model still dominates. Since
functionalities were also described as not being well
quantitative. It is not understood that we [in the s
[C1].</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Discussion</title>
      <p>
        While the user involvement in the ISD has been studied and urged, the practice of involving them
has remained ambiguous especially in the context of large-scale systems development. Particularly
discussion about who is the target user and what are the implications of such choice are rare. In this
paper, we have studied who are the target users of a patient record system development. Figure 1
shows the relationships between different user groups and the IS in a patient record system. It
illustrates that the development of a large-scale public sector IS addresses directly healthcare and
social care professionals, administration, and management
        <xref ref-type="bibr" rid="ref31">(Thakurta, 2017)</xref>
        , considering citizens
and even public services only indirectly. Citizens using the client portal is an exception, since they
were considered directly in that narrow context. Medical and social care professionals are the
primary user of the system as they provide services to citizens. Administration uses the system
directly when they support to the actual customer service, such as billing. Management is also in a
direct use-relationship as they use the management functionalities towards the professionals (e.g.
monitoring citizen feedback) and to receive information about the services (e.g. about the patient
flow).
      </p>
      <p>
        In our case, addressing the users directly was an efficient and effective approach at least in
theory. First, they were given a possibility to influence development
        <xref ref-type="bibr" rid="ref13">(Damodaran, 1996; Pekkola et
al., 2006)</xref>
        . However, it is uncertain how effective the involvement actually was since measuring their
influence or observing large scale system changes remains a mystery. There is a possibility for
nonefficient involvement of users
        <xref ref-type="bibr" rid="ref29 ref36">(Wing et al., 2017; Martikainen et al., 2020)</xref>
        . While both parties may be
interested in collaboration, the users perceive their views may not be efficiently considered
        <xref ref-type="bibr" rid="ref28">(Martikainen, 2015)</xref>
        . Our findings parallel with the literature that involving only some groups of
users
        <xref ref-type="bibr" rid="ref2">(Abusamhadana, 2019)</xref>
        especially hands-on users
        <xref ref-type="bibr" rid="ref11">(Cherry &amp; Macredie, 1999)</xref>
        is a typical
usercentered approach.
      </p>
      <p>
        As Figure 1 illustrates, the citizens were not defined having a direct use-relationship with the
system (apart from through the citizen portal which provided only limited functionality). They were
providing services
        <xref ref-type="bibr" rid="ref31">(Thakurta, 2017)</xref>
        . Indirect users were not involved in the ISD. They were
addressed through the professionals and their experiences of typical users. This approach is
common in the form of intermediaries
        <xref ref-type="bibr" rid="ref23 ref7">(Axelsson et al., 2010; Karlsson et al., 2012)</xref>
        .
      </p>
      <p>
        Although direct users were addressed, their interests were not aligned but numerous
interpretations and opinions were common
        <xref ref-type="bibr" rid="ref34">(c.f. Vidgen, 1997)</xref>
        . Especially the users from the social
care and from the healthcare had very differing needs and dissimilar expectations. Also the
management had different priorities. While they embraced the systematicity with project
management, such as holding on to the schedule, the operational level interviews revealed different
views: project deadlines, they are being held on a bit too tightly. Of course
there is a certain schedule but there are reasons for asking whether we can be bit flexible with it. But
        <xref ref-type="bibr" rid="ref24 ref34">(Vidgen,
1997; Kirsch &amp; Haney, 2006)</xref>
        . The interests of hands-on users may also differ from those of indirect
users
        <xref ref-type="bibr" rid="ref13">(Damodaran, 1996)</xref>
        . Our findings indicate that the healthcare professionals and their opinions
ectives are twofold.
      </p>
      <p>
        This means both healthcare and social care should be considered. This imbalance may cause
problems later when the social care is becoming more in the focus of the development
        <xref ref-type="bibr" rid="ref25">(Lindgren &amp;
Jansson, 2013)</xref>
        .
      </p>
      <p>We argue that in large-scale ISD, the services supported with an IS need to be put in the center.
Not individual users nor technologies. This emphasis on the service process will shift the perspective
of who are the users and how their needs should be considered. While the perspective of patients</p>
    </sec>
    <sec id="sec-6">
      <title>6. Conclusion</title>
      <p>We explored how the IS users are addressed in a large-scale public sector IS project. Our findings
indicate that only those who have a direct use-relation to the IS are directly addressed. Secondary
users, although defined as the main stakeholders, were addressed mainly through intermediaries.
The citizens were thought to be at the main focus, but they and the other indirect user groups were
actually considered as indirect beneficiaries. This results in the IS mostly its direct users,
professionals at healthcare and social care.</p>
      <p>Our case demonstrates that addressing the users and user groups in the development of a
largescale public sector IS is not easy or easily balanced. One reason for this is the large number of
ut some groups are overemphasized at the cost of others.</p>
      <p>Those dominate the development, evidently influencing on the perceptions of the final system and
its quality.</p>
      <p>Our findings illustrate what addressing the users means in practice. This helps researchers and
practitioners in defining what the ambiguous concept of user-centeredness means. However, deeper
analysis about how the intermediaries address the needs of main beneficiaries (citizens in our case)
is still urged. Also, it would be beneficial to explore the user-side perceptions and how their needs
are addressed. This should include all user groups, both hands-on users and more indirect users.</p>
      <p>Our main limitation is the single case study approach. This surely provides somehow narrow
perspective, which should be taken into account when generalizing the results. Second, only the
developer organization employees were interviewed, and mostly from the management level. Such
perspective does not thoroughly describe the operational-level issues.
-services: A Conceptual</p>
      <p>Discussion. Electronic Government And Electronic Participation, 202 214.</p>
      <p>Morgan, D. L. (2008). Random sampling. The SAGE encyclopaedia of qualitative research methods. London:</p>
      <p>SAGE Publications, 725-726.</p>
      <p>Pekkola, S., Kaarilahti, N., &amp; Pohjola, P. (2006). Towards formalised end-user participation in information
systems development process: Bridging the gap between participatory design and ISD methodologies.
Proceedings of the 9th Conference on Participatory Design: Expanding Boundaries in Design, PDC
2006, 1, 21 30
Pouloudi, A. (1999). Aspects of the stakeholder concept and their implications for information systems
development. Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences.
Sundgren, B. (2012). What is a public information system?. International Journal of Public Information</p>
      <p>Systems, 1(1).</p>
      <p>Swanson, E. B. (1974). Management information systems: appreciation and involvement. Management
science, 21(2), 178-188.</p>
      <sec id="sec-6-1">
        <title>About the Authors</title>
        <p>Pasi Raatikainen
Samuli Pekkola
Pasi Raatikainen, MSc (Econ. &amp; Bus. Adm) is a doctoral student at Tampere University, Finland. His research
focuses on information systems development.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Abelein</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sharp</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Paech</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Does involving users in software development really influence system success?</article-title>
          .
          <source>IEEE software</source>
          ,
          <volume>30</volume>
          (
          <issue>6</issue>
          ),
          <fpage>17</fpage>
          -
          <lpage>23</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Abusamhadana</surname>
            ,
            <given-names>G. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Elias</surname>
            ,
            <given-names>N. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mukhtar</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Asma</surname>
            'mokhtar,
            <given-names>U.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>User engagement model in information systems development</article-title>
          .
          <source>Journal of Theoretical and Applied Information Technology</source>
          ,
          <volume>97</volume>
          (
          <issue>11</issue>
          ),
          <fpage>2908</fpage>
          -
          <lpage>2930</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Alanne</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hellsten</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pekkola</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Saarenpää</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Three positives make one negative: public sector IS procurement</article-title>
          .
          <source>Proceedings of International Conference on Electronic Government</source>
          , pp.
          <fpage>321</fpage>
          -
          <lpage>333</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Alford</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2002</year>
          ).
          <article-title>Defining the client in the public sector: A social exchange perspective</article-title>
          .
          <source>Public administration review</source>
          ,
          <volume>62</volume>
          (
          <issue>3</issue>
          ),
          <fpage>337</fpage>
          -
          <lpage>346</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Alsos</surname>
            ,
            <given-names>O. A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Svanaes</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Designing for the secondary user experience</article-title>
          .
          <source>IFIP Conference on HumanComputer Interaction</source>
          (pp.
          <fpage>84</fpage>
          -
          <lpage>91</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Amrit</surname>
          </string-name>
          , C.,
          <string-name>
            <surname>van Hillegersberg</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp; van
          <string-name>
            <surname>Diest</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Involving end users to mitigate risk in IS development projects</article-title>
          .
          <source>Journal of Organizational and End User Computing</source>
          ,
          <volume>25</volume>
          (
          <issue>3</issue>
          ), 67
          <fpage>82</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Axelsson</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Melin</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lindgren</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Exploring the importance of citizen participation and involvement in e government projects</article-title>
          .
          <source>Transforming Government: People, Process and Policy</source>
          <volume>4</volume>
          (
          <issue>4</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Bano</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Zowghi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>A systematic review on the relationship between user involvement and system success</article-title>
          .
          <source>Information and Software Technology</source>
          ,
          <volume>58</volume>
          ,
          <fpage>148</fpage>
          -
          <lpage>169</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Barki</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hartwick</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>1989</year>
          ).
          <article-title>Rethinking the Concept of User Involvement</article-title>
          .
          <source>MIS Quarterly</source>
          ,
          <volume>13</volume>
          (
          <issue>1</issue>
          ), 53
          <fpage>63</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Chan</surname>
            ,
            <given-names>C. M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Pan</surname>
            ,
            <given-names>S. L.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>User engagement in e-government systems implementation: A comparative case study of two Singaporean e-government initiatives</article-title>
          .
          <source>Journal of Strategic Information Systems</source>
          ,
          <volume>17</volume>
          (
          <issue>2</issue>
          ),
          <fpage>124</fpage>
          -
          <lpage>139</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Cherry</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Macredie</surname>
            ,
            <given-names>R. D.</given-names>
          </string-name>
          (
          <year>1999</year>
          ).
          <article-title>The importance of context in information system design: an assessment of participatory design</article-title>
          .
          <source>Requirements Engineering</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ),
          <fpage>103</fpage>
          -
          <lpage>114</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Cotterman</surname>
            ,
            <given-names>W. W.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Kumar</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>1989</year>
          ).
          <article-title>User cube: a taxonomy of end users</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>32</volume>
          (
          <issue>11</issue>
          ),
          <fpage>1313</fpage>
          -
          <lpage>1320</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Damodaran</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          (
          <year>1996</year>
          ).
          <article-title>User involvement in the systems design process-a practical guide for users</article-title>
          .
          <source>Behaviour &amp; information technology</source>
          ,
          <volume>15</volume>
          (
          <issue>6</issue>
          ),
          <fpage>363</fpage>
          -
          <lpage>377</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>DeLone</surname>
            ,
            <given-names>W. H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>McLean</surname>
            ,
            <given-names>E. R.</given-names>
          </string-name>
          (
          <year>1992</year>
          ).
          <article-title>Information systems success: The quest for the dependent variable</article-title>
          .
          <source>Information systems research</source>
          ,
          <volume>3</volume>
          (
          <issue>1</issue>
          ),
          <fpage>60</fpage>
          -
          <lpage>95</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Donaldson</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Preston</surname>
            ,
            <given-names>L. E.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>The stakeholder theory of the corporation: Concepts, evidence, and implications</article-title>
          .
          <source>Academy of management Review</source>
          ,
          <volume>20</volume>
          (
          <issue>1</issue>
          ),
          <fpage>65</fpage>
          -
          <lpage>91</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <given-names>Gulliksen J.</given-names>
            ,
            <surname>Lantz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            , and
            <surname>Boivie</surname>
          </string-name>
          ,
          <string-name>
            <surname>I.</surname>
          </string-name>
          <article-title>User Centered Design in Practice Problems and Possibilities: A Summary of the 1998 PDC and</article-title>
          CSCW workshop, SIGCHI Bulletin
          <volume>31</volume>
          (
          <issue>2</issue>
          )
          <year>1999</year>
          . pp.
          <fpage>25</fpage>
          -
          <lpage>35</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>He</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>King</surname>
            ,
            <given-names>W. R.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>The role of user participation in information systems development: implications from a meta-analysis</article-title>
          .
          <source>Journal of Management Information Systems</source>
          ,
          <volume>25</volume>
          (
          <issue>1</issue>
          ),
          <fpage>301</fpage>
          -
          <lpage>331</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Hsu</surname>
            ,
            <given-names>J. S. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>T. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zheng</surname>
            ,
            <given-names>G. T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hung</surname>
            ,
            <given-names>Y. W.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Users as knowledge co-producers in the information system development project</article-title>
          .
          <source>International Journal of Project Management</source>
          ,
          <volume>30</volume>
          (
          <issue>1</issue>
          ),
          <fpage>27</fpage>
          -
          <lpage>36</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Iivari</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Iivari</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Varieties of user-centeredness</article-title>
          .
          <source>Proceedings of the 39th Annual Hawaii International Conference on System Sciences.</source>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Iivari</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Iivari</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Varieties of user centredness: An analysis of four systems development methods</article-title>
          .
          <source>Information Systems Journal</source>
          ,
          <volume>21</volume>
          (
          <issue>2</issue>
          ),
          <fpage>125</fpage>
          -
          <lpage>153</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Iivari</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Isomäki</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Pekkola</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>The user the great unknown of systems development: reasons, forms, challenges, experiences and intellectual contributions of user involvement</article-title>
          .
          <source>Information Systems Journal</source>
          ,
          <volume>20</volume>
          (
          <issue>2</issue>
          ),
          <fpage>109</fpage>
          -
          <lpage>117</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Isomäki</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2002</year>
          ).
          <article-title>The prevailing conceptions of the human being in information systems development: Systems designers' reflections</article-title>
          . Tampere University Press.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Karlsson</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holgersson</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Söderström</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hedström</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Exploring user participation approaches in public e-service development</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <volume>29</volume>
          (
          <issue>2</issue>
          ),
          <fpage>158</fpage>
          -
          <lpage>168</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Kirsch</surname>
            ,
            <given-names>L. J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Haney</surname>
            ,
            <given-names>M. H.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Requirements determination for common systems: turning a global vision into a local reality</article-title>
          .
          <source>Journal of Strategic Information Systems</source>
          ,
          <volume>15</volume>
          (
          <issue>2</issue>
          ),
          <fpage>79</fpage>
          -
          <lpage>104</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Lindgren</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Jansson</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Electronic services in the public sector: A conceptual framework</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <volume>30</volume>
          (
          <issue>2</issue>
          ),
          <fpage>163</fpage>
          -
          <lpage>172</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <string-name>
            <surname>Lukyanenko</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsons</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wiersma</surname>
            ,
            <given-names>Y. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sieber</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Maddah</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Participatory Design for Usergenerated Content: Understanding the challenges and moving forward</article-title>
          .
          <source>Scandinavian Journal of Information Systems</source>
          ,
          <volume>28</volume>
          (
          <issue>1</issue>
          ),
          <fpage>2</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>Markus</surname>
            ,
            <given-names>M. L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Mao</surname>
            ,
            <given-names>J. Y.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Participation in development and implementation-updating an old, tired concept for today's IS contexts</article-title>
          .
          <source>Journal of the Association for Information systems</source>
          ,
          <volume>5</volume>
          (
          <issue>11</issue>
          ),
          <fpage>14</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <string-name>
            <surname>Martikainen</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Towards Better Usability: Usability and End-User Participation in Healthcare Information Technology Systems Development</article-title>
          . Publications of the University of Eastern Finland Dissertations in Forestry and Natural Sciences, (
          <volume>201</volume>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <string-name>
            <surname>Martikainen</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaipio</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lääveri</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>End-user participation in health information systems (HIS) Taylor</article-title>
          , M. J.,
          <string-name>
            <surname>Moynihan</surname>
            ,
            <given-names>E. P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Wood Harper</surname>
            ,
            <given-names>A. T.</given-names>
          </string-name>
          (
          <year>1998</year>
          ).
          <article-title>End user computing and information systems methodologies</article-title>
          .
          <source>Information Systems Journal</source>
          ,
          <volume>8</volume>
          (
          <issue>1</issue>
          ),
          <fpage>85</fpage>
          -
          <lpage>96</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          <string-name>
            <given-names>Oo</given-names>
            <surname>Tha</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Developing a Framework for User Participation in Information System Development Projects</article-title>
          .
          <source>Association for Information Systems (AIS).</source>
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          <string-name>
            <surname>Thakurta</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Identifying the Motives for User Participation in Information System Projects</article-title>
          .
          <source>Pacific Asia Journal of the Association for Information Systems</source>
          ,
          <volume>9</volume>
          (
          <issue>3</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          <string-name>
            <surname>Tuunanen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Rossi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Engineering a method for wide audience requirements elicitation and integrating it to software development</article-title>
          .
          <source>Proceedings of the 37th Annual Hawaii International Conference on System Sciences.</source>
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          <string-name>
            <surname>Urquhart</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Grounded theory for qualitative research: A practical guide</article-title>
          .
          <source>Sage.</source>
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          <string-name>
            <surname>Vidgen</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1997</year>
          ).
          <article-title>Stakeholders, soft systems and technology: separation and mediation in the analysis of information system requirements</article-title>
          .
          <source>Information Systems Journal</source>
          ,
          <volume>7</volume>
          (
          <issue>1</issue>
          ),
          <fpage>21</fpage>
          -
          <lpage>46</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          <string-name>
            <surname>Walsham</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>Interpretive case studies in IS research: nature and method</article-title>
          .
          <source>European Journal of information systems</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ),
          <fpage>74</fpage>
          -
          <lpage>81</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          <string-name>
            <surname>Wing</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andrew</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Petkov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>The changing nature of user involvement in information system development projects</article-title>
          .
          <source>2017 Conference on Information Communication Technology and Society</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>