<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Automation and E-government Services - A Widened Perspective</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Åsa Cajander</string-name>
          <email>asa.cajander@it.uu.se</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>ACM Classification Keywords</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Elina Eriksson</string-name>
          <email>elina.eriksson@it.uu.se</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>H.5.2. User Interfaces---User-centered design. General</institution>
          ,
          <addr-line>Terms: UCSD, Management, Design, Human Factors., Additional Key Words: Participatory Design</addr-line>
          ,
          <institution>Studies of, Organizations and Usability Studies</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>IT/HCI Uppsala University</institution>
          ,
          <addr-line>PO Box 337, SE-751 05 Uppsala</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2007</year>
      </pub-date>
      <fpage>3</fpage>
      <lpage>6</lpage>
      <abstract>
        <p>This short paper questions the focus on automation of egovernment processes, and efficiency in e-government, which is prevalent in both research and in practice in Swedish governments. We argue that this focus on automation and efficiency might cause unhealthy work for civil servants, and services that do not meet the demands or needs of the citizens. Hence, the role of the civil servant must be reconsidered, from a mere “overseer” of an automated process, to a highly skilled worker that provides complex services and works efficiently with information. Moreover, research on egovernment should elaborate more on the changes that needs to be done in the services provided, as well as which services that are suitable for the Internet and other media.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The maturity of e-government is a whole research area,
and governments can be in different stages of maturity,
as described by Layne and Lee [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Efficiency,
effectiveness and meeting the citizens needs are
mentioned as a driving force, however, the authors do
not describe how a service within a government should
be changed to meet the need of the citizen, and which
types of services are suitable for the Internet. In their
model, the highest level of maturity is when there is a
horizontal integration of government services, which
means that services are integrated between
governmental agencies. This is further elaborated in the
article of Punia and Saxena [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] who has developed a
framework for handling inter-organisational workflows.
The aim of the e-government is automation of existing
services or processes, which we have experience in our
research [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ]. This is further stretched by the study by
Krokan and Midtbust [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] in which their aim was to
understand why a governmental agency in Norway did
not automate. Automation and inter-organizational
services is also mentioned in an article by Arendsen and
van Engers [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], they see the reduction of the
administrative burden as one of the larger goals of
egovernment.
      </p>
      <p>
        Another dominant discourse found in contemporary
research concerns the user, and user involvement;
however, they often have a high focus on the citizen.
Følstad et al in their study [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] has interviewed project
leaders in e-government projects, asking them about
user involvement. Their result shows that the project
leaders think they have good user involvement,
although too little HCI-methods.
      </p>
      <p>
        However, poor usability and a stressful work situation is
still a significant problem in computer supported work,
despite years of research efforts to increase focus on
these issues [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. We must not forget that the user of
governmental services is both the citizens, and the civil
servant, i.e. the civil servant that work within the
government. e-Government applications risk causing
even more health problems as the strong focus on the
automation and efficiency results in applications with
poor usability causing a bad work environment for civil
servants. Moreover, the above-mentioned articles do not
elaborate on the changing role of the users, neither have
they elaborated on the change of the services.
This position paper aims at discussing and interpreting
the high focus on automation, and the problems this
focus might lead to. We claim that research within
egovernment must widen the perspective to include a
discussion about services and users and not only focus
on different ways of integrating governmental systems
or on the processes per se.
      </p>
      <p>
        RESEARCH SETTING
We are involved in research projects together with three
public authorities in Sweden. The projects are partly
funded by the Swedish Development Council for the
Public Sector (Utvecklingsrådet) where focus is at
computer-supported administrative work and health
factors. The project goal of the organization is to get
better systems for their civil servants and by this healthy
work and more healthy workers. All of the authorities
are developing enhanced e-governance. The research
goal is to understand how an organization understands
user centered system design, implements the methods,
and make use of them. We are also interested in
understanding what are the obstacles and beneficial
factors of the implementation process. Our research
group has been involved in these projects, as
researchers and to support the organizations’ work.
Our research aims at influencing systems development
in practice; hence research is carried out in real life
settings with an action research methodology [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Data
is gathered and analysed with a qualitative research
approach with interview studies, meetings with
stakeholders, analysis of documentation, observations
and field studies.
      </p>
      <p>Our research is based on a constructivist and
interpretive perspective, where we create and
understand our reality by using language through
communication. Interpretations are flexible, situated,
and socially constructed. Research based on case
studies leads to contextual in-depth knowledge, and
should not be generalized. We as researchers, the
context, the organization and the conditions under
which the research takes place, color the results.
However, the organizations and the findings are not
unique or unusual and therefore we hope that the reader
will find the knowledge gained applicable in other
settings, and as a background to create a discussion
about the focus of e-government reserach.</p>
      <p>SNAPSHOTS FROM REALITY
In our research we have found that some stakeholders to
systems development, as for example the unions, and
the human resource department discuss the future work
of civil servants in terms of it being more complicated
and complex due to automation of services and
processes. From their perspective the role of the civil
servants in the future e-government where processes are
automated will be to take care of complicated cases and
to “support” the computer when it fails to process a
case.</p>
      <p>However, there is also a discussion where the civil
servants are seen as less skilled workers that can be
replaced by an automated system. An example is the
view of the future organisation described by several
managers in one of the organisations. In this vision of
the future, there are no civil servants and the only
people working in the organisation monitor computers
that process all the case handling work.
“My vision of the future is three men in a bunker inside
a mountain.”
Even though the manager cited above have an extreme
view of the level of automation, there is indeed a strong
focus on automation of case handling in all authorities
participating in our research projects. Automation is
seen as a way of increasing efficiency in the
organization. Increased automation of case handling has
top priority, and all the authorities but one have
implemented electronic case handling at least to some
extent. Visions about the future are based on the idea
that citizens (customers) fill out and send forms and
applications, etc, electronically, the main part of the
case handling will be done automatically and computers
will “make” the decisions. When deciding on what
aspects to automate in the computer systems, the work
situation is seldom considered and consequently
consists of what is left when the computer has done its
best:
“We automate things, and the rest is a bunch of tasks
for users. And these are closely connected to how we
have developed the automatic process. And what is left
there is something I feel we have no control of”
One of the systems development projects that we have
followed as a part of our action research project has the
aim to improve the decision process with a better GUI
for texts and decisions sent to the customers. The main
reason for this is to make the process more efficient, as
it has been quite time consuming with the old system.
The project also aims at automating parts of the case
handling. However, as the project manager is very
interested in usability, and a good work environment, it
has been important to include civil servants in the
system development project. After the first iteration,
where the new decision text system was tested with
users we had a meeting with the project manager. The
civil servants testing the system had spent minutes
reading and controlling the automated decisions made
by the computers. They did not trust the computer, and
were not willing to send decisions to customers without
reading and understanding them first.</p>
      <p>
        Furthermore, our studies have revealed that there is a
gap between the civil servants’ work and work
situation, and the way this work is described in the
systems development. In the systems development
projects, the civil servants’ work is frequently discussed
in terms of simple steps and operations, that may be
predefined and automated in accordance with clearly
defined rules and regulations this is also discussed by
Boivie [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Little attention is being paid to such issues
as routinisation and repetitiveness of work tasks, control
over work situation, control over pace and order of
tasks, social support and deskilling, all of which are
well-known risk factors for occupational health
complaints.
      </p>
      <p>It was seen as a problem that civil servants have to
make decisions in complex cases where the computer
fails to generate a decision and where “human”
judgement is required. These “human” decisions were
seen as subjective and open to interpretations – which is
the reason that the computer fails to make them in the
first place – and the civil servants making the decisions
were seen as incompetent.</p>
      <p>The design and development of computer systems are
based on information flow models the case handling
process in the organisations that we have studies. This
results in IT systems that do not support the situated
nature of work. One example of this is that the system
does not support that the civil servant works with
several cases at once, and there is no possibility to save
the work done so far in a case if you want to move on to
another case or if the telephone rings. Moreover, this
perspective may lead to inflexible and rigid computer
systems that shape and confine work situations, as is
illustrated by this comment:
”The new computer system forces you to do things in a
specific way. Previously we had different alternatives”
CONCLUDING REMARKS
In the previous section we have described a few
snapshots from our research projects, and in this section
we would like to direct the reader to a couple of
interpretations and implications of this focus on
automation of e-Government services.</p>
      <p>
        One of the basic values underpinning automation of
work in the governments included in our studies is the
notion that human decisions are objective and based on
facts. This means they believe that decisions can be
translated into computer code based on computer logic
with if- and else-statements etc. There is little
recognition that decisions may involve judgements, and
that case handling might include subjective and
contextual elements that will be impossible to transfer
to computers. It seems that the thoughts of Lucy
Suchman have not yet reached these governments [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
In the perspective on work and automation presented in
the results section, humans and their work are often
thought of as rational and predictable. Our studies
indicate that there is a tendency to elevate the rational
and structural dimensions of work, as in Morgan’s
machine metaphor [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The official and structured way
of representing work in the organisations in our studies
is through explicit models, such as described by [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
This perspective on work obscures human aspects of
work as a complex, situated and social process [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
However, work is more than procedures that can be
defined and fully understood. Work is also a complex
social process, and civil servants constantly
communicate and interact with each other to solve
problems and to make decisions. From the engineering
oriented perspective these aspects are blurred and
ignored. Instead computer supported work is seen
almost as a flow of information between the computer
and the user, as in use-cases1 for example. However,
work has a purpose and is driven by goals or intentions
and that work is specific to the context and shaped by
circumstances of the situation as it evolves – i.e. it is
situated and contextual [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Thus the
engineeringoriented perspective on users’ work and work practices
as well-defined models ignores the situated and social
nature work. The engineering-oriented perspective does
not address users’ practical knowledge about their
work, their understanding about “what-to-do” as well as
“how-to” in a specific situation [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>
        It is essential to understand users’ current work
practices, and how these practices may be affected and
improved by new technology. A fragmentary
understanding of the work situation, and the perspective
on work as procedures and sequential steps or
operations, may result in IT systems that are poorly
adapted to the users’ needs, causing frustration and
strain in the work situation. The system built does not
support the situated, contextual nature of the work. In
our studies, we have seen that systems development is
often based on an engineering-oriented view of problem
solving, where the system forces the users through a
workflow divided into a number of windows on the
screen. Each window containing only what is believed
to be relevant information for the specific task, and with
no possibility to go backwards or forwards or to save or
pause. This engineering-perspective is closely related to
the systems theoretical perspective, which places
emphasis on technical and formal aspects of the
relationship between man and machine [
        <xref ref-type="bibr" rid="ref17 ref18">17, 18</xref>
        ]. In an
engineering-oriented perspective, users are primarily
defined by their relation to a technical system.
What will be the role of the civil servant when more and
more services will be automated? Layne and Lee [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]
describe a situation where systems are integrated and
automated the “government employees are now
becoming more an overseer of the process than a simple
task-oriented assembly-line worker”. In our experience
it is of utmost importance to include the users in the
change of an IT-system, and consider the work that will
be the result of the new IT-system.
      </p>
      <p>
        Another problem is that the user in the form of citizens,
are not making decisions or using the service in a way
that the government anticipated, as in one of the
examples mentioned above. When automating, or
putting a service on the Internet, the behaviour of the
user might change, and they might pose different, or
new demands on the government. This can already be
seen in other e-service markets, for example banking
and travel agencies as shown in the work of Värlander
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. Värlander shows in her work that there is an
overflow from e-services that affect the physical world
1 use case is a technique for capturing requirements of
systems that is used in Rational Unified Process
15. Kruchten, P., The Rational Unified Process: An
Introduction. 2003: Addison-Wesley Professional.
in that face-to-face meetings become more important.
E-government research can learn something from this
research, and try to find out which kind of services are
more suitable for virtualisation, and which should be
kept in the physical world. Moreover, the role of the
civil servant will change and the work will not merely
be “overseeing” the automated process, rather it will be
focused on meeting the new kinds of demands from the
citizen, where efficiency regarding time will be less
important, and information efficiency more important
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ].
      </p>
      <p>AUTHORS EXPERIENCE IN THE FIELD
Åsa Cajander and Elina Eriksson are PhD-students at
Uppsala University, with Jan Gulliksen as supervisor.
Both authors are involved in a research project with
three Swedish governments as partners. The aim of the
research project is improving usability and health in
computer-supported administrative work.</p>
      <p>The HCI-group at Uppsala University has been
involved with e-government related research for the
past decade. One major concern is that too much
emphasis is put on the user experience of citizens using
e-services, before the civil servants and their changing
work. When moving more services to the Internet, the
work of civil servants will also change. The issues
around healthy work and civil servants are important
and perhaps not that prevalent in e-government
research. Even though the aim of the project is not first
and foremost e-governance, the presented perspective
plays an important role for all research in the area.
ACKNOWLEGEMENTS
The authors would like to thank the public authorities,
and all the people we have been in contact with in these
projects.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Krokan</surname>
            , A. and
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Midtbust</surname>
          </string-name>
          .
          <article-title>Why don't they automate. in User involvement and representation in eGovernment projects</article-title>
          . Workshop at NordiCHI
          <year>2006</year>
          .
          <year>2006</year>
          . Oslo, Norway.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Groenlund</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <article-title>State of the art in e-Gov research: A survey</article-title>
          , in Electronic Government: Third International Conference, EGOV.
          <year>2004</year>
          , SpringerVerlag Berlin/Heidelberg.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Layne</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Lee</surname>
          </string-name>
          ,
          <article-title>Developing fully functional E-government: A four stage model</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <year>2001</year>
          .
          <volume>18</volume>
          (
          <issue>2</issue>
          ): p.
          <fpage>122</fpage>
          -
          <lpage>136</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Punia</surname>
            ,
            <given-names>D.K.</given-names>
          </string-name>
          and
          <string-name>
            <surname>K.B.C. Saxena</surname>
          </string-name>
          ,
          <article-title>Managing inter-organisational workflows in eGovernment services</article-title>
          ,
          <source>in Proceedings of the 6th international conference on Electronic commerce</source>
          .
          <year>2004</year>
          :
          <article-title>Delft, The Netherlands</article-title>
          . p.
          <fpage>500</fpage>
          -
          <lpage>505</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Cajander</surname>
            , Å.,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Gulliksen</surname>
            ,
            <given-names>and I. Boivie</given-names>
          </string-name>
          ,
          <article-title>Management perspectives on usability in a public authority: a case study</article-title>
          ,
          <source>in Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles</source>
          .
          <year>2006</year>
          . p.
          <fpage>38</fpage>
          -
          <lpage>47</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Cajander</surname>
          </string-name>
          , Å.,
          <source>Values and Perspectives Affecting IT Systems Development and Usability Work</source>
          , in Department of Information Technology.
          <year>2006</year>
          , Uppsala University: Uppsala.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Arendsen</surname>
            , R. and
            <given-names>T.M. van Engers</given-names>
          </string-name>
          ,
          <article-title>Reduction of the Administrative Burden: An e-Government Perspective</article-title>
          , in Electronic Government.
          <year>2004</year>
          , Springer Berlin/Heidelberg. p.
          <fpage>200</fpage>
          -
          <lpage>206</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Følstad</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>H.D.</given-names>
            <surname>Jørgensen</surname>
          </string-name>
          , and
          <string-name>
            <surname>J. Krogstie,</surname>
          </string-name>
          <article-title>User involvement in e-government development projects, in Proceedings of the third Nordic conference on Human-computer interaction</article-title>
          ,
          <source>NordiCHI'04</source>
          .
          <year>2004</year>
          : Tampere, Finland. p.
          <fpage>217</fpage>
          -
          <lpage>224</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Åborg</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <article-title>How does IT feel @ work? And how to make IT better</article-title>
          .:
          <article-title>Computer use, stress and health in office work</article-title>
          .
          <year>2002</year>
          , Acta Universitatis Upsaliensis: Uppsala. p.
          <fpage>50</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Avison</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , et al.,
          <source>Action Research. Communications of the ACM</source>
          ,
          <year>1999</year>
          .
          <volume>42</volume>
          (
          <issue>1</issue>
          ): p.
          <fpage>94</fpage>
          -
          <lpage>97</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Boivie</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>A Fine</given-names>
            <surname>Balance</surname>
          </string-name>
          <article-title>: Addressing Usability and Users Needs in the Development of IT Systems for the Workplace</article-title>
          .
          <year>2005</year>
          , Acta Universitatis Upsaliensis: Uppsala. p.
          <fpage>85</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12. Morgan,
          <string-name>
            <surname>G.</surname>
          </string-name>
          , Images of Organization.
          <year>1997</year>
          , London: Sage Publication Ltd.
          <volume>485</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Sachs</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <article-title>Transforming work: collaboration, learning, and design</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <year>1995</year>
          .
          <volume>38</volume>
          (
          <issue>9</issue>
          ): p.
          <fpage>36</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Suchman</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <article-title>Plans and Situated Actions: The Problem of Human-Machine Communication</article-title>
          .
          <year>1987</year>
          , Cambridge: Cambridge University press.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kruchten</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <source>The Rational Unified Process: An Introduction</source>
          .
          <year>2003</year>
          :
          <string-name>
            <surname>Addison-Wesley Professional</surname>
          </string-name>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Schön</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , The Reflective Practitioner - How Professionals Think in Action.
          <year>1995</year>
          , Aldershot, UK: Ashgate Publishing.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Nurminen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <article-title>Different perspectives: what are they and how can they be used? in In System Design for Human Development and productivity</article-title>
          , B. Participation, Docherty, Editor.
          <year>1987</year>
          ,
          <string-name>
            <given-names>Elsevier</given-names>
            <surname>Science</surname>
          </string-name>
          , Noth Holland. p.
          <fpage>163</fpage>
          -
          <lpage>174</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Kammersgaard</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <source>Four Different Perspectives on Human Computer Interaction</source>
          , in Human-Computer
          <string-name>
            <surname>Interaction</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Preece</surname>
          </string-name>
          and L. Keller, Editors.
          <year>1990</year>
          , Prentice-Hall: University Press: Cambridge.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Värlander</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <source>Framing and Overflowing: How the Infusion of Information Technology Alters Proximal Service Production</source>
          .
          <year>2007</year>
          , Stockholm University, School of Business: Stockholm. p.
          <fpage>216</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>