<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Citizenship in a Digitalized Society: Exploring Administrative Evil in Digital Government⋆</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Hanna Sara-Maria Höglund Rydén</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Cintia Ebner Melchiori</string-name>
          <email>cintia.melchiori@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alessio Maria</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Braccini</string-name>
          <email>abraccini@unitus.it</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Maria Alexandra Cunha</string-name>
          <email>alexandra.cunha@fgv.br</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Øystein Saebø</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Fundação Getulio Vargas - Sao Paulo School of Managment - FGV EAESP</institution>
          ,
          <addr-line>São Paulo</addr-line>
          ,
          <country country="BR">Brazil</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Agder, Department of Information Systems</institution>
          ,
          <addr-line>Kristiansand</addr-line>
          ,
          <country country="NO">Norway</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>University of Tuscia, Department of Economics Engineering Society and Business Organization</institution>
          ,
          <addr-line>Viterbo</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The public sector introduces digital technologies (DT) to deliver public services and to support the political discourse based on ideas of innovation, cost efficiency, and effectiveness. Current literature reflects on what is needed to succeed in so doing where failure is generally explained as the lack of achieving expected benefits. We here argue for the need to discuss digital technology's potentially harmful effects on citizenship, not only as the absence of achieving what is considered good but as direct negative consequences for citizens. Based on the dimensions of citizenship and the concept of administrative evil, we suggest an analytical approach to identify the harmful consequences of introducing digital technologies in governments. We present an exemplary case from Norway to demonstrate the value of our analytical approach. We argue for the need for more research focusing on exploring the causes and causality of administrative evil to increase awareness of the negative implications of digital public services provision on the dimensions of citizenship.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Citizenship</kwd>
        <kwd>digital government</kwd>
        <kwd>digitalized society</kwd>
        <kwd>administrative evil 1</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The e-government literature champions using technologies to make bureaucratic systems
more efficient [
        <xref ref-type="bibr" rid="ref31">1</xref>
        ]. Successes are mainly valued based on metrics such as the number of
subjects involved, retention, or cost-effectiveness, while failures are described as missed
targets [2]. Consequently, following a technical-rational logic, introducing digital
technologies (DT) within the public sector is considered inherently good, where adverse
effects result from absent positive achievements.
      </p>
      <p>We challenge such logic by arguing for the need to explore the negative consequences of
digitalization for citizenship. We do so by discussing how DT may harm citizenship in
digitalized societies where the adoption of digital services has become an integral part of a
global political culture [3]. Citizen-centricity is important since DT should be designed to
address citizens' interests [4], raising the need for more awareness of the potential adverse
outcomes that may be ingrained in them.</p>
      <p>The terminology of citizenship add value to capture the dynamics between citizens and
the state. Citizenship usually refers to the connection between a nation or territory and their
individual members [5, 6], entitling civil, political, and social rights and obligations.
Contemporary digital societies encompass individualized processes, governance structures,
and services that promote self-directed citizenship in a new technology-enabled democracy
[7]. Through DT, resources can be relocated, and work can be transferred to citizens who
engage in digital service procedures, with different outcomes depending on individual
preconditions [8].</p>
      <p>Previous literature acknowledge that DT can negatively impact the most vulnerable
citizens [9, 10], raising the need to critically reflect on the potential negative outcomes of
DT. In this paper, we explore the impact of DT on citizenship by adopting the administrative
evil theory, as exploring administrative evil dynamics will allow to explore conditions and
causes for the negative impacts of DT on citizenship. The concept of administrative evil can
be understood as a masked behaviour performed by bureaucratic apparatuses that inflicts
pain and causes harm to innocent people, possibility inadvertently, without perpetrators –
the bureaucrats - being aware they are doing something wrong. Quite the contrary, they
may believe they are complying with their roles as expected by pairs and superiors,
following the best technical rationality [11].</p>
      <p>To analyse how DT adoption can carry traces of evil, seen in the negative outcomes for
citizens that harm citizens' relations with the public sector and jeopardise citizens' abilities
to take part in society, we combine administrative evil and citizenship theories. The value
of our approach is explored by an exemplary case study of the Norwegian Labour and
Welfare Administration (NAV).</p>
      <p>The paper is structured as follows. First, we present our conceptual approach, combining
citizenship and administrative evil theories in the context of digital societies. Second, we
present our research design and the NAV case description. Preliminary findings and
analyses are then presented, and the discussion and conclusion follow. A future version of
this paper will include more illustrative cases and further methodological steps.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Conceptual Approach</title>
      <p>This section brings together our conceptual approach. In 2.1, we discuss citizenship in a
digitalized society, adopting Stokke's framework [5]. We then discuss how the public sector
bureaucratic apparatus fosters citizenship through DT (section 2.2). Finally, we mobilise
administrative evil theory in relation to DT in the public sector (section 2.3).</p>
      <sec id="sec-2-1">
        <title>2.1. Citizenship in a Digitalized Society</title>
        <p>
          Although the concept of citizenship has been extended through the years because of
migratory movements, globalization, and political struggles regarding identity [5],
citizenship usually refers to the link between a particular nation or official territory and the
members of that community. This relation recognizes and assures individuals as detainers
of an identity, rights, and obligations capable of participating and acting in a specific
geographical space [6]. More than that, citizenship constitutes the nuclear idea of welfare,
aimed at assuring some degree of equality and well-being to all and combating excessive
social stratification [
          <xref ref-type="bibr" rid="ref11">16, 17</xref>
          ].
        </p>
        <p>
          Numerous conceptual models on citizenship delineate the complex relationship between
citizens and the state as citizenship reflects historically and geographically situated political
relations, ideological orientation, comprehension of democracy, and expectations of
citizens' roles [5, 6], although the focus on rights and participation is central in most models
[
          <xref ref-type="bibr" rid="ref11">5, 16</xref>
          ]. In a digitalized society, where interactions between citizens and the public sector
primarily migrate online, DT facilitate fluent borders, reshaping the operational landscape
of citizens and states [6]. Hence, enabling individuals to participate in digital spaces is
essential for actualizing citizenship in a digital society.
        </p>
        <p>In several countries, DT are the primary way for citizens to engage with the government,
demonstrating an ideological pouch for digital society and what has been called "digital
citizenship" [6]. Such citizenship is formed in relation to DT and is characterised by online
encounters between citizens and the state participating out of a digital-first ideal [6].
Ideally, DT can create ownership and empowerment for citizens and bring efficiency gains
for governments [8] with the "self-serving citizen" profile borne out of such ideals [12].
When work tasks are transferred to citizens in the digitalized society, fewer resources will
supposedly be required from administration and public officials [8].</p>
        <p>DT are usually designed with citizens' interests and needs in mind, easing citizens'
workload in service procedures [4]. In this sense, DT can reduce burdens for the public
sector and citizens [13]. However, DT rarely benefit every citizen [14]. In fact, DT harm
some citizens more than others by imposing burdens that make citizens struggle to access
services [15].</p>
        <p>While citizenship figures in a digitalized society, it is, in reality, rooted in offline lives.
This makes the "digital citizen" a state that can be achieved rather than a fixed construct
[19]. However, implying the existence of a "digital citizen" or a "digital citizenship" leads to
assuming the existence of a second-class non-digital citizen who would be automatically
excluded in the digitalized society. The use of DT by governments can be viewed in this
sense as both a means to achieve and fulfill citizenship dimensions or imposing obstacles
that prevent citizenship actualization in practice. Therefore, a broader understanding of
citizenship in a digitalized society is needed, emphasizing society's responsibility to put
preconditions in place for all citizens to participate.</p>
        <p>Actualizing citizenship is fundamental for individuals' inclusion in society, life, and
wellbeing, making the citizenship dimensions essential to understand concerning DT.
Citizenship is not fixed; it is formed from political decisions, making its preconditions
depend on the political agenda that sets the DT targets expressed in government DT
practices [6]. To study the impacts on citizenship resulting from DT use in the public sector,
we adopt Stokke's [5] integral framework composed of four essential and interrelated
dimensions:
1. Membership - distinguishes insiders and outsiders in a community from
ethnocultural and juridical-political perspectives.
2. Legal status implies a contractual relationship between citizens and state, with
rights and responsibilities.
3. Rights – relates to Marshalling [17] threefold typology of civil, political, and social
rights associated with membership and legal status.
4. Participation - involves active engagement in governance, public affairs, and
community responsibilities.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Administrating Citizenship with Digital Technologies</title>
        <p>The possibility of citizens exerting their rights is directly affected by the services delivered
by public sector organisations. In democratic countries, citizens have the right to elect
representatives who, in turn, appoint bureaucrats to manage the public sector bureaucratic
apparatus that will deliver the public services [20]. DT are one of the cornerstones through
which contemporary public bureaucratic apparatuses work. Hence, DT influence how
citizenship is shaped, promoted, and developed in a digitalized society. To understand the
implications of DT for administering citizenship, we must point out the drivers of public
sector organisations and their potential implications.</p>
        <p>The bureaucratic apparatus is an instrument through which public governance promotes
citizenship. Such apparatus is guided by ethical principles that can be inspired by
democratic or bureaucratic values [20]. When public bureaucracies act on democratic
values, they foster public interest, citizen empowerment, social equity, justice, and
benevolence. When acting on bureaucratic values, they promote efficiency, effectiveness,
loyalty, and accountability.</p>
        <p>From a public governance perspective, policymakers, in their activities, act teleologically,
promoting the greatest good for the greatest number of people, and see the bureaucratic
apparatus as a means to achieve this goal [21]. Public bureaucrats, on the other hand, act
deontologically, seeing the bureaucratic structures as the primary goal in reaching the
objectives set by the policymakers. So, concerning our context, politicians would issue
policies to use DT to create better conditions for most citizens following a teleological
approach, while bureaucrats would focus on pushing DT use by citizens to materialise
public policies. Such perspective difference can be the source of a significant drift in public
sector action: administrative evil.</p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3. Administrative Evil and Digital Technologies</title>
        <p>The concept of administrative evil refers to harmful consequences materialised by
administrative actions of bureaucratic systems that, at the same time, correspond to a
rational action of bureaucracies while also producing a negative outcome [11]. When
bureaucratic structures act this way, they may harm and engage in acts with various
detrimental outcomes, such as white lies, damage to organisational reputation,
psychological harm, ethical harm, or even physical harm [11, 21, 22]. Such harm is often not
recognised as a negative outcome; quite the contrary, bureaucrats frequently believe that
they are doing their duties and that their actions are necessary to follow their deontological
stance [23]. Hence, administrative evil must be unmasked, unveiling factors and causal
mechanisms that produce the negative outcome to make it visible to everyone [11]. In this
work, we posit that when DT promoted by public policies affect the dimensions of
citizenship, they can produce negative effects that harm citizens, materialising into
elements of administrative evil.</p>
        <p>Exploring administrative evil requires investigating the bureaucratic context in which
the phenomena occur and observing how DT are integrated. Administrative evil is unveiled
when the negative outcome can be connected to characteristics of the organisational action
that make the reproduction of the harmful outcome systematic. The literature refers to
several dimensions of administrative evil, such as bureaucratic impersonality and
professionalism, technical rationality, market logic, decentralisation or
compartmentalisation, loss of ethical or moral standards, or technological amplification
[11, 21, 22, 24]. However, these dimensions are not exclusive, and future research may
explore new dimensions or mechanisms of evil.</p>
        <p>Administrative evil has already been associated with the use of DT in organisations. Still,
current literature limits the conceptual exploration of evil on emerging technologies such
as artificial intelligence and blockchain [25–27]. No research has explored administrative
evil in using DT regarding citizenship with an empirical approach, and the literature
provides no specific frameworks for the analysis of administrative evil. In this work, we will
explore administrative evil by combining three elements:
1. Contextual factors – such as bureaucratic impersonality, professionalism, technical
or technological rationality – associated with the negative outcome (i.e. the digital
platform is the more convenient and cost-effective way to deliver services to
citizens).
2. A negative outcome – such as psychological, reputational, or organisational harm
related to citizenship – that is considered normal by bureaucrats (i.e. it is normal that
a citizen cannot exert one of his rights if he does not use the online digital platforms).
3. A bureaucratic logic - connecting contextual factors with negative outcomes (i.e.
street-level bureaucrats pushing citizens to go online when they indicate difficulties
using online systems because no services can be provided if not online).</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Research Design and Case Description</title>
      <p>Our work is motivated by the following RQ: How can DT implementation in governments
harm citizenship in a digitalized society? To answer this we explore the prospect of DT use
in the public sector aligned with the concepts of citizenship [5] and administrative evil [24],
applied to one illustrative case from Norway. The illustrative case is described in section 3.1
and is well documented in literature from a citizen perspective [9, 15, 29].</p>
      <p>Regarding citizenship, we build on Stokke's [5] framework by analysing the impacts of
each of the dimensions of citizenship proposed by the author. Concerning administrative
evil, we highlight how the application of DT harms dimensions of citizenship, searching for
traces of evil in the negative dissonance between objectives (contextual factors) and
negative outcomes of the DT use that together compose a bureaucratic logic. The context is
DT in self-service practice, which we analyse out of the dimensions of citizenship and detect
traces of administrative evil.</p>
      <p>Following a qualitative approach, a future version of this ongoing research will explore
the factors and causal mechanisms behind the bureaucratic context associated with DT, in
which the phenomena occur. Data for this phase of the study will be collected through
interviews with bureaucrats involved in DT design and implementation on the cases
selected.</p>
      <sec id="sec-3-1">
        <title>3.1. Digitalising Financial Assistance in Norway: the NAV Case</title>
        <p>The Norwegian Labor and Welfare Administration (NAV) has been a key player in realizing
the digital transition of the public sector in Norway with key milestones in 2005, 2006, and
2010, developing a web portal nav.no and the online service platform myNAV [29]. The
COVID-19 pandemic accelerated NAV's digitalization, replacing physical services with
remote options on nav.no and self-service stations at local offices. However, research in NAV
has shown that the digital-first ideal sometimes collides with citizens' needs and interests
[9]. Despite the success of digital service development, the digitalization of welfare services
poses challenges for citizens who struggle to access services online [15, 29].</p>
        <p>A research project that focuses on how citizens in need of welfare benefits experience
the digital services in NAV, demonstrate how many citizens who visit NAV offices struggle
to use digital services. Self-service stations provided at the NAV offices offer citizens to
access the platform nav.no and allow citizens to log in to their sight of myNAV. Some citizens
managed their self-services at the stations, while others struggled with access or needed
assistance from frontline workers [9].</p>
        <p>During observations we found that most citizens who asked for personal assistance to
apply for financial benefits were directed by frontline workers to use digital self-service
stations and log on to nav.no. Citizens who asked for paper applications did so as they
struggled to manage their errands at the digital service stations. They were often denied
paper applications as the office protocol was to increase the number of digital applications
and to promote self-services as the first choice. Many citizens could not engage as active
service co-producers as they struggled to navigate the platform and submit personal
information. The fear of doing something wrong, lack of digital knowledge, language
barriers, and lack of access to digital services needed to identify them restricted them from
participating in digital self-service procedures. As a result, several gave up when they could
not manage the digital services at nav.no [9].</p>
        <p>To actualize dimensions of citizenship became challenging for citizens who struggled to
use digital self-services. Some of the citizens who required NAV services were often
vulnerable in several aspects relating to physical or mental health issues, poverty, and
language barriers. For many citizens that came to the office, the digital stations and nav.no
were more of an obstacle than an access point to NAV.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Preliminary Findings and Analysis</title>
      <p>This section analyses how DT in NAV produced negative outcomes for citizens seeking
services, highlighting the traces of administrative evil and its impact on citizenship
dimensions [5]. Findings are summarised in Table 1, showing traces of evil in harmful
outcomes that challenge citizenship, such as exclusion, dropout, and rights difficulties.</p>
      <p>Concerning citizenship's membership dimension, the digital community that myNav
represents was supposed to include citizens. However, this was only a reality for citizens
who knew NAV services and could understand myNav to practice such membership. Many
citizens struggled to access the full-service span at myNAV and to find the services they
needed online. Without this, the membership was of little value. Digital accounts and
accessible service stations did not secure membership and belonging for all citizens. In fact,
this shows that digital service stations and platforms do not foster community inclusion and
membership only by functionality that supports such membership.</p>
      <p>It shows traces of evil rising from the contextual ideal of digital efficiency and
bureaucratic logic that most citizens shall use DT according to office protocol. Citizens with
preconditions to take part could access membership, while the exclusion from membership
rises when citizens are directed to a digital community without the ability to be full
members.</p>
      <p>We also found negative outcomes concerning the dimension of legal status. In NAV, the
system provides different authorization options related to the "legal status" dimension,
which refers to identity [5]. While in theory, digital identification supports legal status, our
observations demonstrate that some citizens are denied digital ID due to addiction or health
issues or failure to submit their personal data. Consequently, DT prohibits them from
actualizing their legal status. Citizens who managed to actualize their legal status by logging
in to nav.no also faced barriers when they struggled to navigate the platform and
understand the services and the NAV system. In these cases, the actualization of the legal
status that granted them access to rightful services was of little use [19].</p>
      <p>When the frontline workers ensured that citizens had a BankId, they often left citizens
on their own to engage in the self-service, resulting in several citizens failing to log in. The
organisational logic that DT save resources from administration gave public officials less
room to assist citizens. Some citizens gave their IDs to other citizens to help them. The
bureaucratic logic of DT use and contextual efficiency of self-service direction to exchange
human assistance took focus away from ensuring legal status realisation.</p>
      <p>Finally, negative outcomes were also found in relation to the citizenship dimension of
rights. In NAV, these rights are seen in welfare services. When citizens apply for financial
welfare services in NAV, they must match the eligibility criteria to receive benefits. Still,
eligible citizens directed to use digital self-service often were afraid to make mistakes and
face the consequences of potential digital wrongdoing. This prevented some citizens from
following through. Language barriers made citizens miss out on services as they could not
read about their rights at nav.no. Many needed personal guidance and information about
their rights and could make choices based on a novel understanding of such rights.</p>
      <p>In this case, the logic that DT can compensate for human interaction ended up excluding
citizens from their social rights. The context was that digital self-services provided
efficiency from an organizational goal and motive but restricted how citizens exercise their
rights. Citizens' struggle at service stations or, worse, dropping out of the welfare system
was the outcome of DT, and as such, preconditions challenge equality concerning rights.</p>
      <p>We could not identify negative outcomes in the participation dimension of citizenship in
the NAV case, as it is often related to political participation and community engagement.
Future case studies will cover the participation dimension.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Discussion and Conclusion</title>
      <p>Our findings indicate that DT, even if implemented out of good intentions, may result in
negative outcomes for some citizens who encounter digital government. This means that
digital policies that promote digital government actions can be argued to account for
administrative evil in practice [11]. The excessive focus on the bureaucratic logic behind DT
in the public sector, permeated by values such as efficiency, impersonality, professionalism,
and technical rationality, may be a source of a moral inversion, where public and democratic
values inherent to citizenship are overlapped by the precedency of system functionality,
masked under the requirements of the job and good technique. While promoted for
effectiveness, universality, and innovation in public governance, DT create new barriers for
many citizens, hindering them from exercising their full citizenship.</p>
      <p>DT require some preconditions from the citizens – such as literacy, assistance from
intermediaries, system understanding, and access to digital ID. These are preconditions that
need to be in place for citizens to interact online and benefit from DT. However, such
preconditions are not granted for all or immediately. As bureaucrats force citizens to go
online, this leaves no room to deal with non-digital stances.</p>
      <p>In NAV, frontline workers with limited time ended up directing citizens to digital
selfservices, without considering their competences and skill to use such services. Many
citizens experienced stress, anxiety, frustration, and dismay when they were not able to take
part or were not able to apply for services to which they were entitled. This made some
citizens face challenges in actualizing their citizenship in the DT encounter. The lack of
preconditions and resources to address exceptions to digital interactions manifests the evil
dimensions in the DT adopted by NAV. The first factor (lack of preconditions) creates
exclusion, and the second (not addressing exceptions) makes the excluded invisible or
forgotten to the public apparatus.</p>
      <p>
        We refrain from generalising such mechanisms to all DT used in the public sector to
foster citizenship. As amply reported by the literature [
        <xref ref-type="bibr" rid="ref31">1, 2, 13, 18</xref>
        ], we acknowledge that
DT use in the public sector produces positive outcomes for many citizens. Instead, we use
this illustrative case to show how DT can deny citizenship and to posit that the negative
outcomes are not just a lack of success but unintentional purposeful harm, manifesting a
dimension of evil in the public sector's use of DT. This shows that when the government
goal is digital-first, it may reflect administrative evil reinforced by "good" digital numbers.
Furthermore, considering that the different dimensions of citizenship are closely
interwoven [5], digital services challenge them as a bundle and administrative evil rises
when digital policies and strategies are adopted without all citizens' needs in mind.
      </p>
      <p>We do not claim that the exclusion of citizens or damage to citizenship was intentional.
Indeed, administrative evil is masked and often not visible to the perpetrators. It may be
unintentional, but we posit it is purposeful, resulting in a causal mechanism activated by the
two factors identified. We argue that critically discussing potential harmful traits of DT in
administration is important, and we suggest further exploring how to unmask evil. We
argue that such outcomes and traces of evil are important to unmask to safeguard
citizenship rights and that our theoretical concepts introduced in this paper will provide
value in doing so.</p>
      <p>Our results account for some implications for practice and research, as well as we have
limitations to acknowledge.</p>
      <p>As a practical implication, we want to emphasise the importance of critically reflecting
on the path that the digitalization of government embarks on. The logic that focuses on
limited resources will inevitably lead to actions driven by the best value for money that may
exclude the interest of citizens. When the public sector does not account for all citizens'
interests and needs, it does not fulfil the government's responsibility. In public sector
digitalization, it is important to put emphasis on the more marginalized citizens and develop
strategies for their inclusion, as well as without DT. Digital government should support
diversity rather than serve citizens as a homogenous group, be accountable to all citizens,
and safeguard citizenship across different dimensions [4].</p>
      <p>On the research side, our conceptual approach and illustrative case demonstrate the
need to foster a digital government that mirrors citizens' needs in a digital analogic
continuity to promote a government system that safeguards citizenship. Based on our
findings, we argue for the relevance of discussing citizenship in a digitalised society instead
of digital citizenship to avoid reproducing the duality of digital and analog citizens, which
leads us to the inclusion-exclusion dichotomy. Furthermore, we argue for the importance of
further exploring the needs and preconditions of all citizens to avoid consequences related
to administrative evil. Our findings show that digital systems will reinforce administrative
evil if this is not critically reflected.</p>
      <p>Secondly, we identify a connection between DT use and negative outcomes for
citizenship from an administrative evil perspective. We do not argue whether such a
connection is transient, i.e., can be removed by DT or process redesign, or permanent, i.e.,
changing DT affordances will continuously recreate it. Future research should explore the
role and characteristics of DT better and investigate how their action possibilities may avoid
or reproduce conditions for administrative evil.</p>
      <p>Finally, in this paper we advocate for causality in DT use and administrative evil
outcomes towards digital citizenship. However, we limit our exploration to identifying a
connection between two factors that manifest evil, exemplified by one case study.
Furthermore, the case analysed does not allowed us to observe the participation dimension
of citizenship. We will address this limitation in future research, in which we will progress
our investigation from several case studies. We plan to do it by extending this study
integrating the cases of M5S movement in Italy and the Desenrola Brazil case. In the M5S
case a political party used DT to build a digital space for including and fostering citizen
debate. In this case, the focus on political rights diverges from the NAV case as the M5S
understand DT in relation to a democratic process with the aim of improving transparency
and democracy. The Desenrola Brazil case is interesting as it provides a rational, simple,
and agile ambience where selected groups of citizens could engage and negotiate their
debts. By connecting with the private sector and government companies efficiently, they
could benefit from huge discounts and be able to "clean their names" through accounts on
the Gov.br platform. As we are familiar with these cases, we know that both cases exemplify
different angles on how citizenship can be harmed and denied when DT is adopted.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgements</title>
      <p>This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível
Superior – Brasil (CAPES) – Finance Code 001.
17.
18.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Agarwal</surname>
            ,
            <given-names>P.K.</given-names>
          </string-name>
          :
          <article-title>Public Administration Challenges in the World of AI and Bots</article-title>
          .
          <source>Public Adm Rev</source>
          .
          <volume>78</volume>
          ,
          <fpage>917</fpage>
          -
          <lpage>921</lpage>
          (
          <year>2018</year>
          ). https://doi.org/10.1111/puar.12979.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Janowski</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Digital government evolution: From transformation to contextualization</article-title>
          .
          <source>Gov Inf Q</source>
          .
          <volume>32</volume>
          ,
          <fpage>221</fpage>
          -
          <lpage>236</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          https://doi.org/10.1016/J.GIQ.
          <year>2015</year>
          .
          <volume>07</volume>
          .001.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Melitski</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holzer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
          </string-name>
          , S.-T.,
          <string-name>
            <surname>Kim</surname>
          </string-name>
          , C.-G.,
          <string-name>
            <surname>Rho</surname>
          </string-name>
          , S.-Y.:
          <article-title>Digital Government Worldwide</article-title>
          .
          <source>In: Global Information Technologies</source>
          . pp.
          <fpage>1463</fpage>
          -
          <lpage>1479</lpage>
          . IGI Global (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          https://doi.org/10.4018/978-1-
          <fpage>59904</fpage>
          -939-7.
          <year>ch107</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Moynihan</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herd</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harvey</surname>
          </string-name>
          , H.:
          <article-title>Administrative Burden: Learning, Psychological, and Compliance Costs in Citizen-State Interactions</article-title>
          .
          <source>Journal of Public Administration Research and Theory</source>
          .
          <volume>25</volume>
          ,
          <fpage>43</fpage>
          -
          <lpage>69</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>https://doi.org/10.1093/JOPART/MUU009.</mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Stokke</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Politics of citizenship: Towards an analytical framework</article-title>
          .
          <source>Norsk Geografisk Tidsskrift</source>
          .
          <volume>71</volume>
          ,
          <fpage>193</fpage>
          -
          <lpage>207</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          https://doi.org/10.1080/00291951.
          <year>2017</year>
          .
          <volume>1369454</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Schou</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          : Remaking Citizenship:
          <article-title>Welfare Reform and Public Sector Digitalization</article-title>
          , https://pure.itu.dk/en/publications/remaking-citizenship
          <article-title>-welfare-reform-andpublic-sector-</article-title>
          <string-name>
            <surname>digitalizat</surname>
          </string-name>
          , (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <volume>16</volume>
          ,
          <fpage>153</fpage>
          -
          <lpage>173</lpage>
          (
          <year>2013</year>
          ). https://doi.org/10.1177/1368431012459693.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Jeffares</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The virtual public servant: Artificial intelligence and frontline work</article-title>
          .
          <source>The Virtual Public Servant: Artificial Intelligence and Frontline Work</source>
          .
          <fpage>1</fpage>
          -
          <lpage>274</lpage>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          https://doi.org/10.1007/978-3-
          <fpage>030</fpage>
          -54084-5/COVER.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Rydén</surname>
            ,
            <given-names>H.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hofmann</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Verne</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>The Self-serving Citizen as a Co-producer in the Digital Public Service Delivery</article-title>
          .
          <source>Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)</source>
          .
          <source>14130 LNCS</source>
          ,
          <fpage>48</fpage>
          -
          <lpage>63</lpage>
          (
          <year>2023</year>
          ). https://doi.org/10.1007/978-3-
          <fpage>031</fpage>
          - 41138-
          <issue>0</issue>
          _4/TABLES/2.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Melchiori</surname>
            ,
            <given-names>C. E.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Sanches</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Cruz</surname>
            ,
            <given-names>M. C. C.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Diniz</surname>
            ,
            <given-names>E. H.</given-names>
          </string-name>
          ; and Cunha,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Digital</surname>
          </string-name>
          <article-title>Welfare and Vulnerable Citizens: a Literature Review</article-title>
          .
          <article-title>ECIS 2023 Research-in-Progress Papers</article-title>
          .
          <volume>58</volume>
          . https://aisel.aisnet.org/ecis2023_rip/58 (
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Adams</surname>
            ,
            <given-names>G.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Balfour</surname>
            ,
            <given-names>D.L.</given-names>
          </string-name>
          :
          <article-title>Unmasking Administrative Evil. SAGE Publications Inc</article-title>
          .,
          <string-name>
            <surname>Thousand</surname>
            <given-names>Oaks</given-names>
          </string-name>
          , California (
          <year>1998</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Distel</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lindgren</surname>
            ,
            <given-names>I.:</given-names>
          </string-name>
          <article-title>A matter of perspective: Conceptualizing the role of citizens in E-government based on value positions</article-title>
          .
          <source>Gov Inf Q</source>
          .
          <volume>40</volume>
          ,
          <issue>101837</issue>
          (
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          https://doi.org/10.1016/J.GIQ.
          <year>2023</year>
          .
          <volume>101837</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>L.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mirpuri</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rao</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Law</surname>
          </string-name>
          , N.:
          <article-title>Conceptualization and measurement of digital citizenship across disciplines</article-title>
          .
          <source>Educ Res Rev</source>
          .
          <volume>33</volume>
          ,
          <issue>100379</issue>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Larsson</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          :
          <article-title>Digitization or equality: When government automation covers some, but not all citizens</article-title>
          .
          <source>Gov Inf Q</source>
          .
          <volume>38</volume>
          ,
          <issue>101547</issue>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          https://doi.org/10.1016/J.GIQ.
          <year>2020</year>
          .
          <volume>101547</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Heggertveit</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lindgren</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Madsen</surname>
            ,
            <given-names>C.Ø.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hofmann</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <source>Administrative Burden in Digital Self-service: An Empirical Study About Citizens in Need of Financial Assistance. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)</source>
          .
          <source>13392 LNCS</source>
          ,
          <fpage>173</fpage>
          -
          <lpage>187</lpage>
          (
          <year>2022</year>
          ). https://doi.org/10.1007/978-3-
          <fpage>031</fpage>
          -23213-8_11/TABLES/4.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Leisering</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barrientos</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Social citizenship for the global poor? The worldwide spread of social assistance</article-title>
          .
          <source>Int J Soc Welf</source>
          .
          <volume>22</volume>
          , (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>https://doi.org/10.1111/IJSW.12046.</mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Marshall</surname>
            ,
            <given-names>T. H.</given-names>
          </string-name>
          : Citizenship and
          <string-name>
            <given-names>Social</given-names>
            <surname>Class</surname>
          </string-name>
          . London: Pluto Press (
          <year>1992</year>
          [1950]).
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <string-name>
            <given-names>Citizensh</given-names>
            <surname>Stud</surname>
          </string-name>
          .
          <volume>1</volume>
          ,
          <fpage>285</fpage>
          -
          <lpage>303</lpage>
          (
          <year>1997</year>
          ). https://doi.org/10.1080/13621029708420660.
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>Isin</surname>
            ,
            <given-names>E.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruppert</surname>
            ,
            <given-names>E.S.:</given-names>
          </string-name>
          <article-title>Being digital citizens</article-title>
          . Rowman &amp; Littlefield
          <string-name>
            <surname>Publishers</surname>
          </string-name>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <string-name>
            <surname>Riccucci</surname>
            ,
            <given-names>N.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Van Ryzin</surname>
            ,
            <given-names>G.G.</given-names>
          </string-name>
          :
          <article-title>Representative Bureaucracy: A Lever to Enhance Social Equity, Coproduction, and Democracy</article-title>
          .
          <source>Public Adm Rev</source>
          .
          <volume>77</volume>
          ,
          <fpage>21</fpage>
          -
          <lpage>30</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>https://doi.org/10.1111/PUAR.12649.</mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          <string-name>
            <surname>Rocha</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          :
          <article-title>Enabling corporate immorality: Understanding administrative evil through Better Off Ted</article-title>
          .
          <source>NaN</source>
          .
          <volume>12</volume>
          ,
          <fpage>49</fpage>
          -
          <lpage>63</lpage>
          (
          <year>2024</year>
          ). https://doi.org/10.1386/JPTV_00114_
          <fpage>1</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          1-
          <fpage>5</fpage>
          (
          <year>2024</year>
          ). https://doi.org/10.1080/23276665.
          <year>2024</year>
          .
          <volume>2356540</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          <string-name>
            <surname>Virtanen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lehtonen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Raisio</surname>
          </string-name>
          , H.:
          <article-title>Reaching Into the Dark Side of Organisations: The Banality and Emergence of Administrative Evil in the Light of Two Case Examples</article-title>
          .
          <source>Scandinavian Journal of Public Administration</source>
          .
          <volume>26</volume>
          ,
          <fpage>3</fpage>
          -
          <lpage>21</lpage>
          (
          <year>2022</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>https://doi.org/10.58235/SJPA.V26I2.7015.</mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          <string-name>
            <surname>Adams</surname>
            ,
            <given-names>G.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Balfour</surname>
            ,
            <given-names>D.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Reed</surname>
            ,
            <given-names>G.E.: Abu</given-names>
          </string-name>
          <string-name>
            <surname>Ghraib</surname>
          </string-name>
          ,
          <source>Administrative Evil, and Moral Inversion: Th e Value of "Putting Cruelty First." Public Adm Rev</source>
          .
          <volume>66</volume>
          ,
          <fpage>680</fpage>
          -
          <lpage>693</lpage>
          (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          <string-name>
            <surname>Heckler</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Crypto-Governance: The Ethical Implications of Blockchain in Public Service</article-title>
          .
          <source>Public Integrity</source>
          .
          <volume>24</volume>
          ,
          <fpage>66</fpage>
          -
          <lpage>81</lpage>
          (
          <year>2022</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          https://doi.org/10.1080/10999922.
          <year>2020</year>
          .
          <volume>1848106</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          <volume>49</volume>
          ,
          <fpage>751</fpage>
          -
          <lpage>761</lpage>
          (
          <year>2019</year>
          ). https://doi.org/10.1177/0275074019856123.
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          <string-name>
            <surname>Young</surname>
            ,
            <given-names>M.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Himmelreich</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bullock</surname>
            ,
            <given-names>J.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>K.C.</given-names>
          </string-name>
          : Artificial Intelligence and
          <string-name>
            <given-names>Administrative</given-names>
            <surname>Evil</surname>
          </string-name>
          .
          <source>Perspect Public Manag Gov</source>
          .
          <volume>4</volume>
          ,
          <fpage>244</fpage>
          -
          <lpage>258</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>https://doi.org/10.1093/ppmgov/gvab006.</mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          <string-name>
            <surname>Kuiken</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Exemplary Case Design</article-title>
          . In: Mills,
          <string-name>
            <given-names>A.J.</given-names>
            ,
            <surname>Eurepos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            , and
            <surname>Wiebe</surname>
          </string-name>
          , E. (eds.)
          <source>Encyclopedia of Case Study Research</source>
          , Vol.
          <volume>1</volume>
          . pp.
          <fpage>359</fpage>
          -
          <lpage>362</lpage>
          . SAGE Publications Inc., Thousands Oaks, CA (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          <string-name>
            <surname>Lundberg</surname>
            ,
            <given-names>K.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Syltevik</surname>
            ,
            <given-names>L.J.:</given-names>
          </string-name>
          <article-title>Everyday interaction at the frontline: The case of the Norwegian all-in-one bureaucracy</article-title>
          .
          <source>Journal of Organizational Ethnography</source>
          .
          <volume>5</volume>
          ,
          <fpage>152</fpage>
          -
          <lpage>166</lpage>
          (
          <year>2016</year>
          ). https://doi.org/10.1108/JOE-12-2015-0026/FULL/PDF.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>