<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Typology for Applications of Public Sector AI</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Marissa Hoekstra</string-name>
          <email>marissa.hoekstra@tno.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Anne Fleur van Veenstra</string-name>
          <email>annefleur.vanveenstra@tno.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Cass Chideock</string-name>
          <email>cass.chideock@tno.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>TNO Strategic Analysis &amp; Policy</institution>
          ,
          <addr-line>The Hague</addr-line>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
      </contrib-group>
      <fpage>121</fpage>
      <lpage>128</lpage>
      <abstract>
        <p>The use of Artificial Intelligence (AI) in the public sector is on the rise. Yet, there is no clear definition of AI. While AI is considered to be useful for process optimizing and efficiency, there are also concerns for its impact on citizens, for example regarding transparency and discrimination. For this reason it is important to understand how and for which purpose AI is being used within government. Few explorative studies have provided fragmented insight into how AI is used in the public sector, but a clear overview of typical applications is still lacking. To support insight into public sector use of AI, this paper develops a typology for applications of public sector AI. This typology is based on a literature review. Based on the literature, we find eight types of applications of public sector AI. In further research, we will validate this typology with evidence from practice. Acknowledgement: The research presented in this paper is based on the study “Quickscan AI in de publieke dienstverlening II,” commissioned by the Ministry of the Interior and Kingdom Relations of the Netherlands.</p>
      </abstract>
      <kwd-group>
        <kwd>AI</kwd>
        <kwd>Public Sector AI</kwd>
        <kwd>Artificial Intelligence</kwd>
        <kwd>Typology</kwd>
        <kwd>AI challenges</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The use of AI in the public sector has increased in the past years. The European Commission defines
AI as: “Artificial intelligence (AI) refers to systems that display intelligent behavior by analyzing
their environment and taking actions – with some degree of autonomy – to achieve specific goals.”
        <xref ref-type="bibr" rid="ref8">(European Commission, 2018, p. 1)</xref>
        . As such, AI may improve public sector performance, by making
processes more efficient, thereby reducing costs, and by improving the quality of services
        <xref ref-type="bibr" rid="ref14 ref20 ref4 ref6">(Chui et
al, 2018; De Sousa et al, 2019; Misuraca, van Noordt &amp; Boukli, 2020)</xref>
        . However the use of AI also
raises some concerns; depending on how it is used, it can help or damage people
        <xref ref-type="bibr" rid="ref9">(Feijoo &amp; Kwon,
2020)</xref>
        . For example, AI systems can be used for profiling, which if used in the wrong way could lead
to discrimination
        <xref ref-type="bibr" rid="ref19 ref21 ref9">(Thierer, O'Sullivan &amp; Russell, 2017; Wirtz, Weyerer &amp; Geyer, 2019; Feijoo &amp; Kwon,
2020)</xref>
        .
      </p>
      <p>Copyright ©2021 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).</p>
      <p>
        To improve our understanding on the opportunities and challenges of public sector AI, it is
important to first understand how and for which purposes AI systems are used within government.
A few studies have provided explorative and fragmented insight into how AI is used in the public
sector
        <xref ref-type="bibr" rid="ref14 ref14 ref20 ref20">(Misuraca, Van Noordt &amp; Boukli, 2020; Van Veenstra, Grommé &amp; Djafari, 2020)</xref>
        . However, a
structured overview of how and for which purposes AI is used in the public sector is still lacking
        <xref ref-type="bibr" rid="ref13 ref14 ref20">(
Kankanhalli, Charalabidis &amp; Mellouli, 2019; Misuraca, Van Noordt &amp; Boukli, 2020)</xref>
        . To gain such an
overview, it is useful to have a typology that focuses on typical applications of public sector AI.
Individual case studies have provided us with fragmented evidence of specific types of use of public
sector AI
        <xref ref-type="bibr" rid="ref1 ref18">(Androutsopoulou et al, 2019; Sun &amp; Medaglia, 2019)</xref>
        . Furthermore, many typologies of
public sector AI often have a technological focus
        <xref ref-type="bibr" rid="ref14 ref20 ref21 ref6">(e.g. Wirtz, Weyerer &amp; Geyer, 2019; Misuraca, Van
Noordt &amp; Boukli, 2020)</xref>
        . Therefore, the objective of this study is to develop a typology for public
sector AI applications based on literature, that will support the understanding of how and for which
purposes is AI technology applied.
      </p>
      <p>To develop such a typology, the following method is applied: a study of the literature is
conducted and then a typology based on literature is introduced. The paper is structured as follows.
First the state of the literature on AI in the public sector is discussed. Subsequently an overview of
current typologies on AI in the public sector is used to develop a typology based on literature. The
paper concludes with a discussion of the findings.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Public Sector AI</title>
      <p>
        While AI is not a new phenomenon, it has, as a result of a large increase in computing power gained
much attention over the last years
        <xref ref-type="bibr" rid="ref13 ref14 ref20">(Kankanhalli, Charalabidis &amp; Mellouli, 2019; Misuraca, Van
Noordt &amp; Boukli, 2020)</xref>
        . However, there is no generally accepted definition of AI (yet). Based on four
often used definitions from the European Commission (2018), OECD (2019), the High-Level Expert
Group on AI (AI HLEG) (2019) and the Dutch Strategic Action Plan for AI (SAPAI) (2019) we
discerned four common elements. The first element is that AI systems are either software or
hardware systems that are designed by humans
        <xref ref-type="bibr" rid="ref11 ref8">(European Commission, 2018; High-Level Expert
Group on Artificial Intelligence, 2019)</xref>
        . The second element is that data is processed for specific and
complex purposes. The third element is that AI systems can operate with varying levels of autonomy
        <xref ref-type="bibr" rid="ref7">(OECD, 2019; Dutch Ministry of Economic Affairs and Climate, 2019)</xref>
        . And the fourth element is that
AI either uses symbolic rules or numeric models for prediction, recommendations or automated
decisions
        <xref ref-type="bibr" rid="ref11">(High-Level Expert Group on Artificial Intelligence, 2019)</xref>
        . From a technological
perspective, AI is considered an umbrella term that includes many different types of technologies
such as predictive analytics, natural language processing (NLP), speech analytics, robotics and
image recognition techniques
        <xref ref-type="bibr" rid="ref10 ref2">(Fong, 2018; Berryhill et al., 2019)</xref>
        .
      </p>
      <p>
        Misuraca, Van Noordt &amp; Boukli (2020) found that within the public sector the use of AI
applications is emerging, based on a landscape analysis of the use of AI in European countries. They
found 85 different examples of AI applications in government across fifteen European member
states. Van Veenstra, Grommé &amp; Djafari (2020) performed a mapping exercise of public sector data
analytics in the Netherlands, including examples of AI. While they identified 74 examples of public
sector data analytics, they were not able to determine how many of them make use of AI. However,
beyond these exploratory mapping exercises not much is known yet about how and for which
purposes AI is used to improve public services and government operations
        <xref ref-type="bibr" rid="ref14 ref20">(Misuraca, Van Noordt
&amp; Boukli, 2020)</xref>
        . There are however a couple of case studies that aimed to give an insight into the
use of specific AI technologies in the public sector. For example, with the use of NLP, machine
learning and data mining technologies,
        <xref ref-type="bibr" rid="ref1">Androutsopoulou et al. (2019)</xref>
        developed a chatbot that can
foster communication between citizens and government.
      </p>
      <p>
        There is a lot of research on challenges regarding the application of AI in the public sector.
Technical and data challenges are insufficient size of available data, a lack of standards for data
collection, the data and system quality and data security
        <xref ref-type="bibr" rid="ref1 ref18 ref21 ref3">(Androutsopoulou et al., 2019; Sun &amp;
Medaglia, 2019; Wirtz, Weyerer &amp; Geyer, 2019; Campion et al., 2020)</xref>
        . Organizational challenges are
a lack of skills and expertise in public organizations, financial feasibility, a lack of collaborative
culture and a resistance to sharing data between parties
        <xref ref-type="bibr" rid="ref21 ref3">(Wirtz, Weyerer &amp; Geyer, 2019; Campion et
al., 2020)</xref>
        . However, these challenges are not new. Similar challenges have also been identified in the
context of the use of public sector data analytics
        <xref ref-type="bibr" rid="ref14 ref20">(Van Veenstra, Grommé &amp; Djafari, 2020)</xref>
        . Ethical
and societal challenges that are often attributed more specifically to AI-based algorithms are
transparency and explainability, since the autonomous nature of many AI algorithms means that
these algorithms may function as a ‘black-box’, which means that the outcomes of these algorithms
may be difficult to explain
        <xref ref-type="bibr" rid="ref12 ref5">(Janssen &amp; Kuk, 2016; Craglia et al., 2018)</xref>
        . AI can also create bias, which
may result in discrimination; the use of AI therefore risks hampering human rights and public values
like human dignity, equal treatment and privacy
        <xref ref-type="bibr" rid="ref5">(Craglia et al., 2018)</xref>
        . Since there is no generally
accepted definition of AI and we are still trying to understand for which purposes public sector AI
is used, we do not know when and in which phase specific challenges can arise. For this reason,
there is a need for a typology that takes into account both the purpose of an application and the type
of AI technology that is used.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. A Typology for Public Sector AI Based on Literature</title>
      <p>To develop a typology for public sector AI, a literature search was undertaken. First, a Scopus search
using the search terms "AI" AND "Government", "AI" AND "Public sector", was conducted.
Subsequently, the snowball method was used, in which the key documents found through the
Scopus search were used as a starting point for finding other literature. In addition, two expert
researchers were asked to give suggestions on known typologies. Many of the challenges regarding
the use of public sector AI are identical to the challenges encountered with the use of public sector
data analytics. Therefore typologies based on data analytics are included within the scope of this
study.</p>
      <p>
        The literature search identified nine papers presenting typologies. These were subsequently
reviewed and compared. We included both typologies with a focus on the use of big data analytics
in the public sector
        <xref ref-type="bibr" rid="ref14 ref15 ref16 ref17 ref20">(Mehr, 2017; Poel, Meyer &amp; Schroeder, 2018; Santiso &amp; Roseth, 2018; Van Ooijen,
Ubaldi &amp; Welby, 2019; Van Veenstra, Grommé &amp; Djafari, 2020)</xref>
        and typologies with a focus on the
use of AI in the public sector
        <xref ref-type="bibr" rid="ref14 ref20 ref21 ref4 ref6">(Chui et al, 2018; De Sousa et al, 2019; Wirtz, Weyerer &amp; Geyer, 2019;
Misuraca, Van Noordt &amp; Boukli, 2020)</xref>
        . Among the nine papers with typologies, a distinction can be
made between those that focus on the technical applications of data analytics and AI, and those
applications that address a type of governmental process. Furthermore, some of the typologies are
developed based on literature only, while others are also validated by empirical research.
      </p>
      <p>
        Four of the examined typologies focus on the technical applications of data analytics and AI
        <xref ref-type="bibr" rid="ref14 ref20 ref21 ref4">(Mehr, 2017; Chui et al, 2018; Wirtz, Weyerer &amp; Geyer, 2019; Misuraca, Van Noordt &amp; Boukli, 2020)</xref>
        .
For example Wirtz, Weyerer &amp; Geyer (2019) provided a list of ten technical applications of AI in the
public sector, varying from virtual agents to cognitive robotics &amp; autonomous systems. For each of
these technical applications they provide examples of public sector use cases found in the literature.
For example, predictive analytics can be used for prediction of water levels or crime prediction and
virtual agents can be used for the application of chatbots. Mehr (2017) on the other hand, identified
six problems where AI techniques can provide a solution for, including resource allocation, shortage
of experts, working in large data sets, procedural and repetitive tasks, scenario prediction and
diverse data. Whereas
        <xref ref-type="bibr" rid="ref4">Chui et al. (2018)</xref>
        identified three categories where AI can help to improve
performance: predictive maintenance, logistics optimization and personalization. All these
typologies look at how AI techniques can help governments, but they do not take into account the
specific role that a governmental organization may have
        <xref ref-type="bibr" rid="ref14 ref20">(Van Veenstra, Grommé &amp; Djafari, 2020)</xref>
        .
      </p>
      <p>
        Five studies have identified types of applications that are aimed at improving governmental
processes and policymaking
        <xref ref-type="bibr" rid="ref14 ref15 ref16 ref17 ref20 ref6">(Poel, Meyer &amp; Schroeder, 2018; Santiso &amp; Roseth, 2018; Van Ooijen,
Ubaldi &amp; Welby, 2019; De Sousa et al., 2019; Van Veenstra, Grommé &amp; Djafari, 2020)</xref>
        .
        <xref ref-type="bibr" rid="ref17">Santiso &amp;
Roseth (2018)</xref>
        and Van Ooijen, Ubaldi &amp; Welby (2019) distinguish four different stages of data
analytics: descriptive analytics, diagnostic analytics, predictive analytics and prescriptive analytics.
Based on other studies in the literature, De Sousa et al. (2019) developed an overview of 22 AI
solutions for the public sector, ranging from knowledge management and data processing
automation, detecting fraud, measurement and optimization of public transport to crime prediction
and assessment.
      </p>
      <p>
        Five studies that were found have been based on literature research, or have mentioned
individual examples of applications of public sector AI
        <xref ref-type="bibr" rid="ref15 ref17 ref21 ref6">(Mehr, 2017; Santiso &amp; Roseth, 2018; Van
Ooijen, Ubaldi &amp; Welby, 2019; De Sousa et al., 2019; Wirtz, Weyerer &amp; Geyer, 2019)</xref>
        . Some papers
have gone a step further and also based their typologies on an empirical mapping of examples of
usage in practice
        <xref ref-type="bibr" rid="ref14 ref14 ref16 ref20 ref20 ref4">(Chui et al., 2018; Poel, Meyer &amp; Schroeder, 2018; Misuraca, Van Noordt &amp; Boukli,
2020; Van Veenstra, Grommé &amp; Djafari, 2020)</xref>
        . Poel, Meyer &amp; Schroeder (2018), Van Veenstra,
Grommé &amp; Djafari (2020) and Misuraca, Van Noordt &amp; Boukli (2020) developed their typologies by
undertaking such mapping studies. After conducting a policy analysis and interviews with
stakeholders, Poel, Meyer &amp; Schroeder (2018) identified different phases in the policy making
process like foresight and agenda setting, monitoring and interim evaluation, problem analysis,
identification and design of policy options, policy implementation and ex-post evaluation and
impact assessment, of which most of the examples were in the foresight and agenda setting phase.
Misuraca, Van Noordt &amp; Boukli (2020) conducted a preliminary mapping exercise across the EU
where they aimed to gain a better understanding of current AI implementations in the public sector.
Their typology focuses on the type of AI techniques that are applied in practice, including image
recognition, natural language processing, pattern recognition, robotic process automation and
robotics.
      </p>
      <p>Based on a mapping study on the usage of data analytics in the Dutch public sector, Van Veenstra,
Grommé &amp; Djafari (2020) formulated a typology for the use and purpose of public sector data
analytics, including AI. Six types of purposes have been identified, including personalization,
resource allocation, maintenance, inspection and enforcement, crime investigation and forecasting.
Based on the typologies discussed above we have further developed Van Veenstra, Grommé &amp;
Djafari (2020)’s typology on the use of public sector data analytics in the Netherlands and specifically
tailored it to the use of AI in the public sector. Because this typology combines technical aspects of
data analytics with government roles and has been developed based on an empirical study of 74
applications, we use this typology as a starting point. Subsequently, we attune this typology based
on literature on the other typologies specifically to AI.</p>
      <p>Table 1 presents the results of this exercise. To attune the typology of Van Veenstra, Grommé &amp;
Djafari (2020) to public sector AI, we investigated the typologies found in the literature in relation
to the categories of the framework. Based on the literature, we found that two categories were
missing. Therefore, to give a more complete overview of the type of use of AI in the public sector,
based on the study of Poel, Meyer &amp; Schroeder (2018) on the use of big data for policy analysis and
the study of De Sousa et al. (2019) and Wirtz, Weyerer &amp; Geyer (2019) on AI applications for
knowledge management, we added the categories ‘knowledge management’ and ‘policy analysis’.</p>
      <sec id="sec-3-1">
        <title>Tailored solutions Personalization of public (personalization) service to individual needs of citizens, e.g. with the use of chatbots or virtual agents</title>
        <p>Process Improving the process by Mehr, 2017; Chui et al, 2018; De Sousa et al,
optimization making it more efficient and 2019; Wirtz, Weyerer &amp; Geyer, 2019; Van
(resource allocation) effective, e.g. with the use of Veenstra, Grommé &amp; Djafari, 2020
predictive analytics
Maintenance</p>
      </sec>
      <sec id="sec-3-2">
        <title>Inspection</title>
        <p>enforcement
and
(Crime)
investigation</p>
      </sec>
      <sec id="sec-3-3">
        <title>Identifying when something needs to be repaired, e.g. with the use of predictive analytics</title>
      </sec>
      <sec id="sec-3-4">
        <title>Chui et al, 2018; De Sousa et al, 2019; Wirtz, Weyerer &amp; Geyer, 2019; Van Veenstra, Grommé &amp; Djafari, 2020</title>
      </sec>
      <sec id="sec-3-5">
        <title>Fraud identification, De Sousa et al, 2019; Wirtz, Weyerer &amp; inspection of the physical Geyer, 2019; Van Veenstra, Grommé &amp; environment, e.g. with the Djafari, 2020 use of predictive analytics</title>
      </sec>
      <sec id="sec-3-6">
        <title>Investigation of crime, e.g. De Sousa et al, 2019; Wirtz, Weyerer &amp; with the use of predictive Geyer, 2019; Van Veenstra, Grommé &amp; analytics, pattern recognition Djafari, 2020 Misuraca, Van Noordt &amp; and identity analytics Boukli, 2020</title>
      </sec>
      <sec id="sec-3-7">
        <title>Forecasting</title>
      </sec>
      <sec id="sec-3-8">
        <title>Knowledge management</title>
      </sec>
      <sec id="sec-3-9">
        <title>Policy analysis</title>
      </sec>
      <sec id="sec-3-10">
        <title>Prediction of trends and</title>
        <p>scenario's, e.g. with the use of
predictive analytics
Mehr, 2017; De Sousa et al, 2019; Wirtz,
Weyerer &amp; Geyer, 2019; Van Veenstra,
Grommé &amp; Djafari, 2020</p>
      </sec>
      <sec id="sec-3-11">
        <title>The use of AI for archiving of information, e.g. with the use of knowledge management software</title>
      </sec>
      <sec id="sec-3-12">
        <title>Use of data for decision making and policy evaluation, e.g. with the use of predictive analytics</title>
      </sec>
      <sec id="sec-3-13">
        <title>De Sousa et al, 2019; Wirtz, Weyerer &amp; Geyer, 2019</title>
      </sec>
      <sec id="sec-3-14">
        <title>Poel, Meyer &amp; Schroeder, 2018; Wirtz, Weyerer &amp; Geyer, 2019</title>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Findings and Discussion</title>
      <p>The objective of this study was to develop a typology for public sector AI based on literature, that
supports the understanding of how and for which purposes is AI technology applied. Based on the
literature we find that a typology based on eight categories is useful to map the use of public sector
AI. These eight categories of public sector AI illustrate for which purpose AI can be used within
government: ‘tailored solutions’, ‘process optimization’, ‘maintenance’, ‘inspection and
enforcement’, ‘crime investigation’, ‘knowledge management’, ‘forecasting’ and ‘policy analysis’.</p>
      <p>This typology of eight categories addresses three main challenges with public sector AI. The first
challenge is that there currently is no clear definition of AI. AI is considered an umbrella term for
different technologies that can be used for different purposes. The second challenge is that there are
no definite mapping studies available. There are few exploratory mapping studies available, such
as Van Veenstra, Grommé &amp; Djafari (2020) and Misuraca, Van Noordt &amp; Boukli (2020). However,
these studies do not give a complete overview of how public sector AI is used in practice. In addition,
a third challenge is that we do not know which type of AI can be linked to certain challenges, as it is
unclear which challenges are associated with which phases.</p>
      <p>Currently, there is a lot of effort to understand, define and map public sector AI. This typology
may support this research, and may help to categorize challenges. In addition, a more complete
overview can be given of when and for which purposes a certain AI technology can be used. For
example, in this study we found that chatbots and virtual agents are often used for tailored solutions
aimed at personalizing public service to individual needs of citizens, whereas forecasting and the
prediction of trends and scenario's use predictive analytics. This typology has not yet been validated
with evidence from practice. We aim to validate this typology with evidence from practice in the
next phase of our research.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion</title>
      <p>This study developed a typology for applications of public sector AI based on literature. Such a
typology can be used not only to gain a structured overview of public sector AI, but also to gain
insight into which type of applications are associated with certain challenges. Based on a literature
study of nine typologies of public sector data analytics and AI we identified eight categories of
public sector AI: ‘tailored solutions’, ‘process optimization’, ‘maintenance’, ‘inspection and
enforcement’, ‘crime investigation’, ‘knowledge management’, ‘forecasting’ and ‘policy analysis’. A
limitation of this study is that it is solely based on other typologies mentioned in the literature.
Therefore, we do not know if this typology is representative in practice. For this reason, we aim to
validate this typology in practice in further research.
Mehr, H. (2017). Artificial Intelligence for Citizen Services and Government. Harvard Ash Center.</p>
      <p>OECD (2019). Artificial Intelligence in Society, OECD Publishing, Paris.</p>
      <p>About the Authors
Marissa Hoekstra
Anne Fleur van Veenstra
Cass Chideock
Marissa Hoekstra is a researcher at TNO's Strategic Analysis &amp; Policy Unit. Her research focusses on the
impact of new technologies, digitalization and innovation on society and the public sector. Marissa has a MA
in International Relations and a BSc in Political Science from Leiden University.</p>
      <p>Dr. Anne Fleur van Veenstra is Director of Science at TNO's Strategic Analysis &amp; Policy Unit. She has widely
published on Public Sector AI, Public Sector Innovation and Digital Governance. She obtained her PhD in
Technology, Policy and Management at Delft University of Technology.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Androutsopoulou</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karacapilidis</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loukis</surname>
            ,
            <given-names>E.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Charalabidis</surname>
            ,
            <given-names>Y</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Transforming the communication between citizens and government through AI-guided chatbots</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <volume>36</volume>
          (
          <issue>2</issue>
          )
          <fpage>167</fpage>
          -
          <lpage>384</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Berryhill</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heang</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clogher</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>McBride</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2019</year>
          ). Hello,
          <source>World: Artificial Intelligence</source>
          and
          <article-title>its Use in the Public Sector</article-title>
          .
          <source>OECD Working Paper on Public Governance</source>
          .
          <volume>36</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Campion</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hernandez</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mikhaylov</surname>
            ,
            <given-names>S.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Esteve</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Managing Artificial Intelligence Deployment in the Public Sector</article-title>
          .
          <source>Computer</source>
          <volume>53</volume>
          (
          <issue>10</issue>
          ),
          <fpage>28</fpage>
          -
          <lpage>37</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Chui</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Manyika</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miremadi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Henke</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chung</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nel</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malhotra</surname>
            ,
            <given-names>S</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Notes from the AI frontier: Applications and the value of deep learning Insights from hundreds of cases</article-title>
          . Discussion paper.
          <source>McKinsey Global Institute.</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Craglia</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Annoni</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Benczur</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bertoldi</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Delipetrev</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Prato</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Feijoo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fernandez Macias</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gomez</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Iglesias</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Junklewitz</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>López</surname>
            <given-names>Cobo</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Martens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Nascimento</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Nativi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Polvora</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Sanchez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Tolan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Tuomi</surname>
          </string-name>
          ,
          <string-name>
            <surname>I.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Vesnic</given-names>
            <surname>Alujevic</surname>
          </string-name>
          ,
          <string-name>
            <surname>L.</surname>
          </string-name>
          (
          <year>2018</year>
          ).
          <source>Artificial Intelligence - A European Perspective.</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>De Sousa</surname>
          </string-name>
          , W.G.,
          <string-name>
            <surname>de Melo</surname>
            ,
            <given-names>E.R.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bermejo</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,H.,
          <string-name>
            <surname>Farias</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gomes</surname>
            ,
            <given-names>A.O.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>How and where is artificial intelligence in the public sector going? A literature review and research agenda</article-title>
          .
          <source>Government Information Quarterly</source>
          <volume>36</volume>
          (
          <issue>4</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <source>Dutch Ministry of Economic Affairs and Climate</source>
          (
          <year>2019</year>
          ).
          <article-title>Strategisch actieplan voor AI</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Communication from the Commission</article-title>
          ,
          <source>Artificial Intelligence for Europe</source>
          ,
          <source>COM</source>
          (
          <year>2018</year>
          )
          <volume>237</volume>
          ,
          <fpage>1</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Feijóo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kwon</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>AI impacts on economy and society: Latest developments, open issues and new policy measures</article-title>
          .
          <source>Telecommunications Policy</source>
          ,
          <volume>44</volume>
          (
          <issue>6</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Fong</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Autonomous Systems NASA Capability Overview</article-title>
          , NASA - Space
          <source>Technology Mission Directorate.</source>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <source>High-Level Expert Group on Artificial Intelligence</source>
          . (
          <year>2019</year>
          ).
          <article-title>A definition of AI: main capabilities and disciplines</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuk</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>The challenges and limits of big data algorithms in technocratic governance</article-title>
          .
          <source>Government Information Quarterly</source>
          <volume>33</volume>
          (
          <issue>3</issue>
          ),
          <fpage>371</fpage>
          -
          <lpage>377</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Kankanhalli</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Charalabidis</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mellouli</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>IoT and AI for Smart Government: A Research Agenda</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <volume>36</volume>
          (
          <issue>2</issue>
          ).
          <fpage>304</fpage>
          -
          <lpage>309</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Misuraca</surname>
            , G., van Noordt,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boukli</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>The use of AI in public services: results from a preliminary mapping across the EU</article-title>
          .
          <source>In Proceedings of the 13th International Conference on Theory and Practice of Electronic Governance (ICEGOV</source>
          <year>2020</year>
          ).
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>90</fpage>
          -
          <lpage>99</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Ooijen</surname>
            , C., van, Ubaldi,
            <given-names>B.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Welby</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>A data-driven public sector</article-title>
          .
          <source>OECD Working Papers on Public Governance</source>
          .
          <volume>33</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Poel</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , Meyer, E.T.,
          <string-name>
            <surname>Schroeder</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Big Data for Policymaking: Great Expectations, but with Limited Progress?</article-title>
          .
          <source>Policy and Internet</source>
          <volume>10</volume>
          (
          <issue>3</issue>
          ),
          <fpage>347</fpage>
          -
          <lpage>367</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Santiso</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Roseth</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Data Disrupts Corruption</article-title>
          . Stanford Social Innovation Review, Spring, pp.
          <fpage>50</fpage>
          -
          <lpage>55</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Sun</surname>
            ,
            <given-names>T.Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Medaglia</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Meeting the challenges of Artificial Intelligence in the public sector: Evidence from public healthcare</article-title>
          .
          <source>Government Information Quarterly</source>
          <volume>36</volume>
          (
          <issue>2</issue>
          ),
          <fpage>368</fpage>
          -
          <lpage>383</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Thierer</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Castillo O'Sullivan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Russell</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <source>Artificial Intelligence and Public Policy. Mercatus Research</source>
          . George Mason University. 1-
          <fpage>156</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>van Veenstra</surname>
            ,
            <given-names>A.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grommé</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Djafari</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>The use of public sector data analytics in the Netherlands</article-title>
          .
          <source>Transforming Government: People, Process and Policy</source>
          . Vol.
          <article-title>ahead-of-print (No. ahead-of-print)</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Wirtz</surname>
            ,
            <given-names>B.W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weyerer</surname>
            ,
            <given-names>J.C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Geyer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Artificial Intelligence and the Public Sector - Applications and Challenges</article-title>
          .
          <source>International Journal of Public Administration</source>
          .
          <volume>42</volume>
          (
          <issue>7</issue>
          )
          <fpage>596</fpage>
          -
          <lpage>615</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>