<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Stimulating the Uptake of AI in Public Administrations: Overview and Comparison of AI Strategies of European Member States</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Colin van Noordt</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rony Medaglia</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gianluca Misuraca</string-name>
          <email>Gianluca.MISURACA@ec.europa.eu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Joint Research Centre.</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>TalTech</institution>
          ,
          <addr-line>Tallinn</addr-line>
          ,
          <country country="EE">Estonia</country>
        </aff>
      </contrib-group>
      <fpage>269</fpage>
      <lpage>277</lpage>
      <abstract>
        <p>There is an interest in governments to stimulate the uptake of AI technologies within their administrations. However, little is still known about the policy initiatives countries are taking to facilitate the development and usage of AI within governmental organizations. This paper analyses, through the lens of policy instruments, existing AI strategies of European Member States to give a first overview of the different policy actions proposed to tackle adoption challenges in the public sector. Our findings suggest that there are significant differences between the number and type of policy actions taken and that many of the countries favour the exploitation of soft policy instruments over harder, regulatory approaches or active funding and other financial incentives. Acknowledgements: Work on this paper has been in part conducted under the contract CTEX2019D361089-101 funded by the ISA2 ELISE Action, and in support of the activities on AI for the</p>
      </abstract>
      <kwd-group>
        <kwd>Artificial Intelligence</kwd>
        <kwd>Public Sector</kwd>
        <kwd>Strategy</kwd>
        <kwd>Policy Instruments</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Disclaimer: The views expressed in this article are purely those of the authors and may not be
regarded as stating the official position of the European Commission.</p>
      <p>
        Governments across the world have increasingly committed themselves to actively stimulating the
development and diffusion of Artificial Intelligence (AI) in the public sector. In particular, AI in
Europe has been regarded as highly important on the political agendas already since the Tallinn
Declaration signed in 2017, where political leaders took notice of the potential of AI to enhance
political decision making (European Union, 2017). Currently, there are numerous European actions
to further stimulate investments in AI, such as the signed Coordinated Action Plan on AI (European
Commission, 2018). As part of this document, countries were asked to draft national AI strategies to
further detail their policy plans on stimulating AI development and adoption. In general, AI
includes systems which perform human-like cognitive functions, often by making predictions,
recommendations and decisions (OECD, 2019). What makes AI different from earlier technological
waves is its potential to be delegated with decision-making capacity, rather than solely providing
information
        <xref ref-type="bibr" rid="ref5 ref7">(Just &amp; Latzer, 2017; Latzer &amp; Just 2020)</xref>
        . However, challenges lie in the adoption and
use of AI solutions within government. As illustrated by
        <xref ref-type="bibr" rid="ref13">Wirtz et al. (2019)</xref>
        in a recent review, there
are currently four major dimensions which are limiting the use of AI in the public sector: technology,
laws, ethics and social factors. For example, the development and usage of AI technology requires
high levels of data quality and integration, and specialized staff to develop and work with AI
solutions resources that are often missing in government.
      </p>
      <p>
        Thus, considering the wide amount of identified challenges on AI adoption already identified by
recent research, there is a great need to understand how governments are planning to overcome
these adoption barriers in government
        <xref ref-type="bibr" rid="ref13">(Wirtz et al., 2019; Sun &amp; Medaglia, 2019)</xref>
        . The swift
emergence of different national strategies for AI in Europe has led to a mushrooming of diverse
policy instruments designed by governments to stimulate the uptake of AI. The aim of this paper is
to provide an overview and a first analysis of the policy instruments highlighted in these strategies,
enabling the identification of different policy styles with regards to the use of AI in the public sector.
Analysing the AI strategies is likely to give fruitful insights on the intentions as well as the
importance of stimulating AI within government and outline possible directions for policy and
research.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Theoretical Framework</title>
      <p>In our analysis, we adopt the lens of policy instruments to capture the diversity of national strategies
for AI in the public sector. Policy instruments are generally de
(Howlett, 2005)</p>
      <p>As
implement their public pol</p>
      <p>
        <xref ref-type="bibr" rid="ref4">(Howlett, 1991)</xref>
        .
      </p>
      <p>
        The study of policy instruments arises from the need to both unpack the connections between
policy formulation and implementation, and to understand public policy decision-making processes
[9]. In the research area of innovation, policy instruments are emphasized in their purposive nature,
as a set of techniques by which governmental authorities wield their power in attempting to ensure
support and effect (or prevent) social change
        <xref ref-type="bibr" rid="ref12">(Vedung, 1998)</xref>
        .
      </p>
      <p>
        Nevertheless, attempts at classifying policy instruments provide useful heuristics for
comparison, benchmarking, and cross-country learning processes
        <xref ref-type="bibr" rid="ref8">(Linder &amp; Peters, 1998)</xref>
        , in
particular in relation to the digitalization of the public sector
        <xref ref-type="bibr" rid="ref2">(Hood &amp; Margetts, 2007)</xref>
        . While there
is no agreement on a single approach to all classifications of policy instruments, a general, three-fold
typology of policy instruments has been proven useful in a variety of practical contexts
        <xref ref-type="bibr" rid="ref9">(Bruijn &amp;
Hufen, 1998; Tools of Government, 2002)</xref>
        . This three-fold typology includes regulatory instruments,
economic and financial instr
the establishment of Intellectual Property Rights, competition regulation, or ethical regulations.
economic incentives. Examples include direct cash transfers, tax incentives, competitive research
residual category, often used in conjunction with the other two categories of policy instruments. Soft
instruments include, for instance, communication campaigns, private-public partnerships, and
voluntary codes of conduct.
      </p>
      <p>We adopt this categorization as a lens to systematize the diversity of policy instruments for AI in
public sector within the AI national strategies of European Members States. Besides allowing us to
make sense of the complexity and the diversity of such strategies, this categorization lens can
contribute to define shared criteria of the choice and implementation of future policy instruments to
stimulate the uptake of AI in the public sector.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Methodology</title>
      <p>
        In order to understand which policy instruments are adopted to stimulate the use of AI in the public
sector within national strategies in Europe, this research uses a comparative policy document
analysis approach. Comparative policy document analysis is a well-established approach in public
administration research that aims to understand the intentions, plans and political interests in
policy-making
        <xref ref-type="bibr" rid="ref6">(Karppinen &amp; Moe, 2012; Pollitt &amp; Bouckaert, 2017)</xref>
        .1 For such an approach,
comparability is essential. This study analyses all the official governmental AI strategies published
by European Member States by the 25th of February 2020, taking note of the comparative overviews
of the strategies in the AI Watch
        <xref ref-type="bibr" rid="ref11">(van Roy, 2020)</xref>
        .
      </p>
      <p>Only the final published AI strategies were considered for the full review. Upon further
inspection into the published AI strategies, some countries have published AI-related policy
initiatives in other documents rather than or in addition to the official AI strategy. These
initiatives have been excluded for this overview, to ensure the comparability and to avoid some
countries being under- or overrepresented. Due to language barriers, only the AI Strategies which
have been available in English, Dutch, Italian, Danish and Spanish were considered for the full text
review. Therefore, 13 AI strategy documents2 have been considered for this research.</p>
      <p>During the document review, the AI strategies were analysed to discern any actions governments
are considering or have already taken to stimulate and facilitate the development of AI in their
1</p>
      <p>Often, a report was published with these recommendations which may or may not have ended up on
2 Those from the Czech Republic, Denmark, Estonia, France, Finland, Germany, Lithuania,
Luxembourg, Malta, the Netherlands, Portugal, Sweden and the United Kingdom.
sed by at least
two of the authors and, when discrepancies in the categorizations arised, documents were further
discussed until a consensus emerged. Following, a summary was written including the policy
initiatives mentioned in the full strategy report to exclude non-relevant information (e.g., regarding
actions boosting R&amp;D in AI in universities). Lastly, these different policy initiatives were then
analysed using the three-fold typology on policy instruments.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Findings</title>
      <p>Following our analysis, a variety of different policy initiatives are considered by the countries to
stimulate the use of AI in the public sector, tailored to their specific situation. Some initiatives are
tasked with stimulating the awareness of the potential of AI technologies among civil servants. This
should improve their understanding of the technological potential and perhaps discover use cases
to explore AI in their line of work, through holding awareness campaigns, organizing regular
meetings between civil servants with AI experts or by creating opportunities to participate in
(European) AI policy events.</p>
      <p>Related to these awareness campaigns are policy actions aimed at improving the internal capacity
of public administrations to develop and implement AI into their daily workflows. Hence, some
governments are exploring the creation of internal AI training: either a general AI training course
for all civil servants to assist them with working with AI technologies, or a specialized training
course for technical personnel to stimulate in-house development of AI applications, potentially
facilitated by new AI related positions or departments. In the Danish example, an internal academy
will be established to provide general training courses for civil servants, while there are plans to
develop specialist AI courses in collaboration with universities (The Danish Government, 2019).</p>
      <p>Other initiatives are tasked with improving the data on which the AI applications are built upon.
Common actions are establishing data management programmes, organizing internal training for
civil servants to improve data literacy and by creating a new technological infrastructure for data
governance across the public sector as methods to improve the overall data quality. Another set of
policy initiative focus on improving access to public sector data among different institutions.</p>
      <p>Unique for the public sector, however, it is mentioned to consider improving the access to data
held by private sector institutions, potentially valuable for public organizations. This is why the UK
government in a responsible and trustworthy way (HM Government, 2019).</p>
      <p>As many organizations and governments have expressed the possible ethical concerns associated
to the development and use of AI, many strategies mention the consideration of the ethical
implications of adopting AI, especially when they are used in the public sector. Such a framework
document could assist in establishing trust among both civil servants and citizens that the AI
used in government is of high quality and in line with ethical values. In Finland, there are plans to
create an ethical code of conduct as part of the AuroraAI public sector reform programme (Ministry
of Economic Affairs and Employment of Finland, 2019).</p>
      <p>Other initiatives aim to conduct legal reforms to facilitate AI development and use in various
policy areas, while the Estonian strategy mentions the possibility to explore general AI laws which
among other goals has the objective to clarify the accountability and transparency issues related
to the use of AI in public services (Government of the Republic of Estonia, 2019).</p>
      <p>
        Some strategies also mention the need for revisions to existing public procurement regulation in
order to provide more accessible ways to contract with the public sector. As an example, the Dutch
strategy mentions the plans to use innovative procurement processes to assist SMEs in developing
AI for government, such as hackathons
        <xref ref-type="bibr" rid="ref11">(Ministerie van Economische Zaken en Klimaat, 2019)</xref>
        .
      </p>
      <p>In addition, some strategies mention the allocation of funding to stimulate the development and
uptake of AI in the public sector. As an example, the Danish strategy mentions that the government
is planning to allocate 27 million euros to test and deploy AI in municipalities and regions (The
Danish Government, 2019). While some of these funding programmes are aimed at administrations
themselves, others focus on stimulating the GovTech Startup landscape, assuming they will bring
innovative AI solutions to the market for government organizations.</p>
      <p>Lastly, some of these initiatives aim to facilitate the experimentation of this technology to learn
from the challenges in developing and applying AI in public sector contexts. Therefore, a variety of
countries have mentioned some AI flagship projects which will be used to learn from AI
implementations and its effects. Based on the experiences of these initiatives, knowledge could be
shared among institutions and revisions of the AI strategies made in the future. As part of this
experimentation, some mention that regulatory sandboxes are being established to provide an
experimental setting or safe area to test AI applications before they are deployed on a larger scale.</p>
      <p>In the following table, an overview of each of these initiatives in all countries under investigation
can be found.
Z K E E I R T U A L T W K</p>
      <p>Total</p>
      <p>X X X X X X
X X X X
X X X X X</p>
      <p>X
X
X
X</p>
      <p>X
X
X
X
X
X X</p>
      <p>X
X
X
X
X
X
X
X
X X
X X X
X X
X X</p>
      <p>X
X X</p>
      <p>X X
X X</p>
      <p>X
X
X</p>
      <p>X
X</p>
      <p>X
X X X</p>
      <p>X X X
X X X X
X X X X</p>
      <p>X X
X X X X X</p>
      <p>X
X</p>
      <p>X X</p>
      <p>X</p>
      <p>X
X
X
X
X</p>
      <p>X
X X X</p>
      <p>X X X X
10
10
9
3
4
9
1
8
6
6
4
8
3
1
4
4
5</p>
      <p>The analysis of the policy actions proposed in the different AI national strategies shows that not
all countries have explored the same depth and scope of initiatives to stimulate the adoption of AI
within the public sector. As it can be seen in the overview, there are considerable differences in what
actions Member States are taking to ensure the uptake of AI in the public sector. Nevertheless, some
of these initiatives seem to be more reoccurring than others, as most strategies mention to improve
the data used for AI in the public sector, having flagship AI projects, hosting awareness campaigns,
training programmes and developing ethical frameworks.</p>
      <p>Following, these different policy actions have been classified according to the three-fold typology
of policy instruments sticks, carrots and sermons, as shown in Table 2.</p>
      <p>As can be seen in the overview, many of these policy instruments could be classified as the
facilitating AI development and usage. By comparison, far less of these policy instruments could be</p>
      <p>In sum, many of the existing and planned policy initiative which are aimed to tackle would be
relatively soft policy instruments, aimed at facilitating civil servants into experimenting, while far
few policy initiatives are of regulatory or financial nature. While it is too early to say what this will
mean for the future development and usage of AI in the public sector, having limited financial
resources and regulatory policy support might mean that many of the other well-intentioned policy
initiatives might not be effective to promote AI adoption. Further research is very much needed into
usage in the public sector.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion and Future Research</title>
      <p>
        In conclusion, the analysis of AI national strategies reveals a wide variety of initiatives and
techniques that Member States are putting in place or intend to put in place to foster the use of AI
in the public sector, both directly and indirectly. Using the vocabulary of a classic categorization of
different policy instruments
        <xref ref-type="bibr" rid="ref12">(Vedung, 1998)</xref>
        training and dissemination programmes), we can observe that, for the time being, most of the
      </p>
      <p>
        Soft policy instruments, such as campaigns for awareness,
encouragements to improve data quality, and employee training, are in fact prevalent across almost
all countries. Regulation and financial resource allocation, such as project funding and procurement
process reviews, on the other hand, are instruments that are less uniformly distributed at this stage.
This overview of national approaches to fostering the implementation and use of AI in the public
sector is a snapshot of a swiftly developing scenario, which is very likely to transform over time.
sector can serve as a practical first step to systematically assess potential impacts of AI in public
services in the European Union. Ideally, most public policy reviews combine document analysis
with expert interviews to ensure that necessary information regarding the policy is not lost or
misunderstood
        <xref ref-type="bibr" rid="ref1">(Bowen, 2009)</xref>
        . We notice this limitation, as it is likely that some policy actions
regarding AI are included into other initiatives, such as the Digital Government strategies.
Therefore, as part of the AI Watch studies, additional research activities such as a workshop
        <xref ref-type="bibr" rid="ref10 ref11">(van
Noordt et. al., 2020 forthcoming)</xref>
        eGovernment representatives have already been held, which can be consulted in the full report
        <xref ref-type="bibr" rid="ref10 ref11">(Misuraca &amp; van Noordt, 2020 forthcoming)</xref>
        . The future research activity will build on these insights,
by including additional policy documents, and interviews with stakeholders to further interpret the
strategies, the rationale and possibly, the effects, of different policy initiatives.
Bruijn, H.A. De, Hufen, H.A.: The Traditional Approach to Policy Instruments. In: Public Policy Instruments:
      </p>
      <p>Evaluating the Tools of Public Administration (1998).</p>
      <p>European Commission: Coordinated Plan on Artificial Intelligence. (2018).</p>
      <p>European Union: Tallinn Declaration on eGovernment - at the ministerial meeting during Estonian
Presidency of the Council of the EU on 6 October 2017. 14 (2017).</p>
      <p>HM Government: Industrial Strategy Artificial Intelligence Sector Deal. (2019).
Ministerie van Economische Zaken en Klimaat: Strategisch Actieplan voor Artificiële Intelligentie [Strategic</p>
      <p>Action Plan for Artificial Intelligence]. (2019).</p>
      <p>Ministry of Economic Affairs and Employment of Finland: Leading the way into the age of artificial
intelligence. , Helsinki (2019).</p>
      <p>Misuraca, G., van Noordt, C.: Overview of the use of AI in public services in the EU and proposed
methodology to assess their impacts., AI Watch, Luxembourg (2020, forthcoming).</p>
      <p>OECD: Hello, World: Artificial Intelligence and its use in the Public Sector. OECD Obs. Public Sect. Innov. 1
148 (2019).</p>
      <p>Pollitt, C., Bouckaert, C.: Public Management Reform: A Comparative Analysis - Into The Age of Austerity.</p>
      <p>Oxford University Press, Oxford (2017).</p>
      <p>Sun, T.Q., Medaglia, R.: Mapping the challenges of Artificial Intelligence in the public sector: Evidence from
public healthcare. Gov. Inf. Q. 36, 368 383 (2019). https://doi.org/10.1016/j.giq.2018.09.008.
The Danish Government: National Strategy for Artificial Intelligence. (2019).
on the use and impa
About the Authors</p>
      <sec id="sec-5-1">
        <title>Colin van Noordt</title>
      </sec>
      <sec id="sec-5-2">
        <title>Rony Medaglia</title>
      </sec>
      <sec id="sec-5-3">
        <title>Gianluca Misuraca</title>
      </sec>
      <sec id="sec-5-4">
        <title>Colin van Noordt is a PhD Researcher at the Ragnar Nurkse Department of Innovation and Governance at</title>
      </sec>
      <sec id="sec-5-5">
        <title>Tallinn University of Technology (TalTech), Estonia.</title>
        <p>Rony Medaglia, PhD is Associate Professor at the Department of Digitalisation of the Copenhagen Business
School, Denmark.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Bowen</surname>
            ,
            <given-names>G.A.</given-names>
          </string-name>
          :
          <article-title>Document analysis as a qualitative research method</article-title>
          .
          <source>Qual. Res. J. 9, 27</source>
          <volume>40</volume>
          (
          <year>2009</year>
          ). https://doi.org/10.3316/QRJ0902027.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Hood</surname>
            ,
            <given-names>C.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Margetts</surname>
            ,
            <given-names>H.Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hood</surname>
            ,
            <given-names>C.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Margetts</surname>
            ,
            <given-names>H.Z.</given-names>
          </string-name>
          :
          <article-title>Looking Ahead: The Tools of Government in the Digital Age</article-title>
          . In:
          <article-title>The Tools of Government in the Digital Age (</article-title>
          <year>2007</year>
          ). https://doi.org/10.1007/978-1-
          <fpage>137</fpage>
          - 06154-
          <issue>6</issue>
          _
          <fpage>9</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Howlett</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>What is a policy instrument? Tools, mixes, and implementation styles</article-title>
          . In: Designing Government: From Instruments to Governance (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Howlett</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          : Policy Instruments, Policy Styles, and Policy Implementation:
          <article-title>National Approaches to Theories of Instrument Choice</article-title>
          .
          <source>Policy Stud. J. 19, 1</source>
          <volume>21</volume>
          (
          <year>1991</year>
          ). https://doi.org/10.1111/j.1541-
          <fpage>0072</fpage>
          .
          <year>1991</year>
          .tb01878.x.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Just</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Latzer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Governance by algorithms: reality construction by algorithmic selection on the Internet</article-title>
          .
          <source>Media, Cult. Soc</source>
          .
          <volume>39</volume>
          ,
          <fpage>238</fpage>
          <lpage>258</lpage>
          (
          <year>2017</year>
          ). https://doi.org/10.1177/0163443716643157.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Karppinen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moe</surname>
          </string-name>
          , H.:
          <article-title>What We Talk about When We Talk About Document Analysis</article-title>
          . In: Just,
          <string-name>
            <given-names>N.</given-names>
            and
            <surname>Manuel</surname>
          </string-name>
          , P. (eds.) Trends in Communication Policy Research. pp.
          <fpage>177</fpage>
          <lpage>194</lpage>
          . Intellect, Bristol, UK (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Latzer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Just</surname>
          </string-name>
          , N.:
          <article-title>Governance by and of Algorithms on the</article-title>
          <source>Internet : Impact and Consequences. 1</source>
          <volume>21</volume>
          (
          <year>2020</year>
          ). https://doi.org/10.1093/acrefore/9780190228613.013.904.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Linder</surname>
            ,
            <given-names>S.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peters</surname>
            ,
            <given-names>B.G.</given-names>
          </string-name>
          :
          <article-title>The study of policy instruments: four schools of thought</article-title>
          , (
          <year>1998</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <article-title>The Tools of government: a guide to the new governance</article-title>
          .
          <source>Choice Rev. Online</source>
          . (
          <year>2002</year>
          ). https://doi.org/10.5860/choice.40-
          <fpage>2422</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          ,
          <string-name>
            <given-names>AI</given-names>
            <surname>Watch</surname>
          </string-name>
          ,
          <string-name>
            <surname>Seville</surname>
          </string-name>
          (
          <year>2020</year>
          , forthcoming).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>van Roy</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <source>AI Watch - National strategies on Artificial Intelligence: A European</source>
          perspective in
          <year>2019</year>
          . (
          <year>2020</year>
          ). https://doi.org/10.2760/602843.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Vedung</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          : Carrots, Sticks, &amp;
          <string-name>
            <surname>Sermons: Policy</surname>
            <given-names>Instruments &amp; Their</given-names>
          </string-name>
          <string-name>
            <surname>Evaluation. Carrots</surname>
          </string-name>
          , Sticks,
          <source>Sermons Policy Instruments Their Eval</source>
          .
          <article-title>(</article-title>
          <year>1998</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Wirtz</surname>
            ,
            <given-names>B.W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weyerer</surname>
            ,
            <given-names>J.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Geyer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Artificial Intelligence and the Public Sector Applications and Challenges</article-title>
          .
          <source>Int. J. Public Adm</source>
          .
          <volume>42</volume>
          ,
          <fpage>596</fpage>
          <lpage>615</lpage>
          (
          <year>2019</year>
          ). https://doi.org/10.1080/01900692.
          <year>2018</year>
          .
          <volume>1498103</volume>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>