<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The Use of Blockchain Technology in Digital Coproduction: The Case of Barcelona</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Evrim Tan</string-name>
          <email>Evrim.tan@kuleuven.be</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>A. Paula Rodriguez Müller</string-name>
          <email>anapaula.rodriguezmuller@kuleuven.be</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Katholieke Leuven Universiteit, Public Governance Institute</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <fpage>125</fpage>
      <lpage>134</lpage>
      <abstract>
        <p>By creating an autonomous, transparent, and secure decentralized system, blockchain technology enables the removal of intermediaries as trustees to be replaced by a peer-to-peer based governance system. This feature upholds important implications to redesign the public governance systems and co-production practices in a more transparent, efficient and effective way. As a first use case example of the blockchain technology in a digital co-production process, the city of Barcelona has initiated the Digital Democracy Data Commons (DDDC) project to uses the blockchain and distributed ledger technology to share a petition with participants, sign it with a mobile app and count the signatures in a cryptographically secure and completely anonymous way. Through an in-depth case study, this paper analyzes how blockchain technology can shape the coproduction processes and what possible roles can be assumed by citizens for the use of these technologies in digital coproduction. In this paper, we created a novel analytical framework to categorize possible roles imposed on coproducers in blockchain technology-based systems. Our preliminary findings suggest that the compatibility with the legal framework, the interoperability with existing institutions in data governance, and previous experiences and established communities for deliberative and participatory processes are important on the design -based digital coproduction processes.</p>
      </abstract>
      <kwd-group>
        <kwd>Blockchain</kwd>
        <kwd>Digital Coproduction</kwd>
        <kwd>Distributed Ledger Technology</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Disruptive technologies are increasingly influencing the way coproduction provides value to society
and how coproduction processes are implemented. Governments around the globe are conceiving
of new ways to engage citizens in coproduction and collaborative efforts via disruptive technologies,
such as blockchain and distributed ledger technology (DLT). These efforts lie on the promises of
such technologies to increase trust in and security of transactions and reduce transactions cost
        <xref ref-type="bibr" rid="ref10 ref7">(Foth,
2017; ITU, 2017)</xref>
        . However, the existing literature is limited in empirical cases to show how
blockchain and DLT can shape the coproduction processes and what possible roles can be assumed
by citizens for the use of these technologies in digital coproduction.
      </p>
      <p>This paper aims to address this gap by focusing on the following research question: How can
blockchain and DLT shape citizen coproduction processes? A pilot of the Digital Democracy Data
Commons (DDDC) project in Barcelona, which applies DLT to engage stakeholders in a
participatory process will be studied in order to answer this research question. Through this case
study, the paper will outline a theoretical model to study the applications of blockchain and DLT in
digital coproduction processes. The remainder of the paper is structured as followed. Section 2
discusses the background of digital coproduction and the way blockchain and DLT can shape digital
coproduction processes. Section 3 presents the analytical framework, while Section 4 describes the
case and methodology. Section 5 outlines key findings. Finally, Section 6 concludes the paper.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Background</title>
      <p>2.1.</p>
      <sec id="sec-2-1">
        <title>Digital Coproduction</title>
        <p>
          The conception of coproduction fits in the New Public Governance paradigm that recognizes the
provision of public services as a model based on networks and inter-organizational relationships
(Bovaird &amp; Loeffler, 2012). In this article, we draw on the concept of coproduction by
          <xref ref-type="bibr" rid="ref2">Brandsen and
Honingh (2016</xref>
          , p. 431):
        </p>
        <p>Coproduction is a relationship between a paid employee of an organization and (groups of)
individual citizens that requires a direct and active contribution from these citizens to the work of the
organization.</p>
        <p>
          Citizens can engage in the coproduction of public services in different stages of the delivery
process, including the public service design, public service delivery and execution, and public
service monitoring. Each stage, therefore, entails different roles both from the public service
provider and the citizen
          <xref ref-type="bibr" rid="ref14">(Linders, 2012)</xref>
          .
        </p>
        <p>
          The ability to perform coproduction activities is seen to be increased by the implementation of
technological advances in the public sector
          <xref ref-type="bibr" rid="ref11 ref13 ref17 ref8">(Fugini &amp; Teimourikia, 2016; Johnston, 2010; Lember,
2017; Meijer, 2016; William, Webster, &amp; Leleux, 2018)</xref>
          . In that regard, digital coproduction often
corresponds to the adoption of information and communication technologies (ICT) in coproduction
processes. The adoption of ICT can affect coproduction by providing real-time access and exchange
coproduction processes with fully (or partly) automated processes (e.g. predictive policing). In this
vein, different technologies are strongly shaping coproduction processes and our understanding of
coproduction.
2.2.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>How Can Blockchain Shape Digital Coproduction?</title>
        <p>
          Blockchain and DLT are a class of technologies, henceforth blockchain technologies (BCT), that
create a transparent, autonomous and decentralized data governance system that gives users
confidence that archived information has not been tampered with
          <xref ref-type="bibr" rid="ref1 ref6">(Beck &amp; Müller-Bloch, 2018)</xref>
          without the need of trustees to verify the genuineness of stored data.
        </p>
        <p>
          We expect this feature of the BCT to have important implications for the coproduction processes
in public sector, because it allows the service users and stakeholders to directly shape their service
provision without a need of intermediary or administrator to validate or channel their input. BCT
can also increase the transparency, auditability and accountability of the information provided in
the coproduction processes and thereby builds trust in the coproduction processes. For instance,
BCT provides new ways of coproduction by allowing cities to create 'voluntary data repositories' of
citizens' personal data in order to co-produce new services. Moreover, BCT, as a communication
technology, can enable peer-to-peer public service delivery
          <xref ref-type="bibr" rid="ref12">(Lember, et al. 2019)</xref>
          and a new
generation of democratic processes (Saldivar, et al. 2019).
        </p>
        <p>However, there are some caveats and different technological features of BCT can have different
implications to the coproduction processes. First, choices of the system designers on the design of
the digital platform can affect the role of the coproducers and the scope of the coproduction
activities. BCT-based platforms can have permissionless/permissioned and public/private forms
(Miller, 2019). The choice between permissioned and permissionless systems calls for considerations
of several trade-offs and decisions to be made by policymakers and system designers. These
tradeoff conditions are context-dependent and factors concerning organizational and technological
capacities, provider of technology services, area of application, interoperability with other data
platforms, and political preferences might determine the choice of decision-makers. Secondly, the
underlying consensus protocol and the associated incentive mechanism can alter the role of the
actors involved in the coproduction processes. Incentives are important to attract the validators that
contribute to the system with their time and resources (e.g. computing power and/or money). The
most common form of incentive mechanism is distributing tokens to the validators, which can hold
either a monetary value (e.g. Bitcoin) or another form of value for the beneficiary. However, using
tokens to motivate users to participate in coproduction processes may undermine the effectiveness
of coproduction processes or have negative repercussions (e.g. adverse environmental impact in
Proof of Work (PoW)- based systems).</p>
        <p>Thirdly, BCT is not a monolithic technology and auxiliary technologies (e.g. tokens,
zeroknowledge protocols, smart contracts, etc.) integrated in the blockchain platform can alter the way
coproduction takes place. For example, through tokens and smart contracts, coproducers can enable
various voting features for coproduction processes and automatically execute ex-ante agreed rules
of transactions for service provision. At the same time, with zero-knowledge protocols, co-producers
can preserve their anonymity without undermining the validity of transactions in the blockchain
network. Depending on the applications (or decentralized applications), the scope and the
underlying features of coproduction in a blockchain platform may vary.</p>
        <p>
          Fourth, the way decisions are implemented in the blockchain platform can impact the legitimacy
of coproduction. In blockchain governance, there are on-chain and off-chain decision-making
mechanisms. On-chain system brings the trade-off between efficient decision-making and transition
processes and risking destabilization due to the political dissonance. Off-chain system brings the
trade-off between enhancing the political consensus in the decision-making and transition processes
undermine the stability of the system
          <xref ref-type="bibr" rid="ref6">(Finck, 2018)</xref>
          .
        </p>
        <p>The fifth caveat is related to the definition of the digital coproduction and concerns about to what
extent different acts of engagement using BCT can be classified as coproduction or co-creation. Veiko
et al. (2019) differentiate on the scope of activities associated with coproduction and cocreation based
on the level of engagement where activities concerning the service production correspond to
coproduction and the services at a strategic level correspond to cocreation. Moreover, they focus on
whether citizens provide direct and active input. Here direct refers to whether the input provided
by the citizens affects the services individually provided to them, and active refers to whether
citizens take part in the design or delivery of services. Yet, this definition has certain shortcomings
when applied to the user roles in a BCT-based system. The functionality of the BCT-based systems
rests upon the active engagement of the users in validation of the transactions. Even if the input of
the validators (be it random or selected nodes) can be rendered as active and direct according to the
aforementioned definition, their involvement is arbitrary and indiscriminate to the service provided
by the platform. In a way, they are passive service producers without holding an agency about the
scope of the services. Therefore, it is important to identify the different roles of the participants
engaging in BCT-based coproduction processes and whether they hold an agency in the services
provided by the system.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Analytical Framework</title>
      <p>The literature of digital coproduction is still at its infancy, and only a few analytical frameworks are
ne
framework developed by Veiko et al. (2019) provides some coarse assumptions about the impact of
four categories of technology (i.e.sensing, communication, processing, and actuation) on motivation,
interaction, resources and decision-making processes and the
coin coproduction. However, this coarse categorization has its shortcomings when it comes to the roles
of the BCT in coproduction processes. As mentioned earlier, BCT is not a monolith technology, and
varying applications and different underlying protocols of blockchain platforms may change the
implication of the technology concerning
decisioncoproduction processes. Furthermore, it is difficult to position BCT only under one category of
digital technologies. BCT can be categorized as a processing technology- as rendered by the
authors</p>
      <p>BCT allows users to control and verify the personal data and
thereby it allows an on-chain and off-chain engagement at a larger scale.</p>
      <p>
        A second type of analytical model available in the literature focuses on the use and ownership of
data in the coproduction processes
        <xref ref-type="bibr" rid="ref16">(Toots et al, 2017; McBride et al, 2018)</xref>
        . For instance, Toots et al.
(2017) focus on barriers and drivers in the use of open data in digital co-production processes by
categorizing the institutional characteristics of the coproduction processes concerning the
technology, organizational structure, perception, attitudes and culture of stakeholders, and
regulative framework. This framework is useful to analyze the facilitating and debilitating
institutional factors in the use of open data in coproduction. However, in BCT-based systems, data
to the functioning of the system through their computing power and energy consumption, and
thereby the functionality and stability of the system rely on the continuous engagement of the
participants with the mining processes. This technical feature of BCT expands the impact of the
institutional framework on digital coproduction processes beyond the use of open data to a more
complex techno-social interaction. For instance, PoW-based systems are highly energy-consuming
processes1. Compatibility of the technology with regulations about CO2 emissions, rights to
forgotten or GDPR, and the cost of energy consumption for nodes are some additional institutional
factors that may affect the scope and the applications of BCT in coproduction processes. Therefore,
we infer that a functional analytical framework for the user roles in BCT-based coproduction
processes should align the user roles imposed by the technological features of BCT with the
institutional dimensions shaping the application of BCT in co-production processes.
      </p>
      <p>As a first step, we developed an analytical model to assess the user roles in BCT-based
coproduction (see Figure 1). In the construction of the model, we paid attention to matching three
dimensions with each other: (1) possible user roles identified by the BCT-based systems; (2) possible
citizen and state roles identified by the digital co-production/co-creation systems; and (3) a versatile
and evolutionary view on the role of BCT. Accordingly, we identified three stages in the use of BCT
in co-production processes.</p>
      <p>
        Citizen-controlled information management: BCT is used to process personal data of citizens. In this
simplest form of BCT-based coproduction, a coproducer can have the role of data provider, verifier
and data user
        <xref ref-type="bibr" rid="ref5">(Erhan et al., 2019)</xref>
        . Coproducers can control and trace the personal data used in the
coproduction processes, verify the transaction as a node either in a permissioned or permissionless
system, and use the data for the creation of the public policies. In this mode of digital coproduction,
choices of public service organizations about the permission criteria to data infrastructure or
ownership of data infrastructure can affect the role of citizens or their representative organizations
in the coproduction processes. Nevertheless, citizens preserve the ultimate control of personal data
shared for coproduction processes. Therefore, we call this type of coproduction as citizen-controlled
information management.
      </p>
      <p>Citizen-controlled public service design: In this mode, applications with smart contracts and digital
tokens are used to allow automated, self-enforced service decisions. In digital coproduction, citizens
through the use of the tokens can vote on the priority areas and criteria in public service provision
and automate the implementation through the use of smart contracts.</p>
      <p>Citizen-controlled public service production: In the most advanced form of BCT-based co-production,
we expect the convergence of BCT with other digital technologies such as artificial intelligence (AI),
internet of things (IoT), or actuation technologies. In this mode, citizens can decide on the content,
extent and amount of the public service production. Depending on the combination of technologies,
citizens can provide tailor-made services for the specific needs of the communities or groups of
people. We expect in this stage, state to have limited or no involvement in public service provision
1 According to the Digieconomist, PoW-based Bitcoin mining consumes above 70.000 terawatt-hours per
year, comparable to the annual carbon footprint of Denmark and energy consumption of Austria.
(https://digiconomist.net/bitcoin-energy-consumption)
and instead to provide data or meta-data available in state-sources to contribute to the
citizencontrolled production processes.</p>
      <p>This framework will help us to categorize the roles imposed on the citizens in a BCT-based
system. We will expand our analysis later with the barriers and drivers identified by Toots et al
(2017) to understand the impact of institutional conditions on the use of open data on the BCT-based
co-production processes. The findings from the case study will allow us to refine and further develop
the proposed analytical framework.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Methodology</title>
      <p>This study is designed as a single exploratory case study to examine how blockchain technologies
can shape citizen coproduction processes. A single exploratory case study is a useful design to gain
insights about a phenomenon that are thus far understudied or not understood, and to construct
new theory or generate propositions about the phenomenon (Yin, 1989). In this study, we will
the whole process of
coacy Data Common
of the EU funded DECODE project. DDDC uses BCT to share a petition with participants, sign it
with a mobile app and count the signatures in a cryptographically secure and completely
anonymous way.</p>
      <p>We will collect our empirical data from secondary sources and expert interviews. We will gather
data from multiple sources of evidence (semi-structured interviews, technical reports and policy
reports, government documents) to triangulate conclusions and ensure higher levels of internal
validity. Furthermore, triangulation also helps to mitigate against subjectivity in the research and
thus strengthens the overall research design.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Preliminary Findings</title>
      <p>Some preliminary key findings are shared below:
1) The case in Barcelona falls into the category of citizen-controlled public service design. The
pilot allows the control of the personal data by the people and creating an immutable and
transparent system. Each citizen of Barcelona receives a token for the use of services and
functionalities provided by the platform. Through tokens, citizens can vote on the proposals
for the municipality agenda on public services. The system operates through smart contracts.
2) Two possible pathways are being discussed on the governance of the DDDC. One option is
building a community around the application and creating a self-governance system around
the community. The second option is creating an institution for the governance. Whilst the
former option refers to a more decentralized system design, where the citizens control the data
structure, the second option leads to a more centralized system.
3) Several factors had been influential on the design choices with the platform and integration of
-government platform:
a) Need for legal framework: No personal data in the ledger is being transferred, which gives
direct control to citizens, but for further applications with BCT there is a need for a DLT
legal framework.
b) Interoperability: Interoperability of the technology with other administrative institutions
(e.g. Barcelona Data Office) is important. Further testing of the platform will focus on this
dimension.
c) Political leverage: Person in charge should have some political leverage. For this project,
d) Building the platform around a community: Building the technology around an existing
community is important for an easier transformation.
e) Path dependency: Previous practices with participative democracy (e.g. 50 men movement)
and digital governance (i.e. Decidim) had been influential in the prioritization of
citizenempowering (or more decentralized) systems designs. Furthermore, the emerging business
culture in Barcelona in adopting smart city technologies since 2015, allowed the city to
cooperate with big corporations on the development of the technology.
4) There are some challenges ahead to scale up the project:
a) Technology itself does not create trust: If people do not understand the technology, it is difficult
to create trust only by the technical features of blockchain. Trusted parties/stakeholders
can assist in building trust about the technology.
b) Compatibility with existing legal/regulative framework: There are challenges with the current
legal framework especially concerning the right to be forgotten and the immutability and
transparency of the DLT system. It is possible that some challenges can be solved
technically (e.g. zero-knowledge protocol) but some decisions may need to be centralized.
Therefore, there may be a need for more complex governance systems (partially centralized,
partially through DLT or other decentralized systems). The environmental impact of the
PoW technology and its compatibility with the CO2 framework are other concerns and
reflect on the decisions with (de)centralization of the platform.</p>
    </sec>
    <sec id="sec-6">
      <title>6. Concluding Remarks</title>
      <p>DDDC pilot is a unique use case to understand the implications of the BCT in coproduction
processes. The case shows that BCT can create a pathway for citizen-controlled coproduction
processes where citizens control their own data used in service production, and collectively decide
on the policy priorities. However, there are various institutional, technological, social and
organizational factors that can affect the design choices of the decision-makers, and thereby the
application of BCT in the coproduction processes. In the case of Barcelona, the compatibility with
the legal framework, the interoperability with existing institutions in data governance, and previous
experiences and established communities for deliberative and participatory processes had been
system.</p>
      <p>Further research is recommended to understand further the underlying factors affecting the choices
of decision-makers toward more decentralized systems in BCT-based coproduction.</p>
      <p>Communities to Outcomes and Pu
-production: The Contribution of Users and
1138.</p>
      <p>Bovaird, T., &amp; Loeffler, E. (2012). From Engagement to Co-production: The Contribution of Users and
Communities to Outcomes and Public Value. Voluntas, 23(4), 1119 1138.</p>
      <p>inguishing Different Types of Coproduction: A Conceptual
435. doi:
10.1111/puar.12465.Distinguishing.</p>
      <p>Meijer, A. J. (2016). Coproduction as a structural transformation of the public sector. International Journal of</p>
      <p>Public Sector Management, 29(6), 596 611.</p>
      <p>Miller, A. (2020). Permissioned and Permissionless Blockchains. In S. Shetty, C. Kamhoua and L. Njilla (Eds.)</p>
      <p>Blockchain for Distributed Systems Security (pp.193-204). Wiley.</p>
      <p>Mingers, J. (1996). A Comparison of Maturana's Autopoietic Social Theory and Giddens' Theory of
Structuration. Systems Research, 13(4), 469-482.</p>
      <p>Supported Cooperative Work. CSCW, 28, pp. 169 207. doi: 10.1007/s10606-018-9311-7.</p>
      <p>Toots, M., McBride, K., Kalvet, T., Krimmer, R. (2017). Open Data as Enabler of Public Service Co-creation:
Exploring the Drivers and Barriers. In: Proceedings of the 2017 International Conference for
EDemocracy and Open Government (pp.102-112). Krems, Austria: IEEE Computer Society</p>
      <sec id="sec-6-1">
        <title>About the Authors</title>
        <p>Evrim Tan
Evrim Tan is a postdoctoral researcher at KU Leuven Public Governance Institute. His research focuses on
decentralization, blockchain governance, and public governance models. He is part of the academic advisory
board of INATBA, and member of the Belgian representatives for European Blockchain Service Infrastructure.
A. Paula Rodriguez Müller</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Beck</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Müller-Bloch</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>King</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Governance in the Blockchain Economy: A Framework and Research Agenda</article-title>
          .
          <source>Journal of the Association for Information</source>
          ,
          <volume>19</volume>
          (
          <issue>10</issue>
          ),
          <source>Art.1.</source>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Brandsen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Honingh</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Distinguishing Different Types of Coproduction: A Conceptual Analysis Based on the Classical Definitions</article-title>
          .
          <source>Public Administration Review</source>
          ,
          <volume>76</volume>
          (
          <issue>3</issue>
          ),
          <fpage>427</fpage>
          <lpage>435</lpage>
          . https://doi.org/10.1111/puar.12465.Distinguishing
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Chadwick</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2006</year>
          ). Internet Politics: States, Citizens, and New Communication Technologies. Oxford: Oxford University Press. (Style ArticleReferences)
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Coleman</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Parliament in the Information Age: The Case of Westminister and Holyrood</article-title>
          . In R. Gibson &amp; S. Ward (Eds.),
          <source>Reinvigorating democracy? British Politics and the Internet</source>
          (pp.
          <fpage>67</fpage>
          -
          <lpage>80</lpage>
          ). Farnham, Surrey: Ashgate Pub Ltd.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Erhan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tarhan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ozsoy</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>A Conceptual Model for Blockchain-Based Software Project Information Sharing</article-title>
          . IWSM-Mensura.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Finck</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Blockchain Regulation and Governance in Europe</article-title>
          . Cambridge University Press.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Foth</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2017</year>
          ). Participation,
          <string-name>
            <surname>Co-Creation</surname>
            , and
            <given-names>Public</given-names>
          </string-name>
          <string-name>
            <surname>Space</surname>
          </string-name>
          .
          <source>The Journal of Public Space</source>
          ,
          <volume>2</volume>
          (
          <issue>4</issue>
          ), 21. https://doi.org/10.5204/jps.v2i4.
          <fpage>139</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Fugini</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Teimourikia</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>The Role of ICT in Co-Production of e-Government Public Services</article-title>
          . In M. Fugini, E. Bracci, &amp; M. Sicilia (Eds.),
          <article-title>Co-production in the Public Sector</article-title>
          (pp.
          <fpage>119</fpage>
          <lpage>139</lpage>
          ). Springer, Cham.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Heeks</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Implementing and Managing eGovernment</article-title>
          . London: Sage Publications.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>ITU.</surname>
          </string-name>
          (
          <year>2017</year>
          ).
          <source>Measuring the Information Society Report 2017 - Volume</source>
          <volume>1</volume>
          . In International Telecommunication Union (Vol.
          <volume>1</volume>
          ). https://doi.org/10.3359/oz0303157
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Johnston</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <source>Governance infrastructures in 2020. Public Administration Review, 70(SUPPL. 1)</source>
          ,
          <fpage>122</fpage>
          <lpage>128</lpage>
          . https://doi.org/10.1111/j.1540-
          <fpage>6210</fpage>
          .
          <year>2009</year>
          .
          <volume>02116</volume>
          .x
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Lember</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brandsen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Tõnurist</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>The potential impacts of digital technologies on coproduction and co-creation</article-title>
          .
          <source>Public Management Review</source>
          ,
          <volume>21</volume>
          (
          <issue>11</issue>
          ),
          <fpage>1665</fpage>
          -
          <lpage>1686</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Lember</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>The Increasing Role of Digital Technologies in Co-production</article-title>
          . In T. Brandsen,
          <string-name>
            <given-names>T.</given-names>
            <surname>Steen</surname>
          </string-name>
          , &amp; B.
          <string-name>
            <surname>Verschuere</surname>
          </string-name>
          (Eds.),
          <source>Co-Production and Co-Creation: Engaging Citizens in Public Services. London: Routledge.</source>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Linders</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>From e-government to we-government: Defining a typology for citizen coproduction in the age of social media</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <volume>29</volume>
          (
          <issue>4</issue>
          ),
          <fpage>446</fpage>
          <lpage>454</lpage>
          . https://doi.org/10.1016/j.giq.
          <year>2012</year>
          .
          <volume>06</volume>
          .003
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Macintosh</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Whyte</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Evaluating how ePariticipation changes local democracy</article-title>
          ,
          <source>eGovernment Workshop 11 September</source>
          <year>2006</year>
          , Brunel University, West London.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>McBride</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , et al. (
          <year>2018</year>
          ).
          <article-title>How does open government data driven co-creation occur? Six factors</article-title>
          and a
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>William</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Webster</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Leleux</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Smart governance: Opportunities for technologically-mediated citizen co-production</article-title>
          .
          <source>Information Polity</source>
          ,
          <volume>23</volume>
          ,
          <fpage>95</fpage>
          <lpage>110</lpage>
          . https://doi.org/10.3233/IP-170065
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Wolfram</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Spink</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Jansen</surname>
            ,
            <given-names>B. J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Saracevic</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>Vox populi: The public searching of the Web</article-title>
          .
          <source>Journal of the American Society for Information Science and Technology</source>
          ,
          <volume>52</volume>
          (
          <issue>12</issue>
          ),
          <fpage>1073</fpage>
          -
          <lpage>1074</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>