<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>September</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Open data co-creation, a path for better public services</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Héctor Ochoa-Ortiz</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>PROS - PROcesses &amp; Services lab, Computer Science Division, School of Science and Technology, University of Camerino</institution>
          ,
          <addr-line>Via Madonna delle Carceri 7, 62032 Camerino (MC)</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2023</year>
      </pub-date>
      <volume>1</volume>
      <fpage>3</fpage>
      <lpage>15</lpage>
      <abstract>
        <p>Stakeholders of the quadruple helix have new expectations about how data and public services should act in our digital world paradigm. Governments should understand that value and release open data accordingly and help stakeholders shape new and improved data-driven public services. OGD-driven co-creation can then help shape better public services closer to user needs, with its horizontal nature. A combination of societal and technical solutions is needed to achieve the best result. The technical solution should come from expanding currently used tools. Little implementation has been seen, with more theoretical solutions proposed so far.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;co-creation</kwd>
        <kwd>open data</kwd>
        <kwd>public services</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        More and more raw data than ever is being collected with the development of science and
technology [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. However, data sharing, openness, and availability difer across domains [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ].
Open Data (OD) is defined as available as a whole, free of charge, with an open license, and in a
machine-readable open format [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Opening up these ever-growing number of datasets to the
public can unlock its true world-changing potential.
      </p>
      <p>
        Digitalization has become part of our daily life, with a more than ever connected society.
However, there is still a lack of understanding about what does it mean and its implications [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
Governments have to adapt to this new paradigm and ofer digitalized services, that cater the
needs of their users. This digitalization is still in the making, rather than a reality [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>This paper aims to provide an overview of the potential impact of OD and how it can drive
co-creation, fostering collaborative eforts between various stakeholders in shaping public
services. A literature review will determine which stakeholders are currently included in OD
co-creation, and extract relevant factors for improving the current situation.</p>
    </sec>
    <sec id="sec-2">
      <title>2. The path towards Open Data driven co-creation</title>
      <sec id="sec-2-1">
        <title>2.1. Co-creation against co-production</title>
        <p>
          Several definitions of co-creation have been proposed over the years, sometimes intertwining
with co-production ideas. Co-creation started in the business environment as a way for
customers to take a more active role in developing products and services [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ], and can be considered
central to generative value creation [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. It can also be defined as “the involvement of outside,
non-typical, stakeholders in the initiation, design, implementation and evaluation of public
services” [
          <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
          ].
        </p>
        <p>
          The most relevant definition, as it makes a distinction over co-production and expands on
previous definitions, is that co-creation is a process that involves multi-actor collaboration, where
both providers and users play an active role in shaping services, defining common problems, and
designing and implementing new or better public solutions [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. In this definition, co-creation
difers from co-production in that actors are ideally considered equal, and horizontal relations
are established between them [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. Co-production establishes a vertical hierarchy instead, with
actors not considered equal. Ideas from users can be included in a product or service with
co-production, but co-creation can make them completely user-centered.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Open Government (Data)</title>
        <p>
          Citizens have new expectations and demands for public services with the introduction of digital
technologies [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. Governments have to respond to the new expectations, with digitalization
eforts ongoing. Open Government Data (OGD) has to comply with the open data definition
previously explained to be considered truly open, by being released free of charge on an open
and machine-readable format. On top of that, it has to be released by a government organization
and it has to be of non-confidential nature [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. If it does not comply with this definition, it can
be considered government data, or simply data, but not OGD.
        </p>
        <p>Moreover, to be genuinely efective, OGD must be easily accessible and discoverable by users.
This is where data portals come into play, by providing a centralized platform for accessing OGD.
The publisher should choose the correct data portal and publishing plan to ensure data can be
helpful to users [13]. Freeing up data can unlock added value, but the datasets and formats have
to be carefully chosen in order to be useful [14]. Machine-readable and reproducible formats
and datasets that follow user needs should be chosen.</p>
        <p>OGD in the literature is an ongoing topic. Future literature is expected to ensure a sustainable
OGD, resulting in creating more value from OD [15].</p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3. Open Government Data &amp; co-creation</title>
        <p>
          Governments must rely on their users to ensure that OGD and public services sustainability is
met and value is created from it. OGD-driven co-creation has mostly focused on governments
and citizens as stakeholders [
          <xref ref-type="bibr" rid="ref12">12, 16, 17, 18</xref>
          ]. For a broader scope, the quadruple helix stakeholders
(academia, industry, government, society) [19] should be included. The relevant government
body may not be the main driver in the design and implementation of public services [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], but
the services should rather be designed, implemented, and evaluated in a co-created way.
        </p>
        <p>Both public and private sectors must contribute to the successful implementation of
technology-driven public reforms [20]. Diferent factors are relevant for the success of
OGDdriven co-creation: motivated stakeholders, innovative leaders, proper communication, an
existing OGD portal, external funding, and agile development [21].</p>
        <p>Several barriers exist when co-creating public services with OGD. The barriers can be split
into four categories: data and technology, stakeholders’ attitude and culture, organizational
aspects, and legal aspects. Every barrier can have an associated driver, providing conditions
are met (e.g. lack of OD availability can become a driver when OD is readily available) [22].
Therefore, efective co-creation should address each one of the four categories.</p>
      </sec>
      <sec id="sec-2-4">
        <title>2.4. From Co-creation to Open Data Ecosystems</title>
        <p>
          Ecosystems in the information domain are defined “to be a system of people, practices, values
and technologies in a particular local environment” [23]. This local environment has highly
connected components, and its stakeholders are mutually interdependent [
          <xref ref-type="bibr" rid="ref4">4, 24</xref>
          ].
        </p>
        <p>In traditional OD systems, the data flows one way, from providers to users. In OD ecosystems,
meanwhile, data cycles between providers and users [25, 24]. OD Ecosystems (ODEs) need
to address these four characteristics to be value-creating and sustainable: to be user-driven,
inclusive, circular, and skill-based [24]. Co-creation is a means to achieve this user-driven cycle.</p>
        <p>
          Standardized open tools must be developed to reduce the barrier of entry and ensure a
transparent and trustworthy co-creation flow, completing the circularity in the ecosystem. But
technology is not enough, and a socio-technical infrastructure [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] should be set up to solve the
diferent barriers in the ecosystem.
        </p>
        <p>Data portals are current platforms where data producers upload their O(G)D to the public.
Utilizing these already existing platforms and making them more circular and sustainable to
support value-creating has immense potential. McBride et al. [21] cite an existing OGD portal
to be one of the factors playing a key role in allowing co-creation to take place. Each of the
current data portals and platforms software has some pros and cons, but platforms such as
CKAN and DKAN are greatly used for their wide number of features [13]. Data publishers
(usually government agencies), however, still alter these software packages to fill their gaps.
Co-creation is one of these gaps that should be addressed and incorporated into already existing
tools. Tools like GitHub, while not suitable as data portals (as explained with its multiple cons
in [13]), do include standardized co-creation tools such as issues and pull requests. Including
standardized co-creation mechanisms to CKAN or DKAN may be a technical solution to explore.</p>
        <p>Regarding the skill-based characteristic, training stakeholders is important, so their
contribution does not depend on best efort [ 24]. The processes for co-creation must be properly
explained, with clear instructions and well-designed technical solutions.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Open Data - co-creation in practice</title>
      <p>Van Loenen et al. [24] cite five case studies where OD is provided and used, and with a diversity
of actors. These cases are geographic, education, agricultural, financial, and legal, and the
conclusions are that “none of the systems fully correspond to the ideal situation for value
creating and sustainable OD ecosystems”.</p>
      <p>Experiences show that in critical times, such as during the Covid-19 pandemic, stakeholders
can react quickly to the demands and co-create platforms, efectively changing public services.
Examples are civic hackathons in Germany, Estonia or Spain [26], and the Spanish collaborative
digital platform of “Frena la Curva” [26, 18]. This platform aimed to co-create ideas and broad
concepts on how to fight the virus, as well as propose service oferings and network building.</p>
      <p>Another example related to the Covid-19 pandemic comes from [27]. Here, several co-created
services are presented in three diferent countries (Estonia, Czechia and Latvia), with diferent
stakeholders and user involvement. The key takeaway from these examples is that “OGD does
play an important role in enabling new forms of information dissemination during a crisis” and
that continuous government support is critical in maintaining OGD-driven ecosystems over
time.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Discussion and conclusion</title>
      <p>ODEs and co-creation are greatly intertwined. The horizontal nature of co-creation can be a
driver toward fairer, more inclusive, and user-based OD systems. Input from the diferent actors
in every part of the process is key to maintaining the sustainability of the system. A co-creation
solution is preferred to co-production as actors are considered equal. This horizontal relation
can help create services truly centered in its users, rather than just including some of their ideas.</p>
      <p>Both societal and technological aspects have to be addressed as part of the solution. A only
social or only technical solution can help lower the barriers, but will a true change will happen
only when both are combined. The legal framework should also allow for co-creation eforts to
be successful and not act as a barrier.</p>
      <p>A gap is found in the implementation of the processes and technical solutions to the problem,
which is still in the early stages of its theoretical framework. The technical solution should start
from already-in-use tools such as open data portals, expanding them to allow for co-creation
with standardized and properly explained methods, ultimately empowering a great interaction
between stakeholders.</p>
      <p>On top of that, more eforts need to be made to include non-citizen stakeholders in co-creation
processes, as diferent services may be used primarily by diferent actors of the quadruple helix.
The industry seems to be the actor less included in current eforts.</p>
      <p>Current challenges in the social space are how to lower the social barriers to co-creation and
keep stakeholders motivated, as well as trust building.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>This project has received funding from the European Union’s Horizon 2020
research and innovation programme under the Marie Skłodowska-Curie grant
agreement No 955569.</p>
      <p>The opinions expressed in this document reflect only the author’s view and in no way reflect
the European Commission’s opinions. The European Commission is not responsible for any
use that may be made of the information it contains.
creation: Moving Towards Citizen-Government Collaboration, in: P. Parycek,
O. Glassey, M. Janssen, H. J. Scholl, E. Tambouris, E. Kalampokis, S. Virkar
(Eds.), Electronic Government, Lecture Notes in Computer Science, Springer
International Publishing, Cham, 2018, pp. 184–195.
[13] M. Ali, C. Alexopoulos, Y. Charalabidis, A comprehensive review of open
data platforms, prevalent technologies, and functionalities, in: Proceedings
of the 15th International Conference on Theory and Practice of Electronic
Governance, ICEGOV ’22, Association for Computing Machinery, New York,
NY, USA, 2022, pp. 203–214.
[14] C. P. Geiger, J. v. Lucke, Open Government and (Linked) (Open) (Government)
(Data), JeDEM - eJournal of eDemocracy and Open Government 4 (2012)
265–278. Number: 2.
[15] Y. Gao, M. Janssen, C. Zhang, Understanding the evolution of open government
data research: towards open data sustainability and smartness, International
Review of Administrative Sciences 89 (2023) 59–75. Publisher: SAGE Publications
Ltd.
[16] D. Linders, From e-government to we-government: Defining a typology for
citizen coproduction in the age of social media, Government Information
Quarterly 29 (2012) 446–454.
[17] C. Callinan, M. Scott, A. Ojo, E. Whelan, How to Create Public Value Through
Open Data Driven Co-Creation: A Survey of the Literature, in: Proceedings
of the 11th International Conference on Theory and Practice of Electronic
Governance, ICEGOV ’18, Association for Computing Machinery, New York,
NY, USA, 2018, pp. 363–370.
[18] J. I. Criado, A. Guevara-Gómez, Public sector, open innovation, and
collaborative governance in lockdown times. A research of Spanish cases during the
COVID-19 crisis, Transforming Government: People, Process and Policy 15
(2021) 612–626. Publisher: Emerald Publishing Limited.
[19] K. Miller, R. McAdam, M. McAdam, A systematic literature review of university
technology transfer from a quadruple helix perspective: toward a research
agenda, R&amp;D Management 48 (2018) 7–24.
[20] M. Kassen, Adopting and managing open data: Stakeholder perspectives,
challenges and policy recommendations, Aslib Journal of Information Management
70 (2018) 518–537. Publisher: Emerald Publishing Limited.
[21] K. McBride, G. Aavik, M. Toots, T. Kalvet, R. Krimmer, How does open
government data driven co-creation occur? Six factors and a ‘perfect storm’; insights
from Chicago’s food inspection forecasting model, Government Information
Quarterly 36 (2019) 88–97.
[22] M. Toots, K. McBride, T. Kalvet, R. Krimmer, Open Data as Enabler of Public
Service Co-creation: Exploring the Drivers and Barriers, in: 2017 Conference
for E-Democracy and Open Government (CeDEM), 2017, pp. 102–112.
[23] B. A. Nardi, V. O’Day, Information Ecologies: Using Technology with Heart,</p>
      <p>MIT Press, 1999.
[24] B. van Loenen, A. Zuiderwijk, G. Vancauwenberghe, F. J. Lopez-Pellicer, I.
Mulder, C. Alexopoulos, R. Magnussen, M. Saddiqa, M. D. d. Rosnay, J. Crompvoets,
A. Polini, B. Re, C. C. Flores, Towards value-creating and sustainable open
data ecosystems: A comparative case study and a research agenda, JeDEM
eJournal of eDemocracy and Open Government 13 (2021) 1–27. Number: 2.
[25] R. Pollock, Building the (Open) Data Ecosystem – Open
Knowledge Foundation blog, 2011. URL: https://blog.okfn.org/2011/03/31/
building-the-open-data-ecosystem/.
[26] J. I. Criado, A. Guevara-Gómez, J. Villodre, Using Collaborative Technologies
and Social Media to Engage Citizens and Governments during the COVID-19
Crisis. The Case of Spain, Digital Government: Research and Practice 1 (2020)
30:1–30:7.
[27] K. McBride, A. Nikiforova, M. Lnenicka, S. Kempeneer, J. Wolswinkel, The
role of open government data and co-creation in crisis management: Initial
conceptual propositions from the COVID-19 pandemic, Information Polity 28
(2023) 219–238.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>H.</given-names>
            <surname>He</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. A.</given-names>
            <surname>Garcia</surname>
          </string-name>
          ,
          <article-title>Learning from imbalanced data</article-title>
          ,
          <source>IEEE Transactions on Knowledge and Data Engineering</source>
          <volume>21</volume>
          (
          <year>2009</year>
          )
          <fpage>1263</fpage>
          -
          <lpage>1284</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>L.</given-names>
            <surname>Tedersoo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Küngas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Oras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Köster</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Eenmaa</surname>
          </string-name>
          , Ä. Leijen,
          <string-name>
            <given-names>M.</given-names>
            <surname>Pedaste</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Raju</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Astapova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Lukner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kogermann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Sepp</surname>
          </string-name>
          ,
          <article-title>Data sharing practices and data availability upon request difer across scientific disciplines</article-title>
          ,
          <source>Scientific Data</source>
          <volume>8</volume>
          (
          <year>2021</year>
          )
          <fpage>192</fpage>
          . Number: 1 Publisher: Nature Publishing Group.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M.</given-names>
            <surname>Dulong de Rosnay</surname>
          </string-name>
          , K. Janssen,
          <article-title>Legal and Institutional Challenges for Opening Data across Public Sectors: Towards Common Policy Solutions</article-title>
          ,
          <source>Journal of theoretical and applied electronic commerce research 9</source>
          (
          <year>2014</year>
          )
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>B. van Loenen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Vancauwenberghe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Crompvoets</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. Dalla</given-names>
            <surname>Corte</surname>
          </string-name>
          , Open Data Exposed, in: B. van Loenen,
          <string-name>
            <given-names>G.</given-names>
            <surname>Vancauwenberghe</surname>
          </string-name>
          , J. Crompvoets (Eds.), Open Data Exposed, Information Technology and Law Series, T.M.C. Asser Press, The Hague,
          <year>2018</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>T.</given-names>
            <surname>Dufva</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Dufva, Grasping the future of the digital society</article-title>
          ,
          <source>Futures</source>
          <volume>107</volume>
          (
          <year>2019</year>
          )
          <fpage>17</fpage>
          -
          <lpage>28</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>N.</given-names>
            <surname>Haug</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Dan</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Mergel</surname>
          </string-name>
          ,
          <article-title>Digitally-induced change in the public sector: a systematic review and research agenda, Public Management Review (</article-title>
          <year>2023</year>
          )
          <fpage>1</fpage>
          -
          <lpage>25</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>G.</given-names>
            <surname>Almeida</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Cappelli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Maciel</surname>
          </string-name>
          ,
          <string-name>
            <surname>Y. Mahecha,</surname>
          </string-name>
          <article-title>Co-production of Digital Services: Definitions, Frameworks, Cases and Evaluation Initiatives - Findings from a Systematic Literature Review</article-title>
          , in: A.
          <string-name>
            <surname>Kő</surname>
          </string-name>
          , E. Francesconi (Eds.),
          <source>Electronic Government and the Information Systems Perspective, Lecture Notes in Computer Science</source>
          , Springer International Publishing, Cham,
          <year>2018</year>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>19</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>S.</given-names>
            <surname>Brunswicker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Majchrzak</surname>
          </string-name>
          , E. Almirall,
          <string-name>
            <given-names>R.</given-names>
            <surname>Tee</surname>
          </string-name>
          ,
          <article-title>Cocreating Value from Open Data: From Incentivizing Developers to Inducing Cocreation in Open Data Innovation Ecosystems</article-title>
          , in: World Scientific Reference on Innovation,
          <source>WORLD SCIENTIFIC</source>
          ,
          <year>2018</year>
          , pp.
          <fpage>141</fpage>
          -
          <lpage>162</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M.</given-names>
            <surname>Toots</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>McBride</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Kalvet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Krimmer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Tambouris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Panopoulou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Kalampokis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Tarabanis</surname>
          </string-name>
          ,
          <article-title>A Framework for Data-Driven Public Service Co-production</article-title>
          , in: M.
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Axelsson</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          <string-name>
            <surname>Glassey</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Klievink</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Krimmer</surname>
            ,
            <given-names>I. Lindgren</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Parycek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. J.</given-names>
            <surname>Scholl</surname>
          </string-name>
          , D. Trutnev (Eds.),
          <source>Electronic Government, Lecture Notes in Computer Science</source>
          , Springer International Publishing, Cham,
          <year>2017</year>
          , pp.
          <fpage>264</fpage>
          -
          <lpage>275</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>K.</given-names>
            <surname>McBride</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Toots</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Kalvet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Krimmer</surname>
          </string-name>
          ,
          <article-title>Turning Open Government Data into Public Value: Testing the COPS Framework for the Co-creation of OGDDriven Public Services</article-title>
          , in: M.
          <string-name>
            <surname>P. Rodríguez Bolívar</surname>
            ,
            <given-names>K. J.</given-names>
          </string-name>
          <string-name>
            <surname>Bwalya</surname>
          </string-name>
          , C. G. Reddick (Eds.),
          <source>Governance Models for Creating Public Value in Open Data Initiatives</source>
          , Springer International Publishing, Cham,
          <year>2019</year>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>31</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>C.</given-names>
            <surname>Ansell</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. Torfing,</surname>
          </string-name>
          <article-title>Co-creation: the new kid on the block in public governance</article-title>
          ,
          <source>Policy &amp; Politics</source>
          <volume>49</volume>
          (
          <year>2021</year>
          )
          <fpage>211</fpage>
          -
          <lpage>230</lpage>
          . Publisher: Policy Press Section: Policy &amp; Politics.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>K.</given-names>
            <surname>McBride</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Toots</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Kalvet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Krimmer</surname>
          </string-name>
          , Open Government Data Driven Co-
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>