<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Integrated Public Service Co-Creation and Provision: Guidelines and Lessons Learnt</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Unisystems S.A.</string-name>
          <email>KonidiM@unisystems.gr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Athens</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Greece.</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Deloitte Consulting S.r.l</string-name>
          <email>acioffi@deloitte.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Milan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Italy.</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Crompvoets</institution>
          ,
          <addr-line>Anita Cioffi , Konstantinos Tarabanis</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>KULeuven</institution>
          ,
          <addr-line>Leuven</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Proceedings EGOV-CeDEM-EPart2023</institution>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>University for Continuing Education Krems</institution>
          ,
          <addr-line>Krems</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>University of Macedonia and CERTH/ITI</institution>
          ,
          <addr-line>Thessaloniki</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>University of Macedonia</institution>
          ,
          <addr-line>Thessaloniki</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Integrated Public Services (IPS) enable the provision of personalised, citizen-friendly services through seamless collaboration of the involved public authorities. In this workshop we will present results from the H2020 inGov European Union funded project. We will start by presenting the Holistic Framework for IPS co-creation and provision which includes a number of practical recommendations for public authorities. We will discuss the framework with participants looking for constructive comments and ideas. We will then proceed with presenting experiences gained so far in different European settings and prompt participants to comment and discuss our approaches and findings.</p>
      </abstract>
      <kwd-group>
        <kwd>Integrated public services</kwd>
        <kwd>Holistic framework</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        technologies [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Context 2.1.</title>
      <p>
        Integrated Public Services (IPS) are generally defined as the result of bringing and fitting together
governmental services in such a way that users can access them through a single seamless experience
based on their needs. IPS are regarded as a critical prerequisite for achieving strategic goals that can
benefit citizens, such as one-stop and no-stop government. A key aspect for IPS provision is
interoperability: in Europe, the European Interoperability Framework (EIF), currently in its third
version, is considered a cornerstone document for public sector organisations [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Even with EIF
however a number of challenges still exist such as citizens' limited role, the lack of IPS governance
models, the shortage of holistic guidelines for public authorities, and the limited exploitation of mobile
      </p>
      <p>The aim of this workshop is to bring together researchers, policy makers and practitioners interested
in IPS co-creation and delivery to discuss these challenges and possible solutions.</p>
      <p>The inGov project aims to develop innovative ICT-supported governance models and tools in order
to enable stakeholder collaboration in co-producing inclusive and accessible Integrated Public Services
(IPS) thus increasing citizens' trust and satisfaction. The main objective of inGov is to contribute to the</p>
      <p>2020 Copyright for this paper by its authors.
creation of more inclusive and participatory forms of governance and to improve the quality and
relevance of public services by involving citizens in their design and delivery. It is carried out by a
multidisciplinary consortium consisting of 12 partners from 9 countries, and piloted in Malta, Austria,
Greece, and Croatia. The project results will feed into European Union (EU) policies to achieve
alignment between policies, research, and practice.
2.2.</p>
    </sec>
    <sec id="sec-3">
      <title>Co-creation and Sustainability</title>
      <p>
        One important aspect of inGov project is the role of co-creation in IPS provision. Co-creation is an
innovative strategy that involves different stakeholders, including end-users, in any phase of the public
services’ design, delivery and evaluation in order to deliver better and more democratic public services
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ][
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Co-creation is gaining attention as it is seen as bringing in knowledge and expertise of a wide
range of stakeholders that can help provide better (integrated) public services. It is relevant especially
as the public sector is facing challenges regarding citizens' trust and satisfaction, and scarcity of
resources. Our approach proposes a shift in paradigm where IPS users are not mere consumers of
services but instead are key stakeholders actively participating in IPS provision. In the context of IPS
provision, inGov proposes that co-creation can lead to more efficient and effective solutions by
fostering inter-organizational coordination, overcoming issues regarding interoperability of
technologies, allowing to find common goals, and enhancing a holistic overview especially in the
codesign stage [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ][
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        In addition, inGov project is equally interested in the sustainability of its results. Ensuring
sustainable and long-term co-creation processes and outcomes require stakeholder involvement,
although such participation is complex, particularly when using digital tools and ICTs [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Several
factors influence the sustainability of co-creation processes and outcomes, in particular the
organizational culture, learning and attitude to innovation and technology. Capacity building is
important in order to develop an innovation culture amongst key stakeholders, to facilitate knowledge
sharing and to dispel myths about the co-creation process [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>3. IPS Guidelines and lessons learnt</title>
      <p>One of the main objectives of the inGov project is the development and deployment of an IPS holistic
framework that will support IPS co-creation and governance. The holistic framework is built along the
three phases of implementation (design, delivery and evaluation) and intends to connect IPS governance
structures, IPS agreements, stakeholders' engagement methods, converging into an IPS agile roadmap.</p>
      <p>The IPS holistic framework was created upon solid theoretical bases and practical experience
(derived from the revision of European IPS best practices and inGov's pilots) and includes a set of
recommendations, a set of KPI and an Agile roadmap for IPS co-creation.</p>
      <p>The co-creation approach as well as the IPS holistic framework have already been piloted and
evaluated in four countries, namely Malta, Croatia, Greece and Austria, to modernize and digitize public
services. Specifically, the Maltese pilot aims at modernizing the digital common family household
public service, the Croatian pilot aims at creating an AI-driven mobile virtual assistant for the citizens
of the City of Bjelovar, the Greek pilot aims at digitalizing the issuing procedure of the disabled citizens
discount cards for public transportation in the Region of Thessaly and the Austrian pilot aims at
digitalizing the tourism overnight stay tax collection in Lower Austria. The piloting activities include
30 dedicated co-creation workshops with various stakeholders in order to collect valuable information
for the IPS development and feedback for the project. The experiences gained so far higlight the strength
and benefits of the project but also the challenges that remain to be addressed.</p>
    </sec>
    <sec id="sec-5">
      <title>4. Workshop Outline</title>
      <p>We will start rhis workshop by briefly introducing inGov project and proceed by presenting the
holistic framework for IPS co-creation and provision. The holistic framework includes aspects, layers
and a number of practical recommendations for public authorities. We will spend some time discussing
with participants the framework looking for their ideas and constructive comments. After that, we will
continue with presenting experiences gained within the project from applying the guidelines in four
different European countries and discuss sustainability challenges. Consequently, we will prompt
participants to provide us with comments and discuss our approaches and findings based on their own
viewpoints and experiences.</p>
    </sec>
    <sec id="sec-6">
      <title>5. Acknowledgements</title>
      <p>This work was funded by the European Commission, within the H2020 Programme, in the context
of the project inGov under Grant Agreement Number 962563 (https://ingov-project.eu/).</p>
    </sec>
    <sec id="sec-7">
      <title>6. References</title>
    </sec>
    <sec id="sec-8">
      <title>About the Authors</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>“New European Interoperability Framework</article-title>
          .
          <article-title>Promoting seamless services and data flows for European public administrations</article-title>
          ,” available at: https://ec.europa.eu/isa2/sites/isa/files/eif_brochure_final.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Tambouris</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Tarabanis</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>“Towards inclusive integrated public service (IPS) cocreation and provision”</article-title>
          ,
          <source>DG.o2021: The 22nd Annual International Conference on Digital Government Research</source>
          , ACM, New York, NY, pp.
          <fpage>458</fpage>
          -
          <lpage>462</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Torfing</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          et al. (
          <year>2019</year>
          ).
          <article-title>Transforming the Public Sector Into an Arena for Co-Creation: Barriers, Drivers</article-title>
          , Benefits, and
          <string-name>
            <given-names>Ways</given-names>
            <surname>Forward</surname>
          </string-name>
          .
          <source>Administration &amp; Society. 51</source>
          ,
          <issue>5</issue>
          (May
          <year>2019</year>
          ),
          <fpage>795</fpage>
          -
          <lpage>825</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Rodriguez</given-names>
            <surname>Müller</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.P.</surname>
          </string-name>
          ; Casiano Flores,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Albrecht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            ;
            <surname>Steen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            &amp;
            <surname>Crompvoets</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>A Scoping Review of Empirical Evidence on (Digital) Public Services Co-creation</article-title>
          ,
          <source>Administrative Sciences</source>
          ,
          <volume>11</volume>
          (
          <issue>4</issue>
          ): 30, https://doi.org/10.3390/admsci11040130
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Casiano</given-names>
            <surname>Flores</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Rodriguez</surname>
          </string-name>
          <string-name>
            <surname>Müller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.P.</given-names>
            ,
            <surname>Albrecht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            ,
            <surname>Crompvoets</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Steen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Tambouris</surname>
          </string-name>
          ,
          <string-name>
            <surname>E.</surname>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Towards the Inclusion of Co-creation in the European Interoperability Framework</article-title>
          . In: L.
          <string-name>
            <surname>Euripidis</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          <string-name>
            <surname>Macadar</surname>
          </string-name>
          , M. Meyerhoff Nielsen (Eds.),
          <source>Proceedings of the 14th International Conference on Theory and Practice of Electronic Governance (ICEGOV</source>
          <year>2021</year>
          ), New York, pp.
          <fpage>538</fpage>
          -
          <lpage>540</lpage>
          . doi:
          <volume>10</volume>
          .1145/3494193.3494320 Open Access
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Loeffler</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <source>Co-Production of Public Services and Outcomes</source>
          . Springer International Publishing.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Edelmann</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Mergel</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Co-production of digital public services in Austrian public administrations</article-title>
          .
          <source>Administrative Sciences</source>
          ,
          <volume>11</volume>
          (
          <issue>1</issue>
          ),
          <fpage>22</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Edelmann</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Virkar</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>The Impact of Sustainability on Co-Creation of Digital Public Services</article-title>
          .
          <source>Administrative Sciences</source>
          ,
          <volume>13</volume>
          (
          <issue>2</issue>
          ),
          <fpage>43</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>