<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>UninvievresristiytyooffEEccoonnoommiiccss,</institution>
          ,
          <addr-line>PPrraagguue,eC,zCezcehchReRpuepbluicblic f</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>hCahralrelsesUUnniviveerrssiittyy iinn PPraragguue</institution>
          ,
          <addr-line>eC,zCezcehcRheRpuebpluicblic</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2011</year>
      </pub-date>
      <volume>1343</volume>
      <fpage>52</fpage>
      <lpage>64</lpage>
      <abstract>
        <p>Publication and reuse of machine-readable data on the Web is one of the current trends in data management that is mainly manifested by the Open Data movement. This movement is especially strong in the government and public sector domain where many Open Government Data initiatives have been launched in a large number of countries across the globe. In the European Union the recent update of the PSI Directive aims at fostering the reuse of data and information held by the public sector bodies by promoting publication of data in open machine-readable formats together with the relevant metadata. Even though the support of governments and the EU to Open Data and PSI reuse seems to be strong, public sector bodies are facing many challenges when publishing Open Government Data and the desired reuse is not always evident. In order to overcome these challenges Open (Government) Data publication methodologies are being proposed and the best practices in this domain are being formulated. In this paper we discuss the current challenges related to the OGD publication and reuse, we provide an overview of the existing methodologies and the best practices for publication of Open Government Data, we present an OGP publication methodology developed in the COMSODE project.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        With many Open Government Data initiatives being executed in a large number of
countries across the globe (see for example [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]) and the recent update of the PSI
Directive [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] we can see a significant shift towards provision of data held by the
public sector bodies in machine readable formats together with the relevant metadata.
      </p>
      <p>
        According to [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] Open Data is “data that can be freely used, reused and
redistributed by anyone – subject only, at most, to the requirement to attribute and
sharealike.” In this paper we refer to Open Data published by public sector bodies (PSBs) on
the web in machine-readable formats as Open Government Data (OGD).
      </p>
      <p>
        Open Government Data promise significant benefits that can range from increased
efficiency and effectiveness of the public sector bodies to greater trust and improved
transparency [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. Significant economic impacts are expected from the reuse of OGD
as well. However current studies often provide only estimates and there is still lack of
empirical evidence [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]. Even though the support of the top management is a
necessary prerequisite of a successful OGD initiative it does not guarantee the reuse of the
released data [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. One of the reasons might be that the public sector bodies
sometimes view the OGD from different perspective than the potential users [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ].
      </p>
      <p>
        It is evident that there are many issues related to publication and reuse of OGD. In
order to help the involved stakeholders to deal with these issues methodologies and
best practice guidelines for OGD publication have been developed or are currently
under development. In this paper we discuss the current challenges related to the
OGD publication and reuse and we provide an overview of some of the current
methodologies proposing the best practices of the OGD publication. We also present the
Methodology for publishing datasets as open data [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] developed in the COMSODE
project which tries to address some of the known problems in this domain and we
introduce two projects in that this methodology is utilized.
      </p>
      <p>This paper is structured as follows. This introduction is followed by a section
discussing the current problems and issues related to the OGD publication. Next
examples of the existing OGD publication methodologies are presented. Methodology for
publishing datasets as open data is introduced in the next section. Conclusions are
presented at the end of this paper.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Challenges of the OGD publication</title>
      <p>
        Public sector bodies are facing a number of challenges when publishing Open
Government Data. Some of the challenges might further hinder reuse of the data. For
example unclear licensing of datasets might prevent the re-users from developing
sustainable business models on top of the published data. Both Ubaldi [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ] and Janssen,
Charalabidis and Zuiderwijk [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] provide a comprehensive discussion of the
challenges in the OGD domain. Kučera and Chlapek [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] point out that there are not only
benefits that could be reaped out of the OGD reuse but there are also risks that need to
be mitigated.
      </p>
      <p>Table 1 summarizes the current challenges related to the OGD publication
discussed in the literature. We classify the challenges into the following groups:
 Political and social challenges (SOC) – challenges related to the political support,
decision making and social problems;
 Economic challenges (ECO) – challenges and problems related to benefits and
costs of OGD and to its measurement; potential problems related to the financing
of the OGD initiatives belong to this group too;
 Organizational challenges and challenges related to the internal processes (ORG)
– problems related to the organizational structures and the internal processes
through which the OGD are delivered by the PSBs;
 Legal challenges (LEG) – problems related to the legal openness of OGD as well
as the legislative issues;
 Technical challenges (TCH) – issues and challenges related to the technology, data
formats or infrastructure needed to publish OGD.</p>
      <sec id="sec-2-1">
        <title>Group</title>
        <p>SOC</p>
      </sec>
      <sec id="sec-2-2">
        <title>Refs.</title>
        <p>CL1
CL2
CL3
CL4
CL5
CL6
CL7
CL8
CL9
CL10
CL11
CL12
CL13
CL14
CL15
CL16</p>
      </sec>
      <sec id="sec-2-3">
        <title>Problem/issue</title>
        <p>Too many OGD initiatives – users in Netherland
sometimes feel frustrated by too many OGD initiatives.
Misinterpretation or contradictory conclusions –
different users might draw different conclusions out of the
data or the data might be misinterpreted.</p>
        <p>Provided feedback might not always have the
necessary level of quality to be used for improvements.
Some of the published datasets have little value for the
users or the possible use is not always obvious.
Some PSBs seek benefits for themselves rather than the
benefits to the society.</p>
        <p>Fees might represent a barrier to the re-use. However
some PSBs are required to sell data to cover their costs.
Not enough resources, especially in case of the small
public sector bodies
No systematic OGD cost measurement
No systematic OGD benefits assessment
No standard process or policy for the OGD publication.
Responsible persons might not always know how to
proceed with the OGD publication.</p>
        <p>
          Lack of interaction between OGD users and publishers
– PSBs not always respond to the provided feedback or
questions of the users. There might be lack of the
appropriate processes and tools [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
        </p>
        <p>There is not always a centralized OGD portal available
to the PSBs.</p>
        <p>Publication of OGD requires an appropriate structure
of processes, roles and responsibilities. However these
are not always in place and setting up the right
organizational structure requires significant effort.</p>
        <p>Published datasets are in many cases not regularly
updated and thus the provided data might be obsolete
or non-valid.</p>
        <p>There is a risk of violation of protection of the personal
information or other protected information when
publishing OGD. Concerns about the possible violation of
legislation acts as a barrier to the OGD publication.
Published datasets have missing, unclear or restrictive
terms of use. This results in legal uncertainty of the
potential users.</p>
        <p>
          SOC
SOC
ECO
ECO
ECO
ECO
ECO
ECO
ORG
ORG
ORG
ORG
LEG
LEG
ORG
[
          <xref ref-type="bibr" rid="ref30">30</xref>
          ]
        </p>
        <p>ID</p>
        <p>It is difficult to find the required data.</p>
      </sec>
      <sec id="sec-2-4">
        <title>Problem/issue</title>
        <p>Same or similar datasets do not always share the same
format or schema.</p>
        <p>
          Sometimes users need to register to access data. Such
practice is seen as discriminatory by [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ].
        </p>
        <p>Published data does not represent the primary data but
only processed data.</p>
        <p>Quality of the published data is often not good enough.
Common data quality issues are related to the accuracy,
completeness and timeliness of the data.</p>
        <sec id="sec-2-4-1">
          <title>Missing description of the data formats and schemas.</title>
          <p>Missing explanation of the data. Missing standards.
In some cases it might be difficult to publish OGD due
to the underlying ICT infrastructure (e.g. in case of the
"legacy" applications).</p>
          <p>Lack of suitable software tools for OGD publication.</p>
        </sec>
      </sec>
      <sec id="sec-2-5">
        <title>Group</title>
        <p>
          TCH
TCH
TCH
TCH
TCH
TCH
TCH
TCH
List of the challenges related to the OGD publication presented in the table 1 is by no
means comprehensive. Although some of the problems discussed above might be
addressed by the PSBs themselves, e.g. by putting more emphasis on quality of the
published data and metadata (CL14, CL20, CL21) and the user engagement (CL11),
some of the challenges will probably require more systematic changes. Charging for
data is one of such issues. In its recent notice [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] the European Commission
recommends regular assessment of the potential costs and benefits of a zero-cost policy and
a marginal cost policy. However according to [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ] if the civil servants are responsible
for the income of the relevant PSBs it might lead to maximization of the fees. In some
cases PSBs even see the commercial re-users as competitors and believe in selling
their data [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ].
        </p>
        <p>
          Some of the challenges presented above might not be unique to the OGD domain,
e.g. insufficient data quality. However OGD utilize the web as a medium for the data
provision and consumption and due to this it contributes to the data on the web
phenomenon [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. Current draft of the W3C Data on the Web Best Practices points to the
fact that the openness and flexibility of the web can lead to new challenges [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. The
fact that the publishers and the users might be unknown to each other is one of them
[
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. According to [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ] the concept of quality is cross-disciplinary, however there is
no single agreed up-on definition of quality. Data quality might be understood within
the contexts of the fitness of the data for its intended use [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. However if the OGD
publishers are not aware of the potential users it might be difficult to specify the
intended use of the published data which in turn might affect the assessment of the data
quality. This illustrates that in case of the OGD some of the already known problems
related to data management are put into the new context which might require specific
solutions.
        </p>
        <p>
          However the approach of the PSBs to OGD is not the only barrier to the OGD
reuse. According to [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ] there is a lack of knowledge of how the data can be utilized
among the potential users and thus more success stories are required. More attention
should be also paid to the OGD based business plans as a business plan is a
precondition of any long-term OGD reuse [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ].
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Open Government Data publication methodologies</title>
      <p>Challenges discussed in the previous section show that publishing data on the web for
reuse is not just a matter of providing the data in machine-readable formats. There are
various other problems that are not-technical in nature, like the challenges related to
the licensing, user engagement or appropriate internal processes and organizational
structures. In order to help the stakeholders to deal with the known challenges and
problems methodologies and best practice guidelines for OGD publication have been
developed or are currently under development. In this paper OGD publication
methodology is defined as a set of methods, procedures or practices for publication of
Open Government Data.</p>
      <p>Existing OGD publication methodologies that are discussed in this paper are listed
in table 2. For each of the methodologies its name is provided as well as its authors or
publisher and the country of origin. Relevant references are also provided.</p>
      <p>
        Refs.
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]
[
        <xref ref-type="bibr" rid="ref31">31</xref>
        ]
[
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]
[
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]
[
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]
[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]
[
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]
      </p>
      <sec id="sec-3-1">
        <title>Name</title>
        <p>Open Data Ireland: Best Practice
Handbook
Open Government Data Toolkit
Methodology for publishing datasets
as open data
Methodological Guidelines for
Publishing Linked Data
National Guidelines for valorizing
Public Sector Information
Project Open Data</p>
      </sec>
      <sec id="sec-3-2">
        <title>Author/publisher</title>
        <p>D. Lee, R. Cyganiak,
S. Decker
World Bank</p>
        <sec id="sec-3-2-1">
          <title>COMSODE</title>
        </sec>
        <sec id="sec-3-2-2">
          <title>B. Villazón-Terrazas, O. Corcho Agenzia per l’Italia Digitale</title>
          <p>
            The White House
It is obvious that OGD publication methodologies are being developed both at the
international level as well as at the national or local level. Space limitations do not
allow us to discuss each of the methodologies in detail but they differ in scope, focus
and structure. For example Open Data Handbook developed by the Open Knowledge
Foundation [
            <xref ref-type="bibr" rid="ref23">23</xref>
            ] provides an introduction to the concept of Open Data and it provides
basic recommendations for its publication. Compared to the Open Data Handbook the
Open Data Ireland: Best Practice Handbook [
            <xref ref-type="bibr" rid="ref15">15</xref>
            ] provides more detailed
recommendation and it also compares current international and Irish practices.
          </p>
          <p>
            It is interesting that the United Nations and the World Bank, both well-known
international organizations, developed their OGD methodologies. United Nations
provides quite a comprehensive set of recommendations aimed at establishing and
executing an OGD initiative [
            <xref ref-type="bibr" rid="ref31">31</xref>
            ]. The World Bank often refers to other methodologies or
papers instead of developing its own recommendations. However it developed the
Open Data Readiness Assessment tool which helps to assess the OGD readiness of a
government [
            <xref ref-type="bibr" rid="ref35">35</xref>
            ].
          </p>
          <p>
            In the USA the Project Open Data is supervised by the White House but it is open
to anyone who wishes to participate (see [
            <xref ref-type="bibr" rid="ref34">34</xref>
            ]). On the other hand Open Data Field
Guide [
            <xref ref-type="bibr" rid="ref27">27</xref>
            ] was developed by a private company Socrata which also provides
solutions for OGD portals.
          </p>
          <p>Alongside the USA there ale local/national OGD publication methodologies in the
Czech Republic, Flanders (Belgium), Italy, Ireland, Norway and Spain. However it is
necessary to say that the list of the methodologies in table 2 might not be
comprehensive as a more detailed study aimed at the OGD initiatives across the globe would be
necessary.</p>
          <p>
            Some of the methodologies are aimed primarily at Linked Data or Linked Open
Data (see [
            <xref ref-type="bibr" rid="ref3">3</xref>
            ]). Namely Best Practices for Publishing Linked Data [
            <xref ref-type="bibr" rid="ref11">11</xref>
            ] and
Methodological Guidelines for Publishing Linked Data [
            <xref ref-type="bibr" rid="ref33">33</xref>
            ]. However Linked Open Data is
mentioned or addressed by other methodologies as well, for example [
            <xref ref-type="bibr" rid="ref9">9</xref>
            ], [
            <xref ref-type="bibr" rid="ref15">15</xref>
            ], or
[
            <xref ref-type="bibr" rid="ref18">18</xref>
            ].
          </p>
          <p>
            Open Data Certificate is a tool for assessment of the quality of the open datasets
[
            <xref ref-type="bibr" rid="ref21">21</xref>
            ]. There are four levels of the certificate [
            <xref ref-type="bibr" rid="ref20">20</xref>
            ]: Raw, Pilot, Standard and Expert.
The certificate is awarded to a dataset according to what practices are being followed
by its publisher. Because the required practices for the respective certificate levels are
described, the Open Data Certificate can be considered as an OGD publication
methodology. However there are currently no step-by-step guidelines to implementation of
the required practices.
4
          </p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Methodology for publishing datasets as open data</title>
      <sec id="sec-4-1">
        <title>Overview of the methodology</title>
        <p>
          Methodology for publishing datasets as open data (COMSODE methodology)
represents one of the outcomes of the project Components Supporting the Open Data
Exploitation (COMSODE) [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. It is a generic methodology that covers both technical
and non-technical issues related to the publication of OGD. It is mainly aimed at
PSBs that have already decided to publish some of their data as Open Data (although
the question “Why should I publish Open Data?” is being discussed in the
methodology there are no specific guidelines for gaining the top management support).
        </p>
        <p>The COMSODE methodology consists of the five building blocks:
 Phases – a phase represents a stage of the Open Data publication process. Phases
reflect the lifecycle of an open dataset and they are further divided into task.
 Cross-cutting activities – activities that should be performed in every phase of the
open data publication process are called the cross-cutting activities. Cross-cutting
activities are also divided into tasks.
 Artefacts – artefacts represent the inputs and outputs of the tasks.
 Roles – a role represents a responsibility assigned to one or more persons in an
organization. In the context of the methodology roles are being assigned with
responsibilities for the tasks of the phases of the cross-cutting activities.
 Practices – practices provide more detailed guidelines to execution of the tasks
specified by the methodology.</p>
        <p>
          The following phases of the open data publication process are proposed in the
COMSODE methodology [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]:
1. (P01) Development of open data publication plan,
2. (P02) Preparation of publication,
3. (P03) Realization of publication,
4. (P04) Archiving.
        </p>
        <p>Objectives of the first phase (P01) are to identify potential datasets for opening up, to
analyze and prioritize the datasets taking into account risks, benefits and cost and to
develop an open data publication plan for the selected datasets. In the second phase
(P02) the selected datasets are prepared for publication, tasks in this phase involve for
example transformation of the data into machine-readable formats, creation of
metadata or selecting the appropriate license. Once the datasets are prepared for
publication, tasks of the third phase (P03) can be executed. Maintenance of the datasets is
also performed during this phase. The goal of the last phase (P04) is to manage
endof-life stage of the dataset lifecycle. Activities of this phase are triggered when it is no
longer possible to maintain or even make available some of the previously published
open datasets, e.g. due to the changes in legislation.</p>
        <p>
          Four cross-cutting activities were identified that should be performed throughout
the whole publication process [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]:
1. (CA01) Data quality management,
2. (CA02) Communication management,
3. (CA03) Risk management,
4. (CA04) Benefits management.
        </p>
        <p>The cross-cutting activities are aimed at management of the data quality (CA01), the
communication and collaboration between the publisher and the (potential) users of
its data (CA02) and at management of the benefits (CA03) and potential risks (CA04)
related to publication of OGD.</p>
        <p>
          Feedback from the re-users is an important part of the OGD ecosystem [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ], [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ].
Therefore, it is not viewed just as a single step in the publication process but rather as
a cross-cutting activity that should be performer throughout the whole publication
process. This approach is depicted in figure 1. More details about how the feedback
should be processed and how the users should be engaged is described in [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ].
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Challenges addressed by the methodology</title>
        <p>COMSODE methodology addresses some of the challenges of the OGD publication
discussed in the section no. 2:
 Identification of datasets for opening up – the methodology provides
recommendation for identification of datasets for opening up and it also promotes publication of
datasets that are perceived as “high-value datasets” (addresses the challenge CL4).
 It discusses the potential OGD benefits including the benefits for the whole
economy which might help to avoid situations when PSBs too much focus on their
internal benefits (CL5). However, benefits for the PSBs are discussed as well.
 The methodology provides recommendations for the effort estimation which might
help to manage costs of the OGD initiative (CL8). There is a separate cross-cutting
activity aimed at the management of benefits (CL9).
 The methodology proposes an OGD publication process and it sets responsibilities
for the proposed tasks. This might help to establish standard process and
organization structure supporting the OGD publication (CL10, CL13).
 In order to prevent the lack of interaction between OGD users and publishers
(CL11) the cross-cutting activity (CA03) Communication management should be
performed.
 The methodology is independent on the availability of the central data portal
(CL12). However if the central data portal is available, PSBs are free to utilize it.
 A separate cross-cutting activity is introduced in order to ensure that the published
data has the desired level of quality (CL20). Maintenance of the data and metadata
is addressed by specific tasks and the related practices (CL14).
 A separate cross-cutting activity is introduced in order to manage the OGD related
risks including the risk of the personal data protection violation (CL15).
 The methodology proposes recommended practices for dataset licensing (CL16).
 There are several practices in the methodology aimed at ensuring high level of
technical openness of the datasets. These practices include but are not limited to
the reuse of the existing schemas and ontologies (CL17) and documenting the
schemas in a machine-readable way (CL22).
 The methodology promotes data cataloging which should help to improve
discoverability of the datasets (CL21).</p>
        <p>However, there are some remaining issues that are not addressed by the current
version of the COMSODE methodology, namely:
 Social issues – the methodology is aimed mainly at the individual public sector
bodies. Solving the social issues would probably require actions on the government
level (consolidation/coordination of the OGD initiatives, CL1) or actions aimed at
the re-users (building knowledge and skills how the data can be use and how to
provide feedback that can be effectively used for improvements, CL2-3).
 Fees (CL6) – the methodology provides no guidelines reading fees.
 Limited resources, especially in case of the small PSBs (CL7) – the methodology
does not provide any recommendations specifically tailored for particular types of
PSBs. This challenge is therefore not addressed.
 The actual design of the data portals is outside the scope of the methodology and
thus it does not provide any recommendation regarding registration of the users on
the portals (CL18). Dealing with the legacy applications is also beyond the scope
of the methodology (CL23).</p>
        <p>The COMSODE methodology promotes a risk based approach to the OGD
publication. This means that if some data cannot be published in its primary form due the
possible breach of the personal data protection, it proposes to anonymize the data. It
does not prevent publication of the primary data (CL19), but it respects that the
publication of some primary data is not always possible.</p>
        <p>
          The COMOSDE methodology is software tool independent. It only proposes a
Reference architecture of software tools for open data publication [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. However, a
platform called the Open Data Node is developed in the COMSODE project [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
The COMSODE methodology has been utilized in a project aimed at opening up data
of the Supreme Audit Office of the Czech Republic. As a first step a project plan
following the phases P01-03 of the methodology was prepared. Identification of suitable
datasets for opening up and development of the open data publication plan was
performed in January and February 2015. The publication of the selected datasets is
expected to a happen in June 2015. A selected subset of the datasets will also be
published as Linked Open Data.
        </p>
        <p>In January 2015 the Ministry of Interior of the Czech Republic launched a project
aimed at supporting the Czech PSBs in their OGD initiatives. The COMSODE
methodology serves as one of the most significant inputs upon which the Czech Open
Government Data standards will be developed.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusions</title>
      <p>The Open Government Data promise significant benefits to citizens, business as well
as to the public sector. However, PSBs often face challenges when publishing OGD.
Based on the literature review, 24 challenges related to the OGD publication and
reuse were identified. These challenges include the political and social challenges,
economic, legal and technical challenges as well as the organizational challenges and
challenges related to the internal processes. Even though some of the identified
challenges might not be completely unique to the OGD domain, e.g. the insufficient data
quality, OGD might represent a unique context for these challenges which might
require specific solutions.</p>
      <p>In order to help the stakeholders to deal with the known challenges and problems,
methodologies and best practice guidelines for OGD publication have been developed
or they are currently under development. We were able to identify 16 OGD
publication methodologies at both international and national or local level. Further analysis
of these methodologies might provide a better understanding of the current best
practices for publication and reuse of the Open Government Data.</p>
      <p>Methodology for publishing datasets as open data is one of the existing OGD
publication methodologies. This methodology is one of the generic OGD publication
methodologies. It proposes an OGD publication process organized into four phases:
(P01) Development of open data publication plan, (P02) Preparation of publication,
(P03) Realization of publication, (P04) Archiving. The phases are accompanied by
four cross-cutting activities: (CA01) Data quality management, (CA02)
Communication management, (CA03) Risk management, (CA04) Benefits management. This
methodology is currently used to in a project aimed at opening up data of the Supreme
Audit Office of the Czech Republic and is expected to be used as one of the key
resources upon which the Czech Open Government Data standards will be developed
by the Ministry of Interior of the Czech Republic.</p>
      <p>Acknowledgements. The research is supported by the EU ICT FP7 project
COMSODE under GA No. 611358.
6</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. Agenzia per l'Italia Digitale.
          <article-title>Linee guida nazionali per la valorizzazione del patrimonio informativo pubblico [National Guidelines for valorizing Public Sector Information] (</article-title>
          <year>2014</year>
          ), http://www.agid.gov.it/sites/default/files/linee_guida/patri moniopubblicolg2014_
          <fpage>v0</fpage>
          .7finale.pdf
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Álvarez</given-names>
            <surname>Espinar</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          :
          <article-title>Government Data Openness</article-title>
          and
          <string-name>
            <surname>Re-Use</surname>
          </string-name>
          (
          <year>2014</year>
          ), http://transparencia.gencat.cat/web/sites/transparencia/.con tent/pdfs/governobert/governobert_2_en.pdf
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <string-name>
            <surname>Linked Data - Design Issues</surname>
          </string-name>
          (
          <year>2006</year>
          ), http://www.w3.org/DesignIssues/LinkedData.html
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Chlapek</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kučera</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nečaský</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Metodika publikace otevřených dat veřejné správy ČR [Czech Open Government Data Publication Methodology] (</article-title>
          <year>2012</year>
          ), http://www.mvcr.cz/soubor/metodika-publ
          <article-title>-opendata-verze-1-0- pdf</article-title>
          .aspx
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Data</given-names>
            <surname>Management</surname>
          </string-name>
          <string-name>
            <surname>Association</surname>
          </string-name>
          ,
          <article-title>The: Guide to the Data Management Body of Knowledge</article-title>
          .
          <source>Technical Publications</source>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Difi</surname>
          </string-name>
          :
          <article-title>Del og skap verdier - Veileder i tilgjengeliggjøring av offentlige data [Difi Guide for disclosure of public data] (</article-title>
          <year>2013</year>
          ), http://data.norge.no
          <article-title>/document/del-ogskap-verdier-veileder-i-tilgjengeliggj%C3%B8ring-avoffentlige-data</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>European</given-names>
            <surname>Union</surname>
          </string-name>
          :
          <article-title>Comission Notice. Guidelines on recommended standard licences, datasets and charging for the reuse of documents (</article-title>
          <year>2014</year>
          /C 240/01) (
          <year>2014</year>
          ), http://eurlex.europa.eu/legalcontent/EN/TXT/?uri=
          <source>CELEX:52014XC0724%2801%29</source>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>European</given-names>
            <surname>Union</surname>
          </string-name>
          :
          <article-title>Directive 2013/37/EU of the European parliament and the Council of 26 June 2013 amending Directive 2003/98/EC on the re-use of public sector information (</article-title>
          <year>2013</year>
          ), http://eur-lex.europa.eu/legalcontent/EN/TXT/?uri=CELEX:
          <fpage>32013L0037</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9. Flemish government: Open Data Handleiding [Open Data Handbook]
          <article-title>(</article-title>
          <year>2014</year>
          ), http://www.opendataforum.info/images/Open_Data_Handboek_
          <year>2014</year>
          1119.pdf
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Hanečák</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Open Data Node - what it is, what it does, what is next (</article-title>
          <year>2014</year>
          ), http://www.comsode.eu/index.php/
          <year>2014</year>
          /06/open
          <article-title>-data-node-whatit-is-what-it-does-what-is-next/</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Hyland</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Atemezing</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Villazón-Terrazas</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Best Practices for Publishing Linked Data (</article-title>
          <year>2014</year>
          ), http://www.w3.org/TR/ld-bp/
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Charalabidis</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Zuiderwijk</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Benefits, Adoption Barriers and Myths of Open Data and Open Government</article-title>
          .
          <source>Information Systems Management</source>
          , vol.
          <volume>29</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>258</fpage>
          -
          <lpage>268</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Zuiderwijk</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Open data and transformational government</article-title>
          .
          <source>In: Proceedings of the Transforming Government Workshop 2012 (tGov2012)</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
          . Brunel University, London, United
          <string-name>
            <surname>Kingdom</surname>
          </string-name>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Kučera</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Chlapek</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Benefits and Risks of Open Government Data</article-title>
          .
          <source>Journal of Systems Integration</source>
          , vol.
          <volume>5</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>30</fpage>
          -
          <lpage>41</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cyganiak</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Decker</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Open Data Ireland: Best Practice Handbook (</article-title>
          <year>2014</year>
          ), http://www.per.gov.ie/open-data/
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Lóscio</surname>
            ,
            <given-names>B.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burle</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Calegari</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          :
          <article-title>Data on the Web Best Practices</article-title>
          . W3C
          <string-name>
            <surname>First Public Working Draft</surname>
          </string-name>
          (
          <year>2015</year>
          ), http://www.w3.org/TR/2015/WD-dwbp-
          <volume>20150224</volume>
          /
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17. National Audit Office:
          <article-title>Implementing transparency (</article-title>
          <year>2012</year>
          ), http://www.nao.org.uk/wpcontent/uploads/2012/04/10121833.pdf
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Nečaský</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Chlapek</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klímek</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kučera</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maurino</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rula</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konecny</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vanova</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Deliverable D5.1: Methodology for publishing datasets as open data (</article-title>
          <year>2014</year>
          ), http://www.comsode.eu/wp-content/uploads/D5.1
          <article-title>- Methodology_for_publishing_datasets_as_open_data</article-title>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Nečaský</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Chlapek</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klímek</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kučera</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maurino</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rula</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Deliverable D5.1: Methodology for publishing datasets as open data</article-title>
          .
          <source>Documentation of practices</source>
          (
          <year>2014</year>
          ), http://www.comsode.eu/wp-content/uploads/Annex1_D5.
          <fpage>1</fpage>
          - Documentation_of_practices.pdf
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <article-title>Open Data Institute, The: About the Open Data Certificate</article-title>
          , https://certificates.theodi.org/about
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>21. Open Data Institute, The: Open Data Certificate, https://certificates.theodi.org/</mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>22. Open Data Institute, The: Guides, http://theodi.org/guides</mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <article-title>Open Knowledge Foundation: The Open Data Handbook (</article-title>
          <year>2012</year>
          ), http://opendatahandbook.org/
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Russell</surname>
            ,
            <given-names>G.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miles</surname>
            ,
            <given-names>M.P.:</given-names>
          </string-name>
          <article-title>The definition and perception of quality in ISO-9000 firms</article-title>
          .
          <source>In: Review of Business</source>
          , vol.
          <volume>9</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>13</fpage>
          -
          <lpage>16</lpage>
          (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Share-PSI</surname>
          </string-name>
          :
          <article-title>Uses of Open Data Within Government for Innovation and Efficiency: Report (</article-title>
          <year>2014</year>
          ), https://www.w3.org/2013/share-psi/workshop/samos/report
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Share-PSI</surname>
          </string-name>
          :
          <article-title>Encouraging open data usage by commercial developers: Report (</article-title>
          <year>2015</year>
          ), https://www.w3.org/2013/share-psi/workshop/lisbon/report
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Socrata: Open Data Field Guide</surname>
          </string-name>
          (
          <year>2014</year>
          ), http://www.socrata.com/open
          <article-title>-data-field-guide/</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Sunlight</surname>
          </string-name>
          <article-title>Foundation: Ten Principles for opening up government information (</article-title>
          <year>2010</year>
          ), http://sunlightfoundation.com/policy/documents/ten-opendata-principles/
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Tinhold</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>The Open Data Economy. Unlocking Economic Value by Opening Government and Public Data (</article-title>
          <year>2013</year>
          ), https://www.capgeminiconsulting.com/ebook/The-Open-DataEconomy/files/assets/downloads/publication.pdf
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Ubaldi</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Open Government Data: Towards Empirical Analysis of Open Government Data Initiatives</article-title>
          .
          <source>OECD Working Papers on Public Governance</source>
          , vol.
          <volume>22</volume>
          . OECD Publishing (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>United</surname>
          </string-name>
          <article-title>Nations: Guidelines on Open Government Data for Citizen Engagement (</article-title>
          <year>2013</year>
          ), http://workspace.unpan.org/sites/Internet/Documents/Guidenli nes%
          <source>20on%20OGDCE%20May17%202013</source>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Van Herreweghe</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          :
          <article-title>Open Data Dag In Vlaanderen</article-title>
          , Conclusions (
          <year>2014</year>
          ), http://www.w3.org/2013/share-psi/workshop/lisbon/oddv
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Villazón-Terrazas</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Corcho</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Methodological Guidelines for Publishing Linked Data (</article-title>
          <year>2011</year>
          ), http://delicias.dia.fi.upm.es/wiki/images/7/7a/07_MGLD.pdf
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>White</surname>
            <given-names>House</given-names>
          </string-name>
          :
          <article-title>Project Open Data, https://project-open-data.cio</article-title>
          .gov/
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35. World Bank: Open Government Data Toolkit (
          <year>2014</year>
          ), http://data.worldbank.org/open-government
          <article-title>-data-toolkit</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36. World Wide Web Foundation, The: Open Data Barometer - Second
          <string-name>
            <surname>Edition</surname>
          </string-name>
          (
          <year>2015</year>
          ), http://www.opendatabarometer.org/assets/downloads/Open%20Dat a%20Barometer%
          <fpage>20</fpage>
          -
          <lpage>%</lpage>
          20Global%
          <fpage>20Report</fpage>
          %
          <fpage>20</fpage>
          -
          <lpage>%</lpage>
          202nd%
          <fpage>20Edition</fpage>
          %
          <fpage>20</fpage>
          -
          <lpage>%</lpage>
          20PRINT.pdf
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>