<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Open Data in Regions from the Users' Perspective: an Analytical Study</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Miloš Ulman</string-name>
          <email>ulman@pef.czu.cz</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Edita Šilerová</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jan Masner</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Michal Stočes</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pavel Šimek</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Petr Benda</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Information Technology, Faculty of Economic and Management, Czech University of Life Sciences in Prague</institution>
          ,
          <addr-line>Kamycka 129, 165 21 Prague Suchdol</addr-line>
          ,
          <country country="CZ">Czech Republic</country>
        </aff>
      </contrib-group>
      <fpage>902</fpage>
      <lpage>911</lpage>
      <abstract>
        <p>The paper is focused on open data in regions from the users' perspective and presents the perceived usability of various public data sets in the Czech Republic. There were 265 data sources assessed by respondents according the format, suggestions of further use, number of views, and usability for citizens, businesses, officers and other users. Only 14 datasets from national public agencies were already provided as open data, but none at the local level. The most frequent formats of data were DOC, HTML, PDF and XLS. The respondents came with 36 different suggestions for the further use of data sets. Currently, the citizens cannot see the difference in usability of open and non-open data unless there are particular applications available. Nationwide data sets were assessed in usability on average better (1.57) than local data sets (1.93). The usability of data was evaluated similarly across observed regions beside those provided by national institutions.</p>
      </abstract>
      <kwd-group>
        <kwd>Open data</kwd>
        <kwd>open government data</kwd>
        <kwd>user's perspective</kwd>
        <kwd>region</kwd>
        <kwd>local government</kwd>
        <kwd>usability</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        Open data is the term that echoes from local and world media with growing
frequency. Open data are complete, easily accessible, machine readable, using open
standards (e.g. CSV or XML) and published with an open license
        <xref ref-type="bibr" rid="ref1">(Auer et al, 2007)</xref>
        .
The term of open data firstly gained popularity in academia where it denotes effort to
publish academic data under free access in special digital depositories
        <xref ref-type="bibr" rid="ref10">(Murray-Rust,
2008)</xref>
        . Now the idea of open data is mainly perceived with political meaning,
especially, due to the launch of government open data portals data.gov and
data.gov.uk in the U.S. and the U.K.
        <xref ref-type="bibr" rid="ref7">(Kassen, 2013)</xref>
        and with the start of initiatives
such as Open Government Partnership. Making public sector information freely
accessible in open formats is also referred as open government data (OGD)
        <xref ref-type="bibr" rid="ref12 ref6">(Kalampokis et al, 2011; Shadbolt et al, 2012)</xref>
        .
      </p>
      <p>
        Benefits and advantages of using open data provided by government and public
agencies (or open government data) are promising for the public administration and
for private sector (World Bank, 2014). But most public organizations have no or
limited interaction with data users and are often very selective in communication
        <xref ref-type="bibr" rid="ref14">(Susha et al, 2015)</xref>
        . Some authors propose that open data rather should be a way for
government to interact with citizens
        <xref ref-type="bibr" rid="ref13">(Sieber &amp; Johnson, 2015)</xref>
        .
      </p>
      <p>
        The Czech Republic has committed to implement open government data by
joining the Open Government Partnership in 2011. Since then a number of OGD
activities have been started at different levels of the public sector as well as in
academia and other domains. Although there are some challenges that the Czech
Republic needs to face – like the missing official OGD catalogue, some public sector
bodies have already started to publish open government data
        <xref ref-type="bibr" rid="ref4">(Chlapek et al, 2014)</xref>
        .
There are several pioneering organizations that started as first and have showed
already some tangible results. Among these organizations belong national state
agencies (namely the Ministry of Finance, Czech Trade Inspection or Czech
Telecommunication Office), regional administrations (e.g. Vysocina region) and
municipalities (e.g. Prague, Decin, Opava). The national open data catalogue of the
Czech Republic has been recently launched within the main government portal
portal.gov.cz. There are concentrated all datasets from national public institutions
that have opened their data so far. The main resource is the register of public
contracts that provides scanned copies of all public tender contracts with metadata in
XML for automated processing.
      </p>
      <p>
        Enormous data volumes are generated on daily basis by municipalities and
regional authorities. The demand for public data in open format and the number of
relevant applications are expected to be steadily growing as an effect of the increase
in the level of digital skills and demand for information for example among
inhabitants in rural areas
        <xref ref-type="bibr" rid="ref6">(Vaněk et al, 2011)</xref>
        and small farmers
        <xref ref-type="bibr" rid="ref8">(Kubata et al, 2014)</xref>
        .
The extend of open data sources could have a positive impact on areas such as
tourism (Šilerová, 2013). Some authors argue that the potential of the open data
concept can be realized at the local level
        <xref ref-type="bibr" rid="ref7">(Kassen, 2013)</xref>
        . Contributions and particular
impacts of open data on rural life should be examined and researched. The
Department of Information Technologies FEM CULS Prague has started cooperation
with Czech Ministry of Agriculture on the research of open data in agriculture and
rural regions.
      </p>
      <p>There are two aims of the paper: firstly, to estimate the potential of open data
sources at the national and regional level, and secondly, to evaluate user’s view of
open data usability in the Czech Republic.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Materials and Methods</title>
      <p>Particular research questions that were examined in the survey were stated such as:
1. The number of potential data sets identified for opening and the number of
suggestions for the further use of open data was rather higher at local or
regional administrations than at the national level.
2. There are differences in estimated usability related to the type of the
municipality and the user group.
3. There is a significant difference in usability of open data and data that are
not open.
4. There are differences in estimated usability related to the size of the
municipality population.</p>
      <p>Based on research questions further statistical processing was conducted. The
methodological approach used in the paper is both of qualitative and quantitative
nature and includes literature review, user interviews and descriptive analysis. The
data were processed with association tables, descriptive statistics and tests to
compare differences in values.</p>
    </sec>
    <sec id="sec-3">
      <title>3 Results and Discussion</title>
      <p>Data were collected through questionnaire form administered to citizens living in
various regions. In total, there were 265 data sets assessed by respondents in terms of
format, suggestions of further use, number of views, and usability for citizens,
businesses, officers and other users. The perceived usability of data sets was ranked
on the scale from 1 (the best) to 5 (the worst). Basic data are summarized in Table 1.</p>
      <p>
        The collected data represent 52 municipalities from 9 regions (including the
capital Prague), 8 public institutions (7 schools and 1 school dormitory) and 11 state
bodies in the Czech Republic. The most frequently evaluated types of data sets were:
obligatory information published on public office website (also called as “e-desk”)
(33 %), budget information (33 %), annual report (13 %), newsletter (10 %) and
decision of representatives (10 %). In the survey focused on the openness to
information disclosure among between 395 municipalities (with up to 2,000
inhabitants) in one region of the Czech Republic in 2009
        <xref ref-type="bibr" rid="ref2">(Bachmann, 2012)</xref>
        , it was
found that 71 % of municipalities published electronically minutes from the
municipal council meetings, and 28 % electronic periodicals (newsletter). In the
survey between 400 municipalities across the whole Czech Republic in 2012, there
were 27 % of municipalities publishing resolution from the municipal council
meetings, 17 % resolutions and minutes, and 40 % of municipalities publishing
newsletter. The procurement information was published only in 30 % of cases.
However there is a significant correlation between the size of municipality
population and its information openness
        <xref ref-type="bibr" rid="ref3">(Bachmann &amp; Zubr, 2014)</xref>
        .
      </p>
      <p>There were 16 various formats of data sets identified such as DOC, HTML, XLS,
PDF, XML, CSV and other. Additional 6 various combinations of certain formats
were used and some datasets were already provided in the form of a web application.
Respondents came with particular ideas of further use of data sets in open format in
36 cases (13.6 %), while 14 (5.3 %) data sets were already provided according to
open data principles. The remarkable finding is that all open data sets were provided
by state administration bodies and none by local authorities. However more
suggestions came for local data sets (26) than for national (10). The most suggestions
for the further use of data were declared with files in PDF (9 suggestions), HTML
(8), XLS (5), HTML combined with PDF (4) and CSV (4). The first research
assumption was confirmed since the availability and the number of inputs for data
sets use is prevailing at regional level.</p>
      <p>
        The second question was explored by conducting a statistical analysis. Regarding
the nature of gathered data differences among mean values were examined by the
analysis of variance and several non-parametric tests. We found that data usability
evaluation does not have normal distribution and samples are of different size.
ANOVA test assumptions such as normality and symmetry of sample distribution
were not fully satisfied, so non-parametric tests were also employed, namely
Kruskal-Wallis, Leven’s test (means) and Welch’s test
        <xref ref-type="bibr" rid="ref17 ref9">(Lantz, 2013; Zimmerman,
2011)</xref>
        . The statistical hypotheses that were tested are presented in Table 2.
Hypotheses
H1 There is no significant difference between the type of format of the data set and its
usability (from the citizen’s perspective).
      </p>
      <p>H2 There is no significant difference between the local and national providers and the
estimated usability (from the citizen’s perspective).</p>
      <p>H3 There is no significant difference between regions and the estimated usability (from the
citizen’s perspective).</p>
      <p>H4 There is no significant difference between the evaluation of the data set usability and the
user group.</p>
      <p>H5 There is no significant difference in usability between data provided as open data and
non-open data.</p>
      <p>H6 There is no significant difference in usability between municipalities according to size of
population.</p>
      <p>Source: self-authored, 2015.</p>
      <p>Basic descriptive statistics and results of hypotheses testing are presented in
following tables (Table 3 – 12).</p>
      <p>Firstly, we focused on differences between data format and perceived usability of
data. Based on results in Table 4, we can conclude that there are no significant
differences in the means and the type of format has no influence on the perceived
usability of data. It is needed to add that only three data formats were included
because the other had less than 10 evaluations that might affect reliability of results.
Selected formats (DOC, HTML, PDF, XLS) are also typical for publishing data on
web, however technically, PDF is considered to be one-star data according to the
five-star data concept (Berners-Lee, 2010).</p>
      <p>The interesting finding brings the frequency analysis of formats usability
evaluation. Data sources were assessed with 1 or 2 in usability in particular formats:
DOC (64.7 %), HTML (75.9 %), PDF (80.5 %) and XLS (75.9 %). So having data in
one of these formats is likely to be perceived positively.</p>
      <p>Many examples of successful open data applications are based on data sets
provided by nationwide authorities such as police or national health agency, but we
suppose that there are myriads of opportunities to exploit data from local or regional
resources. The respondents spotted 216 various local data sources (see Table 5).
However, none of local data sets was served in an open data format. There were
some significant differences in average values (and medians according to the
Welch’s test) of usability between national and local data sets (see Table 6). Thus,
the hypothesis no. 2 (H2) has to be rejected.</p>
      <p>The evaluation of the usability was positive (1 or 2) at local resources in 75.5 % of
cases and at national resources in 89.8 % of cases.</p>
      <p>Collected answers were categorized according the municipalities and regions
where data were originated or related. In Table 7, there are four regions that provided
at least 10 scores: whole Czech state administration (CZ), Olomoucký region (M),
Plzeň region (P) and Ústí nad Labem region (U). The differences between regions
were not statistically significant with 95 % probability (see Table 8). The other
regions that were presented in responses, but not included in computation, were:
South Bohemian region, Pardubický region, Vysočina region, Karlovarský region
and Moravia-Silesian region.</p>
      <p>The frequency of positive evaluation (1 or 2) of data sources usability across
regions was distributed such as: national (89.8 %), Moravian-Silesian region (76.3
%), Plzeň region (78.4 %) and Ústí nad Labem region (81.8 %).</p>
      <p>The usability from the perspective of citizen, business and public administration
(PA) staff was examined and summarized in tables 9 and 10. However, the results
were not unanimous and we cannot simply tell whether or not there are any
differences in usability evaluation. From the descriptive statistics (see Table 9), we
can see that the variance and mean values from business users remarkably differ.
ANOVA and Levene’s tests that examine differences in means signalize that there
are no significant differences, however, Kruskal-Wallis and Welch’s test indicate the
opposite (see Table 10). Actually, the responses were given by citizens rather than by
business people or public officers. This fact might have significant impact on data.</p>
      <p>To answer the second research question supposing difference in data usability
among regions and user groups, we can conclude that the usability was evaluated
similarly across observed regions and between user groups. On the other hand, the
data sets provided by national institutions were ranked with better score than regional
sources (see Table 5).</p>
      <p>The evaluation of usability according user groups ranked 1 or 2 in 78.1 %
(citizen), 68.3 % (business) and 79.3 % (PA staff) of cases.</p>
      <p>The third research question was to reveal the users’ point of view on usability of
data provided in open format and data that are not open yet. The descriptive summary
is presented in Table 11. There were only 11 open data sets evaluated by users
against 254 non-open data sets. Some significant discrepancy in mean values was
confirmed only by Levene’s p-value, but other test results including ANOVA
prevented from rejecting the hypothesis about equality of mean values (see Table
12).</p>
      <p>There was also no remarkable difference in the frequency of a positive evaluation
of data usability between open data (63.6 %) and non-open data (78.7 %).</p>
      <p>
        We can conclude that citizens can hardly see any difference between open and
non-open data in terms of the usability. Unless there are particular applications based
on open data much interest cannot be expected. The value of open data materializes
only upon its use
        <xref ref-type="bibr" rid="ref14">(Susha et al, 2015)</xref>
        .
      </p>
      <p>
        The fourth research question and resulting final hypothesis were to examine
differences among municipalities of different size. In the Table 13, we can see
comparison of testing differences in usability between municipalities (without
schools and national institutions) according to size of population. There were four
different categories of the population size: under 2,000 inhabitants, between 2,000
and 4,999, between 5,000 and 9,999, and over 10,000. The categories follow
guidelines of the Czech Statistical Office
        <xref ref-type="bibr" rid="ref5">(CZSO, 2011)</xref>
        . Because there was no
sample where all test criteria would be significant, we could not reject the null
hypothesis and we should state that there are no significant differences between mean
values of the usability evaluation. The benefit from using data was not affected by
the size of municipality population from the perspective of respondents. However,
the respondents did not need to be residents in the respective municipalities. The
number of population had some significant effect in the evaluation of municipality
openness to information disclosure
        <xref ref-type="bibr" rid="ref2 ref3">(Bachmann, 2012; Bachmann &amp; Zubr, 2014)</xref>
        .
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>Based on the survey, it can be concluded that data sets provided by national state
agencies and authorities are more frequently in line with open data principles, while
at the regional level there are still large resources that could be unleashed under open
data concept. Citizens and businesses come in contact rather with local than national
authorities and they could take better advantage of novel applications and services
based on open data if they exist.</p>
      <p>The main highlights of the survey findings are summarized under:
• In the sample of 265 data sets, the most frequently published data were:
obligatory information published on public office website (also called as
“edesk”) (33 %), budget information (33 %), annual report (13 %), newsletter
(10 %) and decision of representatives (10 %);
• Out of 265 data sets, there were 216 data sets provided by local municipalities
or institutions (81.5 %) and 49 by national bodies (18.5 %);
• Nationwide data sets were assessed in usability on average better (1.57) than
local data sets (1.93);
• HTML (30.5 %), PDF (29.1 %), XLS (10.9 %) and DOC (6.4 %) are the most
used data formats on municipality and public authority web sites. Their
usability was assessed as positive (score 1 or 2) in at least 64.7 % cases;
• The usability of data was evaluated similarly across observed regions beside
those provided by nationwide institutions;
• The usability of data was assessed from three perspectives: citizen (265
evaluations), business (60) and public administration staff (58);
• The average usability was the best from citizen’s point of view (1.86) and the
worst from the business point of view (2.25), but most of respondents were
rather citizens than business people, which might have impacted results;
• Currently, the citizens cannot see the difference in usability of open and
nonopen data unless there are particular applications available;
• The benefit from using data was not affected by the size of municipality
population from the perspective of respondents, but those respondents did not
need to be the actual residents in those municipalities.</p>
      <p>
        The presented results are limited due to the scope of the survey. More details
about opinions of users coming from regions and local communities should be
investigated. Also the willingness of people to use tools based on open data and to
interact online with their local representatives should be examined thoroughly
        <xref ref-type="bibr" rid="ref11 ref14">(Office, 2011; Susha et al, 2015)</xref>
        .
      </p>
      <p>Acknowledgments. The results and knowledge included herein have been obtained
owing to support from the Internal grant agency of the Faculty of Economics and
Management, Czech University of Life Sciences in Prague, grant no. 20151039
"Využití otevřených dat v agrárním sektoru" (The use of open data in agricultural
sector).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kobilarov</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cyganiak</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Ives</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          (
          <year>2007</year>
          )
          <article-title>DBpedia: A nucleus for a Web of open data</article-title>
          .
          <source>Translated from English by</source>
          ,
          <volume>4825</volume>
          LNCS.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Bachmann</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Openness to information disclosure: the case of Czech rural municipalities</article-title>
          .
          <source>AGRIC. ECON. - CZECH</source>
          ,
          <volume>58</volume>
          (
          <issue>12</issue>
          ),
          <fpage>580</fpage>
          -
          <lpage>589</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bachmann</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Zubr</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>What affects the information provided on the web? Case of Czech rural municipalities</article-title>
          .
          <source>Acta Universitatis Agriculturae et Silviculturae Mendelianae Brunensis</source>
          ,
          <volume>62</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1221</fpage>
          -
          <lpage>1231</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Chlapek</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kučera</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nečaský</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Kubáň</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>Open data and PSI in the Czech Republic</article-title>
          .
          <source>European Public Sector Information Platform.</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>CZSO</surname>
          </string-name>
          (
          <year>2011</year>
          )
          <article-title>Preliminary results of the Census 2011 Population</article-title>
          ,
          <year>2011</year>
          . Available online: https://http://www.czso.cz/csu/sldb/population [Accessed.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Kalampokis</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tarabanis</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Tambouris</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2011</year>
          )
          <article-title>A classification scheme for open government data: Towards linking decentralised data</article-title>
          .
          <source>International Journal of Web Engineering and Technology</source>
          ,
          <volume>6</volume>
          (
          <issue>3</issue>
          ),
          <fpage>266</fpage>
          -
          <lpage>285</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Kassen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>A promising phenomenon of open data: A case study of the Chicago open data project</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <volume>30</volume>
          (
          <issue>4</issue>
          ),
          <fpage>508</fpage>
          -
          <lpage>513</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Kubata</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tyrychtr</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ulman</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Vostrovskỳ</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>Business informatics and its role in agriculture in the Czech Republic</article-title>
          .
          <source>Agris On-line Papers in Economics and Informatics</source>
          ,
          <volume>6</volume>
          (
          <issue>2</issue>
          ),
          <fpage>59</fpage>
          -
          <lpage>66</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Lantz</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>The impact of sample non-normality on ANOVA and alternative methods</article-title>
          .
          <source>British Journal of Mathematical &amp; Statistical Psychology</source>
          ,
          <volume>66</volume>
          (
          <issue>2</issue>
          ),
          <fpage>224</fpage>
          -
          <lpage>244</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Murray-Rust</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2008</year>
          )
          <article-title>Open data in science</article-title>
          .
          <source>Serials Review</source>
          ,
          <volume>34</volume>
          (
          <issue>1</issue>
          ),
          <fpage>52</fpage>
          -
          <lpage>64</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Office</surname>
            ,
            <given-names>C. S.</given-names>
          </string-name>
          (
          <year>2011</year>
          )
          <article-title>Preliminary results of the Census 2011 Population</article-title>
          . Available online: https://http://www.czso.cz/csu/sldb/population [Accessed.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Shadbolt</surname>
          </string-name>
          , N.,
          <string-name>
            <surname>O'Hara</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gibbins</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Glaser</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hall</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Schraefel</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Linked open government data: Lessons from data</article-title>
          .
          <source>gov.uk. IEEE Intelligent Systems</source>
          ,
          <volume>27</volume>
          (
          <issue>3</issue>
          ),
          <fpage>16</fpage>
          -
          <lpage>24</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Sieber</surname>
            ,
            <given-names>R. E.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Johnson</surname>
            ,
            <given-names>P. A.</given-names>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>Civic open data at a crossroads: Dominant models and current challenges</article-title>
          .
          <source>Government Information Quarterly.</source>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Susha</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          , Grönlund,
          <string-name>
            <given-names>Å.</given-names>
            &amp;
            <surname>Janssen</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>Organizational measures to stimulate user engagement with open data</article-title>
          .
          <source>Transforming Government: People, Process and Policy</source>
          ,
          <volume>9</volume>
          (
          <issue>2</issue>
          ),
          <fpage>181</fpage>
          -
          <lpage>206</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Šilerová</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maneva</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hřebejková</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>The Importance of Congress Tourism for Regional Development. Agris on-line Papers in Economics and Informatics, V(3</article-title>
          ),
          <fpage>79</fpage>
          -
          <lpage>86</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Vaněk</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jarolímek</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Vogeltanzová</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2011</year>
          )
          <article-title>Information and Communication Technologies for Regional Development in the Czech Republic - Broadband Connectivity in Rural Areas. AGRIS on-line Papers in Economics and Informatics</article-title>
          ,
          <source>III(3)</source>
          ,
          <fpage>67</fpage>
          -
          <lpage>76</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Zimmerman</surname>
            ,
            <given-names>D. W.</given-names>
          </string-name>
          (
          <year>2011</year>
          )
          <article-title>A simple and effective decision rule for choosing a significance test to protect against non-normality</article-title>
          .
          <source>British Journal of Mathematical &amp; Statistical Psychology</source>
          ,
          <volume>64</volume>
          (
          <issue>3</issue>
          ),
          <fpage>388</fpage>
          -
          <lpage>409</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>