<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Geographic Information Observatories for Supporting Science</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Benjamin Adams</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mark Gahegan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Prashant Gupta</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Richard Hosking</string-name>
          <email>r.hoskingg@auckland.ac.nz</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Centre for eResearch The University of Auckland</institution>
          ,
          <country country="NZ">New Zealand</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this paper we explore two questions that we feel are important to investigate further if geographic information observatories are to be fruitful research endeavor in GIScience. The rst question is simply `what is a geographic information observatory (and what is it not)?' and the second question is `what use is a geographic information observatory?'. The construction of large-scale geographic information observatories has the potential to be an exciting development, but it remains unclear what forms they might take. Furthermore, the reasons articulated so far for building these observatories remain largely in the domain of information science and have not been motivated in context to broader scienti c problems, such as global climate change. We investigate how geographic information observatories can support science in other elds, focusing on the example of socio-ecological system research. We argue that it is in the application of geographic information observatories toward solving big problems that they can garner community buy-in and demonstrate real impact.</p>
      </abstract>
      <kwd-group>
        <kwd>geographic information observatory</kwd>
        <kwd>GIScience</kwd>
        <kwd>Web Science</kwd>
        <kwd>socio-ecological systems</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Astronomical and terrestrial observatories have existed since antiquity with
perhaps the rst state-sponsored observatory as research institute having been built
in Baghdad in the 9th century CE during the reign of al-Ma'mun [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. However,
it was Galileo and his contemporaries' adoption of the optical telescope for
astronomy that led to our modern conceptualization of observatories as houses
for observational scienti c equipment, such as telescopes. Since that time,
advances in observational technology like improvements in telescope design have
been undertaken in tandem with changes in science. Observatories have often
been built to help nd experimental evidence for theoretical advances in physics
and astronomy, and as a result technological developments have been made in
order to observe phenomena that are not already easy to observe with the
existing infrastructure. Equally important, these technological advancements have
opened up new avenues of theoretical and applied research in many other elds.
For example, technologies that allowed astronomers to observe the non-visible
light spectrum expanded the scope of the observable universe and greatly
effected cosmology. Today, observatories are large-scale collaborative
infrastructure projects designed to support campaigns that are the outcome of extensive
consulting processes and considerable investments of time and money. Examples
of modern observatories include the optical Manua Kea observatory, the Very
Large Array radio observatory, and the Hubble Space Telescope.
1.1
      </p>
    </sec>
    <sec id="sec-2">
      <title>What are geographic information observatories?</title>
      <p>
        Recently, the analogy of building information and web science observatories has
been proposed, though this idea is nascent and remains largely underspeci ed
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Now this idea has been extended to geographic information observatories
[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Although the metaphor of the observatory conjures up many interesting
possibilities for what forms geographic information observatories might take, it is
important that we work to clarify what geographic information observatories are
and what di erentiates them from other kinds of observatories. Table 1 presents
one simple way of organizing some di erent types of observatories based on
examples. In the case of de ning geographic information observatories, we are
presented with the question of whether the term geographic modi es information
observatory, or rather do we mean observatories of geographic information ? In
the former case, we have the sense of information observatories that are regional
or site-speci c in scope{perhaps focusing on the unique characteristics of
information in the context of a spatial location and time. The latter interpretation
has more to do with understanding the embedding of geographic information in
the broader universe of information, for example, examining global patterns in
networks of geographic information.
      </p>
      <p>
        Type of observatory Examples
Geographic observatory Long-term Ecological Research Network (LTER)[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ],
[site-speci c] Montserrat Volcano Observatory[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
Geographic observatory National Ecological Observatory Network (NEON)[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]
[global]
Information observatory Web Science Observatories[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]
Geographic (infor- Urban Observatory (http://www.urbanobservatory.org/)
mation observatory)
[site-speci c]
Observatory of geo- (proposed) Portals for spatial, temporal, semantic
signagraphic information tures of place types
[global]
Table 1. Di erent types of geographic and information observatories, with examples.
      </p>
      <p>Both of these interpretations of geographic information observatory can be
viewed as distinct from the idea of a geographic observatory (sans
information), where the objects of interest{i.e., what are being observed{are terrestrial
processes, though the observatory's products are information objects. These
information sources and products (from geographic observatories as well as other
less-organized and emergent sources) might be the information events that an
information observatory observes, however. Even so, since all kinds of
observatories perform information processing, any line between geographic observatories
and geographic information observatories is quite fuzzy and more exploration of
the di erence{e.g., in terms of information processing steps subsequent to
physical measurement, or in terms of contextual meta-analysis{might help us clarify
the form that we would like these observatories to take. For example, depending
on the de nitions we choose, the Urban Observatory1 can be considered either
a geographic observatory or a geographic information observatory (or perhaps
both). As well, although geographic information observatories are in some sense
one step removed from the direct process of making observations of the Earth
and human behavior, geographic information observatories can still be
considered important tools for geographically-related scienti c research. Understanding
the primary sources of data production, data use, re-use, and integration all fall
within the purview of geographic information observatories as we envision them.</p>
      <p>However, even if we better de ne what we mean by geographic information
observatories that does not necessarily give us a meaningful road map of
priorities for how we should proceed toward building the observatories. Instead, what
gives us that roadmap is an investigation into why geographic information
observatories are an important development. One lesson we can take from real-world
observatories is that for there to be community buy-in to the investment of time
and money necessary to build large-scale observational infrastructure requires
clear purpose. In the remainder of this paper we argue that a good strategy is to
look deeper into how geographic information observatories can support scientists
trying to solve big social and environmental problems.
2</p>
      <sec id="sec-2-1">
        <title>Why do we want to build geographic information observatories?</title>
        <p>2.1</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>The support science argument</title>
      <p>
        Not to ignore our curiosity as information scientists about the nature of the
geographic information universe for its own sake, but as we consider the question of
why we need geographic information observatories we feel it is necessary to look
to problems that are not restricted solely to the domain of information science.
That is, the question of why is driven by the need to solve important problems
irrespective of discipline. There is a tendency among geographic information
scientists to assert their desire to do GIScience (with a big-S on science) and
not be simply seen as tool-builders. This perspective focuses on Goodchild's [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]
rst sense of GIScience (the science of GIS), but ignores the second but equally
important sense{that GIScience investigate how GIS can support science. It is
1 http://www.urbanobservatory.org/
our contention that by linking the outcomes of building geographic information
observatories to solving interdisciplinary problems of concern to many (e.g.,
geographers, Earth scientists, and ecologists){rather than remaining in the abstract
domain of the information universe{there will be much more vested interest in
actually building these observatories. Otherwise, we can hardly be surprised if
it is considered a niche endeavor, not worthy of large expenditures of research
funding and time. Astronomical observatories are no di erent{even when the
research objectives are at the esoteric end of cosmology, there is always an explicit
acknowledgement that by building the observatory there will be technological
advances that will aid us in other domains as well. For example, the massive
computing infrastructure required to store and analyze data from the CERN
particle accelerator has driven innovation in distributed grid computing that
will be useful in many other elds. Observatories do support science and we
should not shirk from the idea that although geographic information
observatories are in themselves legitimate scienti c endeavors, they also support research
in multiple domains.
      </p>
      <p>Geographic data is obviously extremely useful in many kinds of research, but
in order to get at what we want geographic information observatories to look
like, we might rst start by asking: what are the elds of research where we are
severely hampered by a lack of understanding of the kinds, forms, and diversity
of geographic data that exist in the information universe? There are likely many
answers to this question, but interdisciplinary and transdisciplinary research
elds that rely on the synthesis of geographical data from disparate sources are
obvious candidates. We would like to highlight one subject of study in particular,
socio-ecological systems, which we believe would greatly bene t from a better
understanding of the geographic information universe, and therefore help justify
why we want to build geographic information observatories.
2.2</p>
    </sec>
    <sec id="sec-4">
      <title>Exemplar: supporting socio-ecological system research</title>
      <p>
        Socio-ecological systems (also known as social-ecological systems or coupled
human-environment systems) concern the holistic study of the complex
relations between human social action and biogeochemical and physical systems [
        <xref ref-type="bibr" rid="ref2">2,
17</xref>
        ]. The study of socio-ecological systems was borne of the recognition that the
arti cial division of social systems and environmental systems into discrete
research threads does not re ect the actual strong interweaving between human
social systems and environmental systems at all spatial and temporal scales.
Having a better understanding of socio-ecological systems is at the core of
solving many of the very di cult problems (so-called \wicked problems" [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]) that
we face in the 21st century, including global climate change, infectious disease
pandemics, natural disaster emergency management, sustainable development,
resource management, and environmental justice issues.
      </p>
      <p>
        The socio-ecological system perspective advocates an integrative approach.
However, although there is conceivably a vast amount of geographic data that
can shed light on understanding socio-ecological systems, most of the data is
not integrated, nor even accessible to a scientist in any useful form. In fact, in
many cases even when the data is available, it is unclear what data is useful for
answering a speci c question. In part, this is due to the fact that social data and
environmental data are collected and stored using very di erent procedures and
formats, and for di erent purposes. Furthermore, the study of socio-ecological
systems is fundamentally the study of equilibrium, resilience, robustness,
adaptability, and vulnerability [
        <xref ref-type="bibr" rid="ref14 ref4">14, 4</xref>
        ]. But the scale at which we observe geographic
processes fundamentally biases our conclusions about these dynamics in
socioecological systems [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Thus, epistemologically we must have a better handle on
the scale of the environmental and social processes that are being represented in
geographic information [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. An example of this in climate science is the
problem of downscaling [16]. Arguably, getting a better understanding of the scale
of the processes represented in geographic information and \scaling e ects" on
di erent interpretations of that information is one of the most critical research
areas for geographic information observatories.
      </p>
      <p>
        Socio-ecological systems are adaptive, complex systems operating at
multiple spatial and temporal scales, and our sensors of the geographic world are
also operating at several spatial, temporal, and thematic scales. Ideally, there
is great potential to exploit the increasing availability of multi-resolution and
multi-thematic geographic data to model socio-ecological systems. However,
because we do not have a good picture of the geographic information universe,
it is extremely di cult to match and integrate the relevant data that might
be scattered across the information universe to speci c socio-ecological research
problems. For many socio-ecological analyses, it is often the case that in order
to get at a composite social-environmental picture requires using heterogeneous
information artifacts that people \leave behind," e.g., through social media,
GPS tracking, etc., in combination with environmental sensor data of varying
resolutions and themes, such as metagenomic analysis and spatio-temporal
microparticle measurements. The investigation of exposure over the life-course of
an individual (exposome) is a prime example of this kind of analysis [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
2.3
      </p>
    </sec>
    <sec id="sec-5">
      <title>What makes up a geographic information observatory?</title>
      <p>In the context of answering what form we want geographic information
observatories to take we might also identify some of the various aspects geographic
information that we want to be able to observe in order to support the scienti c
process.</p>
      <p>Finding what we need. We need observatories that specialize in nding and
ingesting geographical data from a multitude of sources. Along many fronts these
are already being developed in the context of spatial data infrastructures, linked
geo-data repositories, and the like. For the example of socio-ecological research
this entails mapping the vast variety of environmental and social
geographicallyreferenced data that are available.</p>
      <p>
        Understanding what we nd. We must also understand what kinds of data
are useful for what purposes, which is in many ways a much more di cult
research problem [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. In part this is because the information event representing
the use of a data set is not transparent in many cases. The observation of this
information might not be something for which there is primarily a technological
solution. Instead, we might need deep research e ort into the sociological study
of how scientists use their data. Observatories can attract researchers because
they o er functionality to observe (and data about) data use, and thus create
the opportunity to look through the lens in the other direction at the research
community.
      </p>
      <p>Watching the detectives. We want to measure the change of geographical
information, both in terms of content and related conceptual framing and
interpretation. For example, in order to recognize that data from a source is used
for one purpose by the originating community but has been re-purposed by
an unrelated community. We want to be able to observe these di erences and
their patterns through space and time. Also, at the community-level scienti c
knowledge is in ux and interpretation of data recorded in the past through a
present-day lens will often be distorted.</p>
    </sec>
    <sec id="sec-6">
      <title>Studying the use of geographic information. Perhaps of particular impor</title>
      <p>tance to geographic information observatories, we want to be able to observe the
myriad relationships between attributes of geographic information and its use.
For example, exploring the relationships between scale and process, and the
implications of those relationships for speci c scienti c research questions, which
could also entail observing methodological di erences in how scale is
conceptualized by di erent users of geographic information. We could also study the
geographic footprint of data in terms of where (when) it is used as opposed
to where (when) it depicts, or what it was used for as opposed to what it was
made for.
3</p>
      <sec id="sec-6-1">
        <title>Outro</title>
        <p>More often than not, geographic information scientists interested in organizing
information about socio-environmental and other complex geographic systems
are limited to using their \table-top telescopes" that are only pointed in one
direction and which collect data that are easy to get, but biased and of limited
interest (e.g., Twitter API). Or worse yet, they are information astrologers
designing ontologies with no basis in observation! Information observatories (both
geographic and non-geographic) do already exist{companies like Google and
Facebook and governmental organizations like the United States National
Security Agency have developed information observatories that are designed to
answer the needs of commercial industry and the intelligence community. Where
do we as academic information scientists position our information observatories
in this environment? The observatories these organizations have built are
powerful, but they are not designed to support scientists working to solve the many
di cult problems of the next century. We have an opportunity (and imperative)
to build similarly powerful observatories that will support critical research
questions in climate change, health care, environmental science, social sciences, and
the like.</p>
      </sec>
      <sec id="sec-6-2">
        <title>Acknowledgments</title>
        <p>We would like to thank Cameron McLean and Brandon Whitehead for
contributing to the discussions that led to this paper.
16. Wood, A.W., Leung, L.R., Sridhar, V., Lettenmaier, D.P.: Hydrologic implications
of dynamical and statistical approaches to downscaling climate model outputs.</p>
        <p>Climatic change 62(1-3), 189{216 (2004)
17. Young, O.R., Berkhout, F., Gallopin, G.C., Janssen, M.A., Ostrom, E., van der
Leeuw, S.: The globalization of socio-ecological systems: an agenda for scienti c
research. Global Environmental Change 16(3), 304{316 (2006)</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Aspinall</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loughlin</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Michael</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miller</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Norton</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rowley</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sparks</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Young</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The montserrat volcano observatory: its evolution, organization, role and activities</article-title>
          .
          <source>Geological Society, London, Memoirs</source>
          <volume>21</volume>
          (
          <issue>1</issue>
          ),
          <volume>71</volume>
          {
          <fpage>91</fpage>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Berkes</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Folke</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Colding</surname>
          </string-name>
          , J.:
          <article-title>Linking social and ecological systems: management practices and social mechanisms for building resilience</article-title>
          . Cambridge University Press (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Gahegan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Adams</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Re-envisioning data description using Peirce's pragmatics</article-title>
          .
          <source>In: Geographic Information Science</source>
          . Springer (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Gallop n</surname>
          </string-name>
          , G.C.:
          <article-title>Linkages between vulnerability, resilience, and adaptive capacity</article-title>
          .
          <source>Global Environmental Change</source>
          <volume>16</volume>
          (
          <issue>3</issue>
          ),
          <volume>293</volume>
          {
          <fpage>303</fpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Goodchild</surname>
            ,
            <given-names>M.F.</given-names>
          </string-name>
          :
          <article-title>Geographical information science</article-title>
          .
          <source>International Journal of Geographical Information Systems</source>
          <volume>6</volume>
          (
          <issue>1</issue>
          ),
          <volume>31</volume>
          {
          <fpage>45</fpage>
          (
          <year>1992</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Janowicz</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Adams</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McKenzie</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kauppinen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Towards geographic information observatories</article-title>
          .
          <source>In: Proceedings of Workshop on Geographic Information Observatories</source>
          <year>2014</year>
          , pp.
          <volume>1</volume>
          {
          <issue>5</issue>
          .
          <string-name>
            <surname>CEUR-WS.org</surname>
          </string-name>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. Keller, M.,
          <string-name>
            <surname>Schimel</surname>
            ,
            <given-names>D.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hargrove</surname>
            ,
            <given-names>W.W.</given-names>
          </string-name>
          ,
          <article-title>Ho man</article-title>
          ,
          <string-name>
            <surname>F.M.:</surname>
          </string-name>
          <article-title>A continental strategy for the national ecological observatory network</article-title>
          .
          <source>Frontiers in Ecology and the Environment</source>
          <volume>6</volume>
          (
          <issue>5</issue>
          ),
          <volume>282</volume>
          {
          <fpage>284</fpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Levin</surname>
            ,
            <given-names>S.A.</given-names>
          </string-name>
          :
          <article-title>The problem of pattern and scale in ecology: the Robert H</article-title>
          .
          <article-title>MacArthur award lecture</article-title>
          .
          <source>Ecology</source>
          <volume>73</volume>
          (
          <issue>6</issue>
          ),
          <year>1943</year>
          {
          <year>1967</year>
          (
          <year>1992</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Redman</surname>
            ,
            <given-names>C.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grove</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuby</surname>
            ,
            <given-names>L.H.</given-names>
          </string-name>
          :
          <article-title>Integrating social science into the longterm ecological research (lter) network: social dimensions of ecological change and ecological dimensions of social change</article-title>
          .
          <source>Ecosystems</source>
          <volume>7</volume>
          (
          <issue>2</issue>
          ),
          <volume>161</volume>
          {
          <fpage>171</fpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Rittel</surname>
            ,
            <given-names>H.W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Webber</surname>
            ,
            <given-names>M.M.:</given-names>
          </string-name>
          <article-title>Dilemmas in a general theory of planning</article-title>
          .
          <source>Policy sciences 4(2)</source>
          ,
          <volume>155</volume>
          {
          <fpage>169</fpage>
          (
          <year>1973</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Saliba</surname>
          </string-name>
          , G.:
          <article-title>A history of Arabic astronomy: planetary theories during the golden age of Islam</article-title>
          , vol.
          <volume>19</volume>
          . New York University Press (
          <year>1994</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Sayre</surname>
            ,
            <given-names>N.F.</given-names>
          </string-name>
          :
          <article-title>Ecological and geographical scale: parallels and potential for integration</article-title>
          .
          <source>Progress in Human Geography</source>
          <volume>29</volume>
          (
          <issue>3</issue>
          ),
          <volume>276</volume>
          {
          <fpage>290</fpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Tiropanis</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hall</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shadbolt</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Roure</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Contractor</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>The web science observatory</article-title>
          .
          <source>IEEE Intelligent Systems</source>
          <volume>28</volume>
          (
          <issue>2</issue>
          ),
          <volume>100</volume>
          {
          <fpage>104</fpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Walker</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holling</surname>
            ,
            <given-names>C.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carpenter</surname>
            ,
            <given-names>S.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kinzig</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Resilience, adaptability and transformability in social{ecological systems</article-title>
          .
          <source>Ecology and society 9(2)</source>
          ,
          <volume>5</volume>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Wild</surname>
            ,
            <given-names>C.P.</given-names>
          </string-name>
          :
          <article-title>Complementing the genome with an \exposome": the outstanding challenge of environmental exposure measurement in molecular epidemiology</article-title>
          .
          <source>Cancer Epidemiology Biomarkers &amp; Prevention</source>
          <volume>14</volume>
          (
          <issue>8</issue>
          ),
          <year>1847</year>
          {
          <year>1850</year>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>