<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Bringing epidemiology into the Semantic Web</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jo a˜o D. Ferreira</string-name>
          <email>joao.ferreira@lasige.di.fc.ul.pt</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Catia Pesquita</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Francisco M. Couto</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>M a´rio J. Silva</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>IST, INESC-ID, Technical University of Lisbon</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Lasige, Departamento de Informa ́ tica, Faculdade de Cieˆ ncias da Universidade de Lisboa</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Epidemiology is a domain of knowledge interconnected with many other domains, thus making it a good candidate for reusing existing ontologies that, despite having been created for different purposes, characterize information frequently manipulated by epidemiologists and public health scientists. This paper presents an evaluation of existing ontologies for the semantic annotation of epidemiological resources. We selected a set of ontologies and proposed a Network of Epidemiology-Related Ontologies (NERO), which can form the core of semantic annotation for data-intensive epidemiology-related information systems, such as epidemic forecasting infrastructures. To support this selection, we defined a set of requirements for inclusion of ontologies in NERO, based on good ontology practice, the interdisciplinary nature of the epidemiological domain and support of semantic web technologies. Most of the selected NERO ontologies are current candidates or members of the Open Biological and Biomedical Ontologies initiative.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 INTRODUCTION</title>
      <p>Epidemiology is a truly multidisciplinary subject in the sense that
it relies on diverse areas of knowledge, such as medicine, statistics,
social sciences and geography. As a result, epidemiological data is
both one of the most diverse and also one whose characterization
can benefit the most from semantic technologies. In fact, only a
framework able to understand heterogeneous and multidisciplinary
resources can ultimately deal with all aspects of epidemiology.
Ontologies can help address this issue by improving the integration,
categorization and sharing of epidemiological resources.</p>
      <p>Consider the following example: a research team is building a
model for influenza spread and they need to know the number of
infections caused by this disease over time to fit the parameters of
their model. They are interested in building a model that works
in France. By means of an appropriate query, they can try to find
data resources about “influenza in France.” To effectively find the
resources in need using an automated process, these should be
correctly annotated in advance. One of the best approaches for
creating such annotations is to associate ontological concepts to
each resource. The annotations could then be used by a service that
would locate the resources satisfying the query and rank them by
means of semantic similarity applied to the ontological concepts
associated to the query and the annotated resources. Furthermore,
by using ontologies, the process of annotating a resource can be
facilitated through the identification of concept labels using text
mining for analysis of the content of the resource.</p>
      <p>To provide the service described in the above scenario, it
is paramount to establish a comprehensive and powerful set
or inter-related semantic concepts ensuring the consistency of
the annotations. By doing so, we stimulate the creation of
tools to serve epidemic modelers and epidemiologists in general,
thereby contributing to the adoption of semantic technologies in
epidemiology.</p>
      <p>This paper proposes NERO, a Network of Epidemiology-Related
Ontologies, a first step towards the generation of a useful source of
epidemiological concepts and the relations among them supporting
the characterization of data resources used in epidemiological
studies. In this aspect, NERO can be considered an ontology per se,
but the disparate set of domains in this area suggests that it should,
in fact, be composed of a number of distinct inter-related ontologies.
To ensure good interoperability between these ontologies, we
propose a list of requirements for inclusion in NERO. A survey to
the state-of-the-art in epidemiologically relevant ontologies yielded
a set of ontologies that partially fulfill the proposed requirements.
2</p>
    </sec>
    <sec id="sec-2">
      <title>METHODOLOGY</title>
      <p>
        The ontologies to be included in NERO were selected based on the
domains of knowledge that are generally present in epidemiological
ontologies (diseases, locations etc.; see Table 4.1 for a full list of
NERO domains). However, since its goal is to serve epidemiological
research, we also based this selection on the needs of one
particular epidemic research platform, the Epidemic Marketplace
(EM)
        <xref ref-type="bibr" rid="ref15">(Lopes et al., 2010)</xref>
        . This website provides storage capabilities
for all kinds of epidemiological resources, as well as a full set
of associated services, such as adding comments to the resources
and sharing the resources with other parties. Within the EM,
NERO concepts can be used to annotate epidemiological resources
(see, for an example, http://epimarketplace.net/metadata/example).
However, as illustrated in Figure 1, even though NERO is based on
our experience of developing the EM, it can be applied outside the
Fig. 1. NERO was created by analysing epidemiology-related ontologies;
additionally, NERO and the EM are related to one another since NERO was
created based on specific needs for the EM. However, NERO is external to
the EM and can be used outside that context by any epidemiologist.
scope of that system, as it is a general network of epidemiological
concepts applicable to any epidemiologically-related context.
      </p>
      <p>We started by discussing which requirements should be fulfilled
by the ontologies to be included in NERO, in order to create a
concise, comprehensive and good quality network of ontological
concepts for the epidemiological domain. We then surveyed current
ontologies in this domain and evaluated them according to their
fulfillment of the requirements. Since it was found that these
ontologies generally fail in satisfying many of the requirements,
we then considered general-purpose ontologies, like UMLS, and
ontologies with a more focused domain, like the Disease Ontology.
3</p>
    </sec>
    <sec id="sec-3">
      <title>THE NETWORK OF EPIDEMIOLOGICALLY</title>
    </sec>
    <sec id="sec-4">
      <title>RELATED ONTOLOGIES</title>
      <p>
        The ability to reuse concepts from one application in another is
one of the premises of the semantic web
        <xref ref-type="bibr" rid="ref22">(Shadbolt et al., 2006)</xref>
        .
Given that the main purpose of this work is to define a source
of concepts to use primarily for the annotation of epidemiological
datasets, we want the advantage of not having to deal with
maintaining and curating these concepts ourselves, but instead to
leverage on existing ontologies for that. Therefore, we propose the
Network of Epidemiology-Related Ontologies (NERO), a collection
of ontologies that cover the epidemiological domain and enable the
annotation of epidemiological resources with the relevant concepts.
      </p>
      <p>
        In any comprehensive collection with multiple provenances,
there must be a set of requirements ensuring and enabling both
a good interoperability among those resources and an overall
cohesive structure. Besides the specific requirements derived from
the particular goals of NERO, some of the requirements presented
here include adaptations of (i) principles of the W3C semantic
web
        <xref ref-type="bibr" rid="ref12">(Koivunen and Miller, 2001)</xref>
        ; and (ii) principles of the OBO
Foundry
        <xref ref-type="bibr" rid="ref24">(Smith et al., 2007)</xref>
        .
      </p>
      <p>This list should be considered as a set of guidelines, not as
absolutely mandatory rules. They lead NERO towards an ideal
scenario where ontologies have a high level of expressibility and
good interoperability between each other, all the while enabling a
simple, yet powerful, implementation of semantic web technologies.</p>
      <p>We propose ten requirements:
1. Relevant Domain The most important requirement for
incorporating an ontology in NERO is that it should encode a
domain of knowledge that is interesting from the point of view
of epidemiology, i.e. it must contain concepts that are relevant
to annotate epidemiological resources. Likewise, the full
network should cover almost all of the epidemiological domain
(diseases, modes of transmission, geographical locations, etc.).
2. Appropriate granularity To achieve high domain coverage
and improve the semantic characterization of epidemiological
resources, an ontology must provide an adequately detailed
representation of its domain. Biomedical and geospatial
ontologies tend to comply to this requirement quite well, and
in fact some contain many thousands or even tens of thousands
of concepts spread over many levels of depth, allowing specific
annotations such as the exact strain of a virus instead of its
family. In contrast, the best ontology to describe a given
domain can be too granular for the purpose of epidemiological
annotation (e.g. photon in ChEBI). In these cases, NERO
should disregard the unwanted branches of the ontology.
3. Expressiveness with tractability A large number of
concepts is an important advantage, but being able to manage
the ontologies is also a technical requirement, and as such
the ontologies must be well structured and tractable from a
computational point of view. Specifically, this means that the
properties must be formally defined and that these definitions
should be adjusted to the domain in question. For example,
in an the anatomy domain, it does not make sense to have
only an is-a relationship type, since properties like part-of and
arterial-supply are equally relevant.
4. Cross-references Ontologies encoding different domains
can, nevertheless, be related to one another. For example,
symptoms are usually associated with diseases and vice-versa.
External references that cross from one ontology to another link
together concepts from different domains, enabling semantic
web technologies to explore multiple-domain relations.
5. Textual definitions Since NERO will be employed primarily
to annotate epidemiological resources, it is important that its
users understand the meaning of each concept. Ontologies
encode theirs concepts’ meaning in machine-readable code, but
for users to correctly identify the concept they want, concepts
should be complemented with textual definitions.
6. List of synonyms As synonyms are abundant in natural
language, particularly in the biomedical field, it is important
that NERO explicitly states these synonyms (e.g., “AIDS” is a
synonym of “acquired immune deficiency syndrome” and users
expect that both refer to the same concept).
7. Popularity NERO ontologies should be well known in
the epidemiology community, since familiarity increases the
chance that users more easily choose the correct concept.
Furthermore, if an ontology is popular, there is a higher
probability that its development does not stall in the foreseeable
future, ensuring that NERO is kept updated with the most
current knowledge.
8. Publicly available It is imperative to adopt an open-source
ontology rather than one that needs licenses or other form of
control over usage. This requirement stems from the fact that
we intend NERO to be publicly available to anyone in order to
further increase the spread of semantic web technologies into
epidemiology. Also important, in this context, is that users have
the opportunity to submit corrections, suggestions and other
improvements to the ontologies.
9. Persistent identifiers Since ontologies constantly change in
response to advances in the field, errors found, etc., some
concepts may change their definition, ultimately resolving in
some annotations becoming wrong. To mitigate this issue,
ontologies in NERO should have semantic-free identifiers
which are never removed from the ontology.
10. Distributed access to the ontology Several languages have
been developed to encode ontologies (most notably OWL and
OBO format); but other formats exist, from simple tree-like
structures described in a text document to tables on a database.
Instead of having to cope with all these differences, NERO
ontologies should be easily accessible through “the cloud”,
(web services or equivalent). Moreover, by not having a local
copy of the ontology, there is no need to take special actions in
order to keep it up-to-date.</p>
      <p>The first three requirements (domain, granularity and
expressiveness) are scope-related, since they refer specifically to
the knowledge encoded in the ontology itself. The others are
properties that simplify the tractability of an ontology and improve
its usefulness as a scientifically sound source of concepts for
annotating epidemiological resources, while ensuring a certain
degree of user-friendliness, which is important given that one of the
aims of NERO is to facilitate the annotation process.
4</p>
    </sec>
    <sec id="sec-5">
      <title>RESULTS</title>
      <p>This section presents a survey of the state-of-the-art in ontological
representation of the epidemiological domain and an overview
of currently existing ontologies that, despite having been created
for other purposes, can be used to describe concepts relevant for
this field of research, such as diseases, modes of transmission,
demographics or geography. A summary of the considered
ontologies and the domains they represent is given in Table 4.1.</p>
      <p>As we are interested in covering the whole spectrum of
epidemiological domains, we have not defined a minimum number
of requirements to be fulfilled by NERO ontologies. In fact, not
all requirements are equally important. Instead, NERO includes the
most well-adjusted ontology for each domain, and for the topics
where we could not find ontologies of good quality, it fills the gap
with controlled vocabularies, such as taxonomies and dictionaries. It
is expectable that relevant ontologies will be developed in the future,
and given the modular nature of NERO, these could, when available,
easily replace the lower quality terminologies.
4.1</p>
      <p>
        Ontologies specific to the epidemiological domain
There have been two attempts at organizing epidemiological
terminologies in a hierarchical manner
        <xref ref-type="bibr" rid="ref17 ref6">(Frank et al., 2009; Lynch
et al., 2007)</xref>
        . These two works have resulted in published material
describing the ontologies, but neither points the reader to a place
where such ontologies can be downloaded or browsed.
      </p>
      <p>
        There has also been a number of automatic systems designed
to monitor epidemic surges. One example is the BioCaster Global
Health Monitor
        <xref ref-type="bibr" rid="ref1">(Collier et al., 2008)</xref>
        , a news filter created with
the aim of providing “an early warning monitoring station for
epidemic and environmental diseases”. BioCaster is based on an
ontology published in a standard format (OWL), allowing for an
easy integration in current semantic web technologies. It contains
approximately 2000 entities. While this number may be appropriate
for BioCaster purposes (text mining of news articles), it is poor as
a source of annotation concepts. For example, only five countries
appear in the ontology, and while there are a number of diseases
and syndromes, they are shallowly organized (diseases are instances
of Avian Disease, Human Disease or other similar classes, all of
which are direct subclasses of the concept Disease). Concepts of the
therapeutics domain are not well represented (the ontology contains
the concept therapeutic role, but no other in this area) and there is
no concept of vaccination. Overall, we observe that the majority of
concepts in this ontology is better represented in other ontologies.
      </p>
      <p>
        Another ontology built especially for epidemiological studies is
the Epidemiology Ontology, developed by HuGE NET
        <xref ref-type="bibr" rid="ref10 ref11">(Khoury
and Dorman, 1998; HuGE Net, 2007)</xref>
        . It is not as well structured
as the BioCaster ontology, as it consists of a single hierarchy of
terms related with each other by a single property type, leading
to Person being described under Hypothesis Formulation from
Descriptive Studies or Hospital under Notifiable disease. It contains
791 distinct concepts, some of which also appear in the Dictionary
of Epidemiology
        <xref ref-type="bibr" rid="ref19">(Porta, 2008)</xref>
        , a dictionary containing a detailed
list of concepts of the epidemiological field. Despite the alphabetic
organization and the absence of a hierarchy, each entry has a detailed
description of its meaning and some form of structure given in the
form of references to other entries. However, it is also poor in
quantity and ontological structure. Considering all the domains of
NERO, and given the low coverage of the Epidemiology Ontology
and the Dictionary of Epidemiology in domains such as geography
or diagnostic methods, we believe that they have limitations. Just
like BioCaster, however, they can help by providing a sense of which
domains NERO should represent.
4.2
      </p>
      <p>Other ontologies containing epidemiological
concepts
Given the low suitability of those resources for inclusion in NERO,
our focus moved to ontologies not built for epidemiology but
which, nonetheless, contain relevant epidemiological concepts. The
relevant domains were assumed to be the ones in need for the
EM metadata model, which agree with the domains of knowledge
represented in BioCaster, the Epidemiology ontology and the
Dictionary of Epidemiology, namely: demography, diagnostic
methods and other clinical methods, diseases, drugs, environment,
geographical location, socio-economic conditions, symptoms,
taxonomy, transmission modes and vaccination.</p>
      <p>
        Some research has been conducted in epidemiology based
on the use of existing ontologies containing epidemiologically
relevant concepts, but which were not designed with that
specific domain of knowledge in mind. This category includes
the Unified Medical Language System (UMLS), a “collection
of ontologies and terminologies that promote the creation of
more effective and interoperable biomedical information systems
and services”
        <xref ref-type="bibr" rid="ref13">(Lindberg et al., 1993)</xref>
        , and Medical Subject
Headings (MeSH), a controlled vocabulary used to index articles
in biomedical sciences
        <xref ref-type="bibr" rid="ref14">(Lipscomb, 2000)</xref>
        . These resources can be
seen as hierarchies of terms, where a term directly descends from
one or more terms, thus creating a graph-like structure.
      </p>
      <p>
        As an example, the work of
        <xref ref-type="bibr" rid="ref27">Xu et al. (2010)</xref>
        uses UMLS to mine
for epidemiologically relevant concepts in articles. While it could
prove useful in our endeavor, UMLS is a large resource, with over
one million concepts; properly scanning through this terminology
and determining the relevant concepts is too colossal a task for the
typical epidemic modeler.
      </p>
      <p>Additionally, MeSH is relatively unstructured and makes use of
a single relation (just like the Epidemiology Ontology presented
above). For example, Axial length and Eyebrow are categorized
under Eye, but one is a property and the other is a nearby structure.
Likewise, Eye is both categorized under Sense Organs and Face,
but while it is a sense organ, it is part of the face. MeSH makes no
distinction between these semantic relations, which we consider one
of the main drivers for the use of ontologies.</p>
      <p>
        There are other limitations with UMLS and MeSH: since they
have a generic and broad domain, the addition of new concepts
is non-trivial, and there is a high risk of introducing errors and
inconsistencies. In fact, it is known that UMLS houses many
inconsistencies
        <xref ref-type="bibr" rid="ref7">(Geller et al., 2009)</xref>
        . These two resources are not
Fulfills requirement #. . .
3 4 5 6 7 8
      </p>
      <p>10 In NERO?
Y
N
N
Y
N
Y
Y
Y
Y
Y
Y
Y
N
N
Y
Y
N</p>
      <p>Y
N
Y
Y
Y
Y
N
Y
Y
Y
Y
Y
N
Y
Y
Y
Y</p>
      <p>Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
N
N
Y
Y
N
N</p>
      <p>N
N
N
Y
Y
Y
Y
Y
N
Y
Y
N
Y
Y
Y
Y
Y
N
N</p>
      <p>Y
Y
Y
Y
N
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
9
N
N
N
Y
Y
N
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y</p>
      <p>N
N
N
N
N
N
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y</p>
      <p>No
Yes
No
No
Yes
No
Yes
No
No
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes</p>
      <p>Terminology
published in a standard semantic web format, meaning that they
do not integrate well with semantic web technologies. Moreover,
UMLS needs a license to be used.</p>
      <p>
        SNOMED-CT R , a subset of UMLS, was also considered
individually, since it is a comprehensive terminology for diseases
and other clinical terms
        <xref ref-type="bibr" rid="ref25">(Stearns et al., 2001)</xref>
        . Since this is a
terminology that needs a license to be used, it does not entirely
fit NERO’s purposes. Furthermore, its domains are (although
sometimes with less detail) represented in other ontologies (like
DOID, see Table 4.1).
      </p>
      <p>
        In face of these issues, we turned to attempts to create and
organize more formal ontologies in the biomedical field. OBO
should be highlighted, since it aims at providing a suite of
interoperable reference ontologies in the biomedical domain
        <xref ref-type="bibr" rid="ref24">(Smith
et al., 2007)</xref>
        . The OBO Foundry defines a set of principles that
must be fulfilled by an ontology before it is included. There are
currently eight OBO ontologies, but other candidates are presently
working to fulfill the required principles for being endorsed by
the OBO Foundry. Given that OBO’s set of principles enforces
good quality ontologies by promoting good practices in ontology
development, and that any one of these ontologies, both supported
and candidate, strives to fulfill those principles, we included some
of them in NERO (see Table 4.1). Because the ontologies of OBO
span over many biological and biomedical domains of knowledge,
these domains can thus be well covered in NERO.
      </p>
      <p>
        Non-biological concepts must be retrieved from other resources.
Yahoo! GeoPlanetTM
        <xref ref-type="bibr" rid="ref28">(Yahoo!, 2011)</xref>
        contains a representation of
the world geography, and is in fact a good candidate for inclusion
in NERO. Other geographical ontologies were considered, such
as GeoNames and Geo-Net-PT. GeoNames
        <xref ref-type="bibr" rid="ref8">(Geonames.org, 2011)</xref>
        is a flat dictionary of locations on Earth, lacking an ontological
structure. For instance, there is no relation between Italy and Rome
(its capital) or Italy and France (one of its neighbors).
Geo-NetPT
        <xref ref-type="bibr" rid="ref16">(Lopez-Pellicer et al., 2009)</xref>
        is an ontology of the Portuguese
territory and, despite being rich in detail, it covers a small scope
of the Earth. However, there are correspondences between Yahoo!
GeoplanetTM and Geo-Net-PT
        <xref ref-type="bibr" rid="ref5">(Ferreira et al., 2010)</xref>
        ; therefore, if a
more detailed annotation is required, Geo-Net-PT would be a good
complement in the area it covers.
      </p>
      <p>
        We have been unable to find ontologies that specifically represent
demography or social and economic conditions, and suspect that
none exist that are publicly available. As such, we will have to
rely on resources such as MeSH, the Epidemiology Ontology and
NCI Thesaurus for those domains. In this context, it is important to
mention that resources like the Dictionary of Epidemiology can be
curated in an ontological format (e.g., through triplification
        <xref ref-type="bibr" rid="ref2 ref20 ref9">(Hitzler
and van Harmelen, 2010)</xref>
        ), introducing semantics to its entries and
allowing the application of semantic web technologies to them.
      </p>
      <p>A graphical summary of this survey is shown on Table 4.1, which
details the requirements fulfilled by each of the ontologies found,
and which of them were included in NERO.
5</p>
    </sec>
    <sec id="sec-6">
      <title>CONCLUSION</title>
      <p>This paper proposes the Network of Epidemiology-Related
Ontologies (NERO), which aims at providing a core of relevant
concepts to semantically characterize epidemiological resources and
therefore enable the application of semantic technologies in the
epidemiological domain. NERO is being developed as part of the
Epidemic Marketplace platform (EM) to annotate its resources, but
can be further used by any epidemiologist or public health scientist.</p>
      <p>The choice of a network of ontologies was motivated by the
fact that existing epidemiology ontologies (BioCaster and the
Epidemiology Ontology) are not comprehensive enough to suitably
model the epidemiology domain. Nevertheless, they offer an
insight into what an epidemiological network of ontologies should
cover and how it should be organized, since they contain the
branches of knowledge required in epidemiology (diseases, modes
of transmission, locations, social conditions, etc.). By crossing this
information with the needs of the EM, we concluded that selected
ontologies from the OBO project complemented with branches of
MeSH and the Epidemiology Ontology are the most appropriate
terminologies for the biomedical portion of epidemiology, since
together they span over a large amount of the biomedical domain
on this area. Other resources, such as UMLS or SNOMED-CT R ,
are not as suitable due to their licensing, complexity, and difficulty
in integrating into a fully semantic web approach.</p>
      <p>For geographical information, we included the geographical
ontology of Yahoo! GeoPlanetTM, based on its higher quality when
compared to the other candidates. For the domains of demography
and social and economical conditions, the lack of any specific
ontologies prompted us to consider branches of MeSH and NCI
Thesaurus. Additionally, the Epidemiology Ontology has also
concepts in these domains.</p>
      <p>Once epidemiological resources are annotated with NERO, it
will be possible to exploit these annotations to perform complex
semantic analysis on diverse data processing tasks tasks, such as
information retrieval, integration and extraction. These tasks will
provide epidemiologists, particularly epidemiology modelers, with
tools that enable an easy discovery of models and the parameters
to use in them. The Epidemic Marketplace is currently being
developed with the intention of serving as a starting point for this
semantic analysis.</p>
      <p>Finally, it is worth noticing that, at the moment, NERO is little
more than a list of requirements and the identified set of ontologies.
As future work, we plan to completely integrate these ontologies in
a more tangible network. For instance, semi-automatic alignments
between the ontologies should produce pairs of equivalent concepts
that can be merged. The mapping of these ontologies into
upperdomain ones (such as BFO) should also contribute to a better
integration of all the ontologies. Eventually, we plan to introduce
other semantic web technologies that will make use of NERO, such
as RDF triple stores and SPARQL endpoints.</p>
    </sec>
    <sec id="sec-7">
      <title>ACKNOWLEDGEMENTS</title>
      <p>The authors want to thank the European Commission for the
financial support of the EPIWORK project under the Seventh
Framework Programme (Grant #231807), and the Portuguese
Fundac¸a˜o para a Cieˆncia e Tecnologia through the financial support
of the SOMER project (PTDC/EIA-EIA/119119/2010), the PhD
grants SFRH/BD/42481/2007 and SFRH/BD/69345/2010, and the
PIDDAC Program funds (INESCID multi annual funding) and
through the LASIGE multi annual support.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Collier</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Doan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kawazoe</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al. (
          <year>2008</year>
          ).
          <article-title>Biocaster: detecting public health rumors with a web-based text mining system</article-title>
          .
          <source>Bioinformatics</source>
          ,
          <volume>24</volume>
          (
          <issue>24</issue>
          ),
          <fpage>2940</fpage>
          -
          <lpage>2941</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Cowell</surname>
            ,
            <given-names>L. G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Infectious disease ontology</article-title>
          . In V. Sintchenko, editor,
          <source>Infectious Disease Informatics</source>
          , pages
          <fpage>373</fpage>
          -
          <lpage>395</lpage>
          . Springer New York.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>de Matos</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , Alca´ntara, R.,
          <string-name>
            <surname>Dekker</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al. (
          <year>2010</year>
          ).
          <article-title>Chemical Entities of Biological Interest: an update</article-title>
          .
          <source>Nucl. Acids Res</source>
          .,
          <volume>38</volume>
          ,
          <fpage>D249</fpage>
          -
          <lpage>D254</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>EnvO developers</surname>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>The envo project</article-title>
          . http://gensc.org/gc wiki/index.php/EnvO Project.
          <source>Accessed Jan 5</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Ferreira</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Batista</surname>
            ,
            <given-names>D. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Couto</surname>
            ,
            <given-names>F. M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Silva</surname>
            ,
            <given-names>M. J.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>The geo-netpt/yahoo! geoplanet (tm) concordance</article-title>
          .
          <source>Technical Report</source>
          <year>2010</year>
          ;5, Universidade de Lisboa, Faculdade de Cieˆncas. http://hdl.handle.net/10455/6677.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Frank</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wheaton</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bakalov</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cooley</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Wagener</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>An ontology for designing models of epidemics</article-title>
          .
          <source>In Proceedings of ICBO</source>
          , volume
          <year>2009</year>
          , pages
          <fpage>47</fpage>
          -
          <lpage>50</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Geller</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Morrey</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xu</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , et al. (
          <year>2009</year>
          ).
          <article-title>Comparing inconsistent relationship configurations indicating umls errors</article-title>
          .
          <source>In AMIA Annual Symposium Proceedings</source>
          , volume
          <year>2009</year>
          , page 193. American Medical Informatics Association.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          Geonames.org (
          <year>2011</year>
          ). Geonames. http://www.geonames.org/.
          <source>Accessed Dec 9</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Hitzler</surname>
          </string-name>
          , P. and
          <string-name>
            <surname>van Harmelen</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>A reasonable semantic web</article-title>
          .
          <source>Semantic Web</source>
          ,
          <volume>1</volume>
          (
          <issue>1</issue>
          ),
          <fpage>39</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>HuGE Net</surname>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Guidelines for the epidemiological ontology</article-title>
          . http://www.hugenet.org.uk/resources/informatics/Ontology Version 1.pdf.
          <source>Accessed Dec 16</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Khoury</surname>
            ,
            <given-names>M. J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Dorman</surname>
            ,
            <given-names>J. S.</given-names>
          </string-name>
          (
          <year>1998</year>
          ).
          <article-title>The human genome epidemiology network</article-title>
          .
          <source>American journal of epidemiology</source>
          ,
          <volume>148</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>3</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Koivunen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          -R. and
          <string-name>
            <surname>Miller</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>W3c semantic web activity</article-title>
          .
          <source>Semantic Web KickOff in Finland</source>
          , pages
          <fpage>27</fpage>
          -
          <lpage>41</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Lindberg</surname>
            ,
            <given-names>D. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Humphreys</surname>
            ,
            <given-names>B. L.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>McCray</surname>
            ,
            <given-names>A. T.</given-names>
          </string-name>
          (
          <year>1993</year>
          ).
          <article-title>The unified medical language system</article-title>
          .
          <source>Methods of information in Medicine</source>
          ,
          <volume>32</volume>
          (
          <issue>4</issue>
          ),
          <fpage>281</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Lipscomb</surname>
            ,
            <given-names>C. E.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Medical subject headings (mesh)</article-title>
          .
          <source>Bulletin of the Medical Library Association</source>
          ,
          <volume>88</volume>
          (
          <issue>3</issue>
          ),
          <fpage>265</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Lopes</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Silva</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Couto</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          , et al. (
          <year>2010</year>
          ).
          <article-title>Epidemic marketplace: an information management system for epidemiological data</article-title>
          .
          <source>Information Technology in Bio-and Medical Informatics</source>
          ,
          <string-name>
            <surname>ITBAM</surname>
          </string-name>
          <year>2010</year>
          , pages
          <fpage>31</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Lopez-Pellicer</surname>
            ,
            <given-names>F. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chaves</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rodrigues</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , and J.,
          <string-name>
            <surname>S. M.</surname>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Geographic ontologies production in grease-ii</article-title>
          .
          <source>Technical Report 09-18</source>
          , Universidade de Lisboa, Faculdade de Cieˆncas. http://hdl.handle.net/10455/3256.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Lynch</surname>
            ,
            <given-names>C. O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cunningham</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schripsema</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Morris</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Rhodes</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>A biosurveillance platform for biosense message analysis using integrated reference ontologies and intelligent agents</article-title>
          .
          <source>In AAAI Fall Symposium</source>
          , volume
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Osborne</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Flatow</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holko</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , et al. (
          <year>2009</year>
          ).
          <article-title>Annotating the human genome with disease ontology</article-title>
          .
          <source>BMC genomics</source>
          ,
          <volume>10</volume>
          (
          <issue>Suppl 1</issue>
          ),
          <fpage>S6</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Porta</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , editor (
          <year>2008</year>
          ).
          <article-title>A Dictionary of Epidemiology</article-title>
          . Oxford University Press, USA,
          <source>5th edition edition.</source>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Robinson</surname>
            ,
            <given-names>P. N.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Mundlos</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>The human phenotype ontology</article-title>
          .
          <source>Clinical genetics</source>
          ,
          <volume>77</volume>
          (
          <issue>6</issue>
          ),
          <fpage>525</fpage>
          -
          <lpage>534</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Schriml</surname>
            ,
            <given-names>L. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arze</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nadendla</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , et al. (
          <year>2010</year>
          ).
          <article-title>Gemina, genomic metadata for infectious agents, a geospatial surveillance pathogen database</article-title>
          .
          <source>Nucleic Acids Research</source>
          ,
          <volume>38</volume>
          (
          <issue>suppl 1</issue>
          ),
          <fpage>D754</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Shadbolt</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hall</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>The semantic web revisited</article-title>
          .
          <source>Intelligent Systems</source>
          , IEEE,
          <volume>21</volume>
          (
          <issue>3</issue>
          ),
          <fpage>96</fpage>
          -
          <lpage>101</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Sioutos</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coronado</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haber</surname>
            ,
            <given-names>M. W.</given-names>
          </string-name>
          , et al. (
          <year>2007</year>
          ).
          <article-title>Nci thesaurus: a semantic model integrating cancer-related clinical and molecular information</article-title>
          .
          <source>Journal of biomedical informatics</source>
          ,
          <volume>40</volume>
          (
          <issue>1</issue>
          ),
          <fpage>30</fpage>
          -
          <lpage>43</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ashburner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosse</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , et al. (
          <year>2007</year>
          ).
          <article-title>The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration</article-title>
          .
          <source>Nature biotechnology</source>
          ,
          <volume>25</volume>
          (
          <issue>11</issue>
          ),
          <fpage>1251</fpage>
          -
          <lpage>1255</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Stearns</surname>
            ,
            <given-names>M. Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Price</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Spackman</surname>
            ,
            <given-names>K. A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>A. Y.</given-names>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>Snomed clinical terms: overview of the development process and project status</article-title>
          .
          <source>In Proceedings of the AMIA Symposium, page 662</source>
          . American Medical Informatics Association.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <string-name>
            <surname>Wheeler</surname>
            ,
            <given-names>D. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barrett</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Benson</surname>
            ,
            <given-names>D. A.</given-names>
          </string-name>
          , et al. (
          <year>2007</year>
          ).
          <article-title>Database resources of the national center for biotechnology information</article-title>
          .
          <source>Nucleic acids research</source>
          ,
          <volume>35</volume>
          (
          <issue>suppl 1</issue>
          ),
          <fpage>D5</fpage>
          -
          <lpage>D12</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>Xu</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lu</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jiang</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , et al. (
          <year>2010</year>
          ).
          <article-title>Mining biomedical literature for terms related to epidemiologic exposures</article-title>
          .
          <source>In AMIA Annual Symposium Proceedings</source>
          , volume
          <year>2010</year>
          , page 897. American Medical Informatics Association.
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <string-name>
            <surname>Yahoo!</surname>
          </string-name>
          (
          <year>2011</year>
          ). Yahoo! geoplanetTM. http://developer.yahoo.com/geo/geoplanet/.
          <source>Accessed Dec 16</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sayers</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Protegen: a web-based protective antigen database and analysis system</article-title>
          .
          <source>Nucleic Acids Research</source>
          ,
          <volume>39</volume>
          (
          <issue>suppl 1</issue>
          ),
          <fpage>D1073</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>