<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Applying ontology design patterns to the implementation of relations in GENIA</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Robert Hoehndorf</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Axel-Cyrille Ngonga Ngomo</string-name>
          <email>ngonga@informatik.uni-leipzig.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sampo Pyysalo</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tomoko Ohta</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Anika Oellrich</string-name>
          <email>anika@ebi.ac.uk</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dietrich Rebholz-Schuhmann</string-name>
          <email>rebholz@ebi.ac.uk</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, University of Leipzig</institution>
          ,
          <addr-line>Leipzig</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Computer Science, University of Tokyo</institution>
          ,
          <addr-line>Tokyo</addr-line>
          ,
          <country country="JP">Japan</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Department of Genetics, University of Cambridge</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>European Bioinformatics Institute</institution>
          ,
          <addr-line>Hinxton, Cambridge</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <fpage>27</fpage>
      <lpage>35</lpage>
      <abstract>
        <p>Motivation: Annotated reference corpora such as the GENIA corpus play an important role in biomedical information extraction. A semantic annotation of the natural language texts in these reference corpora using formal ontologies and logic is challenging due to the ambiguous use of natural language and natural language semantics. Providing formal definitions and axioms for these relations would offer the means for developing consistent and verifiable annotation guidelines and allow for the automatic verification of annotations as well as enabling the discovery of new information through deductive inferences. Results: We developed a formal ontology of relations based on the relations used in the recent GENIA corpus annotations. For this purpose, we selected existing axiom systems based on the desired properties of the relations within the domain and provided new axioms for several relations. To apply this ontology of relations to the semantic annotation of natural language texts, we developed and implemented two ontology design patterns. We provide an implementation of the ontology of relations in the Web Ontology Language (OWL). By combining the implementation of the design patterns and that of the relation ontology, we also provide a software application to convert annotated GENIA abstracts into OWL ontologies. In this way, we make these ontologies amenable for automated verification, deductive inferences and other knowledge-based applications. Availability: Documentation, implementation and examples are available from http://www-tsujii.is.s.u-tokyo. ac.jp/GENIA/.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Background</title>
      <p>The goal of Information Extraction (IE) is to
recognize specific pieces of information in natural
language texts and to represent them in a structured
form that comprises meaningful associations of
relevant entities. For this reason, IE approaches
typically involve Named Entity Recognition (NER)
where mentions of specific types of “real-world”
entities, such as people or places, are detected in text.
To facilitate reliable biomedical IE, considerable
efforts have been made with regard to the development
of specialized NER methods for key domain entities,
focusing in particular on the recognition of gene and
gene product (GGP) mentions (1; 2; 3). As GGP
mentions can further be normalized to identify
specific entries in databases such as UniProt, they
provide a connection to entities relevant to biomolecular
research and thus a solid basis for domain IE.
However, in contrast to the well-defined meaning of the
basic entities, the semantics of their associations are
often only informally defined.</p>
      <p>
        In biomedical IE, extracted information is
frequently represented simply as untyped pairs of
entities representing, for instance, protein-protein or
gene-disease associations (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ). However, even
resources identifying protein-protein interactions as
entity pairs diverge considerably in their actual
annotations (
        <xref ref-type="bibr" rid="ref5">5</xref>
        ), leading to restrictions ranging from
usability to interpretability of both the annotations
and IE results. In response to the limitations of such
representations, there has recently been increased
interest in richer representations of extracted
information (
        <xref ref-type="bibr" rid="ref6">6</xref>
        ) and a number of corpora have been
published that annotate associations between entities
by using fine-grained types drawn from ontologies
(7; 8). Yet, no definition or axiomatization of these
relations has been proposed so far. Definitions and
axioms are necessary to make the meaning of the
relations explicit, and to provide the means for
developing consistent and verifiable annotation guidelines
allowing for the automatic detection of inconsistent
annotations, and enabling the discovery of new
information through deductive inferences. Here, our
aim is to define such relations and axioms for
fundamental relations such as part-of connecting GGPs to
referents of non-specific domain terms such as
promoter region. Annotations to these fundamental
relations to have been introduced recently (9; 10) to
the widely used GENIA corpus (
        <xref ref-type="bibr" rid="ref11">11</xref>
        ).
      </p>
      <p>1http://code.google.com/p/information-artifact-ontology/</p>
      <p>Providing formal definitions and axioms for these
relations is challenging because the annotations are
based on the use of the relations in text, where it
is generally not possible to enforce a common
understanding of terms. We present a formal
characterization of the relations used in GENIA
annotation based on two ontology design patterns. These
patterns are not restricted to GENIA and can be
applied in a wide number of domains, in particular
in ontology- and knowledge-based applications using
the categories of biological sequences, DNA, RNA or
proteins. We implement the developed formalisms in
OWL and provide a conversion software to represent
GENIA annotations in OWL.</p>
      <sec id="sec-1-1">
        <title>1.1 The GENIA corpus</title>
        <p>
          The GENIA corpus consists of 2,000 PubMed
abstracts annotated manually by biomedical domain
experts as a resource for the development and
evaluation of domain information extraction (IE)
methods. GENIA is one of the most widely used corpora
for biomedical IE and has served as the basis for
two shared tasks on named entity recognition (
          <xref ref-type="bibr" rid="ref1">1</xref>
          )
and event extraction (
          <xref ref-type="bibr" rid="ref6">6</xref>
          ). The corpus annotation
includes markup that identifies occurrences of domain
terms and named entities as well as statements of
events and relations involving them (8; 9; 11; 12).
        </p>
      </sec>
      <sec id="sec-1-2">
        <title>1.2 Formal ontology</title>
        <p>
          An ontology is the formal specification of a
conceptualization of a domain (
          <xref ref-type="bibr" rid="ref13">13</xref>
          ). A conceptualization
is a system of categories accounting for a
particular view on the world (
          <xref ref-type="bibr" rid="ref14">14</xref>
          ). Ontologies are used to
specify the meaning of terms within a vocabulary. A
basic ontological distinction is made between classes
and individuals (or particulars). A class is an entity
that can be predicated of other entities and that can
have instances. The instance-of relation links
instances to the class of which they are an instance.
Some instances may be classes themselves and have
further instances. An individual is an entity that
cannot be further instantiated (
          <xref ref-type="bibr" rid="ref15">15</xref>
          ).
        </p>
        <p>
          For the purpose of formalizing the relations
used in the GENIA corpus, we make use of
several biomedical domain ontologies: the Information
Artifact Ontology1 (IAO), the Sequence Ontology
(SO) (
          <xref ref-type="bibr" rid="ref16">16</xref>
          ), the Ontology of Biomedical Investigations
(OBI) (
          <xref ref-type="bibr" rid="ref17">17</xref>
          ), the Gene Ontology (GO) (
          <xref ref-type="bibr" rid="ref18">18</xref>
          ) and the
GENIA term ontology (
          <xref ref-type="bibr" rid="ref11">11</xref>
          ).
        </p>
      </sec>
      <sec id="sec-1-3">
        <title>1.3 Preliminaries of GENIA corpus annotation</title>
        <p>The first question we have to answer before we can
formalize relations used in corpus annotation is what
kind of entities are connected through these
relations. Our first observation is that relations in
corpus annotations are usually asserted between names
and other biomedical domain terms, i.e., between
strings that are identified as referring to some kind
of entity. For the purpose of this work, we assume
that these names denote one entity that can be
either a class or an individual.</p>
        <p>
          In some cases, there is ambiguity in
determining the referent of a name or domain term, i.e.,
certain terms may not refer to identical entities,
yet their referents are regarded as indistinguishable
within the context of a task such as the annotation
or recognition of named entities. Regarding certain
referents as indistinguishable can improve the
automatic extraction of relations and entities. The
indistinguishability assumption also allows the
definition of generic relations that hold between disjoint
categories. Through these means, the effort to
create annotation can be reduced, while the
applicability of the relations in different tasks and the
feasibility of automatic extraction can be maximized.
Within GENIA annotations (
          <xref ref-type="bibr" rid="ref12">12</xref>
          ), and the NER
systems based on it, genes and gene products are not
distinguished. Therefore, a basic precursor for our
work is an equivalence relation which states that,
within the context of a named entity annotation
task, two classes are considered to be
indistinguishable.
2
        </p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Results</title>
      <sec id="sec-2-1">
        <title>2.1 Equivalence</title>
        <p>Names or terms referring to either a class of genes,
DNA, proteins, RNAs and their splice variants, gene
products, arbitrary transcripts or similar are
considered to be equivalent within the context of the
GENIA relation annotations. These classes are called
genes/gene products (GGPs). For example, CD19,
CD19 protein and CD19 gene may be considered to
be equivalent and represent a single GGP.</p>
        <p>To provide a decidable implementation of our
formalization, and to facilitate automated queries,
verification and inferences, we provide a definition
of GGP-equivalence in OWL. We define a class GC
based on a class C, which is assumed to be a subclass
of DNA, and entities derived from C through chains
of transcription and translation relations between
individuals. The classes Protein, DNA and RNA are
those used in the GENIA term ontology.</p>
        <sec id="sec-2-1-1">
          <title>C ⊔ (RN A ⊓ ∃transcribedF rom.C)⊔</title>
          <p>
            (P rotein ⊓ ∃(translatedF rom◦
transcribedF rom).C) ⊑ GC
(
            <xref ref-type="bibr" rid="ref1">1</xref>
            )
Such a formalization has the benefit of connecting
the different kinds of GGPs through formal relations
that can be exploited by an automated reasoner.
          </p>
          <p>For example, the name “CD19 protein” refers to
a class of proteins, and instances of this class stand
in a translated-from relation to instances of a class
of RNA which may be referred to as “CD19 RNA”.
Instances of this class of RNA stand in a
transcribedfrom relation to instances of a class of DNA which
may be referred to as “CD19 gene”. Thus, according
to our definition, all three classes are subclasses of
the GGP class GCD19.</p>
        </sec>
      </sec>
      <sec id="sec-2-2">
        <title>2.2 Subclass</title>
        <p>
          The class-subclass relation is used to annotate the
relation between terms or names in the GENIA corpus
where one term refers to a more general class than
the other term. For example, this relation holds
between the names “CD19 human” (denoting the class
CD19 human) and “CD19” (denoting a class that is
indistinguishable from the class CD19 (GGP)). We
base the definition of the class-subclass relation upon
the ontological is-a relation (
          <xref ref-type="bibr" rid="ref19">19</xref>
          ): the classes C and
D stand in the is-a relation, if and only if, every
instance of C is also an instance of D.
        </p>
        <p>For example, the referent of the name “human
CD19 gene” (the class CD19 human gene) stands in
the is-a relation to the referent of the name “CD19”
(the GGP class CD19 (GGP)), because all instances
of CD19 human gene are also instances of CD19
(GGP).</p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3 Mereological relations</title>
        <p>The largest group of relations in the relationship
annotations of the GENIA corpus refers to
mereological relations, i.e., relations between parts and their
wholes. Three kinds of parthood relations are
distinguished within GENIA:
• relations between a whole and its components,
for example between the classes CD19
promoter and CD19,
• relations between a collection and its members,
as between Hox gene family and HOXA1,
• the relation between an entity and the location
at which this entity exists, such as CD19 which
is located at CD19 locus.</p>
        <p>Substantial work has already been undertaken with
regard to mereological relations and their
representation in OWL and biomedical ontologies (20; 21; 22).
In particular, the relation CC-part-of2, as a relation
between classes, must be defined in terms of another
relation II-part-of, which is a relation between
individuals (20; 23). For example, CC-part-of can be
defined as</p>
        <sec id="sec-2-3-1">
          <title>C ⊑ ∃partOf.D</title>
          <p>
            (
            <xref ref-type="bibr" rid="ref2">2</xref>
            )
Although such a definition is valid for many of the
parthood relations asserted between classes in
biological ontologies, it is an inadequate schema for
parthood relations which have a GGP class as
argument, because the GGP class is “too general”.
          </p>
          <p>However, as a GGP class has several
GGPequivalent subclasses, the CC-has-part and
CC-partof relations may be valid for one of these classes but
not for the others. For example, assuming the
definition of CC-has-part above, asserting a
CC-haspart relation between the GGP class CD19 (GGP)
and CD19 promoter would be incorrect, because
the GGP class will also include the CD19 protein
class, which has no promoter as part (in virtue
of being a class of proteins). Similarly, although
it would be correct to assert that CD19 promoter
CC-part-of CD19, it would be incorrect to say that
CD19 CC-part-of CD19/CD21/CD81/Leu-13
complex. If the two statements above would hold, we
could infer that CD19 promoter is CC-part-of the
CD19/CD21/CD81/Leu-13 complex, which is
incorrect because protein complexes have no promoters
as part.</p>
          <p>Consequently, we use the following alternative
definition for the GGP-subclass-has-part relation
(where the argument GC refers to a GGP class, and
X to an arbitrary class):</p>
          <p>GGP-subclass-has-part(GC , X) ⇐⇒
(GC ⊓ DN A ⊑ ∃II-hasPart.X) or
(GC ⊓ RN A ⊑ ∃II-hasPart.X) or
(GC ⊓ P rotein ⊑ ∃II-hasPart.X)</p>
          <p>
            (
            <xref ref-type="bibr" rid="ref3">3</xref>
            )
          </p>
          <p>In the OWL syntax, a disjunction of subclass
axioms is not permitted. Consequently, we have to
reformulate the right side of the definition by using
a single subclass axiom (where ⊥ refers to the OWL
class owl:Nothing) and derive the equivalent
definition:</p>
          <p>GGP-subclass-has-part(GC , X) ⇐⇒
(GC ⊓ DN A ⊓ ¬∃II-has-part.X)⊔
(GC ⊓ RN A ⊓ ¬∃II-has-part.X)⊔
(GC ⊓ P rotein ⊓ ¬∃II-has-part.X) ⊑ ⊥</p>
          <p>
            (
            <xref ref-type="bibr" rid="ref4">4</xref>
            )
Intuitively, this definition states that if the GGP
class GC stands in the GGP-subclass-has-part
relation to the class X, then either the DNA, RNA or
Protein subclass of GC must stand in a CC-has-part
relation to X. Using this pattern, we are further
able to define the relation GGP-subclass-part-of by
replacing II-has-part with II-part-of in definition 4.
          </p>
          <p>II-part-of is a primitive relation and we assert
axioms that hold for it. II-part-of is reflexive, transitive
and antisymmetric. We define II-proper-part-of:
II-proper-part-of(x, y) ⇐⇒ II-part-of(x, y)∧¬x = y</p>
          <p>
            (
            <xref ref-type="bibr" rid="ref5">5</xref>
            )
It is the II-proper-part-of relation which will provide
the basis for the mereological relations within the
GENIA, because identical (or co-extensional) classes
are not annotated as standing in a parthood relation.
          </p>
          <p>
            Parthood relations that are not based upon
location are further distinguished into two kinds in
the GENIA relation annotation: a relation between
components and the objects of which they are
components, and membership in collections. We assume
that the component-object relation (between
individuals) II-oc-part-of is similar to the relation of
determinate parthood (
            <xref ref-type="bibr" rid="ref21">21</xref>
            ) in that it is reflexive,
transitive, antisymmetric and satisfies the strong
supplementation principle (
            <xref ref-type="bibr" rid="ref22">22</xref>
            ). Assuming these axioms
for II-oc-part-of provides compatibility with the SO,
which also assumes the axioms of extensional
mereology for the entities classified by it (
            <xref ref-type="bibr" rid="ref16">16</xref>
            ).
          </p>
          <p>The member-component relation, on the other
hand, is a relation between entities of different kinds
and is neither reflexive nor antisymmetric (21; 24).</p>
          <p>
            The II-member-of relation is a sub-relation of the
II-proper-part-of relation and is non-reflexive,
asymmetric and non-transitive (
            <xref ref-type="bibr" rid="ref24">24</xref>
            ). II-member-of is not
the same relation as the member-of relation in the
          </p>
          <p>SO; in the SO, member-of is transitive, while
II2We generally prefix relations between two classes with CC-, and relations that hold between two individuals with II-. The
CC- type relations are not available in OWL but are defined using complex description logics statements and converted to
OWL using the software tool we provide.
member-of is non-transitive. The relation
GGPsubclass-member-of holds between a GGP class and
a collection, such that for one of the subclasses of
the GGP class, all instances are a member of some
instance of the collection. Therefore, the same
pattern as in definition 4 applies for the definition of
GGP-member-of.</p>
          <p>For example, the Lck (GGP) class stands in the
GGP-member-of relation to the protein family Src
family, because there is a subclass of Lck (GGP),
i.e., Lck protein, such that all instances of this
subclass (Lck protein) stand in an II-member-of relation
to some instances of Src family3.</p>
          <p>The third parthood relation used in the GENIA
corpus annotations is GGP-subclass-region-of, which
we define by using the primitive II-region-of relation.</p>
          <p>In the GENIA relation annotations,
GGP-subclassregion-of is used to relate a GGP class to a genomic
location. We introduce GGP-subclass-region-of to
relate the GGP class to the class of loci. The
region is a place where all instances of one subclass
of the GGP class are located. As for the definition
of GGP-subclass-has-part, GGP-subclass-part-of and
GGP-subclass-member-of, we assume that there is a
subclass of the GGP class for which all instances are
located in some instance of the locus, and we use the
same pattern as in formula 4.</p>
          <p>Next we define the interactions of II-region-of
with II-part-of. We want to be able to infer that
if the individual x is part of y, and y is located at z,
then x is located at z. Furthermore, if the individual
x is located at y and y is a part of z, then we infer
that x is located at z.</p>
          <p>
            II-part-of ◦ II-region-of ⊆ II-region-of
II-region-of ◦ II-part-of ⊆ II-region-of
(
            <xref ref-type="bibr" rid="ref6">6</xref>
            )
(
            <xref ref-type="bibr" rid="ref7">7</xref>
            )
          </p>
        </sec>
      </sec>
      <sec id="sec-2-4">
        <title>2.4 Objects and their variants</title>
        <p>The second major group of GENIA corpus relations
connects names of GGP classes to names of classes
of their variants. Again, we formalize the relations
that hold between the classes that are denoted by
these names.</p>
        <p>The GENIA annotations for GGP classes and
their variants use six different relations to express
the following relationships:
• GGPs to modified proteins, e.g., TR alpha 1</p>
        <p>(GGP) to 35S-TR alpha 1 (Protein),
• GGPs to protein isoforms, e.g., ACTA1
(Pro</p>
        <p>tein) to G-Actin (GGP),
• GGPs to mutants, e.g., TNFRI (GGP) to</p>
        <p>dominant-negative mutant TNFRI (Protein),
• GGPs to recombinants, e.g., Oct-2 (GGP) to</p>
        <p>Oct-2 expression vector (DNA),
• GGPs to precursors, e.g., IL-16 (GGP) to
pro</p>
        <p>IL-16 (Protein),
• GGPs to experimental material, in particular
to antisense elements, e.g., GATA-3 (GGP) to
antisense GATA-3 RNA (RNA).</p>
        <p>We will call the basic relation between a GGP
and its variant GGP-has-variant. There is a general
schema involved in the sub-relations of
GGP-hasvariant that we exploit in its definition: whenever
GGP-has-variant(GC , D), then every instance of D
is a variation of some instance of GC . Although it
is possible to identify a more specific subclass of GC
in some cases, this is not true for all sub-relations of
GGP-has-variant. We define the relation GC
GGPhas-variant D by using the relation II-has-variant,
which is a relation between individuals:</p>
        <p>D ⊑ ∃II-has-variant.GC</p>
        <p>
          (
          <xref ref-type="bibr" rid="ref8">8</xref>
          )
        </p>
        <p>Again, we provide basic axioms for the
II-hasvariant relation. Our first observation is that
variance is reflexive, i.e., everything (every molecule) is
a variant of itself. Furthermore, variance is
symmetric, i.e., if x is a variant of y, then y is a variant of x.</p>
        <p>Whether II-has-variant is transitive is more difficult
to ascertain. While it seems to be the case that, if
x is a variant of y and y a variant of z, then x is a
variant of z, this principle may fail if the distance
between x and z increases, i.e., more intermediate
variants are introduced. Consequently, we do not
assume that II-has-variant is transitive.</p>
        <p>To formalize a sub-relation of II-has-variant, e.g.,
II-has-isoform, we note domain and range of the
relation as well as basic axioms. In the definition of the
GGP relation, we must carefully consider whether
the relation holds between all instances of the GGP
class, or only one of its subclasses. For example, the
3We do not provide a formal characterization of protein family here, but re-use the class from the GENIA term ontology.
Arguably, protein families should not be classes but rather individual collections. If this approach is taken, protein family
classes can be defined using nominals as having exactly one instance: the individual collection that constitutes the protein
family.
definition of GGP-has-isoform between GC and D
is:</p>
        <p>GC ⊑ ∃II-has-isoform.D⊔
∃translates-into.∃II-has-isoform.D⊔
∃transcribes-into.∃translates-into.
∃II-has-isoform.D</p>
        <p>
          (
          <xref ref-type="bibr" rid="ref9">9</xref>
          )
The relations GGP-has-recombinant,
GGPhas-precursor and GGP-has-modified-protein
follow the same pattern.
        </p>
        <p>II-has-mutant is a relation between an instance
of a GGP class and a mutant of this instance. The
relation II-has-mutant is irreflexive and symmetric,
and consequently not transitive. The definition of
GC GGP-has-mutant D is as follows:</p>
        <p>GC ⊑ II-has-mutant.D</p>
        <p>
          (
          <xref ref-type="bibr" rid="ref10">10</xref>
          )
        </p>
        <p>
          II-has-experimental-material relates an instance
of a GGP class to experimental material such as an
antisense element. The formal characterization is
subject to future work and requires integration with
ontologies of experiments such as the Ontology of
Biomedical Investigations (OBI) (
          <xref ref-type="bibr" rid="ref17">17</xref>
          ).
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3 Implementation</title>
      <p>
        We provide an implementation which consists of two
parts. The first part covers the integration of the
basic axioms of relations between individuals into
an OWL ontology. It formalizes GENIA’s relation
ontology and provides the taxonomy of relations as
illustrated in figure 1. To be applicable for
automated inferences, we had to omit axioms pertaining
to reflexivity or symmetry from the OWL ontology,
as those are not permitted for non-primitive
properties (
        <xref ref-type="bibr" rid="ref25">25</xref>
        ). The OWL ontology contains the hierarchy
of relations and a single new OWL class, the class
GGP. Furthermore, to provide the definitions of the
relations, we also import the OWL versions of the
Sequence Ontology (SO) (
        <xref ref-type="bibr" rid="ref16">16</xref>
        ) and the GENIA term
ontology (
        <xref ref-type="bibr" rid="ref26">26</xref>
        ) so that we can refer to relations such
as transcribes-into from the SO, and to classes such
as DNA or Protein from the GENIA term ontology.
The second part provides a conversion from the
relations between names and terms that refer to classes
in OWL. It is a prototypical conversion tool that
translates annotated GENIA abstracts into an OWL
file based on the definitions we provide for GENIA’s
relationship annotations.
      </p>
      <p>The resulting OWL file is based on GENIA’s
relation ontology. The conversion tool implements the
ontology design patterns we have developed to define
relations that take a GGP class as an argument. The
conversion tool and examples of converted abstracts
can be found on the project website4.</p>
    </sec>
    <sec id="sec-4">
      <title>4 Discussion</title>
      <sec id="sec-4-1">
        <title>4.1 Related work</title>
        <p>
          The BioTop Ontology (
          <xref ref-type="bibr" rid="ref27">27</xref>
          ) is derived from the
GENIA term ontology and provides definitions and
axioms for the classes in the GENIA ontology.
Additionally, this ontology includes several relations.
        </p>
        <p>Some of these relations overlap with those used in
the GENIA relation annotation and in the relation
ontology, in particular the mereological relations.</p>
        <p>Yet, BioTop includes mostly the generic definitions
of mereological relations. Thus, BioTop’s
formalization of mereological relations cannot be used with
respect to GGP, as their axioms do not always hold
4http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/home/wiki.cgi?page=Relation+annotation
for GGPs as shown earlier. Furthermore, the BioTop
ontology does not include any of the variance
relations. As BioTop provides a rich axiom system for
the classes of the GENIA term ontology, we will aim
at integrating the BioTop ontology with the relation
ontology and the design patterns we provide in
future work.</p>
        <p>
          Another relevant ontology is the Gene Regulation
Ontology (GRO) (
          <xref ref-type="bibr" rid="ref28">28</xref>
          ), which is an ontology for the
domain of gene regulation. It provides axioms and
definitions for the classes DNA, RNA and protein.
        </p>
        <p>Furthermore, it establishes relations between these
classes. Therefore, it provides a means for a more
detailed specification of GGP classes. GRO does not
cover the relations formalized in this work. Rather,
it could be allow to provide a more fine-grained
definition of GGP classes if necessary.</p>
      </sec>
      <sec id="sec-4-2">
        <title>4.2 Applications in GENIA</title>
        <p>There are several applications of formalized relations
within the GENIA corpus:
• development of unambiguous annotator
guidelines,
• verification of annotations,
• inference of hidden knowledge and
• abductive reasoning, inductive logic
programming, rule learning.</p>
        <p>Firstly, the development of clear annotator
guidelines can be facilitated to increase
interannotator consistency through the provision of less
ambiguity. For this purpose, high expressivity is
necessary to specify the meanings of relationship terms
or other terms as precisely as possible. To proceed
towards the goal of unambiguous, formal guidelines
for corpus annotation, we used predicate logic for
the formalization, and additionally associated our
definitions and axioms with explanations in natural
language.</p>
        <p>Secondly, the axioms provide a means to verify
annotations. Such a verification is made possible
because axioms restrict the combinations of relations
and may lead to contradictions which are sometimes
automatically detectable. In particular, the OWL
implementation of both the axioms and the ontology
design patterns is amenable to automated reasoning
and can be used to detect inconsistencies.
Additionally, it is possible to draw inferences from the
asserted knowledge automatically. These inferences
can be used to verify whether or not erroneous
annotations have been asserted by identifying undesired
or false inferences. Moreover, automatic inferences
can be used to infer hidden or new knowledge.</p>
        <p>The conversion tool we provide converts
annotated GENIA abstracts into an OWL ontology. This
conversion is a form of ontology induction or
ontology generation. The resulting ontologies – each
covering a domain described within one abstract – can
be used for abductive or inductive logic
programming, rule learning or other knowledge-based
machine learning techniques.</p>
      </sec>
      <sec id="sec-4-3">
        <title>4.3 Ontology design patterns</title>
        <p>
          To provide definitions for the relations between
classes that are used in the GENIA corpus, we
developed two closely related ontology design patterns
(
          <xref ref-type="bibr" rid="ref29">29</xref>
          ). They are particularly suited for applications
in text mining where the exact referent of a term
cannot always be reliably determined. However, the
patterns could be useful in other domains and
applications as well.
        </p>
        <p>The first ontology design pattern is applicable
when a class C with the subclasses D1, ..., Dn stands
in a relation CC-R to a class E such that every
instance of at least one subclass of C stands in a
relation II-R to some instance of E. This pattern is
useful when one class cannot be entirely disambiguated,
and a superclass is used in a relation statement
instead. For example, GGP classes in GENIA are
primarily introduced because it is not always possible
– or reasonable – to disambiguate entirely whether
a term refers to DNA, RNA or Protein classes.
Instead, the GGP class is used in relation statements,
and the GGP class unifies the classes of DNA, RNA
and Protein. In many cases, the relation is only
relevant for the instances of one of the subclasses, e.g.
only the Proteins, such that some property or
relation applies to every instance of this subclass but
not to all the instances of the other subclasses.</p>
        <p>The specialized pattern for a relation
GGPsubclass-R is as follows:</p>
        <p>
          CC-R(GC , X) ⇐⇒ (GC ⊓ DN A ⊓ ¬∃II-R.X)⊔
(GC ⊓ RN A ⊓ ¬∃II-R.X)⊔
(GC ⊓ P rotein ⊓ ¬∃II-R.X) ⊑ ⊥
(
          <xref ref-type="bibr" rid="ref11">11</xref>
          )
The pattern in formula 11 can be further generalized,
as it still uses the classes DNA, RNA and Protein. In
terms of a class C with subclasses D1, ..., Dn whose
instances are standing in a relation II-R to some
instance of E, the pattern is formulated as follows
(where R is the relation between the two classes):
R(C, E) ⇐⇒ (C ⊓ D1 ⊓ ¬∃II-R.E) ⊔ ...⊔
(C ⊓ Dn ⊓ ¬∃II-R.E) ⊑ ⊥
(
          <xref ref-type="bibr" rid="ref12">12</xref>
          )
        </p>
        <p>
          The second ontology design pattern is derived
from the definitions of the has-variant relations. It
is applicable when every instance of a GGP class is
related by the relation II-S either to some instance
x of a class D, or to some individual which stands in
a combination of the relations T1, ..., Tm to x. The
general pattern is as follows:
S(GC , D) ⇐⇒ GC ⊑ ∃II-S.D ⊔ ∃II-S ◦ T1.D ⊔ ...⊔
∃II-S ◦ T1 ◦ ... ◦ Tm.D
(
          <xref ref-type="bibr" rid="ref13">13</xref>
          )
In general, it is possible to consider either an order
defined on the relations T1, ..., Tm or arbitrary
permutations. Intuitively, the pattern is used to state
that all instances of one general class (the GGP class
in the case of GGP annotations) stand in a relation
II-S to some instance of a class D or to any entity
reachable by a chain (or permutation) of the
relations T1, ..., Tm from any instance of this class.
        </p>
      </sec>
      <sec id="sec-4-4">
        <title>4.4 Future research</title>
        <p>
          Although the formalization of relationships used in
the GENIA annotation is itself valuable to provide a
means for automated inferences, verification and the
development of annotation guidelines, formalized
relations will be much more useful in combination with
a formal characterization of events (
          <xref ref-type="bibr" rid="ref8">8</xref>
          ). Events
include more dynamic entities such as the binding of a
molecule to a binding site. In conjunction with the
formalization of the relations, useful inferences can
be drawn. For example, from the assertion that a
class X binds Y which is a GGP-part-of Z, we would
be able to infer that X GGP-binds Y . However, a
formalization of the GENIA event annotations and
its interrelation are subject to future work.
Furthermore, an extensive evaluation of the utility of
the axioms and definitions for the verification of
annotations and the inference of hidden knowledge is
subject to future work. To support the detection
of complex annotation inconsistencies in the
evaluation, a formalization of the event annotations is
required in addition to the relation annotations.
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusions</title>
      <p>We present and discuss a formal ontology-based
characterization of the relations used for
annotating the GENIA corpus. The main challenge is the
ambiguity of the terms upon which the relations we
are interested in are based. These terms refer to one
of several ontological classes, and the definitions of
the relationships between two terms must reflect the
fact that only one of these classes may stand in some
relation to another class. To characterize these
phenomena formally, we introduce the notion of a GGP
class, which is an ontological class with subclasses
whose names are not distinguished within a certain
annotation task. In particular, the class is a common
superclass for classes of DNA, RNA and proteins,
and is intended to unify classes of genes and their
products (GGP stands for “gene/gene product”).</p>
      <p>To define relations that hold between a GGP
class and another class formally, we introduce two
ontology design patterns. The ontology design
patterns are general enough to be useful for other
domains and applications besides text mining,
although they are especially useful whenever it is not
possible – or not feasible – to determine the exact
class that stands in some relation to another class,
and a more general class is chosen in a relation
statement instead.</p>
      <p>We implement the axioms and definitions as well
as the ontology design patterns in a tool that
converts GENIA abstracts into OWL ontologies. These
OWL ontologies can be used subsequently to
answer queries, verify annotations or provide a basis
for knowledge-based machine learning techniques.</p>
      <p>Formalizing the relations used in the relationship
annotations of the GENIA corpus provides a
powerful means to verify the annotations, to use them for
knowledge-based machine learning techniques and
inferences, and to establish and communicate
unambiguous and precise annotation guidelines. However,
the relations that are used in the GENIA
annotations, and the axioms and definitions we provide for
them, are applicable and useful beyond GENIA, and
can be integrated in other ontology- or
knowledgebased resources such as ontologies of biological
sequences, RNA or proteins. Similarly, the ontology
design patterns we developed are useful not only in
defining the relations used in the GENIA corpus
annotations, but have an impact on other efforts to
annotate text corpora semantically, and can
additionally be used for defining relations between
ontological classes in general.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Kim</surname>
            <given-names>JD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ohta</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsuruoka</surname>
            <given-names>Y</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tateisi</surname>
            <given-names>Y</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Collier</surname>
            <given-names>N</given-names>
          </string-name>
          :
          <article-title>Introduction to the bio-entity recognition task at JNLPBA</article-title>
          .
          <source>In Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and its Applications</source>
          (JNLPBA)
          <year>2004</year>
          :
          <fpage>70</fpage>
          -
          <lpage>75</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Yeh</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Morgan</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Colosimo</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hirschman</surname>
            <given-names>L</given-names>
          </string-name>
          :
          <article-title>BioCreAtIvE Task 1A: gene mention finding evaluation</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2005</year>
          , 6(
          <issue>Suppl 1</issue>
          ):
          <fpage>S2</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Wilbur</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            <given-names>L</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tanabe</surname>
            <given-names>L</given-names>
          </string-name>
          :
          <article-title>BioCreative 2. Gene Mention Task</article-title>
          .
          <source>In Proceedings of Second BioCreative Challenge Evaluation Workshop</source>
          . Edited by Hirschman L,
          <string-name>
            <surname>Krallinger</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Valencia</surname>
            <given-names>A</given-names>
          </string-name>
          <year>2007</year>
          :
          <fpage>7</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Zweigenbaum</surname>
            <given-names>P</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Demner-Fushman</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yu</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cohen</surname>
            <given-names>KB</given-names>
          </string-name>
          :
          <article-title>Frontiers of biomedical text mining: current progress</article-title>
          .
          <source>Brief Bioinform</source>
          <year>2007</year>
          ,
          <volume>8</volume>
          (
          <issue>5</issue>
          ):
          <fpage>358</fpage>
          -
          <lpage>375</lpage>
          , [http://bib. oxfordjournals.org/cgi/content/abstract/8/5/358].
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Pyysalo</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Airola</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heimonen</surname>
            <given-names>J</given-names>
          </string-name>
          , Bjo¨rne
          <string-name>
            <given-names>J</given-names>
            ,
            <surname>Ginter</surname>
          </string-name>
          <string-name>
            <given-names>F</given-names>
            ,
            <surname>Salakoski</surname>
          </string-name>
          <string-name>
            <surname>T</surname>
          </string-name>
          :
          <article-title>Comparative analysis of five proteinprotein interaction corpora</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2008</year>
          , 9(
          <issue>Suppl 3</issue>
          ):
          <fpage>S6</fpage>
          , [http://www.biomedcentral.com/1471-2105/ 9/S3/S6].
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Kim</surname>
            <given-names>JD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ohta</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pyysalo</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kano</surname>
            <given-names>Y</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsujii</surname>
            <given-names>J</given-names>
          </string-name>
          :
          <article-title>Overview of BioNLP'09 Shared Task on Event Extraction</article-title>
          .
          <source>In Proceedings of the BioNLP 2009 Workshop Companion Volume for Shared Task</source>
          <year>2009</year>
          :
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Pyysalo</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ginter</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heimonen</surname>
            <given-names>J</given-names>
          </string-name>
          , Bjo¨rne
          <string-name>
            <given-names>J</given-names>
            ,
            <surname>Boberg</surname>
          </string-name>
          <string-name>
            <given-names>J</given-names>
            ,
            <surname>J¨arvinen</surname>
          </string-name>
          <string-name>
            <given-names>J</given-names>
            ,
            <surname>Salakoski</surname>
          </string-name>
          <string-name>
            <surname>T</surname>
          </string-name>
          :
          <article-title>BioInfer: a corpus for information extraction in the biomedical domain</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2007</year>
          , 8:
          <fpage>50</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Kim</surname>
            <given-names>JD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ohta</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsujii</surname>
            <given-names>J</given-names>
          </string-name>
          :
          <article-title>Corpus annotation for mining biomedical events from literature</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2008</year>
          ,
          <volume>9</volume>
          (
          <issue>10</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Pyysalo</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ohta</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            <given-names>JD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsujii</surname>
            <given-names>J</given-names>
          </string-name>
          :
          <article-title>Static Relations: a Piece in the Biomedical Information Extraction Puzzle</article-title>
          .
          <source>In Proceedings of the BioNLP 2009 Workshop, Association for Computational Linguistics</source>
          <year>2009</year>
          :
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Ohta</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sampo</surname>
            <given-names>P</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            <given-names>JD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsujii</surname>
            <given-names>J</given-names>
          </string-name>
          :
          <article-title>A Re-evaluation of Biomedical Named Entity - Term Relations</article-title>
          .
          <source>In Proceedings of the 3rd International Symposium on Languages in Biology and Medicine (LBM2009)</source>
          <year>2009</year>
          :
          <fpage>97</fpage>
          -
          <lpage>102</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Kim</surname>
            <given-names>JD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ohta</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tateisi</surname>
            <given-names>Y</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsujii</surname>
            <given-names>J</given-names>
          </string-name>
          :
          <article-title>GENIA corpusa semantically annotated corpus for bio-textmining</article-title>
          .
          <source>Bioinformatics</source>
          <year>2003</year>
          ,
          <volume>19</volume>
          (
          <issue>suppl 1</issue>
          ):
          <fpage>i180</fpage>
          -
          <lpage>182</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Ohta</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            <given-names>JD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pyysalo</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            <given-names>Y</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsujii</surname>
            <given-names>J</given-names>
          </string-name>
          :
          <string-name>
            <surname>Incorporating</surname>
            <given-names>GENETAG</given-names>
          </string-name>
          <article-title>-style annotation to GENIA corpus</article-title>
          .
          <source>In Proceedings of the BioNLP 2009 Workshop</source>
          <year>2009</year>
          :
          <fpage>106</fpage>
          -
          <lpage>107</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Gruber</surname>
            <given-names>TR</given-names>
          </string-name>
          :
          <article-title>Toward principles for the design of ontologies used for knowledge sharing</article-title>
          .
          <source>International Journal of Human-Computer Studies</source>
          <year>1995</year>
          ,
          <volume>43</volume>
          (
          <issue>5-6</issue>
          ), [http://dx.doi. org/10.1006/ijhc.
          <year>1995</year>
          .
          <volume>1081</volume>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Guarino</surname>
            <given-names>N</given-names>
          </string-name>
          :
          <article-title>Formal Ontology and Information Systems</article-title>
          .
          <source>In Formal Ontology in Information Systems: Proceedings of the First International Conference (FOIS'98)</source>
          , Trento, Italy,
          <fpage>6</fpage>
          -
          <lpage>8</lpage>
          June 1998, Volume
          <volume>46</volume>
          of Frontiers in
          <source>Artificial Intelligence and Applications</source>
          . Edited by
          <string-name>
            <surname>Guarino</surname>
            <given-names>N</given-names>
          </string-name>
          , Amsterdam: IOS Press 1998:
          <fpage>3</fpage>
          -
          <lpage>15</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Herre</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heller</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burek</surname>
            <given-names>P</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hoehndorf</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loebe</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Michalek H: General Formal Ontology (GFO) - A Foundational Ontology Integrating Objects</surname>
          </string-name>
          and
          <source>Processes [Version 1.0]. Onto-med report</source>
          , Research Group Ontologies in Medicine, Institute of Medical Informatics, Statistics and Epidemiology, University of Leipzig,
          <year>Leipzig 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Eilbeck</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewis</surname>
            <given-names>SE</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mungall</surname>
            <given-names>CJ</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yandell</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stein</surname>
            <given-names>L</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Durbin</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ashburner</surname>
            <given-names>M</given-names>
          </string-name>
          :
          <article-title>The Sequence Ontology: a tool for the unification of genome annotations</article-title>
          .
          <source>Genome Biol</source>
          <year>2005</year>
          ,
          <volume>6</volume>
          (
          <issue>5</issue>
          ), [http://dx.doi.org/10.1186/gb-2005-6-5-r44].
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Courtot</surname>
            <given-names>M</given-names>
          </string-name>
          , et al.:
          <article-title>The OWL of Biomedical Investigations</article-title>
          .
          <source>In OWLED</source>
          , Volume
          <volume>432</volume>
          <source>of CEUR Workshop Proceedings</source>
          . Edited by Dolbear C,
          <string-name>
            <surname>Ruttenberg</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            <given-names>U</given-names>
          </string-name>
          , CEUR-WS.org
          <year>2008</year>
          [http://www.bibsonomy.org/bibtex/ 27efede95690cf226301af45%f878b03b0/dblp].
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Ashburner</surname>
            <given-names>M</given-names>
          </string-name>
          , et al.:
          <article-title>Gene ontology: tool for the unification of biology</article-title>
          .
          <source>The Gene Ontology Consortium. Nat Genet</source>
          <year>2000</year>
          ,
          <volume>25</volume>
          :
          <fpage>25</fpage>
          -
          <lpage>29</lpage>
          , [http://dx.doi.org/10.1038/75556].
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Brachmann</surname>
            <given-names>RJ</given-names>
          </string-name>
          :
          <article-title>What IS-A Is and Isn't: An Analysis of Taxonomic Links in Semantic Networks</article-title>
          .
          <source>IEEE Computer</source>
          <year>1983</year>
          ,
          <volume>16</volume>
          (
          <issue>10</issue>
          ):
          <fpage>30</fpage>
          -
          <lpage>36</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Smith</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ceusters</surname>
            <given-names>W</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klagges</surname>
            <given-names>B</given-names>
          </string-name>
          , Ko¨hler
          <string-name>
            <given-names>J</given-names>
            ,
            <surname>Kumar</surname>
          </string-name>
          <string-name>
            <given-names>A</given-names>
            ,
            <surname>Lomax</surname>
          </string-name>
          <string-name>
            <given-names>J</given-names>
            ,
            <surname>Mungall</surname>
          </string-name>
          <string-name>
            <given-names>C</given-names>
            ,
            <surname>Neuhaus</surname>
          </string-name>
          <string-name>
            <given-names>F</given-names>
            ,
            <surname>Rector</surname>
          </string-name>
          <string-name>
            <given-names>AL</given-names>
            ,
            <surname>Rosse</surname>
          </string-name>
          <string-name>
            <surname>C</surname>
          </string-name>
          :
          <article-title>Relations in biomedical ontologies</article-title>
          .
          <source>Genome Biol</source>
          <year>2005</year>
          ,
          <volume>6</volume>
          (
          <issue>5</issue>
          ), [http://dx.doi.org/10.1186/gb-2005-6-5-r46].
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Rector</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rogers</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bittner</surname>
            <given-names>T</given-names>
          </string-name>
          :
          <article-title>Granularity, scale and collectivity: When size does and does not matter</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          <year>2006</year>
          ,
          <volume>39</volume>
          (
          <issue>3</issue>
          ):
          <fpage>333</fpage>
          -
          <lpage>349</lpage>
          , [http://dx.doi.org/10.1016/j.jbi.
          <year>2005</year>
          .
          <volume>08</volume>
          .010].
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Simons</surname>
            <given-names>PM</given-names>
          </string-name>
          :
          <article-title>Parts: a study in ontology</article-title>
          . Oxford University Press 1987.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Hoehndorf</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oellrich</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kelso</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>RebholzSchuhmann</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herre</surname>
            <given-names>H</given-names>
          </string-name>
          :
          <article-title>Relations as patterns: Bridging the gap between OBO and OWL</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2010</year>
          ,
          <volume>11</volume>
          :
          <fpage>441</fpage>
          +.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Wood</surname>
            <given-names>Z</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Galton</surname>
            <given-names>A</given-names>
          </string-name>
          :
          <article-title>A taxonomy of collective phenomena</article-title>
          .
          <source>Applied Ontology</source>
          <year>2009</year>
          ,
          <volume>4</volume>
          (
          <issue>3</issue>
          -4):
          <fpage>267</fpage>
          -
          <lpage>292</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25. OWL Working Group W: OWL 2
          <string-name>
            <given-names>Web</given-names>
            <surname>Ontology</surname>
          </string-name>
          <article-title>Language: Document Overview</article-title>
          .
          <source>W3C Recommendation 27 October</source>
          <year>2009</year>
          . [Available at http://www.w3.org/TR/owl2-overview/].
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Kim</surname>
            <given-names>JD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ohta</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tateisi</surname>
            <given-names>Y</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsujii</surname>
            <given-names>JI</given-names>
          </string-name>
          :
          <article-title>GENIA corpus - a semantically annotated corpus for biotextmining</article-title>
          .
          <source>In ISMB (Supplement of Bioinformatics)</source>
          <year>2003</year>
          :
          <fpage>180</fpage>
          -
          <lpage>182</lpage>
          , [http://bioinformatics.oupjournals.org/ cgi/content/abstract/1%9/suppl\ 1/i180?etoc].
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Schulz</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beisswanger</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wermter</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hahn</surname>
            <given-names>U</given-names>
          </string-name>
          :
          <article-title>Towards an Upper-Level Ontology for Molecular Biology</article-title>
          .
          <source>AMIA Annu Symp Proc</source>
          <year>2006</year>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Beisswanger</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            <given-names>V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rebholz-Schuhmann</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Splendiani</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dameron</surname>
            <given-names>O</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schulz</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hahn</surname>
            <given-names>U</given-names>
          </string-name>
          :
          <article-title>Gene Regulation Ontology (GRO): Design Principles and Use Cases</article-title>
          .
          <source>In MIE</source>
          <year>2008</year>
          :
          <fpage>9</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Aranguren</surname>
            <given-names>ME</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Antezana</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuiper</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            <given-names>R</given-names>
          </string-name>
          :
          <article-title>Ontology Design Patterns for bio-ontologies: a case study on the Cell Cycle Ontology</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2008</year>
          , 9(
          <issue>Suppl 5</issue>
          ):
          <fpage>S1</fpage>
          +.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>