<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Lexical Framework for Semantic Annotation of Positive and Negative Regulation Relations in Biomedical Pathways</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sine Zambach</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tine Lassen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Copenhagen Business School</institution>
          ,
          <addr-line>ISV, Dalgas Have 15, 2000 Frederiksberg</addr-line>
          ,
          <country country="DK">Denmark</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Roskilde University</institution>
          ,
          <addr-line>Computer Science,4000 Roskilde</addr-line>
          ,
          <country country="DK">Denmark</country>
        </aff>
      </contrib-group>
      <fpage>145</fpage>
      <lpage>150</lpage>
      <abstract>
        <p>Knowledge of regulation relations is widely applied by biomedical researchers in for example experiment design on regulatory pathways and in systems biology. In the work presented here, we analyze in total 28 verbs - and in dept 6 frequently used verbs denoting the regulation relations regulates, positively regulates and negatively regulates through corpus analysis. We propose a formal representation of the acquired knowledge as domain specific semantic frames and the semantic types of the relata of the resulting relationships. We suggest that the acquired knowledge patterns can be used to identify and reason over knowledge represented in texts from the biomedical domain.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Relations representing positive and negative
regulations are widely used in the biomedical domain in
systems biology for representation of pathway
relations, e.g. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In biomedical texts, verbs denoting
regulation relations are used quite frequently, and
for information retrieval tools, retrieval of gene-gene
regulations has been investigated more or less
detailed, cf e.g. [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ].
      </p>
      <p>For a more precise retrieval and representation
of regulation relations, however, a deeper analysis of
the semantics of the different verbs denoting
regulation relations can be useful. The knowledge that
is acquired from such an analysis can be translated
into textual knowledge patterns, or semantic frames,
similar to those in the lexical resources FrameNet
and VerbNet.</p>
      <p>
        BioFrameNet [
        <xref ref-type="bibr" rid="ref4 ref5">4, 5</xref>
        ] is a domain-specific
extension to FrameNet [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], which is currently being
developed. BioFrameNet is concerned with ’intracellular
protein transport’, and is augmented with
domainspecific semantic relations and links to biomedical
ontologies. It uses Frame semantics [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] to annotate
the meaning of natural language texts, where the
frames are expressed in the Description Logic
variant of OWL which facilitates inference on knowledge
found in texts.
      </p>
      <p>
        In another related work focusing on regulation,
[
        <xref ref-type="bibr" rid="ref8 ref9">8,9</xref>
        ], a total of 314 abstracts are manually inspected
for regulates-relations and ranked patterns of the
form e.g. [Agent] V-active [Patient Action-NN]
produced. In addition, “trigger” words concerning
regulation from categories of the GRO-ontology [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
are manually identified.
      </p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], an approach to indexing biomedical texts
by their conceptual content using ontologies,
lexicosyntactic information and semantic role assignment
provided by lexical resources is presented. In this
approach, the conceptual content of texts is
transformed into conceptual feature structures where
synonymous but linguistically distinct expressions are
given identical representations. This allows for a
content-based search which can be useful for
document retrieval.
      </p>
      <p>
        Our aim is to develop a formal semantics of the
regulates relation developed from [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], based on a
corpus analysis of selected verbs denoting types of
’regulation’ within a comparable frame of textual
knowledge patterns similar to [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] and [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] as well
as an ontological analysis.
      </p>
      <p>
        Additionally, the focus on agent-patient roles in
regulation can support reasoning over additional
extracted events as suggested by [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Corpus Analysis</title>
      <p>In this section, we describe the corpus analysis that
is a means of identifying the lexico-syntactic patterns
that exist for regulatory verbs and their arguments
in biomedical texts. These analyses are the basis for
a bio-extension of the semantic frames as presented
in section 3.</p>
      <p>In order to categorize the different types of
regulation relations other than through the isa-relation
hierarchy in which positive and negative regulations
are specializations of regulation, cf. figure 1, we
analyze a corpus compiled of biomedical texts or,
more specifically, a collection of PubMed abstracts.
Through this analysis, we have identified four
general types of regulations patterns as outlined below.</p>
      <p>Verbs denoting regulation, negative regulation
and positive regulation have a somewhat different
usage in biomedical texts than they do in general
language texts. In order to identify this usage, we
created a concordance of all occurrences for a selection
of regulatory verbs in a corpus consisting of 40.000
PubMed abstracts. Our search covered the
specific verb forms “regulates” (323 occurences)
(denoting regulation), “inhibits” (781 occurences)
(denoting negative regulation), “reduces” (699 occurences)
(denoting negative regulation), “decreases” (1119
occurences) (denoting negative regulation), “increases”
(3171 occurences) (denoting positive regulation), and
“stimulates” (372 occurences)(denoting positive
regulation).</p>
      <p>By examining the concordances for these verb
forms, we can classify the usage of the examined
verbs with respect to types of arguments into four
general frame types or patterns (analyzed further in
section 3.1). In the patterns presented below,
arguments may be of the type processes or substances.
Substances can for example be gene products (e.g.
proteins and functional rna) or small molecules and
processes can for example be glucagon release or
glucose transport.</p>
      <p>
        A majority of the identified frame parts are
overlapping with the ones identified in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], however two
additional frame parts were identified through our
analysis (italicized). The notation form for the frame
parts presented below is equal to the one used in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
Substances regulate processes. This pattern covers
roughly 80% of the occurences of the examined
verbs. Example: “...glp-1 inhibits glucagon
release...” . This correlates with the frame parts in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
having the forms:
[Patient
[Agent]
[Agent] V-active [Patient Action-NN]
[Patient Action-NN ] V-passive [Agent]
[Agent] is required/essential/involved
[Patient Action-NN]
in
[Action-NN ’of’ Patient] by [Agent]
[Patient Action-NN] V-active [Agent]
      </p>
      <p>Action-NN] V-active caused by</p>
      <sec id="sec-2-1">
        <title>Substances regulate substances. This pattern covers</title>
        <p>
          roughly 10% of the occurences of the examined
verbs. For this pattern, the regulated substances
are most frequently enzymes. Example:“...lithium
inhibits the enzyme glycogen synthase kinase-3...”, .
In terms of [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], the frame parts would be:
[Agent]-Action-JJ [Patient]
[Agent] V-active [Patient] (added)
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>Processes regulate processes. This pattern also cov</title>
        <p>
          ers roughly 10% of the occurences of the examined
verbs. Example: “...nitric oxide pathway regulates
pulmonary vascular tone...” . In terms of [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], the
frame parts for this pattern would be:
[Agent Action-NN] V-active cause [Patient
Action-NN]
[Agent Action-NN] V-active [Patient
ActionNN] (added)
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>Processes regulate substances. This pattern covers</title>
        <p>a minor part of the occurences of the examined
verbs. Very few examples of this pattern were found,
only in the analysis of the verb regulates. Example:
“...Proximal tubular dopamine production regulates
basolateral Na-K-ATPase ...”.</p>
        <p>
          Thus, not many textual instances of regulations
have a process on their left hand side, i.e. present
the patterns processes regulate substances or
processes regulate processes, but the vast majority of
our examples present a pattern where a substance
regulates a substance/process. Normally, when
regulation relations are represented in biochemical
interaction webs such as KEGG [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ], they are marked
from substance to substance, e.g. “PP1 stimulates
GYS” (two gene products). This wording, however,
does not reflect the fact that most often the
statement is really: “PP1 stimulates the production of
GYS”.
        </p>
        <p>
          The over-representation of the pattern substances
regulate processes is also reflected in the number of
text patterns found. For example, in [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], 13 patterns
are found of which at least 7 are of this form. A
semantic discussion of this is given in section 3
        </p>
        <p>In an extended corpus analysis as well as
framecomparison from the resources of FrameNet,
VerbNet and WordNet, we notice that some of the verbs
representing regulatory relations exhibit a deviant
behaviour compared to the identified frame parts.
For example, the verbs “increase” and “decrease”
often appear in a passive or nominal form, and in these
cases, they do not have an expressed agent. We must
thus add frame parts such as [ Patient Action-NN]
V-passive and NN ’in’ [ Patient Action-NN]. This
type of linguistic knowledge is important for the
outcome of the semantic annotation and eventually for
a reasoning over the extracted knowledge.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Semantics of Regulation Relations</title>
      <p>The results of the corpus analysis as presented in
section 2, can be viewed as an extensional definition
of regulation relations. However, to be able to
perform a reliable semantic annotation of text, there is
a need for an understanding of the intensional side
of the relations.</p>
      <sec id="sec-3-1">
        <title>3.1 Ontological Types of the Relata</title>
        <p>
          Here, we discuss the connection between the
patterns presented in section 2 and the intensional
descriptions of the relations as it is described in [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
        </p>
        <p>Though the proposed transformations are purely
formal, they can be useful for a reasoning process as
well as for a foundation for a semantic annotation.</p>
        <p>
          In line with [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], we distinguish between
ontological types from a top-level ontology, however, we use
types from the domain specific top-level ontology of
UMLS, the Semantic Network [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. By using the
Semantic Network as our top-ontology, it is possible to
identify the ontological types of terms present in the
text.
        </p>
        <p>This means that the abovementioned knowledge
patterns can be processed such that the semantic
constraint, Substances inhibit processes, can be
incorporated into the knowledge patterns using
concepts from the Semantic Network. For example,
“Substance(T167)” is a type, having subtypes such
as “Amino Acid Peptide or Protein” and
“Chemical”. Additionally, “Phenomenon or Process(T067)”
is type representing “process” having subevents like
“Physiologic Function” and “Cell-function”.</p>
        <p>Since all concepts in the individual
UMLSresources have a direct link into the Semantic
Network, this method will make it possible to capture
the ontological types of a large number of domain
specific terms. The understanding of the main types
are as follows:</p>
        <p>
          Substances are, like for instance “continuants” in
BFO [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ], entities that continue to exists over time
and which may undergo changes, contrary to
“processes” which are subtypes of “events”. Substances
are entities that can change and such changes are
processes. An example of a substance in our domain,
could be an amount of insulin, whereas glycogenesis
is a process.
        </p>
        <p>Substances can regulate other substances or
processes, but processes can also regulate other
processes or substances. Focusing on for example the
relation regulates there are therefore four
possible relations among individuals combining the two
types of relata substance and process,
corresponding to the four general patterns given in section 2.
We name these relations regulatesss, regulatessp,
regulatesps, and regulatespp, where the subscript
“ss” means that it is a relation that can only exist
between two substances, “sp” means that it is a
relation that can only exist between a substance and
a process,“ps” means that it is a relation that can
Regulation
FN.Objective_inuence,BFN.Regulation
regulate
a€ect
inuence
Positive Regulation
Negative Regulation
Activation Stimulation
FN.Encoding,FN.cause_to_start,FN.Initially_create FN.Cause_change_on_position_of_a_scale
encode
express
produce
generate
activate
start
(Increase)</p>
        <p>Increase
amplify
stimulate
promote
elevate
induce
facilitate</p>
        <p>Irreversible inhibition
FN.Removing
eliminate
remove
delete
abolish
(Decrease)
FN.Change_on_position_of_a_scale</p>
        <p>Reversible inhibition
FN.Hindering,FN.Eclipse,
FN.Cause_change_on_position_of_a_scale
reduce
inhibits
decrease
block
limit
suppress
attenuate
Inactivate
only exist between a process and a substance, and
finally, “pp” means that it is a relation that can only
exist between two processes given in section 2.</p>
        <p>We can formalize the four general types of
patterns discussed in section 2. We use s, s1, s2, . . . to
range over substances, and p, p1, p2, . . . to range over
processes.</p>
        <p>Substances regulate substances</p>
        <p>⇒ s1 regulatesss s2
Substances regulate processes</p>
        <p>⇒ s regulatessp p
Processes regulate substances</p>
        <p>⇒ p regulatesps s
Processes regulate processes</p>
        <p>
          ⇒ p1 regulatespp p2
However, introducing a “production of” and a
“output of” operator as proposed in [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], makes it
possible to reduce these four relations to one, namely
regulatessp, as shown in the transformations
below.
        </p>
        <p>The “production of” operator works on a
substance s by transforming it to the process that
produces s. Similarly the “output of” operator
transforms a process p to the substance that is the
output of p. With these operators, the instance
relations regulatesss, regulatesps, regulatespp and
regulatessp can be transformed into one, namely
the regulatessp relation. These transformations are
given below
s1 regulatesss s2</p>
        <p>⇒ s1 regulatessp production of (s2)
s regulatessp p</p>
        <p>⇒ s regulatessp p
p regulatesps s</p>
        <p>⇒ output of (p) regulatessp production of (s)
p1 regulatespp p2</p>
        <p>⇒ output of (p1) regulatessp p2
Additionally, we note that the pattern
s1 regulatessp f unction of (s2) denoting a slightly
different meaning, namely a regulation by a
substance of the function of an enzyme (or another
substance), frequently occurs. The specific lexical
patterns representing this relation are for example
the expressions:
[Agent]V − active[Patientactivity/function]
[Agent]V − active[activity/function of Patient]
Similarily,
the
production of -operator
in
s1 regulatessp production of (s2), has the
expressions:
[Agent]V − active[Patientproduction/secretion/
transcription/expression/synthesis/release]
[Agent]V − active[(the) synthesis/production/
secretion/expression/transcription/release
of Patient]
These identified specific lexical patterns expressing
the patient, can be of use for extraction of
knowledge regarding the pattern for later reasoning as
presented briefly earlier in this section.</p>
        <p>Reasoning over Knowledge Patterns
These transformations reflect the underlying
semantics of verbs denoting regulates relations in
biomedical texts. For example, the verb
stimulate has a usage where it denotes the relation
positively regulates1: “Insulin stimulatesss
glycogen”, “insulin stimulatessp the glycogenesis”, and
“insulin stimulatessp the production of glycogen
(through the glygoneonesis)” where the process
glycogenesis is equal to “the production of
glycogen”. Likewise, we can construct the sentences:
“beta cell secretion stimulatespp glycogenes” that
can be transformed to “outout of beta cell
secretion stimulatessp production of glycogen”, where
the output of beta cell secretion is insulin.</p>
        <p>It may be argued that the relations regulatesps
and regulatespp are not genuine relations since we
can question whether it is at all possible for processes
to stimulate other processes or substances directly
or whether it is rather through their outputs they
stimulates.</p>
        <p>However, as part of our aim is to be able to
identify and annotate instances of regulations in texts, it
is important to include the patterns that cover the
forms as they actually occur in biomedical texts, and
not only as we know them to function. In this cross
field between form and meaning, it may be possible
both to grab meaningful contents from texts through
the semantic roles (e.g. agent and patient) of the
relata.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4 Conclusions</title>
      <p>
        In this work we have performed a preliminary
investigation of a subset of English verbs denoting
regu1This example is also used in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
lation relations, and given a more formal account of
these relations. We have investigated concordances
for 6 verbs; 1 verb denoting regulation, 2 verbs
denoting positive regulation and 3 verbs denoting negative
regulation, and identified additional textual
knowledge patterns compared to former work and the
lexical resources FrameNet, WordNet and VerbNet.
      </p>
      <p>In order to achieve a deeper knowledge about
the semantics of the studied relations, we initially
mapped the relata of the relations into the UMLS
Semantic Network. Second we grouped the different
verbs denoting regulates relations and their
corresponding text-patterns into four different types
corresponding to the types of their relata.</p>
      <p>Finally, we gave a formal description of the four
observed types of regulation relations and
transformed these into one. Using the operators
“production of”, “output of”, and “function of”, the four
observed types of regulation relations, regulatesss,
regulatessp, regulatesps, and regulatespp, can be
transformed into one, namely the regulatessp
relation.</p>
      <p>We stress the importance of identifying textual
forms of the relations as knowlege patterns as they
actually occur in biomedical texts, even if we know
that a given pattern does not reflect how regulations
function in reality as we know them to function.</p>
      <p>
        The semantic patterns that are identified
through our corpus analysis, can form a background
for further knowledge extraction, where for
example text is automatically annotated by use of the
patterns and subsequently fed to a machine
learning algorithm for identification of new patterns (in
line with [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]). This could be a part of an automatic
semantic annotation for semantic based information
retrieval. The semantic roles that are gained by such
an attempt, should be precise enough for being part
of a knowledge base that can be enriched with
reasoning rules.
      </p>
      <p>
        Additionally, through a deeper linguistic
analysis, these parts can be part of the basis for a domain
specific FrameNet describing regulatory events (an
extended BioFrameNet in line with the vision of [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]).
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Kanehisa</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goto</surname>
            <given-names>S</given-names>
          </string-name>
          : KEGG:
          <article-title>Kyoto Encyclopedia of Genes and Genomes</article-title>
          .
          <source>Nucleic Acids Res</source>
          .
          <year>2000</year>
          ,
          <volume>28</volume>
          :
          <fpage>27</fpage>
          -
          <lpage>30</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Chen</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sharp</surname>
            <given-names>BM</given-names>
          </string-name>
          :
          <article-title>Content-rich biological network constructed by mining PubMed abstracts</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2004</year>
          , 5:
          <fpage>147</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Hoffmann</surname>
            <given-names>R</given-names>
          </string-name>
          :
          <article-title>Using the iHOP information resource to mine the biomedical literature on genes, proteins, and chemical compounds</article-title>
          .
          <source>Curr Protoc Bioinformatics</source>
          <year>2007</year>
          , Chapter 1:
          <fpage>Unit1</fpage>
          .
          <fpage>16</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Dolbey</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ellsworth</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Scheffczyk</surname>
            <given-names>J</given-names>
          </string-name>
          :
          <article-title>Bioframenet: A domain-specific framenet extension with links to biomedical ontologies</article-title>
          .
          <source>Proceedings of KR-MED</source>
          <year>2006</year>
          , :
          <fpage>87</fpage>
          -
          <lpage>94</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Dolbey</surname>
            <given-names>AE</given-names>
          </string-name>
          :
          <article-title>BioFrameNet: a FrameNet Extension to the Domain of Molecular Biology</article-title>
          .
          <source>PhD thesis</source>
          , University of California, Berkeley
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Fillmore</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnson</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Petruck</surname>
            <given-names>M</given-names>
          </string-name>
          : Background to Framenet.
          <source>International Journal of Lexicography September</source>
          <year>2003</year>
          ,
          <volume>16</volume>
          :
          <fpage>235</fpage>
          -
          <lpage>250</lpage>
          (
          <issue>16</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Fillmore</surname>
            <given-names>CJ</given-names>
          </string-name>
          :
          <article-title>Frame semantics and the nature of language. In Origins and evolution of language and speech</article-title>
          .
          <source>Edited by Harnad S, Academy of Sciences</source>
          <year>1976</year>
          :
          <fpage>155</fpage>
          -
          <lpage>202</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Buyko</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beisswanger</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hahn</surname>
            <given-names>U</given-names>
          </string-name>
          :
          <article-title>Testing Different ACE-Style Feature Sets for the Extraction of Gene Regulation Relations from MEDLINE Abstracts</article-title>
          .
          <source>In Proceedings of the Third International Symposium on Semantic Mining in Biomedicine (SMBM</source>
          <year>2008</year>
          ), Turku, Finland. Edited by Salakoski T,
          <string-name>
            <surname>RebholzSchuhmann</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pyysalo</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <article-title>Turku Centre for Computer Science</article-title>
          (TUCS)
          <year>2008</year>
          :
          <fpage>21</fpage>
          -
          <lpage>28</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Hahn</surname>
            <given-names>U</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tomanek</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buyko</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            <given-names>Jj</given-names>
          </string-name>
          ,
          <string-name>
            <surname>RebholzSchuhmann D</surname>
          </string-name>
          :
          <article-title>How feasible and robust is the automatic extraction of gene regulation events?: a cross-method evaluation under lab and real-life conditions</article-title>
          .
          <source>In BioNLP '09: Proceedings of the Workshop on BioNLP</source>
          , Morristown, NJ, USA: Association for Computational
          <source>Linguistics</source>
          <year>2009</year>
          :
          <fpage>37</fpage>
          -
          <lpage>45</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Beisswanger</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            <given-names>V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            <given-names>JJ</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rebholz-Schuhmann</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Splendiani</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dameron</surname>
            <given-names>O</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schulz</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hahn</surname>
            <given-names>U</given-names>
          </string-name>
          :
          <article-title>Gene Regulation Ontology (GRO): design principles and use cases</article-title>
          .
          <source>Stud Health Technol Inform</source>
          <year>2008</year>
          ,
          <volume>136</volume>
          (NIL):
          <fpage>9</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>T</given-names>
            <surname>Andreasen PAJ H Bulskov</surname>
            , Lassen
          </string-name>
          <string-name>
            <surname>T</surname>
          </string-name>
          :
          <article-title>Conceptual Indexing of Text Using Ontologies and Lexical Resources</article-title>
          .
          <source>In Proceedings of the Eigth International Conference on Flexible Query Answering Systems</source>
          , Springer 2009.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Zambach</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hansen</surname>
            <given-names>J</given-names>
          </string-name>
          :
          <article-title>Logical knowledge representation of regulatory relations in biomedical pathways</article-title>
          .
          <source>In Proceedings of ITBAM-DEXA, Lecture Notes in Computer Science</source>
          , Springer,
          <string-name>
            <surname>LNCS</surname>
          </string-name>
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Zambach</surname>
            <given-names>S</given-names>
          </string-name>
          :
          <article-title>A formal framework on the semantics of regulatory relations and their presence as verbs in biomedical texts</article-title>
          .
          <source>In Proceedings of the Eigth International Conference on Flexible Query Answering Systems, Lecture Notes in Computer Science</source>
          , Springer
          <year>2009</year>
          :
          <fpage>443</fpage>
          -
          <lpage>452</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Smith</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ceusters</surname>
            <given-names>W</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klagges</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ko hler</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kumar</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomax</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mungall</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Neuhaus</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rector</surname>
            <given-names>AL</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosse</surname>
            <given-names>C</given-names>
          </string-name>
          :
          <article-title>Relations in biomedical ontologies</article-title>
          .
          <source>Genome Biol</source>
          .
          <year>2005</year>
          ,
          <volume>6</volume>
          :
          <fpage>R46</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Mccray</surname>
            <given-names>AT</given-names>
          </string-name>
          :
          <article-title>An Upper-Level Ontology for the Biomedical Domain</article-title>
          .
          <source>Comp Funct Genom</source>
          <year>2003</year>
          ,
          <volume>9</volume>
          (
          <issue>4</issue>
          ):
          <fpage>80</fpage>
          -
          <lpage>4</lpage>
          , [http://citeseer.ist.psu.edu/706880.html;http: //lhncbc.nlm.nih.gov:80/lhc/docs/published/2003/ pub2003023.pdf].
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>16. Basic Formal Ontology.[http://ontology.buffalo.edu/ bfo/].</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>