<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Semi-Automated Semantic Annotation of the Biomedical Literature</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Computational Linguistics, University of Zurich</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>s, in order to present a richer view of the existing literature.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
    </sec>
    <sec id="sec-2">
      <title>Methods</title>
      <p>The Ontogene system is based on a pipeline architecture (see gure 1), which includes, among
others, modules for entity recognition and relation extraction. Some of the modules are rule-based
(e.g. lexical lookup with variants) while others use machine-learning approaches (e.g. maximum
entropy techniques). The initial step consists in the annotation of names of relevant domain entities in
biomedical literature (currently the system considers proteins, genes, species, experimental
methods, cell lines, chemicals, drugs and diseases). These names are sourced from reference databases
and are associated with their unique identi ers in those databases, thus allowing resolution of
synonyms and cross-linking among di erent resources.</p>
      <p>One of the problems with sourcing resources
from several databases is the possible
inconsistencies among them. The fact that domain knowledge
BioC XML input is scattered across dozens of data sources,
occa# sionally also with some incompatibilities among
(0) Wait request / validate BioC them, is a severe problem in the life sciences.
Ide# ally these resources should be integrated in a
sin(1) Read input with PyBioC reader gle repository, as some projects are attempting
(2) Fetch Pubmed s#ource (optional) twoitdhoin (aen.gu.nOi
peednPphlaatcftosrm[1.6H])o,waelvloewr,inagdqeeuperiynitneggration of the information provided by the
scien# ti c literature and the content of the databases is
(3) Convert to OGXML still missing.</p>
      <p>
        # We train our system using the knowledge
pro(4) Sentence splitting + tokenization vided by life sciences databases as our gold
stan# dard, instead of hand-labeled corpora, since we
(5) Term annotation believe that the scope and size of manually
anno# tated corpora, however much e ort has been
in(6) Extract terms vested in creating them, is not su cient to capture
# the wide variety of linguistic phenomena that can
(7) Merge tokens be encountered in the full corpus of biomedical
lit# erature, let alone other types of documents, such
(8) Entity disambiguation as internal scienti c reports in the pharma
indus# try, which are not represented at all in annotated
(9) Compute concept relevance corpora. For example, PubMed currently contains
# more than 23 million records, while the entire
(10) Filter concepts by score set of all annotated publications probably barely
# reaches a few thousands, most of them sparsely
(11) Compute relation relevance annotated for very speci c purposes.
We generate interaction candidates using
co(12) Filter relati#ons by score occurence of entities within selected syntactic
units (typically sentences). An additional step of
# syntactic parsing using a state-of-the-art
depen(13) Annotate OGXML for visualization dency parser allows us to derive specialized
fea# tures in order to increase precision. The details of
(14) Add annotations to PyBioC writer the algorithm are presented in [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. The
informa# tion delivered by the syntactic analysis is used as
(15) Send back annotated BioC a factor in order to score and lter candidate
in# teractions based on the syntactic fragment which
      </p>
      <p>
        BioC XML output connects the two participating entities. All
availFig. 1. Schema of the OntoGene pipeline able lexical and syntactic information is used in
order to provide an optimized ranking for
candidate interactions. The ranking of relation
candidates is further optimized by a supervised machine learning method described in detail in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>Semi-Automated Semantic Annotation of the Biomedical Literature</p>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <p>
        The OntoGene annotator o ers an open architecture allowing for a considerable level of
customization so that it is possible to plug in in-house terminologies. We additional provide access to some of
our text mining services through a RESTful interface.2 Users can submit arbitrary documents to
the OntoGene mining service by embedding the text to be mined within a simple XML wrapper.
Both input and output of the system are de ned according to the BioC standard [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. However,
typical usage will involve processing of PubMed abstracts or PubMed Central full papers. In this
case, the user can provide as input simply the PubMed identi er of the article. Optionally the user
can specify which type of output they would like to obtain: if entities, which entity types, and if
relationships, which combination of types.
      </p>
      <p>
        The OntoGene pipeline identi es all relevant entities mentioned in the paper, and their
interactions, and reports them back to the user as a ranked list, where the ranking criteria is the system's
own con dence for the speci c result. The con dence value is computed taking into account
several factors, including the relative frequency of the term in the article, its general frequency in
PubMed, the context in which the term is mentioned, and the syntactic con guration among two
interacting entities (for relationships). A detailed description of the factors that contribute to the
computation of the con dence score can be found in [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>The user can choose to either inspect the results, using the ODIN web interface, or to have
them delivered back via the RESTful web service in BioC XML format, for further local
processing. ODIN (OntoGene Document Inspector) is a exible browser-based client application which
interfaces with the OntoGene server. The curator can use the features provided by ODIN to
visualize selected annotations, together with the statements from which they were derived, and, if
necessary, add, remove or modify them. Once the curator has validated a set of candidate
annotations, they can be exported, using a standard format (e.g. CSV, RDF), for further processing by
other tools, or for inclusion in a reference database, after a suitable format conversion. In case of
ambiguity, the curator is o ered the opportunity to correct the choices made by the system, at any
of the di erent levels of processing: entity identi cation and disambiguation, organism selection,
interaction candidates. The curator can access all the possible readings given by the system and
select the most accurate.</p>
      <p>
        As a way to verify the quality of the core text mining functionalities of the OntoGene
system, we have participated in a number of text mining evaluation campaigns [
        <xref ref-type="bibr" rid="ref12 ref13 ref3 ref9">9, 3, 12, 13</xref>
        ]. Some
of most interesting results include best results in the detection of protein-protein interactions in
BioCreative 2009 [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], top-ranked results in several tasks of BioCreative 2010 [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], best results in
the triage task of BioCreative 2012 [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. The usage of ODIN as a curation tool has been tested in
a few collaborations with curation groups, including PharmGKB [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], CTD [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], RegulonDB [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
Assisted curation is also one of the topics being evaluated at the BioCreative competitions [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],
where OntoGene/ODIN participated with favorable results. The e ectiveness of the web service
has been recently evaluated within the scope of one of the BioCreative 2013 shared tasks [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
Di erent implementations can rapidly be produced upon request.
      </p>
      <p>Since internally the original database identi ers are used to represent the entities and
interactions detected by the system, the annotations can be easily converted into a semantic web format,
by using a reference URI for each domain entity, and using RDF statements to express
interactions. While it is possible to access the automatically generated annotations for further processing
by a reasoner or integrator tool, we strongly believe that at present a process of semi-automated
validation is preferable and would lead to better data consistency.</p>
      <p>Acknowledgments. The OntoGene group is partially supported by the Swiss National
Science Foundation (grant 105315 130558=1 to Fabio Rinaldi) and by the Data Science Group at
Ho mann-La Roche, Basel, Switzerland.
2 http://www.ontogene.org/webservices/</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Arighi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roberts</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agarwal</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bhattacharya</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cesareni</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <article-title>Chatr-aryamontri,</article-title>
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Clematide</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Gaudet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Giglio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Harrow</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Huala</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Krallinger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Leser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            ,
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Lu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            ,
            <surname>Maltais</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Okazaki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Perfetto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Rinaldi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Saetre</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Salgado</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Srinivasan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Thomas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Toldo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Hirschman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Wu</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          :
          <article-title>Biocreative iii interactive task: an overview</article-title>
          .
          <source>BMC Bioinformatics</source>
          <volume>12</volume>
          (
          <issue>Suppl 8</issue>
          ),
          <source>S4</source>
          (
          <year>2011</year>
          ), http://www.biomedcentral.com/1471-2105/12/S8/S4
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Ranking relations between diseases, drugs and genes for a curation task</article-title>
          .
          <source>Journal of Biomedical Semantics</source>
          <volume>3</volume>
          (
          <issue>Suppl 3</issue>
          ),
          <source>S5</source>
          (
          <year>2012</year>
          ), http://www.jbiomedsem.com/content/3/ S3/S5
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>Ontogene at calbc ii and some thoughts on the need of document-wide harmonization</article-title>
          .
          <source>In: Proceedings of the CALBC II workshop</source>
          , EBI, Cambridge, UK,
          <fpage>16</fpage>
          -18
          <string-name>
            <surname>March</surname>
          </string-name>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Comeau</surname>
            ,
            <given-names>D.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Doan</surname>
            ,
            <given-names>R.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ciccarese</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cohen</surname>
            ,
            <given-names>K.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krallinger</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leitner</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lu</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peng</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Torii</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Valencia</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Verspoor</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wiegers</surname>
            ,
            <given-names>T.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wu</surname>
            ,
            <given-names>C.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wilbur</surname>
            ,
            <given-names>W.J.:</given-names>
          </string-name>
          <article-title>BIoC: a minimalist approach to interoperability for biomedical text processing</article-title>
          .
          <source>The Journal of Biological Databases and Curation bat064</source>
          (
          <year>2013</year>
          ), published online
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Gama-Castro</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lpez-Fuentes</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Balderas-Martnez</surname>
            ,
            <given-names>Y.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ellendor</surname>
            ,
            <given-names>T.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Collado-Vides</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          :
          <article-title>Assisted curation of growth conditions that a ect gene expression in e. coli k-12</article-title>
          .
          <source>In: Proceedings of the Fourth BioCreative Challenge Evaluation Workshop</source>
          . vol.
          <volume>1</volume>
          , pp.
          <volume>214</volume>
          {
          <issue>218</issue>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ellendor</surname>
            ,
            <given-names>T.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marques</surname>
          </string-name>
          , H.:
          <article-title>OntoGene: CTD entity and action term recognition</article-title>
          .
          <source>In: Proceedings of the Fourth BioCreative Challenge Evaluation Workshop</source>
          . vol.
          <volume>1</volume>
          , pp.
          <volume>90</volume>
          {
          <issue>94</issue>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Garten</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Whirl-Carrillo</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gong</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hebert</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sangkuhl</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thorn</surname>
            ,
            <given-names>C.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klein</surname>
            ,
            <given-names>T.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Altman</surname>
          </string-name>
          , R.B.:
          <article-title>Using ODIN for a PharmGKB re-validation experiment</article-title>
          .
          <source>Database: The Journal of Biological Databases and Curation</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hafner</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Ranking of ctd articles and interactions using the ontogene pipeline</article-title>
          .
          <source>In: Proceedings of the 2012 BioCreative workshop</source>
          . Washington D.C. (April
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hafner</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grigonyte</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Romacker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vachon</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Using the OntoGene pipeline for the triage task of BioCreative 2012</article-title>
          .
          <source>The Journal of Biological Databases and Curation</source>
          , Oxford Journals (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Romacker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vachon</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>ODIN: An advanced interface for the curation of biomedical literature</article-title>
          .
          <source>In: Biocuration</source>
          <year>2010</year>
          ,
          <article-title>the Conference of the International Society for Biocuration and the 4th International Biocuration Conference</article-title>
          . p.
          <volume>61</volume>
          (
          <year>2010</year>
          ), available from Nature Precedings http://dx.doi.org/10.1038/npre.
          <year>2010</year>
          .
          <volume>5169</volume>
          .1
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gama-Castro</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lpez-Fuentes</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Balderas-Martnez</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Collado-Vides</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>Digital curation experiments for regulondb</article-title>
          .
          <source>In: BioCuration</source>
          <year>2013</year>
          ,
          <string-name>
            <surname>April</surname>
            <given-names>10th</given-names>
          </string-name>
          , Cambridge, UK (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kappeler</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaljurand</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klenner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hess</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>von Allmen</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parisot</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Romacker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vachon</surname>
          </string-name>
          , T.:
          <article-title>OntoGene in BioCreative II</article-title>
          .
          <source>Genome Biology</source>
          <volume>9</volume>
          (
          <issue>Suppl 2</issue>
          ),
          <source>S13</source>
          (
          <year>2008</year>
          ), http://genomebiology.com/
          <year>2008</year>
          /9/S2/S13
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kappeler</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaljurand</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klenner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hess</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>von Allmen</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Romacker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vachon</surname>
          </string-name>
          , T.:
          <article-title>OntoGene in Biocreative II</article-title>
          .
          <source>In: Proceedings of the II Biocreative Workshop</source>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaljurand</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vachon</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Romacker</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>OntoGene in BioCreative II.5</article-title>
          .
          <source>IEEE/ACM Transactions on Computational Biology and Bioinformatics</source>
          <volume>7</volume>
          (
          <issue>3</issue>
          ),
          <volume>472</volume>
          {
          <fpage>480</fpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clematide</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rinaldi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Detection of interaction articles and experimental methods in biomedical literature</article-title>
          .
          <source>BMC Bioinformatics</source>
          <volume>12</volume>
          (
          <issue>Suppl 8</issue>
          ),
          <source>S13</source>
          (
          <year>2011</year>
          ), http://www.biomedcentral. com/1471-2105/12/S8/S13
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>A.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harland</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Groth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pettifer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chichester</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
            ,
            <given-names>C.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blomberg</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ecker</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goble</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mons</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Open phacts: semantic interoperability for drug discovery</article-title>
          .
          <source>Drug Discovery Today</source>
          <volume>17</volume>
          (
          <issue>2122</issue>
          ),
          <volume>1188</volume>
          {
          <fpage>1198</fpage>
          (
          <year>2012</year>
          ), http://www.sciencedirect.com/science/ article/pii/S1359644612001936
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>