<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Increasing the nanopublication recall with a BridgeDb Identi er Mapping Service</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Dept. Bioinformatics - BiGCaT</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>NUTRIM</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Maastricht University</string-name>
          <email>egon.willighagen@maastrichtuniversity.nl</email>
        </contrib>
      </contrib-group>
      <abstract>
        <p>The volume of literature in the life sciences is continuously growing and keeping up with it is a problem. While review articles and databases help us by summarizing vast amounts of research, dissemination of core research outcomes is still mostly restricted to scholarly journal. Nanopublications have been proposed as a solution to capture scienti c statements. This led to a 2010 proposal to serialize nanopubs in the Resource Description Framework (RDF) and in 2016 to an international network of nanopublication servers. However, RDF has a limitation that the Internationalized Resource Identi er (IRI) for resources does not have to be normalized and unique. To overcome this issue, the Open PHACTS project developed an Identi er Mapping Service and an approach called scienti c lenses for mapping of equivalent IRIs. We here demonstrate the application of this approach to improve the recall of nanopublications from the international network.</p>
      </abstract>
      <kwd-group>
        <kwd>nanopublications identi er BridgeDb</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The volume of literature in the life sciences is continuously growing and keeping
up with literature is a problem [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. While literature reviews and databases
summarize vast amounts of research, dissemination of core research outcomes is still
mostly restricted to the written word. Nanopublications have been proposed to
capture scienti c statements with provenance to the origin of that statement [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
This led to a 2010 proposal to serialize nanopubs in the Resource Description
Framework (RDF) [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Kuhn et al. introduced in 2016 an international network
of connected servers to host nanopublications, with initial data sets from
DisGeNET [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], neXtProt [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], and others [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Nanopublications for WikiPathways
were added later [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. The network currently hosts about 10 million
nanopublications [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>However, RDF has a limitation that the Internationalized Resource Identi er
(IRI) for resources does not have meaning and do not have to be unique. This
causes an in nite number of possible IRIs for the same resource. And because
when creating RDF content, one is not meant to reuse domain names not under
your control and one often wishes to make resource IRIs dereferenceable, this
is exactly what we see in practise: di erent data sets use di erent IRIs for the
same gene, protein, or metabolite.</p>
      <p>
        The Open PHACTS project has had the same problem when starting to link
di erent pharmacology data sets [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], including ChEMBL [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and
WikiPathways [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. To overcome this issue, it developed an Identi er Mapping Service
(IMS) based on BridgeDb [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and the scienti c lenses approach that allowed
mapping of equivalent IRIs [
        <xref ref-type="bibr" rid="ref13 ref14">13,14</xref>
        ]. The alternative, of course, is to normalize
IRIs in data sets before the integration, e.g. with identi ers.org [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], but
removes exibility to change the level of equivalence depending on the data
analysis done [
        <xref ref-type="bibr" rid="ref13 ref14">13,14</xref>
        ]. The IMS implemented the identi er mapping as integral part of
the Open PHACTS Linked Data API, hiding this need to map equivalent IRIs
when querying the underlying data sets.
      </p>
      <p>Therefore, the assumption is that if we use an IMS as outlined here with
appropriate loaded scienti c lenses, we will nd more nanopubs for a particular
biological entity. To test this hypothesis, we searched nanopubs with information
about a set of genes on the international network of nanopublication servers.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Methods</title>
      <p>To implement our work ow, an R Markdown document was developed to perform
the various steps detailed below. The full document is available at https://
github.com/egonw/swat4hcls2018/. It uses a few R packages and introduces
a helper function to simplify searching nanopublications.</p>
      <p>
        Genes As representative data set we took two pathways from the list of most
viewed WikiPathways (https://www.wikipathways.org/index.php/Special:
PopularPathwaysPage). Pathway WP241 was selected, about the human one
carbon metabolism [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], with mostly NCBI Gene identi ers. WP2059 was
selected as a second example, with predominantly Ensembl gene identi ers [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
The rrdf package was used to query all genes in this pathways from the SPARQL
endpoint [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
      </p>
      <p>
        Nanopublication Server As source of nanopubs we took a nearby server
from the international network of mirroring servers, hosted by the Institute for
Data Sciences at Maastricht University (http://graphdb.dumontierlab.com/
repositories/nanopubs) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. To simplify the interaction with the server, we
took advantage of an online running instance of grlc (grlc.io) [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] that wraps
the nanopublication server API with an OpenAPI [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]: https://github.com/
peta-pico/nanopub-api.
      </p>
      <p>
        BridgeDb Identi er Mapping Server For the IRI mapping, we used the
Docker image of the IMS developed by the Open PHACTS project (https:
//hub.docker.com/r/openphacts/identitymappingservice/) [
        <xref ref-type="bibr" rid="ref12 ref13 ref9">12,13,9</xref>
        ]. This
was recently repurposed by Ehrhart et al. for gene-variant mappings [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. The
IMS is started and loaded with IRI mapping data as explained in [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]: 1. the
user starts to Docker image, and then 2. loads the identi er mapping les into
the IMS instance using a loading script. The actual mapping les were generated
by J. Melius based on data from Ensembl 87 (see http://bridgedb.org/data/
linksets/current/HomoSapiens/. The source code can be found at https:
//github.com/BiGCAT-UM/EnsemblLinksetsCreator). These linksets map
Ensembl identi ers with NCBI Gene, HGNC, and others.
      </p>
      <p>Data Analysis The R Markdown notebook integrates the three
aforementioned approaches into a single analysis. To test the hypothesis, it rst retrieves
the genes from two WikiPathways and for each gene it searches for nanopubs.
This is done by looking up equivalent gene IRIs using the IMS server and then
for each gene IRI search for nanopublications. It then counts only the original
IRI and for all equivalent IRIs and reports the di erences.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <p>With the R Markdown notebook we searched for nanopublications for two
popular WikiPathways, WP241 and WP2059. The rst has mostly NCBI Gene
identi ers and the second mostly Ensembl Gene identi ers. The script reports that
NCBI Gene identi ers return the most nanopublications when searching the
full nanopublication network, indicating nanopublication data sets prefer to use
NCBI Gene identi er-based IRIs. This observation a ects the number of
additional nanopubs found via equivalent IRIs: for WP241 we indeed nd a high
number of found pathways when using only the IRI returned by the
WikiPathways SPARQL endpoint and a lower number for WP2059. For WP241 we get
on average 464 nanopublications (min: 10, max: 1000, median: 288), while for
WP2059 we retrieve on average 21 nanopublications (min: 0, max:1000, median:
1). The count is currently capped at 1000 nanopublications, imposed by the grlc
API wrapping around the nanopublication server, which explains this artifact.</p>
      <p>As hypothesized, using equivalent IRIs, as returned by the IMS, will retrieve
additional nanopublications. The number of equivalent IRIs by the IMS is
different for both pathways. For WP241 it returns on average 9 IRIs (min: 7, max:
23, median: 7) and for WP2059 it returns on average 11 IRIs (min: 7, max: 29,
median: 10). The returned IRIs are a mix of mappings to other database sources
and di erent IRI patterns for the same database identi er.</p>
      <p>Indeed, with these additional IRIs, more nanopublications are found on the
international nanopublication network. Furthermore, when the additional IRIs
include NCBI Gene identi er-based IRIs, we nd a higher number of additional
nanopublications. This observation is similar for that observed when only using
the original NCBI Gene identi er-based IRI, as explained above. Therefore, we
nd fewer additional nanopublications for WP241 which used predominantly
NCBI Gene identi ers: on average it nd 17 additional nanopublications (min: 0,
max: 230, median: 3). However, for WP2059 which used predominantly Ensembl
identi ers we nd a much higher number of additional nanopublications, on
average 44 (min: 0, max: 1099, median: 0).</p>
    </sec>
    <sec id="sec-4">
      <title>Discussion</title>
      <p>It goes without discussion that the results show that we indeed nd more
nanopublications about a certain gene. However, there are some aspects that must be
noted. First, the enrichment is only as good as the completeness and quality of
the gene-gene identi er mapping link sets. The link sets used in this study are
biased towards equivalent IRIs based on Ensembl and NCBI Gene identi ers.
If nanopublication data sets use other gene identi ers, these will still not be
found. Besides this completeness issue, the author had the impression that some
mappings were missing, something will be explored. A more elaborate analysis
is planned, involving more pathways and more identi er sources.</p>
      <p>Another e ect of this completeness aspect is that the link sets used only
cover gene-gene identi er mappings. However, the scienti c lenses approach also
allows gene-RNA and gene-protein mappings, under a lens that equates genes
and proteins. This is particularly relevant for WikiPathways, where gene and
proteins are frequently used as equivalent. The ability to load such additional
link sets and the feature of the IMS to turn on and o the lenses, would allow
returning even more nanopublications.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>The results show that using an IRI mapping service increases the recall when
searching nanopublication, overcoming the problem that nanopublications do
not (and should not need to) normalize IRIs. This paper demonstrates this with
the application of a locally installed BridgeDb IMS service and an R script in
combination with online nanopublication services.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Pain</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>How to keep up with the scienti c literature</article-title>
          .
          <source>Science (November</source>
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Mons</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Velterop</surname>
          </string-name>
          , J.:
          <article-title>Nano-Publication in the e-Science Era</article-title>
          .
          <source>In: Proceedings of the Workshop on Semantic Web Applications in Scienti c Discourse (SWASD</source>
          <year>2009</year>
          ),
          <article-title>collocated with the 8th</article-title>
          <source>International Semantic Web Conference (ISWC2009)</source>
          ,
          <string-name>
            <surname>Washington</surname>
            <given-names>DC</given-names>
          </string-name>
          , USA, October
          <volume>26</volume>
          ,
          <year>2009</year>
          . Volume
          <volume>523</volume>
          ., CEUR Workshop Proceedings (
          <year>October 2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Groth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gibson</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Velterop</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>The anatomy of a nanopublication</article-title>
          .
          <source>Information Services and Use</source>
          <volume>30</volume>
          (
          <issue>1</issue>
          ) (
          <year>January 2010</year>
          )
          <volume>51</volume>
          {
          <fpage>56</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Queralt-Rosinach</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuhn</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chichester</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sanz</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Furlong</surname>
            ,
            <given-names>L.I.</given-names>
          </string-name>
          :
          <article-title>Publishing DisGeNET as nanopublications</article-title>
          .
          <source>Semantic Web</source>
          <volume>7</volume>
          (
          <issue>5</issue>
          ) (
          <year>June 2016</year>
          )
          <volume>519</volume>
          {
          <fpage>528</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Chichester</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gaudet</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karch</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Groth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lane</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bairoch</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mons</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loizou</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Querying neXtProt nanopublications and their value for insights on sequence variants and tissue expression</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          <volume>29</volume>
          (
          <year>December 2014</year>
          )
          <volume>3</volume>
          {
          <fpage>11</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Kuhn</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chichester</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krauthammer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Queralt-Rosinach</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Verborgh</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Giannakopoulos</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ngonga</surname>
            <given-names>Ngomo</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>A.C.</given-names>
            ,
            <surname>Viglianti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Dumontier</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          :
          <article-title>Decentralized provenance-aware publishing with nanopublications</article-title>
          .
          <source>PeerJ Computer Science</source>
          <volume>2</volume>
          (
          <year>August 2016</year>
          ) e78+
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Kuhn</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Queralt-Rosinach</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Centeno</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Furlong</surname>
            ,
            <given-names>L.I.</given-names>
          </string-name>
          :
          <article-title>Reliable Granular References to Changing Linked Data</article-title>
          . In d'Amato,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Fernandez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Tamma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            ,
            <surname>Lecue</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Cudr-Mauroux</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Sequeda</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Lange</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>He</surname>
          </string-name>
          <string-name>
            <surname>in</surname>
          </string-name>
          , J., eds.:
          <source>The Semantic Web ISWC 2017</source>
          . Volume
          <volume>10587</volume>
          . Springer International Publishing,
          <string-name>
            <surname>Cham</surname>
          </string-name>
          (
          <year>2017</year>
          )
          <volume>436</volume>
          {
          <fpage>451</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Kuhn</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meroo-Peuela</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malix</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poelen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hurlbert</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Centeno</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Furlong</surname>
            ,
            <given-names>L.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Queralt-Rosinach</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chichester</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Banda</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ehrhart</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malas</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Nanopublications: A Growing Resource of Provenance-Centric Scienti c Linked Data</article-title>
          .
          <source>In: Proceedings of IEEE eScience</source>
          <year>2018</year>
          , arXiv.
          <source>org (September</source>
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>A.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harland</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Groth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pettifer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chichester</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
            ,
            <given-names>C.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blomberg</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ecker</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goble</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mons</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <string-name>
            <surname>Open</surname>
            <given-names>PHACTS</given-names>
          </string-name>
          :
          <article-title>semantic interoperability for drug discovery</article-title>
          .
          <source>Drug Discovery Today</source>
          <volume>17</volume>
          (
          <fpage>21</fpage>
          -
          <lpage>22</lpage>
          ) (
          <year>November 2012</year>
          )
          <volume>1188</volume>
          {
          <fpage>1198</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Waagmeester</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Spjuth</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ansell</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>A.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tkachenko</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hastings</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wild</surname>
            ,
            <given-names>D.J.:</given-names>
          </string-name>
          <article-title>The ChEMBL database as linked open data</article-title>
          .
          <source>Journal of Cheminformatics</source>
          <volume>5</volume>
          (
          <issue>1</issue>
          ) (
          <year>2013</year>
          )
          <fpage>23</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Waagmeester</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kutmon</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Riutta</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miller</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
            ,
            <given-names>C.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pico</surname>
            ,
            <given-names>A.R.</given-names>
          </string-name>
          :
          <article-title>Using the Semantic Web for Rapid Integration of WikiPathways with Other Biological Online Data Resources</article-title>
          .
          <source>PLOS Computational Biology</source>
          <volume>12</volume>
          (
          <issue>6</issue>
          ) (
          <year>June 2016</year>
          ) e1004989
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Van Iersel</surname>
            ,
            <given-names>M.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pico</surname>
            ,
            <given-names>A.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kelder</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gao</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ho</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hanspers</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Conklin</surname>
            ,
            <given-names>B.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
          </string-name>
          , C.T.:
          <article-title>The BridgeDb framework: standardized access to gene, protein and metabolite identi er mapping services</article-title>
          .
          <source>BMC Bioinformatics</source>
          <volume>11</volume>
          (
          <issue>1</issue>
          ) (
          <year>January 2010</year>
          )
          <volume>5</volume>
          +
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Brenninkmeijer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goble</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gray</surname>
            ,
            <given-names>A.J.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Groth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pettifer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>William</surname>
            ,
            <given-names>A.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.L.</given-names>
          </string-name>
          :
          <article-title>Scienti c Lenses over Linked Data: An Approach to Support Task Speci c Views of the Data. A Vision</article-title>
          .
          <source>In: Linked Science 2012 - Tackling Big Data</source>
          . (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Batchelor</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brenninkmeijer</surname>
            ,
            <given-names>C.Y.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chichester</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Davies</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Digles</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dunlop</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
            ,
            <given-names>C.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gaulton</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goble</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gray</surname>
            ,
            <given-names>A.J.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Groth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harland</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karapetyan</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loizou</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Overington</surname>
            ,
            <given-names>J.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pettifer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Steele</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tkachenko</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Waagmeester</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.L.</given-names>
          </string-name>
          :
          <article-title>Scienti c Lenses to Support Multiple Views over Linked Chemistry Data</article-title>
          . In Mika, P.,
          <string-name>
            <surname>Tudorache</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bernstein</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Welty</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Knoblock</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vrandei</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Groth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Janowicz</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goble</surname>
          </string-name>
          , C., eds.:
          <source>The Semantic Web ISWC 2014</source>
          . Volume
          <volume>8796</volume>
          . Springer International Publishing,
          <string-name>
            <surname>Cham</surname>
          </string-name>
          (
          <year>2014</year>
          )
          <volume>98</volume>
          {
          <fpage>113</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Juty</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Le Novre</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laibe</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Identi ers.org and MIRIAM Registry: community resources to provide persistent identi cation</article-title>
          .
          <source>Nucleic Acids Research</source>
          <volume>40</volume>
          (
          <issue>D1</issue>
          ) (
          <year>January 2012</year>
          ) D580{
          <fpage>D586</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Adriaens</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marianthi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kalafati</surname>
            , Pico,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kelder</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Slenter</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hanspers</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , Txr24, Egoyenechea, Fehrhart, Thakur,
          <string-name>
            <surname>G.</surname>
          </string-name>
          ,
          <article-title>Je : One Carbon Metabolism (Homo sapiens)</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Salomonis</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hanspers</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fehrhart</surname>
            , Pico,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kelder</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mlius</surname>
          </string-name>
          , J.:
          <source>Alzheimers Disease (Homo sapiens)</source>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Willighagen</surname>
          </string-name>
          , E.:
          <article-title>Accessing biological data in R with semantic web technologies</article-title>
          .
          <source>Technical report, PeerJ Inc. (March</source>
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Meroo-Peuela</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hoekstra</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>: grlc Makes GitHub Taste Like Linked Data APIs</article-title>
          . In Sack, H.,
          <string-name>
            <surname>Rizzo</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Steinmetz</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mladeni</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lange</surname>
          </string-name>
          , C., eds.:
          <article-title>The Semantic Web</article-title>
          . Volume
          <volume>9989</volume>
          . Springer International Publishing,
          <string-name>
            <surname>Cham</surname>
          </string-name>
          (
          <year>2016</year>
          )
          <volume>342</volume>
          {
          <fpage>353</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Sferruzza</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rocheteau</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Attiogb</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lanoix</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Extending OpenAPI 3.0 to Build Web Services from their Speci cation</article-title>
          .
          <source>In: Proceedings of the 14th International Conference on Web Information Systems and Technologies</source>
          , Seville, Spain, SCITEPRESS - Science and Technology
          <string-name>
            <surname>Publications</surname>
          </string-name>
          (
          <year>2018</year>
          )
          <volume>412</volume>
          {
          <fpage>419</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Ehrhart</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Melius</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cirillo</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kutmon</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Willighagen</surname>
            ,
            <given-names>E.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coort</surname>
            ,
            <given-names>S.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Curfs</surname>
            ,
            <given-names>L.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evelo</surname>
          </string-name>
          , C.T.:
          <article-title>Providing gene-to-variant and variant-to-gene database identi er mappings to use with BridgeDb mapping services</article-title>
          .
          <source>F1000Research</source>
          <volume>7</volume>
          (
          <year>September 2018</year>
          )
          <fpage>1390</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>