<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>YAM-BIO { Results for OAEI 2017</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Amina Annane</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Zohra Bellahsene</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Faical Azouaou</string-name>
          <email>azouaoug@esi.dz</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Clement Jonquet</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Center for BioMedical Informatics Research (BMIR), Stanford University</institution>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Laboratory of Informatics, Robotics and Microelectronics of Montpellier (LIRMM) University of Montpellier &amp; CNRS</institution>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>National Higher School of Informatics (ESI)</institution>
          ,
          <addr-line>Algiers</addr-line>
          ,
          <country country="DZ">Algeria</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The YAM-BIO ontology alignment system is an extension of YAM++ but dedicated to aligning biomedical ontologies. YAM++ has successfully participated in several editions of the Ontology Alignment Evaluation Initiative (OAEI) between 2011 and 2013, but this is the rst participation of YAM-BIO. The biomedical extension includes a new component that uses existing mappings between multiple biomedical ontologies as background knowledge. In this short system paper, we present YAM-BIO's work ow and the results obtained in the Anatomy and Large Biomedical Ontologies tracks of the OAEI 2017 campaign.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>1.1</p>
    </sec>
    <sec id="sec-2">
      <title>Presentation of the YAM-BIO system</title>
      <sec id="sec-2-1">
        <title>State, purpose, general statement</title>
        <p>
          YAM-BIO may be seen as an extension of YAM++ [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] that uses existing
mappings between multiple biomedical ontologies as background knowledge to
enhance the matching results. The latest version of YAM++, which we reused in
YAM-BIO, obtained excellent results in multiple Ontology Alignment Evaluation
Initiative (OAEI) campaigns, especially in 2013 [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. YAM++ did not
participate more since then. Four years on from the last participation, our objective
this year was to establish a comparison between the potential performance of
a bio-customized YAM++, and state-of-the-art systems in matching biomedical
ontologies.
        </p>
        <p>
          Over last OAEI campaigns, state-of-the-art systems such as AML [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] and
LogMapBio [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] used specialized background knowledge to improve their
results. More generally, the use of background knowledge {or indirect matching
techniques{ as recently allowed to obtain better results. YAM-BIO is an
equivalent evolution of YAM++ in which we added a component that uses existing
mappings as background knowledge. With YAM-BIO, we participated this year
to the Anatomy and Large Biomedical Ontologies (Largebio) tracks.
1.2
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>YAM-BIO's general alignment worklfow</title>
        <p>As illustrated in Fig. 1, YAM-BIO's work ow contains three main steps: First, to
compute direct matching between source and target ontologies using YAM++.
Second, to compose relevant existing mappings in the background knowledge for
concepts not aligned during rst step. Third, to compute union of the alignments
produced by the two previous steps.</p>
        <p>
          Direct matching with YAM++: Annotations (labels, comments, etc.)
and structures of source and target ontologies are indexed as well as the context
of each entity that may be a concept or a property. Then, candidate mappings
with a low annotation similarity are pre- ltered. Other advanced lexical and
structural similarity measures are applied on the remaining candidate mappings,
before updating their similarity scores using the structure information of source
and target ontologies. Finally, a threshold is dynamically computed to select the
most relevant mapping candidates. For more details on each steps of the
execution of YAM++, readers may refer to [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ].
        </p>
        <p>Indirect matching and union: During this step YAM-BIO nds
mappings for the concepts that have not been matched during direct matching with
YAM++. First, background knowledge existing mappings are loaded in a list of
lists noted A as follows:
1. Identi ers of all concepts in the background knowledge are added to A. The
identi er of a given concept is the last part of its URI, for example the
identi er of the concept that has the URI http://mouse.owl#MA 0000031
is MA 0000031.
2. Each element x of A points to a list that contains identi ers of all concepts
matched to x in the background knowledge.</p>
        <p>Then, for each source concept y that is not matched yet, YAM-BIO checks if
y's identi er exists in A. If yes, YAM-BIO gets the corresponding list {pointed
by y{ and for each element of this list, YAM-BIO veri es if itself points to a
list that contains a concept identi er from the target ontology. If so, YAM-BIO
derives a new mapping and adds it to the alignment produced previously by the
direct matching.
1.3</p>
      </sec>
      <sec id="sec-2-3">
        <title>Adaptations made for the OAEI campaign</title>
        <p>
          The existing mappings used as background knowledge have been extracted from
Uberon [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] and the Human Disease Ontology (DOID) [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. These ontologies
contain several manually edited/curated cross references to other biomedical
ontologies that we may consider as mappings.
        </p>
        <p>
          In addition, concept identi ers of the ontologies provided for the Largebio
track are not the original ones, but have been replaced by their standardized
preferred labels. For this reason, we have used the NCBO BioPortal's REST
API [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] to replace concept identi ers within Uberon and DOID by their
standardized preferred labels.
1.4
        </p>
      </sec>
      <sec id="sec-2-4">
        <title>Availability</title>
        <p>
          YAM++ has now a publicly accessible online prototype version [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] and is
registered on Maven repositories: http://yamplusplus.lirmm.fr. YAM-BIO has not
been packaged yet to be reused by others. However, the alignment set produced
        </p>
        <sec id="sec-2-4-1">
          <title>Source</title>
          <p>ontology</p>
        </sec>
        <sec id="sec-2-4-2">
          <title>Target ontology 1.YAM++</title>
        </sec>
        <sec id="sec-2-4-3">
          <title>Existing</title>
          <p>mappings</p>
        </sec>
        <sec id="sec-2-4-4">
          <title>2.Mappings composition</title>
        </sec>
        <sec id="sec-2-4-5">
          <title>Not-matched source concepts</title>
        </sec>
        <sec id="sec-2-4-6">
          <title>Alignment 1</title>
        </sec>
        <sec id="sec-2-4-7">
          <title>3.Union</title>
        </sec>
        <sec id="sec-2-4-8">
          <title>Alignment 2</title>
        </sec>
        <sec id="sec-2-4-9">
          <title>Final alignment</title>
          <p>as well as the background knowledge le are available at the following link:
https://goo.gl/zNznNz</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <sec id="sec-3-1">
        <title>Anatomy track</title>
        <p>
          The Anatomy track consists of nding an alignment between the Adult Mouse
Anatomy [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] (2744 classes) and a subset of the National Cancer Institute (NCI)
Thesaurus [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] (3304 classes) describing human anatomy. Table 1 shows
YAMBIO's evaluation result and runtime on this track. YAM-BIO scored in second
position among the 12 systems that have participated in 2017 with almost the
same precision and a slightly lower recall comparing to the top ranked system.
The Largebio track consists of respective nding alignments between the
Foundational Model of Anatomy (FMA) [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], SNOMED-CT [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ], and the NCI
Thesaurus. There are six tasks with di erent input ontology sizes: small fragment,
large fragment and whole ontologies. Table 2 shows YAM-BIO's evaluation
re4
3
3.1
sults and runtime on those tasks. With the exception of the XMAP system4,
YAM-BIO is the top ranked system in Task 1 and Task 4 and obtained almost
the same results as the best system in Task 3 with an F-measure of 0.834 vs
0.835. In Task 2 and Task 6, YAM-BIO scored in second position with a better
recall than the best system and a lower precision. In Task 5, it shared third
position with LogMapBio. In terms of running time, YAM-BIO completed the
di erent tasks in acceptable time.
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Discussion</title>
      <sec id="sec-4-1">
        <title>Comments on the results and ways of improvement</title>
        <p>YAM-BIO scored second position in the Anatomy track and scored rst or second
also in the Largebio track (except Task 5). As expected, using existing mappings
as background knowledge has improved YAM++ results in terms of recall and
consequently F-measure. Mapping compositions extracted from Uberon allowed
YAM-BIO to discover non trivial mappings, speci cally in Anatomy track and
in Task 1 and Task 2 of Largebio track. Similarly, the composition of mappings
extracted from DOID allowed to increase the recall of Task 5 and Task 6.
However, the incoherence analysis shows that YAM-BIO returns some incoherent
mappings. This may be explained by the fact that the mappings derived
using background knowledge have been added to the nal alignment without any
semantic veri cation.</p>
        <p>
          In our current system, mappings derived using background knowledge are
not post- ltered and semantically veri ed as in YAM++. A simple union of the
direct and indirect alignments is performed to obtain the nal alignment. In the
future, our goal would be to integrate the use of background knowledge directly
inside YAM++'s internal architecture which, we believe, will improve coherence
of the nal results. More speci cally, we will implement the approach proposed
in [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ].
        </p>
        <p>
          In addition, we are aware of the importance of the dynamic selection of
ontologies to use as background knowledge [
          <xref ref-type="bibr" rid="ref15 ref2">15, 2</xref>
          ]. Indeed, from the selected
ontologies we may extract manual/automatic mappings as background knowledge.
For this reason, we will extend YAM-BIO to dynamically select a set of
ontolo4 We note XMAP uses UMLS Metathesaurus as background knowledge, which is the
same from which Largebio reference alignments are extracted.
gies from a given ontology library such as the NCBO BioPortal or Watson [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ],
if we want to go beyond biomedicine.
3.2
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Comments on the OAEI evaluation</title>
        <p>When possible, we think it would be interesting to publish participants results
with and without use of specialized background knowledge. On one hand, this
will allow to better evaluate the in uence of background knowledge in matching
quality and running time. On the other hand, this will allow a fair comparison
with systems that do not use background knowledge.</p>
        <p>Some components are common in all ontology matching system architectures;
others do not always exist |such as background knowledge selection or semantic
veri cation. This makes the comparison of running time executions particularly
cumbersome and not always fair. According to us, it would be more appropriate
to evaluate execution times for each separate component. For example,
YAMBIO used a prede ned background knowledge while LogMapBio made a dynamic
selection from an online repository necessarily taking additional time. Splitting
running time by components will also help the community to identify less e cient
components to improve them, and most e cient ones to reuse them.
4</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>In 2017 YAM-BIO participated in two tracks: Anatomy and LargeBio. The
results obtained in those tracks are very close to top ranked state-of-the-art
systems, thanks to di erent content matching techniques implemented in YAM++
and to the use of background knowledge. Due to the high heterogeneity of
ontologies, we believe that an advanced generic (i.e., not restricted to biomedicine)
module that selects and uses background knowledge should be implemented in
the internal architecture of YAM++ to improve its results. In the future, we will
work on such a module and hopefully participate in di erent OAEI tracks.
5</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgment</title>
      <p>This work was done during a LIRMM-ESI collaboration within the Semantic
Indexing of French biomedical Resources (grant ANR-12-JS02-01001) and
PractikPharma (ANR-15-CE23-0028) projects that received funding from the French
National Research Agency as well as by the European H2020 Marie
SklodowskaCurie action (agreement No 701771), the University of Montpellier and the
CNRS. The authors also acknowledge the Ei el Excellence Scholarship program.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Annane</given-names>
            <surname>Amina</surname>
          </string-name>
          , Bellahsene Zohra, Azouaou Faical, and
          <string-name>
            <given-names>Jonquet</given-names>
            <surname>Clement</surname>
          </string-name>
          .
          <article-title>Selection and combination of heterogeneous mappings to enhance biomedical ontology matching</article-title>
          .
          <source>In 20th International Conference on Knowledge Engineering and Knowledge Management</source>
          ,
          <string-name>
            <surname>EKAW</surname>
          </string-name>
          , Bologna, Italy, pages
          <volume>19</volume>
          {
          <fpage>33</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Faria</given-names>
            <surname>Daniel</surname>
          </string-name>
          , Pesquita Catia, Santos Emanuel,
          <string-name>
            <surname>Cruz Isabel</surname>
            <given-names>F</given-names>
          </string-name>
          , and Couto Francisco M.
          <article-title>Automatic background knowledge selection for matching biomedical ontologies</article-title>
          .
          <source>PloS One</source>
          ,
          <volume>9</volume>
          (
          <issue>11</issue>
          ):
          <fpage>e111226</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>d'Aquin Mathieu</surname>
          </string-name>
          , Gridinoc Laurian,
          <article-title>Angeletou So a, Sabou Marta, and Motta Enrico. Watson: A Gateway for Next Generation Semantic Web Applications</article-title>
          . In 6th International Semantic Web Conference, ISWC, Poster and Demonstration, Busan, Korea, pages
          <volume>11</volume>
          {
          <fpage>15</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Kevin</given-names>
            <surname>Donnelly</surname>
          </string-name>
          .
          <article-title>SNOMED-CT: The advanced terminology and coding system for eHealth</article-title>
          .
          <source>Studies in health technology and informatics</source>
          ,
          <volume>121</volume>
          :
          <fpage>279</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Ngo</surname>
            <given-names>DuyHoa</given-names>
          </string-name>
          and
          <string-name>
            <given-names>Bellahsene</given-names>
            <surname>Zohra</surname>
          </string-name>
          .
          <article-title>Overview of YAM++:(not) yet another matcher for ontology alignment task</article-title>
          .
          <source>Journal of Web Semantics</source>
          ,
          <volume>41</volume>
          :
          <fpage>30</fpage>
          {
          <fpage>49</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Noy Natalya</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shah Nigam</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Whetzel Patricia</surname>
            <given-names>L</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dai</surname>
            <given-names>Benjamin</given-names>
          </string-name>
          , Dorf Michael,
          <source>Gri th Nicholas</source>
          , Jonquet Clement, Rubin Daniel L,
          <string-name>
            <surname>Storey</surname>
          </string-name>
          Margaret-Anne, and Chute Christopher G.
          <article-title>BioPortal: ontologies and integrated data resources at the click of a mouse</article-title>
          .
          <source>Nucleic Acids Research</source>
          ,
          <volume>37</volume>
          :
          <fpage>170</fpage>
          {
          <fpage>173</fpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Daniel</given-names>
            <surname>Faria</surname>
          </string-name>
          , Catia Pesquita, Booma S Balasubramani, Catarina Martins, Joao Cardoso, Hugo Curado, Francisco M Couto, and Isabel F Cruz.
          <article-title>Oaei 2016 results of AML</article-title>
          . In 11th International Workshop on Ontology Matching, Kobe, Japan., pages
          <volume>138</volume>
          {
          <fpage>145</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Terry</surname>
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Hayamizu</surname>
          </string-name>
          , Mary Mangan, John P. Corradi, James A.
          <string-name>
            <surname>Kadin</surname>
            , and
            <given-names>Martin</given-names>
          </string-name>
          <string-name>
            <surname>Ringwald</surname>
          </string-name>
          .
          <article-title>The adult mouse anatomical dictionary: a tool for annotating and integrating data</article-title>
          .
          <source>Genome Biology</source>
          ,
          <volume>6</volume>
          (
          <issue>3</issue>
          ):
          <fpage>R29</fpage>
          ,
          <string-name>
            <surname>Feb</surname>
          </string-name>
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>E</given-names>
            <surname>Jimenez-Ruiz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B Cuenca</given-names>
            <surname>Grau</surname>
          </string-name>
          , and
          <string-name>
            <given-names>V</given-names>
            <surname>Cross</surname>
          </string-name>
          .
          <article-title>Logmap family participation in the oaei 2016</article-title>
          . In 11th International Workshop on Ontology Matching, Kobe, Japan., pages
          <volume>185</volume>
          {
          <fpage>189</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Christopher J. Mungall</surname>
          </string-name>
          , Carlo Torniai,
          <string-name>
            <surname>Georgios</surname>
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Gkoutos</surname>
            ,
            <given-names>Suzanna E.</given-names>
          </string-name>
          <string-name>
            <surname>Lewis</surname>
          </string-name>
          , and
          <string-name>
            <surname>Melissa</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Haendel</surname>
          </string-name>
          .
          <article-title>Uberon, an integrative multi-species anatomy ontology</article-title>
          .
          <source>Genome Biology</source>
          ,
          <volume>13</volume>
          (
          <issue>1</issue>
          ):
          <fpage>R5</fpage>
          ,
          <string-name>
            <surname>Jan</surname>
          </string-name>
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <article-title>DuyHoa Ngo and Zohra Bellahsene</article-title>
          . YAM+
          <article-title>+ results for OAEI 2013</article-title>
          . In 8th International Workshop on Ontology Matching, Sydney, Australia., pages
          <volume>211</volume>
          {
          <fpage>218</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>Cornelius</given-names>
            <surname>Rosse</surname>
          </string-name>
          and
          <string-name>
            <given-names>Jos L.V.</given-names>
            <surname>Mejino</surname>
          </string-name>
          .
          <article-title>A reference ontology for biomedical informatics: the foundational model of anatomy</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          ,
          <volume>36</volume>
          (
          <issue>6</issue>
          ):
          <volume>478</volume>
          {
          <fpage>500</fpage>
          ,
          <year>2003</year>
          . Uni ed Medical Language System.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. Lynn Marie Schriml, Cesar Arze, Suvarna Nadendla,
          <string-name>
            <surname>Yu-Wei Wayne</surname>
            <given-names>Chang</given-names>
          </string-name>
          , Mark Mazaitis, Victor Felix, Gang Feng, and Warren Alden Kibbe.
          <article-title>Disease ontology: a backbone for disease semantic integration</article-title>
          .
          <source>Nucleic Acids Research</source>
          ,
          <volume>40</volume>
          (
          <issue>D1</issue>
          ):
          <source>D940{ D946</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Nicholas</surname>
            <given-names>Sioutos</given-names>
          </string-name>
          , Sherri de Coronado, Margaret W. Haber, Frank W. Hartel, WenLing Shaiu, and Lawrence W. Wright.
          <article-title>NCI thesaurus: A semantic model integrating cancer-related clinical and molecular information</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          ,
          <volume>40</volume>
          (
          <issue>1</issue>
          ):
          <volume>30</volume>
          {
          <fpage>43</fpage>
          ,
          <year>2007</year>
          . Bio*Medical Informatics.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Chen</surname>
            <given-names>Xi</given-names>
          </string-name>
          , Xia Weiguo,
          <string-name>
            <surname>Jimenez-Ruiz Ernesto</surname>
            , and
            <given-names>Cross</given-names>
          </string-name>
          <string-name>
            <surname>Valerie</surname>
          </string-name>
          .
          <article-title>Extending an ontology alignment system with BioPortal: a preliminary analysis</article-title>
          .
          <source>In 13th International Semantic Web Conference, ISWC, Posters and Demonstrations, Riva del Garda</source>
          , Italy, pages
          <volume>313</volume>
          {
          <fpage>316</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Bellahsene</surname>
            <given-names>Zohra</given-names>
          </string-name>
          , Emonet Vincent, Ngo DuyHoa, and Todorov Konstantin. Yam+
          <article-title>+ online: a multi-task platform for ontology and thesaurus matching</article-title>
          .
          <source>In 14th Extended Semantic Web Conference</source>
          , ESWC, Posters and Demonstrations, Portoroz, Slovenia,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>