<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>CroLOM: Cross-Lingual Ontology Matching System</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>LITIO Laboratory, University of Oran1 Ahmed Ben Bella</institution>
          ,
          <addr-line>Oran</addr-line>
          ,
          <country>Algeria abderrahmane</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2016</year>
      </pub-date>
      <abstract>
        <p>The current work describes an automatic system especially designed for aligning cross-lingual ontologies. The CroLOM software, unlike existing systems, uses the Yandex translator, NLP techniques and a similarity computation based on the categories of the words and synonyms. CroLOM participated for the first time in OAEI2016 evaluation campaign and the results obtained are so far been quite promising. The paper also discusses some important issues related to multilingualism treatment.</p>
      </abstract>
      <kwd-group>
        <kwd>Cross lingual Alignment</kwd>
        <kwd>Multilingual Ontologies Survey</kwd>
        <kwd>Ontology Matching</kwd>
        <kwd>Yandex</kwd>
        <kwd>Semantic Similarity</kwd>
        <kwd>OAEI</kwd>
        <kwd>Direct matching</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        Recently, with the growing number of ontologies defined in different languages,
multilingualism has become an issue of major interest in ontology matching field.
Multilingual ontology alignment, defined as the process of identification of semantic
correspondences between entities of different ontologies described in different natural language,
represents the solution to the problem of semantic interoperability between different
sources of distributed information [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. Several methods have been elaborated to
semantically align multilingual ontologies. These methods can be generally split into two
main categories direct and indirect matching approaches [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The approaches of the first
category are based on external resources (i.e. translation) to align cross-lingual
ontologies. However, the approaches of the second category are based on the composition
of alignments such as the work proposed in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] where the authors reuse the mappings
between ontologies that already exist.
      </p>
      <p>In this study, we consider the approaches of the first category, since we develop an
approach which implements a direct strategy. However, there are many exciting
questions regarding these approaches to address the multilingualism issue. These questions
are as follows: (1) Which machine translation should be used, (2) which translation
path should be considered and (3) which ontologies features and dictionaries can be
exploited. In the following paragraphs, we describe the points mentioned above.</p>
      <p>First, several translators have been developed to translate automatically the text from
one natural language to another. We can mention for example: Google, Bing, SDL and
Gengo translators. Each translator has its specific characteristics such as: number of
source/target languages and execution time. However, selecting one or several
translators (by combining them) remains an open problem. This choice is crucial in ”direct
approaches”, since they apply a monolingual matching techniques in cross-lingual
ontology mapping.</p>
      <p>Second, the translation path also plays an important role to resolve the heterogeneity
problem. Two translation paths can be considered, (i) either considering the translation
path from one to another or (ii) selecting a pivot language which is often the English
language. This choice highly depends on available sources (dictionaries, thesaurus, etc.)
in different natural languages. Most matching systems consider the translation path
using English as a pivot language due to available sources in English language.</p>
      <p>Finally, in some cases, the results of a translation machine could be poor, however,
to avoid this situation some ontology features can be exploited such Description Logics.</p>
      <p>Most matching systems which implement a direct translation approach uses a
wellknown translators mentioned above. The current work uses also a direct matching
approach. However, unlike existing approaches, it addresses the multilingualism challenge
by using (a) the Yandex translator1, (b) a translation into a pivot language after applying
NLP techniques and (c) a similarity computation based on the categories of the words
and synonyms.</p>
      <p>The rest of the paper is organized as follows. First, in Section 2, we discuss the
top systems that participated in the last editions of the multifarm track. In section 3 we
describe the CroLOM system. Section 4 contains the experiment results. Finally, some
concluding remarks and future work are presented in Section 5.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        In this section, we continue our previous work [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] by covering the main cross-lingual
ontology matching systems that have participated in the last editions of the
Multifarm track of OAEI evaluation campaign. These systems use a direct translation-based
matching approach.
      </p>
      <p>Table 1 summarizes the results of the top systems in the multifarm track.</p>
      <p>
        The AUTOMSv2 system [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] uses a free Java API named WebTranslator2 in order
to solve the multi-language problem by translating label and properties in English
language. The GOMMA system [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] uses a free translation API named ”mymemory”3
to automatically translate non-English terms. The WeSeE-Match system [16]
translates the fragments, labels, and comments in English as a pivot language using the
Bing4 Search APIs translation capabilities. The WikiMatch system [17] employs the
Google Translation API5 for addressing multi-lingual ontologies. The CLONA system
[18] translates the entities described in different natural languages into English as a
pivot language using Bing translator. Then it uses Lucene search engine and WordNet
to determine alignment candidates. The XMap system [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] uses an automatic translation
1 https://translate.yandex.com/?lang=es-en&amp;text=administrar&amp;
ncrnd=5317
2 http://webtranslator.sourceforge.net/
3 http://mymemory.translated.net/
4 https://www.microsoft.com/en-us/translator/translatorapi.aspx
5 http://code.google.com/apis/language/translate/overview.html
0.50
0.29
0.28
0.35
Top Systems
AUTOMSv2
WeSeE
GOMMA
WikiMatch
YAM++
for obtaining correct matching pairs in multilingual ontology matching. The
translation is done by querying Microsoft Translator for the full name. The AML system [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
uses an automatic translation module based on Microsoft Translator. The translation is
done by querying Microsoft Translator for the full name (rather than word-by-word).
To improve performance, AML stores locally all translation results in dictionary files,
and queries the Translator only when no stored translation is found. The LogMap
system that participated in the OAEI 2014 campaign used a multilingual module based on
Google translate; however the new version of the LogMap system uses both Microsoft
and Google translator APIs [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. The YAM++ system [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] uses a multilingual translator
based on Microsoft Bing to translate the annotations to English.
      </p>
      <p>
        The multifarm track of OAEI 2015 contains our dataset in Arabic language (ADOM)
[
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ]. Contrary to AUTOMSv2, GOMMA, WeSeE-Match, WikiMatch and YAM++
systems which have not participated in OAEI2015; CLONA system participated for the
first time in OAEI2015 initiative.
      </p>
      <p>Except these systems, the results of XMap, LogMap and AML systems on
multifarm track (includes Arabic) are slightly lower than previous editions of OAEI (i.e. in
OAEI2014). According to the results obtained from the systems mentioned above, this
is explained by the fact that the Arabic dataset brings an additional complexity to the
multifarm track.</p>
      <p>We have also observed that the best system (in all OAEI editions including this year)
achieved an F-measure of 0.51. This is surprising, in spite of many research works that
have been established in the field of multilingual ontology matching.
3</p>
    </sec>
    <sec id="sec-3">
      <title>CroLOM: Cross-Lingual Ontology Matching System</title>
      <p>We summarize the process of our approach to provide a general idea of the proposed
solution. It consists in the following successive phases:
3.1</p>
      <sec id="sec-3-1">
        <title>Extraction and Normalization</title>
        <p>CroLOM extracts first the entities of the input ontologies. Then, it employs NLP
techniques to normalize the entities described in different natural languages. Unlike
existing approaches, we have applied lemmatization, stemming and stopword elimination
for each natural language separately before translation step. First, for each language
considered by multifarm, we have established the stop words of each language in
order to eliminate them from entities labels. Second, we have developed morphological
algorithms to obtain lemmatization of the entities words.</p>
        <p>This step is important 6, since one of matchers used is (1) based on string
comparison algorithm to compute similarity and (2) the categories of the words are stoked in
lemma form.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Translation</title>
        <p>Once the entities are normalized, CroLOM uses the Yandex translator in order to
translate the entities described in different natural languages in English as a pivot language.
After translation, CroLOM employs for the second time the normalization step in order
to eliminate the stop words of the English language from entities labels.</p>
        <p>We have mentioned before that the translation path and the used translator play
important role to resolve the multilingualism heterogeneity problem. Our choice for the
Yandex translator is justified by the fact that it is ranked as the 4th largest search engine
in the world and it has not previously used to align multilingual ontologies. However, we
have chosen English as a pivot language because there a lot dictionaries that are
available in English language. These dictionaries could be exploited in order to improve our
system in the future. In addition, to compute the similarity between entities, we have
used dictionaries (word categories and WordNet) in English. Due to automatic
translation, we have observed that some stop words can be appeared in translated entities. For
this purpose, we have employed the normalization for the second time.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Similarity Computation</title>
        <p>Once the translation and standardization are carried out, CroLOM applies first, a case
conversion by converting all entities words in lower case then it passes to the
similarity computation step. Unlike existing systems, which use well known matchers, we
have developed a matcher which calculates the similarity between entities based on the
categories of the Words, string-based algorithm and synonyms using Wordnet7.</p>
        <p>The matcher developed establishes a Cartesian product between the two entities
words, then it returns the maximum similarity value using Levenshtein distance,
similarity based on WordNet and similarity based on the categories of the words. The
similarity based on the categories of the words has been adapted with some modification
from the project ”Calculate Semantic Similarity” 8. The project has been developed to
6 This step allows to obtain good results such as the results of our previous work [19] (STRIM
system) in instance matching.
7 http://wordnet.princeton.edu/
8 https://sourceforge.net/projects/semantics/</p>
        <p>System
CroLOM
LogMap
AML</p>
        <p>Track
Multifarm
Multifarm
Multifarm
match sentences, however we have modified the code in order to compute similarity
between words.
Finally, CroLOM applies a filter to select candidate correspondences which possess the
maximum similarity value in each line of Cartesian product between entities. Then it
applies a second a filter to identify the correspondences that possess similarity value
upper than a given threshold.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Experimental Study</title>
      <p>The results obtained by running our CroLOM system on multifarm tracks of OAEI
2016 evaluation campaign are obtained from the following website: http://oaei.
ontologymatching.org/2016/results/multifarm/index.html.</p>
      <p>
        The multifarm[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] track has been integrated in the Ontology Alignment Evaluation
Initiative (OAEI) in 2012 with the goal of estimating and comparing different
techniques and systems related to multilingual ontology alignment. From 2012 to 2014
the multifarm track contains conference ontologies[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] described in eight different
languages (i.e., Chinese, Czech, Dutch, French, German, Portuguese, Russian, Spanish).
However, in 2015 the multifarm includes the Arabic language.
      </p>
      <p>The results obtained by our CroLOM system on multifarm are quite promising with
F-measure equal to 36%. Comparing these results against the results of the systems
which have participated in OAEI previous editions (Table 1), CroLOM with this first
participation, is among the best systems with respect to F-measure. Regarding this year
[Table 2], only AML (F-measure equals to 0.40) and LogMap (F-measure equals to
0.37) systems whose results are slightly better than CroLOM system.</p>
      <p>The major drawback of CroLOM system is the execution time compared to other
systems. We are working forward to identify this problem and improve our system.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>In this paper, we have presented our CroLOM system, (not) yet another cross-lingual
ontology matching system. CroLOM unlike existing approaches, applies first NLP
techniques on each natural language before translation. Then, it uses the Yandex translator
in order to translate all entities in English as pivot language. Finally, CroLOM
computes the similarity between translated entities based on the category of the words and
WordNet.</p>
      <p>As future challenges, we aim to (1) improving the quality results of our system and
especially the execution time, (2) conduct a survey study that addresses all the issues
mentioned above, (3) taking into account the indirect approaches.
16. H. Paulheim, ”WeSeE-Match results for OEAI 2012”, In Proceedings of the 7th Workshop
on Ontology Matching ISWC 2012, USA, 2012.
17. S. Hertling and H. Paulheim, ”WikiMatch results for OEAI 2012”, In Proceedings of the 7th</p>
      <p>Workshop on Ontology Matching ISWC 2012, pp., USA, 2012.
18. M. El-Abdi, H. Souid, M. Kachroudi and S. Ben-Yahia, ”CLONA results for OAEI 2015”,</p>
      <p>In Proceedings of the 10th Workshop on Ontology Matching ISWC 2015, USA, 2015.
19. A. Khiat, M. Benaissa and M. A. Belfdhal, ”STRIM results for OAEI 2015 instance matching
evaluation”. In Proceedings of the 10th International Workshop on Ontology Matching
colocated with the 14th International Semantic Web Conference (ISWC 2015), USA, 2015.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>A.</given-names>
            <surname>Khiat</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Benaissa</surname>
          </string-name>
          , ”
          <article-title>A New Instance-Based Approach for Ontology Alignment”</article-title>
          .
          <source>International Journal on Semantic Web and Information Systems (IJSWIS)</source>
          , Vol.
          <volume>11</volume>
          , No. 3, ISSN 1683-
          <issue>3198</issue>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>A.</given-names>
            <surname>Khiat</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Benaissa</surname>
          </string-name>
          , ”
          <article-title>Boosting Reasoning-Based Approach by Structural Metrics for Ontology Alignment”</article-title>
          .
          <source>The Journal of Information Processing Systems (JIPS)</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>S</given-names>
            <surname>Zhang</surname>
          </string-name>
          and
          <string-name>
            <given-names>O.</given-names>
            <surname>Bodenreider</surname>
          </string-name>
          , ”
          <article-title>Alignment of Multiple Ontologies of Anatomy: Deriving Indirect Mappings from Direct Mappings to a Reference”</article-title>
          ,
          <source>AMIA 2005 Symposium Proceedings</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>J. J.</given-names>
            <surname>Jung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hakansson</surname>
          </string-name>
          , and
          <string-name>
            <surname>R. H. . ”</surname>
          </string-name>
          <article-title>Indirect Alignment between Multilingual Ontologies: A Case study of Korean and Swedish Ontologies,”</article-title>
          <source>in Proceedings of the Third KES International Symposium on Agent and Multi-Agent Systems: Technologies and Applications</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>A.</given-names>
            <surname>Khiat</surname>
          </string-name>
          and
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Benaissa and Ernesto Jimnez-Ruiz ”ADOM: arabic dataset for evaluating arabic and cross-lingual ontology alignment systems”</article-title>
          .
          <source>In Proceedings of the 10th International Workshop on Ontology Matching co-located with the 14th International Semantic Web Conference (ISWC</source>
          <year>2015</year>
          ), USA,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>A.</given-names>
            <surname>Khiat</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Diallo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Yaman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Jimnez-Ruiz</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Benaissa</surname>
          </string-name>
          , ”
          <article-title>ABOM and ADOM: Arabic Datasets for the Ontology Alignment Evaluation Campaign”</article-title>
          .
          <source>In Proceedings of the 14th International Conference (ODBASE</source>
          <year>2015</year>
          ), Greece,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>W.</given-names>
            <surname>Djeddi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. T.</given-names>
            <surname>Khadir</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Ben-Yahia</surname>
          </string-name>
          , “
          <article-title>XMap++ results for OAEI 2015”</article-title>
          .
          <source>In Proceedings of the 10th International Workshop on Ontology Matching ISWC</source>
          <year>2015</year>
          , USA,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>D.</given-names>
            <surname>Faria</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Martins</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nanavaty</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Oliveira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Sowkarthiga</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Taheri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Pesquita</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Couto</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Cruz</surname>
          </string-name>
          , “
          <article-title>AML results for OAEI 2015”</article-title>
          .
          <source>In Proceedings of the 10th Workshop on Ontology Matching ISWC</source>
          <year>2015</year>
          , USA,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>D.</given-names>
            <surname>Ngo</surname>
          </string-name>
          and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Bellahsene</surname>
          </string-name>
          , “YAM+
          <article-title>+ results for OAEI 2013”</article-title>
          ,
          <source>In Proceedings of the 8th Workshop on Ontology Matching ISWC</source>
          <year>2013</year>
          , pp.
          <fpage>211</fpage>
          -
          <lpage>218</lpage>
          , Australia,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>A.</given-names>
            <surname>Khiat</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Benaissa</surname>
          </string-name>
          , “
          <article-title>AOT / AOTL results for OAEI 2014”</article-title>
          .
          <source>In Proceedings of the 9th International Workshop on Ontology Matching ISWC</source>
          <year>2014</year>
          , pp.
          <fpage>113</fpage>
          -
          <lpage>119</lpage>
          , Italy,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. E.
          <string-name>
            <surname>Jime</surname>
          </string-name>
          <article-title>´nez-Ruiz, BC</article-title>
          . Grau,
          <string-name>
            <given-names>A.</given-names>
            <surname>Solimando</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Cross</surname>
          </string-name>
          , “
          <article-title>LogMap family results for OAEI 2015”</article-title>
          .
          <source>In Proceedings of the 10th Workshop on Ontology Matching ISWC</source>
          <year>2015</year>
          , USA,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>O.</given-names>
            <surname>Svab</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Svatek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Berka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rak</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Tomasek</surname>
          </string-name>
          , “
          <article-title>OntoFarm: Towards an Experimental Collection of Parallel Ontologies”</article-title>
          ,
          <source>In: Poster Track of ISWC</source>
          <year>2005</year>
          , Galway,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>C. Meilicke</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Garca-Castro</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Freitas</surname>
          </string-name>
          ,
          <string-name>
            <surname>WR. Van Hage</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Montiel-Ponsoda</surname>
            ,
            <given-names>R</given-names>
          </string-name>
          .R. De Azevedo,
          <string-name>
            <given-names>H.</given-names>
            <surname>Stuckenschmidt</surname>
          </string-name>
          ,
          <string-name>
            <surname>O.</surname>
          </string-name>
          <article-title>vb-</article-title>
          <string-name>
            <surname>Zamazal</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Svtek</surname>
            and
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Tamilin</surname>
          </string-name>
          , “
          <article-title>MultiFarm: A benchmark for multilingual ontology matching”</article-title>
          .
          <source>Web Semant. Sci. Serv</source>
          .
          <source>Agents World Wide Web</source>
          . Vol.
          <volume>15</volume>
          , pp.
          <fpage>62</fpage>
          -
          <lpage>68</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>K.</given-names>
            <surname>Kotis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Katasonov</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Leino</surname>
          </string-name>
          , ”
          <article-title>AUTOMSv2 results for OAEI 2012”</article-title>
          ,
          <source>In Proceedings of the 7th Workshop on Ontology Matching ISWC</source>
          <year>2012</year>
          , USA,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>A.</given-names>
            <surname>Gro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Hartung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Kirsten</surname>
          </string-name>
          and E. Rahm, ”
          <article-title>GOMMA results for OAEI 2012”</article-title>
          ,
          <source>In Proceedings of the 7th Workshop on Ontology Matching ISWC</source>
          <year>2012</year>
          , USA,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>