<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Framework for Recommending Ontology Matching Systems based on Application Requirements</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Diego Pessoa</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Centro de Informatica Universidade Federal de Pernambuco (UFPE) Recife</institution>
          ,
          <country country="BR">Brazil</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Ontology matching is the process of generating correspondences between terms of di erent ontologies. Today, several methods for ontology matching have been proposed, which makes di cult the choice of the most suitable to use in a particular setting. In this paper, we propose a novel ontology matching framework that uses automatic matchers recommendation to generate alignments. The di erential of this work is the employment of application requirements as means of acquiring knowledge about a particular matching task.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology Matching</kwd>
        <kwd>Ontology Matchers Recommendation</kwd>
        <kwd>Knowledge Acquisition</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Ontology matching is the task of nding relationships between entities expressed
in di erent ontologies [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. It usually outputs alignments containing a set of
correspondences between ontology terms, which are generated by using a single
similarity measure or by combining di erent ones [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        In the last years, many Ontology Matching Systems (Ontology Matchers)
have been proposed, as stated in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. There is a yearly event, organized by the
Ontology Alignment Evaluation Initiative (OAEI, e.g., [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]), in which matchers
are tested under di erent test cases. The OAEI results have demonstrated that
the evaluated matchers have achieved di erent performances depending on the
matching task. For example, in 2016 edition, the matcher ALIN reached a high
F-measure (0.74) in the Conference test case, but it was unable to provide any
results in the Large-bio test case [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. As there is limited knowledge about which
factors may impact on the matchers' performance, it becomes challenging to a
user the choice of the most suitable ones for a particular matching task. This
fact increases the need for an automatic approach to select, combine and tune
matchers.
      </p>
      <p>This work introduces a framework for the automatic recommendation of
ontology matchers regarding an application-speci c matching task. Existing
frameworks typically consider matchers' parameters or reference alignments as input.
In this case, the user is engaged mostly only in the later validation of
correspondences. A di erential of the proposed framework is that it allows the user to
de ne a set of application requirements, which are formalized as RDF resources.
The framework aims not only to reduce the search space of a matching task
(by producing ontology segments), but also to recommend the most suitable
matchers for the reduced setting generated according to the requirements.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Relevancy</title>
      <p>The integration of ontologies (i.e., establishing a uni ed view of ontologies from
heterogeneous sources) has several applications (e.g. data integration, search,
and analysis). Ontology matching is an essential step in this process, as sources
usually employ di erent terms to describe the same real-world concept, even in
the case of sources from the same domain.</p>
      <p>Especially in large-scale matching tasks (i.e., when dealing with several
ontologies that may contain a lot of elements), it is hard to acquire good quality
alignments. It is because of the necessity of more computational e ort (given the
high quantity of items to compare), as also a greater number of user validations.
As there are several ontology matchers available, the con guration of a matching
task may be a complicated and time-consuming task to the user. In this aspect,
there is a lack of approaches that could automatically provide the generation of
alignments, by using a set of recommended matchers for a particular matching
task.</p>
      <p>The basic idea of proposed framework is to solve this issue by allowing users
to de ne a set of application requirements, enabling both the reduction of the
amount of compared terms and the delivery of a set of recommended matchers.
Consequently, it also will make easier the con guration of a particular matching
task, rather than the need of having knowledge on matchers' characteristics.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Related Work</title>
      <p>
        There are a few works in the literature addressing the ontology matchers
recommendation problem. The work in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] has identi ed (by applying questionnaires
with domain experts) a set of features related to matchers (regarding input,
output, approach, usage, cost, and documentation). For each feature, the user can
de ne weights which are used by a multi-criteria decision method called Analytic
Hierarchy Process (AHP) that determines the suitable matchers. However, they
consider only a xed set of matchers, in such a way that it would be necessary to
apply new questionnaires to identify the features for novel approaches. As
ontology matchers are in constant evolution, this could be a useless e ort. Also, users
may not have knowledge about matchers peculiarities, which makes challenging
to choose the relevant ones according to their interests.
      </p>
      <p>
        The approaches [
        <xref ref-type="bibr" rid="ref12 ref14">12, 14</xref>
        ] consider textual and structural-based characteristics
of input ontologies to recommend matchers before the task execution. However,
it would lead to dismissing matchers that may provide better results in practice,
since they do not consider any result of alignments. The work in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] deals with
this issue by considering previous results. But, as it would be unfeasible to run
all matchers on every possible scenario, they are executed only over random
ontology samples (called ontology segments). However, generating random samples
may lead to uncertain evaluations, since every execution may present di erent
results.
      </p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], three recommendation strategies based on the use of ontology
segments are proposed. The rst generates segment pairs based on the exact
matching with a set of concepts. The second considers a whole set of validated mapping
suggestions and the third only segment pairs of these validated set. However,
there is no assurance that good performance on parts of the ontologies may
lead to the same result on the whole ontologies. Furthermore, several measures
can be used to de ne the matcher performance, which can result in di erent
recommendations depending on the chosen metric.
      </p>
      <p>To the best of our knowledge, there are no other work that addresses ontology
matchers recommendation by employing application requirements as means of
acquiring knowledge about the priorities for a particular ontology matching task.
The assumption of using requirements is allowing the user to de ne the relevant
terms and the quality metrics to be considered in the matching. We intend
to provide both a way to reduce the search space, through the generation of
ontology segments related to terms that meet the requirements; and a form to
evaluate the matchers more accurately, by considering the metrics that are more
signi cant to the user.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Research Questions &amp; Hypotheses</title>
      <p>The following research questions (Q) and related hypothesis (H) investigate how
the use of application requirements will reduce the search space of an ontology
matching task and consequently improve the matchers' recommendation:
{ Q1: Would the use of application requirements provide the generation of
better ontology segments? Will these segments reduce the search scope of a
matching task without loss of quality?
{ H1: Employing application requirements will enable to generate better
ontology segments, reducing more e ciently the search space of a matching
task, compared to state of the art techniques.
{ Q2: How can the use of application requirements improve ontology matchers'
recommendations? Is it possible to formalize the application needs regarding
an ontology matching task?
{ H2: Application requirements will allow the users to specify which terms
(data requirements) and metrics (quality requirements) should be
considered in an ontology matching task. The generation of ontology segments
based on the most relevant terms and the use of a set of preferred metrics
when evaluating matchers will provide better recommendations, compared
to state of the art. RDF resources will be used to formalize the application
requirements.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Proposed Approach</title>
      <p>The proposed framework aims to support ontology matching users to perform
matching tasks using a set of matchers suitable for a particular application.
Figure 1 presents the respective framework components and work ow. We introduce
a brief example to illustrate the de nition of application requirements and detail
the framework work ow in what follows.</p>
      <p>To start an ontology matching task, the user should provide a pair of
ontologies to match and a set of application requirements. These requirements are
represented in the form of RDF statements, given the following two categories:
i) Data Requirements and ii) Quality Requirements. The rst are statements
describing characteristics of the more relevant terms to be considered in the
matching ontologies. These statements are used to generate the ontologies
segments. The second ones, are statements that assign weights to quality metrics
(e.g. precision, recall, execution time). These weights are used in the evaluation
of alignments generated by matchers, resulting in recommendation scores.</p>
      <p>To illustrate the de nition of requirements, we introduce an ontology
matching scenario. Suppose an application to integrate open data for understanding
motivations behind people's migration from one country to another in the last
years. Assuming that a large number of data sources may provide diverse data
about countries and cities, this would be a typical case when application
requirements can be used to specify the scope of a particular ontology matching setting.
Table 1 shows the de nition of two data requirements (DR1 and DR2), stating
the preference for ontology classes that match with the terms Weather and GDP,
in which the latter should have GDP per capta as a subclass. As Quality
Requirement (QR), we illustrate the de nition of the weights 0.7 and 0.3 for precision
and execution time respectively, assuming that the application intends to reduce
the number of generated correspondences and the execution time, given a large
number of sources that may be considered.
The framework work ow starts by receiving a set of ontologies and application
requirements from the user. Then, the following steps are performed: i) ontology
segment generation; ii) related alignments nding; iii) matchers score
calculation, iv) matchers execution and iv) alignments validation. Furthermore, as a
support for these steps, the framework also uses an already established
knowledge base containing ontologies, matchers, alignments and validations acquired
from reliable sources (e.g. OAEI).</p>
      <p>Ontology Segment Generation. The rst step is the generation of ontology
segments following the data requirements provided, which will result in a
reduced subset of ontologies containing only the most relevant terms for the user.
The segment generation is made by traversing the ontologies structure
searching for terms that meet the requirements. Ontology segments are automatically
generated based on these terms and their correspondent elements (e.g. classes,
subclasses, superclasses), depending on the data requirements.</p>
      <p>Related Alignments Finding. The second step is seeking for related
alignments (in the alignment database), i.e., the ones between ontologies that share
similar characteristics with the generated segments. To de ne this similarity, we
assign some values to ontologies (or segments) regarding the following matchers
types: i) syntactic, ii) lexical; iii) structural and iv) instance-based.
Matcher Score Calculation. The third step is to calculate a score for the
available matchers considering the results of alignments evaluations, following
the weights for each metric de ned in the quality requirements. The list of
matchers ordered by score will compound the matchers ranking for the current setting.
Matchers Execution. Once the ranking of recommended matchers was
established, the user can apply some criteria (e.g. minimum score threshold or
maximum matchers quantity) to select matchers and then perform their
execution, regarding the following steps: pre-matching, matching, combination, and
ltering.</p>
      <p>Alignment Validation. In the nal step, the user can provide some feedback
about alignments provided by the framework. For this, it is possible to walk
through the alignments' correspondences and annotate them with positive or
negative statements. This information is also stored in the Validations Database
and may impact on subsequent interactions.</p>
      <p>
        Knowledge Bases. The knowledge bases store information about ontologies,
matchers, alignments and validations, serving as a baseline to the mentioned
steps. Regardless of what is the current step in the work ow, the user can provide
data to the knowledge base aiming to improve the obtained results. The
Ontologies Database includes basic descriptions, such as URI and format (e.g. RDF,
OWL). The Matchers Database stores some metadata about existing matchers,
such as name, version, main features and service endpoint. In the Alignments
Database, following as a standard the Alignment API [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], we to store alignments
and, if a gold-standard is available, it also stores a summary of metrics (e.g.
precision, recall, f-measure) and matching information (e.g. correspondences found,
expected and true positives) about the alignment generation. Finally, the
Validation Database stores a set of statements containing negative or positive user
annotations on correspondences.
6
      </p>
    </sec>
    <sec id="sec-6">
      <title>Evaluation Plan</title>
      <p>To evaluate the proposed framework, we perform experiments with real
matchers on public datasets. The initial tests targeted the datasets provided by OAEI
tracks (e.g. conference, anatomy). For this, we rst have prepared the knowledge
bases, by adding some metadata about reference ontologies, existing
matchers (preferably OAEI participants) and alignments evaluations (when reference
alignments are available). As further experiments, we also plan to test the
framework in other domains, such as the integration of ontologies from open data
repositories. Our hypothesis will be validated if the experiments demonstrate
that the use of application requirements enables the reduction of a matching
task and consequently the recommendation of the best matching systems.</p>
    </sec>
    <sec id="sec-7">
      <title>Preliminary Results</title>
      <p>
        To obtain some preliminary results, we have developed a prototype of the
proposed framework. For initializing the Ontology Database, we have imported some
ontologies from the OAEI Conference and Anatomy datasets (Cmt, Conference,
ConfOf, Edas, Ekaw, Iasted, Sigkdd, Human, and Mouse). To ll the Matchers
Database, we have considered the ones that usually are participants in OAEI
campaigns and that have a publicly available source code. To standardize the
access (input/output), we have implemented a wrapper for each matcher. In the
initial experiment, we considered the matchers COMA [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], YAM [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], AML [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ],
LogMap [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and FCAMap [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Figure 2 illustrates the comparison of obtained
matching results considering the whole ontologies and the segments generated
by the prototype. As result of this preliminary experiment, we observed that in
the majority of cases, the prototype was able to improve quality metrics and in
all the cases it was able to reduce the execution time.
      </p>
      <p>Quality Metrics</p>
      <p>Execution Time (seconds)
0,9
0,8
0,7
0,6
0,5
0,4
0,3
0,2
0,1
0</p>
      <p>COMA COMA AML AML LogMap LogMapFCAMapFCAMap YAM YAM
(seg) (seg) (seg) (seg) (seg)</p>
      <p>Precision Recall F-measure
0
5
10
15
20</p>
      <p>25
YAM (seg)</p>
      <p>YAM
FCAMap (seg)</p>
      <p>FCAMap
LogMap (seg)</p>
      <p>LogMap
AML (seg)</p>
      <p>AML
COMA (seg)</p>
      <p>COMA
In this work, we present a framework for matchers recommendation based on
application requirements. Even though the preliminary results indicate that the
proposed approach is promising, we now are focused on performing further
experiments to obtain more extensive results. We still have some work on design
and implementation of the framework, but the main structure was implemented
in the initial prototype, which will support the execution of new experiments.</p>
      <p>We expect that the proposed framework can bring as main contributions:
i) the ease of preparation of a matching task, by using requirements instead of
matcher-speci c parameters; and ii) the generation of alignments with better
quality, by reducing the matching search space and by using the best
recommended matchers to generate alignments. Another bene t of this framework
would be the reduction of execution time, since the matching will not be
performed on entire ontologies, but only on the more relevant segments to the user.
Acknowledgments. I am grateful to my advisor Dr. Ana Carolina Salgado and
my co-advisor Dr. Bernadette Farias Loscio for their support and the opportunity
for the realization of this work.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Achichi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cheatham</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dragisic</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Euzenat</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Faria</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ferrara</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Flouris</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fundulaki</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harrow</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ivanova</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jimenez-Ruiz</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuss</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lambrix</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leopold</surname>
            , H., 0001,
            <given-names>H.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meilicke</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montanelli</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pesquita</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Saveta</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shvaiko</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Splendiani</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stuckenschmidt</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Todorov</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>dos Santos</surname>
          </string-name>
          , C.T.,
          <string-name>
            <surname>Zamazal</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Results of the Ontology Alignment Evaluation Initiative 2016</article-title>
          .
          <article-title>OM@ISWC (</article-title>
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Anam</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>Y.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kang</surname>
            ,
            <given-names>B.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          :
          <article-title>Adapting a knowledge-based schema matching system for ontology mapping</article-title>
          .
          <source>In: Proceedings of the Australasian Computer Science Week Multiconference</source>
          . pp.
          <volume>27</volume>
          :
          <issue>1</issue>
          {
          <fpage>27</fpage>
          :
          <fpage>10</fpage>
          . ACSW '16,
          <string-name>
            <surname>ACM</surname>
          </string-name>
          , New York, NY, USA (
          <year>2016</year>
          ), http://doi.acm.
          <source>org/10</source>
          .1145/2843043.2843048
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bellahsene</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ngo</surname>
            ,
            <given-names>D.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bellahsene</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          :
          <article-title>YAM++ : (not) Yet Another Matcher for Ontology Matching Task</article-title>
          . Bases de Donnees Avancees p.
          <volume>5</volume>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>David</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Euzenat</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , Schar e, F.,
          <string-name>
            <surname>Trojahn</surname>
            dos Santos,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The Alignment API 4.0</article-title>
          .
          <string-name>
            <given-names>Semantic</given-names>
            <surname>Web</surname>
          </string-name>
          ()
          <volume>2</volume>
          (
          <issue>1</issue>
          ),
          <volume>3</volume>
          {
          <fpage>10</fpage>
          (Jan
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Do</surname>
            ,
            <given-names>H.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rahm</surname>
          </string-name>
          , E.:
          <article-title>COMA - A System for Flexible Combination of Schema Matching Approaches</article-title>
          . VLDB pp.
          <volume>610</volume>
          {
          <issue>621</issue>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Elshwimy</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Algergawy</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sarhan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sallam</surname>
            ,
            <given-names>E.A.</given-names>
          </string-name>
          :
          <article-title>Aggregation of similarity measures in schema matching based on generalized mean</article-title>
          .
          <source>2014 IEEE 30th International Conference on Data Engineering Workshops (ICDEW)</source>
          pp.
          <volume>74</volume>
          {
          <issue>79</issue>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Euzenat</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shvaiko</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Ontology Matching. Springer Publishing Company, Incorporated, 2nd edn. (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Fan</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiao</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>An automatic method for ontology mapping</article-title>
          . In: Apolloni,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Howlett</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.J.</given-names>
            ,
            <surname>Jain</surname>
          </string-name>
          , L.C. (eds.)
          <source>KES (3). Lecture Notes in Computer Science</source>
          , vol.
          <volume>4694</volume>
          , pp.
          <volume>661</volume>
          {
          <fpage>669</fpage>
          . Springer (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Faria</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pesquita</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Santos</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Palmonari</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cruz</surname>
            ,
            <given-names>I.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Couto</surname>
            ,
            <given-names>F.M.:</given-names>
          </string-name>
          <article-title>The AgreementMakerLight Ontology Matching System</article-title>
          . Springer Berlin Heidelberg, Berlin, Heidelberg (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Jimenez-Ruiz</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grau</surname>
            ,
            <given-names>B.C.</given-names>
          </string-name>
          :
          <article-title>LogMap: Logic-Based and Scalable Ontology Matching</article-title>
          .
          <source>In: The Semantic Web { ISWC</source>
          <year>2011</year>
          , pp.
          <volume>273</volume>
          {
          <fpage>288</fpage>
          . Springer, Berlin, Heidelberg, Berlin, Heidelberg (Oct
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Lambrix</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaliyaperumal</surname>
          </string-name>
          , R.:
          <article-title>A Session-based Ontology Alignment Approach enabling User Involvement</article-title>
          .
          <source>Semantic Web Journal</source>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Luo</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          :
          <article-title>Rimom: A dynamic multistrategy ontology alignment framework</article-title>
          .
          <source>IEEE Trans. on Knowl. and Data Eng</source>
          .
          <volume>21</volume>
          (
          <issue>8</issue>
          ),
          <volume>1218</volume>
          {1232 (Aug
          <year>2009</year>
          ), http://dx.doi.org/10.1109/TKDE.
          <year>2008</year>
          .202
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Mochol</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jentzsch</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Euzenat</surname>
          </string-name>
          , J.:
          <article-title>Applying an analytic method for matching approach selection</article-title>
          .
          <source>In: OM'06: Proceedings of the 1st International Conference on Ontology Matching -</source>
          Volume
          <volume>225</volume>
          . pp.
          <volume>37</volume>
          {
          <fpage>48</fpage>
          . Free University of Berlin, CEURWS.
          <source>org (Nov</source>
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Pirro</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Talia</surname>
            ,
            <given-names>D.:</given-names>
          </string-name>
          <article-title>UFOme: An ontology mapping system with strategy prediction capabilities</article-title>
          .
          <source>Data &amp; Knowledge Engineering</source>
          <volume>69</volume>
          (
          <issue>5</issue>
          ),
          <volume>444</volume>
          {471 (May
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Shvaiko</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Euzenat</surname>
          </string-name>
          , J.:
          <article-title>Ontology matching: state of the art and future challenges. Knowledge and Data Engineering</article-title>
          , IEEE Transactions on
          <volume>25</volume>
          (
          <issue>1</issue>
          ),
          <volume>158</volume>
          {
          <fpage>176</fpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>