<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Holistic Multiple Ontologies Merging</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Samira Babalou (Early Stage )</string-name>
          <email>samira.babalou@uni-jena.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Heinz-Nixdorf Chair for Distributed Information Systems Institute for Computer Science, Friedrich Schiller University Jena</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Ontologies as the main infrastructure to represent data in the Semantic Web are widely developed independently in each area. When it comes to nding a suitable ontology for a given application, two problems occur: Often, an ontology will cover just a part of the domain of interest or competing ontologies modeling the domain from di erent viewpoints exist. Thus, before being able to leverage the power of ontologies, they themselves need to be integrated. This is a challenging task. The existing approaches are mostly limited to a binary merge. However, by the large availability of the relevant ontologies in the desired domain, an e cient multiple ontologies merging technique is often a necessity to overcome the scalability problem. This research thus advocates for the development of a holistic, e cient multiple ontologies merging method called CoMerger, to satisfy the scalability issue. For e cient processing, rather than merging a large number of ontologies, we merge a small number of clusters. To approve the feasibility of our approach, we will run CoMerger on real-life datasets. Further, our platform will be freely accessible through a live portal.</p>
      </abstract>
      <kwd-group>
        <kwd>Semantic web</kwd>
        <kwd>Ontology merging</kwd>
        <kwd>Ontology mapping</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Ontologies are the semantic model to represent data on the Semantic Web. Often
a domain has more than one "standard" ontology for the same general concepts.
They either cover just a part of the domain of interest or model the domain
from di erent viewpoints. In this fashion, multiple heterogeneous ontologies
are independently developed in each domain. In real-world applications of the
Semantic Web, this is an essential demand to interoperate with more than two
ontologies toward acquiring the desired knowledge for scientists. Indeed, di erent
ontologies cover particular aspects of a domain of discourse but overlap to a
certain degree. Therefore, an e cient technique for merging multiple ontologies
is often a necessity both during ontology development and when ontologies are
used in conjunction with data at the query processing level. This can be a
cost-e cient approach and saves a lot of development e ort. Thus, before being
able to leverage the power of ontologies, they themselves need to be integrated.
This is a challenging task.</p>
      <p>
        Existing ontology merging approaches [
        <xref ref-type="bibr" rid="ref14 ref15 ref18 ref23">14,15,18,23</xref>
        ] are mostly limited to
merging only two ontologies, partly due to using a binary merge (i.e., merging
two ontologies at a time). In principle, a series of binary merges can be applied
to more than two ontologies, however, they are no longer su ciently scalable
and viable for a large number of ontologies [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Precisely, to merge n ontologies,
a binary-merge approach needs to run the n:(n 1) pairwise alignment processes
2
and (n 1) combination operations in an incremental fashion. Nevertheless,
merging multiple ontologies (n &gt; 2) at the same time has not been extensively
studied mainly due to the much more complex search space and it still remains
one of the key challenges in the future research agenda. Therefore, to overcome
the binary merge limitations, the holistic strategy has been introduced as a
feasible and e cient method in [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Following this approach, in our proposed
framework CoMerger, we advocate for developing an e cient, holistic merging
technique that scales to many ontologies. It gets as an input a set of ontologies
with their alignments and automatically generates a merged ontology with a set
of output mappings between the merged and the input ontologies. At rst, the
n input ontologies will be clustered into k clusters. Afterward, the clusters will
be combined based on the corresponding pairs to produce the merged ontology.
To this end, the main problem statement of our research is to enable a holistic
ontology merging method by extending Semantic Web technologies. Thus, the
general research question that my thesis tries to address is:
      </p>
      <p>Research Question: How can the holistic approach be applied for
merging n ontologies to overcome the scalability problem?</p>
      <p>To contribute to the main research question, two RQs with further
sub-questions can be concluded.</p>
      <p>RQ1- How can the elements of input ontologies be e ectively clustered into k
clusters based on the detected correspondences to facilitate the merge process?
RQ1-1- Does the clustering process lead to a signi cant reduction in
execution time and complexity of merging process without compromising
quality?
RQ1-2- What is the e ect of varying the number of clusters k on the merge
quality?
RQ2- How can the combination of k clusters e ciently generate the merged
ontology?</p>
      <p>RQ2-1- Which requirements should be considered for the merging step?
RQ2-2- How to ful ll these requirements?
RQ2-3- How can a high quality of the merge result be achieved?
RQ2-4- How to accomplish consistency in the merged ontology?
2</p>
    </sec>
    <sec id="sec-2">
      <title>State of the Art</title>
      <p>
        Merging strategies basically have been divided into two main categories [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]:
"binary" and "n-ary". The binary approach allows merging of two ontologies
at a time, while n-ary strategy lets to merge n ontologies (n &gt; 2). To
deal with merging more than two ontologies, the binary strategy needs the
quadratic complexity of merging operations and also needs a nal analysis to
add missing global properties [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. However, in the n-ary strategy, the number
of merging steps is minimized. Moreover, a considerable amount of semantic
analysis can be performed before merging, thus avoiding the necessity of a further
analysis and transformation of the merged ontology. This approach also is called
"holistic" strategy [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Indeed, with continuously increasing amount of data
being produced, developing solutions to deal with the simultaneous merging of
di erent ontologies is becoming necessary.
      </p>
      <p>
        To process multiple ontologies, for instance, in the multiple ontologies
matching scenario in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], to match 4000 web-extracted ontologies on six
computers using a pairwise strategy took about one year, which indicates the
insu cient scalability of pairwise strategies. As a further example of multiple
ontologies merging, the integration process in the biomedical ontology UMLS
Metathesaurus [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] was highly complex and involved a signi cant e ort by domain
experts. To the best of our knowledge, the holistic ontology merging has not
been practically applied and still is one of the key challenges in this eld. As
an example, Porsche [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] semi-automatically merges many tree-structured XML
schemas and holistically clusters all matching elements in the nodes of the merged
schema. The nal merge result depends on the order in which the source schemas
are matched and merged. Low alignment accuracy and low minimality on the
merge result arise from its simple heuristic functions. Furthermore, consistency
issues have not been considered.
      </p>
      <p>
        Principally, general processes in the existing approaches seem to indicate
two di erent strategies: "one-level merge" and "two-levels merge". In the latter
one, an intermediate merge result is produced at the rst level. Then, in the
second phase, the intermediate result is re ned to produce a nal merge result. In
contrast, one-level merge tends to produce the merge result in one incrementally
processing step [
        <xref ref-type="bibr" rid="ref10 ref13">10,13</xref>
        ]. In each element combination, they analyzed whether it
does not have any inconsistencies with other previous merged elements. Although
the two-levels merge is the most used strategy in the literature reviews [
        <xref ref-type="bibr" rid="ref14 ref18 ref23">14,18,23</xref>
        ],
there is no comparison between the e ectiveness of these two strategies. We have
prioritized to use one-level merge strategy and check the arising inconsistencies
before applying each combination.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Proposed Approach</title>
      <p>This research aims to comprehensively address the holistic multiple ontologies
merging issue to improve the shortcomings of previous approaches. We have been
investigating the existing methods and found the scalability issue as an ongoing
challenge. Therefore, we have four main objectives:
{ Overcoming the scalability problem in merging multiple
ontologies: We aim to develop a framework for holistic multiple ontologies
merging to overcome the scalability issue.
{ Achieving a high accuracy in the merge result: In order to gain a high
accuracy, the merge requirements should be ful lled, however, it should be
possible to customize them to the task at hand. We plan to derive a method
to apply these customized requirements in a way that they do not contradict
each other.
{ Developing a web tool: As a proof of concept, this research aims to
develop a web tool for merging multiple ontologies. This tool can be divided
into two sections: merger and evaluator. The latter includes systematic
criteria for evaluating the merged ontology independent from the merge
techniques.
{ Validating: To evaluate our framework, we will carry out a set of
experimental tests to analyze the performance of the tool and the merge
algorithm.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Methodology</title>
      <p>
        Ontology merging is the process of building a new coherent ontology (called
a merged ontology) from given input ontologies to provide a uni ed access
on the domain. Principally, it requires to know which elements are equal
to each other. This can be achieved by an ontology alignment method to
detect the corresponding pairs. Many signi cant advances such as [
        <xref ref-type="bibr" rid="ref1 ref21 ref22 ref8">1,8,21,22</xref>
        ]
have already been made for the automatic ontology alignment. Moreover, the
most state-of-the-art matching systems participate in OAEI campaigns 1 have
achieved promising results in several use cases. Therefore, we assume that the
alignments are already determined by an existing tool in this research. Same as
our assumption, using the pre-determined mappings has previously been applied
in [
        <xref ref-type="bibr" rid="ref13 ref16 ref18">13,16,18</xref>
        ].
      </p>
      <p>Below, a schematic of our holistic multiple ontologies merging framework is
illustrated in Fig. 1. It gets as an input a set of ontologies with their alignments,
and automatically generates a merged ontology with a set of output mapping
between the merged and the input ontologies. In the preprocessing step, the
input ontologies and the pre-determined mapping are imported into a repository.
Afterwards, the elements of the n input ontologies will be clustered into the k
clusters in the clustering step. Finally, the combination phase will be applied
to combine the k created clusters into the merged ontology. Thus, instead of
the quadratic merge process, this holistic approach needs k merge operations.
Here the number of clusters is noticeably smaller than the number of input
ontologies (k n). Therefore, to overcome the scalability problem in this
framework, rather than merging a large number of ontologies (n), we merge a
small number of clusters (k). Once the merged ontology is created, the output</p>
      <sec id="sec-4-1">
        <title>1 http://oaei.ontologymatching.org/</title>
        <p>mapping between the merge and the input ontologies will be produced through
a backward process in the postprocessing phase.</p>
        <p>Contributing to RQ1, the clustering component in Fig. 1 is accelerating the
combination process by minimizing the search space in the way of breaking
merging n ontologies into the merging of k clusters. Generally, clustering z
elements of all input ontologies into k clusters needs z(z2 1) times comparisons.
Alternatively, would be comparing z k elements with only k elements, which it
requires z k times comparisons. Therefore, we will use a core-clustering method,
where all z elements will be compared with k core of the clusters through a
semantic similarity function. We deem that the elements with a high number
of correspondences in the input ontologies are more suitable to be considered
as the cores. In this follow, the core of each cluster and the optimal number of
clusters for each set of ontologies will be dynamically determined by using their
mapping information.</p>
        <p>To address RQ2, we divide the combination process into two steps
through the combining component (Fig. 1): (i) intra-combination, and (ii)
inter-combination. In the rst step, the elements inside the clusters will be
combined to create k sub-ontologies. In the inter-combination step, the k
generated sub-ontologies will be attached to create the nal merged ontology.
Here, detecting the nest place of the join is a challenging task. We intend to
nd it in a heuristic method by narrowing comparison between the leaves and
the core of sub-ontologies.</p>
        <p>
          To capture the accuracy and consistency of the result, the
predetermined merge requirements will be assessed before applying each
combining process. The existing merge technique partially aims to satisfy some
of them, however, they should be customized by the task at the hand (RQ2-1 ).
To this end, we are providing a checklist including a variety of requirements
(extracted from [
          <xref ref-type="bibr" rid="ref13 ref15 ref16 ref18">13,15,16,18</xref>
          ]), where the user can customize it (as is shown in
Fig. 2). Each requirement will be performed as a set of rules with a weighting
strategy (RQ2-2 ), in the way that they do not have a contraindicated with
each other. Utilizing these requirements tends to guarantee the consistency of
the created merged ontology, and consequence the quality of the merge result
(RQ2-3 ). To accomplish consistency (RQ2-4 ), the con icts and inconsistencies
should be detected at rst via a reasoner, then they should be resolved. This is
under our survey to handle inconsistencies with some con ict resolver such as
subjective logic-based approach [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
        </p>
        <p>To develop a web-based tool, a preliminary version of CoMerger
is being provided by using the OWL API library 2 and a user-friendly
GUI as is shown in Figs. 2 and 3. The further version might also include the
analysis the execution log of the merge evaluator and visualization of the results.
Evaluation Protocol: We address the required evaluations as below:
E1. To study our main research question, we will compare the quality and
complexity of merging multiple ontologies by a series of the binary merges
rather than our holistic merge approach. The quality will be measured as
states in E5, and the complexity will be measured as the number of required
operations.</p>
        <p>
          E2. The aim of clustering is to accelerate the merge process. Therefore, to
evaluate RQ1-1, we will compare the quality of the merge result and
complexity of the merge operations with and without using clustering.
E3. To evaluate our heuristic approach on RQ1-2, we will compare the quality
of the merge result on the experimental tests for k = 1; :::; n. Besides, the
cohesion and coupling [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] of the created clusters will be analyzed.
E4. A use case testing will investigate the feasibility of which requirements are
worth being considered (RQ2-1 ) and to what extent they can be satis ed
(RQ2-2 ).
        </p>
        <p>
          E5. The quality of the merge result regarding RQ2-3 can be evaluated in three
scenarios: (i) Measuring the integrity of the merged ontology with the merge
quality criteria, namely, compactness, completeness, and minimality [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. In
addition, we are investigating to recast these measures in a broad range of
systematic criteria in our evaluator tool. (ii) Comparing our result with the
mentioned state-of-the-art approaches. (iii) Comparison with human experts
results on the part of our datasets.
        </p>
        <p>E6. The consistency of the merge result can be evaluated by measuring the
ful llment of the customized merge requirements with either a reasoner or
an expert (RQ2-4 ).</p>
        <p>E7. We demonstrate the method's scalability by illustrating the performance
test results on the set of real-life ontologies from BioPortal repository 3 and
OAEI datasets. The rst one currently contains more than 700 biomedical
ontologies with thousand of classes, and the second one includes several
domains such as biodiversity and ecology, anatomy and conference domains.
Here, the runtime performance will be evaluated based on the number of
ontologies versus the time required for merge operations.</p>
      </sec>
      <sec id="sec-4-2">
        <title>2 http://owlapi.sourceforge.net</title>
      </sec>
      <sec id="sec-4-3">
        <title>3 https://bioportal.bioontology.org</title>
        <p>
          The rst conceptual ontology-based data integration work ow has already been
represented in [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. Additionally, we investigated the role of mapping in the merge
process [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. Moreover, we developed a highly accurate similarity method 4 by
applying Information Content as an optimization problem [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. We will revise it
to be extended in our similarity function. Finally, the rst version of our tools,
merger (Fig. 2) and evaluator (Fig. 3) are under our development to be published
online.
6
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Discussion</title>
      <p>
        Ontology merging is often a necessity in applications of the Semantic Web. To
this end, our aim is to provide a holistic multiple ontologies merging, namely
CoMerger, to satisfy the scalability issue. The e cient processing will be held
by breaking the n ontologies processing into the k clusters merging, with a
minor overhead of the clustering process. Each component has a high e ect on
the quality of the nal merge result, therefore, the di culty of this research
would be carefully ne-tune the correctness of each sub-function. Besides, in the
aspect of knowledge integration, the possibility of ambiguous knowledge being
introduced in the nal merged ontology will be another obstacle in this research,
which bring us to deal with the reasoning from ambiguous knowledge challenge
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. The future works of this research can be extended to the merging data
in the schema-level on the Linked Open Data (LOD) scenarios, also utilizing
parallel techniques in our framework.
      </p>
      <sec id="sec-5-1">
        <title>4 http://simbio.uni-jena.de</title>
        <p>The author would like to thank Prof. Birgitta Konig-Ries and Dr. Alsayed
Algergawy for their valuable supervising. The author is supported by a scholarship
from German Academic Exchange Service (DAAD).</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>A.</given-names>
            <surname>Algergawy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Babalou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Kargar</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S. H.</given-names>
            <surname>Davarpanah</surname>
          </string-name>
          .
          <article-title>Seecont: A new seeding-based clustering approach for ontology matching</article-title>
          .
          <source>In ADBIS</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>A.</given-names>
            <surname>Algergawy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Babalou</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Ko</surname>
          </string-name>
          <article-title>nig-</article-title>
          <string-name>
            <surname>Ries</surname>
          </string-name>
          .
          <article-title>A new metric to evaluate ontology modularization</article-title>
          .
          <source>In SumPre with ESWC</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>S.</given-names>
            <surname>Babalou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Algergawy</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Ko</surname>
          </string-name>
          nig-Ries.
          <article-title>An ontology-based scienti c data integration work ow</article-title>
          .
          <source>In Proc. of the 29th GVDB.</source>
          , pages
          <volume>30</volume>
          {
          <fpage>35</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>S.</given-names>
            <surname>Babalou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Algergawy</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Ko</surname>
          </string-name>
          <article-title>nig-</article-title>
          <string-name>
            <surname>Ries</surname>
          </string-name>
          .
          <article-title>A particle swarm-based approach for semantic similarity computation</article-title>
          .
          <source>In OTM</source>
          , pages
          <volume>161</volume>
          {
          <fpage>179</fpage>
          . Springer,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>S.</given-names>
            <surname>Babalou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Algergawy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Lantow</surname>
          </string-name>
          , and
          <string-name>
            <surname>B.</surname>
          </string-name>
          <article-title>Konig-Ries. Why the mapping process in ontology integration deserves attention</article-title>
          .
          <source>In Proc. of the 19th iiWAS Conf.</source>
          , pages
          <volume>451</volume>
          {
          <fpage>456</fpage>
          . ACM,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>C.</given-names>
            <surname>Batini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Lenzerini</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S. B.</given-names>
            <surname>Navathe</surname>
          </string-name>
          .
          <article-title>A comparative analysis of methodologies for database schema integration</article-title>
          .
          <source>In CSUR</source>
          ,
          <volume>18</volume>
          (
          <issue>4</issue>
          ):
          <volume>323</volume>
          {
          <fpage>364</fpage>
          ,
          <year>1986</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>O.</given-names>
            <surname>Bodenreider</surname>
          </string-name>
          .
          <article-title>The uni ed medical language system (umls): integrating biomedical terminology</article-title>
          .
          <source>Nucleic acids research</source>
          ,
          <volume>32</volume>
          (
          <issue>suppl 1</issue>
          ):D267{
          <fpage>D270</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>S. H.</given-names>
            <surname>Davarpanah</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Algergawy</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Babalou</surname>
          </string-name>
          .
          <article-title>Fuzzy inference-based ontology matching using upper ontology</article-title>
          .
          <source>In ADBIS</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>F.</given-names>
            <surname>Duchateau</surname>
          </string-name>
          and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Bellahsene</surname>
          </string-name>
          .
          <article-title>Measuring the quality of an integrated schema</article-title>
          .
          <source>In ER</source>
          , pages
          <volume>261</volume>
          {
          <fpage>273</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>M.</given-names>
            <surname>Fahad</surname>
          </string-name>
          .
          <article-title>Merging of axiomatic de nitions of concepts in the complex owl ontologies</article-title>
          .
          <source>AIR</source>
          ,
          <volume>47</volume>
          (
          <issue>2</issue>
          ):
          <volume>181</volume>
          {
          <fpage>215</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>W.</given-names>
            <surname>Hu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Qu</surname>
          </string-name>
          .
          <article-title>How matchable are four thousand ontologies on the semantic web</article-title>
          .
          <source>In ESWC</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>A. J sang and</surname>
            <given-names>S. J.</given-names>
          </string-name>
          <string-name>
            <surname>Knapskog</surname>
          </string-name>
          .
          <article-title>A metric for trusted systems</article-title>
          .
          <source>In Proc. of the 21st National Security Conf. NSA</source>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>S. P.</given-names>
            <surname>Ju</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. E.</given-names>
            <surname>Esquivel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. M.</given-names>
            <surname>Rebollar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. C.</given-names>
            <surname>Su</surname>
          </string-name>
          , et al.
          <article-title>Creado{a methodology to create domain ontologies using parameter-based ontology merging techniques</article-title>
          .
          <source>In MICAI</source>
          , pages
          <volume>23</volume>
          {
          <fpage>28</fpage>
          . IEEE,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>M. Mahfoudh</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Thiry</surname>
            , G. Forestier, and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Hassenforder</surname>
          </string-name>
          .
          <article-title>Algebraic graph transformations for merging ontologies</article-title>
          .
          <source>In MEDI</source>
          , pages
          <volume>154</volume>
          {
          <fpage>168</fpage>
          . Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          and
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>The prompt suite: interactive tools for ontology merging and mapping</article-title>
          .
          <source>IJHCS</source>
          ,
          <volume>59</volume>
          (
          <issue>6</issue>
          ):
          <volume>983</volume>
          {
          <fpage>1024</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>R. A.</given-names>
            <surname>Pottinger</surname>
          </string-name>
          and
          <string-name>
            <given-names>P. A.</given-names>
            <surname>Bernstein</surname>
          </string-name>
          .
          <article-title>Merging models based on given correspondences</article-title>
          .
          <source>In Proc. of the 29th int. conf. on VeLDB-</source>
          Volume
          <volume>29</volume>
          , pages
          <fpage>862</fpage>
          {
          <fpage>873</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>E. Rahm.</surname>
          </string-name>
          <article-title>The case for holistic data integration</article-title>
          .
          <source>In ADBIS</source>
          , pages
          <volume>11</volume>
          {
          <fpage>27</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <given-names>S.</given-names>
            <surname>Raunich</surname>
          </string-name>
          and
          <string-name>
            <given-names>E.</given-names>
            <surname>Rahm</surname>
          </string-name>
          .
          <article-title>Target-driven merging of taxonomies with atom</article-title>
          .
          <source>Inf. Syst.</source>
          ,
          <volume>42</volume>
          :1{
          <fpage>14</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>S. K.</given-names>
            <surname>Reed</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Pease</surname>
          </string-name>
          .
          <article-title>Reasoning from imperfect knowledge</article-title>
          .
          <source>Cognitive Systems Research</source>
          ,
          <volume>41</volume>
          :
          <fpage>56</fpage>
          {
          <fpage>72</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <given-names>K.</given-names>
            <surname>Saleem</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Bellahsene</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E.</given-names>
            <surname>Hunt</surname>
          </string-name>
          . Porsche:
          <article-title>Performance oriented schema mediation</article-title>
          .
          <source>Information Systems</source>
          ,
          <volume>33</volume>
          (
          <issue>7</issue>
          ):
          <volume>637</volume>
          {
          <fpage>657</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>M. Shamsfard</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Helli</surname>
            , and
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Babalou</surname>
          </string-name>
          . Omega:
          <article-title>Ontology matching enhanced by genetic algorithm</article-title>
          .
          <source>In ICWR</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <given-names>P.</given-names>
            <surname>Shvaiko</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Euzenat</surname>
          </string-name>
          .
          <article-title>Ontology matching: State of the art and future challenges</article-title>
          .
          <source>IEEE Trans. Knowl</source>
          . Data Eng.,
          <volume>25</volume>
          (
          <issue>1</issue>
          ):
          <volume>158</volume>
          {
          <fpage>176</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <given-names>G.</given-names>
            <surname>Stumme</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Maedche.</surname>
          </string-name>
          Fca-merge:
          <article-title>Bottom-up merging of ontologies</article-title>
          .
          <source>In IJCAI</source>
          , pages
          <volume>225</volume>
          {
          <fpage>230</fpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>