<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>KOSIMap: Ontology alignments results for OAEI 2009</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Quentin Reul</string-name>
          <email>Quentin.Reul@vub.ac.be</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Je Z. Pan</string-name>
          <email>jeff.z.pan@abdn.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Presentation of KOSIMap</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>State</institution>
          ,
          <addr-line>Purpose, General Statement</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Aberdeen</institution>
          ,
          <addr-line>Aberdeen AB24 3FX</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>VUB STARLab, Vrije Universiteit Brussel</institution>
          ,
          <addr-line>Pleinlaan 2, 1050 Brussels</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Ontology mapping has been recognised as an important approach to identifying similar information in heterogeneous ontologies. The Knowledge Organisation System Implicit Mapping (KOSIMap) approach relies on DL reasoning (i) to extract background knowledge about every entity, and (ii) to remove inappropriate correspondences from an alignment. The main assumption is that the use of this background knowledge reduces erroneous mappings, thus increasing coverage. In this paper, we provide an overview of KOSIMap, and present the result of our system for its rst participation to the Ontology Alignment Evaluation Initiative (OAEI).</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        1.1
KOSIMap is an extensional and asymmetric matching approach implemented
in Java. Given two consistent ontologies, KOSIMap aligns entities in the source
ontology to entities in the target ontology by extracting background knowledge
about entities based on DL reasoning. More speci cally, a DL reasoner (e.g.
FaCT++ [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], Pellet [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]) deduces logical consequences about an entity based on
the asserted axioms de ned in an ontology. Moreover, we investigate the use of
DL reasoning to remove inappropriate correspondences from an alignment. The
main assumption is that the use of these logical consequences reduces erroneous
mappings, thus increasing coverage.
      </p>
      <p>The current KOSIMap implementation of produces a set of homogeneous
correspondences, where classes are mapped to classes. object properties to object
properties, and datatype properties to datatype properties. More speci cally,
the approach computes the similarity between two entities based on their
respective sets of features (e.g. subsumption). Note that KOSIMap only considers
the equivalence mapping relation between two entities.
1.2</p>
    </sec>
    <sec id="sec-2">
      <title>Speci c Techniques Used</title>
      <p>
        The KOSIMap system calculates the similarity between entities for a pair of
ontologies by analysing three features; namely lexical description (i.e. label),
hierarchical structure (subsumers for concepts, and super-properties), and internal
structure (inherited properties for classes, domains and ranges for object
properties, and domains for datatype properties). The measures obtained by comparing
these three features are then combined into a single value using a weighted sum
in a similar manner to [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. These weights are set by a user depending on the
input ontologies, and requirements for the output.
      </p>
      <p>
        Figure 1 shows the architecture of our approach. KOSIMap consists of three
main steps; namely Pre-Processing, Similarity Generation, and Alignment
Extraction. The pre-processing step includes three sub-tasks. It rst parses the
two ontologies with the OWL API [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The OWL API provides an interface
to access the explicit information for each entity de ned in an ontology. The
API supports several representations including XML/RDF, KRSS and OBO
at les. Secondly, natural language techniques (i.e. elimination, lemmatization,
and transformation) are applied to each entity to obtain their most basic form.
Entities are not only de ned by annotation properties, but also by the semantics
provided by the axioms in the ontology. Thus, the nal pre-processing sub-task
extracts logical consequences (i.e. background information) resulting from
asserted axioms. The current implementation uses the FaCT++ API3 to classify
the di erent ontologies.
      </p>
      <p>De nition 1 (Degree of Commonality Coe cient). Given two sets Ss and
St, the degree of commonality coe cient between them, denoted DoCCoe (Ss, St)
is de ned as:</p>
      <p>DoCCoe (Ss; St) =
1</p>
      <p>∑ max sim(ei; ej )
max(jSsj; jStj) ei2Ss ej2St
(1)
where Ss is the source set, St is the target set, and sim(ei; ej ) computes the
similarity between pair of elements in the two sets.</p>
      <p>
        Secondly, the similarity generator computes three kinds of similarities; namely
syntax similarity, property-based similarity, and class-based similarity. The most
basic feature of entities is their labels. Labels are human identi ers (i.e. words)
expressed in a vocabulary shared by experts in the same domain. Therefore, we
assume that equivalent classes are likely to be modelled using similar labels (or
names). KOSIMap relies on string similarity (e.g. Jaro-Winkler [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], Q-Gram
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], Monge-Elkan [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], and SMOA [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]) to calculate the label similarity for each
pair of entities. The SimMetrics API4 provides a library of normalised and
optimised similarity (or distance) metrics. The property-based similarity and the
class-based similarity both rely on the degree of commonality coe cient
(Definition 1) to provide an similarity value between two sets of complex objects.
The property-based similarity focuses on features containing properties (i.e. set
of super-properties for OWLObjectProperty and OWLDataProperty and the set
of inherited properties for OWLClass), while the class-based similarity focuses
on features containing classes (i.e. set of subsumers for OWLClass and the set
of binary relation containing their domain and range for OWLObjectProperty).
The results of the di erent similarity approaches are then aggregated for each
pair of entities and stored into a n*m matrix, where is the number of element
in the source ontology and m is the number of elements in the target ontology.
The aggregated similarity score for a pair of entities is obtained by applying a
weighted function (see Equation 2), where the weights (i.e. wk) for each measure
3 http://code.google.com/p/factplusplus/
4 http://sourceforge.net/projects/simmetrics/
is in the range [
        <xref ref-type="bibr" rid="ref1">0,1</xref>
        ] and their total is 1.
      </p>
      <p>sim(e1; e2) =
n
∑ wksimk(e1; e2)
k=0
(2)</p>
      <p>
        After the similarity aggregation, we have a n*m matrix containing pairs of
entities with a similarity value. The problem is to extract a set of relevant
mappings from the matrix. This is normally achieved by discarding all candidate
mappings below a threshold . However, this method may return multiple
mappings for each entity in the source ontology. In KOSIMap, we follow a two-step
approach to extract mappings. First, the approach extracts a pre-alignment from
the matrix, by selecting the maximum similarity score for each row in the matrix
(i.e. for each n). This pre-alignment is then passed through a re nement process,
which eliminates inappropriate mappings. In KOSIMap, we use DL reasoning to
extract the local implication as part of the mapping extraction process. This
approach extends the work by Wang and Xu [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], which only checked whether
local implications were asserted in an ontology. As our approach only supports
equivalent mapping relations, we focus on removing inconsistent mappings from
the pre-alignment. Inconsistent mappings occur when the local consistency of
an ontology is violated by the introduction of a correspondence between two
ontologies. For example, an local inconsistency would occur if several entities in
the source ontology are mapped to the same entity in the target ontology, and
that the two classes are not recognised as equivalent by a DL reasoner.
1.3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Adaptations Made for the Evaluation</title>
      <p>As stated in Section 1.1, KOSIMap is an asymmetric matching approach. The
asymmetricity results from Equation 1, which consider the maximum value for
each element in the source set. However, the organisers of OAEI campaign
requested that we delivered a symmetric set of alignments. As a result, we modify
the similarity generation for the property-based and class-based similarity to
consider the biggest set as the source set. Moreover, we implemented a Java
class to run the di erent tracks in batch mode. Moreover, the parameters taken
by the approach (i.e. weights and thresholds) were tuned and set depending on
the type of information contained in the ontologies to be mapped. For example,
the property-based similarity was not calculated for the directory track as no
properties were de ned.
1.4</p>
    </sec>
    <sec id="sec-4">
      <title>Link to the Set of Provided Alignments (in align format)</title>
      <p>The results of the 2009 OAEI campaign for the KOSIMap system can be found
at http://www.csd.abdn.ac.uk/~qreul/research/OAEI2009.zip.
2</p>
      <sec id="sec-4-1">
        <title>Results</title>
        <p>
          In this section, we present the results of the 2009 OAEI campaign obtained
by the KOSIMap system. KOSIMap was used to generate alignments for four
tracks, namely benchmark, anatomy, conference and directory. Note that the full
results of the Alignment Evaluation Initiative (OAEI) 2009 Campaign can be
found in [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. The experiments were carried on a Mac Book with an Intel Core
2 Duo processor (2.13GHz) and 4GB RAM running Mac OSX. The minimum
memory for the Java Virtual Machine was set to 512MB, while its maximum was
set to 1GB. In this experiment, we used FaCT++ as the default DL reasoner
unless stated otherwise.
2.1
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Benchmark</title>
      <p>The benchmark data set contains 111 alignment tasks. KOSIMap follows the
approach de ned in Section 1.2. In this experiment, we used the Q-Gram
similarity measure to compute the syntax similarity and as the similarity function
for the degree of commonality coe cient. The FaCT++ reasoner returned an
exception ( NonSimpleRoleInNumberRestrictionException) for some tests (i.e.
222, 230, 237, 251, 258, and 304), so we used the Pellet reasoner for this test.
The threshold was set to 0.2, while the weights were set as follows:
{ Weight for syntax similarity: 0.3
{ Weight for property-based similarity: 0.2
{ Weight for class-based similarity: 0.5</p>
      <p>KOSIMap gets near perfect alignment (Precision and Recall is 0.99) for tests
101, 103 and 104 (Table 1). Although KOSIMap performs quite well in the
2xx tests, it yields very low recall ( 0:1) when labels in the target ontology
have been scrambled (i.e. tests #202 #248, #249, #25x, and #26x). Note that
KOSIMap yields high recall (i.e. 0:9) for tests #221 to #247. For the real
ontology data set (i.e. 3xx), KOSIMap yields 0.815 for Precision and .425 for
Recall. Finally, KOSIMap achieves a much better harmonic mean precision than
edna even though our system yields the same recall.
The anatomy data set consists of two large scale anatomy ontologies. On the one
hand, the Adult Mouse Anatomical Dictionary5 represents the anatomical
structure of the postnatal mouse and contains 2744 classes organised hierarchically</p>
      <sec id="sec-5-1">
        <title>5 http://www.informatics.jax.org/searches/AMA_form.shtml</title>
        <p>by \is-a" and \part-of" relationships. On the other hand, the NCI Thesaurus6
is a reference terminology and biomedical ontology covering clinical care,
translational and basic research, public information, and administrative activities.
This ontology contains a subset of the classes de ned in the thesaurus (i.e. 3304
classes). Note that the property-based similarity was discarded for this track as
these ontologies only contain a very small number of properties.</p>
        <p>KOSIMap produces an alignment for three of the four sub-tasks of this track:
1. Optimal solution: The optimal solution is obtained with a threshold set to
0.6, the syntax similarity set to 0.6 and the class-based similarity set to 0.4.</p>
        <p>It took KOSIMap approximately 5 min to generate the alignment.
2. Optimal precision: The optimal solution is obtained with a threshold set to
0.7, the syntax similarity set to 0.6 and the class-based similarity set to 0.4.</p>
        <p>It took KOSIMap approximately 5 min to generate the alignment.
3. Optimal recall : The optimal solution is obtained with a threshold set to 0.6,
the syntax similarity set to 0.6 and the class-based similarity set to 0.4. It
took KOSIMap approximately 5 min to generate the alignment.</p>
        <p>The results of the anatomy track are shown in Table 2. KOSIMap takes
around 5 minutes to extract mappings between the Adult Mouse Anatomical
Dictionary and the NCI Thesaurus and the F-Measure is 0.72. We observer
signi cant di erences with regard to the trade-o between precision and recall.
For instance, we observe that the recall obtained by KOSIMap falls from 0.62 to
0.45 when generating an alignment for optimal precision sub-task. As KOSIMap
favours recall over precision, the score obtained for the optimal recall sub-task
is the same as the optimal solution.
2.3</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Conference</title>
      <p>This track contains 15 ontologies covering the conference organization domain.
These ontologies di er in terms of DL expressivity and size. For example, ekaw.owl
is represented in SHIN , while paperdyne.owl is expressed in ALCHIN (D).</p>
      <p>KOSIMap generated 105 non-empty alignments with parameters set as
follows:
{ Weight for syntax similarity: 0.3
{ Weight for property-based similarity: 0.2
{ Weight for class-based similarity: 0.5</p>
      <sec id="sec-6-1">
        <title>6 http://www.cancer.gov/cancerinfo/terminologyresources/</title>
        <p>Table 3 shows the precision, recall, and F-measure computed for three
different thresholds (0.2, 0.5, and 0.7). The results show that KOSIMap reaches
an optimal solution with the threshold set to 0.5 before obtaining lower
performances with higher thresholds. Moreover, the precision achieved by our system
increases at the same time as the threshold.
The directory track consists of 4639 test cases. As no properties (object
properties or datatype properties) are found in this track, the property-based similarity
is discarded for this track. In this experiment, the threshold is set to .0, while
the weights are set to 0.6 (for syntax similarity) and 0.4 (for the class-based
similarity). Due of the low expressivity of the ontologies (i.e. AL), we simpli ed
the rules to retain the correspondence with the highest score when a class in
the source ontology maps to several classes in the target ontology. KOSIMap
takes just over 1 minute to generate the 4639 alignments. The preliminary
results of this track yielded a score of 0.618 for Precision, 0.453 for Recall, and a
F-Measure of 0.523.
3</p>
        <sec id="sec-6-1-1">
          <title>General Comments</title>
          <p>3.1</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Comments on the Results</title>
      <p>From the results we can see that KOSIMap can take advantage of all di erent
features associated with entities. The lexical description is especially important
to achieve high precision and recall, while the hierarchical and internal structure
are used to re ne the nal alignment. For example, tests in the benchmark track
with scrambled labels (i.e. tests 248 to 266) tend to yield very low recall.</p>
      <p>Based on the anatomy track, we have demonstrated the scalability of our
approach. Although the two ontologies are not very expressive (i.e. ALE for
AMA and ALE + for the NCI thesaurus), we have shown that the use of a
DL reasoner does not impact the scalability of our system. Thus, this result
suggests that the use of a reasoner does not greatly increase the runtime of the
mapping task. Note that testing on more expressive large-scale ontologies should
be carried to further test this observation.
KOSIMap uses di erent strategies to extract correspondences between two
ontologies. Based on the test library, we have seen that some strategies (e.g.
property-based similarity) were not always useful to extract alignments. One
possible way to improve the current system would be to include a strategy
selection module. With strategy selection, KOSIMap could avoid some some noise
produced by some strategies when the information these strategies rely on is not
adequate. For example, when no properties are de ned in the ontology.</p>
      <p>Another improvement to the system would be to include a module to ne-tune
weights when combining the di erent similarity measure. The current approach
relies on the user to analyse the information contained in the ontologies. It is
important to note that this is process is both time-consuming and error prone.
A solution to this problem would be to consider the DL expressivity of both
ontologies to analyse the impact of each measure on the global similarity value.
The advantage of the OAEI test library is that it provides a wide range of tests
covering real word and modied ontologies. For example, the benchmark track
allows anyone to clearly identify the strengths and weaknesses of their systems.
The library also includes test cases for comparing large scale ontologies. However,
the ontologies provided in the anatomy track are not very expressive. As a result,
it is di cult to address the impact of using DL reasoners on large scale ontologies.
4</p>
      <sec id="sec-7-1">
        <title>Conclusion</title>
        <p>In this paper, we present the KOSIMap system, which aligns entities from two
ontologies. This system relies on DL reasoning to (i) extract background
knowledge about every entity, and (ii) to remove inappropriate correspondences from
an alignment. KOSIMap consists of three main steps; namely Pre-Processing,
Similarity Generation, and Alignment Extraction. It rst parses the two
ontologies, extracts the implicit structure of both ontologies using an OWL DL
reasoner, and applies natural language techniques to lexical descriptions (i.e.
labels). Next, it computes three di erent types of similarities for every pair of
entities. These similarity values are then combined and stored in a n*m
matrix from which a pre-alignment is extracted. This pre-alignment is then passed
through a re nement process, which eliminates inconsistent mappings.</p>
        <p>Secondly, we report the results obtained by KOSIMap for its rst
participation to the Ontology Alignment Evaluation Initiative. From the results of
the benchmark test case, we can see that our system can take advantage of
all di erent features associated with entities during the ontology mapping task.
We have also shown that KOSIMap remains scalable despite using DL reasoning
throughout the mapping process. However, testing on more expressive large-scale
ontologies should be carried to further test this observation.</p>
      </sec>
      <sec id="sec-7-2">
        <title>Acknowledgements</title>
        <p>The IPAS project is co-funded by the Technology Strategy Board's Collaborative
Research and Development programme (www.innovateuk.org) and Rolls-Royce
(project No. TP/2/IC/6/I/10292).</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>S.</given-names>
            <surname>Castano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ferrara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Montanelli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. N.</given-names>
            <surname>Hess</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Bruno</surname>
          </string-name>
          .
          <article-title>State of the art on ontology coordination and matching</article-title>
          .
          <source>Report FP6-027538</source>
          , BOEMIE,
          <year>March 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>M.</given-names>
            <surname>Ehrig</surname>
          </string-name>
          and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Sure</surname>
          </string-name>
          .
          <article-title>Ontology mapping - an integrated approach</article-title>
          .
          <source>In Proceedings of the 1st European Semantic Web Symposium (ESWS 04)</source>
          , pages
          <fpage>76</fpage>
          {
          <fpage>91</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>J.</given-names>
            <surname>Euzenat</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ferrara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Hollink</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Malaise</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Meilicke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nikolov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Pane</surname>
          </string-name>
          , F. Schar e,
          <string-name>
            <given-names>P.</given-names>
            <surname>Shvaiko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Spiliopoulos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Stuckenschmidt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Svab-Zamazal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Svatek</surname>
          </string-name>
          , C. T. dos
          <string-name>
            <surname>Santos</surname>
            , and
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Vouros</surname>
          </string-name>
          .
          <article-title>Preliminary results of the ontology alignment evaluation initiative 2009</article-title>
          .
          <source>In Proceedings of the 4th International Workshop on Ontology Matching (OM-2009)</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>J.</given-names>
            <surname>Euzenat</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Shvaiko</surname>
          </string-name>
          . Ontology Matching. Springer-Verlag, Berlin,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>J.</given-names>
            <surname>Euzenat</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Valtchev</surname>
          </string-name>
          .
          <article-title>An integrative proximity measure for ontology alignment</article-title>
          .
          <source>In Proceedings of ISWC-2003 Workshop on Semantic Information Integration, page 3338</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>O.</given-names>
            <surname>Noppens</surname>
          </string-name>
          .
          <source>Igniting the OWL 1</source>
          .
          <article-title>1 touch paper: The OWL API</article-title>
          .
          <source>In Proceedings of the 3rd OWL Experienced and Directions Workshop (OWLED</source>
          <year>2007</year>
          ), Innsbruck, Austria,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>A.</given-names>
            <surname>Maedche</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Staab</surname>
          </string-name>
          .
          <article-title>Measuring similarity between ontologies</article-title>
          .
          <source>In Proceedings of the 13th International Conference on Knowledge Engineering and Knowledge Management (EKAW</source>
          <year>2002</year>
          ), pages
          <fpage>251</fpage>
          {
          <fpage>263</fpage>
          ,
          <string-name>
            <surname>Siguenza</surname>
          </string-name>
          , Spain,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>A. E.</given-names>
            <surname>Monge</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Elkan</surname>
          </string-name>
          .
          <article-title>The eld matching problem: Algorithms and applications</article-title>
          .
          <source>In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining</source>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>E.</given-names>
            <surname>Sirin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Katz. Pellet</surname>
          </string-name>
          :
          <article-title>A practical OWL-DL reasoner</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          ,
          <volume>5</volume>
          (
          <issue>2</issue>
          ):
          <volume>51</volume>
          {
          <fpage>53</fpage>
          ,
          <year>June 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. G. Stoilos, G. Stamou, and
          <string-name>
            <given-names>S.</given-names>
            <surname>Kollias</surname>
          </string-name>
          .
          <article-title>A string metric for ontology alignment</article-title>
          .
          <source>In Proceeding of the 4th International Semantic Web Conference (ISWC</source>
          <year>2005</year>
          ),
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. E. Sutinen and
          <string-name>
            <given-names>J.</given-names>
            <surname>Tarhio</surname>
          </string-name>
          .
          <article-title>On using Q-Gram locations in approximate string matching</article-title>
          .
          <source>In Proceedings of the 3rd Annual European Symposium on Algorithms (ESA 95), page 327340</source>
          ,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>D.</given-names>
            <surname>Tsarkov</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Horrocks.</surname>
          </string-name>
          <article-title>FaCT++ description logic reasoner: System description</article-title>
          .
          <source>In Proceedings of the 3rd International Joint Conference on Automated Reasoning (IJCAR</source>
          <year>2006</year>
          ), pages
          <fpage>292</fpage>
          {
          <fpage>297</fpage>
          , Seattle, USA,
          <year>August 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>P.</given-names>
            <surname>Wang</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Xu</surname>
          </string-name>
          .
          <article-title>Debugging ontology mappings: A static approach</article-title>
          .
          <source>Computing and Informatics</source>
          ,
          <volume>22</volume>
          :
          <fpage>1001</fpage>
          {
          <fpage>1015</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>W. E.</given-names>
            <surname>Winkler</surname>
          </string-name>
          .
          <article-title>String comparator metrics and enhanced decision rules in the Fellegi-Sunter Model of record linkage</article-title>
          .
          <source>In Proceedings of the Section on Survey Research Methods</source>
          , pages
          <volume>354</volume>
          {
          <fpage>359</fpage>
          . American Statistical Association,
          <year>1990</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>