<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>HotMatch Results for OEAI 2012</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Thanh Tung Dang</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alexander Gabriel</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sven Hertling</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Philipp Roskosch</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Marcel Wlotzka</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jan Ruben Zilke</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Frederik Janssen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Heiko Paulheim</string-name>
          <email>paulheimg@ke.tu-darmstadt.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Technische Universita ̈t Darmstadt</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>HotMatch is a multi-strategy matcher developed by a group of students at Technische Universita¨t Darmstadt in the course of a hands-on training. It implements various matching strategies. The tool version submitted to OAEI 2012 combines different basic matching strategies, both element-based and structure-based, and a set of filters for removing faulty mappings.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>1.1</p>
    </sec>
    <sec id="sec-2">
      <title>Presentation of the system</title>
      <sec id="sec-2-1">
        <title>State, purpose, general statement</title>
        <p>HotMatch1 has been developed by a group of students in the course of a semantic web
hands-on training conducted at TU Darmstadt. The students were asked to develop and
implement different matching algorithms. For OAEI 2012, we have combined a large
number of those matching algorithms into one tool. To give an overview of our
approaches, all matchers are depicted in figure 1. In contrast to matchers, filters are used
to remove mapping elements found by previous matchers.
1.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Specific techniques used</title>
        <p>HotMatch provides a library of different matching algorithms and filters.</p>
      </sec>
      <sec id="sec-2-3">
        <title>Matching Algorithms</title>
        <p>ElementStringMatcher is a simple string-based, element-level matcher on the element
level. All labels, URI fragments and comments are extracted and tokenized. As a second
step some stopwords are removed. To get a similary measure of two concepts, a cross
product of labels, fragments and comments is calculated with the Damerau–Levenshtein
distance.</p>
        <p>GraphbasedUseClassMatcher is a graph based matcher. It operates on the
structural level and needs some input alignment to have an initial mapping between classes.</p>
        <p>Figure 2 gives an example of the mapping candidates. The properties X and Y are
matched if the domain and range are equals respectively are aligned with a previous
matcher. The confidence of the new mapping between the two Properties is the mean
value between the confidence of mapping A to C and B to D.
1 For Hands-on training matcher
Fig. 2. New mapping of GraphbasedUseClassMatcher. Class A and C as well as B and D are
already matched. Property X and Y is therefore also matched.</p>
      </sec>
      <sec id="sec-2-4">
        <title>GraphbasedUsePropertyMatcher is a modification of GraphbasedUseClassMatcher.</title>
        <p>It uses properties from previous alignments instead of classes. If a property is matched
from previous approaches, then the domain and range are also matched in a new
alignment, inheriting the confidence mapping between the properties.</p>
        <p>
          SimilarityFlooding implements the structural similarity flooding matching
algorithm described in [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ].
        </p>
        <p>FlowerMatcher is a matching algorithm which combines a structural and an
elementbased approach. For each ontology class, its neighborhood (super and subclasses,
properties that this class is a domain or range of) are regarded. From the names and labels
of all the concepts in the neighborhood, a joint set of trigrams is computed. These sets
are compared for determining the class similarity.</p>
        <p>ModelbasedMatcher checks currently only if the union of the two ontologies plus
the input mappings is valid. The implementation uses the pellet reasoner. In the future,
this matcher is supposed to add extra mappings derived by reasoning, as well discard
mappings that generate a contradiction.</p>
      </sec>
      <sec id="sec-2-5">
        <title>DistributionSynonymMatcher and WikipediaCorpusMatcher are matchers us</title>
        <p>
          ing external resources, i.e., the online API lanes2. The distribution synonym matcher
tries to identify synonyms based on distributional similarity, i.e., the similarity of the
context in which two words occur [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. The Wikipedia corpus matcher computes the
percentage of Wikipedia pages on which two terms co-occur (similar to the approach
discussed in [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]).
        </p>
        <p>SynonymMatcher uses the online thesaurus Big Huge Thesaurus3 to find mappings
between concepts.</p>
      </sec>
      <sec id="sec-2-6">
        <title>Filters</title>
        <p>OriginalHostsFilter extracts the major host component of the input ontologies’ URIs.
If an alignment has other URI hosts than the major one, this alignment is removed. The
remaining mappings are not changed. This filter is necessary, because an alignment like
&lt; http : ==purl:org=dc=elements=1:1=description;
http : ==purl:org=dc=elements=1:1=description;</p>
        <p>=;
1:0 &gt;
is definitely true, but not contained in the reference alignments. In OAEI tracks, it will
thus generate a false positive and reduce the mathcher’s precision.</p>
        <p>CardinalityFilter is a filter to enforce a 1 : 1 alignment. If a resource from
ontology one are matched to multiple resources from ontology two, then only the alignment
with the highest confidence is selected. All other mappings are discarded. The same
procedure is also applied for ontology two. The result of this filter is an alignment that
relates each element from one ontology to at most one element from another ontology.</p>
        <p>ConfidenceFilter is a simple filter that removes all alignments that have a smaller
confidence than a given threshold.
2 Language Analysis Essentials, http://research.wilsonwong.me/lanes.html
3 http://words.bighugelabs.com/</p>
        <p>DomainRangeFilter discards all alignments with non-matched domain and range.
This is particularly useful for discarding inverses (e.g., isReviewerOf vs. hasReviewer),
which receive high similarity scores with simple element-based techniques.</p>
        <p>DatatypeRangeFilter checks only datatype properties. Matched properties hat have
a different datatype (e.g., string vs. date) are discarded.</p>
        <p>SynonymFilter has been implemented as a variant of the SynonymMatcher (see
above). Since the latter has shown to produce a too large number of false positives (but
with reasonable recall), it can also be used as a filter, e.g., on structural approaches for
improving precision.
1.3</p>
      </sec>
      <sec id="sec-2-7">
        <title>Adaptations made for the evaluation</title>
        <p>The final matcher composition of the version submitted to OAEI 2012 is shown in
figure 3. The threshold for confidence filter is set to t = 0:7. Note that not all matchers
and filters discussed above are included in the final composition. We discarded all
components that did not improve the system’s accuracy and favored faster components over
slower ones in case of ties.</p>
        <p>All matchers are composed sequentially. The upper lane shows all matchers which
generate new alignments. The lower one depicts all filters used to remove alignments
that are not in the reference alignment to improve the precision value.</p>
        <p>Although the filters only remove elements from the mapping generated by the
matchers, they cannot be arbitrarily permuted. For example, the cardinality filter enforcing a
1:1 mapping will select the candidate with the highest threshold. If a mapping element
with a higher threshold is filtered, e.g., by the OriginalHostsFilter, the selection will be
different. Consider the following constellation for a mapping between ontology A and
B, where B imports the FOAF ontology4:</p>
        <p>&lt; A#person; B#author; =; 0:7 &gt;
&lt; A#person; f oaf #person; =; 0:8 &gt;
(1)
(2)
4 http://xmlns.com/foaf/spec/
Using the CardinalityFilter first would discard the first element, and the second one
would be discarded by the OriginalHostsFilter. On the other hand, using the
OriginalHostsFilter first would discard the second element, with the first one passing the
CardinalityFilter.
1.4</p>
      </sec>
      <sec id="sec-2-8">
        <title>Link to the system and parameters file</title>
        <p>The tool version submitted to OAEI 2012 can be downloaded from http://www.
ke.tu-darmstadt.de/resources/ontology-matching/hotmatch.
2
2.1</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <sec id="sec-3-1">
        <title>Benchmark 2.2</title>
      </sec>
      <sec id="sec-3-2">
        <title>Anatomy</title>
        <p>HotMatch relies on string similarity to a large extent; although some structural measures
are used later in the pipeline. Thus, it only performs well on those benchmark cases
where names and labels are preserved. In particular, they show that the filters work
quite effectively, since the precision only rarely drops below 0.95.</p>
        <p>On the anatomy track, the performance of HotMatch is more or less the same as the
string equivalence baseline5. In other words, the structure-based approaches do not
improve the results much. This is not surprising as the structure-based approaches in
HotMatch largely rely on domain and range definitions, which are not present in the
Anatomy track. The reported runtime of 672 seconds shows an average behavior.
2.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Conference</title>
        <p>This track gives some insights into the strengths and weaknesses of HotMatch. In
contrast to the anatomy track, the structure-based measures in HotMatch are capable of
exploiting the domain and range definitions in the conference ontologies. For example,
the structure-based algorithms provide some useful mappings, such as hasAuthor =
isWrittenBy or hasBeenAssigned = isReviewing, but are also prone to
produce false positives such as Reviewer = MemberPC, since both share a
common super class. In terms of F-Measure, the results are comparable to Baseline26 (i.e.,
string matching with some pre-processing), but with a tendency to prefer recall over
precision in comparison to that baseline, as the examples above show.
5 http://oaei.ontologymatching.org/2011.5/results/anatomy/index.</p>
        <p>html
6 http://oaei.ontologymatching.org/2011.5/results/conference/
index.html
2.4</p>
      </sec>
      <sec id="sec-3-4">
        <title>Multifarm</title>
        <p>This matcher is not designed to work with multilingual ontologies. The results are
accordingly low. Only some labels are equals in their translation like person in
German as well as in English. Such resources are matched through string equality. Despite
those occasional mappings, there is no correlation of the result quality and involved
the languages’ similarity – strangely enough, the best results are achieved for
GermanChinese, two languages that are not known to be particularly similar.
2.5</p>
      </sec>
      <sec id="sec-3-5">
        <title>Library</title>
        <p>The mapping quality achieved by HotMatch on the library track is not as positive as on
the other tracks. Possible reasons may be the absence of domain and range
definitions (in fact, of properties in general), as for anatomy, and the presence of multi-lingual
labels. As HotMatch does not respect languages, this may lead to false positives.
2.6</p>
      </sec>
      <sec id="sec-3-6">
        <title>Large Biomedical Ontologies</title>
        <p>HotMatch has been reported to have some problems of finishing the larger datasets in
this track on time. As the matching process itself is rather light-weight, this may hint at
efficiency issues of the implementation of HotMatch.
3</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>General comments</title>
      <p>3.1</p>
      <sec id="sec-4-1">
        <title>Comments on the results</title>
        <p>The results show that with a multi-strategy approach using different simple matching
strategies, reasonable results can be produced. There is a gap to more sophisticated
systems – which is expected – but the results on the conference track also show that
some of the more complex systems can be beaten.
3.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Discussions on the way to improve the proposed system</title>
        <p>One key feature of HotMatch is the ability to combine multiple matchers and filters. The
final configuration submitted to OAEI has been found using extensive manual testing,
however, it is a compromise which is supposed to produce reasonable results on most
of the tracks.</p>
        <p>
          Being able to individually assembling a configuration for each pair of ontologies
would be an interesting option, thus, the system would clearly benefit from leveraging
work in these fields [
          <xref ref-type="bibr" rid="ref4 ref5">4, 5</xref>
          ].
In the current OAEI test cases, mapping elements that are correct but refer to concepts
of other ontologies (like the example in Sect. 1.2) cause false positives, since they are
not part of the reference alignment. In the HotMatch version for OAEI, we filter them
manually, however, a real-world ontology matching system that returns those elements
as well could equally make sense.
        </p>
        <p>To circumvent this problem, the organizers might consider filtering mapping
elements refering to concepts from other ontologies before computing precision.
4</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>In this paper, we have discussed the results for the HotMatch system, a multi-strategy
matching system developed by students at Technische Universita¨t Darmstadt in the
course of a hands-on training. We have shown that the system provides reasonable
results on most of the OAEI tracks and can compete with many state-of-the-art matching
tools.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Harris</surname>
            ,
            <given-names>Z.S.</given-names>
          </string-name>
          : MathematicalStructuresOfLanguage. Wiley (
          <year>1968</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Hertling</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paulheim</surname>
          </string-name>
          , H.:
          <article-title>Wikimatch - using wikipedia for ontology matching</article-title>
          .
          <source>In: Seventh International Workshop on Ontology Matching (OM</source>
          <year>2012</year>
          ).
          <article-title>(</article-title>
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Melnik</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Garcia-Molina</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rahm</surname>
          </string-name>
          , E.:
          <article-title>Similarity flooding: A versatile graph matching algorithm and its application to schema matching</article-title>
          .
          <source>In: 18th International Conference on Data Engineering</source>
          , IEEE (
          <year>2002</year>
          )
          <fpage>117</fpage>
          -
          <lpage>128</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Mochol</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jentzsch</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Euzenat</surname>
          </string-name>
          , J.:
          <article-title>Applying an analytic method for matching approach selection</article-title>
          .
          <source>In: Proceedings of the 1st International Workshop on Ontology Matching (OM2006)</source>
          . (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Ritze</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paulheim</surname>
          </string-name>
          , H.:
          <article-title>Towards an automatic parameterization of ontology matching tools based on example mappings</article-title>
          . In: Sixth International Workshop on Ontology Matching. (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>