<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>SLINT+ Results for OAEI 2013 Instance Matching</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Khai Nguyen</string-name>
          <email>nhkhai@nii.ac.jp</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ryutaro Ichise</string-name>
          <email>ichise@nii.ac.jp</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>National Institute of Informatics</institution>
          ,
          <country country="JP">Japan</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>The Graduate University for Advanced Studies</institution>
          ,
          <country country="JP">Japan</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The goal of instance matching is to detect identity resources, which refer to the same real-world object. In this paper, we introduce SLINT+, a novel interlinking system. SLINT+ detects all identity linked data resources between two given repositories. SLINT+ does not require the specifications of RDF predicates and labeled matching resources. SLINT+ performs competitively at OAEI instance matching campaign this year.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>1.1</p>
    </sec>
    <sec id="sec-2">
      <title>State, purpose, general statement</title>
      <p>SLINT+ is a flexible schema-independent linked data interlinking system. SLINT+ can
interlink various data sources, and is independent on the schema of data sources. By
detecting appropriate predicate alignments without supervised learning, SLINT+ does
not require expensive curation on data examples.</p>
      <p>The principle of SLINT+ is similar to previous data interlinking systems. There
are two main phases in the interlinking process of SLINT+: candidate generation and
instance matching. The first phase separates similar instances into different groups in
order to reduce the number of the pending pairs. The second phase will determine which
candidate is really identity. With the schema-independent goal, we add two steps into
SLINT+: predicate selection and predicate alignment. The mission of these new steps
is to find the predicate alignments specifying the same properties of instances.
1.2</p>
    </sec>
    <sec id="sec-3">
      <title>Specific techniques used</title>
      <p>The architecture of SLINT+ is depicted in Fig.1. DS and DT are the source and target
data. The predicate selection step finds the important predicate by some statistical
measures based on RDF objects involving with each predicate. The predicate alignment step
matches important predicates and selects the reasonable alignments. This step can be
recognized as an instance-based ontology matching task. The candidate generation step
picks up similar instances, which are predicted to be identity. The final step, instance
matching, compares suggested candidates and produces the interlinking result. In the
following sections, we describe the details of each step in order of the process.</p>
    </sec>
    <sec id="sec-4">
      <title>1.2.1 Predicate selection</title>
      <p>This is the first step of the interlinking process. It collects the important predicates
of each input data sources. Important predicates are expected to be used by a large
portion of instances and stored specific information of each instance. Thus, an important
predicate should have high frequency and diver RDF objects.</p>
      <p>
        We use coverage and discriminability as the metrics to evaluate the importance level
of each predicate. These metrics are the extensions from [4]. Equation (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) and (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) in turn
are the formulas of coverage Cov(pk) of predicate pk and its discriminability Dis(pk).
The notation &lt; s; p; o &gt; stands for subject, predicate, and object of a RDF triple. x, D,
and f are the instance, data source, and frequency of RDF object, respectively.
      </p>
      <p>Cov(pk) = jfxjx 2 D; 9t =&lt; s; pk; o &gt;2 xgj</p>
      <p>jDj
Dis(pk) =</p>
      <p>V ar(pk) H(pk)</p>
      <p>V ar(pk) + H(pk)
V ar(pk) =</p>
      <p>X
oi2Opk</p>
      <p>jOpk j
jftj9x 2 D; t =&lt; s; pk; o &gt;2 xgj</p>
      <p>f (oi) f (oi)
Poj2Opk f (oj )
log P</p>
      <p>oj2Opk f (oj )</p>
      <p>Opk = foj9x 2 D; t =&lt; s; pk; o &gt;2 xg</p>
      <p>A predicate is important if its coverage, discriminability, and the harmonic means
of them are greater than given thresholds , , and , respectively. We select two sets
of important predicates, from two input data sources. In the next step, we align these
sets and find the useful predicate alignments.</p>
      <p>H(pk) =</p>
    </sec>
    <sec id="sec-5">
      <title>1.2.2 Predicate alignment</title>
      <p>
        In this step, we firstly group the predicates by their type. The type of a predicate is
determined by the dominant type of its RDF objects. There are five predicate types used in
SLINT+: string, URI, double, integer, and date. Secondly, we combine the type-similar
predicates of source and target data to get raw predicate alignments. Confidence is the
evidence for evaluating the usefulness of raw alignments. The confidence is estimated
using the intersection of all RDF objects described by the predicates of each alignment.
Equation (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) describes the confidence of the alignment between predicates pi and pj .
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
(
        <xref ref-type="bibr" rid="ref2">2</xref>
        )
(
        <xref ref-type="bibr" rid="ref3">3</xref>
        )
conf (pi; pj ) = jR(Opi ) \ R(Opj )j
      </p>
      <p>jR(Opi ) [ R(Opj )j
Opi = foj9x 2 DS ; &lt; s; pi; o &gt;2 xg</p>
      <p>Opj = foj9x 2 DT ; &lt; s; pj ; o &gt;2 xg</p>
      <p>By using function R, the string, URI, and double are compared indirectly. For string
and URI, R collects lexical words from given texts and links. For double, R rounds the
values into two decimal points precision. For the remaining types, R uses the original
values without transformation.</p>
      <p>Only useful alignments whose confidence is greater than a threshold will be kept
for the next steps. This threshold is computed by averaging the confidence of
nontrivial alignments. An alignment is considered as non-trivial if its confidence is higher
than threshold , a small value. In the next steps, useful alignments will be used as the
specification for comparing instances.</p>
    </sec>
    <sec id="sec-6">
      <title>1.2.3 Candidate generation</title>
      <p>
        The goal of candidate generation is to limit the number of instances to be compared.
SLINT+ performs a very fast comparison for each pair of instances. The result of this
comparison is a rough similarity between instances. It is consolidated from their shared
RDF objects, without any consideration for each predicate alignment. That is, two
compared RDF objects can associate with two predicates having no alignments selected.
Equation (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ) is the rough similarity of instances xS and xT . In this equation, A is the
set of filtered predicate alignments; R is the preprocessing procedure, as used in
predicate alignment step; w(O; S) and w(O; T ) are the weight of shared value O in each
data source DS and DT , respectively. The weight of string and URI values is estimated
by the TF-IDF score while that of remaining types is fixed to 1.0.
      </p>
      <p>rough(xS ; xT ) =
w(O; DS )
w(O; DT )
sum(pS )
sum(pT )</p>
      <p>X
O2R(OS)\R(OT )</p>
      <p>sum(pS ) =</p>
      <p>Although the rough similarity is computed for each pair of instances, in technical
aspect, it can easily be accumulated by passing through each repository only one time
in combination with matrix representation for all rough similarities.</p>
      <p>Candidates are the pairs whose similarity satisfies two conditions. First, it must
be higher than the average similarity of all others , because not every instance in
source data has the identities in target data. Second, it must be relatively higher than
the similarity of the others, in which each instance of the current pair participating. In
addition, we multiply the maximum similarity with a damping factor to avoid the
single pairing assumption.</p>
    </sec>
    <sec id="sec-7">
      <title>1.2.4 Instance matching</title>
      <p>For each candidate, we re-compute the similarity and then select identity pairs based
on this measure. The similarity of two instances is calculated from the shared values
in RDF objects, which are described by each pair of useful predicate alignments. The
confidence of each alignment is used as the weight for the similarity. Concretely, the
similarity function is given in equation (5). In this equation, R is similar with the
previous steps; and corr is the similarity function for RDF objects declared by pS and pT .
corr function works variously for different type of data. For string and URI, it computes
the TF-IDF cosine similarity. For double and integer, it returns the inverted disparity.
For date, it simply performs the exact matching.</p>
      <p>sim(xS ; xT ) =
conf (pS ; pT )</p>
      <p>corr(R(OS ); R(OT ));</p>
      <p>W =</p>
      <p>Similar to selecting candidate in the previous step, we use and as the same
functions and estimations with and in the candidate generation step.</p>
      <p>The instance matching step closes the standard interlinking process of SLINT+.
Next, we describe the configuration for participating OAEI 2013 instance matching.
The instance matching track this year requests participant to connect instances between
DBpedia and an anonymous synthesis repository. There are five test cases with different
difficulty levels. To simplify the experiment, our aim is not using different parameters
for each test case. Therefore, we select the configuration that conciliate the results and
use it for all test cases. We installed the parameters of SLINT+ by testing the system on
training data. We set , , to 0.01, = 0.01, = 0.20 and = 0.75. We slightly modify
the use of and . Instead of using average value of similarities, we permanently set
and to 0.</p>
      <p>We use BM25 weighting scheme as an alternative for TF-IDF modified cosine in
computing the string similarity in instance matching step. To improve the quality of
string matching, we remove the words whose frequency is under 0.25.</p>
      <p>In addition, we use some unsupervised transformation on the data before inputting
to the system. For test case #2, we leverage the information stored in linked instances.
In order to obtain adequate properties for matching, we recover the hidden data by
dereferencing the linked instances provided in RDF objects. For test case #3, #4, and
#5, we use machine translation to get the English version of French strings stored in
the target data. SLINT+ currently does not support multilingual matching. Translation
from other languages into English is a prerequisite.</p>
    </sec>
    <sec id="sec-8">
      <title>Link to the system, parameters file, and provided alignments</title>
      <p>SLINT+ is available to be downloaded at http://ri-www.nii.ac.jp/SLINT/oaei2013.html.
We also provide the parameters and the set of alignments for OAEI 2013 instance
matching on this page.
2</p>
      <sec id="sec-8-1">
        <title>Results</title>
        <p>In this section, we report the experiment result of SLINT+. The results of candidate
generation and instance matching are separately reported. To evaluate the final result
of data interlinking process, we use the conventional measures: Recall, Precision, and
F1 score. To evaluate candidate generation, we use Pair completeness and Reduction
ratio [4]. Pair completeness expresses how many actual identity pairs are selected to
the candidate set. Reduction ratio is the compression level of instance matching pool
comparing with all possible instances pairs between given data sources. We also report
the runtime of SLINT+. The experiment was conducted on a computer running with
core 2 quad 2.66 GHz CPU, 4 GB of RAM, and Windows 7 64 bit version.</p>
        <p>The result of candidate generation, instance matching, and time consumption are
given in Table 1, Table 2, and Table 3, respectively.</p>
        <p>The results of candidate generation are very good when reserving at least 98.7% of
correct alignments and nearly 100% on test case #2. In addition, the largest number of
candidate is only 7177, which reduces 96.7% of total instance pairs.</p>
        <p>The final results of SLINT+ are generally good. Comparing Recall and Pair
completeness on each test, they are similar on test case #1 and #2 and about 7% different
on remaining test cases. In addition, SLINT+ performs a stable interlinking since the
precision and recall are equivalent for all test cases.</p>
        <p>The main reason for the lower result on test case #3, #4, and #5 comes from the
transformation of string values. We temporarily used machine translation to convert
strings from French to English before conducting the matching process. A better
translation strategy may boost the Recall of SLINT+ on these test cases.</p>
        <p>The runtime of SLINT+ is very short. It takes about 350 milliseconds for SLINT+
to finish each test case. This is a promising indication for designing a scalable system
based on SLINT+ in the future.
3
3.1</p>
      </sec>
      <sec id="sec-8-2">
        <title>General comments</title>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>Comments on the OAEI 2013 test cases</title>
      <p>Comparing with recent years, the test cases of this time are more interesting and
challenging. It is very reasonable when OAEI organizers publish the offline data for keeping
the same input for all participants. In addition, it is effective that the test cases can
inspect the advantages of each system.</p>
      <p>The test cases for this year assume that every instance in source data has an identical
one in target data. In our opinion, it could be more efficient if there is a test case that
does not imply this assumption. Besides that, the various sizes of data can help evaluate
the performance of participants.
3.2</p>
    </sec>
    <sec id="sec-10">
      <title>Comments on the OAEI 2013 measures</title>
      <p>Since most interlinking systems generate potentially identity instances before
matching, we suggest to evaluate this step in separation with instance matching, as also was
recommended in [1]. There are many recognized measures in assessing the quality of
this step, such as recall, and reduction ratio as we reported in this paper.
4</p>
      <sec id="sec-10-1">
        <title>Conclusion</title>
        <p>We introduced SLINT+, a schema-independent and training-free linked data
interlinking system. SLINT+ performs four steps interlinking including predicate selection,
predicate alignment, candidate generation, and instance matching. SLINT+ gives a
promising result at the campaign this year.</p>
        <p>Implementing a graph matching algorithm is our objective in improving SLINT+.
Since linked data is basically a graph, leveraging linking characteristics between
instances will result more confident matching quality. Improving SLINT+ to a scalable
system is also our current goal.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Euzenat</surname>
            <given-names>J</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>A modest proposal for data interlinking evaluation</article-title>
          .
          <source>In: ISWC'12 7th Workshop on Ontology Matching</source>
          , pp.
          <fpage>234</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Nguyen</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ichise</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Le</surname>
            <given-names>B</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Interlinking linked data sources using a domain-independent system</article-title>
          .
          <source>In: 2nd Joint International Semantic Technology</source>
          , pp.
          <fpage>113</fpage>
          -
          <lpage>128</lpage>
          , LNCS 7774.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Nguyen</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ichise</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Le</surname>
            <given-names>B</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>SLINT: A schema-independent linked data instance matching system</article-title>
          .
          <source>In: ISWC'12 7th Workshop on Ontology Matching</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Song</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heffin</surname>
            <given-names>J</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Automatically generating data linkages using a domain-independent candidate selection approach</article-title>
          .
          <source>In: ISWC' 11</source>
          , pp.
          <fpage>649</fpage>
          -
          <lpage>664</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>