<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Discovering and Merging Keyword Senses using Ontology Matching?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mauricio Espinoza??</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Raquel Trillo</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jorge Gracia</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Eduardo Mena</string-name>
          <email>emenag@unizar.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>IIS Department, Univ. of Zaragoza</institution>
          ,
          <addr-line>Mar</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>During the last years we are witnessing how the use of keywords has become the standard input when searching the Web. As opposite to the syntactic searches performed by traditional web search engines, the current research challenge is a semantics-guided information retrieval. The increasing pools of ontologies available on the Web can help to discover the semantics of user keywords and this information is priceless for many tasks, including new semantic search engines. In this paper we propose a system that takes as input a list of keywords provided by the user and discovers their possible meanings by consulting the knowledge represented by many (heterogeneous and distributed) ontologies. These keyword senses are semantically enriched with the synonym terms found during the ontology matching process: A synonymy measure based on statistics techniques and ontological similarity is used to integrate senses that are similar enough.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology matching for information integration</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Although keyword-based search is a widely used technique for information
retrieval, traditional techniques do not consider the speci¯c semantics assigned by
the user: the same keywords can be used by di®erent users with the purpose
of accessing to di®erent information. Furthermore, the syntactic-based search
engines are very in°uenced by the enormous amount of information about
popular issues on the Web, i.e., the keyword \java": Java as programming language
eclipses the rest of possible senses (the Indonesian island, a co®ee plant, di®erent
US cities, etc). However, ontologies (which o®er a formal, explicit speci¯cation
of a shared conceptualization [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]) can be used to make the semantics of user
keywords explicit without ambiguity. The more ontologies consulted, the more
chances to ¯nd the semantics assigned to keywords by the user.
      </p>
      <p>In this paper, we propose a system that takes as input a list of plain
keywords provided by the user, discovers their semantics in run-time and obtains a
? This work is supported by the CICYT project TIN2004-07999-C02-02.
?? Work supported by a grant of Santander Central Hispano &amp; University of Zaragoza.
list of senses extracted from di®erent ontology pools; it deals with the possible
overlapping among senses. The main steps of our approach are summarized in
the following:
1. Extraction of Keyword Senses. First, the user keywords are normalized by
a preprocessing step (e.g., rewriting them in lowercase, removing hyphens,
etc.), and in order to discover the semantics of the user keywords, the system
accesses to the shared knowledge stored in di®erent ontology pools available
on the Web. The extracted senses are semantically enriched with the
ontological senses of their synonyms (which are obtained from the ontology
pool), whenever the system evaluates that the synonym senses matches to
the semantics of the corresponding keyword sense.
2. Alignment of Senses. This process uses an incremental algorithm for the
alignment of the di®erent keyword senses in order to remove the possible
semantics redundancy among them. Senses are merged when the estimated
synonymy probability between them is above a certain threshold. The
synonymy measure combines a standard string distance metric with a structural
similarity measure that is based on vector space techniques. Thus the result
is a set of di®erent possible senses for each user keyword.</p>
      <p>
        For e±ciency purposes, the system uses sampling and other statistic
techniques, as well as parallel processing, whenever possible. The output of our
system can be the input for a disambiguation process across keywords [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] or used
to retrieve data once the keyword semantics is known.
      </p>
      <p>The rest of this paper is as follows. In Section 2 we show how the possible
senses of each keyword are obtained and semantically enriched with their
synonym senses. In Section 3 we describe the algorithm that computes the synonymy
probability in order to integrate senses when a certain threshold is achieved.
Finally, conclusions and future work appear in Section 4.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Extraction of Keyword Senses</title>
      <p>
        In this section we provide the details that show the contribution of this paper in
the task of automatically retrieving the possible senses for a set of user keywords.
In order to ¯nd the ontological terms that match those keywords, the system
accesses to Swoogle [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], other remote lexical resources as WordNet [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and other
ontologies not indexed by Swoogle are used as well. We advocate using a pool of
ontologies instead of just a single one, like WordNet (as many works do [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]),
because many technical or subject-speci¯c senses cannot be found in WordNet.
      </p>
      <p>
        The system builds a sense for each URI obtained with the information
retrieved from matching terms in the ontology pool [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In our approach, a sense
of a keyword k, denoted by sk, is a tuple sk = &lt;s, grph, descr, pop, syndgr&gt;,
where s is the list of synonym names1 of keyword k, grph describes the sense
1 To extract from an ontology the synonyms of a class, property or individual, the
primitives equivalentClass, equivalentProperty and sameIndividualAs are used,
respectively.
sk by means of the hierarchical graph of hypernyms and hyponyms of synonym
terms found in one or more ontologies, descr is a description in natural language
of such a sense, and pop and syndgr measure the degree of popularity of this
sense (pop is the number of times it appears in the ontology pool and syndgr is
the integrated percentage of synonymy degree). Thus, senses are built with the
information retrieved from matching terms in the ontology pool [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>As matching terms could be ontology classes, properties or individuals, three
lists of possible senses are associated with each keyword k: Sclass, Sprop and
k k
Sindv. In Figure 1 we show an example of some senses found in the ontology
k
pool for the user keyword \star". The system ¯nds in WordNet two matchings
of keyword \star" as concept/class (s1 and s2), and one matching in the Travel
Ontology2 as property of class \hotel" (s3). Notice that each sense is initialized
with a popularity=1 and a synonymy degree=1.</p>
      <p>celestial body
binary star ... supernova
class
s1star= &lt; {WN#star}, star "(astronomy) a celestial body of hot gases that...", 1, 1 &gt;
s2sctlaars=s &lt; {WN#star, WN#lead, WN#principal}, star , "an actor who plays a principal role", 1, 1 &gt;
actor
co−star ... film star
domain (hotel)
prop
s3star= &lt; {TravelOntology#star}, star , "", 1, 1 &gt;
Each keyword sense is enhanced incrementally with the synonyms terms
extracted from the ontology pool. Therefore our system takes advantage of the
shared ontologies available on the Web and semantically enriches the keyword
senses with senses extracted from their synonyms. The synonym names are stored
in the sense structure shown before, which gets upgraded everytime the sense is
integrated with a (very similar) sense coming from other ontology. In order to
evaluate the semantic similarity between the sense of a keyword and their
synonyms, the system performs a sense alignment process (detailed in Section 3)
which determines whether the semantics of the keyword sense and each synonym
sense found represent the same semantic or not. After discarding the synonym
senses that do not enrich the corresponding keyword sense, the result is a list of
di®erent possible senses for each keyword.</p>
      <p>This process can be limited in time; obtaining the senses is executed in
parallel for each keyword; within that task, the semantic enrichment of each keyword
sense with its synonym senses is performed in parallel too.
2 http://learn.tsinghua.edu.cn:8080/2003214945/travelontology.owl</p>
    </sec>
    <sec id="sec-3">
      <title>Alignment of Senses</title>
      <p>We explain in this section the sense alignment process, which is used in two
situations by our system: 1) to check which synonym senses represent the same
semantics as their keyword senses, and 2) to avoid redundancy in the list of
possible senses of each user keyword. However both tasks share a common goal:
to ¯nd when two given senses represent very similar semantics; in that case they
will be considered synonyms and both senses will be integrated3.</p>
      <p>
        In order to decide if two senses must be integrated (as a single sense) or
not, the system computes their synonymy probability. Thus the system avoid
redundancy among the possible senses of a keyword. At present, several solutions
to determine the matching among ontological terms of distinct ontologies have
been proposed, see [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] for recent surveys. Our approach computes coe±cients
of synonymy degree in the [
        <xref ref-type="bibr" rid="ref1">0,1</xref>
        ] range, however other approaches as semantic
matching [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] can be used as well.
      </p>
      <p>The synonymy measure used relies on both linguistic and structural
characteristics of ontologies. The following steps are performed: 1) an initial
computation using linguistic similarity, which consider labels as strings, 2) a recursive
computation using structural similarity, which exploits the semantics of terms
(ontological context) until a certain depth, and 3) the above values are combined
to obtain the resultant synonymy measure.</p>
      <p>Our proposal for sense alignment is not just a comparison between two senses
but an iterative process, which improves the quality and e±ciency of ontology
matching and enables the reuse of new discovered senses. In other words, each
new integrated sense must be considered as candidate to integrate with the
rest. For the same reason, new senses that do not integrate are stored because
they could become the missing semantic gap between two senses. Although this
method is costly (we limit its execution time), it performs a much better ontology
alignment among senses. Due to space limitations, we do not detail this process.</p>
      <p>
        In a variety of approaches, the similarity measure is only calculated among
ontological terms that plays as classes. However, unlike another works, we
propose a way to obtain the synonymy probability according to the type of senses
that we compare. Details about this process is available in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] as it not the main
goal of this paper.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>
        In this paper we have presented a semantics-guided approach to discover the
possible senses for a set of keywords, by searching and extracting relevant knowledge
from di®erent ontology pools; ontology matching and synonymy estimation
techniques are used to merge senses considered similar enough. The main features
of our proposal are the following:
3 The integration process that we propose can be found in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
1. It uses an iterative approach to retrieve from di®erent knowledge repositories
the possible senses of each user keyword, in a parallel manner. A sense is
represented basically as the (multi)ontological context of a term, and the
system is able to deal with senses corresponding to di®erent kind of ontology
terms (classes, properties, and individuals).
2. It considers not only the senses corresponding to ontology terms syntactically
matching the user keywords but also the senses of ontology terms matching
the synonyms of the user keywords, recursively, in order to semantically
enrich the keyword senses retrieved within a certain synonymy threshold.
3. It measures the synonymy degree between two senses by considering their
linguistic and structural similarity. Statistical techniques like sampling and
parallel processing are used to improve the performance of this process.
      </p>
      <p>We believe that this technique to ¯nd out the semantic di®erent between
senses (subsets of ontologies) can be applied to many ¯elds. As example, we are
currently working on using the retrieved senses to generate queries expressed in
a knowledge representation language to retrieve data corresponding to the user
keywords.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>M.</given-names>
            <surname>Espinoza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Gracia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Trillo</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E.</given-names>
            <surname>Mena</surname>
          </string-name>
          .
          <article-title>Discovering the semantics of keywords: An ontology-based approach</article-title>
          .
          <source>In The 2006 International Conference on Semantic Web and Web Services (SWWS'06)</source>
          , Las Vegas, Nevada (USA). CSREA Press,
          <year>June 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>T.</given-names>
            <surname>Finin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Ding</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Pan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Joshi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Kolari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Java</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Peng</surname>
          </string-name>
          . Swoogle:
          <article-title>Searching for knowledge on the Semantic Web</article-title>
          .
          <source>In AAAI 05 (intelligent systems demo)</source>
          ,
          <year>July 2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>F.</given-names>
            <surname>Giunchiglia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Shvaiko</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Yatskevich</surname>
          </string-name>
          .
          <article-title>Discovering missing background knowledge in ontology matching</article-title>
          .
          <source>In Technical Report DIT-06-005</source>
          , Informatica e Telecomunicazioni, University of Trento,
          <year>February 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>J.</given-names>
            <surname>Gracia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Trillo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Espinoza</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E.</given-names>
            <surname>Mena</surname>
          </string-name>
          .
          <article-title>Querying the web: A multiontology disambiguation method</article-title>
          .
          <source>In Sixth International Conference on Web Engineering (ICWE'06)</source>
          , Palo Alto (California, USA). ACM,
          <year>July 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>T. R.</given-names>
            <surname>Gruber</surname>
          </string-name>
          .
          <article-title>Towards principles for the design of ontologies used for knowledge sharing</article-title>
          . In N. Guarino and R. Poli, editors,
          <source>Formal Ontology in Conceptual Analysis and Knowledge Representation</source>
          . Kluwer Academic Publishers,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>B.</given-names>
            <surname>Le</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Dieng-Kuntz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Gandon</surname>
          </string-name>
          .
          <article-title>On ontology matching problems - for building a corporate semantic web in a multi-communities organization</article-title>
          .
          <source>In ICEIS (4)</source>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>V.</given-names>
            <surname>Lopez</surname>
          </string-name>
          , E. Motta, and
          <string-name>
            <given-names>V.</given-names>
            <surname>Uren</surname>
          </string-name>
          .
          <article-title>Poweraqua: Fishing the semantic web</article-title>
          .
          <source>In 3rd European Sematic Web Conference</source>
          , Budva, Montenegro,
          <year>June 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>G.</given-names>
            <surname>Miller. WordNet</surname>
          </string-name>
          :
          <article-title>A Lexical Database for English</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>38</volume>
          (
          <issue>11</issue>
          ), nov
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>P.</given-names>
            <surname>Shvaiko</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Euzenat</surname>
          </string-name>
          .
          <article-title>A survey of schema-based matching approaches</article-title>
          .
          <source>In Journal on Data Semantics</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>