<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Property-based Semantic Similarity: What Counts?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Silvia Likavec</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Federica Cena</string-name>
          <email>cenag@di.unito.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Universita` di Torino</institution>
          ,
          <addr-line>Dipartimento di Informatica, Torino</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Similarity, one of six Gestalt principles, is one of the most intuitive ways to perceive the world and categorise the objects surrounding us. The notion of similarity plays an important role in many areas, and it is important to simulate human perception of similarity in order to obtain satisfying results in various applications. We draw our inspiration from Tversky's work on similarity and define property-based similarity for ontological concepts taking into account their common and distinctive features and their values. We also discuss some possible ways to improve the property-based similarity.</p>
      </abstract>
      <kwd-group>
        <kwd>Similarity</kwd>
        <kwd>properties</kwd>
        <kwd>ontology</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>It is inherent to human nature to try to categorize objects surrounding us, finding
patterns and forms they have in common. One of the most intuitive ways to relate two
objects is through their similarity. Similarity is one of the six Gestalt principles which
guide the human perception of the world, the remaining ones being: Proximity, Closure,
Good Continuation, Common Fate, and Good Form.</p>
      <p>According to Merriam Webster “similarity” is a quality that makes one person or
thing like another and “similar” means having characteristics in common. There are
many ways in which objects can be perceived as similar, such as having similar color,
shape, size, texture etc. But if we move away from just visual stimuli, we can apply
the same principles to define the semantic similarity of two objects. This leads to a
similarity based on features these two objects have in common, and consequently, the
lack of distinctive features characterising each object.</p>
      <p>
        The concept of semantic similarity can be encountered in various fields, from
Natural Language Processing (NLP) and Information Retrieval to Semantic Web. In this
work we deal with the semantic similarity of concepts in domain ontologies
        <xref ref-type="bibr" rid="ref7 ref8">(Gruber,
1993, Guarino and Poli, 1995)</xref>
        , where concepts are distinguished by the properties
associated to them. The usage of ontologies to represent various domains accounts for
both similarities and di erences among domain objects as well as generic objects and
very specific ones.
      </p>
      <p>Our inspiration comes from Tversky’s work on Features of Similarity (Tversky,
1977) and we try to apply his ideas to similarity among ontological objects. More
precisely, two objects are similar if they both are defined having the same properties with
the same values. In addition to this simple notion of similarity, we explore how this
similarity can be improved by considering relevance for properties or relevance for
values or hierarchical relationships among values, Throughout this work we use domain
of recipes to provide examples and explain our approach and reflections.</p>
      <p>The rest of the paper is organised as follows. In Section 2, we provide a brief
background on ontologies for knowledge representation and on the treatment of properties
in OWL. We give the details of how to calculate the property-based similarity for
instances in the domain ontology in Section 3 and then we look into some possible ways
to improve the property-based similarity in the ontology in Section 4. We summarise the
most relevant related work which regards the semantic similarity in Section 5. Finally,
we conclude in Section 6.
2</p>
    </sec>
    <sec id="sec-2">
      <title>OWL ontologies and knowledge representation</title>
      <p>
        In various fields, from e-commerce and e-learning to cultural heritage, medicine, digital
libraries etc., it is possible to describe the concepts of the domain by using the properties
of these concepts and their respective values. The ones that immediately come to mind
are ontologies
        <xref ref-type="bibr" rid="ref1 ref2">(Antoniou and van Harmelen, 2008, Allemang and Hendler, 2008)</xref>
        and
linked open data
        <xref ref-type="bibr" rid="ref3">(Bizer et al., 2009)</xref>
        , where properties are prominent elements of the
domain and contribute to the description of domain concepts.
      </p>
      <p>In this work we deal with ontologies, powerful and expressive formalisms which
make it possible to explicitly specify domain elements and their properties, as well as
relationships which exist among domain elements. Also, rigorous reasoning mechanisms
are associated with ontologies. One standard formalism for representing ontologies is
OWL.1</p>
      <p>Throughout this work we would use domain of recipes to provide examples and
explain our approach and reflections.
2.1</p>
      <sec id="sec-2-1">
        <title>Properties in OWL</title>
        <p>In ontologies expressed in OWL properties are used to describe domain elements and
express their features. There are two kinds of properties in OWL:
(i) object properties describing relations among individuals and
(ii) data type properties providing relations among individuals and data type values.
Object properties and datatype properties are defined as instances of the built-in OWL
classes owl:ObjectProperty and owl:DatatypeProperty, respectively. Both are subclasses
of the RDF class rdf:Property. Here, we only consider object properties, and leave the
treatment of data type properties (such as literal values) for future analysis, since it is
more complex.</p>
        <p>The property axiom is used to define the characteristics of a property. Usually, it
defines its domain and range. rdfs:domain links a property to a class description, whereas
rdfs:range links a property to either a class description or a data range. For example:
&lt;owl:ObjectProperty rdf:ID="has_ingredient"&gt;</p>
        <p>&lt;rdfs:domain rdf:resource="#Recipet"/&gt;
1 http://www.w3.org/TR/owl-ref</p>
        <p>&lt;rdfs:range rdf:resource="#Food"/&gt;
&lt;/owl:ObjectProperty&gt;
defines a property has ingredient which connects the elements of Recipe class to
the elements of Food class.</p>
        <p>Equivalent properties are defined with owl:equivalentProperty.</p>
        <p>Properties can be explicitly defined for the classes and can be used to define classes
with property restrictions. Our approach to similarity is best illustrated when
considering instances in the ontology, hence we will provide here a brief description of
properties for instances.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2 Instances and their properties</title>
        <p>An instance in the ontology are characterised by its class membership, individual
identity and property values. An instance inherits its properties from the classes it is an
instance of and it has a specific value associated to each property. For example:
&lt;Recipe rdf:ID="Herbed_Asparagus"&gt;
&lt;has_ingredient rdf:resource="#Asparagus"/&gt;
&lt;has_ingredient rdf:resource="#Parmesan"/&gt;
&lt;has_ingredient rdf:resource="#Herbs"/&gt;
&lt;has_origin rdf:resource="#Italy"/&gt;
&lt;suitable_for_diet rdf:resource="#"Vegetarian"/&gt;
&lt;/Recipe&gt;
defines a recipe Herbed Asparagus which has ingredients: asparagus, parmesan and
herbs, originates from Italy and is suitable for vegetarians.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3 Property-based similarity</title>
      <p>First of all, let us have a look at an example which should clarify the basics of our
approach. We consider the domain of recipes where properties such as has ingredient,
has origin, suitable for diet are defined. These properties have one or more
values assigned to them. Intuitively, the similarity among recipes depends on the
propertyvalue pairs they have in common. Consider for example the following recipes: Asparagus
Parmigiana and Herbed Asparagus With Parmesan Cheese. They both have
ingredients: Asparagus, Butter, Parmesan, Pepper among others and are both
suitable for vegetarian diet. On the other hand, Indian Style Chicken has only Butter
in common with any of them and is not suitable for vegetarians. So the asparagus dishes
are definitely more similar among themselves than any of them with the chicken dish.</p>
      <p>Hence, in order to determine similarity among two objects, we want to consider
both, their common features and distinctive features for each of them. To this aim we
use Tversky’s feature-based model of similarity (Tversky, 1977):
simT (O1; O2) =</p>
      <p>( (O1) \ (O2))
( (O1) n (O2)) + ( (O2) n (O1)) + ( (O1) \ (O2))
: (1)
where (O) is the function describing all the relevant features of the object O, and
; ; 2 R are constants which permit di erent treatment of the various components.
For = 1 common features of the two objects have maximal importance and for =
non-directional similarity measure is obtained. In our approach we have = = = 1.</p>
      <p>We will be using the following notation:
– common features of O1 and O2: cf(O1; O2) = (O1) \ (O2),
– distinctive features of O1: df(O1) = (O1) n (O2) and
– distinctive features of O2: df(O2) = (O2) n (O1).</p>
      <p>Using this notation and setting = = = 1 the formula (1) becomes:</p>
      <p>
        Since each of the domain objects has a number of property-value pairs describing
it, for each property p we will have to calculate how much it is responsible for common
features among these objects, as well as for distinctive features of each of them. We
denote these values by cfp, df1p and df2p. We consider equal the properties defined with
owl:EquivalentProperty.
In this work we present our approach only for instances of classes, although it can be
extended to classes defined with their properties and to classes defined as property
restrictions (see
        <xref ref-type="bibr" rid="ref4">Cena et al. (2012)</xref>
        ). The essence of property-based similarity calculation
lies in simple comparison of the property-value pairs for each instance. Let us assume
that the property p has h0 di erent values in O1 and h00 di erent values in O2, and k is
the number of times O1 and O2 have the same value for p, then
cfp =
k2
h0h00
; df1p =
h0 k
h0
and df2p =
h00 k
h00
:
      </p>
      <p>Let us assume that the objects O1 and O2 have properties p1; : : : ; pn in common. We
can repeat the above process for each property pi; i = 1; : : : ; n.</p>
      <p>Now, there are two possible ways to calculate similarity between O1 and O2.
First, we can obtain all common and distinctive features of O1 and O2:
cf(O1; O2) = in=1cfpi
df(O1) = in=1df1pi
df(O2) = in=1df2pi
where n is the number of properties O1 and O2 have in common. The similarity between
two instances O1 and O2 is then calculated using the formula (2):
sim(O1; O2) =</p>
      <p>cf(O1; O2)
df(O1) + df(O2) + cf(O1; O2)
:</p>
      <p>
        This method for property-based similarity of objects in the ontology was first
introduced in
        <xref ref-type="bibr" rid="ref4">(Cena et al., 2012)</xref>
        classes defined with property restrictions but only for value
restrictions. It was further developed to include cardinality restrictions and applied to
categorization of shapes in
        <xref ref-type="bibr" rid="ref12">(Likavec, 2013)</xref>
        .
      </p>
      <p>Second, we can calculate partial similarities w.r.t. each property pi; i = 1; : : : ; n:
simpi =</p>
      <p>cfpi
df1pi + df2pi + cfpi
sim(O1; O2) = in=1simpi :
and then use these similarities to calculate the total similarity between O1 and O2 as:</p>
    </sec>
    <sec id="sec-4">
      <title>4 Improving property-based similarity</title>
      <p>
        The above presented base case property-based similarity provides high rates of
similarity among objects which can be used in many applications. We still did not perform
the thorough evaluation but we evaluated it in the field of user interest propagation and
obtained very satisfying results
        <xref ref-type="bibr" rid="ref4">(Cena et al., 2012)</xref>
        . But, while performing the second
evaluation in this field, we became aware that in certain domains, this property-based
similarity of domain objects can be improved w.r.t. various aspects. We will discuss
here some of them.
4.1
      </p>
      <sec id="sec-4-1">
        <title>Relevance of properties</title>
        <p>When defining the concepts of a domain, not all the properties play an equal role.
Hence, it is possible to introduce the relevance of properties and assign di erent
importance to di erent properties in the domain. Actually, the relevance of a property can
be considered as the capacity of the property to determine the similarity between two
entities. For example, in the recipe domain, the property has ingredient is far more
important than has author and the two recipes with the same ingredients would be
considered more similar than the two recipes with the same author. So, the property
has ingredient would have a higher relevance factor than prophas author.</p>
        <p>There are various approaches to calculation of property relevance in a domain. It
can be declared a priori and although e ective, this solution may not be very feasible
for a huge domain. Also, it is possible to introduce an automatic method to determine
the relevance of properties. One possibility is to compute the similarity of concepts and
then to calculate the relevance factor for each property as the square of the average
similarity between concepts with the same value for that property.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Property or underlying hierarchy?</title>
        <p>First of all, some aspects of the domain can be seen as properties, as well as underlying
hierarchy. So the question is, which way of modelling of the domain would provide
better similarity with human judgement. For example, in the recipes domain, the concepts
corresponding to dish type can be easily organised into a hierarchy and we can have
all the instances be instances of certain Dish Type classes. On the other hand, we can
simply have a property dish type and have all the recipes be instances of Recipe.
4.3</p>
      </sec>
      <sec id="sec-4-3">
        <title>Relevance of values</title>
        <p>One of the problems with the approach in which all the values for properties are treated
equally is that they might not contribute to the overall similarity with the same degree,
since some values might be more important in a certain context than the other. For
example, if we consider recipes and the has ingredient the values beef or asparagus
would be more important than salt or pepper. Hence, we come to the point where we
might need to introduce relevance for values, along the lines for relevance for
properties. These would have to be proposed by domain experts or calculated by an algorithm
designed for this purpose.
4.4</p>
      </sec>
      <sec id="sec-4-4">
        <title>Hierarchy of values</title>
        <p>Another possible improvement of property based similarity is to take into account the
underlying hierarchy which might exist among the concepts used as values for
properties. For example, if we consider recipes and the property has ingredient, one recipe
can have ingredient Fusilli and the other one Spaghetti. Although these two
concepts are not equal, they could be considered equal or equal to a certain degree (e.g. 80%
equal), since they are both types of pasta, and are descendants of Pasta concept. So
it might be possible to consider “almost equal” direct descendants of a certain concept
and even less equal second degree descendants of a certain concept.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Related work</title>
      <p>There are various approaches to calculating similarity among concepts, depending on
the data structure used to represent the domain and on the amount and type of data
available about the concepts of the domain. The principal approaches to similarity
calculation are the following: (i) information content-based methods, (ii) distance-based
methods and (iii) feature-based methods. Various hybrid methods combine some of the
above methods.</p>
      <p>
        In his seminal paper,
        <xref ref-type="bibr" rid="ref16">Resnik (1999)</xref>
        proposes to calculate the semantic similarity of
concepts by calculating the information content in an is-a taxonomy of the closest class
subsuming both compared concepts. This similarity measure is given by the negative
logarithm of the probability of occurrence of the class in a text corpus. Another
important information-theoretic definition of similarity is introduced by
        <xref ref-type="bibr" rid="ref13">Lin (1998)</xref>
        where the
similarity among concepts is calculated taking into account the shared information for
the two concepts and the amount of information needed to fully describe them.
      </p>
      <p>
        The origins of the distance-based approach go back to
        <xref ref-type="bibr" rid="ref15">Rada et al. (1989)</xref>
        where the
ontology graph structure is used to calculate the distance between nodes (i.e., the
number of edges or the number of nodes between the two nodes) as a measure of their
similarity.
        <xref ref-type="bibr" rid="ref10">Leacock and Chodorow (1998)</xref>
        use the normalised path length in WordNet
        <xref ref-type="bibr" rid="ref5">(Fellbaum, 1998)</xref>
        between all the senses of the concepts being compared. The semantic
similarity is computed as a negative logarithm of the ratio between the number of nodes
in the path which connects the given concepts and the maximum depth of the taxonomy.
Wu and Palmer (1994) take into account the depths of the given words in the taxonomy
and the depth of their common subsumer in their similarity measure.
      </p>
      <p>
        <xref ref-type="bibr" rid="ref14">Pirro` and Euzenat (2010)</xref>
        introduced a FaITH semantic similarity measure which
uses Tversky’s feature-based model and calculates the saliency of the features using a
new information content approach based on the ontology structure. This new framework
permits to calculate semantic similarity, as well as semantic relatedness and can be
used to rewrite the existing similarity measures so that they can also compute semantic
relatedness.
      </p>
      <p>
        <xref ref-type="bibr" rid="ref17">Smyth (2007)</xref>
        calculates the similarity by taking into account individual features of
concepts and by assigning to each feature its own similarity function and the weight
which helps distinguish the importance of individual features..
      </p>
      <p>
        A semantic similarity measure for OWL objects introduced by
        <xref ref-type="bibr" rid="ref9">Hau et al. (2005)</xref>
        is
defined as a ratio between the shared and total information content of the two objects.
The information content is calculated from the objects’ description sets containing all
the statements describing the given objects and is based on the number of new RDF
statements that can be generated by applying a certain set of inference rules to the
predicate.
      </p>
      <p>The similarity measure introduced by Zadeh and Reformat (2013) is similar to ours
in the sense that it uses Tversky’s feature-based model for calculating similarity and
then calculates object’s common and distinctive features by observing all the relations
the objects have in the given ontology.</p>
      <p>
        In the realm of “Conceptual Spaces” proposed by
        <xref ref-type="bibr" rid="ref6">Ga¨rdenfors (2004)</xref>
        the concepts
can be seen as convex regions in a conceptual space, whereas instances correspond
to points. The conceptual spaces are constructed using primitive quality dimensions
which represent various qualities of objects (e.g., color, shape, size). These dimensions
of conceptual spaces provide the means for determining similarity between concepts
and instances which can be defined as the inverse of their distance in the space.
      </p>
      <p>
        Recently, Conceptual Spaces have been integrated with ontological formalisms to
form hybrid knowledge bases by
        <xref ref-type="bibr" rid="ref11">Lieto et al. (2015)</xref>
        . Since the points are represented as
vectors of the point coordinates (representing various object dimensions), their mutual
similarity is calculated as cosine similarity.
6
      </p>
    </sec>
    <sec id="sec-6">
      <title>Conclusions and future work</title>
      <p>
        In this work we present an approach to calculate similarity based on properties defined
in an ontology, as well as insights on which other factors can be included to improve
this similarity in di erent contexts. We limited ourselves to presenting the approach
only for the instances in the ontology, although the approach can be applied to classes
and classes defined as property restrictions as well. In addition, this approach can be
applied to linked open data
        <xref ref-type="bibr" rid="ref3">Bizer et al. (2009)</xref>
        or any other structure where the objects
are described by means of their properties. For example, it would be interesting to apply
our measure of similarity to ConceptNet
        <xref ref-type="bibr" rid="ref18">Speer and Havasi (2013)</xref>
        , where an edge which
connects two nodes can be seen as a property and a target concept as its value.
      </p>
      <p>In the case presented here, the prerequisite is the ontology with explicitly defined
properties for classes, rather than only a simple taxonomy of concepts. We only dealt
with object type properties in this work, since data type properties, such as literals,
require more complex analysis.</p>
      <p>One of the limitations of the present approach, known for Tversky’s notion of
similarity, is that in the case of concepts with few properties defined for them, is is possible
that some concepts would be equally similar to the concepts which in reality have
different degrees of similarity with them. This problem can be overcome by enlarging the
knowledge base with as many properties as possible for each concept. Also, by
assigning relevance to certain properties, the more important features would be taken into
account.</p>
      <p>The evaluation of the approach on di erent datasets is being carried out and would
be published elsewhere.</p>
      <p>Tversky, A. (1977). Features of similarity. Psychological Review, 84(4):327–352.
Wu, Z. and Palmer, M. (1994). Verbs semantics and lexical selection. In 32nd Annual
Meeting on Association for Computational Linguistics, pages 133–138. Association
for Computational Linguistics.</p>
      <p>Zadeh, P. D. H. and Reformat, M. (2013). Assessment of semantic similarity of concepts
defined in ontology. Information Sciences, 250:21–39.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Allemang</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Semantic Web for the Working Ontologist: E ective Modeling in RDFS and OWL</article-title>
          . Morgan Kaufmann Publishers.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Antoniou</surname>
          </string-name>
          , G. and
          <string-name>
            <surname>van Harmelen</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>A Semantic Web Primer, second edition</article-title>
          . The MIT Press.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heath</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Linked Data - The Story So Far</article-title>
          .
          <source>International Journal on Semantic Web and Information Systems</source>
          ,
          <volume>5</volume>
          (
          <issue>3</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>22</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Cena</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Likavec</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Osborne</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Property-based interest propagation in ontology-based user model</article-title>
          .
          <source>In 20th Conference on User Modeling</source>
          , Adaptation, and Personalization,
          <string-name>
            <surname>UMAP</surname>
          </string-name>
          <year>2012</year>
          , volume
          <volume>7379</volume>
          <source>of LNCS</source>
          , pages
          <fpage>38</fpage>
          -
          <lpage>50</lpage>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Fellbaum</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , editor (
          <year>1998</year>
          ).
          <article-title>WordNet: An Electronic Lexical Database</article-title>
          . MIT Press.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Ga</surname>
            ¨rdenfors,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Conceptual spaces: The geometry of thought</article-title>
          . MIT Press.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Gruber</surname>
            ,
            <given-names>T. R.</given-names>
          </string-name>
          (
          <year>1993</year>
          ).
          <article-title>A translation approach to portable ontology specifications</article-title>
          .
          <source>Knowledge Acquisition Journal</source>
          ,
          <volume>5</volume>
          (
          <issue>2</issue>
          ):
          <fpage>199</fpage>
          -
          <lpage>220</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Guarino</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Poli</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>Editorial: The role of formal ontology in the information technology</article-title>
          .
          <source>International Journal of Human-Computer Studies</source>
          ,
          <volume>43</volume>
          (
          <issue>5-6</issue>
          ):
          <fpage>623</fpage>
          -
          <lpage>624</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Hau</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Darlington</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>A semantic similarity measure for semantic web services</article-title>
          .
          <source>In Web Service Semantics Workshop at WWW</source>
          (
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Leacock</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Chodorow</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>1998</year>
          ).
          <article-title>Combining local context and WordNet similarity for word sense identification</article-title>
          , pages
          <fpage>305</fpage>
          -
          <lpage>332</lpage>
          . In C. Fellbaum (Ed.), MIT Press.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Lieto</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Minieri</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Piana</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Radicioni</surname>
            ,
            <given-names>D. P.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>A knowledge-based system for prototypical reasoning</article-title>
          .
          <source>Connection Science</source>
          ,
          <volume>27</volume>
          (
          <issue>2</issue>
          ):
          <fpage>137</fpage>
          -
          <lpage>152</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Likavec</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Shapes as property restrictions and property-based similarity</article-title>
          . In Kutz,
          <string-name>
            <given-names>O.</given-names>
            ,
            <surname>Bhatt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Borgo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            , and
            <surname>Santos</surname>
          </string-name>
          , P., editors,
          <source>2nd Interdisciplinary Workshop The Shape of Things</source>
          , volume
          <volume>1007</volume>
          <source>of CEUR Workshop Proceedings</source>
          , pages
          <fpage>95</fpage>
          -
          <lpage>105</lpage>
          . CEUR-WS.org.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>1998</year>
          ).
          <article-title>An information-theoretic definition of similarity</article-title>
          .
          <source>In 15th International Conference on Machine Learning ICML '98</source>
          , pages
          <fpage>296</fpage>
          -
          <lpage>304</lpage>
          . Morgan Kaufmann Publishers Inc.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Pirro</surname>
            `,
            <given-names>G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Euzenat</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>A feature and information theoretic framework for semantic similarity and relatedness</article-title>
          .
          <source>In 9th International Semantic Web Conference, ISWC '10</source>
          , volume
          <volume>6496</volume>
          <source>of LNCS</source>
          , pages
          <fpage>615</fpage>
          -
          <lpage>630</lpage>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Rada</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mili</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bicknell</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Blettner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>1989</year>
          ).
          <article-title>Development and application of a metric on semantic nets</article-title>
          .
          <source>IEEE Trans. on Systems Management and Cybernetics</source>
          ,
          <volume>19</volume>
          (
          <issue>1</issue>
          ):
          <fpage>17</fpage>
          -
          <lpage>30</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Resnik</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>1999</year>
          ).
          <article-title>Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language</article-title>
          .
          <source>Journal of Artificial Intelligence Research</source>
          ,
          <volume>11</volume>
          :
          <fpage>95</fpage>
          -
          <lpage>130</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Smyth</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Case-based recommendation</article-title>
          .
          <source>In The Adaptive Web, Methods and Strategies of Web Personalization</source>
          , volume
          <volume>4321</volume>
          <source>of LNCS</source>
          , pages
          <fpage>342</fpage>
          -
          <lpage>376</lpage>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Speer</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Havasi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>The peoples web meets nlp</article-title>
          .
          <source>In Gurevych, I. and</source>
          <string-name>
            <surname>Kim</surname>
          </string-name>
          , J., editors, ConceptNet 5:
          <article-title>A large semantic network for relational knowledge</article-title>
          , pages
          <fpage>161</fpage>
          -
          <lpage>176</lpage>
          . Springer Berlin Heidelberg.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>