<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Extending Tagging Ontologies with Domain Speci c Knowledge</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Frederic Font</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sergio Oramas</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gyorgy Fazekas</string-name>
          <email>gyorgy.fazekas@eecs.qmul.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Xavier Serra</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Centre for Digital Music, Queen Mary University of London</institution>
          ,
          <addr-line>London</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Music Technology Group, Universitat Pompeu Fabra</institution>
          ,
          <addr-line>Barcelona</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Currently proposed tagging ontologies are mostly focused on the de nition of a common schema for representing the agents involved in a tagging process. In this paper we describe preliminary research around the idea of extending tagging ontologies by incorporating some domain speci c class de nitions and relations. We illustrate our idea with a particular use case where a tag recommendation system is driven by such an ontology. Besides our use case, we believe that such extended tagging ontologies can bring more meaningful structure into folksonomies and improve browsing and organisation functionalities of online platforms relying on tagging systems.</p>
      </abstract>
      <kwd-group>
        <kwd>Tagging ontology</kwd>
        <kwd>Tag recommendation</kwd>
        <kwd>Folksonomy</kwd>
        <kwd>Freesound</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Tagging systems are extensively used in online sharing sites as a means of content
browsing and organisation. In general, tagging systems allow users to annotate
resources with free-form textual labels chosen by the users of the system. The
resulting set of associations between tags, users and resources that arise in tagging
systems is known as a folksonomy. Folksonomies su er from a number of
wellknown issues including tag scarcity, ambiguities with synonymy and polysemy,
typographical errors, the use of user-speci c naming conventions, or even the use
of di erent languages [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Despite these issues, folksonomies have succeeded in
providing basic organisation and browsing functionalities to online sharing sites.
However, their unstructured nature makes it di cult to allow more advanced
capabilities such as hierarchical browsing or faceted searching.
      </p>
      <p>
        In order to bring some structure to folksonomies, some studies have focused
on the analysis of folksonomies to automatically derive structured or
semistructured representations of the knowledge of the domain, typically in the form
of lightweight ontologies or hierarchical taxonomies [2{4]. However, these
methods still tend to require signi cant amount of manual e ort to provide meaningful
representations. Some other studies have proposed modelling folksonomies and
the tagging process using ontologies [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. These ontologies are focused on de ning
a common schema for the agents involved in a tagging process. Current tagging
ontologies may enhance interoperability between folksonomies, but do not
generally provide ways of structuring a folksonomy with domain-speci c knowledge.
      </p>
      <p>In this paper, we present some preliminary research on extending a tagging
ontology by including the possibility to represent the semantics of a speci c
domain. The generic idea is presented and discussed in Sec. 2. In Sec. 3 we
describe a practical application in a real-world tagging system where the tagging
ontology is used to drive a tag recommendation system. Finally, in Sec. 4, we
discuss about possible future directions.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Extending a tagging ontology</title>
      <p>
        Our starting point for the extension of the tagging ontology is the Modular
Uni ed Tagging Ontology (MUTO) [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. In the core of the MUTO ontology, the
muto:Tagging class is de ned which supports several relations to indicate, among
others, a resource that is tagged (muto:hasResource of type rdfs:Resource), the
tag assigned to the resource (muto:hasTag of type muto:Tag), and the user that
made the tag assignment (muto:hasCreator of type sioc:UserAccount).
      </p>
      <p>
        We propose to extend the tagging ontology in two ways. First, we add a
number of subclasses to the muto:Tag class which can be used instead of muto:Tag
(right side of Fig. 1). These subclasses represent di erent tag categories (i.e. with
a narrower scope than the generic muto:Tag class), similarly to the idea of TagSet
introduced in the SCOT ontology [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], but in a semantic sense. A tag category
represents a broad concept that groups a set of tags that share some
semantic characteristics related to the speci c domain. The same principle is applied
to resources, and a number of rdfs:Resource subclasses are de ned (left side
of Fig. 1). Resource subclasses (or resource categories) are used to organise
resources into groups with a narrower scope than the general rdfs:Resource class.
The particular de nition of tag and resource categories would depend on the
particular application domain of the extended tagging ontology (an example is
given below). Also, in the diagram of Fig. 1, both tag and resource subclasses
are only shown as a at hierarchy, but more complex class structures could be
explored. Moreover, existing domain ontologies and taxonomies may be reused
to extend the tagging ontology.
      </p>
      <p>
        Second, we propose to extend the tagging ontology by adding object
properties to model semantic relations among tag categories and resource categories
(dashed lines in Fig. 1). These object properties are useful to, for example, model
dependencies between categories of tags and resources. The speci c meaning of
these semantic relations would also depend on the particular application domain
of the extended tagging ontology. In addition to semantic relations between tag
and resource categories, and given that the muto:Tag class inherits from the
Simple Knowledge Organization System (SKOS) [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] class skos:Concept, semantic
relations between tag individuals can be also modelled [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Use case: tag recommendation in Freesound</title>
      <p>
        We applied an extended tagging ontology as described above in a tag
recommendation task in the context of Freesound, an online collaborative sound database
with more than 200,000 uploaded sounds and 3,8 million registered users [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. In
Extending Tagging Ontologies with Domain Speci c Knowledge
rdfs:Resource
rdfs:subClassOf
:ResCategory1
:ResCategory2
...
:ResCategoryN
muto:hasResource
muto:Tagging
muto:hasTag
muto:Tag
rdfs:subClassOf
:TagCategory1
:TagCategory2
...
:TagCategoryN
previous work by the authors, a tag recommendation system was proposed which,
given a set of input tags, is able to suggest other potentially relevant tags [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
The system is based on the construction of ve tag-tag similarity matrices
tailored to ve manually de ned and rather generic audio categories (e.g. \Music",
\E ects", etc.). The recommendation system uses a classi er to automatically
predict one of these ve categories depending on the input tags, and then uses
the corresponding tag-tag similarity matrix for the recommendation process.
      </p>
      <p>To improve that recommendation system, we used the extended tagging
ontology to model the folksonomy and include some domain speci c knowledge. On
the one side, we extended the tagging ontology by adding 5 resource subclasses
corresponding to the 5 sound categories mentioned above (e.g. :EffectsSound).
Moreover, we de ned 26 tag subclasses that are intended to group the tags in
categories according to the type of information that they describe about sounds
(i.e. grouped in audio properties). These include categories like \instrument",
\microphone",\chord", \material", or \action" (e.g. :InstrumentTag). On the
other side, we extended the ontology by de ning several object properties that
relate resource and tag categories. These object properties indicate that a
particular tag category is relevant for one or more resource categories. For example,
:InstrumentTag is relevant for :MusicSound audio category, and this is indicated
with a :hasInstrument object property that relates instrument tag category with
music resource category. Furthermore, we populated the extended ontology by
manually classifying the 500 most used tags in Freesound into one of the 26
de ned tag categories and added these tags as individuals (instances) of the
corresponding tag category. This last step was necessary to bootstrap the tag
recommendation system (see below).</p>
      <p>Using this ontology we can extend the tag recommendation system in a way
that, given the audio category detected by the classi er and the object properties
that relate resource and tag categories, we can guide the annotation process by
suggesting tag categories that are relevant for a particular sound. For example,
for a sound belonging to the resource category :MusicSound, we can suggest tag
categories like :InstrumentTag or :TempoTag, which are particularly relevant for
musical sounds. Once tag categories are suggested, users can click on them and
get a list of tag recommendations for every category. This list is obtained by
computing the intersection of the tags provided by the aforementioned
recommendation system (based on the tag-tag similarity matrix), with those that have
been manually introduced in the ontology as tag instances of the selected tag
category. See Fig. 2 for an screenshot of a prototype interface for that system.
by the extended tagging ontology.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>In this paper we have shown some preliminary research on extending current
tagging ontologies with structured knowledge speci c to the domain of
application of a tagging system. By incorporating domain speci c knowledge in tagging
ontologies, we expect to be able to bring some semantically-meaningful structure
into folksonomies. We have illustrated the idea with a use case in the context
of an audio clip sharing site where a tag recommendation system is driven by
an extended tagging ontology. Formal evaluation of the ontology-driven tag
recommendation system is planned for future work. Besides the described use case,
we think that using extended tagging ontologies can improve other aspects of
online platforms relying on tagging systems such as browsing and organisation
functionalities. The main limitation for such improvements is the population of
the ontology. In our use case, we use a manually populated ontology to bootstrap
the recommender, but the tagging system could further populate the ontology
by learning new \tag individuals-tag category" relations when users annotate
new sounds. Furthermore, other knowledge extraction techniques could be used
to automatically populate the ontology with information coming from other
user-generated data (e.g. in our case could be sound comments or textual
descriptions), and even from external data sources from linked open data.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>H.</given-names>
            <surname>Halpin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Robu</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Shepard</surname>
          </string-name>
          , \
          <article-title>The dynamics and semantics of collaborative tagging,"</article-title>
          <source>in Proceedings of the 1st Semantic Authoring and Annotation Workshop</source>
          , pp.
          <volume>1</volume>
          {
          <issue>21</issue>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>P.</given-names>
            <surname>Mika</surname>
          </string-name>
          , \
          <article-title>Ontologies are us: A uni ed model of social networks and semantics,"</article-title>
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>5</volume>
          , pp.
          <volume>5</volume>
          {
          <issue>15</issue>
          ,
          <string-name>
            <surname>Mar</surname>
          </string-name>
          .
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>P.</given-names>
            <surname>Heymann</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Garcia-Molina</surname>
          </string-name>
          , \
          <article-title>Collaborative Creation of Communal Hierarchical Taxonomies in Social Tagging Systems," tech. rep</article-title>
          .,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>F.</given-names>
            <surname>Limpens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. L.</given-names>
            <surname>Gandon</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Bu</surname>
          </string-name>
          <article-title>a, \Linking folksonomies and ontologies for supporting knowledge sharing: a state of the art</article-title>
          ,"
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>S.</given-names>
            <surname>Lohmann</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.</surname>
          </string-name>
          <article-title>D az, and I. Aedo, \MUTO: the modular uni ed tagging ontology,"</article-title>
          <source>Proceedings of the 7th International Conference on Semantic Systems - I-Semantics '11</source>
          , pp.
          <volume>95</volume>
          {
          <issue>104</issue>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>H. L.</given-names>
            <surname>Kim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Scerri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. G.</given-names>
            <surname>Breslin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Decker</surname>
          </string-name>
          , and H. G. Kim, \
          <article-title>The State of the Art in Tag Ontologies : A Semantic Model for Tagging and Folksonomies,"</article-title>
          pp.
          <volume>128</volume>
          {
          <issue>137</issue>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. SKOS:
          <article-title>Simple Knowledge Organization System</article-title>
          . http://www.w3.org/TR/skos-reference.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>F.</given-names>
            <surname>Font</surname>
          </string-name>
          , G. Roma, and
          <string-name>
            <given-names>X.</given-names>
            <surname>Serra</surname>
          </string-name>
          , \
          <source>Freesound Technical Demo," in Proceedings of the 21st ACM Conference on Multimedia (ACM MM 13)</source>
          , pp.
          <volume>411</volume>
          {
          <issue>412</issue>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>F.</given-names>
            <surname>Font</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Serra</surname>
          </string-name>
          , and
          <string-name>
            <given-names>X.</given-names>
            <surname>Serra</surname>
          </string-name>
          , \
          <article-title>Class-based tag recommendation and user-based evaluation in online audio clip sharing,"</article-title>
          <source>Journal on Knowledge Based Systems</source>
          ,
          <year>2014</year>
          ,
          <volume>10</volume>
          .1016/j.knosys.
          <year>2014</year>
          .
          <volume>06</volume>
          .003.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>