<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Web 3.0 Approach for Improving Tagging Systems</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alexander Kreiser</string-name>
          <email>akreiser@googlemail.com</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andreas Nauerz</string-name>
          <email>andreas.nauerz@de.ibm.com</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fedor Bakalov</string-name>
          <email>fedor.bakalov@uni-jena.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Birgitta König-Ries</string-name>
          <email>birgitta.koenig-ries@uni-jena.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Martin Welsch</string-name>
          <email>martin.welsch@de.ibm.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Friedrich-Schiller University of Jena</institution>
          ,
          <addr-line>Ernst-Abbe-Platz 1-4, 07743 Jena</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>IBM Research and Development</institution>
          ,
          <addr-line>Schönaicher Straße 220, 71032 Böblingen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>IBM Research and, Development</institution>
          ,
          <addr-line>Schönaicher Straße 220, 71032 Böblingen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>IBM Research and, Development</institution>
          ,
          <addr-line>Schönaicher Straße 220, 71032 Böblingen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In Web 2.0 systems tagging has become one of the most popular techniques to allow users (and entire user communities) to categorize content autonomously. But, current tagging systems have their ipsides, though: synonyms and polysems lead to littered tag spaces making it di cult for users to nd relevant content. Users su er from retrieving content actually not being of interest or, vice versa, from not retrieving content that actually would be of interest when exploring the tag space. Moreover, in current tagging systems no relations between tags are modeled. Thus, recommending related tags (or content) is not possible. In this paper we present an approach allowing users, i.e. the community, to collaboratively model relations between tags. We provide UI components allowing to model these relations which are then stored in a SKOS-based ontology which can be leveraged for content recommendations. Giving the community the power to consolidate tags and to relate tags to each other and, at the same time, storing these relations in ontologies is our Web 3.0 approach to solve tag space littering problems and to issue tag-based recommendations.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Web 2</kwd>
        <kwd>0</kwd>
        <kwd>Web 3</kwd>
        <kwd>0</kwd>
        <kwd>Semantic Web</kwd>
        <kwd>Tagging</kwd>
        <kwd>Recommender</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>The concepts presented are being prototypically implemented
within IBM's WebSphere Portal and can be presented in a
live demo at the workshop.</p>
    </sec>
    <sec id="sec-2">
      <title>Categories and Subject Descriptors</title>
      <sec id="sec-2-1">
        <title>I.2.4 [Knowledge Representation Formalisms and Meth</title>
        <p>ods]: Predicate logic,Relation systems,Semantic networks;</p>
      </sec>
      <sec id="sec-2-2">
        <title>H.3.3 [Information Search and Retrieval]:</title>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>1. INTRODUCTION</title>
      <p>The recent popularity of collaboration techniques on the
Internet, particularly tagging and rating, provides new means
for both semantically describing web content as well as for
reasoning about users' interests, preferences and contexts.
It can add valuable meta information and even lightweight
semantics to web resources. Tagging allows non-expert users
to develop folksonomies that categorize content available in
the system.</p>
      <p>
        Unfortunately most current tagging systems have two main
drawbacks:
First, synonyms and polysems cannot be easily detected
automatically and thus litter the tag space. Synonyms lead
to multiple tags that all can have the same meaning, either
because they are only a morphological variation (apple vs.
apples) or semantically similar (baby vs. infant ). Polysems
lead to single tags that can have multiple meanings
(apple can refer to the fruit or to the company Apple). From
a user perspective the two problems might manifest
themselves as follows: A user Alice and a user Bob might both
apply the tag apple to some resources, but Alice might refer
to the fruit whereas Bob might refer to the computer
manufacturer. When Bob is later doing information retrieval
by selecting the tag apple he receives a lot of "irrelevant
noise" as he is also presented resources that have to do with
the computer manufacturer. This problem is referred to as
low precision problem. In the second scenario both users
might want to tag resources providing information about
the United States. Alice might tag these resources with
USA, Bob with United States. When doing information
retrieval Alice, might miss the resources tagged by Bob and
Bob might miss the resources tagged by Alice just because
the semantic relatedness of these tags remains invisible for
the system. This problem is referred to as low recall
problem. Current approaches to solve these problems include the
application of normalization and stemming algorithms (cp.
e.g. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]) to prevent littering due to synonyms and the
application of multiple tags to single resources to prevent littering
due to polysems. But both approaches have their limits.
Second, tags are at lists of words of uncontrolled
vocabularies not having any relations. Thus, current tagging systems
can hardly recommend users with related content. Being
able to recommend users with more generally available
concepts (e.g. a user interested in making Spaghetti might be
interested in making Pasta in general, too), with more speci c
concepts (i.e. recommending information about Spaghetti,
Farfalle, etc. when a user is searching for information about
Pasta) or just with related concepts (i.e. recommending
information about cat food when a users reads material about
cats in general) are highly appreciatable features in such
large system we deal with.
      </p>
      <p>In this paper we present a Web 3.0 approach for solving
the problems just mentioned. First, we allow users, i.e. the
community, to augment tags to make them less ambiguous.
Second, we allow users to collaboratively model relations
between tags which can then be leveraged for content
recommendations. We provide the community with UI
components to model these relations which are then stored in
a SKOS-based ontology. Giving the community the power
to consolidate tags and to relate tags to each other and, at
the same time, storing these relations in ontologies is our
Web 3.0 approach to solve tag space littering problems and
to issue tag-based recommendations.</p>
    </sec>
    <sec id="sec-4">
      <title>2. RELATED WORK</title>
      <p>
        Several approaches aim to improve tagging systems by
using semantically rich tags instead of at keywords. We will
refer to these systems as semantic tagging systems. These
approaches can be split into two groups based on the
strategies they use:
1. Semantifying already existing tags of a tagging system
2. Enabling a community to annotate resources with
semantically rich tags instead of at keywords
With the rst strategy at keywords of existing tagging
systems (like del.icio.us) are enriched with semantics. This is
often an automatic process in which tags are mapped to
concepts from an ontology or relations between tags are
derived from the folksonomy structure. The system TagOnto
proposed in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] automatically maps tags from a social
tagging system to entities in domain ontologies. In [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] tags are
also mapped to ontology concepts in order to improve the
retrieval process and recommend related content. Heymann
and Garcia-Molina introduced an algorithm in [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] to
transform a set of at tags into a hierarchical taxonomy.
Angeletou et al. ([
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]) create semantic relations between tags by
leveraging the semantics stored in public ontologies.
There were also e orts of conceptualizing and implementing
a new kind of tagging systems, where users de ne the
meaning of a tag when it is applied. Hence, tags are no longer
keywords but references to entities in semantic repositories.
In many of these systems Semantic Web technology was used
to store the meaning of a tag and semantic relations between
tags. The following two paragraphs describe two types of
semantic tagging systems and their related work. With the
rst type existing public ontologies were used while with the
second one the tagging community creates the tag ontology
itself.
      </p>
      <p>
        SemKey - a semantic collaborative tagging system described
in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] - utilizes Wikipedia and WordNet1 to disambiguate
      </p>
      <sec id="sec-4-1">
        <title>1http://wordnet.princeton.edu/</title>
        <p>
          keywords used for tagging while the actual tags then
refer to Wikipedia pages. The social bookmarking website
Faviki enables the annotation of bookmarks with DBpedia2
concepts. The entity describer 3 is an add-on to the
tagging system of Connotea4 where tags refer to entities from
the freebase5 ontology. In [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] Passant and Laublet propose
MOAT, a client-server framework where the server provides
services for term disambiguation and nding matching
concepts in several public knowledge bases (e.g.: DBpedia,
Yahoo! Geonames).
        </p>
        <p>
          With the second type, the tag ontology is created by the
same community that uses it for tagging. That way, the
semantic data is tailored to a tagging community and kept as
small as necessary. In [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] Braun et al. describe two
prototypes of semantic tagging systems where the creation of
semantic data is merged into the tagging process: SOBOLEO
and the IMAGINATION project. RichTags ([
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]) is the name
of a social bookmarking system resulting from the master
thesis of Fountopoulos where users build and extend a SKOS
ontology collaboratively. In Fuzzzy ([
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]) a community
creates its own ontology using Topic Maps6 and is then able to
bookmark sites with the created topics.
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>3. OUR APPROACH</title>
      <p>In this section we describe our approach for solving the
problems of tagging systems by combining Semantic Web
technology with Web 2.0 interface components. Section 3.1
describes our ontology design and how users can provide
semantic relations between tags. In Section 3.2 we give a brief
overview over the web interface and its components. Section
3.3 shows the current system architecture of our prototype.</p>
    </sec>
    <sec id="sec-6">
      <title>3.1 Linked Knowledge Islands</title>
      <p>
        We rely on Semantic Web technology regarding the storage
of tags and relations. SKOS (Simple Knowledge
Organization System, [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]) is a W3C candidate recommendation for
modeling thesauri and loose taxonomies in RDF format and
builts upon OWL7. Like [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] we chose the SKOS
vocabulary to store our tag ontology. In our system tags are
instances of skos:Concept, have multiple labels and a de
nition that helps to disambiguate tags with identical labels.
Users are able to apply a small set of semantic relations:
skos:broader and skos:narrower to model a loose
taxonomy and skos:related to create associative links between
tags. Broader and narrower relations can help to solve the
abstraction level problem: A search for resources annotated
with Animal should also return resources annotated with
Cat, Dog, Bird, etc. The related property can be leveraged
for tag and content recommendation. This is useful to
extend search parameters or reformulating a search query but
also to suggest additional tags during the tagging process.
We chose SKOS to model the tag ontology since in our
opinion the small prede ned set of semantic relations is suitable
2http://dbpedia.org
3http://www.entitydescriber.org/
4Online reference management for clinicians and scientists,
http://www.connotea.org/
5http://www.freebase.com/
6http://topicmaps.org/
7Web Ontology Language, http://www.w3.org/2004/OWL/
for a big community. Users are able to create loose
taxonomies and general associative links between tags without
having to be experts in ontology engineering. Also, our
ontology is compatible with other SKOS-based knowledge
systems which enables us to use existing SKOS ontologies as a
base or to cover certain knowledge domains.
      </p>
      <p>
        Roy Lachica states in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] that "users already have a mental
representation of the world and have no need to
externalize this view by entering their world view into the system."
This conclusion is drawn from the lack of contribution he
experienced testing the Fuzzzy social bookmarking system
where users collaboratively build an ontology. Another
observation made by Lachica was that in "...several cases where
users do not agree with tag-relations that have been created
by others but they take no action to correct it by voting or
other means"([
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]). Having one collective knowledge model is
a di cult task to achieve since the individual mental models
of individual users will always diverge to some degree.
Disagreement on labels and relations used within the model can
be a major issue lowering user experience and motivation to
participate. In our linked knowledge islands approach users
are able to model their private tag space and draw
immediate bene ts from the semantic relations, e.g. by exploiting
the taxonomy and associations to automate steps in their
retrieval process.
      </p>
      <p>This is achieved by giving each user the opportunity to
structure and label his tags the way he wants. Additionally, a user
can map any of his tags to tags from other private models
if both tags refer to the same concept from the real world.
This mapping is stored as skos:exactMatch property in the
ontology. Everyone in the community can have the bene ts
of the collective knowledge model if he wants, but is also
allowed to stay within his own model. Every user has a
concept scheme (skos:ConceptScheme) which contains all tags
created by him. Concept schemes in SKOS were designed
to aggregate concepts when dealing with data from di
erent knowledge organization systems - in our case the di
erent mental models of the users. Since the skos:exactMatch
property is symmetric and transitive the separate knowledge
islands are quickly connected to a big network. If e.g. Bob
links his tag Semantic Web in his model to Alice's tag Web
3.0 in her model he is able to exploit parts of her knowledge
model as well. If Alice has previously linked her tag Web
3.0 to a tag in Carl's model, Bob can exploit Carl's model
as well and vice versa (Figure 1).</p>
    </sec>
    <sec id="sec-7">
      <title>3.2 Web 2.0 Graphical User Interface</title>
      <p>The simplicity and exibility of folksonomies is one of the
main reasons for the success of social tagging systems
today. Specifying the semantics of a tag can solve some of
the problems of tagging systems and therefore improve user
experience. But it also means having to extend the tagging
process which results in a work overhead for the user. In
order to keep this overhead small, we tried to design a user
interface that allows the community to perform the
necessary tasks fast and easily. One aspect of Web 2.0 is the
improved usability provided by Rich Internet Applications
(RIA) using AJAX technology and a more desktop-like look
and feel. Our web interface consists of several widgets built
with the Dojo Toolkit8 which interact with the web services
of our system.</p>
      <sec id="sec-7-1">
        <title>Locating and Disambiguating Tags</title>
        <p>Tags can be found by typing a term into a type-ahead
enabled combo box which in turn displays a list of tags with
matching labels. The user can then navigate through that
list and obtain additional information like the tag de nition
to disambiguate tags with similar or identical labels. For an
even faster disambiguation on rst sight one of the broader
tags is displayed in brackets (Figure 2). This process helps
the user to locate a suitable tag for her intends and lets
her specify the exact meaning of the tag she applies to a
resource. If no suitable tag can be found the user is free to
create a tag in her private model by providing a preferred
label and a de nition. Optionally, other tags that are broader
or narrower than or related to the new tag can be declared,
integrating the new tag directly into the taxonomy.</p>
      </sec>
      <sec id="sec-7-2">
        <title>Providing Semantic Relations</title>
        <p>Within the user interface the semantic tags always have the
same visual representation and can be dragged and dropped
to perform certain actions. If one tag is dropped onto
another tag a context menu appears and the user can add a
semantic relation between these two tags. For instance, if
a user nds a tag from another user that refers to exactly
the same concept as her tag but with a slightly di erent
label, she can map these two tags using the context menu (see
Figure 3). After annotating a resource, the semantic tagging
application con rms the tagging and displays semantic tags
other users have previously applied to this resource. If the
user notices that a tag another user has applied is related to
or about the same thing as one of her tags she can quickly
provide this semantic relation using drag and drop and the
context menu. This was one of our main objectives:
Modeling semantics should be embedded in the tagging process.</p>
        <sec id="sec-7-2-1">
          <title>8http://www.dojotoolkit.org/</title>
          <p>Furthermore, tags can be dropped into tag bags which are
visual representations of containers that hold a set of tags
(e.g. a user can put his favorite tags into one single tag bag).</p>
        </sec>
      </sec>
      <sec id="sec-7-3">
        <title>Browsing the Taxonomy and Related Tags</title>
        <p>In several scenarios it would be valuable to browse the
taxonomy and relations de ned in the tag ontology. For instance,
when selecting semantic tags from the ontology in order to
tag a resource, the most speci c tag should be used instead
of the most general. By exploring the tag model taxonomy
and drilling down into narrower tags the user is able to
select the most speci c semantic tags for a resource. With the
help of our browsing widget users can explore a visualization
of the tag model. In the current prototype, the hierarchical
relations of a tag can be explored with a tree view
(Figure 4). Narrower tags are shown as child nodes in the tree
while broader tags are visualized as parent nodes.
Unfortunately, the tree visualization has obvious drawbacks;
multiple broader tags can not directly be visualized and related
tags aren't displayed at all. In our current implementation
this information can be looked up by right-clicking on a tree
node where related and broader tags are listed in a context
menu.
Therefore, we are experimenting with di erent methods of
tag model visualization. A conceivable replacement for the
tree view could be a simple graph visualization (Figure 5).
Tags are displayed as nodes and straight lines between the
nodes depict semantic relations where each semantic relation
has its own color. By clicking on a node all semantic
relations to directly related tags could be dynamically loaded
and visualized. In that way a user can explore the tag space
visually until she nds the information she needs. Since this
is a rather uncommon type of interface user experience and
acceptance are still to be evaluated.</p>
        <p>Finally, leveraging the knowledge about relations between
tags (and, implicitly, about resources) we can also
automatically recommend users with related content as outlined
before.</p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>3.3 Architecture</title>
      <p>The current system prototype is being implemented on IBM
WebSphere Portal technology with a separate component
containing the knowledge base. The whole system
architecture is loosely coupled using web services to access the
individual components. Our choice regarding the semantic
repository fell on openRDF sesame9 since we considered it
to be one of the most mature non-commercial RDF
repositories. To enable OWL inferencing (which is necessary for
the SKOS properties we use), swiftOWLIM10 was integrated
with sesame as Storage And Inference Layer (SAIL). A web
service layer on top of the RDF repository adds convenient
and simpli ed access to the semantic data which is used by
the user interface widgets. Additional, customized SPARQL
queries can be run against the repository making it possible
for other applications to use the stored semantics.
Tags and their semantic relations are kept in the repository
while the tagging system just stores URI references to the
tags. The loose coupling makes it possible to swap the
underlying tagging system or tagging API which takes care of
annotating resources and retrieving resources by tag
reference.</p>
    </sec>
    <sec id="sec-9">
      <title>4. CONCLUSION AND FUTURE WORK</title>
      <p>In this paper we have described a Web 3.0 approach to
collaboratively modeling semantic relations among tags. Our
approach solves a number of problems associated with the
traditional tagging approach that leverages at lists of
unrelated tags. First, users are enabled to create tag hierarchies
9http://openrdf.org
10http://ontotext.com/owlim/
that t their mental models, hence better organize content
of their interest. Second, the semantic relations among tags
can be used for improving the information retrieval process
and recommending related content. Finally, our approach
solves the tag disambiguation and tag space littering
problems.</p>
      <p>The ideas presented in this paper are being prototypically
implemented in IBM's WebSphere Portal. Upon completion
of implementation, we plan to evaluate usability of the
proposed tagging process as well as the value of improvements
that the collaboratively created tag ontologies provide for
content recommendation. Also in the future we plan to
extend our approach to let users collaboratively create more
semantically rich OWL ontologies.</p>
      <p>IBM and WebSphere are trademarks of International Business
Machines Corporation in the United States, other countries or
both. Other company, product and service names may be
trademarks or service marks of others.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Alexandre</given-names>
            <surname>Passant</surname>
          </string-name>
          .
          <article-title>Using ontologies to strengthen folksonomies and enrich information retrieval in weblogs</article-title>
          .
          <source>In Proceedings of the First International Conference on Weblogs and Social Media (ICWSM)</source>
          , Boulder, Colorado,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Alexandre</given-names>
            <surname>Passant</surname>
          </string-name>
          and
          <string-name>
            <given-names>Philippe</given-names>
            <surname>Laublet</surname>
          </string-name>
          .
          <article-title>Meaning of a tag: A collaborative approach to bridge the gap between tagging and linked data</article-title>
          .
          <source>In Proceedings of the WWW 2008 Workshop Linked Data on the Web (LDOW2008)</source>
          , Beijing, China,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>S.</given-names>
            <surname>Braun</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Walter</surname>
          </string-name>
          .
          <article-title>Ontology maturing: A collaborative web 2.0 approach to ontology engineering</article-title>
          ,
          <volume>08</volume>
          .
          <fpage>05</fpage>
          .
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>G.</given-names>
            <surname>Fountopoulos. RichTags: A Social Semantic</surname>
          </string-name>
          <article-title>Tagging System: Dissertation for MSc Web Technology</article-title>
          .
          <source>PhD thesis</source>
          , University of Southampton, Southampton, 20
          <year>December 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Marchetti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Tesconi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ronzano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Rosella</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Minutoli</surname>
          </string-name>
          .
          <article-title>Semkey: a semantic collaborative tagging system</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Miles</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          .
          <article-title>Skos simple knowledge organization system reference</article-title>
          ,
          <volume>29</volume>
          .
          <fpage>08</fpage>
          .
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>P.</given-names>
            <surname>Heymann</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Garcia-Molina</surname>
          </string-name>
          .
          <article-title>Collaborative creation of communal hierarchical taxonomies in social tagging systems</article-title>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>M. F.</given-names>
            <surname>Porter</surname>
          </string-name>
          .
          <article-title>An algorithm for su x stripping</article-title>
          .
          <source>pages 313{316</source>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>R.</given-names>
            <surname>Lachica</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Karabeg</surname>
          </string-name>
          .
          <article-title>Metadata creation in socio-semantic tagging systems: Towards holistic knowledge creation and interchange</article-title>
          . In L.M. Garshol and L. Maicher, editors,
          <source>Scaling Topic Maps. Topic Maps Research and Applications</source>
          <year>2007</year>
          , Lecture Notes in Computer Science. Springer,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Silvia</surname>
            <given-names>Bindelli</given-names>
          </string-name>
          , Claudio Criscione, Carlo Curino, Mauro L. Drago, Davide Eynard, and
          <string-name>
            <given-names>Giorgio</given-names>
            <surname>Orsi</surname>
          </string-name>
          .
          <article-title>Improving search and navigation by combining ontologies and social tags</article-title>
          . In Robert Meersman, Zahir Tari, and Pilar Herrero, editors,
          <source>OTM Workshops</source>
          , volume
          <volume>5333</volume>
          of Lecture Notes in Computer Science, pages
          <volume>76</volume>
          {
          <fpage>85</fpage>
          . Springer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <article-title>So a Angeletou, Marta Sabou, Lucia Specia, and Enrico Motta. Bridging the gap between folksonomies and the semantic web: An experience report</article-title>
          .
          <source>In Bridging the Gep between Semantic Web and Web 2.0 (SemNet</source>
          <year>2007</year>
          ), pages
          <fpage>30</fpage>
          {
          <fpage>43</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>