<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Semantic Wiki Refactoring. A Strategy to Assist Semantic Wiki Evolution</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Martin Rosenfeld</string-name>
          <email>martin.rosenfeld@lifia.info.unlp.edu.ar</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alejandro Fern</string-name>
          <email>alejandro.fernandez@lifia.info.unlp.edu.ar</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alicia Daz ?</string-name>
          <email>alicia.diaz@lifia.info.unlp.edu.ar</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>LIFIA, Facultad de InformÆtica, Universidad Nacional de La Plata</institution>
          ,
          <country country="AR">Argentina</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The content and structure of a wiki evolve as a result of the collaborative eort of the wiki users. In semantic wikis, this also results in the evolution of the ontology that is implicitly expressed through the semantic annotations. Without proper guidance, the semantic wiki can evolve in a chaotic manner resulting in quality problems in the underlying ontology, e.g. inconsistencies. As the wiki grows in size, the detection and solution of quality problems become more dicult. We propose an approach to detect quality problems in semantic wikis and assist users in the process of solving them. Our approach is inspired by the key principles of software refactoring, namely the cataloging and automated detection of quality problems (bad smells), and the application of quality improvement transformations (refactorings). In this paper we discuss the problem of evolving semantic wikis, present the core model of our approach, and introduce an extensible catalog of semantic wiki bad smells and an extensible toolkit of semantic wiki refactorings.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Semantic Wikis [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] enhance the functionality of wikis with mechanisms to express
semantic for the content in the wiki, in the form of semantic annotations . The
synthesis of all semantic annotations in a semantic wiki denes its ontology.
      </p>
      <p>
        Wikis evolve as a result of the collaborative eort of its users [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. However,
the uncoordinated edits of users may result in semantic wikis with poor quality
regarding the underlying ontology. Thus, assistance needs to be provided to check
that quality criteria are met and to minimize the eort of improvement.
      </p>
      <p>
        In software engineering, refactoring techniques are applied to improve
programs quality. The term refactoring [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] refers to the process of making persistent
and incremental changes to a system’s internal structure without changing its
external behavior, yet improving the quality of its design. Refactoring is based
on two key concepts: bad smells, that are an informal still useful characterization
of patterns of bad source code, and refactorings, which are piecemeal
transformations of source code that keep the semantics while removing (totally or partly)
a bad smell.
? This work was partially funded by: the PAE 37279-PICT 02203 which is sponsored
by the ANPCyT, Argentina.
      </p>
      <p>A strategy for refactoring consists in the following components: a toolbox
of refactorings, a catalog of bad smells, and detailed instructions on how to
apply refactorings to remove each smell. Additionally, automated tools for the
detection of bad smells and refactoring editors reduce the eort of refactoring and
the chance of introducing errors. Environments in which refactoring is a mature
practice (a culture), such as Smalltalk, usually oer these powerful tools.</p>
      <p>Inspired by the principles of refactoring, this paper explores the use of such
strategies to assist the evolution of semantic wikis and incrementally improve
their quality. In this order, we give denitions for Semantic Wiki Bad Smell
and Semantic Wiki Refactoring . Then, we adapt each of the components of a
refactoring strategy to the context of semantic wikis. This includes a toolbox of
semantic wiki bad smells, and a catalog of semantic wiki refactorings with their
instructions on how to remove bad smells. Additionally, we discuss how tools
can be used to automate the detection of bad smells and refactoring operations.</p>
      <p>The structure of this paper is the following. We discuss in detail the
problem of achieving quality in evolving semantic wikis in Section 2. Afterwards,
in Section 3, we describe the state of the art in works to assist the evolution
of semantic wikis. In Section 4, we present our approach that applies the ideas
of software engineering refactoring in the context of semantic wikis. Finally, in
section 5 we present the conclusions and future work.
2</p>
    </sec>
    <sec id="sec-2">
      <title>The problem of evolving semantic wikis</title>
      <p>
        The structure of a wiki, as well as its content, evolves as a result of the
collaborative eort of the wiki users. Usually, wikis are created with very few or
no structure in advance, so that users adjust it as a necessity to express
knowledge, ideas, opinions, etc. Mader [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] suggests that the wiki creator should not
try to guess the structure of a wiki in advance, but let it evolve into the optimal
organization of information as people use it.
      </p>
      <p>
        When the wiki is semantic, the wiki evolution also aects the formal
representation of the wiki content, i.e. the underlying ontology. Thus, the ontology
emerges with the wiki, as users add semantic annotations to the wiki content.
Kousetti et. al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] use the term Ontology Convergence to mean the process of
the implicit ontology evolving to a single model.
      </p>
      <p>The problem of evolving wikis consists in assuring a good wiki quality through
all the stages of the wiki evolution. If the evolution is not controlled, it is very
possible that the wiki evolves in a chaotic manner. Many problems can arise
as the result of multiple users collaboratively and incrementally editing a wiki.
In traditional wikis, these problems are usually related to the following quality
metrics: readability, structure, navegability, completeness, consistency.</p>
      <p>
        Semantic wikis aim to improve the quality of traditional wikis by allowing
to add semantic knowledge to the wiki content. However, they cannot assure
that the wiki evolves in a correct manner and that a good ontology convergence
is achieved. Kousetti et. al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] describe the following quality metrics for the
semantic wiki’s implicit ontology:
      </p>
      <sec id="sec-2-1">
        <title>Consistency: no sentence can be contradicted.</title>
        <p>Completeness: anything that needs to be in the ontology is explicitly dened
or it can be inferred from other dened denitions and axioms.</p>
        <p>Conciseness: does not contain unnecessary denitions or redundancies.
Expandability: you can easily add more knowledge without requiring to make
major changes to the existing structure.</p>
        <p>Sensitiveness: the ontology is more sensitive if small changes can alter easily
how well-dened a denition is.</p>
        <p>Let’s take a motivating example of a semantic wiki being employed to describe
geographical places. In an early stage of evolution, a user creates a category
"City". Later, another user creates a category "Capital city", attempting to form
a more specic group for cities that are also capitals. However, this user does not
realize that this category denes a subset of the resources of category "City" and,
consequently, should be a subcategory of it. The lack of this semantic relation
between the two categories results in many problems. First of all, it aects the
conciseness of the semantic wiki. Every time a user creates a page for a city that
is also a capital city, he will have to categorize it with both categories, so that no
semantic knowledge is lost. Secondly, it aects the semantic wiki completeness.
A user asking the wiki for a list of cities will not get as result the resources
categorized with category "Capital City" but not with category "City".</p>
        <p>The example above exposes that problems can arise while the evolution of
semantic wikis takes place. Such problems are nally perceived as a lack of
quality in the product, thus jeopardizing the success of the wiki. This results in
the necessity of an extra work, that consists in periodically checking for problems
in the wiki quality, and making the corresponding modications. This work is
commonly called "wiki gardening" 1. However, as the wiki becomes longer, with
many pages and semantic annotations, it becomes more dicult to detect quality
problems and solve them appropiately.</p>
        <p>In this context, where shared ownership and evolution of structure and
content are a plus, assistance needs to be provided to check that quality criteria are
met and to minimize the eort of improvement.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>State of the art</title>
      <p>
        Wikis are groupware. Peter and Trudy Johnson-Lenz [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] identify two prevailing
approaches to groupware: mechanism, the use of explicit forms and procedures,
and context or open space, to allow groups to self organize. Wikis are by nature
closer to the later approach. There are semantic wiki tools, such as Project
Halo 2, that support the denition of the ontology upfront (thus stressing the
"mechanism"’ approach). Those wikis are usually called Semantic Data Wikis .
In contrast, our research focuses on wikis created with very few or no structure
in advance, so that users incrementally create the ontology.
1 http://www.wikisym.org/ws2008/index.php/What_are_the_tasks_of_a_wiki_gardener%3F
2 http://www.mediawiki.org/wiki/Extension:Halo_Extension
      </p>
      <p>
        In the eld of ontologies, the problem of ontology evolution is one of the
current topics of the research agenda. Djedidi et. al. [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and Haase et. al. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
focus on consistency achievement when a change in the ontology is performed.
They employ resolution mechanisms to recover from four levels of
inconsistencies: structural, logical, conceptual and domain dependent. Moreover, the former
presents a list of metrics to evaluate the quality of an ontology. Baumeister and
Seipel [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] describe a set of anomalies in the design of the ontology that may
aect its mantainability, usability and understandability, and propose
refactoring methods to eliminate them. They distinguish four categories of anomalies:
redundancy, circularity, inconsistency and deciency. Although these approaches
make signicant contributions to the eld of ontologies, the domain of semantic
wikis presents new challenges. Firstly, the collaborative way of editing a wiki
increments the possibilities of generation of dierent kind of anomalies. Secondly,
the combination of semantic annotations with wiki’s tacit knowledge (i.e. text,
images, etc.) has to be considered.
      </p>
      <p>
        An approach to assist the evolution of semantic wikis is MOCA [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], which is
a Semantic Mediawiki (SMW) [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] extension. It is a support system that assists
wiki authoring and contribution to the background ontology. MOCA provides
assistance in the edit page of the wiki, giving help with recommendations for types
using the background ontology, and insertion of annotations without knowledge
of the syntax. A similar approach is taken by the Project Halo, which is also an
extension of SMW that provides intuitive graphical interfaces that facilitate the
authoring, retrieval, navigation and organization of semantic data.
      </p>
      <p>Although these two works assist the evolution of semantic wikis by helping
users in the creation of content, they do not aim to neither nd quality problems
nor solve them. SMW+3 is actually an approach to accomplish part of this.
SMW+ is a semantic wiki built on top of SMW, aimed at the enterprise market.
In addition to assisting users in authoring using the Halo Extension, SMW+
oers gardening functionality. It comprises a set of programmable tasks (called
bots) to automate or assist users in the process of improving the quality of the
wiki content. For example, there are bots to nd pages without annotations, or
to nd artifacts on schema or annotation level which indicate a bad modeling.</p>
      <p>Although the contribution of the gardening functionality of SMW+ should
be recognized, it is strongly biased towards the identication of quality problems.
It does not provide support for the implementation of the changes required to
remove them and, thus, to improve the quality of the semantic wiki.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Refactoring semantic wikis</title>
      <p>In this section we will see how each of the components of a refactoring strategy,
that were described in section 1, are applied to the context of semantic wikis.
But rst of all, in section 4.1, we will need to dene the model of the artifact
that will serve as the base to dene each of them.</p>
      <sec id="sec-4-1">
        <title>3 http://wiki.ontoprise.de/smwforum/index.php/MainPage</title>
        <p>4.1</p>
      </sec>
      <sec id="sec-4-2">
        <title>Core model In order to dene refactorings and bad smells, we need a model of a semantic wiki that will serve as a base. We call it the core model, which is shown in gure 1. It is dened as an OWL ontology, and we use UML diagrams to visualize it.</title>
        <p>The core model is a conceptual model of a semantic wiki and is inspired on
the knowledge base of SMW. However, it can be customized and extended to
support new features, so that new refactorings and smells could be dened in
terms of them.</p>
        <p>A Resource is anything that can be described in a wiki: Concept, that
represents individuals in the wiki; Category, which allows to group resources; Property,
that describes the semantic of relationships between resources; and Type, that
is used to specify the object type of properties. Each of the resources can have
a wiki Page or Article that describes it. Pages can be also directly related to
other pages using untyped links.</p>
        <p>Semantic Annotation is subclassied in Categorization and Property
Annotation. A Categorization describes a relation of membership of a resource in a
category. A subcategory relationship between categories is dened when the
subject resource of a categorization is a category. In this case, the subject category
is a subcategory of the object category.</p>
        <p>A Property Annotation is composed by three elements: a subject, that can
be any resource; a property, which is an individual of Property; and an object.
Relationship Annotations are those property annotations whose object is another
resource, while the object of Attribute Annotations are end values of a data
type. Categorizations could be restated as relationship annotations in which the
property describes the belongs to semantic, and the object is allways a category.</p>
        <p>We assume the existence of a set of built-in properties with special meanings.
One of them is the Subproperty of Property. When used as the property of a
relationship annotation between two properties, it describes a subproperty
relationship between the subject property and the object property. Another built-in
property is the Has type Property that indicates the object Type of a Property.
4.2</p>
      </sec>
      <sec id="sec-4-3">
        <title>A toolbox of semantic wiki refactorings</title>
        <p>Semantic wiki refactorings are transformations in the semantic structure of a
semantic wiki knowledge base, that allow to improve the implicit ontology quality.
Refactorings describe an ordered way of appropiately performing such
transformations, so that new inconsistencies, redundancies and other quality problems
are avoided. Each refactoring is dened by: a name ; a description, which
summarizes the refactoring in informal language; and the mechanics, which are a
series of mechanical transformations in the model of the wiki.</p>
        <p>In the following we describe in detail the refactoring called Create subcategory
relationship as an example. As it is not the objective of this paper to dene a
complete catalog of refactorings, we will later list other refactorings for which
we will only mention their name and description.</p>
        <p>Create subcategory relationship refactoring describes a transformation in which
an existent category turns to be a subcategory of another one. Dening such
relationship helps improve the quality of search results, the conciseness and
completeness of the semantic wiki.</p>
        <p>Following the example described in section 2, applying this refactoring would
mean to make "Capital City" a subcategory of "City". The rst step to
appropiately accomplish this, must consist in actually making "Capital City"
subcategory of "City". This is the basic step to create the subcategory relationship.
Secondly, the categorizations of category "City" in each resource that also belongs
to category "Capital City" have to be removed. This is because it is now
implicit that every resource that belongs to "Capital City" also belongs to "City".
Applying this step avoids redundant categorizations. The last step consists in
eliminating redundancies in the categorization chain. Supose the existence of a
category "Geographical place", that is supercategory of both categories. Then,
the subcategory relationship that states that "Capital City" is subcategory of
"Geographical place" is now redundant and, thus, has to be eliminated.</p>
        <p>The following is the formalization of this refactoring. Applied to the
example, the category "City" plays the role of supercategory, "Capital City" is the
subcategory, and "Geographical place" is the super-supercategory :</p>
      </sec>
      <sec id="sec-4-4">
        <title>Name Create subcategory relationship.</title>
        <p>Description Make an existent category subcategory subcategory of another
existent category supercategory.</p>
        <p>Mechanics
1. Make supercategory supercategory of subcategory.
2. For each resource that belongs to subcategory remove its categorization
of supercategory.
3. For each category super-supercategory that is supercategory of
subcategory : if it is also a supercategory of supercategory, remove it as
supercategory of subcategory.</p>
        <p>Note that the steps dened in the mechanics of the refactoring are not bound
to any semantic wiki implementation. The concrete actions that has to be done
to actually perform the steps, depend on the way each semantic wiki
implementation implements each of the semantic wiki features. In this way, refactorings
are able to be reused in any semantic wiki implementation.</p>
        <p>Table 1 presents a list of other possible semantic wiki refactorings. This
list can be extended and customized. Furthermore, if the implementation of the
semantic wiki supported new features, it could be extended to make use of them.</p>
      </sec>
      <sec id="sec-4-5">
        <title>A catalog of semantic wiki bad smells</title>
        <p>
          Refactorings describe how to appropiatelly perform transformations in the wiki.
However, they say nothing about when they should be applied. Fowler [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] arms
that "deciding when to start refactoring, and when to stop, is just as important
to refactoring as knowing how to operate the mechanics of a refactoring".
        </p>
        <p>Dening bad smells may help determine when to apply each refactoring. A
semantic wiki bad smell is a symptom in the semantic structure of a semantic
wiki that possibly indicates a deeper problem, and suggests that a refactoring
should be applied. It must be said that the detection of a bad smell does not
necessarily implies a real problem. It must be analyzed in the current context
and decide whether it should be applied or not a refactoring.</p>
        <p>Each bad smell is dened with: a name ; a description, which describes the
bad smell in informal language; the related refactorings that should be applied
to remove the smell; and a detection mechanism . The detection mechanism may
simply involve the execution of a query to the wiki knowledge base, or may apply
more sophisticated methods such as data minning techniques.</p>
        <p>As with refactorings, it is not the objective of this paper to dene a complete
catalog of bad smells. We will rst describe as an example the Twin categories
bad smell and then present a preliminar list of other possible ones.</p>
        <p>The Twin categories bad smell describes the case when two categories appear
together in categorizations very frequently. The rst reason why this bad smell
can be detected, is if two categories have the same semantic but dierent names.
This case is intrinsic to the collaborative way of semantic wikis. This situation
can arise because a user does not know a category already exists, or because
of users belonging to dierent professional stu or speaking dierent languages.
The consequence of this problem is that a category is duplicated.</p>
        <p>The second possible cause is that the twin categories dene a subcategory
relationship. The example presented in section 2 describes this situation. Because
of the lack of the subcategory relationship between the categories "Capital City"
and "City", every time a resource is categorized with category "Capital City",
it should be also categorized with category "City". To remove the bad smell in
this case, the "Create subcategory relationship" refactoring should be applied.</p>
        <p>The following is the full denition of this bad smell:</p>
      </sec>
      <sec id="sec-4-6">
        <title>Name Twin categories</title>
        <p>Description Categorizations of two categories categoryA and categoryB appear
together very frequently.</p>
        <p>Related Refactorings
1. Unify categories</p>
        <p>Cause: The two categories describe the same category.</p>
        <p>Example: categoryA = "LIFIA", categoryB = "LIFIA Lab"
2. Create subcategory relationship</p>
        <p>Cause: The two categories describe a subcategory relationship.</p>
        <p>Example: categoryA = "Capital city", categoryB = "City"
Detection Mechanism In this case, we decided to use a semantic query as the
detection mechanism. The semantic query is expressed in SPARQL query
language, and is based on "SPARQL 1.1 Query" 4 specication.</p>
        <p>SELECT DISTINCT ? categoryA ? categoryB
WHERE { ? categorizationA has_subject ? subjectA
? categorizationB has_subject ? subjectA
? categorizationA has_object ? categoryA
? categorizationB has_object ? categoryB .</p>
        <p>FILTER ((? categorizationA != ? categorizationB )</p>
        <p>&amp;&amp; (? categoryA != ? categoryB ))
}
GROUP BY ? categoryA ? categoryB</p>
        <p>HAVING ( count (*) &gt; PARAM )</p>
        <p>Table 2 presents a list of other possible semantic wiki bad smells.
4 http://www.w3.org/TR/2009/WD-sparql11-query-20091022/
Name Description
Concept too catego- A concept belongs to too many categories. This symptom may
exrized pose the fact that the concept describes more than one real concept.
Divergent property Instances of a property diverge in range and domain. A property is
used with many semantics.</p>
        <p>Twin properties Annotations of two properties appear together in the same resources
very frequently.</p>
        <p>Resource with no se- A resource is not subject of any semantic annotation.
mantic annotations
Large category</p>
        <p>A category is object of too many categorizations.</p>
        <p>Table 2: List of semantic wiki bad smells
4.4</p>
      </sec>
      <sec id="sec-4-7">
        <title>Automating the detection of bad smells and refactoring</title>
        <p>operations
Automating the detection of smells is a necessity as the wiki grows in size and
semantic knowledge. Dening a detection mechanism such as a semantic query
for each smell, makes it possible to nd all the occurrences of a bad smell
automatically. Integrating a tool for the detection of bad smells in the semantic wiki
would allow users to look for quality problems with less eort.</p>
        <p>The mechanics of the refactorings describe an ordered way of applying
transformations, consisting in a series of simple actions. However, it could become
tedious and time-consuming to execute those actions by hand. Moreover, the
chances of making mistakes and introducing new errors are increased. For wiki
refactoring to be a productive strategy to assist semantic wiki evolution, eort
and risk must be minimized.</p>
        <p>Fortunately, many times it is possible to have a refactoring automation tool.
Take for example the Create subcategory relationship refactoring. You have
several changes to make and check for correctness if you do it by hand. With a
refactoring automation tool, one simply selects both categories (subcategory and
supercategory) and launches the refactoring. The refactoring tool applies all the
steps of the mechanics as part of the same single transaction. The whole process
takes seconds instead of several minutes. Moreover, the refactoring operation
ensures that no action is lost and no bugs are introduced.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusions and future work</title>
      <p>Semantic wiki refactoring is an approach to detect quality problems in
semantic wikis and assist users in the process of solving them. It is inspired by the
key principles of software refactoring. We have discussed the problem of
evolving semantic wikis, presented the core model of our approach, and introduced
extensible catalogs of semantic wiki bad smells and refactorings.</p>
      <p>As future work to complete and extend this investigation, it remains to
complete the catalogs of semantic wiki bad smells and refactorings. A categorization
should be dened to achieve a better understanding. In other respects, the tools
to automate the semantic wiki refactoring operations and semantic wiki detection
of smells should be developed. It will allow to carry out experimental evaluations
to check the eect of a refactoring strategy in the evolution of semantic wikis.</p>
      <p>In other sense, as wikis have a strong social component, it can be
investigated the social factor in a semantic wiki refactoring strategy. In this order,
collaborative detection of smells and collaborative testing of refactorings should
be studied. The rst one arises as a necessity because some bad smells are
difcult to be detected by automated detection mechanisms, e.g. a bad smell to
detect inappropiate names for categories. We propose a social detection
mechanism in which users could collaboratively agree the presence of a bad smell. The
second takes the idea from software engineering agile methods. They advocate
the use of automated unit testing to ensure that no bugs were introduced and
the success of a refactoring. Adapting this idea, we propose a social testing in
which wiki users could collaboratively state if a refactoring was successful or not.</p>
      <p>Finally, future work will deal with refactoring of wiki’s tacit knowledge. Tacit
knowledge should be considered in the refactoring operations, and could also be
the source of bad smells.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Schaert</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bry</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baumeister</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kiesel</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Semantic wikis</article-title>
          .
          <source>IEEE Software 25(4)</source>
          (
          <year>2008</year>
          )
          <fpage>811</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Leuf</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cunningham</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>The Wiki way: quick collaboration on the Web</article-title>
          .
          <string-name>
            <surname>Addison-Wesley</surname>
          </string-name>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Fowler</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Refactoring: Improving the Design of Existing Code</article-title>
          . Addison-Wesley, Boston, MA, USA (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Mader</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          : Wikipatterns. Wiley Publishing (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Kousetti</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Millard</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Howard</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>A study of ontology convergence in a semantic wiki</article-title>
          .
          <source>In: WikiSym</source>
          <year>2008</year>
          . (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Johnson-Lenz</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , Johnson-Lenz,
          <string-name>
            <surname>T.</surname>
          </string-name>
          :
          <article-title>Post-mechanistic groupware primitives: rhythms, boundaries and containers</article-title>
          .
          <source>Int. J. Man-Mach. Stud</source>
          .
          <volume>34</volume>
          (
          <issue>3</issue>
          ) (
          <year>1991</year>
          )
          <fpage>395417</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Djedidi</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aufaure</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          :
          <article-title>Onto-evoal an ontology evolution approach guided by pattern modeling and quality evaluation</article-title>
          . In Link, S.,
          <string-name>
            <surname>Prade</surname>
          </string-name>
          , H., eds.:
          <source>FoIKS</source>
          . Volume
          <volume>5956</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2009</year>
          )
          <fpage>286305</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Haase</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stojanovic</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Consistent evolution of owl ontologies</article-title>
          .
          <source>In: Proceedings of the Second European Semantic Web Conference</source>
          , Heraklion,
          <string-name>
            <surname>Greece.</surname>
          </string-name>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Baumeister</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seipel</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Verication and refactoring of ontologies with rules</article-title>
          .
          <source>In: EKAW'06: Proceedings of the 15th International Conference on Knowledge Engineering and Knowledge Management</source>
          . (
          <year>2006</year>
          )
          <fpage>8295</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Krtzsch</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vrandecic</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vlkel</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haller</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Studer</surname>
          </string-name>
          , R.:
          <article-title>Semantic wikipedia</article-title>
          .
          <source>Journal of Web Semantic</source>
          <volume>5</volume>
          (
          <issue>4</issue>
          ) (
          <year>2007</year>
          )
          <fpage>251261</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>