<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Composite Ontology Change Operators and their Customizable Evolution Strategies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Muhammad Javed</string-name>
          <email>mjaved1@computing.dcu.ie</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yalemisew M. Abgaz</string-name>
          <email>yabgaz2@computing.dcu.ie</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Claus Pahl</string-name>
          <email>cpahl3@computing.dcu.ie</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Centre for Next Generation Localization (CNGL), School of Computing, Dublin City University</institution>
          ,
          <addr-line>Dublin 9</addr-line>
          ,
          <country country="IE">Ireland</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Change operators are the building blocks of ontology evolution. Elementary, composite and complex change operators have been suggested. While lower-level change operators are useful in terms of finegranular representation of ontology changes, representing the intent of change requires higher-level change operators. Here, we focus on higherlevel composite change operators to perform an aggregated task. We introduce composite-level evolution strategies. The central role of the evolution strategies is to preserve the intent of the composite change with respect to the user's requirements and to reduce the change operational cost. Composite-level evolution strategies assist in avoiding the illegal changes or presence of illegal axioms that may generate inconsistencies during application of a composite change. We discuss few composite changes along with the defined evolution strategies as an example that allow users to control and customize the ontology evolution process.</p>
      </abstract>
      <kwd-group>
        <kwd>Composite Change</kwd>
        <kwd>Composite-level Evolution Strategies</kwd>
        <kwd>Ontology Change Operator Framework</kwd>
        <kwd>Semantic Ontology Evolution</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Ontologies can support tasks ranging from capturing the conceptual knowledge,
architecture and process models/patterns to the organisation and
traceability of digital content and other information artifacts. Ontologies are essential
for knowledge sharing. In such domains, ontologies can convey useful semantic
information for content managers, ontology engineers, domain experts etc. to
understand and process. However, information systems are always subject to
change and ontology change management can pose challenges. The reason for
such changes can be the changes in the domain, the specification, the
conceptualization or any combination of them [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. A change in an ontology may originate
from a domain knowledge expert, a user of the ontology or a change in the
application area [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Some changes are about the introduction of new classes, removal
of outdated classes and changes in the structures and the description of classes.
These change may affect the semantic or structural validity of the data [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Many ontology evolution tasks cannot be done by a single atomic change
operation and require higher-level change operations. Based on different
perspectives, different combinations of atomic change operations can be utilized to
perform a composite task. While performing an ontology change using atomic
change operations, users can utilize different atomic-level evolution strategies
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] to resolve any inconsistencies. Such evolution strategies are essential at each
level of granularity. In this paper, we focus on the composite change operators
of our layered change operator framework [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and present evolution strategies
suitable for composite changes. Central features of our presented work are:
– Elementary, composite and complex change operators have been proposed in
literature [
        <xref ref-type="bibr" rid="ref4 ref6 ref8">4, 6, 8</xref>
        ]. This indicates that the effectiveness of an ontology change
is significantly dependent on the granularity, how the change operators are
combined and the extent of their effect on the ontology. Thus, a coherent
treatment of the change operators and their effect on the consistency at each
level of granularity becomes vital.
– Composite change operators and the composite-level evolution strategies can
reduce the overall operational cost and to achieve a specific intent of change.
Each evolution strategy is most appropriate in one specific situation.
      </p>
      <p>The paper is structured as follows: A description of our empirical study and
the layered change operator framework is given in Section 2. In Section 3, we
discuss higher-level composite change operators. In Section 4, we present
higherlevel evolution strategies suitable for the specific composite change operations. A
brief evaluation is given in Section 5. We end with related work and conclusions.
2</p>
      <p>Layered Ontology Change Operator Framework
We studied the evolution of domain ontologies empirically in order to investigate
the relationships between generic and domain-specific changes and to determine
common patterns of change. Based on our observation of common changes, we
proposed a layered framework of change operators:
– level one captures atomic changes which are elementary tasks,
– level two captures aggregated changes to represent composite tasks,
– level three captures domain-specific change patterns.</p>
      <p>
        In this paper, we focus on level two composite change operators only. As a case
study [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], the domains University Administration and Database Systems were
taken into consideration. The former is selected as it represents an organisation
involving people, organisational units and processes. The latter is a technical
domain that can be looked at from different viewpoints for instance, being
covered in a course or a textbook on a subject. We observed that the changes in
the database system can be identified by taking different perspectives into
account. In teaching, the course content evolves almost every year introducing new
concepts, theories and languages. In publishing, new database books in the area
appear every couple of years resulting in addition of new chapters, merging or
removal of existing chapters and changing of the structure of the topics within
and among chapters. In industry, new technologies and languages are emerging.
These changes result both in schema and instance-level changes.
      </p>
      <p>Composite Ontology Change Operators
Atomic level operationalisation and representation of ontology changes can only
describe the addition or deletion of an ontology element. The semantics of
applied change(s) are missing from such representation. Level two composite change
operators fill this gap. They can be utilized to perform aggregated generic tasks
and present the intent of the applied changes more explicitly. Composite change
operators are identified by grouping atomic change operations of level one.</p>
      <p>LEVEL 3</p>
    </sec>
    <sec id="sec-2">
      <title>Layer 2</title>
    </sec>
    <sec id="sec-3">
      <title>Layer 1</title>
      <p>LEVEL 2
LEVEL 1</p>
      <p>Manage Faculty</p>
      <p>Manage Student Research Student</p>
      <p>Registration</p>
      <p>Add New
Department
.....</p>
      <p>Merge</p>
      <p>Split</p>
      <p>Copy</p>
      <p>Move
.....</p>
      <p>Integrate Class Remove Class</p>
      <p>Context Context</p>
      <p>Integrate
Property Context</p>
      <p>Integrate
Individual
Add Class</p>
      <p>Add
subclassOf</p>
      <p>Delete
Class</p>
      <p>Delete
subclassOf</p>
      <p>Add Object
Property
Delete
Object
Property</p>
      <p>Add
Individual</p>
      <p>Delete
Individual
.....
.....</p>
      <p>Composite change operations come in two layers (Figure 1). First layer of
composite change operations includes group of those atomic change operations
that in general are executed together. For example, “Remove Class Context”
which not only deletes a class from the hierarchy, but also deletes all its roles1.
To delete a single class “faculty” in a university ontology, deleting the class from
the hierarchy is not sufficient. Before we delete the class, we have to delete all
axioms that contain class “faculty” as a parameter, such as deleting from the
domain and the range of properties like “isSupervisorOf ” or “hasPublication”
etc. In addition, we need to either delete its subclasses or link them to the parent
class in order to keep the ontology consistent. If an ontology engineer wants
to merge two or more classes, the operation requires operators higher than the
integrate/remove class context. In such a case, composite change operations from
layer two can be used. “merge classes”, “move classes” and “pull up property”
are the examples of layer two composite change operations. In this paper, we
primarily focus on layer two composite change operators. For simplicity, we refer
them as “composite change operators” here onwards.
1 a role is an ontology axiom by which an entity (Class, Property, Individual) is
attached to another entity of the domain ontology.</p>
      <p>While atomic change operators are useful for fine-granular representation of
ontology changes, representing the intent of the changes at the atomic level is not
feasible. If a class x is removed from a parent y and is attached (as a subclass) to
another class s, the semantics behind such change (at atomic level) only refers
to a change of the class hierarchy for class x, i.e. Move class (x, y, s). However,
if we represent that class s is actually a superclass of y, the semantics behind
such a change will refer to a Pull up class (x, y, s) change.</p>
      <p>
        There is no agreed standard set of composite change operations that one could
based on. It is obvious and also mentioned in research [
        <xref ref-type="bibr" rid="ref4 ref8">4, 8</xref>
        ] that one can combine
different atomic level change operations in order to construct new composite
changes. Thus, providing an exhaustive list of composite change operations is
not feasible. In our current work, we adopted the composite change operations
and their definitions from [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and are given in Table 1.
For higher-level ontology change representation, we introduce composite-level
evolution strategies that support ontology engineers by suggesting the evolution
strategies that may be most appropriate in a specific situation.
      </p>
      <p>
        As, a composite change is a combination of different atomic level change
operations, inconsistent states may emerge during the application of a composite
change operation. In such cases, different sets of atomic change operations can
be additionally utilized, along with the change request, to achieve the
consistent state of the domain ontology. However, each solution may lead to a
distinct consistent ontology version. Here, the term consistent state not only refers
to a structural consistency but also a semantic consistency [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. For example,
if a class ResearchStudent is split into two sibling classes PhDStudent and
MSByReseachStudent, the change will have a direct impact on associated
individuals, subclasses and properties (Figure 2). As soon as ResearchStudent is
FName
      </p>
      <p>DoB
studentId</p>
      <p>FName</p>
      <p>DoB
studentId</p>
      <p>Student</p>
      <p>ResearchStudent
enrolledIn</p>
      <p>hasSupervisor
Robert</p>
      <p>Zubair
FullTimeRS</p>
      <p>PartTimeRS
Change Request:
Split class (ResearchStudent, (PhDStudent,
MSByReasearchStudent))</p>
      <p>Student
?
enrolledIn</p>
      <p>?
hasSupervisor
PhDStudent</p>
      <p>MSByResearcgStudent
?
Robert</p>
      <p>?
FullTimeRS
?</p>
      <p>Zubair
?</p>
      <p>PartTimeRS
- Delete subclassOf (Student, ReserachStudent)
- Delete class (ResearchStiudent)
- Add class (PhDStudent)
- Add subclassOf (Student, PhDStudent)
- Add class (MSByResearchStudent)
- Add subclassOf (Student, MSByResearchStudent)
deleted from the class hierarchy,
– the individuals of class ResearchStudent will lose their type (rdf:type),
– the subclasses of ResearchStudent will become direct subclasses of owl:Thing
– properties will lose their domain/range.</p>
      <p>
        Leaving the individuals without a type and properties without a domain/range
has a semantic impact [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and the purpose of the split change is not achieved.
These issues must be resolved in such a way that the intent of the composite
change is acquired. One possibility here is to utilize the (atomic level) evolution
strategies proposed in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. However, the proposed evolution strategies deal with
the structural inconsistencies only and do not consider semantic inconsistencies.
Based on the given evolution strategies, the orphaned individuals will either be
i) deleted, ii) unique individuals will be deleted or iii) reconnected to the parent
of the deleted class (i.e., Student). The subclasses will either be i) deleted, ii)
attached to the parent class Student or iii) reconnected to the owl:Thing and the
properties will either be i) deleted or ii) left without any domain/range [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
According to the semantics of the split change request, the individuals, subclasses
and properties of the deleted class ResearchStudent must be preserved and
attached to the replacement classes (i.e., PhDStudent and MSByReseachStudent).
There are many ways to resolve this resolution point2.
      </p>
      <p>Different sets of change operations can be utilized to resolve the composite
change resolution point. Each set of change operations will lead to a distinct
ontology version. It would be too restrictive if we enforce one single solution
for a resolution point. Such solution may fulfill requirements of one ontology
engineer but not of others. A flexible mechanism is required here that allows
ontology engineers to resolve the resolution points based on their requirements
and needs. This can be achieved by using composite-level evolution strategies.
The evolution strategies are to preserve the semantics of a composite change in
such a way that domain ontology stays consistent.</p>
      <p>To identify different sets of evolution strategies, we started by exploring the
set of composite changes that can be applied to a domain ontology. Later, we
inspected what structural and semantic impact each composite change may have on
ontology entities and in which circumstances the domain ontology may become
inconsistent. Here, we examined the involved ontology entities of the composite
change and their inter- and intra-dependencies to other neighborhood ontology
entities. We scrutinized the changes that may lead to the subsequent changes.
Next step was to identify the resolution points. For each resolution point, we
defined evolution strategies and each evolution strategy represents one possible
way to resolve the (structural/semantic) consistency issue.</p>
      <p>Split class: In the example for composite change Split class, the newly added
sibling classes PhDStudent and MSByResearchStudent adopt roles from class
ResearchStudent. Thus, deleted relationships (axioms) of ResearchStudent
must be preserved and re-attached to the newly added classes. The question
arise here how to re-attach the deleted roles? Different users may adopt different
approaches to resolve this resolution point. A user can either
– distribute the deleted roles of class ResearchStudent among the replacement
classes, OR
– re-attach the roles to one of the replacement class, OR
– re-attach roles to both the replacement classes, OR
– do nothing.</p>
      <p>Here, a role can be re-attached to two or more classes using the “or” or
“and” property. For example, we can re-attach the property hasPublication as
domainOf(hasPublication) = PhDStudent or MSByReseachStudent, i.e. if an
individual instantiate the property hasPublication, the individual is either a
PhD student or a MS by research student.</p>
      <p>
        Now, we present five different defined composite changes, their structural and
semantic impacts, resolution points and proposed evolution strategies to resolve
such resolution points. The list below is not exhaustive.
2 Resolution points are the branch points where application of different sets of change
operations may lead to different sets of consistent ontology versions [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
Pull up class (X, C):
– Structural impact: The class X is pulled up in the hierarchy and became a
sibling of its previous parent class C.
– Semantic impact: Individuals of X are not individual of C anymore
(inference).
– Resolution point: Given, a class X is disjoint to class C,
      </p>
      <p>type(I) = X ⇒ ¬ type(I) = C (and vice versa)
Composite change may make ontology inconsistent if a predefined
disjointness exists among the siblings of class C (i.e., X and C become disjoint
classes in version 2). In such case, any instantiation of property P whose
domain/range consists class C, by any individual of class X, is not valid
anymore. If such instantiations of P exist, ontology will become inconsistent.
– Evolution Strategies:
– If the property P does not fit for the class C anymore, user can delete the
instantiation of the property P for the individuals of C, OR
– If the individuals of class X can still be individuals of C, user can delete
the disjointness between the classes C and X, OR
– If individuals of class X cannot be considered as individuals of class C
anymore however the property P is still valid for the individuals of class C,
in such case user can explicitly add class X as domain/range of the property
P i.e., domainOf(P) = C or X.</p>
      <p>Pull down class (A, B):
– Structural impact: The class A is pulled down in the class hierarchy and
became a child of its previous sibling class B.
– Semantic impact: Individuals of class A are individuals of class B as well.
– Resolution point: Given two classes A and B,</p>
      <p>subclassOf (A, B) ⇒ ¬ disjointClasses(A, B)
Domain ontology will become inconsistent if the classes A and B were disjoint
to each other before the execution of the composite change. In such case,
individuals of class A cannot be referred as individuals of class B.
– Evolution Strategies: In order to resolve the resolution point, user may
– delete the disjointness between class A and B.</p>
      <p>Merge classes ((C1, C2), X):
– Structural impact: classes C1 and C2 are replaced by one single class X.
– Semantic impact: classes C1 and C2 are merged into one single class X and
the relationships (axioms) of classes C1 and C2 (that had to be adopted by
the class X) become un-attached.
– Resolution point: The newly added class X adopts relationships from the
classes C1 and C2. Thus, the deleted relationships (axioms) of classes C1 and
C2 must be preserved and re-attached to the newly added class X.
– Evolution Strategies: To resolve the resolution point, user can either
– aggregate all the deleted roles of classes C1 and C2 to the replacement class
X, OR
– aggregate selected roles of classes C1 and C2 to the replacement class X.
InstanceOf
(defined)
InstanceOf
(defined)
Y
Y</p>
      <p>C
X
I
X
A</p>
      <p>I
I
A
C1
A
B</p>
      <p>Y
Resolution Point:
Given concepts C1 and C2 merged into a single concept X,
how to re-attach the roles of deleted concepts ?
InstanceOf
(Inference)</p>
      <p>InstanceOf
(Inference)
I</p>
      <p>initiates property P
primitive siblings disjoint (X, Z)</p>
      <p>Y
B
X
I
InstanceOf
(defined)
Y</p>
      <p>X
C1
A
X</p>
      <p>I
I
J
B</p>
      <p>A
P
Z</p>
      <p>I</p>
      <p>P
InstanceOf
(Inference)
initiates property P</p>
      <p>P</p>
      <p>P</p>
      <sec id="sec-3-1">
        <title>Split Concept</title>
        <p>I
C2</p>
        <p>C
InstanceOf
(Inference)
initiates property P
InstanceOf
(Inference)</p>
      </sec>
      <sec id="sec-3-2">
        <title>Pull down Concept</title>
      </sec>
      <sec id="sec-3-3">
        <title>Merge Concepts</title>
      </sec>
      <sec id="sec-3-4">
        <title>Pull up Property</title>
        <p>A</p>
        <p>P</p>
        <p>InstanceOf
(Inference)
initiates property P</p>
        <p>Resolution Point:
Once the property P is pulled up in the concept hierarchy from concept B to A,
the individual (that instantiate P) is no more (inferred) instance of subclass B.
loss of knowledge ?
primitive siblings disjoint (X, Z)
P</p>
        <p>Y
B
C2</p>
        <p>J</p>
        <p>P
P</p>
        <p>P
X
InstanceOf
(defined)</p>
        <p>Z
I</p>
        <p>InstanceOf
(Inference)
initiates property P</p>
        <p>Resolution Point:
Given two concepts A and B
if A issubclassOfB =&gt;¬ A is disjoint to B
InstanceOf
(defined)
Y</p>
        <p>A
B</p>
        <p>A
I</p>
        <p>X
Resolution Point:
Given a concepts X split into two concepts C1 and C2,
how to re-attach the roles of deleted concept X ?
primitive siblings disjoint (B, C)
primitive siblings disjoint (B, C, X)
Resolution Point:
Given, a concept X is disjoint with concept C
type(I) = X =&gt; ¬ type(I) = C (and vice versa)</p>
      </sec>
      <sec id="sec-3-5">
        <title>Pull up Concept</title>
        <p>primitive siblings disjoint (Y, B, A)
primitive siblings disjoint (Y, B, A)</p>
      </sec>
      <sec id="sec-3-6">
        <title>Pull down Property</title>
        <p>We evaluated the composite change operators along with the proposed evolution
strategies based on their change operational cost. The change operational cost
has been evaluated in terms of no. of step to be performed and the time required
performing the specified steps. To do so, we selected split and merge composite
change operations along with evolution strategies (Table 2).
No. Change
1 Split class (ResearchStudent, (MSByResearchStudent,
PhDResearchStudent)), Strategy: Split the Roles
2 Split class (ResearchStudent, (MSByResearchStudent,
PhDResearchStudent)), Strategy: Attach to both classes
3 Split class (ResearchStudent, (MSByResearchStudent,
PhDResearchStudent)), Strategy: Attach to one classes
4 Merge classes ((MSByResearchStudent, PhDResearchStudent),
Research</p>
        <p>Student), Strategy: Aggregate all roles
5 Merge classes ((MSByResearchStudent, PhDResearchStudent),
Research</p>
        <p>Student), Strategy: Aggregate selected roles</p>
        <p>Comparison between two levels (i.e., atomic and composite) of change
operations, in terms of number of required steps and the average operational time
(in seconds), is given in Figure 4. The learning affects (of different users) on the
performance of the operational time has been considered and omitted in our
controlled experiment. Usage of evolution strategies and pattern-driven data entry
0:19
0:17
0:33
0:20</p>
        <p>0:19
0:08
0:10
0:09
0:14
0:14
forms (for performing composite change operations) reduce the required
evolution effort. For example, in case of Merge classes - Strategy 1 change
operation, user need to take eight (8) steps in comparison to thirty (30) atomic change
operations. The biggest difference was seen in case of Split class change
operation where the selected strategy was to join the roles to both the newly added
classes (change 2). The result is fairly understandable as in case of atomic change
operators, user need to attach each role one after the other and hence increases
the number of required steps. More the roles (to be attached), more the steps
it requires. On the other hand, in case of composite change operator, user only
need to select the appropriate evolution strategy and all the roles will
automatically be attached to the newly added split classes. Hence, increase or decrease
of roles did not have any effect on the number of required steps.
6</p>
        <sec id="sec-3-6-1">
          <title>Related Work</title>
          <p>
            Representation of ontology changes using higher-level change operations was first
proposed by Stojanovic [
            <xref ref-type="bibr" rid="ref4">4</xref>
            ] and Klein [
            <xref ref-type="bibr" rid="ref8">8</xref>
            ]. The change operators are classified into
elementary, composite and complex. The identified change operators focus on
generic and structural changes only lacking domain-specificity and abstraction.
Taking into account the different perspectives of the users and domain experts,
our proposed framework defines an additional layer of domain-specific change
patterns - which are neglected by the lower-level compositional change
operators addressed in the literature. Recently, some researchers have also focused on
detection/discovery of higher-level ontology changes [
            <xref ref-type="bibr" rid="ref13 ref14 ref15">13–15</xref>
            ].
          </p>
          <p>
            Evolution strategies were first proposed by Stojanovic [
            <xref ref-type="bibr" rid="ref12">12</xref>
            ] where she
considered them as solutions for keeping the ontology consistent at each resolution
point. In order to automate the process, Stojanovic also introduced advanced
evolution strategies that automatically combine available elementary evolution
strategies. Such evolution strategies includes structure-driven, process-driven,
instance-driven and frequency-driven evolution strategies. The proposed
evolution strategies resolve structural consistency issues only and thus, are useful and
applicable to atomic level change operations only. In order to evolve the domain
ontology according to the needs of the user using composite change operators,
composite-level evolution strategies are necessary.
7
          </p>
        </sec>
        <sec id="sec-3-6-2">
          <title>Conclusion</title>
          <p>Ontologies are dynamic entities and will continue to evolve. Scalability beyond
manual evolution and change support is required for both stand-alone ontologies
that live over very long periods of time and also ontologies used in conjunction
with other information systems that themselves can trigger change. Supporting
this process by automated management of change and its analysis is a solution.</p>
          <p>Most of the ontology evolution tasks cannot be done using a single atomic
change operation and thus requires combination of them. We focused on the
operationalisation of ontology changes using higher-level change operators and
proposed composite-level evolution strategies. These higher-level evolution
strategies can deal with the semantic inconsistent states that may emerge during or
after the applied composite change. As different users may construct their own
composite changes, evolution strategies can be customized to resolve any
resolution point. Such higher-level evolution strategies were missing in the past and
need to be incorporated in any ontology editing framework.
This research is supported by the Science Foundation Ireland (Grant 07/CE/I1142)
as part of the Centre for Next Generation Localisation (www.cngl.ie) at Dublin
City University.</p>
        </sec>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klein</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Ontology evolution: Not the same as schema evolution</article-title>
          .
          <source>In: Journal of Knowledge and Information Systems</source>
          . Volume
          <volume>6</volume>
          (
          <issue>4</issue>
          ). (
          <year>2004</year>
          )
          <fpage>328</fpage>
          -
          <lpage>440</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Liang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alani</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shadbolt</surname>
          </string-name>
          , N.:
          <article-title>Ontology change management in prot´eg´e</article-title>
          .
          <source>In: Proceedings of AKT DTA Colloquium</source>
          , Milton Keynes, UK. (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Qin</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Atluri</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Evaluating the validity of data instances against ontology evolution over the semantic web</article-title>
          .
          <source>Information and Software Technology</source>
          .
          <volume>51</volume>
          (
          <issue>1</issue>
          ) (
          <year>2009</year>
          )
          <fpage>83</fpage>
          -
          <lpage>97</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Stojanovic</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Methods and tools for ontology evolution</article-title>
          .
          <source>PhD thesis</source>
          , University of Karlsruhe (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Javed</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abgaz</surname>
            ,
            <given-names>Y.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pahl</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>A pattern-based framework of change operators for ontology evolution</article-title>
          .
          <source>In: On the Move to Meaningful Internet Systems: OTM Workshops</source>
          . Volume
          <volume>5872</volume>
          of LNCS., Springer (
          <year>2009</year>
          )
          <fpage>544</fpage>
          -
          <lpage>553</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Palma</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haase</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Corcho</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gomez-Perez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Change representation for owl 2 ontologies</article-title>
          .
          <source>In: Proceedings of the sixth international workshop on OWL: Experiences and Directions (OWLED)</source>
          .
          <article-title>(</article-title>
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Gruhn</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pahl</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wever</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Data Model Evolution as Basis of Business Process Management</article-title>
          .
          <source>In: 14th International Conference on Object-Oriented and Entity Relationship Modelling O-O ER95. Springer-Verlag (LNCS Series)</source>
          . (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Klein</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Change Management for Distributed Ontologies</article-title>
          .
          <source>PhD thesis</source>
          , Vrije University Amsterdam (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Boyce</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pahl</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The development of subject domain ontologies for educational technology systems</article-title>
          .
          <source>Educational Technology and Society</source>
          <volume>10</volume>
          (
          <issue>3</issue>
          ) (
          <year>2007</year>
          )
          <fpage>275</fpage>
          -
          <lpage>288</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Holohan</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Melia</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McMullen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pahl</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The generation of e-learning exercise problems from subject ontologies</article-title>
          .
          <source>Sixth International Conference on Advanced Learning Technologies</source>
          . (
          <year>2006</year>
          )
          <fpage>967</fpage>
          -
          <lpage>969</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Pahl</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Giesecke</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hasselbring</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>An ontology-based approach for modelling architectural styles</article-title>
          <source>In: European Conference on Software Architecture ECSA'2007. Springer-Verlag (LNCS Series)</source>
          (
          <year>2007</year>
          )
          <fpage>60</fpage>
          -
          <lpage>75</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Stojanovic</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maedche</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Motik</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stojanovic</surname>
            ,
            <given-names>N.:</given-names>
          </string-name>
          <article-title>User-driven ontology evolution management. Volume 6 of LNCS</article-title>
          ., springer (
          <year>2002</year>
          )
          <fpage>285</fpage>
          -
          <lpage>300</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Papavassiliou</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Flouris</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fundulaki</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kotzinos</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Christophides</surname>
          </string-name>
          , V.:
          <article-title>On detecting high-level changes in RDF/S KBs</article-title>
          . In: 8th
          <source>International Semantic Web Conference</source>
          . Volume
          <volume>5823</volume>
          of LNCS., Springer (
          <year>2009</year>
          )
          <fpage>473</fpage>
          -
          <lpage>488</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Groner</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Staab</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Categorization and recognition of ontology refactoring pattern</article-title>
          .
          <source>Technical Report 09/2010</source>
          ,
          <string-name>
            <surname>Institut</surname>
            <given-names>WeST</given-names>
          </string-name>
          , Univ. Koblenz-Landau (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Javed</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abgaz</surname>
            ,
            <given-names>Y.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pahl</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Graph-based discovery of ontology change patterns</article-title>
          .
          <source>In: Joint Workshop on Knowledge Evolution and Ontology</source>
          Dynamics (EvoDyn):
          <source>ISWC Workshops</source>
          .
          <article-title>(</article-title>
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>