<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Structure-based Analysis and Modularization of Ontologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Gokhan Coskun</string-name>
          <email>coskun@inf.fu-berlin.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Freie Universitat Berlin Supervisor: Prof. Dr.-Ing. Robert Tolksdorf Phase of PhD: Second Phase</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>De ned as a problem-relevant, explicit and formal speci cation of a shared conceptualization, ontologies became a new hype in the context of the Semantic Web. Being a shared knowledge its potential for information integration in the large World Wide Web is promising. But either the reuse of existing ontologies or the matching of di erent ontologies is unavoidable for this integration. Therefore means for analyzing ontologies as well as modularization techniques for partial reuse are very important and a key for the success of information integration based on ontologies. Considering ontologies as networks of concepts connected through properties, this work makes use of network analysis techniques and graph measures. It aims at gaining insight to which extent structure based techniques can be modi ed so they are paying attention to the semantics inherent in ontologies. The expected contribution is a method and tool support for ontology engineers to analyze and modularize ontologies in a (semi-) automatic way. The main goal is to improve the (re-)usability and maintainability by increasing the understandability and allowing ontology engineers to refactor and reuse existing ontologies easily.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology Reuse</kwd>
        <kwd>Ontology Modularization</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        During the last two decades the interest in using ontologies has increased.
According to the last few years this trend was mainly driven by the vision of the
Semantic Web [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. De ned as a problem-relevant, explicit and formal speci
cation of a shared conceptualization, the importance of ontologies lays in the deep
problem and domain analysis to create them. Because a good analysis clari es
the structure of the domain knowledge [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. But a good analysis as only one part of
the overall ontology creation process is a very cumbersome and time-consuming
activity. In order to provide some structural guidance for the ontology creation
process some ontology engineering methodologies have been proposed (e.g. Cyc
Method [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], Uschold and Kings [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ], Gruninger and Fox [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], KACTUS
approach [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], Methontology [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], On-To-Knowledge [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ], and NeOn [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]). They
were followed by some machine learning approaches [
        <xref ref-type="bibr" rid="ref21 ref7 ref9">7, 9, 21</xref>
        ], which aimed at
reducing the need for human intervention. The newest trend in ontology
engineering is to build ontologies with a community in a collaborative manner (e.g.
Holsapple et al. [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], DILIGENT [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], Dogma [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], HCOME [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], RapidOWL [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]).
In most methodologies ontology reuse is recommended, because it is expected
to reduce engineering costs by avoiding re-building already existing conceptual
models. Apart form reducing costs, reusing existing ontologies increases
interoperability from the viewpoint of the Semantic Web, where ontologies are primarily
considered as shared knowledge [
        <xref ref-type="bibr" rid="ref5 ref6">6, 5</xref>
        ].
      </p>
      <p>Even though most of these approaches mention the reuse of existing
ontologies as possible starting point, none of them describe in detail how to discover and
analyze candidate ontologies. This is very important, because reusing ontologies
presumes availability of already existing ontologies and discovery of potential
candidates for the particular use case. In this regard Ontolingua and OntoSelect
libraries are available and search engines as Swoogle1, Watson2 and Ontosearch3
has been already developed in the context of the Semantic Web. Although the
problem of discovering potential candidate ontologies seems to be mainly solved,
there is still an issue on selecting appropriate ontologies as well as understanding
and analyzing them. Even though the Resource Description Framework (RDF)
and the Web Ontology Language (OWL) les are based upon the Extensible
Markup Language (XML) syntax, which is declared to be human readable, it
takes some time to comprehend the content and the main structure and to
understand the main idea and purpose of the model. Even the Friend of a Friend
(foaf) vocabulary4 which is rather small shows in its speci cation a grouping of
the concepts as illustrated in Figure 1, in order to provide the reader an easier
way to understand this vocabulary.</p>
    </sec>
    <sec id="sec-2">
      <title>1 http://swoogle.umbc.edu 2 http://watson.kmi.open.ac.uk/WatsonWUI 3 http://www.ontosearch.org 4 http://xmlns.com/foaf/spec/</title>
      <p>In case of ontologies with hundreds and thousands of concepts (SUMO5: 965
concepts, DBPedia6: 934 concepts ) it is nearly impossible for the human mind to
overview the whole model. But this is essential to decide if a candidate ontology
is really useful and whether it needs some customization.
2</p>
      <sec id="sec-2-1">
        <title>Main Questions of the Thesis</title>
        <p>Ontologies are semantic models with di erent expressiveness levels which are
represented in RDF and OWL. A structure-based approach to analyze and
modularize these semantic models need to tackle some issues during the development
process. This section should provide a brief overview about open research
questions which need to be solved during the development process. The rst part of
the research questions are derived from the ontologies itself and their properties,
while the second part focuses on the ontology engineers which are addressed as
the users of this framework.
2.1</p>
        <sec id="sec-2-1-1">
          <title>Ontologies as Graphs</title>
          <p>
            RDF allows to create structured information as triples following the form
(Subject, Predicate, Object). The graph syntax of RDF allows to represent triples
as graphs where the subjects and the objects are nodes and the predicates are
directed edges (from subject to object). At this level the inherent semantic of
OWL ontologies are not taken into consideration. Furthermore, the nodes and
edges have di erent types, which are re ected in the labels (namespace and
localname), which is a problem for standard Social Network Analysis approaches
[
            <xref ref-type="bibr" rid="ref15">15</xref>
            ]. Additionally, it is not possible to organize the edges and nodes into disjunct
sets, because a resource which is a subject or an object in one statement might
be a predicate in another statement. This problem can be avoided if in contrast
to the RDF graph syntax every named entity of the ontology is represented as
a node (even the predicate is a node, which is connected with the subject and
the object). But as the number of properties which are used as predicates is
much less than the number of resources used as subject and objects, this graph
representation would lead to a very di erent structure in which the properties
are very central nodes with high degree values.
          </p>
          <p>Some predicates as \hasLabel" or \hasComment" have an impact on the
structural values. That is, their centrality values might be very high. It is very
important to lter such concepts, which have an impact on the structural analysis
but are not necessary to understand the content of an ontology. Furthermore, it
is important to take di erent namespaces into consideration. It might be useful,
to consider concepts from one namespace as a class of nodes and to analyze the
connectedness of nodes from namespace to nodes of di erent namespaces.</p>
          <p>Other open research questions derived from the graph representation of
ontologies based on RDF and OWL are:
5 http://www.ontologyportal.org/translations/SUMO.owl
6 http://dbpedia.org/ontology
1. RDF speci cation allows to create blank nodes, which have an in uence on
the structure of the graph. How should these blank nodes be handled?
2. Ontologies allow reasoning which leads to a change in the structure of the
ontology. Should these changes taken into account. That means, should a
reasoning process executed before the structure-analysis process starts?
3. Ontologies might be expressed in di erent expressiveness levels (OWL Lite,
OWL DL, OWL FULL). What is the impact of the expressiveness on the
structure of an ontology?
4. Besides the schema ontologies represented in OWL may include instances.</p>
          <p>Is it important to take them into account? In which cases do they have to
be considered and which cases not?
2.2</p>
        </sec>
        <sec id="sec-2-1-2">
          <title>A Framework for Ontology Engineering</title>
          <p>During the last years there is an increasing interest in the usability aspect of
software products. For the success of a framework it is very important to take
the addressed users' needs into account during the design process. Because this
works addresses ontology engineers, their expectations of an ontology analysis
and modularization framework have to be obtained and used as guidelines for
the design process. This issue needs further investigation. At this point following
questions have been identi ed:
1. How important are realtime and interactivity for ontology engineers?
2. What are the needs of ontology engineers, that have to be taken into account
by developing an ontology analysis and modularization framework?
3. Ontology Engineering methodologies are mostly heavyweight. How can the
framework be used in di erent methodologies?
3</p>
        </sec>
      </sec>
      <sec id="sec-2-2">
        <title>General Approach</title>
        <p>
          This work is based on the belief that the utilization of semantic models would
improve the quality of information systems and would enable interoperability
in distributed open systems as the Web. But creating ontologies from scratch
as well as analyzing, reusing and maintaining existing ontologies are complex
tasks which are hindering broad acceptance and application of ontologies. This
is identi ed as the main problem, which this work tries to solve by developing and
implementing methods as well as techniques to analyze and modularize
ontologies. Regarding the de nition "The design science paradigm seeks to extend the
boundaries of human and organizational capabilities by creating new and
innovative artifacts" [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] the design science paradigm is apparently the most suitable
research methodology for this work. According to [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ] the process of design
science research is a design cycle which comprise the following ve subprocesses,
which are used as a guidance for this research and to clarify the structure of this
document.
1. Awareness of problem: Section 1 described the lack of appropriate techniques
to analyze and modularize large ontologies, in order to simplify the reuse
process. E cient and exible reusability in turn is seen as a key for the
success of information integration based on ontologies. This problem is the
main motivation for this research.
2. Suggestion: This work suggests to use structural information about
ontologies to support the ontology analysis and modularization process in order to
simplify ontology reusage. The problems of realizing this approach and the
research question which have to be responded were presented in Section 2
while the proposed solution is discussed in Section 4 while .
3. Development: The current state of the design and implementation of an
ontology analysis and modularization framework is presented in the second
part of Section 4.
4. Evaluation. At this stage the evaluation process did not start yet.
Therefore there will be a short presentation of the rst ideas about this work's
evaluation in Section 5.
5. Conclusion. Finally, Section 6 provides the conclusion and as this work is
still in progress it describes the next steps.
4
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>Proposed Solution</title>
        <p>Considering ontologies as networks of concepts connected through properties,
network analysis techniques and using network measures (e.g. node centrality,
betweenness, density, similarity) are a promising approach to analyze and
modularize ontologies. As a very well established discipline in science there are a lot
of sophisticated methods and tools for network analysis available. We believe
that these methods can be modi ed, extended (in order to take the semantics
into consideration) and applied to ontologies, so that the ontology structure can
be used to analyze the content and to identify regions, which can be seen as
network \communities" and can be extracted as modules. Furthermore, we are
convinced that structure analysis enables a rst evaluation of the usability by
allowing di erent views, so that existing ontologies can be easier comprehended
by ontology engineers. This is very important because refactoring and reusing
of existing models assume that these models are understood.</p>
        <p>
          The foundation of this work is the hypothesis, that analyzing and
modularization of an ontology can be done in an e cient manner, by using
structural information about the ontology. Some previously done related work have
shown that this approach is promising. Structural analysis in [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ] is motivated
by the idea to measure the importance of a node in an RDF graph, without
distinguishing between schema and data. For ranking the nodes the closeness
centrality values are used. AKTiveRank [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] is a system which is motivated to
facilitate reusing existing ontologies. It aims at improving ontology search
engines by ranking ontologies based on structural properties of the search terms
within the whole ontology. Four di erent measures are de ned, which are
calculated separately by ignoring the instances and the resulting values are merged.
In [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] Semantic Network Analysis (SemNA) is introduced to analyze ontologies
for the purpose of reuse and re-engineering. Di erent notions of node centrality
are used, namely degree centrality, betweenness centrality and eigenvector
centrality. Analyzing the network structure of an ontology as a basis for partitioning
the class hierarchy into disjoint and covering set of concepts is presented in [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ].
Its main goal is to support distributed maintenance, selective reuse and e cient
reasoning.
        </p>
        <p>Therefore this work investigates on the application of network analysis
techniques and network measures (e.g. node centrality, betweenness, density,
similarity) to ontologies and aims at gaining insight to which extent structure based
techniques can be modi ed so they are paying attention to the semantics
inherent in ontologies. The expected contribution is a method and tool support for
ontology engineers to analyze and modularize ontologies in a (semi-) automatic
way. The main goal is to improve the usability and maintainability by
increasing the understandability and allowing ontology engineers to refactor and reuse
existing ontologies easily.
4.1</p>
        <sec id="sec-2-3-1">
          <title>Current State of the Artifact</title>
          <p>The current development of the artifact is at a very early state. As a very well
known integrated development environment Eclipse allows to implement
functional extensions through plugins. In this regard we have identi ed functional
components which can be implemented as Eclipse plugins so an Ontology
Modularization and Integration framework can be realized. Figure 2 illustrates the
architecture of this framework.
Based on the developed architecture, the decision was made to reuse the
SONIVIS:Tool7 to realize the targeted system. The SONIVIS:Tool is a network
analysis software which is based upon Eclipse and allows easy extension through
the Eclipse Plugin system. It provides already the Graph Analysis and the
Visualization components and makes use of the Eclipse User Interface. Figure 3
illustrates the foaf vocabulary where the node size depends on the node degree.</p>
          <p>The biggest nodes in the visualization are \Agent", \Document", \Person",
\OnlineAccount", and \Organization". If these concepts are compared with the
concept groups (especially the group names) from the speci cation as illustrated
in Figure 1 it obvious that there is a similarity. The group names \Personal Info,
\Documents and Images" and \Online Accounts"contain some of the concepts
which have a high centrality in the structure. This rst insight is an indication
for the applicability and usability of the chosen approach and justi es further
investigation.</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>7 http://www.sonivis.org</title>
      <sec id="sec-3-1">
        <title>Evaluation</title>
        <p>Research activities always have to be validated in order to measure its quality.
Design science can make use of di erent evaluation approaches to evaluate the
outcome. The most popular approaches are case study, professional review,
goalfree evaluation, and goal-based evaluation.</p>
        <p>
          At this stage of this work it has not been clari ed in detail how the
outcomes can be evaluated. The rst ideas are to evaluate the ontology analysis
aspect through professional reviews of di erent ontology engineers. The
important question is whether these ontology engineers gain new insight about their
ontologies when they are using this framework. As their personal opinion
cannot really be quanti ed and objectively compared it is still an open question,
in which degree this is really applicable. For the modularization of ontologies it
is intended to apply di erent ontology evaluation methods as [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] on the
produced ontology modules to check their quality. For this approach case studies
are necessary which are not found at this stage.
        </p>
        <p>The goal-free evaluation is mainly a comparison activity of di erent solutions
for the same problem based on some pre-de ned criteria. Based on an in depth
literature work about the state-of-the-art these criteria needs to be de ned. In
contrary, the goal-based evaluation focuses on the designed artifact itself. It gives
a quali ed view on the achievements of the proposed solution. The requirements
which have been identi ed by the developer during the problem analysis process
are used to evaluate to which extend they have been truly achieved. For this
approach the problem to be solved have to be analyzed deeply and the requirements
which have to be ful lled by the artifact have to be formulated concretely.
6</p>
      </sec>
      <sec id="sec-3-2">
        <title>Future Work</title>
        <p>The vision of the Semantic Web brought new attention to ontologies by
underlining its knowledge sharing aspect. Ontologies are considered as the most
important means for information integration in the highly distributed and open Web.
But either the reuse of existing ontologies or the matching of di erent ontologies
is unavoidable for this integration. Therefore means for analyzing ontologies as
well as modularization techniques for partial reuse are very important and a
key for the success of information integration based on ontologies. Following the
design science research methodology this work is grounded on the hypothesis,
that analyzing and modularization of an ontology can be done in an e cient
manner, by using structural information about the ontology.</p>
        <p>As this work is still in progress the design and development process is
ongoing and there are open research questions (see Section 2) which need further
investigation. It is also expected that new questions will arise. Additionally, as
mentioned in Section 5 it is still an open issue how this work is going to be
evaluated. Use cases as well as criteria for goal-based and goal-free evaluation
needs to found and de ned.</p>
        <p>||||{
Acknowledgements This work has been partially supported by the \InnoPro
leCorporate Semantic Web" project funded by the German Federal Ministry of
Education and Research (BMBF) and the BMBF Innovation Initiative for the
New German Lander - Entrepreneurial Regions.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Harith</given-names>
            <surname>Alani</surname>
          </string-name>
          and
          <string-name>
            <given-names>Christopher</given-names>
            <surname>Brewster</surname>
          </string-name>
          .
          <article-title>Metrics for ranking ontologies</article-title>
          .
          <source>In Denny Vrandecic, Mari del Carmen Suarez-Figueroa</source>
          ,
          <string-name>
            <given-names>Aldo</given-names>
            <surname>Gangemi</surname>
          </string-name>
          , and York Sure, editors,
          <source>Proceedings of the 4th International Workshop on Evaluation of Ontologies for the Web (EON2006) at the 15th International World Wide Web Conference (WWW</source>
          <year>2006</year>
          ), pages
          <fpage>24</fpage>
          {
          <fpage>30</fpage>
          ,
          <string-name>
            <surname>Edinburgh</surname>
          </string-name>
          , Scotland, May
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>So</surname>
          </string-name>
          <article-title>ren Auer. The rapidowl methodology{towards agile knowledge engineering</article-title>
          .
          <source>In WETICE</source>
          , pages
          <volume>352</volume>
          {
          <fpage>357</fpage>
          . IEEE Computer Society,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>A.</given-names>
            <surname>Bernaras</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Laresgoiti</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Correra</surname>
          </string-name>
          .
          <article-title>Building and Reusing Ontologies for Electrical Network Applications</article-title>
          .
          <source>In ECAI96. 12th European conference on Arti - cial Intelligence</source>
          , pages
          <fpage>298</fpage>
          {
          <fpage>302</fpage>
          . John Wiley &amp; Sons, Ltd.,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Tim</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>James</given-names>
            <surname>Hendler</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Ora</given-names>
            <surname>Lassila</surname>
          </string-name>
          .
          <article-title>The semantic web</article-title>
          . Scienti c American, May
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Elena</given-names>
            <surname>Paslaru</surname>
          </string-name>
          Bontas and
          <string-name>
            <given-names>Malgorzata</given-names>
            <surname>Mochol</surname>
          </string-name>
          .
          <article-title>Towards a reuse-oriented methodology for ontology engineering</article-title>
          .
          <source>In Proceedings of the 7th International Conference on Terminology and Knowledge Engineering TKE</source>
          <year>2005</year>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Elena</given-names>
            <surname>Paslaru</surname>
          </string-name>
          <string-name>
            <surname>Bontas</surname>
          </string-name>
          , Malgorzata Mochol, and
          <string-name>
            <given-names>Robert</given-names>
            <surname>Tolksdorf</surname>
          </string-name>
          .
          <article-title>Case studies on ontology reuse</article-title>
          .
          <source>In Proceedings of the 5th International Conference on Knowledge Management</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Paul</given-names>
            <surname>Buitelaar</surname>
          </string-name>
          , Philipp Cimiano, and
          <string-name>
            <given-names>Bernardo</given-names>
            <surname>Magnini</surname>
          </string-name>
          .
          <source>Ontology Learning from Text: An Overview</source>
          , volume
          <volume>123</volume>
          . IOS Press,
          <volume>7</volume>
          <fpage>2005</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>B.</given-names>
            <surname>Chandrasekaran</surname>
          </string-name>
          ,
          <string-name>
            <surname>John R. Josephson</surname>
          </string-name>
          , and V. Richard Benjamins.
          <article-title>What are ontologies, and why do we need them</article-title>
          ?
          <source>IEEE Intelligent Systems</source>
          ,
          <volume>14</volume>
          :
          <fpage>20</fpage>
          {
          <fpage>26</fpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Philipp</given-names>
            <surname>Cimiano</surname>
          </string-name>
          , Aleksander Pivk,
          <article-title>Lars Schmidt-Thieme, and Ste en Staab. Learning taxonomic relations from heterogeneous sources of evidence. In Ontology Learning from Text: Methods, Evaluation and Applications, Frontiers in Arti cial Intelligence</article-title>
          . IOS Press,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Mariano</surname>
            <given-names>Fernandez</given-names>
          </string-name>
          , Asuncion Gomez-Perez, and
          <string-name>
            <given-names>Natalia</given-names>
            <surname>Juristo</surname>
          </string-name>
          .
          <article-title>Methontology: from ontological art towards ontological engineering</article-title>
          .
          <source>In Proceedings of the AAAI97 Spring Symposium Series on Ontological Engineering</source>
          , pages
          <volume>33</volume>
          {
          <fpage>40</fpage>
          ,
          <string-name>
            <surname>Stanford</surname>
          </string-name>
          , USA, March
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Alvaro</surname>
            <given-names>Graves</given-names>
          </string-name>
          , Sibel Adali, and
          <string-name>
            <given-names>Jim</given-names>
            <surname>Hendler</surname>
          </string-name>
          .
          <article-title>A method to rank nodes in an rdf graph</article-title>
          .
          <source>In Christian Bizer and Anupam Joshi</source>
          , editors,
          <source>International Semantic Web Conference (Posters &amp; Demos)</source>
          , volume
          <volume>401</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12. M.
          <article-title>Gruninger and M. S. Fox. Methodology for the design and evaluation of ontologies</article-title>
          .
          <source>In International Joint Conference on Arti cial Inteligence (IJCAI95)</source>
          ,
          <source>Workshop on Basic Ontological Issues in Knowledge Sharing</source>
          ,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>A. R. Hevner</surname>
            ,
            <given-names>S. T.</given-names>
          </string-name>
          <string-name>
            <surname>March</surname>
            , J. Park, and
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Ram</surname>
          </string-name>
          .
          <article-title>Design science in information systems research</article-title>
          .
          <source>MIS Quarterly</source>
          ,
          <volume>28</volume>
          (
          <issue>1</issue>
          ):
          <volume>75</volume>
          {
          <fpage>106</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Clyde</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Holsapple</surname>
            and
            <given-names>K. D.</given-names>
          </string-name>
          <string-name>
            <surname>Joshi</surname>
          </string-name>
          .
          <article-title>A collaborative approach to ontology design</article-title>
          .
          <source>Commun</source>
          . ACM,
          <volume>45</volume>
          (
          <issue>2</issue>
          ):
          <volume>42</volume>
          {
          <fpage>47</fpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Bettina</surname>
            <given-names>Hoser</given-names>
          </string-name>
          , Andreas Hotho, Robert Jschke, Christoph Schmitz, and
          <string-name>
            <given-names>Gerd</given-names>
            <surname>Stumme</surname>
          </string-name>
          .
          <article-title>Semantic network analysis of ontologies</article-title>
          .
          <source>In Proceedings of the 3rd European Semantic Web Conference</source>
          , volume
          <volume>4011</volume>
          <source>of LNCS</source>
          , pages
          <volume>514</volume>
          {
          <fpage>529</fpage>
          ,
          <string-name>
            <surname>Budva</surname>
          </string-name>
          , Montenegro, June 2006. Springer.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>Mustafa</given-names>
            <surname>Jarrar</surname>
          </string-name>
          and
          <string-name>
            <given-names>Robert</given-names>
            <surname>Meersman</surname>
          </string-name>
          .
          <article-title>Formal ontology engineering in the dogma approach</article-title>
          . In Robert Meersman and Zahir Tari, editors,
          <source>CoopIS/DOA/ODBASE</source>
          , volume
          <volume>2519</volume>
          of Lecture Notes in Computer Science, pages
          <volume>1238</volume>
          {
          <fpage>1254</fpage>
          . Springer,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>Konstantinos</given-names>
            <surname>Kotis</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Vouros</surname>
          </string-name>
          .
          <article-title>Human-centered ontology engineering: The hcome methodology</article-title>
          .
          <source>Knowledge and Information Systems</source>
          ,
          <volume>10</volume>
          (
          <issue>1</issue>
          ):
          <volume>109</volume>
          {
          <fpage>131</fpage>
          ,
          <year>July 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>D.B. Lenat</surname>
            and
            <given-names>R.V.</given-names>
          </string-name>
          <string-name>
            <surname>Guha</surname>
          </string-name>
          .
          <source>Building Large Knowledge-Based Systems: Representation and Inference in the Cyc Project</source>
          .
          <year>1990</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <article-title>HUANG Ning and</article-title>
          DIAO Shihan.
          <article-title>Structure-based ontology evaluation</article-title>
          .
          <source>In IEEE International Conference on e-Business Engineering</source>
          ,
          <year>2006</year>
          . ICEBE '
          <volume>06</volume>
          , pages
          <fpage>132</fpage>
          {
          <fpage>137</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Helena</surname>
          </string-name>
          <article-title>So a Pinto, Ste en Staab, and Cristoph Tempich</article-title>
          . Diligent:
          <article-title>Towards a ne-grained methodology for distributed, loosely-controlled and evolving engineering of ontologies</article-title>
          .
          <source>In Proceedings of the 16th European Conference on Arti cial Intelligence (ECAI</source>
          <year>2004</year>
          ), Valencia, Spain,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <given-names>Francesco</given-names>
            <surname>Sclano</surname>
          </string-name>
          and
          <string-name>
            <given-names>Paola</given-names>
            <surname>Velardi</surname>
          </string-name>
          .
          <article-title>Termextractor: a web application to learn the shared terminology of emergent web communities</article-title>
          .
          <source>In Proceedings of the 3rd International Conference on Interoperability for Enterprise Software and Applications (I-ESA</source>
          <year>2007</year>
          ),
          <source>Funchal (Madeira Island)</source>
          , Portugal,
          <year>March 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <given-names>Heiner</given-names>
            <surname>Struckenschmidt</surname>
          </string-name>
          .
          <article-title>Network analysis as a basis for partitioning class hierarchies</article-title>
          .
          <source>In Workshop on Semantic Network Analysis, ISWC</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Mari Carmen</surname>
            Suarez-Figueroa and
            <given-names>Asuncion</given-names>
          </string-name>
          <string-name>
            <surname>Gomez-Perez</surname>
          </string-name>
          .
          <article-title>Neon methodology for building ontology networks: a scenario-based methodology</article-title>
          .
          <source>In Proceedings of the International Conference on SOFTWARE, SERVICES &amp; SEMANTIC TECHNOLOGIES</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24. York Sure, Ste en Staab, and
          <string-name>
            <given-names>Rudi</given-names>
            <surname>Studer</surname>
          </string-name>
          .
          <article-title>On-to-knowledge methodology (otkm)</article-title>
          .
          <source>In Ste en Staab and Rudi Studer</source>
          , editors,
          <source>Handbook on Ontologies: International Handbook on Information Systems</source>
          , pages
          <fpage>117</fpage>
          {
          <fpage>132</fpage>
          . Springer,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25. H.
          <string-name>
            <surname>Takeda</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Veerkamp</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Tomiyama</surname>
            , and
            <given-names>H.</given-names>
          </string-name>
          <string-name>
            <surname>Yoshikawam</surname>
          </string-name>
          .
          <article-title>Modeling design processes</article-title>
          .
          <source>AI Magazine</source>
          ,
          <volume>11</volume>
          (
          <issue>4</issue>
          ):
          <volume>37</volume>
          {
          <fpage>48</fpage>
          ,
          <year>1990</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <given-names>M.</given-names>
            <surname>Uschold</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>King</surname>
          </string-name>
          .
          <article-title>Towards a methodology for building ontologies</article-title>
          .
          <source>In Workshop on Basic Ontological Issues in Knowledge Sharing, held in conjunction with IJCAI-95</source>
          , Montreal, Canada,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>