<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>FCA-Based Concept Detection in a RosettaNet PIP Ontology</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jamel Eddine Jridi</string-name>
          <email>jridijam@iro.umontreal.ca</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Guy Lapalme</string-name>
          <email>lapalme@iro.umontreal.ca</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>DIRO, Université de Montréal</institution>
          ,
          <country country="CA">Canada</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper presents an FCA-based methodology for concept detection in a flat ontology. We apply this approach to an automatically generated ontology for a RosettaNet Partner Interface Process (PIP) which does not take advantage of some important OWL semantic relations like subClassOf. The goal of our approach is to regroup ontology classes sharing a set of properties (Data and Object Property) in order to improve the quality, readability and the inheritance richness of a flat ontology.</p>
      </abstract>
      <kwd-group>
        <kwd>Formal Concept Analysis</kwd>
        <kwd>Ontology</kwd>
        <kwd>RosettaNet PIP Ontology</kwd>
        <kwd>Inheritance Richness</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Ontologies are widely used in knowledge management, information integration,
natural language processing, information retrieval, business-to-business (B2B),
e-commerce, etc [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        Research is now envisioning the adoption of semantic web technologies in the
business domain. Lytras et al. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] analyse the practical requirements in terms of
interoperability or knowledge representation. The use of ontologies is not only
for communication between different applications but also to provide reasoning
support to infer, integrate information and to extract meaning.
      </p>
      <p>
        After an ontology is constructed, it is important to assess the quality of
an ontology to detect design defects and to automatically recognize parts that
cause problems and might need more work. In this paper, we try to improve the
inheritance richness of an OWL ontology based on the balance between depth
and height of the inheritance tree which, according to Tatir et al. [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], play a
role in a quality assessment. In Software Engineering, Sheldon et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] claim
that when the hierarchy in the inheritance tree is shallow, better will be the
maintainability, readability and understanding.
      </p>
      <p>In this paper, we propose a method to verify, regroup concepts sharing
properties to improve the quality and readability of an automatically generated
ontology. We use Formal Concept Analysis in the context of concept detection in
OWL ontologies using OWL artifacts (Class, DataProperty and ObjectProperty ).</p>
      <p>The remainder of this paper is structured as follows. Section 2 states the
problem. In Section 3, we describe the principles of the Formal Concept
Analysis algorithm underlying our approach and the adaptation of its principles for
the detection of concepts in a RosettaNet Ontology. Section 4 presents and
discusses the validation results. A summary of the related work in ontology-based
attempts of B2B standards and the use of Formal Concept Analysis in
Ontological Engineering is given in Section 5. We conclude and suggest future research
directions in Section 6.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Background and Problem Statement</title>
      <p>In this section, we describe the problem of concepts detection and the importance
of the inheritance tree to represent a domain knowledge. We start by defining
important notions. Then, we detail the specific problems that are addressed by
our approach.
2.1</p>
      <sec id="sec-2-1">
        <title>Basic notions</title>
        <p>
          Ontology in Semantic Web technology provides a shared and common
vocabulary for a domain of interest and a specification of the meaning of its terms [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ].
It allows users to organize information into a hierarchy of concepts, to describe
relationships between them, and to make semantics machine processable, not
just readable by a human.
        </p>
        <p>RosettaNet B2B Standard is a consortium which provides a global forum
for suppliers, customers, and competitors to do business and collaboration in
an efficient and profitable manner. To manage business activities, RosettaNet
formalizes Partner Interface Processes (PIP) with either Data Type Definition
(DTD) format or XML Schema, and define business processes between trading
partners. PIPs are organized into eight groups of core business processes called
clusters, themselves further grouped into segments. Each segment includes
several PIPs. In section 3, we will use the PIP3A4 as running example of our
methodology. But we managed to apply the same technique on all published
PIPs.</p>
        <p>
          The RosettaNet architecture contains a Business Dictionary to define the
properties for basic business activities and Technical Dictionaries to provide
properties for products [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. The RosettaNet Implementation Framework (RNIF)
describes the packaging, routing, and transport of all PIP messages and business
signals.
2.2
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>Problem Statement</title>
        <p>There are few works to measure quality of an ontology using metrics. But, to
our knowledge, no work has yet proposed methods to verify, maintain concept
hierarchy representation and improve the quality and readability of an ontology
from inheritance point of view using OWL artifacts (Class, DataProperty and
ObjectProperty ).</p>
        <p>
          Tatir et al. [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] and Sicilia et al. [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ] propose an Inheritance Richness metric
defined as the average number of subclasses per class and represent the
distribution of information across different levels of the ontology inheritance tree.
Values close to zero indicate horizontal ontologies representing perhaps more
general knowledge while large values represent vertical ontologies describing
detailed knowledge of a domain.
        </p>
        <p>In our case study, we have chosen an ontology describing a detailed domain
knowledge. Some approaches are proposed to ontologize some of the famous B2B
standards like RosettaNet1 and ebXML2.</p>
        <p>
          In this paper, we apply our methodology on a RosettaNet Ontology described
in our paper published in the 15th International Conference on Enterprise
Information Systems [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. RosettaNet focuses on a supply chain domain and defines
processes and business documents in detail. This automatically generated
ontology, described in Section 4, has some drawbacks because it does not take
advantage of some important OWL semantic relations like subClassOf. It is
quite flat and does not describe in details the supply chain knowledge provided
by RosettaNet, although it deals with a specific domain having several concepts
with a common semantics. Although approaches have been previously proposed
to ontologize a few B2B standards like RosettaNet and ebXML [
          <xref ref-type="bibr" rid="ref2 ref6 ref7">2,6,7</xref>
          ], we
argue in [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] that our methodology is the first to deal with the complete set of
RosettaNet PIPs.
        </p>
        <p>During the transformation process, it is difficult to automatically detect
elements with a common semantics which are described in separate OWL files.
But, we noticed that many of those share some properties and lexemes in their
compounded names. For this reason, we use FCA as a classification approach to
detect concepts by regrouping classes in an ontology to improve its quality and
readability.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>FCA-Based Concept Detection Approach</title>
      <p>The goal of our approach is to regroup ontology classes sharing a set of properties
(Data and Object Property) and then maintain the hierarchy representations.</p>
      <p>The core of our system has three main parts: Ontology Processing, FCA
System and Regrouping concepts. The Ontology Processing step builds a cross-table
from ontology artifacts (Class, Data Property and Object Property) without
dealing with the property type or occurrence restrictions. This table describes
relationships between objects (ontology classes are represented by rows) and
attributes (Data and Object properties correspond to columns).</p>
      <p>Taking the example in Table 1, o1::k represents ontology classes with k is the
number of classes in the ontology. p1::m represents the set of Data and Object</p>
      <sec id="sec-3-1">
        <title>1 http://www.rosettanet.org/ 2 http://www.ebxml.org/</title>
        <p>
          Properties with m being the total number of data and object properties. Element
&lt;i,j &gt; of the table is marked with “ x” if the domain of property pj is class oi.
We use FCA to create a hierarchy of concepts displayed as an inheritance tree.
According to [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], maintainability, readability and understanding of a hierarchy
are better when it is shallow. For this reason, we consider only two levels in the
hierarchy of the concept lattice.
        </p>
        <p>The concept lattice in Figure 1, which is the output of our FCA
application, describes the RosettaNet PIP3A4 (Purchase Order Request). Intermediate
concepts (of the form Concept_NN) were generated by the algorithm and
represent the shared set of properties. The others represent the original ontology
classes.</p>
        <p>Each class will be associated with the concept having the largest
number of shared properties. As shown in Figure 1, we note that the Concept_7
combines the two classes ProductSubLineItemType and ProductLineItemType
with 19 shared properties; Concept_8 joins ServiceLineItemByOptionType and
ServiceLineItemType because of 22 shared properties.</p>
        <p>The combined classes share some semantics consistent with the concept
definitions provided by RosettaNet. They represent one concept (Concept_7 and
Concept_8) that has been generated by our approach. As the regrouped classes
share tokens in their compound names, we will use these to rename the FCA
generated names. So, Concept_7 becomes ProductLineItem and Concept_8,
ServiceLineItem.</p>
        <p>Using the generated group of classes, we update the original ontology. To do
this, we used the OWL API3 for manipulating, developing and maintaining the
ontology.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Experimentation</title>
      <p>The goal of our study is to evaluate the efficiency of our approach for concept
detection in an OWL ontology. In this section, we describe our experimental
setup and results.</p>
      <p>
        In order to test our methodology, we use the RosettaNet Ontology, proposed
in our ICEIS 2013 paper [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. It is the result of mapping the full set of
RosettaNet Partner Interface Process (PIP) descriptions, currently defined with DTD
or XML Schemas format, to an ontological representation using an OWL/XML
rendering. Among the 132 PIPs, 112 PIPs are available for download from the
PIP Directory in RosettaNet website from which we generated 138 OWL
documents, valid according to the XML Schema for OWL/XML serialization from
syntactical point of view. These OWL documents were also checked for
consistency with an OWL reasonner.
      </p>
      <p>
        In Table 3, we evaluate our RosettaNet Ontology using state of the art
ontology metrics defined in Table 2. Only basic metrics related to the main elements
of ontologies have been used [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Although, we use two metrics that indicate
the relationship and inheritance richness of an ontology schema. The
Relationship Richness metric (rr ) reflects the diversity and placement of relations in
the ontology [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. It is defined as the ratio of the number of properties (nop)
divided by the sum of the number of subclasses (nosc) plus the number of
properties. Also, the Inheritance Richness metric (ir ) represents how knowledge
is grouped across different levels of the ontology inheritance tree [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. It is the
average number of subclasses per class.
      </p>
      <sec id="sec-4-1">
        <title>3 http://owlapi.sourceforge.net/</title>
        <p>Metrics Definition
classes (noc) number of classes (|C|) in the ontology.
data properties (nodp) number of data properties.
foobject properties (noop) number of object properties.
rebmspurobpclearstsieess ((nnoopsc)) snuummboefrnoofdspuabncdlasnsoeosp(|msCe|t)riicns.the ontology.
uNroot classes (norc) onfumthbisermoeftrroicotiscblaestswesee(nwi1thaonudt |sCu|p. erclasses). The range
leaf classes (nolc) cbleatswseesenw1itahnodut|Csu|.bclasses. The range of this metric is</p>
        <p>We notice in Table 3 that the values of ir and nosc metrics are zero and
the values of norc and nolc are equal to the number of classes |C| in the
ontology. These metric values indicate that our original RosettaNet PIP Ontology
as generated from the DTD and XML Schemas is a flat or horizontal ontology
representing a general knowledge despite the fact that RosettaNet represents a
specific domain of interest with many elements sharing a common semantics.</p>
        <p>The application of our FCA-based Concept Detection approach extracts 182
groups of concepts comprising 384 classes from the 1252 in the ontology, bringing
the inheritance metric ir from 0 to 0.31. On average, each concept contains 2
classes.</p>
        <p>We extracted 90 groups of concepts because several concepts are shared
between PIP files e.g. the concept, combining RegionalBusinessTaxIdentifier
and NationalBusinessTaxIdentifier classes, is detected in 3 PIPs (PIP3A5,
PIP3A11 and PIP3B6).</p>
        <p>We also performed a manual validation of all detected concepts. We noticed
that among the 90 concepts detected, 79 concepts have effectively a common
semantics. So, we have a detection precision of 87%. From Table 3, we can see
that the value of nosc and ir metrics increase, norc and nolc decrease after
applying our FCA-based approach.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Related Work</title>
      <p>
        Ontologies and Formal Concept Analysis (FCA) aim at modeling concepts [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
For this reason, we use FCA to regroup concepts in a flat ontology representing
general knowledge to improve its inheritance richness. To our knowledge, no
previous work has addressed the problem of flat ontology using FCA techniques.
      </p>
      <p>
        Some FCA-based proposals in Ontology Engineering differ from our own
strategy with respect to the nature of the problem. Cimiano et al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] proposed
a benchmark to discuss how FCA can be used to support Ontology Engineering
and how ontology can be exploited in FCA applications. The FCA can support
the building of the ontology and the constructed ontology can be analyzed and
navigated using FCA techniques [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        Stumme [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] presents an Ontology Merging approach based on FCA, named
FCA-MERGE, for organizing business knowledge. It takes as input one or more
source ontologies and returns a merged ontology between the given source
ontologies.
      </p>
      <p>
        Obitko et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] propose an approach to improve ontology design by
discovering the need for new objects (or classes) and relations (properties). They argue
for the necessity of a better description of concepts and relations than just
ordering them in taxonomy. In our case, we consider instead regrouping concepts
from existing ontology classes for improving the taxonomy representation in a
flat ontology.
6
      </p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>We have presented an approach for concepts detection in a flat ontology using
a Formal Concept Analysis and applied this methodology on a RosettaNet PIP
Ontology which was automatically generated ontology.</p>
      <p>Our goal is to improve the readability, maintainability and inheritance
richness of an ontology. We used FCA to detect groups of concepts sharing properties
and having a common semantics. Through the use of ontology metrics, we have
shown that our FCA-based concept detection methodology can improve
inheritance richness.</p>
      <p>As the results using RosettaNet are promising, we suggest as future work to
test the efficiency of our concept detection approach to other ontologies dealing
with other domains.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgements</title>
      <p>We would like to thank RosettaNet Group for allowing us to download the
RosettaNet Partner Interface Processes (PIPs) from the RosettaNet website.
This work has been partially funded by Tunisian Government and NSERC.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hotho</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stumme</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tane</surname>
          </string-name>
          , J.:
          <article-title>Conceptual knowledge processing with formal concept analysis and ontologies</article-title>
          .
          <source>In: Concept Lattices</source>
          , pp.
          <fpage>189</fpage>
          -
          <lpage>207</lpage>
          . Springer (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Dogac</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kabak</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laleci</surname>
            ,
            <given-names>G.B.</given-names>
          </string-name>
          :
          <article-title>Enriching ebXML registries with OWL ontologies for efficient service discovery</article-title>
          .
          <source>Proceedings of the 14th International Workshop on Research Issues on Data Engineering: Web Services for E-Commerce and EGovernment Applications (RIDE)</source>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Euzenat</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shvaiko</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Ontology Matching, vol.
          <volume>18</volume>
          . Springer Heidelberg (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Gómez-Pérez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Corcho</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fernandez-Lopez</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          : Ontological Engineering. Springer-Verlag, London, Berlin (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Jridi</surname>
            ,
            <given-names>J.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lapalme</surname>
          </string-name>
          , G.:
          <article-title>Adapting RosettaNet B2B standard to Semantic Web Technologies</article-title>
          . vol.
          <volume>2</volume>
          , pp.
          <fpage>484</fpage>
          -
          <lpage>491</lpage>
          . 15th International Conference on Enterprise Information Systems, Angers, France (
          <year>July 2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Kotinurmi</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haller</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oren</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>Ontologically Enhanced RosettaNet B2B Integration</article-title>
          .
          <article-title>Semantic Web for Business: Cases and Applications (</article-title>
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Kotinurmi</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haller</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oren</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <source>Global Business: Concepts</source>
          ,
          <source>Methodologies, Tools and Application</source>
          , vol.
          <volume>4</volume>
          , chap.
          <source>Ontologically enhanced RosettaNet B2B Integration</source>
          , p.
          <fpage>27</fpage>
          .
          <string-name>
            <surname>USA</surname>
          </string-name>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Lytras</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>García</surname>
          </string-name>
          , R.:
          <article-title>Semantic Web applications: a framework for industry and business exploitation-what is needed for the adoption of the semantic web from the market and industry</article-title>
          .
          <source>International Journal of Knowledge and Learning</source>
          <volume>4</volume>
          (
          <issue>1</issue>
          ),
          <fpage>93</fpage>
          -
          <lpage>108</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Obitko</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Snasel</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smid</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Snasel</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Ontology design with formal concept analysis</article-title>
          .
          <source>Concept Lattices and their Applications</source>
          , Ostrava: Czech Republic pp.
          <fpage>111</fpage>
          -
          <lpage>119</lpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Sheldon</surname>
            ,
            <given-names>F.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jerath</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chung</surname>
          </string-name>
          , H.:
          <article-title>Metrics for maintainability of class inheritance hierarchies</article-title>
          .
          <source>Journal of Software Maintenance and Evolution: Research and Practice</source>
          <volume>14</volume>
          (
          <issue>3</issue>
          ),
          <fpage>147</fpage>
          -
          <lpage>160</lpage>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Sicilia</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rodríguez</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>García-Barriocanal</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sanchez-Alonso</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Empirical findings on ontology metrics</article-title>
          .
          <source>Expert Systems with Applications</source>
          <volume>39</volume>
          (
          <issue>8</issue>
          ),
          <fpage>6706</fpage>
          -
          <lpage>6711</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Stumme</surname>
          </string-name>
          , G.:
          <article-title>Using ontologies and formal concept analysis for organizing business knowledge</article-title>
          .
          <source>In: In Proc. Referenzmodellierung</source>
          <year>2001</year>
          .
          <string-name>
            <surname>Citeseer</surname>
          </string-name>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Tartir</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arpinar</surname>
            ,
            <given-names>I.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moore</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sheth</surname>
            ,
            <given-names>A.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aleman-Meza</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>OntoQA: Metric-based ontology quality analysis</article-title>
          .
          <source>In: IEEE Workshop on Knowledge Acquisition from Distributed</source>
          , Autonomous,
          <source>Semantically Heterogeneous Data and Knowledge Sources</source>
          . vol.
          <volume>9</volume>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Song</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Architectures supporting RosettaNet</article-title>
          . In: Software Engineering Research,
          <source>Management and Applications</source>
          ,
          <year>2006</year>
          . Fourth International Conference on. pp.
          <fpage>31</fpage>
          -
          <lpage>39</lpage>
          . IEEE (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>