<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Analysing Syntactic Regularities in Ontologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Eleni Mikroyannidi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nor Azlinayati Abdul Manaf</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Luigi Iannone</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Robert Stevens</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Manchester</institution>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Syntactic regularities are repetitive structures of axioms in the asserted form of an ontology. The Regularity Inspector for Ontologies (RIO) is a framework for detecting such regularities in ontologies using cluster analysis. Detection of syntactic regularities can be used to identify parts of an ontology that have a similar syntactic structure, and could therefore provide an intuition of their construction. In this paper, we introduce uniformity in regularities, meaning the degree of diversity of regularities in an ontology. Based on this notion, we present an analysis of syntactic regularities in a variety of ontologies by applying RIO. The selected ontologies are mainly biomedical ontologies; processable BioPortal ontologies and SKOS vocabularies that represent biomedical concepts, gathered from the Web. Our analysis aims to show how syntactic regularities are formulated when a different knowledge representation language (OWL, SKOS) is used. The results have shown that the selected SKOS vocabularies were more uniform in terms of their syntactic regularities; smaller homogeneous clusters were found, and with few generalisations, but of high abstraction level and cluster coverage. Compared to SKOS vocabularies, BioPortal ontologies were regular, but more complex and less uniform. The analysis of syntactic regularities and uniformity of regularities can be helpful for gaining an intuition of the ontology design and its complexity.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Advancements in ontology engineering should lead to the adoption of more systematic
methods and more advanced tools for ontology development. The construction of
ontologies has become a collaborative process that is often based on patterns of different
granularity. These can be conceptual schemas, general guidelines, spreadsheets for
collecting knowledge and populating the ontology, and so on [11,7]. The instantiation of
these patterns should give rise to repeating regularities in the use of entities and
axioms. The recognition of regularities is important when authoring an ontology in order
to understand it and to assure that it conforms to guidelines and agreed patterns.</p>
      <p>A syntactic regularity is defined as a set of axioms with reoccurring (regular)
syntactic structure. We presented RIO in [9]; a framework for detecting such regularities.
A regularity can be expressed with a generalisation, which is an axiom that allows for
variables to replace entities. For example, given the following axioms:
American SubClassOf hasTopping some TomatoTopping</p>
    </sec>
    <sec id="sec-2">
      <title>LaReine SubClassOf hasTopping some HamTopping Margherita SubClassOf hasTopping some TomatoTopping Fiorentina SubClassOf hasTopping some SpinachTopping</title>
      <p>Then the syntactic regularity of these axioms can be given by the following
generalisation:</p>
      <p>?Pizza SubClassOf hasTopping some ?PizzaTopping
where ?Pizza, ?PizzaTopping are variables holding the corresponding similar
entities. Such a framework can be used when authoring an ontology, in order to pinpoint
repetitive information.</p>
      <p>
        We distinguish the notion of syntactic regularity from the notion of pattern. Patterns
are used in the literature with multiple meanings. In ontology engineering, they can be
interpreted as design patterns, meaning solutions to design problems [
        <xref ref-type="bibr" rid="ref2 ref3 ref4">4,2,3</xref>
        ]. Patterns
of axioms, however, can exist throughout an ontology without being an accepted design
pattern. In general, we regard patterns as the modelling templates that the ontology
engineer follows when developing the ontology. Patterns can be represented with different
forms, such as conceptual models, OPPL scripts1 scripts [
        <xref ref-type="bibr" rid="ref5">5,6</xref>
        ], text descriptions etc [10]
etc. The correct use of patterns will produce syntactic regularities, i.e., axioms of
similar syntax [9]; on the other hand, a syntactic regularity does not necessarily coincide
with a pattern. However, the recognition of syntactic regularities should be helpful in
understanding the composition of the ontology, as it can reveal parts of the ontology
that were designed in similar ways. This should enable the user to complete tasks, such
as extension of the ontology, its integration with other ontologies, quality assurance and
so on.
      </p>
      <p>In addition, patterns can be represented as an aggregation of generalisations. For
example, the pattern that describes all pizzas is:
?Pizza SubClassOf hasTopping some ?PizzaTopping
?Pizza SubClassOf hasTopping only ?PizzaTopping</p>
    </sec>
    <sec id="sec-3">
      <title>DisjointClasses:’set(?Pizza.VALUES)’</title>
      <p>A pattern can be represented not only by a single generalisation but, also as a set of
generalisations.</p>
      <p>In this paper, we also define the notion of uniformity in syntactic regularities. The
level of uniformity in regularities is an indication of the diversity or degree of regularity
of an ontology. An ontology can be regular, but not uniform, meaning that there are
1 http://oppl2.sourceforge.net
many different types of regularities, which cover significant parts of the ontology. This
may also give an intuition for the compositional complexity of an ontology. It should
show whether different design decisions were taken for describing different portions of
the ontology. On the other hand, an ontology with very low uniformity and instantiation
coverage of its regularities is an indication of an irregular ontology. We define metrics
based on the RIO framework for measuring uniformity of regularities in ontologies.</p>
      <p>In addition, we perform an analysis of the syntactic regularities of the BioPortal
corpus and of selected SKOS vocabularies. Our comparison focuses on level,
uniformity and impact of the syntactic regularities. The results have shown that many SKOS
vocabularies have syntactic regularities which reflect patterns on predicates such as
annotations and object properties.</p>
      <p>However, the resulting clusters are few in number (on average, only four clusters
per ontology were found), and they are homogeneous with few generalisations, but with
high abstraction level and cluster coverage. Compared to SKOS vocabularies,
BioPortal ontologies were regular but more complex, with more clusters and less uniformity.
The analysis of syntactic regularities and uniformity of regularities can be helpful for
gaining an intuition of the ontology design and its complexity. A regular ontology with
low uniformity can indicate the existence of a general pattern, with a few variations.
Such an analysis should be useful when authoring or extending an ontology.
2</p>
      <sec id="sec-3-1">
        <title>RIO framework</title>
        <p>The RIO [9] framework spots syntactic regularities in ontologies using cluster analysis.
RIO enables the partitioning of a set of entities in an ontology according to a similar
usage in the axioms of the ontology.</p>
        <p>The detection of syntactic regularities is based on the following two general steps:
1. Computation of clusters of similar entities in the ontology.
2. Provision of a synthetic view of all the axioms that contribute to the generation of
an entity cluster.</p>
        <p>The purpose of cluster analysis is to partition data into groups (clusters) that are
meaningful, useful, or both [12]. In the second step, the description of the cluster is
shown with generalisations, which are axioms with entities represented by variables.
The variables represent the corresponding clusters of similar entities and the syntactic
regularities in the ontology are expressed with the generalisations.
2.1</p>
        <sec id="sec-3-1-1">
          <title>Clustering</title>
          <p>Algorithm 1 shows the steps that are followed for the computation of clusters in an
ontology. The role of the placeholder replacement function is described later in this
section. The HIERARCHICAL(Mi;j ; P ) is the function that performs hierarchical
agglomerative clustering and has as parameters the generated proximity matrix Mi;j and
a stopping criterion P . Details on how the hierarchical agglomerative clustering works
can be found in [12].</p>
          <p>Algorithm 1 RIO Clustering
Require: A placeholder replacement function , J the set of axioms in O.</p>
          <p>Ensure: A set of clusters S.
1: Sig(J )
2: Mi;j ; 0 i; j &lt; j j
3: for all ( i, j) 2 x do
4: Get axioms Ax( i), Ax( j ) 2 J
5: Ai (Ax( i)),Aj (Ax( j))
6: d( i; j ) jAi[AjAjij[AjAjij\Ajj
7: mi;j d( i; j )
8: end for
9: S HIERARCHICAL(Mi;j ; P )
10: return S
. Transform axioms
. Calculate distance
. Build proximity matrix
. P: Stopping criterion</p>
          <p>
            The stopping criterion P is selected according to the minimal or maximal
differences between pairs of entities whose distance is computed. As defined in step 6 of
Algorithm 1, the value of d( i; j ) is in the interval [
            <xref ref-type="bibr" rid="ref1">0,1</xref>
            ]. We select P (1), thus the
algorithm will stop agglomerations when the distances between all possible pairs of
elements for all clusters is greater than 1.
2.2
          </p>
        </sec>
        <sec id="sec-3-1-2">
          <title>Placeholder replacement policy</title>
          <p>Placeholder replacement policy. The axioms in step 5 of algorithm 1 are transformed
into more abstract forms using a placeholder replacement function , which is based
on a heuristic approach. It enables comparison between pairs of entities and control of
the distance granularity. The placeholder replacement policy used by defines when an
entity should be replaced by a placeholder.</p>
          <p>More formally, given an ontology O, we define =f ?owlClass,
?owlObjectProperty, ?owlDataProperty, ?owlAnnotationProperty, ?owlIndividual, ?*g a set of six
symbols that do not appear in the signature2 of O - sig(O). A placeholder replacement
is a function : sig(O) ! sig(O) [ satisfying the following constraints: Consider
an entity e 2 O then (e) =
– e or ?* or ?owlClass if e is a class name;
– e or ?* or ?owlObjectProperty if e is an object property name;
– e or ?* or ?owlDataProperty if e is a data property name;
– e or ?* or ?owlAnnotationProperty if e is an annotation property name;
– e or ?* or ?owlIndividual if e is an individual property name.</p>
          <p>In previous work we have demonstrated the usage of different replacement
policies [9,8]. In this paper, we will use a replacement policy that is based on the popularity
of the entities in axioms [9].
2 For signature here we mean the set of class names, data/object/annotation property names,
individuals referenced in the axioms of an ontology O.</p>
          <p>For example, given the following axioms from the AminoAcid3 ontology
1 = A SubClassOf hasSize some Tiny
2 = A SubClassOf hasPolarity some Non-polar
3 = A SubClassOf hasCharge some Neutral
4 = C SubClassOf hasSize some Small
5 = C SubClassOf hasPolarity some Polar
6 = C SubClassOf hasCharge some Neutral
For calculating the distance d(A; C) the axioms are transformed as:</p>
          <p>A1 = ?* SubClassOf hasSize some ?owlClass
A2 = ?* SubClassOf hasPolarity some Non-polar
A3 = ?* SubClassOf hasCharge some Neutral
A4 = ?* SubClassOf hasSize some ?owlClass
A5 = ?* SubClassOf hasPolarity some Polar</p>
          <p>A6 = ?* SubClassOf hasCharge some Neutral</p>
          <p>The transformation is done according to the popularity replacement policy (e.g.
Neutral and Polar classes are popular, hence are not replaced by a placeholder). Entities
A, C have two axioms in common (A1 = A4; A3 = A6), thus, according to Algorithm
1, step 6, d(A; C)=(4-2)/4=0.5.
2.3</p>
        </sec>
        <sec id="sec-3-1-3">
          <title>Generalisations</title>
          <p>
            Algorithm 1 will return a set of clusters, whose description is given by generalisations.
Generalisations provide a synthetic view of all the axioms that contribute to generate a
cluster of entities. They also express the detected semantic regularities in the ontology.
Each of these axioms can be regarded as an instantiation of a generalisation, as they can
be obtained by replacing each variable in the generalisation with entities in the signature
of the ontology. The syntax for the variables is borrowed from OPPL4, a declarative
language for manipulating OWL ontologies [
            <xref ref-type="bibr" rid="ref5">5</xref>
            ].
          </p>
          <p>For example, RIO will produce for 14 clusters for the AminoAcid ontology, which
will include a cluster with all the Amino Acids (20 classes), and smaller clusters
including the physicochemical properties and different types of Amino Acids (e.g.
PolarAminoAcid, Non-PolarAminoAcid).
3 http://www.co-ode.org/ontologies/amino-acid/
4 http://oppl2.sourceforge.net
2.4</p>
        </sec>
        <sec id="sec-3-1-4">
          <title>Grouping the generalisations</title>
          <p>We provide a more synthetic view of the generalisations, by grouping generalisations of
similar structure and representing them with generalisations of higher abstraction. For
the grouping of the generalisations, the following parameters in the generalisations are
considered:
– Similar structure of generalisations
– Position of the representative cluster variable in generalisations of similar structure</p>
          <p>The super generalisations that are created have variables whose values can be also
variables of more fine-grained generalisations. In addition, the name of the variable is
selected according to the commonalities of the entities that it holds. The name of the
variables is selected to be the least common subsumer of the values that are covered.
If this is the top entity (owl:Thing), then a general placeholder will be selected. For
example,
hg = ?hematologic evaluation SubClassOf ?cluster13</p>
          <p>only ?unit of measurement
g1 = platelet function analyzer 100 SubClassOf
g2 = ?hematologic evaluation SubClassOf
?cluster13 only ?unit of measurement
?cluster13 only ?unit of measurement
generalisations g1; g2 are folded under super generalisation hg.
2.5</p>
        </sec>
        <sec id="sec-3-1-5">
          <title>Measuring regularity</title>
          <p>We define the following metrics for measuring the level of regularity in an ontology:
Definition 1 (Mean Generalisations per Cluster (MG)). M G = Pn gi , where gi
i=0 N
is a generalisation and N is the number of detected clusters. It is a measure intended
to show the level of abstraction for each generalisation.
agi
Definition 2 (Mean Instantiations per Generalisation (MI)). M I = Pn
i=0 gii , where</p>
          <p>N
ai is an axiom (instantiation) covered by a generalisation gi and gNi is the total number
of generalisations in cluster i. It is a measure intended to show the level of abstraction
for each generalisation.</p>
        </sec>
        <sec id="sec-3-1-6">
          <title>Definition 3 (Total Mean Cluster Coverage per generalisation (TMCC)). Given a</title>
          <p>set of clusters cN of size N , in which every cluster ci holds en entities described by
gn generalisations, if each generalisation gi covers em entities in the cluster, then
T M CC = Pn egmi .</p>
          <p>i=0 engnN</p>
          <p>The union of the generalisations describes the cluster, hence a single generalisation
might not be necessarily applicable for all the values in a cluster. Thus, TMCC measures
the number of values in a cluster for which a generalisation is applicable.
Definition 4 (Cluster homogeneity). Given a cluster ci, the homogeneity h is defined
as h = 1 M ean Internal Distance. It is a measure that assesses how well formed
the clusters are.
2.6</p>
        </sec>
        <sec id="sec-3-1-7">
          <title>Uniformity in regularities</title>
          <p>The main question about detection of regularities is which strategy captures regularities,
if they exist, in the most efficient way. Then a second question that arises is what is
considered as an efficient way. An ontology can be one of the followings in terms of
regularities:
– It can be irregular
– It can be regular with many different forms of regularities
– It can be regular with a few different forms of regularities</p>
          <p>According to the RIO framework, we can characterise an ontology as irregular if
all the generalisations in the ontology cover only single axioms. This is an extreme
case, which is unlikely to happen for medium to large size ontologies. The reason is
that the axioms are constructed following a syntax, thus they are expected to have some
syntactic regularities.</p>
          <p>We define uniformity in regularities as the degree of diversity of regularities in an
ontology. The intuition behind uniformity is to define a characteristic that allows the
assessment of the detected regularities. According to the previous states, an ontology can
be regular, but have different forms of regularities; thus it has low uniformity.
Uniformity can give an intuition of the composition complexity of an ontology. It shows that
different design decisions were taken for describing different portions of the ontology.
For example, a general pattern that has been chosen to describe a set of entities in the
ontology, can have some deviations when it is applied in a different set of entities. On
the other hand, an ontology can be regular with a high level of uniformity, meaning that
the same form of regularity appears in most axioms of the ontology. On a second level,
this reveals a low compositional complexity of the ontology.</p>
          <p>According to the RIO framework, we can observe the following properties in order
to assess the uniformity of an ontology:
– Number of generalisations
– Number of instantiations per generalisation
– Cluster coverage by generalisations
– Degree of homogeneity of clusters</p>
          <p>An indicator of a regular and homogeneous ontology is the number of
generalisations covering a high number of instantiations: the higher the number of instantiations
covered by a generalisation, the more regular the ontology is; a side effect is that the
number of such generalisations must be small. As a consequence, the cluster coverage
by per generalisation will be close to 1. On the other hand, the existence of a high
number of generalisations of similar structures gives the indication of a regular but not very
uniform ontology. This can be also assessed by the number of grouped generalisations.</p>
          <p>The high number of generalisations of similar structure having only a few
differences in the variables, indicates the existence of a regularity with many deviations.
There can be two explanations for the deviations. The first one is that the distance
approach which is selected does not capture similarities between entities in the most
efficient way but the detected regularities is an approximation. The second one is that even
though entities share common axioms, in which they play similar roles, their design
deviates in other axioms.
3</p>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>Results</title>
        <p>
          We applied RIO to 86 ontologies from BioPortal and in 76 SKOS vocabularies collected
from the web [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. The selected ontologies are processable and their clusters can be
computed in less than two minutes. All the results can be found online5. Here, we will
refer only to some interesting cases.
        </p>
        <p>Figure 1(a) shows some selected clustering results that could give an intuition of
the uniformity of regularities in the BioPortal corpus. The mean number of clusters for
each ontology is 28, with a mean size of 10 entities per cluster. Mean generalisations per
cluster is 12 with a minimum of 2 generalisations and maximum 125 generalisations.
Mean cluster coverage (MCC) is 9.8%. The mean instantiations per generalisation for
the corpus is 12 axioms, with a min value of two axioms per generalisation and a max
value of 524 axioms (Ontology 72: human-developmental-anatomy-abstract.owl). This
ontology is an example of one with a high regularity and uniformity. It consists of 6
clusters in total. The first cluster includes 1512 classes whose description is abstracted
by two generalisations. The first refers to an annotation label and the second one is
shown in Figure 2, which abstracts 1528 axioms.</p>
        <p>The benefit from such uniform and regular design is that in an inspection task, the
ontology engineer can inspect very few regularities and have an intuition of how the
ontology is constructed. In addition, this can be an intuition of the ontology complexity;
the ontology is based on very few patterns and constructs, thus the understanding of
these patterns covers the construction of most of the ontology.</p>
        <p>Also, Figure 1(b) shows that many ontologies that have a high level of abstraction
(MI), have also a high level of homogeneity (e.g. Ontologies 32-36). This is a strong
indication of a regular and uniform ontology. On the other hand, ontologies like 1,
and 73 are regular but less uniform; there is a high number of instantiations (more
than 1000) but there is also a quite high number of generalisations with a small mean
cluster coverage (MCC=0.001%). In addition, the homogeneity of the clusters is more
than 0.8, which means that the ontology is regular but not very homogeneous. This
is an indication of an ontology which is regular but the regularities appear to have
deviations, meaning many generalisations with similar structure. These deviations are
either deliberate design or design errors. The intuition of uniformity can be helpful for
also assessing the complexity of the ontology. For example, extending an ontology by
following the initial design style is more difficult, since there are more than one options
of regularities to select.</p>
        <p>Figure 3 shows the corresponding clustering results for the SKOS vocabularies. On
average, 4 clusters per ontology were detected, with a mean of 19 entities per cluster,
5 http://www.cs.man.ac.uk/˜mikroyae/2012/owled/
100000 
10000 
1000 
100 
10 
1  1  3  5  7  9  11  13  15  17  19  21  23  25  27  29  31  33  35  37  39  41  43  45  47  49  51  53  55  57  59  61  63  65  67  69  71  73  75  77  79  81  83  85 </p>
        <p>Ontology ID 
(a) Number of Instantiations and Generalisations
a mean of 6 generalisations per cluster and a mean 30 instantiations per generalisation.
The mean cluster coverage (MCC) is 50.5%, which is much higher than BioPortal’s
corpus. Compared to the BioPortal corpus, SKOS vocabularies were regular, more
uniform, with simpler and fewer generalisations, but with quite a high abstraction impact.</p>
        <p>The detected syntactic regularities are mainly individual types and annotations.
Some example syntactic regularities are shown in Figure 4 from vocabulary 47
(GeoSciCDTGVocabularyRelation200811.rdf). The results of the detected syntactic regularities
in SKOS ontologies revealed that most detected patterns refer to predicates like
annotation properties and object properties.
4</p>
      </sec>
      <sec id="sec-3-3">
        <title>Conclusions</title>
        <p>In this paper we have defined notions of uniformity in syntactic regularities, meaning
the degree of diversity of regularities in an ontology. Based on this notion, we present an
analysis of syntactic regularities in a variety of OWL ontologies and SKOS vocabularies
by applying RIO.</p>
        <p>The selected targets are the processable BioPortal ontologies and SKOS
vocabularies that represent biomedical concepts, gathered from the Web. The results have shown
that the selected SKOS vocabularies were more uniform in terms of their syntactic
regularities; smaller homogeneous clusters resulted with few generalisations, but of high
?cluster1 SubClassOf HUMAN-DEV-ANAT-ABSTRACT part of some ?cluster2
Example Instantiation :
EHDAA 2925 SubClassOf HUMAN-DEV-ANAT-ABSTRACT part of some EHDAA 2923
where
f?cluster2 : CLASS=[EHDAA 2923]; ?cluster1 : CLASS=[EHDAA 2925]g
 Generalisa4ons   Instan4a4ons 
10000 
1000 
100 
10 
abstraction level and cluster coverage. Compared to SKOS vocabularies, BioPortal
ontologies were regular but more complex and less uniform. The analysis can be used for
assessing the design style of the ontologies and for quality insurance. For example,
ontologies with low uniformity indicates a possibly complex ontology; the high number
of the generalisations of similar structure (only a variable changes in the structure of
the generalisations) shows that there are deviations of the regularity, which might be
intended design or design errors. Also, extending an ontology by following a regularity
that has deviations (expressed with many generalisations) makes the task less
straightforward since there is more than one option to select. Future work will involve the
examination of alternative clustering or isomorphic approaches, since they may provide
more well formed generalisations.</p>
        <p>We have shown that RIO can highlight differences in syntactic regularity,
homogeneity of clusters and the uniformity of an ontology or vocabulary written in OWL.
The tooling of such notions made available in RIO offers users and authors of
ontologies means by which overviews and characterisations of ontologies can be generated
that could be used in quality assurance and control. The analysis of the design style
and the construction of the ontology can be useful for tasks such as ontology
authoring, maintenance and extension. Notions of regularity, homogeneity and uniformity in
ontologies, coupled with the software adds a tool for inspecting ontologies that is not
just a graph or the axioms themselves; it is an abstraction with the power to describe
general properties of the ontology.
6. L. Iannone, A. Rector, and R. Stevens. Embedding knowledge patterns into OWL. The</p>
        <p>Semantic Web: Research and Applications, pages 218–232, 2009.
7. S. Jupp, M. Horridge, L. Iannone, J. Klein, S. Owen, J. Schanstra, K. Wolstencroft, and
R. Stevens. Populous: a tool for building owl ontologies from templates. BMC
Bioinformatics, 13(Suppl 1):S5, 2011.
8. E. Mikroyannidi, L. Iannone, R. Stevens, and A. Rector. Inspecting regularities and
irregularities in SNOMED-CT. In Proceedings of Semantic Web Applications and Tools for the
Life Science 2011 (SWAT4LS), 2011.
9. E. Mikroyannidi, L. Iannone, R. Stevens, and A. Rector. Inspecting regularities in ontology
design using clustering. The Semantic Web–ISWC 2011, pages 438–453, 2011.
10. B. Peters, A. Ruttenberg, J. Greenbaum, M. Courtot, R. Brinkman, P. Whetzel, D. Schober,
S. Sansone, R. Scheuerman, and P. Rocca-Serra. Overcoming the ontology enrichment
bottleneck with quick term templates. Applied Ontology, 2009.
11. S. Staab, M. Erdmann, and A. Maedche. Engineering ontologies using semantic patterns. In
Proceedings of the IJCAI-01 Workshop on E-Business &amp; the Intelligent Web, pages 174–185,
2001.
12. P.-N. Tan, M. Steinbach, and V. Kumar. Introduction to Data Mining. Addison-Wesley,
2005.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>N. A.</given-names>
            <surname>Abdul-Manaf</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>The current state of SKOS vocabularies on the Web</article-title>
          .
          <source>In Proceedings of the 9th Extended Semantic Web Conference (ESWC2012)</source>
          , May
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Egan˜a, A</article-title>
          . Rector,
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E.</given-names>
            <surname>Antezana</surname>
          </string-name>
          .
          <article-title>Applying Ontology Design Patterns in Bio-ontologies</article-title>
          , volume
          <volume>5268</volume>
          of Lecture Notes in Computer Science, pages
          <fpage>7</fpage>
          -
          <lpage>16</lpage>
          . Springer Verlag,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>A.</given-names>
            <surname>Gangemi</surname>
          </string-name>
          .
          <article-title>Ontology design patterns for semantic web content</article-title>
          .
          <source>The Semantic Web-ISWC</source>
          <year>2005</year>
          , pages
          <fpage>262</fpage>
          -
          <lpage>276</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>A.</given-names>
            <surname>Gangemi</surname>
          </string-name>
          and
          <string-name>
            <given-names>V.</given-names>
            <surname>Presutti</surname>
          </string-name>
          .
          <article-title>Ontology design patterns</article-title>
          .
          <source>Handbook on Ontologies</source>
          , pages
          <fpage>221</fpage>
          -
          <lpage>243</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>L.</given-names>
            <surname>Iannone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Egana</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rector</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Augmenting the expressivity of the ontology pre-processor language</article-title>
          .
          <source>In Proceedings of the Fifth OWLED Workshop on OWL: Experiences and Directions</source>
          , OWLED. Citeseer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>