<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>ReAD: Delegate OWL Reasoners for Ontology Classification with Atomic 1 Decomposition</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Haoruo ZHAO</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bijan PARSIA</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Uli SATTLER</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Manchester</institution>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Classification is a key ontology reasoning task. Several highly-optimised OWL reasoners are designed for different fragments of OWL 2. Combining these delegate reasoners to classify one ontology gives potential benefits, but these may be offset by overheads or redundant subsumption tests. In this paper, we show that with the help of the atomic decomposition, a known ontology partition approach, these redundant subsumption tests can be avoided. We design and implement our classification algorithms and empirically evaluate them.</p>
      </abstract>
      <kwd-group>
        <kwd />
        <kwd>OWL</kwd>
        <kwd>Description Logic</kwd>
        <kwd>Classification</kwd>
        <kwd>Delegate Reasoner</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <sec id="sec-1-1">
        <title>Classification is a core reasoning task for Web Ontology Language (OWL) 2 [1] ontolo</title>
        <p>
          gies. Several classification algorithms have been implemented in highly-optimized
reasoners [
          <xref ref-type="bibr" rid="ref2 ref3 ref4 ref5">2,3,4,5</xref>
          ] for different fragments [
          <xref ref-type="bibr" rid="ref6 ref7 ref8">6,7,8</xref>
          ] of OWL 2. For OWL 2, these use a
traversal algorithm which determines which subsumptions to test next, ideally avoiding most
of them [
          <xref ref-type="bibr" rid="ref10 ref9">9,10</xref>
          ]. Ontology modularisation [
          <xref ref-type="bibr" rid="ref11 ref12 ref13 ref14">11,12,13,14</xref>
          ], especially locality-based
modules [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] (logical approximations of conservative extension-based modules) and Atomic
Decomposition (AD) [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] (an ontology partition algorithm), have already been used for
optimizing the classification [
          <xref ref-type="bibr" rid="ref17 ref18 ref19 ref20">17,18,19,20</xref>
          ] by easing subsumption test (STs) or avoiding
them. But checking STs with modules or AD rather than the whole ontology causes
redundant STs. In this paper, we design and implement our algorithm with no redundant
STs and also evaluate our algorithm with a corpus of BioPortal ontologies.
        </p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>2. Background Knowledge</title>
      <p>
        We assume the reader to be familiar with Description Logics (DLs), a family of
knowledge representation languages underlying OWL 2 that are basically decidable fragments
of First Order Logic [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], and only fix the notation used. In this paper, we use O for an
ontology and M O for a ?-syntactic locality-based module.2 A signature Σ is a set of
concept names and role names. For an axiom, a module, or an ontology  , we use e to
denote its signature.
      </p>
      <sec id="sec-2-1">
        <title>2.1. Classification</title>
        <p>
          To classify an ontology O, we first check whether O is consistent. If it is, we check for all
  2 Oe \ NC,  ≠ , whether O j=?  v  O j=?  v ? and O j=? &gt; v . Naively, this
results in a quadratic number of entailment tests. To avoid these, DL reasoners employ
a form of traversal algorithm to reduce the number of STs [
          <xref ref-type="bibr" rid="ref10 ref9">9,10</xref>
          ]. In practice, these are
highly effective, almost always reducing the quadratic number of STs to at most  log 
tests [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. In this paper, we concentrate on ST avoidance and assume all ontologies to be
consistent.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Modules and AD</title>
        <p>
          Throughout this paper, we concentrate on ?-locality based modules [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. These are
subsets of an ontology that have certain properties which are important for their use in AD
and, in turn, for classification optimization. Let M = M ¹Σ Oº be such a ?-locality based
module of O for the signature Σ. Then M
        </p>
        <sec id="sec-2-2-1">
          <title>1. preserves all entailments of O over Σ, i.e., it covers Σ,</title>
          <p>2. preserves all entailments of O over Mf, i.e., it is self-contained,
3. is unique, i.e., there is no other ?-locality based module of O for the signature Σ,
and
4. is subsumer-preserving, i.e., if  is a concept name in M and O j=  v , then</p>
          <p>M j=  v .</p>
          <p>
            The atomic decomposition (AD) ¹Oº [
            <xref ref-type="bibr" rid="ref16">16</xref>
            ] partitions an ontology into logically
inseparable sets of axioms, so-called atoms , and relates these atoms via a dependency
relation . In the rest of paper, we use ¹Oº to represent the ?-AD because in [
            <xref ref-type="bibr" rid="ref23">23</xref>
            ], we
find these to be mostly fine-grained than other ADs.
          </p>
          <p>
            Definition 1. [
            <xref ref-type="bibr" rid="ref23">23</xref>
            ] Given two axioms   2 O, we say  O  if for all modules M of O,
we have  2 M iff  2 M. The atoms of an ontology O are the equivalence classes O .
          </p>
        </sec>
      </sec>
      <sec id="sec-2-3">
        <title>Given two atoms , , we say that  is dependent on , written   if, for any module</title>
        <p>M,  M implies that  M.</p>
        <p>For an atom  2 ¹Oº, its principal ideal #  = f 2  j  2 ¹Oº  g is the union
of all atoms it depends on, and this has been shown to be a genuine module, i.e., it cannot
be decomposed into a union of independent modules.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. The set of STs of an atom, a module and an atomic decomposition</title>
      <p>In this section, we explain the foundations of using the AD for avoiding STs during
classification. Using the AD, we identify a (hopefully small) set of subsumption tests
2We use module for it in the rest of this paper.
that are sufficient for classification. Provided that the AD has a ’good’ structure (no big
atoms), this results in a low number of STs for a reasoner to carry out, with the potential
to use delegate reasoners for these or parallelisation.</p>
      <p>First, we fix some notation. Let  be a concept name. The set of atoms Ats¹ º of 
is defined as follows:</p>
      <p>Ats¹ º := f 2 ¹Oº j  2 eg</p>
      <sec id="sec-3-1">
        <title>The set of lowest atoms MinAts¹ º of  is defined as follows:</title>
        <p>MinAts¹ º := f 2 Ats¹ º j there is no  2 Ats¹ º with 
g</p>
        <sec id="sec-3-1-1">
          <title>For an atom , the candidate set of concept names to be tested is defined as follows:</title>
          <p>CanS¹º of  is</p>
          <p>CanS¹º := f  j  2 MinAts¹ º and #MinAts¹ º = 1g</p>
          <p>Please note that CanS¹º is a subset of the set of concept names of the atom, i.e.,
CanS¹º e \ NC.</p>
          <p>The set of concept names below top BTop¹Oº is defined as follows:</p>
          <p>BTop¹Oº := f  j  2 Oe \ NC and #MinAts¹ º ¡ 1g</p>
          <p>In Figure 1, these different definitions are shown in the example ontology.
Lemma 1. For each concept name  2 Oe, we have
1. Oe \ NC =
Ð</p>
          <p>CanS¹º [ BTop¹Oº.</p>
          <p>2¹ Oº
2. if  2 BTop¹Oº, there is no atom  2 ¹Oº with  2 CanS¹º.</p>
          <p>3. if  2 CanS¹º, there is no atom  ≠  with  2 CanS¹º.</p>
          <p>Proof. (1). Since ¹Oº partitions O, we have that Oe \ NC =
2¹ Oº
each concept name  2 Oe \ NC, #MinAts¹ º ¡ 0. Let  2 Oe \ NC. If MinAts¹ º = 1,
we thus have some  2 ¹Oº with  2 MinAts¹ º and hence  2 CanS¹º. Otherwise,
MinAts¹ º ¡ 1 and  2 BTop¹Oº. The “ ” direction holds by definition of CanS¹º and
BTop¹Oº.
Ð
e \ NC, and thus for
(2). This follows immediately from the facts that  2 BTop¹Oº implies that
#MinAts¹ º ¡ 1 and  2 CanS¹º implies that #MinAts¹ º = 1.</p>
          <p>(3). Let  2 CanS¹º. By definition,  2 MinAts¹ º. Assume there was some  ≠ 
with  2 CanS¹º; this would mean  2 MinAts¹ º, contradicting #MinAts¹ º = 1.
Theorem 2. Given an ontology O and a concept name  2 BTop¹Oº, we have
1. M ¹f g Oº = ;,
2. O 6j=  v ?, and
3. there is no concept name  ≠ ,  2 Oe with O j=  v .</p>
          <p>Proof. (1). Let  2 BTop¹Oº. Hence #MinAts¹ º ¡ 1, and thus there are two atoms   2
MinAts¹ º. By definition of MinAts¹ º,   and  . Now assume M ¹f g Oº ≠ ;;
hence there is some  with M ¹f g Oº = # . Since ?-locality based modules are
monotonic, M ¹f g Oº #  and M ¹f g Oº #  which, together with   2 MinAts¹ º and
 2 e, contradicts the minimality condition in the definition of MinAts¹ º.</p>
          <p>(2). This is a direct consequence of (1) M ¹f g Oº = ;: ?-locality based modules
capture deductive (and model) conservativity, hence M ¹f g Oº = ; implies that O
cannot entail  v ?.</p>
          <p>
            (3). This is also a direct consequence of (1) and the fact that ?-locality based
modules are closed under subsumers [
            <xref ref-type="bibr" rid="ref22">22</xref>
            ].
          </p>
          <p>Next, we use the AD to identify a (hopefully small) set of STs that are sufficient for
classification.</p>
          <p>Definition 2. The set of STs Subs¹º of an atom  is defined as follows:
Subs¹º := f¹  º j  2 CanS¹º  2 #f and  ≠ g [
f¹  ?º j  2 CanS¹ºg [
f¹&gt; º j  2 CanS¹ºg</p>
          <p>Given a module M = 1 [ 2 [ , the set of STs Subs¹Mº of M is defined as
follows:</p>
          <p>Subs¹Mº :=</p>
          <p>Theorem 3. For   2 Oe \ NC with  ≠ ,  ≠ ?. If O j=  v  then there is exactly
one  with ¹  º 2 Subs¹º.</p>
          <p>Proof. Let   be as described in Theorem 3 and let O j=  v . Then  ∉ BTop¹Oº
by Theorem 2 (3). By Lemma 1 (1), there is an atom  with  2 CanS¹º. By definition,
CanS¹º e #f, and thus  2 #f and, by Section 2.2, #  is a module. By Section 2.2,
we have  2 #f. By definition of Subs¹ º, ¹  º 2 Subs¹º. By Lemma 1 (3), we know
there is no another atom  is unique.</p>
          <p>
            In [
            <xref ref-type="bibr" rid="ref23">23</xref>
            ], we have shown that the AD of many ontologies results in many small atoms
with a rather shallow and wide dependency relation. As a consequence, we should be able
to exploit the AD and the insights captured in Theorem 3 to avoid almost all subsumption
tests in a novel, AD-informed alternative to well-known enhanced traversal algorithms
[
            <xref ref-type="bibr" rid="ref10 ref9">9,10</xref>
            ].
          </p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. How the set of satisfiability tests of an AD interacts with delegate reasoners</title>
      <p>Assume we have, for 1   modules M O that are in a specific description logic
L for which we have a specialised, optimised reasoner.3 Based on our observations in
Section 3, we can partition our subsumption tests as follows:</p>
      <p>Ø
 2¹ Oº
*M1[[M
Subs¹Oº =</p>
      <p>Subs¹º [    [</p>
      <p>Ø
 2¹ Oº
 M1[[M</p>
      <p>Subs¹º
If we have one reasoner optimised for L, the modules M1, M2...M can be classified
by this reasoner. Based on Section 2.2, if we classify the union of L modules M1 [    [
M, these satisfiability tests Ð Subs¹º are checked. Then we just
have
Ð</p>
      <p>2¹ Oº M1[[M</p>
      <p>Subs¹º waiting to be checked. Next, we will explain it with
 2¹ Oº*M1[[M
examples.</p>
      <p>Assume we have one ontology shown in Figure 2(a) with 7 atoms and these axioms
in atoms 1, 2, 5, 6, 7 are in L. We also have four modules M1, M2, M6, M7 in L.
Here M5 is not in L because the atom 3 M5 is not in L.</p>
      <p>Now we can use a specific reasoner for L to classify a set of axioms M1 [ M2 [ M6.
Because our ontology is monotonic, classify M1 [ M2 [ M6 means these subsumption
tests Subs¹1º, Subs¹2º, Subs¹6º, Subs¹7º are checked. We still have subsumption
tests Subs¹3º, Subs¹4º, Subs¹5º remaining. Now we can either check these tests in
the ontology shown in Figure 2(b) left part or check them in several modules contain
atoms 3, 4, 5. For example, we can check Subs¹3º in M3, check Subs¹4º in M4
and check Subs¹5º in M5 shown in Figure 2(b) right part. Similarly, we can also check
Subs¹3º, Subs¹4º, Subs¹5º in M4 [ M5.</p>
      <p>Here a union of modules sometimes is not a module. For example, if we have
1 = f  v g 2 = f v g 3 = f u  v  t  g and L = EL in our example
ontology shown in Figure 2(a). Now the union of modules M1 [ M2 [ M6 is not a module.
Because now ,  are all in the signature of this module. Based on Section 2.2, we put
the axioms which entails the subsumption relation between  u  and its subsumers into
the module. So if we want to fix M1 [ M2 [ M6 to a module, we put  u  v  t 
into the module. Then the module is not even in EL. It means if we want a L module
which is a superset of the union of L modules, we will have not only additional axioms
in this module but also this L module is sometimes not in L. The evaluation of this
phenomenon is shown in Section 6.2.</p>
      <p>
        In this paper, we have L = EL¸¸ [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and we use ELK [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] for classifying the union
of EL¸¸ modules M1 [    [ M.
      </p>
      <p>3It is straightforward to extend this to more than one DL and more than one specialised, optimised reasoner.
(a) an AD with seven atoms in
different Description Logics</p>
      <p>(b) Different Choice for left subsumption tests</p>
    </sec>
    <sec id="sec-5">
      <title>5. How the set of satisfiability tests of an AD interacts with classification algorithm</title>
      <p>In this section, we introduce our the classification algorithm ReAD as sketched in
Algorithm 1. Firstly, we compute the AD and get the union of E L¸¸ modules T . Then we use
a reasoner specific for E L¸¸ to classify T and store the subsumption relation to hierarchy
H . Then we use another reasoner for OWL DL to finish the rest of STs in left atoms. In
order to do that, we modify the classification algorithm for the OWL DL reasoner. In this
paper, we pick HermiT as the OWL DL reasoner. The modified classification algorithm
of HermiT is shown in Algorithm 2.</p>
      <p>
        In Algorithm 2 we modify the classification algorithm in HermiT in order to make
it AD-aware (recall that we assume that our ontology has already been tested for
consistency). If  = &gt;, we will not check T 0 6j=  v ?. For every ST, HermiT uses a
wellorganized transitive closure and free results from ST to implement Prune() in order to
avoid STs. More details about Prune() are shown in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
    </sec>
    <sec id="sec-6">
      <title>Algorithm 2 CheckRemainingSTs</title>
      <p>Require: a set of atoms RemainingAtoms, ?-¹Oº, a hierarchy H
1: TopAtoms = f j  2 RemainingAtoms and there is no atom</p>
      <p>RemainingAtoms with  g
2: compute a set of axioms T 0 = #</p>
      <p>Ð
2TopAtoms</p>
    </sec>
    <sec id="sec-7">
      <title>6. Evaluation</title>
      <p>In this section, we report on the empirical evaluation of our algorithm. In particular, we
answer the following research questions:
1. Compared to the size of the whole ontology, what is the size of the union of EL¸¸
modules? This will help us to understand the potential benefits of using ELK.
2. How many EL¸¸ modules are in the union of modules? Are these modules a</p>
      <p>EL¸¸ module? This will help us to understand potential overlap.
3. Compared to the classification time and the number of STs of HermiT, what is
the classification time of ReAD and how many STs does ReAD run?</p>
      <sec id="sec-7-1">
        <title>6.1. Experiment Setting</title>
        <p>Corpus In our experiment, we use the snapshot of the NCBO BioPortal ontology
repository4 by [24], which contains 438 ontologies. Firstly, we remove ABox axioms for these
438 ontologies since we want to know how the classification algorithm behaves on the
TBox axioms. Then we remove those ontologies that have only ABox axioms or are not
in OWL 2 DL. We also remove those ontologies for which we cannot compute an AD or
which HermiT cannot handle. To concentrate on STs and traversal algorithms, we also
remove deterministic ontologies using a test provided by HermiT.5 This leaves us with
a corpus of 98 ontologies; the number of their TBox axioms and the length6 of these
ontologies is summarised in Table 1.</p>
        <p>Implementation The implementation of ReAD is based on the OWL API [25]
Version 3.4.3, especially on the implementation of the AD7 that is part of the OWL API,
namely the one available via Maven Central (maven.org) with an artifactId of
owlapi-tools. We modify the code of reasoner HermiT in version 1.3.88 and use the
reasoner ELK version 0.4.2 as a delegate reasoner. We also use the code from MORe9
for checking E L¸¸ axioms in used for ELK. All experiments have been performed on
Intel(R) Core(TM) i7-6700HQ CPU 2.60GHz RAM 8GB, running Xms1G Xmx8G. Time
is measured in CPU time.
6.2. The Size and Details of the Union of L modules
In this section, we answer our research Questions 1 and 2. Using Algorithm 1, we
implement and compute the union of E L¸¸ modules for these ontologies; in the following, we
call this union the E L¸¸-part of an ontology. We have 34 ontologies that do not contain
any E L¸¸ modules. Figure 3 shows scatter plots of the size of TBox axioms (each point)
and the union of E L¸¸ modules (each x-mark) of each ontology (with the same x-axis
value) among 64 ontologies which contain at least one E L¸¸ module in our corpus. We
find that there are many ontologies in our corpus that have a large E L¸¸-part. These
ontologies also distribute evenly among different sizes.</p>
        <p>To answer our research question 2, we consider how the number of (subset-)
maximal E L¸¸ modules in the E L¸¸-parts varies across the ontologies in our corpus in
Table 2. Among our 64 ontologies, only one ontology has only one such maximal E L¸¸
module. In Table 2, we find most of ontologies have a large number of maximal E L¸¸
genuine modules (average 1,701).; half of our ontologies (32) have more than 69
maximal E L¸¸ genuine modules and 99% ontologies have 9,662 maximal E L¸¸ genuine
modules.</p>
        <p>As discussed at the end of Section 4, a union of E L¸¸ modules is not necessarily an
E L¸¸ module. We tested, for our 64 ontologies, whether the E L¸¸-part is a module. It
turns out that this is the case a surprisingly large proportion of our ontologies, i.e., 80%
(13/64), which could be exploited further for classification.</p>
        <p>
          5HermiT does not use a traversal algorithm for these.
6The length in this chapter is defined in [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ] Page 24.
        </p>
        <p>7AD implementation now is only in OWL API version 5. In our implementation we compile one to OWL
API version 3
8The code of this version can be found in http://www.hermit-reasoner.com
9http://owlapi.sourceforge.net/</p>
      </sec>
      <sec id="sec-7-2">
        <title>6.3. The Classification Time and CTs number during Classification</title>
        <p>In these experiments, we use HermiT version 1.3.8 to compare classification times with.
First, we classify our 64 ontologies 5 times to understand the variation of classification
time. Then we use ReAD to classify the 64 ontologies and record classification time data
as a combination of ELK classification time and modified HermiT classification time.10
Inspired by [26,27], we split our classification data into three bins: (1) less than 1,000ms;
(2) more than 1,000ms and less than 10,000ms; (3) more than 10,000ms. Then we discuss
and compare the results for each bin.</p>
        <p>We also want to know how the EL¸¸ modules size affect the our classification time.
So we define EL¸¸ModulesPercentage as:</p>
        <p>EL¸¸    =
#  EL¸¸  
#  
The classification times measured in CPU Time (ms) versus EL¸¸ Modules percentage
among 64 ontologies for HermiT and ReAD are shown in Figure 4. It shows scatter
plots of the HermiT classification time (each point) and ReAD classification time (each
x-mark) of each ontology (with the same x-axis value) among 64 ontologies. We find
that for these ontologies which EL¸¸ModulesPercentage is more than 50% trends to
have a classification time improvement. We also have some ontologies which have lower
than 50% EL¸¸ModulesPercentage but also have a significant improvement, e.g. NCIT
(47%) from around 75s to 47s, PHAGE (36%) from around 594s to 436s.</p>
        <p>We also count the STs number of HermiT and modified HermiT in ReAD shown in
Table 3. We find the number of STs decreases as we expected in theory.
10This excludes the time used for computation of AD.
(a) Classification Time less than 1,000ms for HermiT(b) Classification Time less than 10,000ms for
and ReAD HermiT and ReAD
(c) Classification Time more than 10,000ms for</p>
        <p>HermiT and ReAD</p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>7. Summary and Future Work</title>
      <p>In this paper, we design and implement our approach for avoiding redundant STs during
classification with the help of AD. We show how our algorithm interacts with the
classification algorithm in HermiT. In the future, we also want to explore how our algorithm
interacts with Enhanced Traversal algorithm. In Section 4, there are several choices for
checking the remaining STs. In this paper, we use the union of modules of each atom
 if we have Subs¹º in our remaining STs for our experiment evaluation. We can also
check these STs in the whole ontology or check each Subs¹º in its genuine module # .
How to decide this is also related to easing the STs. In [28] Chapter 7, the author designs,
categorizes and organizes how to make a choice of the set of axioms for STs. Using these
strategies for checking left STs will tell us more about easification hypothesis: Using
module than the whole ontology checking STs will make the STs easier and faster or
not?</p>
      <p>Since AD gives benefit for optimizing Classification. Optimizing the computation
AD gives benefit. In [29], the author recommend that we can store the AD as a specific
format for ontology. When we classify the ontology, we can use this pre-computed AD
rather than computing AD every time.</p>
      <p>Matentzoglu N, Parsia B. BioPortal Snapshot 30 March 2017 (data set). Zenodo; 2017. http://doi.
org/10.5281/zenodo.439510.</p>
      <p>Horridge M, Bechhofer S. The owl api: A java api for owl ontologies. Semantic web. 2011;2(1):11–21.
Goncalves JR. Impact analysis in description logic ontologies. The University of Manchester; 2014.
Gonc¸alves RS, Parsia B, Sattler U. Performance heterogeneity and approximate reasoning in description
logic ontologies. In: International Semantic Web Conference. Springer; 2012. p. 82–98.</p>
      <p>Matentzoglu NA. Module-based classification of OWL ontologies. University of Manchester; 2016.
Del Vescovo C, Gessler DD, Klinov P, Parsia B, Sattler U, Schneider T, et al. Decomposition and
modular structure of bioportal ontologies. In: International Semantic Web Conference. Springer; 2011.
p. 130–145.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Grau</surname>
            <given-names>BC</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Motik</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel-Schneider</surname>
            <given-names>P</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            <given-names>U.</given-names>
          </string-name>
          <article-title>OWL 2: The next step for OWL</article-title>
          .
          <source>Journal of Web Semantics</source>
          .
          <year>2008</year>
          ;
          <volume>6</volume>
          (
          <issue>4</issue>
          ):
          <fpage>309</fpage>
          -
          <lpage>322</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Glimm</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Motik</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stoilos</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang Z. HermiT</surname>
          </string-name>
          <article-title>: an OWL 2 reasoner</article-title>
          .
          <source>Journal of Automated Reasoning</source>
          .
          <year>2014</year>
          ;
          <volume>53</volume>
          (
          <issue>3</issue>
          ):
          <fpage>245</fpage>
          -
          <lpage>269</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Steigmiller</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liebig</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Glimm</surname>
            <given-names>B</given-names>
          </string-name>
          .
          <article-title>Konclude: system description</article-title>
          .
          <source>Journal of Web Semantics</source>
          .
          <year>2014</year>
          ;
          <volume>27</volume>
          :
          <fpage>78</fpage>
          -
          <lpage>85</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Sirin</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grau</surname>
            <given-names>BC</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kalyanpur</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Katz</surname>
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Pellet</surname>
          </string-name>
          :
          <article-title>A practical owl-dl reasoner</article-title>
          .
          <source>Journal of Web Semantics</source>
          .
          <year>2007</year>
          ;
          <volume>5</volume>
          (
          <issue>2</issue>
          ):
          <fpage>51</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Kazakov</surname>
            <given-names>Y</given-names>
          </string-name>
          , Kro¨tzsch M,
          <article-title>Simancˇ´ık F. The incredible elk</article-title>
          .
          <source>Journal of automated reasoning</source>
          .
          <year>2014</year>
          ;
          <volume>53</volume>
          (
          <issue>1</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>61</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Baader</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brandt</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lutz</surname>
            <given-names>C</given-names>
          </string-name>
          .
          <article-title>Pushing the E L envelope further</article-title>
          . In: OWLED;
          <year>2008</year>
          . .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kutz</surname>
            <given-names>O</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            <given-names>U.</given-names>
          </string-name>
          <string-name>
            <surname>The Even More Irresistible S R O I Q. In</surname>
          </string-name>
          : KR-06;
          <year>2006</year>
          . p.
          <fpage>57</fpage>
          -
          <lpage>67</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Hustadt</surname>
            <given-names>U</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Motik</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            <given-names>U</given-names>
          </string-name>
          .
          <article-title>Data complexity of reasoning in very expressive description logics</article-title>
          .
          <source>In: IJCAI; 2005</source>
          . p.
          <fpage>466</fpage>
          -
          <lpage>471</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Baader</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hollunder</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nebel</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Profitlich</surname>
            <given-names>HJ</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Franconi</surname>
            <given-names>E.</given-names>
          </string-name>
          <article-title>An empirical analysis of optimization techniques for terminological representation systems</article-title>
          .
          <source>Applied Intelligence</source>
          .
          <year>1994</year>
          ;
          <volume>4</volume>
          (
          <issue>2</issue>
          ):
          <fpage>109</fpage>
          -
          <lpage>132</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Glimm</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Motik</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shearer</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stoilos</surname>
            <given-names>G.</given-names>
          </string-name>
          <article-title>A novel approach to ontology classification</article-title>
          .
          <source>Journal of Web Semantics</source>
          .
          <year>2012</year>
          ;
          <volume>14</volume>
          :
          <fpage>84</fpage>
          -
          <lpage>101</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Grau</surname>
            <given-names>BC</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sirin</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kalyanpur</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Modularity</surname>
            and
            <given-names>Web</given-names>
          </string-name>
          <string-name>
            <surname>Ontologies</surname>
          </string-name>
          . In: KR;
          <year>2006</year>
          . p.
          <fpage>198</fpage>
          -
          <lpage>209</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Romero</surname>
            <given-names>AA</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaminski</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grau</surname>
            <given-names>BC</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I.</given-names>
          </string-name>
          <article-title>Module extraction in expressive ontology languages via datalog reasoning</article-title>
          .
          <source>Journal of Artificial Intelligence Research</source>
          .
          <year>2016</year>
          ;
          <volume>55</volume>
          :
          <fpage>499</fpage>
          -
          <lpage>564</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Lutz</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walther</surname>
            <given-names>D</given-names>
          </string-name>
          , Wolter F.
          <article-title>Conservative Extensions in Expressive Description Logics</article-title>
          . In: IJCAI;
          <year>2007</year>
          . p.
          <fpage>453</fpage>
          -
          <lpage>458</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Ghilardi</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lutz</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter F. Did I Damage My</surname>
          </string-name>
          <article-title>Ontology? A Case for Conservative Extensions in Description Logics</article-title>
          . In: KR. AAAI Press;
          <year>2006</year>
          . p.
          <fpage>187</fpage>
          -
          <lpage>197</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Cuenca Grau</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kazakov</surname>
            <given-names>Y</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler U</surname>
          </string-name>
          .
          <article-title>A Logical Framework for Modularity of Ontologies</article-title>
          . In: IJCAI;
          <year>2007</year>
          . p.
          <fpage>298</fpage>
          -
          <lpage>303</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Del Vescovo</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            <given-names>U</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            <given-names>T.</given-names>
          </string-name>
          <article-title>The Modular Structure of an Ontology: Atomic Decomposition</article-title>
          . In: IJCAI;
          <year>2011</year>
          . p.
          <fpage>2232</fpage>
          -
          <lpage>2237</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Tsarkov</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Palmisano</surname>
            <given-names>I.</given-names>
          </string-name>
          <article-title>Chainsaw: a Metareasoner for Large Ontologies</article-title>
          . In: ORE;
          <year>2012</year>
          . .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Romero</surname>
            <given-names>AA</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grau</surname>
            <given-names>BC</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I.</given-names>
          </string-name>
          <article-title>MORe: Modular combination of OWL reasoners for ontology classification</article-title>
          . In: International Semantic Web Conference. Springer;
          <year>2012</year>
          . p.
          <fpage>1</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Matentzoglu</surname>
            <given-names>N</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            <given-names>U</given-names>
          </string-name>
          .
          <article-title>OWL reasoning: Subsumption test hardness and modularity</article-title>
          .
          <source>Journal of automated reasoning</source>
          .
          <year>2018</year>
          ;
          <volume>60</volume>
          (
          <issue>4</issue>
          ):
          <fpage>385</fpage>
          -
          <lpage>419</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Zhao</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            <given-names>U</given-names>
          </string-name>
          .
          <article-title>Avoiding Subsumption Tests During Classification Using the Atomic Decomposition</article-title>
          .
          <source>In: DL-19</source>
          . vol.
          <volume>573</volume>
          ;
          <year>2019</year>
          . .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Baader</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lutz</surname>
            <given-names>C</given-names>
          </string-name>
          , Sattler U, editors. An Introduction to Description Logic. Cambridge University Press;
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <surname>Cuenca Grau</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            <given-names>I</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kazakov</surname>
            <given-names>Y</given-names>
          </string-name>
          , Sattler U.
          <article-title>Modular reuse of ontologies: Theory and practice</article-title>
          .
          <source>Journal of Artificial Intelligence Research</source>
          .
          <year>2008</year>
          ;
          <volume>31</volume>
          (
          <issue>1</issue>
          ):
          <fpage>273</fpage>
          -
          <lpage>318</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>Del Vescovo</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horridge</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            <given-names>U</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhao</surname>
            <given-names>H</given-names>
          </string-name>
          .
          <article-title>Modular Structures and Atomic Decomposition in Ontologies (to be published)</article-title>
          .
          <source>Journal of Artificial Intelligence Research.</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>