<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards Practical Defeasible Reasoning for Description Logics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Giovanni Casini</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Thomas Meyer</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kody Moodley</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ivan Varzinczak</string-name>
          <email>IVarzinczakg@csir.co.za</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Centre for Artificial Intelligence Research CSIR Meraka Institute and UKZN</institution>
          ,
          <country country="ZA">South Africa</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The formalisation of defeasible reasoning in automated systems is becoming increasingly important. Description Logics (DLs) are nowadays the main logical formalism in the field of formal ontologies. Our focus in this paper is to devise a practical implementation for prior work that formalises a version of Rational Closure (an important type of defeasible reasoning) for DLs. We show that the conclusions drawn from it are generally intuitive and desirable. Moreover, we present experimental results showing that using Rational Closure for ontologies of reasonable size is practical.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Reasoning with exceptions has been a major topic in AI since the 80’s. The problem
has been the assumption of certainty, in monotonic systems, of represented information
when deriving inferences. These systems generally cannot accommodate the addition
of new information which contradicts with what is known. For example, if a monotonic
system is told that “Students do not pay taxes” then, upon encountering an exception
(a student who works), it will still conclude that this student is exempt from taxes [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
Defeasible reasoning is concerned with the development of formalisms which are able
to represent and reason with defeasible (non-strict) facts:“Typically, students do not pay
taxes” is the defeasible counterpart of “Students do not pay taxes”.
      </p>
      <p>
        The main approaches for introducing defeasible reasoning into KR formalisms (such
as DLs [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]) have been through adaptations or combinations of the following systems:
Circumscription [
        <xref ref-type="bibr" rid="ref29 ref5">5, 29</xref>
        ], Default Logic [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ], Negation as failure [
        <xref ref-type="bibr" rid="ref12 ref20">12, 20</xref>
        ], Probabilistic
logic [
        <xref ref-type="bibr" rid="ref19 ref24">19, 24</xref>
        ], Autoepistemic Logic [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] and Preferential reasoning [
        <xref ref-type="bibr" rid="ref14 ref8 ref9">8, 9, 14</xref>
        ].
      </p>
      <p>
        The theoretical foundation of our work is a DL adaptation of the preferential
reasoning approach by Lehmann et al. [
        <xref ref-type="bibr" rid="ref22 ref23">22,23</xref>
        ]. The motivation for focusing on the preferential
approach is that it gives back intuitive inferences using procedures that reduce to
classical DL reasoning. This gives the advantage of being able to use “off-the-shelf” DL
reasoners to perform defeasible inference. Hinging on the decidability of classical DLs,
we find that our preferential approach is also decidable. Here, we focus on a
particular preferential construction, the Rational Closure [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ], that has been adapted to the
DL ALC [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>
        In this paper, our goals are: to refine the practical implementation of the Rational
Closure algorithm, based on the procedure presented in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] (Section 2); to reiterate that,
in a DL setting, Rational Closure makes intuitive and desirable inferences in general
(Section 3) and to show that it is practical to use Rational Closure in a DL setting from
a performance perspective (Section 4). The latter performance evaluation is the main
contribution of this work and is, to our knowledge, the first evaluation of this
maturity and nature in the community. We assume that the reader is familiar with DLs [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
and ALC [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ] in particular.
2
      </p>
      <p>
        An algorithm to compute Rational Closure in ALC
We present an algorithm for computing Rational Closure in ALC, based on a
procedure defined by Casini and Straccia [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and similar in style to Pearl’s System Z [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]
and the possibilistic system by Benferhat et al. [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]; a version of this algorithm has been
published in earlier work [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] and what we present here is a refinement to align fully
with our semantic characterisation of Rational Closure [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]; we omit the theoretical
underpinnings, referring the reader to Lehmann and Magidor’s work [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] and, w.r.t. the
DL reformulation, to the work of Casini and Straccia [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and Britz et al. [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
Rational Closure has a series of very desirable properties from the formal point of view:
the consequence relation has a solid logical connotation, since it is characterised by a
set of structural properties that should be satisfied by any non-monotonic formal
system [
        <xref ref-type="bibr" rid="ref21 ref23 ref7">7, 21, 23</xref>
        ]; the decision problem can be reduced to a series of classical monotonic
decision steps; eventually, the overall computational complexity of the procedure is the
same as the one of the underlying entailment relation [
        <xref ref-type="bibr" rid="ref7 ref9">7, 9</xref>
        ].
      </p>
      <p>
        In order to model defeasible reasoning in ALC, we introduce a new kind of
inclusion axiom, i.e., a defeasible inclusion axiom C @ D, which is read as “any object
classified under the concept C is typically also classified under the concept D”, that is,
if we are informed that an object is in the set referred to by C we can conclude that it is
also in the set referred to by D, provided we do not have any other information forcing
us to conclude otherwise. For the semantics of such axioms, we refer the reader to the
work by Britz et al. [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ].
      </p>
      <p>We consider knowledge bases (KBs) of the form K = hT ; Di, where T is a DL TBox
and D is known as a DBox which is a finite set of defeasible inclusion axioms. We are
not considering the ABox here, and the algorithm we are going to introduce computes
the Rational Closure only considering concepts, i.e., it will consider KBs K = hT ; Di
and it will be able to decide if C @ D or C v D is in the Rational Closure of K (i.e., if
it is a defeasible consequence of K according to Rational Closure).</p>
      <p>
        To be more specific, we shall consider only KBs composed by a DBox D: since from
the point of view of the procedure the two axioms C v ? and C @ ? are equivalent and
each classical inclusion axiom C v D is equivalent to the defeasible inclusion axiom
C u :D @ ?, as explained by Casini and Straccia [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Hence it is always possible to
transform a KB K = hT ; Di into an equivalent KB K0 = h;; DKi, where DK =
D [ fC u :D @ ? j C v D 2 T g.
      </p>
      <p>Example 1. Consider the KB K = hT ; Di, with T = fBactMen v Men; VirMen v
Meng and D = fMen @ :Fatal; BactMen @ Fatalg. K is about meningitis (Men),
bacterial meningitis (BactMen), viral meningitis (VirMen), and their fatality (Fatal):</p>
      <p>We can transform it into a KB composed of just a DBox DK = fBactMen u
:Men @ ?; VirMen u :Men @ ?; Men @ :Fatal; BactMen @ Fatalg.</p>
      <p>From now on, when talking about a KB K, we assume that all the information in the
TBox has been moved into the DBox, i.e., we shall assume that we are talking about a
KB h;; DKi. The use of KBs of the form hT ; Di will be functional to the exposition,
and has to be considered simply as a renaming of the correspondent DBox DK.</p>
      <p>If all the axioms in K were classical inclusion axioms, we would derive that bacterial
meningitis is at the same time fatal (BactMen v Fatal) and non-fatal (BactMen v
Men, Men v :Fatal), i.e., it would have turned out to be an empty concept. Thus, we
rather represent some of the strict facts in Kas defeasible ones to exhibit the atypicality
of BactMen (BactMen is atypical w.r.t. to its parent class Men because it has a property
Fatal which is in direct contradiction to a property of its parent i.e. :Fatal).</p>
      <p>We shall indicate with D the sets of the materialisations of the axioms in D, where
the materialisation of an axiom C @ D denotes the concept expressing the same
subsumption relation of the axiom (i.e., :C t D). Hence D = f:C t D j C @ D 2 Dg.</p>
      <p>The algorithm to compute Rational Closure consists of a main algorithm and two
sub-procedures. All three are based solely on classical entailment for ALC (j=). The
first sub-procedure is called exceptional. Its aim is to determine which of the concepts
named in our axioms are exceptional. Intuitively, a concept is exceptional in a KB if it
refers to a class that is atypical w.r.t. one of its superclasses (e.g. BactMen in the
example above). Technically, the exceptionality of a concept can be decided using j=, since
a concept C is exceptional in K = h;; Di if and only if j= d D v :C.1 A defeasible
axiom C @ D 2 D is considered exceptional if its antecedent C is exceptional. Given
a finite set E of defeasible inclusion axioms, the algorithm exceptional gives back the
subset of E containing the exceptional axioms.</p>
      <sec id="sec-1-1">
        <title>Procedure exceptional(E )</title>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Input: E D</title>
    </sec>
    <sec id="sec-3">
      <title>Output: E0</title>
      <p>1 E0 := ;;</p>
    </sec>
    <sec id="sec-4">
      <title>2 foreach C @ D 2 E do</title>
      <p>3 if j= d E v :C then
4 E0 := E0 [ fC @ Dg;</p>
      <p>E such that E0 is exceptional w.r.t. E</p>
    </sec>
    <sec id="sec-5">
      <title>5 return E0;</title>
      <p>
        Once we have defined the notion of exceptionality, we can think of ordering all
the defeasible axioms in our KB with respect to their exceptionality. That is, we can
associate a ranking value to each axiom in the KB by a recursive application of the
algorithm exceptional. computeRanking is the algorithm that, using exceptional as a
sub-procedure, partitions the set D into R = fD0; D1; : : :g, where each set Di contains
the defeasible axioms having i as ranking value.
1 This is the only difference between the present procedure and the ones presented by Casini
and Straccia [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and Moodley et al. [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ], where a concept C is considered exceptional in K
if and only if K j= &gt; v :C; the need for such a change has become apparent once we have
defined an appropriate semantics for the Rational Closure in ALC [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <sec id="sec-5-1">
        <title>Procedure computeRanking(K)</title>
        <p>Input: Defeasible KB D</p>
        <p>Output: The ranking R for D
1 E0 := D; E1 := exceptional(E0); i := 0;
2 while Ei+1 6= Ei do
3 i := i + 1; Ei+1 := exceptional(Ei);
4 D1 := Ei; R := fD1g;
5 for j = 1 to i do
6 Dj 1 := Ej 1nEj; R := R [ fDj 1g;
7 return R;</p>
        <p>computeRanking receives as input our DBox D. It starts identifying the exceptional
axioms in D (i.e., the set E1), then the exceptional axioms in E1 (i.e., the set E2), and
so on. For some i, it will necessarily turn out that Ei = Ei + 1: that means that Ei
(possibly being empty) is a fixed point of exceptional, and we say that the axioms in Ei
have 1 as ranking value. That implies that we derive the negation of the antecedents of
such axioms at every step of the ranking construction. That is, we cannot conceive of
a situation so exceptional such that such concepts are non-empty. That means that the
negation of such antecedents is not properly defeasible information, and can be treated
as strict information: C @ D being in D1 is equivalent to saying that C v ? is in our
KB. Note that any axiom C u:D @ ? obtained from a classical inclusion axiom C v D
always turns out to have 1 as a ranking value, which corresponds to C u :D v ?,
which in turn is logically equivalent to the original C v D. Hence D1 will contain all
the information in the original T plus, possibly, some non-defeasible information that
implicitly follows from the defeasible axioms. We give an example to illustrate this:
Example 2. Consider a KB K = hT ; Di, with T = fE v Dg and D = fC @ :D; C @ Eg.
K is transformed into DK = fC @ :D; C @ E; E u :D @ ?g. We apply the
ranking procedure, and we obtain that both E u :D and C are exceptional concepts, i.e.,
E1 = E0 = DK. Such a result implies that D1 = DK, and therefore, that our initial
KB K is equivalent to the TBox T 0 = fE v D; C v :D; C v Eg because we obtain
the same ranking for both. Note that the information that C v ? was not explicit in the
original KB K, and only became derivable when additionally considering the DBox.</p>
        <p>Once the algorithm has identified D1, it ranks all the other axioms: an axiom has i
as a ranking value if i is the highest label for which it turns out to be exceptional, that
is, if it is in Ei but it does not appear anymore in Ei+1. We obtain a partition of D into
R = fD0; : : : ; Di 1; D1g.</p>
        <p>Example 3. Consider the KB in Example 1. computeRanking takes DK as input and
begins to compute the ranking. The result of Lines 1 to 3 will be the sequence E0 = DK,
E1 = fBactMen u :Men @ ?; VirMen u :Men @ ?; BactMen @ Fatalg, E2 = E3 =
fBactMenu :Men @ ?; VirMen u :Men @ ?g. Hence, by the instructions from Line 4
to Line 6, we obtain a partition of DK in D0K = fMen @ :Fatalg, D1K = fBactMen @
Fatalg, and D1K = fBactMen u :Men @ ?; VirMen u :Men @ ?g.</p>
        <p>Now, given a defeasible KB K = f;; Dg, we can obtain a ranking R = fD0; : : : ; Dn;
D1g. Once this ranking is identified we can ask a query of the form C @ D (noting that
we can translate strict queries of the form C v D into C u :D @ ?). Algorithm 1 can
determine whether such queries are in the Rational Closure of K. Note that if we are
confronted with a strict query (classical inclusion axiom C v D), one can determine
if it is in the Rational Closure of the KB by checking if it is classically entailed by the
strict information in D (D1). This can be implemented as an optimisation.</p>
        <p>Algorithm 1: Rational Closure</p>
        <p>Input: The ranking R of D and query '</p>
        <p>Output: true iff ' is in the Rational Closure of K
1 n := 0; DR := DnD1;
2 while j= d D1 u d DR v :C and DR 6= ; do
3 DR := DRnDn; n := n + 1;
4 return j= d D1 u d DR u C v D;</p>
        <p>However, for simplicity, Algorithm 1 considers only the case in which the query
is a defeasible inclusion axiom. The algorithm takes as input the ranking and query
C @ D and determines which portion of R is compatible with the concept C, i.e., which
portion of defeasible information does not imply the negation of C, starting from the
most normal situations up to increasing levels of exceptionality. We give an example:
Example 4. Consider the ranking R in Example 3 and the query ' = VirMen @ :Fatal
which we pose to Algorithm 1. The algorithm checks if j= d DK v :VirMen, which
is not the case. Hence, we have to check if j= d D1 u d DR u VirMen v :Fatal,
which is true. On the other hand, if our query is ' = BactMen @ :Fatal, we obtain
a different result: since j= d DK v :BactMen but 6j= d DK=D0 v :BactMen,
BactMen is an exceptional class of level 1, compatible with D1, and we have to
increase the exceptionality level eliminating the information in D0 from DR. It turns out
that 6j= d D1 u d DR u BactMen v :Fatal, that is the right conclusion since we have
BactMen @ Fatal in our KB.</p>
        <p>
          The computational complexity of the entire procedure is the same as that of the
underlying monotonic entailment relation j=, i.e., it is an EXPTIME-complete problem
( [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] and [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ], Corollary 2). This is easy to see since the number of classical entailment
checks is at most exponential w.r.t. the size of the ontology (number of axioms).
Moreover, note that the defined procedures can be applied to all the DLs that are more
expressive than ALC, still preserving the computational complexity of the decision problem
w.r.t. the underlying monotonic entailment relation. Using a more expressive DL than
ALC, the defeasible information will be still represented only by defeasible inclusion
axioms C @ D, while the strict information different from ALC inclusion axioms (role
inclusion axioms, role transitivity, etc.) must be considered as background knowledge
at each step of the decision procedure. The correctness of Algorithm 1 follows from the
procedure by Casini and Staccia [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] as it is a direct translation/rewriting thereof.
        </p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Test Suite</title>
      <p>
        We would like to argue that the kind of reasoning that Rational Closure models is
satisfying from an intuitive point of view, i.e., that the conclusions we can draw are
reasonable. For a thorough semantical motivation of this the reader should consult our
theoretical work [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. In this section we make use of a test suite consisting of
ontology snippets widely used in the community to show that our presented procedure gives
back the same desirable inferences that some other non-monotonic formalisms are able
to derive as well as some which they are not able to derive.
      </p>
      <p>
        Eukaryotic Cells [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]. Eukaryotic cells (EukCell) have a proper nucleus, but there
are some cells lacking a proper nucleus and are nonetheless considered eukaryotic, such
as the mammalian red blood cells (MamRedBloodCell).
      </p>
      <p>K =</p>
      <p>EukCell @ 9hasNucleus:&gt;;</p>
      <p>MamRedBloodCell v EukCell u :9hasNucleus:&gt;</p>
      <p>Using only classical subsumption, would imply the non-existence of mammalian
red blood cells (MamRedBloodCell v ?), while using defeasible subsumption we
obtain the ranking D0K = fEukCell @ 9hasNucleus:&gt;g and D1K = fMamRedBloodCell u
:(EukCell u :9hasNucleus:&gt;) @ ?g that allows mammalian red blood cells to exist
as exceptional eukaryotic cells, without a nucleus. The query MamRedBloodCell @
9hasN ucleus:&gt; returns a negative answer, since the concept MamRedBloodCell can
be associated only with D1K and not with the entire DK. If we take under
consideration another kind of eukaryotic cell, e.g. the cells composing the muscle of a mammal
(we add to our KB MamMuscCell v EukCell), in the absence of more information
the procedure associates the concept MamMuscCell with all the defeasible
information DK, concluding that it is a typical eukaryotic cell, and hence it has a nucleus
(MamMuscCell @ 9hasNucleus:&gt;).</p>
      <p>
        Other well-known test-examples that present the same structure (a subclass that does
not satisfy some properties typically characterising a super-class) are the Situs Inversus
and the Whale examples [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], and the present procedure treats them in the same way.
      </p>
      <p>
        Access Control [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. In this example we deal with an extra level of exceptionality.
A user typically does not have access to a confidential file, but members of the staff do.
However, if a staff member is black listed, the access is revoked.
      </p>
      <p>K =
8 User @ :9AccessTo:Con dential; 9
&lt; Sta @ 9AccessTo:Con dential; Sta v User; =
: BlackListedSta v Sta u :9AccessTo:Con dential ;</p>
      <p>If we used only classical subsumption, we would have derived Sta v ? and
BlackListedSta v ?, that would have allowed for undesired conclusions (e.g., Sta v
:9AccessTo:Con dential and BlackListedSta v 9AccessTo:Con dential). Instead,
using @ and Procedure computeRanking we end up with the ranking: D0K = fUser
@ :9AccessT o:Conf identialg, D1K = fSta @ 9AccessTo:Con dentialg, and D1K =
fSta u :User @ ?; BlackListedSta u :(Sta u :9AccessTo:Con dential) @ ?g.
Hence the concept Sta can be associated only with the default information in D1K [
D1K, avoiding the conclusion Sta @ :9AccessTo:Con dential. In the same way, the
concept BlackListedSta can be associated only with D1K, avoiding a positive answer
to the query BlackListedSta @ 9AccessTo:Con dential.</p>
      <p>
        Bee Key. In this example we go beyond ALC, since we make use of qualified
number restrictions. It is a real-world example of classification/taxonomisation of bee
species in sub-Saharan Africa [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] into genera and subgenera. The problem is that there
are exceptions in the characteristics of bee species, and this makes species difficult to
classify into genera and hence genera into families. A case in point is that most male
afrotropical bees have thirteen segment antennae (SegAnt). An afrotropical male
belonging to sub-family apidae (ApiFBee) and the pasite genus (PGBee), however, only
has twelve segment antennae. We can formalise such information as:
      </p>
      <p>K =
8&lt; PPGGBBeeee uvMAaplieFBvee;=A1p2iFhBasePeavrt:ASefrgoASnFtB;ee; =9
: AfroSFBee u Male @ = 13 hasPart:SegAnt ;</p>
      <p>
        Using a defeasible axiom, we avoid the concept PGBee u Male to turn out as
necessarily empty (i.e., the procedure gives back a negative answer to the query PGBee u
Male @ = 13 hasPart:SegAnt), while keeping the information that typically males
of the afrotropical family have thirteen-segment antennas. We have shown that
Rational Closure derives intuitive conclusions for our test suite. It must be noted, however,
that in some cases the inferential power of Rational Closure turns out to be
insufficient. That is, there may be conclusions that are intuitively desirable, but we are not
able to derive. Once a class turns out to be atypical w.r.t. one of its superclasses, it
cannot inherit any of the typical properties associated to each of its super-classes. For
example, if we consider the Access Control case above, and add to the KB the axiom
User @ 9AccessTo:Public, i.e., every user has usually access to public files. Applying
the ranking procedure to the new KB, we obtain the same results as above, only with
the addition of User @ 9AccessTo:Public in D0K. As above, the axioms in D0K cannot be
associated to exceptional concepts as Sta and BlackListedSta , hence we cannot
derive neither Sta @ 9AccessTo:Public nor BlackListedSta @ 9AccessTo:Public, that
would have been desirable conclusions. In order to overcome such inferential limits, we
have to extend the inferential power of Rational Closure. Among the proposed
extensions, the most well-known one is the Lexicographic Closure [
        <xref ref-type="bibr" rid="ref10 ref22">10, 22</xref>
        ] which addresses
the shortcoming of Rational Closure described above. We plan to present the procedure
for computing it in DLs and the relevant experimental results in future publications.
4
      </p>
    </sec>
    <sec id="sec-7">
      <title>Experiments</title>
      <p>We have run preliminary experiments to determine the practical performance of the
Rational Closure algorithm. To our knowledge there are no other published evaluations
of this scale or nature for defeasible reasoning approaches. In this section we give a
description of the data we generated and present the results of our experiments.</p>
      <p>Setup. We initially considered using, as our data, E L? test ontologies graciously
made available on the LoDEN (http://loden.fisica.unina.it) project website. LoDEN
stands for Low complexity Description Logics with Non-monotonic features. In the
end, although the ontologies were of sufficient size, we decided that there were too few
in the dataset to be statistically significant. Also, we decided that we are more
interested in the performance for ALC. Therefore, we generated our own dataset as follows
to address our needs: we randomly generated 11 sets of 50 OWL ontologies each (all
represented in ALC). Each set represented a different percentage defeasibility (ratio
of defeasible to strict axioms in the ontologies) in increments of 10 from 0 to 100. The
number of axioms in the ontologies of each set varied uniformly between 150 and 5150.</p>
      <p>It is notable that the size of the ontologies cannot be considered large-scale to be
representative of mature bio-medical ontologies such as those stored in the NCBO
BioPortal corpus (http://bioportal.bioontology.org) but at the same time our ontologies are
by no means small and give an accurate reflection of the average sizes of application
ontologies in other corpuses such as the SWEET (http://sweet.jpl.nasa.gov) corpus. We
motivate the use of randomly generated ontologies by observing that the defeasibility
paradigm is not as yet widely embraced in “real-world” ontology development. There
simply aren’t any applied ontologies in existence incorporating similar notions of
defeasibility to which we are presenting. The idea of these experiments was to get an initial
sense for how well the Rational Closure algorithm performs with non-trivial ontologies
of reasonable size. We conjecture that the data we have generated is qualitatively and
quantitatively appropriate as a first attempt to determine this. Our ALC ontology
generator and test ontologies are available for download at: http://tinyurl.com/onwddh6.</p>
      <p>In addition to the ontologies, we also randomly generated a set of TBox queries for
each ontology using terms in their signatures (concept and role names in the ontology).
The total number of queries generated per ontology was 2 percent of the number of
axioms in that ontology. The task was then to check entailment of the queries in each
ontology using Rational Closure (Section 2). The first step was to generate the rankings
of the ontologies; and then finally to execute the queries. We recorded the average
ranking computation times, the number of ranks that occurred in each ranking and the
average query answering times. The experiments were carried out on an Intel Core 2 Duo
machine with 2GB of memory allocated to the JVM (Java virtual machine). The
classical DL reasoning implementation used was HermiT (http://www.hermit-reasoner.com)
accessed through the OWLAPI (http://owlapi.sourceforge.net).</p>
      <p>Results. From the perspective of ontology engineering, we view the computation
of the ranking of a certain version of an ontology as a task to be executed offline.
The typical scenario is that the ranking will be computed once a stable version of the
ontology is obtained and then stored offline. When query answering needs to be carried
out the ranking can be loaded on demand. The average number of ranks per ranking of
an ontology that we encountered in our dataset is shown in Figure 1.</p>
      <p>In terms of the average performance of the ranking computation procedure, our
results show a steady increase in this measurement as the percentage defeasibility of
ontologies increases. In the case of 10 percent defeasiblility we obtained an average
ranking computation time of less than half a second. In the worst case, that is in the
case of ontologies with 100 percent defeasibility the average time to compute a ranking
was found to be in the region of 8 seconds. In the special case where we have 0 percent
defeasibility, query answering reduces to classical DL entailment and hence no ranking
is required. If we study the impact of the number of ranks in a particular ranking on
our performance results, we find that we obtained 30 different values for the number of
ranks in our dataset ranging between 0 and 49. If we disregard the 0 defeasibility case,
the difference between the times for computing the rankings with the lowest number
of ranks (3) and the highest number of ranks (49) is about 22.5 seconds. Results are
depicted in Figure 2.</p>
      <p>In summary, for computation of the ranking of the ontologies in our dataset we can
conclude that on average computing the ranking takes between 0.4 and 8 seconds for
ontologies that are between 150 and 5150 axioms large. This seems to indicate that
computation of the ranking, as an offline task, is feasible from an ontology engineering
point of view. It is also clear from the results that the number of ranks in the ranking
affects the performance of the ranking computation. It is likely that this is because
of more entailment checks required to compute rankings with more ranks. We note
that updating of ontologies to new versions will require recomputation of the ranking
although this need not be in a naive way. We have optimisations in the pipeline for
modifying existing rankings to reflect the new changes in the ontology.</p>
      <p>
        In terms of query execution, our results show that defeasible reasoning is practical in
ontologies of similar sizes to those in our dataset. With an additional optimisation step
we have pruned away axioms in the ranking that are irrelevant to the signature of the
query using ontology modularisation techniques [
        <xref ref-type="bibr" rid="ref17 ref18">17, 18</xref>
        ]. The results are that executing
a single TBox query takes on average between 1.2 and 1.7 milliseconds depending on
the percentage of defeasibility of the ontologies. We note also that defeasible
reasoning is very close to the performance of classical entailment (0.7 milliseconds in the 0
percent defeasible case). These results strongly indicate that query answering can be
executed on demand at least in the context of average ontology sizes between 150 and
5150 and average ranking sizes up to 50. Query results are shown in Figure 3.
Closely related to our work from a theoretical point of view is that of Giordano et
al. [
        <xref ref-type="bibr" rid="ref15 ref16">15, 16</xref>
        ] which uses preferential orderings on the individuals to define a typicality
operator T s.t. the expression T(C) v D corresponds to our C @ D. They provide a
tableau calculus for their system that relies on the properties of the preferential
consequence relations. In order to augment the inferential power of their system they have
used circumscription techniques, obtaining systems that share properties of both the
preferential and the circumscriptive approaches. At present, we are not aware of any
implementation of their work. Outside the family of preferential systems there are mature
proposals based on circumscription for DLs by Bonatti et al. [
        <xref ref-type="bibr" rid="ref3 ref4 ref6">3,4,6</xref>
        ] and by Sengupta et
al. [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. To our knowledge, the proposal by Bonatti et al. is the only one, together with
the present one, that has been properly implemented. We are aware that they have
performance results for their latest circumscriptive approach which are not yet published
to our knowledge, and we hereby acknowledge their input to our work through sharing
of test data for comparison purposes.
      </p>
      <p>
        The main drawback of circumscriptive approaches is the burden on the ontology
engineer to make appropriate decisions related to the fixing and varying of concepts and
the priority of defeasible subsumption statements. Such choices can have a major effect
on the conclusions drawn from the system, and can easily lead to counter-intuitive
inferences. For example, in the Eukaryotic Cell example, circumscription can derive the
conclusion MamRedBloodCell v ? (Bonatti’s personal communication), which means
that the existence of mammalian red blood cells is impossible, that is clearly an
undesirable result. Moreover, the use of circumscription usually implies a considerable
increase in computational complexity w.r.t. the underlying monotonic entailment relation
(TBox reasoning with concept-circumscribed KBs for ALC is NEXPNP-complete [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]),
in contrast to the EXPTIME-complete complexity of our approach (Section 2).
6
      </p>
    </sec>
    <sec id="sec-8">
      <title>Conclusions and future work</title>
      <p>We have presented an algorithm for computing Rational Closure for ALC (Section
2), and we have shown that such a procedure gives back desirable conclusions w.r.t.
some representative test-examples extracted from the literature (Section 3). The main
contribution of the present work is a first but significant practical evaluation of the
performance of Algorithm 1 w.r.t. ontologies of moderate size. Our results show that query
answering can be computed on demand and is roughly twice as slow as classical
entailment over the dataset. We have seen that despite the fact that computation of classical
entailment is clearly more efficient, the cost of the implementation of Rational
Closure is not at all excessive. Therefore, the implementation of the additional inferential
capabilities of Rational Closure is justified.</p>
      <p>About future work, we have implemented Lexicographic Closure of the TBox and
we plan to carry out an analogous evaluation (to the one presented in this paper) for it.
We have also developed a semantics for Rational Closure of the ABox and a companion
algorithm for computing this. We plan to implement this algorithm and to carry out a
similar experimental evaluation of this. In addition, we plan to explore the feasibility of
other rational consequence relations as candidates for defeasible entailment.</p>
      <p>Acknowledgements. This work was partially funded by Project number 247601,
Net2: Network for Enabling Networked Knowledge, from the FP7-PEOPLE-2009-IRSES
call. It is also based upon research supported by the National Research Foundation.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Calvanese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. L.</given-names>
            <surname>McGuinness</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Nardi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P. F.</given-names>
            <surname>Patel-</surname>
          </string-name>
          Schneider, editors.
          <source>The Description Logic Handbook</source>
          . Cambridge University Press,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>S.</given-names>
            <surname>Benferhat</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Dubois</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Prade</surname>
          </string-name>
          .
          <article-title>Representing default rules in possibilistic logic</article-title>
          .
          <source>In Proc. of KR</source>
          , pages
          <fpage>673</fpage>
          -
          <lpage>684</lpage>
          ,
          <year>1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>P.</given-names>
            <surname>Bonatti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Faella</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.</given-names>
            <surname>Sauro</surname>
          </string-name>
          .
          <article-title>Defeasible inclusions in low-complexity DLs</article-title>
          . JAIR,
          <volume>42</volume>
          :
          <fpage>719</fpage>
          -
          <lpage>764</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>P.</given-names>
            <surname>Bonatti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Faella</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.</given-names>
            <surname>Sauro</surname>
          </string-name>
          .
          <article-title>On the complexity of EL with defeasible inclusions</article-title>
          .
          <source>In Proc. of IJCAI</source>
          , pages
          <fpage>762</fpage>
          -
          <lpage>767</lpage>
          . AAAI Press,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>P.</given-names>
            <surname>Bonatti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lutz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Wolter</surname>
          </string-name>
          .
          <article-title>Description logics with circumscription</article-title>
          .
          <source>Proc. of KR</source>
          ,
          <volume>6</volume>
          :
          <fpage>400</fpage>
          -
          <lpage>41O</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>P.</given-names>
            <surname>Bonatti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lutz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Wolter</surname>
          </string-name>
          .
          <article-title>The complexity of circumscription in description logic</article-title>
          .
          <source>JAIR</source>
          ,
          <volume>35</volume>
          (
          <issue>2</issue>
          ):
          <fpage>717</fpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>K.</given-names>
            <surname>Britz</surname>
          </string-name>
          , G. Casini, T. Meyer, K. Moodley,
          <string-name>
            <given-names>and I. J.</given-names>
            <surname>Varzinczak</surname>
          </string-name>
          .
          <article-title>Ordered Interpretations and Entailment for Defeasible Description Logics</article-title>
          .
          <source>Technical report, CAIR, CSIR Meraka and UKZN</source>
          ,
          <string-name>
            <surname>South</surname>
            <given-names>Africa</given-names>
          </string-name>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>K.</given-names>
            <surname>Britz</surname>
          </string-name>
          , T. Meyer, and
          <string-name>
            <surname>I. Varzinczak.</surname>
          </string-name>
          <article-title>Semantic foundation for preferential description logics</article-title>
          .
          <source>In Proc. of the Australasian Joint Conference on Artificial Intelligence, number 7106 in LNAI</source>
          , pages
          <fpage>491</fpage>
          -
          <lpage>500</lpage>
          . Springer,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>G.</given-names>
            <surname>Casini</surname>
          </string-name>
          and
          <string-name>
            <given-names>U.</given-names>
            <surname>Straccia</surname>
          </string-name>
          .
          <article-title>Rational closure for defeasible description logics</article-title>
          .
          <source>In Proc. of JELIA</source>
          , pages
          <fpage>77</fpage>
          -
          <lpage>90</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. G. Casini and
          <string-name>
            <given-names>U.</given-names>
            <surname>Straccia</surname>
          </string-name>
          .
          <article-title>Lexicographic closure for defeasible description logics</article-title>
          .
          <source>In Proc. of Australasian Ontology Workshop</source>
          , volume
          <volume>969</volume>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>F. M. Donini</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Nardi</surname>
            , and
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Rosati</surname>
          </string-name>
          .
          <article-title>Autoepistemic description logics</article-title>
          .
          <source>In Proc. of IJCAI</source>
          , volume
          <volume>15</volume>
          , pages
          <fpage>136</fpage>
          -
          <lpage>141</lpage>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>F. M. Donini</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Nardi</surname>
            , and
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Rosati</surname>
          </string-name>
          .
          <article-title>Description logics of minimal knowledge and negation as failure</article-title>
          .
          <source>ACM Transactions on Computational Logic (TOCL)</source>
          ,
          <volume>3</volume>
          (
          <issue>2</issue>
          ):
          <fpage>177</fpage>
          -
          <lpage>225</lpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>C. Eardley</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Kuhlmann</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Pauly</surname>
          </string-name>
          .
          <article-title>The bee genera and subgenera of sub-Saharan Africa</article-title>
          .
          <source>Belgian Development Cooperation</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14. L.
          <string-name>
            <surname>Giordano</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Gliozzi</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Olivetti</surname>
            , and
            <given-names>G. L.</given-names>
          </string-name>
          <string-name>
            <surname>Pozzato</surname>
          </string-name>
          .
          <article-title>Preferential description logics</article-title>
          .
          <source>In Logic for Programming</source>
          ,
          <source>Artificial Intelligence, and Reasoning</source>
          , pages
          <fpage>257</fpage>
          -
          <lpage>272</lpage>
          . Springer,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15. L.
          <string-name>
            <surname>Giordano</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Gliozzi</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Olivetti</surname>
            , and
            <given-names>G. L.</given-names>
          </string-name>
          <string-name>
            <surname>Pozzato</surname>
          </string-name>
          .
          <article-title>A non-monotonic description logic for reasoning about typicality</article-title>
          .
          <source>Artif</source>
          . Intell.,
          <volume>195</volume>
          :
          <fpage>165</fpage>
          -
          <lpage>202</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16. L.
          <string-name>
            <surname>Giordano</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Olivetti</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Gliozzi</surname>
            , and
            <given-names>G.L.</given-names>
          </string-name>
          <string-name>
            <surname>Pozzato</surname>
          </string-name>
          . ALC +
          <article-title>T : A preferential extension of description logics</article-title>
          .
          <source>Fund</source>
          . Inf.,
          <volume>96</volume>
          (
          <issue>3</issue>
          ):
          <fpage>341</fpage>
          -
          <lpage>372</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          , I. Horrocks,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          , and
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Just the right amount: extracting modules from ontologies</article-title>
          .
          <source>In Proceedings of the 16th international conference on World Wide Web</source>
          , pages
          <fpage>717</fpage>
          -
          <lpage>726</lpage>
          . ACM,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          , I. Horrocks,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          , and
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Modular reuse of ontologies: Theory and practice</article-title>
          .
          <source>Journal of Artificial Intelligence Research</source>
          ,
          <volume>31</volume>
          (
          <issue>1</issue>
          ):
          <fpage>273</fpage>
          -
          <lpage>318</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>J.</given-names>
            <surname>Heinsohn</surname>
          </string-name>
          .
          <article-title>Probabilistic description logics</article-title>
          .
          <source>In Proc. of the Tenth International Conference on Uncertainty in Artificial Intelligence</source>
          , pages
          <fpage>311</fpage>
          -
          <lpage>318</lpage>
          . Morgan Kaufmann Publishers Inc.,
          <year>1994</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <given-names>P.</given-names>
            <surname>Ke</surname>
          </string-name>
          and
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Next steps for description logics of minimal knowledge and negation as failure</article-title>
          .
          <source>In Proc. of the 2008 Description Logic Workshop (DL</source>
          <year>2008</year>
          ), volume
          <volume>353</volume>
          .
          <string-name>
            <surname>Citeseer</surname>
          </string-name>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <given-names>S.</given-names>
            <surname>Kraus</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Lehmann</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Magidor</surname>
          </string-name>
          .
          <article-title>Nonmonotonic reasoning, preferential models and cumulative logics</article-title>
          .
          <source>Art</source>
          . Intell.,
          <volume>44</volume>
          :
          <fpage>167</fpage>
          -
          <lpage>207</lpage>
          ,
          <year>1990</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <given-names>D.</given-names>
            <surname>Lehmann</surname>
          </string-name>
          .
          <article-title>Another perspective on default reasoning</article-title>
          .
          <source>Annals of Mathematics and Artificial Intelligence</source>
          ,
          <volume>15</volume>
          :
          <fpage>61</fpage>
          -
          <lpage>82</lpage>
          ,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <given-names>D.</given-names>
            <surname>Lehmann</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Magidor</surname>
          </string-name>
          .
          <article-title>What does a conditional knowledge base entail? Art</article-title>
          . Intell.,
          <volume>55</volume>
          (
          <issue>1</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>60</lpage>
          ,
          <year>1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <given-names>T.</given-names>
            <surname>Lukasiewicz</surname>
          </string-name>
          .
          <article-title>Expressive probabilistic description logics</article-title>
          .
          <source>Artificial Intelligence</source>
          ,
          <volume>172</volume>
          (
          <issue>6</issue>
          ):
          <fpage>852</fpage>
          -
          <lpage>883</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <given-names>K.</given-names>
            <surname>Moodley</surname>
          </string-name>
          , T. Meyer, and
          <string-name>
            <given-names>I. J.</given-names>
            <surname>Varzinczak</surname>
          </string-name>
          .
          <article-title>A defeasible reasoning approach for description logic ontologies</article-title>
          .
          <source>In Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference</source>
          , pages
          <fpage>69</fpage>
          -
          <lpage>78</lpage>
          . ACM,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <given-names>J.</given-names>
            <surname>Pearl</surname>
          </string-name>
          .
          <article-title>System Z: a natural ordering of defaults with tractable applications to nonmonotonic reasoning</article-title>
          .
          <source>In Proceedings of the 3rd conference on Theoretical aspects of reasoning about knowledge</source>
          ,
          <source>TARK '90</source>
          , pages
          <fpage>121</fpage>
          -
          <lpage>135</lpage>
          . Morgan Kaufmann Publishers Inc.,
          <year>1990</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <given-names>J.</given-names>
            <surname>Quantz</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Ryan</surname>
          </string-name>
          .
          <source>Preferential default description logics</source>
          ,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28. M.
          <string-name>
            <surname>Schmidt-Schauß</surname>
            and
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Smolka</surname>
          </string-name>
          .
          <article-title>Attributive concept descriptions with complements</article-title>
          .
          <source>Artificial intelligence</source>
          ,
          <volume>48</volume>
          (
          <issue>1</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>26</lpage>
          ,
          <year>1991</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <given-names>K.</given-names>
            <surname>Sengupta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Krisnadhi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Hitzler</surname>
          </string-name>
          .
          <article-title>Local closed world semantics: Grounded circumscription for OWL</article-title>
          .
          <source>In Proc. of ISWC</source>
          , pages
          <fpage>617</fpage>
          -
          <lpage>632</lpage>
          . Springer,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. E.</given-names>
            <surname>Aranguren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Wolstencroft</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Drummond</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Rector</surname>
          </string-name>
          .
          <article-title>Using OWL to model biological knowledge</article-title>
          .
          <source>Intern. Journ. of Human-Computer Studies</source>
          ,
          <volume>65</volume>
          (
          <issue>7</issue>
          ):
          <fpage>583</fpage>
          -
          <lpage>594</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>