<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Completing Description Logic Knowledge Bases using Formal Concept Analysis?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Franz Baader</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bernhard Ganter</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ulrike Sattler</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Basr¸ı Sertkaya</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>TU Dresden</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>The University of Manchester</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We propose an approach for extending both the terminological and the assertional part of a Description Logic knowledge base by using information provided by the knowledge base and by a domain expert. The use of techniques from Formal Concept Analysis ensures that, on the one hand, the interaction with the expert is kept to a minimum, and, on the other hand, we can show that the extended knowledge base is complete in a certain, well-defined sense.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Description Logics (DLs) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] are employed in various application domains, such
as natural language processing, congfiuration, databases, and bio-medical
ontologies, but their most notable success so far is due to the fact that DLs provide
the logical underpinning of OWL, the standard ontology language for the
semantic web [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. As a consequence of this standardization, several ontology editors
support OWL [
        <xref ref-type="bibr" rid="ref10 ref8 ref9">9, 10, 8</xref>
        ], and ontologies written in OWL are employed in more
and more applications. As the size of these ontologies grows, tools that
support improving their quality become more important. The tools available until
now use DL reasoning to detect inconsistencies and to infer consequences, i.e.,
implicit knowledge that can be deduced from the explicitly represented
knowledge. There are also promising approaches that allow to pinpoint the reasons
for inconsistencies and for certain consequences, and that help the ontology
engineer to resolve inconsistencies and to remove unwanted consequences [
        <xref ref-type="bibr" rid="ref13 ref7">13, 7</xref>
        ].
These approaches address the quality dimension of soundness of an ontology,
both within itself (consistency) and w.r.t. the intended application domain (no
unwanted consequences). In the present paper, we are concerned with a different
quality dimension: completeness. We provide a basis for formally well-founded
techniques and tools that support the ontology engineer in checking whether an
ontology contains all the relevant information about the application domain, and
to extend the ontology appropriately if this is not the case.
      </p>
      <p>A DL knowledge base (nowadays often called ontology) usually consists of
two parts, the terminological part (TBox), which denfies concepts and also states
? Supported by DFG (GRK 334/3) and the EU (IST-2005-7603 FET project TONES
and NoE 507505 Semantic Mining).
additional constraints (so-called general concept inclusions, GCIs) on the
interpretation of these concepts, and the assertional part (ABox), which describes
individuals and their relationship to each other and to concepts. Given an
application domain and a DL knowledge base (KB) describing it, we can ask whether
the KB contains all the relevant information about the domain: Are all the
relevant constraints that hold between concepts in the domain captured by the
TBox? Are all the relevant individuals existing in the domain represented in the
ABox?</p>
      <p>
        As an example, consider the OWL ontology for human protein phosphatases
that has been described and used in [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. This ontology was developed based on
information from peer-reviewed publications. The human protein phosphatase
family has been well characterised experimentally, and detailed knowledge about
different classes of such proteins is available. This knowledge is represented in the
terminological part of the ontology. Moreover, a large set of human phosphatases
has been identified and documented by expert biologists. These are described as
individuals in the assertional part of the ontology. One can now ask whether the
information about protein phosphatases contained in this ontology is complete.
Are all the relationships that hold among the introduced classes of phosphatases
captured by the constraints in the TBox, or are there relationships that hold
in the domain, but do not follow from the TBox? Are all possible kinds of
human protein phosphatases represented by individuals in the ABox, or are
there phosphatases that have not yet been included in the ontology or even not
yet been identiefid?
      </p>
      <p>Such questions cannot be answered by an automated tool alone. Clearly,
to check whether a given relationship between concepts—which does not follow
from the TBox—holds in the domain, one needs to ask a domain expert, and the
same is true for questions regarding the existence of individuals not described in
the ABox. The roˆle of the automated tool is to ensure that the expert is asked as
few questions as possible; in particular, she should not be asked trivial questions,
i.e., questions that could actually be answered based on the represented
knowledge. In the above example, answering a non-trivial question regarding human
protein phosphatases may require the biologist to study the relevant literature,
query existing protein databases, or even carry out new experiments. Thus, the
expert may be prompted to acquire new biological knowledge.</p>
      <p>
        Attribute exploration is an approach developed in Formal Concept Analysis
(FCA) [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] that is used to acquire knowledge about an application domain by
querying an expert. One of the earliest applications of this approach is described
in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], where the domain is lattice theory, and the goal of the exploration process
is to find, on the one hand, all valid relationships between properties of lattices
(like being distributive), and, on the other hand, to find counterexamples to all
the relationships that do not hold. To answer a query whether a certain
relationship holds, the lattice theory expert must either confirm the relationship (by
using results from the literature or carrying out a new proof for this fact), or give
a counterexample (again, by either finding one in the literature or constructing
a new one).
      </p>
      <p>
        Although this sounds very similar to what is needed in our context, we
cannot directly use this approach. The main reason is the open-world semantics of
description logic knowledge bases. In DLs, if we cannot deduce from the
knowledge base that an individual i is an instance of the concept C, we do not assume
that i belongs to ¬C. In contrast classical FCA assumes complete knowledge in
the sense that, whenever it is not explicitly mentioned that an object o has a
property p, we assume that o does not have p. There has been some work on how
to extend FCA and attribute exploration from complete knowledge to the case
of partial knowledge [
        <xref ref-type="bibr" rid="ref11 ref4">11, 4</xref>
        ]. However, this work is based on assumptions that
are different from ours. In particular, it assumes that the expert cannot answer
all queries and, as a consequence, the knowledge obtained after the exploration
process may still be incomplete. In contrast, our intention is to complete the
KB, i.e., in the end we want to have complete knowledge about these
relationships. What may be incomplete is the description of individuals used during the
exploration process.
      </p>
      <p>
        Due to space limitation, we introduce our variant of FCA that can deal
with the open-world semantics of DL knowledge bases only briefly. For a more
comprehensive description, we refer the reader to the long version of this paper
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] or to the technical report [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], which also contains full proofs of our results.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Exploring Partial Contexts</title>
      <p>
        In this section, we extend the classical approach to Formal Concept Analysis
(FCA), as described in detail in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], to the case of individuals (called objects
in FCA) that have only a partial description in the sense that, for some
properties (called attributes in FCA), it is not known whether they are satisefid by
the individual or not. The connection between this approach and the classical
approach is explained in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. In the following, we assume that we have a finite
set M of attributes and a (possibly infinite) set of objects.
      </p>
      <p>Definition 1. A partial object description (pod) is a tuple (A, S) where A, S ⊆
M are such that A ∩ S = ∅. We call such a pod a full object description (fod)
if A ∪ S = M . A set of pods is called a partial context and a set of fods a full
context.</p>
      <p>Intuitively, the pod (A, S) says that the object it describes satisfies all attributes
from A and does not satisfy any attribute from S. For the attributes not
contained in A ∪ S, nothing is known w.r.t. this object.</p>
      <p>Definition 2. We say that the pod (A0, S0) extends the pod (A, S), and write
this as (A, S) ≤ (A0, S0), if A ⊆ A0 and S ⊆ S0. Similarly, we say that the partial
context K0 extends the partial context K, and write this as K ≤ K 0, if every pod
in K is extended by some pod in K0. If K is a full context and K ≤ K, then K
is called a realizer of K. If (A, S) is a fod and (A, S) ≤ (A, S), then we also say
that (A, S) realizes (A, S).</p>
      <p>The following notion of implication formalizes the informal notion
“relationship between properties” used in the introduction.</p>
      <p>Definition 3. An implication is of the form L → R where L, R ⊆ M . This
implication is refuted by the pod (A, S) if L ⊆ A and R ∩ S 6= ∅. It is refuted
by the partial context K if it is refuted by at least one element of K. The set
of implications that are not refuted by a given partial context K is denoted by
Imp(K). The set of all fods that do not refute a given set of implications L is
denoted by Mod (L).</p>
      <p>For a set of implications L and a set P ⊆ M , the implicational closure of P with
respect to L, denoted by L(P ), is the smallest subset Q of M such that
– P ⊆ Q, and
– L → R ∈ L and L ⊆</p>
      <p>Q imply R ⊆</p>
      <p>Q.</p>
      <p>A set P ⊆</p>
      <p>M is called L-closed if L(P ) = P .</p>
      <p>Definition 4. The implication L → R is said to follow from a set J of
implications if R ⊆ J (L). The set of implications J is called complete for a set of
implications L if every implication in L follows from J . It is called sound for L
if every implication that follows from J is contained in L. A set of implications
J is called a base for a set of implications L if it is both sound and complete
for L, and no strict subset of J satisfies this property.</p>
      <p>The following is a trivial fact regarding the connection between partial
contexts and the implications they do not refute.</p>
      <p>Proposition 1. For a given set P ⊆ M and a partial context K, K(P ) :=
M \ S{S | (A, S) ∈ K, P ⊆ A} is the largest subset of M such that P → K(P )
is not refuted by K.</p>
      <p>
        Attribute exploration with partial contexts The classical attribute
exploration algorithm of FCA assumes that there is a domain expert that can
answer questions regarding the validity of implications in the application
domain. Accordingly, our approach requires an expert that can decide whether an
implication is refuted in the application domain or not. In contrast to existing
work on extending FCA to the case of partial knowledge [
        <xref ref-type="bibr" rid="ref11 ref4">11, 4</xref>
        ], we do not
assume that the expert has only partial knowledge and thus cannot answer all
implication questions.
      </p>
      <p>To be more precise, we consider the following setting. We are given an initial
(possibly empty) partial context K, an initially empty set of implications L, and
a full context K that is a realizer of K. The expert answers implication questions
“L → R?” w.r.t. the full context K. More precisely, if the answer is “yes,” then K
does not refute L → R. The implication L → R is then added to L. Otherwise,
the expert extends the current context K such that the extended context refutes
L → R and still has K as a realizer. Consequently, the following invariant will be
satisfied by K, K, L: K ≤ K ⊆ Mod (L). Our aim is to enrich K and L such that
eventually L is not only sound, but also complete for Imp(K), and K refutes all
other implications (i.e., all the implications refuted by K). As in the classical
case, we want to do this by asking as few as possible questions to the expert.
Definition 5. Let L be a set of implications and K a partial context. An
implication is called undecided w.r.t. K and L if it neither follows from L nor is
refuted by K. It is decided w.r.t. K and L if it is not undecided w.r.t. K and L.
In principle, our attribute exploration algorithm tries to decide each undecided
implications by either adding it to L or extending K such that it refutes the
implication. If all implications are decided, then our goal is achieved.
Proposition 2. Assume that K ≤ K ⊆ Mod (L) and that all implications are
decided w.r.t. K and L. Then L is complete for Imp(K) and K refutes all
implications not belonging to Imp(K).</p>
      <p>How can we find—and let the expert decide—all undecided implications
without considering all implications? The following proposition motivates why it is
sufficient to consider implications whose left-hand sides are L-closed.
Proposition 3. Let L be a set of implications and L → R an implication. Then,
L → R follows from L iff L(L) → R follows from L.</p>
      <p>
        Concerning right-hand sides, Proposition 1 says that the largest right-hand
side R such that L → R is not refuted by K is R = K(L). Putting these
two observations together, we only need to consider implications of the form
L → K(L) where L is L-closed. In order to enumerate all relevant left-hand sides,
we can thus use the well-known approach from FCA for enumerating closed sets
in the lectic order [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>Definition 6. Assume that M = {m1, . . . , mn} and fix some linear order m1 &lt;
m2 &lt; · · · mn on M . The lectic order &lt; is defined as follows: for mi ∈ M
and A, B ⊆ M we define A &lt;i B iff mi ∈ B \ A and A ∩ {m1, . . . , mi− 1} =
B ∩ {m1, . . . , mi− 1}. The order &lt; is the union of the orders &lt;i.
Obviously, &lt; extends the strict subset order, and thus ∅ is the smallest and M
the largest set w.r.t. &lt;.</p>
      <p>
        Proposition 4. Given a set of implications L and an L-closed set A ( M , the
next L-closed set following A in the lectic order is L((A∩{m1, . . . , mj− 1})∪{mj })
where j is maximal such that A &lt;j L((A ∩ {m1, . . . , mj− 1}) ∪ {mj }.
In [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], an extension of the usual attribute exploration algorithm that is based
on this idea is described. Here, we only give in detail the instantiation used to
complete DL KBs (see Algorithm 1 in the next section).
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Completing DL Knowledge Bases</title>
      <p>
        In order to represent knowledge about an application domain using Description
Logics (DLs) (see [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] for more details and references), one usually first defines the
relevant concepts of this domain, and then describes relationships between
concepts and between individuals and concepts in the knowledge base. To construct
concepts, one starts with a set NC of concept names (unary predicates) and a set
Name of constructor
negation
conjunction
      </p>
      <p>¬C Δ I \ CI</p>
      <p>C u D CI ∩ DI
general concept inclusion C v D CI ⊆ DI</p>
      <p>NR of role names (binary predicates), and builds complex concept descriptions
out of them by using the concept constructors provided by the particular
description language being used. In addition, a set NI of individual names is used
to refer to domain elements. In this paper, we do not fix a specicfi set of
constructors, we only assume that the constructors conjunction and negation (see
the upper part of Table 1) are available. A TBox is a finite set of general concept
inclusions (GCIs), and an ABox is a nfiite set of concept and role assertions (see
the lower part of Table 1). A knowledge base (KB) consists of a TBox together
with an ABox. The semantics of concept descriptions, TBoxes, and ABoxes is
given in terms of an interpretation I = (Δ I , · I ), where Δ I (the domain) is a
nonempty set, and · I (the interpretation function) maps each concept name A ∈ NC
to a set AI ⊆ Δ I , each role name r ∈ NR to a binary relation rI ⊆ Δ I × Δ I ,
and each individual name a ∈ NI to an element aI ∈ Δ I . Concept descriptions
C are also interpreted as sets CI ⊆ Δ I , which are defined inductively, as seen in
the semantics column of Table 1 for the constructors conjunction and negation.
An interpretation I is a model of the TBox T (the ABox A) if it satisfies all its
GCIs (assertions) in the sense shown in the semantics column of the table. In
case I is a model of both T and A, it is also called a model of the knowledge
base (T , A). If there is such a model, we call the KB consistent.</p>
      <p>Given a KB (T , A), concept descriptions C, D, and an individual name a,
the inference problems subsumption and instance are denfied as follows: C is
subsumed by D w.r.t. T (C vT D) if CI ⊆ DI holds for all models I of T ; and
a is an instance of C w.r.t. T and A (T , A |= C(a)) if aI ∈ CI holds for all
models of (T , A). For most DLs, these problems are decidable, and there exist
highly optimized DL reasoners such as FaCT, Racer, and Pellet that can solve
these problems for very expressive DLs on large practical KBs.</p>
      <p>Our approach for completing DL knowledge bases applies to arbitrary DLs,
provided that the description language allows at least for conjunction and
negation, the TBox formalism for GCIs, the ABox formalism for concept assertions,
and the subsumption and the instance problem are decidable.</p>
      <p>DLs and partial contexts Let (T , A) be a consistent DL knowledge base,
and M be a nfiite set of concept descriptions. An individual name a
occurring in A gives rise to the partial object description pod T ,A(a, M ) := (A, S)
where A := {C ∈ M | T , A |= C(a)} and S := {C ∈ M | T , A |= ¬C(a)},
and the whole ABox induces the partial context KT ,A(M ) := {pod T ,A(a, M ) |
a an individual name in A}. Note that pod T ,A(a, M ) is indeed a pod since (T , A)
was assumed to be consistent. Similarly, any element d ∈ Δ I of an
interpretation I gives rise to the full object description fod I (d, M ) := (A, S) where
A := {C ∈ M | d ∈ CI } and S := {C ∈ M | d ∈ (¬C)I }, and the whole
interpretation induces the full context KI (M ) := {fod I (d, M ) | d ∈ Δ I }.
KT 0,A0 (M ) ≤ K I (M ).</p>
      <p>Proposition 5. Let (T , A), (T 0, A0) be DL KBs such that T ⊆ T 0 and A ⊆ A 0,
M a set of concept descriptions, and I a model of (T 0, A0). Then KT ,A(M ) ≤
Next, we straightforwardly transfer the notion of refutation of an implication
from partial (full) contexts to knowledge bases (interpretations).
Definition 7. The implication L → R over the attributes M is refuted by the
knowledge base (T , A) if it is refuted by KT ,A(M ), and it is refuted by the
interpretation I if it is refuted by KI (M ). If an implication is not refuted by I,
then we say that it holds in I. In addition, we say that L → R follows from T if
uL vT uR, where uL and uR respectively stand for the conjunctions dC∈L C
and dD∈R D.</p>
      <p>Obviously, the implication L → R holds in I iff ( uL)I ⊆ (uR)I . As an immediate
consequence of this fact, we obtain:
Proposition 6. Let T be a TBox and I be a model of T . If L → R follows
from T , then it holds in I.</p>
      <p>Completion of DL KBs: formal definition and algorithm We are now
ready to define what we mean by a completion of a DL knowledge base.
Intuitively, the knowledge base is supposed to describe an intended model. For a xfied
set M of “interesting” concepts, the knowledge base is complete if it contains all
the relevant knowledge about implications between these concepts. To be more
precise, if an implication holds in the intended interpretation, then it should
follow from the TBox, and if it does not hold in the intended interpretation,
then the ABox should contain a counterexample.</p>
      <p>Definition 8. Let (T , A) be a consistent DL knowledge base, M a finite set of
concept descriptions, and I a model of (T , A). Then (T , A) is M -complete (or
complete if M is clear from the context) w.r.t. I if the following three statements
are equivalent for all implications L → R over M :
1. L → R holds in I;
2. L → R follows from T ;
3. L → R is not refuted by (T , A).</p>
      <p>A0 ⊆ A .</p>
      <p>Let (T0, A0) be a DL knowledge base and I a model of (T0, A0). Then (T , A) is
a completion of (T0, A0) if it is complete and extends (T0, A0), i.e., T0 ⊆ T and</p>
      <p>We can now describe an instance of attribute exploration for partial contexts
that computes a completion of a given knowledge base (T0, A0) w.r.t. a fixed
model I. We assume that the expert has or can obtain enough information
Algorithm 1 Completion of DL knowledge bases
{attribute set; KB with model I}
1: Input: M = {m1, . . . , mn}, (T0, A0)
2: T := T0, A := A0
3: L := ∅
4: P := ∅
5: while P 6= M do
6: Compute KT ,A(P )
7: if P 6= KT ,A(P ) then {check whether the implication follows from T }
8: if uP vT uKT ,A(P ) then
9: L := L ∪ {P → KT ,A(P ) \ P }
10: Pnew := L((P ∩ {m1, . . . , mj− 1}) ∪ {mj}) for the max. j that satisfies
P &lt;j L((P ∩ {m1, . . . , mj− 1}) ∪ {mj})</p>
      <p>{initial empty set of implications}
{lectically smallest L-closed subset of M }
{extend the ABox}
{P not changed}
about this model to be able to answer questions of the form “Is L → R refuted
by I?”. If the answer is “no,” then L → R holds according to the expert’s
opinion, and is thus added to the implication base computed by the algorithm.
In addition, the GCI uL v uR is added to the TBox. Since L → R is not refuted
by I, the interpretation I is still a model of the new TBox obtained this way.
If the answer is “yes,” then the expert is asked to extend the current ABox (by
adding appropriate assertions on either old or new individual names) such that
the extended ABox refutes L → R and I is still a model of this ABox. Because of
Proposition 6, before actually asking the expert whether the implication L → R
is refuted by I, we can first check whether uL v uR already follows from the
current TBox. If this is the case, then we know that L → R cannot be refuted
by I. This completion algorithm for DL knowledge bases is described in more
detail in Algorithm 1.</p>
      <p>Theorem 1. Let (T0, A0) be a consistent knowledge base, M a finite set of
concept descriptions, and I a model of (T0, A0), and let (T , A) be the knowledge
base computed by Algorithm 1. Then (T , A) is a completion of (T0, A0).
4</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>
        We have extended the attribute exploration algorithm from FCA to partial
contexts, and have shown how the extended algorithm can be used to complete
DL knowledge bases, using both DL reasoning and answers given by a domain
expert. This algorithm inherits its complexity from “classical” attribute
exploration [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]: in the worst case, which occurs if there are few or many relationships
between attributes, it is exponential in the number of attributes. Regarding the
number of questions asked to the expert, it easily follows from results shown in
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] that our method asks the minimum number of questions with positive
answers. For the questions with negative answers, the behaviour depends on the
answers given by the expert: FCA-theory implies that there always exist
counterexamples that, if taken in each step, ensure a minimal number of questions
with negative answers. In general, however, one cannot assume that the expert
provides these “best” counterexamples.
      </p>
      <p>
        Based on the results presented in the previous two sections, we have
implemented a rfist experimental version of a tool for completing DL knowledge bases
as an extension of the ontology editor Swoop [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], which uses the system Pellet
as underlying reasoner [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. We have just started to evaluate our tool on the
OWL ontology for human protein phosphatases mentioned in the introduction,
with biologists as experts, and hope to get first signicfiant results on its
usefulness and performance in the near future. Unsurprisingly, we have observed that
the experts sometimes make errors when answering implication questions. Hence
we will extend the completion tool such that it supports detecting such errors
and also allows to correct errors without having to restart the exploration from
scratch.
      </p>
      <p>
        From a theoretical point of view, we will also look at extensions of our
definition of a complete KB. As a formalization of what “all relationships between
interesting concepts” really means, we have used subsumption relationships
between conjunctions of elements of the set of interesting concepts M . One could
also consider more complex relationships by fixing a specicfi DL D, and then
taking, as attributes, all D-concept descriptions over the concept “names” from
M . The immediate disadvantage of this extension is that, in general, the set of
attributes becomes infinite, and thus termination of the exploration process is
no longer guaranteed. An extension of classical attribute exploration (i.e., for
full contexts) in this direction is described in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The main idea to deal with
the problem of an innfiite attribute set used there is to restrict the attention to
concept descriptions with a bounded role depth. But even though this makes the
attribute set nfiite, its size is usually too large for practical purposes.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Calvanese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>McGuinness</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Nardi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P. F.</given-names>
            <surname>Patel-</surname>
          </string-name>
          Schneider, editors.
          <source>The Description Logic Handbook: Theory</source>
          , Implementation, and
          <string-name>
            <surname>Applications</surname>
          </string-name>
          . Cambridge University Press,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ganter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Sertkaya</surname>
          </string-name>
          .
          <article-title>Completing description logic knowledge bases using formal concept analysis</article-title>
          .
          <source>LTCS-Report LTCS-06-02</source>
          , Chair for Automata Theory, Inst. for Theoretical Computer Science, TU Dresden, Germany,
          <year>2006</year>
          . See http://lat.inf.tu-dresden.de/research/reports.html.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ganter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Sertkaya</surname>
          </string-name>
          .
          <article-title>Completing description logic knowledge bases using formal concept analysis</article-title>
          .
          <source>In Proc. of the Twentieth Int. Joint Conf. on Artificial Intelligence (IJCAI'07)</source>
          . AAAI Press,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>P.</given-names>
            <surname>Burmeister</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Holzer</surname>
          </string-name>
          .
          <article-title>Treating incomplete knowledge in formal concept analysis</article-title>
          .
          <source>In Formal Concept Analysis</source>
          , vol.
          <volume>3626</volume>
          <source>of LNCS</source>
          , pages
          <fpage>114</fpage>
          -
          <lpage>126</lpage>
          . Springer,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>B.</given-names>
            <surname>Ganter</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Wille</surname>
          </string-name>
          .
          <source>Formal Concept Analysis: Mathematical Foundations</source>
          . Springer, Berlin, Germany,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>I.</given-names>
            <surname>Horrocks</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. F.</given-names>
            <surname>Patel-Schneider</surname>
          </string-name>
          , and
          <string-name>
            <surname>F. van Harmelen. From SHIQ</surname>
          </string-name>
          and
          <article-title>RDF to OWL: the making of a web ontology language</article-title>
          .
          <source>Journal of Web Semantics</source>
          ,
          <volume>1</volume>
          (
          <issue>1</issue>
          ):
          <fpage>7</fpage>
          -
          <lpage>26</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          , E. Sirin, and
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          .
          <article-title>Repairing unsatisfiable concepts in OWL ontologies</article-title>
          .
          <source>The Semantic Web: Research and Applications. Proc. of the 3rd European Semantic Web Conf. (ESWC</source>
          <year>2006</year>
          ), vol.
          <volume>4011</volume>
          <source>of LNCS</source>
          , pages
          <fpage>170</fpage>
          -
          <lpage>184</lpage>
          . Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Sirin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Hendler</surname>
          </string-name>
          .
          <article-title>Swoop: A web ontology editing browser</article-title>
          .
          <source>Journal of Web Semantics</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ):
          <fpage>144</fpage>
          -
          <lpage>153</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>H.</given-names>
            <surname>Knublauch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. W.</given-names>
            <surname>Fergerson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>The proeteg´´ OWL plugin: An open development environment for semantic web applications</article-title>
          .
          <source>Int. Semantic Web Conf.</source>
          , vol.
          <volume>3298</volume>
          <source>of LNCS</source>
          , pages
          <fpage>229</fpage>
          -
          <lpage>243</lpage>
          . Springer,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>D.</given-names>
            <surname>Oberle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Volz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Staab</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Motik</surname>
          </string-name>
          .
          <article-title>An extensible ontology software environment</article-title>
          .
          <source>Handbook on Ontologies, Int. Handbooks on Information Systems</source>
          , pages
          <fpage>299</fpage>
          -
          <lpage>320</lpage>
          . Springer,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Obiedkov</surname>
          </string-name>
          .
          <article-title>Modal logic for evaluating formulas in incomplete contexts</article-title>
          .
          <source>In Proc. of the 10th Int. Conf. on Conceptual Structures</source>
          ,
          <source>(ICCS</source>
          <year>2002</year>
          ), vol.
          <volume>2393</volume>
          <source>of LNCS</source>
          , pages
          <fpage>314</fpage>
          -
          <lpage>325</lpage>
          . Springer,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>S.</given-names>
            <surname>Rudolph</surname>
          </string-name>
          . Exploring relational structures via
          <source>F LE. 12th Int. Conf. on Conceptual Structures (ICCS</source>
          <year>2004</year>
          ), vol.
          <volume>3127</volume>
          <source>of LNCS</source>
          , pages
          <fpage>196</fpage>
          -
          <lpage>212</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>S.</given-names>
            <surname>Schlobach</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Cornet</surname>
          </string-name>
          .
          <article-title>Non-standard reasoning services for the debugging of description logic terminologies</article-title>
          .
          <source>Proc. of the Eighteenth Int. Joint Conf. on Artificial Intelligence (IJCAI'03)</source>
          , pages
          <fpage>355</fpage>
          -
          <lpage>362</lpage>
          . Morgan Kaufmann,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>E.</given-names>
            <surname>Sirin</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          .
          <article-title>Pellet: An OWL DL reasoner</article-title>
          .
          <source>In Proc. of the 2004 Int. Workshop on Description Logics (DL2004)</source>
          , vol.
          <volume>104</volume>
          <source>of CEUR Workshop Proc.. CEUR-WS.org</source>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>R.</given-names>
            <surname>Wille</surname>
          </string-name>
          .
          <article-title>Restructuring lattice theory: An approach based on hierarchies of concepts</article-title>
          .
          <source>Ordered Sets</source>
          , pages
          <fpage>445</fpage>
          -
          <lpage>470</lpage>
          . Reidel, Dordrecht-Boston,
          <year>1982</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>K.</given-names>
            <surname>Wolstencroft</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Brass</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Horrocks</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. W.</given-names>
            <surname>Lord</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Turi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>A little semantic web goes a long way in biology</article-title>
          .
          <source>In Proc. of the 4th Int. Semantic Web Conf. (ISWC</source>
          <year>2005</year>
          ), vol.
          <volume>3729</volume>
          <source>of LNCS</source>
          , pages
          <fpage>786</fpage>
          -
          <lpage>800</lpage>
          . Springer,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>