<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>OntoComP System Description</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Bar s Sertkaya ?</string-name>
          <email>sertkaya@tcs.inf.tu-dresden.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Theoretical Computer Science</institution>
          ,
          <addr-line>TU Dresden</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We describe OntoComP, a Protege 4 plugin that supports knowledge engineers in completing DL-based ontologies. More precisely, OntoComP supports a knowledge engineer in checking whether an ontology contains all the relevant information about the application domain, and in extending the ontology appropriately if this is not the case. It acquires complete knowledge about the application domain efciently by asking successive questions to the knowledge engineer. By using novel techniques from Formal Concept Analysis, it ensures that, on the one hand, the interaction with the knowledge engineer is kept to a minimum, and, on the other hand, the resulting ontology is complete in a certain well-de ned sense.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Since the standardization of OWL as the ontology language for the
Semantic Web [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], several ontology editors now support OWL [
        <xref ref-type="bibr" rid="ref11 ref12">12, 11</xref>
        ], and ontologies
written in OWL are employed in more and more applications in various domains.
As the number and size of these ontologies grow, tools that support improving
and maintaining their quality become more important. The tools available
until now mostly deal with detecting inconsistencies and inferring consequences,
i.e., implicit knowledge that can be deduced from the knowledge explicitly
represented in the ontology. There are also promising approaches that allow to
pinpoint the reasons for inconsistencies and for certain unwanted consequences.
These approaches address the quality dimension of soundness of an ontology,
both within itself (consistency) and w.r.t. the intended application domain (no
unwanted consequences). In our previous work [
        <xref ref-type="bibr" rid="ref15 ref2">2, 15</xref>
        ], we have considered a
different quality dimension, namely completeness of the knowledge in an ontology.
We have provided a formally well-founded technique called ontology completion,
that supports the ontology engineer in checking whether an ontology contains
all the relevant information about the application domain, and in extending the
ontology appropriately if this is not the case. In ontology completion, given an
application domain and a DL-based ontology describing it, we are interested in
checking whether all relevant constraints that hold between concepts in the
domain are captured by the TBox, and whether all relevant individuals existing in
the domain are represented in the ABox.
? Supported by German Research Foundation (DFG) under grant BA 1122/12-1
      </p>
      <p>Clearly, these questions cannot be answered by an automated tool alone. In
order to check whether a given relationship between concepts|which does not
already follow from the TBox|holds in the domain, one needs to ask a domain
expert, and the same is true for questions regarding the existence of individuals
not described in the ABox. The role of the ontology completion tool here is
to ensure that the expert is asked as few questions as possible; in particular,
she should not be asked trivial questions, i.e., questions that could actually be
answered based on the represented knowledge.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Motivating example</title>
      <p>
        As an example of how ontology completion supports the ontology engineer in
practice, consider the OWL ontology for human protein phosphatases that has
been described and used in [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. This ontology was developed based on
information from peer-reviewed publications. The human protein phosphatase family
has been well characterised experimentally, and detailed knowledge about
different classes of such proteins is available. This knowledge is represented in the
terminological part of the ontology. Moreover, a large set of human phosphatases
has been identi ed and documented by expert biologists. These are described
as individuals in the assertional part of the ontology. One can now ask whether
the information about protein phosphatases contained in this ontology is
complete. That is, are all the relationships that hold among the introduced classes of
phosphatases captured by the constraints in the TBox, or are there relationships
that hold in the domain, but do not follow from the TBox? Are all possible kinds
of human protein phosphatases represented by individuals in the ABox, or are
there phosphatases that have not yet been included in the ontology or even not
yet been identi ed?
      </p>
      <p>Clearly, these questions need to be answered by a biologist. In this
example, answering a non-trivial question regarding human protein phosphatases
may require the biologist to study the relevant literature, query existing
protein databases, or even to carry out new experiments. Thus, the expert may be
prompted to acquire new biological knowledge.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Ontology Completion</title>
      <p>
        The key technologies lying under ontology completion are Description Logic
reasoning, and the attribute exploration method developed in Formal Concept
Analysis (FCA) [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. FCA is a eld of applied mathematics that aims to formalize
the notions of a concept and a conceptual hierarchy by means of mathematical
tools. It is used for conceptual data analysis and knowledge processing. Attribute
exploration is a knowledge acquisition method of FCA that is used to acquire
complete knowledge about an application domain by asking successive questions
to a domain expert. In [
        <xref ref-type="bibr" rid="ref15 ref2">2, 15</xref>
        ] we have presented an adaptation of this method
for completing a DL knowledge base w.r.t. a xed model. It assumes the
existence of a domain expert that has (or can obtain) enough information about an
application domain I to be able to answer implication questions of the form \Is
L ! R refuted by I? ", where L and R are sets of concept names from the given
ontology. We say that an individual refutes such an implication question if it is
an instance of all concepts in L, and it is an instance of the complement of at
least one concept in R. Accordingly, we say that a domain (an ABox) refutes an
implication if it contains an individual (instance) that refutes this implication
question. Given a DL knowledge base (T0; A0), and a model I of this knowledge
base that is a formal representation of the application domain, our completion
algorithm successively asks questions of the above form. If the expert answers
\no", then L ! R is not refuted by I according to the expert's opinion, and
thus the GCI uL v uR is added to the current TBox, and the knowledge base is
reclassi ed. Since L ! R is not refuted by I, the interpretation I is still a model
of the new TBox obtained this way. If the expert answers \yes", then according
to the expert's opinion there exists an individual that refutes this question. The
expert is asked to extend the current ABox (by adding appropriate assertions on
either old or new individual names) such that the extended ABox refutes L ! R
and I is still a model of this ABox. Upon extension of the ABox, the knowledge
base is reclassi ed and the process continues with the next implication question
that does not follow from T and that is not refuted by A. Once all such questions
are answered in this way the knowledge base is complete in a certain well-de ned
sense [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        It is possible to optimize this algorithm by employing DL reasoning. Before
actually asking the expert whether the implication L ! R is refuted by I, we
can rst check whether uL v uR already follows from the current TBox. If this
is the case, then we know that L ! R cannot be refuted by I. Similarly, there
are also cases where an implication can be rejected without asking the expert
because accepting it would make the knowledge base inconsistent. However, in
this case the expert still needs to extend the ABox such that the implication is
refuted. The following example illustrates this case, which was not taken into
account in the original version of the completion algorithm in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
Example 1. Consider the knowledge base (T ; A) with the empty TBox T = ;,
and the ABox A = f(9r:A u 8r::B)(a)g. Clearly, the implication fAg ! fBg
does not follow from T . Moreover, it is not refuted by A because this ABox does
not explicitly contain a named individual that is an instance of both A and :B.
That is, the implication fAg ! fBg will be asked to the expert at some step
during the execution of the algorithm. If the user accepts this implication, and
thus the GCI A v B is added to T , the knowledge base will become inconsistent
since the assertion in A enforces the existence of an implicit individual that
belongs to both A and :B. This shows that this GCI cannot hold in the intended
model I of (T ; A).
      </p>
      <p>
        An improved version of the completion algorithm that takes this case into
account has been given in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Whenever a new implication question L ! R that
does not already follow from the TBox is generated, before asking the expert
this algorithm checks whether addition of the GCI uL v uR will make the TBox
inconsistent. If this is the case, it directly asks the expert to provide a
counterexample to L ! R. For details of this algorithm the reader is referred to [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In the
following we demonstrate the execution of this algorithm on a small knowledge
base about countries and some of their properties where the intended model I
is the \real world".
      </p>
      <p>Example 2. Assume our knowledge base de nes a coastal country as a country
that has a border to a sea or an ocean; a Mediterranean country as a country that
has border to the Mediterranean Sea; a German-speaking country as a country
that has the language German as an o cial language; and an EU member as a
Acountries Coastal Mediterranean EUmember GermanSpeaking</p>
      <p>Italy</p>
      <p>India
Germany
Austria
+
+
+
+
+
+
+
+
?
country that is a member of the EU.</p>
      <p>Tcountries := f Coastal</p>
      <p>EUmember</p>
      <p>Mediterranean
GermanSpeaking</p>
      <p>Country u 9hasBorderTo:(Ocean t Sea)
Country u 9isMemberOf:fEUg
Country u 9hasBorderTo:fMediterraneanSeag</p>
      <p>Country u 9hasO cialLanguage:fGermang g</p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref19 ref20">20, 19</xref>
        ] Volker and Rudolph have worked on a method that is similar to
our method. They have also combined DL reasoning with FCA for ontology
re nement, and developed a tool for this purpose. The di erence of this work to
ours is that, there the main aim is acquiring domain-range restrictions.
      </p>
      <p>Coastal Mediterranean EUmember GermanSpeaking
Italy</p>
      <p>India
Germany</p>
      <p>Austria
Switzerland</p>
      <p>Turkey
+
+
+
+
+
+
+
+
+
+
+
+</p>
    </sec>
    <sec id="sec-4">
      <title>Detecting errors and recovery from errors</title>
      <p>Based on the approach described in the previous section, we had implemented
a rst experimental version of a DL knowledge base completion tool. Our
experiments with this tool showed that during completion the expert sometimes
makes errors. For better usability of the completion procedure, it is important
to support the expert in detecting and correcting these errors.</p>
      <sec id="sec-4-1">
        <title>Detecting Errors</title>
        <p>
          We say that the expert makes an error if he extends the knowledge base such
that it no longer has the intended model I as its model. Since the procedure
has no direct access to I, in general it cannot detect such errors without help
from the expert. The only case where the procedure can automatically detect
that an error has occurred is when the knowledge base becomes inconsistent.
Obviously, the intended model I cannot be a model of an inconsistent KB.
However, when an inconsistency is detected by DL reasoning, then it is not
clear at which stage the actual error was made. In fact, although only the last
extension of the knowledge base has made it inconsistent, the deviation from
what holds in I may have occurred in a previous step. Pinpointing [
          <xref ref-type="bibr" rid="ref10 ref13 ref14 ref3 ref5">14, 10, 13, 3,
5</xref>
          ] can be used to compute all minimal subsets of the knowledge base that are
already inconsistent, and thus help the expert to nd the place where the error
was made. But in the end, the expert needs to tell the completion tool which
are the erroneous assertions and/or GCIs.
        </p>
        <p>The expert may also be alerted by DL reasoning to errors in cases where the
knowledge base is not inconsistent. In fact, after each extension of the KB, the
DL reasoner re-classi es it, i.e., computes the implied subsumption and instance
relationships. If one of them contradicts the experts knowledge about I, she
also knows that an error has occurred. Again, pinpointing can show all minimal
subsets of the knowledge base from which this unintended consequence already
follows.</p>
      </sec>
      <sec id="sec-4-2">
        <title>Recovery from Errors</title>
        <p>Once the sources of the error are found, the next task is to correct it without
producing unnecessary extra work for the expert. Of course, one can just go back
to the step where the rst error was made, and continue the completion process
from there, this time with a correct answer. The problem with this simple
approach is that it throws away all the information about I that the expert has
added (by answering implication queries) after the rst error had occurred.
Consequently, the completion procedure may again pose implication queries whose
answer actually follows from this information. On the DL side, it is no
problem to keep those assertions and GCIs that really hold in I. More precisely, the
completion procedure can keep the GCIs and assertions for which the expert has
stated that they are not erroneous. In fact, our completion procedure allows for
arbitrary extensions of the KB as long as the KB stays a model of I.</p>
        <p>
          On the FCA side, it is less clear whether one can keep the implications that
have been added after the rst error had been made. In fact, since the new
(correct) answer di ers from the previous incorrect one, the completion procedure
may actually produce di erent implication questions. The proof of correctness of
the procedure, as given in [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ], strongly depends on the fact that implications are
enumerated in some speci c lexicographic order. Thus, if we change this order
the correctness of the completion algorithm will not be guaranteed any more.
In [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ] we have overcome this problem by using the previous answers of the expert
as \background knowledge" as mentioned in [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ], and shown that in this setting
the correctness of the algorithm is still guaranteed.
5
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>OntoComP</title>
      <p>
        Based on our results in [
        <xref ref-type="bibr" rid="ref15 ref2 ref4">2, 15, 4</xref>
        ], we have implemented an open-source ontology
completion tool called OntoComP1, which stands for Ontology Completion
Plugin. It is written in the Java programming language as a plugin for the
Protege 4 ontology editor [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. It communicates with the underlying DL reasoner
over the OWL API [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. OntoComP can easily be installed by just copying
the jar le provided on the project web page into the plugins directory of
an existing Protege 4 installation. Upon a new start Protege will nd the
OntoComP plugin and open a new tab for it.
      </p>
      <p>
        In order to complete an ontology with OntoComP, the user rst
classies the ontology with a reasoner that is supported by Protege 4, namely
FaCT++ [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] or Pellet [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Once the ontology is classi ed, the OntoComP
tab displays the class hierarchy on the left. At this point the user can drag
\interesting" class names, which she wants to have in the completion process, from
this hierarchy and drop them into the Context tab on the right. Simultaneously,
the instances of these classes will also be displayed in a table in the Context tab.
In this table a + in row a and column C means that the individual a is an intance
of the class C, a - means that a is an instance of the complement of C, and a
? means that nothing is known about the membership of a in class C. When
the user is done with selecting the relevant classes, she starts the completion by
hitting the Start button and sees the rst question in the Messages tab. If she
1 available under http://ontocomp.googlecode.com
con rms the question by hitting the Yes button, OntoComP comes up with
the next question. If she rejects the question by hitting No button OntoComP
opens the Counterexample editor tab where the user can generate a
counterexample to the rejected question. The process continues until all questions
have been answered by the user. During completion, at any time the user can
suspend the completion process and see her answering history. If she thinks she
has made an error at some point, she can repair it by undoing that particular
erroneous answer and can continue completion.
5.1
      </p>
      <sec id="sec-5-1">
        <title>Counterexample Generation.</title>
        <p>OntoComP has a counterexample editor for supporting the user during
counterexample generation. When the user rejects an implication, OntoComP opens
a counterexample editor in a new tab, and displays those individuals from the
ABox that can potentially be turned into a counterexample by adding
assertions for them. Alternatively, the user can introduce a new individual together
with assertions that make it a counterexample. During counterexample
generation, OntoComP guides the user and noti es her once she has created a valid
counterexample to the implication question.</p>
        <p>At any point during knowledge base completion, if the user notices that he has
made a mistake in one of the previous steps, he can stop the completion and
can request to see the history of all answers he has given. OntoComP displays
all the questions asked in previous steps, the answers that were given to these
questions, and the counterexamples accompanying negative answers. The user
can browse the answering history, correct the wrong answers he has given in
the previous steps, and can then continue completion. OntoComP keeps all
GCIs and counterexamples that were not marked as incorrect in the knowledge
base, i.e., after an error recovery it does not ask the user questions that he has
already answered. Pinpointing reasons for consequences (such as inconsistency or
unintended subsumption or instance relationships) is not directly integrated into
the current version of OntoComP. However, the user could use the pinpointing
facilities provided by Protege 4.
6</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Concluding remarks and future work</title>
      <p>
        We have recalled ontology completion, a method which we have introduced
previously in [
        <xref ref-type="bibr" rid="ref15 ref2">2, 15</xref>
        ], and described extensions of it for better usability. We have also
described an implementation of it, namely OntoComP, which is a plugin for
the Protege 4 ontology editor. We have described key technologies underlying
OntoComP, and discussed how OntoComP makes use of DL reasoning. We
have introduced further optimizations that have not taken place originally in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>Currently, our method only works for languages that allow for negation.
Negation is required while producing counterexamples. Due to increasing
popularity of lightweigt DLs like E L and E L+, in the future we want to support
knowledge bases written in these languages as well. In order to express that an
individual is a counterexample to an implication like L ! R, we need to say that
this individual is an instance of the negation of at least one concept in R. We can
overcome this limitation by introducing an additional concept name A for every
concept name A that takes part in completion, and making A and A disjoint.
While generating a counterexample, whever the user says that an individual is
an intance of :A, we assert that this individual is an instance of A.</p>
      <p>One other limitation of our method is that after each answer of the expert,
the knowlege base has to be reclassi ed, which can be time consuming for a big
real world ontology. In fact, when an expert wants to complete an ontology, she
is usually interested in a small fragment of it, and her answers do not necessarily
a ect the subsumption relations in other fragments of the ontology. Thus, before
completion one could in principle extract a module and work on it with our
completion method, and after completion \re-plug" this extended module into
the original ontology. As future work we are going to investigate this approach
and whether it leads to any improvement.</p>
      <p>On the practical side we are going to improve our implementation, especially
its user interface. Moreover, we are going to test and evaluate OntoComP on
large scale ontologies from real world applications.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ganter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Sertkaya</surname>
          </string-name>
          .
          <article-title>Completing description logic knowledge bases using formal concept analysis</article-title>
          .
          <source>LTCS-Report LTCS06-02</source>
          , Chair for Automata Theory, Institute for Theoretical Computer Science, Dresden University of Technology, Germany,
          <year>2006</year>
          . See http://lat.inf.tudresden.de/research/reports.html.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ganter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Sertkaya</surname>
          </string-name>
          , and
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Completing description logic knowledge bases using formal concept analysis</article-title>
          . In M. M. Veloso, editor,
          <source>Proceedings of the Twentieth International Joint Conference on Arti cial Intelligence (IJCAI'07)</source>
          , pages
          <fpage>230</fpage>
          {
          <fpage>235</fpage>
          . AAAI Press,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          , R. Pen~aloza, and
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Pinpointing in the description logic EL+</article-title>
          . In J. Hertzberg,
          <string-name>
            <given-names>M.</given-names>
            <surname>Beetz</surname>
          </string-name>
          , and R. Englert, editors,
          <source>Proceedings of the 30th German Conference on Arti cial Intelligence (KI2007)</source>
          , volume
          <volume>4667</volume>
          <source>of Lecture Notes in Arti cial Intelligence</source>
          , pages
          <fpage>52</fpage>
          {
          <fpage>67</fpage>
          . Springer-Verlag,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Sertkaya</surname>
          </string-name>
          .
          <article-title>Usability issues in description logic knowledge base completion</article-title>
          . In S. Ferre and S. Rudolph, editors,
          <source>Proceedings of the 7th International Conference on Formal Concept Analysis</source>
          ,
          <source>(ICFCA</source>
          <year>2009</year>
          ), volume
          <volume>5548</volume>
          <source>of Lecture Notes in Arti cial Intelligence</source>
          , pages
          <fpage>1</fpage>
          <lpage>{</lpage>
          21. Springer-Verlag,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Debugging SNOMED CT using axiom pinpointing in the description logic EL+</article-title>
          .
          <source>In Proceedings of the International Conference on Representing and Sharing Knowledge Using SNOMED (KR-MED'08)</source>
          , Phoenix, Arizona,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Volz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P. W.</given-names>
            <surname>Lord</surname>
          </string-name>
          .
          <article-title>Cooking the semantic web with the OWL API</article-title>
          . In D. Fensel,
          <string-name>
            <given-names>K. P.</given-names>
            <surname>Sycara</surname>
          </string-name>
          , and J. Mylopoulos, editors,
          <source>Proceedings of the Second International Semantic Web Conference</source>
          ,
          <source>(ISWC</source>
          <year>2003</year>
          ), volume
          <volume>2870</volume>
          of Lecture Notes in Computer Science, pages
          <volume>659</volume>
          {
          <fpage>675</fpage>
          . Springer-Verlag,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>B.</given-names>
            <surname>Ganter</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Wille</surname>
          </string-name>
          .
          <source>Formal Concept Analysis: Mathematical Foundations</source>
          . Springer-Verlag, Berlin, Germany,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Tsarkov</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Redmond</surname>
          </string-name>
          .
          <article-title>Supporting early adoption of OWL 1.1 with Protege-OWL and FaCT++</article-title>
          .
          <source>In Proceedings of the Second International Workshop OWL: Experiences and Directions (OWLED</source>
          <year>2006</year>
          ).
          <source>CEUR-WS</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>I.</given-names>
            <surname>Horrocks</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. F.</given-names>
            <surname>Patel-Schneider</surname>
          </string-name>
          , and
          <string-name>
            <surname>F. van Harmelen. From SHIQ</surname>
          </string-name>
          and
          <article-title>RDF to OWL: the making of a web ontology language</article-title>
          .
          <source>Journal of Web Semantics</source>
          ,
          <volume>1</volume>
          (
          <issue>1</issue>
          ):7{
          <fpage>26</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          , E. Sirin, and
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          .
          <article-title>Repairing unsatis able concepts in OWL ontologies</article-title>
          . In Y. Sure and J. Domingue, editors,
          <source>The Semantic Web: Research and Applications. Proceedings of the 3rd European Semantic Web Conference (ESWC</source>
          <year>2006</year>
          ), volume
          <volume>4011</volume>
          of Lecture Notes in Computer Science, pages
          <volume>170</volume>
          {
          <fpage>184</fpage>
          . Springer-Verlag,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Sirin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Hendler</surname>
          </string-name>
          .
          <article-title>Swoop: A web ontology editing browser</article-title>
          .
          <source>Journal of Web Semantics</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ):
          <volume>144</volume>
          {
          <fpage>153</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12. H.
          <string-name>
            <surname>Knublauch</surname>
            ,
            <given-names>R. W.</given-names>
          </string-name>
          <string-name>
            <surname>Fergerson</surname>
            ,
            <given-names>N. F.</given-names>
          </string-name>
          <string-name>
            <surname>Noy</surname>
            , and
            <given-names>M. A.</given-names>
          </string-name>
          <string-name>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>The protege OWL plugin: An open development environment for semantic web applications</article-title>
          . In S. A.
          <string-name>
            <surname>McIlraith</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Plexousakis</surname>
          </string-name>
          , and F. van Harmelen, editors,
          <source>Proceedings of the 3rd International Semantic Web Conference</source>
          ,
          <source>(ISWC</source>
          <year>2004</year>
          ), volume
          <volume>3298</volume>
          of Lecture Notes in Computer Science, pages
          <volume>229</volume>
          {
          <fpage>243</fpage>
          . Springer-Verlag,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. T. Meyer,
          <string-name>
            <given-names>K.</given-names>
            <surname>Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Booth</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. Z.</given-names>
            <surname>Pan</surname>
          </string-name>
          .
          <article-title>Finding maximally satis able terminologies for the description logic ALC</article-title>
          .
          <source>In Proceedings of the 21st Natonal Conference on Arti cial Intelligence (AAAI</source>
          <year>2006</year>
          ), pages
          <fpage>269</fpage>
          {
          <fpage>274</fpage>
          . AAAI Press/The MIT Press,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>S.</given-names>
            <surname>Schlobach</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Cornet</surname>
          </string-name>
          .
          <article-title>Non-standard reasoning services for the debugging of description logic terminologies</article-title>
          . In G. Gottlob and T. Walsh, editors,
          <source>Proceedings of the Eighteenth International Joint Conference on Arti cial Intelligence (IJCAI'03)</source>
          , pages
          <fpage>355</fpage>
          {
          <fpage>362</fpage>
          . Morgan Kaufmann,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>B.</given-names>
            <surname>Sertkaya</surname>
          </string-name>
          .
          <article-title>Formal Concept Analysis Methods for Description Logics</article-title>
          .
          <source>Ph.D. dissertation</source>
          , Institute of Theoretical Computer Science, TU Dresden, Germany,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>E.</given-names>
            <surname>Sirin</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          .
          <article-title>Pellet: An OWL DL reasoner</article-title>
          .
          <source>In Proceedings of the 2004 International Workshop on Description Logics (DL2004)</source>
          , volume
          <volume>104</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17. G. Stumme.
          <article-title>Attribute exploration with background implications and exceptions</article-title>
          . In H.
          <string-name>
            <surname>-H. Bock</surname>
          </string-name>
          and W. Polasek, editors,
          <source>Data Analysis and Information Systems. Statistical and Conceptual approaches. Proceedings of GfKl'95. Studies in Classication, Data Analysis, and Knowledge Organization</source>
          <volume>7</volume>
          , pages
          <fpage>457</fpage>
          {
          <fpage>469</fpage>
          .
          <string-name>
            <surname>SpringerVerlag</surname>
          </string-name>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <given-names>D.</given-names>
            <surname>Tsarkov</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Horrocks.</surname>
          </string-name>
          <article-title>FaCT++ description logic reasoner: System description</article-title>
          . In U. Furbach and N. Shankar, editors,
          <source>Proceedings of the International Joint Conference on Automated Reasoning (IJCAR</source>
          <year>2006</year>
          ), volume
          <volume>4130</volume>
          <source>of Lecture Notes in Arti cial Intelligence</source>
          , pages
          <fpage>292</fpage>
          {
          <fpage>297</fpage>
          . Springer-Verlag,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>J. Vo</surname>
          </string-name>
          <article-title>lker and</article-title>
          <string-name>
            <given-names>S.</given-names>
            <surname>Rudolph</surname>
          </string-name>
          .
          <article-title>Fostering web intelligence by semi-automatic OWL ontology re nement</article-title>
          .
          <source>In Proceedings of the 7th International Conference on Web Intelligence (WI)</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>J. Vo</surname>
          </string-name>
          <article-title>lker and</article-title>
          <string-name>
            <given-names>S.</given-names>
            <surname>Rudolph</surname>
          </string-name>
          .
          <article-title>Lexico-logical acquisition of OWL DL axioms - An integrated approach to ontology re nement</article-title>
          . In R. Medina and S. Obiedkov, editors,
          <source>Proceedings of the 6th International Conference on Formal Concept Analysis</source>
          ,
          <source>(ICFCA'08)</source>
          , volume
          <volume>4933</volume>
          <source>of Lecture Notes in Arti cial Intelligence</source>
          , pages
          <fpage>62</fpage>
          {
          <fpage>77</fpage>
          . Springer-Verlag,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <given-names>K.</given-names>
            <surname>Wolstencroft</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Brass</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Horrocks</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. W.</given-names>
            <surname>Lord</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Turi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>A little semantic web goes a long way in biology</article-title>
          .
          <source>In Proceedings of the 4th International Semantic Web Conference</source>
          ,
          <source>(ISWC</source>
          <year>2005</year>
          ), volume
          <volume>3729</volume>
          of Lecture Notes in Computer Science, pages
          <volume>786</volume>
          {
          <fpage>800</fpage>
          . Springer-Verlag,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>