<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The E LepHant Reasoner System Description</article-title>
      </title-group>
      <abstract>
        <p>We intoduce the ELepHant reasoner, a consequence-based reasoner for the EL+ fragment of DLs. We present optimizations, implementation details and experimental results for classi cation of several large bio-medical knowledge bases. In [6, 5] Brandt has shown that the tractability result in [1] for subsumption w.r.t. cyclic E L TBoxes can be extended to the DL E LH, which in addition to E L allows for general concept inclusion axioms and role hierarchies. Later in [2], Baader et. al. have shown that the tractability result can even be further extended to the DL E L++ which in addition to E LH allows for the bottom concept, nominals, role inclusion axioms, and a restricted form of concrete domains. In addition to these promising theoretical results, it turned out that despite their relatively low expressivity, these fragments are still expressive enough for the well-known bio-medical knowledge bases SNOMED [8] and (large parts of) Galen [19], and the Gene Ontology GO [7]. In [3, 4, 21] the practical usability of these fragments on large knowledge bases has been investigated. The CEL Reasoner [18] was as a result of these studies the rst reasoner that could classify the mentioned knowledge bases from the life sciences domain in reasonable times. Successful applications of the E L family increased investment in further work in this direction. The E L family now provides the basis for the pro le OWL2 EL1. Moreover, there are now several other reasoners speci cally tailored for the E L family, like Snorocket [16], TrOWL [22], CB [11] (which extends the E L++ algorithm to Horn SHIQ), JCEL [17] (which is a Java implementation of CEL) and ELK [12, 14, 13, 15] (which is currently the only reasoner that can classify large ontologies from real-life applications within only a few seconds). A comprehensive study comparing the performace of several reasoners on large biomedical knowledge bases has been presented in [9]. A more recent comparison can be found in the experimental results section of [15]. In the present paper we introduce the E LepHant reasoner,2 a consequencebased reasoner for the E L+ fragment of DLs. It is the successor of our prototype reasoner cheetah [20]. Our motivation to develop E LepHant is on the one hand 1 http://www.w3.org/TR/owl2-pro les/#OWL 2 EL 2 http://code.google.com/p/elephant-reasoner</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        push the performance of OWL EL reasoning further by investigating di erent
optimizations, and on the other hand provide a reasoner with a small footprint
that can be used on platforms with limited memory and computing capabilities
for applications like embedded reasoning [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>The paper is organized as follows: After describing the implementation
details, we present the results of our experiments for classi cation of large
ontologies from the biomedical domain. Although there is still room for improvements
like multithreading, the experimental results show that the performance is still
promising.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Implementation Details</title>
      <p>
        The E LepHant reasoner is the successor of the cheetah prototype [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. The
motivation for the cheetah prototype was to improve the worst-case complexity
of the E L+ classi cation algorithm by using the linear-closure algorithm from
databases. There we used a modi ed version of the linear-closure algorithm for
computing the closure of atomic concepts under the axioms of the knowledge
base, i.e., for saturating the knowledge base. For each concept name, we kept a
counter that is used to check whether it already satis es the left-hand side of an
axiom. The experimental results there showed that the overhead of this method
was too big compared to the performance gain.
      </p>
      <p>
        The E LepHant reasoner does not use this method. Instead, it implements
the consequence-based algorithm used in ELK [
        <xref ref-type="bibr" rid="ref12 ref15">12, 15</xref>
        ] with some small modi
cations. It di ers from ELK in the implementation of the inference rules, and in
scheduling of the input and derived axioms.
      </p>
      <p>
        As also pointed out in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], the most time consuming phase of
consequencebased classi ciation is the phase where the inference rules are applied for
saturating the knowledge base. Therefore it is important to optimize this phase for
getting a good performance. The original saturation algorithm uses a queue for
keeping the scheduled axioms. Our experiments showed that the queue
operations take a considerable amount of time since these operations are executed
millions of times for classifying large knowledge bases like SNOMED CT.
Removal from the front and addition at the back are indeed costly operations
compared to adding and removing on only one side since in the former case the
links to the next queue element have to be maintained properly. In order to
avoid this overhead, in E LepHant we keep the scheduled axioms in a stack. Our
experiments show that for some of the ontologies this results in a larger number
of derivations, but the overall performance becomes better. The performance
di erence between queue and stack processing is shown in Table 2.
      </p>
      <p>One other optimization that E LepHant implements is that it uses the told
subsumer information as input axioms for initializing the stack. For each concept
name A, instead of using axioms of type A v A as input, it uses A v B, where
B is a told subsumer of A.</p>
      <p>
        Apart from these basic optimizations, E LepHant also implements some of
the optimization techniques introduced in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. It implements the optimization
of rules for decomposing conjunctions and existential restrictions. More precisely,
it does not decompose a conjunction if it has been previously derived by
conjunction introduction. Similarly, if an existential restriction has previously been
derived via the existential introduction rule, it does not decompose this
existential restriction. Unlike ELK, when an existential restriction is decomposed,
E LepHant does not schedule a so-called init axiom, it directly schedules an
axiom with the ller of the existential on both sides. E LepHant does not yet
support concurrent reasoning, but it is planned for future versions.
      </p>
      <p>During saturation, we often need to do a lookup to check if a concept is
subsumed by another, or if an axiom has already been processed before, etc. For
such operations, we need an e cient data structure. Besides doing a lookup, we
also often need to insert new elements to these data structures, like adding a
new subsumer to the subsumers list, marking an axiom as processed, etc. But
we never delete elements from these data structures. We also sometimes need
to iterate over the elements of these data structures. For these operations, the
most appropriate data structure is a an associative array. As associative array
implementation, we used the Judy array library3 for C. The library is optimized
to avoid CPU cache misses as often as possible. Its memory consumption scales
smoothly with number of entries, even when the keys are sparsely distributed.</p>
      <p>For some of the data structures that are traversed often during saturation,
E LepHant keeps double indexes. For instance, the list of subsumers of a concept
is stored once as a conventional array and once as Judy array. If during saturation
we need to check whether a concept is subsumed by another, we do a lookup
in the Judy array. But if we need to traverse the subsumer list, for instance in
existential introduction rule, we use the conventional array.</p>
      <p>Just like its predecessor, the E LepHant reasoner is implemented in the C
programming language. The reason why cheetah was implemented in C is the
large amount of memory required by the algorithm that it implements. Due to the
large number of concept names and axioms in real-life ontologies, this algorithm
requires a large amount of memory and an e cient memory management. This
is why we chose C as the implementation language. Although the E LepHant
reasoner does not use this algorithm, large part of its code is based on the code
of the cheetah prototype.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Experimental Results</title>
      <p>In order to test the performance of E LepHant, we performed a series of
experiments on large biomedical knowledge bases from real-life applications. We used
the January 2013 international release of SNOMED CT by converting it to OWL
functional syntax by the converter provided. Additionally, we used 6 ontologies,
namely GO1, FMA, ChEBI, EMAP, Molecule Role and Galen 7 provided in the
test ontology suite on the ELK web page.4 We did not use the Galen8, GO2 and
Fly Anatomy ontologies provided there since they contain disjointness axioms,
3 http://judy.sourceforge.net
4 http://code.google.com/p/elk-reasoner
which is not yet supported by ELepHant. The metrics of the used ontologies are
shown in Table 1.</p>
      <p>In order to measure the e ects of optimizations described in Section 2, we
have run a series of experiments. The experiments were run on a computer with
Intel Core i3 processor with 2.1 GHz clock speed, 8 GB of main memory and
Linux operating system with 3.2.0 kernel. The results were obtained as average
of 5 runs per setting per ontology. We tested the performance gain obtained
by using a stack instead of a queue and performance gain obtained by
initializing the stack with told subsumer information. Runtimes in miliseconds, and
also total and unique number of derivations obtained from these experiments
are presented in Table 2. Test results for the setting where a queue is used are
marked with 'queue', results for the setting where a stack is used with 'stack' and
the results for setting where a stack is used and the stack is initialized with told
subsumer information is marked with 'stack+told'. The results show that except
for the EMAP and Molecule Role ontologies, using a stack improves the runtime
performance even if the number of total or unique derivations does not change.
This is due to the overhead of enqueue and dequeue operations compared to the
push and pop operations. It is also seen in the table that using the told
subsumer information for preparing the input axioms always improves the runtime
performance and reduces both the number of total and unique derivations.</p>
      <p>We have also run a series of tests for comparing the loading and classi cation
performances of ELepHant to that of ELK. We have run ELK 5 times for each
ontology with the -XX:+AggressiveHeap parameter and taken the average of
these runtimes. The results presented in Table 3 show that ELK classi es the
SNOMED CT ontology faster, but needs more time to load it compared to
ELepHant. For all smaller ontologies, both classi cation and loading times of
ELepHant are slightly shorter. We conjecture that this is due to the overhead
of starting the Java virtual machine. In terms of memory usage the performance
of ELepHant is quite good as well. For classifying SNOMED CT, the maximum
memory usage is around 420MB as the Linux top command shows. For ELK, it
is around 1.6GB with the aggressive heap option and around 1GB without this
option.</p>
      <p>classi cation time total derivations unique derivations</p>
    </sec>
    <sec id="sec-4">
      <title>Concluding Remarks and Future Work</title>
      <p>We have introduced the consequence-based E L+ reasoner E LepHant, described
implementation details and presented experimental results.</p>
      <p>Currently the E LepHant reasoner is still under heavy construction, and there
is a number of improvements that we plan to do as future work. First of all, we
are going to investigate the role of ordering derived axioms for reducing the
number of derivations. We are going to check whether this can be implemented
with a feasible overhead. We are going to implement concurrent reasoning in
order to further improve the performance. We are going to extend the supported
expressivity by allowing disjointness axioms. Last but not least, we are going
to implement an OWL API wrapper using the Java native interface in order to
make it compatible with ontology editors and other practical applications.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          .
          <article-title>Terminological cycles in a description logic with existential restrictions</article-title>
          . In G. Gottlob and T. Walsh, editors,
          <source>Proceedings of the 18th International Joint Conference on Arti cial Intelligence (IJCAI'03)</source>
          , pages
          <fpage>325</fpage>
          {
          <fpage>330</fpage>
          . Morgan Kaufmann,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Brandt</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Lutz</surname>
          </string-name>
          .
          <article-title>Pushing the EL envelope</article-title>
          . In L. P. Kaelbling and
          <string-name>
            <given-names>A.</given-names>
            <surname>Sa</surname>
          </string-name>
          otti, editors,
          <source>Proceedings of the Nineteenth International Joint Conference on Arti cial Intelligence</source>
          ,
          <source>(IJCAI 05)</source>
          , pages
          <fpage>364</fpage>
          {
          <fpage>369</fpage>
          . Professional Book Center,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lutz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Is tractable reasoning in extensions of the description logic EL useful in practice?</article-title>
          <source>In Proceedings of the Methods for Modalities Workshop (M4M-05)</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lutz</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Is tractable reasoning in extensions of the description logic EL useful in practice?</article-title>
          <source>In Journal of Logic</source>
          , Language and Information, Special Issue on Method for
          <source>Modality (M4M)</source>
          ,
          <year>2007</year>
          . To appear.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>S.</given-names>
            <surname>Brandt</surname>
          </string-name>
          .
          <article-title>On subsumption and instance problem in ELH w</article-title>
          .r.t.
          <article-title>general tboxes</article-title>
          . In V. Haarslev and R. Moller, editors,
          <source>Proceedings of the 2004 International Workshop on Description Logics, (DL2004)</source>
          , volume
          <volume>104</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>S.</given-names>
            <surname>Brandt</surname>
          </string-name>
          .
          <article-title>Polynomial time reasoning in a description logic with existential restrictions, GCI axioms</article-title>
          , and
          <article-title>- what else</article-title>
          ? In R. L. de Mantaras and L. Saitta, editors,
          <source>Proceedings of the 16th Eureopean Conference on Arti cial Intelligence</source>
          ,
          <source>(ECAI</source>
          <year>2004</year>
          ), pages
          <fpage>298</fpage>
          {
          <fpage>302</fpage>
          . IOS Press,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>T. G. O.</given-names>
            <surname>Consortium</surname>
          </string-name>
          .
          <article-title>Gene ontology: Tool for the uni cation of biology</article-title>
          .
          <source>Nature Genetics</source>
          ,
          <volume>25</volume>
          :
          <fpage>25</fpage>
          {
          <fpage>29</fpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>R.</given-names>
            <surname>Cote</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rothwell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Palotay</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Beckett</surname>
          </string-name>
          , and
          <string-name>
            <surname>L. Brochu.</surname>
          </string-name>
          <article-title>The systematized nomenclature of human and veterinary medicine</article-title>
          .
          <source>Technical report</source>
          , International, North eld, IL: College of American Pathologists,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>K.</given-names>
            <surname>Dentler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Cornet</surname>
          </string-name>
          , A. ten
          <string-name>
            <surname>Teije</surname>
          </string-name>
          , and N. de Keizer.
          <article-title>Comparison of reasoners for large ontologies in the OWL 2 EL pro le</article-title>
          .
          <source>Semantic Web Journal</source>
          ,
          <year>2011</year>
          . To appear.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>S.</given-names>
            <surname>Grimm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Watzke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Hubauer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Cescolini</surname>
          </string-name>
          .
          <article-title>Embedded EL + reasoning on programmable logic controllers</article-title>
          .
          <source>In Proceedings of the 11th International Semantic Web Conference (ISWC</source>
          <year>2012</year>
          ), volume
          <volume>7650</volume>
          of Lecture Notes in Computer Science, pages
          <volume>66</volume>
          {
          <fpage>81</fpage>
          . Springer-Verlag,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          .
          <article-title>Consequence-driven reasoning for Horn SHIQ ontologies</article-title>
          . In C. Boutilier, editor,
          <source>Proceedings of the 21st International Joint Conference on Arti cial Intelligence</source>
          ,
          <source>(IJCAI 2009)</source>
          , pages
          <year>2040</year>
          {
          <year>2045</year>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Krotzsch, and</article-title>
          <string-name>
            <surname>F.</surname>
          </string-name>
          <article-title>Simanc k. Concurrent classi cation of EL ontologies</article-title>
          . In L. Aroyo,
          <string-name>
            <given-names>C.</given-names>
            <surname>Welty</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Alani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Taylor</surname>
          </string-name>
          , A.
          <string-name>
            <surname>Bernstein</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Kagal</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Noy</surname>
          </string-name>
          , and E. Blomqvist, editors,
          <source>Proceedings of the 10th International Semantic Web Conference (ISWC'11)</source>
          , volume
          <volume>7032</volume>
          of Lecture Notes in Computer Science. SpringerVerlag,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Krotzsch, and</article-title>
          <string-name>
            <surname>F.</surname>
          </string-name>
          <article-title>Simanc k. ELK: a reasoner for OWL EL ontologies</article-title>
          . System description, University of Oxford,
          <year>2012</year>
          . available from http://code.google.com/p/elk-reasoner/wiki/Publications.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Krotzsch, and</article-title>
          <string-name>
            <surname>F.</surname>
          </string-name>
          <article-title>Simanc k. ELK reasoner: Architecture and evaluation</article-title>
          .
          <source>In Proceedings of the OWL Reasoner Evaluation Workshop 2012 (ORE'12)</source>
          , volume
          <volume>858</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Krotzsch, and</article-title>
          <string-name>
            <surname>F.</surname>
          </string-name>
          <article-title>Simanc k</article-title>
          .
          <source>The incredible ELK</source>
          .
          <year>2013</year>
          . available from http://code.google.com/p/elk-reasoner/wiki/Publications.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>M.</given-names>
            <surname>Lawley</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Bousque</surname>
          </string-name>
          .
          <article-title>Fast classi cation in Protege: Snorocket as an OWL2 EL reasoner</article-title>
          .
          <source>In Proceedings of Australasian Ontology Workshop</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17. J. Mendex.
          <article-title>jcel: A modular rule-based reasoner</article-title>
          .
          <source>In Proceedings of the 1st International Workshop on OWL Reasoner Evaluation (ORE</source>
          <year>2012</year>
          ), volume
          <volume>858</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <given-names>J.</given-names>
            <surname>Mendez</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Reintroducing CEL as an OWL 2 EL reasoner</article-title>
          . In B. C.
          <string-name>
            <surname>Grau</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          <string-name>
            <surname>Horrocks</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Motik</surname>
          </string-name>
          , and U. Sattler, editors,
          <source>Proceedings of the 22nd International Workshop on Description Logics (DL</source>
          <year>2009</year>
          ), volume
          <volume>477</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>A.</given-names>
            <surname>Rector</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Horrocks.</surname>
          </string-name>
          <article-title>Experience building a large, re-usable medical ontology using a description logic with transitivity and concept inclusions</article-title>
          .
          <source>In Proceedings of the Workshop on Ontological Engineering</source>
          , AAAI Spring Symposium (AAAI'
          <fpage>97</fpage>
          ). AAAI Press,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <given-names>B.</given-names>
            <surname>Sertkaya</surname>
          </string-name>
          .
          <article-title>In the search of improvements to the EL+ classi cation algorithm</article-title>
          .
          <source>In Proceedings of the 24th International Workshop on Description Logics (DL</source>
          <year>2011</year>
          ), volume
          <volume>745</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Polynomial-Time Reasoning Support for Design and Maintenance of Large-Scale Biomedical Ontologies</article-title>
          .
          <source>Ph.D. dissertation</source>
          , Institute for Theoretical Computer Science, TU Dresden, Germany,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22. E. Thomas,
          <string-name>
            <given-names>J. Z.</given-names>
            <surname>Pan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Ren. TrOWL</surname>
          </string-name>
          :
          <article-title>Tractable owl 2 reasoning infrastructure</article-title>
          . In L. Aroyo,
          <string-name>
            <given-names>G.</given-names>
            <surname>Antoniou</surname>
          </string-name>
          , E. Hyvonen, A. ten Teije,
          <string-name>
            <given-names>H.</given-names>
            <surname>Stuckenschmidt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Cabral</surname>
          </string-name>
          , and T. Tudorache, editors,
          <source>The Semantic Web: Research and Applications, 7th Extended Semantic Web Conference</source>
          ,
          <source>(ESWC</source>
          <year>2010</year>
          ), volume
          <volume>6089</volume>
          of Lecture Notes in Computer Science, pages
          <volume>431</volume>
          {
          <fpage>435</fpage>
          . Springer-Verlag,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>