<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Reasoning the FMA Ontologies with TrOWL</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Je Z. Pan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yuan Ren</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nophadol Jekjantuk</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jhonatan Garcia</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computing Science, University of Aberdeen</institution>
          ,
          <addr-line>Aberdeen, AB23 3UE</addr-line>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this paper, we brie y introduce the TrOWL ontology reasoning infrastructure and share our experience of using TrOWL to reason with various versions of the Foundational Model of Anatomy Ontology (FMA), which are among the most challenging ontologies for Description Logic reasoners. { OWL2-DL, the most expressive decidable language in the OWL2 family, and { three tractable sub-languages of OWL2-DL, i.e. OWL2-EL, OWL2-QL and OWL2-RL.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>TrOWL</title>
      <p>TrOWL1 is a tractable reasoning infrastructure for the second version of the Web
Ontology Language, or simply OWL22, which comes with a family of ontology
languages, including:</p>
      <p>There are at least three approaches to reasoning in OWL2:</p>
      <p>TrOWL supports OWL2 by using the approaches 2 and 3 mentioned above.
On the tractable language level, TrOWL contains an OWL2-EL reasoner (REL)
and an OWL2-QL reasoner (Quill). The approach of TrOWL is to o er tractable
support for all the expressive power of OWL2 by using quality guaranteed (in
terms of soundness and/or completeness) approximate reasoning. TrOWL
contains an OWL2 pro le checker to detect which pro le an ontology may t into.</p>
      <p>
        The semantic approximation from OWL2 to OWL-QL is based on the work
described in Pan and Thomas [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Semantic approximation applies the
knowledge compilation [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] to precompute the entailment of an arbitrary ontology into
a DL-Lite ontology. In general, this approach is soundness preserving and could
be incomplete. Furthermore, a conditional completeness condition is identi ed:
if input queries are database style queries, i.e. the variables only bound to named
individuals, the approach is also complete. In other words, database style queries
are not expressive enough to tell the di erence between the original OWL2-DL
ontology and its approximation. A drawback for this approach is that reasoners
are required to compute the semantic approximation; therefore, the construction
of the approximation is usually done o -line.
      </p>
      <p>
        The syntactic approximation from OWL2 to OWL2-EL is based on the
soundness preserving approximate reasoning approach presented in Ren et al.
[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. The construction of the approximation is on the syntax and hence can be
done e ciently just before applying approximate reasoning. The idea is not to
throw away the axioms that are beyond OWL2-EL; otherwise, we might su er
from low recall | for example, if we naively remove from the Cyc ontology all
the axioms that are beyond OWL2-EL, the recall is only 1% for classi cation.
Therefore, in this approach, we introduce some fresh named classes to represent
non-OWL2-EL class expressions. In order to recover the hidden semantics within
these fresh named classes, some relation between such named classes and
existing classes are maintained and some extra completion rules (beyond those in
OWL2-EL) are introduced, with the extended set of completion rules still being
tractable. In [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], we reported that the recall of such approximate reasoning is
very high for TBox classi cation, 100% for most existing benchmark ontologies
except the Wine Ontology (99.4%). A further investigation indicates that it is
due to the syntax sensitivity nature of our approach. After adding a further
normalisation step into TrOWL, the recall for the Wine Ontology is also 100%.
      </p>
      <p>TrOWL supports both OWL and Jena APIs. It has a plug-in for the Protege
ontology editor v4.3.
2</p>
    </sec>
    <sec id="sec-2">
      <title>FMA Ontologies</title>
      <p>
        The Foundational Model of Anatomy Ontology (FMA) [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] is an evolving
computer-based knowledge source for biomedical informatics, mainly developed by the
University of Washington since 1994. The importance of this ontology resides
in the fundamental underlining of anatomy in all elds of medicine. Proper
interpretation of these data relies on an implicit understanding of anatomy. The
inferences entailed in such reasoning call upon cognitive or computational
processing of abstractions about physical entities of the body, making use of
relationships that exist among anatomical concepts. Relevance and impact of the
File Source File size Cls Props Inds Expressivity
FMA-DLR4 bioontology.org 147.6 Mb 78989 110 139374 ALU IN (D)
FMA-FullR4 bioontology.org 37.7 Mb 23597 77 82935 ALCOF (D)
FMA-Constitutional [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] 42.1 Mb 41647 148 85 ALCOIF (D)
FMA-OWL2G noMTC [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] 261.7 Mb 85005 140 74698 SROIQ(D)
FMA-DLR M15 this paper 140Kb 26 133 26 ALCOIF (D)
FMA-DLR M26 this paper 225Kb 56 133 56 ALCOIF (D)
FMA ontology on its eld can now be compared to other well-known medical
ontologies such as SNOMED [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] or GALEN [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        Nowadays, the FMA can be viewed as a complex, highly connected network
in which nearly 70,000 anatomical concepts, from over 170,000 frames, are
interrelated by over 570,000 relationship instances. There have been a number
of approaches [
        <xref ref-type="bibr" rid="ref10 ref4 ref5">5, 10, 4</xref>
        ] to translating the knowledge encapsulated by the FMA
ontology into the OWL ontology language. Golbreich et al. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] developed the
FMA-OWLizer tool, which can be applied to automatically obtain a translation
of the FMA ontology into OWL 2.
      </p>
      <p>Given the size and complexity of the FMA ontology, reasoning under OWL
has proven to be a real challenge. Table 1 provides a list of FMA ontologies
written in OWL that we used in our evaluation.
3</p>
    </sec>
    <sec id="sec-3">
      <title>FMA with Metamodeling</title>
      <p>
        The FMA features a complex structure of superclasses and subclasses that
requires the support of metamodeling. For example, \Physical anatomical entity"
is an instance of \Anatomical entity template", and a subclass of both
\Anatomical entity template" and \Anatomical entity" [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In OWL, a class is interpreted
as a set of objects. Similarly, a metaclass is interpreted as a set of sets in
metamodeling extensions of OWL, such as OWL-FA [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. For example, the metaclass
Vertebra can be interpreted as a set of di erent types of vertebrae, such as
cervical, thoracic, lumbar, which in turn can be interpreted as subsets of other sets,
e.g., rst, ..., fth lumbar vertebra.
      </p>
      <p>
        There have been several attempts in dealing with metamodeling in FMA.
Dameron et al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] converted the frame-based FMA ontology into an
OWL1DL version and an OWL1-Full version, with metaclasses included in the latter
one. Golbreich et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] tried to capture (some of) the knowledge encoded at
metaclasses di erently in OWL1-DL directly (cf. the FMA-Constitutional
ontology in Table 1). The idea is to replace instance-of links between a class and
its metaclasses with subClassOf links. The structure of their instances, property
4 http://www.bioontology.org/wiki/index.php/FMAInOwl
5 http://homepages.abdn.ac.uk/je .z.pan/pages/onto/fma-dlr-m1.owl
6 http://homepages.abdn.ac.uk/je .z.pan/pages/onto/fma-dlr-m2.owl
restrictions of metaclasses are interpreted as closure axioms and approximated
by universal restrictions while restrictions of classes are translated into
existential restriction. Later on, Golbreich et al. further encoded the FMA ontology
in OWL2-DL, producing two ontologies, one with metaclasses and one without
them. The idea is to use the OWL 2 metamodeling capability, i.e., punning,
to represent metaclasses, using the same URI to refer to a class and an
individual at the same time in FMA-OWL2G MT. For example, the name Heart
can be used both for the metaclass Heart and for the class Heart, instance of
Organ with cavitated organ parts.
      </p>
      <p>
        The drawback of the punning approach is that, although a class and an
individual can share the same name, say C, they are treated as di erent entities.
For example, even if the class C is entailed to be equivalent to a class D, the
individuals C and D can still be di erent. This has been regarded as non-intuitive
due to the lack of expected entailments (e.g., the individuals C and D should be
the same). To deal with this problem, we apply the class-based approach from
Glimm et al. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] to enrich some small (but already challenging for DL reasoners)
subsets of FMA-DLR ontology and accommodate metaclasses (cf. the last two
ontologies in Table 1) with the Typing and MatSubClass functions proposed
in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>Ontology
FMA-DLR
FMA-FullR
FMA-Constitutional
FMA-OWL2G noMTC
FMA-DLR M1
FMA-DLR M2</p>
      <p>RT FaCT++ HermiT TrOWL MORe Recall</p>
      <p>C 32.425 s 46.94 s 32.596 s 47.794 s 100%
C 121.041 s 1064.947 s 4.45 s 4.571 s 100%
C t/o 3043.61 s 155.808 s t/o 100%
C o/m t/o 967.59 s t/o N/A
M 932.5 s 26.39 s 0.819 s N/A 100%</p>
      <p>M t/o 737.43 s 2.863 s N/A 100%</p>
      <p>
        Table 2 lists the classi cation (for the rst four ontologies) and
materialisation (for the last two ontologies) time (reasoning time + retrieving time) from
some of the state of the art DL reasoners (including FaCT++ v1.6.2, HermiT
v1.3.8, TrOWL v1.3 and MORe v0.1.3 [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]) over the FMA ontologies in Table
1. The machine used for the experiment is a MacBook, with CPU 2.26 core 2
duo, Ram 8 GB and 6 GB allocated to JVM. The last column of Table 2 reports
the recall (on the number of subsumptions among named classes) of TrOWL
with respect to results of HermiT. Note that FaCT++ had a datatype error for
the FMA-DLR ontology, so we did not import the FMA-DLR ontology into the
FMA-FullR ontology when testing FMA-FullR. Moreover, as MORe does not
support ABox reasoning, its time with the FMA-DLR M1 and FMA-DLR M2
ontologies is not reported.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Dealing with Unsatis able Concepts in FMA</title>
    </sec>
    <sec id="sec-5">
      <title>Constitutional</title>
      <p>
        An ontology is called incoherent [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] if it contains unsatis able concepts, which
are equivalent to the bottom concept ? and can not have any instance.
Unsatisable named concepts (except the bottom concept ?) in a constructed ontology
usually indicates possible design aws. For example, 33,433 out of 41,648
concepts are unsatis able in the FMA-Constitutional ontology. This was apparently
not intended since the current version of FMA has already eliminated all these
unsatis abilities.
      </p>
      <p>
        Understanding ontology incoherence is not trivial. Incoherence can usually be
explained and resolved by computing justi cations [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], i.e., minimal
entailmentpreserving sub-ontologies. However, computing justi cations with a black-box
algorithm requires a large number of entailment checking, which can be expensive
given the complexity of reasoning and size of the ontology. Also, looking into
33,433 justi cations to debug the ontology will be very time consuming.
      </p>
      <p>
        We notice that some of the concepts are unsatis able due to other
unsatisable concepts. For example in FMA-Constitutional we can infer N euron v ?
and Central neuron v N euron, hence we also have Central neuron v ?. In
this case, Central neuron is unsatis able due to the unsatis ability of N euron.
Such a phenomena has been formally characterised by Kalyanpur et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] as
root and derived unsatis able concepts. Particularly, A is a derived unsatis able
concept if there is a justi cation for A v ? that contains a justi cation for
B v ?, where B is another unsatis able concept, and B is called the parent of
A. Otherwise, A is a root unsatis able concept.
      </p>
      <p>
        The REL reasoner in TrOWL is using a forward-chaining completion-based
algorithm, in which each rule infers a set of consequence axioms from a set
of antecedence axioms. Such an algorithm can be easily extended to compute
justi cations on the y by incorporating a truth-maintenance system (TMS) [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
However naively applying such a solution has the following limitations:
1. For big and complex ontologies, maintaining the entire in TMS is a big
overhead on reasoning. In fact, we are only interested in justi cations for
unsatis ability but not the others so a fully- edged TMS is unnecessary.
2. Repairing all the root unsatis abilities cannot always repair all the derived
unsatis abilities because a derived unsatis ability may have another
justication that depends on no other unsatis ability. In this case, one need to
iteratively reclassify, debug and repair. For di cult ontologies such as FMA
Constitutional, we would like to minimise the number of such iterations.
      </p>
      <p>In order to improve e ciency, we introduce Type I and Type II unsatis able
concepts as approximations to the root and derived unsatis able concepts with
the following procedure in REL:
1. When a rule infers A v ?, if the antecedences contain B v ?, where both
A and B are named concepts in the original ontology, we label A as a Type
II unsatis able concept. Otherwise, we label A as a Type I unsatis able
concept.
2. We continue reasoning on Type II concepts regardless their unsatis ability,
and label them with Type I if possible. They will not be treated immediately
as sub-concept of all concepts.</p>
      <p>The above point 2 is important to explore alternative derivation of unsatis
ability for Type II concepts. If such a derivation does not depend on other
unsatisability, the concept will be labeled Type I as well. It is possible for a derived
unsatis able concept to be labeled earlier than its parent, making it mistakenly
labeled as a Type I. For example, considering the following axiom:
A v B;
B v C;
B v :C;
(1)
(2)
(3)
if we infer A v C from (1) and (2), then A v :C from (1) and (3), and
then A v ?, then we have A as a Type I unsatis able concept. To avoid such
situations as much as possible, we apply a depth- rst classi cation strategy,
always classifying super-concepts before classifying sub-concepts.</p>
      <p>Using the above mechanism we are able to distinguish the di erent types of
unsatis able concepts in the FMA-Constitutional. Results show that only 145
concepts belong to Type I, which is only 0:43% of all the unsatis able concepts.
By examining their justi cations, we realise that they are due to similar reasons.
Particularly, there is a boolean-valued functional datatype property has mass
in the ontology. With the axioms in FMA Constitutional, it is possible to
infer both A v 9has mass:ftrueg and A v 9has mass:ff alseg for concept A,
making A unsatis able. Another boolean-valued functional datatype property
has inherent 3-D shape has a similar problem. There are in total only 6
concept axioms with these two properties. Debugging these 6 axioms is apparently
much easier than debugging all the 122,136 logical axioms, or the justi cations
of all the 33,433 unsatis able concepts.
5</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion and Outlook</title>
      <p>This paper brie y introduces the TrOWL ontology reasoning infrastructure. Our
evaluations with the FMA ontologies indicate that approximate reasoners can
be useful for reasoning and debugging complex ontologies. The tested FMA
ontologies are only some of the existing ones. We will further test more FMA
ontologies, in particular those related to metamodeling.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>O.</given-names>
            <surname>Dameron</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. L.</given-names>
            <surname>Rubin</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>Challenges in converting frame-based ontology into OWL: the Foundational Model of Anatomy case-study</article-title>
          .
          <source>In the Proc. of the AMIA Annual Symposium</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Birte</given-names>
            <surname>Glimm</surname>
          </string-name>
          , Ian Horrocks, and
          <string-name>
            <given-names>Boris</given-names>
            <surname>Motik</surname>
          </string-name>
          .
          <article-title>Optimized description logic reasoning via core blocking</article-title>
          .
          <source>In IJCAR</source>
          , pages
          <volume>457</volume>
          {
          <fpage>471</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Birte</given-names>
            <surname>Glimm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Sebastian</given-names>
            <surname>Rudolph</surname>
          </string-name>
          , and
          <article-title>Johanna Volker. Integrated metamodeling and diagnosis in owl 2</article-title>
          .
          <source>In Proceedings of the 9th International Semantic Web Conference</source>
          , volume
          <volume>6496</volume>
          <source>of LNCS</source>
          , pages
          <volume>257</volume>
          {
          <fpage>272</fpage>
          . Springer, November
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>C.</given-names>
            <surname>Golbreich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Grosjean</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S. J.</given-names>
            <surname>Darmoni</surname>
          </string-name>
          .
          <article-title>The fma in owl 2</article-title>
          .
          <source>In Proceedings of the 13th conference on Arti cial intelligence in medicine</source>
          ,
          <source>AIME'11</source>
          , pages
          <fpage>204</fpage>
          {
          <fpage>214</fpage>
          , Berlin, Heidelberg,
          <year>2011</year>
          . Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Christine</given-names>
            <surname>Golbreich</surname>
          </string-name>
          , Songmao Zhang, and
          <string-name>
            <given-names>Olivier</given-names>
            <surname>Bodenreider</surname>
          </string-name>
          .
          <article-title>The foundational model of anatomy in owl: Experience and perspectives</article-title>
          .
          <source>J. Web Sem</source>
          .,
          <volume>4</volume>
          (
          <issue>3</issue>
          ):
          <volume>181</volume>
          {
          <fpage>195</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Rogers</surname>
            <given-names>JE</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roberts</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Solomon</surname>
            <given-names>WD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>van der Haring</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wroe</surname>
            <given-names>CJ</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zanstra</surname>
            <given-names>PE</given-names>
          </string-name>
          , and AL.
          <string-name>
            <surname>Rector</surname>
          </string-name>
          .
          <article-title>Galen ten years on: Tasks and supporting tools</article-title>
          .
          <source>In Proceedings of the MEDINFO2001</source>
          , pages
          <fpage>256</fpage>
          {
          <fpage>260</fpage>
          . IOS Press,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Nophadol</given-names>
            <surname>Jekjantuk</surname>
          </string-name>
          , Je
          <string-name>
            <given-names>Z.</given-names>
            <surname>Pan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Gerd</given-names>
            <surname>Grner</surname>
          </string-name>
          .
          <article-title>Verifying and Validating MultiLayered Models with OWL FA Toolkit</article-title>
          .
          <source>In the Proc. of the Extended Semantic Web Conference (ESWC2010)</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Aditya</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          , Bijan Parsia, Matthew Horridge, and
          <string-name>
            <given-names>Evren</given-names>
            <surname>Sirin</surname>
          </string-name>
          .
          <article-title>Finding all justi cations of owl dl entailments</article-title>
          .
          <source>In ISWC/ASWC</source>
          <year>2007</year>
          , pages
          <fpage>267</fpage>
          {
          <fpage>280</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Aditya</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          , Bijan Parsia, Evren Sirin, and
          <string-name>
            <given-names>James</given-names>
            <surname>Hendler</surname>
          </string-name>
          .
          <article-title>Debugging unsatis able classes in owl ontologies</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          ,
          <volume>3</volume>
          (
          <issue>4</issue>
          ):
          <volume>268</volume>
          {
          <fpage>293</fpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. Natalya Fridman Noy and Daniel L.
          <article-title>Rubin. Translating the foundational model of anatomy into owl</article-title>
          .
          <source>J. Web Sem</source>
          .,
          <volume>6</volume>
          (
          <issue>2</issue>
          ):
          <volume>133</volume>
          {
          <fpage>136</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. Je
          <string-name>
            <given-names>Z.</given-names>
            <surname>Pan</surname>
          </string-name>
          and Edward Thomas.
          <article-title>Approximating OWL-DL Ontologies</article-title>
          . In
          <source>the Proc. of the 22nd National Conference on Arti cial Intelligence (AAAI-07)</source>
          , pages
          <fpage>1434</fpage>
          {
          <fpage>1439</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Stearns</surname>
            <given-names>M. Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Price</surname>
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Spackman</surname>
            <given-names>K. A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Wang</surname>
            <given-names>A. Y.</given-names>
          </string-name>
          <article-title>Snomed clinical terms: overview of the development process and project status</article-title>
          .
          <source>In Proceedings of the AMIA Symposium</source>
          , American Medical Informatics Association, pages
          <volume>662</volume>
          {
          <fpage>666</fpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>Yuan</given-names>
            <surname>Ren and Je Z Pan</surname>
          </string-name>
          .
          <article-title>Optimising ontology stream reasoning with truth maintenance system</article-title>
          .
          <source>In Proceedings of the 20th ACM international conference on Information and knowledge management</source>
          , pages
          <volume>831</volume>
          {
          <fpage>836</fpage>
          . ACM,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Yuan</surname>
            <given-names>Ren</given-names>
          </string-name>
          , Je
          <string-name>
            <given-names>Z.</given-names>
            <surname>Pan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Yuting</given-names>
            <surname>Zhao</surname>
          </string-name>
          .
          <article-title>Soundness Preserving Approximation for TBox Reasoning</article-title>
          .
          <source>In the Proc. of the 25th AAAI Conference Conference (AAAI2010)</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15. Ana Armas Romero, Bernardo Cuenca Grau, and
          <string-name>
            <given-names>Ian</given-names>
            <surname>Horrocks</surname>
          </string-name>
          . More:
          <article-title>Modular combination of owl reasoners for ontology classi cation</article-title>
          .
          <source>In Proceedings of the 11th International Semantic Web Conference (ISWC</source>
          <year>2012</year>
          ), LNCS. Springer,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>Cornelius</given-names>
            <surname>Rosse</surname>
          </string-name>
          and Jose L. V.
          <article-title>Mejino Jr. A reference ontology for biomedical informatics: the foundational model of anatomy</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          ,
          <volume>36</volume>
          (
          <issue>6</issue>
          ):
          <volume>478</volume>
          {
          <fpage>500</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>Stefan</given-names>
            <surname>Schlobach</surname>
          </string-name>
          and
          <string-name>
            <given-names>Ronald</given-names>
            <surname>Cornet</surname>
          </string-name>
          .
          <article-title>Non-standard reasoning services for the debugging of description logic terminologies</article-title>
          .
          <source>In IJCAI</source>
          , pages
          <volume>355</volume>
          {
          <fpage>362</fpage>
          . Morgan Kaufmann,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <given-names>Bart</given-names>
            <surname>Selman</surname>
          </string-name>
          and
          <string-name>
            <given-names>Henry</given-names>
            <surname>Kautz</surname>
          </string-name>
          .
          <article-title>Knowledge compilation and theory approximation</article-title>
          .
          <source>J. ACM</source>
          ,
          <volume>43</volume>
          (
          <issue>2</issue>
          ):
          <volume>193</volume>
          {
          <fpage>224</fpage>
          ,
          <string-name>
            <surname>March</surname>
          </string-name>
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>