<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Upwardly Abstracted De nition-Based Subontologies?</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>IHTSDO (SNOMED International)</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>The University of Manchester</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>1824</year>
      </pub-date>
      <abstract>
        <p>In this paper, we present a method for extracting subontologies from ELH ontologies for a set of symbols. The approach is focused on the generation of upwardly abstracted de nitions, which is a technique for computing de nitions expressed using closest primitive ancestors. The subontologies returned by the method are evaluated for quality and compared to extracts computed with locality-based modularisation and uniform interpolation methods. Our subontology generation method produces promising results in terms of size and relevance to the needs of domain experts.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Ontologies are formalised representations of domain knowledge. SNOMED CT,
the Gene ontology (GO) and the NCIt ontology are just a few of the major
ontologies used in the biomedical domain [
        <xref ref-type="bibr" rid="ref12 ref28 ref30 ref35 ref7 ref9">7, 9, 12, 28, 30, 35</xref>
        ]. Due to the large
size and complexity of such ontologies, it is necessary to facilitate their use for a
variety of applications including analysis, curation, debugging, and integration.
To overcome the size issue, domain-speci c subsets of concept names (reference
sets) such as the ERA reference set [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ] are used in SNOMED CT. Reference
sets assist in limiting querying, searching, and data entry to a part of the
application domain, and are carefully created to represent speci c de nitions from
the source ontology indicating their intended function. Retrieving information
for such reference sets requires querying the ontology in its entirety. In order to
minimise the computational cost and overhead, rather than using a at list of
concepts, it is advantageous to be able to use instead a subontology that
encompasses all semantic relationships associated with the concepts in the reference
set.
      </p>
      <p>
        There are various methods and approaches for extracting subontologies in the
literature, including graph-based ontology partitioning [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], locality-based
modularisation [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], and uniform interpolation [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Syntactic locality-based
modularisation (SLBM) is a method that is widely used for the purpose of importability
? Copyright © 2021 for this paper by its authors. Use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).
      </p>
      <sec id="sec-1-1">
        <title>We thank Yizheng Zhao and Zhao Liu for allowing us to use their ELH forgetting</title>
        <p>
          tool, and their help in using it.
and reuse. The method computes a subset of the stated axioms of an ontology
that covers information related to the input signature. Modules can be large and
can contain information outside the meaning of the input signature [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
        <p>
          Another method for producing compact representations is uniform
interpolation (UI), a logic-based method for computing restricted views of an ontology
which faithfully captures information about the set of speci ed concepts and role
names. This is accomplished by forgetting symbols that are not contained in the
input signature [
          <xref ref-type="bibr" rid="ref16 ref22 ref24">16,22,24</xref>
          ]. Because the axioms within the UIs are rewritten
during the forgetting process, the syntactic form of axioms may di er signi cantly
from those in the original ontology.
        </p>
        <p>
          Locality-based modularisation and uniform interpolation are useful for a
variety of applications such as ontology summarisation, reuse, analysis, logical
difference, and information hiding [
          <xref ref-type="bibr" rid="ref15 ref18 ref23 ref34 ref6">6, 15, 18, 23, 34</xref>
          ]. To be useful to the SNOMED
community, subontologies must be in the language of SNOMED CT and must
also satisfy SNOMED modelling guidelines. While modules satisfy these
requirements because they contain only axioms from the original ontology, they tend
to contain an excessive number of symbols that are not part of the input
signature [
          <xref ref-type="bibr" rid="ref17 ref21 ref33 ref4">4, 17, 21, 33</xref>
          ]. By contrast, UIs contain only those symbols speci ed in the
input signature but rewrite axioms and are harder to compute even when
combined with modularisation [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. To be bene cial to SNOMED users, a di erent
notion of subontology is needed.
        </p>
        <p>
          In this paper, we introduce a notion of subontology based on the idea of
abstracted de nitions, because SNOMED CT users are already familiar with
a variety of normal forms [
          <xref ref-type="bibr" rid="ref11 ref27">11, 27</xref>
          ]. Our abstracted de nitions follow the same
format as the commonly used proximal primitive normal form in SNOMED
CT. Proximal primitive normal forms explicitly state all possible constraints
and de ning characteristics of particular concepts to facilitate implementation,
recording, storage, and retrieval within SNOMED CT. Additionally, such forms
enable more precise inferred parent identi cation of focus concepts after running
a classi er, they simplify parent relationship maintenance, and improve the
accuracy and breadth of super and subconcepts [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ]. We found that the generation
of abstracted de nitions aides the inclusion of information that is truly necessary
for the resulting subontologies. Our method is targeted at acyclic ontologies such
as SNOMED CT, the Gene ontology, and the Sequence ontology.
        </p>
        <p>The main contributions of the paper are threefold:
{ An investigation of computing upwardly abstracted de nitions for E LH
ontologies that satisfy common modelling guidelines used in SNOMED CT,
one of the most widely used biomedical ontologies.
{ A method for extracting subontologies based on the principle of abstracted
de nitions.
{ An evaluation of the subontology extraction method and comparison with
two existing subontology extraction methods, namely the bottom variant of
SLBM, and the UI method, in order to comprehend bene ts of subontologies
based on the abstracted de nitions.</p>
        <p>The paper is organised as follows. Section 2 gives preliminary de nitions
and background information. Section 3 goes into detail about the upwardly
abstracted de nitions. The aim, requirements, algorithm and an example of the
subontology generation method are presented in Section 4. Section 5 discusses
related notions including SLBM and uniform interpolation. In Section 6, we
evaluate the quality of the returned subontologies, and compare the results of our
subontology generation method with SLBM and uniform interpolation in terms
of precision and extract size. Finally, we conclude in Section 7.
2</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Preliminaries and Background</title>
      <p>
        Let NC and NR be disjoint sets of concept and role names respectively. The union
of such sets form the signature of an ontology O. The signature sig( ) is a set
of concept and role names that occur in , where is any syntactic object or
ontology. The set of E L-concepts C, and the sets of E LH-axioms are built
according to the grammar rules: C ::= A j C u C j 9r:C and ::= C v C j C
C j r v s where A 2 NC and r; s 2 NR.1 An E LH-TBox is a nite set of E
LHaxioms. The semantics, including the notions of model, satisfaction of concepts,
axioms and TBoxes as well as the logical consequence relation (entailment), are
de ned in the usual manner; see, for example [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>A terminology is a TBox that contains only axioms of the form A C or
A v C, with A appearing not more than once on the left-hand side of an axiom.
If A does not depend on itself, i.e., does not occur in the set of symbols required
to de ne itself for any A 2 NC, the terminology is acyclic.</p>
      <p>Classi cation is a standard reasoning task that computes a hierarchy H for O.
A hierarchy H is a nite set of subsumption axioms A v B such that O j= A v B,
where A and B are concept names in sig(O).</p>
      <p>
        Figure 1 shows an example of an E LH biomedical terminology, adapted
from [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The axioms 1 to 5 are concept de nitions of the form A C or
A v C, where A is the described concept. De nitions, with both necessary and
su cient conditions (A C), are critical in terminologies because they assist in
determining which concepts are classi ed under them in the concept hierarchy.
On the other hand, concepts with necessary conditions only (A v C) a ect how
a concept is classi ed, but have no e ect on which concepts can be classi ed
under them [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
      </p>
      <p>Our study on generating upwardly abstracted de nitions is limited to axioms
of the form A C or A v C in an E LH ontology or terminology, as the majority
of biomedical ontologies lack GCIs of the form C v A, C v D, or C D, where
C and D denote complex concepts and A denotes a concept name.</p>
      <sec id="sec-2-1">
        <title>1 : In ammatoryDisorder Disease u 9involves.In ammation;</title>
      </sec>
      <sec id="sec-2-2">
        <title>2 : LiverDisease Disease u 9location.Liver;</title>
      </sec>
      <sec id="sec-2-3">
        <title>3 : Hepatitis2 LiverDisease u 9involves.In ammation;</title>
      </sec>
      <sec id="sec-2-4">
        <title>4 : LargeLiver v LiverDisease u 9location.EntireLiver;</title>
        <p>5 : EntireLiver v Liver</p>
        <sec id="sec-2-4-1">
          <title>1 These grammar rules are su cient for the ELH fragment we are considering.</title>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Upwardly Abstracted De nitions</title>
      <p>We start by de ning the key concepts used in this article.</p>
      <p>De nition 1 (De ned (Primitive) Concept). Let O be an ontology, and C
an E L-concept other than A. A concept name A is a de ned concept in O if
there is an axiom of the form A C in O. Otherwise, it is called a primitive
concept.</p>
      <p>Regardless as to whether a named concept A is de ned or primitive, its
abstracted de nition is computed by inferring its closest primitive ancestor(s) in
the subsumption hierarchy. Closest primitive ancestors are de ned as follows.
De nition 2 (Closest Primitive Ancestor). Let O be an ontology, A; P 2
sig(O) where A is a de ned or a primitive concept name and P is a primitive
concept name. We say that P is a closest primitive ancestor to A in O if O j=
A v P and there does not exist a primitive concept name Z 2 sig(O) (other
than P or A) such that O j= A v Z and O j= Z v P . The set of closest
primitive ancestors to A will be denoted by PA.</p>
      <p>We de ne abstracted de nitions as follows.</p>
      <p>De nition 3 (Upwardly Abstracted De nition). Let O be an ontology,
and A a de ned (primitive) concept name in O. The abstracted de nition of
A is A PA u EA (A v PA u EA), where PA is a conjunction of the closest
primitive ancestors to A, while EA is a conjunction of existential restrictions
(of the form 9r:C) required to complete the abstracted de nition of A such that
O j= A PA u EA (or O j= A v PA u EA), and sig(PA u EA) sig(O).
Example 1. Consider the ontology O = fA D u 9r:C1; D P u 9r:C2; P v
9r:C3g. An upwardly abstracted de nition of A is A P u 9r:C1 u 9r:C2 u 9r:C3.</p>
      <p>
        Di erent equivalent logical forms of SNOMED CT concept de nitions are
discussed in [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. Two distinct forms of proximal primitive modelling is mentioned
there: rst, a short canonical form in which only the existential restrictions that
distinguish the concept from its closest primitive ancestors are listed. For
instance, in Example 1, the short canonical form of A is A P u 9r:C1 u 9r:C2.
The second is the long canonical form, which lists all possible existential
restrictions, which can be viewed as the de ning characteristics of the concept being
de ned [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. In Example 1, the long canonical form of A is A P u 9r:C1 u
9r:C2 u 9r:C3. According to De nition 3, both short and long canonical forms
are abstracted de nitions. This illustrates that abstracted de nitions are not
unique.
      </p>
      <p>The following example illustrates that abstracted de nitions may also be
weaker than the original de nitions when O is an ontology rather than a
terminology.
Example 2. Let O = f 1; 2; 3g, where 1: A Du9r:C, 2: D P u9r:C and
3: A v P2. We notice that both ab1: A P u 9r:C and ab2: A P u P2 u 9r:C
are entailed by O and are in fact abstracted de nitions of A. Let's consider
the ontologies O1 = fab1; 2; 3g and O2 = fab2; 2; 3g in which the original
de nition 1 of A is respectively replaced by ab1 and ab2. We observe that
O O1 but O 6 O2 because O2 6j= O as O2 6j= 1 since ab2 is weaker than 1.</p>
      <p>The abstracted de nition of A in O computed by our algorithm is the second
case (ab2) as part of its search for all of the closest primitive ancestors. As seen
in the example, this de nition is weaker than the original de nition. To de ne
the logical strength of abstracted de nitions, we use the following de nition:
De nition 4 (Logical Strength). An ontology O0 is weaker than another
ontology O if O j= O0 but O0 6j= O. An axiom 0 is weaker than another axiom
in O if O j= 0 but Onf g [ f 0g 6j= .
4</p>
    </sec>
    <sec id="sec-4">
      <title>Computing Subontologies</title>
      <p>Our aim is to compute for a given set of symbols a domain-speci c subontology
from a source ontology that satis es the following requirements:
1. The subontology must capture the meaning of the concepts in the focus set,
using whenever possible abstracted de nitions in long canonical form.
2. The transitive closure of concept name subsumption of the subontology is
a restriction of the original ontology's transitive closure of concept name
subsumption over the signature of the subontology.</p>
      <p>These requirements were established with a leading terminologist at SNOMED
international.</p>
      <p>
        Our method to compute subontologies is presented in Algorithm 1. The
algorithm takes as input an ontology O and a focus set F of concept and role
names to generate a subontology S. The rst step of the algorithm initialises
the output S, and the set of existential restrictions E , and + is set to F .
The second step classi es O using the ELK reasoner [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] to obtain the concept
hierarchy H, which is then used throughout the algorithm to compute the
abstracted de nitions for focus concepts correctly, i.e., to compute concepts that
can be related to a focus concept via inferred relations. As a result, the correct
subontology subsumption hierarchy is derived.
      </p>
      <p>Computing an abstracted de nition for a focus concept A 2 F calls the
method AbstractedDe nitionExtraction presented in Algorithm 2. The method
starts with computing the Ancestors of A using H. The Ancestors set consists
of all concept names in sig(O) that subsume A. In Line 2, the function
ComputePrimitiveAncestors lters the set of ancestors by determining their status in O
as de ned or primitive in order to obtain just the primitive concept ancestors.
We use O to obtain the existential restrictions EA that occur in the right-hand
side of A's de nition and all of A's ancestors' de nitions, which is computed by
the function ComputeExistentialRestrictions in Line 3.</p>
      <sec id="sec-4-1">
        <title>Algorithm 1 SubontologyExtraction(O, F )</title>
        <sec id="sec-4-1-1">
          <title>Input: Ontology O, Focus set F</title>
          <p>Output: Subontology S</p>
          <p>+ :=
1: S := ;, F , E := ;.
2: H := Classify(O)
3: for A 2 F do
4: if A is a de ned concept name in O then
5: A PA0 u EA0 := AbstractedDe nitionExtraction(A, O, H, TRUE)
6: else A v PA0 u EA0 := AbstractedDe nitionExtraction(A, O, H, FALSE)
7: + := +[ sig(A (v) PA0 u EA0)
8: E := E [ GetExistentialRestrictions(A (v) PA0 u EA0)
9: S := S [ A (v) PA0 u EA0
10: S := S [ ComputeAdditionalAxioms( +,E, H, O)</p>
        </sec>
      </sec>
      <sec id="sec-4-2">
        <title>Algorithm 2 AbstractedDe nitionExtraction(A, O, H, isDe nedConcept )</title>
        <sec id="sec-4-2-1">
          <title>Input: The concept to de ne A, Ontology O, Concept hierarchy H, De ned concept</title>
          <p>checker isDe nedConcept
Output: The abstracted de nition of A
1: Ancestors := ComputeAncestorsOfA(A, H)
2: PA := ComputePrimitiveAncestors(Ancestors, O)
3: EA := ComputeExistentialRestrictions(A, Ancestors, O)
4: PA0 u EA0 := RemoveRedundantConcepts(PA, EA, H, O)
5: if isDe nedConcept then
6: return A PA0 u EA0
7: else return A v PA0 u EA0</p>
          <p>The method RemoveRedundantConcepts in Line 4 returns the set (PA0 u E A0),
which is a conjunction of the closest primitive ancestors and the most speci c
existential restrictions, after the removal of possible redundant concepts from
the set of primitive concepts PA and existential restrictions EA. A concept D is
regarded as redundant if it occurs in another concept C where D is equivalent to
or subsumes C. Redundant concepts in the sets PA and EA are removed according
to the general rule C u D C , C v D. The removal of redundant concepts
from the set PA results in the set of closest primitive ancestors. To remove
redundant existential restrictions from the set EA, we follow the rules in Figure
2. For example, if the set E has two existential restrictions, E := 9t:(9r1:A1 u
::: u 9rn:An) and G := 9u:(9s1:B1 u ::: u 9sm:Bm), we check whether E v G.
We do this by using the rst rule to check if the outer role t in E is equivalent
to or subsumed by the outer role u in G. If this is the case, then we continue
with the rst rule to check if an existential restriction 9ri:Ai is subsumed by
or equivalent to an existential restriction 9sj :Bj under the nested roles t and u,
respectively. Then, following rule 2, we determine if the subsumption checking
performed using rule 1 is su cient for all 9ri:Ai to be subsumed by all 9sj :Bj .
If this is the case, then it means that E v G, and G can be removed from the
set E .</p>
          <p>1.r v s; C v D ) 9r:C v 9s:D
2.8i = 1::n 9j = 1::m 9ri:Ci v 9sj:Dj ) 9t:(9r1:C1 u :: u 9rn:Cn) v 9t:(9s1:D1 u :: u 9sm:Dm)</p>
          <p>Algorithm 2 concludes by returning the abstracted de nition of A as either
A PA0 u E A0 or A v PA0 u E A0 depending on whether A is a de ned or a
primitive concept in O. Lines 7 and 8 of Algorithm 1 add the signature, and
the existential restrictions of the generated abstracted de nition to the sets +
and E , respectively. Line 10 returns the subontology S after using the function
ComputeAdditionalAxioms to add extra axioms to complete the hierarchy of the
subontology. This is performed by looking for possible subsumption relations
between concept and role names in the set +, as well as between concept
names in + and the existential restrictions in E . For example, the axiom 3 in
Figure 3 is an additional axiom that is required for the subontology hierarchy
to be complete.</p>
          <p>Our method abstracts the de nitions based on the closest primitive ancestors
in order to include only what is truly necessary in the resulting subontology. For
example, if a user is interested in computing a subontology using the ontology in
Figure 1 for the focus set concepts A1:Hepatitis2 and A2:LargeLiver, then
applying Algorithm 1 for A1 and A2 results in the subontology shown in Figure 3. It
includes abstracted de nitions of A1 and A2, where the concept A3:LiverDisease
occurring in the original de nitions of A1 and A2 has been abstracted away. The
use of A3 would require the inclusion of its de nition and increase the size of
the desired subontology without adding additional meaning. This is because A3
carries the same information that A1 and A2 inherit, and thus, the de nition of
A3 is super uous with respect to the focus set fA1; A2g of interest to the user.
We refer to the extra symbols occurring in the signature of the generated focus
set de nitions as the supporting set, e.g., the concept EntireLiver occurring in
the de nition of LargeLiver is a supporting concept.</p>
          <p>1 : Hepatitis2 Disease u 9involves.In ammation u 9location.Liver
2 : LargeLiver v Disease u 9location.EntireLiver
3 : EntireLiver v Liver
We de ne a subontology for a given set of focus symbols
F as follows.</p>
          <p>De nition 5 (Focus Set Subontology). Let O be an E LH ontology and F a
focus set. S is a focus set subontology of O w.r.t. F if the following conditions
are satis ed: (i) F sig(S); (ii) for every E LH-axiom where sig( ) sig(S)
we have: (a) S j= =) O j= and (b) if is of the form A v B, then
O j= =) S j= , where A and B are concept names.</p>
          <p>Depending on the input ontology, our algorithm generates two types of
subontologies: focus set subontologies, which may contain weaker abstracted de
nitions (cf. ab2 in O2 in Example 2), and equivalent focus set subontologies, which
contain abstracted de nitions that are equivalent to their original de nitions
in O for all concepts in the focus set F . We de ne a subontology that contain
equivalent focus set abstracted de nitions for all focus concepts in F as follows.
De nition 6 (Equivalent Focus Set Subontology). Let O be an E
LHacyclic terminology, and S a focus set subontology of O w.r.t. F . We say that S
is an equivalent focus set subontology when O j= , S j= for all abstracted
de nitions of focus concepts in F in S.</p>
          <p>In order to obtain an equivalent focus set subontology, the input ontology to
our method has to be E LH-acyclic terminology.
5
5.1</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Related Notions</title>
      <p>
        Syntactic Locality Based Modularisation
SLBM is widely used in ontology engineering to facilitate ontology reuse and
import [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]. It is available as part of the OWL API tool [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. The method takes
as input an ontology O and a seed signature , and supports computing three
distinct module types: bottom (?), top (&gt;), and nested (?&gt; ) modules. In
essence, SLBM internally extends to cover the upward (downward) views
of until it reaches the top (bottom) symbol in O, as speci ed by the ? (&gt;)
types. The ?&gt; -type is an iteration of &gt; and ? types, returning a module with
symbols contained within 's ? (&gt;) views. We use the ? type in our evaluation
(Section 6) because it is the most relevant type for how our method works, which
is to generate an upwardly expanded extract for an input focus set.
      </p>
      <p>
        SLBM retains the original forms of axioms in the resulting modules. However,
for the purpose of extracting de nitions of concepts in , modules computed
contain a signi cant number of supporting symbols. For instance, as demonstrated
in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], computing ?&gt; -modules from SNOMED CT using NHS subsets results
in modules with a precision rate of 72%. Very low average precision rate (1.14%)
was obtained in a research examining module extraction using a medical corpus
annotated with SNOMED CT concepts, performed for usability purposes [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].
5.2
      </p>
      <p>
        Uniform Interpolation
Uniform interpolation is a task that allows potentially undesirable symbols to
be eliminated from an ontology without a ecting the meaning of the remaining
symbols in the ontology [
        <xref ref-type="bibr" rid="ref16 ref19 ref22 ref24 ref36">16, 19, 22, 24, 36</xref>
        ]. Theoretically, it has been proved that
the size of the given UIs can be exponentially three times larger than the size of
the input ontology [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. However, an evaluation in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] with real-world signatures
demonstrated that the size is less than the original ontology, with a precision rate
of 100% for all resulting UIs except for a few that contained de ner names [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        Computing UIs for focus set concepts produces ontologies too small to include
de nitions of the focus concepts. For example, computing a UI for A1: Hepatitis2
and A2:LargeLiver for the ontology in Figure 1, requires forgetting the rest of the
ontology's symbols. This results in the UI fA1 v &gt;, A2 v &gt;g, because the RHSs
of the de nitions of A1 and A2 are eliminated. More informative UIs can be
generated by rst extending the focus set using a signature extension algorithm
as in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. However, the resulting UIs had rewritten axioms (not in their original
form), which were not satisfactory for SNOMED CT users.
6
      </p>
    </sec>
    <sec id="sec-6">
      <title>Evaluation</title>
      <p>The goal of the evaluation is to test empirically the following three hypotheses
about our method: (1) The abstracted de nitions in the generated subontologies
are equivalent to their original de nitions when the input ontology is a
terminology (Section 6.1). (2) Abstracted de nitions aid in the reduction of axioms
deemed redundant in relation to the input focus set. The study of the signature
of the bottom modules demonstrates this (Section 6.2). (3) Subontologies are
smaller in size than bottom modules, and smaller or equal in size to the UIs
(Sections 6.2 and 6.3). To do this, we developed a Java prototype implementing our
method using the OWL API. 2 We employed two distinct ontologies, SNOMED
CT (July 2017) and the Gene ontology (GO) (February 2021). GO does not meet
the requirements of a terminology, as it may contain more than one axiom for
a concept name A. Both SNOMED CT and GO lack GCI axioms of the forms
C v A and C v D where C and D are E L-concepts.</p>
      <p>
        We compared the produced subontologies to the two extract types outlined in
Section 5: the ?-modules and the UIs. We computed UIs using a newly developed
UI tool for E LH ontologies [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. The ?-modules were generated using the OWL
API's built-in SLBM tool. The comparisons involve a size and precision rate
analysis of the generated extracts.
      </p>
      <p>SNOMED CT had a total of 335 245 logical axioms, 335 225 concept names
and 97 role names. The Gene ontology had a total of 102 203 logical axioms,
44 085 concept names,3 and 8 role names. Both ontologies are in the scope of
E LH, with the exception of one role chain axiom (r s v r) in SNOMED CT
and one inverse role, 29 disjoint classes, four transitive roles, and two role chain
axioms in the Gene ontology. Non E LH-axioms were omitted.</p>
      <p>
        As focus sets, we used ve sets of human and animal medical conditions for
computing SNOMED CT extracts used in the experiments of [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The
supplementary information of these experiments includes a list of 20{40 concept names
for each of the medical conditions.4 Due to the small number of concept names
provided, we computed descendant concepts of these to increase the size of the
generated extracts, which can provide better insights into the types of extracts
we considered. As a result, the focus sets used consisted of 4401{14 828 concept
2 http://owlapi.sourceforge.net/
3 This number excludes 6 430 deprecated concepts that exist in the version 01-02-2021
4 https://tinyurl.com/medical-conditions-signature
10 G. Alghamdi et al.
      </p>
      <p>Table 1. Results of logical strength test of the abstracted de nitions of medical
conditions and gene slim focus sets in Snomed CT (SCT) and Gene Ontology (GO),
respectively.</p>
      <p>
        Quality criteria
Focus set
Anaemia (SCT)
Arthritis (SCT)
Diabetes (SCT)
Hypertension (SCT)
Obesity (SCT)
goslim mouse (GO)
goslim pir (GO)
goslim plant (GO)
goslim pombe (GO)
goslim yeast (GO)
names. For the Gene ontology, we used ve focus sets of the GO slim sets
provided in [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. Each set represents a at list of concept and role names that are
speci c to certain species or organisms. All experimental data used in this study
is available at https://tinyurl.com/evaluation-data.
      </p>
      <p>Given how the three methods work, we used the following input sets to
generate the di erent extracts: (1) The focus set was used as the input signature
for computing the bottom modules and subontologies, because both SLBM and
our subontology generation method extend the signature as needed. (2) As input
to the UI method, we used the signatures of the computed subontologies. As
mentioned, UIs for focus sets would not adequately capture their de nitions.
6.1</p>
      <p>Logical Strength of the Upwardly Abstracted De nitions
To determine the logical strength of the generated abstracted de nitions, the
test of De nition 4 was used. We found that when using SNOMED CT to
compute subontologies, the abstracted de nitions generated have the same logical
strength as the original de nitions. This is because SNOMED CT is a
terminology that includes no more than one concept de nition for a concept name A.
On the other hand, when the Gene ontology is used, the abstracted de nitions
derived may be weaker than the original de nitions. The count numbers of the
logical strength of the abstracted de nitions in the subontologies of SNOMED
CT and the Gene ontology are shown in Table 1.</p>
      <p>Subontology Results Against Bottom SLBM
Table 2 shows that the number of symbols (concepts and roles) in the bottom
modules were signi cantly larger than those in the subontologies. The average
numbers of logical axioms, concepts, and roles in SNOMED CT's subontologies
were 36.04%, 36.35%, and 39.79% less than the average numbers of those in the
bottom modules, respectively.</p>
      <p>
        Table 3 shows the computed values for Precision and Region for each bottom
module, as well as the number of signatures for subontologies denoted by jsig(S)j
and for bottom modules denoted by jsig(M)j for each SNOMED CT and Gene
ontology focus set. We use the formula given in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] to de ne Precision(extract, S)
as (j(sig(S)\ sig(extract))j [ f&gt;g=jsig(extract)j). This gives the ratio of relevant
symbols that occur in the signature of a subontology over the number of symbols
in an extract. We regard an extract to be precise if it contains no symbols
that are not part of the subontology's signature. This is because subontologies'
signatures correspond to the focus set de nitions and supporting set inclusions,
which represent the necessary information about the input focus set that a user
is interested in. As can be seen from Table 3, precision ratings for the bottom
modules range between 28% and 84% for SNOMED CT focus sets and are almost
half that for the Gene ontology focus sets (22%{41%).
      </p>
      <p>To quantify the bene ts of abstracting focus concepts' de nitions in terms of
reducing the size of an extract, we examined the set of symbols in the bottom
modules that occur outside the set of their corresponding subontologies'
signatures. Speci cally, we calculated the number of concepts that exist in the region
between the concepts in the focus set F and their closest primitive ancestors,
denoted by P F using the formula:</p>
      <p>Region( F , P F ) := (Ancestors of F \ Descendants of P F ).</p>
      <p>The de nitions of concepts found in the Region set can be viewed as redundant
information in relation to the input focus set de nitions. This is because de
nitions of concepts in the Region set should carry the same information that the
abstracted de nitions of focus concepts inherit, which is especially true when the
input ontology is a terminology. Thus, incorporating de nitions of focus concepts
following abstraction is su cient for including information that is genuinely
important in the extract, as the abstraction process aids in the inclusion of all of
the focus concept's de ning characteristics. As can be observed from Table 3,
99.9% of concepts that exist outside the subontology's signature in the Diabetes
bottom module occur in the Region set, demonstrating that the size of such an
extract can be greatly reduced by abstracting the de nitions of focus concepts
to their closest primitive ancestors.
6.3</p>
      <p>
        Subontology Results Against UI
The UI tool was unable to generate views for the SNOMED CT medical
conditions focus sets (Table 2). This is due to the fact that forgetting becomes more
di cult when the input signature is small in comparison to the source ontology's
signature, particularly when forgetting from a very complex, large ontology such
as SNOMED CT [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>As shown in Table 2, the number of concepts and roles for subontologies and
UIs for the Gene ontology focus sets coincide, as the UIs were computed for the
subontologies' signatures, con rming the expected 100% precision of UI. On the
other hand, the results show that the number of logical axioms in UIs is greater
than that in subontologies. There are two main explanations for this observation.
The rst is that the UI method has incorporated inferred axioms of the form
C v A, where A denotes a focus or a supporting concept name. For example,
forgetting B1 and B2 from B1 C, B1 v B2, B2 v A, where all symbols in C
are in the signature of the subontology, derives C v A. The second is that when
a focus concept A is described by multiple axioms, our method generated an
abstracted de nition that condenses these multiple axioms into a single axiom.
For instance, the UI might contain two axioms for A, A C1 and A v C2, while
our method infers the axiom A C1 u C2, which results in fewer axioms in the
subontology, but can also result in a weaker de nition for A.
7</p>
    </sec>
    <sec id="sec-7">
      <title>Conclusion</title>
      <p>We presented a method of extracting subontologies, which is based on abstracted
de nitions for given sets of focus symbols. Such abstracted de nitions are
motivated by normal forms used in proximal primitive modelling in the SNOMED
CT community. We empirically demonstrated that when the input ontology is a
terminology, the method generates equivalent focus set subontologies; however,
when the input ontology is not a terminology, the method may yield
subontologies with weaker de nitions.</p>
      <p>In comparison to bottom modules, our abstracted de nition-based
subontologies contain signi cantly fewer supporting set symbols and contained fewer
axioms. The sizes of the Region set in the bottom modules give additional
insights into why the notion of abstracted de nitions in subontologies produce
signi cantly smaller extracts than bottom modules while retaining all of the
de ning characteristics of the focus set concepts.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Arguello-Casteleiro</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Des-Diz</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wroe</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fernandez-Prieto</surname>
            ,
            <given-names>M.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maroto</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maseda-Fernandez</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Demetriou</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peters</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Noble</surname>
            ,
            <given-names>P.J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jones</surname>
            ,
            <given-names>P.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dukes-McEwan</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Radford</surname>
            ,
            <given-names>A.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Keane</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nenadic</surname>
          </string-name>
          , G.:
          <article-title>Exploring semantic deep learning for building reliable and reusable one health knowledge from pubmed systematic reviews and veterinary clinical notes</article-title>
          .
          <source>Journal of Biomedical Semantics</source>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Baader</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lutz</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          :
          <article-title>An Introduction to Description Logic</article-title>
          . Cambridge University Press (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alghamdi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walther</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gao</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Modularity Meets Forgetting: A Case Study with the SNOMED CT Ontology</article-title>
          .
          <source>In: Proceedings of the 32nd International Workshop on Description Logics</source>
          . vol.
          <volume>2373</volume>
          .
          <string-name>
            <surname>CEUR-WS.org</surname>
          </string-name>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alghamdi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walther</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gao</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Ontology extraction for large ontologies via modularity and forgetting</article-title>
          .
          <source>In: Proceedings of the 10th International Conference on Knowledge Capture, K-CAP</source>
          . pp.
          <volume>45</volume>
          {
          <fpage>52</fpage>
          .
          <string-name>
            <surname>ACM</surname>
          </string-name>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Cornet</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abu-Hanna</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Auditing description-logic-based medical terminological systems by detecting equivalent concept de nitions</article-title>
          .
          <source>International Journal of Medical Informatics 77 5</source>
          ,
          <issue>336</issue>
          {
          <fpage>45</fpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Cuenca</given-names>
            <surname>Grau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Motik</surname>
          </string-name>
          ,
          <string-name>
            <surname>B.</surname>
          </string-name>
          :
          <article-title>Reasoning over Ontologies with Hidden Content: The Import-by-Query Approach</article-title>
          .
          <source>Journal of Arti cial Intelligence Research abs/1401</source>
          .5853 (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Eilbeck</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewis</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mungall</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yandell</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stein</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Durbin</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ashburner</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>The Sequence Ontology: a tool for the uni cation of genome annotations</article-title>
          .
          <source>Genome biology 6</source>
          ,
          <issue>R44</issue>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Garcia</surname>
            ,
            <given-names>A.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tiveron</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Justel</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cavalcanti</surname>
            ,
            <given-names>M.C.</given-names>
          </string-name>
          :
          <article-title>Applying Graph Partitioning Techniques to Modularize Large Ontologies</article-title>
          .
          <source>In: ONTOBRAS-MOST</source>
          . vol.
          <volume>938</volume>
          , pp.
          <volume>72</volume>
          {
          <fpage>83</fpage>
          . CEUR Workshop Proceedings (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Golbeck</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fragoso</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hartel</surname>
            ,
            <given-names>F.W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oberthaler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>The National Cancer Institute's Thesaurus and Ontology</article-title>
          .
          <source>J. Web Semant</source>
          .
          <volume>1</volume>
          ,
          <issue>75</issue>
          {
          <fpage>80</fpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Grau</surname>
            ,
            <given-names>B.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kazakov</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          :
          <article-title>Modular Reuse of Ontologies: Theory and Practice</article-title>
          .
          <source>J. Artif. Intell. Res</source>
          .
          <volume>31</volume>
          ,
          <issue>273</issue>
          {
          <fpage>318</fpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Harry</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Primitive parent modelling</article-title>
          . https://confluence.ihtsdotools.org/ display/DOCEG/Proximal+Primitive+Modeling, SNOMED International, Accessed:
          <fpage>2021</fpage>
          -05-23
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Hastings</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Owen</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dekker</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ennis</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kale</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Muthukrishnan</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Turner</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Swainston</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mendes</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Steinbeck</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          : ChEBI in 2016:
          <article-title>Improved services and an expanding collection of metabolites</article-title>
          .
          <source>Nucleic Acids Research</source>
          <volume>44</volume>
          , pp.
          <source>D1214 { D1219</source>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bechhofer</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The OWL API: A Java API for Working with OWL 2 Ontologies</article-title>
          . In
          <source>: Proceedings of the 6th International Conference on OWL: Experiences and Directions</source>
          . vol.
          <volume>2</volume>
          , pp.
          <volume>11</volume>
          {
          <issue>21</issue>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Kazakov</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          , Krotzsch,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Simancik</surname>
          </string-name>
          ,
          <string-name>
            <surname>F.</surname>
          </string-name>
          :
          <article-title>The Incredible ELK - From Polynomial Procedures to E cient Reasoning with E L Ontologies</article-title>
          . J.
          <string-name>
            <surname>Autom</surname>
          </string-name>
          . Reason.
          <volume>53</volume>
          ,
          <issue>1</issue>
          {
          <fpage>61</fpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Konev</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ludwig</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walther</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>The Logical Di erence for the Lightweight Description Logic EL</article-title>
          .
          <source>Journal of Arti cial Intelligence Research</source>
          <volume>44</volume>
          ,
          <volume>633</volume>
          {
          <fpage>708</fpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Konev</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walther</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Forgetting and Uniform Interpolation in LargeScale Description Logic Terminologies</article-title>
          .
          <source>In: Proceedings of the 21st International Joint Conference on Arti cial Intelligence</source>
          , Pasadena, California, USA,
          <source>July (IJCAI)</source>
          . pp.
          <volume>830</volume>
          {
          <issue>835</issue>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Konev</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lutz</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walther</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Model-theoretic Inseparability and Modularity of Description Logic Ontologies</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>203</volume>
          ,
          <issue>66</issue>
          {
          <fpage>103</fpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Konev</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walther</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>The Logical Di erence Problem for Description Logic Terminologies</article-title>
          .
          <source>In: Automated Reasoning</source>
          . vol.
          <volume>5195</volume>
          , pp.
          <volume>259</volume>
          {
          <fpage>274</fpage>
          . Springer (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Koopmann</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          :
          <article-title>Forgetting Concept and Role Symbols in ALCHOntologies</article-title>
          .
          <source>In: Proc. of LPAR'13</source>
          . vol.
          <volume>8312</volume>
          , pp.
          <volume>552</volume>
          {
          <fpage>567</fpage>
          . Springer (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lu</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alghamdi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhao</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Tracking Semantic Evolutionary Changes in Large-Scale Ontological Knowledge Bases</article-title>
          . To appear
          <source>in the 30th ACM International Conference on Information and Knowledge Management (CIKM)</source>
          (
          <year>2021</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Lopez-Garc</surname>
            <given-names>a</given-names>
          </string-name>
          , P.,
          <string-name>
            <surname>Boeker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Illarramendi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schulz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Usability-driven pruning of large ontologies: the case of SNOMED CT</article-title>
          .
          <source>Journal of the American Medical Informatics Association</source>
          <volume>19</volume>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Ludwig</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konev</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Practical Uniform Interpolation and Forgetting for ALC TBoxes with Applications to Logical Di erence</article-title>
          .
          <source>In: Principles of Knowledge Representation and Reasoning: Proceedings of the Fourteenth International Conference, KR 2014</source>
          , Vienna, Austria. AAAI Press (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Lutz</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Foundations for Uniform Interpolation and Forgetting in Expressive Description Logics</article-title>
          .
          <source>In: IJCAI 2011, Proceedings of the 22nd International Joint Conference on Arti cial Intelligence</source>
          , Barcelona, Catalonia, Spain. pp.
          <volume>989</volume>
          {
          <fpage>995</fpage>
          . IJCAI/AAAI (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Nikitina</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rudolph</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>(Non-)Succinctness of uniform interpolants of general terminologies in the description logic EL</article-title>
          .
          <source>Artif. Intell</source>
          .
          <volume>215</volume>
          ,
          <issue>120</issue>
          {
          <fpage>140</fpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Rector</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Coordinating Taxonomies: Key to Re-Usable Concept Representations</article-title>
          .
          <source>In: Proceedings of Arti cial Intelligence Medicine, 5th Conference on Arti cial Intelligence in Medicine in Europe, AIME'95</source>
          ,
          <string-name>
            <surname>Pavia</surname>
          </string-name>
          , Italy. vol.
          <volume>934</volume>
          , pp.
          <volume>17</volume>
          {
          <fpage>28</fpage>
          . Springer (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Sattler</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zakharyaschev</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <source>Which Kind of Module Should I Extract? In: Proceedings of the 22nd International Workshop on Description Logics (DL</source>
          <year>2009</year>
          ), Oxford, UK. vol.
          <volume>477</volume>
          .
          <string-name>
            <surname>CEUR-WS.org</surname>
          </string-name>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Spackman</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Normal forms for description logic expressions of clinical concepts in SNOMED RT</article-title>
          .
          <source>In: AMIA</source>
          <year>2001</year>
          , American Medical Informatics Association Annual Symposium, Washington, DC, USA. AMIA (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Spackman</surname>
            ,
            <given-names>K.A.</given-names>
          </string-name>
          :
          <article-title>SNOMED RT and SNOMED CT</article-title>
          .
          <article-title>Promise of an international clinical ontology</article-title>
          .
          <source>M.D. computing : computers in medical practice 17</source>
          ,
          <issue>29</issue>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29. The Gene Ontology Consortium: http://geneontology.org/docs/ go-subset-guide/, Accessed:
          <fpage>2021</fpage>
          -05-23
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <article-title>The Gene Ontology Consortium: The Gene Ontology Resource: 20 years and still GOing strong</article-title>
          .
          <source>Nucleic Acids Research</source>
          <volume>49</volume>
          ,
          <year>gky1055</year>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Ulrich</surname>
          </string-name>
          , B.: https://bit.ly/2RqRA9A, Accessed:
          <fpage>2021</fpage>
          -06-06
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Venkat-Raman</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tomson</surname>
            ,
            <given-names>C.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gao</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cornet</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stengel</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>GronhagenRiska</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Reid</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jacquelinet</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schae ner</surname>
          </string-name>
          , E.,
          <string-name>
            <surname>Boeschoten</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Casino</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Collart</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Meester</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zurriaga</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kramar</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jager</surname>
            ,
            <given-names>K.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Simpson</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>New primary renal diagnosis codes for the ERA-EDTA</article-title>
          .
          <source>Nephrology Dialysis Transplantation</source>
          <volume>27</volume>
          (
          <issue>12</issue>
          ),
          <volume>4414</volume>
          {
          <fpage>4419</fpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Vescovo</surname>
            ,
            <given-names>C.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klinov</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schneider</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsarkov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Empirical Study of Logic-Based Modules: Cheap Is Cheerful</article-title>
          .
          <source>In: Proceedings of the Semantic Web - ISWC 2013 - 12th International Semantic Web Conference</source>
          , Sydney,
          <string-name>
            <surname>NSW</surname>
          </string-name>
          , Australia. vol.
          <volume>8218</volume>
          , pp.
          <volume>84</volume>
          {
          <fpage>100</fpage>
          . Springer (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Topor</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pan</surname>
          </string-name>
          , J.:
          <article-title>Forgetting for knowledge bases in DL-Lite</article-title>
          .
          <source>Annals of Mathematics and Arti cial Intelligence</source>
          <volume>58</volume>
          (
          <issue>1-2</issue>
          ),
          <volume>117</volume>
          {
          <fpage>151</fpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Younesi</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malhotra</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , Gundel,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Scordis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Kodamullil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.T.</given-names>
            ,
            <surname>Page</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          , Muller,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Springstubbe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            , Wullner, U.,
            <surname>Scheller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Hofmann-Apitius</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.:</surname>
          </string-name>
          <article-title>PDON: Parkinson's disease ontology for representation and modeling of the Parkinson's disease knowledge domain</article-title>
          .
          <source>Theoretical Biology &amp; Medical Modelling (1)</source>
          ,
          <volume>1</volume>
          {
          <fpage>17</fpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Zhao</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          :
          <article-title>On Concept Forgetting in Description Logics with Quali ed Number Restrictions</article-title>
          .
          <source>In: Proceedings of the Twenty-Seventh International Joint Conference on Arti cial Intelligence</source>
          ,
          <source>IJCAI</source>
          <year>2018</year>
          , Stockholm, Sweden. pp.
          <year>1984</year>
          {
          <year>1990</year>
          . ijcai.
          <source>org</source>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>