<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>On the Complexity of Finding Good Proofs for Description Logic Entailments</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Christian Alrabbaa</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Franz Baader</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stefan Borgwardt</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Patrick Koopmann</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alisa Kovtunova</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Theoretical Computer Science</institution>
          ,
          <addr-line>TU Dresden</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>If a Description Logic (DL) system derives a consequence, then one can in principle explain such an entailment by presenting a proof of the consequence in an appropriate calculus. Intuitively, good proofs are ones that are simple enough to be comprehensible to a user of the system. In recent work, we have introduced a general framework in which proofs are represented as labeled, directed hypergraphs, and have investigated the complexity of finding small proofs. However, large size is not the only reason that can make a proof complex. In the present paper, we introduce other measures for the complexity of a proof, and analyze the computational complexity of deciding whether a given consequence has a proof of complexity at most q. This problem can be NP-complete even for EL, but we also identify measures where it can be decided in polynomial time.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Introduction
The first work on explaining DL entailments is probably the PhD thesis of
McGuinness [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], where the results obtained by the structural subsumption
algorithm of the CLASSIC system [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] are translated into proofs in a formal calculus.
The thesis also investigates how to create shorter, better understandable proofs
by pruning away unimportant parts. In [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], proofs of subsumptions generated
by a tableau-based system are translated into sequent proofs. The authors then
investigate how to make the sequent proofs shorter. More recent work on
explaining DL entailment was often focused on computing so-called justifications,
i.e., minimal subsets of the knowledge base (KB) from which the consequence in
question follows (see, e.g., [
        <xref ref-type="bibr" rid="ref12 ref24 ref4">4, 12, 24</xref>
        ]). The basic assumption is here that, whereas
KBs may be very large and have many consequences, a single consequence often
follows from a small subset of the KB by an easy derivation. While this is true in
certain applications [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], in general it may be quite hard for a user to see without
help why a consequence follows from a given justification [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. On the one hand,
this has triggered research into assessing the complexity of a justification, i.e.,
how hard it is to derive the given consequence from the justification [
        <xref ref-type="bibr" rid="ref13 ref19">13, 19</xref>
        ]. On
the other hand, it has rekindled the interest in generating proofs appropriate for
Copyright c 2020 for this paper by its authors. Use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).
human consumption. For example, the explanation plugin for the ontology editor
Protégé described in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] cannot only produce justfications, but can also display
proofs, provided that proofs of an appropriate form are returned by the employed
reasoner, an assumption that is, e.g., satisfied by the reasoner ELK [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. While
these proofs are represented in the formal syntax employed by Protégé, the work
reported in [
        <xref ref-type="bibr" rid="ref19 ref22 ref23">19, 22, 23</xref>
        ] uses ontology verbalization techniques to translate proofs
into natural language text.
      </p>
      <p>
        Recently, we have investigated the complexity of deciding whether proofs of
a certain size exist, which is measured in the number of steps involved in the
proof [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Instead of concentrating on a specific DL and proof calculus or reasoner
for this DL, we used a general framework in which proofs are represented as
labeled, directed, acyclic hypergraphs whose vertices are labeled with axioms
and hyperedges correspond to sound derivation steps. Note that such proofs
need not be tree-shaped since a single axiom can be reused in multiple inference
steps, thereby reducing the overall size of the proof. To abstract away from
implementation details, we assume that a reasoner (called deriver to distinguish
it from an actual implemented system) generates a so-called derivation structure,
which consists of possible proof steps, from which actual proofs can be constructed.
For example, if we consider the consequence-based reasoning approaches for the
DLs EL and E LI described in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], then we could obtain a derivation structure
for a given KB and consequence by collecting all (finitely many) instantiated
classification rules. The EL reasoner ELK actually returns such a derivation
structure, which however only contains the rule instances that have actually been
used during the reasoning process.
      </p>
      <p>
        In this paper, we extend the results of [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] by considering more measures
of proof complexity (other than size), with the ultimate goal of finding proofs
that are easy to understand for users. In a recent user study [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], for example, it
was observed that proof understandability can be influenced by the structure
(e.g. linear vs. several independent reasoning threads), the complexity of the
individual reasoning steps (e.g. whether a combination of quantifiers is involved),
the representation of the domain (e.g. abstract concept and role names vs. long
domain-specific names), and the overall format (e.g. graphical vs. textual).
      </p>
      <p>
        In this paper, we consider a few possible approaches to defining proof
complexity, where we focus on the overall structure of the proof. For this reason, we
are not interested in the complexity/weight of individual axioms or inference
steps, which has already been investigated in the literature [
        <xref ref-type="bibr" rid="ref13 ref20">13, 20</xref>
        ]. For most of
the paper, we use the size of an axiom (or group of axioms) as a proxy for their
complexity, but it is easy to substitute other measures from the literature.
      </p>
      <p>
        We now list a few approaches for defining proof complexity, which we discuss
throughout this paper.
1. A proof is at least as hard to understand as its hardest axiom.
2. The complexity of a proof is the sum (product, average, . . . ) of all weights of
its axioms.
3. As a special case of the previous item, the number of axioms constituting
the proof defines its complexity.
4. The hardness of a proof corresponds to its (weighted) tree size, i.e., the
number (weighted sum) of vertices in its tree unraveling [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
5. A proof is as hard to understand as the hardest inference step.
6. The hardness of a proof is the sum (product, average, . . . ) of inference step
weights.
7. Proof complexity is determined by the number of TBox axioms that are used,
i.e., the size of a corresponding justification.
8. A proof is more complex if there are more inference steps between the TBox
axioms and the conclusion. We could compute the maximal distance (depth),
or the maximal sum of weights along such a path.
9. A linear proof is easier to follow, hence we could measure the pathwidth of a
proof (when viewing a proof as an undirected graph obtained by replacing
each directed hyperedge with several undirected edges between the conclusion
and each premise).
10. We could consider a similary adapted notion of (undirected) treewidth as a
measure for the complexity of a proof, which reflects its degree of connectivity.
11. Multiple adjacent reasoning steps using the same rule schema are easier
to understand than when these steps are interspersed with other types of
inference rules.
12. For the presentation to a user, it may also be relevant whether a proof is
planar, i.e., it can be drawn without intersecting (hyper)edges.
      </p>
      <p>
        There are of course many more ways in which “proof complexity” could be
measured. This paper takes a few steps towards classifying the complexity of
finding “best” proofs w.r.t. any such measure. Before we can introduce this
problem formally, we recall the basic definitions from [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
2
      </p>
      <p>
        Preliminaries
We assume a basic familiarity with description logics [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Most of our theoretical
discussions apply to an arbitrary (description) logic; from now on, we fix one
such logic L, where we focus on the terminological part, i.e., the TBox. Following
the notation from [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], SL denotes all TBox axioms that can be formulated in L.
We assume that the size |α| of such an axiom α is defined in some way, e.g. by
the number of symbols in α. Given a TBox T and axiom α, a justification for α
in T is a minimal subset J ⊆ T such that J |= α. Already for EL-ontologies, for
which finding a single justification is possible in polynomial time, there may be
still exponentially many justifications, and finding a justification of size ≤ n is
NP-complete [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>While justifications can pinpoint the reasons for an entailment in a TBox, we
are interested in more detailed proofs such as, for example, the one in Figure 1.
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>Hypergraphs</title>
      <sec id="sec-2-1">
        <title>As in [1], we view proofs as directed hypergraphs.</title>
        <p>
          Definition 1 (Hypergraph). A (finite, directed, labeled) hypergraph [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ] is
a triple H = (V, E, `), where
– V is a finite set of vertices,
– E is a set of hyperedges (S, d) with source vertices S ⊆ V and target vertex
d ∈ V , and
– ` : V → SL is a labeling function that assigns axioms to vertices.
The size of H, denoted |H|, is measured by the size of the labels of its hyperedges:
|H| :=
        </p>
        <p>X |(S, d)|, where |(S, d)| := |`(d)| +</p>
        <p>X|`(v)|.
(S,d)∈E
v∈S
A vertex v ∈ V is called a leaf if it has no incoming hyperedges, i.e., there is
no (S, v) ∈ E, and v is a sink if it has no outgoing hyperedges, i.e., there is no
(S, d) ∈ E such that v ∈ S. We denote the set of all leafs and the set of all sinks
in H as leaf (H) and sink(H), respectively.</p>
        <p>A hypergraph H0 = (V 0, E0, `0) is called a subgraph of H = (V, E, `) if V 0 ⊆ V ,
E0 ⊆ E and `0 = `|V 0 . In this case, we also say that H contains H0 and write
H0 ⊆ H. Given two hypergraphs H1 = (V1, E1, `1) and H2 = (V2, E2, `2) s.t.
`1(v) = `2(v) for every v ∈ V1 ∩ V2, their union is defined as H1 ∪ H2 :=
(V1 ∪ V2, E1 ∪ E2, `1 ∪ `2).</p>
        <p>Definition 2 (Cycle, Tree). Given a hypergraph H = (V, E, `) and s, t ∈ V , a
path P of length q &gt; 0 in H from s to t is a sequence of vertices and hyperedges</p>
        <p>P = (d0, (S1, d1), d1, (S2, d2), . . . , dq−1, (Sq, dq), dq),
where d0 = s, dq = t, and dj−1 ∈ Sj for all j, 1 ≤ j ≤ q. If there is such a path
in H, we say that t is reachable from s in H. If t = s, then P is called a cycle.
The hypergraph H is acyclic if it does not contain a cycle. The hypergraph H is
connected if every vertex is connected to every other vertex by a series of paths
and reverse paths.</p>
        <p>A tree H = (V, E, `) with root t ∈ V is a hypergraph in which t is a sink and
is reachable from every vertex v ∈ V \ {t} by exactly one path.</p>
        <p>In particular, the root is the only sink in a tree, and all trees are acyclic and
connected.</p>
        <p>Definition 3 (Homomorphism). Let H = (V, E, `), H0 = (V 0, E0, `0) be two
hypergraphs. A homomorphism from H to H0, denoted h : H → H0, is a mapping
h : V → V 0 s.t. for all (S, d) ∈ E, one has h(S, d) := ({h(v) | v ∈ S}, h(d)) ∈ E0
and, for all v ∈ V , it holds that `0(h(v)) = `(v). Such an h is an isomorphism if
it is a bijection and, its inverse, h− : H0 → H, is also a homomorphism.
A v B</p>
        <p>B v ∃r.A
– grounded, i.e., every leaf v in D is labeled by `(v) ∈ T ; and
– sound, i.e., for every (S, d) ∈ E, the entailment {`(s) | s ∈ S} |= `(d) holds.
We now define proofs as special derivation structures that derive a goal axiom.
Definition 5 (Proof). Given an axiom η and a TBox T , a proof for T |= η is
a derivation structure P = (V, E, `) over T that
– contains exactly one sink vη ∈ V , which is labeled by η, and
– is acyclic.</p>
        <p>A tree proof is a proof that is a tree. A subproof of a hypergraph H is a subgraph
of H that is a proof.
– leaf (P−v) = leaf (P) ∪ {v} and
– sink(P−v) = sink(P).</p>
        <p>Intuitively, we obtain P−v by removing every vertex from P from which every
path to the sink goes through v. P−v need not be a proof since v is now a leaf,
but `(v) may not be an axiom from T . Finally, for a proof P0 = (V 0, E0, `0) with
sink v such that V ∩ V 0 = {v} and `(v) = `0(v), we define the proof P[v 7→ P0] as
P−v ∪ P0. The intuitive idea here is that v, as every vertex in V , is labeled with
an axiom that has its own proof above it. And P−v is obtained by removing the
proof above v; vertices are kept only if they are used to prove other vertices in P.
Then, P[v 7→ P0] is the result of “replacing” the proof above v by P0. Moreover,
since P and P0 have only one vertex in common, it is guaranteed that the resulted
hypergraph P[v 7→ P0] is acyclic. Additionally, unravelling P into a tree can be
seen as the result of recursively applying P[v 7→ Pv] to every vertex v in P.
2.3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Derivers</title>
      <p>
        As in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], we rely on a deriver (imagine a DL reasoner) that, given a TBox T
and a goal axiom η, produces a derivation structure D that contains “all possible
proofs”. This structure describes all instances of inference rules that are relevant
for constructing proofs for η, without us having to know how inferences are
performed. The quest for a good proof thus becomes a search for a good proof
expressible by the inference steps in D. Since reasoners may not be complete for
proving arbitrary axioms of L, we restrict η to a subset CL ⊆ SL of supported
consequences.
      </p>
      <p>Definition 6 (Deriver). A deriver D is given by a set CL ⊆ SL and a
function that assigns derivation structures to pairs (T , η) of TBoxes T ⊆ SL and
axioms η ∈ CL, such that T |= η iff D(T , η) contains a proof for T |= η. A
proof P for T |= η is called admissible w.r.t. D(T , η) if there is a homomorphism
h : P → D(T , η). We call D a polynomial deriver if there exists a polynomial p(x)
such that the size of D(T , η) is bounded by p(|T | + |η|).</p>
      <p>We assume w.l.o.g. that D(T , η) does not contain two vertices with the same
label; this does not affect our results.</p>
      <p>
        Elk [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] can be seen as a polynomial deriver for EL in this sense, because it
allows to instantiate the inference rules with only a polynomial number of
ELconcepts, namely the subconcepts appearing in T or η. The derivation structure
Elk(T , η) contains all allowed instances of these rules, where each axiom is
represented by a unique vertex. Since the number of premises in each rule is
bounded by 2, the size of this structure is polynomial. Elk is complete only
for goal axioms of the form C v D, where D is a concept name and C is a
subconcept from T . To prove other kinds of entailments T |= η, one first has to
adapt T and η, thus leading to a different derivation structure Elk(T , η).
      </p>
      <p>
        There are consequence-based derivers for other DLs, but they may not be
polynomial [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. In [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], we described a polynomial deriver for expressive description
logics that is based on forgetting [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] and may take double-exponential time to
compute the polynomial derivation structure D(T , η). In [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], we also investigated
exponential derivers, but here we focus on the case of polynomial derivers.
      </p>
      <p>Measuring Proof Complexity
Taking into consideration the variety of examples in the introduction, we define
a general class of complexity measures for proofs. Our goal is to find proofs that
minimize these measures, i.e., lower numbers are better.</p>
      <p>Definition 7. A (complexity) measure is a function m : PL → Q≥0, where PL is
the set of all proofs over L and Q≥0 is the set of non-negative rational numbers.</p>
      <p>We call m a Ψ-measure if, for every P ∈ PL,
[P] m(P) is computable in polynomial time in the size of P,
[SI] every subproof of a homomorphic image of P weighs no more than P, i.e.,
m(P00) ≤ m(P) for any homomorphism h : P → P0 and P00 ⊆ h(P) such
that P00 ∈ PL.</p>
      <p>Intuitively, a Ψ-measure m does not increase when the proof gets smaller, either
when parts of the proof are removed (i.e., for a subproof) or when parts are
merged (i.e., for a homomorphic image). We cannot replace the property [SI]
by two separate properties for each of these cases since the image of a proof P
may not be acyclic, but has relevant acyclic subgraphs that should also not have
larger weight than P. Due to [SI], there always exists a proof P for T |= η that
is minimal w.r.t. m as well as non-redundant, i.e., there is no subproof P0 ⊂ P
for T |= η. Moreover, two isomorphic proofs have the same weight w.r.t. m.</p>
      <p>In Table 1, we provide examples of how the complexity measures from the
introduction can be defined formally, where by P ∈ P we denote that P is a
path in P, and by |P | the length of P . Since P is acyclic, there is always at least
one such path. In this table, we use the size of an axiom or edge as a proxy for
its complexity; other values from Q≥0 could be used instead. The table covers all
measures from the introduction except for Items 4 and 9–12. Tree size (Item 4)
is defined recursively; we discuss this measure in the context of a more general
family of “local” measures later in Section 4.</p>
      <p>Lemma 8. Tree size and all measures in Table 1 except for depth and worst
path are Ψ-measures. Indeed, depth, worst path and treewidth do not satisfy
[SI].</p>
      <p>
        The remaining items (9–12) are not Ψ-measures: the problems behind Items 9
and 10, i.e., to determine the pathwidth or treewidth for proofs which are graphs
are NP-hard [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Moreover, note that treewidth is not interesting in our context,
since we can always obtain a tree-shaped proof (with minimal treewidth 1) by
unraveling. A similar argument applies to Item 12 (planarity) since every tree is
planar. We will discuss Item 11 separately in Section 5.
      </p>
      <p>We now formally define our main problem: finding optimal admissible proofs
w.r.t. a measure m and D(T , η).</p>
      <p>Definition 9 (Optimal Proof). Let D be a deriver and m be a measure. Given
a TBox T and an axiom η ∈ CL, an admissible proof P w.r.t. D(T , η) is called
optimal w.r.t. m if m(P) is minimal among all such proofs. The associated
For the complexity analysis, we assume the deriver to be given in the form of a
method that allows to access elements of D(T , η). The complexity of this method
is not our concern here, we simply assume in the following that elements of
D(T , η) can be accessed in constant time. Since all of our complexity bounds
are at least P, our results remain the same for the derivers whose derivation
structure can be constructed in polynomial time even if we take the complexity
of computing the derivation structure into account.</p>
      <p>
        We can show that if P is optimal w.r.t. a Ψ-measure m and D(T , η), then the
homomorphic image of P in D(T , η) is also a proof. Thus, to decide OPΨ(D, m)
we can focus on proofs that are subgraphs of D(T , η). This is shown by the
following lemma, which generalizes a result from [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The full proof can be found
in the appendix.
      </p>
      <p>Lemma 10. For any Ψ-measure m, if there is an admissible proof P w.r.t.
D(T , η) with m(P) ≤ q for some q ∈ Q, then there exists a subproof Q of D(T , η)
for T |= η with m(Q) ≤ q.</p>
      <p>Proof (Sketch). Let P be any such proof. Then there is a homomorphism
h : P → D(T , η). If h(P) is a proof, then the claim immediately follows from [SI].
Otherwise, h(P) contains cycles, which must be due to different vertices in P
with the same label that are connected by a path. We can iteratively remove
such paths to obtain another proof P∗ that can be homomorphically mapped to
a subproof Q of h(P) ⊆ D(T , η), and therefore m(Q) ≤ m(P) ≤ q by [SI]. tu
In particular, this shows that an optimal proof always exists (recall that derivation
structures are always finite).</p>
      <p>We can now show the following generic upper bound for our decision problem.
Theorem 12. OPpΨoly(D, m) is in NP.</p>
      <p>
        Proof. We start by guessing a subgraph P of D(T , η). This can be done in
non-deterministic polynomial time in the size of D(T , η), which is polynomial
in the size of T and η. This subgraph P is necessarily sound, and checking the
remaining properties of Definitions 4 and 5 and that m(P) ≤ q can be done in
polynomial time in the size of P, in particular due to [P] in Definition 7. tu
Note that, one can similarly show an upper bound of NP for pathwidth, since
checking m(P) ≤ q is in NP [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. (First guessing P and then verifying m(P) ≤ q
can be performed by a polynomially bounded sequence of non-deterministic
steps.)
      </p>
      <p>
        Matching lower bounds hold for OPpoly(D, m) with a fixed D and m being
Ψ
vertex size [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] or justification size [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. As we already noted, all the complexity
measures from Table 1, including vertex size and justification size, are Ψ-measures.
Theorem 13 ([
        <xref ref-type="bibr" rid="ref1 ref4">1, 4</xref>
        ]). For m being vertex size or justification size, there is a
polynomial deriver D such that OPpoly(D, m) is NP-complete.
      </p>
      <p>Ψ
4</p>
      <p>
        Local Measures
In this section, we consider a property that allows us to reduce the upper bound
from NP to P. This also generalizes a result from [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Recall that intuitively,
P[v 7→ P0] denotes the result of replacing in P the proof above v by P0.
Definition 14. Let P = (V, E, `) be a proof and v ∈ V . We say that a Ψ-measure
m is local for v in P if for every proof Pv0 = (V 0, E0, `0) with sink v such that
V ∩ V 0 = {v}, `(v) = `0(v) and m(Pv0) ./ m(Pv), we have m(P[v 7→ Pv0]) ./ m(P),
for any choice of relation ./ ∈ {&lt;, ≤, =, ≥, &gt;}.
      </p>
      <p>A Ψ-measure m is local if it is local for every vertex in every proof.
Intuitively, if the measure is local, then we can replace subproofs by easier or
harder alternative proofs, and the weight of the full proof will change accordingly.
Measures that can be defined in a monotone, recursive way on the graph structure
usually have this property:</p>
      <p>m(H, v) := |`(v)| + P(S,v)∈E Pw∈S m(H, w).
– the measures hardest axiom, hardest inference step, from Table 1;
– tree size defined for an ayclic H = (V, E, `) by m(H) := Pv∈sink(H) m(H, v),
where m(H, v) := 1 + P(S,v)∈E Pw∈S m(H, w);
– weighted tree size, defined similarly by m(H) := Pv∈sink(H) m(H, v) with
As the names of the last two measures indicate, local measures cannot distinguish
between hypergraphs and their unravelings into trees, since unraveling of a proof
P can be seen as recursively computing P[v 7→ Pv] for all vertices v in P. That is</p>
      <sec id="sec-3-1">
        <title>Algorithm 1: A Dijkstra-like algorithm</title>
        <p>
          Input: A derivation structure D(T , η) = (V, E, `), a local Ψ-measure m
Output: An optimal proof of T |= η w.r.t. D(T , η) and m
the reason why they are especially well-suited for cases where proofs are presented
to users in the form of trees. This is for example the case for the Elk-proof
plugin for Protégé [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ].
        </p>
        <p>
          Algorithm 1 describes a Dijkstra-like approach that is inspired by the algorithm
in [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] for finding minimal hyperpaths w.r.t. so-called additive weighting functions,
which represent a subclass of local Ψ-measures. It progressively defines proofs
P(v) for `(v) that are contained in D(T , η). If it reaches a new vertex v in this
process, this vertex is added to the set Q. In each step, a vertex with minimal
weight m(P(v)) is chosen and removed from Q. Whenever all source vertices
of a hyperedge (S, d) have been processed in this way, a new proof for `(d) is
constructed by joining the proofs for the source vertices using the new hyperedge,
and this is compared to the best previously known proof for `(d). All proofs
constructed in this way are tree proofs, but this restriction does not matter since
m is local. For Line 18, recall that we assumed D(T , η) to contain no two vertices
with the same label, and hence it contains a unique vertex vη with label η.
Lemma 15. For any local Ψ-measure m and polynomial deriver D, Algorithm 1
computes an optimal proof in time polynomial in the size of T and η.
Proof (Sketch). The main argument is that the algorithm is monotone in the
sense that the smallest weight min{m(P(w)) | w ∈ Q} can never decrease. Hence,
easier proofs (according to m) will be constructed before harder ones. This shows
that each vertex v will be removed at most once from Q in Line 17, and hence
the algorithm terminates in polynomial time. Moreover, one can use the above
fact to show that whenever v is chosen in Line 9, then P(v) is a minimal proof
for `(v) in D(T , η). This step uses an inductive argument that is based on the
locality property of the measure m. Finally, by Lemma 10 we do not need to
consider proofs that are not contained in D(T , η). tu
Since we can actually compute an optimal proof in polynomial time, the following
complexity result follows.
        </p>
        <p>
          Theorem 16. For any local Ψ-measure m, OPpΨoly(D, m) is in P.
A matching lower bound was shown in [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] for the problem of finding an admissible
tree proof of minimal vertex size. This is equivalent to finding an arbitrary proof
of minimal tree size, since a tree proof (with the same tree size) can always be
obtained by unravelling, and for tree proofs the measures tree size and vertex
size coincide. Since tree size is a local Ψ-measure, we obtain the following.
Theorem 17 ([
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]). For m being tree size, there is a polynomial deriver D such
that OPpoly(D, m) is P-complete.
        </p>
        <p>Ψ
5</p>
        <p>Chunks
In this section, we discuss Item 11 from the introduction, which is part of ongoing
work. To define such a measure, we need to extend the definition of hypergraphs
by a function ρ that assigns to each hyperedge (S, d) a label, the idea being
that ρ(S, d) is the name of the inference rule that was instantiated to obtain the
inference step {`(s)|s∈S} . Based on this, we define the notion of chunks.</p>
        <p>`(d)
Definition 18. Given a proof P, a chunk of P is a maximal connected subgraph
H ⊆ P such that ρ(e) = ρ(e0) for all hyperedges e, e0 in H0.</p>
        <p>Every proof has a unique decomposition into chunks that do not share hyperedges.
A proof can thus be measured by the chunk count, which is the number of its
chunks. This measure follows the idea that proofs with less alternations between
inference rules are easier to understand. Consider for example proofs P1 and P2
depicted in Figure 4. Both are proofs for the same entailment A v ∃r.F , and P1
has three chunks, while P2 has only one (all inference steps follow the same rule
schema), hence P2 is easier to understand. Of course one can consider also more
complicated measures that also take the size of the chunks into account.</p>
        <p>Clearly, the measure satsifies [P]. However, we need extend the notion of
homomorphism to take into account the edge labeling function ρ. Nevertheless,
we conjecture that we can extend the NP upper bound in Section 3 to cover this
measure by carefully adapting Condition [SI]. Unfortunately, the chunk count is
not local, because it is not invariant under unraveling (which may copy a single
chunk into multiple ones).
A v F1 u F2</p>
        <p>A v F1</p>
        <p>F1 v ∃r.F2
A v ∃r.F2</p>
        <p>F2 v F
A v ∃r.F</p>
        <p>A v B</p>
        <p>A v C</p>
        <p>B v C
A v D</p>
        <p>C v D
A v E</p>
        <p>D v E
A v ∃r.F</p>
        <p>E v ∃r.F</p>
        <p>Fig. 4. Two proofs P1 (on the left) and P2 of the same entailment A v ∃r.F .
6</p>
        <p>
          Conclusion
We have investigated the complexity of finding optimal proofs for description logic
entailments w.r.t. a variety of measures. Obviously, size is not enough to evaluate
the difficulties users face when trying to understand proofs, and existing measures
for justification complexity (e.g. [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]) cannot capture the structural aspects of
this problem. We identified two classes of structural measures, Ψ-measures and
local Ψ-measures, and showed that finding optimal proofs w.r.t. such measures
is in NP and in P, respectively, for polynomial derivers. In the future, we will
investigate more measures, try to find more tractable subclasses, and identify
properties of measures that make them P-hard or NP-hard. Most importantly,
we will evaluate which measures are most relevant for practical purposes, to
actually help users understand description logic proofs.
        </p>
        <p>Acknowledgements This work was supported by the DFG in grant 389792660 as
part of TRR 248 (https://perspicuous-computing.science), and QuantLA,
GRK 1763 (https://lat.inf.tu-dresden.de/quantla). We also want to thank
the anonymous reviewers for their many helpful comments.</p>
        <p>Proofs
Lemma 8. Tree size and all measures in Table 1 except for depth and worst
path are Ψ-measures. Indeed, depth, worst path and treewidth do not satisfy
[SI].</p>
        <p>
          Proof. It should be easy to see that, given a proof P, all the measures in Table 1
can be computed according to the formulas in polynomial time in the size of P.
Tree size also satisfies the property [P], see [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ].
        </p>
        <p>Since a homomorphism preserves edges and vertex labels, weights
corresponding to the hardest, sum and size measures of subproofs of a homomorphic image
is no greater than the weight of the proof.</p>
        <p>In order to see why [SI] does not hold for depth and worst path, we use
the following example in Figure 5. For simplicity we omit vertex labeling; we
assume only `(v) = `(v0). Clearly, the graph on the left has depth 4, while its
homomorphic image and a subproof obtained by omitting the cycle on the right
have 5. A similar argument can be applied to worst path since depth is its special
case (when the weight of an edge is always equal to 1).</p>
        <p>The intuition behind why [SI] does not hold for treewidth is as follows. A
connected graph G has treewidth 1 if and only if it is a tree. However, its
homomorphic image of a tree is not necessary a tree. One can construct a tree
proof and a homomorphism s.t. there is a subproof in the homomorphic image
which is not a tree and, thus, has a treewidth greater than 1.</p>
        <p>Despite the strong connection between treewidth and pathwidth, i.e., for any
graph, its pathwidth is no smaller than its treewidth, we cannot conjecture a
similar result for pathwidth. Cycles (if any) created by a homomorphism which
also could increase pathwidth are not part of subrpoofs for [SI].
tu
Lemma 10. For any Ψ-measure m, if there is an admissible proof P w.r.t.
D(T , η) with m(P) ≤ q for some q ∈ Q, then there exists a subproof Q of D(T , η)
for T |= η with m(Q) ≤ q.</p>
        <p>Proof. Let P be such a proof with associated homomorphism h : P → D(T , η). If
h(P) is acyclic, then by [SI] in Definition 7 we have m(h(P)) ≤ m(P) ≤ q. Since
v
v0
h(v)
h(v0)</p>
        <p>Fig. 5. A homomorphism that increases depth and worst path of the graph
P has a unique sink vη, it must be mapped to a unique sink h(vη) in h(P), and
thus h(P) is the desired subproof of D(T , η).</p>
        <p>If h(P) is not acyclic, our goal is to find another admissible proof P∗ w.r.t.
D(T , η) that uses a subset of the vertices of P such that h(P∗) ⊆ h(P) is acyclic,
and therefore satisfies the requirements of the lemma by [SI] in Definition 7.
For this purpose, consider an arbitrary cycle in h(P), which must be due to two
vertices v, v0 in P such that h(v) = h(v0) and there is a path between v and v0
(or due to multiple such pairs of vertices). Since P is acyclic, we can assume that
there is a path from v to v0, but no path from v0 to v. We now consider the two
subproofs Pv and Pv0 . As there is a path from v to v0, we have Pv ⊂ Pv0 . Since
h(v) = h(v0), both vertices are labeled with the same axiom. The idea of the
following construction is to remove Pv0 from P and replace it with Pv, which
effectively removes all paths from v to v0.</p>
        <p>More formally, we first consider the hypergraph H = P−v0 ∪ Pv and then, in
the hyperedges (S, d) in H that still contain v0 ∈ S, we replace v0 by v, effectively
merging the two vertices, remove v0 from the set of vertices, and thus obtain a
hypergraph P0. If there was no such hyperedge, then v0 was the sink of P, i.e.,
`(v0) = η, and v will now be the new sink in P0 with `(v) = `(v0) = η. We now
show that P0 is also an admissible proof w.r.t. D(T , η). Our construction does not
produce new leafs, and hence P0 is still grounded. Clearly, all remaining edges are
sound since they were already sound in P. Moreover, P0 is acyclic since all cycles
in P0 can be traced back to paths in P that involve both v and v0; but we have
assumed that there are no paths from v0 to v, and have destroyed all paths from v
to v0. As argued above, we have also kept the property that there is exactly one
sink, which is labeled with η. Observe that h is also a homomorphism from P0
to D(T , η) (when restricted to the vertex set of P0), because h(v) = h(v0), and
moreover h(P0) ⊆ h(P).</p>
        <p>The resulting proof P0 has less vertices than P since we have removed
at least v0. This means that, after finitely many such operations, we can
obtain from P the desired proof P∗ such that h(P∗) ⊆ h(P) is acyclic. Since
h(P∗) also has a unique sink labeled by η, it is a subproof of D(T , η) and
m(h(P∗)) ≤ m(P) ≤ q by [SI] in Definition 7. tu
Corollary 11. If T |= η, then, for every deriver D and Ψ-measure m, there is
an optimal proof for T |= η w.r.t. D and m.</p>
        <p>Proof. By Definition 6, the derivation structure D(T , η) contains at least one
proof for T |= η. Since D(T , η) is finite, there are finitely many proofs for T |= η
contained in D(T , η). The finite set of all weights of these proofs always has
a minimum. Finally, if there were an admissible proof weighing less than this
minimum, it would contradict Lemma 10.
tu
Lemma 15. For any local Ψ-measure m and polynomial deriver D, Algorithm 1
computes an optimal proof in time polynomial in the size of T and η.</p>
      </sec>
      <sec id="sec-3-2">
        <title>Proof. We can show the following facts about this algorithm.</title>
        <p>(I) Whenever P(v) is defined, then it is a proof for `(v) contained in D(T , η).</p>
        <p>We prove this by induction on the order in which the hypergraphs P(v)
are constructed by Algorithm 1. The ones in Line 4 consist of a single
leaf v, which is labeled by a TBox axiom, and hence are sound, grounded,
acyclic, and have the single sink v. Similarly, P(v) in Line 6 is always a
proof since it consists of a single edge from D(T , η), has no leafs, and
has v as the only sink.</p>
        <p>Consider now the hypergraph P constructed in Line 14 as a possible
candidate for P(v) (where v = d). At this point, all P(s), s ∈ S, are
already defined since the counter k(e) can only reach |S| if each s ∈ S
has already been chosen in Line 9, and thus P(s) must have been defined.
Hence, by induction, each P(s) is a proof for `(s) contained in D(T , η),
and, because we assume that D(T , η) contains no two vertices with the
same label, must have s as sink. This shows that the hypergraph P
constructed in Line 14 is sound, grounded, and has a single sink, namely v.
Finally, P(v) is only updated to P in Line 17 if P is acyclic and therefore
it is a proof.
(II) If vertex v is chosen before vertex w in Line 9, then m(P(v)) ≤ m(P(w)).</p>
        <p>We show that after choosing v in Line 9 the algorithm cannot produce a
new proof P in Line 14 with m(P) &lt; m(P(v)), and thus the smallest weight
min{m(P(w)) | w ∈ Q} can never decrease. Consider the proof P from
Line 15. Since v ∈ S, we have P(v) ⊂ P, and therefore m(P(v)) ≤ m(P)
by [SI].
(III) Algorithm 1 terminates in polynomial time.</p>
        <p>Item (II) implies that each vertex v ∈ V can be removed from Q at most
once: in order for v to be added again to Q in Line 17, there would need to
exist a proof other than P(v) with the same sink v but a smaller weight,
but according to (II), after choosing v in Line 9, the algorithm does not
construct any proofs with a weight smaller than m(P(v)) (for any sink).
Therefore, in Line 14, during the complete run of the algorithm, each edge
(S, d) ∈ E will be used at most once. Moreover, all primitive operations in
the algorithm can be done in polynomial time, such as checking acyclicity
of hypergraphs in Line 15 or finding the minimal value m(P(v)) in Line 9.
It follows that Algorithm 1 terminates in time polynomial in the size
of D(T , η), which is polynomial in the size of T and η.
(IV) Every vertex v ∈ V that is the sink of a proof P contained in D(T , η) is
added to Q at some point.</p>
        <p>We prove this by induction on the structure of P. If P contains only v,
then either `(v) ∈ T , and hence v is added to Q in Line 4, or otherwise
there is an edge (∅, v) in P (and hence in E), in which case v is added
to Q in Line 6.</p>
        <p>If P has more than one vertex, then it must contain at least one edge
e = (S, v) ∈ E, where each s ∈ S is the sink of a subproof of P in D(T , η).
By induction we know that each s ∈ S is added to Q at some point during
the algorithm. By Item (III), they must also be removed from Q at some
point afterwards, and hence eventually k(e) reaches |S| in Line 13. If P(v)
was already defined at this point, then v had already been added to Q
earlier. Otherwise, v is now added to Q in Line 17.
(V) When the algorithm terminates and P(v) is defined, then m(P(v)) is
minimal among all proofs for `(v) contained in D(T , η).</p>
        <p>By (I), P(v) is a proof of this form. Assume to the contrary that there
is a proof P for `(v) contained in D(T , η) such that m(P) &lt; m(P(v)).
Then P and P(v) must both have the sink v, because we assume that
D(T , η) contains no two vertices with the same label. Assume moreover
that
i) P is an optimal proof for `(v), that is, m(P) ≤ m(P0) for every other
proof P0 for `(v) in D(T , η) (cf. Corollary 11), and
ii) among all other vertices v0 ∈ V for which there exists a proof P0
for `(v0) in D(T , η) such that m(P0) &lt; m(P(v0)), we also have
m(P) ≤ m(P0) and whenever m(P) = m(P0), then |P| ≤ |P0|.</p>
        <p>Since P is optimal, we know that it has a unique last inference step (S, v).
We show that, for every vertex w ∈ S, an optimal proof was assigned to
P(w) before v was chosen in Line 9. We first show that for every w ∈ S,
the subproof Pw must be similarly minimal.</p>
        <p>If this were not the case, then there would be a proof Pw0 for `(w)
in D(T , η) such that m(Pw0) &lt; m(Pw). But then, by locality, we have
m(P[w 7→ Pw00 ]) &lt; m(P), where Pw00 is constructed from Pw0 by renaming
all vertices except w. Since P[w 7→ Pw00 ] is an admissible proof for `(v)
w.r.t. D(T , η), by Lemma 10 we know that D(T , η) contains a proof P0
for `(v) with m(P0) ≤ m(P[w 7→ Pw00 ]) &lt; m(P), contradicting the
optimality of P. Hence, Pw must be optimal among all proofs for `(w) in
D(T , η).</p>
        <p>Moreover, by [SI], we have m(Pw) ≤ m(P) and |Pw| &lt; |P|. By
Assumption ii) and (IV), this means that P(w) is also optimal w.r.t. m among all
proofs for `(w) in D(T , η).</p>
        <p>Since both Pw and P(w) are optimal in this sense, we obtain that
m(P(w)) = m(Pw) ≤ m(P) &lt; m(P(v)),
which by (II) means that w must have been chosen (in Line 9) before v.
To summarize, for every vertex w ∈ S, we know that an optimal proof
for `(w) with weight m(Pw) has already been assigned to P(w) before v is
chosen in Line 9, and moreover each w ∈ S was chosen before v. But then,
for one of these vertices w (the last one to be processed), a proof P0 is
constructed from the subproofs P(w) and the edge (S, v) in Line 14. If we
consider the variant P00 of P0 where each of the subproofs P(w) is renamed
such that it shares only the vertex w with the rest of the proof, then
by locality we have m(P00) = m(P0). Moreover, since m(P(w)) = m(Pw)
holds for all w ∈ S, locality also yields that m(P00) = m(P). Since P0
was constructed as a candidate for P(v) by the algorithm, we know
that m(P(v)) ≤ m(P0) = m(P), which contradicts our assumption that
m(P) &lt; m(P(v)). We obtain that P(v) must be optimal.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Christian</given-names>
            <surname>Alrabbaa</surname>
          </string-name>
          , Franz Baader, Stefan Borgwardt, Patrick Koopmann, and
          <string-name>
            <given-names>Alisa</given-names>
            <surname>Kovtunova</surname>
          </string-name>
          .
          <article-title>Finding small proofs for description logic entailments: Theory and practice</article-title>
          .
          <source>In Elvira Albert and Laura Kovacs</source>
          , editors,
          <source>LPAR-23: 23rd International Conference on Logic for Programming</source>
          ,
          <source>Artificial Intelligence and Reasoning</source>
          , volume
          <volume>73</volume>
          of EPiC Series in Computing, pages
          <fpage>32</fpage>
          -
          <lpage>67</lpage>
          . EasyChair,
          <year>2020</year>
          . doi:
          <volume>10</volume>
          .29007/nhpp.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Stefan</given-names>
            <surname>Arnborg</surname>
          </string-name>
          , Derek G. Corneil, and
          <string-name>
            <given-names>Andrzej</given-names>
            <surname>Proskurowski</surname>
          </string-name>
          .
          <article-title>Complexity of finding embeddings in a k-tree</article-title>
          .
          <source>SIAM J. Algebraic Discrete Methods</source>
          ,
          <volume>8</volume>
          (
          <issue>2</issue>
          ):
          <fpage>277</fpage>
          -
          <lpage>284</lpage>
          ,
          <year>April 1987</year>
          . doi:
          <volume>10</volume>
          .1137/0608024.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Franz</given-names>
            <surname>Baader</surname>
          </string-name>
          , Ian Horrocks, Carsten Lutz, and
          <string-name>
            <given-names>Uli</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>An Introduction to Description Logic</article-title>
          . Cambridge University Press,
          <year>2017</year>
          . doi:
          <volume>10</volume>
          .1017/9781139025355.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Franz</given-names>
            <surname>Baader</surname>
          </string-name>
          , Rafael Peñaloza, and
          <string-name>
            <given-names>Boontawee</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Pinpointing in the description logic EL+</article-title>
          .
          <source>In KI 2007: Advances in Artificial Intelligence, 30th Annual German Conference on AI, KI</source>
          <year>2007</year>
          , Osnabrück, Germany,
          <source>September 10-13</source>
          ,
          <year>2007</year>
          , Proceedings, pages
          <fpage>52</fpage>
          -
          <lpage>67</lpage>
          ,
          <year>2007</year>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>540</fpage>
          -74565-
          <issue>5</issue>
          _
          <fpage>7</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Franz</given-names>
            <surname>Baader</surname>
          </string-name>
          and
          <string-name>
            <given-names>Boontawee</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          .
          <article-title>Debugging SNOMED CT using axiom pinpointing in the description logic EL+</article-title>
          .
          <source>In Proc. of the 3rd Conference on Knowledge Representation in Medicine (KR-MED</source>
          '08):
          <article-title>Representing and Sharing Knowledge Using SNOMED</article-title>
          , volume
          <volume>410</volume>
          <source>of CEUR-WS</source>
          ,
          <year>2008</year>
          . URL: http:// ceur-ws.
          <source>org/</source>
          Vol-
          <volume>410</volume>
          /Paper01.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Alexander</given-names>
            <surname>Borgida</surname>
          </string-name>
          , Enrico Franconi, and
          <string-name>
            <given-names>Ian</given-names>
            <surname>Horrocks</surname>
          </string-name>
          .
          <article-title>Explaining ALC subsumption</article-title>
          .
          <source>In ECAI 2000, Proceedings of the 14th European Conference on Artificial Intelligence</source>
          , Berlin, Germany,
          <source>August 20-25</source>
          ,
          <year>2000</year>
          , pages
          <fpage>209</fpage>
          -
          <lpage>213</lpage>
          ,
          <year>2000</year>
          . URL: http://www.frontiersinai.com/ecai/ecai2000/pdf/p0209.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Stefan</given-names>
            <surname>Borgwardt</surname>
          </string-name>
          , Anke Hirsch, Alisa Kovtunova, and
          <article-title>Frederik Wiehr. In the eye of the beholder: Which proofs are best?</article-title>
          <source>In Proc. of the 33th Int. Workshop on Description Logics (DL'20)</source>
          ,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Ronald</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Brachman</surname>
          </string-name>
          ,
          <string-name>
            <surname>Deborah L. McGuinness</surname>
          </string-name>
          ,
          <string-name>
            <surname>Peter F. Patel-Schneider</surname>
          </string-name>
          ,
          <article-title>Lori Alperin Resnick, and Alexander Borgida. Living with CLASSIC: When and how to use a KL-ONE-like language</article-title>
          . In John F. Sowa, editor,
          <source>Principles of Semantic Networks</source>
          , pages
          <fpage>401</fpage>
          -
          <lpage>456</lpage>
          . Morgan Kaufmann,
          <year>1991</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>David</given-names>
            <surname>Tena</surname>
          </string-name>
          <string-name>
            <surname>Cucala</surname>
          </string-name>
          ,
          <source>Bernardo Cuenca Grau, and Ian Horrocks</source>
          .
          <article-title>15 years of consequence-based reasoning</article-title>
          . In Description Logic,
          <string-name>
            <given-names>Theory</given-names>
            <surname>Combination</surname>
          </string-name>
          , and
          <string-name>
            <surname>All</surname>
          </string-name>
          That - Essays Dedicated to Franz
          <source>Baader on the Occasion of His 60th Birthday</source>
          , pages
          <fpage>573</fpage>
          -
          <lpage>587</lpage>
          ,
          <year>2019</year>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -22102-7_
          <fpage>27</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Giorgio</surname>
            <given-names>Gallo</given-names>
          </string-name>
          , Giustino Longo, and
          <string-name>
            <given-names>Stefano</given-names>
            <surname>Pallottino</surname>
          </string-name>
          .
          <article-title>Directed hypergraphs and applications</article-title>
          .
          <source>Discrete Applied Mathematics</source>
          ,
          <volume>42</volume>
          (
          <issue>2</issue>
          ):
          <fpage>177</fpage>
          -
          <lpage>201</lpage>
          ,
          <year>1993</year>
          . doi:
          <volume>10</volume>
          .1016/
          <fpage>0166</fpage>
          -
          <lpage>218X</lpage>
          (
          <issue>93</issue>
          )
          <fpage>90045</fpage>
          -P.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Petr</surname>
            <given-names>Hlinený</given-names>
          </string-name>
          , Sang-il
          <string-name>
            <surname>Oum</surname>
            , Detlef Seese, and
            <given-names>Georg</given-names>
          </string-name>
          <string-name>
            <surname>Gottlob</surname>
          </string-name>
          .
          <article-title>Width parameters beyond tree-width and their applications</article-title>
          .
          <source>Comput. J.</source>
          ,
          <volume>51</volume>
          (
          <issue>3</issue>
          ):
          <fpage>326</fpage>
          -
          <lpage>362</lpage>
          ,
          <year>2008</year>
          . URL: https://doi.org/10.1093/comjnl/bxm052, doi:10.1093/comjnl/bxm052.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>Matthew</given-names>
            <surname>Horridge</surname>
          </string-name>
          .
          <article-title>Justification Based Explanation in Ontologies</article-title>
          .
          <source>PhD thesis</source>
          , University of Manchester, UK,
          <year>2011</year>
          . URL: https://www.research.manchester. ac.uk/portal/files/54511395/FULL_TEXT.PDF.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Matthew</surname>
            <given-names>Horridge</given-names>
          </string-name>
          , Samantha Bail, Bijan Parsia, and
          <string-name>
            <given-names>Uli</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Toward cognitive support for OWL justifications</article-title>
          .
          <source>Knowledge-Based Systems</source>
          ,
          <volume>53</volume>
          :
          <fpage>66</fpage>
          -
          <lpage>79</lpage>
          ,
          <year>2013</year>
          . doi:
          <volume>10</volume>
          .1016/j.knosys.
          <year>2013</year>
          .
          <volume>08</volume>
          .021.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Matthew</surname>
            <given-names>Horridge</given-names>
          </string-name>
          , Bijan Parsia, and
          <string-name>
            <given-names>Ulrike</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Justification oriented proofs in OWL</article-title>
          .
          <source>In The Semantic Web - ISWC 2010 - 9th International Semantic Web Conference, ISWC 2010</source>
          , Shanghai, China, November 7-
          <issue>11</issue>
          ,
          <year>2010</year>
          ,
          <string-name>
            <given-names>Revised</given-names>
            <surname>Selected</surname>
          </string-name>
          <string-name>
            <given-names>Papers</given-names>
            ,
            <surname>Part</surname>
          </string-name>
          <string-name>
            <surname>I</surname>
          </string-name>
          , pages
          <fpage>354</fpage>
          -
          <lpage>369</lpage>
          ,
          <year>2010</year>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>642</fpage>
          -17746-0_
          <fpage>23</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Yevgeny</surname>
            <given-names>Kazakov</given-names>
          </string-name>
          , Pavel Klinov, and
          <string-name>
            <given-names>Alexander</given-names>
            <surname>Stupnikov</surname>
          </string-name>
          .
          <article-title>Towards reusable explanation services in protege</article-title>
          . In Alessandro Artale, Birte Glimm, and Roman Kontchakov, editors,
          <source>Proc. of the 30th Int. Workshop on Description Logics (DL'17)</source>
          , volume
          <volume>1879</volume>
          <source>of CEUR Workshop Proceedings</source>
          ,
          <year>2017</year>
          . URL: http://www.ceur-ws.
          <source>org/</source>
          Vol-1879/paper31.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Yevgeny</surname>
            <given-names>Kazakov</given-names>
          </string-name>
          , Markus Krötzsch, and
          <string-name>
            <given-names>Frantisek</given-names>
            <surname>Simancik</surname>
          </string-name>
          .
          <article-title>The incredible ELK - from polynomial procedures to efficient reasoning with EL ontologies</article-title>
          .
          <source>J. Autom. Reasoning</source>
          ,
          <volume>53</volume>
          (
          <issue>1</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>61</lpage>
          ,
          <year>2014</year>
          . doi:
          <volume>10</volume>
          .1007/s10817-013-9296-3.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>Carsten</given-names>
            <surname>Lutz</surname>
          </string-name>
          and
          <string-name>
            <given-names>Frank</given-names>
            <surname>Wolter</surname>
          </string-name>
          .
          <article-title>Foundations for uniform interpolation and forgetting in expressive description logics</article-title>
          .
          <source>In Proceedings of IJCAI 2011</source>
          , pages
          <fpage>989</fpage>
          -
          <lpage>995</lpage>
          . IJCAI/AAAI,
          <year>2011</year>
          . doi:
          <volume>10</volume>
          .5591/978-1-
          <fpage>57735</fpage>
          -516-8/
          <fpage>IJCAI11</fpage>
          -170.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Deborah L. McGuinness</surname>
          </string-name>
          .
          <article-title>Explaining Reasoning in Description Logics</article-title>
          .
          <source>PhD thesis</source>
          , Rutgers University, NJ, USA,
          <year>1996</year>
          . doi:
          <volume>10</volume>
          .7282/t3-q0c6-5305.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19. Tu Anh Thi Nguyen, Richard Power, Paul Piwek, and
          <string-name>
            <given-names>Sandra</given-names>
            <surname>Williams</surname>
          </string-name>
          .
          <article-title>Measuring the understandability of deduction rules for OWL</article-title>
          .
          <source>In Proceedings of the First International Workshop on Debugging Ontologies and Ontology Mappings</source>
          ,
          <source>WoDOOM</source>
          <year>2012</year>
          , Galway, Ireland, October 8,
          <year>2012</year>
          ., pages
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          ,
          <year>2012</year>
          . URL: http://www.ida.liu.se/~patla/conferences/WoDOOM12/papers/paper4.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20. Tu Anh Thi Nguyen, Richard Power, Paul Piwek, and
          <string-name>
            <given-names>Sandra</given-names>
            <surname>Williams</surname>
          </string-name>
          .
          <article-title>Predicting the understandability of OWL inferences</article-title>
          .
          <source>In The Semantic Web: Semantics and Big Data</source>
          , 10th International Conference, ESWC 2013, Montpellier, France, May
          <volume>26</volume>
          -30,
          <year>2013</year>
          . Proceedings, pages
          <fpage>109</fpage>
          -
          <lpage>123</lpage>
          ,
          <year>2013</year>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>642</fpage>
          -38288-
          <issue>8</issue>
          _
          <fpage>8</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21. Lars Relund Nielsen, Kim Allan Andersen, and
          <string-name>
            <given-names>Daniele</given-names>
            <surname>Pretolani</surname>
          </string-name>
          .
          <article-title>Finding the K shortest hyperpaths</article-title>
          .
          <source>Computers &amp; OR</source>
          ,
          <volume>32</volume>
          :
          <fpage>1477</fpage>
          -
          <lpage>1497</lpage>
          ,
          <year>2005</year>
          . doi:
          <volume>10</volume>
          .1016/j.cor.
          <year>2003</year>
          .
          <volume>11</volume>
          .014.
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Marvin</surname>
            <given-names>R. G.</given-names>
          </string-name>
          <string-name>
            <surname>Schiller</surname>
            and
            <given-names>Birte</given-names>
          </string-name>
          <string-name>
            <surname>Glimm</surname>
          </string-name>
          .
          <article-title>Towards explicative inference for OWL</article-title>
          .
          <source>In Informal Proceedings of the 26th International Workshop on Description Logics</source>
          , Ulm, Germany,
          <source>July 23 - 26</source>
          ,
          <year>2013</year>
          , pages
          <fpage>930</fpage>
          -
          <lpage>941</lpage>
          ,
          <year>2013</year>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>1014</volume>
          /paper_36.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Marvin</surname>
            <given-names>R. G.</given-names>
          </string-name>
          <string-name>
            <surname>Schiller</surname>
            , Florian Schiller, and
            <given-names>Birte</given-names>
          </string-name>
          <string-name>
            <surname>Glimm</surname>
          </string-name>
          .
          <article-title>Testing the adequacy of automated explanations of EL subsumptions</article-title>
          .
          <source>In Proceedings of the 30th International Workshop on Description Logics</source>
          , Montpellier, France,
          <source>July 18-21</source>
          ,
          <year>2017</year>
          .,
          <year>2017</year>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-1879/paper43.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <given-names>Stefan</given-names>
            <surname>Schlobach</surname>
          </string-name>
          and
          <string-name>
            <given-names>Ronald</given-names>
            <surname>Cornet</surname>
          </string-name>
          .
          <article-title>Non-standard reasoning services for the debugging of description logic terminologies</article-title>
          .
          <source>In Georg Gottlob and Toby Walsh</source>
          , editors,
          <source>Proc. of the 18th Int. Joint Conf. on Artificial Intelligence (IJCAI</source>
          <year>2003</year>
          ), pages
          <fpage>355</fpage>
          -
          <lpage>362</lpage>
          , Acapulco, Mexico,
          <year>2003</year>
          . Morgan Kaufmann. URL: http://ijcai. org/Proceedings/03/Papers/053.pdf.
          <article-title>Since by Lemma 10 the derivation structure D(T , η) contains an optimal proof for T |= η, Items (III)-(V) show that Algorithm 1 returns such a proof in Line 18</article-title>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>