<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>DL</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>ASP-based Axiom Pinpointing for Description Logics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ignacio Huitzil</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Giuseppe Mazzotta</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rafael Peñaloza</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Francesco Ricca</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Calabria</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Milano-Bicocca</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2023</year>
      </pub-date>
      <volume>36</volume>
      <fpage>2</fpage>
      <lpage>4</lpage>
      <abstract>
        <p>Axiom pinpointing is the task of identifying the axiomatic causes for a consequence to follow from an ontology. Diferent approaches have been proposed in the literature for finding one or all justifications: the subset-minimal subontologies that preserve a description logic consequence. We propose an approach that leverages the capabilities of answer set programming-through minimal unsatisfiable subset enumeration-for transparent axiom pinpointing. Our approach is general in that it allows one to seamlessly specify the ontology and the reasoning rules, thus being applicable to diferent logics without modification to the core method. We showcase this generality by introducing methods for ℰℒ and for Horn-ℒ, and explaining how to apply it to other logics. A preliminary experiment shows the practicality of the approach.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;axiom-pinpointing</kwd>
        <kwd>non-standard reasoning</kwd>
        <kwd>ASP</kwd>
        <kwd>consequence-based methods</kwd>
        <kwd>Horn DLs</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Axiom pinpointing [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] refers to the task of identifying the axioms in an ontology that are
responsible for a consequence to follow. It has been extensively studied in description logics
(DLs) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and, under many diferent names, in other areas [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. Its basic goal is to enumerate
one or all so-called justifications : the subset-minimal subontologies which still preserve the
consequence of interest.
      </p>
      <p>
        To-date, the most successful approach to axiom pinpointing which does not rely on repeated
(black-box) calls to a standard reasoner is a reduction to the enumeration of the minimal
unsatisfiable subsets (MUS) of clauses of a propositional formula [
        <xref ref-type="bibr" rid="ref5 ref6 ref7">5, 6, 7</xref>
        ]. In this approach,
developed for the light-weight DL ℰℒ, propositional variables are used to represent GCIs in
normal form, and the propositional formula encodes the full execution of completion algorithm
over the normalised TBox. This idea was improved upon in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], where a more eficient encoding
and a diferent enumeration process are used.
      </p>
      <p>
        The main disadvantage of these approaches is that they require, as a pre-processing step,
the construction of a huge propositional formula, which makes the reasoning steps explicit. In
other words, the encoding step requires an implementation of the ℰℒ completion algorithm
(or a consequence-based algorithm) with a modification to generate the propositional clauses.
This in particular means that the approach cannot be easily adapted to diferent logics, as new
implementations of the full decision procedure would be necessary. On the other hand, they
have the advantage that any MUS enumerator can be applied on the derived formula, thus
leveraging the fast developments from SAT [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>
        Our goal is to keep the advantages of the reduction to MUS enumeration, while at the same
time allowing a higher flexibility to handle diferent kinds of languages, and in particular,
diferent DLs beyond ℰℒ. We thus propose a new approach to axiom pinpointing based on a
translation to Answer Set Programming (ASP) [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ]. The basic idea is to produce an ASP
program which encodes the reasoning rules of the consequence based algorithm—rather than
executing them directly. Within this setting, the MUSes of the generated ASP program [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] have
a one-to-one correspondence with the justifications of the ontology. Our approach is general in
the sense that it can be applied to any possible logical language which allows for a “modular”
ASP representation. In a nutshell, a logic has a modular ASP representation if every axiom is
translatable to a set of rules plus potentially a fixed finite program. The modular representation
has the advantage of serving as a simple reasoner for the logic and, at a second step, as a
tool for enumerating justifications. In addition, we can leverage the MUS enumerator to find
justifications with special properties; e.g., with minimal cardinality, or to find the intersection
of justifications.
      </p>
      <p>As an example of its applicability, we instantiate our approach to deal with axiom pinpointing
in Horn-ℒ and its sublogic ℰℒ. We also explain the changes to handle the very inexpressive
ℋℒ, which essentially corresponds to hypergraph reachability. We also implemented a tool
called OWL2ASP, which translates (for now) ℰℒ ontologies to our ASP format, and calls a
variant of the ASP solver WASP to enumerate the MUSes and thus the justifications. We present
a first preliminary analysis of its performance on realistic ontologies.</p>
      <p>
        The seed ideas of this paper were originally presented in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. This work extends that
short paper by including the encoding for Horn-ℒ, by improving the call for the ASP MUS
enumerator, and by describing the implemented encoder and the first (preliminary) empirical
results.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Preliminaries</title>
      <p>We start by briefly introducing the notions of answer set programming, DLs, and axiom
pinpointing that are needed for understanding our approach.</p>
      <sec id="sec-2-1">
        <title>2.1. Answer Set Programming</title>
        <p>
          Answer set programming (ASP) [
          <xref ref-type="bibr" rid="ref10 ref14 ref15">10, 14, 15</xref>
          ] is a declarative programming paradigm based on
stable models. Syntactically, it is based on rules and constraints.
        </p>
        <p>
          In ASP, a variable is a string starting with uppercase letter; a constant is an integer or a
string starting with lowercase letter; and an atom is an expression of the form (1, . . . , )
where  is a predicate of arity  and 1, . . . ,  are terms. An atom is ground if it contains no
variables. A literal is a atom  or its negation   where  denotes negation as failure. A
literal ℓ is negative if it is of the form  , otherwise it is positive. The complement of positive
(resp. negative) literal ℓ =  (resp. ℓ =  ), denoted by ℓ, is the literal   (resp. ). A
(normal) rule is an expression of the form ℎ ← 1, . . . ,  where 1, . . . ,  is a conjunction of
literals, called the body,  ≥ 0, and ℎ is an atom called the head. All variables in a rule must
occur in some positive literal of the body (i.e., are safe cf. [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]). If  is a rule, then ℎ() is
the head atom, and () is the set of all literals in the body. A fact is a rule with an empty
body (i.e.  = 0). A constraint is a rule with an empty head; it is a shorthand for the rule
 ← 1, · · · , ,  , where  is a ground atom not occurring anywhere else. We will also use
a special kind of choice rule which is of the form {} where  is an atom. In this case, we call 
a choice atom. A program is a finite set of rules.
        </p>
        <p>
          Given a program  , the Herbrand Universe  denotes the set of constants in  ; the Herbrand
Base  denotes the set of standard ground atoms that can be obtained from predicate in  and
constants in  . Given a rule  ∈  , () denotes the set of possible rule instantiations
that can be obtained by replacing variables in  with constants in  . The ground instantiation
of the program  , denoted by ( ), is the union of ground instantiations of rules in
 . An interpretation  is a subset of  . Given an interpretation , a positive (resp. negative)
literal ℓ is true w.r.t. , if ℓ ∈  (resp. ℓ ∈/ ); it is false if ℓ ∈/  (resp. ℓ ∈ ). A conjunction of
literals is true w.r.t.  if all the literals are true w.r.t. . An interpretation  is a model of  if for
each  ∈ ( ), the head of  is true whenever the body of  is true. The choice rule {}
simply guesses whether  is made true or not. Given a program  and an interpretation , the
(Gelfond-Lifschitz) reduct [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]—  —is the program obtained from ( ) by (i) removing
all those rules having in the body a false negative literal w.r.t. , and (ii) removing negative
literals from the body of remaining rules. Given a program  , the model  of  is a stable model
or answer set if there is no ′ ⊂  such that ′ is a model of   . A program  is coherent if it
admits at least one answer set, otherwise it is incoherent. ASP solvers decide whether a program
is coherent and, in case, enumerate one or all its answer sets.
        </p>
        <p>In the following sections, all ASP symbols are often denoted with a typewriter font, to
distinguish them from other mathematical symbols, and rules use :- instead of ← .</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Horn Description Logics</title>
        <p>
          We assume familiarity with description logics (DLs) [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] but for clarity we introduce ℰℒ [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ] and
Horn-ℒ [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. These are used as prototypical examples, based on the fact that most axiom
pinpointing tools focus on ℰℒ. However, our goal is to describe a general approach that can be
easily applied to other logics as well.
        </p>
        <p>Starting from two infinite, disjoint sets  and  or concept names and role names,
respectively, ℒ-concepts are constructed through the grammar rule</p>
        <p>::=  | ⊤ | ⊥ | ¬ |  ⊓  |  ⊔  | ∃. | ∀.,
where  ∈  and  ∈ . A GCI is an expression of the form  ⊑  where  and  are
concepts. A TBox is a finite set of GCIs.</p>
        <p>To define Horn- ℒ we need the notion of polarity for each occurrence of a concept in an
expression, which is defined recursively as follows. Each concept  occurs positively in ; if
 occurs positively (resp. negatively) in ′, then (i) it also occurs positively (resp. negatively)
in ′ ⊓ , ′ ⊔ , ∃.′, ∀.′ and  ⊑ ′ (considering commutativity of ⊓, ⊔) and (ii) it
occurs negatively (resp. positively) in ¬′ and ′ ⊑ . Horn-ℒ is the sublogic of ℒ
in which axioms with positive occurrences of  ⊔  or negative occurrences of ¬ or ∀.
are disallowed. ℰℒ is another sublogic of ℒ, where the constructors ¬, ⊔, ∀, and ⊥ are
not allowed. In particular, ℰℒ is also a fragment of Horn-ℒ. As an additional example, we
consider also the fragment ℋℒ (also known as ℒ0) of ℰℒ in which only concept names and
conjunctions (⊓) are allowed.</p>
        <p>The semantics of ℒ (and its fragments) is defined through interpretations, which are
pairs ℐ = (∆ ℐ , · ℐ ) with ∆ ℐ a non-empty set called domain and · ℐ is the interpretation function
mapping every  ∈  to a set ℐ ⊆ ∆ ℐ and every  ∈  to a binary relation ℐ ⊆ ∆ ℐ × ∆ ℐ .
The interpretation function is extended to concepts setting ⊤ℐ := ∆ ℐ , (¬)ℐ := ∆ ℐ ∖ ℐ ,
( ⊓ )ℐ := ℐ ∩ ℐ , and (∃.)ℐ := { | ∃ ∈ ℐ .(,  ) ∈ ℐ }. The other constructors are
treated analogously. The interpretation ℐ satisfies the GCI  ⊑  if ℐ ⊆ ℐ . It is a model of
 if it satisfies all GCIs in  . We often call GCIs axioms, which allows us to seamlessly connect
between DL and arbitrary representation languages. The TBox  entails the GCI  ⊑ 
( |=  ⊑ ) if every model of  satisfies  ⊑ . In this case we say that  ⊑  is a
consequence of  .</p>
        <p>
          We focus on the problem of deciding atomic subsumption relations  ⊑  where ,  ∈  .
The consequence-based algorithm for Horn-ℒ [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ] first transforms the TBox to normal form.
A GCI is in normal form if it has one of the following shapes:
 ⊑ ,  ⊓ ′ ⊑ ,  ⊑ ∃.,
∃. ⊑ ,  ⊑ ∀.
where  ∈  and , ′,  ∈  ∪ {⊤},  ∈  ∪ {⊥}. Once the TBox  is in normal
form, the consequence-based algorithm applies the completion rules in Table 1 to add new
consequences until saturation. It is shown in [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] that the method is sound and complete for all
atomic subsumptions over the concept names appearing in the original TBox.
        </p>
        <p>In the case of ℰℒ, the last kind of normal form axiom will never appear, and the concept 
appearing in the right-hand side of the first two kinds can never be ⊥. Hence, the first four rules
in Table 1 sufice for atomic subsumption in this logic. For practical reasons, in this case we
will unify two rules into one with a larger set of preconditions, which will sufice for deciding
atomic subsumptions. It can be seen that ℋℒ is a syntactic variant of directed hypergraphs.
Specifically, a GCI 1 ⊓ · · · ⊓  ⊑ 1 ⊓ · · · ⊓  represents a directed hypergraph connecting
nodes 1, . . . ,  with nodes 1, . . . , , and the entailment problem is nothing more than
reachability in this hypergraph.</p>
        <p>Beyond standard reasoning, it is sometimes important to understand which axioms are
responsible for a consequence to follow from a TBox. This goal is often instantiated as the task
of identifying justifications .</p>
        <p>Definition 1. A justification for a consequence  w.r.t. the TBox  is a set ℳ ⊆ 
ℳ |=  and (ii) for every  ⊂ ℳ ,  ̸|=  .
such that (i)</p>
        <p>
          Briefly, a justification is a subset-minimal sub-TBox that still entails the consequence.
Importantly, justifications refer to the GCIs in the original TBox before normalisation, which means
an additional minimisation step if the pinpointing method works on normalised TBoxes [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
        </p>
        <p>
          Most work focuses on computing one or all justifications. While the former problem remains
polynomial in ℰℒ, the latter necessarily needs exponential time, as the number of justifications
may be exponential on the size of the TBox. Despite some potential uses, which have been
identified for non standard reasoning [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ], only very recently have specific algorithms for
computing the unions and intersection of justifications been developed [
          <xref ref-type="bibr" rid="ref22 ref23">22, 23</xref>
          ]. To the best
of our knowledge, no previous work has considered computing the justifications of minimal
cardinality directly.
        </p>
        <p>
          A similar problem is observed in ASP. When a program is incoherent, one may want to find
the minimal sub-programs that are still incoherent. This notion, analogous to justifications in
DLs, is called a minimal unsatisfiable subset (MUS) in the ASP community [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. Rather than
giving the same weight to all facts and rules in the program, one variant is to limit the search
to a subclass of facts of interest and assume that the rest of the program is fixed and hence,
irrelevant for the explanation. We exploit this analogy and solve axiom pinpointing through
MUS enumeration.
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Reasoning Through Rules</title>
      <p>Before presenting our approach to axiom pinpointing using ASP, we briefly describe how to
reduce reasoning in Horn-ℒ to ASP. The approach simulates the completion algorithm
sketched in Section 2.2 through a small set of rules, while the TBox axioms (in normal form) are
represented through facts.</p>
      <p>Consider a TBox  in normal form, and let ( ) and ℛ( ) be the sets of concept names
and role names appearing in  , respectively. For each  ∈ ( ) we use a constant a, and for
each  ∈ ℛ( ) we use a constant r. We also use the numerical constants 0 and 1 for ⊥ and
⊤, respectively. We identify the four shapes of normal form axioms via a diferent predicate
s0, . . . , s4 as shown in Figure 1 (left). Hence, s0(a,b) stands for the GCI  ⊑  and so on.
For each axiom in normal form appearing in  , we write the associated fact. As previously
mentioned, the reasoning process is simulated through rules. In the specific case of Horn- ℒ,
these rules are shown in the right-hand side of Figure 1. As before, if the TBox belongs to
ℰℒ, then the first four rules sufice (and the last two can be removed from the program). For
eficiency reasons, in the ℰℒ encoding we merge the third and fourth rules into one. To decide
whether the atomic subsumption  ⊑  is a consequence of the TBox, we need only ask the
query s0(a,b); i.e., check whether this fact is derivable from the initial facts, applying the rules.
Since the original TBox may not be in normal form, the facts obtained this way are the result of</p>
      <p>ASP fact
 ⊑  s0(a,c).
1 ⊓ 2 ⊑  s1(a1,a2,c).
 ⊑ ∃. s2(a,r,b).
∃. ⊑  s3(r,a,b).
 ⊑ ∀. s4(a,r,b).</p>
      <p>s0(X,Y) :- s0(X,Z), s0(Z,Y).
s0(X,Y) :- s0(X,Z1), s0(X,Z2), s1(Z1,Z2,Y).
s2(X,R,Y) :- s2(X,R,Z), s0(Z,Y).
s0(X,Y) :- s2(X,R,Z), s3(R,Z,Y).
s2(X,R,Y) :- s2(X,R,Z1), s4(X,R,Z2), s1(Z1,Z2,Y).</p>
      <p>s0(X,0) :- s2(X,R,Y), s0(Y,0).
the normalisation step over the original GCIs. As we will see later, we can use additional rules
to preserve the origin information for each normalised GCI, which will be useful for axiom
pinpointing.</p>
      <p>
        In the case of ℋℒ, one can produce a more direct reduction, which takes into account
the hyperedges without the need for normalisation or general derivation rules. We again
represent each concept name  through a constant a, and associate a new constant gi for
each GCI in  . Then the GCI 1 ⊓ · · · ⊓  ⊑ 1 ⊓ · · · ⊓  is translated to the set of
rules {gi :- a1, . . . , am., b1 :- gi., . . . , bn :- gi.}. To decide whether  ⊑  is a
consequence, we add the fact a. and verify the query b. The correctness of these approaches
follows from the results in [
        <xref ref-type="bibr" rid="ref19 ref24 ref25">19, 24, 25</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Axiom Pinpointing Through ASP</title>
      <p>We present a general approach for solving axiom pinpointing tasks through an ASP solver.
The approach is applicable to any logic (including other DLs) which allows for a modular ASP
encoding. Roughly, an encoding is a function that maps TBoxes (or more generally, knowledge
bases) to ASP programs, and it is modular if each axiom in  translates to a set of rules, such
that an ASP encoding Π  of  is obtained by the union of the encodings of its axioms, possibly
together with some additional rules (independent of the specific axioms in  ) needed to simulate
reasoning in ASP.</p>
      <p>Definition 2. An encoding in ASP Π  is modular if for every TBox  it holds that (i) for each
 ∈  there is an ASP program Π  , and (ii) there is a (possibly empty) set of rules  such that
Π  = ⋃︀ ∈ Π  ∪</p>
      <p>The encodings from Section 3 for Horn-ℒ, ℰℒ and ℋℒ are all modular. In the first two
cases,  is the set of rules in Figure 1 (right), while in the latter  = ∅. For any (arbitrary)
Horn-ℒ GCI  , Π  is the ASP representation of its translation to normal form. We now
formulate the problem of computing all justifications in ASP. First, we apply an adornment step,
which allows to identify and keep track of the rules of a module corresponding to a given axiom,
necessary for pinpointing.</p>
      <p>Definition 3. Let  be an ASP program, and  be an atom not occurring in  . The  -adornment
for  is the program ∆  ( ) = { |  ∈  }, where  is such that ℎ( ) = ℎ(), and
( ) = () ∪  .</p>
      <p>In words, the  -adornment adds a new identifying atom  to the body of each rule of the
program. This guarantees that the rules trigger only when  is true. In the case of Horn-ℒ,
which means that axioms in normal form will be considered only if the original axiom that
produces them is considered.</p>
      <p>Definition 4. The adorned ASP encoding of the TBox  is the program
 (Π 
) = ⋃︁ ∆   (Π  ) ∪  ∪</p>
      <p>∈
containing a choice rule {  } for each  ∈  .
where for each</p>
      <p>
        ∈  ,   is a fresh atom not occurring in Π(  ), and  is the ASP program
In the case of Horn-ℒ and ℰℒ, the adornment will change each fact (corresponding to a
GCI in normal form) si(_). into the rule si(_) :- xj, where xj is the chosen constant for
the original (DL) axiom   . Importantly, this approach handles the original axioms in the TBox,
and not those already normalised as done e.g. in [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
      </p>
      <p>We now describe an ASP program that can be used for axiom pinpointing. Note that  ⊑ 
is a consequence of  if and only if the program  (Π 
) entails the atom s0(a,b). Thus,
incoherence. In other words, the MUSes.
if we add the constraint :-s0(a,b). the resulting program will be incoherent. To find out
the justifications for  ⊑  (the minimal subset of axioms that entail it), it sufices to find
the minimal subsets of adornments—which refer to the original axioms in  —that preserve
 ∈ ℳ} =  ∩ {  |</p>
      <p>∈  }.
 =  (Π  ) ∪ {←
such that {  |
Proposition 1. Let  be a TBox,  an atom modelling a consequence of  , and  the program
}. ℳ ⊆ 
is a justification for  if there is a MUS  of  w.r.t. {  |
 ∈  }</p>
      <p>Justifications that are cardinality minimal (and thus also subset minimal) can be directly
computed using an ASP program with weak constraints. In a nutshell, a weak constraint :∼a
tries to exclude the atom a from any model, but can be introduced if necessary. In this case,
the MUS enumerator tries to minimise the number of weak constraints that are violated which
corresponds to minimising the cardinality of the associated justification.</p>
      <p>Proposition 2. Let  be a TBox,  an atom modelling a consequence of  , and  the program
 =  (Π 
) ∪ {←
} ∪ {:∼   |</p>
      <p>∈  }. ℳ ⊆ 
there exists an optimal MUS  of  such that {  |
 ∈ ℳ} =  ∩ {  |</p>
      <p>∈  }.
is a cardinality-minimal justification for  if</p>
      <p>
        Before describing our implementation and empirical evaluation, we note that the translation
permits computing the intersection of all justifications, and consequences derived from it,
through the application of cautious reasoning [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. In ASP, a cautious consequence is one that
holds in every answer set. Since the program  from Proposition 1 provides a one-to-one
correspondence between answer sets and sub-ontologies deriving a consequence, cautious
reasoning refers to reasoning over the intersection of all those sub-ontologies, and in particular
over the subset-minimal ones; that is, over the justifications. Unfortunately, an analogous result
does not exist for the union of all justifications. Indeed, every axiom would be available for brave
reasoning (consequences which hold in at least one answer set) [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] over the same program  ,
but not all axioms belong to some justification.
5. OWL2ASP
To verify the practicality of our approach, we implemented a tool called OWL2ASP, which
translates an ℰℒ ontology into the ASP syntax described in Section 3 and then calls an ASP
solver (after an adequate adorning) to obtain all the justifications for a given query. For the first
part of the translation, the tool reuses the normalisation module of jcel [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] and improves upon
the functionality of OwlToProlog1 by correcting some issues on the use of ⊤ and standardising
the output syntax. The parsing and manipulation of axioms and concepts uses the elements
available through the OWL API. We implemented OWL2ASP in Java. The system and other
relevant information is publicly available at https://board.unimib.it/datasets/r6xcggwvjp/1.
      </p>
      <p>The translator takes an ℰℒ TBox and produces five files which include all the information
about the original axioms, the normalised GCIs they produce, and a mapping from concept and
role names (in DL) and constants (in ASP). As it is standard, we use integers as ASP constants
to reduce the consumption of memory and other resources. Specifically, for a given TBox  ,
OWL2ASP generates (i) a file asp.txt which contains the ASP translation of the normalisation of
 together with the information of which original axioms produced them using a new predicate
symbol o(_) to better capture the origin; (ii) originalAxioms.txt containing an (integer) ID
for each OWL-represented axiom in the original ontology; (iii) owlElements.txt relating the
concept and role names with unique integer IDs; (iv) axiom_facts.asp enumerating the IDs of
original axioms for aiding the ASP MUS enumerator; and (v) encoding.asp enumerating the
reasoning rules and the query of interest.</p>
      <p>Note that in the current implementation, the file encoding.asp is the same for any possible
input TBox modulo the requested query: it always contains the first four rules shown in Figure 1
(right).2 Yet, here lies the flexibility in our approach: to handle other formalisms, one needs only
to change this file with the corresponding rules, and—perhaps the largest efort—implement the
normalisation procedure for the new language. The rest of the approach remains unchanged,
which means that ASP features can be used without issues.</p>
      <p>
        The resulting files can be fed to an ASP solver to verify that the consequence expressed in
the query follows from the TBox. But our goal is rather to enumerate the justifications for
this consequence. Thus, the tool adds a choice rule for each atom representing an original
GCI from  , and calls the MUS enumerator of WASP3 [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ] to obtain one or all MUSes. These
MUSes are encoded using the constants from the ASP program. The information in the file
originalAxioms.txt can be used to map this information back to a justification in the original OWL
syntax of the TBox. The output of the MUS enumerator is available for a direct visualization
by the user, or in a file which can be fed to other tools in e.g., a repair pipeline if necessary.
A full execution example is available at the public repository for OWL2ASP. As mentioned
already, through modifications in the call to WASP, it is possible to obtain also the justifications
of minimal cardinality and their intersection. We can also take advantage of optimisations
developed for ASP applications, as we see in the next section.
1https://github.com/Gallax619/OwlToProlog
2Recall that we merge the third and fourth rules for eficiency reasons.
3http://alviano.github.io/wasp/
      </p>
    </sec>
    <sec id="sec-5">
      <title>6. Preliminary Experiment</title>
      <p>We executed a preliminary experiment to empirically assess the potential of our method. For
this experiment we consider the well-known biomedical ontology NOT-GALEN, which is among
the de facto benchmarks for axiom pinpointing in ℰℒ. More precisely, we consider the version
provided in jcel,4 which features 4379 axioms, 2748 concepts, and 413 roles, and chose a random
sample of 25 queries on this ontology already considered in the literature. The task we consider
is the enumeration of all justifications for each query.</p>
      <p>
        Our tool, called OWL2ASP, employs the encoding from Figure 1 targeted for ℰℒ, with the
third and fourth rules combined into one. The resulting program was first processed through
the magic sets technique [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ] using a direct call to the DLV2 system [
        <xref ref-type="bibr" rid="ref29 ref30">29, 30</xref>
        ]. The adornment
process (see Section 4) was applied to the resulting program, and WASP [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ] was called for
MUS enumeration [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <p>
        We compare with other glass-box axiom pinpointing tools for ℰℒ. In particular, we run three
methods based on a translation to SAT originally proposed by Sebastiani and Vescovi—namely
EL2SAT [
        <xref ref-type="bibr" rid="ref32 ref5">5, 32</xref>
        ], BEACON [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], and SATPIN [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]—and the resolution-based PULi [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] (configured
with option SAT and strategy THRESHOLD). The experiment was executed on an Intel(R)
Xeon(R) CPU E7-8880 v4 @ 2.20GHz running Debian Linux (4.9.0-19-amd64), with memory and
time limits of 16GB and 800 seconds, respectively.
      </p>
      <p>The results of the execution are reported in Table 2, which shows the solving time in seconds
for each query and tool. For the cells denoted by &lt; 0.01, the execution time was below the
sampling range of the observation wrapper we used. For our tool (OWL2ASP) we report the
time needed by WASP to perform MUS enumeration without considering the pre-processing
time to obtain propositional programs. This is to create a fair comparison with the SAT-based
tools whose input is already a SAT formula encoding the full standard reasoning process. On
the one hand, we report that OWL2ASP requires 0.8s on average (with a standard deviation
of 0.15) to pre-process the input over all the 25 queries compared, which is a positive result.
On the other hand, we observe that the experiment highlights the viability of the proposed
approach; indeed, OWL2ASP results to be the fastest in terms of solving time for this sample,
providing answers almost instantaneously.</p>
    </sec>
    <sec id="sec-6">
      <title>7. Conclusions</title>
      <p>
        We presented a general approach for axiom pinpointing based on a reduction to ASP. Similar
to existing SAT-based approaches, we construct an ASP program which, if extended with a
constraint encoding a consequence of interest, becomes incoherent; that is, has no models. Then,
an ASP MUS enumerator is used to find justifications eficiently. Importantly, even though the
reasoning step requires normalisation, our approach enumerates directly on the original axioms
in the TBox, thus avoiding an additional (potentially expensive) recovery step [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
      </p>
      <p>
        As a proof of concept, we have shown how the reduction works for the DL Horn-ℒ, and
its sublogics ℰℒ and ℋℒ. The same idea is applicable for any logic with a modular translation
to ASP, for instance any DL with a consequence-based reasoning algorithm [
        <xref ref-type="bibr" rid="ref18 ref33">18, 33</xref>
        ] should
      </p>
      <sec id="sec-6-1">
        <title>QUERY</title>
      </sec>
      <sec id="sec-6-2">
        <title>BEACON</title>
        <p>EL2SAT
OWL2ASP</p>
      </sec>
      <sec id="sec-6-3">
        <title>PULI SATPIN</title>
        <p>
          1.not.galen
2.not.galen
3.not.galen
4.not.galen
5.not.galen
6.not.galen
7.not.galen
8.not.galen
9.not.galen
10.not.galen
11.not.galen
12.not.galen
13.not.galen
14.not.galen
15.not.galen
16.not.galen
17.not.galen
18.not.galen
19.not.galen
20.not.galen
21.not.galen
22.not.galen
23.not.galen
24.not.galen
25.not.galen
enjoy such a translation. The challenge in these cases is to find an adequate expression of the
consequence-based rules which can be handled by the ASP solver. For instance, the
consequencebased method for (full) ℒ manipulates sets, which are not native to ASP. Dealing with further
constructors imposes additional challenges. On the other hand, once such an encoding has been
devised, our approach can be seamlessly applied, without further implementation issues. In
contrast, existing methods based on SAT [
          <xref ref-type="bibr" rid="ref5 ref6 ref7">5, 6, 7</xref>
          ], need to explicitly execute all the reasoning
steps to produce their encoding.
        </p>
        <p>To test the applicability of our method, we implemented OWL2ASP, a tool that produces
the corresponding encoding for ℰℒ TBoxes, and compare it with other glass-box methods for
pinpointing in this logic. Our results are very promising, they show that our tool is competitive
with state-of-the-art alternatives in a preliminary experiment considering 25 queries executed
on NOT-GALEN. For future work, we plan to extend the evaluation to a larger sample of queries
and ontologies, following existing benchmarks. We will also extend the implementation to
handle Horn-ℒ.</p>
        <p>An advantage of using an of-the-shelf ASP solver is that we can directly take advantage of
all the services that these solvers provide without any additional cost. In particular, through
a simple modification to the MUS enumerator call, one can obtain justifications of minimal
cardinality. In the future, we plan to study the implementation of other axiom pinpointing
services based on ASP constructs and evaluate their practical applicability. Moreover, we plan
to further reduce the (already acceptable) pre-processing times by exploiting the modularity
properties of the ontology in input, in order to specialise the reasoning task only to those
modules that are involved in the input query.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgments</title>
      <p>This work was partially supported by MUR for the Department of Excellence DISCo at the
University of Milano-Bicocca and under PRIN project PINPOINT Prot. 2020FNEB27, CUP
H23C22000280006 and H45E21000210001. We would like to thank Carmine Dodaro for his
support using the MUS enumerator.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.</given-names>
            <surname>Schlobach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Cornet</surname>
          </string-name>
          ,
          <article-title>Non-standard reasoning services for the debugging of description logic terminologies</article-title>
          ,
          <source>in: Proceedings of IJCAI'03</source>
          , Morgan Kaufmann Publishers Inc.,
          <year>2003</year>
          , pp.
          <fpage>355</fpage>
          -
          <lpage>360</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Calvanese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>McGuinness</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Nardi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Patel-Schneider</surname>
          </string-name>
          (Eds.),
          <source>The Description Logic Handbook: Theory</source>
          , Implementation, and Applications, second ed., Cambridge University Press,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Sirin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Hendler</surname>
          </string-name>
          ,
          <article-title>Debugging unsatisfiable classes in OWL ontologies</article-title>
          ,
          <source>Journal of Web Semantics</source>
          <volume>3</volume>
          (
          <year>2005</year>
          )
          <fpage>268</fpage>
          -
          <lpage>293</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.websem.
          <year>2005</year>
          .
          <volume>09</volume>
          .005.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          ,
          <article-title>Explaining axiom pinpointing</article-title>
          , in: C.
          <string-name>
            <surname>Lutz</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          <string-name>
            <surname>Sattler</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Tinelli</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Turhan</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Wolter</surname>
          </string-name>
          (Eds.),
          <string-name>
            <surname>Description</surname>
            <given-names>Logic</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Theory</given-names>
            <surname>Combination</surname>
          </string-name>
          , and
          <string-name>
            <surname>All</surname>
          </string-name>
          That - Essays Dedicated to Franz
          <source>Baader on the Occasion of His 60th Birthday</source>
          , volume
          <volume>11560</volume>
          of Lecture Notes in Computer Science, Springer,
          <year>2019</year>
          , pp.
          <fpage>475</fpage>
          -
          <lpage>496</lpage>
          . URL: https://doi.org/10.1007/978-3-
          <fpage>030</fpage>
          -22102-7_
          <fpage>22</fpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -22102-7\_
          <fpage>22</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>R.</given-names>
            <surname>Sebastiani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Vescovi</surname>
          </string-name>
          , Axiom Pinpointing in Large EL+
          <article-title>Ontologies via SAT and SMT Techniques</article-title>
          ,
          <source>DISI Technical report</source>
          , University of Trento,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>M. F.</given-names>
            <surname>Arif</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Mencía</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ignatiev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Manthey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Marques-Silva</surname>
          </string-name>
          ,
          <article-title>BEACON: an eficient SAT-based tool for debugging EL+ ontologies</article-title>
          ,
          <source>in: Proceedings of SAT</source>
          <year>2016</year>
          ., volume
          <volume>9710</volume>
          <source>of LNCS</source>
          , Springer,
          <year>2016</year>
          , pp.
          <fpage>521</fpage>
          -
          <lpage>530</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>N.</given-names>
            <surname>Manthey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          , S. Rudolph,
          <article-title>SATPin: Axiom pinpointing for lightweight description logics through incremental SAT, Künstliche Intelligenz 34 (</article-title>
          <year>2020</year>
          )
          <fpage>389</fpage>
          -
          <lpage>394</lpage>
          . doi:https://doi.org/10.1007/s13218-020-00669-4.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Skocovský</surname>
          </string-name>
          ,
          <article-title>Enumerating justifications using resolution</article-title>
          , in: D.
          <string-name>
            <surname>Galmiche</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Schulz</surname>
          </string-name>
          , R. Sebastiani (Eds.),
          <source>Proceedings of the 9th International Joint Conference on Automated Reasoning (IJCAR</source>
          <year>2018</year>
          ), volume
          <volume>10900</volume>
          <source>of LNCS</source>
          , Springer,
          <year>2018</year>
          , pp.
          <fpage>609</fpage>
          -
          <lpage>626</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>319</fpage>
          -94205-6_
          <fpage>40</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M. H.</given-names>
            <surname>Lifiton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Previti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Malik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Marques-Silva</surname>
          </string-name>
          ,
          <article-title>Fast, flexible MUS enumeration</article-title>
          ,
          <source>Constraints</source>
          <volume>21</volume>
          (
          <year>2016</year>
          )
          <fpage>223</fpage>
          -
          <lpage>250</lpage>
          . URL: https://doi.org/10.1007/s10601-015-9183-0. doi:
          <volume>10</volume>
          . 1007/s10601-015-9183-0.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>G.</given-names>
            <surname>Brewka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Eiter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Truszczynski</surname>
          </string-name>
          ,
          <article-title>Answer set programming at a glance</article-title>
          ,
          <source>Commun. ACM</source>
          <volume>54</volume>
          (
          <year>2011</year>
          )
          <fpage>92</fpage>
          -
          <lpage>103</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>V.</given-names>
            <surname>Lifschitz</surname>
          </string-name>
          ,
          <article-title>Answer set planning</article-title>
          , in: D. D.
          <string-name>
            <surname>Schreye</surname>
          </string-name>
          (Ed.),
          <source>Logic Programming: The 1999 International Conference</source>
          , MIT Press,
          <year>1999</year>
          , pp.
          <fpage>23</fpage>
          -
          <lpage>37</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Alviano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Dodaro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Fiorentino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Previti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ricca</surname>
          </string-name>
          ,
          <article-title>ASP and subset minimality: Enumeration, cautious reasoning</article-title>
          and MUSes, Artif. Intell.
          <volume>320</volume>
          (
          <year>2023</year>
          )
          <article-title>103931</article-title>
          . URL: https: //doi.org/10.1016/j.artint.
          <year>2023</year>
          .
          <volume>103931</volume>
          . doi:
          <volume>10</volume>
          .1016/j.artint.
          <year>2023</year>
          .
          <volume>103931</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ricca</surname>
          </string-name>
          ,
          <article-title>Pinpointing axioms in ontologies via ASP</article-title>
          ,
          <source>in: Proc. of the 16th International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR</source>
          <year>2022</year>
          , volume
          <volume>13416</volume>
          of Lecture Notes in Computer Science, Springer,
          <year>2022</year>
          , pp.
          <fpage>315</fpage>
          -
          <lpage>321</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>031</fpage>
          -15707-3\_
          <fpage>24</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>M.</given-names>
            <surname>Gelfond</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Lifschitz</surname>
          </string-name>
          ,
          <article-title>Classical negation in logic programs</article-title>
          and disjunctive databases,
          <source>New Generation Comput. 9</source>
          (
          <year>1991</year>
          )
          <fpage>365</fpage>
          -
          <lpage>386</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>C.</given-names>
            <surname>Baral</surname>
          </string-name>
          ,
          <source>Knowledge Representation, Reasoning and Declarative Problem Solving</source>
          , Cambridge University Press,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>S.</given-names>
            <surname>Ceri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Gottlob</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Tanca</surname>
          </string-name>
          ,
          <article-title>Logic Programming</article-title>
          and Databases, Surveys in computer science, Springer,
          <year>1990</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Brandt</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Lutz, Pushing the ℰℒ envelope</article-title>
          ,
          <source>in: Proceedings of IJCAI'05</source>
          , Professional Book Center,
          <year>2005</year>
          , pp.
          <fpage>364</fpage>
          -
          <lpage>369</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>F.</given-names>
            <surname>Simančík</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Horrocks</surname>
          </string-name>
          ,
          <article-title>Consequence-based reasoning beyond Horn ontologies</article-title>
          ,
          <source>in: Proc. IJCAI'11</source>
          , AAAI Press,
          <year>2011</year>
          , pp.
          <fpage>1093</fpage>
          -
          <lpage>1098</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kazakov</surname>
          </string-name>
          ,
          <article-title>Consequence-driven reasoning for horn SHIQ ontologies</article-title>
          , in: C.
          <string-name>
            <surname>Boutilier</surname>
          </string-name>
          (Ed.),
          <source>Proceedings of the 21st International Joint Conference on Artificial Intelligence</source>
          ,
          <year>2009</year>
          , pp.
          <fpage>2040</fpage>
          -
          <lpage>2045</lpage>
          . URL: http://ijcai.org/Proceedings/09/Papers/336.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Suntisrivaraporn</surname>
          </string-name>
          ,
          <article-title>Pinpointing in the description logic EL+</article-title>
          ,
          <source>in: Proc. of KI'07</source>
          , volume
          <volume>4667</volume>
          <source>of LNCS</source>
          , Springer,
          <year>2007</year>
          , pp.
          <fpage>52</fpage>
          -
          <lpage>67</lpage>
          . doi:
          <volume>10</volume>
          .1007/ 978-3-
          <fpage>540</fpage>
          -74565-
          <issue>5</issue>
          _
          <fpage>7</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>M.</given-names>
            <surname>Bienvenu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Rosati</surname>
          </string-name>
          ,
          <article-title>Tractable approximations of consistent query answering for robust ontology-based data access</article-title>
          , in: F. Rossi (Ed.),
          <source>Proceedings of IJCAI'13</source>
          , AAAI Press/IJCAI,
          <year>2013</year>
          , pp.
          <fpage>775</fpage>
          -
          <lpage>781</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>J.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Ma</surname>
          </string-name>
          , R. Peñaloza,
          <string-name>
            <given-names>H.</given-names>
            <surname>Yang</surname>
          </string-name>
          ,
          <article-title>Union and intersection of all justifications</article-title>
          ,
          <source>in: Proc. of ESWC</source>
          <year>2022</year>
          , volume
          <volume>13261</volume>
          <source>of LNCS</source>
          , Springer,
          <year>2022</year>
          , pp.
          <fpage>56</fpage>
          -
          <lpage>73</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Mencía</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ignatiev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Marques-Silva</surname>
          </string-name>
          ,
          <article-title>Lean kernels in description logics</article-title>
          ,
          <source>in: Proceeding of the 14th Semantic Web Conference (ESWC</source>
          <year>2017</year>
          ), volume
          <volume>10249</volume>
          <source>of LNCS</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>518</fpage>
          -
          <lpage>533</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>319</fpage>
          -58068-5_
          <fpage>32</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Sertkaya</surname>
          </string-name>
          ,
          <article-title>Understanding the complexity of axiom pinpointing in lightweight description logics</article-title>
          ,
          <source>Artif. Intell</source>
          .
          <volume>250</volume>
          (
          <year>2017</year>
          )
          <fpage>80</fpage>
          -
          <lpage>104</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>İ.</given-names>
            <surname>İ. Ceylan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Mendez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          ,
          <article-title>The Bayesian ontology reasoner is BORN!</article-title>
          , in: M.
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Glimm</surname>
            ,
            <given-names>R. S.</given-names>
          </string-name>
          <string-name>
            <surname>Gonçalves</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Jiménez-Ruiz</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Matentzoglu</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Parsia</surname>
            ,
            <given-names>G. B.</given-names>
          </string-name>
          <string-name>
            <surname>Stamou</surname>
          </string-name>
          , G. Stoilos (Eds.),
          <source>Proceedings of the 4th International Workshop on OWL Reasoner Evaluation (ORE-2015)</source>
          , volume
          <volume>1387</volume>
          <source>of CEUR Workshop Proceedings, CEUR-WS.org</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>8</fpage>
          -
          <lpage>14</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>1387</volume>
          /paper_5.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>J.</given-names>
            <surname>Mendez</surname>
          </string-name>
          ,
          <article-title>jcel: A modular rule-based reasoner</article-title>
          , in: I. Horrocks,
          <string-name>
            <given-names>M.</given-names>
            <surname>Yatskevich</surname>
          </string-name>
          , E. JiménezRuiz (Eds.),
          <source>Proceedings of the 1st International Workshop on OWL Reasoner Evaluation (ORE-2012)</source>
          , Manchester,
          <string-name>
            <surname>UK</surname>
          </string-name>
          ,
          <year>July 1st</year>
          ,
          <year>2012</year>
          , volume
          <volume>858</volume>
          <source>of CEUR Workshop Proceedings, CEUR-WS.org</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>M.</given-names>
            <surname>Alviano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Dodaro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Fiorentino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Previti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ricca</surname>
          </string-name>
          ,
          <article-title>Enumeration of minimal models and MUSes in WASP</article-title>
          ,
          <source>in: Proceedings of the 16th International Conference on Logic Programming and Nonmonotonic Reasoning</source>
          ,
          <source>LPNMR</source>
          <year>2022</year>
          , volume
          <volume>13416</volume>
          of Lecture Notes in Computer Science, Springer,
          <year>2022</year>
          , pp.
          <fpage>29</fpage>
          -
          <lpage>42</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>031</fpage>
          -15707-3\_3.
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>F.</given-names>
            <surname>Bancilhon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Maier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Sagiv</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Ullman</surname>
          </string-name>
          ,
          <article-title>Magic sets and other strange ways to implement logic programs</article-title>
          , in: PODS, ACM,
          <year>1986</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>15</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>M.</given-names>
            <surname>Alviano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Calimeri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Dodaro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Fuscà</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Leone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Perri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ricca</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Veltri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Zangari</surname>
          </string-name>
          ,
          <article-title>The ASP system DLV2</article-title>
          , in: LPNMR, volume
          <volume>10377</volume>
          of Lecture Notes in Computer Science, Springer,
          <year>2017</year>
          , pp.
          <fpage>215</fpage>
          -
          <lpage>221</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>M.</given-names>
            <surname>Alviano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Leone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Veltri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Zangari</surname>
          </string-name>
          ,
          <article-title>Enhancing magic sets with an application to ontological reasoning</article-title>
          ,
          <source>Theory Pract. Log. Program</source>
          .
          <volume>19</volume>
          (
          <year>2019</year>
          )
          <fpage>654</fpage>
          -
          <lpage>670</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>M.</given-names>
            <surname>Alviano</surname>
          </string-name>
          , G. Amendola,
          <string-name>
            <given-names>C.</given-names>
            <surname>Dodaro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Leone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Maratea</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ricca</surname>
          </string-name>
          ,
          <article-title>Evaluation of disjunctive programs in WASP</article-title>
          , in: LPNMR, volume
          <volume>11481</volume>
          of Lecture Notes in Computer Science, Springer,
          <year>2019</year>
          , pp.
          <fpage>241</fpage>
          -
          <lpage>255</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>R.</given-names>
            <surname>Sebastiani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Vescovi</surname>
          </string-name>
          ,
          <article-title>Axiom pinpointing in lightweight description logics via HornSAT encoding and conflict analysis</article-title>
          , in: R. A.
          <string-name>
            <surname>Schmidt</surname>
          </string-name>
          (Ed.),
          <source>Automated Deduction - CADE-22</source>
          , Springer Berlin Heidelberg, Berlin, Heidelberg,
          <year>2009</year>
          , pp.
          <fpage>84</fpage>
          -
          <lpage>99</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>D. T.</given-names>
            <surname>Cucala</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Horrocks</surname>
          </string-name>
          ,
          <article-title>Consequence-based reasoning for description logics with disjunction, inverse roles, and nominals</article-title>
          ,
          <source>in: Proceedings of DL</source>
          <year>2017</year>
          , Montpellier, France,
          <source>July 18-21</source>
          ,
          <year>2017</year>
          .,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>