<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Argumentation-based Causal and Counterfactual Reasoning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Lars Bengel</string-name>
          <email>lars.bengel@fernuni-hagen.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lydia Blümel</string-name>
          <email>lydia.bluemel@fernuni-hagen.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tjitze Rienstra</string-name>
          <email>t.rienstra@maastrichtuniversity.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matthias Thimm</string-name>
          <email>matthias.thimm@fernuni-hagen.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>1st International Workshop on Argumentation for eXplainable AI</institution>
          ,
          <addr-line>ArgXAI, co-located with COMMA '22</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Artificial Intelligence Group</institution>
          ,
          <addr-line>FernUniversität in Hagen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Department of Advanced Computing Sciences, Maastricht University</institution>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this paper we present a model for argumentative causal and counterfactual reasoning in a logical setting. Causal knowledge is represented in this system using Pearl's causal model of a set of structural equations and a set of assumptions expressed in propositional logic. Queries concerning observations or actions can be answered by constructing an argumentation framework and determining its extensions. For counterfactual queries we propose an argumentation-based implementation of the twin network method and analyse its expressiveness.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Causality</kwd>
        <kwd>Counterfactuals</kwd>
        <kwd>Abstract Argumentation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>corresponds directly to the solutions of causal models. In addition to that, this representation is
also adequate for answering interventional queries for the causal model.</p>
      <p>
        In this paper we contribute to these lines of research by investigating an explainable,
argumentation-based account of reasoning with causal models. The starting point in our
approach is a propositional knowledge base that encodes a causal model in the sense of Pearl [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
restricted to boolean variables and default assumptions about background variables. The
approach makes it possible to answer interventional and counterfactual queries by constructing
an argumentation framework whose stable extensions provide the answer to the queries. Our
method of answering counterfactual queries is a reformulation of the dual approach due to
Pearl, where a counterfactual query can be answered equivalently using two diferent methods:
a three-step abduction-action-prediction procedure, and the so called twin network method [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
We prove that, in our setting, the two methods are also equivalent.
      </p>
      <p>Our work can be understood as an initial investigation into the possibility of causal reasoning
within Dung’s model of argumentation.</p>
      <p>To summarise, the contributions of this paper are the following.
1. We introduce the notion of causal knowledge bases (Section 3).
2. We provide a novel approach for argumentation-based explanations for counterfactual
reasoning implementing the twin network method (Section 4).
3. We prove the standard three-step procedure and the twin network method for evaluating
counterfactuals by Pearl are equivalent under our notion (Section 4).
4. We discuss our approach and related work (Section 5).</p>
      <p>In Section 2 we present the necessary background on knowledge bases and formal
argumentation and Section 6 concludes the paper.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Preliminaries</title>
      <p>
        The causal reasoning framework we develop builds on a simple and well-known form of default
reasoning based on maximal consistent subsets [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Let ℒ be a set of propositional formulas
generated by a finite set of atoms. We assume there is a set  ⊆ ℒ of facts and a set  ⊆ ℒ of
assumptions. We call a pair Δ = (, ) a knowledge base. Facts are true and thus we assume
that  is consistent. Assumptions are statements that we are willing to assume true unless
we have evidence to the contrary. The consequences of a knowledge base Δ = (, ) are
determined by  together with the maximal -consistent subsets of .
      </p>
      <p>Definition 1. Let Δ = (, ) be a knowledge base and ,  ∈ ℒ. A set Σ ⊆  is a maximal
-consistent subset of  whenever Σ ∪  is consistent and Σ′ ∪  is inconsistent for all Σ′ ⊆ 
such that Σ ⊂ Σ′. We say that:
• Δ entails  (written Δ |∼  ) whenever Σ ∪  ⊢  for every maximal -consistent subset
of .
•  Δ-entails  (written  |∼ Δ  ) whenever ( ∪ {}, ) entails  .</p>
      <p>
        In the next section we define a special class of knowledge bases used to represent causal
knowledge. Our goal is to provide an argumentative method for causal and counterfactual
reasoning based on such knowledge bases. The argumentative aspect of this method relies
on a characterisation of reasoning with maximal consistent subsets based on the notion of
argumentation framework or AF, for short [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>Definition 2. An argumentation framework is a pair  = (A, ⇒) where  is a set whose
elements are called arguments and where ⇒ ⊆  ×  is called the attack relation.</p>
      <p>
        We mostly use infix notation for attacks and write  ⇒  for (, ) ∈ ⇒ and  ̸ ⇒ for
(, ) ̸∈ ⇒. If  ⇒  we also say that  attacks . Given an AF, a semantics determines sets of
jointly acceptable arguments called extensions. The admissible, preferred and stable semantics
are defined as follows [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>Definition 3. Let  = (A, ⇒) be an AF. A set  ⊆
A is:
• conflict-free if for all ,  ∈  we have  ̸⇒ .
• self-defending if for all  ∈  and  ∈ A ∖  such that  ⇒ , there is a  ∈  such that
 ⇒ .
• admissible if  is conflict-free and self-defending.
• preferred if  is admissible and there is no admissible set ′ ⊆ A such that  ⊂ ′.
• stable if  is conflict-free and for every  ∈ A ∖  there is a  ∈  such that  ⇒ .</p>
      <p>
        Following Cayrol [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] we define an argument induced by a knowledge base Δ = (, )
to be a pair (Φ,  ) where Φ ⊆  is a minimal set of assumptions (called the premises of the
argument) that, together with , consistently entails  (called the conclusion of the argument).
One argument undercuts another if the conclusion of the former is the negation of a premise of
the latter. The set of all arguments induced by Δ, together with undercut as the attack relation,
forms the AF induced by Δ 1. Formally:
Definition 4. Let Δ = (, ) be a knowledge base.
      </p>
      <p>• An argument induced by Δ is a pair (Φ,  ) such that
– Φ ⊆ ,
– Φ ∪  ⊬ ⊥,
– Φ ∪  ⊢  , and if Ψ ⊂ Φ then Ψ ∪  ⊬  .
• An argument (Φ,  ) undercuts an argument (Φ′,  ′) if for some ′ ∈ Φ′ we have ′ ≡ ¬  .
• The AF induced by Δ is the AF (A, ⇒) where A consists of all arguments induced by Δ
and  ⇒  holds whenever  undercuts . We denote the AF induced by Δ by  (Δ).</p>
      <p>
        Cayrol et al. [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] showed that there is a one-to-one correspondence between maximal
consistent subsets of a knowledge base and the stable extensions of the induced AF. Thus, given
a knowledge base Δ = (, ), the question of whether  Δ-entails  can be determined by
constructing the AF induced by ( ∪ {}, ) and checking whether every stable extension
contains an argument with conclusion  .
      </p>
      <p>1Note that this construction method allows arguments to have syntactically diferent, but semantically equivalent
conclusions.
Proposition 1. Let Δ = (, ) be a knowledge base. Then  |∼ Δ  if and only if every stable
extension  of  ( ∪ {}, ) contains an argument with conclusion  .</p>
      <p>
        We conclude this section by noting that the form of argumentation we consider here can also
be captured by structured argumentation formalisms such as ASPIC and ABA [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Causal Knowledge Bases</title>
      <p>
        Our definition of a causal model is essentially that of Pearl [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] except that we restrict our
attention to Boolean-valued variables. A causal model consists of a set  of background atoms,
a set  of explainable atoms, and a set  of formulas which we call Boolean structural equations
(this terminology was adopted from [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]). Background atoms represent variables that are
determined outside of the model. They are typically unobservable and uncontrollable. Every
explainable atom  is functionally dependent on other atoms of the model. This dependency
is specified by a Boolean structural equation of the form  ↔ . Intuitively, this equation
represents the causal mechanism by which  is determined by the other atoms in the model.
We use bi-implication because the represented causal mechanism determines not only when 
is true, but also when  is false.
      </p>
      <p>Definition 5. A causal model is a triple (, , ) where  and  partition the set of atoms into,
respectively, a set of background and explainable atoms.  consists of a set of Boolean structural
equations, one for each atom  ∈  . A Boolean structural equation for  is a formula of the form
 ↔ 
where  is a propositional formula that does not contain .</p>
      <p>
        Given a causal model (, , ) we can reconstruct  and  from  as follows; (1) for every
formula  ↔  in , add  to  , and (2) add all the remaining atoms that appear in  but
not in  to  . Therefore we can refer to a causal model as . For every Boolean structural
equation  ↔ , we call an atom appearing in  a parent (background or explainable) of . Like
in the standard case, a causal model induces a causal graph  whose vertices are the explainable
atoms of the model [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. This graph contains an edge from atom  to atom ′ whenever  is an
explainable parent of ′.
      </p>
      <p>Example 1. Let  = {corona, influenza , at-risk} and  =
{covid, flu , short-of-breath, fever, chills}. The set  consisting of the following equations
represents a causal model for a patient diagnosis scenario.</p>
      <p>short-of-breath ↔ covid ∧ at-risk
covid ↔ corona
lfu</p>
      <p>↔ influenza
fever ↔ covid ∨ flu
chills ↔ fever
corona</p>
      <p>influenza</p>
      <p>In words: corona virus causes covid, influenza virus causes flu , covid and flu cause fever, fever
causes chills, and covid causes short-of-breath, but only if the patient is at risk for this
condition (represented by the background atom at-risk). Note that corona, influenza and at-risk are
background atoms and thus assumed unobservable.</p>
      <p>Figure 1 depicts the causal graph for this model. This figure also includes the background atoms
of the model, drawn using dotted lines.</p>
      <p>
        We define a causal knowledge base to be a knowledge base where the set of facts is a causal
model and where the set of assumptions is restricted to contain assumptions about background
atoms. Here we depart from the probabilistic approach to causal modelling, where belief about
background atoms is represented using probability distributions over their values [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
Definition 6. A causal knowledge base is a knowledge base Δ = (, ) where  is a causal
model and where  is a set of background assumptions, at least one for each background atom. A
background assumption for an atom  is a literal  ∈ {, ¬}.
      </p>
      <p>By restricting background assumptions to be literals we prevent the ability to express
dependencies among background atoms. There are three possible attitudes towards a background
atom , since we can assume just , just ¬, or both. Assuming just  or ¬ amounts to
assuming that  is true or false, unless we have evidence to the contrary. Assuming both  and
¬ represents a state of uncertainty where  may, depending on the evidence, be true as well
as false. If Δ = (, ) is a causal knowledge base then Δ-entailment represents a relation
between observations and predictions. These predictions include causes as well as efects of the
observation in accordance with the causal model  and background assumptions .
Example 2. Consider the causal knowledge base Δ = (, ) where  is the causal model
defined in Example 1 and where  = {at-risk, ¬at-risk, ¬corona, ¬influenza }. In words, these
assumptions mean that we are uncertain whether the patient is at risk to develop shortness of
breath, and a corona or influenza infection is assumed false unless there is evidence to the contrary.
Now consider the question of whether observing fever entails shortness of breath, i.e., whether
fever |∼ Δ short-of-breath.
Flu and covid cause fever. Thus, fever is evidence for flu or covid. Of these two possible causes,
covid may cause shortness of breath, but only if the patient is at risk, which may or may not be
true. Hence, fever may or may not be evidence for shortness of breath. This reasoning is depicted
by the AF  =  (( ∪ {fever}, )) shown in Figure 2 (we only depict arguments relevant to the
conclusion of short-of-breath). This AF has four stable extensions {2, 4}, {3, 4}, {2, 5}, and
{3, 5, 1}. The argument 1 with conclusion short-of-breath is included in some but not all of
these extensions. We thus have that (1) is false, but note that</p>
      <p>fever |∼ Δ ¬short-of-breath
is also false. Thus, given fever, shortness of breath is possible but not necessary.</p>
      <p>1 : ({at-risk, ¬influenza}, short-of-breath)
2 : ({¬at-risk}, ¬at-risk)</p>
      <p>4 : ({¬corona}, influenza)
3 : ({at-risk}, at-risk)
5 : ({¬influenza}, corona)</p>
    </sec>
    <sec id="sec-4">
      <title>4. Counterfactuals</title>
      <p>
        In this section we show how causal knowledge bases provide a means to evaluate counterfactuals.
Pearl introduces two methods for evaluating counterfactuals in causal models [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], a
threestep procedure and the twin network method. We now demonstrate these two processes are
equivalent under our notion of causal knowledge bases.
      </p>
      <p>Before dealing with counterfactual statements we start with interventional statements of the
form
if  would be  then  would be true
(2)
where  is a variable we intervene on and  a truth value (we use ⊤ for true and ⊥ for false).
The antecedent of this statement represents the action of setting  to . In our running example,
a patient might be given Ibuprofen to treat fever. This is an action that amounts to setting fever
to ⊥. Note that this is diferent from observing ¬fever. While the observation ¬fever would, in
our model, imply ¬covid and ¬flu , the action of setting fever to ⊥ amounts to overriding the
causal mechanism that determines fever, which does not afect covid or flu . Like Pearl, given
a causal model , we denote by [=] the new causal model where the equation  ↔  is
replaced with  ↔ .</p>
      <p>Definition 7. Let  be a causal model, let  be an explainable atom, and let  ∈ {⊤, ⊥}. We
denote by [=] the causal model defined by
[=] = {(′ ↔ ) ∈  | ′ ̸= } ∪ {( ↔ )}.
Example 3. Let Δ = (, ) be the causal knowledge base from Example 2. Since short-of-breath
is caused by covid, covid causes fever, and fever causes chills, we have that shortness of breath leads
to the prediction of chills</p>
      <p>short-of-breath |∼ Δ chills.</p>
      <p>But what if we observe short-of-breath in a patient that has been given Ibuprofen? The answer is
given by the causal knowledge base Δ′ = ([fever=⊥], ). Here, the action of setting fever to ⊥
blocks the efect of covid on chills. We now have that shortness of breath leads to the prediction of
no chills</p>
      <p>short-of-breath |∼ Δ′ ¬chills.</p>
      <p>
        We now turn to counterfactual statements. These are statements of the form
given , if  had been  then  would be true
where  is an observed piece of evidence and  is the counterfactual conclusion. An example of
a counterfactual in our running example would be: given that the patient has fever, would the
patient have had fever if we had administered a covid vaccine? This amounts to the statement
given fever, if covid had been ⊥ then fever would be true. The standard causal modelling approach
of evaluating a counterfactual statement of the form (5) is based on a three-step procedure [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
that we adapt for our setting as follows.
      </p>
      <p>Definition 8. Given a causal knowledge base Δ = (, ), the truth of a counterfactual
statement (5) is determined by:
• Step 1 (abduction) Determine the maximal  ∪ {}-consistent subsets Σ1, . . . , Σ of .</p>
      <p>These sets represent the possible configurations of the background atoms consistent with
evidence .
• Step 2 (action) Set  to  by updating the causal model  to [=].
• Step 3 (prediction) For each Σ obtained in step 1, determine whether Σ ∪ [=] ⊢  . If
the answer is yes for all  ∈ 0, . . . , then the counterfactual statement (5) is true.</p>
      <p>
        The dificulty with this procedure is that it requires the computation of the maximal  ∪
{}consistent subsets of . The same dificulty arises in probabilistic causal models, where the
abduction step requires the computation of a probability distribution over configurations of
the background atoms. The twin network method overcomes this dificulty [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. It is based on
constructing a so called twin model whose causal network consists of two parts, one to represent
the actual world, and one to represent the counterfactual world. While the two networks share
the same background variables, the counterfactual part consists of a “counterfactual copy” of all
the explainable variables. In what follows we use * to denote a unique new atom representing
the counterfactual copy of , and use * to denote the formula  with each occurrence of an
explainable atom  replaced with * .
      </p>
      <p>Definition 9. The twin model for a causal model  is the causal model * defined by
* =  ∪ {(* ↔ * ) | ( ↔ ) ∈ }
.</p>
      <p>While the abduction step takes place in the actual network, the action and prediction steps
take place in the counterfactual network. Let us now prove this intuition of separated areas
in the twin model holds up formally during the evaluation, i. e., the three step procedure is
equivalent to the evaluation of the twin model.</p>
      <p>Proposition 2. Let Δ = (, ) be a causal knowledge base. The counterfactual statement
given , if  had been  then  would be true
is true in Δ if and only if  |∼ Δ*[* =]  * .</p>
      <p>Proof. We prove that the twin model method is equivalent to the three-step procedure for
evaluating counterfactuals from Pearl as given in Definition 8.</p>
      <p>Let Δ = (, ) be a causal knowledge base. First, we recall that  |∼ Δ  if and only if
( ∪ {}, ) entails  . ( ∪ {}, ) entails  whenever for every maximal K-consistent subset
Σ of , we have that Σ ∪  ⊢  .</p>
      <p>(⇐) Now, for the given counterfactual statement, consider Δ* = (* , ) with * as given
in Definition 9. Furthermore, we modify Δ* by setting * =  in * , i.e., we have Δ*[* =].
That means, * fully contains  as well as an exact copy of  (each copy of a formula  of 
is denoted with * ). In this copy, we also have set * = . Therefore, we can essentially also
consider * as the union of  and [=].</p>
      <p>With the twin model method, we have that  |∼ Δ*[* =]  * . That means, according to
Definition 1 we determine the * ∪{}-consistent subsets Σ*1, ..., Σ* of . Now, since  ⊂ * ,
it follows that Σ*1 ∩ , ..., Σ* ∩  are maximal consistent with  ∪ {} (as required by step 1
abduction).</p>
      <p>The action step of Definition 8 is also executed in the twin model by setting * =  in * .</p>
      <p>In the prediction step, we have to determine whether Σ ∪ [=] ⊢  for all -consistent
Σ. In the twin model method, we consider the * ∪ {}-consistent subsets. As already
explained above, [=] is fully contained in * and therefore, similarly to above, if we have
that Σ* ∪ * ⊢  * it follows that Σ* ∪ [=] ⊢  . Thus, the twin model method is equivalent
to the three-step procedure for evaluating counterfactual statements.</p>
      <p>(⇒) Suppose the counterfactual statement is true according to the three step procedure. In the
twin model it holds that  and {(* ↔ * ) | ( ↔ ) ∈ } have no variables in common. Thus,
for any Σ maximal consistent wrt. * ∪{} it holds that Σ′ = Σ∩{(* ↔ * ) | ( ↔ ) ∈ }
is maximal consistent wrt. [=] ∪ {}. By the assumption we have Σ′ ∪ [=] ∪ {} ⊢ 
for any such Σ′. By monotony of classic entailment it follows that Σ ∪ [** =] ∪ {} ⊢  .</p>
      <p>We have now proven that the standard three-step procedure can be reduced to a single
evaluation step on the twin model. To conclude, let us give some examples of counterfactual
reasoning with the AFs build from a twin model.</p>
      <p>Example 4. Let Δ = (, ) be the causal knowledge base defined in Example 2. Suppose we
have evidence that the patient has fever. Would the patient have had fever if we had administered
a covid vaccine (i.e., if covid had been false)? This depends on whether the fever is caused by covid
or flu. If fever was caused by covid then the vaccine would indeed have prevented fever. If, on the
corona</p>
      <p>influenza
other hand, fever was caused by flu, then the vaccine would not have had an efect, and the patient
would still have had fever. To evaluate this counterfactual statement we check whether
fever |∼ Δ*[covid* =⊥] fever* .</p>
      <p>fever |∼ Δ*[covid* =⊥] ¬fever*
Figure 3 shows the causal graph of the twin model c*ovid* =⊥ and Figure 4 shows the AF  =
([*covid* =⊥] ∪ {fever}, ). This AF has two stable extensions {1, 3} and {2}. While the first
entails fever, the second does not. Thus, (6) is false, but note that
is also false. Thus, given that the patient has fever, the patient may or may not have had fever, had
we administered a covid vaccine.
3 : ({¬corona}, influenza)</p>
      <p>Example 5. Suppose that, in addition to having evidence that the patient has fever, we also have
evidence of shortness of breath. Again, we want to know if the patient would have had fever if we
had administered a covid vaccine. This time, the evidence of shortness of breath implies that the
fever must have been caused by covid. Hence, the vaccine would indeed have prevented fever. We
check this formally by checking whether</p>
      <p>fever ∧ short-of-breath |∼ Δ*[covid* =⊥] fever* .
(7)
(8)</p>
    </sec>
    <sec id="sec-5">
      <title>5. Discussion</title>
      <p>
        Our work can be understood as an initial investigation into the possibility of reasoning with
causal models using tools of abstract information science and logic. By doing this we contribute
to explaining technically advanced causal reasoning procedures with concepts closer to human
reasoning. Our account of Pearl’s theory was motivated by the non-monotonic interpretation
of his causal model in [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. The need to further explain causal reasoning, e. g., using Bayesian
networks, has also been pointed out in [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. Their contribution towards this is making
dseparation explicit in so called support graphs, which eliminate circular causal structures
and help to explain interdependent causes. Implementing a similar mechanism within our
framework has proven nontrivial. In [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] they illustrate the power of their framework by
applying it to legal reasoning. As the authors point out under future work, the support graph
is more of a visualization tool while the actual evaluation of arguments is still done in the
original Bayesian network formalism. A sophisticated approach towards a framework capable
of intrinsic evaluations of causal statements is the method for generating bipolar argumentation
frameworks from causal models by Rago et al. [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], which is also based on Pearl’s notion of
a causal model. For that they create so called explanation moulds, that reinterpret desirable
properties of semantics of argumentation frameworks. Rago et. al. point out that, compared to
[
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], they make better use of the AF representation in their causal reasoning by basing their
semantic evaluation on the support and attack relations themselves instead of relying on an
additional ontological structure. This criticism does not apply to our framework, we only rely
on the causal model. Once the AF is constructed, we do not need the inference apparatus of the
underlying knowledge base formalism for causal reasoning in our framework.
      </p>
      <p>
        There are several major design diferences between the two approaches. First Rago et al.
use bipolar AFs in contrast to our Dung-style approach. Second, our approach is based on
structured argumentation, while theirs uses causal atoms as arguments. On the evaluation
level, they apply gradual semantics while we make use of classic stable semantics. For both
frameworks an interesting future work direction would be to apply the resp. other type of
semantics. An important diference lies in the resp. attack notions. Rago et al. let causes
contribute negatively or positively towards the status of an argument via the attack and support
relation, respectively. Our focus is on the explanation aspect. Attacks are used to exclude
certain premises as causes. This is done by undercut-attacks on the corresponding argument. A
current shortcoming of our approach is the restriction to propositional logic in the attack notion,
which would have dificulties handling uncertain causal relations. A promising future work
direction would therefore be to investigate ways for representing uncertain causal relations in
some type of probabilistic argumentation framework, e. g. by adding a probability distribution
over possible causal structures [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. Another option could be to utilize a form of probabilistic
instantiation like PABA [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
      </p>
    </sec>
    <sec id="sec-6">
      <title>6. Conclusion</title>
      <p>We have proposed a natural way to model causal reasoning with Dung-style AFs by means of
causal knowledge bases. The framework introduced integrates given causal knowledge in form
of structural equations into an attack relation and a set of structured arguments constructed
from sets of assumptions resp. observations from the real world. By doing this we have
laid the groundwork for an implementation of the twin network method for counterfactual
reasoning. It ofers an alternative for computing the truth value of counterfactual statements
which, as we proved, is equivalent to the standard approach in our framework. The results
we obtain demonstrate that causal reasoning can be done as an instantiation of Dung’s model
of argumentation. This can be used to provide argumentative explanations for causal and
counterfactual queries. That is, the argumentation framework contains not only the arguments
used to arrive at a prediction, but also possible counterarguments that lead to alternative
predictions.</p>
      <p>Acknowledgements The research reported here was partially supported by the Deutsche
Forschungsgemeinschaft (grant 375588274).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Adadi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Berrada</surname>
          </string-name>
          ,
          <article-title>Peeking inside the black-box: a survey on explainable artificial intelligence (XAI)</article-title>
          ,
          <source>IEEE access 6</source>
          (
          <year>2018</year>
          )
          <fpage>52138</fpage>
          -
          <lpage>52160</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>R.</given-names>
            <surname>Guidotti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Monreale</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Ruggieri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Turini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Giannotti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Pedreschi</surname>
          </string-name>
          ,
          <article-title>A survey of methods for explaining black box models, ACM computing surveys (CSUR) 51 (</article-title>
          <year>2018</year>
          )
          <fpage>1</fpage>
          -
          <lpage>42</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>P. M.</given-names>
            <surname>Dung</surname>
          </string-name>
          ,
          <article-title>On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>77</volume>
          (
          <year>1995</year>
          )
          <fpage>321</fpage>
          -
          <lpage>358</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>C.</given-names>
            <surname>Antaki</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Leudar</surname>
          </string-name>
          ,
          <article-title>Explaining in conversation: Towards an argument model</article-title>
          ,
          <source>European Journal of Social Psychology</source>
          <volume>22</volume>
          (
          <year>1992</year>
          )
          <fpage>181</fpage>
          -
          <lpage>194</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>B.</given-names>
            <surname>Moulin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Irandoust</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Bélanger</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Desbordes, Explanation and argumentation capabilities: Towards the creation of more persuasive agents</article-title>
          ,
          <source>Artificial Intelligence Review</source>
          <volume>17</volume>
          (
          <year>2002</year>
          )
          <fpage>169</fpage>
          -
          <lpage>222</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>K.</given-names>
            <surname>Čyras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rago</surname>
          </string-name>
          , E. Albini,
          <string-name>
            <given-names>P.</given-names>
            <surname>Baroni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Argumentative xai: a survey</article-title>
          ,
          <source>arXiv preprint arXiv:2105.11266</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>A.</given-names>
            <surname>Vassiliades</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Bassiliades</surname>
          </string-name>
          , T. Patkos,
          <source>Argumentation and explainable artificial intelligence:</source>
          a survey,
          <source>The Knowledge Engineering Review</source>
          <volume>36</volume>
          (
          <year>2021</year>
          )
          <article-title>e5</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J.</given-names>
            <surname>Pearl</surname>
          </string-name>
          ,
          <article-title>Causality: models, reasoning and inference</article-title>
          , volume
          <volume>29</volume>
          , Cambridge University Press,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>M. M. De Graaf</surname>
            ,
            <given-names>B. F.</given-names>
          </string-name>
          <string-name>
            <surname>Malle</surname>
          </string-name>
          ,
          <article-title>How people explain action (and autonomous intelligent systems should too)</article-title>
          ,
          <source>in: 2017 AAAI Fall Symposium Series</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>19</fpage>
          -
          <lpage>26</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>T.</given-names>
            <surname>Miller</surname>
          </string-name>
          ,
          <article-title>Explanation in artificial intelligence: Insights from the social sciences</article-title>
          ,
          <source>Artificial intelligence 267</source>
          (
          <year>2019</year>
          )
          <fpage>1</fpage>
          -
          <lpage>38</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>P.</given-names>
            <surname>Schwab</surname>
          </string-name>
          , W. Karlen, Cxplain:
          <article-title>Causal explanations for model interpretation under uncertainty</article-title>
          ,
          <source>Advances in Neural Information Processing Systems</source>
          <volume>32</volume>
          (
          <year>2019</year>
          )
          <fpage>10188</fpage>
          -
          <lpage>10198</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>D.</given-names>
            <surname>Alvarez-Melis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. S.</given-names>
            <surname>Jaakkola</surname>
          </string-name>
          ,
          <article-title>A causal framework for explaining the predictions of black-box sequence-to-sequence models</article-title>
          ,
          <source>arXiv preprint arXiv:1707</source>
          .
          <year>01943</year>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>R. M. J. Byrne</surname>
          </string-name>
          ,
          <article-title>Counterfactuals in explainable artificial intelligence (XAI): evidence from human reasoning</article-title>
          , in: S. Kraus (Ed.),
          <source>Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI</source>
          <year>2019</year>
          , Macao, China,
          <source>August 10-16</source>
          ,
          <year>2019</year>
          , ijcai.org,
          <year>2019</year>
          , pp.
          <fpage>6276</fpage>
          -
          <lpage>6282</lpage>
          . doi:
          <volume>10</volume>
          .24963/ijcai.
          <year>2019</year>
          /876.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>A.</given-names>
            <surname>Bochman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Lifschitz</surname>
          </string-name>
          ,
          <article-title>Pearl's causality in a logical setting</article-title>
          , in: B.
          <string-name>
            <surname>Bonet</surname>
          </string-name>
          , S. Koenig (Eds.),
          <source>Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, January 25-30</source>
          ,
          <year>2015</year>
          , Austin, Texas, USA, AAAI Press,
          <year>2015</year>
          , pp.
          <fpage>1446</fpage>
          -
          <lpage>1452</lpage>
          . URL: http://www.aaai. org/ocs/index.php/AAAI/AAAI15/paper/view/9686.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>N.</given-names>
            <surname>McCain</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Turner</surname>
          </string-name>
          , et al.,
          <article-title>Causal theories of action and change</article-title>
          , in: AAAI/IAAI, Citeseer,
          <year>1997</year>
          , pp.
          <fpage>460</fpage>
          -
          <lpage>465</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>N. R. R.</given-names>
            <surname>Manor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Rescher</surname>
          </string-name>
          ,
          <article-title>On inference from inconsistent premises</article-title>
          ,
          <source>Theory and Decision</source>
          <volume>1</volume>
          (
          <year>1970</year>
          )
          <fpage>179</fpage>
          -
          <lpage>219</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>C.</given-names>
            <surname>Cayrol</surname>
          </string-name>
          ,
          <article-title>On the relation between argumentation and non-monotonic coherence-based entailment</article-title>
          ,
          <source>in: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, IJCAI</source>
          <volume>95</volume>
          ,
          <string-name>
            <surname>Montréal</surname>
            <given-names>Québec</given-names>
          </string-name>
          , Canada,
          <source>August 20-25</source>
          <year>1995</year>
          , 2 Volumes, Morgan Kaufmann,
          <year>1995</year>
          , pp.
          <fpage>1443</fpage>
          -
          <lpage>1448</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>O.</given-names>
            <surname>Arieli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Borg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Heyninck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Straßer</surname>
          </string-name>
          ,
          <article-title>Logic-based approaches to formal argumentation</article-title>
          ,
          <source>FLAP</source>
          <volume>8</volume>
          (
          <year>2021</year>
          )
          <fpage>1793</fpage>
          -
          <lpage>1898</lpage>
          . URL: https://collegepublications.co.uk/ifcolog/?00048.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>S. T.</given-names>
            <surname>Timmer</surname>
          </string-name>
          , J.-J. C. Meyer, H. Prakken,
          <string-name>
            <given-names>S.</given-names>
            <surname>Renooij</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Verheij</surname>
          </string-name>
          ,
          <article-title>Explaining bayesian networks using argumentation</article-title>
          ,
          <source>in: European Conference on Symbolic and Quantitative Approaches to Reasoning and Uncertainty</source>
          , Springer,
          <year>2015</year>
          , pp.
          <fpage>83</fpage>
          -
          <lpage>92</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>S. T.</given-names>
            <surname>Timmer</surname>
          </string-name>
          , J.-J. C. Meyer, H. Prakken,
          <string-name>
            <given-names>S.</given-names>
            <surname>Renooij</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Verheij</surname>
          </string-name>
          ,
          <article-title>A structure-guided approach to capturing bayesian reasoning about legal evidence in argumentation</article-title>
          ,
          <source>in: Proceedings of the 15th International Conference on Artificial Intelligence and Law</source>
          ,
          <year>2015</year>
          , pp.
          <fpage>109</fpage>
          -
          <lpage>118</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>A.</given-names>
            <surname>Rago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Russo</surname>
          </string-name>
          , E. Albini,
          <string-name>
            <given-names>P.</given-names>
            <surname>Baroni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Forging argumentative explanations from causal models</article-title>
          , in: M.
          <string-name>
            <surname>D'Agostino</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>A. D'Asaro</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          Larese (Eds.),
          <source>Proceedings of the 5th Workshop on Advances in Argumentation in Artificial Intelligence</source>
          <year>2021</year>
          co
          <article-title>-located with the 20th International Conference of the Italian Association for Artificial Intelligence</article-title>
          (AIxIA
          <year>2021</year>
          ), Milan, Italy, November 29th,
          <year>2021</year>
          , volume
          <volume>3086</volume>
          <source>of CEUR Workshop Proceedings, CEUR-WS.org</source>
          ,
          <year>2021</year>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>3086</volume>
          /paper3.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>P.</given-names>
            <surname>Besnard</surname>
          </string-name>
          , M.
          <article-title>-</article-title>
          <string-name>
            <surname>O. Cordier</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Moinard</surname>
          </string-name>
          ,
          <article-title>Arguments using ontological and causal knowledge</article-title>
          ,
          <source>in: International Symposium on Foundations of Information and Knowledge Systems</source>
          , Springer,
          <year>2014</year>
          , pp.
          <fpage>79</fpage>
          -
          <lpage>96</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>A.</given-names>
            <surname>Hunter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Polberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Rienstra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Thimm</surname>
          </string-name>
          ,
          <article-title>Probabilistic argumentation: A survey</article-title>
          ,
          <source>Handbook of Formal Argumentation</source>
          <volume>2</volume>
          (
          <year>2021</year>
          )
          <fpage>397</fpage>
          -
          <lpage>441</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>K.</given-names>
            <surname>Čyras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Heinrich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Computational complexity of flat and generic assumptionbased argumentation, with and without probabilities</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>293</volume>
          (
          <year>2021</year>
          )
          <fpage>103449</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>