<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Applying Attribution Explanations in Truth-Discovery Quantitative Bipolar Argumentation Frameworks</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Xiang Yin</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nico Potyka</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Francesca Toni</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Cardif University</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Imperial College London</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <fpage>56</fpage>
      <lpage>67</lpage>
      <kwd-group>
        <kwd>eol&gt;Explainable AI</kwd>
        <kwd>Quantitative Argumentation</kwd>
        <kwd>Truth Discovery Application</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        of the exhibition — each distinguished by diferent colors. For pairs of contradictory claims,
where diferent values are asserted for the same object, a bi-directional attack relationship
is introduced between the claims. For each report (one for each pair of source and claim), a
bi-directional support relationship is established between the source and the claim. Following
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], we use a base score of 0.5 for source argument (we are initially indiferent about the
trustworthiness of a source), and a base score of 0 for claims (we do not believe claims without
evidence). We compute the dialectical strength of arguments using the Quadratic Energy (QE)
gradual semantics [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], and the final strengths of arguments are displayed on their side in Figure
1. While the strength values seem plausible, it can be challenging to understand why certain
claims and sources receive higher or lower trust scores.
      </p>
      <p>
        To address this problem, attribution explanations (AEs) have been proposed. Specifically, given
an argument of interest (topic argument) in a QBAF, AEs can explain the impact of arguments
on the topic argument. AEs can be broadly categorized into Argument Attribution Explanations
(AAEs) (e.g., [
        <xref ref-type="bibr" rid="ref15 ref16 ref17">15, 16, 17</xref>
        ]) and Relation Attribution Explanations (RAEs) (e.g., [
        <xref ref-type="bibr" rid="ref18 ref19">18, 19</xref>
        ]). AAEs
explain the strength of the topic argument by assigning attribution scores to arguments: the
greater the attribution score, the greater the argument’s contribution to the topic argument.
Similarly, RAEs assign the attribution scores to edges to measure their contribution.
Removalbased and Shapley-based techniques are commonly used for computing the attribution scores.
      </p>
      <p>However, most existing studies focus on explaining acyclic QBAFs rather than cyclic ones,
leaving a gap in understanding the complexities of the latter. In addition, current research
typically examines only one type of attribution — either AAEs or RAEs — without providing a
comprehensive comparison of both methods. In this paper, we aim to address these gaps by
investigating the applicability of removal and Shapley-based AAEs and RAEs in the context of
cyclic TD-QBAFs. Furthermore, we ofer a comprehensive comparison between them to better
understand the applicability of these AEs.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Preliminaries</title>
      <sec id="sec-2-1">
        <title>2.1. QBAFs and the QE Gradual Semantics</title>
        <p>
          We briefly recall the definition of QBAFs and the QE gradual semantics [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
        </p>
        <p>
          Definition 1 (QBAF). A Quantitative Bipolar Argumentation Framework (QBAF) is a
quadruple  = ⟨, ℛ− , ℛ+,  ⟩ consisting of a finite set of arguments , binary relations of attack
ℛ− ⊆ × and support ℛ+ ⊆ × (ℛ− ∩ℛ+ = ∅) and a base score function  :  → [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ].
The base score function in QBAFs assigns an apriori belief to arguments. QBAFs can be
represented graphically (as in Figure 1) using nodes to represent arguments and edges to show
the relations between them. Then QBAFs are said to be (a)cyclic if the graphs representing them
are (a)cyclic.
        </p>
        <p>
          In this paper, we use the QE gradual semantics [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] to evaluate the strength of arguments in
QBAFs. Like most QBAF semantics, it computes strength values iteratively by initializing the
strength value of each argument with its base score and repeatedly applying an update function.
Let us represent the strength of arguments in the -th iteration by a function
  :  → [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ],
where  0( ) =  ( ) for all  ∈ . In order to compute  +1 from  , the update function first
computes the energy  of attackers and supporters of each argument  defined by
It then computes the strength in the next iteration via
 =
        </p>
        <p>∑︁
{ ∈|(, )∈ℛ+}
 ( ) −</p>
        <p>∑︁
{ ∈|(, )∈ℛ− }</p>
        <p>( ).</p>
        <p>⎧ ( )2
 +1( ) = ⎨ ( ) −  ( ) · 1+( )2</p>
        <p>≤ 0;
( )2
⎩ ( ) + (1 −  ( )) · 1+( )2   &gt; 0.</p>
        <p>
          The final dialectical strength of each argument  is then defined as the limit lim→∞  ( ). In
cyclic graphs, the strength values may start oscillating and the limit may not exist [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ]. In all
known cases, the problem can be solved by continuizing the semantics [
          <xref ref-type="bibr" rid="ref13 ref14">14, 13</xref>
          ]. However, we
do not have space to discuss these issues in more detail here and will just restrict to examples
where the strength values converge.
        </p>
        <p>To better understand the QE gradual semantics, let us look at an example.</p>
        <p>Example 1. Consider the QBAF in Figure 2, where the base scores are given as  ( ) = 0.8,  ( ) =
0.6,  ( ) = 0.9, and  ( ) = 0.7. Since  and  have no parents, we have  =  = 0 for all 

and thus  ( ) =  ( ) = 0.6 and  ( ) =  ( ) = 0.9. For  , we have  =  ( )
−  ( ) = 0.3
for all , hence  ( ) =  ( ) + (1 −  ( )) · 0.32/(1 + 0.32) = 0.72. For  , we have  =  ( ) +
 ( ) −  ( ) = 1.02 for all  ≥ 1. Hence,  ( ) =  ( ) + (1 −  ( )) · 1.022/(1 + 1.022) = 0.90.</p>
        <p>In the remainder, unless specified otherwise, we assume as given a generic QBAF  =
⟨, ℛ− , ℛ
+,  ⟩ and we let ℛ = ℛ</p>
        <p>− ∪ ℛ
the arguments or edges, or change the base score function, as follows.</p>
        <p>+ We will often need to restrict QBAFs to a subset of
denote the strength of  in | .</p>
        <p>Notation 1. For  ⊆  , let | = ⟨ ∩  , ℛ− , ℛ+,  ⟩. Then, for any  ∈ , we let   ( )
denote the strength of  in | .</p>
        <p>Notation 2. For  ⊆ ℛ
, let | = ⟨, ℛ− ∩ , ℛ
+
∩ ,  ⟩. Then, for any  ∈ , we let   ( )
any  ∈ , we let   ′ ( ) denote the strength of  in | ′ .</p>
        <p>
          Notation 3. For  ′ :  → [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] a base score function, let | ′ = ⟨, ℛ− , ℛ+,  ′⟩. Then, for
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Truth Discovery QBAFs (TD-QBAFs)</title>
        <p>where  = ⋃︀</p>
        <p>
          ∈
TD-QBAFs allow reasoning about truth discovery problems using quantitative argumentation.
Truth discovery problems can be described concisely as truth discovery networks (TDNs) [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ].
of objects , a set  = {}∈ of domains of the objects, and a set of reports  ⊆  ×  ×
Formally, a TDN is a tuple N = (, , , ) consisting of a finite set of sources , a finite set
 ,
, and for all (, , ) ∈ , we have  ∈ , and there is no (, , ′) ∈ 
trust score to each source and each claim [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ].
with  ̸= ′. Given a TDN N , we are interested in a truth discovery operator that assigns a
        </p>
        <p>
          Singleton suggested to reason about TDNs using bipolar argumentation frameworks, where
we have bi-directional support edges between sources and their claims (trustworthy sources
make claims more believable, and, conversely, believable claims make sources more trustworthy)
and contradictory claims attack each other [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. TD-QBAFs implement this idea with QBAFs,
where sources have a base score of 0.5 (we are initially indiferent about the trustworthiness of
sources) and claims have a base score of 0 (we do not believe anything without evidence).
Definition 2 (TD-QBAF induced from a TDN). The TD-QBAF induced from the TDN N =
(, , , ) is defined as  = (, ℛ− , ℛ+,  ), where  =  ∪{(, ) | ∃ ∈  : (, , ) ∈ },
ℛ− = {(, ′) ∈ 2 ∩ 2 | obj() = obj(′), val() ̸= val(′)}, ℛ+ = {(, (, )), ((, ), ) |
(, , ) ∈ }.  () = 0.5 for all  ∈  and  () = 0 for all  ∈ .
        </p>
        <p>Every QBAF semantics gives rise to a truth discovery operator that is defined by associating
each source and claim with its final strength under the semantics. The semantical properties of
QBAF semantics like balance and monotonicity directly translate to meaningful guarantees for
the derived trust scores.</p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3. Argument Attribution Explanations</title>
        <p>
          In order to explain trust scores in TD-QBAFs, we recall the removal-based and Shapley-based
AAEs. AAEs aim at evaluating the impact of an argument on a given topic argument. The
removal-based AAEs proposed by [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] measure how the strength of the topic argument changes
if an argument is removed.
        </p>
        <sec id="sec-2-3-1">
          <title>Definition 3 (Removal-based AAEs).</title>
          <p>under  is:</p>
          <p>( ) =  ( ) −  ∖{ }( ).</p>
          <p>
            The Shapley-based AAEs [
            <xref ref-type="bibr" rid="ref16 ref21">16, 21</xref>
            ] use the Shapley value from coalitional game theory [
            <xref ref-type="bibr" rid="ref22">22</xref>
            ]
to assign attributions. Each argument in a QBAF is seen as a player that can contribute to the
strength of the topic argument. Intuitively, Shapley-based AAEs look at all possible ways how
the argument could be added to the QBAF and average its impact on the topic argument.
          </p>
          <p>Let , 
∈ . The removal-based AAE from  to</p>
        </sec>
        <sec id="sec-2-3-2">
          <title>Definition 4 (Shapley-based AAEs).</title>
          <p>under  is:
Let , 
∈ . The Shapley-based AAE from  to 
  ( ) =</p>
          <p>∑︁
⊆∖{ , }
(| ∖ { }| − | | −
| ∖ { }|!
1)! | |! [︀
 ∪{ }( ) −   ( )︀] .</p>
        </sec>
      </sec>
      <sec id="sec-2-4">
        <title>2.4. Relation Attribution Explanations</title>
        <p>
          RAEs are similar to AAEs, but measure the impact of edges rather than the impact of arguments.
Analogous to the idea of removal-based AAEs [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ], we consider the removal-based RAEs.
        </p>
        <sec id="sec-2-4-1">
          <title>Definition 5 (Removal-based RAEs).</title>
          <p>to  under  is:</p>
          <p>() =  ( ) −  ℛ∖{}( ).</p>
          <p>
            Shapley-based RAEs [
            <xref ref-type="bibr" rid="ref18 ref19">18, 19</xref>
            ] share the same idea with Shapley-based AAEs, but the attribution
objects are changed from arguments to edges.
          </p>
          <p>Let  ∈  and  ∈ ℛ. The removal-based RAE from</p>
        </sec>
        <sec id="sec-2-4-2">
          <title>Definition 6 (Shapley-based RAEs).</title>
          <p>to  under  is:</p>
          <p>Let  ∈  and  ∈ ℛ. The Shapley-based RAE from 
 () =</p>
          <p>∑︁
⊆ℛ∖{ }
(|ℛ| − || −
|ℛ|!
1)! ||! [︀</p>
          <p>∪{}( ) −   ( )︀] .
3. Explaining TD-QBAFs with AAEs and RAEs</p>
        </sec>
      </sec>
      <sec id="sec-2-5">
        <title>3.1. Settings</title>
        <p>
          To compare the diefrent AEs, we explain the strength of argument 5 in Figure 1. Since there
are 17 arguments and 32 edges in Figure 1, computing Shapley-based AAEs and RAEs exactly
is prohibitively expensive. We therefore apply the approximation algorithm from [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] that
approximates the Shapley values using sampling (we set the sample size to 1000).
        </p>
        <p>We report the removal and Shapley-based AAEs and RAEs in Figure 3 and 4 1. In addition,
to provide intuitive explanations for argument 5, we visualize the removal and
Shapleybased AAEs and RAEs as shown in Figure 3 and 4, where blue/red arguments or edges denote
positive/negative AAEs or RAEs. The darkness of the color of arguments and the thickness of
the edges denote the magnitude of the their AAEs and RAEs, respectively2.</p>
      </sec>
      <sec id="sec-2-6">
        <title>3.2. Results and Analysis for AAEs</title>
        <p>Figure 3 shows the results of removal and Shapley-based AAEs.</p>
        <p>For the removal-based AAEs, we observe that 7, 8, 9, and 10 have noticeably positive
influences on 5, followed by minor positive influences from 3, 1, and 2. This is because 7
to 10 are direct supporters for 5, whereas 3, 1, and 2 indirectly support 5. Specifically, 2
supports 3, 3 supports 1, 1 supports 7, and then 7 supports 5, meaning 3, 1, and 2 all
indirectly support 5. These indirect influences also explain why the AAEs of 3, 1, and 2 are
much smaller than those of 7 to 10. Besides, since 7 is supported by 1, its AAE is slightly
larger than those of 8 to 10, which have consistent AAEs due to their symmetrical structure
to 5. In contrast, 0, 1, 2, and 0 have minor negative influences on 5 because 0 attacks
1, an indirect supporter for 5. Furthermore, 0 to 2 support 0, and thus they have negative
influences on 5 as well. However, their negative influences are not obvious due to the indirect
influences. Finally, the remaining arguments have AAEs close to 0, indicating their negligible
influences on 5.</p>
        <p>When considering the Shapley-based AAEs, the results are similar to those of removal-based
AAEs, where 7 to 10 still have significant influences on 5. Unlike removal-based AAEs,
however, we notice that both 4 and 6 have minor negative influences on 5. This is because
4 directly attacks 5, while 6 indirectly attacks 5 by supporting 4, although the QE strength
of 4 is very small (close to 0). Also, the negative influences of 0 to 2 and 0 and positive
influence of 2 are relatively negligible compared with those of in removal-based AAEs due to
their indirect connection to 5.</p>
        <p>In this case study, both removal and Shapley-based AAEs can efectively capture the main
influential arguments despite having some tiny diferences in those low contributing arguments.
This is mainly because of their diferent mechanisms of computing the AAEs. Another important
reason is probably due to the approximation algorithm used for Shapley-based AAEs, leading
to diferent AAEs even with the same sample size for the coalitions. We also noticed that
the qualitative influence (the sign) of those Shapley-based AAEs close to 0 is sensitive when
1The numerical AAEs and RAEs can be found in the Appendix
2The code of all experiments is available at https://github.com/XiangYin2021/TD-QBAF-AAE-RAE.
Removal-based AAEs</p>
        <p>Shapley-based AAEs
applying the approximation algorithm, thus we do not visualize those close to 0. However, this
should not be a concern since their influence is negligible.</p>
      </sec>
      <sec id="sec-2-7">
        <title>3.3. Results and Analysis for RAEs</title>
        <p>Figure 4 shows the results of removal and Shapley-based RAEs.</p>
        <p>Let us first discuss the removal-based RAEs. We see that (7, 5) has the largest positive
impact on 5. Following closely are (8, 5), (9, 5), and (10, 5), which also have notably
positive influences on 5 because they are direct incoming supports to 5. There are also
four outgoing supports from 5, namely (5, 7), (5, 8), (5, 9), and (5, 10), with positive
influences but their RAEs are greatly smaller than that of the previous four as they are indirect
supports. For instance, 5 first supports 7, and then 7 supports 5, indicating the indirect
positive influence of (5, 7). Additionally, (5, 4) also contributes positively to 5 because
5 attacks its attacker 4, thus the attack from 4 to 5 is weakened. We can also observe
some marginal influences, such as the positive influences provided by (1, 7), (3, 1), and
(2, 3) on 5, while the negative influences from (0, 1), (0, 0), (1, 0), and (2, 0). The
remaining edges have RAEs close to 0, showing their negligible influence on 5.</p>
        <p>When it comes to the Shapley-based RAEs, which have similar efects to removal-based
RAEs, the four incoming supports to 5 are still the major contributors, and the four
outgoing supports from 5 have minor RAEs. Diferent from removal-based RAEs, Shapley-based
RAEs capture some diferent negligible influences, such as the negative influence by (4, 5)
and (6, 4). However, Shapley-based RAEs also disregard some tiny influences, like (0, 0),
(1, 0), and (2, 0), which are shown by removal-based RAEs.</p>
        <p>In this case study, both removal and Shapley-based RAEs have a consistent ranking for the
main influential edges despite having some tiny diferences in those low contributing edges.
The reasons are the same as we discussed above.</p>
        <p>Let us further compare the results of AAEs and RAEs. In this case study, we observe some
connections between AAEs and RAEs. For example, in both AAEs, the top-4 influential
arguments are 7 to 10, while in both RAEs, the outgoing edges from these arguments ((7, 5),
(8, 5), (9, 5), and (10, 5)) also rank in the top-4. In addition, 0 to 4 and 0 to 2 have
minor influences in the removal-based AAEs, while their incoming or outgoing edges also
have minor influences in the removal-based RAEs. A similar phenomenon can be found in
the Shapley-based AAEs and RAEs. While it is expected that the RAEs for outgoing edges
of important arguments are relatively high, the consistency observed across diferent sets of
arguments and edges is noteworthy. Besides, we found that removal or Shapley-based AAE of
an argument does not necessarily equate to the sum of RAEs of all its incoming and outgoing
edges, which goes against a reasonable expectation. We will leave the investigation of their
formal relationships for future work.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>4. Conclusion</title>
      <p>Since most existing applications of AAEs and RAEs focus on acyclic QBAFs, this paper
investigated their applicability in cyclic QBAFs. First, we found that AAEs and RAEs can provide
intuitive explanations. By displaying the ranking of arguments or edges, it is easy to identify
the most influential arguments or edges in the QBAF without delving into the complex (cyclic)
structure of the QBAFs, particularly in TD-QBAFs where the number of arguments is typically
large and the connections between source arguments and claim arguments are bi-directional.
Second, AAEs and RAEs can provide interesting or even surprising explanations. For example,
in the case study provided earlier, one might overlook the influence between claim arguments
1 and 5 because they are in diferent topics ( Year=1962 and Theme=Art), but AEs demonstrate
that 1 can contribute to 5 through 7. Third, RAEs provide more fine-grained explanations
than AAEs. This is because when computing AAEs, such as removal-based AAEs, removing an
argument means removing all the incoming and outgoing edges associated with that argument,
whereas RAEs ofer a more detailed insight by processing every incoming and outgoing edge
individually. One can choose between them depending on the granularity for practical use.</p>
      <p>For future work, it would be worthwhile to investigate how diferent gradual semantics
influence AAEs and RAEs, because the property satisfaction of semantics have an influence on the
property satisfaction of explanations. Additionally, the formal relationship between AAEs and
RAEs requires further exploration. However, we believe AAEs and RAEs can complement each
other, providing a deeper and more comprehensive understanding of the internal mechanisms
of QBAFs, particularly the interactions between arguments and edges in complex QBAFs.</p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgments</title>
      <p>This research was partially funded by the European Research Council (ERC) under the European
Union’s Horizon 2020 research and innovation programme (grant agreement No. 101020934,
ADIX) and by J.P. Morgan and by the Royal Academy of Engineering under the Research Chairs
and Senior Research Fellowships scheme. Any views or opinions expressed herein are solely
those of the authors.</p>
    </sec>
    <sec id="sec-5">
      <title>Additional Results for AAEs and RAEs</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>P. M.</given-names>
            <surname>Dung</surname>
          </string-name>
          ,
          <article-title>On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>77</volume>
          (
          <year>1995</year>
          )
          <fpage>321</fpage>
          -
          <lpage>358</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>B.</given-names>
            <surname>Mittelstadt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Russell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Wachter</surname>
          </string-name>
          ,
          <article-title>Explaining explanations in ai</article-title>
          , in: Conference on fairness, accountability, and transparency,
          <year>2019</year>
          , pp.
          <fpage>279</fpage>
          -
          <lpage>288</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>K.</given-names>
            <surname>Čyras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rago</surname>
          </string-name>
          , E. Albini,
          <string-name>
            <given-names>P.</given-names>
            <surname>Baroni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <string-name>
            <surname>Argumentative</surname>
            <given-names>XAI</given-names>
          </string-name>
          :
          <article-title>a survey</article-title>
          ,
          <source>in: International Joint Conference on Artificial Intelligence (IJCAI)</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>4392</fpage>
          -
          <lpage>4399</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <article-title>Interpreting neural networks as quantitative argumentation frameworks</article-title>
          ,
          <source>in: AAAI Conference on Artificial Intelligence</source>
          , volume
          <volume>35</volume>
          ,
          <year>2021</year>
          , pp.
          <fpage>6463</fpage>
          -
          <lpage>6470</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Yin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Explaining random forests using bipolar argumentation and markov networks</article-title>
          ,
          <source>in: AAAI Conference on Artificial Intelligence</source>
          , volume
          <volume>37</volume>
          ,
          <year>2023</year>
          , pp.
          <fpage>9453</fpage>
          -
          <lpage>9460</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>P.</given-names>
            <surname>Baroni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Romano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Aurisicchio</surname>
          </string-name>
          , G. Bertanza,
          <article-title>Automatic evaluation of design alternatives with quantitative argumentation</article-title>
          ,
          <source>Argument &amp; Computation</source>
          <volume>6</volume>
          (
          <year>2015</year>
          )
          <fpage>24</fpage>
          -
          <lpage>49</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>P.</given-names>
            <surname>Baroni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>From fine-grained properties to broad principles for gradual argumentation: A principled spectrum</article-title>
          ,
          <source>International Journal of Approximate Reasoning</source>
          <volume>105</volume>
          (
          <year>2019</year>
          )
          <fpage>252</fpage>
          -
          <lpage>286</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A.</given-names>
            <surname>Rago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Cocarascu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Argumentation-based recommendations: Fantastic explanations and how to find them</article-title>
          ,
          <source>in: IJCAI</source>
          <year>2018</year>
          ,
          <year>2018</year>
          , pp.
          <fpage>1949</fpage>
          -
          <lpage>1955</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>O.</given-names>
            <surname>Cocarascu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rago</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Extracting dialogical explanations for review aggregations with argumentative dialogical agents</article-title>
          ,
          <source>in: AAMAS</source>
          <year>2019</year>
          ,
          <year>2019</year>
          , pp.
          <fpage>1261</fpage>
          -
          <lpage>1269</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>N.</given-names>
            <surname>Kotonya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Gradual argumentation evaluation for stance aggregation in automated fake news detection</article-title>
          , in: Workshop on Argument Mining,
          <year>2019</year>
          , pp.
          <fpage>156</fpage>
          -
          <lpage>166</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>J.</given-names>
            <surname>Singleton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Booth</surname>
          </string-name>
          ,
          <article-title>Towards an axiomatic approach to truth discovery, Autonomous Agents and Multi-Agent Systems 36 (</article-title>
          <year>2022</year>
          )
          <fpage>1</fpage>
          -
          <lpage>49</lpage>
          . URL: https://doi.org/10.1007/ s10458-022-09569-3.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>J.</given-names>
            <surname>Singleton</surname>
          </string-name>
          ,
          <article-title>On the link between truth discovery and bipolar abstract argumentation, Online Handbook of Argumentation for AI (</article-title>
          <year>2020</year>
          )
          <fpage>43</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Booth</surname>
          </string-name>
          ,
          <article-title>An empirical study of the behaviour of quantitative bipolar argumentation frameworks for truth discovery</article-title>
          ,
          <source>in: Computational Models of Argument - Proceedings of COMMA</source>
          ,
          <year>2024</year>
          , p. To appear.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <article-title>Continuous dynamical systems for weighted bipolar argumentation</article-title>
          ,
          <source>in: International Conference on Principles of Knowledge Representation and Reasoning (KR)</source>
          ,
          <year>2018</year>
          , pp.
          <fpage>148</fpage>
          -
          <lpage>157</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>J.</given-names>
            <surname>Delobelle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Villata</surname>
          </string-name>
          ,
          <article-title>Interpretability of gradual semantics in abstract argumentation, in: Symbolic and Quantitative Approaches to Reasoning with Uncertainty: European Conference (ECSQARU)</article-title>
          , volume
          <volume>11726</volume>
          ,
          <year>2019</year>
          , pp.
          <fpage>27</fpage>
          -
          <lpage>38</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>K.</given-names>
            <surname>Čyras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Kampik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Weng</surname>
          </string-name>
          ,
          <article-title>Dispute trees as explanations in quantitative (bipolar) argumentation</article-title>
          , in:
          <source>ArgXAI</source>
          <year>2022</year>
          , 1st International Workshop on Argumentation for eXplainable
          <source>AI</source>
          , Cardif, Wales,
          <year>September 12</year>
          ,
          <year>2022</year>
          , volume
          <volume>3209</volume>
          ,
          <string-name>
            <surname>CEUR-WS</surname>
          </string-name>
          ,
          <year>2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>X.</given-names>
            <surname>Yin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Argument attribution explanations in quantitative bipolar argumentation frameworks</article-title>
          ,
          <source>in: European Conference on Artificial Intelligence (ECAI)</source>
          , volume
          <volume>372</volume>
          ,
          <year>2023</year>
          , pp.
          <fpage>2898</fpage>
          -
          <lpage>2905</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>L.</given-names>
            <surname>Amgoud</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Ben-Naim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Vesic</surname>
          </string-name>
          ,
          <article-title>Measuring the intensity of attacks in argumentation graphs with shapley value</article-title>
          ,
          <source>in: International Joint Conference on Artificial Intelligence (IJCAI)</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>63</fpage>
          -
          <lpage>69</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>X.</given-names>
            <surname>Yin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Explaining arguments' strength: Unveiling the role of attacks and supports</article-title>
          ,
          <source>in: International Joint Conference on Artificial Intelligence (IJCAI)</source>
          ,
          <year>2024</year>
          , pp.
          <fpage>3622</fpage>
          -
          <lpage>3630</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>T.</given-names>
            <surname>Mossakowski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Neuhaus</surname>
          </string-name>
          ,
          <article-title>Modular semantics and characteristics for bipolar weighted argumentation graphs</article-title>
          , arXiv preprint arXiv:
          <year>1807</year>
          .
          <volume>06685</volume>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>T.</given-names>
            <surname>Kampik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Potyka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Yin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Čyras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Contribution functions for quantitative bipolar argumentation graphs: A principle-based analysis</article-title>
          ,
          <source>arXiv preprint arXiv:2401.08879</source>
          (
          <year>2024</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>L. S.</given-names>
            <surname>Shapley</surname>
          </string-name>
          , Notes on the N-person
          <string-name>
            <surname>Game</surname>
          </string-name>
          ,
          <year>1951</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>