<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>D. Odekerken); https://annemarieborg.nl/ (A. Borg);
https://www.informatik.uni-leipzig.de/~berthold/ (M. Berthold)</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Accessible Algorithms for Applied Argumentation</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Daphne Odekerken</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>AnneMarie Borg</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matti Berthold</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Information and Computing Sciences, Utrecht University</institution>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>National Police Lab AI</institution>
          ,
          <addr-line>Netherlands Police</addr-line>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>ScaDS.AI Dresden/Leipzig, Universität Leipzig</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2023</year>
      </pub-date>
      <volume>000</volume>
      <fpage>0</fpage>
      <lpage>0003</lpage>
      <abstract>
        <p>Computational argumentation is a promising research area, yet there is a gap between theoretical contributions and practical applications. Bridging this gap could potentially raise interest in this topic even more. We argue that one part of the bridge could be an open-source package of implementations of argumentation algorithms, visualised in a web interface. Therefore we present a new release of PyArg, providing various new argumentation-based functionalities - including multiple generators, a learning environment, implementations of theoretical papers and a showcase of a practical application - in a new interface with improved accessibility.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;argumentation</kwd>
        <kwd>implementation</kwd>
        <kwd>visualisation</kwd>
        <kwd>education</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Computational argumentation is a promising interdisciplinary research area, with applications
in, e.g. the legal, medical and e-government domain [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Thanks to its natural connection with
human cognition, its exibility and its dialectic nature, argumentation seems to be particularly
suitable as a logical foundation for human-centered arti cial intelligence (AI) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        The construction of argumentation-based AI systems that are applicable to real-world use
cases requires not only theoretical developments, but also e ective solving of problems related
to argumentation. Although there is a signi cant amount of work on theoretical aspects of
computational argumentation, which include various argumentation formalisms, semantics and
their properties, as well as a growing body of research on solvers that are su ciently e cient to
be applied in practice1, we argue that the connection between these two areas could (and should)
be strengthened. This is based on our observation that real-life applications use a di erent
formalism than those mainly studied in the community [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] or require e cient algorithms for
yet unexplored problems [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>In addition, we hypothesise that the application of argumentation-based AI is more
cumbersome for non-experts than, for example, the application of machine-learning based AI, which is
more convenient thanks to the availability of numerous software packages (such as Scikit-learn2
and Tensor ow3) as well as user-friendly interfaces to try this AI.4 This makes argumentation
less accessible to students, software developers and companies searching for AI-based solutions
to domain-speci c problems.</p>
      <p>In order to improve both the connection within theoretical and practical work within the
computational argumentation community and the connection with stakeholders outside the
community, it would be helpful to have open-source software, paired with an accessible web
interface. In this paper, we therefore present a new release of PyArg.</p>
      <p>PyArg is an open-source software implementation in Python that not only provides practical
algorithms for theoretical problems in various argumentation formalisms, but also makes
(potential) applications of these algorithms visible in a user interface that is accessible from the
internet without installation. PyArg is intended to be a software solution for researchers within
the argumentation community, students who may become part of it, as well as stakeholders
outside the community, thanks to the following features:
1. Open-source implementations of argumentation algorithms on GitHub can be validated
and extended by community members (https://github.com/DaphneOdekerken/PyArg);
2. The Python package can be installed using pip install python-argumentation
and is therefore directly usable for software developers;
3. The web interface on https://pyarg.npai.science.uu.nl/ makes argumentation more
accessible to those who wish to learn more about argumentation and serves as a platform for
showcasing applications of argumentation to stakeholders outside the community.</p>
      <p>
        The release presented here is a major update compared to the preliminary version earlier
presented in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. In the following sections, we describe PyArg’s new functionalities.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Support for more formalisms</title>
      <p>
        Research on computational argumentation ranges over an ever-growing number of formalisms
and extensions of formalisms. Whereas the initial version of PyArg [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] only supported abstract
argumentation frameworks and ASPIC+, in this iteration we added support for
assumptionbased argumentation (ABA) [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. In particular, PyArg can now (1) compute the extensions of a
given ABA framework under the prominent semantics and visualise them in the instantiated
abstract argumentation framework; and (2) verify if a speci c set of extensions can be realised
under a given semantics (see Section 3.2).
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Algorithms for argumentation problems</title>
      <p>
        The new PyArg version still contains all algorithms presented in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], including various
implementations of formalisms and algorithms in both abstract argumentation [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and ASPIC+ [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. It
provides algorithms for evaluating argumentation settings in di erent semantics [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], as well
2https://scikit-learn.org/
3https://www.tensor ow.org/
4e.g. https://freegpt.cc/
as explaining the (non-)acceptance of arguments and formulas in various ways [
        <xref ref-type="bibr" rid="ref11 ref12">11, 12</xref>
        ]. In the
new version, we also provide algorithms for dynamic argumentation problems as well as for
the construction of canonical representations.
      </p>
      <sec id="sec-3-1">
        <title>3.1. Dynamic argumentation problems</title>
        <p>
          Many problems in argumentation assume that all information required to decide upon, for
example, the acceptance of an argument is present. This is however not always a realistic
assumption in applied settings. Therefore, recently the problems of stability [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ] and relevance [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]
have been introduced for various formalisms, including ASPIC+. Informally, the stability status
of a “topic” argument or formula represents the impossibility that its acceptability status may
change in view of additional, yet uncertain information. For topics that are not stable, it is
interesting to study relevance, where only information that can change the stability status of
the topic is relevant. PyArg provides an implementation of the approximation algorithm for
stability from [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ], as well as an inexact but e cient algorithm for estimating relevance based
on the labels from the aforementioned stability algorithm.
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. Canonical argumentation frameworks</title>
        <p>
          The work by Dunne et al. [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] studies the realisability in abstract argumentation: given a
semantics and a set of extensions S, is there an argumentation framework F realising S
under , i.e., such that (F ) = S – and which characteristics determine whether such an
argumentation framework exists? Similarly, realisability can be characterised for ABAFs [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ].
PyArg now provides the algorithms to determine whether a given set extensions satis es
these characteristic properties and generates “canonical” argumentation frameworks or ABA
frameworks, when they exist; see Figure 1.
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Practical features</title>
      <sec id="sec-4-1">
        <title>4.1. Generators</title>
        <p>There are various situations in which it is useful to randomly generate an argumentation
setting. One example would be for testing new algorithms: a large part of the data sets used
in the ICCMA competition to assess runtime of algorithms is based on randomly generated
argumentation frameworks. A second example is related to education: in order to assess a
student’s understanding of, e.g., speci c argumentation semantics, it is convenient to have a
generator for automatically creating new exercises.</p>
        <p>In order to address this demand, PyArg provides several generators. For generating ASPIC+
argumentation systems, PyArg uses the “layered” generator from [4, Section 4.2.5]. In addition,
PyArg provides a basic random generator for abstract argumentation frameworks.</p>
        <p>The generators can be found in the source code; in addition, the web interface provides
functionality for generating a single argumentation framework or system, parameterised by the
values given in input elds. The resulting argumentation setting can then be downloaded for
further use within or outside PyArg.</p>
      </sec>
      <sec id="sec-4-2">
        <title>4.2. Improved visualisation</title>
        <p>Compared to the previous version, PyArg’s user interface has been made more user-friendly
and accessible. A screenshot of the new visualisation for abstract argumentation frameworks is
shown in Figure 2. PyArg now features both a regular mode (in which accepted arguments are
coloured green, while other arguments are yellow or red) and a colourblind-friendly mode that
uses an adapted colour palette.</p>
      </sec>
      <sec id="sec-4-3">
        <title>4.3. Importers and exporters</title>
        <p>PyArg provides various importers and exporters to convert argumentation settings to various
formats. For abstract argumentation frameworks, it is possible to read from and write to all
formats used in recent ICCMA competitions, that is: the ASPARTIX format (.APX), the Trivial
Graph Format (.TGF) and the input format used for ICCMA 2023 (.ICCMA23). In addition,
for both abstract argumentation frameworks and ASPIC+ argumentation systems, there are
importers and exporters to and from JSON.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Applications of algorithms in the web interface</title>
      <p>In order to demonstrate how PyArg’s algorithms can be applied in various settings, we provide
two use cases in the web interface: a learning environment and a chat interface.</p>
      <sec id="sec-5-1">
        <title>5.1. Learning environment</title>
        <p>The learning environment is intended for anyone interested in learning computational
argumentation. In this functionality in the web interface, a learner can choose between various exercises.
The current PyArg version features three exercises: identifying grounded, complete and
preferred extensions in abstract argumentation. As the learner starts an exercise, PyArg generates
a random abstract argumentation framework using its generators. The learner then gives the
extensions, and PyArg uses its semantics algorithms for validating the learner’s solutions.</p>
      </sec>
      <sec id="sec-5-2">
        <title>5.2. Chat interface</title>
        <p>The chat interface showcases an application for the algorithms for stability and relevance
in inquiy dialogue. First, the user chooses an ASPIC+ argumentation system (which can be
randomly generated, hand-made or the prede ned fraud example), a set of queryables (e.g.
formulas that can be asked in a dialogue), a topic formula for the chat and an initial knowledge
base. PyArg then uses the stability algorithm to nd out if it makes sense to ask for more
information - if so, it uses the relevance algorithm for identifying relevant questions.</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>6. Related work</title>
      <p>
        For an extended overview of software related to computational argumentation, we refer to
[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. In this section, we relate to implementations that are most similar to PyArg. Tweety [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]
is a comprehensive collection of Java libraries that includes algorithms for both abstract and
structured approaches to argumentation. It is in fact more comprehensive than PyArg, but
does not have a visualisation option. The Online Argument Structures Tool (TOAST) [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] does
provide a visualisation for ASPIC+, but the source code is not openly available. Gorgias Cloud
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] is a recent system that is similar to PyArg, but is based on the Gorgias argumentation system.
NEXAS [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] is an alternative approach to visualising extensions of abstract argumentation
frameworks, which, compared to PyArg, is more aimed towards (large) frameworks with many
extensions. Finally, many algorithms for argumentation-related problems have been submitted
to the ICCMA competition. However, these are mostly focused on fast implementation of limited
problems, mainly in the context of abstract argumentation.
      </p>
    </sec>
    <sec id="sec-7">
      <title>7. Conclusion and future work</title>
      <p>PyArg combines algorithms for argumentation problems with a web interface, aiming to improve
the connections between theoretical and practical work on argumentation on the one hand,
and inside and outside the community on the other hand.</p>
      <p>
        The contributions of this version of PyArg are mainly focused on the front-end. In the
back-end, the algorithms for computing the semantics are not state-of-the-art. This becomes
noticeable if the visualisation is tested on hard (large) instances, as no output will appear on
the screen within a reasonable amount of time. In a next version of PyArg, we plan to improve
this performance aspect by calling more e cient solvers in the back-end. In addition, we
aim to add support more formalisms, such as abstract dialectical frameworks [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], abstract
frameworks with collective attacks [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] and abstract frameworks with support for claims [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ],
and to implement their intertranslations [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
      </p>
      <p>On a nal note, we hope that the functionalities presented in this paper are just the beginning,
as are the plans for future work mentioned above. We are open to any suggestions for additional
functionalities, algorithms or other feedback, which we hope to incorporate in future releases
of PyArg. Hopefully, this leads to an increase of interest and understanding of computational
argumentation, both within and outside the community, eventually resulting in more responsible
applications of arti cial intelligence.</p>
    </sec>
    <sec id="sec-8">
      <title>Acknowledgments</title>
      <p>The authors have not been sorted alphabetically. They acknowledge the nancial support by
the Federal Ministry of Education and Research of Germany and by the Sächsische
Staatsministerium für Wissenschaft Kultur und Tourismus in the program Center of Excellence for
AI-research "Center for Scalable Data Analytics and Arti cial Intelligence Dresden/Leipzig",
project identi cation number: ScaDS.AI.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>K.</given-names>
            <surname>Atkinson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Baroni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Giacomin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hunter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Prakken</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Reed</surname>
          </string-name>
          , G. Simari,
          <string-name>
            <given-names>M.</given-names>
            <surname>Thimm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Villata</surname>
          </string-name>
          ,
          <article-title>Towards arti cial argumentation</article-title>
          ,
          <source>AI</source>
          magazine
          <volume>38</volume>
          (
          <year>2017</year>
          )
          <fpage>25</fpage>
          -
          <lpage>36</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>E.</given-names>
            <surname>Dietz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kakas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Michael</surname>
          </string-name>
          ,
          <article-title>Argumentation: A calculus for human-centric AI</article-title>
          ,
          <source>Frontiers in Arti cial Intelligence</source>
          <volume>5</volume>
          (
          <year>2022</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A. C.</given-names>
            <surname>Kakas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Moraitis</surname>
          </string-name>
          ,
          <string-name>
            <surname>N. I. Spanoudakis</surname>
          </string-name>
          , Gorgias: Applying argumentation,
          <source>Argument &amp; Computation</source>
          <volume>10</volume>
          (
          <year>2019</year>
          )
          <fpage>55</fpage>
          -
          <lpage>81</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>D.</given-names>
            <surname>Odekerken</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Bex</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Borg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Testerink</surname>
          </string-name>
          ,
          <article-title>Approximating stability for applied argumentbased inquiry</article-title>
          ,
          <source>Intelligent Systems with Applications</source>
          <volume>16</volume>
          (
          <year>2022</year>
          )
          <fpage>200110</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Borg</surname>
          </string-name>
          , D. Odekerken,
          <article-title>PyArg for solving and explaining argumentation in Python: Demonstration</article-title>
          , in
          <source>: Proceedings of (COMMA-22)</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>349</fpage>
          -
          <lpage>350</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Bondarenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. A.</given-names>
            <surname>Kowalski</surname>
          </string-name>
          ,
          <article-title>An assumption-based framework for nonmonotonic reasoning</article-title>
          ,
          <source>in: Proceedings of (LPNMR-93)</source>
          ,
          <year>1993</year>
          , pp.
          <fpage>171</fpage>
          -
          <lpage>189</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>K.</given-names>
            <surname>yras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Fan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Schulz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Toni</surname>
          </string-name>
          ,
          <article-title>Assumption-based argumentation: Disputes, explanations, preferences</article-title>
          , in: Handbook of Formal Argumentation, volume
          <volume>1</volume>
          ,
          <year>2018</year>
          , pp.
          <fpage>365</fpage>
          -
          <lpage>408</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>P. M.</given-names>
            <surname>Dung</surname>
          </string-name>
          ,
          <article-title>On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games</article-title>
          ,
          <source>Arti cial Intelligence</source>
          <volume>77</volume>
          (
          <year>1995</year>
          )
          <fpage>321</fpage>
          -
          <lpage>357</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>H.</given-names>
            <surname>Prakken</surname>
          </string-name>
          ,
          <article-title>An abstract framework for argumentation with structured arguments</article-title>
          ,
          <source>Argument &amp; Computation</source>
          <volume>1</volume>
          (
          <year>2010</year>
          )
          <fpage>93</fpage>
          -
          <lpage>124</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>P.</given-names>
            <surname>Baroni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Caminada</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Giacomin</surname>
          </string-name>
          ,
          <article-title>An introduction to argumentation semantics</article-title>
          ,
          <source>The Knowledge Engineering Review</source>
          <volume>26</volume>
          (
          <year>2011</year>
          )
          <fpage>365</fpage>
          -
          <lpage>410</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Borg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Bex</surname>
          </string-name>
          ,
          <article-title>A basic framework for explanations in argumentation</article-title>
          ,
          <source>IEEE Intelligent Systems</source>
          <volume>36</volume>
          (
          <year>2021</year>
          )
          <fpage>25</fpage>
          -
          <lpage>35</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>A.</given-names>
            <surname>Borg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Bex</surname>
          </string-name>
          ,
          <article-title>Necessary and su cient explanations for argumentation-based conclusions</article-title>
          ,
          <source>in: Proceedings of (ECSQARU-21)</source>
          , Springer,
          <year>2021</year>
          , pp.
          <fpage>45</fpage>
          -
          <lpage>58</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>D.</given-names>
            <surname>Odekerken</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Lehtonen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Borg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. P.</given-names>
            <surname>Wallner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Järvisalo</surname>
          </string-name>
          ,
          <article-title>Argumentative reasoning in ASPIC+ under incomplete information</article-title>
          ,
          <source>in: Proceedings of (KR-23)</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>531</fpage>
          -
          <lpage>541</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>P. E.</given-names>
            <surname>Dunne</surname>
          </string-name>
          , W. Dvo ák, T. Linsbichler,
          <string-name>
            <given-names>S.</given-names>
            <surname>Woltran</surname>
          </string-name>
          ,
          <article-title>Characteristics of multiple viewpoints in abstract argumentation</article-title>
          ,
          <source>Arti cial Intelligence</source>
          <volume>228</volume>
          (
          <year>2015</year>
          )
          <fpage>153</fpage>
          -
          <lpage>178</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>M.</given-names>
            <surname>Berthold</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rapberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ulbricht</surname>
          </string-name>
          ,
          <article-title>On the expressive power of assumption-based argumentation</article-title>
          ,
          <source>in: Proceedings of (JELIA-23)</source>
          ,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>F.</given-names>
            <surname>Cerutti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Gaggl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Thimm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Wallner</surname>
          </string-name>
          ,
          <article-title>Foundations of implementations for formal argumentation</article-title>
          ,
          <source>IfCoLog Journal of Logics and their Applications</source>
          <volume>4</volume>
          (
          <year>2017</year>
          )
          <fpage>2623</fpage>
          -
          <lpage>2705</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>M.</given-names>
            <surname>Thimm</surname>
          </string-name>
          ,
          <article-title>The formal argumentation libraries of Tweety</article-title>
          ,
          <source>in: Proceedings of (TAFA-17)</source>
          , Springer,
          <year>2018</year>
          , pp.
          <fpage>137</fpage>
          -
          <lpage>142</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>M.</given-names>
            <surname>Snaith</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Reed, TOAST: Online ASPIC+ implementation</article-title>
          , in
          <source>: Proceedings of (COMMA12)</source>
          , IOS Press,
          <year>2012</year>
          , pp.
          <fpage>509</fpage>
          -
          <lpage>510</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>N. I.</given-names>
            <surname>Spanoudakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Gligoris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Koumi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. C.</given-names>
            <surname>Kakas</surname>
          </string-name>
          ,
          <article-title>Explainable argumentation as a service</article-title>
          ,
          <source>Journal of Web Semantics</source>
          (
          <year>2023</year>
          )
          <fpage>100772</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>R.</given-names>
            <surname>Dachselt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Gaggl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Krötzsch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Méndez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rusovac</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Yang</surname>
          </string-name>
          ,
          <article-title>Nexas: A visual tool for navigating and exploring argumentation solution spaces</article-title>
          ,
          <source>in: Proceedings of (COMMA-22)</source>
          , volume
          <volume>353</volume>
          , IOS Press,
          <year>2022</year>
          , pp.
          <fpage>116</fpage>
          -
          <lpage>127</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>G.</given-names>
            <surname>Brewka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Strass</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Ellmauthaler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. P.</given-names>
            <surname>Wallner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Woltran</surname>
          </string-name>
          ,
          <article-title>Abstract dialectical frameworks revisited</article-title>
          ,
          <source>in: Proceedings of (IJCAI-13)</source>
          ,
          <year>2013</year>
          , pp.
          <fpage>803</fpage>
          -
          <lpage>809</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>S. H.</given-names>
            <surname>Nielsen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Parsons</surname>
          </string-name>
          ,
          <article-title>A generalization of dung's abstract framework for argumentation: Arguing with sets of attacking arguments</article-title>
          ,
          <source>in: Proceedings of (ArgMAS-2006)</source>
          , Springer,
          <year>2006</year>
          , pp.
          <fpage>54</fpage>
          -
          <lpage>73</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>540</fpage>
          -75526-5\_4.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>W.</given-names>
            <surname>Dvorák</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rapberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Woltran</surname>
          </string-name>
          ,
          <article-title>Argumentation semantics under a claim-centric view: Properties, expressiveness and relation to setafs</article-title>
          ,
          <source>in: Proceedings of (KR-20)</source>
          ,
          <year>2020</year>
          , pp.
          <fpage>341</fpage>
          -
          <lpage>350</lpage>
          . doi:
          <volume>10</volume>
          .24963/kr.2020/35.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>M.</given-names>
            <surname>König</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rapberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ulbricht</surname>
          </string-name>
          ,
          <article-title>Just a matter of perspective</article-title>
          ,
          <source>in: Proceedings of (COMMA-22)</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>212</fpage>
          -
          <lpage>223</lpage>
          . doi:
          <volume>10</volume>
          .3233/FAIA220154.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>