<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Dispute Resolution with OWL DL and Reasoning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ildar Baimuratov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Elena Lisanyuk</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dmitry Prokudin</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>L3S Research Center, Leibniz University Hannover</institution>
          ,
          <addr-line>Hannover</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>National Research University Higher School of Economics</institution>
          ,
          <addr-line>Moscow</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>St Petersburg State University</institution>
          ,
          <addr-line>St Petersburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>TIB - Leibniz Information Centre for Science and Technology</institution>
          ,
          <addr-line>Hannover</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Dispute resolution is an essential part of argumentation. Although there have been particular advances in computational argumentation with machine learning, we assume that explicit and deterministic techniques for dispute resolution still have significant potential. There are semantic approaches to argument representation, such as the Argument Interchange Format that supports a certain level of interoperability, but according to our knowledge, dispute resolution techniques based on semantics are not yet studied. In this research, we consider single mixed disputes through abstract argumentation frameworks and propose a method for representing such disputes in OWL DL that allows resolving them with reasoning. Additionally, we develop an algorithm for generating the OWL DL representation having argument sets and attack relations as input. The algorithm is validated with a proof of concept implementation, and the OWL DL representation - with an example of correct dispute resolution performed by reasoning over the generated ontology.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Dispute resolution</kwd>
        <kwd>abstract argumentation frameworks</kwd>
        <kwd>computational argumentation</kwd>
        <kwd>OWL DL</kwd>
        <kwd>reasoning</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>An argument is a piece of reasoning implying a transition from premises to a conclusion that
expresses the opinion to be defended. Argumentation can be considered from diferent angles,
among them are persuasion, proof, decision-making, information-seeking, dispute resolution,
etc. Argumentation is a multidisciplinary research field that spans across diverse areas such as
logic, philosophy, language, rhetoric, law, psychology, and computer science. Argumentation
plays an essential role in artificial intelligence study, due to its ability to conjugate user-related
cognitive models with computational models for automated reasoning. Neighboring areas
inside the artificial intelligence domain include machine learning, natural language processing,
discourse analysis, computational linguistics, information extraction, and knowledge
representation. Computational argumentation has recently become a hot topic due to recent advances
in machine learning methods that promise to enable applications of artificial intelligence to
social, economic sciences, and policymaking.</p>
      <p>
        Although there are particular advances in argumentation mining [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], we assume that explicit
and deterministic techniques for dispute resolution still have significant potential. A trustworthy
dispute resolution technique requires a representation format for dialogical argumentation that
would be machine- and human-readable, and enable an algorithmic procedure to derive the
solution. In this research, we aim at OWL-based argumentation representations that provide
dispute resolution with reasoning.
      </p>
      <p>
        Disputes are divided into single and multiple ones according to the number of propositions
that constitute the parties’ points of view, and into unmixed and mixed ones, depending on
the parties’ intentions to defend their point of view or criticize other opinions, or do both,
respectively [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. In this study, we consider only single mixed disputes.
      </p>
      <p>The contributions of the present work are the following: 1) a method for representing
argumentation with OWL DL1 that is based on abstract argumentation frameworks and supports
dispute resolution with reasoning, and 2) an algorithm for generating the OWL representation
having argument sets and attack relations as input. The algorithm is validated with a proof of
concept implementation, and the OWL DL representation – with an example of the correct
dispute resolution performed by reasoning over the generated ontology.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Related Work</title>
      <p>
        A method for the formal representation of an argument is called an argumentation framework.
There are several argumentation frameworks. In [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], Phan Minh Dung proposed abstract
argumentation frameworks, where an argument is an abstract entity whose role is determined
solely by its relationship to other arguments. The former idea allows abstracting from the
structural distinctions among them, making the notion of argument demonstration derivative
from the notion of acceptability of arguments.
      </p>
      <p>
        Considering the computational aspect, currently, the most widely used argument
representation is the Argument Interchange Format (AIF) [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. It is intended to exchange data between
various argumentation tools and applications. Its abstract model includes three groups of
entities: 1) argument entities and relations between them, 2) entities describing the communication
of arguments, and 3) ones describing the context of arguments. Arguments are represented as
directed graphs, called argumentation networks, where nodes represent statements or
argumentation patterns, and edges are unlabeled. Various implementations of AIF were considered,
including one in the RDF format2. In [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], an OWL DL implementation of AIF was proposed. It
allows the classification and inference of argument schemes, but the dispute resolution problem
and dialogical argumentation, in general, were not considered. The AIF format is used in
the OVA tool [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] for analyzing and annotating argumentation texts in natural language. The
annotation can be represented in formats such as JSON, RDF and Prolog. For the accumulation
of annotated texts, an online database AIFdb was created [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        A project [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] develops a software system designed to support the study of argumentation
in popular science texts in the Russian language. For annotating texts, the authors extend AIF
model with the weight of the argument scheme and of its elements. Data is represented in RDF
      </p>
      <sec id="sec-2-1">
        <title>1https://www.w3.org/TR/owl-guide/</title>
        <p>2https://www.w3.org/RDF/
format. The system implements the identification of argumentative indicators and automated
evaluation of the persuasiveness of the arguments.</p>
        <p>Another argument representation format, Argdown3 is a Markdown4-inspired argument
mark-up language, implemented as a context-free grammar and parser. It allows representing
dialogical argumentation and generating argument maps but does not provide any dispute
resolution procedures.</p>
        <p>
          The legal domain is closely related to the argumentation theory. The Legal Knowledge
Interchange Format (LKIF) [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] is designed for two purposes: 1) as a reusable and extensible
core ontology for legal knowledge bases, and 2) as an interchange format for existing legal
knowledge representation languages. The LKIF ontology includes entities for cases, obligations,
and relations between them. Similarly to AIF, LKIF annotates argumentation rules as nodes of a
specific argumentation scheme. LKIF rules are implemented not within OWL DL syntax, but as
an extension of SWRL with support for negation and defeasible reasoning. LKIF is used via the
XML format in the Carneades system [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
        <p>
          In [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ], the authors proposed an approach for the advanced access and reasoning facilities
on legislation. The authors use the provision model that includes various provision types and
attributes. They formalize it with OWL DL language and use it together with domain ontologies
to form a structural mark-up of legal texts. They demonstrate how reasoning can be applied to
infer indirect relations between provisions and how to query them with SPARQL. However, the
model is too domain-specific and can not be scaled for argumentation.
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Method</title>
      <sec id="sec-3-1">
        <title>3.1. Abstract Argumentation Framework</title>
        <p>
          Our dispute resolution algorithm is based on Dung’s abstract argumentation framework,
described in [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ].
        </p>
        <p>Definition 1.</p>
        <p>An argumentation framework  is a pair</p>
        <p>=&lt; ,  &gt;,
where  is a set of arguments and  ⊆  × .</p>
        <p>We say that an argument  attacks an argument  (or  is attacked by ) if (, ) holds.
Similarly, we say that a set  of arguments attacks  (or  is attacked by ) if  is attacked
by an argument in . The binary abstract relation (, ) between arguments  and
 symbolizes how the criticism of argument  rejects argument ; and how a further critical
development in the dialog (, ) rejects argument  by counterattacking it and thereby
returns argument  as defended.</p>
        <p>Unlike the entailment relation, the attack relation is not reflexive, symmetric, or transitive.
This transferred the formal logical representation of argumentation from the microlevel of the
internal structure of the argument to the macrolevel of the structure of argumentation in the</p>
        <sec id="sec-3-1-1">
          <title>3https://argdown.org/</title>
          <p>4https://daringfireball.net/projects/markdown/syntax
dispute and made it possible to overcome the restrictions of the classical argumentation analysis
on modeling criticism.</p>
          <p>Another feature of this argumentation framework is the usage of procedural semantics instead
of classical logic frameworks. For a set of arguments, procedural semantics allows to define
subsets with specific properties, including consistency and completeness, where required. Thus,
Dung defines a conflict-free set of arguments.</p>
          <p>Definition 2. A set  of arguments is said to be conflict-free if there are no arguments  and 
in  such that  attacks .</p>
          <p>The notion of acceptability allows determining dispute outcomes.</p>
          <p>Definition 3. An argument  ∈  is acceptable with respect to a set  of arguments if for
each argument  ∈ : if  attacks  then  is attacked by .</p>
          <p>Finally, an admissible set of arguments is a set of acceptable arguments.</p>
          <p>Definition 4. A conflict-free set of arguments  is admissible if each argument in  is acceptable
with respect to .</p>
          <p>For a resolution of the single unmixed dispute, it is suficient that there is a nonempty
admissible subset of arguments, that is, there is at least one acceptable argument. Thus, the
dispute resolution problem can be considered as a classification of arguments into admissible
sets.</p>
          <p>
            Example 1. Let us consider the original example of argumentation from Dung’s paper [
            <xref ref-type="bibr" rid="ref3">3</xref>
            ]:
• I: My government cannot negotiate with your government because your government doesn’t
even recognize my government.
• A: Your government doesn’t recognize my government either.
          </p>
          <p>• I: But your government is a terrorist government.</p>
          <p>This argument is formalized as two argumentation sets  = {1, 2} and  = {}, and attack
pairs {(1, ), (, 1), (2, )}. Both sets are conflict-free, but the argument  is not acceptable
w.r.t. , as it is attacked by 2, but no argument from  attacks 2. Thus, there is a non-empty
admissible subset only for .</p>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. OWL DL Implementation</title>
        <p>Our OWL DL implementation of Dung’s framework is designed in a way that provides the
automatic classification of arguments into admissible sets with reasoning. We illustrate the
implementation with listings in the Manchester syntax.</p>
        <p>The formalization of the basic elements of the framework is straightforward. Each argument
set is represented as an owl:Class.</p>
        <p>Class: &lt;onto.owl#A&gt;</p>
        <p>SubClassOf:
owl:Thing</p>
        <sec id="sec-3-2-1">
          <title>Listing 1: Example of an argument set</title>
          <p>Each argument is considered to be an owl:NamedIndividual. The belonging of an argument
to the argument set is represented with the rdf:type relation. The text of the argument is stored
in rdfs:label.</p>
          <p>To represent the attacks relation, the owl:ObjectProperty ’attacks’ is defined (for clearness,
here and further we write custom OWL entities in apostrophes). Also, the property
’isAttackedBy’ is defined as owl:inverseOf ’attacks’. It is required for defining admissible sets of
arguments.</p>
          <p>ObjectProperty: &lt;onto.owl#attacks&gt;</p>
          <p>InverseOf:
&lt;onto.owl#isAttackedBy&gt;</p>
        </sec>
        <sec id="sec-3-2-2">
          <title>Listing 3: Declaration of the ’attacks’ relation</title>
        </sec>
        <sec id="sec-3-2-3">
          <title>Now we can assert that one argument attacks another.</title>
          <p>In order to provide reasoning under Open World Assumption (OWA), we have to “close” each
individual argument with respect to the list of arguments it attacks. We do this by asserting that
the argument belongs to an unnamed class that has the relation ’attacks’ to the set of arguments
it attacks, constructed with owl:oneOf operator under owl:allValuesFrom restriction. If the
argument attacks no argument, we assert that it attacks only owl:Nothing.</p>
          <p>For the same reason, we also close each individual argument regarding the relation
’isAttackedBy’.</p>
          <p>Listing 6: Example of closing an argument regarding the ’isAttackedBy’ relation
To define a conflict-free set in a manner that supports reasoning under the OWA, we can not
use the owl:complementOf operator. Thus, for each argument set we form a union of all other
argument sets with owl:unionOf. Then its conflict-free subset is defined as a class that has the
relation ’attacks’ only (owl:allValuesFrom) to the union of other argument sets.
Class: &lt;onto.owl#AConflictFree&gt;</p>
          <p>EquivalentTo:
&lt;onto.owl#A&gt;
and (&lt;onto.owl#attacks&gt; only (&lt;onto.owl#I&gt;))
SubClassOf:
&lt;onto.owl#A&gt;</p>
        </sec>
        <sec id="sec-3-2-4">
          <title>Listing 7: Example of a conflict-free set</title>
          <p>For each conflict-free set, an admissible subset is defined as a class that has the relation
’isAttackedBy’ only (owl:allValuesFrom) to the arguments that have the relation ’isAttackedBy’
to some (owl:someValuesFrom) arguments from the initial conflict-free set. Thus, if an argument
is attacked by no arguments, it also belongs to the admissible set.</p>
          <p>Class: &lt;onto.owl#AAdmissible&gt;</p>
          <p>EquivalentTo:
&lt;onto.owl#AConflictFree&gt;
and (&lt;onto.owl#isAttackedBy&gt; only (&lt;onto.owl#isAttackedBy&gt; some &lt;onto.owl#</p>
          <p>AConflictFree&gt;))
SubClassOf:
&lt;onto.owl#AConflictFree&gt;</p>
        </sec>
        <sec id="sec-3-2-5">
          <title>Listing 8: Example of an admissible set</title>
          <p>Example 2. Let us implement the argument from the Example 1 in OWL DL. The resulting class
hierarchy visualized with Protege interface is presented in Fig. 1. The full declarations of the
arguments 1,  and 2 are presented in Listings 9, 10 and 11 respectively.</p>
          <p>Individual: &lt;onto.owl#i1&gt;</p>
          <p>Annotations:
rdfs:label "My government cannot negotiate with your government because your
government doesn’t even recognize my government"^^xsd:string</p>
          <p>Listing 10: Declaration of 
Individual: &lt;onto.owl#i2&gt;</p>
          <p>Annotations:</p>
          <p>rdfs:label "But your government is a terrorist government"^^xsd:string
Types:
&lt;onto.owl#I&gt;,
&lt;onto.owl#attacks&gt; only ({&lt;onto.owl#a&gt;}),
&lt;onto.owl#isAttackedBy&gt; only owl:Nothing
Facts:
&lt;onto.owl#attacks&gt; &lt;onto.owl#a&gt;</p>
          <p>Listing 11: Declaration of 2</p>
        </sec>
      </sec>
      <sec id="sec-3-3">
        <title>3.3. Ontology Generating Algorithm</title>
        <p>The algorithm is intended to generate the described OWL DL representations of arguments
using the list of argument sets and attack pairs as input. For better readability, the algorithm is
divided into three steps.</p>
        <p>Algorithm 1 declares basic entities including argument sets, arguments, ’attacks’ and
’isAttackedBy’ relations, and infers ’isAttackedBy’ statements with reasoning. Not considering
reasoning, the algorithm has linear complexity, as it only runs once through both lists of
arguments in argument sets and of attack pairs.</p>
        <p>Algorithm 1 Basic entities generation
Require: Argument sets, attack pairs</p>
        <p>Create ontology 
for argument set  in argument sets do</p>
        <p>Create an owl:Class 
for argument  ∈  do</p>
        <p>Create an owl:NamedIndividual  of rdf:type 
end for
end for
Create owl:ObjectProperty ’attacks’
Create owl:ObjectProperty ’isAttackedBy’
Assert ’isAttackedBy’ owl:inverseOf ’attacks’
for (1, 2) in attack pairs do</p>
        <p>Find the instance 1 in  for 1
Find the instance 2 in  for 2</p>
        <p>Assert 1 ’attacks’ 2
end for
Run reasoner</p>
        <p>Algorithm 2 closes arguments regarding ’attacks’ and ’isAttackedBy’ relation to support
the reasoning under OWA. This algorithm also has linear complexity regarding the number of
arguments.</p>
        <p>Algorithm 3 declares conflict-free and admissible subsets of arguments for each input
argument set and classifies arguments into them with reasoning. As declaring a conflict-free set
for the argument set requires constructing a list of other argument sets, this algorithm has
quadratic complexity regarding the number of argument sets.</p>
        <p>Thus, the algorithm generates an ontology that contains an empty admissible subset for
each argument set. These admissible subsets are then populated by classifying arguments with
reasoning.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Proof of Concept</title>
      <p>Input Data For proof of concept, the input data, i.e. argument sets and attack pairs, are
represented in JSON format. Its structure includes two high-level keys: argument_sets and
Algorithm 2 Closing world
Require: Ontology 
for argument instance  in  do</p>
      <p>Get the set  of the arguments  attacks
if  is empty then</p>
      <p>Assert  rdf:type (’attacks’ owl:AllValuesFrom owl:Nothing)
else</p>
      <p>Assert  rdf:type ’attacks’ owl:AllValuesFrom owl:OneOf())
end if
Get the set  of the arguments  is attacked by
if  is empty then</p>
      <p>Assert  rdf:type (’isAttackedB’ owl:AllValuesFrom owl:Nothing)
else</p>
      <p>Assert  rdf:type (’isAttackedBy’ owl:AllValuesFrom owl:OneOf())
end if
end for
Algorithm 3 Inferring solution
Require: Argument sets, ontology 
for argument set  in argument sets do</p>
      <p>Find the class  for  in 
Create its subclass 
Create an empty set 
for argument set  in argument sets do
if  is not  then</p>
      <p>Find the class  for  in</p>
      <p>Add  to 
end if
end for</p>
      <p>Assert  owl:equivalentClass (owl:intersectionOf (, ’attacks’ owl:allValuesFrom
owl:unionOf()))</p>
      <p>Create subclass  of</p>
      <p>Assert  owl:equivalentClass (owl:intersectionOf ( , ’isAttackedBy’
owl:allValuesFrom (’isAttackedBy’ owl:someValuesFrom  )))
end for</p>
      <p>Run reasoner
attack_pairs. The key argument_sets has a dictionary, where each item represents an argument
set. The argument set item has a label and a dictionary of arguments that belong to it. Each
argument item in the latter dictionary has a label and a text. The key attack_pairs has a list
of two-element lists of argument labels that represent attack pairs. Formatted input data for
Example 1 are provided in Listing 12.
{
"argument_sets": {
"I": {
"i1": "My government cannot negotiate with your government because your government
doesn’t even recognize my government",
"i2": "But your government is a terrorist government"
},
"A": {</p>
      <p>"a": "Your government doesn’t recognize my government either"
}</p>
      <sec id="sec-4-1">
        <title>Listing 12: Input data based on Example 1</title>
        <p>
          Prototype The algorithm was implemented with Python language using Owlready2 library5
for working with OWL and the Pellet reasoner [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. The prototype is available in GitHub6, as
well as the input data and the ontology generated from Example 1. Additionally, a separate
script runs the reasoner over the generated ontology to classify arguments into conflict-free or
admissible sets.
        </p>
        <p>Results The most intransparent parts of the algorithm are running reasoner for 1) inferring
’isAttackedBy’ assertions, and 2) classifying arguments into conflict-free and admissible sets.
We provide the logs of these runs, conducted in Windows 10 OS with Intel Core i7-11850H CPU
and 16GB RAM. The first run took 0.72 s. and as a result, 6 individual assertions were inferred,
see Listing 13. The second run classified 3 individuals for 0.75 s., see Listing 14.
* Owlready2 * Pellet took 0.7212517261505127 seconds
* Owlready2 * Pellet output:
http://www.w3.org/2002/07/owl#Thing
onto.owl#A - (onto.owl#a)
onto.owl#I - (onto.owl#i1, onto.owl#i2)
PROPINST: onto.owl#i1 onto.owl#attacks onto.owl#a
PROPINST: onto.owl#i1 onto.owl#isAttackedBy onto.owl#a
PROPINST: onto.owl#a onto.owl#attacks onto.owl#i1
PROPINST: onto.owl#a onto.owl#isAttackedBy onto.owl#i1</p>
      </sec>
      <sec id="sec-4-2">
        <title>5https://owlready2.readthedocs.io/en/latest/ 6https://github.com/ldrbmrtv/computational_argumentation_dung</title>
        <p>PROPINST: onto.owl#a onto.owl#isAttackedBy onto.owl#i2
PROPINST: onto.owl#i2 onto.owl#attacks onto.owl#a</p>
        <p>Listing 13: Inferring ’isAttackedBy’ relation
* Owlready2 * Pellet took 0.75439453125 seconds
* Owlready2 * Pellet output:
http://www.w3.org/2002/07/owl#Thing
onto.owl#A
onto.owl#AConflictFree - (onto.owl#a)</p>
        <p>onto.owl#AAdmissible
onto.owl#I
onto.owl#IConflictFree
onto.owl#IAdmissible - (onto.owl#i1, onto.owl#i2)</p>
      </sec>
      <sec id="sec-4-3">
        <title>Listing 14: Classifying arguments</title>
        <p>In result, the arguments 1 and 2 were correctly classified as acceptable, and assigned to
the class , i.e. the admissible subclass of the argument set . And the argument
 was correctly assigned only to the class   , i.e. the conflict-free subset of the
argument set .</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion</title>
      <p>In this research, we reviewed existing solutions related to semantic argument representation
and concluded that among them, there is no approach that would provide a dispute
resolution technique. Based on Dung’s abstract argumentation frameworks, we proposed a method
for OWL DL representation of single mixed disputes designed in a manner that allows their
resolution with reasoning. Moreover, we proposed an algorithm for the generation of the
OWL DL representations having argument sets and attack pairs as input. The algorithm has
quadratic complexity and is validated with a proof of concept implementation. The proposed
representation is validated with an example of the correct dispute resolution over the
generated ontology. Future work will address extending the present approach for implementing
complete, preferred and stable extensions of argument sets, and developing approaches for the
computational resolution of other types of disputes. The latter may require considering other
argumentation frameworks. We also plan to automate the input data preparation with text
annotation, NLP techniques and machine learning.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>This work was co-funded by the European Research Council for the project ScienceGRAPH
(Grant agreement ID: 819536) and NFDI4DataScience funded by the German Research
Foundation (DFG project number 460234259). The support from the Russian Science Foundation,
project No. 20-18-00158, realised at St. Petersburg State University, is kindly recognized.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M.</given-names>
            <surname>Lippi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Torroni</surname>
          </string-name>
          ,
          <article-title>Argumentation mining: State of the art and emerging trends</article-title>
          ,
          <source>ACM Trans. Internet Technol</source>
          .
          <volume>16</volume>
          (
          <year>2016</year>
          ). doi:
          <volume>10</volume>
          .1145/2850417.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>F. H. Van Eemeren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Grootendorst</surname>
          </string-name>
          ,
          <article-title>A systematic theory of argumentation: The pragmadialectical approach</article-title>
          , Cambridge University Press,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>P. M.</given-names>
            <surname>Dung</surname>
          </string-name>
          ,
          <article-title>On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>77</volume>
          (
          <year>1995</year>
          )
          <fpage>321</fpage>
          -
          <lpage>357</lpage>
          . doi:
          <volume>10</volume>
          .1016/
          <fpage>0004</fpage>
          -
          <lpage>3702</lpage>
          (
          <issue>94</issue>
          )
          <fpage>00041</fpage>
          -
          <lpage>X</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>C.</given-names>
            <surname>Chesñevar</surname>
          </string-name>
          ,
          <string-name>
            <surname>Mcginnis</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Modgil</surname>
            , I. Rahwan,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Reed</surname>
            , G. Simari,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>South</surname>
            , G. Vreeswijk,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Willmott</surname>
          </string-name>
          ,
          <article-title>Towards an argument interchange format</article-title>
          ,
          <source>The Knowledge Engineering Review</source>
          <volume>21</volume>
          (
          <year>2006</year>
          )
          <fpage>293</fpage>
          -
          <lpage>316</lpage>
          . doi:
          <volume>10</volume>
          .1017/S0269888906001044.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>I.</given-names>
            <surname>Rahwan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Reed</surname>
          </string-name>
          ,
          <article-title>The argument interchange format</article-title>
          ,
          <source>Argumentation in Artificial Intelligence</source>
          (
          <year>2009</year>
          )
          <fpage>383</fpage>
          -
          <lpage>402</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-0-
          <fpage>387</fpage>
          -98197-0\_
          <fpage>19</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>M.</given-names>
            <surname>Janier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Lawrence</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Reed</surname>
          </string-name>
          , Ova+:
          <article-title>An argument analysis interface</article-title>
          ,
          <source>Frontiers in Artificial Intelligence and Applications</source>
          <volume>266</volume>
          (
          <year>2014</year>
          )
          <fpage>463</fpage>
          -
          <lpage>464</lpage>
          . doi:
          <volume>10</volume>
          .3233/ 978-1-
          <fpage>61499</fpage>
          -436-7-463.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.</given-names>
            <surname>Lawrence</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Bex</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Reed</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Snaith</surname>
          </string-name>
          ,
          <article-title>Aifdb: Infrastructure for the argument web</article-title>
          ,
          <source>in: Computational Models of Argument</source>
          , IOS Press,
          <year>2012</year>
          , pp.
          <fpage>515</fpage>
          -
          <lpage>516</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zagorulko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Garanina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Sery</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Domanov</surname>
          </string-name>
          ,
          <article-title>Ontology-based approach to organizing the support for the analysis of argumentation in popular science discourse</article-title>
          ,
          <source>in: Artificial Intelligence: 17th Russian Conference, RCAI</source>
          <year>2019</year>
          , Ulyanovsk, Russia,
          <source>October 21-25</source>
          ,
          <year>2019</year>
          , Proceedings 17, Springer,
          <year>2019</year>
          , pp.
          <fpage>348</fpage>
          -
          <lpage>362</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A.</given-names>
            <surname>Boer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Winkels</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Vitali</surname>
          </string-name>
          ,
          <source>MetaLex XML and the Legal Knowledge Interchange Format</source>
          , Springer Berlin Heidelberg, Berlin, Heidelberg,
          <year>2008</year>
          , pp.
          <fpage>21</fpage>
          -
          <lpage>41</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>T. F.</given-names>
            <surname>Gordon</surname>
          </string-name>
          ,
          <article-title>Introducing the carneades web application</article-title>
          ,
          <source>in: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Law</source>
          ,
          <year>2013</year>
          , pp.
          <fpage>243</fpage>
          -
          <lpage>244</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>E.</given-names>
            <surname>Francesconi</surname>
          </string-name>
          ,
          <article-title>Semantic model for legal resources: Annotation and reasoning over normative provisions</article-title>
          ,
          <source>Semantic Web</source>
          <volume>7</volume>
          (
          <year>2016</year>
          )
          <fpage>255</fpage>
          -
          <lpage>265</lpage>
          . doi:
          <volume>10</volume>
          .3233/SW-140150.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>E.</given-names>
            <surname>Sirin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. C.</given-names>
            <surname>Grau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Katz</surname>
          </string-name>
          ,
          <article-title>Pellet: A practical owl-dl reasoner</article-title>
          ,
          <source>Web Semant</source>
          .
          <volume>5</volume>
          (
          <year>2007</year>
          )
          <fpage>51</fpage>
          -
          <lpage>53</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.websem.
          <year>2007</year>
          .
          <volume>03</volume>
          .004.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>