<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Discourse-Based Reasoning for Controlled Natural Languages</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Andrew Potter</string-name>
          <email>andrew.potter@sentar.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Sentar</institution>
          ,
          <addr-line>Incorporated, 315 Wynn Drive, Suite 1 Huntsville, Alabama, USA 35805</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Logic-based controlled natural languages usually provide some facility for compositional representation, minimally including sentence level coordination and sometimes subordination. Although these compositional forms suffice for representing short passages, they can become unwieldy for expressing entire paragraphs and documents. This paper describes an approach to representing larger composite texts in a controlled natural language. This approach, called discourse-based reasoning, integrates rhetorical structure theory with argumentation theory to define a model for defining composite structures and argument strategies in an ontological representation. Rhetorical structures are used to represent controlled texts, and argument strategies are defined for reasoning about interactions between structures. This provides the basis for expressing, summarizing, and interacting with explanatory and argumentative discourse. This would expand the scope of problems that may be addressed using controlled natural languages.</p>
      </abstract>
      <kwd-group>
        <kwd>Controlled Natural Language</kwd>
        <kwd>Rhetorical Structure Theory</kwd>
        <kwd>Argumentation</kwd>
        <kwd>Discourse-Based Reasoning</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Logic-based controlled natural languages usually provide some facility for
compositional representation. Most well known among these, ACE and PENG define
discourse representation structures that support both sentence level coordination and
subordination [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ], and CLCE, CPL, and E2V support sentence level coordination
[
        <xref ref-type="bibr" rid="ref3 ref4 ref5">3-5</xref>
        ]. Although these forms of compositional representation are useful for expressing
short passages of a few sentences, they can become unwieldy for expressing entire
paragraphs or documents. Techniques are needed for representing longer
compositions in a way that is both rhetorically expressive and logically reducible. In
response to this need, we are developing a discourse-based representation technology
that will support high level rhetorical structures, argumentation strategies, and
intertextual synthesis.
      </p>
      <p>
        Our approach, called Discourse-Based Reasoning (DBR), is based on underlying
structures of natural discourse and argumentation theory. DBR draws on Mann and
Thompson's Rhetorical Structure Theory (RST) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], Toulmin's model of
argumentation [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], and Perelman and Olbrechts-Tyteca's strategic argumentative
processes [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. The Toulmin model provides a framework for argumentation. RST
provides schemas, constraints, and rhetorical relations used in generating discourse
structures. The concept of strategic argumentative processes leads to a definition of
structural interactions which may be discovered and synthesized within one or more
ontologically normalized texts. While DBR has been introduced in some earlier
papers [
        <xref ref-type="bibr" rid="ref10 ref11 ref9">9-11</xref>
        ], it has become clear that implementation will require use of a controlled
natural language. It seems that controlled languages could use DBR as well.
      </p>
      <p>Warrant
nucleus Instance Situation
satellite Instance* Situation
nucleus satellite* interactant*</p>
      <p>Span
relation Instance Relation
statement Instance Statement</p>
      <p>relation
Relation</p>
      <p>Antithesis</p>
      <p>Background
identifier Symbol Circumstance</p>
      <p>Concession
…
statement</p>
      <p>Statement</p>
      <p>Interaction
interactant Instance* Warrant</p>
      <p>Substantiation</p>
      <p>Rebuttal
type Symbol Backing</p>
      <p>Undercut</p>
      <p>…
The reasoning model defines a mapping between RST and the Toulmin model. This
makes it possible to represent argumentative reasoning using RST discourse
structures. As shown in Fig. 1, the elements of the model are warrants, spans,
statements, relations, and interactions. A warrant establishes a set of links between a
nucleus and zero or more satellites. The nucleus and its satellites are represented as
spans. A span consists of a CNL statement, and in the case of satellites, the satellite’s
RST relation to its nucleus. In argumentative terms, the nucleus corresponds to a
claim, and the satellites corespond to grounds. Each satellite (or ground) links to the
nucleus (or claim) by means of a rhetorical relation. That said, it should be noted that
while some rhetorical relations are clearly argumentative, or at least inferential, others
are merely synthetic, and the reasoning model must take this into account. Examples
of inferential relations include Condition, Evidence, Means, Otherwise, and the causal
relations. Examples of synthetic relations include Background, Circumstance,
Elaboration, Restatement, and Summary. In a synthetic relation, the satellite and
nucleus are logically conjunctive, but the nucleus is more salient than the satellite.
This distinction between synthetic and inferential relations supports application of the
reasoning process, facilitating both explanatory and argumentative discourse.</p>
      <p>Interactions define the rules for synthesizing complex structures to create an
explanation network. An interaction occurs when a nucleus, satellite, or warrant of
one structure can be unified with a nucleus, satellite, or warrant of another structure.
Interactions are defined in terms of the possible relationships between warrants,
satellites, and nuclei. For example, if the claim of one argument unifies with the
ground of another, a substantiation interaction is said to occur. Fig. 2 shows examples
of substantiation and concomitance, and Table 1 defines the full set of interactions.</p>
      <p>Substantiation</p>
      <p>Concomitance</p>
      <p>
        With this reasoning model it is possible to represent highly expressive explanation
networks that may be queried at varying levels of depth. In natural language
processing, Marcu [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and others have shown that salience-based discourse structure
may be useful in distilling textual summaries. Further, Marcu integrated a set of
metrics that could be used to improve these summaries, such as rhetorical clustering,
explicit markers, and structure shape. If techniques such as these are promising for
summarizing natural language, it would seem of likely utility for controlled languages
as well. Our preliminary experimentation supports this claim. We developed a utility
that distills raw summaries with specifiable depth from RST analyses stored in
RSTtool markup format, and our results thus far have been encouraging.
3
      </p>
      <p>
        Generating Discourse Structures
For the value of these discourse structures to be realized, it will be necessary to
provide an efficient means for their generation. Although parsing discourse relations
in CNL may be less difficult than natural language, it is not a trivial problem. The
difficulties lie not merely in the complexities of the language, but in the subtleties of
the RST relation definitions themselves. Consider for example the distinction between
Antithesis and Concession. Antithesis prescribes that the writer has positive regard for
the nucleus and that the satellite and nucleus are mutually incompatible, e.g. “Rather
than waste time teaching at the university, Charles pursued a lucrative career in the
publishing industry.” The Concession relation, on the other hand, prescribes that the
writer has positive regard for the nucleus but that there is not necessarily an
incompatibility between it and the satellite, e.g. “Although his mother would have
preferred that he teach, Charles pursued a lucrative career in the publishing industry.”
Following these definitions it might seem that any instance of the Antithesis relation
could also be coded as Concession [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Similar difficulties arise when distinguishing
Elaboration from Evidence.
      </p>
      <p>
        For CNL, the answer, it seems to us, is that DBR structures would be created the
same way as other CNL discourse structures—namely they would be created as part
of the authoring process. For example, Attempto Controlled English supports several
discourse representation structures for representing composite sentences, such as
conditions, coordinates, and subordinates [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], and the ACE parser is able to recognize
these. In a study of automated parsing of natural language texts, Marcu and Echihabi
[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] were able to achieve 93% accuracy in recognizing discourse relations for a small
subset of relation types. While this success rate is not adequate for CNL, it does
suggest that through a combination of refining the RST relation set and extending the
set of cue phrases available to CNL authors, it may be possible to develop a
hypotactic style that would support automatic DBR structure generation. For example,
if we wish to preserve the distinction between Antithesis and Concession, we could
specify this through the use of cue words such as but, not, and although:
1
2
      </p>
      <p>An administrator can not verify every system, but it is necessary that if a system is a
compromised system then the administrator must verify it.</p>
      <p>Although it is possible that an administrator believes that a system is up-to-date, it is not
provable that the system is invulnerable.</p>
      <p>Interaction
Substantiation. The claim of one
argument is used as the ground of another
Rebuttal. The claims of two arguments
are incompatible
Backing. An argument substantiates the
warrant of another
Undercut. The claim of one argument is
incompatible with the ground of another
Dissociation. The claim of one argument
disputes the warrant of another
Convergence. Two arguments lead to the
same claim, with possible accrual
Concomitance. Two arguments use the
same ground to establish distinct claims
Confusion. The grounds of two
arguments are incompatible</p>
      <p>Definition
substantiation(arg(G1,C1,W1) &amp; arg(C1,C2,W2))
rebuttal(arg(G1,C1,W1) &amp; arg(G2,C2,W2)) &amp;</p>
      <p>incompatible(C1,C2))
backing(arg(G1,C1,W1) &amp; arg(G2,C2,C1))
undercut(arg(G1,C1,W1) &amp; arg(G2,C2,W2) &amp;</p>
      <p>incompatible(C1,G2))
dissociation(arg(G1,C1,W1) &amp; arg(G2,C2,W2) &amp;</p>
      <p>incompatible(C1,W2))
accrual(arg(G1,C1,W1) &amp; arg(G2,C1,W2))
concomitance(arg(G1,C1,W1) &amp; arg(G1,C2,W2))
confusion(arg(G1,C1,W1) &amp; arg(G2,C2,W2) &amp;</p>
      <p>incompatible(G1, G2))</p>
      <p>
        In addition, we may be able to build on this through recognition of syntactically
recognizable rhetorical forms, such as sorites, hypothetical syllogism, and dilemma.
Paragraph breaks and punctuation cues could also be used to support recognition of
larger composite structures [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. Through a combination of cue phrases, syntactical
forms, and layout features, it may be possible to arrive at a composition style that is
easy enough for writers to write, readers to read, and automated reasoning systems to
process.
      </p>
      <p>This paper has defined an approach to representing and reasoning about complex
composite structures in controlled natural languages. This is accomplished through
definition of a reasoning model that synthesizes rhetorical structure theory with
Toulmin’s argumentative model and Perelman’s theory of argument strategy. By
defining rules for managing interactions among inferential and synthetic structures,
DBR provides the basis for representing, summarizing, and interacting with
explanatory and argumentative discourse, and it expands the scope of problems that
may be addressed using controlled natural languages. Some anticipated future work
includes identification of an experimental RST relation set for CNL, developing a
prototype for encoding composite texts, and further definition of the reasoning model.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Fuchs</surname>
            ,
            <given-names>N.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaljurand</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuhn</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Discourse representation structures for ACE 6.0</article-title>
          . Department of Informatics, University of Zurich, Zurich (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Schwitter</surname>
          </string-name>
          , R.:
          <article-title>English as a formal specification language</article-title>
          .
          <source>Proceedings of the 13th International Workshop on Database and Expert Systems Applications</source>
          (
          <year>2002</year>
          )
          <fpage>228</fpage>
          -
          <lpage>232</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Pratt-Hartmann</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>A two-variable fragment of English</article-title>
          .
          <source>Journal of Logic, Language and Information</source>
          <volume>12</volume>
          (
          <year>2003</year>
          )
          <fpage>13</fpage>
          -
          <lpage>45</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Sowa</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>Common logic controlled English</article-title>
          .
          <article-title>(</article-title>
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harrison</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jenkins</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thompson</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wojcik</surname>
          </string-name>
          , R.:
          <article-title>Acquiring and using world knowledge using a restricted subset of English</article-title>
          .
          <source>FLAIRS</source>
          (
          <year>2005</year>
          )
          <fpage>506</fpage>
          -
          <lpage>511</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Mann</surname>
            ,
            <given-names>W.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thompson</surname>
            ,
            <given-names>S.A.</given-names>
          </string-name>
          :
          <article-title>Rhetorical structure theory: Towards a functional theory of text organization</article-title>
          .
          <source>Text</source>
          <volume>8</volume>
          (
          <year>1988</year>
          )
          <fpage>243</fpage>
          -
          <lpage>281</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Toulmin</surname>
            ,
            <given-names>S.E.</given-names>
          </string-name>
          :
          <article-title>The uses of argument</article-title>
          . Cambridge University Press, Cambridge, UK (
          <year>1958</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Perelman</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Olbrechts-Tyteca</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The new rhetoric: A treatise on argumentation</article-title>
          . University of Notre Dame, Notre Dame,
          <string-name>
            <surname>IA</surname>
          </string-name>
          (
          <year>1969</year>
          [1958])
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Potter</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>A discourse approach to explanation aware knowledge representation</article-title>
          . In: RothBerghofer,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Schulz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Leake</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.B.</given-names>
            ,
            <surname>Bahls</surname>
          </string-name>
          ,
          <string-name>
            <surname>D</surname>
          </string-name>
          . (eds.):
          <article-title>Explanation-aware computing: Papers from the 2007 AAAI Workshop</article-title>
          . AAAI Press, Menlo Park, CA (
          <year>2007</year>
          )
          <fpage>56</fpage>
          -
          <lpage>63</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Potter</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Generating discourse-based explanations</article-title>
          .
          <source>Künstliche Intelligenz</source>
          <volume>22</volume>
          (
          <year>2008</year>
          )
          <fpage>28</fpage>
          -
          <lpage>31</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Potter</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Linked and convergent structures in discourse-based reasoning</article-title>
          . In: RothBerghofer,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Schulz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Bahls</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Leake</surname>
          </string-name>
          , D.B. (eds.):
          <source>Proceedings of the 3rd International Explanation Aware Computing Workshop (ExaCt</source>
          <year>2008</year>
          ), Patras, Greece (
          <year>2008</year>
          )
          <fpage>72</fpage>
          -
          <lpage>83</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Marcu</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>The theory and practice of discourse parsing and summarization</article-title>
          . MIT Press, Cambridge, MA (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Stede</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <source>Disambiguating rhetorical structure Research on Language &amp; Computation</source>
          <volume>6</volume>
          (
          <year>2006</year>
          )
          <fpage>311</fpage>
          -
          <lpage>332</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Marcu</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Echihabi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>An unsupervised approach to recognizing discourse relations</article-title>
          .
          <source>Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL)</source>
          , Philadelphia (
          <year>2002</year>
          )
          <fpage>368</fpage>
          -
          <lpage>375</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Campbell</surname>
            ,
            <given-names>K.S.</given-names>
          </string-name>
          : Coherence, continuity, and
          <article-title>cohesion: Theoretical foundations for document design</article-title>
          . Lawrence Erlbaum, Hillsdale, NJ (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>