<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Deception-aware pragmatic inference</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Katerina Papantoniou</string-name>
          <email>papanton@ics.forth.gr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, University of Crete</institution>
          ,
          <addr-line>Heraklion</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Institute of Computer Science</institution>
          ,
          <addr-line>FORTH, Heraklion</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Pragmatic competence i.e., the ability to understand intended meaning is a long standing challenge in communication. This work proposes a computational framework for pragmatic inference that is based on reasoning by taking into account the realistic assumption that any communication could be deceptive and that intentions can be re ected in language use. Pragmatic inference is examined under the light of culture since as literature manifests, cultural di erences is a crucial parameter in the communication process and often a cause of misinterpretations (e.g., false alarms about the deceptiveness of a message). In contrast to the current situation, the proposed approach takes a holistic stance, aiming to infer knowledge both from surface patterns in raw text and more formal structures beyond the text level.</p>
      </abstract>
      <kwd-group>
        <kwd>Pragmatics</kwd>
        <kwd>Deception</kwd>
        <kwd>Culture</kwd>
        <kwd>Reasoning</kwd>
        <kwd>NLP</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Every day, people through their interpersonal interactions run into
deceptiveprone situations struggling to decipher deceptive signals in messages. In
highstake situations and in situations, where justice and equal treatment must be
ensured, the ability to detect deception is of utmost importance. An example
that falls into the above cases is the examination of asylum applications from
trained personnel, a task neither easy nor rare.1</p>
      <p>Let's consider Nizar, a 29 years old Syrian forced to leave his country and
seeks asylum in an European country. Some of the questions that are raised
during his interactions with the Asylum O ce personnel:
{ In case the communication is not totally honest, which strategies of
deception are employed maybe from both parties (e.g., blu , information hiding,
outright lie, exaggeration etc.)?
{ What both parties hypothesize about the portion of information the other
party possess or ignore? What are their hypotheses about the beliefs of each
side (e.g., Nizar believes that the examiner of his application believes that
he didn't lie about his marital status or his political beliefs)?
1 By the end of 2015, asylum-seekers were 3.2 million (UNHCR).
{ How the train of thought will change/revise when a deceptive e ort come to
light? How the beliefs of both parties revised?
{ Does the di erent culture a ect deceptive signals and may this condition
cause misconceptions?
In the above context, the participants whoever role they hold must be extremely
skilled at mind-reading in order to interpret implicit or seemingly uncorrelated
information and to reason about unexpressed beliefs and intentions. The problem
is further exacerbated by the di erent cultural and cognitive background of the
involved actors (Nizar and the Asylum o ce personnel).</p>
      <p>The proposed work is motivated by such situations and aims to research
deception, by concentrating on a more holistic angle compared to existing
literature. We aim at providing a computational framework that will gain advantage
from deception detection techniques over a text message in order to enhance and
inform complex reasoning tasks (e.g., given that a message of A is deceptive, A
hides something else, what points an agent chooses to undermine or stress). We
believe that by combining deception detection techniques with reasoning
approaches over the communicated content we can achieve a deeper understanding
of a message and to infer information that is implied or is hidden. Next, we
brie y discuss the three basic axes we decided to rely on namely deception, text
and culture.</p>
      <p>
        Deception is omnipresent in every facet of human life [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], for example in fake
news, forged reviews, cheaters in exams, white lies, self-deception, concealment
of truth for our beloved ones or in order to save face. Despite this pervasiveness of
deception, humans are notoriously bad at distinguishing between lies and truth
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. In experimental studies of detecting deception, accuracy is typically only
slightly better than chance [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], even among trained people such as investigators
or customs inspectors. So, it is evident the necessity for the development of
reliable and ideally proactive and real-time deception detection approaches that
can protect individuals and the common weal.
      </p>
      <p>
        The input to our deception detection algorithms will be simple textual data.
This approach has recently gained momentum in the eld of deception
detection. A combination of factors seem to lead in this turn namely the advances
in elds of Natural Language Processing (NLP) and Computational Linguistics,
the enormous production of textual data, the seminal work of Vrij [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] and pure
need as in many cases text is the only available source or more a ordable and
less intrusive (e.g., MRI). Last but not least, we prioritize the use of text since
it allows us to gain insight over realistic situations.
      </p>
      <p>
        We place great emphasis on examining deception taking into account the
cultural characteristic of the potential liar. As studies show, people of other ethnic
group when try to detect deception perform even worse than judging people of
their own ethnic group [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. For example, in a cross-cultural interrogation setting,
that the norms of the person under investigation is di erent from the norms of
the investigator, false signals may arise that impede the interrogation process
and reduce the investigator's con dence. The importance of culture is recognized
by many law enforcement authorities such as the U.K Home O ce that list
cultural di erences and cultural awareness as one of the key issues in investigator
training and development [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. It is indicative that often o cers are specialized
in di erent world regions or countries and cases assigned to them accordingly
[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. From a di erent perspective, the consideration of culture in statistical NLP
models can contribute as a form of debiasing, which is currently a vivid research
thread [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>The starting point of this work is that deception indicators are critical to
be extracted not only from surface patterns in textual data (e.g., news articles,
dialogues, reports etc) but also by taking advantage of the overall context that
can reveal the intention behind a deception e ort and implied information. This
requires the formal (abstract) representation of the communication content and
subsequently the application of the appropriate forms of reasoning.
2</p>
    </sec>
    <sec id="sec-2">
      <title>State-of-the-art</title>
      <p>
        The passage from unrestricted free form text to a formalization that will enable
complex reasoning process is a genuine arduous project. A lot of endeavours
for the representation of semantics and pragmatics to logical forms have been
presented in the literature. A comprehensive overview of this e orts such as LFG
(Lexical functional Grammar), HPSG (Head-driven phrase structure grammar)
and DRT (Discourse Representation Theory) is provided in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. The
current state-of-the art in transforming dependency structures to logical forms
succeeds in representing underlying predicate-argument structures, in an almost
language-independent manner [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. This work will be the basis for our transition
to logical forms.
      </p>
      <p>
        As far as the deception representation and reasoning is concerned a recent
and very close to our goals work is that of Licato [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] that attempts to model
the complex reasoning and deceptive planning used in an episode of the
popular TV series \Breaking Bad". The author extend Cognitive Event Calculus to
represent knowledge that involves nested beliefs, desires and intentions. For the
representation of plans actions schemas were used, while for nested beliefs and
all the alternative possibilities in a plan, he used non-monotonic reasoning and
speci cally default reasoning. In [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] the authors propose a model of belief and
intention change over the course of a dialogue in which the decisions taken
during the dialogue a ect the possibly con icting goals of the agents involved. They
used Situation Calculus to model the evolution of the world and an observation
model to analyze the evolution of intentions and beliefs. Their formalization is
illustrated within the game of Werewolf, a party game that is frequently is used
as use case in deceptive studies. A complete but mainly theoretical formal
account of dishonesty is presented in [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. The authors introduce a propositional
multi-modal logic that can represent an agent's belief and intention as well as
communication between agents. They handle di erent categories of dishonesty
namely lies, bullshit, withholding information and half-truths.
      </p>
      <p>
        In the context of culture modelling an important contribution is o ered in
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. The CARA architecture (Cognitive Architecture for Reasoning about
Adversaries) supports methods to gather data about di erent cultural groups and
learn the intensity of those groups' opinions on various topics. The aspect of
culture is modelled through rules taking advantage of knowledge extracted from the
Web [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and from prior theoretical studies. Rules are also used in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] to model
culture for a trade agents scenario. They model culture based on one of the ve
dimensions of culture according to Hofstede: individualism versus collectivism.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Proposed Approach</title>
      <p>In an abstract level the the proposed approach constitutes of two processes
(Figure 1). The rst one is responsible to decide about the overall deceptiveness
of a textual message and the extraction of ne-grained information such as type
of deception based mainly on NLP approaches. This task feeds the pragmatics
inference task that realizes the modelling of complex situations where reasoning
beyond the text level is needed to understand hidden intentions and beliefs as
those re ected in the introductory example. As Figure 1 depicts, culture is a
modular parameter for both tasks, thus our approach can be applied also in
contexts where culture is not so critical.
Deception detection from a computational linguistics viewpoint focuses on
linguistics di erences between deception and truth-telling. A lot of theories back
up this approach (psychoanalytic approach of Freud, Lexical Hypothesis) and
in this respect a long list of lexical features almost for any level level of lexical
analysis (e.g., morphology, syntax, discourse, psycholinguistics) has been
examined. Since this research goal is out of the focus of this paper we brie y mention
the directions that we will base our e orts upon:</p>
      <sec id="sec-3-1">
        <title>Cross-linguistic and cross-culture deception detection</title>
        <p>
          A reasonable argument that has already started to be explored [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] is if the
world's languages di erences a ect deception linguistic cues.2 Drawing on prior
research on psychology and sociology we want to examine in a larger scale
indications about the existence of discriminating cues that are universally applicable
across cultures. Equally important and under investigation is to understand the
di erences between cultures that are re ected in language use and maybe lead
to misconceptions. For example, anxiety and awkwardness because of
communication obstacles or politeness as an inherent characteristic in some cultures.
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Deception types</title>
        <p>
          A large body of the deception literature has been devoted to the typology of
deception and to the identi cation of subtle di erences between types of deception
[
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] (e.g., distraction, concealments, white lies etc.). As very little work has
been done [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] towards the discrimination between deception strategies from text
data, we concentrate our e orts in this direction.
        </p>
        <p>As far as the input data availability is concerned the vivid interest for
deception detection has lead to the creation of a considerable number of publicly
available textual datasets from diverse domains (e.g., news, reviews, court data).
We plan to base our work is such datasets and perhaps to expand this pool of
data with datasets for the Greek language.
3.2</p>
      </sec>
      <sec id="sec-3-3">
        <title>Pragmatics Inference</title>
        <p>
          The rst step in this task is the structured representation of the communicated
content. We anticipate to formalize natural language just to the extent that it
allows us to transfer certain information to a formal context taking advantage of
the recent advances in this direction [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. Since none of the available modal logics
we reviewed is able to fully cover our requirements [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], we plan to introduce
a new modal logic that builds upon the rst-order Event Calculus (EC). EC
has become almost the natural choice for the modelling of natural language
narratives since to some extent it can capture natural language semantics. In
addition, the reformulation of EC in terms stable model semantics that can be
computed by Answer Set Programming (ASP) solvers make EC a robust choice.
        </p>
        <p>In our case, a critical requirement is nonmonotonicity due to dynamic changes
in belief, intentions and knowledge. For instance, the presence of a deceptive
message maybe lead to the revision of the existing knowledge or the creation
of alternative paths that due to explosion in the quantity of knowledge must
be handled. The parameter of time is another important requirement since the
sequence of facts cannot be ignored.</p>
        <p>
          As we have already argued, in an inter-cultural setting, the cultural gap may
play a decisive role in communication since often it could be the cause of
misconceptions and misunderstandings. In this respect, we must be able to incorporate
knowledge about culture. This culture-driven knowledge can take two forms: a.
the form of context-dependent knowledge about values, norms, relations,
opinions, stance towards life (e.g., perceptions about family bonds) and b. linguistic
2 The relationship between language and culture is supported by several theories
among them the Sapir-Wholf hypothesis that language in uences cognition.
expression of cultural di erences (e.g., some cultures are engaged to small talk
while others are more tolerant to persuasion). The theoretical support is
provided by the research for cross-cultural deception detection [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], the di erences
between high and low context cultures [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] and the cultural dimensions as
reected in the work of Hofstede [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. From an implementation perspective the
obvious choice is the modelling through rules however the challenge is the
validation of these rules perhaps by using external sources as validation mechanism
in order to avoid the modelling of stereotypical and prejudged knowledge.
        </p>
        <p>The nature of the examined problem guide us to forms of reasoning that
make inferences beyond the scope of the premises as well as the ability to
backtrack. For that reason, we plan to de ne a new form of reasoning that can be
placed under the umbrella of Ampliative and Defeasible Reasoning. In addition,
we must also take into account the di erences in reasoning that emerge from
culture (e.g., since a culture expressed in a particular way what conclusion could be
inferred). Lastly, returning to the initial discussion about mind-reading a
challenge is to incorporate aspects of Counterfactual Reasoning as a way to examine
the viewpoint of the \Other" and avoid problems like con rmation bias. Table
1 provides a sketch of the key requirements that must be ful lled in respect of
representation and reasoning.</p>
      </sec>
      <sec id="sec-3-4">
        <title>Nested Example</title>
        <p>Events in a course of a dialogue, time sequence in a
narrative</p>
        <p>All Europeans citizens are individualists
X Nizar believes that the examiner of his application
believes that the well-being of his family is a priority
for him
X Investigator ignores that...</p>
        <p>X Investigator hides from Nizar that he holds
information about his past, Nizar lied about his involvement
in the civil war of this country, O cer blu s about...</p>
      </sec>
      <sec id="sec-3-5">
        <title>Type Example</title>
        <p>Defeasible If Nizar lied for his economical status, he previously also lied...
Ampliative Nizar does not disclose information about his war experiences. I
can conclude that maybe su ers for post-traumatic stress disorder
Counterfactual Examine the case when a lie was not a lie but the result of
conrmation bias
Cultural Nizar as collectivist, values high the institution of family, so the
white lie in relation to some family members was indeed an e ort
to protect them</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusions &amp; Future Steps</title>
      <p>In this paper, we present our proposal for a deceptive-aware computational
framework for pragmatics inference. We aim at a closer collaboration between
Knowledge Representation and Reasoning with NLP in order to o er a deeper
understanding of the communicated content. We prioritize the in uence of
culture since, as literature emphatically manifests, it is a crucial parameter and
a constant source of misconceptions. Our prospective goal is two-fold, from one
side to o er more realistic deceptive aware multi-agent environments that require
complex forms of reasoning and from the other side to contribute to
Computational Pragmatics by based on formal logic for the pragmatic interpretation.</p>
      <p>Our immediate steps is to complete our requirements analysis for the
deceptiveaware modal logic while in parallel we work on towards the deception detection
from text task.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgements</title>
      <p>This work is funded by the Institute of Computer Science (ICS) of the
Foundation for Research and Technology - Hellas (FORTH) and is conducted under the
supervision of Prof. Dimitrios Plexousakis and in cooperation with Dr. Giorgos
Flouris, Dr. Theodoros Patkos and Prof. Ion Androutsopoulos.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Massimiliano</given-names>
            <surname>Albanese</surname>
          </string-name>
          and
          <string-name>
            <given-names>VS</given-names>
            <surname>Subrahmanian</surname>
          </string-name>
          .
          <article-title>T-rex: A domain-independent system for automated cultural information extraction</article-title>
          .
          <source>In Proceedings of the First International Conference on Computational Cultural Dynamics (ICCCD</source>
          <year>2007</year>
          ),
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Darren</given-names>
            <surname>Scott Appling</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Erica J.</given-names>
            <surname>Briscoe</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Clayton J.</given-names>
            <surname>Hutto</surname>
          </string-name>
          .
          <article-title>Discriminative models for predicting deception strategies</article-title>
          .
          <source>In Proceedings of the 24th International Conference on World Wide Web, WWW '15 Companion</source>
          , pages
          <volume>947</volume>
          {
          <fpage>952</fpage>
          , New York, NY, USA,
          <year>2015</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bella</surname>
            <given-names>M DePaulo</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Julie I Stone</surname>
            , and
            <given-names>G Daniel</given-names>
          </string-name>
          <string-name>
            <surname>Lassiter</surname>
          </string-name>
          .
          <article-title>Deceiving and detecting deceit</article-title>
          .
          <source>The self and social life</source>
          ,
          <volume>323</volume>
          ,
          <year>1985</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Codruta Liliana</surname>
            <given-names>G</given-names>
          </string-name>
          ^rlea, Eyal Amir, and
          <string-name>
            <given-names>Roxana</given-names>
            <surname>Girju</surname>
          </string-name>
          .
          <article-title>Tracking beliefs and intentions in the werewolf game</article-title>
          .
          <source>In Principles of Knowledge Representation and Reasoning: Proceedings of the Fourteenth International Conference, KR 2014</source>
          , Vienna, Austria,
          <source>July 20-24</source>
          ,
          <year>2014</year>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Naveen</given-names>
            <surname>Sundar</surname>
          </string-name>
          <string-name>
            <surname>Govindarajulu</surname>
          </string-name>
          , Selmer Bringsjord,
          <string-name>
            <given-names>and John</given-names>
            <surname>Licato</surname>
          </string-name>
          .
          <article-title>On deep computational formalization of natural language</article-title>
          .
          <source>In Proceedings of the Workshop:Formalizing Mechanisms for Arti cial General Intelligence and Cognition(Formal MAGiC) at Arti cial General Intelligence</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>PA</given-names>
            <surname>Granhag</surname>
          </string-name>
          , LA Stromwall, and ( Eds).
          <article-title>The detection of deception in forensic contexts</article-title>
          . Cambridge University Press,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. Par A. Granhag, Aldert Vrij, and
          <string-name>
            <given-names>Bruno</given-names>
            <surname>Verschuere</surname>
          </string-name>
          .
          <source>Detecting Deception: Current Challenges and Cognitive Approaches</source>
          (Wiley Series in Psychology of Crime, Policing and Law).
          <source>Wiley-Blackwell</source>
          ,
          <volume>1</volume>
          <fpage>edition</fpage>
          ,
          <year>October 2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Par</given-names>
            <surname>Granhag</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Vrij</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Verschuere</surname>
          </string-name>
          .
          <article-title>Detecting deception : current challenges and cognitive approaches</article-title>
          . Wiley, Hoboken,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Pr</given-names>
            <surname>Anders</surname>
          </string-name>
          <string-name>
            <given-names>Granhag</given-names>
            , Leif A.
            <surname>Strmwall</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Maria</given-names>
            <surname>Hartwig</surname>
          </string-name>
          .
          <article-title>Granting asylum or not? migration board personnel's beliefs about deception</article-title>
          .
          <source>Journal of Ethnic and Migration Studies</source>
          ,
          <volume>31</volume>
          (
          <issue>1</issue>
          ):
          <volume>29</volume>
          {
          <fpage>50</fpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>Maria</given-names>
            <surname>Hartwig</surname>
          </string-name>
          .
          <article-title>Interrogating to detect deception and truth: E ects of strategic use of evidence</article-title>
          .
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Geert</surname>
            <given-names>H.</given-names>
          </string-name>
          <string-name>
            <surname>Hofstede</surname>
          </string-name>
          .
          <article-title>Culture's consequences: Comparing values, behaviors, institutions, and organizations across nations</article-title>
          . Sage, Thousand Oaks, CA,
          <source>2nd and enlarged edition</source>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12. Gert Jan Hofstede,
          <string-name>
            <surname>Catholijn M. Jonker</surname>
            , and
            <given-names>Tim</given-names>
          </string-name>
          <string-name>
            <surname>Verwaart</surname>
          </string-name>
          . Individualism and Collectivism in Trade Agents, pages
          <volume>492</volume>
          {
          <fpage>501</fpage>
          . Springer Berlin Heidelberg, Berlin, Heidelberg,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>Dirk</given-names>
            <surname>Hovy</surname>
          </string-name>
          .
          <article-title>Demographic factors improve classi cation performance</article-title>
          .
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>Licato</given-names>
            <surname>John</surname>
          </string-name>
          .
          <article-title>Formalizing deceptive reasoning in breaking bad: Default reasoning in a doxastic logic</article-title>
          .
          <source>In Proceedings from the 2nd AAAI Symposium on Deceptive and Counter-Deceptive Machines (DCDM</source>
          <year>2015</year>
          ), Arlington,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Veronica</surname>
            Perez-Rosas and
            <given-names>Rada</given-names>
          </string-name>
          <string-name>
            <surname>Mihalcea</surname>
          </string-name>
          .
          <article-title>Cross-cultural deception detection</article-title>
          .
          <source>In ACL</source>
          <year>2014</year>
          , June 22-27,
          <year>2014</year>
          , Baltimore,
          <string-name>
            <surname>MD</surname>
          </string-name>
          , USA, Volume
          <volume>2</volume>
          :
          <string-name>
            <given-names>Short</given-names>
            <surname>Papers</surname>
          </string-name>
          , pages
          <volume>440</volume>
          {
          <fpage>445</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>Tiantian</given-names>
            <surname>Qin</surname>
          </string-name>
          and
          <string-name>
            <given-names>Judee K.</given-names>
            <surname>Burgoon</surname>
          </string-name>
          .
          <source>An Empirical Study on Dynamic E ects on Deception Detection</source>
          , pages
          <volume>597</volume>
          {
          <fpage>599</fpage>
          . Springer Berlin Heidelberg, Berlin, Heidelberg,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Siva</surname>
            <given-names>Reddy</given-names>
          </string-name>
          , Oscar Tackstrom, Michael Collins, Tom Kwiatkowski,
          <string-name>
            <surname>Dipanjan Das</surname>
          </string-name>
          ,
          <string-name>
            <surname>Mark Steedman</surname>
            , and
            <given-names>Mirella</given-names>
          </string-name>
          <string-name>
            <surname>Lapata</surname>
          </string-name>
          .
          <article-title>Transforming Dependency Structures to Logical Forms for Semantic Parsing</article-title>
          .
          <source>Transactions of the Association for Computational Linguistics</source>
          ,
          <volume>4</volume>
          :
          <fpage>127</fpage>
          {
          <fpage>140</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Chiaki</surname>
            <given-names>Sakama</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Martin</given-names>
            <surname>Caminada</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Andreas</given-names>
            <surname>Herzig</surname>
          </string-name>
          .
          <article-title>A formal account of dishonesty</article-title>
          .
          <source>Logic Journal of the IGPL</source>
          ,
          <volume>23</volume>
          (
          <issue>2</issue>
          ):
          <fpage>259</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19. VS Subrahmanian, Massimiliano Albanese, Maria Vanina Martinez, Dana Nau, Diego Reforgiato, Gerardo I Simari, Amy Sliva, Octavian Udrea, and
          <string-name>
            <given-names>Jonathan</given-names>
            <surname>Wilkenfeld</surname>
          </string-name>
          .
          <article-title>Cara: A cultural-reasoning architecture</article-title>
          .
          <source>IEEE Intelligent Systems</source>
          , pages
          <fpage>12</fpage>
          {
          <fpage>16</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Aldert</surname>
            <given-names>Vrij</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Granhag</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Porter</surname>
          </string-name>
          .
          <article-title>Pitfalls and opportunities in nonverbal and verbal lie detection</article-title>
          .
          <source>Psychological Science In The Public Interest</source>
          ,
          <volume>11</volume>
          (
          <issue>3</issue>
          ):
          <volume>89</volume>
          {
          <fpage>121</fpage>
          , 12
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>