<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Designing an Intelligent Cognitive Assistant as Persuasive Technology for Stress, Anxiety and Depression Relief</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Tine Kolenik</string-name>
          <email>tine.kolenik@ijs.si</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Martin Gjoreski</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matjaž Gams</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Jožef Stefan Institute</institution>
          ,
          <addr-line>Jamova cesta 39, 1000 Ljubljana</addr-line>
          ,
          <country country="SI">Slovenia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Jožef Stefan International Postgraduate School</institution>
          ,
          <addr-line>Jamova cesta 39, 1000 Ljubljana</addr-line>
          ,
          <country country="SI">Slovenia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This poster proposal paper describes how intelligent cognitive assistant technology can be used as an effective persuasion tool for behavior change to reduce stress, anxiety and depression. After a brief review of related work, it is argued that our own design goes beyond the state of the art because it includes a personality-based user model, expert domain ontologies, personalized strategies, machine learning for strategy evaluation and smart bracelet integration.</p>
      </abstract>
      <kwd-group>
        <kwd>Intelligent Cognitive Assistant</kwd>
        <kwd>Behavior Change</kwd>
        <kwd>Mental Health</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Stress, anxiety and depression (SAD) are becoming an increasing burden on our
society, with figures in certain groups reaching 71% for stress, 12% for anxiety disorder
and 48% for depression [
        <xref ref-type="bibr" rid="ref8">9</xref>
        ]. This provides an opportunity for scientific and
technological interventions. Persuasive technology (PT) operates to change attitudes or behaviors
without coercion or deception. An effective vessel for persuasion is intelligent
cognitive assistant (ICA) technology. ICAs can communicate in natural language as well as
understand context, adapt, learn, predict, perceive, act, and reason. Therefore, they can
be designed for psychotherapeutic help. Such ICAs can offer a number of advantages
in the mental health field: they can be free of charge and available around the clock;
people tend to be more comfortable talking to an ICA than to a person [1]; ICAs are
available in remote locations, etc. These benefits can reduce both the burden on health
care systems and barriers to their access [
        <xref ref-type="bibr" rid="ref1">2</xref>
        ].
After reviewing related papers on state-of-the-art (SOTA) psychotherapeutic ICAs
(PICAs), three were selected for this work. The criteria for inclusion was the following: 1)
the PICAs were researched in an ecological environment (user interaction took place in
the “wild”); 2) the PICAs were empirically tested; 3) the PICAs were text-based. The
use of ICAs as PT in mental health is a very young venture, making the pool of PICAs
small.
      </p>
      <p>
        A PICA by Yorita, Egerton, Oakman, Chan and Kubota [
        <xref ref-type="bibr" rid="ref9">10</xref>
        ] is based on the
BeliefDesire-Intention architecture, which contains three models: “a conversation model for
acquiring state information about the individual, measuring their stress level, a Sense
of Coherence (SOC) model for evaluating the individuals state of stress, and Peer
Support model, which uses the SOC to select a suitable peer support type and action it”
[Ibid., p. 3762]. The PICA tries to teach its users to improve their SOC and thus reduce
stress levels, which the PICA succeeds in in the reported experiment.
      </p>
      <p>Another effective PICA is called Woebot [1], which is based on a “decision tree with
suggested responses that accepts natural language inputs” [Ibid., p. 3]. It selects a
helping strategy in the form of educational content, personalized messages and scripted
advice by collecting data on users’ emotions and identifying their errors in thinking. In
one experiment, Woebot was more successful in relieving SAD symptoms (about 20%
improvement in mood) than the government-prescribed material (no improvement).</p>
      <p>
        Tess is another PICA which “reduce[s] self-identified symptoms of depression and
anxiety” [
        <xref ref-type="bibr" rid="ref1">2</xref>
        ]. It builds its foundation largely on an extensive emotion ontology, which
then serves to identify the emotions of its users from the text. It uses scripted
conversations to help the users, and collects journal data and user feedback to improve its
interventions. In one experiment, Tess significantly reduced depression and anxiety
symptoms (about 15% improvement in mood), while the government-approved eBook
for self-help did not help.
      </p>
      <p>Reviewed PICAs were successful in experiments, but do not fully exploit the
possibilities PT offers (e.g. behavior change (BC) theories, user modeling, adaptation,
personalization). The design of our PICA wants to leverage that.
3</p>
    </sec>
    <sec id="sec-2">
      <title>Design</title>
      <p>The main focus of our development is on what we call the PICA’s ‘theory of mind’
(ToM). In cognitive science, ToM describes the ability to “understand the thoughts and
feelings” [4, p. 528] as well as “attributing thoughts and goals to others” [Ibid.] in order
to function in social life. The PICA’s ToM is more domain-specific, but it serves the
same purpose – to understand its user to the extent that it provides effective
personalized help to alleviate SAD.</p>
      <p>The PICA is designed to be button-based, which reduces the complexity in the users’
linguistic input, making the system more predictable and controllable. Certain NLP
skills and free text options appear at certain nodes in the scripted conversations.</p>
      <p>
        The most important parts of the PICA include user modeling, adaptation and
personalization. These largely have a basis in behavioral and cognitive sciences advances on
human decision-making, BC and related phenomena [
        <xref ref-type="bibr" rid="ref7">8</xref>
        ], and they are largely what
make the PICA persuasive as such. To effectively dispatch its strategies, our PICA
holds and continually updates a model of its user. The PICA dialogically delivers a
questionnaire [
        <xref ref-type="bibr" rid="ref5">6</xref>
        ] on the Big Five personality traits (B5), which represents the user’s
personality. BC strategy selection is largely based on B5. Another fundamental aspect
of the user model are the SAD scores. These are determined by the Depression Anxiety
Stress Scales 21 questionnaire [
        <xref ref-type="bibr" rid="ref4">5</xref>
        ]. The questionnaire is regularly posed to the user for
up-to-date SAD scores. A smart bracelet is also a part of the PICA for biophysiological
measurements, which are used for automatic monitoring of SAD by creating an
accurate model of a user's SAD scores. As the scores are updated continuously and in real
time, there is no need for the PICA to pose the SAD questionnaire.
      </p>
      <p>
        The user model is used by the domain knowledge module, which is built from
ontologies on BC and SAD. The PICA uses the two modules for a range of activities that
guarantee tailored persuasion: B5 is ostensibly used to personalize the persuasive
messages the PICA dispatches; nudging is used at the times that are most beneficial to the
user, and occurs when the user model reflects certain SAD scores from the smart
bracelet readings; the ontologies on emotions are used in conjunction with the mental states
in the user model to guide the conversation; the SAD knowledge determines the SAD
severity and type for selecting the right strategy; and others. Strategies are dependent
on the user in two ways: 1) domain-knowledge model uses the user model to determine
the strategy, 2) strategies are selected according to their success – machine learning in
the form of reinforcement learning (RL) [
        <xref ref-type="bibr" rid="ref6">7</xref>
        ] allows PICA to learn about historical
interactions with the user to identify the right strategy.
4
      </p>
    </sec>
    <sec id="sec-3">
      <title>Conclusions and Future Work</title>
      <p>This work outlines a PICA that we believe goes beyond the existing SOTA. It is
surpassed by what is termed as ToM, which consists of: a specifically constructed user
model with global and local user data, which relies on behavioral and cognitive sciences
advances, especially the use of B5; a RL algorithm to model historical interactions
between the PICA and the user, thus capturing which strategies work and which do not;
so far inexistent ontologies, especially on BC and SAD. SOTA is further surpassed by
integrating two technologies, which is something not done before – ICA technology
and wearables, to achieve our goals in BC for mental health.</p>
      <p>The final implementation of the design is our next step. Later, user studies will
inform about further steps to be taken. Moreover, the study by Fitzgerald et al [1] will be
replicated by replacing Woebot with our PICA. We believe that our ideas can inform
and advance relevant areas of research, especially in the field of personalized health.</p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgements References</title>
      <p>This work is supported by Slovenian Research Agency’s Young researchers
postgraduate research funding.
1. Fitzpatrick, K.K., Darcy, A., Vierhile, M.: Delivering Cognitive Behavior Therapy to Young
Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational
Agent (Woebot): A Randomized Controlled Trial. JMIR Mental Health 4(2), e19 (2017).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          2.
          <string-name>
            <surname>Fulmer</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Joerin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gentile</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lakerink</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rauws</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Using Psychological Artificial Intelligence (Tess) to Relieve Symptoms of Depression and Anxiety: Randomized Controlled Trial</article-title>
          .
          <source>JMIR Mental Health</source>
          <volume>5</volume>
          (
          <issue>4</issue>
          ),
          <year>e64</year>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          3.
          <string-name>
            <surname>Gjoreski</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Luštrek</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gams</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gjoreski</surname>
          </string-name>
          , H.:
          <article-title>Monitoring stress with a wrist device using context</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          <volume>73</volume>
          ,
          <fpage>159</fpage>
          -
          <lpage>170</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          4.
          <string-name>
            <surname>Leslie</surname>
            ,
            <given-names>A.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Friedman</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>German</surname>
            ,
            <given-names>T.P.</given-names>
          </string-name>
          :
          <article-title>Core mechanisms in 'theory of mind</article-title>
          .'
          <source>Trends in Cognitive Sciences</source>
          <volume>8</volume>
          (
          <issue>12</issue>
          ),
          <fpage>528</fpage>
          -
          <lpage>533</lpage>
          (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          5.
          <string-name>
            <surname>Lovibond</surname>
            ,
            <given-names>S.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lovibond</surname>
            ,
            <given-names>P.F.</given-names>
          </string-name>
          :
          <article-title>Manual for the depression anxiety stress scales</article-title>
          .
          <source>Psychology Foundation of Australia</source>
          , Sydney (
          <year>1996</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          6.
          <string-name>
            <surname>Rammstedt</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>John</surname>
            ,
            <given-names>O.P.</given-names>
          </string-name>
          :
          <article-title>Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German</article-title>
          .
          <source>Journal of Research in Personality</source>
          <volume>41</volume>
          (
          <issue>1</issue>
          ),
          <fpage>203</fpage>
          -
          <lpage>212</lpage>
          (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          7.
          <string-name>
            <surname>Sutton</surname>
            ,
            <given-names>R.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barto</surname>
            ,
            <given-names>A.G.</given-names>
          </string-name>
          :
          <article-title>Reinforcement learning: an introduction</article-title>
          , Cambridge. The MIT Press, MA (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          8.
          <string-name>
            <surname>Thaler</surname>
            ,
            <given-names>R.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sunstein</surname>
            ,
            <given-names>C.R.</given-names>
          </string-name>
          :
          <article-title>Nudge: improving decisions using the architecture of choice</article-title>
          . Yale University Press, New Haven, CT (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          9.
          <string-name>
            <surname>Twenge</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          :
          <article-title>Time Period and Birth Cohort Differences in Depressive Symptoms in the U</article-title>
          .S.,
          <year>1982</year>
          -
          <fpage>2013</fpage>
          .
          <source>Social Indicators Research</source>
          <volume>121</volume>
          (
          <issue>2</issue>
          ),
          <fpage>437</fpage>
          -
          <lpage>454</lpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          10.
          <string-name>
            <surname>Yorita</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Egerton</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oakman</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chan</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kubota</surname>
          </string-name>
          , N.:
          <article-title>A Robot Assisted Stress Management Framework: Using Conversation to Measure Occupational Stress</article-title>
          .
          <source>In: 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)</source>
          , pp.
          <fpage>3761</fpage>
          -
          <lpage>3767</lpage>
          . IEEE, New Jersey (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>