<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>PerMEASS - Personal Mental Health Virtual Assistant with Novel Ambient Intelligence Integration</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Tine Kolenik</string-name>
          <email>tine.kolenik@ijs.si</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matjazˇ Gams</string-name>
          <email>matjaz.gams@ijs.si</email>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Jozˇef Stefan Institute Jozˇef Stefan International Postgraduate School</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Jozˇef Stefan Institute Jozˇef Stefan International Postgraduate School, Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). This volume is published and copyrighted by its editors. Advances in Artificial Intelligence for Healthcare</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper describes the design for a personal mental health virtual assistant with novel ambient intelligence integration - PerMEASS. It is specifically designed to provide help for three mental health issues: stress, anxiety and depression. Its assistance in these issues is based on two very closely related and trending multidisciplinary computer science fields - persuasive technology and digital behavior change intervention, which both research ways to affect human behavior or attitudes with technology, but without coercion or deception. A short overview of such assistants focuses on three of them, which represent state of the art. PerMEASS is described in more detail and compared to state of the art to showcase how it advances the existing solutions. The focus is on two parts of PerMEASS' cognitive architecture that present novel contributions: 1) a model of the theory of mind, a cognitive ability to understand other people and act appropriately, 2) an integration with ambient intelligence - artificial intelligence in the environment - in the form of a smart bracelet. PerMEASS' theory of mind is used to build a user model and utilize mental health and behavior change ontologies to devise effective and personalized strategies. At the same time, reinforcement learning is used to evaluate the strategies in real-time and use only the ones that are successful, making PerMEASS very adaptive. PerMEASS uses a smart bracelet to achieve this goal as well. The integration of the assistant with a device to collect biophysiological data in real-time pushes the assistant technology into new, so far unexplored directions. Our future work consists of firm implementation of the design and testing it in randomized controlled trials.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 INTRODUCTION</title>
      <p>
        Virtual assistant (VA) technology is rising in its prominence through
advancements in artificial intelligence (AI), showcased by Google
and Amazon VAs. However, this field of research has also been
receiving more and more attention and financing for other, less
commercially-oriented domain use [
        <xref ref-type="bibr" rid="ref23 ref27 ref6">6, 23, 27</xref>
        ]. VAs can be described
as complex information processing agents, capable of acquiring
information, putting it into action and transmitting knowledge,
bringing together, much like cognitive science, things like perception,
intelligence, thinking, calculation, reasoning, imagining and, in the
end, conscience [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. Research on VAs has made them understand
context, adapt, learn, develop, communicate, collaborate, socialize,
anticipate, predict, perceive, act, interpret, and reason. VAs are
capable of doing that by having a cognitive architecture (CArch), a
“hypothesis about the fixed structures that provide a mind, whether
in natural or artificial systems, and how they work together – in
conjunction with knowledge and skills embodied within the
architecture – to yield intelligent behavior in a diversity of complex
environments” [1, para. 2]. VAs are deployed either as conversational agents
(aka chatbot, chatterbot, interactive agent, conversational AI,
smartbot) or robots.
      </p>
      <p>
        Another field of research in computer science that is rising in
prominence is ambient intelligence (AmI). AmI is “in essence, AI in
the environment” [11, p. 71], and it more specifically refers to
“electronic environments that are sensitive and responsive to the presence
of people,” [11, p. 76] where “one of the essential tasks of AmI is to
detect the physical, mental, emotional and other states of a user” [11,
p. 75]. AmI is usually instantiated in platforms such as smart cities,
intelligent living rooms, intelligent work places, smart public places,
smart schools and playgrounds, and in ambient care and safety. To
this end, AmI systems have to be embedded, context-aware,
personalized, adaptive, anticipatory, unobtrusive and non-invasive [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
Such systems have become readily available to the public due to the
recent technological advances in wearables that measure
biophysiological phenomena. These wearables include devices that can
measure anything from heart rate and skin conductance to movement and
respiratory rate [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>
        VA and AmI technologies are beginning to be used for mental
health (MHealth) and well-being [
        <xref ref-type="bibr" rid="ref14 ref25 ref32">14, 25, 32</xref>
        ], mostly due to the trend
of progressively larger MHealth issues. Their devastating effects on
an individual as well as on the society as a whole are only slowly
being recognized systemically. Stress, anxiety and depression (SAD)
are on the forefront of MHealth issues, with figures reaching 71%
for stress, 12% for anxiety disorder and 48% for depression [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ].
High suicide rates [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] contribute to revealing the lack of MHealth
professionals and appropriate regulations [
        <xref ref-type="bibr" rid="ref33">33</xref>
        ]. This can therefore be
an opportunity for unique technological solutions.
      </p>
      <p>
        VAs can be purposed for MHealth treatment if used as persuasive
technology (PT) [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] for digital behavior change intervention (DBCI)
[
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. DBCIs attempt to “change attitudes or behaviors or both
(without using coercion or deception)” [8, p. 20], where behavior change
(BC) signifies a temporary or permanent effect on an individual’s
behavior or attitude as compared to their past [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Using VAs for
MHealth can make an immediate impact, as they can be used
without payment (which breaks down socioeconomic barriers); they are
always online (making therapy available to anyone with a device that
has an internet connection at any time); people feel less uneasy and
anxious about sharing their feelings or personal information when
talking to a VA than to a professional or other people [
        <xref ref-type="bibr" rid="ref20 ref7">7, 20</xref>
        ]; VAs
can be accessed from remote locations, and so on. Using VAs in
the MHealth care therefore reduces burden on the existing system,
while also reducing barriers to access it. It is also important to note
that these technologies are meant to complement, rather than replace
MHealth professionals [
        <xref ref-type="bibr" rid="ref25 ref6">6, 25</xref>
        ].
      </p>
      <p>Section 2 shortly presents three MHealth VAs (MHVAs), which
represent the current state of the art (SOTA). Section 3 presents
PerMEASS in more detail, focusing on the CArch design, in order to
show how it surpasses the current SOTA. Section 4 summarizes the
work and sketches future directions.
2</p>
    </sec>
    <sec id="sec-2">
      <title>STATE OF THE ART</title>
      <p>The selection of the three SOTA MHVAs for this section was made
according to the following conditions: 1) the MHVAs were
textbased; 2) the MHVAs were researched ecologically, outside of a
laboratory; 3) the MHVAs were experimentally tested. Due to the novelty
of these technologies being used for MHealth, the pool of existing
MHVAs that satisfied our conditions was not much larger than three.</p>
      <p>Tess is a MHVA that “reduce[s] self-identified symptoms of
depression and anxiety” [9, p. 1]. It is based on having an extensive
ontology on emotions. This ontology is used on the input text from
a user to discern their mood. After mood identification, Tess uses
scripted conversations to help the user. The conversations are the
result of three of Tess’ CArch modules: a natural language
understanding module, dialogue state manager and natural language response
generator. Once Tess dispatches the help, it gathers journaling data
and user feedback to improve them. When tested, depression and
anxiety symptoms in the test group, which used Tess, were reduced
by roughly 15%, while the control group, which used official
selfhelp material, saw no change.</p>
      <p>
        Yorita, Egerton, Oakman, Chan and Kubota [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ] presented a
MHVA that teaches its users to manage stress better and thus
reduce it. Its Belief-Desire-Intention CArch has three models: “a
conversation model for acquiring state information about the individual,
measuring their stress level, a Sense of Coherence (SOC) model for
evaluating the individuals state of stress, and Peer Support model,
which uses the SOC to select a suitable peer support type and action
it” [34, p. 3762]. The MHVA uses its user model, based on
questionnaires on stress, to select a stress relief strategy. Strategies try to
teach users to improve their stress management. The experiment with
the MHVA reported that the more the subjects used the MHVA, the
more they learned to manage their stress.
      </p>
      <p>
        The last overviewed MHVA is named Woebot [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. It primarily
functions with a simple machine learning (ML) algorithm, a
“decision tree with suggested responses that accepts natural language
inputs with discrete sections of natural language processing
techniques embedded at specific points in the tree to determine routing
to subsequent conversational nodes” [7, p. 3]. Its user model has a
few data points, including data on users’ moods, goals, expectations
and similar. The user model guides Woebot’s selection of an
intervention, which can be in the form of educational videos and tailored
advice. When used in a randomized controlled trial, the test group,
which used Woebot, saw 20% SAD symptom relief, while the
control group, which used the government-approved self-help book, saw
no change.
      </p>
      <p>
        Although experimentally successful – these successes have been
reported across the board [
        <xref ref-type="bibr" rid="ref17 ref2 ref22 ref25 ref32">2, 17, 22, 25, 32</xref>
        ] – such MHVAs still
lack what PT and DBCI have to offer, especially in terms of user
modelling, personalization and adaptation as well as working with
real-time biophysiological data. This is what our research focuses on
and presents in Section 3.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>PERMEASS ARCHITECTURE DESIGN</title>
      <p>This section describes the design of PerMEASS, a personal
mental health virtual assistant with novel ambient intelligence
integration. The focus is on two parts of PerMEASS’ CArch: 1) the theory
of mind (ToM) model, whose modules form the basis for
PerMEASS’ cognition, namely understanding and helping a user; 2)
ambient intelligence integration with smart bracelet, which presents a
novel fusion of two technologies, MHVAs and AmI, thus
combining recognition powers of the latter and intervention potential of the
former. These two features are why PerMEASS surpasses the
current SOTA, which is described in Section 2, as they make the MHVA
highly adaptive and personalized.</p>
      <p>PerMEASS’ CArch design can be seen in Figure 1. The
fundamental part is labelled ‘THEORY OF MIND’ (top of the figure;
it consists of: ‘USER MODEL’, ‘EXPERT DOMAIN
KNOWLEDGE’ and the two ‘STRATEGY’ modules). In cognitive science,
ToM describes the ability to “understand the thoughts and feelings”
[18, p. 528] as well as “attributing thoughts and goals to others” [18,
p. 528]. The ToM in PerMEASS’ CArch is not as general as cognitive
science deems it, but more domain-specific in terms of its
functionality – with it, PerMEASS tries to understand a user in terms of their
MHealth issues and help them with a reasonable action – a
personalized and adaptive strategy – to solve those issues. AmI integration
happens at the bottom of Figure 1, where ‘PHYSIOLOGICAL
INPUT’ flows into ‘AFFECT RECOGNITION’ module.</p>
      <p>
        In terms of PerMEASS’ natural language processing (NLP)
capabilities, they are simple and largely subservient to ToM. Since
they are not the focus of our research, they are mostly outsourced
to existing technologies and available software. Rasa [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], an open
source conversational AI framework, is being used as one such
solution. Rasa offers NLP ML for intent classification and entity
recognition (word2vec algorithms) as well as reinforcement learning (RL)
[
        <xref ref-type="bibr" rid="ref29">29</xref>
        ] for selecting the correct dialogue nodes. However, PerMEASS
is mostly designed to be button-based, which contributes to the stated
simplicity, as there is less complexity in linguistic inputs. This also
presents a safer option in terms of control and precision for
discerning which strategy for SAD symptom relief works best for a user. The
option for certain NLP capabilities and free text options appearing at
certain nodes in the scripted conversations is being researched.
      </p>
      <p>
        The next two subsections focus on the two PerMEASS’ CArch
parts that are the basis of its capabilities: its ToM and its AmI
integration. ToM is largely based in behavioral and cognitive sciences
advances on human decision-making, BC and similar phenomena
[
        <xref ref-type="bibr" rid="ref30 ref4">4, 30</xref>
        ]. These advances are rarely considered when designing such
systems, which is what we want to leverage and endow PerMEASS
with. There does, however, seem to be a trend in recognizing benefits
of such multi- and interdisciplinary efforts, as PTs are being
progressively used to help, motivate and guide people towards well-being
[
        <xref ref-type="bibr" rid="ref16 ref24">16, 24</xref>
        ]. Using behavioral and cognitive sciences knowledge in
PerMEASS should therefore prove to be crucial for its success.
3.1
      </p>
    </sec>
    <sec id="sec-4">
      <title>Model of the theory of mind in PerMEASS</title>
      <p>PerMEASS’ ToM consists of three larger subparts (see Figure 1):
the user model (‘USER MODEL’), a module with ontologies on
expert and domain knowledge (‘EXPERT DOMAIN
KNOWLEDGE’), and modules on strategy selection (‘STRATEGY
SELECTION MODULE’) and adaptation (‘STRATEGY ADAPTATION
MODULE’). These are described in depth below.
3.1.1</p>
      <sec id="sec-4-1">
        <title>User Model</title>
        <p>
          The user model [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] is an essential part of PerMEASS to effectively
dispatch its strategies. These range from passively – when the user is
not actively conversing with PerMEASS – delivered nudges, which
are “any aspect of the choice architecture that alters people’s
behavior in a predictable way without forbidding any options” [30, p. 6],
to active in-conversation help. For increased rates of success,
PerMEASS continually updates a model of its user. It dialogically
delivers a questionnaire on the Big Five personality traits (B5) [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ],
which model the user’s personality. The Big 5 model of a user is
a global aspect of the user model, meaning that it is not changing
or updating. For local – or continuously updating – aspects of the
user model, SAD scores are the most important. They are determined
through the Depression Anxiety Stress Scales 21 questionnaire [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ],
which measures short-term SAD. These scores get regularly updated
through continuous posing of the questionnaire. Sentiment analysis
also presents a dimension in the user model, used for discerning
emotional valence. Collecting data on other user dimensions is being
considered as well.
3.1.2
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Expert and Domain Knowledge</title>
        <p>
          The expert and domain knowledge module is made of various
ontologies. This means that the knowledge on emotions, BC and SAD
is, through rules, transformed into a computer-readable language.
Ontological relations then serve other VA’s functions that can use
them. PerMEASS uses the expert and domain knowledge module,
which utilizes the user model, to personalize its behavior and
tailor its strategies to the user: B5 is used to personalize the messages
PerMEASS dispatches (e.g., the dominant B5 dimension of a user
guides the strategy selection [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]); the ontology on emotions is used
in connection with the local aspects of the user model to guide the
conversation (see Tess in Section 2); the SAD knowledge determines
the SAD severity and type for selecting the correct thematic strategy
(e.g., self-education on the SAD type); the most helpful form of BC
is selected, which ranges from self-reflection (that, e.g., comes from
monitoring) to tailored emotion elicitation [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ].
3.1.3
        </p>
      </sec>
      <sec id="sec-4-3">
        <title>Strategy Selection and Adaptation</title>
        <p>
          Strategy selection for dispatching tailored help to the user is largely
based on the latter’s B5 profile, but also on SAD scores. B5 is one
of the most stable psychological and cognitive constructs, highly
reproduced and successful in determining the right kind of influence on
specific personalities [
          <xref ref-type="bibr" rid="ref15 ref26">15, 26</xref>
          ]. This makes it fundamental for strategy
selection. The expert and domain knowledge module provides
multiple different strategies that compete with each other for deployment.
They have to contend according to multiple criteria [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] for selection.
However, this is only one part of how the strategies are dependent
on the user. The other mechanism for strategies is their adaptation,
which is dependent on their success in certain timespan with a certain
user. ML, namely RL [
          <xref ref-type="bibr" rid="ref29">29</xref>
          ], enables PerMEASS to learn from its
historical interactions and conversations with its users to discern which
strategies work better and which do not work. If the strategy selection
is a top-down approach, dependent on our knowledge and
presuppositions on what works with certain psychological and cognitive
profiles, this adaptive approach is a bottom-up process. Combined, they
form a powerful capability to discern the most effective strategies.
Currently, the main problem of strategy adaptation with RL is
determining the reward function in the algorithm. The reward function in
PerMEASS’ RL algorithm is represented by the SAD score as well
as the length of the time that it takes to evaluate a certain strategy and
whether it works (meaning it helps the user). Since timespan
evaluation is difficult and becomes accurate only when not using short-term
strategies, only some strategies can work from this bottom-up aspect.
Experiments and user studies are planned to determine the timespan
threshold of strategies as well as to select the strategies for RL usage.
        </p>
        <p>The three modules that form ToM are a fruitful testing ground for
fusing MHVA technology with AmI. Integrating PerMEASS with
AmI, namely connecting a smart bracelet to be part of its ‘cognition’,
can be beneficial and enhance existing functionalities to a new level.
3.2</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Ambient Intelligence Integration</title>
      <p>
        A smart bracelet – specifically, Empatica [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] is being tested –
provides PerMEASS with biophysiological measurements (e.g., heart
rate, sweating rate and skin temperature). These measurements are
used for automatic monitoring of SAD [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. The bracelet readings
are fed into a neural network to build a model that can predict a user’s
SAD symptoms, which eliminates the need for PerMEASS to pose
the SAD questionnaire or at least lower the frequency of it being
posed, improving the user experience. Therefore, the user model is
updated with SAD scores in real time and continuously. To establish
such a process, the SAD model is built in the following way: when
the measurements start, the SAD answers from the questionnaire are
used to label the biophysiological data from the smart bracelet. The
accuracy of the model is dependent on the amount of data, so through
time, enough data results in personalized ML models that become
accurate enough to predict SAD scores. The affect recognition module
(‘AFFECT RECOGNITION’ in Figure 1) is used for this
PerMEASS’ capability.
      </p>
      <p>With such a model, the smart bracelet can be used to improve
nudging. Nudges can be utilized at times that most benefit the user.
When the user model reflects certain real-time SAD scores, a nudge
can be dispatched as a passive intervention (which means that the
user will not have to use PerMEASS actively to receive help).
4</p>
    </sec>
    <sec id="sec-6">
      <title>CONCLUSION</title>
      <p>This paper outlines PerMEASS, a personal mental health virtual
assistant with novel ambient intelligence integration. We show, through
overviewing SOTA MHVA systems, how PerMEASS advances
current state of the art in this field. We believe that PerMEASS achieves
that with: 1) modelling ToM, a cognitive ability to understand and
properly act in social interactions with people, and 2) introducing a
novel fusion between two technologies, MHVAs and AmI, through
integrating a smart bracelet into PerMEASS’ CArch. ToM consists
of: a user model with SAD, global and local user data; a RL algorithm
to model historical interactions between PerMEASS and the user,
thus reasoning on which strategies work and which do not; so far
inexistent ontologies, especially on BC and SAD. PerMEASS also
represents a technological fusion between MHVA and AmI, which
we have not come across in the existing literature yet, and we want to
continue exploring this novel symbiosis. Combining ToM and AmI
integration results in an effective way of selecting and adapting
multiple strategies for help in people with SAD symptoms.</p>
      <p>
        In our next steps, we plan to make the final implementation [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ] of
PerMEASS as described. User studies and experiments will be
carried out to test PerMEASS in an ecological environment – Fitzgerald
et al [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] study will be replicated by replacing Woebot with
PerMEASS – as well as to find out how to improve PerMEASS in other
aspects.
      </p>
      <p>Using AI as PT in the personalized health and well-being domain
should be, in our belief, a societal priority. This makes relevant
research important, and we feel that our ideas can contribute to
realizing the promise the MHVA technology is exhibiting.</p>
    </sec>
    <sec id="sec-7">
      <title>ACKNOWLEDGEMENTS</title>
      <p>This work is supported by Slovenian Research Agency’s Young
researchers postgraduate research funding.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <article-title>[1] Cognitive architecture</article-title>
          . http://cogarch.ict.usc.edu/. Accessed:
          <fpage>2020</fpage>
          -05- 30.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>David</given-names>
            <surname>Bakker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Nikolaos</given-names>
            <surname>Kazantzis</surname>
          </string-name>
          , Debra Rickwood, and Nikki Rickard, '
          <article-title>Mental health smartphone apps: Review and evidence-based recommendations for future developments'</article-title>
          ,
          <source>JMIR Mental Health</source>
          ,
          <volume>3</volume>
          (
          <issue>1</issue>
          ),
          <year>e7</year>
          , (
          <year>Mar 2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Tom</given-names>
            <surname>Bocklisch</surname>
          </string-name>
          , Joey Faulkner, Nick Pawlowski, and Alan Nichol, 'Rasa:
          <article-title>Open source language understanding and dialogue management'</article-title>
          , CoRR, abs/1712.05181, (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Rachel</given-names>
            <surname>Carey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Lauren</given-names>
            <surname>Connell</surname>
          </string-name>
          , Marie Johnston, Alexander Rothman, Marijn Bruin,
          <string-name>
            <given-names>Michael</given-names>
            <surname>Kelly</surname>
          </string-name>
          , and Susan Michie, '
          <article-title>Behavior change techniques and their mechanisms of action: A synthesis of links described in published intervention literature'</article-title>
          ,
          <source>Annals of Behavioral Medicine</source>
          ,
          <volume>53</volume>
          ,
          <fpage>693</fpage>
          -
          <lpage>707</lpage>
          , (10
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S. C.</given-names>
            <surname>Curtin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Warner</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Hedegaard</surname>
          </string-name>
          , '
          <article-title>Increase in Suicide in the United States,</article-title>
          <year>1999</year>
          -
          <fpage>2014</fpage>
          ',
          <string-name>
            <given-names>NCHS</given-names>
            <surname>Data</surname>
          </string-name>
          <string-name>
            <surname>Brief</surname>
          </string-name>
          , (
          <volume>241</volume>
          ),
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          , (Apr
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Ahmed</given-names>
            <surname>Fadhil</surname>
          </string-name>
          and Gianluca Schiavo, '
          <article-title>Designing for health chatbots'</article-title>
          , arXiv, (
          <year>1902</year>
          .09022), (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Kathleen</given-names>
            <surname>Kara</surname>
          </string-name>
          <string-name>
            <surname>Fitzpatrick</surname>
          </string-name>
          , Alison Darcy, and Molly Vierhile, '
          <article-title>Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (woebot): A randomized controlled trial'</article-title>
          ,
          <source>JMIR Ment Health</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ),
          <year>e19</year>
          , (
          <year>Jun 2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>B.J.</given-names>
            <surname>Fogg</surname>
          </string-name>
          , Persuasive Technology:
          <article-title>Using Computers to Change What We Think and Do</article-title>
          , Morgan Kaufmann Publishers Inc., San Francisco, CA, USA,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Russell</given-names>
            <surname>Fulmer</surname>
          </string-name>
          , Angela Joerin, Breanna Gentile, Lysanne Lakerink, and Michiel Rauws, '
          <article-title>Using psychological artificial intelligence (tess) to relieve symptoms of depression and anxiety: Randomized controlled trial'</article-title>
          ,
          <source>JMIR Ment Health</source>
          ,
          <volume>5</volume>
          (
          <issue>4</issue>
          ),
          <year>e64</year>
          , (
          <year>Dec 2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>M.</given-names>
            <surname>Gamg</surname>
          </string-name>
          , Weak Intelligence:
          <article-title>Through the Principle and Paradox of Multiple Knowledge, Nova Science Pub Inc</article-title>
          , New York, USA,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Matjaz</surname>
            <given-names>Gams</given-names>
          </string-name>
          , Irene Gu, Aki Ha¨rma¨,
          <source>Andre´s Mun˜oz, and Vincent Tam, 'Artificial intelligence and ambient intelligence'</source>
          ,
          <source>Journal of Ambient Intelligence and Smart Environments</source>
          ,
          <volume>11</volume>
          ,
          <fpage>71</fpage>
          -
          <lpage>86</lpage>
          , (01
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Garbarino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Lai</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Bender</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. W.</given-names>
            <surname>Picard</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Tognetti</surname>
          </string-name>
          , '
          <article-title>Empatica e3 - a wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition'</article-title>
          ,
          <source>in 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH)</source>
          , pp.
          <fpage>39</fpage>
          -
          <lpage>42</lpage>
          , (
          <year>Nov 2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Suparna</surname>
            <given-names>Ghanvatkar</given-names>
          </string-name>
          , Atreyi Kankanhalli, and Vaibhav Rajan, '
          <article-title>User models for personalized physical activity interventions: Scoping review'</article-title>
          ,
          <source>JMIR Mhealth Uhealth</source>
          ,
          <volume>7</volume>
          (
          <issue>1</issue>
          ),
          <year>e11098</year>
          , (
          <year>Jan 2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Martin</surname>
            <given-names>Gjoreski</given-names>
          </string-name>
          , Mitja Lusˇtrek, Matjazˇ Gams, and Hristijan Gjoreski, '
          <article-title>Monitoring stress with a wrist device using context'</article-title>
          ,
          <source>Journal of Biomedical Informatics</source>
          ,
          <volume>73</volume>
          ,
          <fpage>159</fpage>
          -
          <lpage>170</lpage>
          , (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Jacob</surname>
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Hirsh</surname>
          </string-name>
          ,
          <string-name>
            <surname>Sonia K. Kang</surname>
          </string-name>
          , and
          <string-name>
            <surname>Galen</surname>
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Bodenhausen</surname>
          </string-name>
          , '
          <article-title>Personalized persuasion: Tailoring persuasive appeals to recipients' personality traits'</article-title>
          ,
          <source>Psychological Science</source>
          ,
          <volume>23</volume>
          (
          <issue>6</issue>
          ),
          <fpage>578</fpage>
          -
          <lpage>581</lpage>
          , (
          <year>2012</year>
          ). PMID:
          <volume>22547658</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Catriona</surname>
            <given-names>M Kennedy</given-names>
          </string-name>
          , John Powell, Thomas H Payne, John Ainsworth, Alan Boyd, and Iain Buchan, '
          <article-title>Active assistance technology for healthrelated behavior change: An interdisciplinary review'</article-title>
          ,
          <source>J Med Internet Res</source>
          ,
          <volume>14</volume>
          (
          <issue>3</issue>
          ),
          <year>e80</year>
          , (
          <year>Jun 2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>L.</given-names>
            <surname>Laranjo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. G.</given-names>
            <surname>Dunn</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. L.</given-names>
            <surname>Tong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. B.</given-names>
            <surname>Kocaballi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Bashir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Surian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Gallego</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Magrabi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. Y. S.</given-names>
            <surname>Lau</surname>
          </string-name>
          , and E. Coiera, '
          <article-title>Conversational agents in healthcare: a systematic review'</article-title>
          ,
          <source>J Am Med Inform Assoc</source>
          ,
          <volume>25</volume>
          (
          <issue>9</issue>
          ),
          <fpage>1248</fpage>
          -
          <lpage>1258</lpage>
          , (09
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Alan</surname>
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Leslie</surname>
          </string-name>
          , Ori Friedman, and Tim P. German, '
          <article-title>Core mechanisms in 'theory of mind”</article-title>
          ,
          <source>Trends in Cognitive Sciences</source>
          ,
          <volume>8</volume>
          (
          <issue>12</issue>
          ),
          <fpage>528</fpage>
          -
          <lpage>533</lpage>
          , (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>S.H.</given-names>
            <surname>Lovibond</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.F.</given-names>
            <surname>Lovibond</surname>
          </string-name>
          ,
          <article-title>Manual for the Depression Anxiety Stress Scales, Psychology Foundation monograph</article-title>
          ,
          <source>Psychology Foundation of Australia</source>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Gale</surname>
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Lucas</surname>
            , Jonathan Gratch,
            <given-names>Aisha</given-names>
          </string-name>
          <string-name>
            <surname>King</surname>
          </string-name>
          , and
          <string-name>
            <surname>Louis-Philippe</surname>
            <given-names>Morency</given-names>
          </string-name>
          , '
          <article-title>It's only a computer: Virtual humans increase willingness to disclose'</article-title>
          ,
          <source>Computers in Human Behavior</source>
          ,
          <volume>37</volume>
          ,
          <fpage>94</fpage>
          -
          <lpage>100</lpage>
          , (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>D. C.</given-names>
            <surname>Mohr</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. N.</given-names>
            <surname>Burns</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. M.</given-names>
            <surname>Schueller</surname>
          </string-name>
          , G. Clarke, and
          <string-name>
            <given-names>M.</given-names>
            <surname>Klinkman</surname>
          </string-name>
          , '
          <article-title>Behavioral intervention technologies: evidence review and recommendations for future research in mental health'</article-title>
          ,
          <source>Gen Hosp Psychiatry</source>
          ,
          <volume>35</volume>
          (
          <issue>4</issue>
          ),
          <fpage>332</fpage>
          -
          <lpage>338</lpage>
          , (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>Joao</given-names>
            <surname>Luis Zeni Montenegro</surname>
          </string-name>
          ,
          <article-title>Cristiano Andre´ da Costa, and Rodrigo da Rosa Righi, 'Survey of conversational agents in health'</article-title>
          ,
          <source>Expert Systems with Applications</source>
          ,
          <volume>129</volume>
          ,
          <fpage>56</fpage>
          -
          <lpage>67</lpage>
          , (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>J.</given-names>
            <surname>Oakley</surname>
          </string-name>
          .
          <article-title>Intelligent cognitive assistants (ica).</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>Rita</given-names>
            <surname>Orji</surname>
          </string-name>
          and Karyn Moffatt, '
          <article-title>Persuasive technology for health and wellness: State-of-the-art and emerging trends'</article-title>
          ,
          <source>Health Informatics Journal</source>
          ,
          <volume>24</volume>
          (
          <issue>1</issue>
          ),
          <fpage>66</fpage>
          -
          <lpage>91</lpage>
          , (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>S.</given-names>
            <surname>Provoost</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. M.</given-names>
            <surname>Lau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Ruwaard</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Riper</surname>
          </string-name>
          , '
          <article-title>Embodied Conversational Agents in Clinical Psychology: A Scoping Review'</article-title>
          ,
          <string-name>
            <given-names>J. Med. Internet</given-names>
            <surname>Res</surname>
          </string-name>
          .,
          <volume>19</volume>
          (
          <issue>5</issue>
          ),
          <year>e151</year>
          , (
          <year>05 2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>Beatrice</given-names>
            <surname>Rammstedt and Oliver P. John</surname>
          </string-name>
          , '
          <article-title>Measuring personality in one minute or less: A 10-item short version of the big five inventory in english and german'</article-title>
          ,
          <source>Journal of Research in Personality</source>
          ,
          <volume>41</volume>
          (
          <issue>1</issue>
          ),
          <fpage>203</fpage>
          -
          <lpage>212</lpage>
          , (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>A.</given-names>
            <surname>Sheth</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. Y.</given-names>
            <surname>Yip</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Shekarpour</surname>
          </string-name>
          , '
          <article-title>Extending patient-chatbot experience with internet-of-things and background knowledge: Case studies with healthcare applications'</article-title>
          ,
          <source>IEEE Intelligent Systems</source>
          ,
          <volume>34</volume>
          (
          <issue>4</issue>
          ),
          <fpage>24</fpage>
          -
          <lpage>30</lpage>
          , (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>Ian</surname>
            <given-names>Sommerville</given-names>
          </string-name>
          , Software Engineering, Addison-Wesley, Harlow, England,
          <volume>9</volume>
          <fpage>edn</fpage>
          .,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <surname>Richard</surname>
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Sutton</surname>
            and
            <given-names>Andrew G.</given-names>
          </string-name>
          <string-name>
            <surname>Barto</surname>
          </string-name>
          ,
          <source>Reinforcement Learning: An Introduction</source>
          , The MIT Press, second edn.,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>R.H.</given-names>
            <surname>Thaler</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.R.</given-names>
            <surname>Sunstein</surname>
          </string-name>
          , Nudge: Improving Decisions about Health, Wealth, and
          <string-name>
            <surname>Happiness</surname>
          </string-name>
          , Yale University Press,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <surname>Jean</surname>
            <given-names>Twenge</given-names>
          </string-name>
          , '
          <article-title>Time Period and Birth Cohort Differences in Depressive Symptoms in the U</article-title>
          .S.,
          <year>1982</year>
          -
          <fpage>2013</fpage>
          ', Social Indicators Research:
          <article-title>An International and Interdisciplinary Journal for Quality-of-</article-title>
          <string-name>
            <surname>Life</surname>
            <given-names>Measurement</given-names>
          </string-name>
          ,
          <volume>121</volume>
          (
          <issue>2</issue>
          ),
          <fpage>437</fpage>
          -
          <lpage>454</lpage>
          , (
          <year>April 2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>A. N.</given-names>
            <surname>Vaidyam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Wisniewski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Halamka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. S.</given-names>
            <surname>Kashavan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. B.</given-names>
            <surname>Torous</surname>
          </string-name>
          , '
          <article-title>Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape'</article-title>
          ,
          <source>Can J Psychiatry</source>
          ,
          <volume>64</volume>
          (
          <issue>7</issue>
          ),
          <fpage>456</fpage>
          -
          <lpage>464</lpage>
          , (07
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>P.</given-names>
            <surname>Winkler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Krupchanka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Roberts</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Kondratova</surname>
          </string-name>
          , V. Mach?,
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>H?schl</article-title>
          , N. Sartorius,
          <string-name>
            <given-names>R. Van</given-names>
            <surname>Voren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Aizberg</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Bitter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>CergaPashoja</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Deljkovic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Fanaj</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Germanavicius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Hinkov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hovsepyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. N.</given-names>
            <surname>Ismayilov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. S.</given-names>
            <surname>Ivezic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Jarema</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Jordanova</surname>
          </string-name>
          , S. Kuki?,
          <string-name>
            <given-names>N.</given-names>
            <surname>Makhashvili</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. N.</given-names>
            ?
            <surname>arotar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Plevachuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Smirnova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. I.</given-names>
            <surname>Voinescu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vrublevska</surname>
          </string-name>
          , and G. Thornicroft, '
          <article-title>A blind spot on the global mental health map: a scoping review of 25 years' development of mental health care for people with severe mental illnesses in central and eastern Europe'</article-title>
          ,
          <source>Lancet Psychiatry</source>
          ,
          <volume>4</volume>
          (
          <issue>8</issue>
          ),
          <fpage>634</fpage>
          -
          <lpage>642</lpage>
          , (08
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>A.</given-names>
            <surname>Yorita</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Egerton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Oakman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Chan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N.</given-names>
            <surname>Kubota</surname>
          </string-name>
          , '
          <article-title>A robot assisted stress management framework: Using conversation to measure occupational stress'</article-title>
          ,
          <source>in 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)</source>
          , pp.
          <fpage>3761</fpage>
          -
          <lpage>3767</lpage>
          , (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>