<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Psychology: journal of higher school of economy</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Elomia Chatbot: the Effectiveness of Artificial Intelligence in the Fight for Mental Health</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Oleksandr Romanovskyi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nina Pidbutska</string-name>
          <email>podbutskaya_nina@ukr.net</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Anastasiia Knysh</string-name>
          <email>n_knysh@ukr.net</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mixed</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>National technical university “Kharkiv polytechnic institute”</institution>
          ,
          <addr-line>Kyrpychova str. 2, Kharkiv, 61002</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2014</year>
      </pub-date>
      <volume>13</volume>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>The article is presenting results of controlled study of effectiveness of Elomia chatbot in reducing tendency to depression, anxiety and negative emotional effects. Elomia developed using artificial intelligence technologies. In the process of developing a chatbot following technologies were used: RoBERTa(NER) for identification names and locations; COSMIC for identification of human emotions; DIALOGPT for answers generation; DistilBERT (SQuAD) for pointing the most relevant information in the script; GECToR for spelling check. Elomia is able to identify the main psychological problems of the client and offer him the most suitable support option using first aid techniques and cognitive-behavioral psychotherapy. To check the effectiveness of the chatbot it was conducted a study that included three stages: 1) the formation of experimental and control samples; 2) baseline testing; 3) final testing. The study used psychological research methods: 1) Patient Health Questionnaire-9 (PHQ-9) to diagnose a tendency to depression; 2) General Anxiety Disorder7 (GAD-7) to diagnose a tendency to generalized anxiety disorder; 3) Positive and Negative Affect Schedule (PANAS) to diagnose of prevailing (positive / negative) emotional affects. 412 volunteers (202 women, 210 men, ages 19 to 23 years old) who identified their tendency to depression, anxiety and low mood were selected in students social networks groups of Kharkiv region as participants of research. It was found that regular usage of Elomia contributes to a significant reduction in the high tendency to depression (up to 28%), anxiety (up to 31%), and negative affects (up to 15%). Chatbot, artificial intelligence, depression, anxiety, negative states correction, mental health.</p>
      </abstract>
      <kwd-group>
        <kwd>Keywords1</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Depression and anxiety are the two most common disorders that seriously affect the quality of life
of people of different age and social groups. The prevalence of anxiety and depression problems is
evidenced by WHO data, as well as an increasing number of studies on this issue [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In recent years,
scientists have revised the tools for diagnosing anxiety and depression [
        <xref ref-type="bibr" rid="ref2 ref3 ref4">2, 3, 4</xref>
        ], and ways to prevent
and treat them [
        <xref ref-type="bibr" rid="ref5 ref6 ref7">5, 6, 7</xref>
        ], the influence of anxiety and depression on the quality of life of individual age
and social groups [
        <xref ref-type="bibr" rid="ref2 ref8">2, 8</xref>
        ].
image.
      </p>
      <p>The consequences of depressive and anxious conditions are particularly painful for people who are
going through age-related crises and experience reassessment of their own values and changes in
self</p>
      <p>Depressive and anxiety disorders spectrum include: F31 Bipolar disorder, F32 Major depressive</p>
      <p>2021 Copyright for this paper by its authors.
the WHO, about 16% of all mental illnesses on the planet are caused by disorders of the
anxietydepressive spectrum.</p>
      <p>Moreover, hundreds of thousands of people around the world suffer from the so-called
“precursors” of such disorders: increased levels of situational anxiety, low mood, anhedonia, feelings
of loneliness, acute dissatisfaction with interpersonal relationships. People who suffer with these
issues rarely seek help from psychotherapists, psychologists and counselors. They even tend to hide
their emotional struggling from loved ones. Long-term attempts to cope with such experiences
without outside help often have negative consequences for mental health, which results in the
occurrence of disorders of the anxiety-depressive spectrum.</p>
      <p>People of the described group need additional support, which can be provided by “conversational”
services based on artificial intelligence and psychology techniques.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Elomia</title>
    </sec>
    <sec id="sec-3">
      <title>3. Research design</title>
      <p>Statistical analysis with usage of chi-square criterion confirmed the equality of the subjects
distributions by age and gender (no significant differences in the distribution of data were found).</p>
      <p>Among selected participants there were: 13,41% with tendency to mild, 47,56% with tendency to
moderate, 18,29% with tendency to moderate severe and 20,73% with tendency to severe depression;
18,29% with tendency to moderate and 81,7% with tendency to severe anxiety.</p>
      <p>The obtained groups were once again checked for compliance with the selection criteria of
respondents (table 2).</p>
      <p>PHQ-9
GAD-7</p>
      <sec id="sec-3-1">
        <title>Positive affect Negative affect</title>
        <p>The data in the table clearly show that the average indicator of depression in the experimental and
control group corresponds to the indicators of tendency to moderate (10-14 points) depression; the
average anxiety score corresponds to a tendency to a severe (15-21 points) level of anxiety; the
average indicator of tendency to negative affects corresponds to a moderate level (20-40 points); the
average indicator of the tendency to positive affects corresponds to a moderate level (20-40 points).</p>
        <p>A comparison was also made of the average indicators of the respondents of the two groups using
the T-test for independent samples on the level of tendency to anxiety, depression and emotional
affects (table 3).
95% Confidence</p>
      </sec>
      <sec id="sec-3-2">
        <title>Interval of the</title>
      </sec>
      <sec id="sec-3-3">
        <title>Difference Lower -1.549 -1.207</title>
        <p>The obtained results of the T-test indicate the absence of significant differences in the level of the
studied characteristics at the first stage of the study.</p>
        <p>After the completion of baseline testing, the respondents of the experimental group were given
unlimited access to Elomia chatbot for 4 weeks. Respondents were instructed that they can use Elomia
at any time of the day to the extent that they need. Thus, each participant in the study had the
opportunity to control the amount of communication with Elomia, depending on their needs.</p>
        <p>Respondents in the control group were asked to use the Depression self-help guide developed by
The National Health Service of the United Kingdom to correct negative emotional states [12]. This
guide also contains a set of cognitive-behavioral techniques that help to deal with non-adaptive
thoughts and to reduce anxiety and depression. Respondents were instructed that they can contact the
guide at any time when they feel the need for it without restrictions.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Research results</title>
      <p>As a result of a survey after 4 weeks of the study it was revealed that the respondents of the
experimental group used chatbot with different frequencies and intensities (Figure 1).</p>
      <sec id="sec-4-1">
        <title>Never used 2%</title>
      </sec>
      <sec id="sec-4-2">
        <title>Once per week 22%</title>
      </sec>
      <sec id="sec-4-3">
        <title>2 times per week 45%</title>
      </sec>
      <sec id="sec-4-4">
        <title>Every day 14%</title>
      </sec>
      <sec id="sec-4-5">
        <title>4-5 times per week 17% Figure 1: Frequency of Elomia usage in Experimental Group</title>
        <p>Retesting was performed in study groups 4 weeks after the baseline. To identify changes in the
level of anxiety and depression in the study groups the T-test for paired samples was conducted
separately in the experimental (table 4) and control (table 5) study groups.</p>
      </sec>
      <sec id="sec-4-6">
        <title>Mean 9.380 13.476 -7.023</title>
        <p>95% Confidence</p>
      </sec>
      <sec id="sec-4-7">
        <title>Interval of the</title>
      </sec>
      <sec id="sec-4-8">
        <title>Difference Lower 7.762 Upper</title>
        <p>16.880
8.396
0.00</p>
        <p>T-test showed significant differences in all study indicators. This means that users of Elomia after
4 weeks of its usage noted a significant decrease in the symptom of anxiety, depression and negative
affects. Moreover, there is an increase in positive affects, which manifests itself in a more calm,
balanced state, high self-esteem, confidence in the future.</p>
        <p>The participants in the experimental group noted that after using Elomia, they became calmer,
more self-confident. Many noted that they have become less likely to experience aggression towards
others, fear, sense of hopelessness. More than 70% of the participants noted that they returned to
using the chatbot in moments of increased anxiety, panic attack, self-doubt, loneliness.
95% Confidence</p>
      </sec>
      <sec id="sec-4-9">
        <title>Interval of the</title>
      </sec>
      <sec id="sec-4-10">
        <title>Difference Lower -1.469 -0.012</title>
        <p>A similar comparison made in the control group did not detect significant statistical shifts, which
indicates the inefficiency of introspection methods in dealing with signs of depression, anxiety and
negative affects compared to using Elomia chatbot.</p>
        <p>Comparison of the average indicators of depression tendency in the experimental and control
groups allows us to evaluate the effect of the work of respondents with Elomia chatbot. So, after 4
weeks of using the chatbot the average indicator of depression tendency moved from the “Moderate
Depression” zone to the “Mild Depression” zone, while in the control group it remained at the same
level.</p>
        <p>The main reason for such results is that Elomia does not immerse the client in dull and lonely
thoughts. On the contrary, it creates the conditions for self-disclosure of the person, gives the
opportunity to speak out. In addition, the techniques presented in the application allow a person with
depressive tendencies to reduce stress levels and feel a positive attitude towards themselves.
30.00
20.00
10.00</p>
      </sec>
      <sec id="sec-4-11">
        <title>Baseline</title>
      </sec>
      <sec id="sec-4-12">
        <title>4 weeks later</title>
      </sec>
      <sec id="sec-4-13">
        <title>Experimental group</title>
      </sec>
      <sec id="sec-4-14">
        <title>Control group Figure 3: Comparison of means in anxiety level in experimental and control group</title>
        <p>The average indicator of tendency to anxiety in the experimental group moved from a zone of
severe to a zone of moderate anxiety. In the control group the anxiety rate remained as high as during
the baseline testing.</p>
        <p>These results are associated with the systematic use of grounding techniques that AI offers to
anxious clients. While in a state of anxiety, a person often becomes obsessed with unproductive
experiences and thoughts that prevent him from finding contact with a calming reality. Grounding
techniques allow a person to return to reality through simple, repetitive actions (drawing, creating
shapes with simple objects). Elomia allows clients to use these techniques on their own in times of
anxiety or fear.</p>
        <p>PANAS (Positive affect)</p>
        <p>The tendency to negative affects in the experimental group decreased, while in the control group
remained unchanged.</p>
        <p>The participants in the experimental group, after using the chatbot, stopped experiencing fear,
nervousness, shame and distress as the leading emotions. In addition, there was a decrease in
emotions such as irritability, guilt and hostility. Respondents noted that a decrease in negative
experiences led to better relationships with family and friends, which in turn created an additional
circle of psychological support around them. Thus, the use of the chatbot contributed not only to the
reduction of negative feelings directed by a person towards himself, but also the manifestation of
negative emotions directed to others.</p>
        <p>PHQ-9</p>
        <p>GAD-7</p>
      </sec>
      <sec id="sec-4-15">
        <title>PANAS (Positive affect)</title>
      </sec>
      <sec id="sec-4-16">
        <title>PANAS (Negative affect)</title>
      </sec>
      <sec id="sec-4-17">
        <title>Experimental</title>
      </sec>
      <sec id="sec-4-18">
        <title>Group</title>
      </sec>
      <sec id="sec-4-19">
        <title>Control Group Figure 6: Comparison of changes in highest level of study indicators (%)</title>
        <p>During the final interview, the respondents who used the chatbot noted that during communication
they became more self-confident, started to understand life problems differently, began to think about
how they live, felt “the ground under their feet”.</p>
        <p>As the most significant change, participants noted the change in the outlook on the world around
them as more positive, friendly and filled with resources. Having received support from the chatbot,
the participants realized that it was not a shame to ask for help and it was absolutely normal, which
took their thinking out of a dead corner.</p>
        <p>Respondents in the control group also noted the usefulness of the depression self-help guide. But
they also pointed out that in the process of reading the manual they had questions and ideas that they
had no one to discuss with, and attempts to introduce changes into their lives without outside support
came up against resistance from relatives. The inability to bring changes to life reduced the
motivation to re-visit the guide and increased the overall level of frustration and self-discontent.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions</title>
      <p>Regular usage of Elomia contributes to a significant reduction in the high tendency to depression
(up to 28%), anxiety (up to 31%), and negative affects (up to 15%). This reduction is achieved
through the use of "conversational therapy" with elements of cognitive-behavioral techniques. At the
same time usage of such techniques without a conversational elements does not lead to significant
changes in the emotional state of clients within the indicated time frames.</p>
      <p>Elomia is a powerful tool for providing first aid to people suffering from anxiety and depression.
Its systematic use can reduce the level of negative affects. It is important to note that it cannot act as a
full-fledged substitute for psychotherapy or medical treatment for depression. Rather, it reduces the
chances of the person using it to experience serious mental illness.</p>
    </sec>
    <sec id="sec-6">
      <title>6. References</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Depression</surname>
          </string-name>
          ,
          <year>2020</year>
          . URL: https://www.who.int/news-room/fact-sheets/detail/depression. Accessed on:
          <source>February 22</source>
          ,
          <year>2021</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.</given-names>
            <surname>Biaggi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Conroy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Pawlby</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Pariante</surname>
          </string-name>
          ,
          <article-title>"Identifying the women at risk of antenatal anxiety and depression: A systematic review"</article-title>
          ,
          <source>Journal of Affective Disorders</source>
          , volume
          <volume>191</volume>
          ,
          <year>2015</year>
          , pp.
          <fpage>62</fpage>
          -
          <lpage>77</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.jad.
          <year>2015</year>
          .
          <volume>11</volume>
          .014.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.</given-names>
            <surname>Chisholm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Sweeny</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Sheehan</surname>
          </string-name>
          et al.,
          <article-title>"Scaling-up treatment of depression and anxiety: a global return on investment analysis"</article-title>
          ,
          <source>Lancet Psychiatry</source>
          , volume
          <volume>3</volume>
          ,
          <year>2016</year>
          , pp.
          <fpage>415</fpage>
          -
          <lpage>424</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>K.</given-names>
            <surname>Kroenke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Baye</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S. G.</given-names>
            <surname>Lourens</surname>
          </string-name>
          ,
          <article-title>"Comparative validity and responsiveness ofPHQADS and other composite anxiety-depression measures"</article-title>
          ,
          <source>Journal of Affective Disorders</source>
          , volume
          <volume>246</volume>
          ,
          <year>2019</year>
          , pp.
          <fpage>437</fpage>
          -
          <lpage>443</lpage>
          . https://doi.org/10.1016/j.jad.
          <year>2018</year>
          .
          <volume>12</volume>
          .098.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>V.</given-names>
            <surname>Brenninkmeijer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. E.</given-names>
            <surname>Lagerveld</surname>
          </string-name>
          , R. W. B. Blonket al.,
          <article-title>"Predicting the Effectiveness of Work-Focused CBT for Common Mental Disorders: The Influence of Baseline Self-Efficacy, Depression and Anxiety"</article-title>
          ,
          <source>Journal of Occupational Rehabilitation</source>
          , volume
          <volume>29</volume>
          ,
          <year>2019</year>
          , pp.
          <fpage>31</fpage>
          -
          <lpage>41</lpage>
          . https://doi.org/10.1007/s10926-018-9760-3.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J.</given-names>
            <surname>Firth</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Marx</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Dash</surname>
          </string-name>
          et al.,
          <article-title>"The Effects of Dietary Improvement on Symptoms of Depression and Anxiety: A Meta-Analysis of Randomized Controlled Trials"</article-title>
          ,
          <source>Psychosomatic Medicine</source>
          , volume
          <volume>81</volume>
          (
          <issue>3</issue>
          ),
          <year>2019</year>
          , pp.
          <fpage>265</fpage>
          -
          <lpage>280</lpage>
          . doi:
          <volume>10</volume>
          .1097/PSY.0000000000000673.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M. G.</given-names>
            <surname>Craske</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. E.</given-names>
            <surname>Meuret</surname>
          </string-name>
          , T. Ritz et al.,
          <article-title>"Positive affect treatment for depression and anxiety: A randomized clinical trial for a core feature of anhedonia"</article-title>
          ,
          <source>Journal of Consulting and Clinical Psychology</source>
          , volume
          <volume>87</volume>
          (
          <issue>5</issue>
          ),
          <year>2019</year>
          , pp.
          <fpage>457</fpage>
          -
          <lpage>471</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A.</given-names>
            <surname>Werner-Seidler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Perry</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. L.</given-names>
            <surname>Calear</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. M.</given-names>
            <surname>Newby</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Christensen</surname>
          </string-name>
          ,
          <article-title>"School-based depression and anxiety prevention programs for young people: A systematic review and metaanalysis"</article-title>
          ,
          <source>Clinical Psychology Review</source>
          , volume
          <volume>51</volume>
          ,
          <year>2016</year>
          , pp.
          <fpage>30</fpage>
          -
          <lpage>47</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.cpr.
          <year>2016</year>
          .
          <volume>10</volume>
          .005.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>N. V.</given-names>
            <surname>Pogosova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. V.</given-names>
            <surname>Dovzhenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. G.</given-names>
            <surname>Babin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Kursakov</surname>
          </string-name>
          , and
          <string-name>
            <given-names>V. A.</given-names>
            <surname>Vygodin</surname>
          </string-name>
          ,
          <article-title>"Russian version of PHQ-2 and 9 questionnaires: sensitivity and specificity in detection of depression in</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>