<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Robot personality for cognitive training</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Eleonora Zedda</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ISTI-CNR Pisa</institution>
          ,
          <addr-line>Via Giuseppe Moruzzi, 56124 Pisa PI</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Pisa, Largo Bruno Pontecorvo</institution>
          ,
          <addr-line>3, 56127 Pisa PI</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <fpage>78</fpage>
      <lpage>82</lpage>
      <abstract>
        <p>Robots are becoming more present in our daily activities and in particular in the health context. To improve the human-robot interaction in a training session it is important to design and develop social behavior and personality in robots. Recent studies found that personality is an essential feature for creating socially assistive robots. For this purpose, I want to investigate if the robot personality (extrovert or introvert) can improve the user's cognitive performances in elders with Mild Cognitive Impairments during one-o-one cognitive training.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Human-Robot Interaction</kwd>
        <kwd>Socially Assistive Robots</kwd>
        <kwd>Personality</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
    </sec>
    <sec id="sec-2">
      <title>2. Related work</title>
      <p>
        The benefits of SAR in heath context with elderly are investigated in the research by Tanaka et
al.[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The researchers compared a speaking humanoid Kabochan Nodding ROBOT with the
same robot but without the communication elements. In the 8-week trials with MCI patients, the
researchers found improvements in cognitive functions. Pino et al. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] evaluate the efectiveness
of human-robot interaction(HRI) to reinforce therapeutic behavior. In the experiment with
MCI patients, they found improvements in diferents cognitive domains and that HRI can
reinforce therapeutic behavior. In literature for social robots performing assistive tasks with
personality, Tapus et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] investigate the role of the robot’s personality in a therapy process for
rehabilitation of post-stroke users. In the study, they used an ActiveMedia Pioneer 2-DX mobile
robot designed to assist, encourage, and socially interact with post-stroke users engaged in
rehabilitation exercises. As result, they found the first evidence for the preference of personality
in the assistive domains.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Proposal</title>
      <p>
        In 2019 the HIIS laboratory of CNR-ISTI in conjunction with the Neuroscience Institute of CNR
of Pisa collaborated to investigated how seniors with MCI perceived cognitive training with
a humanoid robot [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. As result, we found that the robot seems to improve the engagement
in the user, in fact, the older adults considered the humanoid robot as if it had human traits.
Taking into account this experience, my Ph.D. research addresses the limitation in prior work:
personality. The idea behind this project is to design and implement an extrovert and introvert
personality in a robotic system. Research question: Can a social robot showing a personality
improve cognitive performance and engagement in the user?
Robot system The humanoid robot I will use is called Pepper Robot, which is developed by
Softbank Robotics. Pepper is a 1.2-m-tall wheeled humanoid robot, with 17 joints for expressive
body language. Pepper has multimodal interfaces for interaction: touchscreen, speech, tactile
head, hands, bumper, LEDs, and 20 degrees of freedom for motion in the whole body. It hears
thanks to four directional microphones on his head, which allow it to detect the provenance
of sounds and voices and turn its face in the direction of those who are talking. The robot
speaks or reproduces sounds thanks to two speakers in the ears, and it is also equipped with
4 microphones on the head. For the vision, it is equipped with two identical 2D cameras, a
3D camera, and a stereo camera. To develop personality in the robot I will use the QiSDK for
android, a Java library that ofers a set of modules to program the robot.
      </p>
      <p>
        Behaviour and personality In literature, diferent personality models are proposed. I
consider the Five-factor model[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] because a considerable amount of research indicates that
extroversion and introversion are the most observable personalities. For this reason, I want to implement
extrovert and introvert personalities in a humanoid robot during cognitive training with three
serious games. After a preliminary interview with the psychologies and therapist of the clinic
the two personalities have been identified and, before the user test, they will be validated
Introvert
Neutral
pitch set as default 100
set 50% maximum
150 words per minute
Variation rhythm set 0
neutral feedbacks
neutral colors or light colors
no flashing
one arm with small angles,
slower response
neutral animations
shiny colours, flashing light
Gesture: both arms, head, torso movements
      </p>
      <p>with big angles, faster responses
Set of animations: animations that convey</p>
      <p>diferent emotions
Moving speed: 40% faster than introvert movements slower movements
Sounds: movement associated with sounds no sounds or melody
and melody
Autonomous movements: autonomous movements
few autonomous movements
by psychologists and therapists. Table 1 summarizes the verbal and non-verbal cues used to
modulate the robot’s behavior. For the verbal parameters, I identify: modulation in the robot’s
intonation between neutral, joyful, and didactic; variation in the pitch and rhythm; changes
in the volume and speech rate; diferent set of feedbacks. For the non-verbal cues, I identify:
LEDs with diferent colors and intensities(e.g flashing light), customized set of animation that
can convey diferent emotions; creation of complex gesture with diferent angles; association
of movements with sounds; modulation of the movement’s speed; addition of autonomous
movements (e.g. natural movements of the arms). For each interaction with the users, Pepper
will provide a diferent combination of verbal and non-verbal cues according to the personality
performed.</p>
      <p>Scenarios In this paragraph, I describe two scenarios in which I propose a possible use of the
robot personality during cognitive training with older adults. Mario is a 75 years old teacher
and since he has a diagnosis of MCI, he regularly attends cognitive training in a cognitive center
near his house. Recently a one-o-one cognitive training with a humanoid robot was integrated
into his program by the clinic. Monday morning, as usual, he prepares and goes to the clinics.
The psychologists welcome and take him to the training room. After the introduction phase in
which the robot introduces the cooking game and the ingredients of the first level:
Extrovert scenario.</p>
      <p>1. Pepper says with a joyful intonation and a high-pitched voice "Which is the first ingredient
to cook the chicken curry: chicken, curry, salt or yogurt?" highlighting its LEDs with a
bright blue and moving both its arms over its head.
2. When Mario answers right to the question, immediately Pepper says "Good job Mario,
you are doing a great job!". At the same time, it raises both arms two times and nods
its head, the eyes LEDs become bright green and flashing, and it produces a sound that
expresses joy.
3. Pepper says "How many grams of flour are needed for the recipe: 10, 150, 200, 400 gr?".</p>
      <p>Pepper highlights its LEDs with a bright blue and opens both arms at 40 degrees outwards
as to encourage the user.
4. For the first wrong answer, Pepper says with a loud voice and an enthusiastic intonation
"You made a mistake, but you can try again!". When Mario answers wrong more than one
time Pepper says, " Mario, stay focus! You know the answer, try again!". At the same time,
it shakes the head and moves the arms up and down, an "oh" sound is vocally provided,
and all the LEDs become bright red and flashing.
5. Before the game end, Pepper combines diferent gestures to simulate a victory animation
accompanied by sounds of applause, while all the LEDs are flashing and become green
and blue. In the end, Pepper salutes Mario saying "Really good job Mario, it was fun to
play with you! Hope to see you again next time!". During the cognitive session, Pepper
performs autonomous movements (e.g simulate breathing movements).</p>
      <p>Introvert scenario.
1. Pepper says with neutral intonation and a low volume "Which is the first ingredient to
cook the chicken curry: chicken, curry, salt or yogurt?". After a few seconds, it slowly
undulates the torso twice to the right and left while the shoulders LEDs become light
gray.
2. When Mario answers right, Pepper says with a neutral intonation and a slow speech rate
"Good". It waits two seconds and slowly it nods its head, while the eye LEDs become light
green without flashing.
3. Pepper says "How many grams of flour are needed for the recipe: 10, 150, 200, 400 gr?" It
gently opens its right arm to 20 degrees outwards right while the eyes LEDs become a
light yellow.
4. When Mario answers wrong, Pepper says "Wrong, try again." It lightly shakes the head
one time, while the eyes and shoulders LEDs become light red.
5. In the end, Pepper moves backward and forwards one arm and it salutes Mario saying
"Good job Mario, see you next time". During the cognitive session, Pepper performs a
restricted set of autonomous movements.</p>
      <p>
        Methods and evaluation I want to insert the adaptation of personality in a robot system
for supporting cognitive training according to the users’ personalities. For the evaluation
study, I define two experimental conditions: an extrovert condition in which the robot
performs an extrovert behavior during the training and an introvert condition in which the robot
performs an introvert personality. Before and after the test, the users will be subjected to
the UES questionnaire [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] for evaluating the engagement of the users, the Big Five Inventory
test for evaluating the users’ personalities [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and the Godspeed Questionnaire Series [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
During the cognitive training, I will collect data to evaluate the improvement in the memory
domains stimulated: reaction time, number of the wrong/right answers, time session, number
of attempts, etc. Learning which robot’s personality better fits the user is important to evaluate
the improvements in attention, and also to improve the HRI. Creating a robotic system capable
of adapting its personality to the users could be a useful tool to stimulate the elders to continue
the therapy, and moreover to achieve progress in their rehabilitation. In conclusion, I want to
evaluate if diferent robot personalities adapting to the user can create an enjoyable interaction;
engage more the user during the tasks; increase the user’s attention, and consequentially if can
improve the user’s task performance and cognitive functions.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgments</title>
      <p>I would like to thanks my Ph.D. advisors Prof. Fabio Paternò and Dr. Daniele Mazzei for their
help, support, and guidance.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>World</given-names>
            <surname>Health</surname>
          </string-name>
          <string-name>
            <surname>Organization</surname>
          </string-name>
          ,
          <source>World report on ageing and health</source>
          (
          <year>2015</year>
          ). URL.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>N. A.</given-names>
            <surname>Bishop</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Lu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. A.</given-names>
            <surname>Yankner</surname>
          </string-name>
          ,
          <article-title>Neural mechanisms of ageing and cognitive decline</article-title>
          ,
          <source>Nature</source>
          <volume>464</volume>
          (
          <year>2010</year>
          )
          <fpage>529</fpage>
          -
          <lpage>535</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M.</given-names>
            <surname>Tanaka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ishii</surname>
          </string-name>
          , E. Yamano,
          <string-name>
            <given-names>H.</given-names>
            <surname>Ogikubo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Okazaki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kamimura</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Konishi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Emoto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Watanabe</surname>
          </string-name>
          ,
          <article-title>Efect of a human-type communication robot on cognitive function in elderly women living alone</article-title>
          , Medical science monitor: international
          <source>medical journal of experimental and clinical research 18</source>
          (
          <year>2012</year>
          )
          <article-title>CR550</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>O.</given-names>
            <surname>Pino</surname>
          </string-name>
          , G. Palestra,
          <string-name>
            <given-names>R.</given-names>
            <surname>Trevino</surname>
          </string-name>
          , B. De Carolis,
          <article-title>The humanoid robot nao as trainer in a memory program for elderly people with mild cognitive impairment</article-title>
          ,
          <source>International Journal of Social Robotics</source>
          <volume>12</volume>
          (
          <year>2020</year>
          )
          <fpage>21</fpage>
          -
          <lpage>33</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Tapus</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Ţăpuş</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Matarić</surname>
          </string-name>
          ,
          <article-title>User-robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy</article-title>
          ,
          <source>Intelligent Service Robotics</source>
          <volume>1</volume>
          (
          <year>2008</year>
          )
          <fpage>169</fpage>
          -
          <lpage>183</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>M.</given-names>
            <surname>Manca</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Paternò</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Santoro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Zedda</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Braschi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Franco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Sale</surname>
          </string-name>
          ,
          <article-title>The impact of serious games with humanoid robots on mild cognitive impairment older adults</article-title>
          ,
          <source>International Journal of Human-Computer Studies</source>
          <volume>145</volume>
          (
          <year>2021</year>
          )
          <fpage>102509</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.</given-names>
            <surname>Costa</surname>
          </string-name>
          , T. Paul,
          <article-title>of personality theories: Theoretical contexts for the five-factor model, The five-factor model of personality: Theoretical perspectives 51 (</article-title>
          <year>1996</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>H. L. O'Brien</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Cairns</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Hall</surname>
          </string-name>
          ,
          <article-title>A practical approach to measuring user engagement with the refined user engagement scale (ues) and new ues short form</article-title>
          ,
          <source>International Journal of Human-Computer Studies</source>
          <volume>112</volume>
          (
          <year>2018</year>
          )
          <fpage>28</fpage>
          -
          <lpage>39</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>B.</given-names>
            <surname>Rammstedt</surname>
          </string-name>
          ,
          <string-name>
            <surname>O. P. John,</surname>
          </string-name>
          <article-title>Measuring personality in one minute or less: A 10-item short version of the big five inventory in english and german</article-title>
          ,
          <source>Journal of research in Personality</source>
          <volume>41</volume>
          (
          <year>2007</year>
          )
          <fpage>203</fpage>
          -
          <lpage>212</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>A.</given-names>
            <surname>Weiss</surname>
          </string-name>
          , C. Bartneck,
          <article-title>Meta analysis of the usage of the godspeed questionnaire series</article-title>
          , in: 2015 24th
          <string-name>
            <given-names>IEEE</given-names>
            <surname>International</surname>
          </string-name>
          <article-title>Symposium on Robot and Human Interactive Communication (RO-MAN)</article-title>
          , IEEE,
          <year>2015</year>
          , pp.
          <fpage>381</fpage>
          -
          <lpage>388</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>