<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">EmIR: An Emotional Intelligent Robot Assistant</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author>
							<persName><forename type="first">Jaime</forename><forename type="middle">A</forename><surname>Rincon</surname></persName>
						</author>
						<author>
							<persName><forename type="first">Alberto</forename><surname>Martin</surname></persName>
						</author>
						<author>
							<persName><forename type="first">Angelo</forename><surname>Costa</surname></persName>
						</author>
						<author>
							<persName><forename type="first">Paulo</forename><surname>Novais</surname></persName>
						</author>
						<author>
							<persName><forename type="first">Vicente</forename><surname>Julian</surname></persName>
						</author>
						<author role="corresp">
							<persName><forename type="first">Carlos</forename><surname>Carrascosa</surname></persName>
							<email>carrasco@dsic.upv.es</email>
						</author>
						<author>
							<affiliation key="aff0">
								<orgName type="department">D. Sistemas Informáticos y Computación jrincon</orgName>
								<orgName type="institution">Universitat Politècnica de València</orgName>
							</affiliation>
						</author>
						<author>
							<affiliation key="aff1">
								<orgName type="department" key="dep1">Centro ALGORITMI</orgName>
								<orgName type="department" key="dep2">Escola de Engenharia</orgName>
								<orgName type="institution">Universidade do Minho</orgName>
								<address>
									<settlement>Braga acosta</settlement>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">EmIR: An Emotional Intelligent Robot Assistant</title>
					</analytic>
					<monogr>
						<imprint>
							<date/>
						</imprint>
					</monogr>
					<idno type="MD5">125D2D2FDC3745CA76AEFFF662619F38</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2023-03-25T04:58+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<textClass>
				<keywords>
					<term>Social Robots</term>
					<term>Emotional Models</term>
					<term>Ambient Assisted Living</term>
				</keywords>
			</textClass>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>The development of robots that are truly sociable requires understanding how human interactions can be applied to the interaction between humans and robots. A sociable robot must be able to interact with people taking into account aspects like verbal and non-verbal communications (emotions, postures, gestures). This work presents a social robot which main goal is to provide assistance to older people in carrying out their daily activities (through suggestions or reminders). In addition, the robot presents non-verbal communications like perceiving emotions and displaying human identifiable emotions in order to express empathy. A prototype of the robot is being tested in a daycare centre in the northern area of Portugal.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1">Introduction</head><p>Globally, the elderly population is increasing, according to demographic projections <ref type="bibr" target="#b0">[1]</ref>. The OMS prdeicts that the amount of people aged over 60 is expected to double between 2000 and 2050 <ref type="bibr" target="#b1">[2]</ref>. As less developed countries start to evolve, this trend is onset immediately <ref type="bibr" target="#b1">[2]</ref>. A common societal issue that emerges from a rapid elderly population growth is the exponential demand or care (medical and otherwise).</p><p>The common human resources needed are healthcare professionals, including formal and informal caregivers. Which currently are in short supply, and there is no indication of increase of the caregivers numbers in the foreseeable future. The lack of these professionals represents a serious issue. One way of dealing with this issue is using technology that empowers people to overcome problems that they encounter on their daily lives. Various areas can be of help to the elderly, like Social Robotics <ref type="bibr" target="#b2">[3]</ref>, Virtual Assistants <ref type="bibr" target="#b3">[4]</ref>, Artificial Intelligence <ref type="bibr" target="#b4">[5]</ref>, etc.</p><p>These areas try to solve these problems by introducing new technologies that can help older people living alone or in nursing homes. Some of these solutions include voice assistants such as Amazon's Alexa, Google Voice Assitant and Apple's HomePod. However, other emerging technologies such as assistant robots and therapy robots are becoming increasingly popular. These devices integrate speech recognition, artificial vision, text chat and gestural interactions. These mechanisms help users to interact with these devices. However, in human interaction the way that emotion is expressed plays an important role, mainly because emotions are themselves a communication channel.</p><p>In this paper we present a social robot, called EmIR, which main goal is to provide assistance to the elderly performing their daily activities, presenting human-like features like perceiving emotions of a group of people and displaying human identifiable emotions. Moreover, our social robot makes use of an e-Health platform (Cognitive Life Assistant -CLA) which integrates a persuasive module that makes use of argumentative techniques similar to reasoning procedures that physicians and caregivers use to recommend activities to patients.</p><p>The rest of the paper is structured as follows. Section 2 analyzes previous works in the area of assistants robots. Section 3 presents in detail the main functionalities of the robot with particular emphasis on the emotion detection and the user interaction. Section 4 describes the hardware employed to build the robot and it illustrates the functionalities of the robot through an example. Finally, the conclusions are presented in Section 5.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2">Related Work</head><p>Recently, it is observable the increase on interest in assistive robots and their development. Current sociological shift demands technological solutions that are able to interact with elderly people. Thus, the sudden increase of the number of robots available that have as goal solving this sociological issue. Furthermore, they are increasingly refined and advanced in terms of aspect and features, being more human-like in both fields.</p><p>In recent years, we have seen a growing interest in robots, many of which are available to people. These robots have nice looks, a powerful background of artificial intelligence, navigation in complex environments, artificial vision, etc. Some of them, such as Pepper <ref type="bibr" target="#b5">[6]</ref> and Romeo <ref type="bibr" target="#b6">[7]</ref> from Aldebaran or Aido <ref type="bibr" target="#b7">[8]</ref> or Buddy <ref type="bibr" target="#b7">[8]</ref> from Frog Robotics, are presented as a new generation of home robots. One of the main applications of these robots is to assist older people in their daily life. Usually, these robots are used as a form of therapy or health care. In therapy field, we can find the Paro robot <ref type="bibr" target="#b8">[9]</ref>. The Paro robot is an advanced interactive robot developed by AIST, which offers the well-known benefits of animal therapy to be administered to patients in environments such as hospitals. This robot was built to be a companion to children and elderly, prompting a positive emotional response due to its visual aspect. In the healthcare field we can find the Mabu robot of Catalia Health, who learns over time about the personality, interests and therapeutic challenges of each patient. This allows Mabu to create conversations adapted to each patient. The structure of these conversations is based on wellknown behavioral models of psychology to promote behavioral change.</p><p>From these projects we have observed that while the physical aspect, and its underlying impact (as displayed by PARO), is very advanced and the target of a careful development, they lack in terms of functionality. The actions that makes one human and their emotions are not explored by these projects and we believe that after the initial impact of the visual aspect it is what makes them really human-like. We, as humans, strive for human empathy, and is what our project aims for.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3">Emotional Robot Assistant Description</head><p>In this section we describe the proposed social robot, called EmIR (Emotional Intelligent Robot). This robot has been developed in order to provide assistance to the elderly to perform their daily activities. To validate the proposed robot, a prototype is being tested in a real scenario, in a daycare institution in the north of Portugal.</p><p>The main features of the robot are the following: perceives the emotions of each individual and also calculates the social emotion of a group of people; displays human identifiable emotions according to the emotional states of the users; assists users recommending healthy activities and also, remembering when to do them; and finally, persuades users by giving them arguments to justify recommended actions. The robot was built using a lattepanda board<ref type="foot" target="#foot_0">3</ref> and an Arduino mega 2560 board <ref type="foot" target="#foot_1">4</ref> . These development boards are used to control the different engines and also to detect emotions and to identify people. Figure <ref type="figure" target="#fig_0">1</ref> shows a picture of the robot with its different elements. The functionalities of the proposed robot are divided into three main modules which provides the services that our robot uses to perceive and interact with the environment. The first two modules are the Emotion Detection and the Emotion Display modules which are in charge of detecting, processing and displaying emotions. On the other hand, the other module is the User Interaction module which has been implemented using the CLA framework <ref type="bibr" target="#b9">[10]</ref>. The CLA framework improves the user experience and gives a fluid visual interface to the robot.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4">Application Example</head><p>In order to illustrate the behavior of the robot, this section presents an example which describes the different processes made by the robot as an emotional-based persuasive recommender. In the proposed example, the robot will interact with humans by identifying them, detecting their emotions and suggesting activities.</p><p>Figure <ref type="figure">2</ref> shows the different processes followed by the robot for supporting the described interaction. Fig. <ref type="figure">2:</ref> A schema of the main processes followed by the robot In a general view, the robot will follow the following steps:</p><p>1. The way to initiate the interaction with the robot consists of saying the name of the robot, which in our case is EmIR (Emotional Interactive Robot).As soon as the robot hears its name it starts interacting with the caller(s). 2. The first step is to take a picture through its webcam. This image is used to identify the person and to track the face. If the robot does not know the person, the robot initiates the following dialogue (as an example):</p><p>-EmIR: I'm sorry, but I don't know you.</p><p>-EmIR: What's your name?.</p><p>-User: Hi, my name is Jaime.</p><p>3. After this, the image is then introduced as input into a neural convolutional network that returns the emotional state. If the robot detects more than one face in the same image, the process is repeated for each face. Once the emotional state of all the users are obtained, the robot will adapt its emotion in an attempt to show empathy. To do this the robot can move its eyebrows and change the lights of its cheeks. 4. Next, the robot makes use of its persuasive recommender system. It can recommend the following items:</p><p>-Events that promote active aging. The suggestion of events follows a set of configurations (age, likes, medical condition, etc.) that make them appropriate for each user. -Activities on the user calendar, e.g., medication reminders, medical appointments. During this recommendation process, a dialogue with the user is started where the user can accept or refuse the suggestions. If the user refuses a suggestion, the robot tries to suggest another activity or generates arguments in order to persuade the user. In parallel, it keeps identifying the user's emotion and producing visual cues (eyebrows, etc.) to enforce the information delivered. 5. After this process, the robot goes to a waiting state until it is requested again by the user. In the meanwhile the robot presents practical information like the current weather state or news, in an effort to interact with the user(s).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5">Conclusions and future work</head><p>This paper has presented the EmIR robot, a low cost desktop robot devised to interact with humans taking into account the emotion of the people it interacts with and even being able to express some emotion. The application area where is assistance to an elderly community.</p><p>In the interaction with people in this application area, the robot is able to talk with the persons it perceives and help those people by recommending new activities along with giving reminders about scheduled activities.</p><p>Although the robot is still in a prototype form, its design and abilities have been improved presenting human-like features like perceiving emotions of a group of people and displaying human identifiable emotions. The functionalities of the proposed robot are divided into three main aspects. The first one is the Emotion Detection that allows the robot to estimate the emotional state of the people that is in from of the robot. The second one is the Emotion Display, that allows the robot to express empathy with people according to the emotional states previously detected. The third and last one, is the User Interaction that allows the robot to enhance the user experience suggesting activities/events to the user based on his/her profile and medical condition and trying to persuade the users into accepting the suggested activities/events. This work is being validated by workers and patients of a daycare centre in the northern area of Portugal. Specifically in the centre Centro Social Irmandade de S. Torcato. The validation is being performed through simple interactions with the patients under the supervision of caregivers.</p><p>As future work, we want to improve the detection of emotions by introducing speech recognition as another input in the process of identifying emotional states. Another aspect to be introduced, and currently supported by CLA, is the direct connection with caregivers or doctors to share information on scheduled activities or events as well as the patient progress. Finally, we aim for the adaptation of the proposed system to people with disabilities who cannot use the touchscreen.</p></div><figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_0"><head>Fig. 1 :</head><label>1</label><figDesc>Fig. 1: Robot hardware.</figDesc><graphic coords="3,169.35,418.49,276.65,182.17" type="bitmap" /></figure>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="3" xml:id="foot_0">http://www.lattepanda.com/</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="4" xml:id="foot_1">https://store.arduino.cc/arduino-mega-2560-rev3</note>
		</body>
		<back>

			<div type="acknowledgement">
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6">Acknowledgements</head><p>This work is partially supported by the MINECO/FEDER TIN2015-65515-C4-1-R and the FPI grant AP2013-01276 awarded to Jaime-Andres Rincon. Angelo Costa thanks the FCT -Fundacao para a Ciencia e Tecnologia for the Post-Doc grant SFRH/BPD/102696/2014. This work is supported by FCT within the projects UID/CEC/00319/2013 and COMPETE: POCI-01-0145-FEDER-007043.</p></div>
			</div>

			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<monogr>
		<title level="m" type="main">World population ageing</title>
		<imprint>
			<date type="published" when="2015">2015. 2015</date>
		</imprint>
		<respStmt>
			<orgName>United Nations ; Department of Economic and Social Affairs, Population Division</orgName>
		</respStmt>
	</monogr>
	<note>ST/ESA/SER.A/390</note>
</biblStruct>

<biblStruct xml:id="b1">
	<monogr>
		<idno>ESA/P/WP/248</idno>
		<title level="m">World population prospects: The 2017 revision, key findings and advance tables</title>
				<imprint>
			<publisher>United Nations</publisher>
			<date type="published" when="2017">2017</date>
		</imprint>
		<respStmt>
			<orgName>Department of Economic and Social Affairs, Population Division</orgName>
		</respStmt>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<analytic>
		<title level="a" type="main">Assistive social robots in elderly care: a review</title>
		<author>
			<persName><forename type="first">J</forename><surname>Broekens</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Heerink</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Grontechnology</title>
		<imprint>
			<biblScope unit="volume">8</biblScope>
			<biblScope unit="page" from="94" to="103" />
			<date type="published" when="2009">2009</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<analytic>
		<title level="a" type="main">Social effects of virtual assistants. a review of empirical results with regard to communication</title>
		<author>
			<persName><forename type="first">Nicole</forename><forename type="middle">C</forename><surname>Krämer</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Intelligent Virtual Agents</title>
				<editor>
			<persName><forename type="first">Helmut</forename><surname>Prendinger</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">James</forename><surname>Lester</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">Mitsuru</forename><surname>Ishizuka</surname></persName>
		</editor>
		<meeting><address><addrLine>Berlin, Heidelberg; Berlin Heidelberg</addrLine></address></meeting>
		<imprint>
			<publisher>Springer</publisher>
			<date type="published" when="2008">2008</date>
			<biblScope unit="page" from="507" to="508" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<analytic>
		<title level="a" type="main">Monitoring elderly people at home with temporal case-based reasoning</title>
		<author>
			<persName><forename type="first">Eduardo</forename><surname>Lupiani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Jose</forename><forename type="middle">M</forename><surname>Juarez</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Jose</forename><surname>Palma</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Roque</forename><surname>Marin</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Knowledge-Based Systems</title>
		<imprint>
			<biblScope unit="volume">134</biblScope>
			<biblScope unit="page" from="116" to="134" />
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<analytic>
		<title level="a" type="main">Pepper learns together with children: Development of an educational application</title>
		<author>
			<persName><forename type="first">Fumihide</forename><surname>Tanaka</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Kyosuke</forename><surname>Isshiki</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Fumiki</forename><surname>Takahashi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Manabu</forename><surname>Uekusa</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Rumiko</forename><surname>Sei</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Kaname</forename><surname>Hayashi</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">IEEE-RAS International Conference on Humanoid Robots</title>
				<imprint>
			<date type="published" when="2015-12">2015-December. 2015</date>
			<biblScope unit="page" from="270" to="275" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<analytic>
		<title level="a" type="main">Vision-based manipulation with the humanoid robot Romeo</title>
		<author>
			<persName><forename type="first">Giovanni</forename><surname>Claudio</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Fabien</forename><surname>Spindler</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Francois</forename><surname>Chaumette</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids)</title>
				<imprint>
			<publisher>IEEE</publisher>
			<date type="published" when="2016-11">2016. nov 2016</date>
			<biblScope unit="page" from="286" to="293" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b7">
	<monogr>
		<author>
			<persName><forename type="first">Ester</forename><surname>Martinez-Martin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Angel</forename><forename type="middle">P</forename><surname>Del Pobil</surname></persName>
		</author>
		<title level="m">Personal Robot Assistants for Elderly Care: An Overview</title>
				<meeting><address><addrLine>Cham</addrLine></address></meeting>
		<imprint>
			<publisher>Springer International Publishing</publisher>
			<date type="published" when="2018">2018</date>
			<biblScope unit="page" from="77" to="91" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b8">
	<analytic>
		<title level="a" type="main">Effects of robot assisted activity to elderly people who stay at a health service facility for the aged</title>
		<author>
			<persName><forename type="first">K</forename><surname>Wada</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Shibata</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Saito</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Tanie</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">3 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)</title>
				<imprint>
			<date type="published" when="2003">2003</date>
			<biblScope unit="page" from="2847" to="2852" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b9">
	<analytic>
		<title level="a" type="main">Sensor-driven agenda for intelligent home care of the elderly</title>
		<author>
			<persName><forename type="first">Angelo</forename><surname>Costa</surname></persName>
		</author>
		<author>
			<persName><forename type="first">José</forename></persName>
		</author>
		<author>
			<persName><forename type="first">Carlos</forename><surname>Castillo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Paulo</forename><surname>Novais</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Antonio</forename><surname>Fernández-Caballero</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Ricardo</forename><surname>Simões</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Expert Syst. Appl</title>
		<imprint>
			<biblScope unit="volume">39</biblScope>
			<biblScope unit="issue">15</biblScope>
			<biblScope unit="page" from="12192" to="12204" />
			<date type="published" when="2012">2012</date>
		</imprint>
	</monogr>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
