=Paper= {{Paper |id=Vol-2706/paper7 |storemode=property |title=Transcultural Health-Aware Guides for the Elderly |pdfUrl=https://ceur-ws.org/Vol-2706/paper8.pdf |volume=Vol-2706 |authors=Rafael H. Bordini,Viviana Mascardi,Stefania Costantini,Amal El Fallah Seghrouchni,Yves Lespérance,Alessandro Ricci |dblpUrl=https://dblp.org/rec/conf/woa/BordiniMCSLR20 }} ==Transcultural Health-Aware Guides for the Elderly== https://ceur-ws.org/Vol-2706/paper8.pdf
Transcultural Health-Aware Guides for the Elderly
Rafael H. Bordinia,b , Viviana Mascardib , Stefania Costantinic , Amal El
Fallah-Seghrouchnid , Yves Lespérancee and Alessandro Riccif
a
  PUCRS, Porto Alegre, Brazil
b
  Genova University, Genova, Italy
c
  L’Aquila University, L’Aquila, Italy
d
  Sorbonne University, Paris, France
e
  York University, Toronto, Canada
f
  Università di Bologna, Cesena, Italy


                                         Abstract
                                         In this brief position paper, we present our vision for using software agents and related technologies
                                         to address the growing need of transcultural health-aware “Guides” for the elderly, an increasingly
                                         important topic given the clear trend of population ageing. Such autonomous intelligent guides are
                                         employed in smart living/city infrastructures to give emotional and healthcare support for the elderly
                                         wherever they are, whether at home, outdoors, or in hospital. The main purpose is to help ageing people
                                         to avoid progressive loss of physical, cognitive, and emotional activity, and most importantly to avoid
                                         social exclusion.

                                         Keywords
                                         Population ageing, smart environment, argumentation, ontology




1. Introduction
Most continents, in particular those where the authors live, are exposed to the tangible effects
of the ageing of the population, with all the challenges for the society and for the individuals
(the ageing people, but also their relatives, caregivers, doctors) that this demographic change
raises.
   In this paper, we present our vision on how to address some of these challenges; in particular,
we investigate how intelligent software agents could mitigate the risk of progressive loss of
physical, intellectual, and emotional activity of ageing people, and of their social exclusion,


WOA 2020: Workshop “From Objects to Agents”, September 14–16, 2020, Bologna, Italy
" rafael.bordini@pucrs.br (R. H. Bordini); viviana.mascardi@unige.it (V. Mascardi); stefania.costantini@univaq.it
(S. Costantini); amal.elfallah@lip6.fr (A. El Fallah-Seghrouchni); lesperan@eecs.yorku.ca (Y. Lespérance);
a.ricci@unibo.it (A. Ricci)
~ https://www.inf.pucrs.br/r.bordini/ (R. H. Bordini); https://person.dibris.unige.it/mascardi-viviana/ (V. Mascardi);
http://people.disim.univaq.it/~stefcost/ (S. Costantini); https://webia.lip6.fr/~elfallah/ (A. El Fallah-Seghrouchni);
http://www.cse.yorku.ca/~lesperan/ (Y. Lespérance); https://www.unibo.it/sitoweb/a.ricci/en (A. Ricci)
 0000-0001-8688-9901 (R. H. Bordini); 0000-0002-2261-9926 (V. Mascardi); 0000-0002-5686-6124 (S. Costantini);
0000-0002-8390-8780 (A. El Fallah-Seghrouchni); 0000-0003-1625-0226 (Y. Lespérance); 0000-0002-9222-5092
(A. Ricci)
                                       © 2020 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
    CEUR
    Workshop
    Proceedings
                  http://ceur-ws.org
                  ISSN 1613-0073
                                       CEUR Workshop Proceedings (CEUR-WS.org)



                                                                                                         135
Rafael H. Bordini et al.                                                                                    135–146


in particular when a transition from different situations (moving from home to a protected
structure, or from a protected structure to an hospital) takes place.
   We believe that one way to cope with the needs of old people, especially during these delicate
transitions where they are much more fragile than in stable situations, is to provide them with
highly-interactive culturally adaptive “Guides” that not only care for their health but also serve
as entertaining companions that interact through spoken dialogues and that stimulate their
cognitive abilities. Such Guides, designed and implemented as software agents compliant with
the strong notion of agency [1] and also characterised by emotional features à la Bates [2],
besides mentalistic ones à la Shoham [3], are meant to become a familiar and trustable point
of reference for their users. The Beliefs-Desires-Intentions (BDI) agent model, extended with
emotional features as suggested for example by Pereira et al. [4], Alfonso et al. [5], Su et al. [6],
would hence represent a suitable architecture for our Guides, and has been recently adopted
in healthcare applications [7]. Given the BDI-oriented nature of the Guides1 , we will exploit
languages like DALI [8], SR-APL [9], IndiGolog [10], or Jason [11], meant as a standalone
infrastructure or, better, integrated in the environment- and organization-oriented JaCaMo
framework [12], for their implementation.
   We use the word “Guide” to emphasise that such interactive assistants are always available
to their users when they need advice or company, wherever they are, be it the comfort of their
home, outdoors, but also at difficult times for example when moving to protected structures
or hospital is needed. The Guides may provide guidance — following a protocol pre-agreed
with doctors, psychologists and caregivers — to the elderly on all those situations which do not
require a doctor evaluation and assessment (entertainment, social activity, physical activity, diet,
medication to take according to the agreed protocol). By watching over the elderly, Guides can
collect precious information on their behaviour and can serve as a source of reliable information
for the doctors who care for the elderly. Hence, guidance is bidirectional: caregivers choices
and focus of attention can indeed be driven by the Guide, based on what it senses, observes,
hears, and deduces.
   We expect that Guides should quickly learn the cultural profile of their users and flexibly adapt
to cross-cultural interaction. This means adapting the style of conversation to the conversation
party: old users may require the adoption of a limited, simple vocabulary, which includes words
familiar to them, while doctors may take advantage of a rich technical vocabulary.
   By boosting cross-cultural interaction, our Guides will also facilitate people to get in touch
and to interact, hence achieving one of the main risks of ageing: social exclusion.
   The targets of our investigation are indeed natural language processing, ontologies and argu-
mentation techniques to ensure cross-cultural interaction [13, 14]; agent-oriented approaches to
make such cross-cultural interaction intelligent and emotionally realistic and believable, which
requires explicit representations of the user’s state of mind [15]; and smart-* approaches to
make agent-oriented approaches efficient and well integrated with the existing environment
and infrastructures.



    1
     By “BDI-oriented” here we mean, in a very broad sense, the conceptualization and implementation of the
Guides based on explicit knowledge/ beliefs, declarative and rule based reasoning/planning, explicit goals to achieve.



                                                         136
Rafael H. Bordini et al.                                                                  135–146


2. The “Guides” and Their Smart Environment
The architectural framework we have devised relies upon a “sensing layer” which is necessary
for creating smart environments where people are cared for. Improving the state of the art on the
sensing layer falls outside our research investigation: we plan to exploit as many out-of-the-box
techniques and tools as possible, among the many available ones [16], to allow the Guides
to sense what people are doing in an unobtrusive (or “acceptably obtrusive”) way. Among
these tools, we will consider cameras tracking people and their actions for detecting falls [17],
wearable and IoT devices [18], sleep sensors [19].
   We are much more interested in exploring the potential of software agents as the building
blocks for analysing, designing, and developing the Guides. In particular, we are interested
in argumentation schemes that are specific for the elderly and for each culture, and in their
translation into properly formalised argumentation frameworks [20] where the Guides, imple-
mented as agents, can play a role; in the integration of ontologies and ontological reasoning
[21] inside such argumentation schemes; in the identification of a way to interact with the
user naturally also via voice interaction [22]; in the exploitation of NLP profiling techniques to
detect depression and anomalies in the emotional and cognitive status of the user [23].
   The adoption of methods grounded on formal techniques throughout all the stages of the
Guide engineering will ensure that the actions of the Guide are trustworthy, explainable, and –
up to the extent ethics can be formalised and implemented – also ethical [24, 25].

  A summary of the main research challenges are:
    • developing an intelligent agent approach that supports natural language dialogues with
      elder users that is suitable for elderly of a particular culture; the evaluation therefore
      requires human subjects of different cultures to ensure that cultural adaptation works
      well for different cultures as well as ensuring that the dialogues are suitable specifically
      for elder users;
    • connecting the agent technology with existing smart living environments and smart city
      infrastructures, so that dialogues are appropriately situated;
    • adding features for the intelligent agents to give emotional support for the users as well as
      care for their overall health (which includes doing physical exercises, taking medication,
      etc.);
    • ensure that access to medical data used in dialogues with the users are ethical and that
      data about living routines of the users provided to doctors are respectful of privacy.
    • verifying formally that dialogues will never lead to unethical or culturally inappropriate
      interactions.
To address these challenges, our vision builds on a number of technologies:

    • Smart-environment and smart-city infrastructures. Since the Guides accompany
      the elderly wherever they are, we need to access data from smart environment sensors
      as well as inter-operate in “systems of systems" in the context for smart cities, and in
      particular with hospital systems; we will rely on available standards for this, and connect
      them to our multi-agent systems infrastructure to allow interconnection of Guides of



                                               137
Rafael H. Bordini et al.                                                                  135–146


      different people as well as between Guides and existing systems. To this aim we will exploit
      the lessons we learned while engineering systems that integrate ambient intelligence/IoT
      on the one hand, and agents/MAS on the other [26, 27, 28]. Besides existing work
      emerged from the autonomous agents community, in order to immerse the Guides in a
      smart environment we will also consider the potential offered by open and configurable
      frameworks like FIWARE2 . Albeit not being an agent-oriented infrastructure, FIWARE
      presents many features worth exploring: it has demonstrated its industrial strength
      in many smart* application domains including healthcare, it implements distributed
      smart components that interact asynchronously via message passing, and may be in
      principle integrated with (or “under”) JaCaMo, to provide access to the surrounding smart
      environment via a standard API.
    • NLP profiling techniques and voice-based interaction. All the interactions between
      Guides and humans will be through spoken dialogue in natural languages; although
      existing tools will be used, in our vision we call for a seemless integration between out-of-
      the-box voice-based human-computer interaction tools and the sophisticated culturally
      adaptive AI techniques described below, which address the communication level in a
      broad sense.
    • Big data and computer vision. We need to have summary information from the relevant
      data for the various activities the Guides will accompany the user, for supporting medical
      staff about the ongoing health state of the user, as well as symbolic representation of the
      surroundings of the user; again we plan to use out-of-the-box techniques for this but
      connected to our approach on representing environments for autonomous agents.
    • Planning and reasoning. To provide useful information and support, and to engage
      in complex dialogues, we rely on various formal techniques such as non-monotonic
      reasoning, logic programming, and automated planning, adapted to the context of tran-
      scultural smart-environment elder care. The literature on adoption of formal techniques
      for modelling and implementing agent planning and reasoning mechanisms is vast and
      many recent proposals may be taken under consideration for being integrated into the
      Guides. They include, for example, extensions of goal-based plans used in BDI program-
      ming languages to encapsulate both proactive and reactive behaviour, which supports
      agent reasoning at runtime [29], contextual planning for multiple agents in ambient
      intelligence environments, useful for making the plans developed by the Guides aware
      of the surrounding smart environment [30, 31, 32], dynamic goal decomposition and
      planning in scenarios characterized by a strong inter-dependency between action and
      context, needed to cope with unexpected, or even catastrophic, events [33], automated
      synthesis of a library of template-based process models that achieve goals in dynamic
      and partially specified environments, which are exactly the kind of environments where
      the Guides will operate [34].
    • Ontologies. Ontologies will provide the necessary vocabulary (in various languages and
      also in accordance with different cultures) to be used in the multi-agent dialogues that
      the Guides will be able to engage. Normally the Guides only dialogue with their user, but
      for example in medical consultations the Guides may need to participate in multi-agent
    2
        https://www.fiware.org/, accessed on July 2020.



                                                          138
Rafael H. Bordini et al.                                                                      135–146


      dialogues with the doctor and the user. The interplay between ontologies – and semantic
      web in general – and BDI-style agents – and declarative agent approaches in general – has
      been studied for a long time [35]. Our experience ranges from design and development of
      ontologies in the health domain [36, 37, 38] to their integration into AgentSpeak [13, 39],
      into MAS via CArtAgO artifacts [40], and into data-aware commitment-based MAS [41].
      We will exploit this experience to provide the Guides with the semantic layer required
      to boost their interaction with users. One further advantage of using ontologies is that
      they could suitably cope with the dynamism that characterizes the application domain,
      due not only to the dynamism of the environment, but also to the cultural specificity
      of the elderly people. Many works on ontology evolution have been proposed in the
      literature [42], including those connecting ontology evolution and belief revision that
      seem extremely relevant for our research [43].
      Finally, to make ontologies suitable to different cultures, profiles, ages, and genders, but
      still interoperable, we plan to exploit our background on upper ontologies [44, 45] and
      design ontologies in such a way that they have some upper layer shared among them,
      and specialized sub-ontologies for different users and tasks.
    • Argumentation. The core of the transcultural component of our vision are argumenta-
      tion protocols based on argumentation schemes (i.e., patterns of reasoning and dialogue
      exchange); these are used to decide the utterances of the Guides when engaged in dia-
      logues. This is possible in practice given long-term work on the integration of Argumen-
      tation Theory techniques into Jason and JaCaMo for both reasoning and communication
      [14, 46, 47]. Also, the development of an argumentation-based inference mechanism for
      BDI agents based on Toulmin’s model of argumentation [48] recently put forward [49]
      can be used as an alternative basis for this part of our investigation.
    • Theory of mind. “An individual has a theory of mind if he imputes mental states to himself
      and others. A system of inferences of this kind is properly viewed as a theory because such
      states are not directly observable, and the system can be used to make predictions about the
      behavior of others” [50]. The theory of mind is the ability to attribute mental states – beliefs,
      intents, desires, emotions, knowledge, etc. – to oneself and to others. Its philosophical
      roots include the work by Dennet [51] that is very well known to researchers working
      on BDI-oriented agent theories, languages and architectures. With aging, cognitive
      abilities including theory of mind seem to decline [52, 53], and cultural factors impact its
      development as well [54]. Based on these observations, another fundamental aspect of
      our vision is that we are able to model the minds of users through formal representation of
      their beliefs and intentions. Current dialogue systems have no such representation and the
      literature in the area makes it clear that without such a representation, intelligent systems
      cannot fully address the needs of their users. Our existing framework for theory of mind
      relies on standard rationality assumptions. Based on our previous, recent investigations
      [55, 56, 15] we aim at doing pioneering multi-disciplinary work on modelling the minds
      of elderly and their culture, in particular what are the most appropriate ways to infer
      beliefs and intentions of users given what they communicate. This is clearly specific to
      the elderly public and different cultures, specially as the elder might have debilitating
      diseases that compromise their cognitive processes or even for cultural reasons may want
      to conceal certain states of mind.



                                                 139
Rafael H. Bordini et al.                                                                    135–146


    • Organisations. Our approach also provides the ability to represent the various organisa-
      tions that the users are part of (for example elderly clubs, hospitals, former employees,
      etc.) and this too needs to be adapted to support the different cultural systems where the
      organisations are situated. By integrating MOISE [57], JaCaMo already supports the spec-
      ification and implementation of organizations [58], and the research on the exploitation
      of organizations in MAS is still very active [59, 60].
    • Runtime verification. Because the basis of our work is formal, this also allows us to
      employ Runtime Verification (RV) techniques to ensure that Guides never make dialogue
      utterances that are unethical or inappropriate for the elderly or for a particular culture.
      RV can also be used at a lower, IoT, level, to check that what sensors transmit is in line
      with some known pattern recognised as “normal behaviour”, to raise an alarm if sensory
      inputs deviates from that pattern. Runtime verification engines based on computational
      logic, like RML3 [61] and the trace expressions formalism it builds on [62, 63, 64, 65] are
      a promising direction to address this challenge, and are integrated with Jason [66].

   Clearly, to evaluate the results of this research, we will need a multidisciplinary team to inter-
act with elderly users, including geriatricians, as well as psychologists, sociologists interested
in population aging and philosophers interested in ethical AI systems.


3. Conclusions
This short paper presents the preliminary results of a feasibility study that the authors carried out
looking for an answer to the question: “How can we address the growing need of transcultural
health-aware tools and technologies for aging people?”. We believe that the integration of
existing IoT and smart-* approaches can help providing a very effective, pervasive and reliable
“sensing layer”, on top of which intelligent software agents can be designed and implemented,
and can provide the “intelligence layer” needed to implement a cross-cultural Guide. The MAS
infrastructure adds a further “intelligent coordination layer” to the architecture. The proper
management of emotional aspects is part of this intelligence layer, as the theory of multiple
intelligence suggests [67], and a natural interaction interface is the means to reduce the barriers
between the users and the Guide.


References
 [1] M. Wooldridge, N. R. Jennings, Intelligent agents: theory and practice, Knowledge Eng.
     Review 10 (1995) 115–152. doi:10.1017/S0269888900008122.
 [2] J. Bates, The role of emotion in believable agents, Commun. ACM 37 (1994) 122–125. URL:
     https://doi.org/10.1145/176789.176803. doi:10.1145/176789.176803.
 [3] Y. Shoham, Agent-oriented programming, Artif. Intell. 60 (1993) 51–92. URL: https:
     //doi.org/10.1016/0004-3702(93)90034-9. doi:10.1016/0004-3702(93)90034-9.
 [4] D. Pereira, E. C. Oliveira, N. Moreira, Formal modelling of emotions in BDI agents, in:
     F. Sadri, K. Satoh (Eds.), Computational Logic in Multi-Agent Systems, 8th International
    3
        https://rmlatdibris.github.io/.



                                                140
Rafael H. Bordini et al.                                                                  135–146


     Workshop, CLIMA VIII, Porto, Portugal, September 10-11, 2007. Revised Selected and
     Invited Papers, volume 5056 of LNCS, Springer, 2007, pp. 62–81. URL: https://doi.org/10.
     1007/978-3-540-88833-8_4. doi:10.1007/978-3-540-88833-8_4.
 [5] B. Alfonso, E. Vivancos, V. J. Botti, Toward formal modeling of affective agents in a BDI
     architecture, ACM Trans. Internet Techn. 17 (2017) 5:1–5:23. URL: https://doi.org/10.1145/
     3001584. doi:10.1145/3001584.
 [6] Y. Su, B. Hu, Y. Dai, J. Rao, A computationally grounded model of emotional bdi-agents, in:
     D. Huang, V. Bevilacqua, P. Premaratne, P. Gupta (Eds.), Intelligent Computing Theories
     and Application - 14th International Conference, ICIC 2018, Wuhan, China, August 15-
     18, 2018, Proceedings, Part I, volume 10954 of LNCS, Springer, 2018, pp. 444–453. URL:
     https://doi.org/10.1007/978-3-319-95930-6_41. doi:10.1007/978-3-319-95930-6_41.
 [7] A. Croatti, S. Montagna, A. Ricci, E. Gamberini, V. Albarello, V. Agnoletti, BDI
     personal medical assistant agents: The case of trauma tracking and alerting, Artif.
     Intell. Medicine 96 (2019) 187–197. URL: https://doi.org/10.1016/j.artmed.2018.12.002.
     doi:10.1016/j.artmed.2018.12.002.
 [8] S. Costantini, A. Tocchio, Strips-like planning in the DALI logic programmming language,
     in: G. Armano, F. D. Paoli, A. Omicini, E. Vargiu (Eds.), WOA 2003: Dagli Oggetti agli
     Agenti. 4th AI*IA/TABOO Joint Workshop "From Objects to Agents": Intelligent Systems
     and Pervasive Computing, 10-11 September 2003, Villasimius, CA, Italy, Pitagora Editrice
     Bologna, 2003, pp. 115–120.
 [9] S. M. Khan, Y. Lespérance, SR-APL: a model for a programming language for rational
     BDI agents with prioritized goals, in: L. Sonenberg, P. Stone, K. Tumer, P. Yolum (Eds.),
     10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS
     2011), Taipei, Taiwan, May 2-6, 2011, Volume 1-3, IFAAMAS, 2011, pp. 1251–1252. URL:
     http://portal.acm.org/citation.cfm?id=2034511&CFID=69154334&CFTOKEN=45298625.
[10] S. Sardiña, Y. Lespérance, Golog speaks the BDI language, in: L. Braubach, J. Briot,
     J. Thangarajah (Eds.), Programming Multi-Agent Systems - 7th International Workshop,
     ProMAS 2009, Budapest, Hungary, May 10-15, 2009. Revised Selected Papers, volume
     5919 of LNCS, Springer, 2009, pp. 82–99. URL: https://doi.org/10.1007/978-3-642-14843-9_6.
     doi:10.1007/978-3-642-14843-9_6.
[11] R. H. Bordini, J. F. Hübner, M. Wooldridge, Programming Multi-Agent Systems in AgentS-
     peak using Jason, Wiley Series in Agent Technology, John Wiley & Sons, 2007.
[12] O. Boissier, R. H. Bordini, J. F. Hübner, A. Ricci, A. Santi, Multi-agent oriented programming
     with jacamo, Sci. Comput. Program. 78 (2013) 747–761. URL: https://doi.org/10.1016/j.scico.
     2011.10.004. doi:10.1016/j.scico.2011.10.004.
[13] V. Mascardi, D. Ancona, M. Barbieri, R. H. Bordini, A. Ricci, CooL-AgentSpeak: Endowing
     AgentSpeak-DL agents with plan exchange and ontology services, Web Intelligence and
     Agent Systems 12 (2014) 83–107. URL: https://doi.org/10.3233/WIA-140287. doi:10.3233/
     WIA-140287.
[14] A. R. Panisson, S. Parsons, P. McBurney, R. H. Bordini, Choosing appropriate argu-
     ments from trustworthy sources, in: S. Modgil, K. Budzynska, J. Lawrence (Eds.),
     Computational Models of Argument - Proceedings of COMMA 2018, Warsaw, Poland,
     12-14 September 2018, volume 305 of Frontiers in Artificial Intelligence and Applica-
     tions, IOS Press, 2018, pp. 345–352. URL: https://doi.org/10.3233/978-1-61499-906-5-345.



                                               141
Rafael H. Bordini et al.                                                                 135–146


     doi:10.3233/978-1-61499-906-5-345.
[15] A. R. Panisson, S. Sarkadi, P. McBurney, S. Parsons, R. H. Bordini, On the formal semantics
     of theory of mind in agent communication, in: M. Lujak (Ed.), Agreement Technologies
     - 6th International Conference, AT 2018, Bergen, Norway, December 6-7, 2018, Revised
     Selected Papers, volume 11327 of LNCS, Springer, 2018, pp. 18–32. URL: https://doi.org/10.
     1007/978-3-030-17294-7_2. doi:10.1007/978-3-030-17294-7_2.
[16] A. Lentzas, D. Vrakas, Non-intrusive human activity recognition and abnormal behavior
     detection on elderly people: a review, Artificial Intelligence Review (2019) 1–47.
[17] A. Hariharan, S. Sourab, V. S. Varshini, I. Rajpal, S. M. George, Remote fall detection
     system for the elderly, in: 2019 2nd International Conference on Intelligent Computing,
     Instrumentation and Control Technologies (ICICICT), volume 1, IEEE, 2019, pp. 870–874.
[18] V. Balas, V. Solanki, R. Kumar, M. Ahad (Eds.), A Handbook of Internet of Things in
     Biomedical and Cyber Physical System, Springer, 2020.
[19] C. Murphey, D. Um, Development of a sleep monitoring system by using a depth sensor:
     A pilot study, Advances in Human Factors and Ergonomics in Healthcare and Medical
     Devices 957 (2019) 191.
[20] S. Modgil, Reasoning about preferences in argumentation frameworks, Artificial intelli-
     gence 173 (2009) 901–934.
[21] T. Gruber, Ontologies, Encyclopedia of Database Systems (2008) 1959–1959.
[22] B. Stigall, J. Waycott, S. Baker, K. Caine, Older adults’ perception and use of voice user
     interfaces: A preliminary review of the computing literature, in: Proceedings of the 31st
     Australian Conference on Human-Computer-Interaction, 2019, pp. 423–427.
[23] Z. Huang, J. Epps, D. Joachim, V. Sethu, Natural language processing methods for acoustic
     and landmark event-based features in speech-based depression detection, IEEE Journal of
     Selected Topics in Signal Processing (2019).
[24] High-Level Expert Group on AI, Ethics guidelines for trustworthy AI, 2019. URL: https:
     //ec.europa.eu/digital-single-market/en/news/ethics-guidelines-trustworthy-ai.
[25] The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems (Ed.), Ethically
     Aligned Design: A Vision for Prioritizing Human Well-being with Autonomous and
     Intelligent Systems, IEEE, 2019. URL: https://standards.ieee.org/content/ieee-standards/
     en/industry-connections/ec/autonomous-systems.html.
[26] A. Casals, A. Belbachir, A. E. Fallah-Seghrouchni, A. A. F. Brandão, Fostering agent cooper-
     ation in AmI: A context-aware mechanism for dealing with multiple intentions, in: J. D. Ser,
     E. Osaba, M. N. Bilbao, J. J. S. Medina, M. Vecchio, X. Yang (Eds.), Intelligent Distributed
     Computing XII, 12th International Symposium on Intelligent Distributed Computing, IDC
     2018, Bilbao, Spain, 15-17 October 2018, volume 798 of Studies in Computational Intelli-
     gence, Springer, 2018, pp. 225–234. URL: https://doi.org/10.1007/978-3-319-99626-4_20.
     doi:10.1007/978-3-319-99626-4_20.
[27] A. Freitas, D. Schmidt, A. R. Panisson, R. H. Bordini, F. Meneguzzi, R. Vieira, Applying
     ontologies and agent technologies to generate ambient intelligence applications, in: F. Koch,
     F. Meneguzzi, K. Lakkaraju (Eds.), Agent Technology for Intelligent Mobile Services and
     Smart Societies - Workshop on Collaborative Agents, Research and Development, CARE
     2014, and Workshop on Agents, Virtual Societies and Analytics, AVSA 2014, Held as Part
     of AAMAS 2014, Paris, France, May 5-9, 2014. Revised Selected Papers, volume 498 of



                                               142
Rafael H. Bordini et al.                                                                   135–146


     Communications in Computer and Information Science, Springer, 2014, pp. 22–33. URL:
     https://doi.org/10.1007/978-3-662-46241-6_3. doi:10.1007/978-3-662-46241-6_3.
[28] C. E. Pantoja, H. D. Soares, J. Viterbo, T. Alexandre, A. E. Fallah-Seghrouchni, A. Casals, Ex-
     posing IoT objects in the internet using the resource management architecture, Int. J. Softw.
     Eng. Knowl. Eng. 29 (2019) 1703–1725. URL: https://doi.org/10.1142/S0218194019400175.
     doi:10.1142/S0218194019400175.
[29] R. H. Bordini, R. Collier, J. F. Hübner, A. Ricci, Encapsulating reactive behaviour in goal-
     based plans for programming BDI agents: Extended abstract, in: A. E. F. Seghrouchni,
     G. Sukthankar, B. An, N. Yorke-Smith (Eds.), Proceedings of the 19th International Con-
     ference on Autonomous Agents and Multiagent Systems, AAMAS ’20, Auckland, New
     Zealand, May 9-13, 2020, International Foundation for Autonomous Agents and Multiagent
     Systems, 2020, pp. 1783–1785. URL: https://dl.acm.org/doi/abs/10.5555/3398761.3398981.
[30] R. Boukharrou, A. Chaouche, A. E. Fallah-Seghrouchni, J. Ilié, D. Saïdouni, Dealing with
     temporal failure in ambient systems: a dynamic revision of plans, J. Ambient Intell.
     Humaniz. Comput. 6 (2015) 325–336. URL: https://doi.org/10.1007/s12652-015-0266-y.
     doi:10.1007/s12652-015-0266-y.
[31] A. Casals, A. E. Fallah-Seghrouchni, A. A. F. Brandão, C. E. Pantoja, J. Viterbo, Resource-
     dependent contextual planning in ami, in: E. M. Shakshuki, A. Yasar (Eds.), The 10th
     International Conference on Ambient Systems, Networks and Technologies (ANT 2019)
     / The 2nd International Conference on Emerging Data and Industry 4.0 (EDI40 2019) /
     Affiliated Workshops, April 29 - May 2, 2019, Leuven, Belgium, volume 151 of Procedia
     Computer Science, Elsevier, 2019, pp. 485–492. URL: https://doi.org/10.1016/j.procs.2019.04.
     066. doi:10.1016/j.procs.2019.04.066.
[32] A. Chaouche, A. E. Fallah-Seghrouchni, J. Ilié, D. Saïdouni, Learning from situated
     experiences for a contextual planning guidance, J. Ambient Intell. Humaniz. Com-
     put. 7 (2016) 555–566. URL: https://doi.org/10.1007/s12652-016-0342-y. doi:10.1007/
     s12652-016-0342-y.
[33] S. Costantini, G. D. Gasperis, Dynamic goal decomposition and planning in MAS for highly
     changing environments, in: P. Felli, M. Montali (Eds.), Proceedings of the 33rd Italian
     Conference on Computational Logic, Bolzano, Italy, September 20-22, 2018, volume 2214
     of CEUR Workshop Proceedings, CEUR-WS.org, 2018, pp. 40–54. URL: http://ceur-ws.org/
     Vol-2214/paper4.pdf.
[34] A. Marrella, Y. Lespérance, A planning approach to the automated synthesis of template-
     based process models, Service Oriented Computing and Applications 11 (2017) 367–392.
     URL: https://doi.org/10.1007/s11761-017-0215-z. doi:10.1007/s11761-017-0215-z.
[35] V. Mascardi, J. A. Hendler, L. Papaleo, Semantic web and declarative agent languages and
     technologies: Current and future trends - (position paper), in: M. Baldoni, L. A. Dennis,
     V. Mascardi, W. W. Vasconcelos (Eds.), Declarative Agent Languages and Technologies X -
     10th International Workshop, DALT 2012, Valencia, Spain, June 4, 2012, Revised Selected
     Papers, volume 7784 of LNCS, Springer, 2012, pp. 197–202. URL: https://doi.org/10.1007/
     978-3-642-37890-4_12. doi:10.1007/978-3-642-37890-4_12.
[36] D. C. Engelmann, J. Couto, V. de Oliveira Gabriel, R. Vieira, R. H. Bordini, Towards
     an ontology to support decision-making in hospital bed allocation (S), in: A. Perku-
     sich (Ed.), The 31st International Conference on Software Engineering and Knowl-



                                                143
Rafael H. Bordini et al.                                                                    135–146


     edge Engineering, SEKE 2019, Hotel Tivoli, Lisbon, Portugal, July 10-12, 2019, KSI Re-
     search Inc. and Knowledge Systems Institute Graduate School, 2019, pp. 71–74. URL:
     https://doi.org/10.18293/SEKE2019-130. doi:10.18293/SEKE2019-130.
[37] A. Ferrando, S. Beux, V. Mascardi, P. Rosso, Identification of disease symptoms in mul-
     tilingual sentences: An ontology-driven approach, in: D. Ienco, M. Roche, S. Romeo,
     P. Rosso, A. Tagarelli (Eds.), Proceedings of the First Workshop on Modeling, Learning
     and Mining for Cross/Multilinguality (MultiLingMine 2016) co-located with the 38th
     European Conference on Information Retrieval (ECIR 2016), Padova, Italy, March 20,
     2016, volume 1589 of CEUR Workshop Proceedings, CEUR-WS.org, 2016, pp. 6–15. URL:
     http://ceur-ws.org/Vol-1589/MultiLingMine1.pdf.
[38] L. D. Lauretis, S. Costantini, I. Letteri, An ontology to improve the first aid service quality,
     in: 2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019, Bari,
     Italy, October 6-9, 2019, IEEE, 2019, pp. 1479–1483. URL: https://doi.org/10.1109/SMC.2019.
     8914460. doi:10.1109/SMC.2019.8914460.
[39] Á. F. Moreira, R. Vieira, R. H. Bordini, J. F. Hübner, Agent-oriented programming with
     underlying ontological reasoning, in: M. Baldoni, U. Endriss, A. Omicini, P. Torroni
     (Eds.), Declarative Agent Languages and Technologies III, Third International Workshop,
     DALT 2005, Utrecht, The Netherlands, July 25, 2005, Selected and Revised Papers, volume
     3904 of LNCS, Springer, 2005, pp. 155–170. URL: https://doi.org/10.1007/11691792_10.
     doi:10.1007/11691792_10.
[40] A. Freitas, A. R. Panisson, L. Hilgert, F. Meneguzzi, R. Vieira, R. H. Bordini, Integrating
     ontologies with multi-agent systems through CArtAgO artifacts, in: IEEE/WIC/ACM
     International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT
     2015, Singapore, December 6-9, 2015 - Volume II, IEEE Computer Society, 2015, pp. 143–150.
     URL: https://doi.org/10.1109/WI-IAT.2015.116. doi:10.1109/WI-IAT.2015.116.
[41] S. Costantini, G. D. Gasperis, Exchanging data and ontological definitions in multi-agent-
     contexts systems, in: N. Bassiliades, P. Fodor, A. Giurca, G. Gottlob, T. Kliegr, G. J. Nalepa,
     M. Palmirani, A. Paschke, M. Proctor, D. Roman, F. Sadri, N. Stojanovic (Eds.), Proceedings
     of the RuleML 2015 Challenge, the Special Track on Rule-based Recommender Systems for
     the Web of Data, the Special Industry Track and the RuleML 2015 Doctoral Consortium
     hosted by the 9th International Web Rule Symposium (RuleML 2015), Berlin, Germany,
     August 2-5, 2015, volume 1417 of CEUR Workshop Proceedings, CEUR-WS.org, 2015. URL:
     http://ceur-ws.org/Vol-1417/paper12.pdf.
[42] F. Zablith, G. Antoniou, M. d’Aquin, G. Flouris, H. Kondylakis, E. Motta, Ontology evolution:
     a process-centric survey, The knowledge engineering review 30 (2015) 45–75.
[43] G. Flouris, On belief change in ontology evolution, AI Communications 19 (2006) 395–397.
[44] V. Mascardi, V. Cordì, P. Rosso, A comparison of upper ontologies, in: M. Baldoni,
     A. Boccalatte, F. D. Paoli, M. Martelli, V. Mascardi (Eds.), WOA 2007: Dagli Oggetti agli
     Agenti. 8th AI*IA/TABOO Joint Workshop "From Objects to Agents": Agents and Industry:
     Technological Applications of Software Agents, 24-25 September 2007, Genova, Italy,
     Seneca Edizioni Torino, 2007, pp. 55–64. URL: http://woa07.disi.unige.it/papers/mascardi.
     pdf.
[45] V. Mascardi, A. Locoro, P. Rosso, Automatic ontology matching via upper ontologies:
     A systematic evaluation, IEEE Trans. Knowl. Data Eng. 22 (2010) 609–623. URL: https:



                                                144
Rafael H. Bordini et al.                                                                      135–146


     //doi.org/10.1109/TKDE.2009.154. doi:10.1109/TKDE.2009.154.
[46] A. R. Panisson, R. H. Bordini, Argumentation schemes in multi-agent systems: A social
     perspective, in: A. E. Fallah-Seghrouchni, A. Ricci, T. C. Son (Eds.), Engineering Multi-
     Agent Systems - 5th International Workshop, EMAS 2017, Sao Paulo, Brazil, May 8-9,
     2017, Revised Selected Papers, volume 10738 of LNCS, Springer, 2017, pp. 92–108. URL:
     https://doi.org/10.1007/978-3-319-91899-0_6. doi:10.1007/978-3-319-91899-0_6.
[47] A. R. Panisson, F. Meneguzzi, M. S. Fagundes, R. Vieira, R. H. Bordini, Formal semantics of
     speech acts for argumentative dialogues, in: A. L. C. Bazzan, M. N. Huhns, A. Lomuscio,
     P. Scerri (Eds.), International conference on Autonomous Agents and Multi-Agent Systems,
     AAMAS ’14, Paris, France, May 5-9, 2014, IFAAMAS/ACM, 2014, pp. 1437–1438. URL:
     http://dl.acm.org/citation.cfm?id=2617511.
[48] S. E. Toulmin, The uses of argument, Cambridge university press, 2003.
[49] V. de Oliveira Gabriel, A. R. Panisson, R. H. Bordini, D. F. Adamatti, C. Z. Billa, Reasoning
     in BDI agents using toulmin’s argumentation model, Theor. Comput. Sci. 805 (2020) 76–91.
     URL: https://doi.org/10.1016/j.tcs.2019.10.026. doi:10.1016/j.tcs.2019.10.026.
[50] D. Premack, G. Woodruff, Does the chimpanzee have a theory of mind?, Behavioral and
     Brain Sciences 1 (1978) 515–526. doi:10.1017/S0140525X00076512.
[51] D. C. Dennett, The Intentional Stance, MIT Press, Cambridge, MA, USA, 1989.
[52] S. Bottiroli, E. Cavallini, I. Ceccato, T. Vecchi, S. Lecce, Theory of mind in aging: Comparing
     cognitive and affective components in the faux pas test, Archives of Gerontology and
     Geriatrics 62 (2016) 152–162.
[53] S. Lecce, I. Ceccato, A. Rosi, F. Bianco, S. Bottiroli, E. Cavallini, Theory of mind plasticity in
     aging: The role of baseline, verbal knowledge, and executive functions, Neuropsychological
     rehabilitation 29 (2019) 440–455.
[54] A. Shahaeian, M. Nielsen, C. C. Peterson, V. Slaughter, Cultural and family influences on
     children’s theory of mind development: A comparison of australian and iranian school-age
     children, Journal of Cross-Cultural Psychology 45 (2014) 555–568.
[55] S. Sarkadi, A. R. Panisson, R. H. Bordini, P. McBurney, S. Parsons, Towards an approach for
     modelling uncertain theory of mind in multi-agent systems, in: M. Lujak (Ed.), Agreement
     Technologies - 6th International Conference, AT 2018, Bergen, Norway, December 6-7,
     2018, Revised Selected Papers, volume 11327 of LNCS, Springer, 2018, pp. 3–17. URL:
     https://doi.org/10.1007/978-3-030-17294-7_1. doi:10.1007/978-3-030-17294-7_1.
[56] S. Sarkadi, A. R. Panisson, R. H. Bordini, P. McBurney, S. Parsons, M. Chapman, Modelling
     deception using theory of mind in multi-agent systems, AI Commun. 32 (2019) 287–302.
     URL: https://doi.org/10.3233/AIC-190615. doi:10.3233/AIC-190615.
[57] M. Hannoun, O. Boissier, J. S. Sichman, C. Sayettat, MOISE: an organizational model
     for multi-agent systems, in: M. C. Monard, J. S. Sichman (Eds.), Advances in Artificial
     Intelligence, International Joint Conference, 7th Ibero-American Conference on AI, 15th
     Brazilian Symposium on AI, IBERAMIA-SBIA 2000, Atibaia, SP, Brazil, November 19-
     22, 2000, Proceedings, volume 1952 of LNCS, Springer, 2000, pp. 156–165. URL: https:
     //doi.org/10.1007/3-540-44399-1_17. doi:10.1007/3-540-44399-1_17.
[58] M. R. Zatelli, A. Ricci, J. F. Hübner, Integrating interaction with agents, environment,
     and organisation in JaCaMo, Int. J. Agent Oriented Softw. Eng. 5 (2016) 266–302. URL:
     https://doi.org/10.1504/IJAOSE.2016.10001865. doi:10.1504/IJAOSE.2016.10001865.



                                                 145
Rafael H. Bordini et al.                                                                   135–146


[59] R. C. Cardoso, T. Krausburg, T. L. Baségio, D. C. Engelmann, J. F. Hübner, R. H. Bordini,
     SMART-JaCaMo: an organization-based team for the multi-agent programming contest,
     Ann. Math. Artif. Intell. 84 (2018) 75–93. URL: https://doi.org/10.1007/s10472-018-9584-z.
     doi:10.1007/s10472-018-9584-z.
[60] A. Ricci, A. Ciortea, S. Mayer, O. Boissier, R. H. Bordini, J. F. Hübner, Engineering scalable
     distributed environments and organizations for MAS, in: E. Elkind, M. Veloso, N. Agmon,
     M. E. Taylor (Eds.), Proceedings of the 18th International Conference on Autonomous
     Agents and MultiAgent Systems, AAMAS ’19, Montreal, QC, Canada, May 13-17, 2019,
     International Foundation for Autonomous Agents and Multiagent Systems, 2019, pp. 790–
     798. URL: http://dl.acm.org/citation.cfm?id=3331770.
[61] L. Franceschini, RML: runtime monitoring language: a system-agnostic DSL for runtime
     verification, in: S. Marr, W. Cazzola (Eds.), Conference Companion of the 3rd International
     Conference on Art, Science, and Engineering of Programming, Genova, Italy, April 1-4,
     2019, ACM, 2019, pp. 28:1–28:3. URL: https://doi.org/10.1145/3328433.3328462. doi:10.
     1145/3328433.3328462.
[62] D. Ancona, D. Briola, A. E. Fallah-Seghrouchni, V. Mascardi, P. Taillibert, Efficient verifica-
     tion of mass with projections, in: F. Dalpiaz, J. Dix, M. B. van Riemsdijk (Eds.), Engineering
     Multi-Agent Systems - Second International Workshop, EMAS 2014, Paris, France, May
     5-6, 2014, Revised Selected Papers, volume 8758 of LNCS, Springer, 2014, pp. 246–270. URL:
     https://doi.org/10.1007/978-3-319-14484-9_13. doi:10.1007/978-3-319-14484-9_13.
[63] D. Ancona, D. Briola, A. Ferrando, V. Mascardi, Global protocols as first class entities for
     self-adaptive agents, in: AAMAS, ACM, 2015, pp. 1019–1029.
[64] D. Ancona, A. Ferrando, V. Mascardi, Parametric runtime verification of multiagent
     systems, in: AAMAS, ACM, 2017, pp. 1457–1459.
[65] A. Ferrando, D. Ancona, V. Mascardi, Decentralizing MAS monitoring with DecAMon, in:
     AAMAS, ACM, 2017, pp. 239–248.
[66] D. Ancona, S. Drossopoulou, V. Mascardi, Automatic generation of self-monitoring mass
     from multiparty global session types in jason, in: M. Baldoni, L. A. Dennis, V. Mascardi,
     W. W. Vasconcelos (Eds.), Declarative Agent Languages and Technologies X - 10th Interna-
     tional Workshop, DALT 2012, Valencia, Spain, June 4, 2012, Revised Selected Papers, volume
     7784 of LNCS, Springer, 2012, pp. 76–95. URL: https://doi.org/10.1007/978-3-642-37890-4_5.
     doi:10.1007/978-3-642-37890-4_5.
[67] H. Gardner, Frames of Mind: The Theory of Multiple Intelligences, 1983.




                                               146