<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Gender biases in robots for education⋆</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Laura Cesaro</string-name>
          <email>laura.cesaro@phd.unipd.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andrea Franceschini</string-name>
          <email>andrea.franceschini.2@unipd.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Silvana Badaloni</string-name>
          <email>silvana.badaloni@unipd.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Emanuele Menegatti</string-name>
          <email>emanuele.menegatti@unipd.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Antonio Rodà</string-name>
          <email>antonio.roda@unipd.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Information Engineering</institution>
          ,
          <addr-line>via Gradenigo, 6, 35131 Padova</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Elena Cornaro Center on Gender Studies, University of Padova</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Educational robotics is increasingly spreading in schools, also with the aim of fostering young women's interest in STEM disciplines, particularly in programming and Artificial Intelligence. However, it is crucial to design and select robots that resonate emotionally with female students to overcome gender stereotypes that traditionally deter them from computer science disciplines. This study explores the hypothesis that educational robots should be specifically tailored to meet the expectations and interests of female students. An experiment was conducted with 211 participants, equally divided by gender, who were asked to evaluate images of 16 diferent educational robots using a semantic diferential scale. The results reveal diferences between males and females in the attitudes and opinions towards educational robots. While both genders generally rated the robots as more masculine than feminine, female participants tended to provide higher overall scores, except for specific robots. Additionally, robots that were perceived as more feminine were often rated as simpler whereas masculine robots are associated to the words intelligent and creative, reflecting established societal stereotypes. These insights suggest that educational robots should be designed to appeal to both girls and boys, avoiding reinforcing gender stereotypes and ensuring inclusivity in STEM education. Further research is necessary to explore these attitudes and their implications for fostering a more balanced interest in STEM among both genders.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;gender biases</kwd>
        <kwd>gendered innovation</kwd>
        <kwd>gendered robots</kwd>
        <kwd>artificial intelligence</kwd>
        <kwd>educational robotics</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Women continue to be severely underrepresented in professional roles related to Artificial
Intelligencebased applications and this gap is particularly pronounced in leadership and advanced technical roles [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
The lack of diversity in AI can contribute to the design of biased algorithms and products that don’t
adequately consider the needs and the point of view of women and other underrepresented groups.
Given the importance that these applications are assuming in our society (from healthcare to criminal
justice to news and information), this imbalance risks exacerbating existing gender inequalities. The
situation appears even more concerning in perspective, given that the percentage of women choosing
to study STEM disciplines in general, and computer science in particular, continues to be low [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Some
studies have shown that playful and hands-on interventions, such as educational robotics [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and
gamified approches [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], can be a promising means to introduce females to STEM disciplines, starting
from childhood. However, it is crucial to design and select robots that resonate emotionally with female
students to overcome gender stereotypes that traditionally deter them from computer science disciplines.
It is well known that users tend to attribute, more or less explicitly, a gender to robots and gender
stereotypes can influence the approach to educational robots in various ways [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. However, the efect
that certain external characteristics of educational robots (shape, color, material, etc.) can have on users
remains little studied.
      </p>
      <p>To the best of our knowledge, this is the first study that analyzes how the external appearance of
robots influences the attitudes and opinions of female and male users, comparing a selection of 16
robots used in educational contexts. The main research questions are</p>
      <p>Q1 Are there diferences in attitudes and opinions towards educational robots across genders?
Q2 Are there educational robots that are perceived as more masculine or feminine?
After an introduction on the concept of gendered innovations and the aims of educational robotics,
we will present and discuss the preliminary results of an experiment that involved 211 participants.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Background</title>
      <sec id="sec-2-1">
        <title>2.1. Gendered innovations</title>
        <p>
          Diversity equity and inclusion dimensions of science and technology have become a highly visible and
debated theme worldwide, impacting society at every level, in many fields of knowledge. In particular
we will focus on AI and Robotics and we will analyze the relationship between AI and Robotics and our
societal goals, in particular, concerning the aspect of gender equality [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ].
        </p>
        <p>
          While the concept of bias is very broad, gender-related biases are considered an essential aspect of
fairness [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. We will focus on the gender dimension, for the following reasons [
          <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
          ]:
• numerous studies have shown that gender biases are deeply rooted in our society, so the risk that
datasets are biased concerning gender is high
• gender biases concern more or less half of the population
• in comparison with other types of bias (racial, social, etc.), it’s easier to define the categories
subject to possible discrimination
• promoting studies on gender biases in AI and robotics can facilitate the introduction of gender
knowledge into computer science/engineering courses with a twofold advantage:
1. increasing the degree of involvement of female students,
2. making male students aware of stereotypes that risk discriminating against their female
counterparts.
        </p>
        <p>
          To deal with the integration of gender principles into research an important approach consists
in developing “gendered innovation”. This term refers to the integration of gender dimension into
innovation across disciplines 1. How can scientific theories be re-designed taking into account the
gender dimension? Only a complete redefinition of the method and of the research model with new
ways of observation can re-design science in a gender perspective [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]. Science does not proceed by
progressive and continuous accumulation of truth but thanks to attempts to disprove proposed theories.
        </p>
        <p>
          So the next step should be to address the problem of how the gender dimension can be taken into
account in the content of AI and Robotics. While for AI there is a large awareness on the use of ethical
issues in developing algorithms mitigated from gender biases [
          <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
          ], for Robotics the questions are still
open on gendering social robots [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]: does gendering robots enhance acceptance by humans? Does it
reinforce gender stereotypes that amplify social inequalities?
        </p>
        <p>The challenge is to study and to understand how gender can be embodied in robots and how this
aspect can be perceived by students of diferent gender.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Educational robotics</title>
        <p>
          Educational Robotics (ER) are gaining popularity in education, allowing teachers to provide students
with engaging and stimulating learning experiences aimed at acquiring the skills needed for the future.
Several teachers are incorporating innovative technologies and teaching methods into their instructional
activities [
          <xref ref-type="bibr" rid="ref12 ref13">12, 13</xref>
          ]. The utility of ER in enhancing problem-solving skills [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], embodied learning [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ],
promoting participation and motivation, and improving subject-specific learning outcomes [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] is
demonstrated in diferent studies conducted in primary schools [17].
        </p>
        <p>ER activities are less represented in lower secondary schools, a segment that includes students aged
between 11 and 14 years. This school level has been under-explored about ER but it is essential for
promoting STEM disciplines, particularly among girls. It is widely recognized that social norms, a sense
of belonging, and personal eficacy, influence the educational and career choices of girls and boys from
an early age [18]. Girls experience a confidence gap, or dream gap [ 19], that prevents them from
imagining themselves, as adults, in male-dominated occupations. In certain countries, girls pursue
STEM careers as much as boys. However, this is not the case in many other countries. In Italy, this
gap is evident in the choice of high school: only one-third of the total number of students enrolled in a
technical-scientific high school are girls 2. This shows how initiatives are needed to support schools in
ifghting gender stereotypes. This can be achieved by promoting positive attitudes, self-eficacy beliefs,
and active behaviours towards STEM disciplines among female students in (lower and upper) secondary
schools [20] by introducing factors that could make ER more appealing to girls [21], and ofering
workshop activities instead of structured lessons [22].</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Experiment</title>
      <p>To investigate the attitudes and opinions towards a selection of educational robots across genders, we
set up a survey study presenting a list of robot images and requesting a subjective evaluation by means
of a semantic diferential scale.</p>
      <sec id="sec-3-1">
        <title>3.1. Materials and procedure</title>
        <p>The selection criteria for the educational robots have been the subject of many studies [23], covering
physical characteristics, hardware functionality, operating software systems, expected outcomes, and
other specific aspects. Additionally, educational robots can be classified based on their operational
environment (land, air, water), type of locomotion, dificulty of programming, construction requirements
(kit-based, pre-built, or ready-to-use), and more [24]. For this research, we selected robots from two
databases: the IEEE Robotics Guide 3 and the database created within the European project EARLY 4.
This preliminary selection phase led to the identification of 34 educational robots. Then, we considered
specific requirements when choosing which robots to include in the survey. In particular, we required
that the robots be:
• suitable for ages 11-14
• programmable via visual and text-based languages
• priced under 500 euros
• not requiring soldering (for kit-based robots)
• currently in production
2https://dati.istruzione.it/espscu/index.html?area=anagStu
3https://robotsguide.com/
4https://edurobots.eu/</p>
        <p>Out of 34, only 9 met the estabilished criteria. To address the underrepresentation of social and
animaloid robots in the initial selection, we expanded our search to include well-known examples
from these categories. This led to the addition of several popular models, bringing the total number of
selected robots to 16.</p>
        <sec id="sec-3-1-1">
          <title>Alvik</title>
        </sec>
        <sec id="sec-3-1-2">
          <title>Arduino</title>
          <p>RVR+</p>
        </sec>
        <sec id="sec-3-1-3">
          <title>Sphero</title>
        </sec>
        <sec id="sec-3-1-4">
          <title>Edison</title>
        </sec>
        <sec id="sec-3-1-5">
          <title>Microbric</title>
        </sec>
        <sec id="sec-3-1-6">
          <title>Root</title>
          <p>iRobot</p>
        </sec>
        <sec id="sec-3-1-7">
          <title>Thymio</title>
        </sec>
        <sec id="sec-3-1-8">
          <title>Mobsya</title>
          <p>mBot 2</p>
        </sec>
        <sec id="sec-3-1-9">
          <title>Makeblock</title>
        </sec>
        <sec id="sec-3-1-10">
          <title>Lego Spike Prime</title>
        </sec>
        <sec id="sec-3-1-11">
          <title>LEGO</title>
        </sec>
        <sec id="sec-3-1-12">
          <title>Tello edu DJI</title>
        </sec>
        <sec id="sec-3-1-13">
          <title>Petoi</title>
        </sec>
        <sec id="sec-3-1-14">
          <title>Petoi LLC</title>
        </sec>
        <sec id="sec-3-1-15">
          <title>Paro</title>
        </sec>
        <sec id="sec-3-1-16">
          <title>Paro robots</title>
        </sec>
        <sec id="sec-3-1-17">
          <title>Aibo</title>
        </sec>
        <sec id="sec-3-1-18">
          <title>Sony</title>
        </sec>
        <sec id="sec-3-1-19">
          <title>Dobot Magician</title>
        </sec>
        <sec id="sec-3-1-20">
          <title>Dobot</title>
        </sec>
        <sec id="sec-3-1-21">
          <title>Pepper</title>
        </sec>
        <sec id="sec-3-1-22">
          <title>Softbank Robotics</title>
        </sec>
        <sec id="sec-3-1-23">
          <title>Misty II</title>
        </sec>
        <sec id="sec-3-1-24">
          <title>Mistyc Robotics</title>
        </sec>
        <sec id="sec-3-1-25">
          <title>Otto</title>
        </sec>
        <sec id="sec-3-1-26">
          <title>Hp Robots Nao</title>
        </sec>
        <sec id="sec-3-1-27">
          <title>Softbank Robotics</title>
          <p>To evaluate attitudes and opinions towards robots we selected a list of 10 word pairs starting from a
longer list of 48 words identified by Bidin et al. [ 25]. Moreover, we added the two dimensions “feminine”
and “masculine” that are particularly relevant for this study, obtaining the following 12 word pairs:
complex - simple, negative - positive, boring - fun, uncreative - creative, uncurious - curious, unfeminine
- feminine, unintelligent - intelligent, uninteresting - interesting, unmasculine - masculine, unpleasant
pleasant, dangerous - safe, sad - cheerful.</p>
          <p>We prepared an online survey asking participants to rate each robot according to the above defined
semantic diferential scale. We asked the participants to provide their subjective evaluation of each
word pair on a 5-point Likert scale only showing the two terms at the respective ends of the scale 5.</p>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. Results</title>
        <p>We received 211 valid responses, with 109 respondents identifying as female and 102 as male. Table
1 reports the breakdown of the respondents’ professions, showing a majority of students followed
by a considerable cohort of teachers. In total, we collected 40512 scores, equals to 1 response for 211
participant × 16 robots × 12 word pairs.</p>
        <p>To verify the statistical significance of the diferences between mean values and the existence of
interactions between independent variables, particularly whether the gender variable significantly
influenced the evaluation of robots, we calculated a three-way ANOVA, with gender, robots and word
pairs as independent variables. The results in table 2 show a  &lt; .001 for all the interactions except for
the last one, indicating that female and male participants have diferent attitudes and opinions towards
the selected educational robots. The main diferences are detailed below.</p>
        <p>First of all, female respondents on average attributed significantly higher scores (  = 3.42,  = 1.17)
than males ( = 3.32,  = 1.10), demonstrating a rather positive attitude towards these educational
robots.</p>
        <p>Figure 2 shows the mean scores calculated for each robot across all the word pairs, including both
male and female respondents. We consider this as a “global score” of appreciation given that the
valence of the word pairs was always presented in the same direction – i.e., left, and lower values, for
negative, right, and higher values, for positive. We see that the robots that scored the lowest were Edison
( = 2.91,  = 1.08), Thymio ( = 3.09,  = 1.05), and the DJI drone ( = 3.18,  = 1.11),
while those that scored the highest were Aibo ( = 3.58,  = 1.15), Paro ( = 3.58,  = 1.21),
5See https://www.dei.unipd.it/~roda/gender-robot/question.png for a question example
and Spike ( = 3.53,  = 1.06). Overall, female participants gave higher scores than the males
to all the robots except for Aibo, Petoi, and RVR, which received a higher scores from males (with
statistical significance according to a Tukey test). Interestingly, among the three robots preferred by
males compared to females, there are two with dog-like appearances.</p>
        <p>5
4
3
d
s
±
n
a
e2
m
1
0
n
o
s
i
d
e
o
i
m
y
h
t
e
n
o
r
d
t
o
b
o
d
k
i
v
l
a
2
t
o
b
m
r
v
r
i
o
t
e
p
r
e
p
p
e
p
t
o
o
r
i
i
_
y
t
s
y
m
o
t
t
o
o
a
n
e
k
i
p
s
o
r
a
p
o
b
i
a</p>
        <p>Figure 3 shows the average score of each word pair, where a lower value corresponds to the word with
the negative valence, and vice-versa for the higher values. We see that, overall, the safety evaluation
achieved a relatively high score ( = 3.83,  = 1.06), and likewise did positivity ( = 3.66,  =
0.93), interest ( = 3.65,  = 1.09), and curiosity ( = 3.59,  = 1.07). These result imply a
general good attitudes towards these robots. Interestingly, they are considered significantly more
masculine ( = 3.15,  = 1.07) than feminine. ( = 2.60,  = 1.02).</p>
        <p>Figure 4 gives an intuitive representation of the average scores of each robot for each word pair; a
darker shade corresponds to a higher score, e.g. the light shade of Spike in the unfeminine/feminine
column corresponds to an average score equals to 2.48 (less feminine), whereas the darker shade of Root
in the dangerous/safe column corresponds to 4.46 (very safe). One prominent feature is the dangerous/safe
column where we find Alvik, Edison, Paro, Thymio, and Root scoring considerably more safe than
Nao, Petoi, Pepper, Dobot, and the DJI drone. Although we cannot find a consistent explanation for
all of these, we think that there might be some influence from factors outside the mere appearance of
these robots. For example, we sometimes associate the word “drone” with a weapon, and indeed the DJI
drone is the lowest scoring in the safety scale. Petoi resembles Boston Dynamics’ Spot which is also
associated with the Defence sector. Nao, with its athletic and articulated build, could be perceived as a
potentially harmful sci-fi robot. In figure 4, we also note the unfeminine/feminine and complex/simple
which highlight that robots considered more feminine are also perceived as more simple. There seems
to be however a coincidence of higher femininity and simplicity scores for Edison and Paro. In the case
of Paro, we think that the soft and infantile appearance of the robot plays a role. In the case of Edison,
especially if we compare it to other similar-looking robots who achieved diferent scores, we can only
imagine that the orange colour is the diferentiating factor, although this is not a particularly convincing
explanation. Pepper and Dobot appear to be more complex, and are also given higher masculine scores,
and we think this might be because they are perceived to have a more advanced functionality (social and
industrial) than other robots, such as Lego Spike, Mysty II, and RVR that scored slightly more neutral.
3
d
s
±
n
a
e
2
m
1
0
e
n
i
n
i
m
e
f
−
e
n
i
n
i
m
e
f
n
u
e
l
p
m
i
s
−
x
e
l
p
m
o
c
e
n
i
l
u
c
s
a
m
−
e
n
i
l
u
c
s
a
m
n
u
t
n
e
g
i
l
l
e
t
n
i
−
t
n
e
g
i
l
l
e
t
n
i
n
u
l
u
f
r
e
e
h
c
−
d
a
s
e
v
it
a
e
r
c
−
e
v
it
a
e
r
c
n
u
n
u
f
−
g
n
i
r
o
b
t
n
a
s
a
e
l
p
−
t
n
a
s
a
e
l
p
n
u
s
u
o
i
r
u
c
−
s
u
o
i
r
u
c
n
u
g
n
it
s
e
r
e
t
n
i
−
g
n
it
s
e
r
e
t
n
i
n
u
e
v
iit
s
o
p
−
e
v
it
a
g
e
n
e
f
a
s
−
s
u
o
r
e
g
n
a
d</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>In relation to the two main questions of this study (see 1), we have found indications of positive answers
to both questions, and, although further research is needed, we have attempted some preliminary
explanations.</p>
      <p>With respect to question 1, we found that the average global scores given by female and male
respondents to individual robots are diferent with a high level of statistical significance. Female
respondents gave overall higher scores than males except for Aibo, Petoi, and RVR, but we cannot find
a convincing explanation with the data we have collected and analyzed so far.</p>
      <p>With respect to question 2, we found that these educational robots are, on average, perceived as
having more masculine than feminine characteristics, and in fact we see that the overall score on the
femininity scale is below the mid point of the 5-points Likert scale, if only by a small amount. The
robots perceived as more feminine are Pepper, Paro, and Misty II, while those what scored higher for
masculinity are the DJI drone and MBot. We also found an odd outlier in Edison: by its shape, it should
align more with other similar robots by being perceived as more masculine, but in reality it seems to be
perceived as more feminine. As we could not find satisfying explanations for this, nor could we clearly
categorize other robots by perceived gender, we need further data and analysis.</p>
      <p>Lastly, there seems to be an association between the feminine and simple attributes on the one hand,
and between masculine, intelligent, and creative on the other hand. These associations mirror rather
unfortunate gender stereotypes present in society, and we feel that it is important to highlight this issue
so it can be accounted for, and hopefully addressed, when designing ER interventions but also in the
design of AI algorithms used to control the robots behavior.</p>
      <sec id="sec-4-1">
        <title>4.1. Limitations</title>
        <p>As we see in table 1, there is a noticeable imbalance of genders between teachers and students who
responded to our survey: teachers tend to be a majority female, while students comprise a higher
proportion of males. The teaching profession at large is often more frequently taken up by women, so
this imbalance may just reflect a societal imbalance.</p>
        <p>Our survey asked respondents to evaluate the robots based on their appearance, and we only presented
one picture per robot, often taken from promotional materials. Aspects that are not considered in this
evaluation include, for example, size, movement, voice and sounds, and facial expressions, for robots
that have a face. While it may be possible that some respondents were familiar with some of the robots,
we think that, on the balance of things, we can assume this is a small proportion, and thus not afecting
the results significantly.</p>
        <p>Lastly, the survey was only circulated among Italian respondents. We do not know whether this
might introduce cultural biases, and we hope to open up the survey to international respondents in the
future to enable us to perform a cross-cultural analysis.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>Partially funded from Next Generation EU, Mission 4 Pillar 1 CUP C53D23007970001.
s40692-017-0087-4.
[17] E. Mangina, G. Psyrra, L. Screpanti, D. Scaradozzi, Robotics in the Context of Primary and Preschool
Education: A Scoping Review, IEEE Transactions on Learning Technologies 17 (2024) 342–363.
doi:10.1109/TLT.2023.3266631.
[18] N. Ðapo, I. Čelebičić, L. Spahić, R. Binder-Hathaway, Gender Gap in the STEM Fields and Proposed
Intervention Programmes,
https://eca.unwomen.org/en/digital-library/publications/2021/8/gendergap-in-the-stem-fields-and-proposed-intervention-programmes, 2020.
[19] L. Bian, S.-J. Leslie, A. Cimpian, Gender stereotypes about intellectual ability emerge early and
influence children’s interests, Science 355 (2017) 389–391. doi: 10.1126/science.aah6524.
[20] C. Giberti, Diferenze di genere in matematica: dagli studi internazionali alla situazione italiana,
Didattica della matematica. Dalla ricerca alle pratiche d’aula (2019) 44–69. doi:10.33683/ddm.
18.5.2.
[21] B. K. Maigaard Kjaer Pedersen, B. Charlotte Weigelin, J. C. Larsen, J. Nielsen, Using educational
robotics to foster girls’ interest in STEM: A systematic review, in: 2021 30th IEEE International
Conference on Robot &amp; Human Interactive Communication (RO-MAN), 2021, pp. 865–872. doi:10.
1109/RO-MAN50785.2021.9515538.
[22] B. M. D. Bagatini, Lavorare sul genere a scuola con coding e robotica educativa, Carocci editore,
2022.
[23] S. Krause, A.-L. Henk, F. Stolzenburg, Selecting an educational robot: A comprehensive guideline,
2024.
[24] S. Evripidou, L. Doitsidis, G. Tsinarakis, Z. Zinonos, S. A. Chatzichristofis, Selecting a Robotic
Platform for Education, in: 2022 IEEE International Conference on Consumer Electronics (ICCE),
2022, pp. 1–6. doi:10.1109/ICCE53296.2022.9730568.
[25] S. A. Bidin, A. M. Lokman, W. A. R. W. M. Isa, A development of kansei words for robotic therapy
and the elderly, Environment-Behaviour Proceedings Journal 6 (2021) 63–67.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Mishra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Brynjolfsson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Etchemendy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Ganguli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Grosz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Lyons</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Manyika</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Niebles</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Sellitto</surname>
          </string-name>
          , et al.,
          <source>The ai index 2021 annual report, arXiv preprint arXiv:2103.06312</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>J.</given-names>
            <surname>Waite</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Franceschini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Sentance</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Patterson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Sharkey</surname>
          </string-name>
          ,
          <article-title>An online platform for teaching upper secondary school computer science</article-title>
          , in: United Kingdom and Ireland Computing Education Research conference.,
          <source>UKICER '21</source>
          ,
          <string-name>
            <surname>Association</surname>
          </string-name>
          for Computing Machinery, New York, NY, USA,
          <year>2021</year>
          , p.
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
          . URL: https://doi.org/10.1145/3481282.3481287. doi:
          <volume>10</volume>
          .1145/3481282.3481287.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Sullivan</surname>
          </string-name>
          , M. U. Bers,
          <article-title>Investigating the use of robotics to increase girls' interest in engineering during early elementary school</article-title>
          ,
          <source>International Journal of Technology and Design Education</source>
          <volume>29</volume>
          (
          <year>2019</year>
          )
          <fpage>1033</fpage>
          -
          <lpage>1051</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>A.</given-names>
            <surname>Franceschini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rodà</surname>
          </string-name>
          ,
          <article-title>Play to learn: from serious games to just games</article-title>
          ,
          <source>in: Proceedings of the 2023 ACM Conference on Information Technology for Social Good</source>
          , GoodIT '23,
          <string-name>
            <surname>Association</surname>
          </string-name>
          for Computing Machinery, New York, NY, USA,
          <year>2023</year>
          , p.
          <fpage>117</fpage>
          -
          <lpage>127</lpage>
          . URL: https://dl.acm.org/doi/10.1145/ 3582515.3609525. doi:
          <volume>10</volume>
          .1145/3582515.3609525.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>N.</given-names>
            <surname>Reich-Stiebert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Eyssel</surname>
          </string-name>
          ,
          <article-title>(ir) relevance of gender? on the influence of gender stereotypes on learning with a robot</article-title>
          ,
          <source>in: Proceedings of the 2017 ACM/IEEE international conference on human-robot interaction</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>166</fpage>
          -
          <lpage>176</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>R.</given-names>
            <surname>Vinuesa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Azizpour</surname>
          </string-name>
          , I. Leite,
          <string-name>
            <given-names>M.</given-names>
            <surname>Balaam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Dignum</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Domisch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Felländer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. D.</given-names>
            <surname>Langhans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Tegmark</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Fuso</surname>
          </string-name>
          <string-name>
            <surname>Nerini</surname>
          </string-name>
          ,
          <article-title>The role of artificial intelligence in achieving the sustainable development goals</article-title>
          ,
          <source>Nature communications 11</source>
          (
          <year>2020</year>
          )
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>A.</given-names>
            <surname>Fabris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Purpura</surname>
          </string-name>
          , G. Silvello,
          <string-name>
            <given-names>G. A.</given-names>
            <surname>Susto</surname>
          </string-name>
          ,
          <article-title>Gender stereotype reinforcement: Measuring the gender bias conveyed by ranking algorithms</article-title>
          ,
          <source>Information Processing &amp; Management</source>
          <volume>57</volume>
          (
          <year>2020</year>
          )
          <article-title>102377</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.ipm.
          <year>2020</year>
          .
          <volume>102377</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>S.</given-names>
            <surname>Badaloni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rodà</surname>
          </string-name>
          , et al.,
          <source>Gender knowledge and artificial intelligence</source>
          ,
          <source>in: Proceedings of the 1st Workshop on Bias</source>
          ,
          <string-name>
            <surname>Ethical</surname>
            <given-names>AI</given-names>
          </string-name>
          ,
          <article-title>Explainability and the role of Logic and Logic Programming</article-title>
          , BEWARE-
          <volume>22</volume>
          , co-located
          <source>with AIxIA</source>
          ,
          <year>2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>S.</given-names>
            <surname>Badaloni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rodà</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Scagnet</surname>
          </string-name>
          ,
          <article-title>An italian dataset for the analysis of gender stereotypes in textual documents</article-title>
          .,
          <source>in: BEWARE@ AI* IA</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>73</fpage>
          -
          <lpage>78</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>S.</given-names>
            <surname>Badaloni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. A.</given-names>
            <surname>Lisi</surname>
          </string-name>
          ,
          <article-title>Towards a gendered innovation in ai</article-title>
          ,
          <source>in: Proceedings of the AIxIA 2020 Discussion Papers Workshop co-located with the the 19th International Conference of the Italian Association for Artificial Intelligence (AIxIA2020)</source>
          , volume
          <volume>1613</volume>
          ,
          <year>2020</year>
          , p.
          <fpage>0073</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>G.</given-names>
            <surname>Beraldo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. Di</given-names>
            <surname>Battista</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Badaloni</surname>
          </string-name>
          , E. Menegatti,
          <string-name>
            <given-names>M.</given-names>
            <surname>Pivetti</surname>
          </string-name>
          ,
          <article-title>Sex diferences in expectations and perception of a social robot</article-title>
          ,
          <source>in: 2018 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO)</source>
          , IEEE,
          <year>2018</year>
          , pp.
          <fpage>38</fpage>
          -
          <lpage>43</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Malvezzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Alimisis</surname>
          </string-name>
          , M. Moro (Eds.),
          <article-title>Education in &amp; with Robotics to Foster 21st-Century Skills:</article-title>
          <source>Proceedings of EDUROBOTICS</source>
          <year>2020</year>
          , volume
          <volume>982</volume>
          <source>of Studies in Computational Intelligence</source>
          , Springer International Publishing, Cham,
          <year>2021</year>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -77022-8.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>L.</given-names>
            <surname>Cesaro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Dodero</surname>
          </string-name>
          , E. Menegatti,
          <article-title>Integrating AI into school curriculum: A maker-oriented activity</article-title>
          , in: R.
          <string-name>
            <surname>Balogh</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Obdržálek</surname>
          </string-name>
          , M. Fislake (Eds.), Robotics in Education, Springer Nature Switzerland, Cham,
          <year>2024</year>
          , pp.
          <fpage>367</fpage>
          -
          <lpage>378</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>F.</given-names>
            <surname>Gratani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Giannandrea</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Renieri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Annessi</surname>
          </string-name>
          , Fostering Students'
          <article-title>Problem-Solving Skills Through Educational Robotics in Primary School</article-title>
          , in: M.
          <string-name>
            <surname>Malvezzi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Alimisis</surname>
          </string-name>
          , M. Moro (Eds.),
          <article-title>Education in &amp; with Robotics to Foster 21st-</article-title>
          <string-name>
            <surname>Century</surname>
            <given-names>Skills</given-names>
          </string-name>
          , Springer International Publishing, Cham,
          <year>2021</year>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>S.</given-names>
            <surname>Almpani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Almisis</surname>
          </string-name>
          ,
          <article-title>Dance and robots: Designing a robotics-enhanced project for dance-based STEAM education using ENGINO</article-title>
          , in: M.
          <string-name>
            <surname>Malvezzi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Alimisis</surname>
          </string-name>
          , M. Moro (Eds.),
          <article-title>Education in &amp; with Robotics to Foster 21st-</article-title>
          <string-name>
            <surname>Century</surname>
            <given-names>Skills</given-names>
          </string-name>
          , Springer International Publishing, Cham,
          <year>2021</year>
          , pp.
          <fpage>139</fpage>
          -
          <lpage>151</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>E.</given-names>
            <surname>Fokides</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Papadakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Kourtis-Kazoullis</surname>
          </string-name>
          ,
          <article-title>To drone or not to drone? Results of a pilot study in primary school settings</article-title>
          ,
          <source>Journal of Computers in Education 4</source>
          (
          <year>2017</year>
          )
          <fpage>339</fpage>
          -
          <lpage>353</lpage>
          . doi:
          <volume>10</volume>
          .1007/
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>