<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Trust “in the field": Reflections on a Real-World Lab Deploying Social Robots in Childcare Settings - Abstract</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nora Weinberger</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kathrin Gerling</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jan Ole Rixen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Barbara Bruno</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Human-Computer Interaction and Accessibility (HCI), Karlsruhe Institute of Technology (KIT)</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Institute for Technology Assessment and System Analysis (ITAS), Karlsruhe Institute of Technology (KIT)</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Socially Assistive Robotics with Artificial Intelligence (SARAI) Lab, Karlsruhe Institute of Technology (KIT)</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Trust is highly relevant in human-robot interaction, particularly when it takes place in complex and dynamic social environments. Here, we give an overview of our research within the Real-World Lab Robotics-AI, an interand transdisciplinary research efort in which robots are embedded in society in long-term field research. We focus on two particularly challenging research sites, a kindergarten and an inclusive daycare, and reflect upon implications for researching and designing for trust in robots in this context.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Child-Robot Interaction</kwd>
        <kwd>Field Research</kwd>
        <kwd>Trust</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Trust in robots is a concept as fundamental as it is elusive for Human-Robot Interaction (HRI) research
[
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. A person’s trust in an AI-enabled technology, as most robots are, afects their intention to engage
with the technology [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and thus ultimately determines whether the potential benefits associated with
the new technology will translate into real gains. Research on trust in HRI, following the same path as
robotics itself, initially focused on industrial automation contexts and adults directly interacting with
the robot [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and only recently opened to socially assistive robots and their unique challenges [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        The potential benefits of integrating socially assistive robots into kindergartens are well documented
in the literature: social robots can deliver personalised and interactive learning experiences [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], thereby
improving engagement and comprehension among young children [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], and they can act and be perceived
as non-judgemental companions, aiding in the development of critical social skills and emotional
regulation [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. However, as expected, the efectiveness of social robots in these roles is heavily dependent
on the level of trust that children, educators, managers and parents place in them [
        <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
        ]. The variety
of stakeholders is only one of the challenges facing the analysis of trust in social robots in childcare
settings, alongside the dynamic and unstructured nature of the environment in which the human-robot
interactions occur, the necessarily long-term nature of the interventions and the need to properly
account for the capabilities of the stakeholders (e.g., including 3-5 year old children) when developing
measurement tools [
        <xref ref-type="bibr" rid="ref2 ref4">2, 4</xref>
        ].
      </p>
      <p>The possibility of conducting long-term research on socially assistive robotics in childcare settings
ofered by the Real-World Lab Robotics-AI project provides us with a unique opportunity to contribute
to the understanding of trust (and its evolution) on socially assistive robots “in the field”. In this position
paper, we outline the specific objectives we aim for and the methodology we intend to pursue to achieve
them.</p>
    </sec>
    <sec id="sec-2">
      <title>2. The Real-World Lab "Robotics-AI"</title>
      <p>
        The Real-World Lab Robotics-AI project involves multiple research sites, including a kindergarten and a
daycare, and follows the “Real-World Lab” paradigm [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] which seeks to bring research outside of its
usual controlled settings to enable involving society in research and mutual learning.
      </p>
      <sec id="sec-2-1">
        <title>2.1. Research Site 1: Robot-Mediated learning activities for a Kindergarten Setting</title>
        <p>One of the project partners is a kindergarten operated by a state-recognised provider of youth welfare
services, which ofers 50 spots for children aged 3 years up to school entry (see Figure 1-left). The
pedagogical focus of the kindergarten is on science and technology, as well as movement and sports.
Additionally, the kindergarten provides a cross-group bilingual program through native English-speaking
teachers. Through a years-long collaboration with KIT, the kindergarten regularly incorporates socially
assistive robots (NAO and Pepper, shown in Figure 1-right) into their activities with children. Under
teacher guidance, these robots engage children through playful activities, such as guiding them through
language learning games and physical exercises.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Research Site 2: Supporting Children in an Inclusive Daycare Setting</title>
        <p>Within the project we also cooperate with an inclusive daycare centre that cares for approximately 75
children. As an inclusive institution, the daycare is looking after both disabled and non-disabled children
who spend their daily lives together. While this inclusive approach can lead to diferent development
stages between children of similar ages, a wide age range - of one to six years - further introduces a
plethora of diferent needs and desires managed by the caregivers. Caregivers put great efort toward
the inclusion of all by e.g. including lessons in sign language in their interactions with the children
equipping both non-verbal and verbal children alike with tools to communicate with them and amongst
each other. The daycare also routinely incorporates a NAO robot to engage the children in physical
activities or storytelling sessions.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Research Objectives</title>
      <p>
        Since trust (by all involved stakeholders) is a pre-requisite for a successful robot integration in any
educational context and since the “Real-World Lab Robotics-AI" project ultimately aims at developing
and deploying social robots that can support the activities and objectives of the partner research sites,
a key objective of the project is to understand how trust in robots evolves in the two complex social
environments. Referring to established findings and naming conventions on trust in HRI settings [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],
we specifically aim to consider:
• environmental factors, namely the impact of the deployment context, including its social setting
and dynamics;
• human-related factors, including ability-based factors such as prior experience with robots and
technical competence and personal characteristics such as demographics, attitude towards robots
and, specifically, disabilities;
• robot-related factors, including the robot’s behaviour and role in the interactive activity, as well
as the perceived individual and/or community benefit.
      </p>
      <p>To address these research objectives, we have formulated the following key questions that guide our
investigation:
1. To what extent does the social environment within a kindergarten, including peer and teacher
interactions, afect children’s trust in social robots?
2. How do disabled children engage in interaction with social robots, and are there specific
adaptations that can enhance trust?
3. How do perceived educational and developmental benefits influence children’s, educators’ and
parents’ trust in social robots in early childhood education?
4. How does the nature and quality of interaction experiences between children and social robots
influence the development of trust over time?</p>
    </sec>
    <sec id="sec-4">
      <title>4. Research Methodology</title>
      <p>
        The striking diversity among our stakeholders suggests that a portfolio of research methods should be
favoured over a "one-fits-all" solution, to take into account and adjust to diferent abilities, roles and
requirements [
        <xref ref-type="bibr" rid="ref2 ref4">2, 4</xref>
        ]. The use of diferent instruments and methods, while promoting the validity of the
results, brings up the challenge of ensuring their comparability.
      </p>
      <p>Alongside the problem of how to measure trust, stands the challenge of identifying what else we
need to measure, since the real-world, peculiar and dynamic conditions of our research sites make
it non-trivial to identify the environmental and social factors that need to be modelled to obtain an
accurate picture of user trust.</p>
      <p>To address our research questions and overcome the afore-identified challenges, our project will
undertake an exploration of trust at the two research sites, examining each context both separately and
comparatively. We envision to leverage the multidisciplinary expertise within the project consortium
(including our practice partners) to utilise a mixed-methods approach attuned to each of the sites and
capture the multifaceted nature of trust by combining day-to-day observations and robot logs with
questionnaires and semi-structured interviews.</p>
      <p>Given the embedded nature of our research approach, day-to-day observations of participant
interactions with robots in combination with robot activity logs and metrics of use will lay the foundation
for work; such real-time behavioural observations (conducted and analysed by qualified experts) will
ofer insight into non-verbal indicators of trust, e.g., body language, and allow for identifying potential
correlations with contextual, social and/or robot-related events.</p>
      <p>
        These data will be supplemented by questionnaires and semi-structured interviews, regularly
exploring user trust levels. This will provide additional insight into subjective experiences and the underlying
reasons for user trust or distrust in the robots. Since valid and reliable questionnaire only exist for
adults directly interacting with robots [11], semi-structured interviews will be particularly useful with
all the adults indirectly involved in the human-robot interaction. To overcome the lack of validated
questionnaires for children [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], while looking forward to advancements from the community, we will
explore research approaches that are accessible to verbal and non-verbal children alike, facilitating
modes of participation that align with individual children’s preferences (e.g., drawing upon
augmentative and alternative communication, employing visual methods [12], and working closely with carers
and parents/guardians), and generally building on previous work on inclusive participation in our
research community [13].
      </p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions</title>
      <p>Measuring trust in socially assistive robots is an open challenge due to the varying perspectives and
expectations among diferent stakeholders, the long interaction required for the robot to reveal its
benefits and the dynamic and unstructured environment in which the human-robot interaction occurs.</p>
      <p>The Real-World Lab approach pursued in the “Real-World Lab Robotics-AI" project allows us to study
the full complexity of human-robot trust beyond the dyadic relationship between humans and robots,
particularly in the dynamically changing environments of the two diferent childcare settings.</p>
      <p>Through the project we aim to develop accessible methods to explore what trust in socially assistive
robots means to our diferent stakeholders groups, with a special emphasis on the needs of the children.
We hope that by identifying and contextualising factors of relevance, real-world labs can provide deeper
insights into the dynamics of trust in human-robot interactions in realistic social and assistive settings.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>This work was funded by the Baden-Württemberg Ministry of Science, Research and Art (MWK), via
the state digitalisation strategy digital@bw.
[11] K. E. Schaefer, Measuring trust in human robot interactions: Development of the “trust perception
scale-hri”, in: Robust intelligence and trust in autonomous systems, Springer, 2016, pp. 191–218.
[12] K. Gerling, K. Hicks, M. Kalyn, A. Evans, C. Linehan, Designing movement-based play with young
people using powered wheelchairs, in: Proceedings of the 2016 CHI Conference on Human Factors
in Computing Systems, CHI ’16, Association for Computing Machinery, New York, NY, USA, 2016,
p. 4447–4458. URL: https://doi.org/10.1145/2858036.2858070. doi:10.1145/2858036.2858070.
[13] J. Falk, A. Blumenkranz, M. Kubesch, R. Vetter, L. Hofer, C. Frauenberger, Designing diverse
pathways for participation, in: Proceedings of the CHI Conference on Human Factors in Computing
Systems, CHI ’24, Association for Computing Machinery, New York, NY, USA, 2024. URL: https:
//doi.org/10.1145/3613904.3642240. doi:10.1145/3613904.3642240.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>P. A.</given-names>
            <surname>Hancock</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. R.</given-names>
            <surname>Billings</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K. E.</given-names>
            <surname>Schaefer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. Y.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. J.</given-names>
            <surname>De Visser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Parasuraman</surname>
          </string-name>
          ,
          <article-title>A meta-analysis of factors afecting trust in human-robot interaction</article-title>
          ,
          <source>Human factors 53</source>
          (
          <year>2011</year>
          )
          <fpage>517</fpage>
          -
          <lpage>527</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>R.</given-names>
            <surname>Stower</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Calvo-Barajas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Castellano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kappas</surname>
          </string-name>
          ,
          <article-title>A meta-analysis on children's trust in social robots</article-title>
          ,
          <source>International Journal of Social Robotics</source>
          <volume>13</volume>
          (
          <year>2021</year>
          )
          <fpage>1979</fpage>
          -
          <lpage>2001</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>H.</given-names>
            <surname>Choung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>David</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ross</surname>
          </string-name>
          ,
          <article-title>Trust in ai and its role in the acceptance of ai technologies</article-title>
          ,
          <source>International Journal of Human-Computer Interaction</source>
          <volume>39</volume>
          (
          <year>2023</year>
          )
          <fpage>1727</fpage>
          -
          <lpage>1739</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>A.</given-names>
            <surname>Langer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Feingold-Polak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Mueller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Kellmeyer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Levy-Tzedek</surname>
          </string-name>
          ,
          <article-title>Trust in socially assistive robots: Considerations for use in rehabilitation</article-title>
          ,
          <source>Neuroscience &amp; Biobehavioral Reviews</source>
          <volume>104</volume>
          (
          <year>2019</year>
          )
          <fpage>231</fpage>
          -
          <lpage>239</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>P.</given-names>
            <surname>Vogt</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. De Haas</surname>
          </string-name>
          , C. De Jong, P. Baxter, E. Krahmer,
          <article-title>Child-robot interactions for second language tutoring to preschool children, Frontiers in human neuroscience 11 (</article-title>
          <year>2017</year>
          )
          <fpage>73</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D.</given-names>
            <surname>Conti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Cirasa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. Di</given-names>
            <surname>Nuovo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Di</surname>
          </string-name>
          <string-name>
            <surname>Nuovo</surname>
          </string-name>
          ,
          <article-title>“robot, tell me a tale!” a social robot as tool for teachers in kindergarten</article-title>
          ,
          <source>Interaction Studies</source>
          <volume>21</volume>
          (
          <year>2020</year>
          )
          <fpage>220</fpage>
          -
          <lpage>242</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>R.</given-names>
            <surname>Cacefo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. A.</given-names>
            <surname>Gonçalves</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Bonacin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. C.</given-names>
            dos
            <surname>Reis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Valente</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. C. C.</surname>
          </string-name>
          <article-title>Baranauskas, Children's social interactions within a socioenactive scenario</article-title>
          ,
          <source>Computers &amp; Education</source>
          <volume>176</volume>
          (
          <year>2022</year>
          )
          <fpage>104324</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>K. A.</given-names>
            <surname>Brink</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. M.</given-names>
            <surname>Wellman</surname>
          </string-name>
          ,
          <article-title>Robot teachers for children? young children trust robots depending on their perceived accuracy and agency</article-title>
          .,
          <source>Developmental Psychology</source>
          <volume>56</volume>
          (
          <year>2020</year>
          )
          <fpage>1268</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M. H.</given-names>
            <surname>Smakman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. A.</given-names>
            <surname>Konijn</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Vogt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Pankowska</surname>
          </string-name>
          ,
          <article-title>Attitudes towards social robots in education: Enthusiast, practical, troubled, sceptic, and mindfully positive</article-title>
          ,
          <source>Robotics</source>
          <volume>10</volume>
          (
          <year>2021</year>
          )
          <fpage>24</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>O.</given-names>
            <surname>Parodi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Steglich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bylund</surname>
          </string-name>
          ,
          <article-title>Real-world lab, Handbook transdisciplinary learning (</article-title>
          <year>2023</year>
          )
          <fpage>287</fpage>
          -
          <lpage>296</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>