<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Exploring Greek students' intention to use Telepresence Robots in Higher Education</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Maria Perifanou</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Macedonia</institution>
          ,
          <addr-line>Egnatia 156, 546 36, Thessaloniki</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper aims to present the findings of a series of pilot studies that took place in the context of the TRinE Erasmus+ project and evaluated the potential of using Telepresence Robots (TR) in Higher Education (HE) settings in Greece. The main goal of this study was to measure the acceptance of TR based on students' feedback, after using them in class. This was achieved by deploying a Technology Acceptance Model (TAM) approach. The participants involved in the study were in total 5 HE teachers and 104 HE students. Both students and educators participated in completing a validated questionnaire, which was tailored to the technology of the TR. The findings unveiled generally positive perceptions among the in-class students regarding the usage of the TR. Moreover, the results showcased even more positive perceptions among the out-of-class students concerning TR utilization. Overall, these findings suggest that integrating TR into educational environments has the potential to foster dynamic and interactive learning environments, which could ultimately enhance student engagement and improve learning outcomes.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Telepresence Robots</kwd>
        <kwd>Distance Education</kwd>
        <kwd>Distance Learning</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The COVID-19 pandemic has been a significant catalyst for the rise of distance education even
though the need for distance education existed before this challenging period. A variety of tools
became essential as they succeeded in facilitating the remote teaching and learning processes.
Telepresence robots (TR) are among the innovative technologies that gained attention and
adoption during the pandemic as they allowed students to virtually attend classes, interact with
teachers and peers, and engage in various learning activities while physically distanced [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. TR are
mobile remote-controlled devices that represent the remote user via video and audio and their
biggest advantage lies in the possibility of users to move around a physical space, providing a more
immersive and interactive experience compared to static video conferencing or remote
communication tools [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. But how easy and useful will it be for students to use TR in various
educational contexts? Within the context of the Erasmus+ KA2 project TRinE – Telepresence Robots
in Education (Ref.:2020-1-MT01-KA227-SCH-092408) which focuses on examining how TR is
utilized in educational settings at the upper secondary and higher education levels, including
classrooms and various electronic learning environments, we conducted various pilot studies in
five countries: Greece, Iceland, Malta, Germany and Austria [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The main aim of this study was to
evaluate the effectiveness of integrating TRs into Higher Education learning environments by
examining their acceptance based on Greek students’ feedback. In the following sections of this
paper, we will briefly describe the research methodology adopted as well as the main research
findings collected in Greece.
1∗ Corresponding author.
      </p>
      <p>mariaperif@gmail.com (M. Perifanou)
0000-0002-9874-8417 (M. Perifanou)</p>
      <p>© 2024 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).</p>
    </sec>
    <sec id="sec-2">
      <title>2. “TRinE GR Pilots in Higher Education”</title>
      <sec id="sec-2-1">
        <title>2.1. The design of the “TRinE GR Pilots in HE”</title>
        <p>
          The TRinE project partners adopted the Technology Acceptance Model (TAM) approach [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ] and
followed a consistent research procedure. They collaborated with lecturers and teachers in their
respective institutions to gather data to answer the question of the effectiveness of integrating a TR
into Higher Education educational environments during the academic year 2022-2023. More
concretely, a structured data collection protocol was established, along with instructional materials
provided to both higher educators and students.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2.1.1. The TAM4Edu Framework</title>
        <p>
          In the context of our survey, which aspires to evaluate the acceptance of TR based on students’
feedback, the “TAM4Edu framework” was adopted [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. While there have been several attempts to
apply the TAM in the context of Robot-assisted Learning [
          <xref ref-type="bibr" rid="ref6 ref7 ref8">6-8</xref>
          ], the “TAM4Edu framework”
represents a novel proposal that encompasses the following parameters: a) Technology Acceptance
Modeling (red), b) Determinants of Perceived Usefulness (green), c) Determinants of Perceived Ease of
Use (yellow), d) Intercorrelated dependencies between determinants (blue).
        </p>
        <p>
          Figure 1 illustrates how these parameters interact within the “TAM4Edu framework”, providing a
comprehensive model for understanding and predicting technology acceptance in educational
contexts. After initially gathering student data through the construction of the questionnaire and
analyzing the obtained results, the most suitable questions for each determinant were identified to
ensure effective adoption of the “TAM4Edu framework” [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. Subsequently, based on statistical
analysis, 24 questions were incorporated into the survey (Table 1) [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. These questions aimed to
assess students' acceptance of technology within each determinant of the proposed framework.
Furthermore, it was adopted a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly
agree) within the framework. The sequence of questions was randomized, with certain items
intentionally reverse-coded to better detect potential disengagement in student responses.
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>2.2. Methodology</title>
      </sec>
      <sec id="sec-2-4">
        <title>2.2.1. Data Collection &amp; Instrument</title>
        <p>
          During the academic year 2022-2023, five pilot surveys were conducted in the context of the TRinE
Erasmus+ project with an average participation of 20 students from various fields in each survey.
The TR used was the Ohmni Robot [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]. The data collection took place over two days per classroom:
a Pre-Trial day and a Trial day. On the Pre-Trial day, students were first introduced to the TRinE
project and the Ohmni Robot and then they had to fill in a consent form before they start their
training on how to interact with the TR. On the Trial Day, during classroom activities, six or seven
students (depending on the duration of the lecture) interacted with the TR in a rotational manner.
Upon completion of the lessons, both the students and lecturers were asked to complete a
questionnaire. The questions were tailored to different groups of respondents: a) students who
interacted with the TR in class, b) students who used the TR outside the classroom, and c) lecturers
involved in the research. The proposed “TAM4Edu model” was separately tested on both students’
groups.
        </p>
        <p>With respect to the questionnaire, it comprised 24 main questions, utilizing a 5-point Likert scale
for measurement, as well as demographic and open-ended questions. All main questions aimed to
assess various factors including perceived usefulness, perceived ease of use, behavioral intention,
computer self-efficacy, technology anxiety, perceived enjoyment, study relevance, usability, social
interactivity, and perceived lecture attention.
2.2.2. Sample
Data collection utilized opportunity sampling inviting lecturers to participate in the study during
their lectures. Some students agreed to leave the classroom and take the role of the “remote student”
who in fact is the “TR controller”. This group of students could use the TR to attend the lecture and
engage with the other students in the classroom remotely. On the other hand, the remaining
students, the “local (in-class) students” had the opportunity to participate in the lecture
conventionally while interacting with the “remote students” through the TR. Table 2, below,
provides an overview of the participants involved in the study.</p>
        <p>A total of 109 responses were collected, with 104 students engaging with the TR to varying
extents. Among these students, 32 took control of the TR for at least twenty minutes. The majority
of respondents (74%) were identified as female. Regarding age distribution, the largest proportion
of respondents (89%) fell into the 19-24 age bracket. Notably, no missing values were detected for
any of the data items, avoiding the need for imputation.</p>
      </sec>
      <sec id="sec-2-5">
        <title>2.3. Main Results</title>
        <p>The study aimed to investigate the acceptance and effectiveness of integrating a TR in educational
settings at higher education levels and concretely at the University of Macedonia in Thessaloniki in
Greece in the context of the Erasmus + project TRinE. The results revealed generally positive
perceptions among the “local (in-class) students” and “remote (out-of-class) students” regarding
using the TR.</p>
        <p>With regards to the “local (in-class) students” views, the integration of the TR in educational
settings has been perceived as enjoyable and relevant by them, enhancing their learning
experience. More than 75% of them somewhat or strongly agreed that the TR enabled better
participation in classroom activities remotely, promoted discussion and collaboration with
classmates, and facilitated interaction with peers. In fact, many students reported feeling
comfortable and found the interaction with the TR intuitive, which aided them in completing tasks
without supervision. Among the respondents, 55% of the students agreed with this opinion, 30%
were neutral, while 15% disagreed. This suggests that while most students had a positive
experience with the TR, there remains a small group that encountered difficulties or felt less
comfortable, indicating a need for further support or training for some users. Furthermore, the
majority of them found the process of using the TR enjoyable and reported feeling attentive and
focused during the whole time involved in class activities while using the TR. Additionally, all
“local (in-class) students” indicated that they did not find the TR usage boring, nor did they
experience any nervousness towards this technology. On the contrary, opinions were divided
regarding the intuitiveness of performing tasks while interacting with the TR. While some students
found the TR easy to use and felt confident in completing tasks independently, others were less
certain. Despite some challenges, such as initial difficulties in interaction, the majority of students
recognized the TR's potential to enhance classroom activities and expressed a desire for its regular
use in future classes. They highlighted the TR's contribution to making remote participation more
accessible and engaging, underlining its significance in their studies. The overall consensus
suggests that while initial training may be necessary, the long-term benefits of using the TR justify
its continued integration into higher education learning environments.</p>
        <p>Similarly, the results revealed generally very positive perceptions among the “remote
(out-ofclass) students” regarding using the TR. Even though most of them expressed that using the TR
was not very relevant to their studies over 80% of students expressed positive sentiments towards
various aspects of the TR technology in their academic pursuits. They highlighted the importance
of TR technology in their studies, found the process of using the TR enjoyable, and felt confident in
completing tasks with minimal supervision. Furthermore, they perceived learning to operate the
TR easy and reported feeling very comfortable while using it and not so nervous. However, the
majority of them stated that they needed help to be shown how to use it while their opinions were
divided regarding the intuitiveness of operating the TR. With regards to participation, the majority
of the remote (out-of-class) students reported that the use of TR significantly enhanced their ability
to participate in classroom activities remotely, allowing them to engage more actively in
discussions and collaborative tasks. The greater part of them also stated that the TR made it
possible for them to perform class activities effectively and intuitively, with minimal learning effort
required to operate the robot. This seamless interaction helped maintain the social and
collaborative aspects of learning, fostering a sense of inclusion and participation even from a
distance. Furthermore, most students noted that using the TR increased their attentiveness and
concentration during class activities, which contributed to a more engaging learning experience.
They found the technology neither boring nor complicated suggesting its potential for regular use
in educational settings. Interestingly, all students expressed anticipation for future use of the TR
technology. Lastly, these findings underscore the positive impact of TR technology on “remote
(out-of-class) students” academic experiences and suggest a high level of acceptance and
satisfaction with its usability and functionality.</p>
        <p>The main difficulties reported by all students in the open-ended questions are the following: 1)
Network Connectivity Issues: The TR required a dedicated wireless network. Connection losses
occurred between the remote operator and the TR, requiring reconnection and provoking
difficulties in their collaboration. Problems also arose when the TR switched between wireless
networks, often resulting in signal loss and requiring manual reconnection; 2) Audio Quality
Problems: Remote operators had difficulty hearing local users when there was noise in the
laboratory due to the lack of noise cancellation functionality. Additionally, remote operators had to
wear headphones to prevent audio feedback that made communication impossible; 3) Screen
Visibility Limitations: Remote operators wanted the ability to zoom in on local users' screens in the
laboratory and vice versa. This was particularly requested by local users even when remote users
were sharing their screens.
In conclusion, this study aimed to assess the acceptance and effectiveness of integrating TR in
higher education settings. The results showed overwhelmingly positive perceptions among both
inclass and out-of-class students regarding TR use despite the technical issues occurred. These
findings suggest that integrating TR technology can foster dynamic and interactive learning
environments, potentially improving student engagement and learning outcomes. Furthermore,
ongoing statistical analysis indicates a significant relationship between the perceived ease of use of
TR and the intention to utilize it. Further details will be presented in a future paper.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Acknowledgements</title>
      <p>This publication was partially supported by Erasmus+ project “TRinE: Telepresence Robots in
Education”. Project Reference: 2020-1-MT01-KA227-SCH-092408. This publication reflects the
views only of the authors. The European Commission support for the production of this
publication does not constitute an endorsement of the contents which reflects the views only of the
authors, and the Commission cannot be held responsible for any use which may be made of the
information contained therein.</p>
    </sec>
    <sec id="sec-4">
      <title>Declaration on Generative AI</title>
      <p>During the preparation of this work, the author used “Grammarly” in order to do a grammar and
spelling check. After using this tool, the author reviewed and edited the content as needed and
took full responsibility for the publication’s content.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M.</given-names>
            <surname>Rueben</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Syed</surname>
          </string-name>
          , E. London,
          <string-name>
            <given-names>M.</given-names>
            <surname>Camarena</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Shin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.J.</given-names>
            <surname>Matarić</surname>
          </string-name>
          .
          <article-title>Long-term, inthe-wild study of feedback about speech intelligibility for k-12 students attending class via a telepresence robot</article-title>
          ,
          <source>in: Proceedings of the 2021 International Conference on Multimodal Interaction</source>
          <year>2021</year>
          , pp.
          <fpage>567</fpage>
          -
          <lpage>576</lpage>
          . doi:
          <volume>10</volume>
          .1145/3462244.3479893
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>T.</given-names>
            <surname>Wernbacher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Pfeiffer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Häfner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Buchar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Denk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>König</surname>
          </string-name>
          , C. DeRaffaele,
          <string-name>
            <given-names>A.</given-names>
            <surname>Attard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Economides</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Perifanou</surname>
          </string-name>
          . TRinE:
          <article-title>Telepresence robots in education</article-title>
          ,
          <source>in: Proceedings of the 16th annual International Technology, Education and Development Conference (INTED)</source>
          ,
          <source>IATED</source>
          <year>2022</year>
          , pp.
          <fpage>6514</fpage>
          -
          <lpage>6522</lpage>
          . doi:
          <volume>10</volume>
          .21125/inted.
          <year>2022</year>
          .1653
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M.</given-names>
            <surname>Perifanou</surname>
          </string-name>
          . “
          <article-title>TRINE 4D Pedagogical Model”: Designing teaching scenarios for using telepresence robots in education</article-title>
          ,
          <source>in: Proceedings EC-TEL 2023, 18th European Conference on Technology-Enhanced Learning. Responsive and Sustainable Educational Futures. Aveiro, Portugal</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>605</fpage>
          -
          <lpage>610</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>031</fpage>
          -42682-7_
          <fpage>49</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>F.</given-names>
            <surname>Davis</surname>
          </string-name>
          .
          <article-title>Perceived usefulness, perceived ease of use, and user acceptance of information technology</article-title>
          ,
          <source>MIS Quarterly 13. 3</source>
          (
          <year>1989</year>
          )
          <fpage>318</fpage>
          -
          <lpage>339</lpage>
          . doi:
          <volume>10</volume>
          .2307/249008
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>C. De Raffaele</surname>
          </string-name>
          .
          <article-title>Investigation and development of a tangible technology framework for highly complex and abstract concepts</article-title>
          ,
          <source>Ph.D. thesis</source>
          , Middlesex University School of Science and Technology,
          <year>2019</year>
          . URL: https://repository.mdx.ac.uk/item/888w7
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D.</given-names>
            <surname>Conti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. Di</given-names>
            <surname>Nuovo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Buono</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. Di</given-names>
            <surname>Nuovo</surname>
          </string-name>
          .
          <article-title>Robots in education and care of children with developmental disabilities: a study on acceptance by experienced and future professionals</article-title>
          .
          <source>International Journal of Social Robotics</source>
          <volume>9</volume>
          (
          <year>2017</year>
          )
          <fpage>51</fpage>
          -
          <lpage>62</lpage>
          . doi:
          <volume>10</volume>
          .1007/s12369-016-0359-6
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J. H.</given-names>
            <surname>Han</surname>
          </string-name>
          .
          <article-title>UTAUT model of pre-service teachers for telepresence robot-assisted learning</article-title>
          .
          <source>Journal of Creative Information Culture 4</source>
          . 2 (
          <year>2018</year>
          )
          <fpage>95</fpage>
          -
          <lpage>101</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>M.</given-names>
            <surname>Lei</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. M.</given-names>
            <surname>Clemente</surname>
          </string-name>
          ,
          <string-name>
            <surname>H. Liu.</surname>
          </string-name>
          <article-title>The acceptance of telepresence robots in higher education</article-title>
          .
          <source>International Journal of Social Robotics</source>
          <volume>14</volume>
          (
          <year>2022</year>
          )
          <fpage>1025</fpage>
          -
          <lpage>1042</lpage>
          . doi:
          <volume>10</volume>
          .1007/s12369-021-00837-y. Computers, volume
          <volume>3</volume>
          <source>of LAC '10</source>
          ,
          <string-name>
            <surname>Paparazzi</surname>
            <given-names>Press</given-names>
          </string-name>
          , Milan Italy,
          <year>2010</year>
          , pp.
          <fpage>422</fpage>
          -
          <lpage>431</lpage>
          . doi:
          <volume>99</volume>
          .9999/woot07-
          <fpage>S422</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>