<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Exploring Barriers and Challenges to Accessibility in Virtual Laboratories: A Preliminary Review</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Fitsum Deriba</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mohammed Saqr</string-name>
          <email>mohammed.saqr@uef.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Markku Tukiainen</string-name>
          <email>markku.tukiainen@uef.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>The University of Eastern Finland, School of Computing</institution>
          ,
          <addr-line>Yliopistonkatu 2, 80100 Joensuu</addr-line>
          ,
          <country country="FI">Finland</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Virtual laboratories (VL) have become an essential tool for educational sectors, allowing students to develop practical skills in a remote environment. However, the accessibility of VL remains a significant challenge for learners. This research paper aimed to investigate the accessibility barrier in VL and explores potential solutions to overcome them. To achieve this, we conducted a comprehensive literature review spanning from 1997 to 2023, focusing on the accessibility of VL. Our search was conducted solely on the Scopus database, resulting in 164 papers, from which we carefully selected 21 primary studies for detailed analysis. The result indicates still there is high barrier to accessing VL. Based on the analysis, we identified four major barriers: technological, infrastructural, pedagogical, and cultural. To address the issues, a range of solutions have been proposed. These findings highlight the critical need to tackle accessibility barriers in VL, thereby enabling all students to have equal opportunities to develop their practical skills.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Virtual laboratories</kwd>
        <kwd>learning analytics</kwd>
        <kwd>Accessibility barriers</kwd>
        <kwd>Remote laboratories</kwd>
        <kwd>Educational technology</kwd>
        <kwd>Online learning</kwd>
        <kwd>Accessible learning</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>In recent years, technology has significantly shaped the education sector in several ways [1], [2].
For example, by improving access; through online classes [3], providing educational applications
[4], and digitalizing textbooks [5], students learn from anywhere at any time, without the
constraints of geography. In the learning process, doing laboratory experiments is one of the vital
parts of education. This enhances students with hands-on experience and allows them to physically
interact with equipment and materials to work together in groups, fostering teamwork and
collaboration [6]. However, there are several limitations to traditional laboratories. First, to run
hand-on the experiment they need physical space and equipment [7], which are expensive to
maintain and update education, especially for students who do not have access to a well-equipped
laboratory [8]. Second, students must physically be present in the laboratory to complete their
experiments, making it challenging for all students to access the same opportunities [9]. Third,
some physical laboratories specifically chemical and biomedical labs need safety and act according
to guidelines [10] due to the laboratories contain a range of hazardous materials such as acids,
bases, flammable liquids, and toxic gases. This leads to various accidents like explosions, and
chemical burns [11]. For example, Lu Zisheng [12] analyzed student laboratory accidents in China
in colleges and universities. According to the study, 197 safety accidents have happened in the past
39 years. They identified explosions, fire, radiation, chemical burn, electric injuries, and dangerous
gas poisoning as the main accidents in the labs. Fourth, most traditional labs are designed to test
specific hypotheses or theories [13] which leads students to miss a vital component of the
experiment or required hardware [14]. Finally, the physical constraint of lab size [15] is the main
issue.</p>
      <p>One of the most promising technologies to solve these issues is the development of VL [16], [17].
These labs allow students to conduct experiments with real-world experiments without the need for
physical equipment [18]. For instance, a smart science lab [19], is one of the most known virtual
labs for science education which uses videos, images, text, and interactive elements to provide
lessons taught by real teachers. The lab incorporates different subjects such as biology, chemistry,
and physics. This opened new possibilities for students who have no access to traditional
laboratories or who have limited resources [20]. As a result, it appeared as an innovative way to
supply practical training and experience to students as well as emerged as a solution to traditional
lab issues. In addition, VL provide a safe environment for students to conduct experiments without
the risk of injury or damage to equipment [21]. For example, in chemistry, VL are used to simulate
experiments involving chemical reactions, titrations, and other practical applications that are too
dangerous in traditional laboratories. Due to several advantages, these labs have been increasing
usage dramatically over the past several years [22].</p>
      <p>However, there are also important considerations to keep in mind when using VL and other
tools, such as issues of accessibility and usability [23]. P A Hatherly et al. [24] argued that
implementing a VL seeks to address the issues of the suitability of an activity for students who are
geographically remote. Similarly, the study of B Balamuralithara [25] identifies, most VL lack
realistic GUI and so that the effectiveness of the labs depends on user interactivity. Many studies
have investigated and developed a virtual tool for various disciplines [26][27], but a thorough
investigation is required to determine whether these tools provide the necessary experimental
objectives, particularly in terms of accessibility [28]. Therefore, this paper aims to review the issues
of accessibility in VL in the education sector. The main goal of our study is to provide insights into
how to improve accessibility in VL for computing disciplines. To achieve this goal, the following
research question were defined:
 RQ: What are the barriers to accessibility in VL in computing disciplines, and how can
they can be overcome ?</p>
      <p>The paper is organized as follows: The background section provides an overview of VL across
different disciplines and the challenges of accessibility within them. The method section describes
the process of developing the protocol, including the eligibility criteria, information source, search
strategy, study selection process, data extraction, and synthesizing. The result section presents an
overview of the selected studies, including accessibility barriers and how they were overcome. The
discussion section analyzes the findings of the study and their implications. Lastly, the conclusion
section summarizes the main findings and suggests future studies.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Method 2.1.</title>
    </sec>
    <sec id="sec-3">
      <title>Protocol</title>
      <p>We developed our protocol using the methodological framework proposed by Arksey and
O'Malley [29] for reviews. The protocol in the study consists of eligibility criteria, an information
source, and search strategy, a study selection, data extraction, and synthesizing.
2.2.</p>
    </sec>
    <sec id="sec-4">
      <title>Eligibility criteria</title>
      <p>To be included in this review, papers must meet the following eligibility criteria: 1)
peerreviewed journal articles, conference proceedings, or book chapters that report on original research;
2) papers that focus on VL designed to enhance accessibility; 3) studies that involve students,
teachers, or other educational stakeholders who use or implement VL for enhancing accessibility; 4)
papers that identify and describe barriers to accessibility in VL; 5) papers that propose or evaluate
solutions to overcome the identified barriers to accessibility; and 6) papers written in English.
2.3.</p>
    </sec>
    <sec id="sec-5">
      <title>Information source and search strategy</title>
      <p>To identify relevant studies, we conducted a literature search using the search terms ("virtual
laboratory" AND "accessib*" ) search with title, abstract, and keyword in the Scopus database.
Scopus was chosen due to the extensive range and nature of the research [29]. The search strategy
was not limited by study design, year, and we initially aimed to include all fields of research or
domains. However, we limited the search to the field of education.
2.4.</p>
    </sec>
    <sec id="sec-6">
      <title>Study selection</title>
      <p>The study selection process began by importing the search results into our online systematic
review software, Rayyan [30]. The inclusion criteria were developed a priori and imported into the
software to screen a total of 164 studies based on their titles and abstracts for level 1 screening. An
abstraction reading of 117 was performed and full-text articles were screened during level 2
screening using the same inclusion and exclusion criteria then reducing the result paper to 32.</p>
      <p>I
d
e
n
t
i
f
i
c
a
t
i
o
n
S
c
r
e
e
n
i
n
g
E
l
i
g
i
b
i
l
i
t
y
I
n
c
l
u
d
e
d</p>
      <p>DB</p>
      <p>N=164 retrieved from Scopus</p>
      <p>N=117 record screened at
level 1
N=32 record screened at level 2</p>
      <p>N=29 full text assessed for
eligibility</p>
      <p>N=21 studies included




</p>
      <p>N=47 excluded
Not related to the domain (n=38)
Review paper (n=6)
Non-English language (=3)
N=85 excluded
Not related to computing fields
N=3 excluded</p>
      <p>Not full text available
</p>
      <p>N= 8 excluded</p>
      <p>Not related to RQ</p>
      <p>After the final screening process, 29 articles were identified as potentially relevant and were
subjected to full-text review. However, after a thorough analysis, only 21 primary studies were
included (Table 1) , as 8 papers that were not related to the research question were excluded.
2.5.</p>
    </sec>
    <sec id="sec-7">
      <title>Data extraction</title>
      <p>We extracted data on several study characteristics from the included studies, including the
authors, year of study, the objective of the study, identified barriers to the accessibility of the
platform, and technique or tools implemented to overcome these obstacles.</p>
      <sec id="sec-7-1">
        <title>To present an approach to establish a cyber-physical remote laboratory that enables universal access to physical experimental platforms in engineering education from any location.</title>
        <p>To propose and implement a virtual laboratory model
that enables students to conduct practical work in IT
using cloud computing technology.</p>
      </sec>
      <sec id="sec-7-2">
        <title>To develop a remote laboratory facility for universities</title>
        <p>that assists students in acquiring practical skills essential
to their future careers.</p>
        <p>Building open virtual cloud lab for
advanced education in networks and
security</p>
      </sec>
      <sec id="sec-7-3">
        <title>To evaluate the features and capabilities of Apache VCL,</title>
        <p>a virtual cloud platform, and provide insights on
implementation costs through performance testing.
A Cloud-Based Architecture for Robotics
Virtual Laboratories</p>
      </sec>
      <sec id="sec-7-4">
        <title>To propose a three-layer architecture for virtual</title>
        <p>laboratories in robotics projects for higher education
institutions.</p>
        <p>Development of a virtualized networking
lab using GNS3 and VMware
workstation</p>
      </sec>
      <sec id="sec-7-5">
        <title>To develop a virtual lab that addresses hardware and</title>
        <p>accessibility constraints in physical networking labs,
facilitating better teaching experiences.</p>
        <p>Enhancing a virtual security lab with a
private cloud framework</p>
      </sec>
      <sec id="sec-7-6">
        <title>To integrate OpenNebula into the Tele-Lab platform,</title>
        <p>creating a more flexible, scalable, and faster virtual
laboratory environment for cybersecurity training.
Initial design principles for an
educational, on-line information security
laboratory</p>
      </sec>
      <sec id="sec-7-7">
        <title>To propose design principles for e-learning platforms,</title>
        <p>specifically online information security labs, through a
systematic process.</p>
        <p>V-lab: A mobile, cloud-based virtual
laboratory platform for hands-on
networking courses</p>
      </sec>
      <sec id="sec-7-8">
        <title>A distributed virtual laboratory architecture for cybersecurity training</title>
      </sec>
      <sec id="sec-7-9">
        <title>A distributed virtual computer security lab</title>
      </sec>
      <sec id="sec-7-10">
        <title>VTE: The Virtual Training Environment: Advanced virtual lab authoring and delivery</title>
      </sec>
      <sec id="sec-7-11">
        <title>To propose and evaluate the effectiveness of V-Lab, a cloud-based virtual laboratory that offers physical flexibility and can be remotely accessed by both desktop and mobile users.</title>
      </sec>
      <sec id="sec-7-12">
        <title>To provide a remote virtual lab system for hands-on IT</title>
        <p>security training, accessible to everyone, to overcome the
challenge of teaching practical-based system or network
security, traditionally reliant on physical computer labs at
universities.</p>
      </sec>
      <sec id="sec-7-13">
        <title>To create a distributed virtual computer security lab environment for distance students, overcoming the limitations of virtual computer labs.</title>
      </sec>
      <sec id="sec-7-14">
        <title>To present the design and function of the Virtual Training Environment (VTE) virtual lab system, which includes descriptions of both student and lab author user experiences.</title>
      </sec>
      <sec id="sec-7-15">
        <title>Security in Tele-Lab - Protecting an</title>
        <p>
          online virtual lab for security training
To provide a comprehensive infrastructure for a remote
virtual computing lab and its secure operation for
handson IT security trainin
          <xref ref-type="bibr" rid="ref6">g.
2021</xref>
          2021
2020
2017
2017
2017
2016
2013
2013
2012
2011
2011
2010
2009
        </p>
      </sec>
      <sec id="sec-7-16">
        <title>To introduce a new approach for teaching TCP/IP networking in computer network courses through an efficient open virtual networking environment based on virtualization technology.</title>
        <p>To develop Virtual Lab (VL), an experimental system that 2008
enhances education and research in wireless network
technologies.</p>
        <p>
          Teaching experiences with a virtual To describe how the Open Networ
          <xref ref-type="bibr" rid="ref22">k Laboratory (ONL), a 2007</xref>
          network laboratory virtual network laboratory, can achieve the objectives of
a modern networking laboratory course and enhance
students' understanding of fundamental networking
concepts.
        </p>
        <p>A combined virtual and remotely
accessible microprocessor laboratory</p>
      </sec>
      <sec id="sec-7-17">
        <title>REAL: A virtual laboratory for mobile robot experiments Creating a virtual network laboratory</title>
        <p>
          To create a remote-access microprocessor lab t
          <xref ref-type="bibr" rid="ref23">hat offers 2004</xref>
          the same features as a traditional lab, serving as a virtual
alternative for distance education students.
        </p>
        <p>To provide remote access to a mobile robots 2003
infrastructure through a virtual laboratory called REAL
(Remotely Accessible Laboratory).</p>
        <p>
          To develop a virtual network laborator
          <xref ref-type="bibr" rid="ref25">y that students can 1997</xref>
          access remotely, eliminating constraints such as time,
geography, and cost in networking education.
2.6.
        </p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>Data synthesize</title>
      <p>The aim of data synthesis is to provide a concise overview of the outcomes obtained from the
primary studies, which can effectively address the research questions. Considering the research
objectives and the chosen primary studies, this paper is categorized as a qualitative study, and a
descriptive synthesis of the gathered data was carried out. We examined both the individual studies
and the collective set of studies as a whole.</p>
    </sec>
    <sec id="sec-9">
      <title>3. Result and Discussion</title>
      <p>This section outlines the results obtained from the 21 selected primary studies. First, we provide
relevant descriptive statistics of the selected studies and their characteristics. Additionally, we
present the responses to the research questions based on our analysis.
conference</p>
      <p>Journal</p>
    </sec>
    <sec id="sec-10">
      <title>Overview of selected studies</title>
      <p>Based on our study, we obtained the included studies from various sources, including 17
conferences, and 4 journals. Our search was not restricted by year, resulting in the inclusion of
papers published between 1997 and 2022. Figure 2 shows the year-wise distribution of the studies
included in our analysis.
3.2. RQ: What are the barriers to accessibility in virtual laboratories
in computing disciplines and how can they be overcome?</p>
      <p>In this study, we used a qualitative approach to summarize the findings of selected primary
studies. The primary studies that were analyzed identified four themes of accessibility barriers and
proposed solutions for accessing VL, including technological, architectural, pedagogical, and
cultural barriers (Table 2). From a technological perspective, security threats, and compatibility
issues were significant barriers that made it challenging to conduct experiments in the labs (e.g.,
[36], [46]). Technical complexity and complicated setups also discouraged participation, especially
among individuals who lacked technical expertise or access to reliable equipment. Additionally,
real-time feedback and assessment posed challenges for learning due to technological issues (e.g.,
[31]). This issue becomes critical because students without real-time assessment and feedback may
struggle to apply the theoretical concepts they have learned. Furthermore, some studies highlighted
design-related issues (e.g., [32]), such as the lack of reliable design, limited customization, and
failure to include design principles in the configuration. To address these issues, different solutions
and strategies were proposed and implemented, such as including universal design principles (e.g.,
[40]), incorporating realistic simulations (e.g., [31]), and integrating different technologies and
frameworks for realistic feedback and compatibility issues (e.g., [32], [37], [47]). Although advanced
technological solutions are still required, these proposed solutions and strategies have the potential
to mitigate the identified accessibility barriers.
1. Technological
2. Infrustractural
3. Pedagogical
4. Cultural</p>
      <sec id="sec-10-1">
        <title>Identified Barriers</title>
      </sec>
      <sec id="sec-10-2">
        <title>Studies</title>
        <p>[31], [33], [34], [35], [36], [41], [46], [49], [51]
[36], [37], [38], [39], [42], [44], [47], [48], [50]
[32], [36], [37], [39], [40], [45], [46], [47]
[32], [48]</p>
        <p>More than one-third of the studies ([36], [37], [38], [39], [42], [44], [47], [48], [50]) identified
limited funding for laboratory development as an infrastructural challenge. According to their
findings, this limitation results in outdated and less effective VL environments that negatively
impact student learning due to the unavailability of the latest technology and equipment.
Additionally, the lack of high-specification servers with massive processing capabilities to host all
the virtual machines (e.g., [39]) results in slow performance and response delays due to limited
internet connectivity and bandwidth (e.g., [47], [48]). To address these issues, some studies (e.g.,
[31], [38], [39], [46]) proposed offering VL that do not require expensive hardware or infrastructure
and increasing the number of physical laboratory spaces available as the best solution.</p>
        <p>Pedagogically, a lack of well-specified pedagogical approaches and principles (e.g., [40]) was
identified as a hindrance to the learning process when teaching complex concepts. Similarly, the
reliance on mathematical models (e.g., [36]) and a long learning curve (e.g., [47]) were key issues
found. These challenges restrict students from opportunities for exploration and experimentation
and make it difficult to assess their performance. To solve the issues primary studies proposed a
variety of solutions, for instance, integrating VL experiences into existing courses and curricula
(e.g., [49]).</p>
        <p>While most studies focused on three main themes, some also identified cultural barriers (e.g.,
[32], [48]) related to misconceptions and trust issues with laboratory platforms. To address these
issues, studies proposed promoting the benefits of VL and encouraging experimentation with
technology. Although these studies showed encouraging results in mitigating barriers, most were
unable to evaluate the long-term effectiveness of the proposed solutions or their impact on students'
overall educational experiences. Therefore, further research is needed to assess the usability
features of developed tools and evaluate the long-term effectiveness of these strategies. Overall, our
review highlights the importance of addressing accessibility barriers in VL to ensure that all
students have access to educational opportunities.</p>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>4. Conclusion and Future work</title>
      <p>The way in which students learn about and interact with technology has the potential to be
completely transformed by VL. However, accessibility barriers make it difficult to fully utilize these
services. Our paper identifies several accessibility barriers and proposed remedy to VL in four
themes, including technological, infrastructural, pedagogical, and cultural themes. The study's
results have significant contributions to various stakeholders, such as educators, researchers, and
educational institutions. They can use these findings to develop strategies, laboratory frameworks,
tools that are accessible to educators. By addressing these barriers, the VL becomes more accessible,
enable all students to engage and learn from these important resources. This research has broader
implications for promoting accessible learning opportunities for students, not only in computing
disciplines but also in other fields. The study acknowledges that there is still work to be done to
make VL fully accessible, and suggests future work to explore existing virtual platforms and their
usability features to further address accessibility barriers.
5. References</p>
      <p>M. Ocaña, H. Khosravi, and A. Bakharia, “Profiling language learners in the big data era,” in
36th International Conference of Innovation, Practice and Research in the Use of Educational
Technologies in Tertiary Education: Personalised Learning. Diverse Goals. One Heart, ASCILITE
2019, 2019, pp. 237–245. [Online]. Available:
https://www.scopus.com/inward/record.uri?eid=2-s2.085088509381&amp;partnerID=40&amp;md5=1cda4e9b05fc767737fc7e9186342ce1
J. J. Serrano-Perez et al., “Traditional vs. virtual laboratories in health sciences education,” J.
Biol. Educ., vol. 57, no. 1, pp. 36–50, 2023, doi: 10.1080/00219266.2021.1877776.</p>
      <p>M. Juergensmeyer and S. A. Adetunji, “Safety in Chemical and Biomedical Laboratories:
Guidelines for the Use of Head Covers by Female Muslim Scientists,” Appl. Biosaf., vol. 27,
no. 1, pp. 1–6, 2022, doi: 10.1089/apb.2021.0015.</p>
      <p>T. Olewski and M. Snakard, “Challenges in applying process safety management at
university laboratories,” J. Loss Prev. Process Ind., vol. 49, pp. 209–214, 2017.</p>
      <p>Z. Lu, “Analysis of China students’ laboratory accidents in the past 39 years and the
laboratory management reform in the future,” Educ. Chem. Eng., vol. 42, pp. 54–60, 2023, doi:
10.1016/j.ece.2022.12.001.</p>
      <p>P. A. Kirschner and M. A. M. Meester, “The laboratory in higher science education: Problems,
premises and objectives,” High. Educ., vol. 17, no. 1, pp. 81–98, 1988.</p>
      <p>F. Lustig, P. Brom, P. Kuriscak, and J. Dvorak, “‘Hands-on-Remote’ Laboratories,” in Lecture
Notes in Networks and Systems, vol. 47, Faculty of Mathematics and Physics, Charles
University, Prague, Czech Republic: Springer, 2019, pp. 118–127. doi:
10.1007/978-3-31995678-7_13.</p>
      <p>
        F. Dinc, A. De, A. Goins, T. Halic, M. Massey, and F. Yarberry, “ARChem: Augmented Reality
Based Chemistry LAB Simulation for Teachin
        <xref ref-type="bibr" rid="ref6">g and Assessment,” in 2021</xref>
        19th International
Conference on Information Technology Based Higher Education and Trainin
        <xref ref-type="bibr" rid="ref6">g, ITHET 2021</xref>
        , 2021.
doi: 10.1109/ITHET50392.2021.9759587.
      </p>
      <p>W.-K. Chiu, “Pedagogy of emerging technologies in chemical education during the era of
digitalization and artificial intelligence: a systematic review,” Educ. Sci., vol. 11, no. 11, 2021,
doi: 10.3390/educsci11110709.</p>
      <p>R. Elmoazen, M. Saqr, M. Khalil, and B. Wasson, “Learning analytics in virtual laboratories: a
systematic literature review of empirical research,” Smart Learn. Environ., vol. 10, no. 1, pp.
1–20, 2023.</p>
      <p>
        A. Van den Beemt, S. Groothuijsen, L. Ozkan, and W. Hendrix, “Remote labs in higher
engineering education: engaging students with active learning pedagogy,” J. Comput. H
        <xref ref-type="bibr" rid="ref2">igh.
Educ., 2022</xref>
        , doi: 10.1007/s12528-022-09331-4.
“Smart Science Labs | Virtual Science Labs for Elementary, Middle &amp; High School Education.”
https://www.smartscience.online/ (accessed Feb. 27, 2023).
      </p>
      <p>H. Birkeland, M. Khalil, and B. Wasson, “Learning analytics in collaborative online lab
environments: A systematic scoping review,” Companion Proc. 12th, vol. 92, 2022.
K. Aljuhani, M. Sonbul, M. Althabiti, and M. Meccawy, “Creating a Virtual Science Lab (VSL):
the adoption of virtual labs in Saudi schools,” Smart Learn. Environ., vol. 5, pp. 1–13, 2018.
S. López-Pernas et al., “Educational Data Virtual Lab: Connecting the Dots Between Data
Visualization and Analysis,” IEEE Comput. Graph. Appl., vol. 42, no. 5, pp. 76–83, 2022.
M. Khalil, J. Wong, M. Baars, F. Zafar, and B. Wasson, “Evaluating the Usability of a Study
Support Mobile App for Higher Education,” in World Conference on Mobile and Contextual
Learning, 2019, pp. 85–93.</p>
      <p>P. A. Hatherly, S. E. Jordan, and A. Cayless, “Interactive screen experiments—innovative
virtual laboratories for distance learners,” Eur. J. Phys., vol. 30, no. 4, p. 751, 2009.
B. Balamuralithara and P. C. Woods, “Virtual laboratories in engineering education: The
simulation lab and remote lab,” Comput. Appl. Eng. Educ., vol. 17, no. 1, pp. 108–118, 2009.
F. J. Agbo, S. S. Oyelere, J. Suhonen, and T. H. Laine, “Co-design of mini games for learning
computational thinking in an online environment,” Educ. Inf. Technol., vol. 26, no. 5, pp.
5815–5849, 2021, doi: 10.1007/s10639-021-10515-1.</p>
      <p>F. J. Agbo, S. S. Oyelere, J. Suhonen, and M. Tukiainen, “Design, development, and evaluation
of a virtual reality game-based application to support computational thinking,” Educ.
[28]
[29]
[30]
[31]
[32]
[33]
[34]
[35]
[36]
[37]
[38]
[39]
[40]
[41]
[42]
[43]
[44]
[45]</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Technol. Res. Dev.</surname>
          </string-name>
          ,
          <year>2022</year>
          , doi: 10.1007/s11423-022-10161-5.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>I. Grout</surname>
          </string-name>
          , “
          <article-title>Towards a Universally Accessible Laboratory for the Teaching and Learning of Electronic</article-title>
          and Computer Engineering BT - Online
          <source>Engineering and Society 4</source>
          .0,”
          <year>2022</year>
          , pp.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Soc. Res. Methodol.</surname>
          </string-name>
          , vol.
          <volume>8</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>19</fpage>
          -
          <lpage>32</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>N.</given-names>
            <surname>Johnson</surname>
          </string-name>
          and M. Phillips, “
          <article-title>Rayyan for systematic reviews,”</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Electron</surname>
          </string-name>
          . Resour. Librariansh., vol.
          <volume>30</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>46</fpage>
          -
          <lpage>48</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <given-names>P.</given-names>
            <surname>Li</surname>
          </string-name>
          , “
          <article-title>Redesigning Cyber Security Labs with Immediate Feedback,” in ASEE Annual Conference</article-title>
          and Exposition,
          <source>Conference Proceedings</source>
          ,
          <year>2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <given-names>G.</given-names>
            <surname>Londino-Smolar</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Hansel</surname>
          </string-name>
          , “
          <article-title>Let's solve it: Designing an interactive online forensic science lab,”</article-title>
          <string-name>
            <given-names>J. High. Educ. Theory</given-names>
            <surname>Pract</surname>
          </string-name>
          ., vol.
          <volume>21</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>73</fpage>
          -
          <lpage>88</lpage>
          ,
          <year>2021</year>
          , doi: 10.33423/JHETP.V21I2.4121.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <given-names>Y.</given-names>
            <surname>Gorbounov</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Chen</surname>
          </string-name>
          , “
          <article-title>Low-Cost Remote Laboratory for Cyber-Physical Experiments,” 29th Natl</article-title>
          .
          <source>Conf. with Int. Particip. TELECOM</source>
          <year>2021</year>
          , pp.
          <fpage>149</fpage>
          -
          <lpage>152</lpage>
          ,
          <year>2021</year>
          , doi: 10.1109/TELECOM53156.
          <year>2021</year>
          .
          <volume>9659620</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Gueye</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Yade</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Gueye</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Kasse</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Lishou</surname>
          </string-name>
          , “
          <article-title>Cloud and WebRTC based laboratory solution for practical work in computer science for a traditional university</article-title>
          ,” in IEEE Global Engineering Education Conference, EDUCON,
          <year>2020</year>
          , vol.
          <source>2020-April</source>
          , pp.
          <fpage>1119</fpage>
          -
          <lpage>1124</lpage>
          . doi:
          <volume>10</volume>
          .1109/EDUCON45650.
          <year>2020</year>
          .
          <volume>9125201</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>T. D. Drysdale</surname>
            ,
            <given-names>N. S. J.</given-names>
          </string-name>
          <string-name>
            <surname>Braithwaite</surname>
            , and F. de C. e
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>(UAlg F</surname>
          </string-name>
          . et al.;
          <string-name>
            <surname>Faculdade de Ciencias e Tecnologia Universidade de Coimbra (UC FCTUC); Universidade de Coimbra (UC); Universidade de Porto</surname>
          </string-name>
          ;
          <article-title>Universidade do Algarve (UAlg); Universidade do Algarve, “An internet of laboratory things</article-title>
          ,
          <source>” 4th Exp. Int. Conf. exp.at</source>
          <year>2017</year>
          , pp.
          <fpage>236</fpage>
          -
          <lpage>240</lpage>
          ,
          <year>2017</year>
          , doi: 10.1109/EXPAT.
          <year>2017</year>
          .
          <volume>7984362</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <given-names>Y.</given-names>
            <surname>Maleh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Sahid</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ezzati</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Belaissaoui</surname>
          </string-name>
          , “
          <article-title>Building open virtual cloud lab for advanced education in networks and security</article-title>
          ,” in Proceedings - 2017
          <source>International Conference on Wireless Networks and Mobile Communications, WINCOM</source>
          <year>2017</year>
          ,
          <year>2017</year>
          . doi:
          <volume>10</volume>
          .1109/WINCOM.
          <year>2017</year>
          .
          <volume>8238172</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <given-names>R.</given-names>
            <surname>Gómez-Chabla</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Real-Avilés</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Hidalgo</surname>
          </string-name>
          ,
          <article-title>A Cloud-Based Architecture for Robotics Virtual Laboratories</article-title>
          , vol.
          <volume>749</volume>
          .
          <year>2017</year>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>319</fpage>
          -67283-0_
          <fpage>17</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <given-names>R.</given-names>
            <surname>Mohtasin</surname>
          </string-name>
          et al.,
          <article-title>“Development of a virtualized networking lab using GNS3 and VMware workstation</article-title>
          ,”
          <source>2016 IEEE Int. Conf. Wirel. Commun. Signal Process. Networking, WiSPNET</source>
          <year>2016</year>
          , pp.
          <fpage>603</fpage>
          -
          <lpage>609</lpage>
          ,
          <year>2016</year>
          , doi: 10.1109/WiSPNET.
          <year>2016</year>
          .
          <volume>7566205</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <given-names>D.</given-names>
            <surname>Moritz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Willems</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Goderbauer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Moeller</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Meinel</surname>
          </string-name>
          , “
          <article-title>Enhancing a virtual security lab with a private cloud framework</article-title>
          ,”
          <source>in Proceedings of 2013 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE</source>
          <year>2013</year>
          ,
          <year>2013</year>
          , pp.
          <fpage>314</fpage>
          -
          <lpage>320</lpage>
          . doi:
          <volume>10</volume>
          .1109/TALE.
          <year>2013</year>
          .
          <volume>6654452</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <given-names>S.</given-names>
            <surname>Iqbal</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Thapa</surname>
          </string-name>
          ,
          <article-title>Initial design principles for an educational, on-line information security laboratory</article-title>
          , vol.
          <volume>8167</volume>
          LNCS.
          <year>2013</year>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>642</fpage>
          -41175-5_
          <fpage>10</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <given-names>L.</given-names>
            <surname>Xu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Huang</surname>
          </string-name>
          , W.-T. Tsai, and
          <string-name>
            <given-names>R. K.</given-names>
            <surname>Atkinson</surname>
          </string-name>
          , “
          <article-title>V-lab: A mobile, cloud-based virtual laboratory platform for hands-on networking courses,”</article-title>
          <string-name>
            <given-names>Int. J. Cyber</given-names>
            <surname>Behav</surname>
          </string-name>
          . Psychol. Learn., vol.
          <volume>2</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>73</fpage>
          -
          <lpage>85</lpage>
          ,
          <year>2012</year>
          , doi: 10.4018/ijcbpl.2012070106.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <given-names>C.</given-names>
            <surname>Willems</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Klingbeil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Radvilavicius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Cenys</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Meinel</surname>
          </string-name>
          , “
          <article-title>A distributed virtual laboratory architecture for cybersecurity training,” in 2011 International Conference for Internet Technology and Secured Transactions</article-title>
          ,
          <string-name>
            <surname>ICITST</surname>
          </string-name>
          <year>2011</year>
          ,
          <year>2011</year>
          , pp.
          <fpage>408</fpage>
          -
          <lpage>415</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <given-names>H.</given-names>
            <surname>Vranken</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Haag</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Horsmann</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Karsch</surname>
          </string-name>
          , “
          <article-title>A distributed virtual computer security lab</article-title>
          ,”
          <source>in CSEDU 2011 - Proceedings of the 3rd International Conference on Computer Supported Education</source>
          ,
          <year>2011</year>
          , vol.
          <volume>1</volume>
          , pp.
          <fpage>110</fpage>
          -
          <lpage>119</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <given-names>C. A.</given-names>
            <surname>Cois</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Beckwith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Wrubel</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Herrman</surname>
          </string-name>
          , “
          <article-title>VTE: The Virtual Training Environment: Advanced virtual lab authoring and delivery</article-title>
          ,”
          <source>in CSEDU 2010 - 2nd International Conference on Computer Supported Education, Proceedings</source>
          ,
          <year>2010</year>
          , vol.
          <volume>1</volume>
          , pp.
          <fpage>208</fpage>
          -
          <lpage>214</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <given-names>C.</given-names>
            <surname>Willems</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Dawoud</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Klingbeil</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Meinel</surname>
          </string-name>
          , “
          <article-title>Security in Tele-Lab - Protecting an online virtual lab for security training,” in International Conference for Internet Technology and Secured Transactions</article-title>
          ,
          <string-name>
            <surname>ICITST</surname>
          </string-name>
          <year>2009</year>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <given-names>D.</given-names>
            <surname>Dobrilović</surname>
          </string-name>
          , Ž. Stojanov, and
          <string-name>
            <given-names>B.</given-names>
            <surname>Odadžić</surname>
          </string-name>
          , “
          <article-title>Implementing BGP-4 protocol scenario in VNLab open networking environment,”</article-title>
          <source>in SISY 2008 - 6th International Symposium on Intelligent Systems and Informatics</source>
          ,
          <year>2008</year>
          . doi:
          <volume>10</volume>
          .1109/SISY.
          <year>2008</year>
          .
          <volume>4664933</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <given-names>D.</given-names>
            <surname>Picovici</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. V.</given-names>
            <surname>Contiu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Topa</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Nelson</surname>
          </string-name>
          , “
          <article-title>Virtual lab for wireless sensor networks</article-title>
          ,
          <source>” Adv. Electr. Comput. Eng.</source>
          , vol.
          <volume>8</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>37</fpage>
          -
          <lpage>42</lpage>
          ,
          <year>2008</year>
          , doi: 10.4316/aece.
          <year>2008</year>
          .
          <year>02007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <given-names>K.</given-names>
            <surname>Wong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Wolf</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Gorinsky</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Turner</surname>
          </string-name>
          , “
          <article-title>Teaching experiences with a virtual network laboratory,”</article-title>
          <source>in SIGCSE 2007: 38th SIGCSE Technical Symposium on Computer Science Education</source>
          ,
          <year>2007</year>
          , pp.
          <fpage>481</fpage>
          -
          <lpage>485</lpage>
          . doi:
          <volume>10</volume>
          .1145/1227310.1227473.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <given-names>H.</given-names>
            <surname>Bähring</surname>
          </string-name>
          , J. Keller, and W. Schiffmann, “
          <article-title>A combined virtual and remotely accessible microprocessor laboratory</article-title>
          ,”
          <source>in Proceedings of the 2004 Workshop on Computer Architecture Education, WCAE 2004 - Held in Conjunction with the 31st International Symposium on Computer Architecture</source>
          ,
          <source>ISCA</source>
          <year>2004</year>
          ,
          <year>2004</year>
          . doi:
          <volume>10</volume>
          .1145/1275571.1275603.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Educ.</surname>
          </string-name>
          , vol.
          <volume>46</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>37</fpage>
          -
          <lpage>42</lpage>
          ,
          <year>2003</year>
          , doi: 10.1109/TE.
          <year>2002</year>
          .
          <volume>804404</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Y.-J. Lee</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Ma</surname>
            ,
            <given-names>D. H. C.</given-names>
          </string-name>
          <string-name>
            <surname>Du</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          <string-name>
            <surname>Schnepf</surname>
          </string-name>
          , and IEEE, “
          <article-title>Creating a virtual network laboratory</article-title>
          ,
          <source>” Proc. 1997 IEEE Int. Conf. Multimed. Comput. Syst. ICMCS</source>
          , pp.
          <fpage>642</fpage>
          -
          <lpage>643</lpage>
          ,
          <year>1997</year>
          , [Online]. Available: https://www.scopus.com/inward/record.uri?eid=
          <fpage>2</fpage>
          -
          <lpage>s2</lpage>
          .
          <fpage>0</fpage>
          -
          <lpage>0030672467</lpage>
          &amp;partnerID=
          <volume>40</volume>
          &amp;md5=
          <fpage>8974da4da8c8ae44e23619a0983923a7</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>