<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Pandemic-Induced Constraints on Rapid Transformation to Digital Education</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Educational Technology, The Open University</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Molde University College</institution>
          ,
          <country country="NO">Norway</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Performance Augmentation Lab, Oxford Brookes University</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>Once the World Health Organization declared the COVID-19 outbreak a pandemic, many countries abruptly established a lock down requiring their populations to stay home to avoid any contact with others to stop the spread of the disease. Consequently, most schools and higher education institutions closed access to campuses and face-to-face class meetings were suspended. Students were sent home and temporarily left without access to traditional educational resources. The migratory solution for this situation is moving toward extensive use of distance learning tools and techniques. However, many teachers were not prepared for this transition. There remains a gap in knowledge about how to quickly transform educational content and manage e-teaching. In this paper, we describe the process of transforming a face-to-face course in Augmented Reality to the online format in a rapid way. We wish to establish case evidence for educators regarding how to convert traditional course content to online content, in the face of incidents, such as the COVID-19 pandemic. In this paper, we present an approach including examples and highlighting opportunities for educators in higher education to support the transformation of courses for distance learning.</p>
      </abstract>
      <kwd-group>
        <kwd>Distance Learning</kwd>
        <kwd>Disruptive Education</kwd>
        <kwd>COVID-19 Pandemic</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Motivation</title>
      <p>slow transmission through infection prevention and physical distancing have been
introduced at different points in time and at varying intensities across the globe.</p>
      <p>
        As a consequence, many educational institutions were suspending all in-person
classes and transitioning to online classes. Universities were adjusting to the new
environment to put arrangements in place that will enable students to continue and complete
their studies. However, many educational institutions were not prepared for such a step.
Teachers and educators need support and guidance to develop skills in using the
technology and tools for teaching at a distance. The technical infrastructure needs to have
the capabilities to support access to educational materials and to organize activities
online. The infrastructure needs to be flexible enough to quickly deal with the increased
demand (see a discussion of readiness, enablers, barriers, and bottlenecks in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]). While
digital education is rapidly growing in popularity, the teaching competence and
exchange of good practices in this field are still very fragmented.
      </p>
      <p>This paper addresses the gap in knowledge about how to quickly transform a course
from a face-to-face (f2f) to an online format and how to manage e-teaching in the midst
of pandemic, during the recovery, and for the second waves or similar events in the
future. We do not aim to describe how to create the best possible online learning
experience, but how to rapidly transfer a course to online with limited resources and in a
short time. We outline the pandemic-induced constraints on such a transformation,
suggest technological alternatives, and requirements for digital platforms. Our overarching
goal is to provide students with the opportunities to successfully complete their studies
even under the lockdown. At the same time, the paper is most useful for educators who
aim to transfer their teaching online to create these opportunities. The alternative
arrangements must be appropriate and deliver all necessary learning outcomes without
compromising standards or devaluing degrees. The COVID-19 pandemic is forcing
students and academics to separate physically, but this is certainly a time to learn to adapt
and to use what we have available. We wish to set an example on how to face the
challenge and develop sustainable solutions for similar incidents that can happen in the
future.</p>
      <p>We use an example of an Advanced Augmented Reality (AR) course. It is a pilot
course prepared by an international consortium of five universities in a scope of the
AR-FOR-EU project. The course was designed to be delivered in a week of intensive
f2f classes. The consortium decided to completely move the course to the online format.
The reader will find a description of this process in the paper.</p>
      <p>The paper is structured as follows. We present the current state of the art with
emphasis on constraints induced by COVID-19 pandemic in section 2. We describe the
new pandemic-induced constraints, comparing to the conditions before the pandemic
in section 3. We describe the process of transforming the course from f2f to distance
learning using as an example the Advanced AR course, including the alternatives we
identified and technology requirements in section 4. We discuss our design decisions
and present recommendations for practitioners in section 5. We present conclusions and
outline future work in section 6.</p>
    </sec>
    <sec id="sec-2">
      <title>State of the Art in Practice</title>
      <p>
        There is ample literature comparing f2f and online learning, and the findings are mixed.
Some studies report that online academic courses have higher satisfaction rates and
higher performance rates, for example, in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Other studies report better academic
performance in online format compared to the f2f mode with the same level of satisfaction
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. However, there are also multiple studies reporting no difference [
        <xref ref-type="bibr" rid="ref4 ref5 ref6 ref7">4-7</xref>
        ]. Some studies
even report the opposite results, namely that f2f students have better performance than
the online students [
        <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
        ].
      </p>
      <p>
        As research presents such contradictory data, we draw a conclusion that the mode of
the delivery is not the only factor determining learning. In our view, the quality of the
course is crucial. Creating activities and assignments that are interesting for students
and motivating them to put in more effort, 'investing' in the topic can make the learning
more effective [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. We assume that our online teaching can have similar results as the
f2f, and its effectiveness depends more on how the course is designed and taught. We
agree with Miller that “good teaching is good teaching, regardless of technology” [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
Moreover, from the students’ perspective employing the technology to learn does not
mean that they automatically develop their problem-solving abilities,
information-reasoning skills, communication skills, creativity, and other higher order thinking skills
[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The key for us is to create conditions under which students can strive.
      </p>
      <p>
        In order to transform our course from f2f to the online format, in a short span of time,
we have drawn from the literature on online course quality [
        <xref ref-type="bibr" rid="ref13 ref14 ref15 ref16">13-16</xref>
        ]. Alqurashi
associated factors that allow predicting student satisfaction and perceived learning within
online learning environments [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. She concludes that student satisfaction rates are
higher when students find that online course materials helped them to understand the
class content, stimulated their interest for the course, helped relate their personal
experience to new knowledge, and were easy to find and access. Furthermore, student
satisfaction and perceived learning rates were higher if students have high quality and
quantity interactions with their instructor. To be successful, an online course must be
(1) well-organized and (2) presented with well-specified learning objectives and
assessment. In addition, (3) the importance of interpersonal communication and collaboration
seems to be pivotal. When it comes to technology (4), it needs to be chosen thoughtfully
to underpin content, meet the needs of learners and support student learning.
      </p>
      <p>
        Classroom and online environments are both equally hard to define, so transforming
from the f2f mode to online may be very challenging [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Often teachers simply
transfer the teaching material and connected pedagogy directly to the online platform
without providing opportunities for interpersonal interaction [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. Such an approach may
result in failure, disappointment and lower student and faculty satisfaction. Borrego
notes that it is a common mistake to assume that it is sufficient to just select the virtual
learning environment, and then to port the classroom-based material to it [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
Nevertheless, to transfer a course to an online environment successfully, it is necessary to
select the technique and tools carefully, to be able to convert the f2f classroom-based
activities to the activities appropriate online. When the course is transferred to the
online environment, the design must compensate for the lack of interaction between
students and teacher. Vaughan et al. discuss the associated organizational challenges,
such as common institutional understanding of online learning and allocation of time
and resources [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].
      </p>
      <p>
        As the above literature conveys, it is possible to successfully convert courses to an
online environment. Even at the midst of pandemic educators can provide students with
a chance to benefit from the advantages of technology. However, it is not online
teaching with ‘business as usual’. We can say it is ‘emergency remote teaching’ [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ].
Working during a pandemic is different on many levels. In the next section, we present an
overview of teaching constraints and learning challenges induced by the COVID-19
pandemic.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>New Pandemic-Induced Constraints</title>
      <p>As the COVID-19 pandemic has prompted universities across the world to suspend all
f2f classes, a common move was the transition to online teaching. It was a sudden
transition, an unprecedented shift. In the rapidly changing situation, universities, teachers,
and students had to adjust to the new environment and to the new ways of working.</p>
      <p>However reconfiguring lives around the new constraints of quarantine lockdown
requires facing many challenges and rearranging priorities. We gathered them all in Table
1. We realize it is not a complete neither absolute list. We rather wish to commence a
discussion in the community to prepare educators for any such disruptive incidents. Of
course, several of the issues identified cannot be resolved by a teacher, as they are not
necessarily under their control, nor are there necessarily accepted solutions around
already. There are issues, nonetheless.</p>
      <p>Work-Life
balance
Social
Distancing
Evaluation
Circadian
Rhythms
Mental
Health
Physical
Health</p>
      <p>
        Personal and
professional can be clearly
separated: Lecture
halls/lab/local
companies are physically in
different location than
private home
Small groups,
bonding experience over
social programme
Evaluation: Study
participants from
target group; Assemble
in lab or reserved
room
Managed by
institute/school, paced
daily schedule
Background levels of
mental health
challenges
Possible to take care
of health (e.g., being
active, healthy eating,
sport)
• New Learning Management System installation
may be needed (the Bavarian State’s school
Moodle, for example, could not take the load),
bandwidth, and CPU power [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
• Retreat into the private: props needed, lack/less
      </p>
      <p>dress code, kids around and interrupting
• Disruptions resulting in longer hours of work
• No need to commute, no travel gives more time
• Lack of interaction
• Meeting virtually via chat applications
• Can be an improvement for people with
diffi</p>
      <p>culties in social interaction
• Evaluation: by experts (switching from
quantitative to qualitative); using remote access or
sideloaded apps; alternatively, based on demo
film recordings if special equipment is needed
but not accessible to evaluators
• Pre-tests or verification are equally affected
• Assessment: no face to face exams
• Disruption of daily life, missing time ‘anchors’,
missing daylight markers due to indoor
environment, disrupted schedule: “Days become
fluent” and the passing of the week is marked only
by the arrival of the bin men, lack of social
events organising day and week.
• Family life may require not to be available at</p>
      <p>core working hours (e.g., looking after kids)
• Coping with anxiety and worry
• Living through a crisis, uncertainty, distressing,</p>
      <p>can be traumatic
• Greater family and work stress
• Coping with isolation, social shift
• Work-from-home environment needs practice
• Coping with grief
• Limited access to health care
• No sport facilities available
• Limited nourishment
• Additional stress
• Excess screen time, fatigue, limited outside
time
Attrition
Openness
Student
Support</p>
      <p>Motivation through
audience feedback,
reactive Q&amp;A
Background levels of
attrition.</p>
      <p>Limited: restricted to
number of places
available in the
lecture hall / seminar
room
Drop-in hours,
private 1:1 sessions,
easily available
resources, and services
at the university
• Lacking awareness
• Some dropouts due to illness
• Lowered expectations as e.g. childcare duties
prevent full working and learning time (“we are
just asking you to work as much as you can”)
• Unlimited, if online hosting allows
• Commitment of learners can vary
tremendously. They are no longer forced by being
there to participate.
• Anonymous online environment potentially</p>
      <p>
        limits willingness to engage.
• Can be beneficial for people with disabilities
• Only online sessions and limited resources
As the reader can see from the table above, the state of quarantine induced by
COVID19 creates many challenges that both teachers and students need to cope with while
transferring teaching to online space. We agree with Hodges [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] that what we can
observe in the face of pandemic is emergency remote instruction which is not standard
online teaching, and therefore it requires different measures.
      </p>
      <p>In the next section of the paper, we describe how we managed the rapid
transformation from f2f to online with our course.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Transformation Decisions and Process</title>
      <p>Before we describe in detail how we rapidly transformed the course from f2f to online
mode, we explain the decision-making process.
4.1</p>
      <sec id="sec-4-1">
        <title>Original course design planned prior to the COVID-19 pandemic</title>
        <p>The Advanced AR Course was designed as an intensive f2f training event taking place
on 19–24 April 2020 and hosted by one of the AR-FOR-EU partner universities. The
training modules were designed and were going to be delivered by trainers from all five
partner universities. The course consisted of 10 lectures (15 hours) and nine tutorials
(13.5 hours). The lectures were designed to give the theoretical knowledge, while the
tutorials were intended to give students practical hands-on experience with AR
hardware and software tools and a chance to apply the new knowledge, developing their
practical skills. In addition, a hackathon was scheduled for Saturday and Sunday 25–
26 April 2020. We intended to assign all participants to small teams of four or five
students for a small group project. We would provide tutor support during the practical
tutorials and at the hackathon, where the bulk of the small group project would be
developed. The project work was designed to be the basis for the credit-bearing
assessment, marking design, development, and evaluation of the resulting AR applications.</p>
        <p>The decision to transform the f2f AR course to the online version was made because
of the COVID-19 pandemic and associated travel restrictions. Moving instruction
online allowed continuing to teach and learn while keeping students and teachers safe.</p>
        <p>The decision was made by the consortium on 12 March 2020, right after WHO
characterized COVID-19 as a pandemic, and only five weeks before the planned date of the
course. That left us with little time to manage this change.</p>
        <p>The consortium had experience in designing and running both f2f and online courses.
We also had experience of adapting teaching materials and activities from a f2f format
to online, although without string time limitations. In 2019, the consortium designed
and delivered a f2f course ‘Foundations of Augmented Reality’. In early 2020, we
adapted this course to an online mode, using video recordings of the f2f lectures and
workshops. However, we were still in the process of running this course when we were
making the decision that the ‘Advanced AR course’ will be transformed to a fully online
course. Below we describe the process in detail.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Design decisions</title>
        <p>First and foremost, we decided that the new form of the course would be a MOOC
(Massive Open Online Course). This way we were able to reach out to a wider audience
and accommodate more students. We realize that it is not the most common case. As
the pandemic started in the middle of the semester, many universities had to find a
solution to provide students with an opportunity to finish their courses. Our course is
not a part of formal education, so we could afford to make the decision to transform it
into a MOOC. When the lockdown regulations were not yet clear, we also considered
a blended format with some local f2f participants going through the course together
with online participants who would not be able to attend in person.</p>
        <p>
          The second decision we made was to change the timeline of the course. The f2f
course was planned as an intensive one-week event. As we moved it online, we decided
to spread the teaching over eight weeks. As neither instructors nor the students need to
travel to join the course, there is no need to compress teaching. It also gave us more
time to prepare a good quality teaching material. The approach we have taken was
similar to a ‘Conventional MOOC’ and ‘Lecture MOOC’, as described in [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ]. We could
say our course was an ‘Emergency MOOC’ – an educational scenario created as an
answer to pandemic-induced constraints, such as access to infrastructure, mental and
physical health, or social awareness (see Table 1).
        </p>
        <p>
          In order to ensure the quality of the course, we decided to design and deliver
completely new material created specifically for the online course. The aim was to create
conditions for students to succeed in their learning despite the constraints induced by
pandemic. We followed the recommendations stated earlier in Section 2. The course
was (1) well-organized with a weekly schedule and each session mapped explicitly
against intended learning outcomes from our skills framework [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]. It is presented with
(2) well-specified learning objectives and assessment. When it comes to (3)
interpersonal communication between students and teachers, we decided to introduce a few
synchronous sessions. The selection of (4) technology is described in detail below
(Tables 2 and 3).
4.3
        </p>
      </sec>
      <sec id="sec-4-3">
        <title>Platform alternatives and requirements</title>
        <p>We identified three main alternatives for the deployment of a digital platform, each
with advantages and limitations, summarized below (Table 2).
The choices of the platform and its components were made by the consortium based on
several requirements, such as adaptability, scalability, interoperability, availability, and
affordability. Table 3 summarizes the requirements and decisions taken when choosing
the online environment.
Availability
Flexibility
Security
Reliability
Maintainability
Sustainability
Interactivity
No Freemium
Retain
intellectual property
Trackability</p>
        <p>Platform skinning with themes
should be off the shelf, bespoke
development should be light touch
As small delays as possible to the
solution going live. Short
installation and deployment process. For
pay procurement processes cost
time, especially at big
organisations.</p>
        <p>Possibility to continue to configure
and extend the system as we go
along, and as requirements
emerge.</p>
        <p>A secure server run by a
trustworthy company
System running the whole duration
of the course without downtime
Offer possibilities to author and
update as much as possible.</p>
        <p>Separate learner data from course
resources (so it can quickly be
removed when the course is
repeated).</p>
        <p>Minor updates required when
repeating, but over time bigger stock
of resources
Active Learning is the underlying
methodology we deploy in project
seminars. All learning materials
should be as interactive as
possible, requiring learners to get
active.</p>
        <p>No hidden costs
Do not sign away the intellectual
property rights in exchange for
free software
Competency register and
possibility to track user behaviour and
engagement</p>
        <p>Professionally designed Moodle
theme
Open Source on LAMP system
Rich plugin universe (survey
plugin, social comments plugin,
H5P plugin for content production)
Moodle installation at a partner
university
Moodle has a release schedule,
providing patches and updates at
convenient times
Moodle rollover features allows to
re-run the course easily; export
with defined format allows import
at other sites.</p>
        <p>GitHub is used for the Open
textbook.</p>
        <p>Lectures chopped into small
520min units allows replacing and
adding parts more conveniently
H5P content production plugin
offers many enhancements in widget
form (such as interactive videos).</p>
        <p>Running own platform, but using
YouTube for streaming at scale
was the compromise chosen
Moodle has competency register
and does support xAPI (through
plugin)
We decided to use the ‘Own server’ alternative (see Table 2) and installed a Moodle at
a partner university and openly available via the project website. The course was
divided in weeks, and the teaching material is being uploaded on a weekly basis.</p>
        <p>Activities in online courses may be offered in either synchronous or asynchronous
mode. We use a combination of both. We offer most of the classes in our Advanced AR
course in the asynchronous mode. This design decision was motivated by our objective
to make the activities we design as reusable as possible. Two sessions are designed to
be delivered in a synchronous mode and open for participants from outside of the
course. The intention is to create an opportunity for interaction between instructors and
students as well as to promote the course.</p>
        <p>In the Advanced AR course, we use different formats for the teaching material and
activities. Each lecture is pre-recorded as multiple short videos (3–6 videos, 3–30 min
each) with slides, video demonstrations, and the video of the narrating instructor as a
picture-in-picture. All the lectures follow the same template to provide a visual
coherence, but with a personal touch by each instructor. Such a form allows students to easily
navigate the course.</p>
        <p>Tutorials delivered by an instructor in a classroom could not be easily converted for
consumption online. For example, we know from some of the classroom recordings
from our foundation course that the bits with the instructor walking from desk to desk
to help tackle the same problem over and over, simply does not work on video. In
addition, the GDPR rules prevent (or make it difficult) recording and sharing of videos
that could identify students.</p>
        <p>The classroom-based activities were substituted by appropriate activities online. The
practical exercises of the course are mostly presented as systematic, step-by-step
tutorials in different media formats. Some of them are video tutorials, created using screen
capture, where the instructor is demonstrating something on the screen. Other exercises
are presented in a text format available as web pages with embedded screenshots,
videos, and links. For some of the tutorials, we provide downloadable examples of AR
apps or content. Similarly, for lectures – simply recording a lecture and posting it in a
learning platform can be less useful in distance education. For the online course, we
created dedicated content with shorter, easy to navigate videos.</p>
        <p>The formative assessment is designed in the form of embedded quizzes and summary
dialogues in some of the videos. For the summative assessment, students are requested
tasked to design, develop, and evaluate their own AR application.</p>
        <p>As teaching how to create AR apps is an emerging topic in Higher Education there
are little textbooks to support teaching and learning. For this course, we write our own
textbook on the topic in the GitHub-based open source format. Some of the lectures
and practical exercises are adapted for the book format (such as video lectures) and
some are published in the book directly (such as the text-based practical exercises).
Some of the tutorials are opened by a short, five-minute video, but they are essentially
step-by-step guides with screenshots and code snippets included, using markdown for
typesetting, and git actions for integration.</p>
        <p>Every book about high tech risks being outdated already when going into print. Our
book is continuously developed and updated, by an open community of contributors,
Open Source style.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Discussion and take-away message</title>
      <p>We introduced the new constraints the pandemic imposed on us in Table 1, which we
took into account, when making our design decisions for transferring teaching online
as summarised in Tables 2 and 3. We made these decisions based on the state of the art
in the field of how to convert a course to online. It is important, however, to connect
explicitly the design implications to the pandemic constraints outlined initially, as only
then it becomes evident how the given situation influenced these decisions. It would
also to allow sharing recommendations for future similar situations.</p>
      <p>The decision to change from intensive one-week f2f course to MOOC format was
dictated by the travel ban and the lockdown restrictions preventing gatherings of even
small groups of people. An alternative would have been to create a SPOC (Small
Private Online Course) just for the registered students. But with the pandemic conditions
and closed education institutions we realised there are many students who could benefit
from the course and we decided to make the material accessible, so as to help remediate
this educational state of emergency in general. We opened the course to the wider
public allowing students from outside our universities and even outside the university
context as such. Changing the target audience brings several challenges. In cases when the
access to the course is limited to the students who are enrolled in a formal education
program, often know each other and (not necessarily, but often) with mandatory
attendance, synchronous activities may play an important role in the course. They may allow
for better communication and help students to cope with isolation and reduce drop-out
levels. However, opening the course and allowing anyone to join greatly reduces the
attendance and effectiveness of synchronous activities under normal circumstances
already, not to speak of the pandemic.</p>
      <p>
        The closure of universities has meant that students are learning from home. Many
had to leave their university accommodation and move to their family home. In
consequence, the conditions students are now working in are likely to differ considerably, as
we summarized in Table 1. Lacking internet access or connectivity can be an issue
during pandemic [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. This is also a problem on the other side, with server capacity
potentially hampering the ability to stream to larger numbers of people. In both cases,
the broadband as well as the server computational capacity can be insufficient for video
streaming to larger numbers. We suggest using a broadcasting network (YouTube) in
combination with Moodle to balance the load.
      </p>
      <p>Beside that students may not have sufficient access to computers or devices required
for learning and assessment. Asynchronous delivery enables shuffle devices.</p>
      <p>
        Another problem in pandemic is the distorted balance between work and private life.
Some students have responsibilities to care for children or vulnerable family members.
Reports show that they also may not have a suitable space to carry out their university
work [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. Our recommendation is to produce the learning material in smaller blocks,
so students can make best use of their time and have natural pausing points.
      </p>
      <p>Social distancing rules enforced during pandemic means that people may feel
isolated and miss the social interaction. Interpersonal communication and collaboration
are crucial for the online course to be successful. For the pandemic ‘emergency
MOOC’, we decided to give students an opportunity to connect with teachers and each
other in live events. It is difficult, however, to organise for an audience to meet all at
the same time, due to individualisation of schedules (some people take care of children
during day and work at night, some rise earlier due to missing commute). We suggest
organising only a very limited number of live meetings, focusing these on a ‘happening’
character, where the live experience matters (e.g., in our course, this was a research
directions panel organised with several well-known speakers). This can be organised
with video conferencing solutions such as Zoom, WebEx, or Microsoft Teams (to
mention a few popular solutions). The feeling of isolation can be mitigated by having
synchronous sessions, and they may also reduce drop-out levels. When it becomes possible
to gather for such synchronous activities in a f2f format, it is possible that restrictions
on the number of people per room are introduced. Such restrictions might require
blended solutions to allow everyone to attend, partly in person and partly via video
conferencing. New issues arise though, such as acquiring microphones that work
properly even when the speaker wears a facemask.</p>
      <p>Generally, asynchronous activities might be more reasonable than synchronous
ones. If all the activities are synchronous, there is a risk of excluding people with access
difficulties (childcare, lack of devices, etc.). At the same time, with only asynchronous
activities, the risk of social isolation is higher, and the mental health of students may
deteriorate. It is a thin line, to find the right trade-off between the two modes of
delivery, and we can only recommend sparse use of live events that are also open to the
public to provide the necessary level of flexibility. Opening to an external audience
may additionally help to ensure that there is audience and impact. Synchronous
activities can often be recorded to share with those who could not attend or to produce a
short, high quality video summary of the live event at a later stage.</p>
      <p>Similarly, flexibility with deadlines for assignments within course is needed to allow
students to successfully follow the course despite distorted work-private life balance by
pandemic.</p>
      <p>Making videos public – to help remediate the general state of educational emergency
– poses several new challenges. Copyright is affected, as the course is no longer in a
university context, where ‘academic review’ applies. The learning material can be taken
out of context, for example, a critique and analysis exercise of existing systems and
their design flaws can suddenly be misunderstood as criticism of others. A solution may
be found in using examples but leaving the students to do the criticism work inside the
course, using overlays like offered by H5P. In this way, students might also learn more.</p>
      <p>Workshops that cannot be done f2f require using innovative online tools to engage
students in interaction and provide them benefits of the workshop despite the mode of
the delivery (e.g., shared files, online forms, and online whiteboards).</p>
      <p>Hardware availability is limited in pandemic. Some of the workshops we planned
required specific hardware that cannot be made available in an online course easily. A
solution can be using emulators instead of the real hardware. In addition, specialist
equipment can be bought online, but may require restructuring plans to keep them
affordable. In our course, for example, this included the recommendation of low-cost
Arduino and sensors and pointers where to order them off-the-shelf with
still-functioning delivery services (in our case, Amazon), with other sites not operating with their
staff furloughed.</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>This paper intends to fill in the gap in knowledge about how to quickly transform course
content from the traditional f2f format into digital education in the event of incidents
such as the COVID-19 pandemic. We used an example of a course on AR to establish
case evidence for educators regarding how to manage such change. We conclude that
such a transformation can be done successfully. We described and discussed
technological alternatives and requirements for such a transformation. Future work may
include a similar analysis of the pedagogical aspects.</p>
      <p>The COVID-19 situation is changing while we are writing this paper. Many issues
stay open and require further attention. We wish to start the discussion in the
Technology-Enhanced Learning community to be able not only to provide emergency remote
instruction but quality education despite any disruptive event in future. Moreover, we
intend to gather feedback on success and student satisfaction with the course. At the
time of writing this paper, the course is still ongoing.</p>
      <p>When normality returns, policies will likely be created putting recovery plans in
place for future eventualities. Decisions will have to be made about responsibilities for
rapid conversion such as the one presented here. We hope our analysis of the
pandemicinduced constraints and design decisions can contribute to framing this discussion.</p>
      <p>Acknowledgments. The work presented in this paper is supported by the
AR-FOREU project funded by the European Commission, grant 2017-1-NO01-KA203-034192.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Ebner</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schön</surname>
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Braun</surname>
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ebner</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grigoriadis</surname>
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haas</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leitner</surname>
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Taraghi</surname>
            <given-names>B.</given-names>
          </string-name>
          : COVID-19
          <string-name>
            <surname>Epidemic as E-Learning</surname>
            <given-names>Boost</given-names>
          </string-name>
          ?
          <article-title>Chronological Development and Effects at an Austrian University against the Background of the Concept of “E-Learning Readiness”</article-title>
          .
          <source>Future Internet</source>
          <volume>12</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>20</lpage>
          (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Soffer</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nachmias</surname>
            <given-names>R.</given-names>
          </string-name>
          :
          <article-title>Effectiveness of learning in online academic courses compared with face-to-face courses in higher education</article-title>
          .
          <source>Journal of Computer Assisted Learning</source>
          <volume>34</volume>
          (
          <issue>5</issue>
          ),
          <fpage>534</fpage>
          -
          <lpage>543</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Luna</surname>
            <given-names>M.E.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cruz</surname>
            <given-names>C.S.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arce</surname>
            <given-names>J.O.</given-names>
          </string-name>
          :
          <article-title>Achievement, Engagement and Student Satisfaction in a Synchronous Online Course</article-title>
          .
          <source>In: 2019 IEEE Global Engineering Education Conference (EDUCON)</source>
          ,
          <fpage>8</fpage>
          -11
          <source>April</source>
          <year>2019</year>
          , pp.
          <fpage>124</fpage>
          -
          <lpage>132</lpage>
          . (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Brown</surname>
            <given-names>J.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Park H</surname>
          </string-name>
          .-S.: Longitudinal Student Research Competency:
          <article-title>Comparing Online and Traditional Face-to-Face Learning Platforms</article-title>
          .
          <source>Advances in Social Work</source>
          <volume>17</volume>
          (
          <issue>1</issue>
          ),
          <fpage>44</fpage>
          -
          <lpage>58</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Ebner</surname>
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gegenfurtner</surname>
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Learning and Satisfaction in Webinar, Online, and Face-to-Face Instruction: A Meta-Analysis</article-title>
          .
          <source>Frontiers in Education</source>
          <volume>4</volume>
          (
          <issue>92</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Stanchevici</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Siczek</surname>
            <given-names>M.</given-names>
          </string-name>
          <article-title>: Performance, Interaction, and Satisfaction of Graduate EAP Students in a Face-to-Face and an Online Class: A Comparative Analysis</article-title>
          .
          <source>TESL Canada Journal</source>
          <volume>36</volume>
          (
          <issue>3</issue>
          ),
          <fpage>132</fpage>
          -
          <lpage>153</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Yen S</surname>
          </string-name>
          .-C.,
          <string-name>
            <surname>Lo</surname>
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Enriquez</surname>
            <given-names>J</given-names>
          </string-name>
          .:
          <article-title>Learning online, offline, and in-between: comparing student academic outcomes and course satisfaction in face-to-face, online, and blended teaching modalities</article-title>
          .
          <source>Education and Information Technologies</source>
          <volume>23</volume>
          (
          <issue>5</issue>
          ),
          <fpage>2141</fpage>
          -
          <lpage>2153</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Amparo</surname>
            <given-names>A.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            <given-names>G.</given-names>
          </string-name>
          ,
          <article-title>Friedman A.: Gender and persistent grade performance differences between online and face to face undergraduate classes</article-title>
          . In: Bastiaens T,
          <string-name>
            <surname>Van Braak</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brown</surname>
            <given-names>M</given-names>
          </string-name>
          et al. (eds.)
          <source>EdMedia + Innovate Learning</source>
          <year>2018</year>
          , Amsterdam, Netherlands, pp.
          <fpage>1935</fpage>
          -
          <lpage>1939</lpage>
          . AACE, Waynesville,
          <string-name>
            <surname>NC</surname>
          </string-name>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Ortega-Maldonado</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Llorens</surname>
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Acosta</surname>
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coo</surname>
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Face-to-Face vs On-Line: An Analysis of Profile, Learning, Performance and Satisfaction among Post Graduate Students</article-title>
          .
          <source>Universal Journal of Educational Research</source>
          <volume>5</volume>
          (
          <issue>10</issue>
          ),
          <fpage>1701</fpage>
          -
          <lpage>1706</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Swanson</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Swanson</surname>
            <given-names>C.S.</given-names>
          </string-name>
          :
          <article-title>Comparing Course Delivery Methods, What Do Students Prefer and What Works</article-title>
          .
          <source>In: Proceedings of the 2019 ASCUE Summer Conference</source>
          , Myrtle Beach, South Carolina, June 9-13,
          <year>2019</year>
          , pp.
          <fpage>70</fpage>
          -
          <lpage>79</lpage>
          . (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Miller M.D.</surname>
          </string-name>
          :
          <article-title>Minds Online: Teaching Effectively with Technology</article-title>
          . Harvard University Press, Cambridge, Mass (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Sharkova</surname>
            <given-names>N.</given-names>
          </string-name>
          :
          <article-title>Learning supported by technology in higher education: From experience to practice</article-title>
          .
          <source>Education Inquiry</source>
          <volume>5</volume>
          (
          <issue>3</issue>
          ),
          <fpage>429</fpage>
          -
          <lpage>444</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Baldwin</surname>
            <given-names>S.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ching</surname>
            <given-names>Y.-H.:</given-names>
          </string-name>
          <article-title>An online course design checklist: development and users' perceptions</article-title>
          .
          <source>Journal of Computing in Higher Education</source>
          <volume>31</volume>
          (
          <issue>1</issue>
          ),
          <fpage>156</fpage>
          -
          <lpage>172</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Grandzol</surname>
            <given-names>C.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grandzol PhD J.R.:</surname>
          </string-name>
          <article-title>Best Practices for Online Business Education</article-title>
          .
          <source>The International Review of Research in Open and Distributed Learning</source>
          <volume>7</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Ismail</surname>
            <given-names>A.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mahmood</surname>
            <given-names>A.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abdelmaboud</surname>
            <given-names>A.</given-names>
          </string-name>
          :
          <source>Factors Influencing Academic Performance of Students in Blended and Traditional Domains</source>
          .
          <year>2018</year>
          13 (
          <issue>02</issue>
          ),
          <fpage>170</fpage>
          -
          <lpage>187</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Vai</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sosulski</surname>
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Essentials of online course design: A standards-based guide</article-title>
          . 2nd ed. edn. Routledge New York, NY (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Alqurashi</surname>
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>Predicting student satisfaction and perceived learning within online learning environments</article-title>
          .
          <source>Distance Education</source>
          <volume>40</volume>
          (
          <issue>1</issue>
          ),
          <fpage>133</fpage>
          -
          <lpage>148</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Young</surname>
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perović</surname>
            <given-names>N.</given-names>
          </string-name>
          :
          <article-title>Rapid and Creative Course Design: As Easy as ABC? Procedia - Social and</article-title>
          <source>Behavioral Sciences</source>
          <volume>228</volume>
          ,
          <fpage>390</fpage>
          -
          <lpage>395</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Jaggars</surname>
            <given-names>S.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xu</surname>
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>How do online course design features influence student performance?</article-title>
          <source>Comput &amp; Educ</source>
          <volume>95</volume>
          ,
          <fpage>270</fpage>
          -
          <lpage>284</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Borrego</surname>
          </string-name>
          J.:
          <article-title>Roadmap For A Successful Transition To An Online Environment</article-title>
          .
          <source>Contemporary Issues in Education Research (CIER) 3</source>
          (
          <issue>5</issue>
          ),
          <fpage>59</fpage>
          -
          <lpage>66</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Vaughan</surname>
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Reali</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stenbom</surname>
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jansen Van Vuuren</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>David</surname>
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Blended Learning from Design to Evaluation: International Case Studies of Evidence-Based Practice</article-title>
          .
          <source>Online Learning 21 (3)</source>
          ,
          <fpage>103</fpage>
          -
          <lpage>114</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Hodges</surname>
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moore</surname>
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lockee</surname>
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Trust</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bond</surname>
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>The Difference Between Emergency Remote Teaching and Online Learning, Educause</article-title>
          <string-name>
            <surname>Review.</surname>
          </string-name>
          (
          <year>2020</year>
          ), https://er.educause.edu/articles/2020/
          <article-title>3/the-difference-between-emergency-remoteteaching-and-online-learning</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Ebner</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schön</surname>
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Braun</surname>
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>More Than a MOOC-Seven Learning and Teaching Scenarios to Use MOOCs in Higher Education and Beyond</article-title>
          . In:
          <string-name>
            <surname>Yu</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ally</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <article-title>Tsinakos A (eds</article-title>
          .)
          <article-title>Emerging Technologies and Pedagogies in the Curriculum</article-title>
          . pp.
          <fpage>75</fpage>
          -
          <lpage>87</lpage>
          . Springer Singapore, Singapore (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Fominykh</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bilyatdinova</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koren</surname>
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jesionkowska</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karsakov</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khoroshavin</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klamma</surname>
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klimova</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Molka-Danielsen</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rasool</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            <given-names>C.H.</given-names>
          </string-name>
          , Wild F.:
          <article-title>Existing Teaching Practices and Future Labour Market Needs in the Field of Augmented Reality</article-title>
          . Augmented Reality in Formal European University Education - AR
          <string-name>
            <surname>-FOR-</surname>
            <given-names>EU</given-names>
          </string-name>
          , (
          <year>2019</year>
          ), https://codereality.net/report/
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Montacute</surname>
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holt-White</surname>
            <given-names>E</given-names>
          </string-name>
          .: COVID-19 and
          <string-name>
            <given-names>Social</given-names>
            <surname>Mobility</surname>
          </string-name>
          Impact Brief: #2:
          <string-name>
            <surname>University</surname>
            <given-names>Access &amp; Student</given-names>
          </string-name>
          <string-name>
            <surname>Finance</surname>
          </string-name>
          .
          <source>The Sutton Trust</source>
          , London,
          <string-name>
            <surname>UK</surname>
          </string-name>
          , (
          <year>2020</year>
          ), https://www.suttontrust.com/our-research/covid-19
          <string-name>
            <surname>-</surname>
          </string-name>
          impacts-university-access/
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>