<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Study for the Improvement of the Moroccan Public Higher Education System Based on a Strategic Plan for Learning Technologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Francisco José García-Peñalvo</string-name>
          <email>fgarcia@usal.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>José Carlos Sánchez-Prieto</string-name>
          <email>josecarlos.sp@usal.es</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mª José Rodríguez-Conde</string-name>
          <email>mjrconde@usal.es</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Adriana Gamazo</string-name>
          <email>adriana.gamazo@usal.es</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alicia García-Holgado</string-name>
          <email>aliciagh@usal.es</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fernando Martínez Abad</string-name>
          <email>fma@usal.es</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>GRIAL Research Group, IUCE, Computer Science Department, University of Salamanca</institution>
          ,
          <addr-line>Salamanca</addr-line>
          ,
          <country>España</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>GRIAL Research Group, IUCE, Computer Science Department, University of Salamanca</institution>
          ,
          <addr-line>Salamanca</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>GRIAL Research Group, IUCE, Didactics, Organization and Research, Methods Department, University of Salamanca</institution>
          ,
          <addr-line>Salamanca</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>- Within the framework of the comprehensive educational reform of Moroccan universities, the twinning project financed by the European Union has the general objective of accompanying, assisting and promoting the reform of the Moroccan higher education system within the framework of its strategic vision 2015-2030 and its approach to the European Higher Education Area, which has a twofold aim: to enhance the employability of graduates and to improve the governance of the university system. The purpose of this paper is to present the work carried out in the component 3 of this project, focused on the diversification of teaching methods (elearning strategy). This component has aimed to provide guidelines and recommendations for addressing the main problems of Higher Education in Morocco and improving its quality.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Keywords—e-learning, Higher Education, Educational
technology, Technology Acceptance, TAM, Morocco.</p>
    </sec>
    <sec id="sec-2">
      <title>I. INTRODUCTION</title>
      <p>In 2015, the Moroccan Government's Higher Education,
Training and Research Council approved the Strategic Vision
2015-30 under the title "For a School of Equity, Quality and
Promotion", which aims to achieve the following objectives
by 2030:</p>
    </sec>
    <sec id="sec-3">
      <title>Equity and equal opportunities.</title>
    </sec>
    <sec id="sec-4">
      <title>Quality for all.</title>
      <p>The promotion of the individual and the society.</p>
      <p>This is a comprehensive reform based on a new
methodological approach, with a particular focus on the
consolidation of the higher education system. Morocco is also
seeking to come closer to the standards and guidelines of the
European Economic Community through higher education
and scientific research, intending to increase the quality of the
higher education system and its governance processes.
Additionally, a modernisation of the higher education system
brings with it an openness to the international market.</p>
      <p>In this context, the Kingdom of Morocco and the Regional
Ministry of Education of Castilla y León signed a twinning
project in November 2017 to adapt the Bologna
recommendations in Moroccan universities, addressing issues
related to educational technologies, ECTS, diversification of
the training offer and recognition of university degrees, among
others, in order to generate a process of transfer of European
knowledge and experience.</p>
      <p>Twinning projects are an instrument of institutional
cooperation of the European Commission with the candidate
countries and the countries of the region of the European
Union's Neighbourhood Policy where, through technical
assistance carried out by public institutions of the member
countries of the European Union, it promotes the
strengthening of the public administrations of the beneficiary
countries.</p>
      <p>This paper aims to give an overview of the work carried
out by the University Institute of Educational Sciences of the
University of Salamanca on the diversification of teaching
methods (e-learning strategy) in the framework of the
twinning project.</p>
      <p>The work has been organised in the following sections.
The second section describes the main components in which
the twinning project is organised. The third section describes
the methodology used to carry out the study in Moroccan
higher education institutions. The fourth section presents a
brief account of the results obtained. Finally, the last section
summarises the main conclusions of the study.</p>
    </sec>
    <sec id="sec-5">
      <title>II. THE TWINNING PROJECT The project "Support for the higher education system in Morocco as part of a move towards the European Higher</title>
      <p>Education Area" (Appui au Système de l'Enseignement
supérieur au Maroc dans le cadre d' un rapprochement avec
l'Espace européen de l'Enseignem), is a European project
whose general objective is to accompany, assist and promote
the reform of Morocco's higher education system within the
framework of its strategic vision 2015-2030 and its approach
to the European Higher Education Area (EHEA) in order to
improve the employability of graduates and the governance of
the university system. The project has lasted two years
(January 2018 - December 2019), and its development is
organised into six components involving different Spanish
institutions coordinated by the Regional Ministry of
Education of Castilla y León:





</p>
      <p>Component 1: Approximation of the legislative and
regulatory framework to EU standards.</p>
      <p>Component 2: Diversification of training provision.
Component 3: Diversification of teaching methods.
Component 4: Policy and implementation of ECTS in
the framework of LMD degrees (Bachelor, Master
and Doctorate).</p>
    </sec>
    <sec id="sec-6">
      <title>Component 5: Recognition of diplomas.</title>
    </sec>
    <sec id="sec-7">
      <title>Component 6: Consolidation of piloting tools.</title>
      <p>Each component has a person in charge of coordinating the
different missions carried out in Morocco as part of the
component so that the objectives of the component are
achieved.</p>
      <p>
        In particular, this work falls under component 3 [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],
coordinated by the Research Institute for Educational
Sciences (IUCE) and the GRIAL Research Group of the
University of Salamanca [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ]. The component aims to
provide the Moroccan higher education system with
incentives to diversify teaching methods in all areas of study,
to reduce the amount of face-to-face training in order to
modernise higher education and improve its quality.
      </p>
      <p>
        This component has been developed according to the
needs formulated by the Moroccan Ministry of Education,
related to the modernisation of the higher education system
and the need for openness at the international level, thus
complying with the recommendations of the Bologna process
on which the European Higher Education Area (EHEA) is
built [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        In particular, component 3 focuses on incorporating
eLearning solutions [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ] to the Moroccan university context
in order to solve the different challenges of massification
faced by Moroccan public universities, as well as to
incorporate methodologies and pedagogical proposals that
improve the teaching-learning processes mediated by
information and communication technologies (ICT), all from
a strategic reference framework [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ].
      </p>
    </sec>
    <sec id="sec-8">
      <title>III. METHODOLOGY</title>
      <sec id="sec-8-1">
        <title>A. Study design</title>
        <p>Component 3 was carried out over six missions in
Morocco and a visit to the University of Salamanca and the
University of Burgos by a delegation of Moroccan
representatives (Fig. 1). The four phases of the study were
carried out during different missions:</p>
        <p>3.1.1
Assessment of
the state of the
art</p>
        <p>3.1.2
Questionnaire
design</p>
        <p>3.1.3
Quantitative
result analysis</p>
        <p>3.1.4
Conducting
interviews
Questionnaire
application</p>
        <p>Report
Fig. 1. Design of the study according to the phases and missions.</p>
        <p>Phase 1: analysis of the context and design of the
research (Mission 3.1.1)</p>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>Phase 2: a quantitative study:</title>
    </sec>
    <sec id="sec-10">
      <title>Phase 3: a qualitative study:</title>
      <p>o
o
o
o
o</p>
    </sec>
    <sec id="sec-11">
      <title>Design of the instruments and definition of the data collection protocol (Mission 3.1.2).</title>
    </sec>
    <sec id="sec-12">
      <title>Application of the instruments.</title>
    </sec>
    <sec id="sec-13">
      <title>Quantitative analysis of the data collected in Moroccan universities (Mission 3.1.3)</title>
    </sec>
    <sec id="sec-14">
      <title>Design and implementation of the interviews based on the results obtained in the quantitative study (Mission 3.1.4).</title>
    </sec>
    <sec id="sec-15">
      <title>Qualitative analysis of the interviews and</title>
      <p>relationship with the quantitative results
(Mission 3.1.5).</p>
      <p>Phase 4: Recommendations to diversify teaching
methods in all fields of study.</p>
      <p>
        The first phase focused on the collection of information for
the design of the study. Specifically, it focused on the
collection of documentation to understand the reality of
Higher Education in Morocco: massification, shortage of
teachers, weak technological infrastructures, few indicators of
access to online training, incipient appropriation of solutions
based on mass instruction platforms, such as MOOC (Massive
Open Online Course) [
        <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
        ] and SPOC (Small Private Online
Course) [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], as well as on other alternatives of eLearning
environments. Likewise, opinions were collected from those
responsible for higher education at ministerial level, and it was
necessary to contrast this information with the agents directly
involved in online training within the universities themselves:
those responsible for teaching and technology in the
universities, coordinators of innovative proposals or specific
eLearning centres, non-innovative teachers, etc.
      </p>
      <p>
        In response to this need, a mixed approach study is
proposed, with an explanatory sequence [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] in which the
quantitative phase precedes the qualitative phase and helps to
plan it.
      </p>
      <p>Finally, after implementing the instrument with the
support of the Moroccan Ministry of Education, the third
mission of Component 3 (Mission 3.1.3) has focused on
carrying out the analysis of the results collected from 1 July
2019 to 4 November 2019.</p>
      <p>3.1.5</p>
      <p>Qualitative
result analysis</p>
      <p>Report
Universit
y</p>
      <p>The study population is made up of teachers from
Moroccan public universities, regardless of their professional
category. Concerning private universities, the Ministry has
indicated that they should be excluded from the study
population.</p>
      <p>
        According to figures from the 2018-2019 official statistics
on university higher education in Morocco (Direction des
Stratégies et des Systèmes d'Information, 2018), the
population is composed of 14 400 teachers. However, the
report for the academic year 2017-2018 [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] provides an
overview of the gender distribution, with a total of 13954
teachers, 3740 of whom are women (26.80%) and 10214 men
(73.20%). Table I details the sample collected at each of the
universities involved in the study.
      </p>
      <p>The sample corresponding to the qualitative phase was
composed of a total of 26 subjects: 20 university teachers
(with and without experience in the educational use of ICT)
and 6 university key agent managers from the different
Moroccan universities organised into four groups.</p>
      <sec id="sec-15-1">
        <title>C. Instruments</title>
        <p>The instruments were designed at the beginning of the
second and third phase. The quantitative instruments were
designed based on the information obtained in the first phase.
To design them, a model was made to evaluate the current
state of integration of Educational Technologies in the
teaching-learning processes in the Public Universities of
Morocco, both at the level of accessibility and support and
concerning their useful inclusion in university teaching.</p>
        <p>
          In particular, as part of the analysis of the situation, two
instruments were developed, a questionnaire of indicators on
the penetration and use of educational technologies in
Moroccan public universities [
          <xref ref-type="bibr" rid="ref14 ref15 ref16">14-16</xref>
          ], and a questionnaire on
the acceptance of educational technologies for teaching in
Moroccan public universities [
          <xref ref-type="bibr" rid="ref17 ref18 ref19">17-19</xref>
          ]; both available in
English, French and Spanish.
        </p>
        <p>
          The indicators tool has been developed based on the
UNIVERSITIC reports [
          <xref ref-type="bibr" rid="ref20 ref21 ref22 ref23">20-23</xref>
          ] developed by CRUE Spanish
Universities [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ].
        </p>
        <p>
          The second instrument is a questionnaire based on the
extended Technology Acceptance Model (TAM) [
          <xref ref-type="bibr" rid="ref25 ref26 ref27 ref28 ref29 ref30 ref31">25-31</xref>
          ]. The
evaluation model proposed, besides evaluating the three
typical dimensions of TAM models (Perceived Utility;
Perceived Ease; Behavioral Intention), includes seven
external dimensions related to social influence (Subjective
norm; Social image), the professional context (Volunteerism;
Relevance; Results of use; External control of the tool) and the
personal context (Anxiety).
        </p>
        <p>Concerning the instrument used for the qualitative part, a
set of semi-structured interviews was designed to address the
issues of interest revealed during the previous quantitative
analysis. Thus, these interviews were organised around the
following topics: institutional resources for the use of new
technologies, level and types of use of ICTs in the teaching of
the interviewees, perceived benefits of the use of ICTs, main
difficulties in the use of ICTs and areas for improvement,
institutional support for the incorporation and use of ICTs in
teaching. In each of the interviews, the questions were
Participati adjusted to the opinions and interests expressed by the
on % participants, allowing other issues to emerge such as the
characteristics of the students or the change in the teaching
and educational model needed to accompany the
implementation of ICTs in higher education.</p>
      </sec>
      <sec id="sec-15-2">
        <title>D. Data collection and analysis</title>
        <p>During Mission 3.1.2, the instruments described above
were defined in order to apply them in the 12 Moroccan public
universities. The first instrument, "Questionnaire of Indicators
on the Penetration and Use of Educational Technologies in
Moroccan Public Universities", was answered in a unique way
by each public university, taking into account the importance
of the answers reflecting the reality of each institution in the
most reliable way. The questionnaire has been shared as a
form in PDF format so that it has been sent to the key agent of
each university to provide the requested data. The process has
been developed from April 2019 to November 2019.</p>
        <p>The second instrument, "Questionnaire of Acceptance of
Educational Technologies for Teaching in Moroccan Public
Universities", is aimed at teachers in all public universities in
Morocco. This questionnaire has been carried out online, so
the data collection process has consisted of sending it to all
public universities and making several reminders in order to
obtain at least 50-60 responses per university. The process has
covered the period from April to November 2019.</p>
        <p>The qualitative information was collected through four
discussion groups with university teachers and management
and administration staff held in December 2019.</p>
      </sec>
    </sec>
    <sec id="sec-16">
      <title>IV. RESULTS</title>
      <p>About the analysis of the first questionnaire, referring to
indicators of penetration and use of new technologies, it is
necessary to highlight the need for improvement in
infrastructure to solve some shortcomings that hinder the use
of new technologies on campus, such as the lack of availability
of WiFi connection in 100% of university spaces or the low
number of free computers available to students.</p>
      <p>However, despite the shortcomings detected in
infrastructure and support, all universities have a virtual
teaching platform, which indicates an interest on the part of
both the institutions and the Ministry in implementing
eLearning solutions. On the contrary, these platforms are
underused, as the number of teachers using them is a
negligible percentage of the total population.</p>
      <p>Secondly, the results of the analysis of the questionnaire
on the acceptance of new technologies (Table II) show that,
although the willingness of university teachers to use
educational technologies is positive, there is a wide range of
improvement.</p>
      <p>In total, high scores (above 5.5) were obtained on 18 items,
medium scores (between 4.5 and 5.5) on 10 items and low
scores (below 4.5) on 6 items.</p>
      <p>The analysis of their content allows the detection of two
priority areas for improvement:

</p>
      <p>Training of university teachers in the use of new
technologies: since most of the items with the scores
refer to the perception of the effort and the own
capacity to use the tools.</p>
      <p>Development of awareness programmes: taking
into account that the scores obtained in the items of
the dimensions related to the social image are below
4.5 in most cases.</p>
      <p>Finally, the results of the qualitative phase were in line
with those obtained in the analyses of the questionnaires,
helping to delve into some issues and providing details about
some of the problems identified in the first phase. Regarding
the available resources, most of the interviewees corroborated
that there is a lack of both material and human resources and
a problem of accessibility to online resources, which hinders
the implementation of ICTs in a generalised way. On the other
hand, there was a general demand for more training for
teachers, with a twofold focus: technical training in the use of
the tools, and pedagogical training in the specific educational
uses of these tools, all accompanied by institutional
programmes to stimulate the use of learning technologies
among teachers, reflected in information and training
campaigns as well as an adequate recognition of the time
dedicated to eLearning tasks. Finally, the discussion groups
also revealed a need to improve communication between
teachers and administrative spheres, with the dual objective of
being able to receive information about institutional resources
and programmes, as well as being able to convey their
concerns and needs about the process.</p>
    </sec>
    <sec id="sec-17">
      <title>V. CONCLUSIONS</title>
      <p>Firstly, some limitations of this study should be
highlighted. In the quantitative part, the main limitation
encountered was that most of the sample came from few
higher education institutions. For its part, one of the main
limitations of the qualitative phase was that most of the
informants came from the same institution. However, this
limitation was compensated for by having a diverse group of
participants (teachers with and without experience in handling
ICTs, administrative staff, academic heads).</p>
      <p>Besides, it is also necessary to take into account, when
interpreting the results, the high student-teacher ratio in
Moroccan universities, given that there are 63 students for
every teacher (62.93).</p>
      <p>In general, despite all the needs and areas for improvement
identified by the participating teachers, they showed a good
disposition towards the use of educational technologies.
However, it should be pointed out that the management and
technical agents did express some reticence on the part of the
teaching staff, which can be explained by the effect of the
social desirability bias, which means that teachers may tend to
respond to what they consider will be better received by the
interviewer. This reticence can be explained by several of the
reasons explained above, such as the extra workload involved
in starting to use ICT or the lack of institutional stimulus
programmes.</p>
      <p>However, in both phases of the study, it is clear that
inexperienced teachers consider technologies to be useful for
their work, although they do not specify specific didactic uses,
which again highlights the need for training programmes in
the pedagogical use of ICT.</p>
      <p>In this sense, the positive results expressed by the
participants in the discussion group held with the teachers who
are experts in the use of ICT (held at the Institute of eLearning
at Mohammed V University) open the door to taking the work
carried out at that centre as a model, bearing in mind that its
teachers seem to have made a successful adoption of these
tools, showing knowledge of both technical handling and
educational possibilities.</p>
      <p>The final conclusion of the study, especially ratified with
decision-makers in the Ministry of Higher Education and
government teams from Moroccan public universities, is the
need to introduce learning technologies under a strategic
framework that allows the important challenges identified to
be tackled with adequate guarantees of success and
sustainability.</p>
    </sec>
    <sec id="sec-18">
      <title>ACKNOWLEDGEMENTS</title>
      <p>This work is part of the Projet Jumelage Enseignement
Supérieur 2018-2020 “Appui au Système de l'Enseignement
supérieur au Maroc dans le cadre d'un rapprochement avec
l'Espace européen de l'Enseignement supérieur” (Ref.
Referencia: MA13/ENPI/SO/02-17 (MA/58)).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Rodríguez-Conde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gamazo-García</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>García-Holgado</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Abad</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Sánchez-Prieto</surname>
          </string-name>
          ,
          <article-title>"Rapport Final de la Composante 3 Diversification des modalités d'enseignement (stratégie e-learning),"</article-title>
          Ministère de l'Éducation Nationale,
          <string-name>
            <surname>de la Formation Professionnelle de l'Enseignement</surname>
          </string-name>
          Supérieur et de la Recherche Scientifique, Maroc,
          <year>2020</year>
          . [Online]. Available: https://bit.ly/38zomrG
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Rodríguez-Conde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Therón</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>GarcíaHolgado</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Abad</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Benito-Santos</surname>
          </string-name>
          ,
          <article-title>"Grupo GRIAL," IE Comunicaciones</article-title>
          . Revista Iberoamericana de Informática Educativa, vol.
          <volume>30</volume>
          , no.
          <fpage>33</fpage>
          -
          <lpage>48</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Grupo</surname>
            <given-names>GRIAL</given-names>
          </string-name>
          ,
          <article-title>"</article-title>
          <source>Producción Científica del Grupo GRIAL de 2011 a</source>
          <year>2019</year>
          ,
          <article-title>"</article-title>
          <source>Grupo GRIAL</source>
          , Universidad de Salamanca, Salamanca, España,
          <string-name>
            <surname>GRIAL-TR-</surname>
          </string-name>
          2019
          <source>-010</source>
          ,
          <year>2019</year>
          . [Online]. Available: https://zenodo.org/record/2821407
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <source>[4] European Ministers of Education. "The European Higher Education Area - Bologna declaration. Bologna on the 19th of June</source>
          <year>1999</year>
          .
          <article-title>" https://goo.gl/W675Nm (accessed 15 Jul</article-title>
          .,
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          and
          <string-name>
            <given-names>A. M.</given-names>
            <surname>Seoane-Pardo</surname>
          </string-name>
          ,
          <article-title>"Una revisión actualizada del concepto de eLearning. Décimo Aniversario," Education in the Knowledge Society</article-title>
          , vol.
          <volume>16</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>119</fpage>
          -
          <lpage>144</lpage>
          ,
          <year>2015</year>
          , doi: 10.14201/eks2015161119144.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>E.</given-names>
            <surname>Crisol-Moya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Herrera-Nieves</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>R.</given-names>
            <surname>Montes-Soldado</surname>
          </string-name>
          ,
          <article-title>"Educación virtual para todos: una revisión sistemática," Education in the Knowledge Society</article-title>
          , vol.
          <volume>21</volume>
          , art. 15, pp.
          <fpage>15</fpage>
          -
          <lpage>1</lpage>
          -
          <fpage>15</fpage>
          -13,
          <year>2020</year>
          , doi: 10.14201/eks.20327.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <article-title>"Modelo de referencia para la enseñanza no presencial en universidades presenciales,"</article-title>
          <source>Campus Virtuales</source>
          , vol.
          <volume>9</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>41</fpage>
          -
          <lpage>56</lpage>
          ,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>M. D. Arango Serna</surname>
            ,
            <given-names>J. W.</given-names>
          </string-name>
          <string-name>
            <surname>Branch</surname>
            ,
            <given-names>L. M.</given-names>
          </string-name>
          <string-name>
            <surname>Castro Benavides</surname>
            , and
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Burgos</surname>
          </string-name>
          ,
          <article-title>"Un modelo conceptual de transformación digital</article-title>
          . Openergy y el caso de la Universidad Nacional de Colombia,
          <article-title>" Education in the Knowledge Society</article-title>
          , vol.
          <volume>19</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>95</fpage>
          -
          <lpage>107</lpage>
          ,
          <year>2018</year>
          , doi: 10.14201/eks201819495107.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Beltrán Hernández de Galindo and M. S. Ramírez-Montoya</surname>
          </string-name>
          ,
          <article-title>"Innovation in the Instructional Design of Open Mass Courses (MOOCs) to Develop Entrepreneurship Competencies in Energy Sustainability," Education in the Knowledge Society</article-title>
          , vol.
          <volume>20</volume>
          ,
          <issue>art</issue>
          . 5,
          <year>2019</year>
          , doi: 10.14201/eks2019_
          <fpage>20</fpage>
          _
          <fpage>a5</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Fidalgo-Blanco</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. L.</given-names>
            <surname>Sein-Echaluce</surname>
          </string-name>
          ,
          <article-title>"Los MOOC: Un análisis desde una perspectiva de la innovación institucional universitaria,"</article-title>
          <source>La Cuestión Universitaria</source>
          , vol.
          <volume>9</volume>
          , pp.
          <fpage>117</fpage>
          -
          <lpage>135</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Fox</surname>
          </string-name>
          ,
          <article-title>"From MOOCs to SPOCs,"</article-title>
          <source>Communications of the ACM</source>
          , vol.
          <volume>56</volume>
          , no.
          <issue>12</issue>
          , pp.
          <fpage>38</fpage>
          -
          <lpage>40</lpage>
          ,
          <year>2013</year>
          , doi: 10.1145/2535918.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>J. W.</given-names>
            <surname>Creswell</surname>
          </string-name>
          ,
          <article-title>A concise introduction to mixed methods research</article-title>
          .
          <source>SAGE publications</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <article-title>Direction des Stratégies et des Systèmes d'Information, "L'enseignement supérieur en chiffres</article-title>
          <year>2017</year>
          /
          <year>2018</year>
          ," Ministère de l'Education Nationale, de la Formation Professionnelle, de l'Enseignement Supérieur et de la Recherche Scientifique,
          <year>2018</year>
          . [Online]. Available: https://www.enssup.gov.ma/sites/default/files/STATISTIQUES/4535/ Brochure%20v%
          <fpage>20101218</fpage>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Rodríguez-Conde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Abad</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>García-Holgado</surname>
          </string-name>
          ,
          <article-title>"Cuestionario de Indicadores sobre la Penetración y Uso de las Tecnologías Educativas en las Universidades Públicas Marroquíes,"</article-title>
          <source>Grupo GRIAL</source>
          , Salamanca, España, Informe
          <string-name>
            <surname>Técnico</surname>
          </string-name>
          GRIAL-TR-2019
          <source>-003</source>
          ,
          <year>2019</year>
          . [Online]. Available: http://repositorio.grial.eu/handle/grial/1543
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Rodríguez-Conde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Abad</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>García-Holgado</surname>
          </string-name>
          ,
          <article-title>"Questionnaire on Indicators of Incorporation and Use of Educational Technologies in Moroccan Public Universities,"</article-title>
          GRIAL Research Group, Salamanca, Spain,
          <source>Technical Report GRIALTR-2019-004</source>
          ,
          <year>2019</year>
          . [Online]. Available: http://repositorio.grial.eu/handle/grial/1543
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Rodríguez-Conde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Abad</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>García-Holgado</surname>
          </string-name>
          ,
          <article-title>"Questionnaire d'Indicateurs sur la Pénétration et l'Usage des Technologies Éducatives dans les Universités Publiques Marocaines," Groupe de recherche GRIAL, Salamanca</article-title>
          , Espagne,
          <source>Rapport technique GRIAL-TR-2019-005</source>
          ,
          <year>2019</year>
          . [Online]. Available: http://repositorio.grial.eu/handle/grial/1545
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Abad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>García-Holgado</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Rodríguez-Conde</surname>
          </string-name>
          ,
          <article-title>"Cuestionario de Aceptación de las Tecnologías Educativas para la Docencia en las Universidades Públicas Marroquíes,"</article-title>
          <source>Grupo GRIAL</source>
          , Salamanca, España, Informe
          <string-name>
            <surname>Técnico</surname>
          </string-name>
          GRIAL-TR-2019
          <source>-006</source>
          ,
          <year>2019</year>
          . [Online]. Available: http://repositorio.grial.eu/handle/grial/1547
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Abad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>García-Holgado</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Rodríguez-Conde</surname>
          </string-name>
          ,
          <article-title>"Questionnaire to measure Educational Technologies Acceptance in Moroccan Public Universities,"</article-title>
          GRIAL Research Group, Salamanca, Spain,
          <source>Technical Report GRIAL-TR2019-007</source>
          ,
          <year>2019</year>
          . [Online]. Available: http://repositorio.grial.eu/handle/grial/1548
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Abad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>García-Holgado</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Rodríguez-Conde</surname>
          </string-name>
          ,
          <article-title>"Questionnaire d'Acceptation des Technologies Éducatives par le corps Professoral des Universités Publiques Marocaines," Groupe de recherche GRIAL, Salamanca</article-title>
          , Espagne,
          <source>Rapport technique GRIAL-TR-2019-008</source>
          ,
          <year>2019</year>
          . [Online]. Available: http://repositorio.grial.eu/handle/grial/1549
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>CRUE</surname>
            <given-names>TIC</given-names>
          </string-name>
          ,
          <article-title>UNIVERSITIC 2014: Descripción, Gestión y Gobierno de las TI en el Sistema Universitario Español</article-title>
          . Madrid, España: Conferencia de Rectores de las Universidades
          <source>Españolas (CRUE)</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>J.</given-names>
            <surname>Gómez</surname>
          </string-name>
          ,
          <string-name>
            <surname>UNIVERSITIC</surname>
          </string-name>
          <year>2016</year>
          .
          <article-title>Análisis de las TIC en las Universidades Españolas</article-title>
          , Madrid: Crue Universidades Españolas,
          <year>2016</year>
          . [Online]. Available: https://goo.gl/ctJLJC.
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>S.</given-names>
            <surname>Píriz</surname>
          </string-name>
          , Ed.
          <source>UNIVERSITIC 2015</source>
          .
          <article-title>Análisis de las TIC en las Universidades Españolas</article-title>
          . Madrid: Crue Universidades Españolas,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>J.</given-names>
            <surname>Gómez</surname>
          </string-name>
          , Ed.
          <source>UNIVERSITIC 2017</source>
          .
          <article-title>Análisis de las TIC en las Universidades Españolas</article-title>
          . Madrid, España: Crue Universidades Españolas,
          <year>2018</year>
          . [Online]. Available: https://goo.gl/zDz5fx.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>CRUE Universidades</given-names>
            <surname>Españolas</surname>
          </string-name>
          .
          <article-title>"UniversiTIC."</article-title>
          http://www.crue.org/SitePages/Universitic.aspx (accessed 15 Jul.,
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>V.</given-names>
            <surname>Venkatesh</surname>
          </string-name>
          and H. Bala,
          <article-title>"Technology Acceptance Model 3 and a Research Agenda on Interventions,"</article-title>
          <source>Decision Sciences</source>
          , vol.
          <volume>39</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>273</fpage>
          -
          <lpage>315</lpage>
          ,
          <year>2008</year>
          , doi: 10.1111/j.1540-
          <fpage>5915</fpage>
          .
          <year>2008</year>
          .
          <volume>00192</volume>
          .x.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Sánchez-Prieto</surname>
          </string-name>
          , Á.
          <string-name>
            <surname>Hernández-García</surname>
            ,
            <given-names>F. J.</given-names>
          </string-name>
          <string-name>
            <surname>García-Peñalvo</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Chaparro-Peláez</surname>
            , and
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Olmos-Migueláñez</surname>
          </string-name>
          ,
          <article-title>"Break the walls! Second-Order barriers and the acceptance of mLearning by first-year pre-service teachers " Computers in Human Behavior</article-title>
          , vol.
          <volume>95</volume>
          , pp.
          <fpage>158</fpage>
          -
          <lpage>167</lpage>
          ,
          <year>2019</year>
          , doi: 10.1016/j.chb.
          <year>2019</year>
          .
          <volume>01</volume>
          .019.
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>F.</given-names>
            <surname>Huang</surname>
          </string-name>
          , Teo,
          <string-name>
            <surname>T.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Sánchez-Prieto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Olmos-Migueláñez</surname>
          </string-name>
          ,
          <article-title>"Cultural values and technology adoption: A model comparison with university teachers from China and Spain,"</article-title>
          <source>Computers &amp; Educations</source>
          , vol.
          <volume>133</volume>
          , pp.
          <fpage>69</fpage>
          -
          <lpage>81</lpage>
          ,
          <year>2019</year>
          , doi: 10.1016/j.compedu.
          <year>2019</year>
          .
          <volume>01</volume>
          .012.
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Sánchez-Prieto</surname>
          </string-name>
          ,
          <article-title>"Diseño de un modelo de adopción tecnológica para evaluar la aceptación de tecnologías móviles en el profesorado de primaria," PhD</article-title>
          , Universidad de Salamanca, Salamanca, Spain,
          <year>2018</year>
          . [Online]. Available: https://goo.gl/qGi4Bc
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Sánchez-Prieto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Olmos-Migueláñez</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <article-title>"MLearning and pre-service teachers: An assessment of the behavioral intention using an expanded TAM model," Computers in Human Behavior</article-title>
          , vol.
          <volume>72</volume>
          , pp.
          <fpage>644</fpage>
          -
          <lpage>654</lpage>
          ,
          <year>2017</year>
          , doi: 10.1016/j.chb.
          <year>2016</year>
          .
          <volume>09</volume>
          .061.
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Sánchez-Prieto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Olmos-Migueláñez</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <article-title>"Informal tools in formal contexts: Development of a model to assess the acceptance of mobile technologies among teachers," Computers in Human Behavior</article-title>
          , vol.
          <volume>55A</volume>
          , pp.
          <fpage>519</fpage>
          -
          <lpage>528</lpage>
          ,
          <year>2016</year>
          , doi: 10.1016/j.chb.
          <year>2015</year>
          .
          <volume>07</volume>
          .002.
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Sánchez-Prieto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Olmos-Migueláñez</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F. J.</given-names>
            <surname>García-Peñalvo</surname>
          </string-name>
          ,
          <article-title>"A TAM based tool for the assessment of the acceptance of mobile technologies among teachers,"</article-title>
          <source>Salamanca, Spain</source>
          ,
          <year>2016</year>
          . [Online]. Available: http://hdl.handle.
          <source>net/10366/127435</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>