<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Organizational Areas for Improvement When Realizing MOOCs At Universities</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Halvdan Haugsbakken</string-name>
          <email>Halvdan.Haugsbakken@ntnu.no</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Inger Langseth</string-name>
          <email>Inger.Langseth@ntnu.no</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Sociology and Political Science, Norwegian University of Science and Technology</institution>
          ,
          <addr-line>Trondheim</addr-line>
          ,
          <country country="NO">Norway</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Institute for Teacher Education, Norwegian University of Science and Technology</institution>
          ,
          <addr-line>Trondheim</addr-line>
          ,
          <country country="NO">Norway</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2017</year>
      </pub-date>
      <fpage>112</fpage>
      <lpage>117</lpage>
      <abstract>
        <p>This policy paper addresses organizational areas for improvement when universities start producing MOOCs. These areas surface in the intersection between educational practice and MOOC policies, and they will be discussed in three parts in the paper. First, we describe the organizational context in which this paper is based. Second, we outline four organizational challenges that can shape the conditions for developing MOOCs at universities. Third, we suggest strategies to shape educational policies and solve organizational challenges. As MOOC developers, our intention with this paper is to describe how receptive universities are when adopting and implementing MOOCs.</p>
      </abstract>
      <kwd-group>
        <kwd>MOOC</kwd>
        <kwd>Educational Management</kwd>
        <kwd>Strategy</kwd>
        <kwd>Digital Competence</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Since 2013, the largest university in Norway, the Norwegian University of Science and
Technology (NTNU) has invested resources in strengthening the quality of teaching
and learning. NTNU Teaching Excellence,1 is a strategic initiative initiated by the
topmanagement to lift the standard of NTNU’s teaching practices to an international level.
The 30 projects that have so far resulted from the initiative, differ in size and scope and
are funded over a period of one, three or four years. Some projects were bottom-up
initiated, where educators applied and received funding as part of an internal selection
process. Other projects were top-down initiated and participation was by invitation
only. The initiative also tried to meet student demands, since NTNU had been criticized
for being too lecture-centric and creating disengaged students in previous student
evaluations. Also, the intention behind NTNU Teaching Excellence was to explore creative
and innovative teaching and learning in higher education.</p>
      <p>Contrary to digital trends in education, NTNU Teaching Excellence reflected a low
interest in new technologies and digitalized education among university educators at
NTNU. NTNU Teaching Excellence funded only two or three educational projects that
aimed exploring MOOC pedagogics. For example, these MOOC initiatives were fueled
by a handful of enthusiastic university educators, who share a passion for new
technologies and digital services. They are early adopters or innovators of technology
and learning. MOOCs at NTNU were grass root driven and bottom-up directed.</p>
      <p>
        Their work has so far resulted in a limited number of MOOCs that reflect two
pedagogical approaches. On the one hand, university educators develop their digital
competences when they jointly produce MOOC courses for internal use in their own subject
area to solve challenges in the educational culture. The collaborative learning process
consists of experimental self-learning, collective reflection and action research. The
aim is to improve teaching and learning in the short term, and to change educational
cultures in the long run. Many university educators seem to lack knowledge about new
technologies and how to produce MOOCs [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. At NTNU’s teacher education one
created a MOOC to deal with the mentioned purpose, and that also aimed at enhancing
the professional digital competence of teacher educators, which so far have been
completed by some twenty teacher educators.
      </p>
      <p>
        On the other hand, MOOCs are also offered as part of courses in further education
at NTNU and are offered as external courses to anyone who wish to enhance their
competences. These MOOCs, however, are made from scratch or converted into an
online course from an existing campus course. Here, course participants can obtain a
certificate of participation upon completion of the MOOC, or they can gain study
credits when passing a final exam upon payment of a tuition fee. An example of the latter,
is the Smart learning MOOC,2 which is a joint educational venture between the
Department of Sociology and Political Science and the Department for Teacher Education,
funded by NTNU Teaching Excellence and the Norwegian Agency for Digital Learning
in Higher Education. The Smart learning MOOC aimed to develop participants’ digital
knowledge, skills and attitude and is based on the text book Smart Laering by Arne
Krokan [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Since 2014, the Smart learning MOOC runs twice a year and takes eight
weeks to complete. The MOOC course offers a diploma on completion or a final exam
with official study credits from NTNU, also against a disbursement of a tuition fee.
Smart learning targets teachers in the Norwegian K-12 system, who wish to strengthen
their digital competences and develop a personal learning network, but participants
have registered from all areas of working life. So far, some 2000 persons have enrolled
in the MOOC, which is based on social and connectivist learning theories.
      </p>
      <p>Seen from a course developer’s perspective, making a MOOC is not a straight
forward journey. One will inevitably encounter organizational challenges. Hence, the
intention with this paper is to address four organizational areas of improvement, which
can ease the realization and production of MOOCs at university. These organizational
areas of improvement are based on experiences that we have accumulated since 2013
as MOOC developers.
2
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>Areas for Organizational Improvement</title>
      <sec id="sec-2-1">
        <title>Area 1: Putting A MOOC Strategy on The Agenda</title>
        <p>We find that the first area for improvement relates to the strategic and organizational
level and the need to develop a holistic institutional MOOC strategy. The holistic
2 See: https://www.ntnu.no/smartlaering/.
MOOC strategy can stand alone in the organization or be embedded in a more
coherent strategy for digitalization in higher education. For example, we suggest that
universities can outline an institutional “MOOC roadmap” and allocate technological and
human resources accordingly to safeguard the quality and the production of MOOCs.</p>
        <p>In contrast, we observe that working with MOOCs is made difficult by other
contemporary and competing educational initiatives, and by the way budgets and people
are tied up. Moreover, universities invest significantly in technological infrastructure,
new Learning Management Systems and related technologies, but these investments
are not automatically accompanied by digital competence development and courses to
develop new pedagogical practices among staff. As for MOOCs, we find little
indication that top-down incentives have been invested in MOOC technologies and research
on MOOCs. Instead, MOOC initiatives are grass root orientated, centered around the
initiative and motivation of a handful of university educators. University educators rely
on marginal local resources and are often dependent on external funding to realize their
ideas. Additionally, external funding agencies, mainly the Norwegian Agency for
Digital Learning in Higher Education, have limited resources to support the work of such
innovative pedagogies. Consequently, proposals on potential MOOC courses are not
easily accepted by funding agencies.</p>
        <p>We therefore find it contradictory to good practice that universities and university
colleges do not invest in relevant IT infrastructure and pedagogical uses of these and
other new digital technologies, including MOOCs. Similarly, there should also be more
emphasis on research on digital teaching and learning to inform future strategies and
funding in higher education.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Area 2: Aligning the Organization to MOOC Production</title>
        <p>We suggest that the second area for improvement relates to the organization’s
supportive role and how the necessities and logics of MOOC production are scaffolded. The
organization needs to simplify and facilitate the production process of MOOCs, in other
words, to create routines. Here, we consider two interrelated fields.</p>
        <p>Firstly, we suggest that universities and funding agencies revise practices on
economic governance on proposals intended to realize MOOCs, as strict and bureaucratic
control of project budgets can limit creativity and innovation in making of MOOCs.
For example, when applying for funding of potential MOOCs, internal and external
funding agencies demand detailed criteria for economic spending. As MOOC
developers, we experienced that criteria for economic spending challenge the notion of
educational innovation. Establishing a framework that is more focused on ensuring that
funding is spent according to original plan, than opening for researchers to explore new
possibilities offered by digital technologies, impedes educational development.</p>
        <p>Secondly, we observe that it is challenging to provide an accurate and up to date
overview of running costs in MOOC projects, as well as in the management of MOOC
courses, when employees from several departments are involved. An observed
organizational pattern is that running costs are divided across different organizational levels.
For example, instead of having a single economic record of a MOOC’s project located
at one department, different departments or faculties create their own economic records
with different bookkeeping practices. This makes it challenging to have a coherent
overview of the costs spent in MOOC projects. Moreover, we suggest that internal
communication across these organizational levels and barriers be an area for
improvement. If internal communication is improved, this can reduce the amount of
project reporting, which is both time consuming and troublesome.</p>
        <p>Therefore, we believe that universities, as an organizational entity, should consider
aligning to modes of organization that foster decentralized and networked
environments. We believe that a vibrant strategy for MOOCs in higher education should
involve participants with complementary competences across institutes and faculties. The
traditional border between teaching and research in higher education must also be
crossed. The strategy should adapt the idea of a network, rather than siloes. The funding
of MOOC projects should be more based on trust and flexibility than budget control.
2.3</p>
      </sec>
      <sec id="sec-2-3">
        <title>Area 3: A Need for a Separate MOOC Infrastructure</title>
        <p>The third area for organizational improvement relates to technological infrastructure
and “a national infrastructure for MOOC production”. As course developers, our
experience is that universities should be better at offering adequate support and service to
realize MOOCs. Another question is to what extent one should develop a national
framework for a separate MOOC infrastructure and allocate human resources
accordingly, as we suggested earlier in the paper.</p>
        <p>We propose this area for improvement for several reasons. The Learning
Management Systems in use do not cater for MOOCs. The LMS used at Norwegian universities
are designed as a kind of information depository, without technological features that
stimulate online social learning. Therefore, we do not find a user interface that we
would expect from a MOOC course and embedded features commonly seen in the
social media landscape, like the possibility to like, follow, separate group functions,
RSSfeeds, etc. Thus, in cases where universities or university colleges wish to run MOOCs,
developers have had to find proper platforms and sign contracts, with all the legal
challenges entailed. Some Norwegian universities focus on creating international MOOCs
in English on the MOOC platform FutureLearn. As for Norwegian language MOOC
production, two options are possible. One can ask the IT department to download and
install open software, like Canvas or Open Edx and run a course there, or one can
register with BIBSYS3, a state owned company running the national library infrastructure,
and pay the cost. The former demands large resources and is more expensive than
renting or hosting space form an external MOOC platform provider like BIBSYS.
2.4</p>
      </sec>
      <sec id="sec-2-4">
        <title>Area 4: Addressing Legal Matters</title>
        <p>
          The fourth area for organizational improvement addresses the relationships between
MOOC pedagogies and legal matters, an area that we have experienced as extremely
challenging for university educators. We argue that MOOC pedagogies and new
technologies open up for new practices that are not covered in current legal frameworks and
interpretations. In some cases, the MOOC pedagogies uncover the need for the
development of new practices. As course developers, one of our most important tasks has
been to check the legal aspects of all technological and pedagogical initiatives, but we
entered a territory where there is great uncertainty and legal disagreement about a range
of matters, like for example whether the Data Protection Agreements is necessary when
3 See: http://www.bibsys.no/organisazion/ BIBSYS has become the national host for most Norwegian MOOCs, offering a
combination of Canvas and Open Edx platforms.
signing an agreement with a MOOC provider. We will also provide two other
examples to illustrate our point:
(1) Who has the legal right to issue a course diploma with a university
logo, when students are not enrolled as students, but attend a free course with no
exams and no final grade? Normally, MOOC providers issue and sell course
diplomas to MOOC participants, but when this option does not apply, how willing is the
university to establish a new practice? Krokan [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ] claims that there is no agreement
on how to deal with the matter at hand.
(2) Who legalizes the piloting of new forms of summative assessment in MOOCs? A
MOOC developer wished to use peer assessment where students grade each other’s
exam papers [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. The argument for peer-assessment was that it is a learning process
and that students should acquire insights in learning objectives and assessment
criteria, and experience other participants’ points of view in addition to the course
providers’. Such pilot initiatives were rejected by legal advisers, who argued that
to pilot the assessment form, the course developers had to apply to the ministry of
educational authority, which is a long process that goes beyond the time frame of
a project.
3
3.1
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Policy options applied</title>
      <sec id="sec-3-1">
        <title>A Program for Digitalization Of Education – NTNU DRIVE</title>
        <p>Then, what policies can improve the organizational challenges that we just outlined? In
2013, NTNU chose not to develop a coherent strategy for the digitalization of education
and learning, but to fund educational projects that could contribute to creative and
innovative teaching and learning in higher education. In 2016, NTNU’s top-management
saw that these educational projects needed top-down coordination and funded a
fiveyear program, NTNU DRIVE, to anchor the digital fruits of the 30 projects across
campuses and simultaneously to make better pedagogical uses of previous investments in
technological infrastructure.4</p>
        <p>NTNU DRIVE is currently in the making. The program is organized as a
decentralized and informal network across institutes and faculties. NTNU DRIVE has also been
manned by a team of persons consisting of participants with complementary
competences. The team consists of experienced educators, researchers, administrative, judicial
and technical consultants. Based on experiences made in the digital Smart learning
project, we have initiated three activities that will provide educators with a technological
infrastructure for MOOCs, that have a budget that leaves room for creativity and
provides clarity among educators and that provide legal support in a complex market.</p>
        <p>One strategy in NTNU DRIVE is to use MOOC pedagogies to create flexible and
varied opportunities for digital competence development among educators and students
alike. The NTNU MOOC project is hosted at the Department of Sociology and Political
Science and has currently two roles. One is to support university teachers who wish to
4 See: http://www.ntnu.no/drive.
produce MOOCs, while the other is to produce a variety of MOOCs to be used in
systematic, internal competence development. Outcomes and experiences made in
the Smart learning project have shaped the aims and objectives in this project.</p>
        <p>Another strategy is to keep up with new technological trends and try out new
technologies and digital tools. The NTNU BETA project is hosted at the Department of
Computer Science and focuses on continuous experimenting, testing and development
of new learning technologies and digital learning in a beta phase. There are two roles.
One is to support educators who want to install and pilot new educational technologies,
and the other is to inform policy makers and suggest new technologies in teaching and
learning. Experiences made in the Smart learning project have also paved the way for
this technologically based support.</p>
        <p>A third strategy is to scaffold digital competence development at group level, to
change educational practices in the university institution. The NTNU Internal
Competence Development project is hosted at the Department of Teacher Education and offers
blended learning and MOOCs to groups of educators and students, who will
systematically develop their teaching and learning in courses and programs at faculty and
institute level over a period of time.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Recommendations</title>
      <p>Based on our experience with MOOC production at NTNU, we have the following
recommendations, which can be applied by policy makers. To achieve better conditions
for MOOC production, one needs to:
• Initiate long-term and holistic educational top-down orientated programs that
include broader groups of educators on universities.
• Initiate and create conditions for educational bottom-up projects that leaves room
for creativity and innovation and that might result in new ways of solving
educational challenges.
• Provide the means to create a reliable national and international MOOC
infrastructure to produce MOOCs.
• Create an economic governance system where budget control is transparent and
based on trust, which can allow money to be moved between departments at a
university level.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Jacobsen</surname>
            ,
            <given-names>D.Y.</given-names>
          </string-name>
          ,
          <article-title>Dropping Out or Dropping In? A Connectivist Approach to Understanding Participants' Strategies in an e-Learning MOOC Pilot</article-title>
          .
          <source>Technology, Knowledge and Learning</source>
          ,
          <year>2017</year>
          : p.
          <fpage>1</fpage>
          -
          <lpage>21</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Langseth</surname>
            ,
            <given-names>I. and H.</given-names>
          </string-name>
          <string-name>
            <surname>Haugsbakken</surname>
          </string-name>
          ,
          <article-title>Introducing Blended Learning MOOC - A Study of One bMOOC in Norwegian Teacher Education</article-title>
          , in Stakeholders and Information Technology in Education, D. Passey and T. Brinda, Editors.
          <year>2016</year>
          . p.
          <fpage>59</fpage>
          -
          <lpage>71</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Krokan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <article-title>Smart laering : hvordan IKT og sosiale medier endrer laering</article-title>
          .
          <year>2012</year>
          , Bergen: Fagbokforlaget. 244 s.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Krokan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <article-title>Organisatoriske utfordringer ved MOOC-prosjekter</article-title>
          .
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>