<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Visualizing online (social) learning processes - Designing a Dashboard to support reflection</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Darya Hayit</string-name>
          <email>darya.hayit@uni-duisburg-essen.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tobias Hölterhof</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Martin Rehm</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oskar Carl</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Michael Kerres</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Types of Learning Analytics - A German Perspective</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Duisburg-Essen</institution>
          ,
          <addr-line>Essen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <fpage>35</fpage>
      <lpage>40</lpage>
      <abstract>
        <p>Learning analytics, as a means to visualize learning, has been repeatedly suggested to enhance learners' and teachers' self-reflection in online learning processes. Departing from this notion, we propose a combination of this visual approach to learning analytics with the concept of social presence, thereby acknowledging social aspects of online learning processes that are often overlooked. More specifically, we present the considerations and design of a dedicated dashboard that supports self-reflection by visualizing (social) online learning processes. The approach is based on our belief that visualizing learning by itself does not automatically lead to self-reflection and awareness among students and teachers. Instead, organizers and instructors of learning activities need to be conscious about the social aspects of learning.</p>
      </abstract>
      <kwd-group>
        <kwd>Dashboard</kwd>
        <kwd>reflection</kwd>
        <kwd>social learning</kwd>
        <kwd>online learning</kwd>
        <kwd>awareness</kwd>
        <kwd>visualization</kwd>
        <kwd>learning analytics</kwd>
        <kwd>social presence</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>when considering the implementation of such systems in a German context.</p>
      <p>
        Dashboards are a frequently used and investigated tool in learning management systems
to visualize learning activities. They consist of dedicated pages or areas within the system
mirroring the personal learning process and thereby contributing to the perception and
reflection of underlying learning processes. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] Moreover, departing from the community of
inquiry framework (CoI), it is possible to make other participants in a learning environment
visible at all three levels: cognitive presence, social presence and teaching presence [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        However, we believe that visualizing learning by itself does not automatically lead to
self-reflection and awareness among students and teachers. Instead, drawing on recent
concepts of online learning, like the CoI or the 3C model, the social dimension of learning
might need to be emphasized more strongly. Accordingly, we argue that organizers and
instructors of learning activities need to be conscious about the social aspects of learning.
Many systems seem to focus on the interaction between the learner and the technology (e.g.
often the Learning Management System wherein the learning activity is hosted and
provided). We propose to extend this approach and to also incorporate the social aspects and
interactions between learners in the visualization of learning, thereby providing a more complete
representation of the underlying learning processes. It is the aim to contribute to the
personalization of a learning environment [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>
        Both concepts, the CoI as well as the 3C model, distinguish between three aspects of
learning. While the CoI model focuses on three kinds of presence, namely teaching
presence (e.g. direct instructions), social presence (e.g. emotional expressions, group cohesion,
open communication) and cognitive presence (e.g. triggering events and exploration) [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ],
the 3C model has a somewhat different focus. Following this model, an online course
consists of content (e.g. various kinds of presenting information), construction (e.g. learning
tasks) and communication (e.g. video conferences, chats and/or forum discussions) [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. To
some extent, those models share the same perspective on online learning: beside
emphasizing the social dimension of learning they mention its cognitive component, as well as the
need for instruction. Accordingly, dashboards to mirror a social learning processes consists
of three components containing visualizations of those dimensions.
      </p>
      <p>
        Previous research explored a link between social interaction in learning management
systems (LMS) and learners’ social presence. Among others, Hölterhof and Rehm (2016)
combined the results of social network analysis and social presence, in order to determine
learners’ position within a communication network and relating this to their (social)
experiences within the LMS in question. More specifically, the authors were able to unveil
different dimensions of social presence, especially pointing towards positive as well as negative
social emotions. While research often focuses on positive emotions, both sides of
socioemotional awareness of other learners are important for a technology enhanced social
learning process, especially if learning is considered as an inquiry process. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
Following this approach of not assessing learners experience of social presence but to
visualize the social heterogeneity of learning as a group inquiry process, the advances of
learning analytics turns towards transparency in providing these type of results to all relevant
actors in the learning process (e.g. learners and teachers).
      </p>
      <p>In order to take into consideration both the course structure on the one hand and social
processes within the structures on the other hand, we develop a dashboard based on the afore
mentioned 3C-model.
2</p>
      <p>
        Designing a Dashboard to Visualize (Social) Learning
Processes
Departing from the aforementioned considerations and stipulations, we identified a high
potential for a technology based solution to support and raise awareness in the context of
enabling social presence (experiences). Consequently, we are in the process of designing a
learning analytics dashboard, which is envisioned to become a feedback instrument,
supporting learners in self-reflecting their learning progresses. The dashboard is integrated in a
social learning management system based on the content management system (CMS)
Drupal®, which is enriched by numerous features to enable communication and collaboration
between learners and teachers [
        <xref ref-type="bibr" rid="ref11 ref12">11, 12</xref>
        ]. The system is further extended by a range of
customized modules that visualize the underlying social and cognitive learning processes.
Drawing on the 3C-model of online learning, digital learning contains of three different
types of structural elements: content, construction and communication. The dashboard
depicts all three elements of the model and is based on a selection of different applicable
variables. The selected variables per category arise from the various affordances that the LMS
offers. The content component visualizes the usage of learning materials available to
learners, like text documents, interactive trainings or videos. Especially clicks on learning
materials are considered to represent its usage. The constructive component mirrors learners’
behavior in relation to the learning assignments. Visualizations within this component
present the number of learning tasks per course unit, the number of submissions per task and
the number of tries per person in order to solve a learning tasks. The communication
component can be considered as rudimentary perspectives on social structures similar to what
social network analysis investigates. They offer interpersonal communication, including
number of posts in a discussion forum, comments per post and a distribution of posts per
role (teacher and learner). Table 1 gives an overview of other variables, which will be
presented within the dashboard.
      </p>
      <p>In order to enable a possible transfer of the dashboard into other CMS and LMS (e.g.
Moodle), the chosen variables and database structure have been constructed to enable this
interoperability.
“Content” variables</p>
      <p>“Construction” variables</p>
    </sec>
    <sec id="sec-2">
      <title>Number of learning materials Number of learning tasks</title>
      <p>“Communication”
variables</p>
    </sec>
    <sec id="sec-3">
      <title>Number of discussions/ posts</title>
    </sec>
    <sec id="sec-4">
      <title>Usage of learning materials</title>
    </sec>
    <sec id="sec-5">
      <title>Proportion of usage</title>
    </sec>
    <sec id="sec-6">
      <title>Number of submissions per</title>
      <p>learning task and person</p>
    </sec>
    <sec id="sec-7">
      <title>Number of comments per</title>
      <p>post (in average)
The dashboard will be piloted in the context of two online master study programs at a
German University, which are designed as in a blended learning course format.
The programs focus on online-learning- periods, which last at least nine weeks and up to
twelve weeks in which three weeks form a unity. During this time, participants
communicate with each other and engage into learning activities within the applicable LMS.
Ultimately, the goal of this instrument is to stimulate course (activity) by enhancing
transparency of (social) learning activities at different points in time. After each three-week course
unit, students and teachers will be able to voluntarily access the current visualization of
what activities took place. This in turn creates an opportunity for all participating actors
(e.g. learners and teachers) to self-reflect about their learning behavior. It also relates
effective data to previous points in time as well as previous courses. A visual representation of
an initial wireframe is provided in Figure 1 below.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Duval E</surname>
          </string-name>
          (
          <year>2010</year>
          )
          <article-title>Attention Please! Learning analytics for visualization and recommendation</article-title>
          .
          <source>In: ACM (ed) Proceedings of LAK11: 1st international conference on learning analytics and knowledge</source>
          , New York,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Leony</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pardo</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>de la Fuente</surname>
            <given-names>L</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sanchez</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Delgado</surname>
            <given-names>C</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>GLASS: A learning analytics visualization tool</article-title>
          . In: ACM (ed) Proceeding
          <source>LAK '13 proceedings of the third international conference on learning analytics and knowledge</source>
          , New York,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Chen</surname>
            <given-names>W</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Persen</surname>
            <given-names>R</given-names>
          </string-name>
          (
          <year>2009</year>
          )
          <article-title>A recommender system for collaborative knowledge</article-title>
          .
          <source>In: IOS Press (ed) Proceedings of the 2009 conference on artificial intelligence in education, Amsterdam</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Özyurt</surname>
            <given-names>Ö</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Özyurt</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baki</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Güven</surname>
            <given-names>B</given-names>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>Integration into mathematics classrooms of an adaptive and intelligent individualized e-learning environment: Implementation and evaluation of UZWEBMAT</article-title>
          .
          <source>Computers in Human Behaviour</source>
          <volume>29</volume>
          (
          <issue>3</issue>
          ):
          <fpage>726</fpage>
          -
          <lpage>738</lpage>
          .
          <fpage>39</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Ruipérez-Valientea</surname>
            <given-names>JA</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Muñoz-Merinoa</surname>
            <given-names>PJ</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leonya</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Delgado Kloosa</surname>
            <given-names>C</given-names>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>ALAS-KA: A learning analytics extension for better understanding the learning process in the Khan Academy platform</article-title>
          .
          <source>Computers in Human Behaviour</source>
          <volume>47</volume>
          :
          <fpage>139</fpage>
          -
          <lpage>148</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Verpoorten</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Westera</surname>
            <given-names>W</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Specht</surname>
            <given-names>M</given-names>
          </string-name>
          (
          <year>2011</year>
          )
          <article-title>A first approach to “Learning Dashboards” in formal learning contexts</article-title>
          .
          <source>Paper presented at the ADVTEL workshop (1st International Workshop on Enhancing Learning with Ambient Displays and Visualization Techniques) at EC-TEL</source>
          <year>2011</year>
          , Palermo, 20
          <string-name>
            <surname>Sept</surname>
          </string-name>
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Garrison</surname>
            <given-names>DR</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anderson</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Archer</surname>
            <given-names>W</given-names>
          </string-name>
          (
          <year>2000</year>
          )
          <article-title>Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education</article-title>
          .
          <source>The Internet and Higher Education</source>
          ,
          <volume>2</volume>
          (
          <issue>2-3</issue>
          ),
          <fpage>87</fpage>
          -
          <lpage>105</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Verpoorten</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Glahn</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kravcik</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ternier</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Specht</surname>
            <given-names>M</given-names>
          </string-name>
          (
          <year>2009</year>
          )
          <article-title>Personalisation of Learning in Virtual Learning Environments</article-title>
          . In Cress U,
          <string-name>
            <surname>Dimitrova</surname>
            <given-names>V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Specht</surname>
            <given-names>M</given-names>
          </string-name>
          <source>(Eds.) Lecture Notes in Computer Sciences 5794, Learning in the Synergy of Multiple Disciplines</source>
          ,
          <fpage>52</fpage>
          -
          <lpage>66</lpage>
          . Berlin, Germany, Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Kerres</surname>
          </string-name>
          , M, de Witt, C (
          <year>2003</year>
          )
          <article-title>A didactical framework for the design of blended learning arrangements</article-title>
          .
          <source>Journal of Educational Media</source>
          ,
          <volume>28</volume>
          ,
          <fpage>101</fpage>
          -
          <lpage>114</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Hölterhof</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rehm</surname>
            <given-names>M</given-names>
          </string-name>
          (
          <year>2016</year>
          )
          <article-title>: Learning in Online Social Networks: Exploring Structural and Emotional Aspects of Social Presence and Sense of Community</article-title>
          .
          <source>Paper presented at AERA</source>
          <year>2016</year>
          , Washington D.C., 11
          <string-name>
            <surname>Apr</surname>
          </string-name>
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Hölterhof</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heinen</surname>
            <given-names>R</given-names>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>A Concept to Bridge Personal Learning Environments: Including a Generic Bookmarking Tool into a Social Learning Management Systems</article-title>
          .
          <source>Journal of Literacy and Technology</source>
          ,
          <volume>15</volume>
          (
          <issue>2</issue>
          ),
          <fpage>111</fpage>
          -
          <lpage>135</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Hölterhof</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nattland</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kerres</surname>
            <given-names>M</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Drupal as a Social Hub for Personal Learning</article-title>
          . In: PLE Conference Proceedings. Available via http://revistas.ua.pt/index.php/ple/article/view/1453. Accessed 29
          <fpage>Jun2016</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>