<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Visualization Index for Educational Resources by Learning Analytics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Noem DeCastro-Garc a</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Angel Luis Mun~oz C</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Mathematics, Universidad de Leon</institution>
          ,
          <addr-line>Campus de Vegazana s/n 24071, Leon</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Research Institute of Applied Science in Cybersecurity (RIASC), Universidad de Leon</institution>
          ,
          <addr-line>Leon</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <abstract>
        <p>In this paper, we propose an oriented-graph - design of the database generated in a virtual educational platform with the records of students access to the learning resources. This theoretical model lets us compute a visualization index for students and for the available material in the platform in a total and a partial way, by the 1-norm of the adjacency matrix of the graph. These coe cients let us construct a classi cation system that it could be useful for determining di erent levels for students and for the material. Then, we can propose di erent sca olding for the learning activities and e ective learning outcomes for a meaningful learning experience depending on the interaction between the students and the resources.</p>
      </abstract>
      <kwd-group>
        <kwd>Learning analytics</kwd>
        <kwd>Learning design</kwd>
        <kwd>Learning resources</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Current educational context is characterized by the diversity of the instruction,
students, and multimedia supports. Moreover, there exist a large number of
hybrid courses in which the blended, online and face-to-face learning are present
at the same time. In this framework, a thought about the material provided by
the teacher is an essential action in order to nd learning patterns and improve
the learning and teaching processes.</p>
      <p>
        Learning analytics techniques may provide very useful tools that help the
teachers to optimize their work (see [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]). The second axiom that is used in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
to analyze the development of the learning analytics eld is based on the idea
that learners are agents. This assumption implies that they have the capability
to exercise choice in reference to preferences (see [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]). And one of the conditions
that could in uence in their preferences is the course instructional design, that
includes the learning material. The analysis of data that are generated from the
interactions between the students and the virtual environment can be used to
predict the achievement of learning outcomes, take decisions on resource design
or analyze the evolution or behavior of the students ([
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]).
      </p>
      <p>Copyright © 2018 for this paper by its authors. Copying permitted for private and academic purposes</p>
      <p>
        Although learning analytics give the teachers methods and tools of gathering
information on how learners are interacting with learning resources, usually there
is a gap between this information and the pedagogical actions that help to the
teachers in their learning designs ([
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]). Moreover, this gap is bigger in situations
in which the teachers have not statistical or technical pro le. In this scenario, it
is necessary that the learning analytics and learning design come together.
      </p>
      <p>
        Learning designs describe frameworks that can be used to help the teachers in
the design and the choice of learning resources, learning tasks or activities, and
learning supports in order to create a meaningful learning experience for the
students, especially with the use of Information and Communication Technologies,
(see [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ],[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]).
      </p>
      <p>
        In the conceptual framework that links learning analytics and learning design,
we have four dimensions on which we can work: temporal analytics, comparative
analytics, cohort dynamics and tool speci c analytics . The third one, the cohort
dynamics, is a category that helps us to propose di erent learning outcomes
depending on the di erent interaction patterns manifested in a course between
students and resources. In this context, the study of whether a student has
accessed or not to a speci c resource is one of the most requested questions
by di erent educational agents as desired information about a course (see [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]).
The answer to this question could help to identify what learning activities or
resources need to be modi ed in order to adapt them to the needs of students
(see [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]). The above question could appear a very simple issue, and frequently,
the data that let us answer it are generated in the educational platform as
Moodle. However, the usual learning management systems have not available
simple tools that provide this information in a visual and easy form (see [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]).
The data are structured, but they are registers or logs of activity with a lot of
redundant features that mean di culties to analyze, visualize and discuss, in a
global way with e ective lters, especially for non-expert teachers in analytical
studies.
      </p>
      <p>One of the usual available tools in an educational platform is the ow
visualizations of the number of visits that each resource has had trough the time.
These graphics are often performed with the absolute frequencies of the visits,
so its interpretation has to be done carefully because it could be deceptive and
confused. For example, we can have a resource that has the highest number of
visits and, however, it has been seen only by a minority number of the students.
In Figure 1 we can see a typical ow of the visits of the resources by the students
in a course in Moodle. We have information about the number of visits per day
but we do not know what resources have been visited or the students that have
accessed to the material. Moreover, it is necessary to take into account that
the interpretation of the obtained results can imply di erent learning insights
depending on the context of implementation. So, simple tools of an overview
of the results, for students and resources, are needed in order to get a good
understanding of this type of cohort dynamics.</p>
      <p>This is the motivation for this work: to obtain more speci c information about
the visualization of the educational resources by the students, in an easy way
that let us create a simple tool. We propose a simple mathematical model that
allows us to analyze the interaction between them and, nally, to obtain a
classication system for both of them. This approach is based on the consideration of
the visualization index. Its computation and the subsequent classi cation let us
provide an overview of the results of the analyses that it is easily understandable
for non- experts in learning analytics. In addition, this index can be applied for a
global course, and in a partial form (for students or for resources).The proposed
model is based on an oriented graph having as nodes both, the students and
the resources. Since the most of the learning management systems for education
have implemented models with social network analysis, it would make easier its
integration in the usual educational platforms.</p>
      <p>This work is organized as follows: In Section 2, we list the goals of this article.
The proposed model to analyze the data is developed in Section 3, together
with a simple example that helps to understand the essential ideas. Finally, the
conclusions and references are given.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Goals</title>
      <p>The main goals of this work are:
1. To de ne a measurement index of visualization that let us analyze what
happens or what happened in a course regarding the interaction between
the students and the provided resources.
2. To de ne a classi cation system for resources and students that depends on
the developed metric.
3. To obtain a simple procedure that gives us a general overview of the situation.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Main results</title>
      <p>This section describes the design of the mathematical model that let us compute
the visualization indices of a course.
3.1</p>
      <p>
        Model of the database
We have used a graph approach to model the data. A graph database is a
database that can be structured in graph form so that the nodes of the graph
contain the information, and the edges contain properties and/or de ne relations
between the information contained in the nodes. One of the main strengths of
this kind of databases is the capability to give answers in short time for questions
regarding relations (see [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]).
      </p>
      <p>Remark 1. We will state the following notation
1. The set X = fx1; : : : ; xlg is going to be the set of nodes that represent the
students.
2. The set Y = fy1; : : : ; ysg contains the resources that the teacher provides
through the virtual platform
3. The database D that we can download from the virtual platform, usually in
.csv format. This database contains the set of all registers Rk. Each register
represents a case in which each student visits one speci c resource.
We can now attach a graph structure to D. In order to do so, we have to de ne
the set of nodes, N , and the set of arrows, A. The graph, G = (N; A), is going
to be composed by two layers of nodes in such a way that all the arrows have
their source in one layer and target in the other one.
1. Layer 1: the nodes are the elements of the set X.
2. Layer 2: the nodes are the elements of the set Y .
3. We have an edge xi ! yj if and only if the student xi has visited the resource
yj . From now on this relation will be expressed as yj 2 xi.</p>
      <p>Example 1. In this example, we suppose that we have a face-to-face course with
six students and ve resources (four of them about contents of the course, and
y5 that is a learning task). So, the layer 1 has six nodes and the layer 2 has ve
nodes. We suppose that we have obtained the database D that is shown in Table
1.
The look of the corresponding graph of D and the ltered data are in Figure
In the sequel, B will denote the set f0; 1g, and the set of matrices with entries
in B with l rows and s columns will be denoted by Bl s.</p>
      <p>De nition 1. The adjacency matrix of D is de ned as the adjacency matrix,
A 2 B(l+s) (l+s), of the associated graph:
2.</p>
      <p>User Resource
x1 y1
x2 y1
x3 y1
x1 y2
x3 y3
x3 y2
x2 y2
x3 y5
x5 y5
x4 y1
yO1Y bf
x1
y2
E O Y
x2
y3
O
x3
y4
x4
&lt;yO5
x5
x6</p>
      <p>where
for i = 1; : : : ; l , j = 1; : : : ; s</p>
      <p>x1 : : : xl y1 : : : ys
ys
cij =
0
0</p>
      <p>1
C = (cij )CC</p>
      <p>C
C
C
C
C</p>
      <p>A
0
1 if yj 2 xi
0 if yj 2= xi
(1)
(2)
(3)
Remark 2. Note that we are only interested in the block C that have been
dened. So, the study of the adjacency matrix is reduced to the study of the matrix
C. For this reason, in this paper, we will use both, the letter A and the letter C,
to make reference to such adjacency matrix if there is no possible confussion.
Example 2. The adjacency matrix associated to the vector database of Example
1 is
0 0 0 0 0 0 0 1 1 0 0 0 1
B 0 0 0 0 0 0 1 1 0 0 0 C
BB 0 0 0 0 0 0 1 1 1 0 1 CC
BB 0 0 0 0 0 0 1 0 0 0 0 CC</p>
      <p>BB 0 0 0 0 0 0 0 0 0 0 1 CC
A = BB 0 0 0 0 0 0 0 0 0 0 0 CC</p>
      <p>BB 0 0 0 0 0 0 0 0 0 0 0 CC
BB 0 0 0 0 0 0 0 0 0 0 0 CC
BB 0 0 0 0 0 0 0 0 0 0 0 CC
B@ 0 0 0 0 0 0 0 0 0 0 0 CA</p>
      <p>0 0 0 0 0 0 0 0 0 0 0
where the matrix C is highlighted in bold characters.
3.2</p>
      <p>Visualization indices
Once we have obtained the adjacency matrix associated to D, we can compute
the total visualization index of the course by the following formula
De nition 2. The total visualization index, D, is the rate of resources that
have been visited, at least, one time.</p>
      <p>D := k A k1 ;
l s
k A k1 being the 1-norm of the matrix A, that it is, the number of 10s in the
matrix A.
Ths visualization index is a real positive number less or equal than one, D 2
[0; 1].</p>
      <p>De nition 3. The partial row-visualization index, xi , is the rate of resources
that have been visited by the student xi at least one time,
k ai k1 being the1-norm of the i-th row of the matrix A, that it is, the number
of 10s in the i-th row of the matrix A. As more resources the student visit, as
higher the index is.</p>
      <p>De nition 4. The partial column-visualization index, yj , is the rate of students
that have visited the resource yj at least one time,
(5)
(6)
k a j k1 being the1-norm of the j-th column of the matrix A, that it is, the
number of 10s in the j-th column of the matrix A. As more students visit the
resource, as higher the index is.</p>
      <p>Like the visualization index, the partial visualization indices are positive real
numbers less or equal than one.</p>
      <p>We highlight that the value of the visualization index has a di erent
interpretation depending on the type of the course we are teaching. For instance, we
have to take into account that the index has di erent consequences if we deal
with an in-person course or an online course. This fact is very important in the
prescriptive design stage. The ideal scenario would get the indices in di erent
checkpoints that let us analyze the dynamic of the course.</p>
      <p>Example 3. The total visualization index for D given in Example 1 is
D =
As we can see in the partial row-visualization indices shown in Figure 3, the
student x6 has not visited any resource. On the other hand, the student x3 is
the one that more di erent resources has visited.</p>
      <p>The partial column-visualization indices are included in Figure 4. In this case,
the resource y1 has a high visualization index. It could mean that the content
of the resource has not been well understood because of most of the students
have revisited it. Another possibility is that this resource is directly related to
the assessment. In the case of y4, the interpretation is the inverse. Finally, at the
stage computation, the task has been visited by less than half of the students.
Although we can have a global insight of the use of the resources with the values
of the indices mentioned above, it would be interesting to have a visualization
tool that let us label the resources or the students depending on the value that the
index has. This system provides us with a ranking of the most visited resources
and the most visiting students. The system is done by constructing classi cation
intervals, each of them carrying with a label, in such a way that we assign to
every student or resource the label corresponding to the interval to which the
visualization index belongs.</p>
      <p>We develop the procedure only for the resources since for the other case the
procedure can be developed in a similar way.</p>
      <p>De nition 5. Let I be the set of partial column-visualization indices of all
resources. Let C be the set fvmin; I1; I2; I3; I4; vmaxg where vmin and vmax are the
minimal and maximal values that the visualization indices take in the database
D, and I1; I2; I3, I4 are the intervals between Q1; Q2; Q3, the quartiles of the set
I. Then, we de ne the following map
: Y</p>
      <p>! C
Learning analytic techniques, together with strategies for learning design, may
provide very useful tools that let the teachers optimize their sequences of the
didactical resources.One of the current challenges that the techniques and
systems of learning analytics face are to help to assess the success and adequacy of
a concrete educational resource, taking into account the pedagogical and local
context of the course in which these procedures are being implemented. In this
work, we propose a mathematical model that can be useful to solve this need.</p>
      <p>Our future work is related to the use of the visualization index to obtain
information about an e ective instructional course by sca olding. In addition,
we are working in a visualization tool, based on the classi cation system
developed in this work, that allows the users to optimize the learning resource design
of a course, and purpose prescriptive actions based on learning design for the
students.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Siemens</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gasevic</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <source>Special Issue on Learning and Knowledge Analytics. b Educational Technology &amp; Society</source>
          ,
          <volume>15</volume>
          (
          <issue>3</issue>
          ),
          <volume>1</volume>
          {
          <fpage>163</fpage>
          , (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Gasevic</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dawson</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Siemens</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <article-title>Let's not forget: Learning analytics are b about learning</article-title>
          .
          <source>TechTrends</source>
          ,
          <volume>59</volume>
          (
          <issue>1</issue>
          ),
          <volume>64</volume>
          {
          <fpage>71</fpage>
          , (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Winne</surname>
            ,
            <given-names>P. H.</given-names>
          </string-name>
          ,
          <source>How Software Technologies Can Improve Research on Learning and Bolster School Reform. Educational Psychologist</source>
          ,
          <volume>41</volume>
          (
          <issue>1</issue>
          ),
          <volume>5</volume>
          {
          <fpage>17</fpage>
          . (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Gasevic</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dawson</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rogers</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Gasevic</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <article-title>Learning analytics should not b promote one size ts all: The e ects of instructional conditions in predicating academic success</article-title>
          .
          <source>Internet and Higher Education</source>
          ,
          <volume>28</volume>
          , 68{
          <fpage>84</fpage>
          , (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Bakharia</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Corrin</surname>
          </string-name>
          , L.,
          <string-name>
            <surname>de Barba</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kennedy</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gasevic</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mulder</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dawson</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Lockyer</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <article-title>A conceptual framework linking learning design with learning analytics</article-title>
          .
          <source>In Proceedings of the Sixth International Conference on Learning Analytics &amp; Knowledge</source>
          ,
          <volume>329</volume>
          {
          <fpage>338</fpage>
          . (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Goodyear</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <article-title>Teaching, technology and educational design: The architecture of productive learning environments</article-title>
          .
          <source>The Australian Learning and Teaching Council</source>
          , (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Lockyer</surname>
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heathcote</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Dawson</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <article-title>Informing pedagogical action: Aligning learning analytics with learning design</article-title>
          .
          <source>American</source>
          Behavioral Scientist,
          <volume>57</volume>
          (
          <issue>10</issue>
          ),
          <volume>1439</volume>
          {
          <fpage>1459</fpage>
          , (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Lockyer</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bennett</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agostinho</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Harper</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <article-title>Handbook of research on learning design and learning objects: issues, applications, and technologies (2 volumes)</article-title>
          .
          <source>IGI Global</source>
          , Hershey,
          <string-name>
            <surname>PA</surname>
          </string-name>
          , (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Oliver</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>Exploring strategies for online teaching and learning</article-title>
          .
          <source>Distance Education</source>
          ,
          <volume>20</volume>
          (
          <issue>2</issue>
          ),
          <volume>240</volume>
          {
          <fpage>254</fpage>
          , (
          <year>1999</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Persico</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pozzi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <article-title>Informing learning design with learning analytics to improve teacher inquiry</article-title>
          .
          <source>British Journal of Educational Technology</source>
          ,
          <volume>46</volume>
          (
          <issue>2</issue>
          ),
          <volume>230</volume>
          {
          <fpage>248</fpage>
          , (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Robinson</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Webber</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eifrem</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Graph</given-names>
            <surname>Databases</surname>
          </string-name>
          .
          <article-title>New Opportunities for Connected Data, 2nd</article-title>
          <string-name>
            <surname>Edition</surname>
            ,
            <given-names>O</given-names>
          </string-name>
          <string-name>
            <surname>'Reilly</surname>
            <given-names>Media</given-names>
          </string-name>
          , (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>