<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>An Overview of the LALA project</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Pedro J. Muñoz-Merino</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Carlos Delgado Kloos</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yi-Shan Tsai</string-name>
          <email>Yi-Shan.Tsai@ed.ac.uk</email>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dragan Gasevic</string-name>
          <email>dragan.gasevic@monash.edu</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Katrien Verbert</string-name>
          <email>katrien.verbert@kuleuven.be</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mar Pérez-Sanagustín</string-name>
          <email>mar.perez-sanagustin@irit.fr</email>
          <email>mar.perez@uc.cl</email>
          <xref ref-type="aff" rid="aff5">5</xref>
          <xref ref-type="aff" rid="aff6">6</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Isabel Hilliger</string-name>
          <xref ref-type="aff" rid="aff6">6</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Miguel Ángel Zúñiga- Prieto</string-name>
          <email>miguel.zunigap@ucuenca.edu.ec</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Margarita Ortiz-Rojas</string-name>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Eliana Scheihing</string-name>
          <xref ref-type="aff" rid="aff8">8</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department Computer Science, Universidad de Cuenca</institution>
          ,
          <addr-line>Av. 12 de Abril y Av. Loja, 010203 Cuenca</addr-line>
          ,
          <country country="EC">Ecuador</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Computer Science, KU Leuven</institution>
          ,
          <addr-line>Celestijnenlaan 200A, B-3001 Leuven</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Department of Data Science and Artificial Intelligence, Faculty of Information Technology, Monash University</institution>
          ,
          <addr-line>29 Ancora Imparo Way , Clayton, VIC 3800</addr-line>
          ,
          <country country="AU">Australia</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Department of Telematics Engineering, Universidad Carlos III de Madrid, Av. Universidad</institution>
          ,
          <addr-line>30, 28911 Leganés, Madrid</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>Information Technology Center, Escuela Superior Politécnica del Litoral, ESPOL</institution>
          ,
          <addr-line>Km 30.5 Vía Perimetral, 09-01-5863, Guayaquil</addr-line>
          ,
          <country country="EC">Ecuador</country>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>Institute de Recherce en Informatique de Toulouse</institution>
          ,
          <addr-line>Université Paul Sabatier Toulouse III, 118 Route de Narbonne, F-31062 Toulouse</addr-line>
        </aff>
        <aff id="aff6">
          <label>6</label>
          <institution>Pontificia Universidad Católica de Chile</institution>
          ,
          <addr-line>Av. Vicuña Mackenna 4860, Macul, Santiago, Chili</addr-line>
        </aff>
        <aff id="aff7">
          <label>7</label>
          <institution>School of Informatics, The University of Edinburgh</institution>
          ,
          <addr-line>Edinburgh</addr-line>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
        <aff id="aff8">
          <label>8</label>
          <institution>Universidad Austral de Chile</institution>
          ,
          <addr-line>Valdivia</addr-line>
          ,
          <country country="CL">Chile</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The LALA project (“Building Capacity to Use Learning Analytics to Improve Higher Education in Latin America”) is a project that aims at building capacity about the use of data in education for improving education in Latin America. This article presents a general overview of the LALA project including the LALA framework (as a set of guidelines, recommendations and patterns for enabling adoption of learning analytics), the adaptation of learning analytics tools (mainly three different tools used in Europe) and the pilots with learning analytics experiences. The results of this project could serve as an example for other institutions in the Latin American region or other under-represented regions to adopt Learning Analytics as part of their processes.</p>
      </abstract>
      <kwd-group>
        <kwd>learning analytics</kwd>
        <kwd>Latin America</kwd>
        <kwd>adoption</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>The LALA project (http://lalaproject.org) is an initiative funded by the European Union
with the purpose of transferring knowledge from Europe to Latin America for the
application of learning analytics in a practical manner in Higher Education Institutions
in Latin America so as to improve their education by means of data-driven approaches.</p>
      <p>Since the project started in October 2018, the LALA project has already produced
different outcomes, some of the most important are:
• The LALA framework. A set of guidelines to support Higher Education</p>
      <p>Institutions in Latin America in the adoption of learning analytics.
• The adapted or adopted learning analytics tools in Latin America, which
includes a counselling system, an early dropout prediction system, a system
for supporting self-regulation in online and blended learning environments,
and the on-task tool.
• Pilots with Learning Analytic tools. At present, different pilots are running
in Latin America institutions and others have already been done in order to
test and validate the learning analytic tools designed during the project.
• Dissemination actions. As part of the dissemination activities, we have
developed different training activities, workshops, publications,
presentations and the annual LALA conference. In addition, the LALA
community has been set up with many institutions interested in the project.
Moreover, there are twitter and Facebook accounts, a distribution list and a
bulletin. Institutions in Latin America can join the LALA project following
the instructions at https://www.lalaproject.org/be-part-of-lala/ and
according to the statutes at https://www.lalaproject.org/statutes/
2</p>
    </sec>
    <sec id="sec-2">
      <title>LALA framework</title>
      <p>
        The LALA framework [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] was conceived as a set of guidelines and instruments to
facilitate and promote the design, implementation and adoption of learning analytics
tools in Higher Education Institutions in Latin America. The LALA framework is
inspired by the SHEILA framework [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] which was established in the SHEILA Erasmus
+ project. The LALA framework is composed of four dimensions that could be applied
independently or in an integrated manner.
      </p>
      <p>
        • Institutional. This dimension aims to promote the participation and
commitment of key actors - or stakeholders - (students, academic staff, and
leaders) in the adoption of LA tools, anticipating political and strategic
aspects. Specifically, it proposes activities to understand what the current
state and the desired state of the institution is in relation to the incorporation
of LA tools, as well as the policies and strategies established for the
management of educational data. It proposes a series of instruments and
phases for answering the following question: What are the institutional
considerations to adopt a a learning analytics tool or process? An important
part of the result of applying the instruments and methods proposed in this
dimension is a list of needs of the main actors of an institution in the form of
strategic guidelines to reach a desired state in terms of adoption of LA. The
identification of needs for the different Latin American partners of the project
can be seen in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>Technical. This dimension proposes a set of guidelines and recommendations
for supporting the design of learning analytic tools. These guidelines aim at
providing a basis for ensuring the adequate collection and administration of
educational metadata, as well as the management of the adequate
infrastructure and technical capacities to support them. This dimension will
answer the question: What steps do I need to follow to work on the deisgn,
implementation and/or adaptation and evaluation of a learning analytics tool
athat is asapted to the needs of the main actors in the institution?
Ethical. This dimension aims to promote the adoption of ethical and privacy
considerations in the design implementation and adoption of learning
analytics tools. Specifically, it proposes a collection of papers and instruments
on ethical considerations for learning analytics that interested institutions
could take as a reference. The application of this dimension will answer the
following question: What are the ethical and privacy considerations that the
institution should take into account in order to adopt or implement a learning
analytics tool?
Community. This dimension provides the guidelines for the creation of a
Learning Analytcis community for promoting the exchange and experiences
between higher education insttitutions in Latin America. The aim is to favour
collaboration among institutions without compromising internal information.
Applying this dimension institutions could answer the following question:
What steps should we follow to to become an active member of the Learning
Analytics community in Latin America (LALA community)?
3</p>
    </sec>
    <sec id="sec-3">
      <title>Adoption of LALA tools</title>
      <p>
        The LALA project has adapted or adopted mainly four tools that have been
developed (at least partially) in Europe: a counselling tool, an early dropout prediction
tool, a system for supporting self-regulation in online and blended learning
environments and the on-task tool. Detailed information about the adaptation and
adoption of these learning analytics tools can be found at [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        A counselling tool developed in KU Leuven has been adapted to Latin American
partners. Universidad Austral de Chile, Escuela Politecnica Superior del Litoral and
Universidad de Cuenca adapted the counselling tool providing a set of dashboards at
the academic level such as the grades of students in different courses, their present call
in each course, etc. An example of this tool can be seen in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] for Universidad Austral
de Chile. Pontificia Universidad Católica de Chile provided also a tool at the course
level named NoteMyProgress, which enabled students and teachers to self-monitor
their learning process in a course including information such as self-regulated learning
strategies.
      </p>
      <p>
        An early dropout prediction tool developed in Universidad Carlos III de Madrid has
been adapted to Latin American partners. Universidad Austral de Chile, Escuela
Politecnica Superior del Litoral and Universidad de Cuenca used an early dropout
prediction tool for predicting dropout at the degree levels, while Pontificia Universidad
Católica de Chile adapted it for courses in a MOOC [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>The Pontificia Universidad Católica de chile developed the NoteMyProgress tool, a
tool for supporting students self-regulation strategies in both online and blended
learning environment. It is composed by a pluggin currently available for the MOOC
platform Courser and the Moodle Learning Management system that provides
interactive visualisations about students activities. Both plugins are available here:
https://git.cti.espol.edu.ec/LALA-Project/PUC .</p>
      <p>The on-task tool, which is contributed in part by University of Edinburgh, is being
adopted in Escuela Politecnica Superior del Litoral, Universidad de Cuenca, and
Universidade Federal Rural de Pernambuco (UFRPE)(an associate partner in Brazil)
for providing personalization and feedback.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Pilot experiences</title>
      <p>All four regular Latin American partners (Pontificia Universidad Católica de Chile,
Universidad Austral de Chile, Universidad de Cuenca and Escuela Politécnica Superior
del Litoral) have already run some pilot experiences with learning analytics tools
developed during the project. Other pilot experiences are running or will run during this
year. In addition, other associate partners from Latin America have or will run pilots
with the tools of the project.</p>
      <p>Regarding the pilot experiences, depending on the context, the target groups are
different. In Pontificia Universidad Católica de Chile, a total of 638 students from a
MOOC in Coursera downloaded the tool, although the analysis of their behavior with
the tool was conducted with 236 that answered all questionnaires related with the pilot.
In Escuela Superior Politécnica del Litoral (ESPOL), more than 315 academic
counselors (teachers) used the new LA visualizations in their current counselling
system. Thus, involving approximately 7700 students. However, the analysis was
carried out with only 152 teachers who answered all the questionnaires related with the
pilot. In Universidad de Cuenca, where LA has no been previously applied, 31
academic counselors (teachers) used the counseling dashboard LA. Thus, involving
approximately 522 students whose academic performance was analyzed by the
academic counselors. Additionally, 178 of those students had an academic counseling
session to analyze their academic performance. While Universidad Austral de Chile
the main stakeholders using the tools are the managers. In any case, students are the
target group to improve their educational process. The first version of the project
deliverable describing all pilots will be publicly available soon in the webpage of the
project.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgements</title>
      <p>Work partially funded by the LALA project (grant no.
586120-EPP-1-2017-1-ESEPPKA2-CBHE-JP). The LALA project has been funded with support from the
European Commission. his publication reflects the views only of the authors, and the
European Commission and the EACEA agency cannot be held responsible for any use
which may be made of the information contained therein.</p>
      <p>The authors want to thank the work of all team members by 7 institutions of the
LALA project.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Sanagustín</surname>
            ,
            <given-names>M. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hilliger</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maldonado</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pérez</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ramírez</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Muñoz-Merino</surname>
            ,
            <given-names>P. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsai</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ortiz-Rojas</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Broos</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pesantez</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sheihing</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Whitelock-Wainright</surname>
          </string-name>
          , Al, (
          <year>2018</year>
          ),
          <source>LALA Framework version 2</source>
          .0, https://www.lalaproject.org/wpcontent/uploads/2019/01/LALS-FW-
          <volume>2</volume>
          .0.pdf
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Tsai</surname>
            ,
            <given-names>Y-S</given-names>
          </string-name>
          , Gasevic,
          <string-name>
            <given-names>D</given-names>
            ,
            <surname>Whitelock-Wainwright</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A</given-names>
            ,
            <surname>Muñoz-Merino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.J.</given-names>
            ,
            <surname>Moreno-Marcos</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.M.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Rubio</given-names>
            <surname>Fernández</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Delgado Kloos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Scheffel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Jivet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Drachsler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Tammets</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            ,
            <surname>Calleja</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.R.</given-names>
            ,
            <surname>Kollom</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
          .
          <year>2018</year>
          ,
          <article-title>SHEILA: Supporting Higher Education to Intergrate Learning Analytics Research Report</article-title>
          . The University of Edinburgh, Edinburgh, UK, https://www.research.ed.ac.uk/portal/files/77883596/SHEILA_research_report.pdf
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Hilliger</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ortiz-Rojas</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pesántez-Cabrera</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Scheihing</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsai</surname>
            ,
            <given-names>Y. S.</given-names>
          </string-name>
          , MuñozMerino, P. J.,
          <string-name>
            <surname>Broos</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Whitelock-Wainwright</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Pérez-Sanagustín</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Identifying needs for learning analytics adoption in Latin American universities: A mixedmethods approach</article-title>
          .
          <source>The Internet and Higher Education</source>
          ,
          <volume>45</volume>
          ,
          <fpage>100726</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Ortiz-Rojas</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jimenez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maya</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Muñoz-Merino</surname>
            ,
            <given-names>P. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moreno-Marcos</surname>
            ,
            <given-names>P. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marín</surname>
            ,
            <given-names>J. I.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Delgado</given-names>
            <surname>Kloos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Zuñiga</surname>
          </string-name>
          <string-name>
            <surname>Prieto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.A.</given-names>
            ,
            <surname>Ulloa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Pérez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Pérez-Sanagustín</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Henriquez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            ,
            <surname>Guerra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Ferreira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Broos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            , &amp;
            <surname>Millecamp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>WPD3</surname>
          </string-name>
          . O.
          <volume>4</volume>
          (
          <issue>2019</issue>
          ), “
          <article-title>Design for Learning Analytics tools for LALA”</article-title>
          , https://www.lalaproject.org/wpcontent/uploads/2019/04/Deliverable-WP3_
          <article-title>English_April12</article-title>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Chevreux</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Henríquez</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guerra</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Scheihing</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Agile Development of Learning Analytics Tools in a Rigid Environment like a University: Benefits, Challenges and Strategies</article-title>
          .
          <source>In European Conference on Technology Enhanced Learning</source>
          (pp.
          <fpage>705</fpage>
          -
          <lpage>708</lpage>
          ). Springer, Cham.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Moreno-Marcos</surname>
            ,
            <given-names>P. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Muñoz-Merino</surname>
            ,
            <given-names>P. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maldonado-Mahauad</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pérez-Sanagustín</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alario-Hoyos</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Delgado Kloos</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Temporal analysis for dropout prediction using self-regulated learning strategies in self-paced MOOCs</article-title>
          .
          <source>Computers &amp; Education</source>
          ,
          <volume>145</volume>
          ,
          <fpage>103728</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>