=Paper=
{{Paper
|id=Vol-2610/paper9
|storemode=property
|title=Facilitating Self-Regulated Learning with Personalized Scaffolds on Student’s own Regulation Activities
|pdfUrl=https://ceur-ws.org/Vol-2610/paper9.pdf
|volume=Vol-2610
|authors=Joep van der Graaf,Inge Molenaar ,Kia Puay Lim ,Yizhou Fan ,Katharina Engelmann ,Dragan Gašević ,Maria Bannert
|dblpUrl=https://dblp.org/rec/conf/lak/GraafMLFEGB20
}}
==Facilitating Self-Regulated Learning with Personalized Scaffolds on Student’s own Regulation Activities==
https://ceur-ws.org/Vol-2610/paper9.pdf
Companion Proceedings 10th International Conference on Learning Analytics & Knowledge (LAK20)
Facilitating Self-Regulated Learning with Personalized Scaffolds on
Student’s own Regulation Activities
Author(s): Joep van der Graaf1, Inge Molenaar1, Lyn Lim2, Yizhou Fan3, Katharina
Engelmann2, Dragan Gašević3,4, Maria Bannert2
1Behavioural Science Institute, Radboud University, The Netherlands
2Technical University of Munich, Germany
3University of Edinburgh, Edinburgh, UK
4Monash University, Melbourne, Australia
j.vandergraaf@pwo.ru.nl
ABSTRACT: The focus of education is increasingly set on students’ ability to regulate their
own learning within technology-enhanced learning environments. Scaffolds have been used
to foster self-regulated learning, but scaffolds often are standardized and do not do not
adapt to the individual learning process. Learning analytics and machine learning offer an
approach to better understand SRL-processes during learning. Yet, current approaches lack
validity or require extensive analysis after the learning process. The FLORA project aims to
investigate how to advance support given to students by i) improving unobtrusive data
collection and machine learning techniques to gain better measurement and understanding
of SRL-processes and ii) using these new insights to facilitate student’s SRL by providing
personalized scaffolds. We will reach this goal by investigating and improving trace data in
exploratory studies (exploratory study1 and study 2) and using the insight gained from these
studies to develop and test personalized scaffolds based on individual learning processes in
laboratory (experimental study 3 and study 4) and a subsequent field study (field study 5). At
the moment study 2 is ongoing. The setup consists of a learning environment presented on a
computer with a screen-based eye-tracker. Other data sources are log files and audio of
students’ think aloud. The analysis will focus on detecting sequences that are indicative of
micro-level self-regulated learning processes and aligning them between the different data
sources.
Keywords: self-regulated-learning; instructional scaffolds; personalized learning; learning
analytics; machine learning; adaptive systems.
1 THE FLORA PROJECT
The FLORA project aims to improve measurement of self-regulated learning by using multimodal
learning analytics. Self-regulated learning (SRL) occurs when learners monitor and regulate content
they access and operations they apply to content as they pursue goals to augment and edit prior
knowledge [1]. SRL is related to better learning outcomes and SRL interventions improve SRL and
learning outcomes. Recently, the need for improved measurement of SRL has increased, because
effects of interventions on actual SRL behavior were limited [2]. A solution is to assess SRL at a more
fine-grained level by measuring micro-level SRL processes.
SRL consists of cognitive activities related to learning the content and meta-cognitive activities
related to regulation. Sub-categories of cognition refer to student’s strategic information processing
Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International
1
(CC BY 4.0).
Companion Proceedings 10th International Conference on Learning Analytics & Knowledge (LAK20)
during learning such as reading the information, repeating it as well as deeper information
processing like elaboration, and organization of information processed. The metacognitive activities
include five categories: planning, goal specification, orientation, monitoring, reflection, and
evaluation which refer to the postulated metacognitive activities during SRL. When zooming in on
these categories, many micro-level processes might be detected, such as content evaluation and
monitoring progress towards learning goals in the category: monitoring [3]. It is the aim to detect
these micro-level processes in study 1 and improve detection of SRL by adding instrumentation tools
to the learning environment in study 2.
2 STUDY 1: MEASURING SRL PROCESSES
The aim of study 1 was to measure micro-level SRL processes. A learning environment was
presented to students. The task for the students was to learn about three topics and to write an
essay. Before and after this task, students’ knowledge about the topics was assessed. Preliminary
results show that there is a significant learning gain. The challenge is to link the learning gain to SRL
processes. The objective is to analyze each data source (think aloud, log data, and eye-tracking) and
extract behaviors that are indicative of micro-level SRL processes, see Fig. 1 for a schematic
overview.
Fig. 1. A schematic overview of study 1.
3 STUDY 2: INSTRUMENTATION TOOLS
To improve traceability of SRL processes, instrumentation tools have been added in study 2. These
include a timer, a note-taking and highlighting application, a planner tool, a search function, and a
hybrid read-write mode of the essay in which both the text and essay is visible. These tools allow
learners to reveal SRL processes, which should be reflected in improved traceability in think aloud,
log, and eye-tracking data. Aside from the instrumentation tools the setup is the same is in Study 1.
4 SENSOR/DATA GATHERING SETUPS AND PROTOTYPES
Three types of data were gathered: log files (mouse and keyboard), audio, and gaze. To record data
a mouse, keyboard, microphone, and eye-tracker were used. The participant was seated in front of a
monitor with a screen-based eye-tracker, microphone, keyboard, and mouse. The stimuli were
presented on this monitor. In future studies, feedback will be provided as well, see Fig. 2 for an
overview of the technical infrastructure.
Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International
2
(CC BY 4.0).
Companion Proceedings 10th International Conference on Learning Analytics & Knowledge (LAK20)
Audio was recorded to measure think aloud data. The participants were instructed to think aloud.
Think aloud consisted of reading text, stating learning goals, mentioning the creation of notes,
stating navigational actions, etc.. To make sense out of the log files, logs have to be interpreted in
the context of the learning environment. Mouse clicks mostly indicate navigation, while typing is
most common for the note-taking function and the essay. Gaze data was recorded using a screen-
based eye-tracker. The raw data consisted of a timestamp (sampling rate is 300 Hz), coordinates of
the where the participants is looking, pupil dilation, Areas Of Interest (AOIs) if enabled, and more.
For all data sources, a coding scheme is needed to label and analyze the data. Analysis will focus on
sequences of actions that can be indicative of specific SRL processes.
Fig. 2. An overview of the technical infrastructure.
5 THE WORKSHOP
The first part of the workshop consists of collecting data with the presented setup and a shorter task
(15 minutes). In the second part, three groups will each investigate a single data source (think aloud,
log data, or eye-tracking). The goal is to extract and analyze SRL processes and identify the value of
instrumentation tools. To do so, data and a coding scheme will be provided. During this process,
each group evaluates the data source in relation to detection of SRL. Advantages and disadvantages
will be identified and discussed at the end when the groups come together to share the results.
REFERENCES
1. Winne, P.: Paradigmatic Dimensions of Instrumentation and Analytic Methods in Research on Self-
Regulated Learning. Computer in Human Behavior, 96, 285-289 (2019)
2. Schunk, D.H., Greene, J.A.: Handbook of Self-Regulation of Learning and Performance. 2nd ed.
Routledge, New York (2018).
3. Greene, J.A., & Azevedo, R.: A macro-level analysis of SRL processes and their relations to the
acquisition of a sophisticated mental model of a complex system. Contemporary Educational
Psychology, 34, 18-29 (2009).
4. Papamitsiou, Z., Economides, A.: Learning Analytics and Educational Data Mining in Practice: A
Systematic Literature Review of Empirical Evidence. Educational Technology & Society,
17(4), 49-64 (2014).
Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International
3
(CC BY 4.0).
Companion Proceedings 10th International Conference on Learning Analytics & Knowledge (LAK20)
Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International
4
(CC BY 4.0).