<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Teacher Sca olding of Students' Self-regulated Learning using an Open Learner Model</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Birmingham</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Uppsala University</institution>
          ,
          <country country="SE">Sweden</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper describes a study of teacher sca olding to support re ection and self-regulated learning (SRL) with an open learner model (OLM) in a geography based task on a touch screen. The study was carried out in 6 one-on-one sessions with students between the ages of 10 and 11. We present examples of teachers sca olding students' SRL behaviours using the OLM, demonstrating how an OLM can be used to prompt the learner to monitor their developing skills, set goals, and use appropriate tools.</p>
      </abstract>
      <kwd-group>
        <kwd>Open learner model</kwd>
        <kwd>Self-regulated learning</kwd>
        <kwd>UCD</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Self regulated learning (SRL) is the meta-cognitive process where a student uses
self-assessment, goal setting, and the selecting and deploying of strategies to
acquire academic skills; the use of SRL strategies are signi cantly correlated with
measures of academic performance [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Open learner models (OLM) externalise
the model that the system has of the learner in a way that is interpretable by the
learner or teacher. The aims of OLM include promoting re ection, to facilitate
planning and decision-making, and raise awareness of understanding or
developing skills [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Previous research has highlighted the importance that teachers have
in support for re ective processes [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Research indicates adaptive or personalised
sca olding of SRL approaches by teachers leads to a greater adoption of SRL
skills as compared to conditions where no sca olding was o ered [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. We have
also seen that a robotic tutor can increase trust, enjoyment, and understanding
in explanations of an OLM as compared to on-screen feedback alone [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>Our goal is to ultimately develop a robotic tutor that can sca old SRL via
an OLM. To this end, we present a user centred design (UCD) study to elicit
how teachers personalise feedback using an OLM to sca old re ection and SRL.</p>
      <p>We have developed a map based learning scenario that enables the learner
to exhibit SRL skills and processes i.e. self-monitoring, goal setting, and help
seeking. The learner has a choice of activities of varying di culty that allow
them to practice map reading skills for distance, direction, and map symbols.
The learner also has access to tools which can provide help with the activity.</p>
      <p>
        This study involves 3 teachers and 6 students, with each teacher assisting 2
students individually through the activity, resulting in 6 sessions in total. The
students are of mixed sex and ability. Prior to the session the teachers were given
an introduction to the task and the OLM. The teachers were asked to provide
assistance using the OLM where possible but to also focus on helping the student
acquire SRL skills and to avoid giving direct answers. The students were asked
to use the learning activity to practice and develop their map reading skills.
They were informed that they were in charge of their own learning and could
choose the order of the activities and how long they wanted to do any activity
for. This is similar to the adaptive content and process sca olding (ACPS) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],
where students are provided with adaptive content sca olding to ensure they
are meeting the overall learning goal and adaptive process sca olding to ensure
they are using the key self-regulatory processes, such as re ection, planning, and
using the tools available in the activity.
      </p>
      <p>
        We build a learner model of the student's map reading competencies using
constraint based modelling. This is an approach whereby competency values
are calculated by checking the learner's actions against a set of relevant
constraints [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Distance and direction are evaluated based on the learner identifying
a point on a map that is a particular distance and/or direction from a starting
point. Symbol knowledge is tested by selecting a particular symbol from a bank
of symbols or from a choice on a map. It is possible for the learner to provide
a partially correct answer by meeting the distance constraint but breaking the
direction and symbol constraint, this is re ected in the model with distance
competency increasing and the direction and symbol competency decreasing. Time
taken to answer is also taken in to account; the competency can only reach the
highest level when time taken to answer is low which indicates that the learner is
pro cient. To ensure that the competency values are current we use a weighted
average so that recent evidence is given a higher weighting than older evidence
in determining the overall level of the competency.
      </p>
      <p>The OLM shows skill meters for each competency and is visible at all times
in the top left of the screen. Changes to the skill meters are made visible with
animation and there are indicators to show the previous values. The learner can
Title Suppressed Due to Excessive Length
inspect a history of the most recent 10 pieces of evidence for each individual
competency by clicking on the corresponding skill meter. For example, if the
learner expands the skill meter for distance then they will see evidence broken
into north, east, south, west; e.g. they may see that they have met the north
and south constraints correctly but not the west and the east constraints. This
enables the user of the OLM to see exactly in which aspect of the competency
their strengths and weaknesses lie.
3</p>
    </sec>
    <sec id="sec-2">
      <title>Examples of SRL Process Sca olding with an OLM</title>
      <p>
        Our initial analysis concerned whether the teachers used the OLM to sca old
SRL process. Video and task logs were reviewed and coded by a single coder.
The coding scheme is based on Zimmerman's SRL phase and sub-process [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
Our results revealed that the teachers used the OLM to sca old the following
SRL processes:
      </p>
      <p>Self-re ection phase. We see that the teachers use the OLM to prompt the
learners to re ect in a number of ways, including prompting the learner to
selfevaluate and attribute causes for the changes in the model of their developing
skills: \What is that showing us then?" and \It's good because you got everything
right, what do you think would happen if you got something wrong?". We also
see that the teachers show satisfaction as the competencies increase: \Oh well
done! It has shot right back up again now!".</p>
      <p>Forethought phase. The teachers then build upon the learner's awareness
of their developing skills to help set goals and strategies. When the OLM is
showing that the student has a high level of competency the teachers use the
OLM to suggest moving on to a new activity: \I think you are pretty good on
that, do you? So what about the inter-cardinal directions?" and \look at that!
Now, do you think that was a bit easy for you? Do you want to try out some
of the others?". If the student has not mastered a skill the teacher will suggest
continuing the activity until they have: \This is really good, but this is wrong
(referring to one element of the OLM), let's continue it so that we can get 100%".</p>
      <p>Performance phase. The teacher also used the OLM as a basis for task
strategies. If the learner is being overly cautious and double checking each answer
with a tool the teacher will encourage them to be more con dent and e cient:
\Oh that's it, you are on a roll now (indicating OLM increase), you might not
need to use the tool any more, you might have worked it out, what do you
think?". When there is an issue with the learner's understanding, the OLM was
used to highlight this: \Oh what happened to the meter, did you get that one
right? I think I went west. Yeah, you can see here that the last attempt at
east was wrong", the learner then proceeds to use the compass tool. Another
example: \Why has it gone dark? That's interesting, what do you think that
tells you there? That I got it wrong", the learner then proceeds to use the map
key to identify the correct symbol.</p>
      <p>
        Previous studies have suggested that prompts used to highlight errors to
encourage self-re ection and reasoning can be e ective in leading the learner to
self-correct those errors [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In addition, prompting re ection on skill levels
can lead to improved problem selection [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. These are the prompts we see the
teachers using with the OLM to sca old SRL behaviours.
4
      </p>
    </sec>
    <sec id="sec-3">
      <title>Discussion and Conclusions</title>
      <p>We see this study as the rst step in investigating if sca olding students' SRL
behaviours using the OLM can be used to produce an environment in which
students would experience greater learning gains through developing their SRL
processes. From this study we are able to identify how teachers use our OLM
to demonstrate re ection and SRL learning techniques. The teachers do this by
drawing attention to the learner's developing competencies using the OLM, then
encouraging re ection on why the competencies are changing and using this as a
basis to suggest appropriate tools, goals, and strategies for the learner. We aim
to use these ndings as a basis for developing robot interactions.</p>
      <p>The strength of this study lies in the fact that we have seen the OLM being
used by experienced teachers and students in a natural school setting. However,
the study is limited due to the small number of participants and short duration.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>R.</given-names>
            <surname>Azevedo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. G.</given-names>
            <surname>Cromley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. C.</given-names>
            <surname>Moos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Greene</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F. I.</given-names>
            <surname>Winters</surname>
          </string-name>
          .
          <article-title>Adaptive Content and Process Sca olding : A key to facilitating students ' self-regulated learning with hypermedia</article-title>
          .
          <source>Psychological Test and Assessment Modeling</source>
          ,
          <volume>53</volume>
          (
          <issue>1</issue>
          ):
          <volume>106</volume>
          {
          <fpage>140</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>S.</given-names>
            <surname>Bull</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Kay</surname>
          </string-name>
          .
          <article-title>Open Learner Models as Drivers for Metacognitive Processes</article-title>
          . In R. Azevedo and V. Aleven, editors,
          <source>International Handbook of Metacognition and Learning Technologies</source>
          , volume
          <volume>28</volume>
          , pages
          <fpage>349</fpage>
          {
          <fpage>365</fpage>
          .
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Jones</surname>
          </string-name>
          , G. Castellano, and
          <string-name>
            <given-names>S.</given-names>
            <surname>Bull</surname>
          </string-name>
          .
          <article-title>Investigating the e ect of a robotic tutor on learner perception of skill based feedback</article-title>
          .
          <source>In International Conference on Social Robotics</source>
          , pages
          <volume>186</volume>
          {
          <fpage>195</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>K. R.</given-names>
            <surname>Koedinger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Aleven</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Roll</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Baker</surname>
          </string-name>
          .
          <article-title>In vivo experiments on whether supporting metacognition in intelligent tutoring systems yields robust learning</article-title>
          . In D. J.
          <string-name>
            <surname>Hacker</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Dunlosky</surname>
          </string-name>
          , and A. C. Graesser, editors,
          <source>Handbook of metacognition in education</source>
          , pages
          <volume>897</volume>
          {
          <fpage>964</fpage>
          .
          <string-name>
            <surname>Routledge</surname>
          </string-name>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Mitrovic</surname>
          </string-name>
          .
          <article-title>Modeling Domains and Students with Constraint-Based Modeling</article-title>
          . In R. Nkambou,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bourdeau</surname>
          </string-name>
          , and R. Mizoguchi, editors,
          <source>Advances in Intelligent Tutoring Systems</source>
          , pages
          <fpage>63</fpage>
          {
          <fpage>80</fpage>
          .
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>R.</given-names>
            <surname>Reingold</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Rimor</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalay</surname>
          </string-name>
          .
          <article-title>Instructor's sca olding in support of student's metacognition through a teacher education online course: a case study</article-title>
          .
          <source>Journal of interactive online learning</source>
          ,
          <volume>7</volume>
          (
          <issue>2</issue>
          ):
          <volume>139</volume>
          {
          <fpage>151</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>B. J.</given-names>
            <surname>Zimmerman. Investigating</surname>
          </string-name>
          Self-Regulation and Motivation: Historical Background, Methodological Developments, and
          <string-name>
            <given-names>Future</given-names>
            <surname>Prospects</surname>
          </string-name>
          . American Educational Research Journal,
          <volume>45</volume>
          (
          <issue>1</issue>
          ):
          <volume>166</volume>
          {
          <fpage>183</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>