<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Identifying Requirements for a Psycho-Pedagogical Mash-up Design for Personalising the Learning Environment</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Marcel Berthold</string-name>
          <email>marcel.berthold@tugraz.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sergei Pachtchenko</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andreas Kiefel</string-name>
          <email>andreas.kiefel@uni-koblenz.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alexander Nussbaumer</string-name>
          <email>alexander.nussbaumer@tugraz.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dietrich Albert</string-name>
          <email>dietrich.albert@tugraz.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Knowledge Management Institute, Technical University of Graz</institution>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Knowledge Media Institute, University of Koblenz-Landau</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper examines educational components that influence the creation of mash-up designs in a Personalised Learning Environment (PLE). These educational components are linking widgets, small tools, to psychopedagogical information and competences of a learner. Taking these into account principles and rules for an adequate PLE mash-up can be identified and empirically studied. Finally an approach is introduced to validate these assumptions.</p>
      </abstract>
      <kwd-group>
        <kwd>environments</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>mash-up design, self-regulated learning, personal learning
In the context of e-learning Personalised Learning Environments (PLEs) attract more
and more users. PLEs are environments that combine services and tools, and
therefore, provide access to different learning resources on the web. By means of this
functionality, a learner is enabled to control, manage and compose her own learning
environment, which could be maintained across institutions (e.g. from school through
university and to a workplace).</p>
      <p>However, it seems to be unclear what psycho-pedagogical rules should be applied
to mash up a PLE. Therefore, the main purpose of this paper is to identify important
educational components that have an influence on composing a PLE during a
selfregulated learning (SRL) process. These educational components will be the basis for
adequate recommandations for mashing up a PLE. The usefulness of the educational
components will be empirically studied. For this reason a validation approach is
introduced.
In the EC-funded project ROLE (Responsive Open Learning Environment) the SRL
behaviour of a learner within a PLE is based on a SRL process model. The model
consists of four phases (see section 2.1). An important building block for mashing-up
a PLE and modelling SRL is the categorisation of learning strategy strategies. In order
to apply learning strategies, learning techniques are used. Learning techniques can be
applied by using widgets or tools. In this way tools can be related to learning
strategies. Further building blocks are competences, such as tool competences, SRL
competences.</p>
      <p>For compiling the widgets rules and principles need to be taken into account. First,
the mash-up up is defined and explained on the level of learning strategies.
Meaningful designs can be derived through the assignment of learning tools to
learning techniques and strategies. Secondly, the tool and SRL competences of
learners are considered, e.g. if learners are able to use the mash-up. Though the
relation of these competences to learners, the mash-up can be related to learners and
his/her PLE profile (this is part of the SRL process model).</p>
      <sec id="sec-1-1">
        <title>2.1 The self-regulated learning process model</title>
        <p>
          The SRL process model in ROLE generally builds upon the cyclic SRL model
introduced by [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ], also see [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] proposed three SRL phases: the forethought phase,
the performance phase and the self-reflection phase. In ROLE it was assumed that the
learner will implicitly or explicitly perform four phases based on four predominant
activity groups. These phases are: (1) learner profile information is defined or revised,
(2) learner finds and selects learning resources, (3) learner works on selected
resources, and (4) learner reflects and reacts on learning strategies, achievements and
usefulness [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ].
        </p>
        <p>
          Within this SRL process the learners perform key activities, such as goal setting,
self-monitoring, self-evaluation, help seeking, time planning and management. These
key activities are of metacognitive nature and enable the learners to take control over
their own learning processes and influence the actual learning and working phase (3).
The ROLE SRL process model features the possibility to repeat the complete learning
cycle for every learning task and recursiveness, which can be understand as possible
iteration of every activity or set of activities within the learning cycle. In general, the
SRL process model can be seen as repository of learning strategies and techniques to
carry out learning activities (e.g. Learning Event Activities [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]).
        </p>
      </sec>
      <sec id="sec-1-2">
        <title>2.2 Assigning learning techniques to learning strategies</title>
        <p>
          From a psycho-pedagogical point of view, it seems suitable to argue that learning
within a configurable PLE is subject to certain learning conditions. In this regard,
learning strategies and learning techniques play a crucial role. It is suggested [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ] that
applying appropriate learning strategies and using learning techniques in the right
manner lead to better learning outcomes. Surprisingly, literature provides no clear
distinction between learning strategies and learning techniques e.g. [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ], [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. However,
learning strategy is rather an umbrella term to classify learning techniques. Learning
techniques in turn are highly sophisticated methods to fulfil or act out learning
activities. Learning strategies are the “What” (What do I want to do?: organize,
manage time, plan etc.) and learning techniques refer to the “How” (How do I
organize?: e.g. Mind-map, slow-fast, calendar etc.).
        </p>
        <p>
          According to the classification of strategies [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] organization strategies, elaboration
strategies, and rehearsal strategies are assigned as cognitive strategies, whereas
selfcontrol is considered as a metacognitive strategy and time management as resource
management. For each type of learning strategy different learning techniques are
available.
        </p>
      </sec>
      <sec id="sec-1-3">
        <title>2.3 Assigning widgets to learning techniques</title>
        <p>
          The classification of learning techniques to learning strategies introduced above
provides the basis of matching learning techniques to widgets. Widgets are small
programs that usually fulfil one task that are used in PLEs. One application for such
widgets could be a language learning scenario [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. In an English learning context a
voice-recording widget can be used to hear one’s pronunciation of words and
compare it to recordings of peers or pronunciation examples provided by online
English dictionary services.
        </p>
        <p>In reference to a learning strategy, the voice-recording widget imputes
metacognitive strategies, more precisely, regulation and evaluation. Therefore, the voice
recording widget could be assigned to the actual learning technique recording.</p>
        <p>
          However, why should widgets be assigned to corresponding learning techniques?
If widgets are assigned to learning techniques, ROLE services could provide
recommendations according to appropriate learning strategies and learning
techniques, respectively, based on scientific research. The use of learning strategies
and techniques improve learning outcome and success, especially in the context of
self-regulated learning [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ].
        </p>
      </sec>
      <sec id="sec-1-4">
        <title>2.4 The role of competences</title>
        <p>
          Once widgets are classified another education component comes to play, the
competence. In ROLE the focus lays mainly on tool and SRL competences. The tool
competence is captured through the usage statistics and user input (assessment) and
influences the order in which the tools are recommended. The competence model in
ROLE distincts between domain knowledge, skills and competences and corresponds
with the European qualification framework model [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ].
        </p>
        <p>Further on, the term competence is used as a master category. Special competence
areas are domain competences, tool competences, and SRL competences. In order to
learn effectively and efficiently in a self-regulated way within a PLE, the learner
needs competences particularly on the SRL and tool levels. On the SRL side, the
environmental structuring competence, which can be seen as a competence in coping
with a learning environment in terms of assembling the widgets and managing
resources, is crucial. Tool competence comprises the ability to perform learning
activities with a specific tool, it captures declarative knowledge (learning tool) and
procedural knowledge (learning activity).
3</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Mash-up design</title>
      <p>The identified education components come into play by means of composing an
applicable mash-up as a teacher or to recommend a mash-up design by the ROLE
system that does not overtax or distract the learner [comp. 5]. For instance, a learner
sets the learning goal to learn new vocabulary and pronounce the words accurately in
in the first phase of the SRL process model. In this language learning scenario ROLE
services identify the need for regulation, a metacognitive strategy, respectively (What
should be done?). Additionally, the competences that are required to accomplish this
learning goal (according to the ROLE competence model) are assessed. These enable
ROLE services to recommend e.g. a voice-recording-widget (“How should it be
done?”), which should be added to the ROLE mash-up design in the second phase of
the SRL process model. In the third phase the learner actually uses the widget. The
next step is the crucial one: There are other widgets available that could benefit the
learner, such as the text2speech or a dictionary-tool.</p>
      <p>However, it has to be clarified, whether these other widgets distract or confuse the
learner and/or what number of widgets would be suitable for this particular learning
attempt. Further research questions arise: Is the learning outcome higher if planning
or goal-setting- (metacognitive), concrete learning- (cognitive) and feedback-widgets
(meta-cognitive) are mash-up within one single design or should they be separated? A
validation approach will attempt to bridge that gap.</p>
    </sec>
    <sec id="sec-3">
      <title>4 Validation and evaluation criteria</title>
      <p>As outlined above, systematic investigations of the moderating, and especially
interacting effects of administering different widgets in a PLE mash-up are lacking.
The present three step validation approach is designed to fill the lacuna.</p>
      <p>In the first step it is planned to empirically verify the assignment of learning
techniques to learning strategies. For this purpose a list of learning strategies and a list
of learning techniques will be presented to experts of the research field, who then are
kindly asked to assort the learning techniques to associated learning strategies. An
interrater-reliabilty analysis will be applied. In the second step the learning techniques
are supposed to be associated with corresponding widgets. Again, expert of the
research field will be asked to assign widgets to learning techniques.</p>
      <p>Hence, appropriate learning strategies and learning techniques need to be
identified for a concrete language learning scenario. This psycho-pedagogical
information will be implemented in the ROLE services according to the SRL process
model and by taking into account the competences, described by the competence
model. In the third validation step an experimental pre-post 3x2 design will be
determined. Independent variables are mash-up design operationalized by the number
of widgets administered at the first use (0 vs. 3 vs. 6) and the pre-set degree of
freedom operationalized dichotomous (maximum guidance vs. maximum freedom).
During the learning phase the learning should be allowed to personalise the mash-up.
In a pre-phase of the experiment a language test will be applied. In a post-phase of the
experiment a parallel version of this language test will be applied, and the difference
between theses tow test will be interpreted as the learning outcome. As an additional
performance indicator grades provided by lectors in a university context might be
feasible. Furthermore, log- and CAM (Contextual Metadata Model) data, respectively,
will be analysed.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion and Outlook</title>
      <p>To sum up, assigning widgets to psycho-pedagogical information has been identified
to be an important issue to provide learners with meaningful recommendation in order
to guide them through the SRL process. In this regard, Tool and SRL competences
need to be taken into account to meet the requirement of a PLE. Validation and
evaluation of the moderating, and interacting effects of these education components
on an empirical level will be the focus of the further research activities.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>E.</given-names>
            <surname>Barkley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Cross</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Major</surname>
          </string-name>
          .
          <article-title>Collaborative Learning Techniques: A Handbook for College faculty</article-title>
          . Jossey-Bass, San Francisco (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. EQF.
          <article-title>Recommendation of the european parliament and of the council on the establishmentof the european qualifications framework for lifelong learning</article-title>
          (april
          <year>2008</year>
          ,
          <year>2008</year>
          /c111/01) http://eurlex.europa.eu/LexUriServ/LexUriServ.do?uri=oj:c:
          <year>2008</year>
          :
          <volume>111</volume>
          :
          <fpage>0001</fpage>
          :0007:en:pdf
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>K.</given-names>
            <surname>Fruhmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nussbaumer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Albert</surname>
          </string-name>
          .
          <article-title>A psycho-pedagogical framework for selfregulated learning in a responsive open learning environment</article-title>
          .
          <source>In Proc. of the International Conference eLearning Baltics Science (eLBa Science</source>
          <year>2010</year>
          ), Rostock, Germany, July (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>C.</given-names>
            <surname>Leopold</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Leutner</surname>
          </string-name>
          .
          <article-title>Der Einsatz von Lernstrategien in einer konkreten Lernsituation bei Schülern unterschiedlicher Jahrgangsstufen</article-title>
          .
          <source>Zeitschrift für Pädagogik</source>
          ,
          <volume>45</volume>
          :
          <fpage>240</fpage>
          -
          <lpage>258</lpage>
          , (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>C.</given-names>
            <surname>Ullrich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Shen</surname>
          </string-name>
          , and
          <string-name>
            <surname>D.</surname>
          </string-name>
          <article-title>Gillet: Not yet ready for everyone: An experience report about a personal learning environment for language learning</article-title>
          .
          <source>In Proceedings of ICWL</source>
          <year>2010</year>
          , page 269278, Rostock, Germany, (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>H.</given-names>
            <surname>Mandl</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H. F.</given-names>
            <surname>Friedrich</surname>
          </string-name>
          . Handbuch Lernstrategien. Göttingen: Hogrefe; (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>P.</given-names>
            <surname>Pintrich</surname>
          </string-name>
          ,
          <article-title>A process-oriented view of student motivation and cognition</article-title>
          . In J. Stark &amp; L.
          <string-name>
            <surname>Mets</surname>
          </string-name>
          (Eds),
          <article-title>Improving teaching and learning through research. New directions for institutional research</article-title>
          (pp.
          <fpage>65</fpage>
          .-
          <lpage>79</lpage>
          ). Jossey-Bass, San Francisco:, (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>D.</given-names>
            <surname>Verpoorten</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Poumay</surname>
          </string-name>
          , and
          <string-name>
            <surname>D.</surname>
          </string-name>
          <article-title>Leclercq: The eight learning events model: A pedagogic conceptual tool supporting diversification of learning methods</article-title>
          .
          <source>Interactive Learning Environments</source>
          <volume>15</volume>
          ,
          <fpage>151</fpage>
          -
          <lpage>160</lpage>
          , (Aug.
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>B.</given-names>
            <surname>Zimmerman</surname>
          </string-name>
          .
          <article-title>Becoming a Self-Regulated Learner</article-title>
          .
          <source>Theory into Practice</source>
          .
          <volume>41</volume>
          ,
          <fpage>64</fpage>
          -
          <lpage>70</lpage>
          (
          <year>2002</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>