<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning”</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nikos Manouselis</string-name>
          <email>nikosm@grnet.gr</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hendrik Drachsler</string-name>
          <email>hendrik.drachsler@ou.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Riina Vuorikari</string-name>
          <email>riina.vuorikari@eun.org</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hans Hummel</string-name>
          <email>hans.hummel@ou.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rob Koper</string-name>
          <email>rob.koper@ou.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Centre for Learning Sciences and Technologies (CELSTEC) Open Universiteit Nederland Valkenburgerweg 177</institution>
          ,
          <addr-line>6419 AT Heerlen, NL</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>European Schoolnet (EUN) Rue de Treve</institution>
          ,
          <addr-line>61, 1040 Brussels</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Greek Research and Technology Network (GRNET S.A.) 56 Messogeion Av.</institution>
          ,
          <addr-line>115 27, Athens</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
      </contrib-group>
      <abstract>
        <p />
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>This paper offers an excerpt of a chapter that will appear later in the First
Handbook on Recommender Systems. It focuses on the field of Technology enhanced
learning (TEL) that aims to design, develop and test socio-technical innovations
that support and enhance learning practices of both individuals and
organisations. TEL is therefore an application domain that generally covers technologies
that support all forms of teaching and learning activities. Since information
retrieval (in terms of searching for relevant learning resources to support teachers
or learners) is a pivotal activity in TEL, the deployment of recommender systems
has attracted increased interest. This chapter attempts to provide an introduction
to recommender systems for TEL settings, as well as to highlight their
particularities compared to recommender systems for other application domains.</p>
    </sec>
    <sec id="sec-2">
      <title>Introduction</title>
      <p>
        As in any other field where there is a massive increase in product variety, in
Technology Enhanced Learning (TEL) there is also a need for better findability of
(mainly digital) learning resources. For instance, during the past few years,
numerous repositories with digital learning resources have been set up (Tzik
        <xref ref-type="bibr" rid="ref74">opoulos
et al., 2007</xref>
        ). A prominent European example is European Schoolnet’s Learning
Resource Exchange (http://lreforschools.eun.org) that federates more than 43,000
learning resources from 25 different content providers in Europe and beyond. The
US examples are repositories such as MERLOT (http:// www.merlot.org) that has
more than 20,000 learning resources (and about 70,000 registered users) and OER
Commons (http://www.oercommons.org) with about 18,000 resources. Apart from
learning content, learning resources may also include learning paths (that can help
them navigate through appropriate learning resources) or relevant peer-learners
(with whom collaborative learning activities can take place).
      </p>
      <p>
        In this plethora of online learning resources available, and considering the various
opportunities for interacting with such resources that often occur in both formal
and non-formal settings, all user groups of TEL systems can benefit from services
that help them identify suitable learning resources from a potentially
overwhelming variety of choices. As a consequence, the concept of recommender systems
has already appeared in the TEL-domain. Latest efforts to identify relevant
research in this field, and to bring together researchers working on similar topics,
have been the annual workshop series of Social Information Retrieval for
Technology Enhanced Learning (SIRTEL), and a Special Issue on Social Information
Retrieval for TEL in the Journal of Digital Information
        <xref ref-type="bibr" rid="ref36">(Duval et al., 2009)</xref>
        . These
efforts resulted in a number of interesting conclusions, the main ones being that:
a) There is a large number of recommender systems that have been deployed (or
that are currently under deployment) in TEL settings;
b) The information retrieval goals that TEL recommenders try to achieve are
often different to the ones identified in other systems (e.g. product
recommenders);
c) There is a need to identify the particularities of TEL recommender systems, in
order to elaborate on methods for their systematic design, development and
evaluation.
      </p>
      <p>In this direction, the present chapter attempts to provide an introduction to issues
related to the deployment of recommender systems in TEL settings, keeping in
mind the particularities of this application domain. The main contributions of this
chapter are the following:</p>
      <p>A sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 3
• Discuss the background of recommender systems in TEL, particularly in
relation to the particularities of TEL context.
• Reflect on user tasks that are supported in TEL settings, and how they compare
to typical user tasks in other recommender systems.
• Review related work coming from adaptive educational hypermedia (AEH)
systems and the learning networks (LN) concept.
• Assess the current status of development of TEL recommender systems.
• Provide an outline of particularities and requirements related to the evaluation
of TEL recommender systems that can provide a basis for their further
application and research in educational applications.</p>
    </sec>
    <sec id="sec-3">
      <title>Background</title>
      <sec id="sec-3-1">
        <title>TEL as context</title>
        <p>
          Technology Enhanced Learning and the analysis of the data it generates take place
in different types of educational settings which are called macro-context
          <xref ref-type="bibr" rid="ref112 ref113 ref114 ref36">(Vuorikari &amp; Berendt, 2009)</xref>
          . It generally has significant influence on what user actions
are possible and how they can be interpreted. Examples of these dimensions of
macro-context include dimensions such as educational level, formal and informal
learning, delivery setting and different user roles.
        </p>
        <p>
          Examples of the educational level are K-12 education, Higher Education (HE),
Vocational Education and Training (VET) and workplace training. A formal
setting for learning includes learning offers from educational institutions (e.g.
universities, schools) within a curriculum or syllabus framework, and is characterised as
highly structured, leading to a specific accreditation and involving domain experts
to guarantee quality. This traditionally occurs in teacher-directed environments
with person-to-person interactions, in a live and synchronous manner.
An informal setting, on the other hand, is described in the literature as a learning
phase of so-called lifelong learners who are not participating in any formal
learning and are responsible for their own learning pace and path
          <xref ref-type="bibr" rid="ref20 ref68">(Colley, Hodkinson &amp;
Malcom, 2002; Longworth, 2003)</xref>
          . The learning process depends to a large extent
on individual preferences or choices and is often self-directed
          <xref ref-type="bibr" rid="ref9">(Brockett &amp;
Hiemstra, 1991)</xref>
          . The resources for informal learning might come from sources such as
expert communities, work context, training or even friends might offer an
opportunity for an informal competence development.
The TEL involvement can be characterised by the provision of blended learning
opportunities to purely distant educational ones
          <xref ref-type="bibr" rid="ref72">(Moore, 2003)</xref>
          . Blended learning
combines traditional face-to-face learning with computer-supported learning
          <xref ref-type="bibr" rid="ref42">(Graham, 2005)</xref>
          . Distance education, on the other hand, can be delivered using
TEL environments in either synchronous or asynchronous ways. Traditionally,
distance learning was more related to self-paced learning and learning-materials
interactions that typically occurred in an asynchronous way
          <xref ref-type="bibr" rid="ref42">(Graham, 2005)</xref>
          .
However, live streaming and virtual, personal learning environments (e.g. Web
2.0) have facilitated the development of synchronous distance learning services in
formal educational settings.
        </p>
        <p>Lastly, different actors and needs can be identified in TEL. A distinction can be
made between the teacher-directed interaction and learner-directed learning
processes. This has ramifications concerning the intended users of TEL environments.
This thesis, for example, considers teachers as main users of the system.
While macro-context has large implications for interpretation and design, its
aspects are fairly agreed-upon, and it is comparatively easy to measure.
Microcontext is a more contested notion and more difficult to measure. However, while
macro-context is domain-specific, concepts for micro-context range over more
diverse fields.</p>
      </sec>
      <sec id="sec-3-2">
        <title>TEL Recommendation goals</title>
        <p>
          In the past, the development of recommender systems has been related to a
number of relevant user tasks that the recommender system supports within some
particular application content. More specifically,
          <xref ref-type="bibr" rid="ref46">Herlocker et al. (2004)</xref>
          have related
popular (or less popular) user tasks with recommendation goals:
•
•
•
•
        </p>
        <p>Annotation in Context. Providing recommendations while the user is
carrying out some other tasks. E.g. Web-recommenders that provide predictions
about existing links in the user’s typical browsing environment.</p>
        <p>Find Good Items. The core recommendation task, recommending users with
a number of suggested items. E.g. systems where good items are
recommended, often without explaining why these ones are chosen (e.g. showing
predicted rating values).</p>
        <p>Find All Good Items. Providing recommendations in domains where
information completeness is a critical factor (e.g. health or legal cases). It concerns
recommending users with an exhaustive list of all relevant items.</p>
        <p>Recommend Sequence. Very relevant in systems where users are
“consuming” items in a sequence (i.e. one after the other), such as personalised radio
A sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 5
and TV applications. It concerns the recommendation of a whole sequence of
items, instead of simply a subset of relevant ones.</p>
        <p>Just Browsing. Relevant in cases where recommendation is not supporting
relevant or “equally good” items, but is trying to expand the search coverage
with novel or serendipitous suggestions. It provides a recommended list of
good items or some annotation in context, but the rationale for the
recommendation is different.</p>
        <p>
          Find Credible Recommender. Relevant in the early stages of getting
familiarised with a recommender system, when users want to explore and validate
the credibility of the system. Good items or annotations in content can be
provided, but the rationale of recommendation may differ (e.g. providing very
few novel or serendipitous suggestions that could surprise the users).
Generally speaking, most of the above identified recommendation goals and user
tasks are valid in the case of TEL recommender systems as well. For example, a
recommender system supporting learners to achieve a specific learning goal,
“providing annotation in context” or “recommending a sequence” of learning resources
are relevant tasks. However, in comparison to the typical item recommendation
scenario, there are several particularities to be considered regarding what kind of
learning is desired, e.g. learning a new concept or reinforce existing knowledge
may require different type of learning resources. Moreover, for learners with no
prior knowledge in a specific domain, relevant pedagogical rules such as
Vygotsky’s “zone of proximal development” should be applied, e.g. ‘recommended
learning objects should have a level slightly above learners’ current competence
level’,
          <xref ref-type="bibr" rid="ref115">(Vygotsky 1978)</xref>
          .
        </p>
        <p>
          Different from buying products, learning is an effort that often takes more time
and interactions compared to a commercial transaction. Learners rarely achieve a
final end state after a fixed time. Instead of buying a product and then owning it,
learners achieve different levels of competences that have various levels in
different domains. In such scenarios, what is important is identifying the relevant
learning goals and supporting learners in achieving them. On the other hand, depending
on the context, some particular user task may be prioritised. This could call for
recommendations whose time span is longer than the one of product
recommendations, or recommendations of similar learning resources, since recapitulation and
reiteration are central tasks of the learning process
          <xref ref-type="bibr" rid="ref100 ref101 ref103 ref70">(McCalla 2004)</xref>
          .
As for teacher-centred learning context, different tasks need to be supported.
These tasks can be broadly distinguished into the ones related to the preparation of
lessons, the delivery of the lesson (i.e. the actual teaching), and the ones related to
the evaluation. For instance, to prepare a lesson the teacher has certain educational
goals to fulfil and needs to match the delivery methods to the profile of the
learners (e.g. their previous knowledge). Lesson preparation can include a variety of
information seeking tasks, such as finding content to motivate the learners, to recall
existing knowledge, to illustrate, visualise and represent new concepts and
information. The delivery can be supported in using different pedagogical methods
(either supported with TEL or not), whose effectiveness is evaluated according to the
goals set. A TEL recommender system could support one or more of these tasks,
leading to a variety of recommendation goals.
        </p>
        <p>Thus, although the previously identified user tasks and recommendation goals can
be considered valid in a TEL context, there are several particularities and
complexities. This means that simply transferring a recommender system from an
existing (e.g. commercial) content to TEL may not accurately meet the needs of the
targeted users. In TEL, careful analysis of the targeted users and their supported
tasks should be carried out, before a recommendation goal is defined and a
recommender system is deployed. This means that the TEL recommendation goals
can be rather complex: for example, a typical TEL recommender system could
suggest a number of alternative learning paths throughout a variety of learning
resources, either in the form of learning sequences or hierarchies of interacting
learning resources. This should take place in a pedagogically meaningful way that
will reflect the individual learning goals and targeted competence levels of the
user, depending on proficiency levels, specific interests and the intended
application context.</p>
        <p>Therefore, the task analysis of TEL recommender systems has to consider a
number of context variables such as user attributes, domain characteristics, and
intelligent methods that can be engaged to provide personalised recommendations.
Extensive work on these topics has been carried out in the past, in the area of
adaptive educational hypermedia systems.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Related Work</title>
      <p>
        Web systems generally suffer from the inability to satisfy the heterogeneous needs
of many users. To address this challenge, a particular strand of research that has
been called adaptive web systems (or adaptive hypermedia) tried to overcome the
shortcomings of traditional ‘one-size-fits-all’ approaches by exploring ways in
which Web-based could adapt their behaviour to the goals, tasks, interests, and
other characteristics of interested users
        <xref ref-type="bibr" rid="ref15">(Brusilovsky &amp; Nejdl, 2004)</xref>
        . A particular
category of adaptive systems has been the one dealing with educational
applications, called adaptive educational hypermedia (AEH) systems. Since one can say
that AEH systems address issues of high relevance to TEL recommender systems,
this section provides a brief overview of related work, trying to identify
commonalities and differences that could be of relevance for TEL recommenders.
      </p>
      <p>A sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 7</p>
      <sec id="sec-4-1">
        <title>Adaptive Educational Hypermedia</title>
        <p>
          Adaptive web systems belong to the class of user-adaptive software systems
          <xref ref-type="bibr" rid="ref93">(Schneider-Hufschmidt et al., 1993)</xref>
          . According to
          <xref ref-type="bibr" rid="ref75">(Oppermann, 1994)</xref>
          a system is
called adaptive "if it is able to change its own characteristics automatically
according to the user’s needs". Adaptive systems consider the way the user interacts with
the system and modify the interface presentation or the system behaviour
accordingly (Weibenzahl, 2003).
          <xref ref-type="bibr" rid="ref51">Jameson (2001)</xref>
          adds an important characteristic: “A
user-adaptive system is an interactive system which adapts its behaviour to each
individual user on the basis of nontrivial inferences from information about that
user”.
        </p>
        <p>
          Adaptive systems help users find relevant items in a usually large information
space, by essentially engaging three main adaptation technologies
          <xref ref-type="bibr" rid="ref15">(Brusilovsky &amp;
Nejdl, 2004)</xref>
          : adaptive content selection, adaptive navigation support, and adaptive
presentation. The first of these three technologies comes from the field of adaptive
information retrieval (IR)
          <xref ref-type="bibr" rid="ref5">(Baudisch, 2001)</xref>
          and is associated with a search-based
access to information. When the user searches for relevant information, the system
can adaptively select and prioritise the most relevant items. The second
technology was introduced by adaptive hypermedia systems
          <xref ref-type="bibr" rid="ref11">(Brusilovsky, 1996)</xref>
          and is
associated with a browsing-based access to information. When the user navigates
from one item to another, the system can manipulate the links (e.g., hide, sort,
annotate) to guide the user adaptively to most relevant information items. The third
technology has its roots in the research on adaptive explanation and adaptive
presentation in intelligent systems
          <xref ref-type="bibr" rid="ref71 ref78">(Moore and Swartout, 1989; Paris, 1988)</xref>
          . It deals
with presentation, not access to information. When the user gets to a particular
page, the system can present its content adaptively.
        </p>
        <p>
          As Brusilovksy (2001) describes, educational hypermedia was one of the first
application areas of adaptive systems. A number of pioneer adaptive educational
hypermedia systems were developed between 1990 and 1996, which he roughly
divided into two research streams. The systems of one of these streams were created
by researchers in the area of intelligent tutoring systems (ITS) who were trying to
extend traditional student modelling and adaptation approaches developed in this
field to ITS with hypermedia components
          <xref ref-type="bibr" rid="ref10 ref43 ref95">(Beaumont, 1994; Brusilovsky, Pesin,
&amp; Zyryanov, 1993; Gonschorek, &amp; Herzog, 1995; Pérez, Lopistéguy, Gutiérrez, &amp;
Usandizaga, 1995)</xref>
          . The systems of the other stream were developed by
researchers working on educational hypermedia in an attempt to make their systems adapt
to individual students
          <xref ref-type="bibr" rid="ref22 ref24 ref48 ref56">(De Bra, 1996; de La Passardiere, &amp; Dufresne, 1992; Hohl,
Böcker, &amp; Gunzenhäuser, 1996; Kay, &amp; Kummerfeld, 1994)</xref>
          . AEH research has
often followed a top- down approach, greatly depending on expert knowledge and
involvement in order to identify and model TEL context variables. For example,
          <xref ref-type="bibr" rid="ref21">Cristea (2005)</xref>
          describes a number of expertise-demanding tasks when AEH
content is authored: initially creating the resources, labelling them, combining them
into what is known as a domain model; then, constructing and maintaining the
user model in a static or dynamic way, since it is crucial for achieving successful
adaptation in AEH. Generally speaking, in AEH a large amount of user-related
information (characterising needs and desires) has to be encoded in the content
creation phase. This can take place in formal educational settings when the context
variables are usually known, and there is a large amount of AEH research (e.g.
dealing with learner and domain models) that can be considered and reused within
TEL recommender research. On the other hand, in non-formal settings less
expertdemanding approaches need to be explored.
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Learning Networks</title>
        <p>
          Another strand of work includes research where the context variables are extracted
from the contributions of the users. A category of such systems includes learning
networks, which connect distributed learners and providers in certain domains
          <xref ref-type="bibr" rid="ref58 ref59 ref60">(Koper &amp; Tattersall, 2004; Koper et al., 2005)</xref>
          . The design and development of
learning networks is highly flexible, learner-centric and evolving from the bottom
upwards, going beyond formal course and programme-centric models that are
imposed from the top downwards. A learning network is populated with many
learners and learning activities provided by different stakeholders. Each user is allowed
to add, edit, delete or evaluate learning resources at any time.
        </p>
        <p>
          The concept of learning networks
          <xref ref-type="bibr" rid="ref109 ref59 ref60">(Koper, Rusman, Sloep, 2005)</xref>
          provides
methA sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 9
ods and technical infrastructures for distributed lifelong learners to support their
personal competence development. It takes advantages of the possibilities of the
Web 2.0 developments and describes the new dynamics of learning in the
networked knowledge society. A learning network is learner-centred and its
development emerges from the bottom-up through the participation of the learners.
Emergence is the central idea of the learning network concept. Emergence appears
when an interacting system of individual actors and resources self-organises to
shape higher-level patterns of behavior
          <xref ref-type="bibr" rid="ref116 ref41 ref53">(Gordon, 1999; Johnson, 2001; Waldrop,
1992)</xref>
          .
        </p>
        <p>
          We can imagine users (e.g. learners) interacting with learning activities in a
learning network while their progress is being recorded. Indirect measures like time or
learning outcomes, and direct measures like ratings and tags given by users allow
identify paths in a learning network which are faster to complete or more
attractive than others
          <xref ref-type="bibr" rid="ref112 ref113 ref114 ref31 ref32 ref33 ref36 ref36 ref40">(e.g. Drachsler at al., 2009; Vuorikari &amp; Koper, 2009)</xref>
          . This
information can be fed back to other learners in the learning network, providing
collective knowledge of the ‘swarm of learners’ in the learning network. Most
learning environments are designed only top-down as oftentimes their structure,
learning activities and learning routes are predefined by an educational institution.
Learning networks, on the other hand, take advantage of the user-generated
content that is created, shared, rated and adjusted by using Web 2.0 technologies. In
the field of TEL several European projects address these bottom-up approaches of
creating and sharing knowledge. A large EU-initiative that addresses the creation
of informal learning networks is the TENcompetence project
          <xref ref-type="bibr" rid="ref126">(Wilson et al., 2008)</xref>
          .
Another category of systems that formulate and define their context variables
following a bottom-up approach, are Mash-Up Personal Learning Environments
(MUPPLE)
          <xref ref-type="bibr" rid="ref125">(Wild et al., 2008)</xref>
          . First such approac
          <xref ref-type="bibr" rid="ref50">hes were created by (Liber,
2000</xref>
          ;
          <xref ref-type="bibr" rid="ref66">Liber &amp; Johnson, 2008</xref>
          ; Wild et al., 2008; Wilson, 2005). The iCamp EU
initiative explicitly addresses the integration of Web2.0 sources into MUPPLE, by
creating a flexible environment that allows learners to create their own
environments for certain learning activities. MUPPLEs are a kind of instance of the
learning network concept and therefore share several characteristics with it. They also
support informal learning as they require no institutional background and focus on
the learner instead of institutional needs like student management or assessments.
The learners do not participate in formal courses and neither receive any
certification for their competence development. A common problem for MUPPLEs is the
amount of data that is gathered already in a short time frame and the unstructured
way it is collected. This can make the process of user and domain modelling
demanding and unstructured. On the other hand, this is often the case in
recommender systems as well, when user and item interactions are explored, e.g. in
order to identify user and item similarities.
        </p>
      </sec>
      <sec id="sec-4-3">
        <title>Similarities and differences</title>
        <p>
          Many of the AEH systems address formal learning
          <xref ref-type="bibr" rid="ref2 ref23 ref61 ref72 ref99">(e.g. Aroyo et al. 2003; De Bra
et al. 2002; Kravcik et al. 2004)</xref>
          , have equally fine-granulated knowledge domains
and can therefore offer personalised recommendations to the learners. They take
advantage of technologies like metadata and ontologies to define the relationships,
conditions, and dependencies of learning resources and learner models. These
systems are mainly used in ‘closed-corpus’ applications
          <xref ref-type="bibr" rid="ref16">(Brusilovsky &amp; Henze, 2007)</xref>
          where the learning resources can be described by an educational designer through
semantic relationships and is therefore a formal learning offer. As mentioned
before, in formal educational settings (such as universities) there are usually
wellstructured formal relationships like predefined learning plans (curriculum) with
locations, student/teacher profiles, and accreditation procedures. All this metadata
can be used to recommend courses or personalise learning through the adaptation
of the learning resources or the learning environment to the students
          <xref ref-type="bibr" rid="ref4">(Baldoni et
al. 2007)</xref>
          . One interesting direction in this research is the work on adaptive
sequencing which takes into account individual characteristics and preferences for
sequencing learning resources
          <xref ref-type="bibr" rid="ref55">(Karampiperis &amp; Sampson, 2005)</xref>
          . In AEH there
are many design activities needed before the runtime and also during the
maintenance of the learning environment. In addition, the knowledge domains in the
learning environment need to be described in detail. These aspects make adaptive
sequencing and other adaptive hypermedia techniques less applicable for TEL
recommendation, where informal learning networks emerge without any highly
structured domain model representation.
        </p>
        <p>
          In informal learning networks, mining techniques need to be used in order to
create some representation of the user or domain model. For instance, prior
knowledge in informal learning is a rather diffuse parameter because it relies on
information given by the learners without any standardisation. To handle the dynamic
and diffuse characteristic of prior knowledge, and to bridge the absence of a
knowledge domain model, probabilistic techniques like latent semantic analysis
are promising
          <xref ref-type="bibr" rid="ref109">(van Bruggen et al., 2004)</xref>
          . The absence of maintenance and
structure in informal learning is also called the ‘open corpus problem’. The open
corpus problem applies when an unlimited set of documents is given that cannot be
manually structured and indexed with domain concepts and metadata from a
community
          <xref ref-type="bibr" rid="ref16">(Brusilovsky and Henze 2007)</xref>
          . The open corpus problem also applies
to informal learning networks. Therefore, bottom-up recommendation techniques
like collaborative filtering are more appropriate because they require nearly no
maintenance and improve through the emergent behaviour of the community.
          <xref ref-type="bibr" rid="ref29 ref30">Drachsler, Hummel and Koper (2008</xref>
          ) analysed how various types of collaborative
filtering techniques can be used to support learners in informal learning networks.
Following their conclusions we have to consider the different environmental
conditions of informal learning, such as the lack of maintenance and less formal
strucA sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 11
tured learning objects, in order to provide an appropriated navigation support to
recommender systems. Learning networks are mainly structured by tags and
ratings given by their users, being therefore in contrast with the institutionalised
Virtual Learning Environments (VLEs) like Moodle or Blackboard that are used to
better manage learning activities and distribute learning resources to learners.
Besides the already mentioned differences for prior knowledge in informal
learning, there are also differences in the data sets which are derived from
environmental conditions. Normally, the numbers of ratings obtained in recommender
systems is usually very small compared to the number of ratings that have to be
predicted. Effective prediction by ratings based on small amounts is very essential
for recommender systems and has an effect on the selection of a specific
recommendation technique. Formal learning can rely on regular evaluations of experts or
students upon multiple criteria (e.g., pedagogical quality, technical quality, ease of
use)
          <xref ref-type="bibr" rid="ref108 ref111 ref69">(Manouselis et al., 2007)</xref>
          , but in informal learning environments such
evaluation procedures are unstructured and few. Formal learning environments like
universities often have integrated evaluation procedures for a regular quality
evaluation to report to their funding body. With these integrated evaluation procedures
more dense data sets can be expected. As a conclusion, the data sets in informal
learning context are characterised by the “Sparsity problem” caused by sparse
ratings in the data set. Multi-criteria ratings could be beneficial for informal learning
to overcome the “Sparsity problem” of the data sets. These multi-criteria ratings
have to be reasonable for the community of lifelong learners. The community
could rate learning resources on various levels, such as required prior knowledge
level (novice to expert), the presentation style of learning resources, and even the
level of attractiveness, because keeping students satisfied and motivated is a vital
criteria in informal learning. These explicit rating procedures should be supported
with several indirect measures, such as “Amount of learners using the learning
resource”, “Amount of adjustments of a learning resources”, in order to measure
how up-to-date the learning resource is.
        </p>
        <p>Informal learning is therefore different from well-structured domains, like formal
learning. Recommender systems for informal learning have no official
maintenance by an institution, mostly rely on its community and most of the time do not
contain well-defined metadata structures. Moreover, where formal learning is
characteristically top-down designed and develop learning offers (closed-corpus),
informal learning offers are emerging from the bottom-up through the
communities (open-corpus). Therefore, it will be difficult to transfer and apply
recommender systems even from formal to non-formal settings (and vice-versa), since
user tasks and recommendation goals are often substantially different.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Survey of TEL Recommender Systems</title>
      <p>
        In the TEL-domain a number of recommender systems have been introduced in
order to propose learning resources to users. Such systems could potentially play
an important educational role, considering the variety of learning resources that
are published online and the benefits of collaboration between tutors and learners
        <xref ref-type="bibr" rid="ref63 ref83 ref84">(Recker &amp; Wiley, 2000; Recker &amp; Wiley, 2001; Kumar, al., 2005)</xref>
        . The following
tables provides a selection of some typical approaches, as well as an assessment of
their status of development and evaluation.
      </p>
      <p>
        One of the first attempts to develop a collaborative filtering system for learning
resources has been the Altered Vista system
        <xref ref-type="bibr" rid="ref117 ref85 ref85 ref86 ref86">(Recker &amp; Walker, 2003; Recker et
al., 2003; Walker et al., 2004)</xref>
        . The aim of this study was to explore how to collect
user-provided evaluations of learning resources, and then to propagate them in the
form of word-of-mouth recommendations about the qualities of the resources. The
team working on Altered Vista explored several relevant issues, such as the design
of its interface
        <xref ref-type="bibr" rid="ref84">(Recker &amp; Wiley, 2000)</xref>
        , the development of non-authoritative
metadata to store user-provided evaluations
        <xref ref-type="bibr" rid="ref83">(Recker &amp; Wiley, 2001)</xref>
        , the design of
the system and the review scheme it uses
        <xref ref-type="bibr" rid="ref85 ref86">(Recker &amp; Walker, 2003)</xref>
        , as well as
results from pilot and empirical studies from using the system to recommend to the
members of a community both interesting resources and people with similar tastes
and beliefs
        <xref ref-type="bibr" rid="ref117 ref122 ref124 ref67 ref85 ref86">(Recker et a., 2003; Walker et al., 2004)</xref>
        .
      </p>
      <p>
        Another system that has been proposed for the recommendation of learning
resources is the RACOFI (Rule-Applying Collaborative Filtering) Composer system
        <xref ref-type="bibr" rid="ref1 ref64 ref64 ref65 ref65 ref72">(Anderson et al., 2003; Lemire et al., 2005; Lemire, 2005)</xref>
        . RACOFI combines
two recommendation approaches by integrating a collaborative filtering engine,
that works with ratings that users provide for learning resources, with an inference
rule engine that is mining association rules between the learning resources and
using them for recommendation. RACOFI studies have not yet assessed the
pedagogical value of the recommender, nor do they report some evaluation of the
system by users. The RACOFI technology is supporting the commercial site
inDiscover (http://www.indiscover.net) for music tracks recommendation. In
addition, other researchers have reported adopting RACOFI’s approach in their own
systems as well
        <xref ref-type="bibr" rid="ref38">(Fiaidhi, 2004)</xref>
        .
      </p>
      <p>
        The QSIA (Questions Sharing and Interactive Assignments) for learning resources
sharing, assessing and recommendation has been developed by Rafaeli et al.
(2004; 2005). This system is used in the context of online communities, in order to
harness the social perspective in learning and to promote collaboration, online
recommendation, and further formation of learner communities. Instead of
developing a typical automated recommender system, Rafaeli et al. chose to base QSIA
on a mostly user-controlled recommendation process. That is, the user can decide
A sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 13
whether to assume control on who advises (friends) or to use a collaborative
filtering service. The system has been implemented and used in the context of several
learning situations, such as knowledge sharing among faculty and teaching
assistants, high school teachers and among students, but no evaluation results have
been reported so far
        <xref ref-type="bibr" rid="ref81">(Rafaeli et al., 2004; 2005)</xref>
        .
      </p>
      <p>
        In this strand of systems for collaborative filtering of learning resources, the
CYCLADES system
        <xref ref-type="bibr" rid="ref3">(Avancini &amp; Straccia, 2005)</xref>
        has proposed an environment
where users search, access, and evaluate (rate) digital resources available in
repositories found through the Open Archives Initiative (OAI,
http://www.openarchives.org). Informally, OAI is an agreement between several
digital archives providers in order to offer some minimum level of interoperability
between them. Thus, such a system can offer recommendations over resources that
are stored in different archives and accessed through an open scheme. The
recommendations offered by CYCLADES have been evaluated through a pilot study
with about 60 users, which focused on testing the performance (predictive
accuracy) of several collaborative filtering algorithms.
      </p>
      <p>
        A related system is the CoFind prototype
        <xref ref-type="bibr" rid="ref106 ref34 ref34 ref35 ref35 ref67 ref84">(Dron et al., 2000a; Dron et al., 2000b)</xref>
        .
It also used digital resources that are freely available on the Web but it followed a
new approach by applying for the first time folksonomies (tags) for
recommendations. The CoFind developers stated that predictions according to preferences were
inadequate in a learning context and therefore more user driven bottom-up
categories like folksonomies are important. A typical, neighbourhood-based set of
collaborative filtering algorithms have been tried in order to support learning object
recommendation by
        <xref ref-type="bibr" rid="ref69">Manouselis et al. (2007)</xref>
        . The innovative aspect of this study
is that the engaged algorithms have been multi-attribute ones, allowing the
recommendation service to consider multi-dimensional ratings that users provider on
learning resources.
      </p>
      <p>
        A different approach to learning resources’ recommendation has been followed by
        <xref ref-type="bibr" rid="ref96">Shen &amp; Shen (2004)</xref>
        . They have developed a recommender system for learning
objects that is based on sequencing rules that help users be guided through the
concepts of an ontology of topics. The rules are fired when gaps in the
competencies of the learners are identified, and then appropriate resources are proposed to
the learners. A pilot study with the students of a Network Education college has
taken place, providing feedback regarding the users’ opinion about the system.
Tang and McCalla proposed an evolving e-learning system, open into new
learning resources that may be found online, which includes a hybrid recommendation
service
        <xref ref-type="bibr" rid="ref117 ref38 ref46 ref99">(Tang &amp; McCalla 2003; 2004a; 2004b; 2004c; 2005)</xref>
        . Their system is
mainly used for storing and sharing research papers and glossary terms among
university students and industry practitioners. Resources are described (tagged)
according to their content and technical aspects, but learners also provide feedback
about them in the form of ratings. Recommendation takes place both by engaging
a Clustering Module (using data clustering techniques to group learners with
similar interests) and a Collaborative Filtering Module (using classic collaborative
filtering techniques to identify learners with similar interests in each cluster). The
authors studied several techniques to enhance the performance of their system,
such as the usage of artificial (simulated) learners
        <xref ref-type="bibr" rid="ref100 ref101 ref103 ref70">(Tang &amp; McCalla, 2004c)</xref>
        . They
have also performed an evaluation study of the system with real learners
        <xref ref-type="bibr" rid="ref102">(Tang &amp;
McCalla, 2005)</xref>
        .
      </p>
      <p>
        A rather simple recommender system without taking into account any preferences
or profile information of the learners was applied by
        <xref ref-type="bibr" rid="ref52">Janssen et al. (2005)</xref>
        .
However, they conducted a large experiment with a control group and an experimental
group. They found positive effects on the effectiveness (completion rates of
learning objects) though not on efficiency (time taken to complete the learning
resources) for the experimental group as compared to the control group.
        <xref ref-type="bibr" rid="ref73">Nadolski et al. (2009)</xref>
        created a simulation environment for different combination
of recommendation algorithms in hybrid recommender system in order to compare
them against each other regarding their impact on learners in informal learning
networks. They compared various cost intensive ontology based recommendation
strategies with light-weight collaborative filtering strategies. Therefore, they
created treatment groups for the simulation through combining the recommendation
techniques in various ways. Nadolski et al. tested which combination of
recommendation techniques in recommendation strategies had a higher effect on the
learning outcomes of the learners in a learning network. They concluded that the
light-weight collaborative filtering recommendation strategies are not as accurate
as the ontology-based strategies but worth-while for informal learning networks
when considering the environmental conditions like the lack of maintenance in
learning networks. Nadolski et al. study confirmed that providing
recommendations leads towards more effective, more satisfied, and faster goal achievement
than no recommendation. Furthermore, their study reveals that a light-weight
collaborative filtering recommendation technique including a rating mechanism is a
good alternative to maintain intensive top-down ontology recommendation
techniques.
      </p>
      <p>
        Moreover, the ISIS system adopts a hybrid approach for recommending learning
resources is the one recently proposed by Hummel et al. (2006). The authors build
upon a previous simulation study by
        <xref ref-type="bibr" rid="ref59 ref60">Koper (2005)</xref>
        in order to propose a system
that combines social-based (using data from other learners) with
informationbased (using metadata from learner profiles and learning activities) in a hybrid
recommender system. They also designed an experiment with real learners.
Drachsler (accepted) recently reported the experimental results the ISIS
experiment. They found a positive significant effect on efficiency (time taken to
complete the learning objects) of the learners after a runtime of four months. It is a
A sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 15
very good example of a system that is following the latest trends in learning
specifications for representing learner profiles and learning activities.
      </p>
      <p>
        The same group recently developed a recommender system called ReMashed
        <xref ref-type="bibr" rid="ref112 ref31 ref32 ref33 ref73">(Drachsler et. al, 2009a,b)</xref>
        that addresses learners in informal learning networks.
They created a mash-up environment that combines sources of users from
different Web2.0 services like flickr, delicious.com or Sildeshare. Again they applied a
hybrid recommender system that takes advantage of the tag and rating data of the
combined Web2.0 sources. The tags that are already given to the Web2.0 sources
are used for the cold-start of the recommender system. The users of ReMashed are
able to rate the emerging data of all users in the system. The ratings are used for
classic collaborative filtering recommendations based on the Duine prediction
engine
        <xref ref-type="bibr" rid="ref109 ref76">(Van Setten, M., 2005)</xref>
        .
      </p>
      <p>
        The same approach is followed by the proposed Learning Object
Recommendation Model (LORM) that also follows a hybrid recommendation algorithmic
approach and that describes resources upon multiple attributes, but has not yet
reported to be implemented in an actual system
        <xref ref-type="bibr" rid="ref107">(Tsai et al., 2006)</xref>
        .
      </p>
      <p>
        Finally, there have been some recent proposals for systems or algorithms that
could be used to support recommendation of learning resources. These included
and a case-based reasoning recommender that
        <xref ref-type="bibr" rid="ref40">Gomez-Albarran &amp; Jimenez-Diaz
(2009)</xref>
        recently proposed.
      </p>
      <p>Nevertheless, despite the increasing number of systems proposed for
recommending learning resources, a closer look to the current status of their development and
evaluation reveals the lack of systematic evaluation studies in the context of
reallife applications. As Table 1 indicates:
•
•</p>
      <p>More than half of the proposed systems (10 out of 16) still remain at a design
or prototyping stage of development;</p>
      <p>
        Only 7 systems have been evaluated through trials that involved human users.
Another interesting observation is that very often, experimental investigation of
the recommendation algorithms does not take place. This is a common evaluation
practice in systems examined for other domains
        <xref ref-type="bibr" rid="ref25 ref45 ref76 ref8">(e.g. Breese et al., 1998;
Deshpande &amp; Karypis, 2004; Papagelis &amp; Plexousakis, 2005; Herlocker et al.,
2002)</xref>
        , which indicate that careful testing and parameterisation has to be carried
out before a recommender system is finally deployed in a real setting. One of the
main reasons is that the performance of recommendation algorithms seems to be
dependent on the particularities of the application context, therefore, it is advised
to experimentally analyse various design choices for a recommender system,
before its actual deployment.
      </p>
      <p>Nikos Manouselis1, Hendrik Drachsler2, Riina Vuorikari2,3, Hans Hummel2, Rob Koper2</p>
      <p>Algorithm</p>
      <p>Simulated users
Full system
Prototype
Prototype
Full system
Prototype
Design
Design
System usage</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusions and further work</title>
      <p>This papers provides an excerpt of a chapter that will appear later in the First
Handbook on Recommender Systems. It offers an introduction to the issues
related to the deployment of recommender systems in the TEL settings emphasising
the particularities of this application domain. To our knowledge, this is the first
study attempting to systematically cover the design and deployment of
recommender systems in the TEL settings. Nevertheless, it can only provide a brief
overview of related issues, leaving several aspects to be further explored and
researched.</p>
      <p>The paper first discussed the context in which TEL recommenders are deployed,
and reflected on related user tasks and recommendation goals. A review of related
work coming from the research strands of Adaptive Educational Hypermedia and
Learning networks has been provided, with a particular emphasis on how it
applies to TEL recommenders for formal and informal learning settings. Then, a
survey of TEL recommenders proposed in the literature was presented with a critical
view on the actual implementation of systems. This paper has left out the part with
a particular emphasis on the evaluation and the discussion on evaluation
requirements and issues for TEL recommender systems.</p>
      <p>
        The main research challenge for the future is the one of the systematic
development and evaluation of TEL recommender systems. In addition, for the various
groups of researchers involved in TEL, a number of topics are of high research
interest. For example, the recommendation support for learners in formal and
informal learning that takes advantage of contextualised recommender systems has
become an important one. These recommender systems, also called context-aware
recommender Systems
        <xref ref-type="bibr" rid="ref64 ref65">(Lemire et al, 2005)</xref>
        , use for example geographical location
of a user to recommend relevant resources. Such contextualisation becomes
important in situations where multilingual educational resources are recommended
from a federation of repositories from a number of countries with different
learning standards and/or institutions with different curricula
        <xref ref-type="bibr" rid="ref112 ref113 ref114 ref36">(Vuorikari &amp; Ochoa,
2009)</xref>
        . Additionally, context awareness could include pedagogical aspects like
prior knowledge, learning goals or study time to embed pedagogical reasoning
into collaborative filtering driven recommendations.
      </p>
      <p>Another promising approach is the use of multi-criteria input for recommender
system in TEL. Users (learners and teachers) can not only rate learning resource
based on the level of complexity, curriculum alignment or how much time is
required to cover the learning material, but input also could be inferred from
different implicit sources. Such multidimensional input can potentially have a high
impact on the suitability of recommendations. A related problem is the lack of TEL
specific data sets for informal and formal learning. Different to the recommender
system world, where many data sets are available (e.g. MovieLens, BookCrossing,
Jester Collaborative Filtering Dataset), the TEL community is still working with
rather small home-made data sets, which are rarely public available.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgements</title>
      <p>Research of N. Manouselis was funded with support by the European Commission
and more specifically, the project ECP-2006-EDU-410012 ‘Organic.Edunet: A
Multilingual Federation of Learning Repositories with Quality Content for the
Awareness and Education of European Youth about Organic Agriculture and
Agroecology’ of the eContentplus Programme. Research of H. Drachsler was
funded with support by the European Commission and more specifically, the
project IST 027087 ‘TENCompetence’ of the FP6 Programme. Riina Vuorikari
thanks the HS-säätiö for the stipend.
A sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 21</p>
      <p>A sneak preview to the chapter “Recommender Systems in Technology Enhanced Learning” 23</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Anderson</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ball</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boley</surname>
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Greene</surname>
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Howse</surname>
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lemire</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGrath</surname>
            <given-names>S.</given-names>
          </string-name>
          , “
          <article-title>RACOFI: A Rule-Applying Collaborative Filtering System”</article-title>
          ,
          <source>In Proc. IEEE/WIC COLA'03</source>
          ,
          <string-name>
            <surname>Halifax</surname>
          </string-name>
          , Canada,
          <year>October 2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Aroyo</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mizoguchi</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Tzolov</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2003</year>
          ). OntoAIMS: Ontological Approach to Courseware Authoring.
          <source>Paper presented at the conference International Conference on Computers in Education (ICCE</source>
          <year>2003</year>
          ), .
          <fpage>2</fpage>
          -
          <issue>5</issue>
          <year>December 2003</year>
          ,
          <string-name>
            <given-names>Hong</given-names>
            <surname>Kong</surname>
          </string-name>
          , China.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <given-names>Avancini H.</given-names>
            ,
            <surname>Straccia</surname>
          </string-name>
          <string-name>
            <surname>U.</surname>
          </string-name>
          , “
          <article-title>User recommendation for collaborative and personalised digital archives”</article-title>
          ,
          <source>International Journal of Web Based Communities</source>
          ,
          <volume>1</volume>
          (
          <issue>2</issue>
          ),
          <fpage>163</fpage>
          -
          <lpage>175</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Baldoni</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baroglio</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brunkhorst</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marengo</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patti</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Reasoning-Based Curriculum Sequencing and Validation: Integration in a Service-Oriented Architecture</article-title>
          .
          <source>EC-TEL</source>
          , Vol.
          <volume>4753</volume>
          . LNCS Springer, Crete, Greece (
          <year>2007</year>
          )
          <fpage>426</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Baudisch P.</surname>
          </string-name>
          (
          <year>2001</year>
          ) “
          <article-title>Dynamic Information Filtering”</article-title>
          ,
          <source>PhD Thesis</source>
          , GMD Forschungszentrum Informationstechnik GmbH, Sankt Augustin.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Belkin</surname>
            ,
            <given-names>N. J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Croft</surname>
            ,
            <given-names>W. B.</given-names>
          </string-name>
          (
          <year>1992</year>
          )
          <article-title>'Information Filtering and Information Retrieval: Two Sides of the Same Coin?</article-title>
          '
          <source>Communications of the ACM</source>
          <volume>35</volume>
          (
          <issue>12</issue>
          ),
          <fpage>29</fpage>
          -
          <lpage>38</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Billsus</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Pazzani</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2000</year>
          )
          <article-title>'User Modeling for Adaptive News Access'</article-title>
          .
          <source>User-Modeling and User-Adapted Interaction</source>
          <volume>10</volume>
          (
          <issue>2</issue>
          ^3),
          <fpage>147</fpage>
          -
          <lpage>180</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Breese</surname>
            ,
            <given-names>J. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heckerman</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Kadie</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>1998</year>
          ) '
          <article-title>Empirical analysis of predictive algorithms for collaborative ¢ltering'</article-title>
          .
          <source>In: Proceedings of the 14th Annual Conference on Uncertainty in Arti¢cial Intelligence</source>
          , pp.
          <fpage>43</fpage>
          -
          <lpage>52</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Brockett</surname>
            ,
            <given-names>R. G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hiemstra</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1991</year>
          ).
          <article-title>Self-direction in adult learning: perspectives on theory, research and practice</article-title>
          . London: Routledge.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Brusilovsky</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pesin</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Zyryanov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>1993</year>
          ).
          <article-title>Towards an adaptive hypermedia component for an intelligent learning environment</article-title>
          . In Bass, L.J.,
          <string-name>
            <surname>Gornostaev</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Unger</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (Ed.),
          <source>Human-Computer Interaction (Lecture Notes in Computer Science</source>
          , Vol.
          <volume>753</volume>
          ). Berlin: SpringerVerlag.
          <fpage>348</fpage>
          -
          <lpage>358</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Brusilovsky</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>1996</year>
          )
          <article-title>“Methods and techniques of adaptive hypermedia”, User Modeling</article-title>
          and
          <string-name>
            <surname>User-Adapted Interaction</surname>
          </string-name>
          ,
          <volume>6</volume>
          (
          <issue>2-3</issue>
          ),
          <fpage>87</fpage>
          -
          <lpage>129</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Brusilovsky</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Eklund</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>1998</year>
          )
          <article-title>“A study of user-model based link annotation in educational hypermedia”, Journal of Universal Computer Science, special issue on assessment issues for educational software</article-title>
          ,
          <volume>4</volume>
          (
          <issue>4</issue>
          ),
          <fpage>429</fpage>
          -
          <lpage>448</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Brusilovsky</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2001</year>
          ) “
          <article-title>Adaptive hypermedia” User Modeling</article-title>
          and
          <string-name>
            <surname>User-Adapted</surname>
            <given-names>Interaction</given-names>
          </string-name>
          ,
          <volume>11</volume>
          (
          <issue>1-2</issue>
          ),
          <fpage>87</fpage>
          -
          <lpage>110</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Brusilovsky</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karagiannidis</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Sampson</surname>
            ,
            <given-names>D. G.</given-names>
          </string-name>
          (
          <year>2001</year>
          ) “
          <article-title>The benefits of layered evaluation of adaptive applications</article-title>
          and services”, In Weibelzahl, S.,
          <string-name>
            <surname>Chin</surname>
            ,
            <given-names>D. N.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Weber</surname>
            ,
            <given-names>G</given-names>
          </string-name>
          . (Eds.),
          <article-title>Empirical Evaluation of Adaptive Systems</article-title>
          . Proceedings of workshop at the Eighth International Conference on User Modeling,
          <source>UM2001</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          , Freiburg.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <given-names>Brusilovsky P.</given-names>
            ,
            <surname>Nejdl</surname>
          </string-name>
          <string-name>
            <surname>W.</surname>
          </string-name>
          , (
          <year>2004</year>
          )
          <article-title>“Adaptive Hypermedia and Adaptive Web”, Practical Handbook of Internet Computing</article-title>
          , CRC Press LLC, to be published.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Brusilovsky</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Henze</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Open Corpus Adaptive Educational Hypermedia</article-title>
          . In P. Brusilovsky,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kobsa</surname>
          </string-name>
          &amp; W. Nejdl (Eds.),
          <source>The Adaptive Web: Methods and Strategies of Web Personalization. (Lecture</source>
          Notes in Computer Science ed., Vol.
          <volume>4321</volume>
          , pp.
          <fpage>671</fpage>
          -
          <lpage>696</lpage>
          ). Berlin Heidelberg New York: Springer.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Burke</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1999</year>
          )
          <article-title>“Integrating Knowledge-based and Collaborative-filtering Recommender Systems”</article-title>
          ,
          <source>In: Proceedings AAAI-99 Workshop (AIEC99)</source>
          , Orlando, FL.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Burke R.</surname>
          </string-name>
          (
          <year>2002</year>
          )
          <article-title>“Hybrid Recommender Systems: Survey and Experiments”, User Modeling and User-</article-title>
          <source>Adapted Interaction</source>
          <volume>12</volume>
          :
          <fpage>331</fpage>
          -
          <lpage>370</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Chin</surname>
            ,
            <given-names>D. N.</given-names>
          </string-name>
          (
          <year>2001</year>
          ) “
          <article-title>Empirical evaluation of user models and user-adapted systems</article-title>
          .”,
          <string-name>
            <given-names>User</given-names>
            <surname>Modeling</surname>
          </string-name>
          and
          <string-name>
            <surname>User-Adapted</surname>
            <given-names>Interaction</given-names>
          </string-name>
          ,
          <volume>11</volume>
          (
          <issue>1-2</issue>
          ),
          <fpage>181</fpage>
          -
          <lpage>194</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Colley</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hodkinson</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Malcolm</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2002b</year>
          ).
          <article-title>non-formal learning: mapping the conceptual terrain</article-title>
          .
          <source>a consultation report [Electronic Version]. Retrieved</source>
          <volume>01</volume>
          .
          <fpage>05</fpage>
          .
          <year>2008</year>
          from http://www.infed.org/archives/e-texts/colley_informal_learning.htm.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Cristea</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Authoring of Adaptive Hypermedia</article-title>
          .
          <source>Educational Technology &amp; Society</source>
          ,
          <volume>8</volume>
          (
          <issue>3</issue>
          ),
          <fpage>6</fpage>
          -
          <lpage>8</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>De Bra</surname>
            ,
            <given-names>P. M. E.</given-names>
          </string-name>
          (
          <year>1996</year>
          ).
          <article-title>Teaching Hypertext and Hypermedia through the Web</article-title>
          .
          <source>Journal of Universal Computer Science</source>
          ,
          <volume>2</volume>
          (
          <issue>12</issue>
          ),
          <fpage>797</fpage>
          -
          <lpage>804</lpage>
          , available online at http://www.iicm.edu/jucs_2_12/teaching_hypertext_and_hypermedia.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>De Bra</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aerts</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smits</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Stash</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          (
          <year>2002</year>
          ).
          <source>AHA! Version 2</source>
          .0,
          <string-name>
            <given-names>More</given-names>
            <surname>Adaptation</surname>
          </string-name>
          Flexibility for Authors.
          <source>Paper presented at the conference World Conference on e-Learning in Corporate, Goverment, Healthcare &amp; Higher Education</source>
          .
          <fpage>15</fpage>
          -
          <issue>19</issue>
          <year>October 2002</year>
          , Montreal, Canada.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>De La Passardiere</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Dufresne</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>1992</year>
          ).
          <article-title>Adaptive navigational tools for educational hypermedia</article-title>
          . In I. Tomek (Ed.),
          <source>ICCAL'92</source>
          ,
          <fpage>4</fpage>
          -th
          <source>International Conference on Computers and Learning</source>
          (pp.
          <fpage>555</fpage>
          -
          <lpage>567</lpage>
          ). Berlin: Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Deshpande</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Karypis</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Selective Markov models for predicting Web page accesses</article-title>
          .
          <source>Transactions on Internet Technology (TOIT)</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ),
          <fpage>163</fpage>
          -
          <lpage>184</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <string-name>
            <surname>Dix</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finlay</surname>
            ,
            <given-names>J. E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abowd</surname>
            ,
            <given-names>G. D.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Beale</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1998</year>
          ).
          <article-title>Human-Computer Interaction</article-title>
          . Harlow, England: Prentice Hall.
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <given-names>Dolog P.</given-names>
            ,
            <surname>Henze</surname>
          </string-name>
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Nejdl</surname>
          </string-name>
          <string-name>
            <given-names>W.</given-names>
            , and
            <surname>Sintek</surname>
          </string-name>
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2003</year>
          )
          <article-title>“Towards the Adaptive Semantic Web”</article-title>
          .
          <source>1st Workshop on Principles and Practice of Semantic Web Reasoning (PPSWR'03)</source>
          ,
          <source>Dec. 8</source>
          ,
          <issue>2003</issue>
          , Mumbai, India.
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <string-name>
            <given-names>Drachsler H.</given-names>
            ,
            <surname>Hummel</surname>
          </string-name>
          <string-name>
            <given-names>H.G.K.</given-names>
            ,
            <surname>Koper</surname>
          </string-name>
          <string-name>
            <surname>R.</surname>
          </string-name>
          ,
          <article-title>"Recommendations for learners are different: Applying memory-based recommender system techniques to lifelong learning"</article-title>
          ,
          <source>in Proc. of the Workshop on Social Information Retrieval in Technology Enhanced Learning (SIRTEL</source>
          <year>2007</year>
          ), Crete, Greece,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <string-name>
            <surname>Drachsler</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hummel</surname>
            ,
            <given-names>H. G. K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Koper</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Personal recommender systems for learners in lifelong learning: requirements, techniques and model</article-title>
          .
          <source>International Journal of Learning Technology</source>
          ,
          <volume>3</volume>
          (
          <issue>4</issue>
          ),
          <fpage>404</fpage>
          -
          <lpage>423</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          <string-name>
            <surname>Drachsler</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hummel</surname>
            ,
            <given-names>H.G.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koper</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          :
          <article-title>Using Simulations to Evaluate the Effects of Recommender Systems for Learners in Informal Learning Networks.</article-title>
          . In: Vuorikari,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Kieslinger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Klamma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Duval</surname>
          </string-name>
          , E. (eds.):
          <article-title>SIRTEL workshop at the 3rd EC-TEL conference</article-title>
          .
          <source>CEUR Workshop Proceedings</source>
          VOL-
          <volume>382</volume>
          , Maastricht, The Netherlands.
          <article-title>(</article-title>
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          <string-name>
            <surname>Drachsler</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hummel</surname>
            ,
            <given-names>H. G. K.</given-names>
          </string-name>
          , Van den Berg,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Eshuis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Berlanga</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Nadolski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Waterink</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            ,
            <surname>Boers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            , &amp;
            <surname>Koper</surname>
          </string-name>
          ,
          <string-name>
            <surname>R.</surname>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Effects of the ISIS Recommender System for navigation support in self-organized learning networks</article-title>
          .
          <source>Journal of Educational Technology and Society.</source>
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          <string-name>
            <surname>Drachsler</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pecceu</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arts</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hutten</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rutledge</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Van Rosmalen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hummel</surname>
            ,
            <given-names>H.G.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koper</surname>
          </string-name>
          , R.:
          <article-title>ReMashed - Recommendations for Mash-Up Personal Learning Environments</article-title>
          . In: Cress,
          <string-name>
            <given-names>U.</given-names>
            ,
            <surname>Dimitrova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            ,
            <surname>Specht</surname>
          </string-name>
          , M. (eds.):
          <article-title>Learning in the Synergy of Multiple Disciplines</article-title>
          ,
          <source>EC-TEL 2009</source>
          Vol.
          <volume>5794</volume>
          . Springer Nice,
          <source>France (2009a)</source>
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          <string-name>
            <surname>Drachsler</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pecceu</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arts</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hutten</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rutledge</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Van Rosmalen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hummel</surname>
            ,
            <given-names>H.G.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koper</surname>
          </string-name>
          , R.:
          <article-title>ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning</article-title>
          .
          <source>1st Workshop on Mashups for Learning at the International Conference on Interactive Computer Aided Learning, Villach, Austria. (2009b)</source>
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          <string-name>
            <surname>Dron</surname>
            , J., Mitchell,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boyne</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Siviter</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2000a</year>
          ).
          <article-title>CoFIND: steps towards a self-organising learning environment</article-title>
          .
          <source>Proceedings of WebNet 2000</source>
          (pp.
          <fpage>146</fpage>
          -
          <lpage>151</lpage>
          ), San Antonio, Texas, USA: AACE.
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          <string-name>
            <surname>Dron</surname>
            , J., Mitchell,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Siviter</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Boyne</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2000b</year>
          ).
          <article-title>CoFIND-an experiment in n-dimensional collaborative filtering</article-title>
          .
          <source>Journal of Network and Computer Applications</source>
          ,
          <volume>23</volume>
          (
          <issue>2</issue>
          ),
          <fpage>131</fpage>
          -
          <lpage>142</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          <string-name>
            <given-names>Duval E.</given-names>
            ,
            <surname>Vuorikari</surname>
          </string-name>
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Manouselis</surname>
          </string-name>
          <string-name>
            <surname>N</surname>
          </string-name>
          . (Eds.),
          <article-title>Special Issue on Social Information Retrieval in Technology Enhanced Learning</article-title>
          ,
          <source>Journal of Digital Information (JoDI)</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          <string-name>
            <surname>Eklund</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>1999</year>
          )
          <article-title>“A Study of Adaptive Link Annotation in Educational Hypermedia”</article-title>
          ,
          <source>PhD thesis</source>
          , University of Sydney.
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          <string-name>
            <surname>Fiaidhi J.</surname>
          </string-name>
          , “
          <article-title>RecoSearch: A Model for Collaboratively Filtering Java Learning Objects”</article-title>
          ,
          <source>International Journal of Instructional Technology and Distance Learning</source>
          ,
          <volume>1</volume>
          (
          <issue>7</issue>
          ),
          <fpage>35</fpage>
          -
          <lpage>50</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          <string-name>
            <given-names>Foltz P.W.</given-names>
            , and
            <surname>Dumais S.T.</surname>
          </string-name>
          (
          <year>1992</year>
          ) “
          <article-title>Personalized information delivery: An analysis of information filtering methods”</article-title>
          ,
          <source>Communications of the ACM</source>
          ,
          <volume>35</volume>
          (
          <issue>12</issue>
          ):
          <fpage>51</fpage>
          -
          <lpage>60</lpage>
          ,
          <year>December 1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          <string-name>
            <surname>Gomez-Albarran</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jimenez-Diaz</surname>
            <given-names>G</given-names>
          </string-name>
          .,
          <article-title>“Recommendation and Students'Authoring in Repositories of Learning Objects: A Case-Based Reasoning Approach”</article-title>
          ,
          <source>International Journal of Emerging Technologies in Learning (iJET)</source>
          ,
          <volume>4</volume>
          (
          <issue>1</issue>
          ),
          <fpage>35</fpage>
          -
          <lpage>40</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          <string-name>
            <surname>Gordon</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          : Ants at Work:
          <article-title>How an Insect Society is Organized</article-title>
          . Free Press, New York (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          <string-name>
            <surname>Graham</surname>
          </string-name>
          (
          <year>2005</year>
          )
          <article-title>Blended learning systems: definitions, current trends and future directions</article-title>
          . In Bonk,
          <string-name>
            <given-names>C. J.</given-names>
            &amp;
            <surname>Graham</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          R. (Eds.)
          <article-title>Handbook of blended learning: Global Perspectives, local designs</article-title>
          . San Francisco, CA: Pfeiffer Publishing.
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          <string-name>
            <surname>Gonschorek</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Herzog</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>Using hypertext for an adaptive helpsystem in an intelligent tutoring system</article-title>
          .
          <source>In J. Greer (Eds.)</source>
          ,
          <source>Artificial Intelligence in Education, Proceedings of AIED'95, 7th World Conference on Artificial Intelligence in Education</source>
          ,
          <volume>16</volume>
          -
          <fpage>19</fpage>
          August
          <year>1995</year>
          . Washington, DC, AACE. - pp.
          <fpage>274</fpage>
          -
          <lpage>2</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          <string-name>
            <surname>Guttman</surname>
            ,
            <given-names>Robert H.</given-names>
          </string-name>
          (
          <year>1998</year>
          )
          <article-title>'Merchant Differentiation through Integrative Negotiation in Agentmediated Electronic Commerce'</article-title>
          .
          <source>Master's Thesis</source>
          , School of Architecture and Planning,
          <source>Program in Media Arts and Sciences</source>
          , Massachusetts Institute of Technology.
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          <string-name>
            <surname>Herlocker</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konstan</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Riedl</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <year>2002</year>
          .
          <article-title>An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms</article-title>
          .
          <source>Information Retrieval 5</source>
          ,
          <issue>4</issue>
          ,
          <fpage>287</fpage>
          -
          <lpage>310</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref46">
        <mixed-citation>
          <string-name>
            <given-names>Herlocker J.L.</given-names>
            ,
            <surname>Konstan</surname>
          </string-name>
          <string-name>
            <given-names>J.A.</given-names>
            ,
            <surname>Terveen</surname>
          </string-name>
          <string-name>
            <given-names>L.G.</given-names>
            ,
            <surname>Riedl</surname>
          </string-name>
          <string-name>
            <surname>J.T.</surname>
          </string-name>
          (
          <year>2004</year>
          )
          <article-title>“Evaluating Collaborative Filtering Recommender Systems”</article-title>
          ,
          <source>ACM Transactions on Information Systems</source>
          , Vol.
          <volume>22</volume>
          , No. 1,
          <string-name>
            <surname>January</surname>
            <given-names>2004</given-names>
          </string-name>
          , Pages 5-
          <fpage>53</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref47">
        <mixed-citation>
          <string-name>
            <surname>Hill</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stead</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosenstein</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Furnas</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>1995</year>
          )
          <article-title>'Recommending and evaluating choices in a virtual community of use'</article-title>
          .
          <source>In: CHI '95: Conference Proceedings on Human Factors in Computing Systems</source>
          , Denver, CO, pp.
          <fpage>194</fpage>
          -
          <lpage>201</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref48">
        <mixed-citation>
          <string-name>
            <surname>Hohl</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Böcker</surname>
          </string-name>
          , H.
          <string-name>
            <surname>-D.</surname>
          </string-name>
          , &amp;
          <string-name>
            <surname>Gunzenhäuser</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1996</year>
          ).
          <article-title>Hypadapter: An adaptive hypertext system for exploratory learning and programming</article-title>
          .
          <source>User Modeling</source>
          and
          <string-name>
            <surname>User-Adapted Interaction</surname>
          </string-name>
          ,
          <volume>6</volume>
          (
          <issue>2-3</issue>
          ),
          <fpage>131</fpage>
          -
          <lpage>156</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref49">
        <mixed-citation>
          <string-name>
            <surname>Hummel</surname>
            ,
            <given-names>H.G.K.</given-names>
          </string-name>
          , Van den Berg,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Berlanga</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.J.</given-names>
            ,
            <surname>Drachsler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Janssen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Nadolski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.J.</given-names>
            ,
            <surname>Koper</surname>
          </string-name>
          ,
          <string-name>
            <surname>E.J.R.</surname>
          </string-name>
          :
          <article-title>Combining Social- and Information-based Approaches for Personalised Recommendation on Sequencing Learning Activities</article-title>
          .
          <source>International Journal of Learning Technology</source>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref50">
        <mixed-citation>
          <string-name>
            <surname>Höök</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2000</year>
          ) “
          <article-title>Steps to take before intelligent user interfaces become real”</article-title>
          ,
          <source>Interacting With Computers</source>
          ,
          <volume>12</volume>
          (
          <issue>4</issue>
          ),
          <fpage>409</fpage>
          -
          <lpage>426</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref51">
        <mixed-citation>
          <string-name>
            <surname>Jameson</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2001</year>
          )
          <article-title>“Systems That Adapt to Their Users: An Integrative Perspective”</article-title>
          , Saarbrücken: Sarland University.
        </mixed-citation>
      </ref>
      <ref id="ref52">
        <mixed-citation>
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tattersall</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Waterink</surname>
          </string-name>
          , W., Van den Berg, B.,
          <string-name>
            <surname>Van</surname>
            <given-names>Es</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Bolman</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          , et al. (
          <year>2005</year>
          ).
          <article-title>Self-organising navigational support in lifelong learning: how predecessors can lead the way</article-title>
          .
          <source>Computers &amp; Education</source>
          ,
          <volume>49</volume>
          ,
          <fpage>781</fpage>
          -
          <lpage>793</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref53">
        <mixed-citation>
          <string-name>
            <surname>Johnson</surname>
          </string-name>
          , S.: Emergence. Scribner, New York (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref54">
        <mixed-citation>
          <string-name>
            <surname>Karagiannidis</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Sampson</surname>
            ,
            <given-names>D. G.</given-names>
          </string-name>
          (
          <year>2000</year>
          ) “
          <article-title>Layered evaluation of adaptive applications</article-title>
          and services”, In Brusilovsky, P. and
          <string-name>
            <surname>Stock</surname>
            ,
            <given-names>C. S. O</given-names>
          </string-name>
          . (Eds.),
          <source>Proceedings of International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, AH2000</source>
          , Trento, Italy, pages
          <fpage>343</fpage>
          -
          <lpage>346</lpage>
          . Berlin: Springer.
        </mixed-citation>
      </ref>
      <ref id="ref55">
        <mixed-citation>
          <string-name>
            <surname>Karampiperis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sampson</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Adaptive Learning Resources Sequencing in Educational Hypermedia Systems</article-title>
          .
          <source>Educational Technology &amp; Society</source>
          ,
          <volume>8</volume>
          (
          <issue>4</issue>
          ),
          <fpage>128</fpage>
          -
          <lpage>147</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref56">
        <mixed-citation>
          <string-name>
            <surname>Kay</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Kummerfeld</surname>
            ,
            <given-names>R. J.</given-names>
          </string-name>
          (
          <year>1994</year>
          ).
          <article-title>An individualised course for the C programming language</article-title>
          .
          <source>Proceedings of Second International WWW Conference</source>
          ,
          <volume>17</volume>
          -
          <fpage>20</fpage>
          October,
          <year>1994</year>
          . Chicago, USA
        </mixed-citation>
      </ref>
      <ref id="ref57">
        <mixed-citation>
          <string-name>
            <surname>Konstan</surname>
          </string-name>
          (Ed.) (
          <year>2004</year>
          )
          <article-title>Special Issue on 'Recommender Systems: Algorithms and Evaluation”</article-title>
          ,
          <source>ACM Transactions on Information Systems.</source>
        </mixed-citation>
      </ref>
      <ref id="ref58">
        <mixed-citation>
          <string-name>
            <surname>Koper</surname>
            ,
            <given-names>E.J.R.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Tattersall</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2004</year>
          ) '
          <article-title>New directions for lifelong learning using network technologies'</article-title>
          ,
          <source>British Journal of Educational Technology</source>
          , Vol.
          <volume>35</volume>
          , No.
          <issue>6</issue>
          , pp.
          <fpage>689</fpage>
          -
          <lpage>700</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref59">
        <mixed-citation>
          <string-name>
            <surname>Koper</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Increasing Learner Retention in a Simulated learning network using Indirect Social Interaction</article-title>
          .
          <source>Journal of Artificial Societies and Social Simulation</source>
          ,
          <volume>8</volume>
          (
          <issue>2</issue>
          ),
          <fpage>18</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref60">
        <mixed-citation>
          <string-name>
            <surname>Koper</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rusman</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sloep</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Effective Learning Networks</article-title>
          .
          <source>Lifelong Learning in Europe 1</source>
          ,
          <fpage>18</fpage>
          -
          <lpage>27</lpage>
          , (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref61">
        <mixed-citation>
          <string-name>
            <surname>Kravcik</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Specht</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Oppermann</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2004</year>
          ). Evaluation of WINDS Authoring Environment: Springer.
        </mixed-citation>
      </ref>
      <ref id="ref62">
        <mixed-citation>
          <string-name>
            <surname>Krulwich</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>1997</year>
          )
          <article-title>'Lifestyle Finder: Intelligent User Profiling Using Large-Scale Demographic Data'</article-title>
          .
          <source>Artificial Intelligence Magazine</source>
          <volume>18</volume>
          (
          <issue>2</issue>
          ),
          <fpage>37</fpage>
          -
          <lpage>45</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref63">
        <mixed-citation>
          <string-name>
            <surname>Kumar</surname>
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nesbit</surname>
            <given-names>J</given-names>
          </string-name>
          .,
          <string-name>
            <surname>Han</surname>
            <given-names>K.</given-names>
          </string-name>
          , “
          <article-title>Rating Learning Object Quality with Distributed Bayesian Belief Networks: The Why and the How”</article-title>
          ,
          <source>in Proc. of the Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05)</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref64">
        <mixed-citation>
          <string-name>
            <surname>Lemire</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Scale and Translation Invariant Collaborative Filtering Systems</article-title>
          .
          <source>Journal of Information Retrieval</source>
          ,
          <volume>8</volume>
          ,
          <issue>1</issue>
          ,pp
          <fpage>129</fpage>
          -
          <lpage>150</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref65">
        <mixed-citation>
          <string-name>
            <surname>Lemire</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boley</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGrath</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ball</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Collaborative Filtering and Inference Rules for Context-Aware Learning Object Recommendation</article-title>
          .
          <source>International Journal of Interactive Technology and Smart Education</source>
          ,
          <volume>2</volume>
          (
          <issue>3</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref66">
        <mixed-citation>
          <string-name>
            <surname>Liber</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnson</surname>
          </string-name>
          , M.:
          <article-title>Personal Learning Environments</article-title>
          .
          <source>Interactive Learning Environments</source>
          <volume>16</volume>
          (
          <year>2008</year>
          )
          <fpage>1</fpage>
          -
          <lpage>2</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref67">
        <mixed-citation>
          <string-name>
            <surname>Liber</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Colloquia - a conversation manager</article-title>
          .
          <source>Campus-Wide Information Systems</source>
          <volume>17</volume>
          (
          <year>2000</year>
          )
          <fpage>56</fpage>
          -
          <lpage>61</lpage>
          .Longworth,
          <string-name>
            <surname>N.</surname>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Lifelong learning in action - Transforming education in the 21st century</article-title>
          . London: Kogan Page.
        </mixed-citation>
      </ref>
      <ref id="ref68">
        <mixed-citation>
          <string-name>
            <surname>Longworth</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          :
          <article-title>Lifelong learning in action - Transforming education in the 21st century</article-title>
          .
          <source>Kogan Page</source>
          , London (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref69">
        <mixed-citation>
          <string-name>
            <given-names>Manouselis N.</given-names>
            ,
            <surname>Vuorikari</surname>
          </string-name>
          <string-name>
            <surname>R</surname>
          </string-name>
          .,
          <string-name>
            <surname>Van Assche F.</surname>
          </string-name>
          ,
          <article-title>"Simulated Analysis of MAUT Collaborative Filtering for Learning Object Recommendation"</article-title>
          ,
          <source>in Proc. of the Workshop on Social Information Retrieval in Technology Enhanced Learning (SIRTEL</source>
          <year>2007</year>
          ), Crete, Greece,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref70">
        <mixed-citation>
          <string-name>
            <surname>McCalla</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2004</year>
          ) '
          <article-title>The ecological approach to the design of e-learning environments: purposebased capture and use of information about learners'</article-title>
          ,
          <string-name>
            <surname>Electronic</surname>
            <given-names>Version</given-names>
          </string-name>
          ,
          <source>Journal of Interactive Media in Education</source>
          , Vol.
          <volume>7</volume>
        </mixed-citation>
      </ref>
      <ref id="ref71">
        <mixed-citation>
          <string-name>
            <surname>Moore J.D.</surname>
          </string-name>
          ,
          <string-name>
            <surname>Swartout</surname>
            <given-names>W.R.</given-names>
          </string-name>
          , (
          <year>1989</year>
          ) “
          <article-title>Pointing: A way toward explanation dialogue”</article-title>
          ,
          <source>In Eight National Conference on Artificial Intelligence</source>
          , pages
          <fpage>457</fpage>
          -
          <lpage>464</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref72">
        <mixed-citation>
          <string-name>
            <surname>Moore</surname>
            ,
            <given-names>M.G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Anderson</surname>
          </string-name>
          , W. E (Ed.) (
          <year>2003</year>
          ).
          <article-title>Handbook of distance education</article-title>
          . Mahwah, NJ: Lawrence Erlbaum
        </mixed-citation>
      </ref>
      <ref id="ref73">
        <mixed-citation>
          <string-name>
            <surname>Nadolski</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , Van den Berg,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Berlanga</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Drachsler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Hummel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Koper</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,&amp;
            <surname>Sloep</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.</surname>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Simulating light-weight Personalised Recommender Systems in learning networks: A case for Pedagogy-Oriented and Rating based Hybrid Recommendation Strategies</article-title>
          .
          <source>Journal of Artificial Societies and Social Simulation (JASSS).</source>
        </mixed-citation>
      </ref>
      <ref id="ref74">
        <mixed-citation>
          <string-name>
            <surname>O'Mahony</surname>
            ,
            <given-names>M. P.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Smyth</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>A recommender system for on-line course enrolment: an initial study</article-title>
          .
          <source>In Proceedings of the 2007 ACM Conference on Recommender Systems (Minneapolis</source>
          , MN, USA, October
          <volume>19</volume>
          -
          <issue>20</issue>
          ,
          <year>2007</year>
          ).
          <source>RecSys '07. ACM</source>
          , New York, NY,
          <fpage>133</fpage>
          -
          <lpage>136</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref75">
        <mixed-citation>
          <string-name>
            <surname>Oppermann</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1994</year>
          ) “
          <article-title>Adaptively supported adaptability”</article-title>
          ,
          <source>International Journal of Human Computer Studies</source>
          ,
          <volume>40</volume>
          (
          <issue>3</issue>
          ),
          <fpage>455</fpage>
          -
          <lpage>472</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref76">
        <mixed-citation>
          <string-name>
            <surname>Papagelis</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Plexousakis</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Kutsuras</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <year>2005</year>
          .
          <article-title>Alleviating the sparsity problem of collaborative filtering using trust inferences</article-title>
          .
          <source>In Proceedings of the 3rd International Conference on Trust Management. LNCS</source>
          . Springer-Verlag, Rocquencourt, France.
        </mixed-citation>
      </ref>
      <ref id="ref77">
        <mixed-citation>
          <string-name>
            <surname>Paramythis</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Totter</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Stephanidis</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2001</year>
          )
          <article-title>“A modular approach to the evaluation of adaptive user interfaces”</article-title>
          , In Weibelzahl, S.,
          <string-name>
            <surname>Chin</surname>
            ,
            <given-names>D. N.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Weber</surname>
            ,
            <given-names>G</given-names>
          </string-name>
          . (Eds.),
          <article-title>Empirical Evaluation of Adaptive Systems</article-title>
          . Proceedings of workshop at the Eighth International Conference on User Modeling,
          <source>UM2001</source>
          , pages
          <fpage>9</fpage>
          -
          <lpage>24</lpage>
          , Freiburg.
        </mixed-citation>
      </ref>
      <ref id="ref78">
        <mixed-citation>
          <string-name>
            <surname>Paris C</surname>
          </string-name>
          (
          <year>1988</year>
          ) “
          <article-title>Tailoring object description to a user's level of expertise”</article-title>
          ,
          <source>Computational Linguistics</source>
          ,
          <volume>14</volume>
          (
          <issue>3</issue>
          ):
          <fpage>64</fpage>
          -
          <lpage>78</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref79">
        <mixed-citation>
          <string-name>
            <surname>Pazzani</surname>
            ,
            <given-names>M. J.</given-names>
          </string-name>
          (
          <year>1999</year>
          )
          <article-title>'A Framework for Collaborative, Content-Based and Demographic Filtering'</article-title>
          .
          <source>Artificial Intelligence Review</source>
          ,
          <volume>13</volume>
          (
          <issue>5</issue>
          /6),
          <fpage>393</fpage>
          -
          <lpage>408</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref80">
        <mixed-citation>
          <string-name>
            <surname>Pérez</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gutiérrez</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lopistéguy</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>An adaptive hypermedia system</article-title>
          .
          <source>In J. Greer (Eds.)</source>
          ,
          <source>Artificial Intelligence in Education, Proceedings of AI-ED'95, 7th World Conference on Artificial Intelligence in Education</source>
          ,
          <volume>16</volume>
          -
          <fpage>19</fpage>
          August
          <year>1995</year>
          . Washington, DC, AACE. - pp.
          <fpage>351</fpage>
          -
          <lpage>358</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref81">
        <mixed-citation>
          <string-name>
            <surname>Rafaeli</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barak</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dan-Gur</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Toch</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>QSIA: a web-based environment for learning, assessing and knowledge sharing in communities</article-title>
          .
          <source>Computers &amp; Education</source>
          ,
          <volume>43</volume>
          (
          <issue>3</issue>
          ),
          <fpage>273</fpage>
          -
          <lpage>289</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref82">
        <mixed-citation>
          <string-name>
            <surname>Rafaeli</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dan-Gur</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Barak</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Social Recommender Systems: Recommendations in Support of E-Learning</article-title>
          .
          <source>International Journal of Distance Education Technologies</source>
          ,
          <volume>3</volume>
          (
          <issue>2</issue>
          ),
          <fpage>29</fpage>
          -
          <lpage>45</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref83">
        <mixed-citation>
          <string-name>
            <surname>Recker</surname>
            <given-names>M.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wiley D.A.</surname>
          </string-name>
          ,
          <article-title>“A non-authoritative educational metadata ontology for filtering and recommending learning objects”</article-title>
          ,
          <source>Journal of Interactive Learning Environments</source>
          ,
          <volume>9</volume>
          (
          <issue>3</issue>
          ),
          <fpage>255</fpage>
          -
          <lpage>271</lpage>
          ,
          <year>December 2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref84">
        <mixed-citation>
          <string-name>
            <surname>Recker</surname>
            <given-names>M.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wiley D.A.</surname>
          </string-name>
          ,
          <article-title>“An interface for collaborative filtering of educational resources”</article-title>
          ,
          <source>in Proc. of the 2000 International Conference on Artificial Intelligence</source>
          , Las Vegas, USA,
          <fpage>26</fpage>
          -
          <lpage>29</lpage>
          June 2000.
        </mixed-citation>
      </ref>
      <ref id="ref85">
        <mixed-citation>
          <string-name>
            <surname>Recker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walker</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , “
          <article-title>Supporting 'word-of-mouth' social networks via collaborative information filtering”</article-title>
          ,
          <source>Journal of Interactive Learning Research</source>
          ,
          <volume>14</volume>
          (
          <issue>1</issue>
          ), pp.
          <fpage>79</fpage>
          -
          <lpage>98</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref86">
        <mixed-citation>
          <string-name>
            <surname>Recker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walker</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lawless</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , “
          <article-title>What do you recommend? Implementation and analyses of collaborative filtering of Web resources for education”</article-title>
          ,
          <source>Instructional Science</source>
          ,
          <volume>31</volume>
          (
          <issue>4</issue>
          /5),
          <fpage>229</fpage>
          -
          <lpage>316</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref87">
        <mixed-citation>
          <string-name>
            <surname>Resnick</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Varian</surname>
            ,
            <given-names>H. R.</given-names>
          </string-name>
          (
          <year>1997</year>
          )
          <article-title>“Recommender Systems”</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>40</volume>
          (
          <issue>3</issue>
          ),
          <fpage>56</fpage>
          -
          <lpage>58</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref88">
        <mixed-citation>
          <string-name>
            <surname>Resnick</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Iacovou</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Suchak</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bergstrom</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Riedl</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>1994</year>
          )
          <article-title>'GroupLens: An Open Architecture for Collaborative Filtering of Netnews'</article-title>
          .
          <source>In: Proceedings of the Conference on Computer Supported Cooperative Work</source>
          , Chapel Hill, NC, pp.
          <fpage>175</fpage>
          -
          <lpage>186</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref89">
        <mixed-citation>
          <string-name>
            <surname>Rich</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>1979</year>
          )
          <article-title>'User Modeling via Stereotypes'</article-title>
          .
          <source>Cognitive Science</source>
          <volume>3</volume>
          ,
          <fpage>329</fpage>
          -
          <lpage>354</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref90">
        <mixed-citation>
          <string-name>
            <surname>Santos O.C.</surname>
          </string-name>
          , “
          <article-title>A recommender system to provide adaptive and inclusive standard-based support along the elearning life cycle”</article-title>
          ,
          <source>in Proc. of the 2008 ACM Conference on Recommender Systems</source>
          ,
          <volume>319</volume>
          -
          <fpage>322</fpage>
          , Lausanne, Switzerland,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref91">
        <mixed-citation>
          <string-name>
            <surname>Schafer</surname>
            ,
            <given-names>J. B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konstan</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Riedl</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>1999</year>
          )
          <article-title>“Recommender Systems in E-Commerce”</article-title>
          .
          <source>In: EC '99: Proceedings of the First ACM Conference on Electronic Commerce</source>
          , Denver, CO, pp.
          <fpage>158</fpage>
          -
          <lpage>166</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref92">
        <mixed-citation>
          <string-name>
            <surname>Schmitt</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Bergmann</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1999</year>
          )
          <article-title>'Applying case-based reasoning technology for product selection and customization in electronic commerce environments.' 12th Bled Electronic Commerce Conference</article-title>
          . Bled, Slovenia, June 7-9,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref93">
        <mixed-citation>
          <string-name>
            <surname>Schneider-Hufschmidt</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuhme</surname>
            <given-names>T.</given-names>
          </string-name>
          , and Malinowski U. (eds.) (
          <year>1993</year>
          )
          <article-title>“Adaptive user interfaces: Principles and practice”</article-title>
          .
          <source>Human Factors in Information Technology. North-Holland, Amsterdam.</source>
        </mixed-citation>
      </ref>
      <ref id="ref94">
        <mixed-citation>
          <string-name>
            <surname>Schwab</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kobsa</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Koychev</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          (
          <year>2001</year>
          )
          <article-title>'Learning User Interests through PositiveExamples Using Content Analysis and Collaborative Filtering'</article-title>
          .
          <source>Internal Memo</source>
          ,
          <string-name>
            <surname>GMD</surname>
          </string-name>
          , St. Augustin, Germany.
        </mixed-citation>
      </ref>
      <ref id="ref95">
        <mixed-citation>
          <string-name>
            <surname>Shardanand</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Maes</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>1995</year>
          ) '
          <article-title>Social Information Filtering: Algorithms for Automating ''Word ofMouth'' '</article-title>
          .
          <source>In: CHI '95: Conference Proceedings on Human Factors in ComputingSystems</source>
          , Denver, CO, pp.
          <fpage>210</fpage>
          -
          <lpage>217</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref96">
        <mixed-citation>
          <string-name>
            <given-names>Shen L.</given-names>
            ,
            <surname>Shen</surname>
          </string-name>
          <string-name>
            <surname>R.</surname>
          </string-name>
          ,
          <source>“Learning Content Recommendation Service based on Simple Sequencing Specification”</source>
          , in Liu W. et al., (Eds.),
          <source>ICWL</source>
          <year>2004</year>
          , LNCS
          <volume>3143</volume>
          ,
          <fpage>363</fpage>
          -
          <lpage>370</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref97">
        <mixed-citation>
          <string-name>
            <surname>Shuell</surname>
            ,
            <given-names>T. J.</given-names>
          </string-name>
          (
          <year>1992</year>
          ).
          <article-title>Designing instructional computing systems for meaningfullearning</article-title>
          . In M.Jones &amp;
          <string-name>
            <surname>P.H.Winne</surname>
          </string-name>
          (Eds.),
          <article-title>Adaptive learning environments</article-title>
          (pp.
          <fpage>19</fpage>
          -
          <lpage>54</lpage>
          ): Berlin: SpringerVerlag.
        </mixed-citation>
      </ref>
      <ref id="ref98">
        <mixed-citation>
          <string-name>
            <surname>Surowiecki</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>The wisdom of crowds: why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations</article-title>
          . Anchor New York (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref99">
        <mixed-citation>
          <string-name>
            <surname>Tang</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCalla</surname>
            <given-names>G</given-names>
          </string-name>
          . “
          <article-title>Smart Recommendation for an Evolving E-Learning System”</article-title>
          ,
          <source>in Proc. of the Workshop on Technologies for Electronic Documents for Supporting Learning, International Conference on Artificial Intelligence in Education (AIED</source>
          <year>2003</year>
          ), Sydney, Australia,
          <source>July 20-24</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref100">
        <mixed-citation>
          <string-name>
            <surname>Tang</surname>
            <given-names>T.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCalla</surname>
            <given-names>G.I.</given-names>
          </string-name>
          , “Beyond Learners'
          <article-title>Interest: Personalized Paper Recommendation Based on Their Pedagogical Features for an E-Learning System”</article-title>
          ,
          <source>in Proc. of the 8th Pacific Rim International Conference on Artificial Intelligence (PRICAI</source>
          <year>2004</year>
          ), Auckland, New Zealand,
          <source>August</source>
          <volume>9</volume>
          -
          <issue>13</issue>
          ,
          <year>2004b</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref101">
        <mixed-citation>
          <string-name>
            <surname>Tang</surname>
            <given-names>T.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCalla</surname>
            <given-names>G.I.</given-names>
          </string-name>
          , “
          <article-title>On the Pedagogically Guided Paper Recommendation for an Evolving Web-Based Learning System”</article-title>
          ,
          <source>in Proc. of the 17th International FLAIRS Conference</source>
          , Miami Beach, Florida, May
          <volume>17</volume>
          -
          <issue>19</issue>
          ,
          <year>2004a</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref102">
        <mixed-citation>
          <string-name>
            <surname>Tang</surname>
            <given-names>T.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCalla</surname>
            <given-names>G.I.</given-names>
          </string-name>
          , “
          <article-title>Smart Recommendation for an Evolving E-Learning System: Architecture and Experiment”</article-title>
          ,
          <source>International Journal on E-Learning</source>
          ,
          <volume>4</volume>
          (
          <issue>1</issue>
          ),
          <fpage>105</fpage>
          -
          <lpage>129</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref103">
        <mixed-citation>
          <string-name>
            <surname>Tang</surname>
            <given-names>T.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCalla</surname>
            <given-names>G.I.</given-names>
          </string-name>
          , “
          <article-title>Utilizing Artificial Learner on the Cold-Start Pedagogical-Value based Paper Recommendation”</article-title>
          ,
          <source>in Proc. of AH 2004: International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, Eindhoven, The Netherlands, August</source>
          <volume>23</volume>
          -
          <issue>26</issue>
          ,
          <year>2004c</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref104">
        <mixed-citation>
          <string-name>
            <surname>Terveen</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Hill</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          (
          <year>2001</year>
          ) '
          <article-title>Human-Computer Collaboration in Recommender Systems'</article-title>
          . In: J.
          <string-name>
            <surname>Carroll</surname>
          </string-name>
          (ed.):
          <article-title>Human Computer Interaction in the New Millenium</article-title>
          . New York: AddisonWesley,
          <fpage>487</fpage>
          -
          <lpage>509</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref105">
        <mixed-citation>
          <string-name>
            <surname>Totterdell</surname>
            ,
            <given-names>P. A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Boyle</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>1990</year>
          ) “
          <article-title>The evaluation of adaptive systems”</article-title>
          , In Browne, D.,
          <string-name>
            <surname>Totterdell</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Norman</surname>
          </string-name>
          , M. (Eds.),
          <source>Adaptive User Interfaces</source>
          , pages
          <fpage>161</fpage>
          -
          <lpage>194</lpage>
          . London: Academic Press.
        </mixed-citation>
      </ref>
      <ref id="ref106">
        <mixed-citation>
          <string-name>
            <surname>Towle</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Quinn</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2000</year>
          )
          <article-title>'Knowledge Based Recommender Systems Using Explicit User Models'</article-title>
          .
          <source>In Knowledge-Based Electronic Markets, Papers from the AAAI Workshop, AAAI Technical Report WS-00-04</source>
          . pp.
          <fpage>74</fpage>
          -
          <lpage>77</lpage>
          . Menlo Park, CA: AAAI Press.
        </mixed-citation>
      </ref>
      <ref id="ref107">
        <mixed-citation>
          <string-name>
            <surname>Tsai K.H.</surname>
          </string-name>
          ,
          <string-name>
            <surname>Chiu</surname>
            <given-names>T.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            <given-names>M.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            <given-names>T.I.</given-names>
          </string-name>
          ,
          <article-title>“A Learning Objects Recommendation Model based on the Preference and Ontological Approaches”</article-title>
          ,
          <source>in Proc. Of of the 6th International Conference on Advanced Learnrning Technologies (ICALT'06)</source>
          , IEEE Computer Society, Los Alamitos, California,IEEE Computer Society Press,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref108">
        <mixed-citation>
          <string-name>
            <given-names>Tzikopoulos A.</given-names>
            ,
            <surname>Manouselis</surname>
          </string-name>
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Vuorikari</surname>
          </string-name>
          <string-name>
            <surname>R.</surname>
          </string-name>
          ,
          <article-title>"An Overview of Learning Object Repositories"</article-title>
          , in P. Northrup (Ed.)
          <article-title>Learning Objects for Instruction: Design and Evaluation, Hershey</article-title>
          , PA: Idea Group Publishing,
          <fpage>29</fpage>
          -
          <lpage>55</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref109">
        <mixed-citation>
          <string-name>
            <surname>van Bruggen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sloep</surname>
            ,
            <given-names>P.</given-names>
            , van Rosmalen, P.
          </string-name>
          ,
          <string-name>
            <surname>Brouns</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vogten</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koper</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Tattersall</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Latent semantic analysis as a tool for learner positioning in learning networks for lifelong learning</article-title>
          .
          <volume>35</volume>
          (
          <issue>6</issue>
          ),
          <fpage>729</fpage>
          -
          <lpage>738</lpage>
          .Van Setten,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2005</year>
          ) '
          <article-title>Supporting people in finding information</article-title>
          .
          <source>Hybrid recommender systems and goal-based structuring'</source>
          , Telematica Instituut Fundamental Research Series No.
          <volume>016</volume>
          (TI/FRS/016), Enschede, The Netherlands.
        </mixed-citation>
      </ref>
      <ref id="ref110">
        <mixed-citation>
          <string-name>
            <given-names>Vuorikari R.</given-names>
            ,
            <surname>Kieslinger</surname>
          </string-name>
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Klamma</surname>
          </string-name>
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Duval</surname>
          </string-name>
          <string-name>
            <surname>E.</surname>
          </string-name>
          ,
          <source>Proc. of the Workshop on Social Information Retrieval in Technology Enhanced Learning (SIRTEL</source>
          <year>2008</year>
          ), http://ariadne.cs.kuleuven.be/sirtel/.
        </mixed-citation>
      </ref>
      <ref id="ref111">
        <mixed-citation>
          <string-name>
            <given-names>Vuorikari R.</given-names>
            ,
            <surname>Manouselis</surname>
          </string-name>
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Duval</surname>
          </string-name>
          <string-name>
            <surname>E.</surname>
          </string-name>
          ,
          <source>Proc. of the Workshop on Social Information Retrieval in Technology Enhanced Learning (SIRTEL</source>
          <year>2007</year>
          ), http://infolab-dev.aua.gr/sirtel2007/.
        </mixed-citation>
      </ref>
      <ref id="ref112">
        <mixed-citation>
          <string-name>
            <surname>Vuorikari</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Berendt</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <article-title>Study on contexts in tracking usage and attention metadata in multilingual Technology Enhanced Learning</article-title>
          . In S. Fischer,
          <string-name>
            <surname>E. Maehle,</surname>
          </string-name>
          &amp; R. Reischuk (Eds.),
          <source>Im Focus das Leben, Lecture Notes in Informatics (LNI)</source>
          , Vol.
          <volume>154</volume>
          . pp.
          <volume>181</volume>
          ,
          <fpage>1654</fpage>
          -
          <lpage>1663</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref113">
        <mixed-citation>
          <string-name>
            <surname>Vuorikari</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Koper</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>Ecology of social search for learning resources</article-title>
          .
          <source>Campus-Wide Information Systems</source>
          ,
          <volume>26</volume>
          (
          <issue>4</issue>
          ),
          <fpage>272</fpage>
          -
          <lpage>286</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref114">
        <mixed-citation>
          <string-name>
            <surname>Vuorikari</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ochoa</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          <article-title>Exploratory Analysis of the Main Characteristics of Tags and Tagging of Educational Resources in a Multi-lingual Context</article-title>
          .
          <source>In Journal of Digital Information</source>
          , Vol
          <volume>10</volume>
          , No 2,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref115">
        <mixed-citation>
          <string-name>
            <surname>Vygotsky</surname>
            ,
            <given-names>L. S.</given-names>
          </string-name>
          (
          <year>1978</year>
          ). Mind in Society: The Development of Higher Psychological Processes: Harvard University Press.
        </mixed-citation>
      </ref>
      <ref id="ref116">
        <mixed-citation>
          <string-name>
            <surname>Waldrop</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Complexity: The Emerging Science at the Edge of Chaos</article-title>
          . Simon &amp; Schuster, New York (
          <year>1992</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref117">
        <mixed-citation>
          <string-name>
            <surname>Walker</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Recker</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lawless</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , Wiley, D., “
          <article-title>Collaborative information filtering: A review and an educational application”</article-title>
          ,
          <source>International Journal of Artificial Intelligence and Education</source>
          ,
          <volume>14</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>26</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref118">
        <mixed-citation>
          <string-name>
            <surname>Wasserman</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Faust</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>1999</year>
          ).
          <article-title>Social Network Analysis: methods</article-title>
          and applications: Cambridge University Press.
        </mixed-citation>
      </ref>
      <ref id="ref119">
        <mixed-citation>
          <string-name>
            <surname>Weibelzahl</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2001</year>
          )
          <article-title>“Evaluation of adaptive systems”</article-title>
          , In Bauer,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Gmytrasiewicz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. J.</given-names>
            , and
            <surname>Vassileva</surname>
          </string-name>
          ,
          <string-name>
            <surname>J</surname>
          </string-name>
          . (Eds.), User Modeling: Proceedings of the Eighth International Conference, UM2001, pages
          <fpage>292</fpage>
          -
          <lpage>294</lpage>
          . Berlin: Springer.
        </mixed-citation>
      </ref>
      <ref id="ref120">
        <mixed-citation>
          <string-name>
            <surname>Weibelzahl</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2003</year>
          )
          <article-title>“Evaluation of Adaptive Systems</article-title>
          ”
          <source>PhD Dissertation</source>
          . University of Trier, Germany.
        </mixed-citation>
      </ref>
      <ref id="ref121">
        <mixed-citation>
          <string-name>
            <surname>Weibelzahl</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Weber</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2001</year>
          )
          <article-title>“A database of empirical evaluations of adaptive systems”</article-title>
          , In Klinkenberg, R.,
          <string-name>
            <surname>Rüping</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fick</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Henze</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herzog</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Molitor</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Schröder</surname>
            ,
            <given-names>O</given-names>
          </string-name>
          . (Eds.),
          <source>Proceedings of Workshop</source>
          Lernen - Lehren
          <string-name>
            <surname>-</surname>
          </string-name>
          Wissen - Adaptivität
          <source>(LLWA 01); research report in computer science nr. 763</source>
          , pages
          <fpage>302</fpage>
          -
          <lpage>306</lpage>
          . University of Dortmund.
        </mixed-citation>
      </ref>
      <ref id="ref122">
        <mixed-citation>
          <string-name>
            <surname>Weibelzahl</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Paramythis</surname>
            <given-names>A</given-names>
          </string-name>
          . (Eds.) (
          <year>2003</year>
          ) 2nd Workshop on “
          <article-title>Empirical Evaluation of Adaptive Systems”</article-title>
          , International Conference on User Modeling, UM2003, Johnstown.
        </mixed-citation>
      </ref>
      <ref id="ref123">
        <mixed-citation>
          <string-name>
            <surname>Weibelzahl</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chin</surname>
            ,
            <given-names>D. N.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Weber</surname>
            ,
            <given-names>G</given-names>
          </string-name>
          . (Eds.) (
          <year>2001</year>
          ) 1st Workshop on “
          <article-title>Empirical Evaluation of Adaptive Systems”</article-title>
          , Workshop at the Eighth International Conference on User Modeling, UM2001, Freiburg.
        </mixed-citation>
      </ref>
      <ref id="ref124">
        <mixed-citation>
          <string-name>
            <surname>Weibelzahl</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paramythis</surname>
            <given-names>A</given-names>
          </string-name>
          and
          <string-name>
            <surname>Totter</surname>
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2003</year>
          )
          <article-title>“A Layered Framework for the Evaluation of Interactive Adaptive Systems”</article-title>
          , 2nd Workshop on “
          <article-title>Empirical Evaluation of Adaptive Systems”</article-title>
          , International Conference on User Modeling, UM2003, Johnstown.
        </mixed-citation>
      </ref>
      <ref id="ref125">
        <mixed-citation>
          <string-name>
            <surname>Wild</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moedritscher</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sigurdarson</surname>
            ,
            <given-names>S.E.</given-names>
          </string-name>
          :
          <article-title>Designing for Change: Mash-Up Personal Learning Environments</article-title>
          .
          <source>eLearning Papers</source>
          <volume>9</volume>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref126">
        <mixed-citation>
          <string-name>
            <surname>Wilson</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sharples</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Griffith</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Distributing education services to personal and institutional systems using Widgets In: Wild</article-title>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Kalz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Palmer</surname>
          </string-name>
          , M. (eds.):
          <article-title>Mash-Up Personal Learning Environments</article-title>
          ,
          <source>Proceedings of teh 1st MUPPLE workshop</source>
          , Vol. VOL-
          <volume>388</volume>
          . CEURProceedings, Maastricht, The
          <string-name>
            <surname>Netherlands</surname>
          </string-name>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref127">
        <mixed-citation>
          <string-name>
            <surname>Worthen</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sanders</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Fitzpatrick</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>1997</year>
          ).
          <article-title>Program Evaluation (2nd ed</article-title>
          .). New York: Longman.
        </mixed-citation>
      </ref>
      <ref id="ref128">
        <mixed-citation>
          <string-name>
            <surname>Yan</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Garcia-Molina</surname>
            <given-names>H</given-names>
          </string-name>
          . (
          <year>1995</year>
          )
          <article-title>“SIFT: A tool for wide-area information dissemination”</article-title>
          ,
          <source>In Proceedings of the USENIX 1995 Winter Technical Conference</source>
          , pages
          <fpage>177</fpage>
          -
          <lpage>186</lpage>
          , New Orleans, Louisiana. Berkeley, CA: USENIX Assoc.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>