<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Enhanced Collaborative Filtering to Recommender Systems of Technology Enhanced Learning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Majda Maâtallah</string-name>
          <email>majda.maatallah@univ-annaba.org</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hassina Seridi-Bouchelaghem</string-name>
          <email>seridi@labged.net</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>LABGED Laboratory, University Badji Mokhtar Annaba</institution>
          ,
          <addr-line>Po-Box 12, 23000</addr-line>
          ,
          <country country="DZ">Algeria</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2012</year>
      </pub-date>
      <fpage>129</fpage>
      <lpage>138</lpage>
      <abstract>
        <p>Recommender Systems (RSs) are largely used nowadays in many areas to generate items of interest to users. Recently, they are applied in the Technology Enhanced Learning (TEL) field to let recommending relevant learning resources to support teachers or learners' need. In this paper we propose a novel recommendation technique that combines a fuzzy collaborative filtering algorithm with content based one to make better recommendation, using learners' preferences and importance of knowledge to recommend items with different context in order to alleviate the Stability vs. Plasticity problem of TEL Recommender Systems. Empirical evaluations show that the proposed technique is feasible and effective.</p>
      </abstract>
      <kwd-group>
        <kwd>Technology-Enhanced Learning</kwd>
        <kwd>Recommender Systems</kwd>
        <kwd>Collaborative Filtering</kwd>
        <kwd>Content Based Filtering</kwd>
        <kwd>Learner Profile</kwd>
        <kwd>Fuzzy C-means</kwd>
        <kwd>Matrix Factorization</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Web development has created a need for new techniques to help users find what
they want and also to know that information exists, these techniques are called
Recommender Systems (RSs). These systems are built generally based on two different
types of methods that are Content Based Filtering (CBF) and Collaborative Filtering
(CF). RSs suffer from several problems defined in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], where one of them is the
problem of the system’s stability compared to the user’s profile dynamicity (Dynamicity
vs. Plasticity Problem) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. This problem comes from the system’s incapability to
track the user’s behavioral evolution, because in RSs once a user’s profile has been
established, it is difficult to change it. RSs are widely used in many areas, especially
in e-commerce [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]and[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Recently, they are applied in the e-learning field, more
specifically in Technology Enhanced Learning (TEL) [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], in order to personalize
learning content and connect suitable learners with each other according to their
individual needs, preferences, and learning goals.
      </p>
      <p>TEL can be differentiated into formal and non-formal learning settings. In
nonformal learning, the learners are acting more self-directed and they are responsible for
their own learning. The learning process is not designed by an institution or
responsible teachers like in formal learning, but it depends on individual learners’ preferences
or choices, which is similar to consumers looking for products on the internet. So,
lifelong learners are need to have an overview of the available learning activities and
materials to decide which of them match better their personal needs, preferences,
prior knowledge and current situation. Where the need to use Personalized
Recommender Systems (PRS) that use efficiently the available resources in the network and
propose learning resources and activities depending on individual needs, learning
goals, context, and increase collaboration between learners. But the learner’s need and
preferences may change over period of time, also in the same time where he wants to
learn from resources with different context. This creates the need of designing
Adaptive RSs (ARS) capable of generating recommendations with different tastes
depending on the learner’s profile evolution. ARSs design is a great challenge because of the
Stability vs. Plasticity problem of these systems.</p>
      <p>
        Whereas recommendations in TEL field depend not only to learner’s preferences
but on the context as demonstrated in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]; this makes more and more important the
use of CBF in the recommendation process. To this end, we elaborate a hybrid
technique that combines between a fuzzy-based CF algorithm and CBF using taxonomic
information to generate multi-context recommendations with better performance.
      </p>
      <p>The paper is organized as follows. Section two, presents the RSs field and the third
section, contains some works deployed RSs in the TEL field. Then, we outline our
proposed fuzzy hybrid technique to recommend learning resources with different
tastes, in section four. Empirical results are presented in the fifth section. Finally, we
give some conclusions and lines of future work.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Recommender Systems</title>
      <p>
        RSs provide adequate information to people in need using a representation of the
user called "User Profile". This profile is compared with different profiles available to
determine those to which they correspond [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. So, RSs intend to send from a
large amount of information generated dynamically, the information judged relevant.
Hence, filtering is interpreted as elimination of unwanted data on an incoming
stream, rather than looking for specific data on this flow.
      </p>
      <p>
        RSs are built generally based on two different types of methods that are Content
Based Filtering (CBF) and Collaborative Filtering (CF). The CBF approach
generates content recommendations based on the characteristics of users or items, while the
CF method just use the evaluations made by users on the items to predict
the unknown ratings of new user-item pair. Typical CF algorithms can be categorized
into two classes: neighborhood methods and factorization methods. Generally
factorbased algorithms are considered more effective than those based on neighborhood.
But they are often complementary and the best performance is often obtained by
blending them [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Hybridization between CF and CBF approaches has been the
subject of interest in a lot of works on RSs, to enjoy their benefits.
      </p>
      <p>
        One of the major problems of RSs is the Stability problem of these systems
compared to the dynamic profile of the user (Stability vs. Plasticity Problem) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. To
overcome this problem, we proposed a hybrid approach that combines between
the CB approach that uses taxonomic information to represent the item’s content and
collaborative approach that uses preferences of similar learners (neighbors) to predict
the active learner’s preferences, then, generating diversified recommendations that
meet their needs according to his membership degrees to different clusters. These
membership values can be obtained in the CF phase by applying the Fuzzy Logic [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ],
or by applying the Fuzzy C-means algorithm (FCM) [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>
        In order to offer all needs of the active learner that fit their different tastes, we
propose a fuzzy based clustering algorithm to regroup learners including the active
learner, and that guarantees a multi-affectation of learners to nearest clusters allowing them
to receive partial recommendations generated in each cluster according to their
membership degrees. Due to the two major challenges for the CF based systems, which are
the Scalability and Sparcity Problems, the application of traditional FCM algorithm
can confront some difficulties. From this point, our goal was to design an efficient CF
algorithm that guarantee a multiple assignment of a user to different clusters, by
modifying the FCM objective function to a Matrix Factorization (MF) one[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Background</title>
      <p>
        Many RSs have been deployed in TEL, as surveyed in Manouselis and al.[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], for
recommending learning materials and resources to the learners in both formal and
informal learning environment[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Concretely, Garc’ıa and al.[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] uses association
rule in the form of IF-THEN rules to discover information of interest through student
performance data, then generating the recommendation based on those rules;
Bobadilla and al.[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] had using a CF scheme where they incorporated learners’ test score into
the item prediction function; Soonthornphisaj and al.[
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] applied CF to predict the
most suitable learning objects to the learners; Ge and al.[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] have combined between
CBF and CF to make personalized recommendation for a courseware selection
module. Finally, Thay-Nghe and al.[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]applied the MF technique in the educational
context, for predicting student performances. A critical study of recommender techniques
regarding to their applicability and usefulness in TEL has presented in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], providing
an overview of advantages and disadvantages of each technique, and report the
envisaged usefulness of each one for TEL recommenders. For more details on TEL
Recommender Systems please refer to [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>Generally RSs in e-learning deal with information about the learners and learning
activities and would be able to track the evolution of the learner profile (behavior)
during his different learning levels. For this aim, we propose a new hybrid technique
that combines CF (using MF) with CBF to better predict the learner’s need. The
proposed technique allows generating learning resources recommendations to lifelong
learners that correspond to their different interests, tracking their profiles evolution.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Contribution</title>
      <p>To improve the recommendation quality, we are conducted toward hybridization
between CF and a CBF to enhance the CF accuracy in TEL Recommender Systems in
order to deal with the sparcity and scalability problems.</p>
      <p>Our proposed approach can be divided into two main phases; the first one contains
the description of the fuzzy-based CF algorithm and the CBF one, with their messing
scores predictions. Then, it presents the hybrid scheme that blends the two predictions
in order to obtain a full learner-course matrix. The second phase contains the
recommendation algorithm adapted to TEL field by incorporating the learner’s
performances in order to generate effective recommendations.
4.1</p>
      <sec id="sec-4-1">
        <title>Environment description</title>
        <p>( ,</p>
        <p>The universe of discourse considered in our system is based on pair-wise
relationships between two types of entities u and t, which we call “user” and “item”, or
“learner” and “course”, respectively. We envision a world with:
─ A set of learners U = { , , …… }; - A set of courses C = { , , …, }.
─ Each item is described by a set of descriptors D(t)= {d1,d2, ..,dn} such that |D (t)|≥1.</p>
        <p>A taxonomic descriptor d is an ordered sequence of topics p denoted by d = {p0,
p1,…pq} where d ⊆ D(c), c ⊆ C. The topics within a descriptor are sequenced so
that the former topics are super topics of the latter topics, when the super topic
covers the general term of the domain and sub-topic covers a more specific term.
─ , The evaluation of course c made by learner u. All evaluations made by the
learner u form a vector , that represents his profile. The evaluation matrix is R.
─ , The probability that learner u belongs to cluster k; Z= ( , is the probability
matrix U × K, where U, K are number of learners and clusters, respectively.
─ , The average of evaluations made by members of cluster k to item t, and C =
is the matrix of centroïds K × T, where T is the number of items.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>The Fuzzy-based Collaborative Filtering algorithm</title>
        <p>
          As mentioned above, this part contains our novel CF algorithm description. From
the literature survey on the CF algorithms, we have the main steps of our algorithm:
─ First, the automatic construction of groups in the system from the evaluation
matrix using the Non-Negative Matrix Factorization (NNMF) method. The reason
behind this choice and use of this method, is the reduction of the scalability
problem that occurs when adding a new user or a new item
─ In addition, the resulting probability matrix can be used to process data to
solve large-scale problems of CF more efficiently.
─ Then, for the neighborhood selection, we propose to consider just the K-nearest
neighbors belonging to the C-nearest clusters following the principle of [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ],
[
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] but using the fuzzy extension of the algorithm.
─ The prediction of learner’s preferences.
        </p>
      </sec>
      <sec id="sec-4-3">
        <title>4.2.1 Users clustering algorithm: Modified FCM to NNMF (MFCMtoNNMF).</title>
        <p>In this step we will factorize the evaluation matrix R into two matrices Z and
C. where Z is the probability matrix and C is the matrix of cluster centers.</p>
        <p>
          We will use a modified version of FCM into NNMF following the same principle
of WU and LI [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ], with adding the non-negativity constraint on the elements of the
matrix C. Since C is the matrix of cluster centers where each element is the
evaluations’ average made by members of a cluster c to a given course c, so its
components must be ≥ 0. The problem with new constrained to be solved is
HZ, C       ∑ , ,   ∑K , ∑ e , ,
St. 1  ; Z ≥ 0 ; C ≥0.
        </p>
        <p>
          To resolve this problem, we have used the ACLS algorithm (Alternating
Constrained Least Squares Algorithm) proposed in [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. And to initialize the ACLS
algorithm, we proposed a modified version of the random Acol initialization method cited
in [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] by initializing each row of the matrix C by averaging p random rows of the
evaluation matrix R. we called this method random Rrows initiatization method.
  λ  || ||   λ || ||
(1)
        </p>
      </sec>
      <sec id="sec-4-4">
        <title>4.2.2 Neighbors Pre-selection and Selection</title>
        <p>
          An important step in the CF algorithm is the search for neighbors of the current
learner. Traditional methods generally need to search the entire database, which
definitely suffer from the scalability problem. We proposed an adjusted version of the
fuzzy neighborhood algorithm following the same principle as in [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ] as follows:
• Calculate similarity between the active learner and all clusters to select the Fuzzy
C-Nearest Prototypes (FCNP) [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ]. We have considered only the FCNP because
it’s uninteresting to assign the learner to dissimilar clusters.
• Calculate similarity between the active learner and members of the FCNP to select
the Fuzzy K-Nearest Neighbors (FKNN) [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ] using the learner membership
degrees to clusters in order to minimize the calculations.
        </p>
        <p>We proposed to use the difference between membership degrees to the same
cluster as a similarity measure between the active learner and members of FCNP. Where,
the similarity between two learners increases when the difference between their
degrees of belonging tends to 0.</p>
      </sec>
      <sec id="sec-4-5">
        <title>4.2.3 The CF-Based prediction of the learner preferences</title>
        <p>
          Similar to the idea presented in [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ], we propose a framework that
can effectively improve the performance, by combining linearly the prediction results
of user based and item based algorithms, respectively as a CF Based prediction.
_,   
,
1
        </p>
        <p>,
Where , and , are user-based and item-based predictions.</p>
        <p>After the application of CF-based prediction methods, values in the cells of
learner-course matrix are recalculated and updated. So, the sparseness of the matrix is
therefore reduced. However, there may still be some empty cells due to the inadequate
number of nearest neighbors for that learner. For this reason, it is necessary to use
content information to make prediction for each learner-course pair. Then, merging
the two predictions types to make full evaluation matrix.
(2)
4.3</p>
      </sec>
      <sec id="sec-4-6">
        <title>Content-Based Filtering</title>
        <p>To predict messing values based on content, we must have a set of features to
describe the items’ content in order to correlate similar items. In our system, items
are courses and features are topics (information used to describe the courses’ content).</p>
        <p>We propose to calculate the occurrence frequency of each topic in all evaluated
items by the active learner ua. Then, we will give a score to each topic to
promote courses according to the topics’ appearance and evaluations made by learner ua
to each course. The reason is that two topics and belong to two courses
and , respectively, can have the same occurrence frequency in the set of items
evaluated by ua, but the course had a better evaluation against the course . Hence, the
learner’s preferences should promote ∈ over ∈ through their scores in the
preferences’ vector. So, the score assigned to the topic in the preferences’ vector of
the learner ua is computed as follows</p>
        <p>∑   ,  .  
  , V || (3)</p>
        <p>Such that |c(ua)| is the number of items rated by . rating(ua,c) is the
evaluation made by ua to the course c containing topic , and represents the
occurrence frequency of the topic in the set of items evaluated by ua.</p>
        <p>After have given a score for each topic, we calculate the similarity between the test
course and the set of courses assessed by the active learner to select the
Tnearest courses to the test course. We propose to use the cosine similarity measure to
calculate the similarity between two course vectors.</p>
      </sec>
      <sec id="sec-4-7">
        <title>4.3.1 Content-Based prediction</title>
        <p>Finally, we make the content-based prediction of the messing values. The rating
prediction for an unseen course is formulated as follows
_,   ∑  ∑ ∈, ,  .  , (4)
Where ratingu , m represents the evaluation made by the learner ua to course
∈ and sim(c,m) is the similarity calculated in the previous section.</p>
        <p>This type of prediction use topics to predict messing ratings. So, it needs predictive
features to achieve a good prediction which limit the effectiveness use of this
prediction lonely. To address limitations of the CF-based and Content-based predictions, we
are conducted toward hybridization between them.
4.4</p>
      </sec>
      <sec id="sec-4-8">
        <title>Hybrid prediction</title>
        <p>In this section, we will present our hybrid prediction scheme that combines
between the CF-based prediction and the Content-based prediction in order to obtain a
full user-item matrix. Our proposed hybrid prediction scheme is defined as follows
_ =α× _ ( , ) + (1−α)× _ ( , ) (5)
Where α is used to control the weight between the two predictions.</p>
      </sec>
      <sec id="sec-4-9">
        <title>The Top-K Recommendation</title>
        <p>After applying the hybrid algorithm cited above, we obtain predictions of the
unviewed items by the active learner. Then, we apply the procedure for generating
the recommendation. The first step is to calculate the scores of items based on
clusters’ preferences and the learner preferences’ prediction, to select the Top-N items in
each group. Then, generating a list of Top-K items selected from the Top-N items.</p>
        <p>The preferred items (courses) will be determined by the number of nearest
learners who evaluated the course (popularity) and their mean explicit evaluations by:
_ ( , c)= ( , c) + (1− ) ( ,c) (6)</p>
        <p>
          This formula is based only on the explicit evaluations. To apply this formula in the
TEL field, we introduce the importance of knowledge proposed in [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. So the
average will be replaced by an evaluation estimation of a course taking into
consideration the importance of knowledge of learners who evaluated the course c;
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Application: Experiment and Results</title>
      <sec id="sec-5-1">
        <title>Moodle Dataset</title>
        <p>Moodle1 is a free source e-learning software platform. Due to the lack of no data
sets have been made publicly available for formal and non-formal learning, we used a
database very known in RSs, BX-Book-Rating2 and we consider that each book is a
learning resource or a course. We restricted our validation to a subset of this base by
selecting just 21 learners, 20 courses and we have added information about the
knowledge level of the learner, which are his test scores. And we integrated it with
our technique in the Moodle platform. As showed in Fig.1.</p>
        <sec id="sec-5-1-1">
          <title>1 www.moodle.org 2 www.informatik.uni-freiburg.de/~cziegler/BX/</title>
        </sec>
      </sec>
      <sec id="sec-5-2">
        <title>Mean Absolute Error (MAE)</title>
        <p>|| ∑
,</p>
        <p>1</p>
        <p>We choose the Mean Absolute Error (MAE ) as the evaluation metric to calculate
the performance of our CF scheme.</p>
        <p>∑ , | | ,| , | (13)
N is the number of test evaluations. More MAE is lower, the performance is better.</p>
        <p>
          As we are in the TEL field, we will apply the novel MAE metric proposed by [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ],
and adapted to the e-learning domain, in order to take in consideration the knowledge
importance of the learner (his different test scores). The novel metric is as follow
||
,
; 0 &lt; α &lt; 1
5.3
        </p>
      </sec>
      <sec id="sec-5-3">
        <title>F1 metric</title>
        <p>To evaluate the performance of Top-K recommendation, we used the
metric,
 </p>
        <p>Where P and R are the precision and recall respectively. They are calculated as
,</p>
        <p>N: The total number of items;
number of relevant items
 : Number of relevant items found and
 : Total
5.4</p>
      </sec>
      <sec id="sec-5-4">
        <title>Performance Evaluation of the CF technique</title>
        <p>
          As the data sample on which we applied our algorithm is smaller the used by
[
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], therefore we cannot compare them. Such as [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] used four clusters of variant
size between 15 and 90, we used only three groups with size between 5 and 10.We
evaluate the performance using the novel MAE metric adapted to the e-learning field.
Results are showed in Fig.2.
Learner Login
        </p>
        <sec id="sec-5-4-1">
          <title>Available courses</title>
          <p>(14)
(15)
(16)</p>
          <p>From Fig.2. We observe that the MAE has an inverse relationship with the clusters
size K, and the different values of α (0.3+0.8), ie. Most K and α are large; most the
value of MAE is small. We can notice that the new MAE in almost all cases is
smaller than usual MAE, which is due to the subtraction of both products of the values
on the y-axis and we know that the levels of RS accuracy are better when the new
metric is applied, this is due to the favorable weighting of the users knowledge.</p>
        </sec>
      </sec>
      <sec id="sec-5-5">
        <title>Performance Evaluation of the Top-K Recommendation</title>
        <p>The figure below shows the evolution of the F1metric with number of
recommended courses. We observe from Fig.3 that the F1 metric increase until 15 courses
evaluated. The F1 values are varied depending on the number of relevant items. It can
be seen also that the recommendation performance of the system is good.</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Conclusion and future works</title>
      <p>Recommender Systems are widely used recently in Technology Enhanced
Learning which creates the need to adapt these systems to e-learning. For this and we
proposed, in this paper, a novel approach which uses an adapted RS to TEL field.
Especially when recommending learning objects that belong to different contexts.
Experimental results show that the proposed approach can improve the recommendation
accuracy. In the future work, we will elaborate this technique to generate
multicontext recommendations taking in the account the temporal dynamics effect.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Burke</surname>
            <given-names>R.</given-names>
          </string-name>
          , “
          <article-title>Hybrid recommender systems: Survey and experiments “, User Modeling and User Adapted Interaction</article-title>
          , vol.
          <volume>12</volume>
          , n°
          <issue>4</issue>
          ,
          <year>2002</year>
          , p.
          <fpage>331</fpage>
          -
          <lpage>370</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Li-Tung</surname>
            <given-names>Weng</given-names>
          </string-name>
          , Yue Xu Yuefeng Li,
          <string-name>
            <given-names>R.</given-names>
            <surname>Nayak</surname>
          </string-name>
          . “
          <article-title>Exploiting Item Taxonomy for Solving Cold-Start Problem in Recommendation Making”</article-title>
          .
          <source>Tools with Artificial Intelligence</source>
          , ICTAI'
          <volume>08</volume>
          , 20th IEEE International Conference, Volume:
          <volume>2</volume>
          ,
          <string-name>
            <surname>Pages</surname>
          </string-name>
          113-
          <fpage>120</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>S.</given-names>
            <surname>Rendle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Freudenthaler</surname>
          </string-name>
          , L. Schmidt-Thieme, “
          <article-title>Factorizing personalized Markov chains for next-basket recommendation”, in Pro. of the 19th IC on WWW</article-title>
          , ACM,
          <fpage>811</fpage>
          -
          <lpage>820</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Koren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Bell</surname>
          </string-name>
          , C. Volinsky, “
          <article-title>Matrix Factorization Techniques for Recommender Systems”</article-title>
          ,
          <source>IEEE Computer Society Press 42 (8)</source>
          (
          <year>2009</year>
          ),
          <fpage>30</fpage>
          -
          <lpage>37</lpage>
          , ISSN 0018-9162.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>N.</given-names>
            <surname>Manouselis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Drachsler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Vuorikari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Hummel</surname>
          </string-name>
          , R. Koper, “
          <article-title>Recommender Systems in Technology Enhanced Learning”</article-title>
          ,
          <source>in the1st RSs Handbook</source>
          , Springer-Berlin,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Drachsler</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Manouselis</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          “
          <source>How Recommender Systems in Technology-Enhanced Learning depend on Context”, the 1st workshop on Context-aware RSs for Learning</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Belkin</surname>
            <given-names>N.J.</given-names>
          </string-name>
          , Croft W.B., “
          <article-title>Information filtering and information retrieval: two sides of the same coin? “, Communication of the ACM</article-title>
          , vol.
          <volume>35</volume>
          ,
          <string-name>
            <surname>n</surname>
            <given-names>12</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pages</surname>
          </string-name>
          29-38,
          <year>Dec 1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Chen</surname>
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
            <given-names>C.</given-names>
          </string-name>
          , “
          <article-title>Collaborative Filtering Using Orthogonal Nonnegative Matrix Tri-factorization “</article-title>
          ,
          <source>J. of Information Processing and Management</source>
          , Volume
          <volume>45</volume>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Maatallah</surname>
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Seridi</surname>
            <given-names>H.</given-names>
          </string-name>
          ,
          <article-title>“A Fuzzy Hybrid Recommender System”</article-title>
          ,
          <source>the 1st International Conference on Machine and Web Intelligence</source>
          , ICMWI'10,
          <string-name>
            <surname>Oct</surname>
          </string-name>
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>J C.</surname>
          </string-name>
          <article-title>Bezdek</article-title>
          ., “
          <article-title>Fuzzyv mathematics in pattern classification” ph_D. dissertation</article-title>
          . Cornell Univ.. Ithaca, NY,
          <year>1973</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Wu</surname>
            <given-names>J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Li</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <article-title>“A modified fuzzy C-means algorithm for collaborative filtering</article-title>
          ”
          <source>Proc. of the 2nd KDD Workshop on Large-Scale RSs and the NPC</source>
          , ACM New York,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12. H.
          <string-name>
            <surname>Drachsler</surname>
            ,
            <given-names>H. G. K.</given-names>
          </string-name>
          <string-name>
            <surname>Hummel</surname>
          </string-name>
          , R. Koper, “
          <article-title>Identifying the Goal, User model and Conditions of Recommender Systems for Formal and Informal Learning”</article-title>
          ,
          <source>Journal of DI 10.</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. E.Garcia,
          <string-name>
            <given-names>C.</given-names>
            <surname>Romero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Ventura</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.D.</given-names>
            <surname>Castro</surname>
          </string-name>
          , “
          <article-title>An architecture for making recommendations to courseware authors using association rule mining and collaborative filtering”, User Modeling</article-title>
          and
          <string-name>
            <surname>User-Adapted</surname>
            <given-names>Interaction</given-names>
          </string-name>
          , Vol
          <volume>19</volume>
          ,
          <issue>issue</issue>
          (
          <issue>1-2</issue>
          ),
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>J. Bobadilla</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Serradilla</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          . Hernando, “
          <article-title>Collaborative filtering adapted to recommender systems of e-learning, Knowledge-Based Systems”</article-title>
          ,
          <source>Journal of KBS</source>
          , vol
          <volume>22</volume>
          , issu 4,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>N.</given-names>
            <surname>Soonthornphisaj</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Rojsattarat</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          <article-title>Yim-ngam, “Smart E-Learning Using Recommender System”</article-title>
          ,
          <source>in: International Conference on Intelligent Computing</source>
          ,
          <fpage>518</fpage>
          -
          <lpage>523</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16. L.
          <string-name>
            <surname>Ge</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Kong</surname>
          </string-name>
          , J. Luo, “
          <article-title>Courseware Recommendation in E-Learning System”</article-title>
          ,
          <source>in: International Conference on Web-based Learning (ICWL'06)</source>
          ,
          <fpage>10</fpage>
          -
          <lpage>24</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Nguyen</surname>
          </string-name>
          Thai-Nghe, Lucas Drumond, Artus Krohn-Grimberghe,
          <article-title>Lars SchmidtThiemeThay, “Recommender System for Predicting Student Performance “</article-title>
          , 1st Workshop on RSs for TEL, Procedia Computer Science, Elsievir,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18. G.
          <string-name>
            <surname>-R. Xue</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Xi</surname>
          </string-name>
          , H.
          <article-title>-</article-title>
          <string-name>
            <surname>J. Zeng</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Yu</surname>
            , and
            <given-names>Z.</given-names>
          </string-name>
          <string-name>
            <surname>Chen</surname>
          </string-name>
          . “
          <article-title>Scalable collaborative filtering using cluster-based smoothing”</article-title>
          .
          <source>In Proc. of SIGIR</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Amy</surname>
            <given-names>Langville</given-names>
          </string-name>
          , Carl Meyer, Russell Albright,
          <string-name>
            <given-names>James</given-names>
            <surname>Cox</surname>
          </string-name>
          and David Duling, “Algorithms, Initializations, and
          <article-title>Convergence for the Nonnegative Matrix Factorization”</article-title>
          ,
          <string-name>
            <surname>KDD</surname>
          </string-name>
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>James M.Keller</surname>
          </string-name>
          , Michael R.Gray, James A.
          <string-name>
            <surname>Givens</surname>
          </string-name>
          , JR, “
          <article-title>A Fuzzy Nearest Neighbor Algorithm”</article-title>
          ,
          <source>IEEE Transaction on Systems,Man and Cybernitics</source>
          ,VOL.SMC-
          <volume>15</volume>
          ,
          <year>1985</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21. J.
          <string-name>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <surname>A. P. de Vries</surname>
            , and
            <given-names>M. J. T.</given-names>
          </string-name>
          <string-name>
            <surname>Reinders</surname>
          </string-name>
          . “
          <article-title>Unifying user-based and item-based collaborative filtering approaches by similarity fusion”</article-title>
          .
          <source>In Proc. of SIGIR</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>