<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>October</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Top-N recommendations on Unpopular Items with Contextual Knowledge</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Paolo Cremonesi</string-name>
          <email>paolo.cremonesi@polimi.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Paolo Garza</string-name>
          <email>garza@elet.polimi.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Elisa Quintarelli</string-name>
          <email>quintare@elet.polimi.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Roberto Turrin</string-name>
          <email>roberto.turrin@moviri.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Moviri srl</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Politecnico di Milano</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2011</year>
      </pub-date>
      <volume>23</volume>
      <issue>2011</issue>
      <abstract>
        <p>Traditional recommender systems provide recommendations of items to users; recently, some of them also consider the context related to predictions. In this paper we propose a technique that relies on classical recommendation algorithms and post-filters recommendations on the basis of contextual information available for them. Association rules are exploited to identify the most significant correlations among context and item characteristics. The mined rules are used to filter the predictions performed by traditional recommender systems to provide contextualized recommendations. Our experimental results show that the proposed approach allows improving the output of classical algorithms proposed in the literature, especially in the case of unpopular items.</p>
      </abstract>
      <kwd-group>
        <kwd>Recommender system</kwd>
        <kwd>Association rules</kwd>
        <kwd>Contextual data</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Categories and Subject Descriptors</title>
      <p>H.4 [Information Systems Applications]: Miscellaneous</p>
    </sec>
    <sec id="sec-2">
      <title>1. INTRODUCTION AND RELATED WORK</title>
      <p>Recommender systems help people in retrieving
potentially useful information or products in a huge set of choices
by using the knowledge of the individual’s past ratings, but
also the ratings of all the system users.</p>
      <p>
        However, other aspects, such as the situation, location,
and time can influence the user ratings and thus, can be
used to improve the accuracy of recommendations. For
example, the restaurants and cuisine types chosen during the
winter can be different from those chosen in the summer;
moreover, the age and location of a user can have a great
impact in the choices related to the food domain. The use of
contextual information in the area of recommendation
systems has been considered in the recent literature [
        <xref ref-type="bibr" rid="ref1 ref13 ref14 ref7 ref8">1, 7, 8,
13, 14</xref>
        ]. In [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] the notion of context is integrated in the
customer’s behavior model for improving the prediction of
their behavior; however, in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] the authors show that
collecting contextual information relevant for recommendation
purposes is a hard task and they develop a special-purpose
browser to gather such information. The proposals related
to contextual recommendation systems can be classified into
three main groups: pre- ltering, post- ltering, and
contextual modeling [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. In [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] the context is used for rating
estimation in multidimensional recommender systems, where
contextual information are added to the standard
dimensions related to users and items. In [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] a proposal which uses
contextual values as virtual items used together to standard
ones is presented; the advantage is that classical
recommendation algorithms can be used without any modification. In
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] an approach to pre-filter the item ratings on the basis of
the possible values of a unique contextual perspective, that
is the season when the rating was expressed, is described.
[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] contains a comparison between the pre-filtering and the
post-filtering approaches and identifies which method
dominates the other and under which circumstances, since, in
general, there is not an approach better than the others.
      </p>
      <p>In this paper we introduce a generic contextual
post-filtering technique, not specifically adapted to a target scenario;
however, to clarify the exposition, in the examples we will
use the movie domain. The proposed approach exploits
association rules to identify the most significant correlations
among context and item characteristics and uses them to
filter the predictions performed by a traditional recommender
system in order to provide contextualized recommendations.
The performed experiments show the effectiveness of the
proposed approach in the context of top-N
recommendations, in particularly when unpopular items are considered.</p>
      <p>The paper is organized as follows. In Section 2 the
proposed approach is described, while in Section 3 the obtained
experimental results are discussed. Finally, Section 4 draws
conclusions and discusses future work.</p>
    </sec>
    <sec id="sec-3">
      <title>PROPOSED ALGORITHM</title>
      <p>
        The notion of context has emerged with different
interpretations in various fields of research like psychology,
philosophy, or computer science. A widely accepted definition
is the one proposed in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], where the context is considered
as any information useful to characterize the situation of an
entity, in our work an access to an item in the movie
domain. In general, contextual information can be explicitly
declared by the user, e.g., the user is interested in dramatic
movies when he/she is alone, and in horror movies when
he/she is with friends, or implicitly inferred by the system,
as in the case of temporal information, or by sensors, e.g.,
the location. The contextual information available for our
scenario includes static demographic information, i.e., Age,
Gender, Occupation, and ZIP code (of the residence address)
of the users. However, the generality of our proposal allows
us to extend our experiments to domains where a wider set
of contextual and dynamic values is traced. For example,
we could consider the user situation (he/she is alone or with
friends) and his/her location (e.g., at home, at office).
2.1
      </p>
    </sec>
    <sec id="sec-4">
      <title>The Context-RS recommender system</title>
      <p>We propose a new recommender system, called
ContextRS, that combines contextual knowledge, traditional
recommender systems, and association rules to improve the quality
of top-N recommendations. Context-RS is a post-filtering
approach (see Figure 1) based on the available knowledge
about users (U ), items (I), contexts (C), and ratings (R). It
exploits association rules to find useful correlations between
contextual knowledge and item characteristics and uses the
extracted rules to filter uninteresting items from the items
recommended by a traditional recommender system.</p>
      <p>Given an arbitrary user u in the context c, the proposed
approach works as follows to select the top-N items to
recommend to u.</p>
      <p>1. for each unrated item i a traditional (collaborative)
recommender system is used to predict the appropriate
rating rui of user u
2. the subset of items having a set of characteristics
related to the current context c, according to the
extracted contextual association rules, is selected
3. the top-N items of the subset of items selected during
the previous step are recommended to user u</p>
      <p>
        The main difference between Context-RS and the
previous post-filtering approaches is given by the adopted
selection technique (step 2). To decide which types of items
are related to a context c, and hence which items must be
considered, we propose to exploit association rules, and in
particular the correlations between context and item
characteristics. Association rules [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] are rules of the form X ) Y ,
where both X and Y are sets of objects. In our approach, X
is a set of predicates representing a context and the
consequent is a characteristic of the available items. For instance,
(gender = M ) ^ (age = [20 25]) ) (genre = horror) is an
association rule representing a correlation between the
context (gender = M ) ^ (age = [20 25]) and the horror genre
mined from the available data (users, items, contexts, and
ratings). Association rules have been successfully applied
to market basket analysis [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and automatic data
classification [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. In this work we show that they can be profitably
exploited also in the context of recommender systems.
      </p>
      <p>Two measures are usually used to assess the quality of
association rules: support (sup) and confidence (conf ). The
support represents the frequency of the rule in the analyzed
data, while the confidence estimates the conditional
probability of the consequent given the antecedent.</p>
      <p>The proposed approach infers which kinds of items are
more of interest for each context c by extracting association
rules from the available training ratings, by taking into
consideration also the context in which the ratings have been
given and the characteristics of the rated items. In
particular, it extracts all the association rules of the form context )
item charactetistic with support and confidence higher than
the minimum thresholds minsup and minconf , respectively.
We remark that the characteristics of the considered users
are also part of the contextual knowledge. Hence, in the
antecedent of the extracted rule predicates on the
characteristics of the users can be present (e.g., a predicate such
as gender = M ).</p>
      <p>After the set of contextual rules has been mined, for each
context c the consequents of the association rules having c
as antecedent are used to form a set Sc composed of the item
characteristics which are more frequently related to c. Only
those items which are characterized by a characteristic that
belongs to Sc can be recommended when the user current
context is c. For example, suppose the following two rules
are extracted for the context (gender = M ):
(gender = M ) ) (genre = horror); sup = 5%; conf = 50%
(gender = M ) ) (genre = action); sup = 4%; conf = 40%</p>
      <p>It follows that Sc is equal to f(genre = horror); (genre =
action)g for the context (gender = M ). Hence, only horror
and action movies can be recommended to male users when
our approach is adopted.
2.1.1</p>
      <sec id="sec-4-1">
        <title>Contextual rule mining</title>
        <p>
          In order to be able to apply traditional rule mining
algorithms to mine contextual rules, the available data (ratings
and the related knowledge) must be represented in the
transactional data format [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. In the context of association rule a
transaction is defined as a set of items, and a transactional
dataset as a set of transactions [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. For the extraction of the
contextual rules exploited by our approach, a transactional
dataset D is generated by applying a data transformation
on the rating data taking into consideration also contextual
knowledge and item characteristics. For each rating four
pieces of information are known: the rated item (i), the
user who rated the item (u), the context in which the rating
has been given (c), and the rating value (rui). Each rating
&lt;i,u,c,rui&gt; given by user u to item i in the context c is
transformed in a transaction (i.e., set of pairs) composed of
the following pairs:
one pair (i.characteristic=value) for each characteristic
of the considered item i
one pair (u.characteristic=value) for each
characteristic of the considered user u
one pair (c.characteristic=value) for each
characteristic of the considered context c
        </p>
        <p>For instance, consider a rating given by a male in the
situation “with friends” and in the location “at home” to a
fantasy movie produced in year 2001. The set f(gender =
M ); (situation = with f riends); (position = at home); (genre =
f antasy); (year = 2001)g is included in D.</p>
        <p>In order to extract only rules related to positive user
experiences we have considered only the positive user ratings
(i.e., 4 and 5 out of 5).</p>
        <p>
          From the generated dataset D, contextual association rules
are efficiently mined by means of an implementation of the
FP-growth algorithm downloaded from the FIMI website [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ].
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>EXPERIMENTAL RESULTS</title>
      <p>Since large datasets with contextual information are not
available, in our initial evaluation of the proposed approach
we used the Movielens dataset and we considered as context
(“static” context) the available demographic data.
3.1</p>
    </sec>
    <sec id="sec-6">
      <title>Testing methodology, datasets, and algorithms</title>
      <p>Our study considered two neighborhood (CorNgbr and
NNCosNgbr) and two latent-factor (AsySVD and PureSVD)
collaborative algorithms, along with two non-personalized
algorithms used as baseline (TopPop and MovieAvg).</p>
      <p>The two non-personalized algorithms recommend static
lists of items regardless the collected user ratings:
TopPop (Top Popular) suggests the most rated items (i.e., the
most popular), while MovieAvg (Movie Average) suggests
the highest rated items (i.e., the most liked).</p>
      <p>
        Neighborhood collaborative algorithms are based on the
similarity relationships among either users or items, in terms
of collected ratings. CorNgbr (Correlation Neighborhood)
computes item-item similarity by means of the Pearson
linear correlation coefficient [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Similarly, NNCosNgbr
(Nonnormalized Cosine Neighborhood) computes item-item
similarity by means of the cosine coefficient [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        Latent factor collaborative models represent users and
items in a common low-dimensional ‘latent factor’ space.
AsySVD (Asymmetric SVD) is a matrix factorization model
that reported an RMSE of 0.9000 in the Netflix context [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
PureSVD is a latent factor algorithm recently proposed [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ],
whose rating estimation rule is based on the conventional
SVD, where unknown ratings have been treated as zeros.
      </p>
      <p>
        In this work we have considered the 1-million-rating
Movielens dataset [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], which publishes user ratings along with
movie genres (e.g., comedy, horror, . . . ) and demographics
(e.g., user gender, age, . . . ). According to the methodology
adopted in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], known ratings are split into a training set M
and a test set T . The test set T contains only 5-star ratings,
i.e., the items relevant to the respective users. Therefore,
we have firstly trained the algorithm over the ratings in M.
Then, for each rating in T given by user u to item i, (i) we
      </p>
      <sec id="sec-6-1">
        <title>PureSVD</title>
      </sec>
      <sec id="sec-6-2">
        <title>AsySVD</title>
      </sec>
      <sec id="sec-6-3">
        <title>NNCosNgbr</title>
      </sec>
      <sec id="sec-6-4">
        <title>CorNgbr</title>
      </sec>
      <sec id="sec-6-5">
        <title>TopPop</title>
      </sec>
      <sec id="sec-6-6">
        <title>MovieAvg</title>
        <p>Algorithm</p>
        <p>standard
with context</p>
        <p>standard
with context</p>
        <p>standard
with context</p>
        <p>standard
with context</p>
        <p>standard
with context</p>
        <p>
          standard
with context
have randomly selected 1,000 additional items unrated by
user u, (ii) we have predicted the ratings for the test item i
and the additional 1,000 items, and (iii) we have formed a
top-N recommendation list composed by the N items with
the highest predicted ratings. Finally, the recommendation
quality has been measured in terms of recall(N ), defined as
the percentage of tested items that appear in the top-N list
[
          <xref ref-type="bibr" rid="ref5">5</xref>
          ].
        </p>
        <p>
          Similarly to [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ], an advanced analysis used to compute the
quality on long-tail items has been performed by selecting
from T the subset of ratings related to unpopular items. In
our tests, we have considered only items with less than 990
ratings (the 95% of items) which refer to the 67% of ratings.
3.2
        </p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Recall analysis</title>
      <p>In this section, we analyze the recall achieved by
contextual and not contextual algorithms on the Movielens dataset.
Initially, we report a high-level analysis related to the
recall achieved by setting the number of recommended items
N to 3 (real systems such as IMDB and Amazon usually
show from 2 to 5 recommended items per page depending
on their layout). Then a deeper discussion on the recall
achieved by varying N on the long tail items is reported.
We recall that, in the performed experiments, the context is
given by age and gender of the users, while the considered
item characteristic is the movie genre. For the contextual
rule mining step, we set the minimum support threshold to
0.01%, while the minimum confidence was initially set to 0%
(the effects of the enforced minimum confidence threshold is
analyzed in the following). Table 1 summarizes the recall
at N =3 for the considered algorithms. For each algorithm
we report the recall obtained by the traditional version of
the algorithm (standard version) and that achieved by the
contextualized version (with context). We report the recall
obtained on all items and that achieved on the long tail
items. The exploitation of contextual rules allows
improving the performance of all the considered algorithms in both
cases (all items and long tail items). The recall improvement
is on the average higher when non-personalized algorithms
are used (e.g., +1.72% for TopPop on all items) and less
relevant when state of the art latent factor based
recommender systems are considered (e.g., +0.42% for PureSVD
on all items). Even if contextual knowledge allows
improving recall also when all items are considered, its positive
effect is more evident when long tail items are considered.
In this more difficult situation the information provided by
the automatically extracted contextual rules allows
improving more significantly also the recall of the better performing
algorithms (+2.03% for PureSVD and +1.85% for
NNCosNgbr). The post-filtering operation, performed by means
of contextual rules, allows focusing on the most interesting
movie genres for each context discarding irrelevant items
from the top-N prediction list. The improvement of recall
on the long tail items is an interesting property. In fact, a
good recall on the long tail items means that the proposed
approach is able to properly recommend also not best seller
items, providing more novelty.
3.2.1</p>
      <sec id="sec-7-1">
        <title>Prediction of long tail items</title>
        <p>Figures 2(a)-2(c) report the recall-at-N when varying the
value of N . For the contextual algorithms we report the
results obtained by using two different settings during the
contextual rule mining step: minconf =0% and minconf =15%.
The second configuration (minconf =15%) is more selective.
Hence, for each context a fewer genres are selected.
However, as discussed in the following, the second configuration
allows achieving higher recall values.</p>
        <p>The contextual versions of the considered algorithms are
significantly better than the not contextual ones,
independently of the considered algorithm. The more selective
configuration, i.e., the one with minconf =15%, shows to be the
most effective (+7.6% at N =5 with respect to standard
version for PureSVD). We performed also a set of experiments
by setting minconf equal to 20%. However, in that
configuration the filter becomes too tight and recall decreases.</p>
        <p>The use of contextual rules allows improving significantly
the recall of the non-personalized algorithm TopPop (+18.6%
at N =10 with respect to standard TopPop). The recall
of the contextual version of TopPop is comparable to that
achieved by the standard versions of many other more
complex algorithms. In particular, the recall achieved by the
contextualized version of TopPop is comparable to that of
standard NNCosNgbr and even better than standard AsySVD.
3.2.2</p>
      </sec>
      <sec id="sec-7-2">
        <title>Recommendations for new users</title>
        <p>The good performance achieved by the contextualized
version of TopPop is particularly of interest in presence of new
users. When recommender systems have to deal with new
users, the state of the art collaborative approaches cannot be
used because the history of new users is empty. In this
situation only non-personalized algorithms, such as TopPop and
MovieAvg, can be used. Since the contextualized version of
TopPop needs only to know the current context and the
profile of the new user (e.g., Age and Gender), contextualized
TopPop can be used to recommend items to new users. The
recall at N =10 of the contextualized TopPop is 18.9% while
that of the standard (not contextualized) TopPop is 0.25%.
Hence, our approach is a very interesting solution when new
users have to be managed.
3.3</p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>Explanation provided by contextual rules</title>
      <p>The main goal of Context-RS is the recall improvement.
However, the proposed approach adds also expressiveness
to traditional collaborative recommender systems. In fact,
the extracted contextual rules can be used to explain to end
users the reason behind the performed recommendations. A
merely list of items is usually less appealing than a set of
items with an explanation. All the items recommended by
Context-RS are selected because (i) they are ranked high by
0</p>
      <p>0
PureSVD (with context - conf=15%)
PureSVD (with context - conf=0%)</p>
      <p>PureSVD (std)
AsySVD (with context - conf=15%)
AsySVD (with context - conf=0%)</p>
      <p>AsySVD (std)
2
4
6
8
10
(a) Latent factor algorithms
NNCosNgbr (with context - conf=15%)
NNCosNgbr (with context - conf=0%)</p>
      <p>NNCosNgbr (std)
CorNgbr (with context - conf=15%)
CorNgbr (with context - conf=0%)</p>
      <p>CorNgbr (std)
2
4
6
8
10
(b) Neighborhood algorithms</p>
      <p>TopPop (with context - conf=15%)
TopPop (with context - conf=0%)</p>
      <p>TopPop (std)
MovieAvg (with context - conf=15%)
MovieAvg (with context - conf=0%)</p>
      <p>MovieAvg (std)
2
4
6
8
10
(c) Non-personalized algorithms
the used standard collaborative filter and (ii) their
characteristics are considered interesting for the current context,
according to the extracted contextualized rules. By simply
showing together to each recommended item also the
contextual rule that has been used to select it we can improve the
confidence of the user on the provided recommendations. As
an example of the knowledge provided by contextual rules,
the sets of rules for two representative contexts are reported
in Table 2. The first context is “female in the range 35-44
years old”, while the second one is “male in the range 35-44
years old”. In both contexts, only a subset of the 18 available
genres is automatically selected by means of the extracted
contextual rules.</p>
    </sec>
    <sec id="sec-9">
      <title>CONCLUSIONS AND FUTURE WORK</title>
      <p>In this paper, we showed how contextual rules,
representing frequent relationships between context information and
the characteristics of the rated items, allow increasing the
recall of state-of-the-art collaborative recommender systems.
Our approach can be profitably applied to both personalized
and non-personalized recommender systems.</p>
      <p>As future work, we are focusing our attention on the
crossdomain problem. In particular, we are investigating the
possible application of contextual rules, extracted from a
dataset, to another dataset. For example, the set of rules
mined from a movie dataset could be applied to a book
dataset. Obviously a mapping function is needed to map
the rules mined from one domain to the domain of the other
dataset. This approach could be useful (i) when past
contextual history is available only for one dataset or (ii) in
presence of noisy datasets. Contextual rules are mined from
the first, non-noisy, dataset and are used to perform
contextualized recommendations for the second dataset.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>G.</given-names>
            <surname>Adomavicius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Sankaranarayanan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Sen</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Tuzhilin</surname>
          </string-name>
          .
          <article-title>Incorporating contextual information in recommender systems using a multidimensional approach</article-title>
          .
          <source>ACM Trans. Inf</source>
          . Syst.,
          <volume>23</volume>
          (
          <issue>1</issue>
          ):
          <fpage>103</fpage>
          -
          <lpage>145</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>G.</given-names>
            <surname>Adomavicius</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Tuzhilin</surname>
          </string-name>
          .
          <article-title>Context-aware recommender systems</article-title>
          .
          <source>In ACM RecSys'08</source>
          , pages
          <fpage>335</fpage>
          -
          <lpage>336</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>R.</given-names>
            <surname>Agrawal</surname>
          </string-name>
          ,
          <string-name>
            <surname>T.</surname>
          </string-name>
          <article-title>Imielin´ski, and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Swami</surname>
          </string-name>
          .
          <article-title>Mining association rules between sets of items in large databases</article-title>
          .
          <source>In ACM SIGMOD'93</source>
          , pages
          <fpage>207</fpage>
          -
          <lpage>216</lpage>
          ,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>L.</given-names>
            <surname>Baltrunas</surname>
          </string-name>
          and
          <string-name>
            <given-names>F.</given-names>
            <surname>Ricci</surname>
          </string-name>
          .
          <article-title>Context-based splitting of item ratings in collaborative filtering</article-title>
          .
          <source>In ACM RecSys'09</source>
          , pages
          <fpage>245</fpage>
          -
          <lpage>248</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>P.</given-names>
            <surname>Cremonesi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Koren</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Turrin</surname>
          </string-name>
          .
          <article-title>Performance of recommender algorithms on top-n recommendation tasks</article-title>
          .
          <source>In ACM Recsys'10</source>
          , pages
          <fpage>39</fpage>
          -
          <lpage>46</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Dey</surname>
          </string-name>
          .
          <article-title>Understanding and using context</article-title>
          .
          <source>Personal Ubiquitous Computing</source>
          ,
          <volume>5</volume>
          (
          <issue>1</issue>
          ):
          <fpage>4</fpage>
          -
          <lpage>7</lpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Domingues</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. M.</given-names>
            <surname>Jorge</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Soares</surname>
          </string-name>
          .
          <article-title>Using contextual information as virtual items on top-n recommender systems</article-title>
          .
          <source>In Workshop on Context-Aware Recommender Systems (CARS-2009)</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>M.</given-names>
            <surname>Gorgoglione</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Palmisano</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Tuzhilin</surname>
          </string-name>
          .
          <article-title>Personalization in context: Does context matter when building personalized customer models?</article-title>
          <source>In ICDM'06</source>
          , pages
          <fpage>222</fpage>
          -
          <lpage>231</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>R. J. B.</given-names>
            <surname>Jr.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Goethals</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Zaki</surname>
          </string-name>
          .
          <source>Frequent itemset mining implementations repository</source>
          ,
          <year>2004</year>
          . http://www.cs.rpi.edu/~zaki/Workshops/FIMI/.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Koren</surname>
          </string-name>
          .
          <article-title>Factorization meets the neighborhood: a multifaceted collaborative filtering model</article-title>
          .
          <source>In ACM SIGKDD'08</source>
          , pages
          <fpage>426</fpage>
          -
          <lpage>434</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>B.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Hsu</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Ma</surname>
          </string-name>
          .
          <article-title>Integrating classification and association rule mining</article-title>
          .
          <source>In ACM SIGKDD'98</source>
          , pages
          <fpage>80</fpage>
          -
          <lpage>86</lpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>B.</given-names>
            <surname>Miller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            <surname>Albert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Lam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Konstan</surname>
          </string-name>
          , and
          <string-name>
            <surname>J. Riedl.</surname>
          </string-name>
          <article-title>MovieLens unplugged: experiences with an occasionally connected recommender system</article-title>
          .
          <source>In International conference on Intelligent user interfaces</source>
          , pages
          <fpage>263</fpage>
          -
          <lpage>266</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>C.</given-names>
            <surname>Palmisano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Tuzhilin</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Gorgoglione</surname>
          </string-name>
          .
          <article-title>Using context to improve predictive modeling of customers in personalization applications</article-title>
          .
          <source>IEEE Trans. Knowl</source>
          . Data Eng.,
          <volume>20</volume>
          (
          <issue>11</issue>
          ):
          <fpage>1535</fpage>
          -
          <lpage>1549</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>U.</given-names>
            <surname>Panniello</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Tuzhilin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Gorgoglione</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Palmisano</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Pedone</surname>
          </string-name>
          .
          <article-title>Experimental comparison of pre- vs. post-filtering approaches in context-aware recommender systems</article-title>
          .
          <source>In ACM RecSys'09</source>
          , pages
          <fpage>265</fpage>
          -
          <lpage>268</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>