<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>From Recordings to Recommendations: Suggesting Live Events in the DVR Context</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alessandro Basso</string-name>
          <email>basso@di.unito.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Marco Milanesio</string-name>
          <email>milane@di.unito.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>André Panisson</string-name>
          <email>panisson@di.unito.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Giancarlo Ruffo Dipartimento di Informatica</string-name>
          <email>ruffo@di.unito.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Università degli Studi di Torino Torino</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Providing valuable recommendations in the DVR domain is quite straightforward when enough information about users and/or contents is known. In this work, we discuss the possibility of recommending future live events without knowing anything else but past user programmed recording schedules.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Digital Video Recorders</kwd>
        <kwd>TV Broadcasts</kwd>
        <kwd>Recommendation Systems</kwd>
        <kwd>Collaborative Algorithms</kwd>
        <kwd>Implicit Data</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>In order to provide a better user experience by means of
focused advices (e.g., recommendation of new contents), the
arisen issues can be summarized in two main categories.
First, some logging activity must be done to nd common
usage patterns on which identify potential users' interests.
Users are not willing to o er an explicit pro le when using
a DVR, thus we do have, possibly, only a set of observations
on their activity. This is an important challenge for many
Copyright is held by the author/owner(s). Workshop on the Practical Use of
Recommender Systems, Algorithms and Technologies (PRSAT 2010), held
in conjunction with RecSys 2010. September 30, 2010, Barcelona, Spain.
known recommendation algorithms, that exploit user
proles for increasing accuracy and take into account privacy
issues as well.</p>
      <p>Second, di erently from the Video on Demand domain, the
usage of an Electronic Program Guide (EPG) is not always
assured. This fact brings two consequences: (a) there is
no knowledge on the content the user is recording and/or
watching, and (b) there is no well de ned one-to-one
correspondence between a recording and a broadcast event. This
leads to the impossibility of directly recommending
recordings to users.</p>
      <p>Taking into account these considerations brings us our
research question: in such a domain, is it possible to give
valuable live event recommendations to users, only
considering their recording activity on the DVR? Users have to be
brought to contents of interest, but, di erently from other
approaches, we are not using anything but collaborative
ltering technique on users' activity. Thus, the main
contribution of our approach is the demonstration that this can be
achieved without any knowledge on what is being broadcast,
neither EPGs nor content classi cations.</p>
    </sec>
    <sec id="sec-2">
      <title>2. RELATED WORK</title>
      <p>
        The task of recommending live events, such as TV shows,
has been already investigated in the past years. Proposed
methods can exploit di erent ways to collect the required
information for user pro ling, as well as can make use of
various recommendation algorithms. In particular, some
approaches, such as [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], explicitly ask the users about their
interests and build suggestions on top of the resulting user
pro les. A di erent idea, which is adopted in several works
[
        <xref ref-type="bibr" rid="ref10 ref2 ref9">2, 9, 10</xref>
        ], makes use of implicit feedbacks, i.e., information
derived from the analysis of the user behavior while using
the DVR. Other solutions, as [
        <xref ref-type="bibr" rid="ref12 ref15 ref4">4, 12, 15</xref>
        ], propose
recommender systems which make use of user's view history as
well as both explicit and implicit feedbacks. According to
authors, such a mixed technique allows to obtain the best
performance.
      </p>
      <p>
        Another feature to tell apart existing methods for live events
recommendation is the recommender algorithm used. A
common approach relies on the content of the programs
broadcast and it is therefore called content-based.
Examples in this category can be found in [
        <xref ref-type="bibr" rid="ref10 ref12">10, 12</xref>
        ]. Some authors
devised recommenders that make use of multiple
contentbased techniques, as in [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ].
      </p>
      <p>
        A solution able to increase novelty of recommendations is
collaborative ltering, like the works in [
        <xref ref-type="bibr" rid="ref2 ref5">2, 5</xref>
        ]. Another
interesting method is proposed in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and exploits the latent
factor model.
      </p>
      <p>In this work, we focus on implicit feedbacks only and we use
a collaborative ltering approach to compute
recommendations. Our aim is to minimize the information required as
input of the recommender system, without sacri cing the
novelty. The real challenge is to be able to recommend
programs to users without actually knowing anything about
what is broadcast on TV, since no EPG is used (di erently
from existing methods).</p>
    </sec>
    <sec id="sec-3">
      <title>3. DATASET</title>
      <p>
        Faucet is a PVR integrated in a podcasting service1, which
allows the recording and further downloading of Italian TV
and Radio broadcasts [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The activity of the users is
incrementally collected (hourly) into a log le containing the
scheduled recordings set in the past hour as well as the
occurred downloads. The resulting dataset is populated by real
users expressing their preferences through the recorded
programs. The dataset is publicly available at http://secnet.
di.unito.it/vcast.
      </p>
      <p>Each registered user can x the desired settings for the
recording of interest. At the end of the process, her
recording is scheduled for the given time and will be further
available for downloading purposes. Each recording ri, thus, is
de ned as a tuple &lt; ui; ci; ti; bi; ei; pi &gt; with the following
notation: user ui sets up a recording on channel ci, starting
from time bi and ending at time ei, with a title ti and a
periodicity pi (e.g., once, every Tuesday, mon-fri). In Faucet,
channels and periodicity values are xed (users can choose
their ci and pi from a combobox), while all other elds are
completely up to the user.</p>
      <p>After the end time expires, the recording is made available
to the user for downloading. In case of periodic events, the
recording step can occur an unde ned number of times.
After each recording step, the respective download is made
available.</p>
    </sec>
    <sec id="sec-4">
      <title>4. METHODOLOGY</title>
      <p>In this section, we want to outline what our approach is.
Given no knowledge on the broadcasts, we collect the users
activity to compute what we call discrete events, to be used
for recommendation purposes and top chart list building.</p>
    </sec>
    <sec id="sec-5">
      <title>4.1 From Recordings to Events</title>
      <p>
        The extraction of meaningful information from the
unstructured amount of data contained in the dataset is essential
to de ne a set of events which map the broadcast programs.
Through the event discovery phase, we can discretize the
continuous domain of timings de ned by the recordings,
creating the basis for the application of a recommender
algorithm. The basic procedure used in the discretization was
rst introduced in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and covers a number of subsequent
steps:
Clustering. Recordings are clustered together by
considering the channel, the periodicity and the di erence between
starting and ending times. All recordings belonging to the
same cluster are thus equal as channel and periodicity, whilst
1http://www.vcast.it/
similar on timings. Speci c values are used to de ne the
maximum clustering distance for the start and the end times.
The output of this activity is a set of clusters, each
identifying a single event. The centroid of the cluster, i.e., the
recording that minimizes the intra-cluster timing distances,
is considered the representative of the event.
      </p>
      <p>Aggregation. As the clustering occurs periodically, this
operation aims to identify newly created events
characterized by the same channel and periodicity of the formerly
created ones, but comparable timings. Such elements refer
to the same programs and are therefore merged into unique
events, whose properties are updated by taking into account
the values of all the similar ones.</p>
      <p>Collapsing. A further re nement phase is required to grant
the consistency of the generated events. In fact, due to the
high variability of timings, especially when a new
transmission appears, events which are initially considered as non
referring to the same transmission tend to slowly and
independently converge to more stable timeframes. This implies
the need of merging them into single events.</p>
      <p>As a result of the processing phase, given a set of recording
clustered together, each one with the same channel ci and
the same periodicity pi, we compute a discrete event ei in
the form of: &lt; fuig; t; ci; b; e; pi &gt;, where fuig is the set of
users whose recordings were clustered together; t is the user
generated title most frequent among users in fuig; b and e
are, respectively, the starting and ending time computed as
the median value of all the clustered recordings.</p>
    </sec>
    <sec id="sec-6">
      <title>4.2 From Events to Recommendations</title>
      <p>
        When future events are computed from scheduled
recordings, we are thus able to propose them to users by means of
two di erent charts: (1) a global chart returning those events
computed starting from the largest groups of recordings, i.e.,
those chosen by the largest sets of users; and (2) a user-based
recommendation list, returning a set of new events of
possible interest to each user requesting it, computed through
a similarity function over the whole population. We call
them Most Popular and Rec2 (Recordings times
Recommendations), respectively. Both charts are computed by means
of the memory based collaborative ltering approach named
k -Nearest Neighbors (kNN) [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. We apply both variants
of the kNN algorithm: the user-based one [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], by
identifying users interested in similar contents; and the item-based
approach [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], by focusing on items shared by two or more
users.
      </p>
      <p>In kNN, the weight (i.e., a measure of interest) of an element
ei for an user uk can be de ned as:
w(uk; ei) =</p>
      <p>
        X
ua2N(uk)
r(ua; ei) c(uk; ua);
(1)
where N (uk) are the neighbors of user uk and r(ua; ei) is
equal to 1 if user ua is associated to the event ei, and 0
otherwise. The coe cient c(uk; ua) represents the neighbor's
information weight for user uk. In most of the kNN-based
algorithms [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], the coe cient used is the similarity between
uk and ua.
      </p>
      <p>Most Popular. The MostPopular algorithm can be de ned
by means of eq. (1), assuming the number of neighbors
unbounded, which implies N (uk) = U; 8uk 2 U ; and c(ua; ub) =
1; 8ua; ub 2 U , with U as the set of all users. Thus, the
weight is modi ed as w(uk; ei) = Pua r(ua; ei).</p>
      <p>After calculating the weight of all elements, they are sorted
in descendant order. In the MostPopular algorithm, as the
set of neighbors is independent of the user, all users
receive the same recommended elements, i.e., the most popular
ones.</p>
      <p>Rec2. In order to provide personal suggestions, we have to
de ne a similarity function for grouping similar users (items)
from which choosing the appropriate elements to
recommend. Our de nition of similarity is based only on implicit
feedbacks, resulting from observing the behavior of users: if
she records something, then we assume that she is interested
in it; otherwise, we can not infer anything about the interest
of the user for that element. We are therefore considering
binary feedbacks.</p>
      <p>
        Given two users u and v and the associated discrete events
Eu and Ev, we can choose the similarity metric, S(u; v),
considering several well known measures (e.g., Dice, Cosine
and Matching) [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. After choosing a metric, 8u we can
compute the subset Nu U of neighbors of user u. A user
v such that Ev \ Eu 6= ; is thus de ned as a neighbor of u.
Starting from the neighborhood of u, the similarity with u is
computed for each pair &lt; u; v &gt; such that v 2 Nu. Finally,
if S(u; v) &gt; 0, we consider u similar to v. The value S(u; v)
is used to weight such a relation, therefore determining a
similarity order among the neighborhood of u, from which
choosing new events to recommend to u.
      </p>
      <p>Similarly, this approach can be adopted for the item-based
similarity: two events are considered similar if the share at
least a single user that is associated to both of them.</p>
    </sec>
    <sec id="sec-7">
      <title>5. EVALUATION</title>
      <p>In the following, we evaluate the obtained results in the
event extraction process and in the recommendation of new
events to users, both in Most Popular and in Rec2.</p>
    </sec>
    <sec id="sec-8">
      <title>5.1 Event Extraction</title>
      <p>As a remainder, we are dealing with several independent,
user generated recording schedules, that we cluster together
and from which we compute the discrete events. In Figure 1,
a view of the distribution of the recordings is given: for each
detected event, the number of recordings clustered together
changes according to users' activity. As it turns out, most
recordings (and, thus, most users) tend to be clustered and
aggregated on very few events, while there are lots of events
with very few recordings. The Most Popular algorithm
exploit these inner features of the resulting discrete events to
compute the top chart.</p>
    </sec>
    <sec id="sec-9">
      <title>5.2 Computing Recommendation</title>
      <p>
        We measure how accurate is the recommendation in
predicting the elements that users would program in terms of
recall. These values are computed as the average of all users'
recall values using the top n recommended elements [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
10-6100
101
      </p>
      <p>
        102
number of recordings
103
104
We are giving particular emphasis on the recall measure; in
fact, since we do not have explicit feedbacks regarding the
user's interest in those items which have not been
considered (i.e., not programmed, nor downloaded), precision is
not very meaningful [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>First, we choose di erent similarity functions to understand
whether similarity in uences the results of the user-based
kNN algorithm. From Figure 2(a) it is clear that, in this
case, all chosen similarity metrics show nearly the same
performance.</p>
      <p>The second step is to nd the optimal value for k. Figure
2(b) shows the results with k 2 f100; 300; 500; 700; 2000g
in user-based kNN (Dice similarity), and the
MostPopular recommender. We omit the values of k = f500; 700g
since the results are almost equal to k = 300. Compared
to the MostPopular algorithm (i.e., unbounded neighbors),
a value k = 100 is not enough to outperform it, whilst for
k = 2000, kNN starts to converge to it. Considering the top
10 recommended elements, we can achieve the best results
for k = 300, whilst k = 500 is more suitable when taking
further elements. As in most cases 10 elements are su cient
for a recommendation, k = 300 o ers a good trade-o
between valuable recommendations and resource consumption
for building the neighborhood.</p>
      <p>
        A comparison among user/item-based kNN and
MostPopular is depicted in Figure 2(c). We can observe that the
latter is clearly outperformed by the other two algorithms,
especially when more than 7 recommended items are
considered. The user-based algorithm performs slightly better
than the item-based one (more noticeable with more than
15 recommended items). In general, item-based algorithms
tend to perform better because usually the number of items
is considerably lower than the users [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], but this property
does not hold in our domain.
      </p>
    </sec>
    <sec id="sec-10">
      <title>6. CONCLUSION</title>
      <p>In this paper we show how to recommend live events to
users without any knowledge about the broadcast content
30
30%
25%
lcae20%
R
15%
10%
5%
0%0
0%0</p>
      <p>Dice similarity
Cosine similarity
Matching similarity
25
30</p>
      <p>15
10 top selection
20
5
(a) Comparison between similarity
functions in user-based kNN
(b) Recall for user-based kNN
(c) Recall for kNN (k = 300) wrt
MostPopular
and user's likes. Recommendations can be given both
globally and personally. It is important to underline that the
most popular events are easier to predict since users tend to
naturally focus on them, even without any speci c
suggestion. On the contrary, granting a high novelty in personal
recommendations is a more challenging goal due to the
reduced amount of explicit information. Nevertheless, we can
obtain interesting results even exploiting a simple approach
as the kNN. We are currently attempting other approaches
to recommendation (e.g., latent factor model) with implicit
feedbacks, with the aim of improving the prediction
accuracy.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Basso</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Milanesio</surname>
          </string-name>
          , and
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Ru o. Events discovery for personal video recorders</article-title>
          .
          <source>In EuroITV '09: Proceedings of the seventh european conference on European interactive television conference</source>
          , pages
          <volume>171</volume>
          {
          <fpage>174</fpage>
          , New York, NY, USA,
          <year>2009</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>P.</given-names>
            <surname>Baudisch</surname>
          </string-name>
          and
          <string-name>
            <given-names>L.</given-names>
            <surname>Brueckner</surname>
          </string-name>
          .
          <article-title>Tv scout: Guiding users from printed guides to personalized tv program</article-title>
          .
          <source>In In Proceedings of the 2nd Workshop on Personalization in Future TV (May</source>
          <volume>28</volume>
          ,
          <string-name>
            <surname>Malaga</surname>
          </string-name>
          , Spain), Universidad de Malaga, pages
          <volume>151</volume>
          {
          <fpage>160</fpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Blanco-Fernandez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. J.</given-names>
            <surname>Pazos-Arias</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gil-Solla</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ramos-Cabrer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Barragans-Mart nez</surname>
          </string-name>
          , M.
          <string-name>
            <surname>Lopez-Nores</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Garc</surname>
            a-Duque,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Fernandez-Vilas</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <surname>R. P.</surname>
          </string-name>
          <article-title>D az-</article-title>
          <string-name>
            <surname>Redondo</surname>
          </string-name>
          .
          <article-title>A multi-agent open architecture for a tv recommender system: A case study using a bayesian strategy</article-title>
          .
          <source>Multimedia Software Engineering</source>
          , International Symposium on, pages
          <volume>178</volume>
          {
          <fpage>185</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>A. L.</given-names>
            <surname>Buczak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Zimmerman</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Kurapati</surname>
          </string-name>
          . Personalization:
          <article-title>Improving ease-of-use, trust and accuracy of a tv show recommender</article-title>
          .
          <source>In in Proceedings of the TV'02 workshop on Personalization in TV, Malaga</source>
          , pages
          <volume>3</volume>
          {
          <fpage>12</fpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>P.</given-names>
            <surname>Cremonesi</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Turrin</surname>
          </string-name>
          .
          <article-title>Analysis of cold-start recommendations in iptv systems</article-title>
          .
          <source>In RecSys '09: Proceedings of the third ACM conference on Recommender systems</source>
          , pages
          <volume>233</volume>
          {
          <fpage>236</fpage>
          , New York, NY, USA,
          <year>2009</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D.</given-names>
            <surname>Das</surname>
          </string-name>
          and H. ter Horst.
          <article-title>Recommender systems for tv</article-title>
          .
          <source>In In Proceedings of AAAI</source>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M.</given-names>
            <surname>Deshpande</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Karypis</surname>
          </string-name>
          .
          <article-title>Item-based top-n recommendation algorithms</article-title>
          .
          <source>ACM Trans. Inf</source>
          . Syst.,
          <volume>22</volume>
          (
          <issue>1</issue>
          ):
          <volume>143</volume>
          {
          <fpage>177</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J. L.</given-names>
            <surname>Herlocker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Konstan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Borchers</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>An algorithmic framework for performing collaborative ltering</article-title>
          .
          <source>In SIGIR '99: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval</source>
          , pages
          <volume>230</volume>
          {
          <fpage>237</fpage>
          , New York, NY, USA,
          <year>1999</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Hu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Koren</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Volinsky</surname>
          </string-name>
          .
          <article-title>Collaborative ltering for implicit feedback datasets</article-title>
          .
          <source>In ICDM '08: Proceedings of the 2008 Eighth IEEE International Conference on Data Mining</source>
          , pages
          <volume>263</volume>
          {
          <fpage>272</fpage>
          , Washington, DC, USA,
          <year>2008</year>
          . IEEE Computer Society.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>S. G.</given-names>
            <surname>Kaushal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Gutta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kurapati</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Martino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Milanski</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. D.</surname>
          </string-name>
          <article-title>Scha er, and</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Zimmerman</surname>
          </string-name>
          .
          <article-title>Tv content recommender system</article-title>
          .
          <source>In In Proceedings of the 17th National Conference on Arti cial Intelligence</source>
          , pages
          <fpage>1121</fpage>
          {
          <fpage>1122</fpage>
          . AAAI Press / The MIT Press,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>B.</given-names>
            <surname>Markines</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Cattuto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Menczer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Benz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hotho</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G.</given-names>
            <surname>Stumme</surname>
          </string-name>
          .
          <article-title>Evaluating similarity measures for emergent semantics of social tagging</article-title>
          .
          <source>In WWW '09: Proceedings of the 18th international conference on World wide web</source>
          , pages
          <volume>641</volume>
          {
          <fpage>650</fpage>
          , New York, NY, USA,
          <year>2009</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Rovira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Gonzalez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lopez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Mas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Puig</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Fabregat</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G.</given-names>
            <surname>Fernandez.</surname>
          </string-name>
          <article-title>Indextv: a mpeg-7 based personalized recommendation system for digital tv</article-title>
          .
          <source>In ICME</source>
          , pages
          <volume>823</volume>
          {
          <fpage>826</fpage>
          . IEEE,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>B. M.</given-names>
            <surname>Sarwar</surname>
          </string-name>
          , G. Karypis,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Konstan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. T.</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>Application of dimensionality reduction in recommender system - a case study</article-title>
          .
          <source>In In ACM WebKDD Workshop</source>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>B. M.</given-names>
            <surname>Sarwar</surname>
          </string-name>
          , G. Karypis,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Konstan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. T.</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>Item-based collaborative ltering recommendation algorithms</article-title>
          .
          <source>In WWW '01: Proceedings of the 10th international conference on World Wide Web</source>
          , pages
          <volume>285</volume>
          {
          <fpage>295</fpage>
          , New York, NY, USA,
          <year>2001</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>K. K. Srinivas</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Gutta</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <article-title>Scha er</article-title>
          , J. Martino, and
          <string-name>
            <given-names>J.</given-names>
            <surname>Zimmerman</surname>
          </string-name>
          .
          <article-title>A multi-agent tv recommender</article-title>
          .
          <source>In In Proceedings of the UM 2001 workshop "Personalization in Future TV"</source>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>