<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A New Recommender System for the Interactive Radio Network FMhost</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Vasily Zaharchuk</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dmitry Ignatov</string-name>
          <email>dignatov@hse.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andrey Konstantinov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sergey Nikolenko</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>National Research University Higher School of Economics</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>St. Petersburg Academic University</institution>
          ,
          <addr-line>St. Petersburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Steklov Mathematical Institute</institution>
          ,
          <addr-line>St. Petersburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>72</fpage>
      <lpage>83</lpage>
      <abstract>
        <p>We describe a new recommender system for the Russian interactive radio network FMhost. The new recommender model combines collaborative and user-based approaches. The system extracts information from tags of listened tracks for matching user and radio station pro les and follows an adaptive online learning strategy based on user history. We also provide some basic examples and describe the quality of service evaluation methodology.</p>
      </abstract>
      <kwd-group>
        <kwd>music recommender systems</kwd>
        <kwd>interactive radio network</kwd>
        <kwd>ecommerce</kwd>
        <kwd>quality of service</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction and related work</title>
      <p>
        Music recommendation is an important topic in the eld of recommender
systems; see, e.g. the proceedings of International Society for Music Information
Retrieval Conference (ISMIR ) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], Workshop on Music Recommendation and
Discovery (WOMRAD) [
        <xref ref-type="bibr" rid="ref2 ref3">2,3</xref>
        ], and Recommender Systems conference (RecSys)
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Although such services as LastFm, Yahoo!LaunchCast and Pandora are well
known, they work on a commercial basis and, moreover, the latter two of them do
not broadcast for Russia. Despite many high-quality papers on di erent aspects
of music recommendation, there are only few studies on radio station
recommender systems for online services.
      </p>
      <p>
        This work is devoted to the Russian online radio hosting service FMhost
and, in particular, its new hybrid recommender subsystem. Recently, the focus
of computer science research for the music industry has shifted from music
information retrieval and exploration [
        <xref ref-type="bibr" rid="ref5 ref6 ref7">5,6,7</xref>
        ] to music recommender services [
        <xref ref-type="bibr" rid="ref8 ref9">8,9</xref>
        ]. The
topic is not new (see, e.g., [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]); however, it is now inspired by new capabilities
of large online services to provide not only millions of tracks for listening to, but
even radio station hosting. Social tagging is also one of the important factors
which allows to apply new tag-similarity based recommender algorithms to the
domain [
        <xref ref-type="bibr" rid="ref11 ref12">11,12</xref>
        ].
      </p>
      <p>
        Recently, a widely acclaimed public contest on music recommender
algorithms, KDD Cup, was held by Yahoo! (http://kddcup.yahoo.com/). In KDD
Cup, track 1 was devoted to learning to predict users' ratings of musical items
(tracks, albums, artists and genres) in which items formed a taxonomy. Each
track belonged to an album, albums belonged to artists, and together they were
tagged by genres. Track 2 aimed at the developing learning algorithms for
separating tracks scored highly by speci c users from tracks not scored by them.
It attracted a lot attention from the community to problems which are both
typical for recommender systems and speci c for music recommendation:
scalability issues, capturing the dynamics and taxonomical properties of items [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
The current trends of music recommender systems re ect advantages of hybrid
approaches and show the need for user-centric quality measures [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. For
instance, in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] an interesting approach based on \forgetting curve" to evaluate
\freshness" of predictions was proposed. In [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], the authors posed an important
question, namely how much metadata do we need in music recommendation,
and after a subjective evaluation of 19 users the authors concluded that pure
content-based methods can be drastically improved by using genres.
      </p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], the authors proposed the music recommender system Starnet for
social networking. It generates recommendations based either on positive ratings of
friends (social recommendations), positive ratings of others in the network
(nonsocial recommendations), and it also makes random recommendations. Another
interesting online music recommendation system we can mention is Hotttabs
[
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], dedicated to guitar learning. Some authors aim at improving music
recommender systems by using semantic extraction techniques [
        <xref ref-type="bibr" rid="ref19 ref20">19,20</xref>
        ]. Paper [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]
describes a system of genre recommendation for music and TV programs, which
can be considered as an alternative channel selector. The authors of paper [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]
proposed a recommender system GroupFan which is able to aggregate
preferences of group users to their mutual satisfaction.
      </p>
      <p>Many online services (e.g., Last.fm or LaunchCast) call their audio streams
\radio stations", but in reality they produce a playlist from a database of tracks
based on a recommender system rather than actually recommend a radio
channel. FMhost, on the other hand, provides users with online radio stations in the
classical meaning of this term: there are human DJs who perform live, a radio
station actually represents a strategy or mood of a certain person (DJ), they
play their own tracks, perform contests etc. Thus, the problem we are solving
di ers from most of the work done in music recommendation, and some of the
challenges are unique.</p>
      <p>The paper is organized as follows. In Section 2, we describe our online service
FMhost. In section 3, we propose our new recommender model, two basic
recommender algorithms, and describe the recommender system architecture. Quality
of Service (QoS) measurement for the system and some insights on FMhost user
behaviour are discussed in Section 4. Section 5 concludes the paper.</p>
    </sec>
    <sec id="sec-2">
      <title>Online service FMhost.me</title>
      <p>2.1</p>
      <sec id="sec-2-1">
        <title>A concise online broadcasting dictionary</title>
        <p>Before we proceed, we need to shortly explain some basic domain terminology.</p>
        <p>A chart is a radio station track rating; for example, the rock chart shows
a certain number (say, 10) of most popular rock tracks, ranked from the most
popular (rank 1) to the least popular (rank 10) according to the survey. A live
performance (or just live for short) is a performance to which one or several
DJs (disk jockeys ) are assigned. They do it from their own PCs, and the audio
stream is being redirected from them to the Icecast server and then everywhere.
Also they may have their own blog for each live, where people may interact with
DJs who perform live. LiquidSoap is a sound generator that broadcasts audio
les (*.mp3, *.aac etc.) into an audio stream. Icecast is a retranslation server
that redirects audio stream from one source, for example LiquidSoap, to many
receivers.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>The FMhost project</title>
        <p>FMhost is an interactive radio network. This portal allows users to listen and
broadcast their own radio stations. There are four user categories in the portal:
(1) unauthorized user; (2) listener; (3) Disk Jockey (DJ); (4) radio station owner.</p>
        <p>User capabilities vary upon their status. Unauthorized listeners can listen
to any station, but they cannot vote or become DJs. They also cannot use the
recommender system and the rating system.</p>
        <p>Listeners, unlike unauthorized users, can vote for tracks, lives, and radio
stations. They can use a recommender system or rating system. They can subscribe
to lives, radio stations, or DJs. They also can be appointed to a live and become
a DJ.</p>
        <p>There are three types of broadcasting: (1) stream redirection from another
server; (2) AutoDJ translation; (3) live performance.</p>
        <p>Stream redirection applies when a radio station owner has its own server and
wants to use FMhost as a broadcasting platform, but also wants to broadcast
using his own sound generator, e.g., SamBroadcaster (http://spacial.com/
sam-broadcaster), LiquidSoap (http://savonet.sourceforge.net/) etc.
AutoDj is a special option that allows the users to play music directly from the
FMhost server. Every radio owner gets some space where he can download as
much tracks as he can, and then LiquidSoap will generate the audio stream and
the Icecast (http://www.icecast.org/) server will redirect it to the listeners.
Usually the owner sets a radio schedule which is being played.</p>
        <p>Live performances are done by DJs. Everyone who has performed live at least
once can be called a DJ. He can also be added to a radio station crew. Moreover,
a DJ can perform lives at any station, not only on his own station where he is
in a crew.</p>
        <p>FMhost was the rst project of its kind in Russia, starting in 2009. Nowadays,
following FMhost's success, there exist several radio broadcasting portals, such
as http://frodio.com/, http://myradio24.com/, http://myradio24.com/,
http://www.radio-hoster.ru/, http://www.taghosting.ru/, http://www.
economhost.com/, and even http://fmhosting.ru/. In late 2011, FMhost was
taken down for a serious rewrite of the codebase and rethinking of the
recommender system's architecture. In this paper, we describe the results of this
upgrade.</p>
        <p>The previous version of the recommender system experienced several
problems, such as tag discrepancy or personal tracks without tags at all. A survey
by FMhost with about a hundred respondents showed that more than half of
them appreciated the previous version of our recommender system and more
than 80% of the answers were positive or neutral (see Table 1); nevertheless,
we hope that the new recommender model and algorithms provide even more
accurate recommendations and make even less prediction mistakes.</p>
        <p>User opinion
I like it very much, all recommendations were relevant
Good, I like most of the radio stations
Sometimes there are interesting stations
I like only few recommended radio stations
None of the recommended stations was satisfactory
The new version features a more complex system of user interaction. Every radio
station has an owner who is not just a name but also has the ability to assign
DJs for lives, prepare radio schedule, and assign lives and programs. There will
be a new broadcasting panel for DJs that will allow them to play tracks with
additional features that were not available before, such as an equalizer or fading
between tracks. A new algorithm for the recommender system, a new rating
system, and a new chart system will be launched.</p>
        <p>The rating system has been developed to rank radio stations and DJs
according to their popularity and quality of work. A new core is being implemented
and a new concept of LiquidSoap and Icecast is being designed. The system is
designed so that to eliminate all problems that have surfaced in the previous
version.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Models, algorithms and recommender architecture</title>
      <p>3.1</p>
      <sec id="sec-3-1">
        <title>Input data and general structure</title>
        <p>Our model is based on three data matrices. The rst matrix A = (aut) tracks
the number of times user u visits radio stations with a certain tag t. Each
radio station r broadcasts audio tracks with a certain set of tags Tr. The sets
of all users, radio stations, and tags are denoted by U , R, and T respectively.
The second matrix B = (brt) contains how many tracks with a tag t a radio
station r has played. Finally, the third matrix C = (cur) contains the number
of times a user u visits a radio station r. For each of these three matrices, we
denote by vA, vB, and vC the respective vectors containing sums of elements:
vA = P aut, vB = P brt, and vC = P aur. We also denote for each matrix
t2T t2T r2R
A, B, C the corresponding frequency of visits matrix by Af , Bf , and Cf ; the
frequency matrix is obtained by normalizing the matrix with the respective visits
vector, e.g., Af = (aut (vuA) 1). Our model is not purely static; the matrices A,
B, and C change after a user u visits a radio station r with a tag t, i.e., each
value aut, brt, and cur is incremented by 1 after this visit.</p>
        <p>The model consists of three main blocks: the Individual-Based Recommender
System (IBRS) model, the Collaborative-Based Recommender System (CBRS)
model, and the End Recommender Systems (ERS) that aggregates the results
of the former two.</p>
        <p>
          Each model has its own algorithmic implementation. Since both our previous
works [
          <xref ref-type="bibr" rid="ref23 ref24">23,24</xref>
          ] and this work implicitly use biclustering ideas, we continue to
name our general algorithms with the RecBi acronym; this time it is the RecBi3
family. We call the resulting algorithms for the three proposed models RecBi3.1,
RecBi3.2, and RecBi3.3, respectively. Here we do not use notation from formal
concept analysis, but refer to [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ] for the basic notation used in our previous
algorithms RecBi2.1 and RecBi2.2.
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>IBRS</title>
        <p>The IBRS model uses matrices Af and Bf and aims to provide a particular user
u0 2 U with top N recommendations represented mathematically by a special
structure T opN (u). Formally, T opN (u0) is a triple (Ru0 ; u0 ; rank), where Ru0
is the set of at most N radio stations recommended to a particular user u0, u0
is a well-de ned quasiordering (re exive, transitive, and complete) on the set
Ru0 , and rank is a function which maps each radio station r from Ruo to [0; 1].</p>
        <p>The RecBi3.1 algorithm computes the 1-norm distance between a user u0
and a radio station r, i.e.m d(u0; r) = P t 2 T jau0t brtj. Then all distances
between the user u0 and the radio stations r 2 R are calculated. Further the
algorithm constructs the relation u0 according to the following rule: ri rj
i d(u0; ri) d(u0; ri). The function rank operates on Ru0 according to the
following rule:
rank(ri) = 1
d(u0; ri)= max d(u0; rj ):
rj2R
Finally, after selecting N radio stations for N greatest rank values in the set
Ru0 , we have the structure T opN (u0) which represents a ranked list of radio
stations recommended to the user u0.</p>
        <p>
          As shown in Fig. 1, our model takes into account not only listened tracks but
also liked tracks, liked radio stations, and favorite radio stations. To re ne the
IBRS submodel we tune it with the SMARTS algorithm known from decision
making theory [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. According to the method and expert decisions, we should
count each track tag of a listened radio station, liked radio station, liked track,
and favorite radio station with a di erent weight. The SMARTS procedure
provided us with the four weights for listened radio station, liked radio station,
favorite radio station, and liked track according to our experts' assessment of
mutual criterion importance, namely 0:07, 0:16, 0:3, and 0:47. In the SMARTS
method, we consider each tag type as a criterion with two terminal values 0 and
100% on a real number scale. Some tag t may have some or even four of these
types simultaneously; in this case, the algorithm adds to aut the total weight of
the tag (i.e., the sum of weights) after a user u visits some radio station with
this tag. In case there are several elements with the same rank so that T opN (u)
is not uniquely de ned, we simply choose the rst elements according to some
arbitrary ordering (e.g., the lexicographic ordering of station names).
The CBRS model is based on the Cf matrix. The matrix also yields a vector
nC which stores the total number of listened stations for each user u 2 U . This
vector also changes over time, and this value is used as a threshold to transform
matrix Cf to distance matrix D as follows:
dij =
jcfir cfjrj; if cfir ni 1and cfjr nj 1
jcfir + cfjrj; if cfir &gt; ni 1and cfjr &lt; nj 1or vice versa
(1)
        </p>
        <p>This distance takes into account the frequency nuC of all radio station visits
for user u and considers its inverse value as a threshold to decide whether a
particular station r should be considered as popular for this user. Thus, users
with di erent signs of cfir ni 1 and cfjr nj 1 become more distant than for
the conventional absolute distance. This distance dij actually serves as a sort of
polarizing lter, and in Section 4 we compare it with common approaches.</p>
        <p>After computing D, the algorithm RecBi3.2 constructs the list T opk(u0) =
(Uu0 ; u0 ; sim) of k users similar to our target user u0 who awaits
recommendations, where sim(u) = 1 duu0 = um02aUx du0u0 . We de ne the set of all radio stations
user u0 listened to as L(u0) = frjcfur = 0g. In a similar way, we de ne
T opN (u0) = (Ru0 ; u0 ; rank); where
rank(r) = sim(u ) cfu r and
u = arg</p>
        <p>max
u2Uu0 ;r2U=L(u0)
sim(u) cfur:
It is worth mentioning that rank : r 7! [0; 1]. The problem of choosing exactly
N topmost stations is solved in the same way as in the IBRS submodel.
3.4</p>
        <p>
          ERS
After IBRS and CBRS have nished, we are left with two ranked lists of
recommended stations T opIN (u0) and T opCN (u0) for our target user u0 from IBRS and
CBRS respectively. The ERS submodel proposes a simple solution for
aggregating these lists into the nal recommendation structure T opEN (u0) = (RuE0 ; uE0
; rankE ). For every r 2 RuC0 [ RuI0 , the function rankE (r) maps r to the weighted
sum
rankC (r) + (1
) rankI (r);
where we let 2 [
          <xref ref-type="bibr" rid="ref1">0,1</xref>
          ], rankC (r) = 0 for all r 62 RC and rankI (r) = 0 for all
r 62 RI . The algorithm RecBi3.3 adds the best N radio stations according to
this criterion to the set RuC0 .
4
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Quality of service assessment</title>
      <p>
        To evaluate the quality of the developed system, we propose a variant of the
cross-validation technique [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. Before we proceed to the detailed description of
the procedure, we discuss some important analyses that we conducted on the
FMhost data for the period from 2009 till 2011.
      </p>
      <sec id="sec-4-1">
        <title>Basic statistics</title>
        <p>
          It is a well-known fact that social networking data often follows the so called
power law distribution [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ]. To decide which amount of active users or radio
stations we have to take into account for making recommendations, we performed
a simple statistical analysis of user and radio station activity. Around 20% of
the users (only registered ones) were analysed.
        </p>
        <p>W = P ( 2)=( 1);
which means that the fraction W of the wealth is in the hands of the richest P
of the population. In our case, 50% of users make 80% of all radio station visits,
and 50% of radio stations have 83% of all visits. Thus, if the service tends to
take into account only active stations and users, it can cover 80% of all visits
by considering only 50% of their active audience. However, new radio stations
still deserve to be recommended, so this rule can only be applied to the user
database.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Quality assessment</title>
        <p>To evaluate QoS for the IBRS subsystem (RecBi3.1 algorithm), we count average
precision and recall on the set RN R, where N is a number of randomly
\hidden" radiostations. We suppose that for all r in RN and every user u 2 U
the algorithm does not know whether the radio stations were liked, added to
favorites, or even visited, and we change Af and R accordingly. Then RecBi3.1
attempts to recommend Top-N radio stations for this modi ed matrix Af .</p>
        <p>Top-N average precision and recall are computed as follows:
;
:
;
:</p>
        <p>To deal with CBRS, we use a modi cation of the leave-one-out technique. At
each step of the procedure for a particular user u, we \hide" all radio stations
r 2 RN by setting cfur = 0. Then we perform RecBi3.2 assuming that cfu0r is
unchanged for u0 2 U=u. After that we compute</p>
        <p>To tune the ERS system, we can use a combination of these two procedures
trying to nd the optimal as
= arg max
2 Precision Recall
(Precision + Recall)</p>
        <p>We suppose that in one month of active operation we will have enough
statistics to tune and choose appropriate similarity and distance measures as well as
Precision = u2U</p>
        <p>Recall = u2U</p>
        <sec id="sec-4-2-1">
          <title>P jRuI\Lu\RN j</title>
          <p>jLu\RuIj
jU j
P jRuI\Lu\RN j
jLu\RN j
jU j
Precision = u2U
Recall = u2U</p>
        </sec>
        <sec id="sec-4-2-2">
          <title>P jRuC\Lu\RN j</title>
          <p>jLu\RuCj
jU j
P jRuC\Lu\RN j
jLu\RN j
jU j
thresholds. We suppose that the resulting system will provide reasonably
accurate recommendations using only a single (last) month of user history and only
50% of the most active users. For quality assessment during the actual operation,
we will compute Top-3, Top-5, and Top-10 Precision and Recall measures as well
as whether the system provides a user only with Top-10 items with a highest
rank. In addition, online surveys can be launched to assess user satisfaction with
the new RS system.
5</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and further work</title>
      <p>
        In this work, we have described the underlying models, algorithms, and the
system architecture of the new improved FMhost service. We hope that the
developed algorithms will help a user to nd relevant radio stations to listen to.
In future optimization and tuning, special attention should be paid to
scalability issues and user-centric quality assessment. We consider matrix factorization
techniques as a reasonable tool to increase scalability, but it has to be carefully
adapted and assessed taking into account the folksonomic nature of tracks tags.
Another attractive feature of the developed system is that it can serve as a kind
of World of Music map built on track-to-track similarity matrices with tags [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
Another important issue is dealing with the triadic relational nature of data
(users, radio stations (tracks), and tags), which constitutes the so called
folksonomy [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ], a primary data structure in tagging resource-sharing systems. As
shown in [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ], this data can be successfully mined by means of triclustering, so
we also plan to build a tag-based recommender system by means of triclustering.
Acknowledgments. We would like to thank Rustam Tagiew, Jonas Poelmans
and Mykola Pechenizkiy for their comments, remarks and explicit and implicit
help during paper preparations. Work of Sergey Nikolenko has been supported
by the Russian Foundation for Basic Research grant 12-01-00450-a, the Russian
Presidential Grant Programme for Young Ph.D.'s, grant no. MK-6628.2012.1,
for Leading Scienti c Schools, grant no. NSh-3229.2012.1, and RFBR grants
1101-12135-o -m-2011 and 11-01-00760-a.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Klapuri</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leider</surname>
          </string-name>
          , C., eds.
          <source>: Proceedings of the 12th International Society for Music Information Retrieval Conference</source>
          ,
          <string-name>
            <surname>ISMIR</surname>
          </string-name>
          <year>2011</year>
          , Miami, Florida, USA, October
          <volume>24</volume>
          -
          <issue>28</issue>
          ,
          <year>2011</year>
          . In Klapuri,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Leider</surname>
          </string-name>
          , C., eds.: ISMIR, University of Miami (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Anglade</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baccigalupo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Casagrande</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Celma</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lamere</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <source>Workshop report: Womrad</source>
          <year>2010</year>
          . In Amatriain,
          <string-name>
            <given-names>X.</given-names>
            ,
            <surname>Torrens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Resnick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Zanker</surname>
          </string-name>
          , M., eds.: RecSys, ACM (
          <year>2010</year>
          )
          <volume>381</volume>
          {
          <fpage>382</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Anglade</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Celma</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fields</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lamere</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McFee</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Womrad: 2nd workshop on music recommendation and discovery</article-title>
          .
          <source>In: Proceedings of the fth ACM conference on Recommender systems. RecSys '11</source>
          , New York, NY, USA, ACM (
          <year>2011</year>
          )
          <volume>381</volume>
          {
          <fpage>382</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <source>RecSys '11: Proceedings of the fth ACM conference on Recommender systems</source>
          , New York, NY, USA, ACM (
          <year>2011</year>
          )
          <fpage>609116</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Hilliges</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holzer</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , Kluber, R.,
          <string-name>
            <surname>Butz</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Audioradar: A metaphorical visualization for the navigation of large music collections</article-title>
          . In Butz, A.,
          <string-name>
            <surname>Fisher</surname>
            ,
            <given-names>B.D.</given-names>
          </string-name>
          , Kruger,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Olivier</surname>
          </string-name>
          , P., eds.:
          <source>Smart Graphics</source>
          . Volume
          <volume>4073</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2006</year>
          )
          <volume>82</volume>
          {
          <fpage>92</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Gleich</surname>
            ,
            <given-names>D.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rasmussen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lang</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhukov</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The world of music: User ratings; spectral and spherical embeddings; map projections</article-title>
          .
          <source>Online report</source>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Gleich</surname>
            ,
            <given-names>D.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhukov</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rasmussen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lang</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>The World of Music: SDP Embedding of High Dimensional data</article-title>
          .
          <source>In: Information Visualization</source>
          <year>2005</year>
          .
          <article-title>(2005) Interactive Poster</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Brandenburg</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dittmar</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gruhne</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abeer</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lukashevich</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dunker</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grtner</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wolter</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grossmann</surname>
          </string-name>
          , H.:
          <article-title>Music search and recommendation</article-title>
          . In Furht, B., ed.:
          <article-title>Handbook of Multimedia for Digital Entertainment</article-title>
          and Arts. Springer US (
          <year>2009</year>
          )
          <volume>349</volume>
          {
          <fpage>384</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Celma</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Music Recommendation and Discovery - The Long Tail, Long Fail, and Long Play in the Digital Music Space</article-title>
          . Springer (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Avesani</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Massa</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nori</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Susi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Collaborative radio community</article-title>
          .
          <source>In: Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems. AH '02</source>
          , London, UK, UK, Springer-Verlag (
          <year>2002</year>
          )
          <volume>462</volume>
          {
          <fpage>465</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Symeonidis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruxanda</surname>
            ,
            <given-names>M.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nanopoulos</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Manolopoulos</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Ternary semantic analysis of social tags for personalized music recommendation</article-title>
          . In Bello,
          <string-name>
            <given-names>J.P.</given-names>
            ,
            <surname>Chew</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Turnbull</surname>
          </string-name>
          , D., eds.: ISMIR. (
          <year>2008</year>
          )
          <volume>219</volume>
          {
          <fpage>224</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Nanopoulos</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rafailidis</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Symeonidis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Manolopoulos</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Musicbox: Personalized music recommendation based on cubic analysis of social tags</article-title>
          .
          <source>IEEE Transactions on Audio, Speech &amp; Language Processing</source>
          <volume>18</volume>
          (
          <issue>2</issue>
          ) (
          <year>2010</year>
          )
          <volume>407</volume>
          {
          <fpage>412</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Koenigstein</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dror</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koren</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Yahoo! music recommendations: modeling music ratings with temporal dynamics and item taxonomy</article-title>
          .
          <source>In: Proceedings of the fth ACM conference on Recommender systems. RecSys '11</source>
          , New York, NY, USA, ACM (
          <year>2011</year>
          )
          <volume>165</volume>
          {
          <fpage>172</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Celma</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lamere</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Music recommendation and discovery revisited</article-title>
          .
          <source>In: Proceedings of the fth ACM conference on Recommender systems. RecSys '11</source>
          , New York, NY, USA, ACM (
          <year>2011</year>
          ) 7{
          <fpage>8</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Hu</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ogihara</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Nextone player: A music recommendation system based on user behavior</article-title>
          .
          <source>[1] 103{108</source>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Bogdanov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herrera</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>How much metadata do we need in music recommendation? a subjective evaluation using preference sets</article-title>
          . [
          <volume>1</volume>
          ]
          <fpage>97</fpage>
          {
          <fpage>102</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Mesnage</surname>
            ,
            <given-names>C.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ra</surname>
            <given-names>q</given-names>
          </string-name>
          , A.,
          <string-name>
            <surname>Dixon</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brixtel</surname>
            ,
            <given-names>R.P.</given-names>
          </string-name>
          :
          <article-title>Music discovery with social networks</article-title>
          .
          <source>In: Workshop on Music Recommendation and Discovery</source>
          <year>2011</year>
          , Workshop on Music Recommendation and Discovery (
          <year>October 2011</year>
          )
          <volume>1</volume>
          {
          <fpage>6</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Barthet</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anglade</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fazekas</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kolozali</surname>
          </string-name>
          , Sefki Macrae, R.:
          <article-title>Music recommendation for music learning: Hotttabs, a multimedia guitar tutor</article-title>
          .
          <source>In: Workshop on Music Recommendation and Discovery</source>
          <year>2011</year>
          , Workshop on Music Recommendation and Discovery (
          <year>October 2011</year>
          )
          <volume>7</volume>
          {
          <fpage>13</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Tatl</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Birturk</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Using semantic relations in context-based music recommendations</article-title>
          .
          <source>In: Workshop on Music Recommendation and Discovery</source>
          <year>2011</year>
          , Workshop on Music Recommendation and Discovery (
          <year>October 2011</year>
          )
          <volume>14</volume>
          {
          <fpage>17</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Knees</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schedl</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Towards semantic music information extraction from the web using rule patterns and supervised learning</article-title>
          .
          <source>In: Workshop on Music Recommendation and Discovery</source>
          <year>2011</year>
          , Workshop on Music Recommendation and Discovery (
          <year>October 2011</year>
          )
          <volume>18</volume>
          {
          <fpage>25</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Knopke</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>The importance of service and genre in recommendations for online radio and television programmes</article-title>
          .
          <source>In: Workshop on Music Recommendation and Discovery</source>
          <year>2011</year>
          , Workshop on Music Recommendation and Discovery (
          <year>October 2011</year>
          )
          <volume>26</volume>
          {
          <fpage>29</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Popescu</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pu</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Probabilistic game theoretic algorithms for group recommender systems</article-title>
          .
          <source>In: Workshop on Music Recommendation and Discovery</source>
          <year>2011</year>
          , Workshop on Music Recommendation and Discovery (
          <year>October 2011</year>
          )
          <volume>7</volume>
          {
          <fpage>12</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Ignatov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poelmans</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zaharchuk</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Recommender System Based on Algorithm of Bicluster Analysis RecBi</article-title>
          . In Ignatov, D.,
          <string-name>
            <surname>Poelmans</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuznetsov</surname>
          </string-name>
          , S., eds.
          <source>: CEUR Workshop proceedings</source>
          Vol-
          <volume>757</volume>
          , CDUD'
          <fpage>11</fpage>
          - Concept Discovery in Unstructured Data. (
          <year>2011</year>
          ) pp.
          <volume>122</volume>
          {
          <fpage>126</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Ignatov</surname>
            ,
            <given-names>D.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuznetsov</surname>
            ,
            <given-names>S.O.</given-names>
          </string-name>
          :
          <article-title>Concept-based Recommendations for Internet Advertisement</article-title>
          . In Belohlavek, R.,
          <string-name>
            <surname>Kuznetsov</surname>
          </string-name>
          , S.O., eds.
          <source>: Proc. CLA 2008</source>
          . Volume Vol.
          <volume>433</volume>
          of CEUR WS., Palack University, Olomouc,
          <year>2008</year>
          (
          <year>2008</year>
          )
          <volume>157</volume>
          {
          <fpage>166</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Ganter</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wille</surname>
          </string-name>
          , R.:
          <source>Formal Concept Analysis: Mathematical Foundations. 1st edn</source>
          . Springer-Verlag New York, Inc., Secaucus, NJ, USA (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Edwards</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barron</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement</article-title>
          .
          <source>Organizational Behavior and Human Decision Processes</source>
          <volume>60</volume>
          (
          <issue>3</issue>
          ) (
          <year>1994</year>
          )
          <volume>306</volume>
          {
          <fpage>325</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Ignatov</surname>
            ,
            <given-names>D.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poelmans</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dedene</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Viaene</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>A New Cross-Validation Technique to Evaluate Quality of Recommender Systems</article-title>
          . In Kundu,
          <string-name>
            <given-names>M.K.</given-names>
            ,
            <surname>Mitra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Mazumdar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Pal</surname>
          </string-name>
          , S.K., eds.:
          <source>PerMIn</source>
          . Volume
          <volume>7143</volume>
          of LNCS., Springer (
          <year>2012</year>
          )
          <volume>195</volume>
          {
          <fpage>202</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Clauset</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shalizi</surname>
            ,
            <given-names>C.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Newman</surname>
            ,
            <given-names>M.E.J.</given-names>
          </string-name>
          :
          <article-title>Power-law distributions in empirical data</article-title>
          .
          <source>SIAM Rev</source>
          .
          <volume>51</volume>
          (
          <issue>4</issue>
          ) (
          <year>November 2009</year>
          )
          <volume>661</volume>
          {
          <fpage>703</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <given-names>Vander</given-names>
            <surname>Wal</surname>
          </string-name>
          ,
          <string-name>
            <surname>T.</surname>
          </string-name>
          : Folksonomy Coinage and De nition (
          <year>2007</year>
          ) http://vanderwal.net/folksonomy.
          <source>html (accessed on 12.03</source>
          .
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Ignatov</surname>
            ,
            <given-names>D.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuznetsov</surname>
            ,
            <given-names>S.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Magizov</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhukov</surname>
            ,
            <given-names>L.E.</given-names>
          </string-name>
          : From Triconcepts to Triclusters. In:
          <article-title>Proceedings of the 13th international conference on Rough sets, fuzzy sets, data mining and granular computing</article-title>
          .
          <source>RSFDGrC'11</source>
          , Berlin, Heidelberg, Springer-Verlag (
          <year>2011</year>
          )
          <volume>257</volume>
          {
          <fpage>264</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>