<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Exploiting Latent Social Listening Representations for Music Recommendations</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Chih-Ming Chen</string-name>
          <email>cmchen@citi.sinica.edu.tw</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Po-Chuan Chien</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yu-Ching Lin</string-name>
          <email>aaronlin@kkbox.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ming-Feng Tsai</string-name>
          <email>mftsai@nccu.edu.tw</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yi-Hsuan Yang</string-name>
          <email>yang@citi.sinica.edu.tw</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science National Chengchi University Taipei 11605</institution>
          ,
          <country country="TW">Taiwan</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Research Center KKBOX Inc.</institution>
          <addr-line>Taipei 11501</addr-line>
          ,
          <country country="TW">Taiwan</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Research Center for Information Technology Innovation Academia Sinica Taipei 11564</institution>
          ,
          <country country="TW">Taiwan</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2015</year>
      </pub-date>
      <abstract>
        <p>Music listening can be regarded as a social activity, in which people can listen together and make friends with one other. Therefore, social relationships may imply multiple facets of the users, such as their listening behaviors and tastes. In this light, it is considered that social relationships hold abundant valuable information that can be utilized for music recommendation. However, utilizing the information for recommendation could be di cult, because such information is usually sparse. To address this issue, we propose to learn the latent social listening representations by the DeepWalk method, and then integrate the learned representations into Factorization Machines to construct better recommendation models. With the DeepWalk method, user social relationships can be transformed from the sparse and independent and identically distributed (i.i.d.) form into a dense and noni.i.d. form. In addition, the latent representations can also capture the spatial locality among users and items, therefore bene ting the constructed recommendation models.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>BACKGROUND</title>
      <p>
        Underlying almost all recommendation algorithms is an
attempt to model the interaction among users and items.
There have been some studies working on utilizing auxiliary
information for improving recommendations. In [
        <xref ref-type="bibr" rid="ref2 ref5">2, 5</xref>
        ], social
relationships are utilized to densify the ratings of users to
improve the similarity computation behind the
Collaborative Filtering-based (CF-based) methods. For the Matrix
Factorization-based (MF-based) methods, some studies focus
on how to incorporate social relations with other attributes
of users [
        <xref ref-type="bibr" rid="ref10 ref3 ref4">3, 4, 10</xref>
        ] and how to a ect the regularization term [
        <xref ref-type="bibr" rid="ref11 ref6">6,
11</xref>
        ]. In addition, the Collaborative Topic Regression (CTR)
methods [
        <xref ref-type="bibr" rid="ref1 ref8">1, 8</xref>
        ] fuse the idea of topic modeling with the
probabilistic matrix factorization on social networks, in order to
infer useful latent topics for collaborative ltering.
2.
      </p>
    </sec>
    <sec id="sec-2">
      <title>METHODOLOGY</title>
      <p>
        Figure 1 illustrates the framework of the proposed method.
We transfer the listening history and friends relationship into
a social listening graph. Given the social listening graph,
DeepWalk is used to learn the implicit representation by
seeking the possible path on the graph. The idea is to maximize
the co-occurrence patterns in each generated path so that the
potential distance is modeled. The representation, usually
presented as a vector, can encode the context information
for further processing [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. From theoretical perspective, the
social representation learning is a technique of combining the
recent developments of language modeling and unsupervised
representation learning. In this work, we use the technique
to learn the representations on a social listening graph, and
then feed the learned representations into Factorization
Machines (FM) [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. After being processed by DeepWalk, the
sparse social relations will become dense and in a non-i.i.d.
form, which can be helpful for increasing the connections
among users and items. To our best knowledge, this work is
the rst attempt to use deepwalk for music recommendation.
      </p>
      <p>To nd the possible path, we utilize random walk to
uniformly sample a series of random vertex from a graph. The
primitive graph is constructed on the sole social network.
For the speci c application of music recommendation, we
propose 3 di erent ways to construct such a social graph:
Social graph: Build the graph only based on users' friends,
which will enable DeepWalk to detect local community.
Listening graph: Build the graph only based on user-item
listening matrix, which will enable DeepWalk to identify
the association patterns about users and items.</p>
      <p>Social Listening graph: Build the graph based on the
above two relations including the user-user and user-item
matrices, which may hopefully fuse the merits of the
preceding two approaches.
3.</p>
    </sec>
    <sec id="sec-3">
      <title>EXPERIMENTS</title>
      <p>Our experiments involve two real-world music datasets {
hetrec2011-lastfm-2k and KKBOX-50K. The rst one is a
public benchmark dataset derived Last.fm. The second one is
collected from a music streaming company KKBOX. Table 2
shows some statistics of the datasets.</p>
      <p>We randomly hold out 80% records for each user as the
training data. The remaining 20% records of all users are</p>
      <p>U1
U2
U3
U4</p>
      <p>I1
I2
I3
I4
I5
I6</p>
      <p>U1
U1</p>
      <p>I2
I3
I2
U4</p>
      <p>U4
U2</p>
      <p>I5</p>
      <p>U4U1 I2</p>
      <p>I1</p>
      <p>I4</p>
      <p>X
(d) Latent Representations
(a) Given Matrices (b) Built Graphs (c) Random Walks (e) Designed Matrix for FM</p>
      <p>Figure 1: Exploring latent social listening representations for music recommendation.
Approach
Sole User-to-Item
Friendship Indexes
Random Social Graph
Social Graph
Listening Graph
Social Listening Graph
treated as the testing item pool. Instead of using pure
precision, we use recall and mean average precision (MAP)
as the performance measurements. We repeat the evaluation
process 5 times with di erent randomly selected training sets
and report the average performance.</p>
      <p>Since FM model is already a promising approach of
MFbased model, we directly perform all the experiments based
on FM, including a) one primitive approach that uses pure
user-to-item matrix, b) one baseline approach that directly
uses friendship indexes as auxiliary feature c) one testing
approach that builds the graph by randomly generated
social links and d) three proposed approaches that integrate
di erent types of latent representation in correspondingly.</p>
      <p>Evaluation results are reported in Table 1.</p>
      <p>Social links are much more sparser than the case of
userto-item ratings so that direct use of friendship is ine ective.</p>
      <p>Besides, combing the social graph with listening graph is
able to lter out the inadequate connections. Consequently,
we can see that the use of social listening graph leads to
about 60% relative improvement to baseline approach (i.e.</p>
      <p>Friendship Indexes) for hetrec2011-lastfm-2k dataset and
about 20% of improvement for KKBOX-50K dataset in terms
of MAP and recall measurements. A randomly generated
social graph is also examined for verifying the e ectiveness
of social relations in music data. It can be found that the
random graph leads to inferior result than the proposed ones</p>
    </sec>
    <sec id="sec-4">
      <title>4. CONCLUSIONS AND FUTURE WORK</title>
      <p>We propose a novel method that bridges unsupervised
representation learning for social links and context-aware
factorization model for recommendations. According to the
experimental results, direct use of friendship indices as
features does not perform well. Among the three proposed ways
for building the graph, integrating the latent representation
learned from the social listening graph achieves the best
improvement in both MAP and recall measurements.</p>
      <p>In current work, all the connections are considered to have
the same weight (i.e. the binary response) and some types of
connections are omitted (i.e. the item-to-item connections).
Hence, it is possible to earn better performance by, for
example, assigning numeric weights to the connections or adding
item-to-item connections. We leave these as future work.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>C.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Zheng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Hong</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Lin</surname>
          </string-name>
          .
          <article-title>Context-aware collaborative topic regression with social matrix factorization for recommender systems</article-title>
          .
          <source>In Proc. AAAI</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>W.-S.</given-names>
            <surname>Hwang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.-W.</given-names>
            <surname>Kim</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Lee</surname>
          </string-name>
          .
          <article-title>Data imputation using a trust network for recommendation</article-title>
          .
          <source>In Proc. WWW Companion</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M.</given-names>
            <surname>Jiang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Cui</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Yang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Zhu</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Yang</surname>
          </string-name>
          .
          <article-title>Social contextual recommendation</article-title>
          .
          <source>In Proc. ACM CIKM</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>X.</given-names>
            <surname>Liu</surname>
          </string-name>
          and
          <string-name>
            <given-names>K.</given-names>
            <surname>Aberer. Soco</surname>
          </string-name>
          :
          <article-title>A social network aided context-aware recommender system</article-title>
          .
          <source>In Proc. WWW</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>C.</given-names>
            <surname>Luo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Pang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Lin</surname>
          </string-name>
          .
          <article-title>Hete-cf: Social-based collaborative ltering recommendation using heterogeneous relations</article-title>
          .
          <source>In Proc. IEEE ICDM</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>H.</given-names>
            <surname>Ma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Zhou</surname>
          </string-name>
          , C. Liu,
          <string-name>
            <given-names>M. R.</given-names>
            <surname>Lyu</surname>
          </string-name>
          ,
          <string-name>
            <surname>and I. King.</surname>
          </string-name>
          <article-title>Recommender systems with social regularization</article-title>
          .
          <source>In Proc. ACM WSDM</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>B.</given-names>
            <surname>Perozzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Al-Rfou</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Skiena</surname>
          </string-name>
          . Deepwalk:
          <article-title>Online learning of social representations</article-title>
          .
          <source>In Proc. ACM KDD</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>S.</given-names>
            <surname>Purushotham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Liu</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Kuo</surname>
          </string-name>
          .
          <article-title>Collaborative topic regression with social matrix factorization for recommendation systems</article-title>
          .
          <source>CoRR</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>S.</given-names>
            <surname>Rendle</surname>
          </string-name>
          .
          <article-title>Factorization machines with libFM</article-title>
          .
          <source>ACM Trans. Intell. Syst. Technol.</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>X.</given-names>
            <surname>Yang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Steck</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Liu</surname>
          </string-name>
          .
          <article-title>Circle-based recommendation in online social networks</article-title>
          .
          <source>In Proc ACM KDD</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>Q.</given-names>
            <surname>Yuan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Chen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Zhao</surname>
          </string-name>
          .
          <article-title>Factorization vs. regularization: Fusing heterogeneous social relationships in top-n recommendation</article-title>
          .
          <source>In Proc. ACM RecSys</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>