<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>What about Interpreting Features in Matrix Factorization-based Recommender Systems as Users?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Marharyta Aleksandrova</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Anne Boyer Université de Lorraine - LORIA Campus Scientifique 54506 Vandoeuvre les Nancy</institution>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Armelle Brun Université de Lorraine - LORIA Campus Scientifique 54506 Vandoeuvre les Nancy</institution>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Oleg Chertov NTUU “KPI”</institution>
          ,
          <addr-line>37, Prospect Peremohy, 03056, Kyiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Université de Lorraine - LORIA</institution>
          ,
          <addr-line>France NTUU “KPI”</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Matrix factorization (MF) is a powerful approach used in recommender systems. One main drawback of MF is the difculty to interpret the automatically formed features. Following the intuition that the relation between users and items can be expressed through a reduced set of users, referred to as representative users, we propose a simple modi cation of a traditional MF algorithm, that forms a set of features corresponding to these representative users. On one state of the art dataset, we show that the proposed representative users-based non-negative matrix factorization (RU-NMF) discovers interpretable features, while slightly (in some cases insigni cantly) decreasing the accuracy.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Recommender systems</kwd>
        <kwd>matrix factorization</kwd>
        <kwd>features interpretation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        trix R into two low-rank matrices U (dim(U ) = K M )
and V (dim(V ) = K N ) in such a way that the product
of these matrices approximates the original rating matrix
R R = U T V . The set of K factors can be seen as a joint
latent space on which a mapping of both users and items
spaces is performed [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Features resulting from
factorization usually do not have any physical sense, what makes
resulting recommendations unexplainable. Some works [
        <xref ref-type="bibr" rid="ref2 ref3">2,
3</xref>
        ] made attempts to interpret them by using non-negative
matrix factorization with multiplicative update rules (for
simplicity, further referred to as NMF). However, the
proposed interpretation is not so easy to perform as it has to
be discovered manually. Based on the assumption that the
preferences between users are correlated, we assume that
within the entire set of users, there is a small set of users
that have a speci c role or have speci c preferences. These
users can be considered as representative of the entire
population and we intend to discover features from MF that are
associated with these representative users.
2. THE PROPOSED APPROACH: RU-NMF
Let us consider 2 linear spaces L1 and L2 of dimensionality
respectively 6 and 3, with basic vectors in canonical form
~
f~umg, m 2 1; 6 and ffkg, k 2 1; 3 . Let the transfer matrix
from L1 to L2 be speci ed by matrix (1). Then ~u5, ~u1 and
~u2 are direct preimages of f~1, f~2 and f~3 respectively, indeed,
P ~u5 = f~3. At the same time vectors ~u3, ~u4 and ~u6 will be
mapped into linear combinations of basic vectors f~1, f~2, f~3.
Matrix U can be considered as a transfer matrix from the
space of users to the space of features. Analyzing the
example considered above, we can say that if matrix U has a
form similar to (1), i.e. U has exactly K unitary columns
with one non-zero and equal to 1 element on di erent
positions, then the users corresponding to these columns are
direct preimages of the K features. The features can thus be
directly interpreted as users. These users will be referred to
as representative users. In order to force matrix U to satisfy
the imposed conditions we propose the RU-NMF approach,
that consists of 6 steps, further detailed below.
      </p>
      <p>
        Step 1. A traditional matrix factorization is performed.
Following [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ], NMF is used.
      </p>
      <p>Step 2. A normalization of each of the M column vectors of
the matrix U is performed so as to result in unitary columns.
The resulting normalized matrix is denoted by Unorm and
the vector of normalization coe cients by C.</p>
      <p>Step 3. This step is dedicated to the identi cation of the
representative users in the Unorm matrix. A user um is
considered as the best preimage candidate (representative user)
for the feature fk if the vector unmorm is the closest to the
corresponding canonical vector (a vector with the only one
non-zero and equal to 1 value on the position k). The
notion of closeness between vectors is expressed in Euclidean
distance. Once all representative users are identi ed, the
matrix Unorm is modi ed so as to obtain a matrix in a form
of (1): lines, corresponding to the representative users, are
replaced with appropriate canonic vectors. The resulting
modi ed matrix is denoted by Unmoordm.</p>
      <p>Step 4. Each column of the matrix Unmoordm is multiplied by
the appropriate normalization coe cient from the set C
resulting in matrix U mod. After this, representative users will
remain preimages of the features but with scaling factors.
Step 5. In order to obtain the best model we also have to
modify the matrix V . The modi cation of V can be
performed using optimization methods with the starting value
obtained during the rst step. As the objective of this
paper is to determine the relevance of nding preimages of the
features and to quantify the decrease in the quality of the
recommendations, we did not consider this step.
Step 6. The resulting recommendation model is made up
of matrices U mod and V (R = U mod T V ).
3. EXPERIMENTAL RESULTS
Experiments are performed on the 100k MovieLens dataset1,
with 80% of ratings used for learning the model and 20%
for testing it. The accuracy is evaluated with two classical
measures: mean absolute error (MAE) and root mean square
error (RMSE). The goal of the experiments is to compare
the accuracies of RU-NMF and NMF. For these reasons we
compute the accuracy loss = err(RU-eNrMr(FN)MFer)r(NMF) 100%
for factorizations with 10, 15 and 20 features on 30 di erent
samples. Results are presented in Table 1. A positive loss
means that NMF performs better than RU-NMF. In the
worst case the accuracy loss equals to 6.64%, for RMSE
with 20 features, which is quite small. The lowest average
accuracy loss (0:05%) is obtained with 10 features for both
errors. When comparing the accuracy loss between test and
learning sets, we can note that the average loss is 3 times
1http://grouplens.org/datasets/movielens/
10 features
mean
min
max
15 features
mean
min
max
20 features
mean
min
max
lower on test than on learning, for both errors and for all
the number of features: thus we can say that RU-NMF has
a lower relative loss between learn and test compared to
NMF. A thorough analysis of the losses obtained on the 30
samples has shown that the accuracy loss on the test set
is lower than the one on the learning set in all cases. In
some runs, RU-NMF has even a higher accuracy than NMF
(Table 1, values in gray shadow).
4. DISCUSSIONS AND FUTURE WORK
The analysis of the accuracy loss between RU-NMF and
traditional NMF has shown that prediction error rises slightly
(in some cases insigni cantly) with RU-NMF. However the
features formed with this approach consistently disturb the
accuracy on the test set less than on the learning one. This
can be considered as a potential ability of factorization
techniques with features related to reality to form better searched
predictions. The proposed approach also lets us easily
explain the resulting recommendations. Indeed, each user of
the population is linearly mapped on the basis related to
representative users (through matrix U ) and the preferences
of the latter ones (expressed by matrix V ) are used to
estimate the ratings of the whole population. In a future work,
we would like to focus rst of all on the veri cations of the
hypothesis that users associated with the features can be
really considered as representative ones. We believe that this
can be done while solving the new item cold-start problem
with ratings of the representative users on new items used
to estimate ratings of all the population on these items.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Koren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Bell</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Volinsky</surname>
          </string-name>
          , \
          <article-title>Matrix factorization techniques for recommender systems,"</article-title>
          <source>Computer</source>
          , vol.
          <volume>42</volume>
          , no.
          <issue>8</issue>
          , pp.
          <volume>30</volume>
          {
          <issue>37</issue>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>S.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Ford</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Makedon</surname>
          </string-name>
          , \
          <article-title>Learning from incomplete ratings using non-negative matrix factorization."</article-title>
          <source>in Proc. of the 6th SIAM Conf. on Data Mining</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J.-F.</given-names>
            <surname>Pessiot</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Truong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Usunier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Amini</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Gallinari</surname>
          </string-name>
          , \
          <article-title>Factorisation en matrices non-negatives pour le ltrage collaboratif,"</article-title>
          <source>in 3rd Conf. en Recherche d'Information et Applications</source>
          ,
          <year>2006</year>
          , pp.
          <volume>315</volume>
          {
          <fpage>326</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>