<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Diversified Utility Maximization for Recommendations</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Azin Ashkan</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Branislav Kveton</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Shlomo Berkovsky</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Zheng Wen</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Technicolor</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>United States</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>azin.ashkan</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>branislav.kveton</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>zheng.wen}@technicolor.com</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>CSIRO</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Australia shlomo.berkovsky@csiro.au</string-name>
        </contrib>
      </contrib-group>
      <pub-date>
        <year>2014</year>
      </pub-date>
      <abstract>
        <p>Consider the problem of recommending items to a group of users subject to the diversity of their tastes. The goal is to recommend a list of items, such that the interests of each user are covered. We cast this problem as maximizing a diversified utility function of the group, the optimal solution of which can be found greedily. We conduct a user study in order to evaluate the performance of the proposed method. Evaluation results show that our method represents an effective strategy compared to various settings in which a convex combination of utility and diversity is maximized.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>INTRODUCTION</title>
      <p>
        It is often the case that multiple users share a single account with
an online recommender, e.g., family members may share the same
account with a movie recommendation service on their TV. The use
of a single account by multiple users poses a challenge in providing
recommendations satisfying the spectrum of their tastes. One
solution to this problem is to recommend a list of diverse movies, in
order to cover a range of tastes and increase user satisfaction.
However, there exists a tradeoff between increasing the list diversity and
maintaining the utility of the results [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        Let E be the ground set of L recommendable items and w(e)
be the utility of item e 2 E. The goal is to recommend a subset
of items S E with the highest utility and diversity for users. A
common approach to diversified ranking is based on the notion of
maximal marginal relevance (MMR) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In this approach, utility and
diversity are represented by two independent metrics, and marginal
relevance is a convex combination of these metrics:
      </p>
      <p>SMMR = arg max (1</p>
      <p>
        S E:jSj=K
)w(S) +
f (S);
(1)
where K is the cardinality of S, 2 [0; 1] is a parameter that
balances the importance of utility and diversity, and w(S) is the sum
of utilities of all items in S. The utility w is a modular function
of S, whereas the diversity f is typically a submodular function of
S. Under these assumptions, the objective in Equation 1 is
submodular in S. Therefore, a (1 1=e)-approximation to the optimal
solution can be computed greedily [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>In this paper, we consider a different objective function, the
optimal solution of which can be found greedily. Our objective is to
maximize the utility of recommending a list of items to a group of
users subject to the diversity of their tastes. Items with high utility
are expected to be included in the list as long as they have a
contribution to the diversity of the list. The utility remains the primary
concern, but it is subjected to maintaining the diversity.
2.</p>
      <p>DIVERSIFIED UTILITY MAXIMIZATION
The main idea of our approach is to maximize utility weighted by
diversity and cover each increase in diversity by the item with the
highest possible utility. The increase in diversity can be viewed as
the probability that a user chooses the item, in the sense that items
that are similar to the previously recommended items are less likely
to be chosen. When the item is chosen, we would like to maximize
the satisfaction of the user, i.e., the utility of the choice. Formally,
our optimization problem is given by:
(2)
(3)
A</p>
      <p>L
= arg max X gA(ak)w(ak);</p>
      <p>A</p>
      <p>k=1
where A = (a1; : : : ; aL) is an ordered set of L items that we also
call a list, and gA 2 (R+)L is a vector of gains in diversity, where:
gA(ak) = f (Ak)
f (Ak 1)
is the gain associated with choosing item ak after choosing items
in Ak 1. The sets Ak and Ak 1 are the first k and k 1 items in
list A, respectively. We refer to our approach as diversified utility
maximization (DUM), since our objective is to maximize the utility
weighted by the increases in diversity.</p>
      <p>
        For a general function f , the problem in Equation 2 is NP-hard.
However, when f is submodular, the problem can be solved
optimally by a greedy algorithm [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. The items are ordered in
decreasing order of utility, A = (a1; : : : ; aL), where w(a1) : : :
w(aL), and they are added to the recommended list in this order.
When gA (ak) &gt; 0, item ak is added to the list. Otherwise, the
item is not added because it does not contribute to the diversity of
the list.
      </p>
      <p>The above solution is meaningful when the length of the
recommended list, i.e., the number of non-zero entries in gA , can be
controlled. This is possible for a range of submodular functions.
One such function is:
f (S) = X min
(
)
X 1fitem e covers topic tg ; Nt :
(4)
t2T</p>
      <p>e2S
Here, T is a set of topics and Nt is an integer threshold for a topic
t. For this f , the recommendation list is guaranteed to contain at
most P Nt items, such that each topic t is covered by at least
Nt mostt2reTlevant items in this topic.
3.</p>
      <p>We conduct a user study in the movie recommendation domain.
The ground set E are 1; 000 most popular movies on IMDb1. The
utility w(e) of a movie e is approximated by its overall popularity,
i.e., the number of people who rated e.</p>
      <p>DUM
The Dark Knight
LOTR 1
The Matrix
Inception
The Shining
Alien
Psycho
Shaun of the Dead
action
action
action
action
horror
horror
horror
horror
action
action
action
action
action
action
action
horror
action
action
action
action
action
action
action
action</p>
      <p>Our study consists of a set of tasks. In each task, we ask a
Mechanical Turk2 worker to consider a situation, where Bob and Alice
go for a vacation and can take several movies with them. Bob and
Alice prefer two different movie genres. The workers are asked to
rate four lists of movies, based on how these movies are appropriate
for Bob and Alice. An example questionnaire is shown in Figure 1.</p>
      <p>One list is generated by DUM. The other three lists are generated
by MMR, with 2 32 ; 31 ; 0:01 . The length of all four lists is
identical, and they are shown in random order to avoid position
bias. Each task has different movie genres t1 and t2 preferred by
Bob and Alice. We generate one task for each pair of 18 most
popular genres on IMDb and assign each task to three workers.
Thus, we obtain 3 153 = 459 ratings for each of the four lists.</p>
      <p>In each task, the diversity function f is defined as in Equation 4.
The topics are T = ft1; t2g and Nt1 = Nt2 = 4. For this
setting, DUM recommends between four to eight movies such that each
genre is covered by at least four movies. The functions w and f are
normalized such that the maximum gain in each function is 1.</p>
      <p>On average, workers spent 57:39 seconds on each task, i.e., 14.35
seconds for a list of at most 8 movies, which is reasonable to judge
whether the list covers two genres. The results of the study are
reported in Figure 2. The workers considered the lists generated
by DUM to be suitable for both Bob and Alice in 74.5% of cases.
This ratio is significantly higher than those of MMR with = 23 and
= 31 . The absolute improvement with respect to the best baseline,
MMR with = 23 , is 9.6%, while the relative improvement is 14.8%.
It is worth to note that in 70 combinations of t1 and t2 (45.8% of
cases), all three workers unanimously rated DUM as appropriate for
both Bob and Alice.</p>
      <p>Since DUM did not dominate the MMR baselines across the board,
it is important to identify cases, where it performs well. One such
2http://www.mturk.com – Amazon Mechanical Turk.
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%</p>
      <p>λ=2/3
Bob and Alice</p>
      <p>λ=1/3
Bob or Alice
example, for action and horror movies, is shown in Table 1. MMR
cannot solve this problem well for the following reasons. When
is large, MMR first chooses most diverse movies that are both
action and horror movies. These movies are less popular than horror
movies that are not action. As a result, the list is only considered as
a good representation of action movies, but not of horror movies.
On the other hand, when is small, MMR tends to choose mostly
action movies, because these movies happen to be more popular than
horror movies. So the list is again a good representation of action
movies only.
4.</p>
    </sec>
    <sec id="sec-2">
      <title>CONCLUSION</title>
      <p>We propose a method to maximize the utility of recommended
items subject to the diversity of users’ tastes. This method
guarantees that movies in the recommendation list cover various aspects of
user tastes with high utility items. We conduct a user study showing
the effectiveness of our method compared to models that maximize
a convex combination of utility and diversity. In the future, we plan
to apply DUM to other domains, such as document summarization
and Web search result diversification. We also plan to extend our
study to groups of more than two users and evaluate the
performance of DUM for various combinations of genres.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J.</given-names>
            <surname>Carbonell</surname>
          </string-name>
          and J.
          <string-name>
            <surname>Goldstein</surname>
          </string-name>
          .
          <article-title>The use of MMR, diversity based reranking for reordering documents and producing summaries</article-title>
          .
          <source>In SIGIR</source>
          , pp.
          <fpage>335</fpage>
          -
          <lpage>336</lpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>J.</given-names>
            <surname>Edmonds</surname>
          </string-name>
          .
          <article-title>Submodular functions, matroids, and certain polyhedra</article-title>
          .
          <source>In Combinatorial Optimization</source>
          , pp.
          <fpage>11</fpage>
          -
          <lpage>26</lpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>G. L.</given-names>
            <surname>Nemhauser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Wolsey</surname>
          </string-name>
          , and
          <string-name>
            <surname>M. L. Fisher.</surname>
          </string-name>
          <article-title>An analysis of approximations for maximizing submodular set functions -</article-title>
          <source>I. Mathematical Programming</source>
          ,
          <volume>14</volume>
          (
          <issue>1</issue>
          ):
          <fpage>265</fpage>
          -
          <lpage>294</lpage>
          ,
          <year>1978</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>T.</given-names>
            <surname>Zhou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Kuscsik</surname>
          </string-name>
          , J. Liu,
          <string-name>
            <given-names>M.</given-names>
            <surname>Medo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. R.</given-names>
            <surname>Wakeling</surname>
          </string-name>
          , and
          <string-name>
            <surname>Y. Zhang.</surname>
          </string-name>
          <article-title>Solving the apparent diversity-accuracy dilemma of recommender systems</article-title>
          .
          <source>National Academy of Sciences</source>
          ,
          <volume>107</volume>
          (
          <issue>10</issue>
          ):
          <fpage>4511</fpage>
          -
          <lpage>4515</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>