<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>ACM Conference on Recommender Systems (RecSys),
September</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Choice-based recommender systems</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Paula Saavedra</string-name>
          <email>paula.saavedra@usc.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rosa Crujeiras</string-name>
          <email>rosa.crujeiras@usc.es</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pablo Barreiro</string-name>
          <email>pablobv70@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>María Loureiro</string-name>
          <email>maria.loureiro@usc.es</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Roi Durán</string-name>
          <email>roiduram@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Eduardo Sánchez Vila</string-name>
          <email>eduardo.sanchez.vila@usc.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>CITIUS, University of Santiago de</institution>
          ,
          <addr-line>Compostela, Santiago de Compostela</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Business, University of Santiago de</institution>
          ,
          <addr-line>Compostela, Santiago de Compostela</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>School of Mathematics, University of Santiago de</institution>
          ,
          <addr-line>Compostela, Santiago de Compostela</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2016</year>
      </pub-date>
      <volume>15</volume>
      <issue>2016</issue>
      <abstract>
        <p>Choice-based models are proposed to overcome some of the limitations found in traditional rating-based strategies. The new approach is grounded on decision-making paradigms, such as choice and utility theories. Speci cally, random utility models were applied in a recommendation problem. Prediction accuracy was compared with state-of-art ratingbased algorithms in a gastronomy dataset. The results show the superior performance of choice-based models, which may suggest that real choices could bring more predictive power than ratings.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Recommender systems are personalization tools aimed at
suggesting relevant items on the basis of available
information on items as well as decision-makers [5]. Broadly
speaking, recommenders can be classi ed in two di erent
categories. Content-based recommenders generate a pro le for
each decision-maker by considering items experienced in the
past. The pro le typically represents the preferences of the
decision-maker, i.e the taste of the decision-maker on each
item's attributes [2]. These preferences can be used to
predict the utility of any given item by comparing them with the
values of item's attributes. Collaborative recommenders, on
the other hand, take advantage of previous ratings provided
by the available decision-makers to predict the utility of any
given user-item pair [6]. This approach has been widely
adopted as it removes the burden of knowing and managing
item attributes as well as their corresponding values.</p>
      <p>Many algorithms and models have been proposed under
the collaborative paradigm. Among them, two families have
gained major attraction: neighborhood algorithms and
latent factor models. The neighborhood approach was the
rst to implement to collaborative concept and became the
reference model in this research area [9, 4]. The method
consists on representing vectors of ratings on either the
decisionmaker or item space. The distance between any pair of these
vectors determine the similarity between either the
decisionmakers or the items that these vectors represent. Individuals
with similar rating's vectors are considered to possess similar
tastes or preferences, while items are considered to have
similar attributes. The latent factor strategy, in turn, attempts
to explain ratings by means of characterizing both users and
items with a limited set of factors. Factors are considered
unknown variables that can be inferred from the ratings
declared by the users. The inference or learning problem can
be solved with factorization techniques. The classical
factorization method is called Singular Value Decomposition
(SVD) and was applied successfully to identify and reduce
the number of relevant factors [10]. However, the method
requires complete knowledge of the rating matrix and ll-in
methods to populate sparse rating matrix come at a cost of
inaccurate factor learning. Recently, new factorization
techniques have been successfully developed that are capable of
learning the factors from sparse rating matrices [7]. Each
rating is explained by means of two vectors whose
dimensions correspond with the set of latent factors. The rst
vector represents the item in terms of its degree of
possesion of each factor, while the second vector represent the
decision-maker on the basis of her preference on each factor.
These item and decision-maker vectors constitute a pair of
matrices whose values have to be inferred. The learning
problem is solved by means of minimizing the regularized
error on the set of known ratings.</p>
      <p>
        Despite the success of current recommender systems, the
experience with state-or-art approaches reveal some
important limitations. First, the degree of performance of a
recommender algorithm depends on the speci c issues of the
problem at hand. Therefore, heuristic models and trial-and-error
methodologies are often used to look for the best solution
for any given situation. The problem may be approached
in a more theoretical and consistent way if recommenders
were considered as agents predicting the decisions taken by
decision-makers. Under this scope, the rst limitation could
be stated as follows: (L1) Current state-of-art approaches
are mostly based on heuristic models rather than
decisionmaking theories. Second, some popular paradigms assume
a direct relationship between preferences and ratings: (
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
the neighborhood approach considers that decision-makers
with similar ratings on a set of items will have similar
preferences, and (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) factorization techniques assume that ratings
can be the result of a product between item's latent factors
and decision-maker preferences about that factors. In these
paradigms unobserved preferences are usually inferred from
observed ratings. The issue here comes from the fact that
ratings could be mostly explained by variables di erent to
preferences. The quality of the item, the user-item context,
and in general any factor involved during the process of
experiencing the item, they all could provide more explanatory
power about ratings than preferences do. Therefore, the
second limitation could be described as follows: (L2)
Preferences are usually derived from ratings without any
supporting evidence about the relationship between these variables.
      </p>
      <p>This work proposes choice-based recommender systems to
overcome these limitations. The concept is grounded on
choice and utility theory, where real choices replace ratings
as the key data to learn the decision-maker's preferences as
well as to make recommendations. The proposed models are
then evaluated in the tourism domain with a gastronomy
dataset that includes both choices and ratings. In what
follows, the choice-based models are presented, the
methods are described, and the models evaluated and compared
against state-of-art rating-based algorithms. The discussion
will comment on the results and highlight the major
contributions of the paper.</p>
    </sec>
    <sec id="sec-2">
      <title>CHOICE MODELS 2. 2.1</title>
    </sec>
    <sec id="sec-3">
      <title>Recommendation as a choice problem</title>
      <p>
        The recommendation problem can be described as an
optimization problem which consists on (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) estimating the
utility of each item a 2 A, the available item set, for any given
decision-maker c, and (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) choosing the item a0 that
maximizes U (c; a), the decision-maker utility on any item a [1]:
a0 = arg max U (c; a)
a2A
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
      </p>
      <p>It is worth noting that this problem is conceptually the
same as the one faced by the Rational Choice Theory, which
aims at explaining economic behaviour under choice
situations [11]. The theory states that a decision-maker will
maximize her utility after satisfying some budget constraints.
More formally, the decision-maker will choose alternative a0
from a choice set A according to the following rule:
CR(A; ) = fa0 2 A k a0
where CR stands for "choice rule" and the operator
denotes the relationship "preferred to, or at least as preferred
as". Basically, it means that the chosen alternative will be
the one from which the decision-maker shows a higher
preference. The preference operator needs to be quanti ed to
allow a numerical comparison between the alternatives.</p>
      <p>The utility theory comes to the rescue to solve this
problem. One of the axioms of this theory states that it is
possible to de ne a utility function such that:
a
b () U (a)</p>
      <p>U (b):
And then, the choice rule in equation 2 can be represented
in terms of the utility function and a numerical operator:
CR(A; ) = fa0 2 A k U (a0)
U (a); 8a 2 Ag:</p>
      <p>
        It is now clear that the new choice rule is
mathematically equivalent to the recommendation problem described
in equation 1:
(
        <xref ref-type="bibr" rid="ref3">3</xref>
        )
(
        <xref ref-type="bibr" rid="ref4">4</xref>
        )
a0 = arg max U (c; a) ()
a2A
CR(A; ) = fa0 2 A k U (a0)
U (a); 8a 2 Ag: (
        <xref ref-type="bibr" rid="ref5">5</xref>
        )
      </p>
      <p>As the recommendation problem can be understood as a
choice prediction problem, then the powerful models and
techniques developed in this eld can be naturally applied
to generate recommendations.
2.2</p>
    </sec>
    <sec id="sec-4">
      <title>Choice models with random utility</title>
      <p>The choice rule models how decision-makers take their
decisions. However, the problem of predicting such
decisions is a di erent task. In real problems the researcher
does not have access to all the factors and variables that
decision-makers include to estimate utilities. For a concrete
individual cn, the researcher only knows some attributes
of the alternatives, labeled xj for all aj alternatives with
j 2 f1; ; J g, and some attributes of the decision-maker,
labeled zn. A function that relates these observed factors to
the decision-maker's utility can be speci ed. This function
is denoted by Vnj = V (xj ; zn) and it is often called
representative utility. It usually depends on parameters that are
unknown and, therefore, they must be estimated.</p>
      <p>Since there are aspects of utility that the researcher does
not or cannot observe, Vnj 6= Unj . Therefore, the utility can
be decomposed as:</p>
      <p>
        Unj = Vnj + nj
(
        <xref ref-type="bibr" rid="ref6">6</xref>
        )
where nj captures the unknown factors that modify the
utility and are not included in Vnj . This decomposition is
fully general, since nj is de ned as simply the di erence
between true utility Unj and the part of utility that the
researcher captures in Vnj . Given its de nition, the
characteristics of nj , such as its distribution, depend critically on
the researcher's speci cation of Vnj . The researcher does not
know nj for all j and therefore these terms are considered
random variables that allow the researcher to make
probabilistic statements about the decision-maker's choice. The
models derived under this assumptions are called random
utility models (RUM) [8].
      </p>
      <p>Now, the choice rule of equation 4, which is deterministic
under the decision-maker perpective, becomes probabilistic
under the perspective of the researcher. Then the rule for a
decision-maker cn choosing alternative ai is:
choosing the alternative that she was observed actually to
choose is
CR(A; ) = fai 2 A k Pi</p>
      <p>
        Pj; 8aj 2 Ag
(
        <xref ref-type="bibr" rid="ref7">7</xref>
        )
and the probability Pi is estimated as follows:
      </p>
      <p>P(Uni &gt; Unj for all j 6= i) =</p>
      <p>P( nj
ni &lt; Vni</p>
      <p>
        Vnj for all j 6= i): (
        <xref ref-type="bibr" rid="ref8">8</xref>
        )
If the joint density of n = ( n1; :::; nJ ) is denoted by f , this
cumulative probability can be rewritten as:
where I is the indicator function, equaling 1 when the term
in parentheses is true and 0 otherwise. This is a
multidimensional integral over the density of the unobserved portion of
utility, f ( n). Di erent choice models are obtained from
different speci cations of this density, that is, from di erent
assumptions about the distribution of the unobserved portion
of utility. In addition, the choice of the density determines
whether the integral takes a closed form or not [12].
      </p>
      <p>The simplest and most widely used choice model is the
standard logit model [8]. It is derived under the assumption
that the each unobserved portion of utility nj is distributed
independently, identically extreme value. In this case, f
denotes the density for Gumbel distribution:</p>
      <p>f ( nj) = e nj e e nj :
Following [8], the logit choice probability that decision-maker
cn chooses alternative i is</p>
      <p>Pni =</p>
      <p>
        eVni
P eVnj
j
:
(
        <xref ref-type="bibr" rid="ref10">10</xref>
        )
(
        <xref ref-type="bibr" rid="ref11">11</xref>
        )
This model presents a clear interpretation. According to
equation 11, if Vni rises, re ecting a matching between the
observed attributes of the alternative and the preferences
of the decision-maker, with Vnj for all j 6= i held constant,
Pni approaches one. And Pni approaches zero when Vni
decreases, since the exponential in the numerator approaches
zero as Vni approaches 1.
      </p>
      <p>The representative utility is usually speci ed to be linear
in the set alternative's attributes: Vnj = nj xj, where xj
is a vector containing, as before, the observed variables of
the alternative aj, and nj denotes the model coe cients
vector which describes the preferences of decision-maker cn
on the attributes of the alternatives aj. The preferences nj
(model coe cients) are estimated by tting equation 11 to
a dataset of choices. Moreover, since the logit probabilities
take a closed form, maximum likelihood procedures are
applied for estimation. Concretely, the probability of person
cn choosing the alternative that he was actually observed to
choose can be expressed as</p>
      <p>Y Pynnii ;
i
where yni = 1 if the individual choses i and zero otherwise.
Since yni = 0 for non-chosen alternatives and Pni raised to
the power of zero is 1, this term is simply the probability
of the chosen alternative. Assuming that decision-maker's
choices are independent, the probability of each individual
L( ) = Y Y Pynnii</p>
      <p>n i
where denotes the vector of all model parameters.
Therefore, the log-likelihood function is</p>
      <p>LL( ) =</p>
      <p>X X yni log Pni
n i
and the estimator is the value of that maximizes this
function. Importantly, it was proved that the log-likelihood
function with these choice probabilities is globally concave in
parameters , which helps in the numerical maximization
procedures, see [8] for more details.</p>
      <p>A well-known issue of standard logit model deals with
capturing the heterogeneity of population [12]. The
importance that decision-makers place on each attribute of the
possible choices varies, in general, over decision-makers.
Although logit model is able to represent the taste variation
related to observed characteristics of the decision-maker, it
can not represent di erences in tastes that can not be linked
to observed characteristics. Therefore, if taste variation is at
least partly random, a logit model with random parameters
should be considered instead. Under this considerations,
is now a vector of random coe cients and these coe cients
vary over decision-makers in the population with density g.
In most applications that have actually been called mixed
logit, g is speci ed to be continuous. For example, it can
be speci ed to be normal, lognormal, uniform, triangular
or, even, gamma. Therefore, this density is a function of
parameters that represent, in the gaussian case, the mean
and covariance of the random coe cient in the population.
Then, the choice probabilities can be written as:
Pni =</p>
      <p>Z</p>
      <p>
        eVni( )
P eVnj( )
j
!
g( j )d :
(
        <xref ref-type="bibr" rid="ref12">12</xref>
        )
Since the previous integral has not a closed form, it must
be evaluated numerically through simulation. Once the
researcher speci es a distribution g for the coe cients, the
parameters maximizing the simulated log-likelihood must be
estimated. Then, R draws of the coe cients are taken from
g and the logit probabilities are computed for every draw.
The unconditional probability in equation 12, that is the
expected value of the conditional probabilities, is estimated as
the average of R probabilities determined previously.
3.
      </p>
    </sec>
    <sec id="sec-5">
      <title>METHODS</title>
      <p>The performance of choice-based models is compared with
a choice of relevant rating-based algorithms from a
gastronomic dataset containing the choices of snacks made by a
set of decision-makers and their corresponding tapa ratings.
The dataset is described in Sections 3.1 and 3.2. Technical
details on the two recommendation alternatives considered
in this work are brie y presented in Sections 3.3 and 3.4.
Finally, the error criteria used to compare them are introduced
in Section 3.5.
3.1</p>
    </sec>
    <sec id="sec-6">
      <title>Experiment</title>
      <p>In the context of the RECTUR project, an experiment
was carried out with real users in the context of
Santiago(e)Tapas, a gastronomic context that takes place every
year in Santiago de Compostela. In 2011 the fourth
edition was held with a total of 56 participating restaurants
proposing and elaborating up to three tapas that were sold
at a price of 2 euro. The experiment was designed to gather
relevant data while preserving the spirit of the contest.
Participants were local users as well as Spanish and
international tourists. A TapasPassport with the o cial
information about the contest was made available to all
participants. It contained: (i) the contest guidelines and other
related information to the participants, (ii) restaurants
location, (iii) the tapas o ered on each restaurant, (iv) an
o cial seal to demonstrate that a participant has visited
the minimum number of restaurants required to obtain
contests gifts. Restaurant sta had to sign the TapasPassport
to certify that its owners have visited the place.</p>
      <p>After consuming a tapa, participants were asked to
evaluate their experience. Users had to provide two ratings
ranging from 0 to 5: (i) a rating of the tapa, and (ii) a rating of
the overall experience (service, place atmosphere, etc.). In
addition, they were informed about our research experiment
and asked to extend their feedback providing information
about the temporal and social context in which the
experience took place.
3.2</p>
    </sec>
    <sec id="sec-7">
      <title>RECTUR Dataset</title>
      <p>The data gathered in the experiment was collected in the
RECTUR dataset. It is assumed that the choice of a tapa
depends on the user preferences about the levels of tapa
attributes, which will in turn depend on the user attributes
and context elements. The consumption of a tapa
determines a choice from a choice set and will elicit a satisfaction
response quanti ed as a user rating.</p>
      <p>For each tapa, we gathered the following attributes:
Choice sets. Di erent choice sets could be de ned for
each choice. We acquired information about the
following sets:
{ Set of tapas in the same area of the city (outlying,
new or old zone).</p>
      <p>{ Set of tapas in the same restaurant.</p>
      <p>Tapa attributes. The gathered attributes are:
{ Type: Cheese, egg, sh, meat, vegetable, shell sh
and other. The main ingredient de ned the type
of the tapa.
{ Character: Traditional or daring. Traditional tapas
are those that follow popular well-known recipes,
while daring tapas are creative and provide
innovative recipes.
{ Restaurant. The restaurant that o ers the tapa
was also categorized in terms of its location
(outlying, new or old area), atmosphere and style.</p>
      <p>Rating. The rating provided by each consumer.
3.3</p>
    </sec>
    <sec id="sec-8">
      <title>Choice-based models</title>
      <p>The standard logit model as well as the mixed logit model
assuming Gaussian distribution on the coe cients, both
described in Section 2.3, were chosen as basic representatives of
the family of random utility choice-based models to be
compared with rating-based algorithms. From attributes type
and character of each tapa described in Section 3.2, eight
binary variables associated to each alternative (or snack)
were generated for tting these two models. Next, the
construction of the variables is brie y described through an
example. The choice set associated to the old area contains, as
possible choices, the set of tapas distributed in restaurants
of this zone. For each one of these snacks, the
dichotomous variables cheese, egg, sh, meat, vegetable, shell sh
and traditional are generated. According to Figure 2, the
main ingredient of t100 is meat. However, this tapa is not
traditional. Therefore, only the variable meat will be equal
to 1. The rest of variables associated to t100 will take the
value zero.</p>
      <p>Within the discrete choice framework, the set of
alternatives known as the choice set must verify three properties.
It has to be nite, exhaustive (the decision-maker always
chooses one of the alternatives) and mutually exclusive (the
choice of one alternative necessarily implies not choosing
any of the other ones). Due to the last property, three
different choice subsets were established in this work. They
correspond to the three possible restaurant locations (old,
new and outlying areas of the city). Therefore, standard
and mixed logit models are estimated separately from these
three choice subsets that contain only the tapas associated
to each zone. This assumption could be less general. For
instance, considering the set of tapas of a concrete restaurant
would provide a new choice set and, as consequence, a new
choice problem.</p>
      <p>Estimations results for these six models are shown in
Section 4.2. For the same area of the city, standard and mixed
logit models present similar estimations for the coe cients.
As consequence, only prediction accuracy of the standard
logit model was compared with rating-based algorithms.
3.4</p>
    </sec>
    <sec id="sec-9">
      <title>Baselines: Rating-based models</title>
      <p>The proposed choice-based models were compared with
two popular rating-based models: User-based collaborative
ltering (UBCF) and matrix factorization (MF). User-based
collaborative ltering assumes that individuals with similar
preferences will rate items in a similar way. Then,
missing ratings for a concrete user cn could be predicted
nding a neighborhood N (n) of similar users and aggregating
their ratings to calculate the corresponding prediction. The
concept of similarity between users is used for de ning this
neighborhood given all users within a similarity threshold.
In this work, the cosine similarity measure is taken into
account and jN (n)j was xed equal to 25. For an item i and
an individual cn, the ratings predicted, r^ni, can be written
as
r^ni =
1</p>
      <p>X
jN (n)j j2N(n)
rji
where j j denotes the cardinal of N (n).</p>
      <p>Matrix factorization, on the other hand, characterizes both
items and users by vectors of factors inferred from item
rating patterns. For a given item i and a user cn, the vector
qi measure the extent to which the item possesses those
factors and the vector pn, the extent of interest the user has
in items that are high on the corresponding factors. The
dot product qiT pn captures the user's interest in the item's
characteristics. This approximates user cn's rating of item
i, rni, leading to the estimate
r^ni = qiT pn:
1
.
4
il,f
sh
ehS
1
.
t,4ea .,3e4
M t
e
w
S
i,.sh42F .,38ggE
5
.
3
il,f
sh
heS
4
i,
shF
8
.
3
,
seee
h
C
5
.
4
t,
e
e
w
S
t,.reh45O t,.reh43O .2
4
,t
a
e
M
0
0
2
d
e
m
csonu 150
spa
a
ftr
o
e
b
uNm 001
edum 030
scsapon
a
ftr
o
e
ubNm 020
0
5
0
0
0
1
0
.,t43ee .,t44eew
w S
9 S
.
3
,t
a
e
M
5
.
3
,t
a
e
M
5
.
4
lif,
sh
heS
8
.
3
i,
shF
Therefore, the challenge is computing the mapping of each
item and user to vectors qi and pn. Here, singular value
decomposition will be applied factoring the user-item rating
matrix that could be sparse. In order to learn the factor
vectors (pn and qi), the regularized squared error on the set
of known ratings is minimized:
min X (rni qiT pn)2 + (kqik2 + kpnk2)
q ;p
where K is the set of the (cn; i) pairs for which rni is known,
k k is the Euclidean norm and denotes a constant
controlling the extent of regularization. In this work, = 1:5.</p>
    </sec>
    <sec id="sec-10">
      <title>3.5 Evaluation</title>
      <p>Classical ranking error metrics could not be applied mainly
because of the lack of information about all the relevant
tapas for the decision-maker on any choice situation.
Therefore, two error metrics are proposed in order to compare
the behaviour of choice-based and rating-based algorithms.
The metrics are described considering that only the tapa
4
,t
a
e
M .1
4
i,
shF
1
.
4
i,
shF
2
.
4
l,
e
i,.s3h9F tegeabV
3
,t
a
e
M
1
.
4
i,
shF
4
,r
e
h
t
O
.,t39aeM i,.s4h3F .63
,t
a
e
M</p>
      <p>8
l,.t3e1aebgeV il.,fs23hehS t,.ea3M
Daring
Traditional
Maximum and minimum rating means
3
.
3
i,t
n
e
d
e
ir
g
n
ssng
ii
M
9
.
3
i,
shF
0
0
4
0
0
3
0
0
1
0
0
0
1
0
4
3
.
3
l,
e
b
a
t
e
egV
7
.
3
i,
shF
5
.
4
ilf,
sh
heS
9
.
3
t,
a
e</p>
      <p>M
4
.
4
,t
a
e
M
2
.
4
il,f
sh
ehS
5
.
3
,
seee
h
C
with the highest associated rating or probability is
recommended/predicted (top 1). Error I is equal to one if the item
predicted does not coincide with the true alternative chosen
by the individual and zero otherwise. Therefore, given an
individual cn, the true choice i and the recommended item
j is:
error I (cn; i) =</p>
      <p>The second measure of error, error II, is equal to the
position of the real choice in the ordered list of
recommendation minus one. Therefore, if the item recommended is
equal to the chosen one then the error is equal to zero. Let
(i1; :::; ik; :::; iJ ) be the list of ordered items to be
recommended, the error for the user cn with true choice i can be</p>
      <p>For instance, if one decision-maker cn chose the snack t1
among the snacks (t1; t104; t105; ) and the prediction
(ordered according to the highest ratings or probabilities)
is equal to (t105; t104; t1; ), then error I (cn; t1) = 1.
However, error II (cn; t1) = 2.</p>
      <p>Error I and error II can be generalized easily if a list of a
concrete number of ordered items (in terms of probabilities
or ratings) is recommended instead of recommending only
one alternative. These two errors are equal to zero if, for an
individual cn, the true choice i belongs to the recommended
list of items. Otherwise, error I will take the value one and
error II, the position of the true choice i in the ordered list
of non-recommended alternatives. In this work, a list of ve
alternatives will be considered (top 5).
4.1</p>
    </sec>
    <sec id="sec-11">
      <title>RESULTS</title>
    </sec>
    <sec id="sec-12">
      <title>Data description</title>
      <p>RECTUR dataset presented in Section 3.2 deals with 5517
individuals, that make one or a sequential choices of one tapa
among a set of 113 tapas distributed in Santiago de
Compostela. Acording to comments in Section 3.3, three subsets
of the original dataset will be considered distinguishing three
di erent choice contexts or, equivalently, three zones of the
city.</p>
      <p>Next, the three scenarios will be brie y described.</p>
      <p>The total number of tapas consumed in new area of the
city is 3888. However, the number of di erent tapas
associated to this zone is only 37; 18 of them present a
traditional character and 19, a daring character. Furthermore,
the number of users in this area is 2030. Then, although
most of these individuals had only one snack, some of them
took several ones. Figure 1 shows the total number of tapas
that users consumed for the 37 possible choices. According
to the results, t22 and t61 were the most common choices.
However, t47 and t48 were rarely selected. According to the
information in Figure 1, only one tapa is made of eggs and
vegetables; two tapas has cheese as main ingredient; four
tapas are made of a sweet component or other; shell sh is
the ingredient of six snacks; meat and sh are the most
common components with ten and nine tapas, respectively. Tapa
ratings that users gave to one consumed tapa are available
too. The values of these ratings are 0, 1, 2, 3, 4 and 5. High
values for ratings are associated to a high customer
satisfaction. Means of tapa ratings for the 37 tapas in the new area
are shown in Figure 1. The lowest means of tapa ratings are
associated to t67, t70, t69 and t49. However, all of these
means are greater than 3. So, the level of satisfaction tends
to be high.</p>
      <p>As for the old zone of the city, a total of 8948 tapas were
consumed. As before, the number of di erent snacks
associated to this zone is only 62; 32 of them present a traditional
character and 30, a daring character. Furthermore, the
number of users in this area is 3953. As before, although most
of these individuals had only one snack, some of them took
several ones. Figures 2 and 3 show the total number of
daring and traditional tapas that users consumed for the 62
possible choices, respectively. According to the results, t101
was the most common choice. However, t37, t103 and t102
were rarely selected. As regards means of snack ratings, the</p>
      <sec id="sec-12-1">
        <title>Cheese</title>
        <p>Egg
Fish</p>
        <p>Meat
Shell sh</p>
        <p>Sweet
Vegetable</p>
        <p>Traditional
Log-Likelihood:</p>
      </sec>
      <sec id="sec-12-2">
        <title>Cheese</title>
        <p>Egg
Fish</p>
        <p>Meat
Shell sh</p>
        <p>Sweet
Vegetable</p>
        <p>Traditional</p>
        <p>Log-Likelihood:
lowest ones correspond to t21 and t94. The highest ones, to
t11 and t99.</p>
        <p>The number of snacks consumed in the outlying area of the
city is 743. Again, the number of di erent snacks associated
to this zone is smaller. Concretely, it is equal to 14; 3 of them
present a traditional character and 11, a daring character.
Furthermore, the number of users in this area is 436. Figure
4 shows the total number of daring and traditional tapas
that users consumed for the 14 choices. According to the
results, t44, t45, t104 and t105 were the most chosen snacks.
However, t2 and t3 were rarely selected. The snacks t58 and
t44 correspond to the tapas with lowest and highest means
of ratings, respectively. The main ingredient of t58 is a
missing value. In addition, cheese and egg are not the main
component for any snack.
4.2</p>
      </sec>
    </sec>
    <sec id="sec-13">
      <title>Choice models fitting</title>
      <p>The standard and mixed logit models have been tted
from the three choice sets described in Section 4.1. Due to
the price is the same for every snack, the determinants of
these choices, xj, are eight dichotomous alternative speci c
variables. Seven of them indicate the main component of
each tapa: Cheese, egg, sh, meat, shell sh, sweet and
vegetable. The eighth variable takes value equal to one when
the snack has a traditional character. In addition, for mixed
logit model, Gaussian distribution was assumed on the
coe cients and R = 100 was xed.</p>
      <p>Outlying zone</p>
      <p>The coe cients obtained are shown for each area of the
city in Tables 1 and 2, respectively, and most of them are
signi cant in the three areas of the city. For the mixed logit
model (Table 2), only the mean estimations of Gaussian
distributions are shown. As for the utility, positive coe cients,
see egg and meat in Table 1 for the old zone, increase its
value. However, negative coe cients, see egg and traditional
in Table 1 for the new area, reduce it.
4.3</p>
    </sec>
    <sec id="sec-14">
      <title>Choice-based vs rating-based predictions</title>
      <p>The behaviour of choice-based and rating-based models
for recommending tapas in the three areas of the city was
analyzed using random sub-sampling and leave-one-out cross
validation from RECTUR dataset.</p>
      <p>For random sub-sampling validation, 100 iterations were
considered using the 25% of randomly selected individuals
as test data for predictions. Therefore, in each iteration and
once the 25% of decision-makers was randomly selected, the
rest of individuals is used as trainning data for rating-based
algorithms or for tting the choice model. Then, for each
decision-maker in the test data and for each recommendation
method, prediction error measures introduced in Section 3.5
can be determined. The procedure for leave-one-out cross
validation is similar. In this case, the number of iterations
is equal to the number of users and, in each iteration, the
test data contains an only decision-maker.</p>
      <p>Tables 3, 4, and 5 contain the empirical means of errors
decribed previously for the new, old and outlying areas of the
city, respectively. According to results shown in Section 4.2,
standard and mixed logit models provide similar estimations
for model coe cients. Therefore, only the rst choice-based
model, the standard logit one, were taken into account to
be compared with the rating-based algorithms.</p>
      <p>The results show that choice-based models o er a better
performance (lower prediction errors) compared with
ratingbased schemes (UBCF and MF). See, in particular, error II
for the top 5 scheme taking into account the di erent
number of tapas recommended in each area of the city.
Furthermore, the accuracy of predictions is reduced as long as the
choice set increases from the outlying to the old area, which
indicates the importance of the choice set and the choice
situation.</p>
    </sec>
    <sec id="sec-15">
      <title>DISCUSSION</title>
      <p>The main point of this work is that the recommendation
problem can be considered as a choice prediction problem.
This is the main di erence of our proposal compared with
current paradigms in recommender systems that focus on
rating prediction. The key aspects of our choice-based
mod</p>
      <sec id="sec-15-1">
        <title>Choice model</title>
      </sec>
      <sec id="sec-15-2">
        <title>Error I II I</title>
        <p>
          II
els are: (
          <xref ref-type="bibr" rid="ref1">1</xref>
          ) preferences are learnt from choices, (
          <xref ref-type="bibr" rid="ref2">2</xref>
          ) the choice
set of each choice situation is included as a relevant variable
to both explain and predict future choices, and (
          <xref ref-type="bibr" rid="ref3">3</xref>
          )
unobserved factors a ecting the decision-making process are
captured through random variables. On the basis of these
elements the models presented in this paper di er from both
collaborative methods, as they infer preferences from
ratings, and content-based techniques, as they do not handle
the choice set of the items experienced in the past. Recent
content-based approaches share the same idea about the
utility of user choices to derive preferences but are limited to
pairwise rather than full choice set comparisons [3].
        </p>
        <p>
          With regard to the limitations stated in the introduction,
choice models face issue L1 by building random utility
models from solid decision-making theories, and solve issue L2 by
using choices, rather than ratings, to estimate preferences.
The drawback of gathering information about the domain
(attributes and values) is compensated in two ways: (
          <xref ref-type="bibr" rid="ref1">1</xref>
          ) by
using more accurate data, choices rather than ratings, and
(
          <xref ref-type="bibr" rid="ref2">2</xref>
          ) by removing the burden of interrogating decision-makers
about their post-experience satisfaction. In summary, choice
modelling seems to be a promising paradigm in the eld of
recommender systems.
        </p>
      </sec>
    </sec>
    <sec id="sec-16">
      <title>Acknowledgments</title>
      <p>This research was sponsored by EMALCSA/Corun~a Smart
City under grant CSC-14-13, the Ministry of Science and
Innovation of Spain under grant TIN2014-56633-C3-1-R, and
the Ministry of Economy and Competitiveness of Spain
under grant MTM2013-41383P.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>T. A. Adomavicius G</surname>
          </string-name>
          .
          <article-title>Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions</article-title>
          .
          <source>IEEE Trans. on Knowl. and Data Eng</source>
          .,
          <volume>17</volume>
          (
          <issue>6</issue>
          ):
          <volume>734</volume>
          {
          <fpage>749</fpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M.</given-names>
            <surname>Balabanovic</surname>
          </string-name>
          and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Shoham</surname>
          </string-name>
          .
          <article-title>Fab: content-based, collaborative recommendation</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>40</volume>
          (
          <issue>3</issue>
          ):
          <volume>66</volume>
          {
          <fpage>72</fpage>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>L.</given-names>
            <surname>Bledaite</surname>
          </string-name>
          and
          <string-name>
            <given-names>F.</given-names>
            <surname>Ricci</surname>
          </string-name>
          .
          <article-title>Pairwise preferences elicitation and exploitation for conversational collaborative ltering</article-title>
          .
          <source>In Proceedings of the 26th ACM Conference on Hypertext &amp; Social Media</source>
          , pages
          <volume>231</volume>
          {
          <fpage>236</fpage>
          . ACM,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J. S.</given-names>
            <surname>Breese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Heckerman</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Kadie</surname>
          </string-name>
          .
          <article-title>Empirical analysis of predictive algorithms for collaborative ltering</article-title>
          .
          <source>In Proceedings of the Fourteenth conference on Uncertainty in arti cial intelligence</source>
          , pages
          <volume>43</volume>
          {
          <fpage>52</fpage>
          . Morgan Kaufmann Publishers Inc.,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>G. M. Burke R.</given-names>
            ,
            <surname>Felfernig</surname>
          </string-name>
          <string-name>
            <surname>A</surname>
          </string-name>
          .
          <article-title>Recommender systems: An overview</article-title>
          .
          <source>AI Magazine</source>
          ,
          <volume>32</volume>
          (
          <issue>3</issue>
          ):
          <volume>13</volume>
          {
          <fpage>18</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D.</given-names>
            <surname>Goldberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Nichols</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. M.</given-names>
            <surname>Oki</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Terry</surname>
          </string-name>
          .
          <article-title>Using collaborative ltering to weave an information tapestry</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>35</volume>
          (
          <issue>12</issue>
          ):
          <volume>61</volume>
          {
          <fpage>70</fpage>
          ,
          <year>1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Koren</surname>
          </string-name>
          .
          <article-title>Factorization meets the neighborhood: a multifaceted collaborative ltering model</article-title>
          .
          <source>In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining</source>
          , pages
          <volume>426</volume>
          {
          <fpage>434</fpage>
          . ACM,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>D.</given-names>
            <surname>McFadden</surname>
          </string-name>
          et al.
          <article-title>Conditional logit analysis of qualitative choice behavior</article-title>
          .
          <year>1973</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>V. H. Resnick P</surname>
          </string-name>
          .
          <article-title>Recommender systems</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>40</volume>
          (
          <issue>3</issue>
          ):
          <volume>56</volume>
          {
          <fpage>58</fpage>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>B.</given-names>
            <surname>Sarwar</surname>
          </string-name>
          , G. Karypis,
          <string-name>
            <given-names>J.</given-names>
            <surname>Konstan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>Application of dimensionality reduction in recommender system-a case study</article-title>
          .
          <source>Technical report, DTIC Document</source>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Sen</surname>
          </string-name>
          .
          <article-title>Rational behaviour</article-title>
          .
          <source>In Utility and probability</source>
          , pages
          <volume>198</volume>
          {
          <fpage>216</fpage>
          . Springer,
          <year>1990</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>K. E.</given-names>
            <surname>Train</surname>
          </string-name>
          .
          <article-title>Discrete choice methods with simulation</article-title>
          . Cambridge university press,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>