<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Balancing Preferences, Popularity and Location in Context-Aware Restaurant Deal Recommendation: A Bristol, Cardif and Brighton Case Study</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ercan Ezin, Hugo Alcaraz-Herrera</string-name>
          <email>ercan.ezin@bristol.ac.uk</email>
          <email>{ercan.ezin,h.alcarazherrera}@bristol.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Personalised Tourism, Restaurant Recommendation, Prefer-</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Iván Palomares</string-name>
          <email>i.palomares@bristol.ac.uk</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Bristol</institution>
          ,
          <addr-line>Bristol</addr-line>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Bristol. Bristol, United Kingdom, The Alan Turing Institute.</institution>
          <addr-line>London</addr-line>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>ence Modeling</institution>
          ,
          <addr-line>Context-Aware Recommendation, Weighting</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <fpage>38</fpage>
      <lpage>41</lpage>
      <abstract>
        <p>We propose a personalisation solution to recommend tailored restaurant deals for residents or visitors in a city. Unlike previous work on recommendations in the restaurant sector where actual venues are recommended, we focus on suggesting specific products in the form of deals ofered by such restaurants. This is done by jointly filtering relevant information for the end-user based on their food-drink preferences, the popularity of the restaurant, its proximity to the user's location and temporal constraints on the availability of deals. A real case study has been conducted upon datasets provided by Wriggle, a platform for discovering local deals in various cities across England.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 INTRODUCTION</title>
      <p>
        Personalisation services for tourism, leisure and
entertainment have been investigated for recommending
Points-ofInterest (PoIs) or sequences of them [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ], selecting suitable
cities for a group itinerary [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], or recommendations in the
hotel sector [
        <xref ref-type="bibr" rid="ref4 ref6">4, 6</xref>
        ], to name a few. This study focuses on
recommendations in the restaurant sector, which has also
attained significant attention within the tourism landscape:
in medium to large cities where both residents and visitors
alike search for new restaurants, cafes or bars amid hundreds
or thousands of available options [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], eating or drinking out
is a cornerstone activity where personalisation turns
indispensable to help them finding venues that meet their taste.
      </p>
      <p>
        Various research eforts have been made on
recommending suitable restaurants based on diferent forms of user
preferences and contextual factors [
        <xref ref-type="bibr" rid="ref10 ref8 ref9">8–10</xref>
        ]. However, these
works typically focus on recommending venues, by analysing
characteristics associated to the restaurant itself, without
looking at specific products (e.g. dishes, drinks, deals, etc.)
ofered by that restaurant or analysing how they meet the
specific user needs or preferences. Despite this is an
important decision-making step for for customers, many of them
also seek specific dishes or suitable ofers/deals that meet
their preferences to a deeper level of granularity. To our
knowledge, this is the first study to jointly consider both
(i) general aspects of restaurants (location, opening times
and popularity) and (ii) specific item features (through users’
preferences on specific types of food-drink deals), for
recommending restaurant deals for residents and visitors in a city.
Some services and apps, such as Wriggle 1, have recently
arisen in which users in Bristol, Cardif and Brighton can
search for available restaurant deals in their area.
      </p>
      <p>We present a model for recommending temporary deals
offered by restaurants, taking account of (i) users’ preferences
on food-drink categories, (ii) contextual information and (iii)
restaurant popularity. In our approach, the recommendable
items are deals ofered by restaurants, rather than
restaurants “as a whole”. We investigate the problem of weighting
(balancing) and aggregating similarity information for the
three aforesaid aspects. In addition, we conduct a case study
and a preliminary evaluation with real user and restaurant
deal data provided by Wriggle on three UK cities. The results
hint that by setting the weighting parameters for balancing
the aforesaid sources from user to user, our proposed scheme
has the potential for addressing the cold start problem (e.g.
ifrst-time visitors to a city with no purchase history), hence
becoming adaptable to both local residents and tourists.
2</p>
    </sec>
    <sec id="sec-2">
      <title>MODEL</title>
      <p>
        Let ui ∈ U be the ith user and U the set of all users. Denote
by C = {c1, . . . , cM } the set of existing food-drink categories
in the system, e.g. ’cocktails’, ’tapas’, ’Indian’, ’Chinese’, etc.
Given M categories, every user ui has associated a preference
vector Pi = (pi1 pi2 . . . piM ) where pik ∈ {0, 1} is a preference
indicator towards category ck by ui . In our current version of
the model, the value of pik is binary and determined
depending on whether the user consumed deals under ck or not. A
restaurant deal xj ∈ X , with X the set of all restaurant deals
(item set), can have associated one or more categories ck ∈ C.
Thus, we formally define a deal as a tuple xj = ⟨rxj , Cj , Vj ⟩,
1Wriggle website: https://www.getawriggleon.com/
where rxj is the restaurant that ofers the deal. Cj is the
temporal context of the deal, namely start and end date at which
the deal is available, and whether it is a lunchtime and/or
dinner time deal. Vj = (vj1 vj2 . . . vjM ) is a binary feature
vector associated with the ofer, in which vjk = 1 if the deal
xj is labeled with category ck , and vjk = 0 otherwise. Our
solution consists of two major stages: a context-based item
pre-filtering stage, and a weighted filtering stage.
Item pre-filtering. Unlike rating-based context pre-filtering
approaches in the literature [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], in our model given an item
set X (i.e. restaurant deals) context information C is firstly
used to extract a subset of data related to the items relevant
to that context. This is fundamental in domains where
contextual limitations imply that not all existing items may be
relevant or accessible by the end user at a certain place or
time. For the scope of this study focused on the Wriggle data,
we extract a subset of relevant deals to the current user and
their context, accomplishing: (i) Start-End Time: most deals
are periodical or limited and have a start-end time, therefore
the currently available deals must be filtered; (ii) Lunch or
Dinner Time: some deals are only active at lunchtime or
dinner time, hence unavailable deals at a given time of the day
are filtered out; and (iii) Dietary Requirements: although this
is a user profile feature, we pre-filter suitable deals for users
who are vegetarian or vegan.
      </p>
      <p>
        Weighted filtering. This stage applies three matching
processes and then weighs and aggregates resulting similarities:
(1) Preference Matching: It calculates the similarity between
ui preferences on food-drink categories, given by Pi , and the
specific categorical features of a deal xj , given by Vj . The
cosine similarity is determined between both one-dimensional
vectors, mα (ui , xj ) = sim(Pi , Vj ). In essence, this filtering
process entails a content-based approach relying on user
preferences and item features of deals, hence it can easily
integrate other content-based models in extant literature.
(2) Popularity Matching: This process takes the restaurant
popularity into account, based on the average customer
rating given to the restaurant. The popularity matching is
calculated as the average customer rating of the restaurant
rxj , thus mβ (ui , xj ) = pop(rxj ). Despite its simplicity, this
solution is not personalised for the end user in question,
because it is only dependent on rxj . An alternative personalised
solution would be to apply a Collaborative Filtering (CF)
algorithm to identify the K most similar users to ui who rated
rxj , based on their preference vectors Pi , and predicting how
popular the restaurant might be for ui .
(3) Location Matching: It takes the distance between
restaurants within a predefined radius and the current user location,
thereby prioritising deals from closer restaurants:
mγ (ui , xj ) = 1 −
dist (ui , rxj )
radius
(1)
One of the contributions in this study is an adaptive
weighting scheme for balancing preferences, popularity and
location. Let α , β and γ be the weighting parameters or degrees
of influence played by the preference, popularity and
location matching, respectively. Without loss of generality,
α , β, γ ∈ [
        <xref ref-type="bibr" rid="ref1">0, 1</xref>
        ] and α + β + γ = 1. The overall matching used
for selecting and recommending the top-N deals for ui , is:
m(ui , xj ) = α ·mα (ui , xj ) + β ·mβ (ui , xj ) + γ ·mγ (ui , xj ) (2)
We now describe a preliminary solution for adaptively setting
α , β and γ for every user. It is worth noting that deeper
investigation of applying more advanced optimisation or
machine learning techniques to optimally set these weights,
constitutes our immediate future work.
      </p>
      <p>The influence of α , which refers to the user preferences
on food-drink types, should rely on the size of the user’s
purchase history, i.e. the number of deals previously
consumed. Users with a longer history have more accurately
built preferences Pi than (cold) users with a short history,
hence α should be higher in the former case. For users with
no purchase history, e.g. first-time visitors to a city, for
instance), preference information in Pi should be disregarded
by setting α = 0. Inspired by fuzzy set theory, we achieve
this by setting α ∈ [0, αmax ], 0 &lt; αmax &lt; 1, such that α
increases as the user history grows.
(3)
(4)
from the restaurant-related data. For the contextual
information, location data and time are inferred by retrieving the
temporal information associated to the last purchased deal
(test data). Finally, we consider k = 10 for the size of the
recommendation list.</p>
      <p>Evaluation Metrics. We recommend the top-k matching
ofers to the target user and investigate the predictive power
exhibited by the model in recommending the (removed)
latest deal purchased by each user, or the restaurant which
ofered it. For this end, the performance evaluation metrics
employed are adapted versions of average recall@k and
average NDCG@k on all users, thereby predicting the appearance
of each user’s latest deal or visited restaurant in her history
in the recommendation list. The average recall is:
Í</p>
      <p>ui ∈U yi
|U |
 1 if last deal consumer by ui is among top-k,
yi =  21 if last restaurant visited by ui is among top-k,
 0 otherwise.</p>
      <p>
Average Normalised Discounted Cumulative Gain at k:
Íui ∈U N DCG@ki</p>
      <p>The influence of β relies on the amount of ratings received
by the restaurant associated to xj . If rxj has more customer
ratings, β should be higher under the premise that frequently
rated restaurants have more reliable (less biased) popularity
information, and vice versa. Likewise, for a new restaurant
with no ratings, we set β = 0. Using a similar principle as
the one for α , we set β ∈ [0, βmax ], 0 &lt; βmax &lt; 1 − αmax .</p>
      <p>The influence of γ , which refers to the proximity between
user and venue, is (without losing generality) determined
upon the other two parameters, as γ = 1 − (α + β). In other
words, distance becomes more relevant if ui has a smaller
purchase history or rxj has less customer ratings. If both α
and β = 0, the filtering process between a cold user and a deal
ofered by an unrated restaurant becomes purely
locationbased, γ = 1.
3</p>
    </sec>
    <sec id="sec-3">
      <title>EXPERIMENTAL CASE STUDY</title>
      <p>This section presents a case study conducted in collaboration
with Wriggle, on a real dataset describing restaurants, deals
and purchases made by users who used Wriggle in Bristol,
Cardif and Brighton. By using the purchase history and user
profile, a sensitivity analysis is conducted on our proposed
model parameters.</p>
      <p>Dataset Description. The anonymised datasets provided by
Wriggle contain a history of purchased deals by every user
over a period of five years, between 2014 and 2019. Around
305K purchases are logged by 141K users. Also, a total of
approximately 11K deals ofered by 2153 restaurants are
included in the dataset, with each deal being associated to one
or multiple categories, out of a total of 63 categories
describing food or drink characteristics/cuisines. There is also data
about every user’s profile, including dietary requirements if
any (vegetarian, vegan), and restaurant profiles that contain
the restaurant’s average popularity based on users’ rating
on deals ofered by that restaurant.</p>
      <p>Experimental Setting. We filter users who have at least
one purchase in the last 5 months of purchase dataset
because real location data exists only for that particular period.
Then, we split the user history dataset into a training and
test set for three major cities, Bristol, Cardif and Brighton,
that Wriggle operates currently. We consider three diferent
time span settings for the user purchase history: 6 Months,
12 Months and entire history since 2014. We then separate
the latest deal with location information purchased by each
user into the test set. Users with three or less items in their
purchased history have been removed for the purpose of
this experiment, leaving a consolidated purchase history of
2043 Users for Bristol, 249 for Cardif and 643 for Brighton.
Category information retrieved from deals in the purchase
history is used to built preference vector of user Pi for the
preference matching. Likewise, the information about
restaurant popularity, opening times and location are retrieved
k
Õ</p>
      <p>|U |
2zi,j − 1
j=1 loд2(j + 1)
where zi, j = 1 if the last deal consumer by ui is the jth
recommended item, zi, j = 0.5 if the restaurant last visited by
ui is at the jth recommended item, and zi, j = 0 otherwise.
Results and Discussion. Three baseline approaches, and
two versions of the proposed model with non-null weights,
are considered:
Most Popular: Recommend deals based on venue popularity.
User-Preference: Recommend deals predicted on preferences
over categories in deals.</p>
      <p>Location: Recommend deals based on restaurant proximity.
Same Weight: Popularity, preferences and context are equally
important for every user and restaurant, i.e. α = β = γ .
Optimised Weight: It adaptively sets weights as explained in
Section 3, with αmax = βmax = 0.3. Both α (resp. β) become
maximum when the user history length (resp. restaurant
rating count) is greater than five.</p>
      <p>Figure 2 summarises the average results obtained by the
ifve models, for users in the three cities considered and the
three time span settings considered. Despite a more
exhaustive validation is needed, the results provide some interesting
insights.</p>
      <p>The proposed model with optimised weight scheme tends
to slightly outperform the version with same weights, in
almost all cases, specially when considering a shorter time
span (6 months). Whilst this improvement is not significant,
it motivates us to investigate how to further improve it by
devising more user-adaptive weight optimisation methods in
future work. Both two versions of our model generally
outperform the three baseline approaches, however a location
based recommendation has better predictive power in two of
the three cities for the 6-month case. This suggests that most
users may have a scarce purchase history in such a short
time span, in which case prioritising restaurant proximity
might increase the chances for better predictions.</p>
      <p>Finally, the fact that the user preference baseline gently
improves for longer time spans, suggests that the more purchase
history data are available, the more reliable the extracted
(implicit) preference information is.
4</p>
    </sec>
    <sec id="sec-4">
      <title>CONCLUSION</title>
      <p>This contribution proposes a recommendation model for
suggesting restaurant deals to local and visiting users to a
city by balancing their food-drink preferences, the popularity
of the restaurant, and the context surrounding the user, such
as his/her location. A case study has been conducted with real
data provided by Wriggle, with insightful results motivating
the need for follow-up research on how to optimally balance
multiple information sources.</p>
      <p>
        People often visit restaurants in groups whose members
have diverse preferences. Accordingly, future work involves
investigating preference aggregation for consensual group
recommendations [
        <xref ref-type="bibr" rid="ref12 ref13">12, 13</xref>
        ]. We are also interested in (i)
harnessing the capabilities of data networks in smart cities to
enable highly situation-aware recommendations in real time,
specially for tourists visiting a city; (ii) modeling users’
preferences on food-drink categories more flexibly and under
several decision criteria; and (iii) applying improved models
on open datasets to make this research more reproducible.
5
      </p>
    </sec>
    <sec id="sec-5">
      <title>ACKNOWLEDGMENTS</title>
      <p>The authors would like to thank Rob Hall (CEO, Wriggle)
and Clement Debiaune (CTO, Wriggle) for incentivising and
fostering the collaboration that made this research possible.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D.</given-names>
            <surname>Herzog</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Laβ</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Wolfgang</given-names>
            <surname>Wörndl</surname>
          </string-name>
          .
          <article-title>Tourrec: a tourist trip recommender system for individuals and groups</article-title>
          .
          <source>Proceedings 12th ACM Conference on Recommender Systems (Recsys'18)</source>
          , pp.
          <fpage>496</fpage>
          -
          <lpage>497</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.</given-names>
            <surname>Moreno</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Valls</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Isern</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Marin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Borrás</surname>
          </string-name>
          . SigTur/E-Destination:
          <article-title>Ontology-based personalized recommendation of Tourism and Leisure Activities</article-title>
          . Engineering Applications of Artificial Intelligence,
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>E.</given-names>
            <surname>Ezin</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Palomares</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Neve</surname>
          </string-name>
          .
          <article-title>Group Decision Making with Collaborative-Filtering ín the loop´: interaction-based preference and trust elicitation</article-title>
          . Accepted,
          <string-name>
            <surname>IEEE SMC</surname>
          </string-name>
          <year>2019</year>
          <article-title>Conference</article-title>
          . In press.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Al-Ghossein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Abdessalem</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Barré</surname>
          </string-name>
          .
          <article-title>Cross-Domain Recommendation in the Hotel Sector</article-title>
          .
          <source>Proceedings RecTour'18, in 11th Conf. ACM Recsys'18</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>G.</given-names>
            <surname>Adomavicius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Tuzhilin</surname>
          </string-name>
          .
          <article-title>Context-Aware Recommender Systems</article-title>
          . In F. Ricci et al. (Eds.) Recommender Systems Handbook, pp.
          <fpage>217</fpage>
          -
          <lpage>253</lpage>
          , Springer,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Ebadi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>KrzyÅĳak. A</surname>
          </string-name>
          <article-title>Hybrid Multi-Criteria Hotel Recommender System Using Explicit and Implicit Feedbacks</article-title>
          .
          <source>International Journal of Computer and Information Engineering</source>
          ,
          <volume>10</volume>
          (
          <issue>8</issue>
          ),
          <fpage>1450</fpage>
          -
          <lpage>1458</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>P.</given-names>
            <surname>Longart</surname>
          </string-name>
          .
          <article-title>Consumer Decision Making in Restaurant Selection</article-title>
          .
          <source>PhD Thesis</source>
          , Buckinghamshire New University,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>L.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zhou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Xiong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Hu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Wei</surname>
          </string-name>
          .
          <article-title>Collaborative Filtering based on User Attributes and User Ratings for Restaurant Recommendation</article-title>
          .
          <source>Proceedings 2nd IEEE IAEAC Conference</source>
          , pp.
          <fpage>2592</fpage>
          -
          <lpage>2597</lpage>
          ,
          <year>2017</year>
          .
          <volume>26</volume>
          (
          <issue>1</issue>
          ), pp.
          <fpage>633</fpage>
          -
          <lpage>651</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>E.</given-names>
            <surname>Palumbo</surname>
          </string-name>
          , G. Rizzo,
          <string-name>
            <given-names>R.</given-names>
            <surname>Troncy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Baralis</surname>
          </string-name>
          .
          <article-title>Predicting Your Next Stopover from Location-based Social</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>J.</given-names>
            <surname>Zeng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Wen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Hirowaka</surname>
          </string-name>
          .
          <article-title>A Restaurant Recommender System based on User and Location in Mobile Environment</article-title>
          .
          <source>Proceedings 5th IIAI International Congress</source>
          , pp
          <fpage>55</fpage>
          -
          <lpage>60</lpage>
          ,
          <year>2016</year>
          .
          <article-title>Network Data with Recurrent Neural Networks</article-title>
          .
          <source>Proceedings RecTour'17, 11th Conf. ACM Recsys'17</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>M.</given-names>
            <surname>Bressan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Leucci</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Panconesi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Raghavan</surname>
          </string-name>
          ,
          <string-name>
            <surname>E. Terolli.</surname>
          </string-name>
          <article-title>The Limits of Popularity-Based Recommendations, and the Role of Social Ties</article-title>
          .
          <source>Proceedings 22nd ACM SIGKDD International Conference</source>
          , pp.
          <fpage>745</fpage>
          -
          <lpage>754</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>A.</given-names>
            <surname>Delic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Neidhardt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Werthner</surname>
          </string-name>
          . Group Decision Making and Group Recommendations.
          <source>Proceedings 20th IEEE CBI</source>
          , pp.
          <fpage>79</fpage>
          -
          <lpage>88</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>I.</given-names>
            <surname>Palomares</surname>
          </string-name>
          .
          <article-title>Large Group Decision Making: creating Decision Support Systems at Scale</article-title>
          . Springerbriefs in Computer Science, Springer,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>