<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>September</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Investigating Mere-Presence Effects of Recommendations on the Consumer Choice Process</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sören Köcher</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dietmar Jannach</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Michael Jugovac</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hartmut H. Holzmüller</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Consumer Choice Behavior, Persuasiveness, Anchoring</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>TU Dortmund University</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2016</year>
      </pub-date>
      <volume>16</volume>
      <issue>2016</issue>
      <abstract>
        <p>In various application domains, recommender systems explicitly or implicitly act as virtual advice givers. They are not only used to lter large item sets or point users to unknown but relevant items, their recommendations can also help users to make a decision given a limited choice set. Such a system is usually considered e ective if the users adopt the recommendations because, for example, the system's suggestions match their preferences or because they generally trust in the system's benevolence and competence. With this work we aim to further explore the persuasive potential of automated recommendations. Our speci c goal was to investigate whether the mere presence of a recommendation has e ects on the user's choice process. We conducted two online studies in which participants received either no recommendation or a random recommendation for a given decision scenario. The obtained results showed that the pure existence of recommendations can, depending on the decision scenario, make users more con dent in their choices and reduce choice di culty. Furthermore, we observed that in both studies even random recommendations led to an anchoring e ect as the participants' choices were measurably biased by the characteristics of the recommended item.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>Recommender systems (RS) can serve di erent purposes
for their users. They, for example, help users to locate
relevant items within large item collections or support them in
discovering additional items of interest outside their typical
preference patterns. A somewhat less explored role of
recommenders is their capability of serving as virtual advice givers
in scenarios where users make decisions given a limited set
of choices.</p>
      <p>
        Such systems are often more interactive and can implement
a number of persuasive cues to increase the users' con dence
in their decision. Additionally, providers can employ the
persuasive potential of such systems to \convince" users to
choose a certain recommended option, e.g., by providing
appropriate explanations or by helping them understand the
relevant decision factors [
        <xref ref-type="bibr" rid="ref11 ref19 ref7">7, 11, 19</xref>
        ].
      </p>
      <p>
        Previous works on this topic focus, for example, on
analyzing the in uence of speci c decision-support functionalities,
like explanations, on persuasiveness [
        <xref ref-type="bibr" rid="ref10 ref8">8, 10</xref>
        ]. In contrast, our
work aims to examine if the mere presence of an arbitrary
advice or recommendation has an e ect on the user's decision
making process. There are di erent reasons why we
conjecture that such e ects might exist: Recommender systems are
omnipresent today and users might generally assume that
such systems are benevolent and competent [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. As a result,
they might consider the recommendations in some form
during their decision making process. If users are, in contrast,
skeptical, the recommended items could at least serve as
reference points when comparing the options. Finally, the
recommended items could serve as anchors [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], which bias
the users' decisions.
      </p>
      <p>
        To investigate the existence of such e ects, we conducted
user studies in which the participants had to make purchase
decisions on ctitious e-commerce shops. One participant
group received one randomly chosen element from the choice
set as a recommendation; the other group received no
recommendation at all. We decided to rely on random
recommendations in our studies as this allows us to rule out potential
e ects related to the (perceived) quality of the
recommendations themselves. Besides the question if a randomly chosen
recommendation can represent an anchor and bias the nal
user decisions, our expectation was that the mere presence of
recommendations has a positive e ect on choice con dence,
e.g., because the users are given a reference point for their
decision. Higher choice con dence might lead to higher choice
satisfaction, which in turn is supposed to increase the users'
intention to actually make a purchase [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>In summary, our research questions are as follows:
RQ1: To what extent has the mere presence of a
recommendation an e ect on the customer's decision process?
RQ2: Can the characteristics of a recommendation serve
as an anchor for decision making?
2.</p>
    </sec>
    <sec id="sec-2">
      <title>STUDY DESIGN</title>
      <p>Research Model. Figure 1 shows our research model. The
independent variables are the presence of a recommendation
(RS) and the user's domain expertise (Dom. Exp.). We
include the latter variable assuming that expertise may have
an impact on the users' decision con dence (Dec. Conf.). We
include choice di culty (Ch. Di culty) as a construct as
we hypothesize that users { utilizing the recommendation
as reference point { might focus on a subset of the items as
choice set. In turn, lower choice di culty should also lead to
higher decision con dence. We measure choice di culty with
indicators variables that assess the degree to which making</p>
      <p>Decision
Confidence
+</p>
      <p>Decision
Satisfaction
the decision was perceived as (emotionally) challenging1.
Finally, both decision con dence and choice di culty are
assumed to impact the users' decision satisfaction (Dec. Sat.).</p>
      <p>Study Environment and Procedure. We created ctitious
online shops for two di erent domains: backpacks (Study
A) and hotels (Study B). In both studies, the scenario for
the participants was that they were searching for an item to
purchase, and we asked them to select one of the available
items on the online site. The choice set sizes were 18
(backpacks) and 24 (hotels), respectively. In each case, additional
item information was provided. We presented the weight,
dimensions, volume, and price of the backpacks and the star
category, community rating, distance to the city center and
the price for the hotels. Half of the participants of each study
received one randomly selected item as a recommendation,
which was clearly marked as being a recommendation as
sketched in Figure 2.</p>
      <p>We recruited 164 and 239 participants for Study A and
Study B, by distributing the URL of the online shop via
email and on social network groups. The average age of the
respondents was about 22 for both groups; more than two
thirds were female participants. When accessing the website,
the participants read the scenario and task description, were
instructed to selected one of the options, and answered a
post-task questionnaire. The participants were randomly
assigned to the treatment groups.</p>
    </sec>
    <sec id="sec-3">
      <title>RESULTS</title>
      <p>The recommended item was actually chosen by 6:7 % of
the participants of Study A, and by 3:8 % in Study B. These
numbers roughly correspond to the theoretical chance that
the recommended item was indeed the preferred option for a
1The questionnaire items can be found at http://ls13-www.
cs.tu-dortmund.de/homepage/intrs13q.
user. Simply displaying a random recommendation therefore
did not persuade users to adopt the recommendations.
3.1</p>
    </sec>
    <sec id="sec-4">
      <title>Structural Equation Modeling Results</title>
      <p>
        We used Structural Equation Modeling (SEM) as an
analysis instrument to detect relationships between the variables
of our research model from Figure 1. Speci cally, we used the
PLS-SEM method, which is particularly recommended for
this type of exploratory research for which no strong theory
exists yet [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. All constructs except the recommendation
condition are measured with multiple questionnaire items.
3.1.1
      </p>
      <sec id="sec-4-1">
        <title>Model Validity and Reliability</title>
        <p>
          We applied di erent validity and reliability tests to our
models and excluded indicators that were not reliably
measuring a construct [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. To check for internal consistency of the
constructs, we measured composite reliability and Cronbach's
alpha of our nal model. The composite reliability values
in both studies range from 0.88 to 0.95; Cronbach's alpha
was between 0.79 and 0.93, i.e., all values were above the
suggested minimum threshold of 0.7. To check for convergent
validity, we calculated the AVE (Average Variance Extracted)
value. The minimum AVE value across both studies was 0.68,
which is again above the minimum threshold of 0.5. Finally,
we veri ed discriminant validity by checking (a) that all cross
loadings were smaller than the respective outer loadings and
(b) that no squared variable correlations exceeded the AVE
values of the respective constructs.
3.1.2
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Observed Effects</title>
        <p>
          In SEM models, path coe cients ( ), which range from
1 and +1, express the strength of the relationships between
two variables. The empirical t-values obtained through
bootstrapping help us assess statistical signi cance. According
to the literature [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ], t-values above 1.96 indicate signi cance
at the 5 % level, values above 2.57 at the 1 % level.
        </p>
        <p>The middle columns of Table 1 show the -values and
t-values for the backpack study. The results con rm the
hypothesized e ects of the presence of a recommender on
decision con dence and choice di culty, which in turn both
a ect decision satisfaction. The main insight of this study is
therefore that the mere existence of a random
recommendation can (a) have a positive, statistically signi cant e ect on
the user's decision con dence and (b) lead to lower choice
di culty for users. This nding is relevant in practice as
lower choice di culty contributes to higher decision con
dence ( = 0:228) and decision satisfaction ( = 0:322).
Likewise, decision con dence is strongly tied with decision
satisfaction ( = 0:608).
Notes: = Path coe cient with corresponding t-value, **p &lt; :01,
*p &lt; :05, n.s.= not signi cant.</p>
        <p>The right-most columns of Table 1 show the results for
the hotels. The obtained path coe cients indicate similar
trends but the e ects did not reach signi cant levels in this
scenario. This suggests that the hypothesized e ects depend
on speci cs of the domain or the decision scenario.</p>
        <p>In both scenarios, the expertise of the users { in contrast to
our expectations { had no measurable direct or moderating
e ect on decision con dence. This indicates that the observed
mere-presence e ects in the backpack domain applied equally
to both experienced and less-experienced participants.</p>
        <p>
          Overall, the results indicate that the mere presence of
recommendations can measurably impact the user's decision
process in terms of decision con dence and choice di culty.
However, while these e ects were signi cant in the backpack
domain, they did not reach signi cance in the hotel domain.
Further research is therefore required to understand which
factors cause these di erences. One explanation could be that
comparing item characteristics might be inherently easier
in one of the domains. In fact, an analysis of the construct
values related to choice di culty revealed that choosing an
item was considered signi cantly (p &lt; 0:05) more di cult in
the backpack domain, which could, e.g., be due to
domainspeci c trade-o s, such as the backpack's weight vs. its
volume. This suggests that the presence of a recommender
has more e ects when the choice situation is more di cult.
Another possible factor contributing to the perceived choice
di culty can be the size of the choice set [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. In our studies,
the choice set size was larger for the hotels than for the
backpack domain. Nonetheless, the decision di culty was
perceived to be higher for the backpacks as mentioned above.
3.2
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Analysis of Anchoring Effects</title>
      <p>Besides the question to what extent a recommendation
in uences the decision making process, we aimed to
investigate if the recommendations also had an e ect on the actual
choices of the participants. We have already mentioned above
that participants did not blindly adopt the random
recommendations. However, we hypothesize that the participants
could (unconsciously) be biased in their nal choice by the
presented recommendation, i.e., that the recommendation
served as an anchor for their decision. Speci cally, we assume
that participants select options that have similar features
compared to the recommendation. To our knowledge, the
existence of attribute-level anchoring e ects has not been
explored in the recommender systems literature so far.</p>
      <p>Technically, we performed several univariate regression
analyses to quantify to what extent the attributes of the
chosen items were dependent on the features of the
recommended item. Furthermore, as a simpler form of analysis, we
calculated the correlations between the attribute values. The
results of these analyses are shown in Table 2 and clearly
show the existence of anchoring e ects for both scenarios.</p>
      <p>In the backpack domain, all features of the nally chosen
item, i.e., weight, volume, and price, were positively and
statistically signi cantly related to the recommended item.
All correlation values ( ) were also positive and signi cant at
p &lt; 0:05. Similar e ects were observed for the hotel domain.
On average, participants chose items that were similar to the
recommended item in terms of the distance to the city center,
the community rating, and the price. No anchoring e ect
was, however, observed for the star category in this domain.
A possible explanation for this phenomenon could lie in the
comparably coarse grained scale of the star category and that
the participants might have already had a comparably strong
mindset before the experiment regarding the star category
of hotels they would possibly book.</p>
      <p>To illustrate the strength of these e ects, we looked at
the item attributes and created di erent subsamples of the
data (e.g., light vs. heavy backpacks). For example, when
the system recommended a light backpack with a weight
between 1.7 and 2.8 kilograms, the average weight of the
chosen backpack was at 2.26 kilogram. When the weight of
the \anchor" was higher and between 2.9 and 4.0 kilograms,
the average weight of the selected backpacks went up by 13 %
to 2.60 kilogram. Similar e ect strengths were observed for
other item features, which we nd remarkable, given that
the recommendations were randomly selected.</p>
      <p>In an additional analysis we tested if domain expertise
had an impact on the strength of the anchoring e ect and
incorporated these aspects into our regression models. We
could, however, not observe any statistically signi cant main
or interaction e ects, which suggests that both novice and
expert users seem to be equally susceptible to anchoring
e ects.
3.3</p>
    </sec>
    <sec id="sec-6">
      <title>Research Limitations</title>
      <p>Our research is mostly based on responses from students of
our university. While the group is homogeneous and students
are potential customers in both tested domains, we cannot
state with certainty that the ndings are representative for
other societal groups. Furthermore, the participants did not
actually make a purchase in the end, and our scenario was
purely ctitious. On the other hand, as the participation was
voluntary, no strong motivators exist for the participants to
act dishonestly during the study.
4.</p>
    </sec>
    <sec id="sec-7">
      <title>PREVIOUS WORKS</title>
      <p>
        Anchoring e ects, as observed in both of our studies, were
rst discussed in the 1970s in the context of research on
human judgment under uncertainty [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Anchoring means
that people derive their nal judgments or estimations for
a given task using a heuristic that consists of adjusting a
(possibly even arbitrary) initial value. Anchoring e ects have
been researched in di erent estimation and decision scenarios
and, in particular in the Marketing literature, in purchase
decision contexts, e.g., [
        <xref ref-type="bibr" rid="ref13 ref15">13, 15</xref>
        ], and [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
      </p>
      <p>
        In the RS literature only few works on anchoring e ects
exist. To what extent displaying predicted ratings for
unfamiliar items in uences the ratings assigned by users is
discussed in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]; how recommendations can impact
the users' willingness-to-pay is furthermore discussed in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
Anchoring e ects on the item feature level, as reported in
our work, have to our knowledge not yet been investigated.
      </p>
      <p>
        In a broader context, anchoring e ects can be seen as
one of several possible approaches to implement persuasive
recommender systems [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. System-provided explanations are
probably the most prominent approach in the RS literature to
convince users to adopt a recommendation or make a certain
choice, see, e.g., [
        <xref ref-type="bibr" rid="ref10 ref8">8, 10</xref>
        ]. Another approach to persuasion
is to engage the user in the choice process, e.g., using an
interactive product advisor, with the goal to promote certain
items [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. Finally, more deceptive means of persuasion
include the manipulation of the recommendation list with
the intent to exploit psychological phenomena like decoy
e ects [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        In contrast to these works, our studies indicate that the
mere presence of random recommendations can have a
persuasive and biasing e ect. More research is however required
to understand the underlying reasons of these e ects. Past
research showed that users see (personalized) recommendations
as a decision aid that can reduce the perceived e ort and
choice overload [
        <xref ref-type="bibr" rid="ref14 ref3">3, 14</xref>
        ]. The fact that even random
recommendations are e ective can have di erent reasons, for example,
because users generally trust that such systems are
benevolent and competent [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. As an e ect, users might feel safer
with their choices when they are close to a recommended
option.
      </p>
    </sec>
    <sec id="sec-8">
      <title>5. SUMMARY AND CONCLUSIONS</title>
      <p>Our work suggests that the mere presence of random
recommendations can measurably a ect the choice processes
of users. In both studies reported in this paper we could
observe anchoring e ects on the attribute level, i.e., the
participants exhibited a tendency to select items that had
similar characteristics compared to the recommended
reference item. In one of the tested domains, the presence of
the recommender furthermore led to lower perceived choice
di culty and higher choice con dence.</p>
      <p>Overall, our work therefore contributes additional evidence
of the persuasive capabilities of recommender systems and
their potential as decision-making aids. In terms of practical
implications, the observed anchoring e ects emphasize that
recommenders can be valuable instruments for providers to
guide the customer choice toward a desired direction. Since
not all e ects could be observed in both studies, more work is
required to understand the underlying factors that determine
the e ective persuasiveness of recommendations in di erent
scenarios.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>G.</given-names>
            <surname>Adomavicius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bockstedt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. P.</given-names>
            <surname>Curley</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Zhang</surname>
          </string-name>
          .
          <article-title>E ects of online recommendations on consumers' willingness to pay</article-title>
          .
          <source>In Proc. of Decisions@RecSys '12</source>
          , pages
          <fpage>40</fpage>
          {
          <fpage>45</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>G.</given-names>
            <surname>Adomavicius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bockstedt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. P.</given-names>
            <surname>Curley</surname>
          </string-name>
          , and
          <string-name>
            <surname>J. Zhang.</surname>
          </string-name>
          <article-title>Do Recommender Systems Manipulate Consumer Preferences? A Study of Anchoring E ects</article-title>
          .
          <source>Information Systems Research</source>
          ,
          <volume>24</volume>
          (
          <issue>4</issue>
          ):
          <volume>956</volume>
          {
          <fpage>975</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>N. N.</given-names>
            <surname>Bechwati</surname>
          </string-name>
          and
          <string-name>
            <given-names>L.</given-names>
            <surname>Xia</surname>
          </string-name>
          .
          <article-title>Consumers in cyberspace do computers sweat? the impact of perceived e ort of online decision aids on consumers' satisfaction with the decision process</article-title>
          .
          <source>Journal of Consumer Psychology</source>
          ,
          <volume>13</volume>
          (
          <issue>1</issue>
          ):
          <volume>139</volume>
          {
          <fpage>148</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>D.</given-names>
            <surname>Bollen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. P.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. C.</given-names>
            <surname>Willemsen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Graus</surname>
          </string-name>
          .
          <article-title>Understanding choice overload in recommender systems</article-title>
          .
          <source>In Proc. of RecSys '10</source>
          , pages
          <fpage>63</fpage>
          {
          <fpage>70</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>D.</given-names>
            <surname>Cosley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. K.</given-names>
            <surname>Lam</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Albert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Konstan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>Is seeing believing?: how recommender system interfaces a ect users' opinions</article-title>
          .
          <source>In Proc. of CHI '03</source>
          , pages
          <fpage>585</fpage>
          {
          <fpage>592</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Felfernig</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Friedrich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Gula</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Hitz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Kruggel</surname>
          </string-name>
          , G. Leitner,
          <string-name>
            <given-names>R.</given-names>
            <surname>Melcher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Riepan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Strauss</surname>
          </string-name>
          , E. Teppan, and
          <string-name>
            <given-names>O.</given-names>
            <surname>Vitouch</surname>
          </string-name>
          .
          <article-title>Persuasive recommendation: serial position e ects in knowledge-based recommender systems</article-title>
          .
          <source>In Proc. of PERSUASIVE '07</source>
          , pages
          <fpage>283</fpage>
          {
          <fpage>294</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>A.</given-names>
            <surname>Felfernig</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Friedrich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Jannach</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Zanker</surname>
          </string-name>
          .
          <article-title>An integrated environment for the development of knowledge-based recommender applications</article-title>
          .
          <source>Intl. Journal of Electronic Commerce</source>
          ,
          <volume>11</volume>
          (
          <issue>2</issue>
          ):
          <volume>11</volume>
          {
          <fpage>34</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>F.</given-names>
            <surname>Gedikli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Jannach</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Ge</surname>
          </string-name>
          .
          <article-title>How should I explain? A comparison of di erent explanation types for recommender systems</article-title>
          .
          <source>Intl. Journal of Human-Computer Studies</source>
          ,
          <volume>72</volume>
          (
          <issue>4</issue>
          ):
          <volume>367</volume>
          {
          <fpage>382</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hair</surname>
          </string-name>
          , G. Hult,
          <string-name>
            <given-names>C.</given-names>
            <surname>Ringle</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Sarstedt</surname>
          </string-name>
          .
          <article-title>Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM)</article-title>
          .
          <source>Sage</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>J.</given-names>
            <surname>Herlocker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Konstan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>Explaining collaborative ltering recommendations</article-title>
          .
          <source>In Proc. of CSCW '00</source>
          , pages
          <fpage>241</fpage>
          {
          <fpage>250</fpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>B.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Willemsen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Gantner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Soncu</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Newell</surname>
          </string-name>
          .
          <article-title>Explaining the user experience of recommender systems</article-title>
          .
          <source>UMUAI</source>
          ,
          <volume>22</volume>
          (
          <issue>4</issue>
          ):
          <volume>441</volume>
          {
          <fpage>504</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>S. X.</given-names>
            <surname>Komiak</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Benbasat.</surname>
          </string-name>
          <article-title>Understanding customer trust in agent-mediated electronic commerce, web-mediated electronic commerce, and traditional commerce</article-title>
          .
          <source>Information Technology and Management</source>
          ,
          <volume>5</volume>
          (
          <issue>1</issue>
          ):
          <volume>181</volume>
          {
          <fpage>207</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>K. C.</given-names>
            <surname>Manning</surname>
          </string-name>
          and
          <string-name>
            <given-names>D. E.</given-names>
            <surname>Sprott</surname>
          </string-name>
          .
          <article-title>Multiple unit price promotions and their e ects on quantity purchase intentions</article-title>
          .
          <source>Journal of Retailing</source>
          ,
          <volume>83</volume>
          (
          <issue>4</issue>
          ):
          <volume>411</volume>
          {
          <fpage>421</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>V.</given-names>
            <surname>Mindel</surname>
          </string-name>
          .
          <article-title>Choice anxiety in decision making: Why people turn to strangers for information</article-title>
          .
          <source>In Proc. of ICIS '15</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Nunes</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Boatwright</surname>
          </string-name>
          .
          <article-title>Incidental prices and their e ect on willingness to pay</article-title>
          .
          <source>Journal of Marketing Research</source>
          ,
          <volume>41</volume>
          (
          <issue>4</issue>
          ):
          <volume>457</volume>
          {
          <fpage>466</fpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>P.</given-names>
            <surname>Pu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Chen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Hu</surname>
          </string-name>
          .
          <article-title>A user-centric evaluation framework for recommender systems</article-title>
          .
          <source>In Proc. of RecSys '11</source>
          , pages
          <fpage>157</fpage>
          {
          <fpage>164</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>A.</given-names>
            <surname>Tversky</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Kahneman</surname>
          </string-name>
          .
          <article-title>Judgment under uncertainty: Heuristics and biases</article-title>
          .
          <source>Science</source>
          ,
          <volume>185</volume>
          (
          <issue>4157</issue>
          ):
          <volume>1124</volume>
          {
          <fpage>1131</fpage>
          ,
          <year>1974</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>B.</given-names>
            <surname>Wansink</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. J.</given-names>
            <surname>Kent</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Hoch</surname>
          </string-name>
          .
          <article-title>An anchoring and adjustment model of purchase quantity decisions</article-title>
          .
          <source>Journal of Marketing Research</source>
          ,
          <volume>35</volume>
          (
          <issue>1</issue>
          ):
          <volume>71</volume>
          {
          <fpage>81</fpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>K.-H. Yoo</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          <string-name>
            <surname>Gretzel</surname>
            , and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Zanker</surname>
          </string-name>
          .
          <source>Persuasive Recommender Systems - Conceptual Background and Implications</source>
          . Springer, New York,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>M.</given-names>
            <surname>Zanker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Bricman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Gordea</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Jannach</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Jessenitschnig</surname>
          </string-name>
          .
          <article-title>Persuasive online-selling in quality and taste domains</article-title>
          .
          <source>In Proc. of EC-Web '06</source>
          , pages
          <fpage>51</fpage>
          {
          <fpage>60</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>