<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <issn pub-type="ppub">1613-0073</issn>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>The Importance of Cognitive Biases in the Recom mendation Ecosystem: Evidence of Feature-Positive Efect, Ikea Efect, and Cultural Homophily</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Markus Schedl</string-name>
          <email>markus.schedl@jku.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oleg Lesota</string-name>
          <email>oleg.lesota@jku.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Shahed Masoudian</string-name>
          <email>shahed.masoudian@jku.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Workshop</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Psychology, Cognition, Feature-Positive Efect, Ikea Efect, Cultural Homophily, Declinism, Halo Efect, Primacy</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Efect, Recency Efect, Position Bias, Empirical Studies</institution>
          ,
          <addr-line>Simulation Study</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Human-centered AI Group, AI Lab, Linz Institute of Technology (LIT)</institution>
          ,
          <addr-line>Altenberger Straße 69, A-4040 Linz</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Institute of Computational Perception, Johannes Kepler University Linz (JKU)</institution>
          ,
          <addr-line>Altenberger Straße 69, A-4040 Linz</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Cognitive biases have been studied in psychology, sociology, and behavioral economics for decades. Traditionally, they have been considered a negative human trait that leads to inferior decision making, reinforcement of stereotypes, or can be exploited to manipulate consumers, respectively. Lately, there has been growing interest in AI research to better understand the influence of such biases in classification, search, and also recommendation tasks. We argue that cognitive biases manifest in diferent parts of the recommendation ecosystem and in various components of the recommendation pipeline, including input data (such as ratings or side information), recommendation algorithm or model (and consequently recommended items), and user interactions with the system. More importantly, we contest the traditional detrimental perspective on cognitive biases and claim that certain cognitive biases can be beneficial when accounted for by recommender systems. Concretely, we provide empirical evidence that feature-positive efect, Ikea efect, and cultural homophily can be observed in the context of recommender systems, and discuss their potential for exploitation. In three small experiments covering recruitment and entertainment domains, we study the pervasiveness of the aforementioned biases. We ultimately advocate for a prejudice-free consideration of cognitive biases to improve user and item models as well as recommendation algorithms.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction and Background</title>
      <p>“Music used to be better in the 1980s when I was young.”
“The cookies I baked are much tastier than the ones I bought.”
”I only remember the last items on my to-do list.”
“He is such a great actor; I am sure those nasty accusations against him are made up.”</p>
      <p>
        These are examples of common cognitive biases, respectively, declinism, Ikea efect, recency efect,
and halo efect. Such biases have been studied in psychology and sociology for decades. In psychology,
they are commonly defined as systematic perceptual deviations of the individual from rationality and
objectivity, cognition, judgment, or decision making, which often happens unconsciously [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. In
sociology, they typically refer to collective prejudices of a society that favor one group’s values, norms,
and traditions over others [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ].
      </p>
      <p>
        Historically, cognitive biases have been regarded as a negative characteristic of humans, which lead
to inferior decision making, reinforce stereotypes, and may even cause severe systematic errors and
harm [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. More recently, psychologists have started to acknowledge the positive efects of certain
cognitive biases, e.g., to improve the eficiency of human learning and decision making [
        <xref ref-type="bibr" rid="ref1 ref6">6, 1</xref>
        ]. In the field
of machine learning, the study of cognitive biases has played a minor role so far. Only lately, some ideas
to leverage cognitive biases for model training, e.g., to improve their generalization capabilities or foster
https://hcai.at (M. Schedl)
      </p>
      <p>CEUR</p>
      <p>
        ceur-ws.org
ethical machine behavior emerged [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Narrowing down the scope to search and ranking, in information
retrieval, some preliminary research on cognitive biases has been conducted recently [
        <xref ref-type="bibr" rid="ref10 ref8 ref9">8, 9, 10</xref>
        ]. Existing
research, however, has focused on detecting some cognitive biases and assessing their influence on
search behavior rather than leveraging them to improve retrieval algorithms.
      </p>
      <p>
        In recommender systems (RSs) research, some psychologically grounded human biases have been
studied in the past, e.g., primacy and recency efects in peer recommendation [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] as well as risk
aversion and decision biases in product recommendation [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. However, despite their importance,
cognitive biases in the context of recommendation have received surprisingly little attention over the
past few years. Nor are we aware of any systematic investigation of their manifestations at diferent
stages of the recommendation process. This is particularly astonishing because research in RSs has
historically been inspired by psychological theories, models, and empirical evidence on human decision
making [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>To narrow this research gap, we advocate for a holistic examination of cognitive biases within the
recommendation ecosystem. And we take first steps in this direction in the paper at hand. Overall, we
argue for studying their potential manifestations in diferent components of the system, at diferent
stages of the recommendation process, and from the perspective of diferent stakeholders. Furthermore,
we aim to evaluate and harness the positive efects these biases may have, with the goal of enhancing
user and item models, as well as refining recommendation algorithms.</p>
      <p>In the following, we briefly introduce a selection of cognitive biases that we believe deserve a more
thorough investigation in the context of RSs (Section 2). We then present empirical evidence of some of
these biases and showcase how they may influence recommendation (Section 3). Ultimately, we argue
for a much-needed (re-)consideration of cognitive biases and point to important directions this could
take (Section 4).</p>
    </sec>
    <sec id="sec-2">
      <title>2. Cognitive Biases in Recommendation</title>
      <p>
        Extensive research in psychology, sociology, and economics has revealed a plethora of cognitive
biases [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. They relate to how humans perceive, process, store, and retrieve information, involving
the cognitive and neurological processes of individuals and even whole societies. While not all cognitive
biases directly apply to RSs, many of them influence user behavior and decision-making processes. As a
result, these biases afect users’ interactions with items (e.g., ratings or consumption patterns) and with
RSs in general (e.g., use of diferent functionalities provided by the system’s interface). However, only a
few cognitive biases have been studied in the context of RSs. In the following, we introduce some, point
to related work, and provide a working definition in the context of the recommendation ecosystem. 1
      </p>
      <p>
        Feature-Positive Efect [
        <xref ref-type="bibr" rid="ref15 ref16">15, 16</xref>
        ]: Humans better realize and put more emphasis on things that are
present than on things that are absent. In the context of RSs, we argue that this efect plays a crucial
role in explainability and fairness [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. For instance, through counterfactuals, one could show users
which (maybe better-suited) items would have been recommended to them if they had diferent traits.
We demonstrate this efect in Section 3.1.
      </p>
      <p>
        Ikea Efect [
        <xref ref-type="bibr" rid="ref18 ref19">18, 19</xref>
        ]: The more efort a person invested in something, the more they will value it.
This efect owes its name to a study that found participants were willing to pay a much higher price
for furniture they had helped build than for ready-made items [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. It can be thought of as the desire
of humans to justify their eforts. In a RS context, we assume the existence of similar efects when
users create their own item collections (e.g., songs or videos in a playlist, visited places) in contrast to
interacting with those created by others or by a recommendation algorithm. We provide evidence for
this efect in Section 3.2.
      </p>
      <p>
        Homophily [
        <xref ref-type="bibr" rid="ref20 ref21">20, 21</xref>
        ]: Homophily refers to the fact that individuals tend to form connections with
others who have similar characteristics (e.g., age, culture, or religion) more often than with people
having diferent traits. While it is a well-studied phenomenon in sociology [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] and even evolutionary
1This is, by no means, meant to be an exhaustive list, but a biased selection of the authors. For a more in-depth discussion
about cognitive biases, we refer to [
        <xref ref-type="bibr" rid="ref13 ref14">14, 13</xref>
        ].
biology [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], in RSs, homophily has not been extensively studied from a cognitive psychological
perspective.2 Evidence of cultural homophily in the music domain has been found in [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ], where music
listeners of certain countries (e.g., Brazil, Sweden, and Germany) showed a preference to listen to
domestic music artists. Vice versa, Brazilian, Polish, and Russian artists were found to be predominantly
liked by their domestic audience. In Section 3.3, we provide additional evidence that such efects can be
observed and influenced by the recommendation algorithm.
      </p>
      <p>
        Declinism [
        <xref ref-type="bibr" rid="ref24 ref25">24, 25</xref>
        ]: The perception that the world or society is declining, i.e., things get worse
over time. This has been shown to be (partly) the result of rosy retrospection — humans’ tendency to
remember the past as more positive as it actually was [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]. Declinism bias can be studied in the context
of RSs, by considering side information on items, e.g., emotions reflected in song lyrics have become
more negative over the last decades [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. We hypothesize that such trends can also be observed in
longer-term historic interaction data, i.e., users tend to interact more frequently over time with items
that are negatively emotion-laden. Identifying and formalizing such trends could also be used to adjust
recommendations to counteract (or amplify) this bias.
      </p>
      <p>
        Contrast Efect [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]: If two items are shown in the vicinity in the recommendation list of a user —
one with exceptional, the other with medium utility — the latter will appear much less appealing to the
user, even if it is still a reasonable choice.
      </p>
      <p>
        Anchoring [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]: As a variant of the contrast efect, anchoring refers to the fact that humans often
overemphasize the piece of information they are exposed to first. RS providers can exploit this efect to
ofer a hook to their users, e.g., showing them a highly-priced item first, making them (unconsciously)
believe that subsequent items are cheap even if they are still overpriced [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]. This use is also referred
to as decoy efect [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ].
      </p>
      <p>
        Conformity Bias [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ]: Providing users with evidence of previous interactions or ratings by others
impacts their own consequent behavior. For instance, showing users (artificial) ratings before asking
them to provide their own results in their ratings being closer to the initially presented ones [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ]. Users
were also found more likely to click on an item if they saw that many others have done so [
        <xref ref-type="bibr" rid="ref33">33</xref>
        ].
Furthermore, recent research reported in [34] has studied two types of conformity bias in RSs: informational
conformity (belief that one’s peer group has superior knowledge) and normative conformity (desire for
social approval). The authors also propose a model to disentangle individual users’ self-interest and
conformity behavior.
      </p>
      <p>
        Primacy and Recency Efect (Position Bias) [
        <xref ref-type="bibr" rid="ref11">35, 11</xref>
        ]: The position at which items occur in a
recommendation list influences the probability that users will interact with them. Users are more likely
to interact with items appearing at the beginning (primacy efect ) and at the end (recency efect ) of a
ranking or sequence of recommendations. In some specific domains, position bias (or serial position
efects ) have been observed already, e.g., users were more likely to vote for recommended science stories
shown to them first and last [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Notably, the primacy efect was much stronger than the recency efect
in this case. In product recommendation, an influence of item position on users’ ability to remember
product characteristics and users’ inclination to select certain products were observed [36]. Recency
efects have also been formalized in the cognitive architecture ACT-R [ 37], which has been used to
predict repeated consumption behavior [38] and to increase diversity and explainability of RSs [39].
      </p>
      <p>Halo Efect [ 40, 41]: One’s overall impression or specific perceived traits of a person influence
the perception of other characteristics of that person. For instance, it has been shown that physically
attractive people tend to be perceived as more intelligent and having more positive personality traits
than less attractive ones [42]. This overly positive perception overshadows the negative traits of the
person. In the context of RSs, we assume that similar efects occur, e.g., in slate-, playlist-, or basket
recommendation, where the recommended collection of items as a whole may be perceived as more or
less favorable depending on a single trait of one salient item (or its creator) in the recommended item
collection. If evidence for this can be found, RS providers could, for instance, implement a mechanism
to push content created by underrepresented producers by adding it to a collection with items whose
2This is even more surprising because collaborative filtering algorithms leverage this concept, by exploiting similarity in
preferences or interaction behaviors.
halo will extend to those injected items, thereby improving the latter’s exposure and overall fairness.</p>
      <p>It is important to note that cognitive biases usually do not occur in isolation. Instead, in the
recommendation process, they are often intertwined and related through feedback loops. For instance,
position bias influences the probability of users clicking on a recommended item, which afects the
interaction data used to train or update the recommendation model. Also, primacy-, contrast-, and
anchoring efects are often at work jointly.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Empirical Findings</title>
      <p>To showcase manifestations of cognitive biases in the context of RSs, we present several preliminary
investigations. Among the many existing cognitive biases, we select feature-positive efect (Section 3.1),
Ikea efect (Section 3.2), and cultural homophily (Section 3.3) because they received only little attention
so far by the RS community. Furthermore, this selection of biases and choice of experimental design
covers diferent recommendation components and stages, respectively, (content-based) training data,
user interactions, and recommendation outcomes. Our experiments cover the domains of recruitment
(candidate recommendation) and entertainment (music recommendation).</p>
      <sec id="sec-3-1">
        <title>3.1. Feature-Positive Efect</title>
        <p>
          The feature positive efect (FPE) is known as the tendency of learning organisms to better detect the
presence of stimuli (e.g., if p then q) rather than their absence (e.g., if p then not q or if not p then q) [
          <xref ref-type="bibr" rid="ref16">16, 43</xref>
          ].
This concept can be relevant in job and candidate RSs, as these systems also focus on what is present in
a job ad to determine an applicant’s relevance, potentially overlooking what is missing in the job ad.
        </p>
        <p>To investigate the presence of the FPE in candidate RSs (for given job ads), we developed a
contentbased RS using the Distil-RoBERTa cross-encoder model, similar to Kumar et al.’s work on detecting
biases in job RSs [44]. We employed GPT-4o to generate 350 CVs across six job categories (dentist,
nurse, photographer, software engineer, accountant, and teacher), resulting in a total of 2,100 CVs. To
mitigate the risk of generating artificial or inaccurate CVs, we instructed GPT-4o to base these CVs on
real-world labeled biographies obtained from the BIOS dataset [45]. For the job postings, we utilized
1,358 samples of job ads from a UK job board. They are labeled and from the same categories as the CVs.
Therefore, the ground truth is established through the match in job category between CV and job ad.
The data was split into training (80%) and validation/test (20%) sets. Our model was trained on a binary
classification task to determine whether pairs of CVs and job ads matched. For each positive training
instance, we included four negative samples to balance the training process. To track the existence of
the FPE, we evaluated the model on the test set containing 272 job ads and 336 unique applicants. We
predict the match between pairs of candidates and job ads with relevance score, and counted 13,607
true positive (TP) and 1,625 false negative (FN) predictions, where TP means the candidate is suitable
for the job ad and the model predicts it correctly, while FN means the candidate is suited for the job ad
but the model predicts they are unsuited.</p>
        <p>We conducted two experiments to study the FPE, in particular, to which extent it could apply to
algorithmic ranking or matching. In the first experiment, we considered pairs of job ads and candidates;
the former as p, the latter as q. TP samples can therefore be considered as fulfilling if p then q; FN samples
as fulfilling if p then not q. As stimuli we considered the presence (or absence) of adjectives in job ads,
and investigated to which extent the FPE would extend to the learned ranking model, simulating the
situations that the classifier “sees” (or does not “see”) these adjectives during decision making. To this
end, we removed a percentage of randomly selected adjectives from the job ads constituting TP samples.
As shown in Figure 1, we found that as more adjectives were removed from job ads, more CVs that
were TPs (q) became FNs (not q). This points to the crucial role of adjectives in RSs’ decision making of
applicants’ suitability for a job even though, for instance, “a passionate dentist” should objectively be
treated the same as “a dentist”. Yet the recommendation model relies on the adjectives to determine
suitability of candidates.</p>
        <p>In a second experiment, we explored leveraging missing adjectives to enhance the decision making
of the model. Within the formal logical framework, this can be interpreted as slightly modifying 
(by replacing words in the job ad), and subsequently investigating whether if p then not q becomes
if p then q after this modification. To modify  , we first calculated recall for each job ad with respect
to all candidates (CVs) in the test set. Subsequently, we grouped the job ads into low- and high-recall
categories. We then identified a unique set of adjectives present in high-recall job ads but absent in
low-recall job ads. Please refer to Table 1 for some examples. Finally, we randomly selected adjectives
from the FN samples and replaced them with adjectives that occurred exclusively in the high-recall job
ads (unique set). Overall, we observed a notable improvement in the average score of these modified
FN samples, which increased from 0.046 to 0.152. In detail, we observed that 52.0% of the FN samples
showed an improvement in their relevance score and 12.9% were reclassified as TPs. In contrast, 39.4%
decreased their score and remained FNs while the remaining 8.6% of samples did not change their score.
This observation hints at the potential advantage of using missing information to improve the utility of
candidate ranking systems.</p>
        <p>These findings point at the significance of the FPE, not only from a human perspective, but also
evidenced by our algorithmic interpretation of the FPE in a learned ranking model. Our experiments
highlight the influence of missing information, such as adjectives, on the accuracy of content-based
candidate-job matching systems.</p>
        <p>Potential for Exploitation: The impact of the (non-)existence of certain adjectives in job ads on the
accuracy of candidate-job matching is particularly noteworthy when it comes to transparency. The FPE
could be mitigated, for instance, by giving recruiters direct feedback on how the pool of applicants changes
when they adjust the wording of their job ad. Likewise, a similar transparency mechanism could help job
seekers identify salient words in their CVs, or even investigate counterfactual recommendations if they alter
aspects like their gender or work experience.</p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. Ikea Efect</title>
        <p>In the context of RSs and streaming platforms, the Ikea efect could be interpreted as a user’s
predisposition towards items and item collections they feel invested in, such as items they conducted research
on or discovered themselves, collections they helped compile. To probe the efect in the music domain,
we conduct a user study, striving to answer the following research question: Do music listeners prefer</p>
        <p>4 2 0 2 4</p>
        <p>Score difference: own versus discovered playlists
playlists they contributed to (own) over playlists created without their participation (other )? We ran the
study on the Prolific 3 platform for 100 participants from the United States who indicated themselves
as users of one or more music streaming services. The study requires participants to complete four
statements by choosing one option from a Likert-5 scale ranging from “Never (1)” to “Very often (5)”. The
statements are presented in the same order to all participants: S1 “I create or edit music collections...”,4
S2 “I play music collections (created by me or someone else).”, S3 “I play music collections I created or
helped create myself.”, S4 “I play music collections created by someone else (e.g., discovered on the
internet or shared by someone).”. Out of 96 respondents who submitted valid attempts, 88 indicated
that they create or edit as well as consume playlists more often than ”Never” (S1 and S2). Out of the 88
participants creating or editing playlists, 48 indicated that they consume own playlists more often than
other (comparing responses to S3 and S4), and 18 participants indicated the opposite. The distribution
of the diference in consumption frequency between own and other playlists (the S4 score subtracted
from the S3 score for each user) is shown in Figure 2. The corresponding mean of these (S3 score − S4
score) is 0.65 and the standard deviation is 1.52. For users creating playlists, we also analyze Spearman’s
correlation between responses. A significant correlation between S1 and S3 ( 0.75,  &lt; 0.001 ) shows that
the more time users put into creating playlists the more time they spend listening to their own playlists.
On the other hand, we observe no significant correlation between S1 and S4. As an additional finding,
we also note the significant correlation between S2 and S3 ( 0.66,  &lt; 0.001 ). It shows that respondents
spending more time listening to playlists in general tend to listen to the playlists they contributed to
more often. We interpret this as active listeners having a clearer formed taste and therefore preferring
their own playlists to cater to it. This particular finding, while not a direct evidence of the Ikea efect,
may indicate a higher degree of investment active listeners feel towards their chosen music. We observe
no significant correlation between S2 and S4.</p>
        <p>From our observations we conclude that, in the given sample, users tend to interact more with
playlists they invested efort in, which we interpret as a variant of the Ikea efect. A larger study would
be required to evaluate the prevalence of the efect globally and investigate factors contributing to the
users’ feeling of being invested into an item.</p>
        <p>Potential for Exploitation: Acknowledging the concept of user investment into an item or a collection
within a RS could help improve user experience with it. For instance, in the scenario of sequential
recommendation, items present in the user’s playlists (the user put efort into picking and assigning them) can
be seen as particularly valuable and serve as anchor points to retain user engagement within the current
listening session. Additionally, recommendation explanations based on items and collections the user feels
invested in could help improve user trust (Ikea efect combined with halo efect).
3https://www.prolific.com
4The participants were instructed to interpret “music collection” as playlist, track compilation, mixtape or similar, created by
a human or automatically.</p>
      </sec>
      <sec id="sec-3-3">
        <title>3.3. Cultural Homophily</title>
        <p>
          Homophily is often defined as the tendency of individuals to associate with similar others [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ], e.g.,
sharing same interests, language, or culture. In the context of RSs, it could be interpreted through the
interaction between item consumers and item creators. Users preferring items produced by creators
sharing their cultural background would be an example of such interpretation [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. In the following,
we present the results of an empirical study showing indications of cultural homophily in the domain
of music recommendation. We put forward two research questions: (1) Do users tend to prefer music
tracks produced by artists from their own country? and (2) Can RSs foster or counteract homophily
in the setting of music recommendation? We answer the first question by analyzing the listening
behavior of users from diferent countries. We answer the second question by conducting a feedback
loop simulation, comparing recommendations provided by a RS at various steps of the feedback loop
with actual user consumption behavior.
        </p>
        <p>
          Following [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ], we select a 5-core filtered sample from years 2018-2019 of the LFM-2b dataset [ 47]
containing 99,897 items (songs) selected uniformly at random and 2,287,732 interactions triggered by
11,776 users of the music platform Last.fm.5 We enrich the sample with information about the country of
each artist crawled from MusicBrainz.6 We conduct a feedback loop simulation, following [48]. Feedback
loop is a setting where a RS (ranking model) is iteratively updated (retrained) using interactions triggered
by the users interacting with previous states of the system. In a way the recommender is trained on the
items it partially recommended itself. In our ofline setting, we therefore simulate user interactions
within the system. At each of the 20 iterations, the data used for training on the previous step is enriched
with one recommendation per user, selected from their personalized recommendations, with higher
probability for higher ranking recommendations, and then used for training at the next iteration. We
use MultVAE [49] as recommendation algorithm.
        </p>
        <p>Table 2 shows the proportions of domestic music in the data sample, user consumption behavior,
and user recommendations for countries with the top 10 largest number of tracks in the data sample.
The value 0.397 for the   ,  shows that about 40% of unique tracks in the data sample are produced
by artists from the   . This column serves as a baseline, showing what the proportion of domestic
consumption would be if every user were to interact with tracks chosen at random. The value 0.626
for the US,  shows that over 60% of actual listening attention of US users is directed towards tracks
produced by US artists. Respectively US,  20 of 0.595 means that among all recommendations to US
users at iteration 20, slightly less than 60% of tracks were produced by US artists.7</p>
        <p>We answer the first question comparing the columns  and  , noticing that for all presented
countries the proportion of actual consumption of domestic music is higher than the baseline. This
shows that on average users have higher interest in music originating from their country than a random
choice would warrant. We also notice that Finnish (FI ) users demonstrate a higher level of interest in
their domestic music than users from countries with comparable track supply, e.g., Australia (AU ) and
Brazil (BR), by inspecting column / showing domestic consumption relative to the available
domestic supply.</p>
        <p>As for the second question, focusing on the first iteration of the feedback loop (  1), we find that users
from the US get recommended a proportion of their domestic music similar to their actual consumption
( ) while users from Germany (DE), Brazil (BR), and Russia (RU ) are slightly over-served with their
domestic music. In contrast, users from other countries are under-served with their domestic music,
most prominently users from Australia (AU ), whose recommendations fail to reach the level of the
baseline. At iteration 20 of the loop ( 20) the proportion of recommended domestic music increases
for some under-served countries, such as the United Kingdom (UK ) and Canada (CA). However, for
other countries such as Sweden (SE) and Finland (FI ) the proportion of recommended domestic music
decreases further away from their actual consumption level.
5https://www.last.fm
6https://www.musicbrainz.org
7Note that in the case of columns  and  ∗ a track is counted multiple times if it is consumed by, or recommended to,
multiple users (also taken into account for normalization).</p>
        <p>The results of this preliminary study show that users tend to be interested in music originating from
their own country, potentially indicating cultural homophily. However, the degree of interest varies
between countries, e.g., Finnish users consume more domestic music than Australian users while having
a comparable domestic supply. RSs do not necessarily represent this interest in their output and could
foster it for some countries while counteracting it for others.</p>
        <p>Potential for Exploitation: Formalizing and leveraging corresponding homophily models as an
additional indicator of user taste could be useful to strike a better balance in terms of diversification of
recommendations, or to pursue calibration between user profiles and recommendations in terms of country,
which is not always achievable in contemporary RSs [50].</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion, Limitations, and Future Work</title>
      <p>Cognitive biases have recently gained recognition in the wider field of machine learning, notably
also in learning to rank tasks. While the recommender systems community has addressed biases
like confirmation bias and position bias to some degree, other cognitive biases have remained largely
unexplored. Addressing this gap, we demonstrated the presence of several cognitive biases within the
recommendation ecosystem, including feature-positive efect, Ikea efect, and cultural homophily. We
also briefly outlined potential positive and negative aspects of these biases in the recommendation
process.</p>
      <p>Limitations: The reported experiments represent only first steps towards obtaining a better
understanding of the studied cognitive biases in the context of RSs. Our study covers three biases and the
two recommendation domains of recruitment and music. While this may limit the generalizability of
the findings to other domains, we believe future studies could build upon the ones we conducted here.
Another limitation of these preliminary studies is that the experiments assume traditional
recommendation setups (e.g., matching jobs with CVs for the feature-positive efect and top-k recommendation for
homophily), neglecting the presumably strong influence the RS’s user interface has on the manifestation
or amplification of cognitive biases. Also, some of the presented results may be influenced by the
characteristics of underlying datasets. For example, the LFM-2b dataset may be representative of users of the
Last.fm service, but the country distributions of users and artists may not necessarily be representative
of the population at large. Concerning cultural homophily, in the absence of better cultural indicators
for both users and items/artists we resort to their country of origin. This limits generalizability of our
ifndings because a song produced in one country does not need to be written in the (oficial) language
of the country’s citizens, nor represent their culture. In addition, cultural identities can extend beyond
country borders. Future work therefore calls for investigating additional cultural aspects, for instance,
based on religion, interwoven history, or Hofstede’s cultural dimensions [51].</p>
      <p>Future Work: The next steps in our research agenda include devising rigorous, formalized models
of cognitive biases, creating a framework to precisely describe how they influence recommendation
outcomes, and developing prototype RSs that leverage the positive efects of cognitive biases while
mitigating the negative ones for recommendation. Focusing on the three biases studied here, concrete
future directions may include investigating the dependence of the Ikea efect on diferent functionalities
ofered by diferent streaming platforms and RSs which alters the ways users interact with them. Given
the varying prevalence of certain RS platforms between countries, we expect notable diferences.
The next steps in the study of cultural homophily could include disentangling homophily from other
factors, such as availability bias, as well as studying the relation between homophily and diversity in
recommendations.</p>
      <p>In conclusion, we strongly believe that RS researchers and practitioners should be equipped
with high sensitivity for the existence of cognitive biases and knowledge of how they may impact
diferent stages in the recommendation process. Furthermore, forming an understanding of where
cognitive biases originate from, how they are intertwined, and how they influence diferent stakeholders
will be vital to fully comprehend their role in the recommendation ecosystem. We advocate for a holistic
discussion of both negative and positive efects of cognitive biases, and for new recommendation
approaches that mitigate the former while exploiting the latter. In our opinion, this will be highly
beneficial for the RS community as a whole, and may even mark the starting point for a new generation
of cognitive-bias-aware RSs.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>This research was funded in whole or in part by the Austrian Science Fund (FWF): https://doi.org/
10.55776/P33526,https://doi.org/10.55776/DFH23, https://doi.org/10.55776/COE12, https://doi.org/10.
55776/P36413. Furthermore, we thank Stefan Brandl, Gustavo Escobedo, and Mohammad Lotfi for their
contributions to initial experiments.
Recommendation with Causal Embedding, in: Proceedings of The Web Conference, 2021, pp.
2980–2991.
[34] C. Ma, Y. Ren, P. Castells, M. Sanderson, Temporal Conformity-aware Hawkes Graph Network for</p>
      <p>Recommendations, in: Proceedings of The Web Conference, 2024, pp. 3185–3194.
[35] N. Craswell, O. Zoeter, M. J. Taylor, B. Ramsey, An Experimental Comparison of Click Position-Bias</p>
      <p>Models, in: Proceedings of WSDM, 2008, pp. 87–94.
[36] A. Felfernig, G. Friedrich, B. Gula, M. Hitz, T. Kruggel, G. Leitner, R. Melcher, D. Riepan, S. Strauss,
E. Teppan, O. Vitouch, Persuasive Recommendation: Serial Position Efects in Knowledge-Based
Recommender Systems, in: Proceedings of PERSUASIVE, volume 4744 of Lecture Notes in Computer
Science, Springer, 2007, pp. 283–294.
[37] J. R. Anderson, D. Bothell, M. D. Byrne, S. Douglass, C. Lebiere, Y. Qin, An Integrated Theory of
the Mind, Psychological Review 111 (2004) 1036.
[38] M. Reiter-Haas, E. Parada-Cabaleiro, M. Schedl, E. Motamedi, M. Tkalcic, E. Lex, Predicting Music</p>
      <p>Relistening Behavior Using the ACT-R Framework, in: Proceedings of RecSys, 2021, pp. 702–707.
[39] M. Moscati, C. Wallmann, M. Reiter-Haas, D. Kowald, E. Lex, M. Schedl, Integrating the ACT-R
Framework with Collaborative Filtering for Explainable Sequential Music Recommendation, in:
Proceedings of RecSys, 2023, pp. 840–847.
[40] R. E. Nisbett, T. D. Wilson, The Halo Efect: Evidence for Unconscious Alteration of Judgments,</p>
      <p>Journal of Personality and Social psychology 35 (1977) 250.
[41] E. L. Thorndike, A Constant Error in Psychological Ratings, Journal of Applied Psychology 4
(1920) 25–29.
[42] C. Batres, V. Shiramizu, Examining the “Attractiveness Halo Efect” Across Cultures, Current</p>
      <p>Psychology 42 (2023) 25515–25519.
[43] H. S. Jenkins, The Development of Stimulus Control Through Diferential Reinforcement,
Fundamental Issues in Associative Learning (1969).
[44] D. Kumar, T. Grosz, E. Greif, N. Rekab-saz, M. Schedl, Identifying Words in Job Advertisements
Responsible for Gender Bias in Candidate Ranking Systems via Counterfactual Learning, in:
Proceedings of RecSys in HR, volume 3490, CEUR-WS.org, 2023.
[45] M. De-Arteaga, A. Romanov, H. Wallach, J. Chayes, C. Borgs, A. Chouldechova, S. Geyik, K.
Kenthapadi, A. T. Kalai, Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes
Setting, in: Proceedings of FAccT, 2019, pp. 120–128.
[46] S. Loria, Textblob Documentation, Release 0.15 2 (2018).
[47] M. Schedl, S. Brandl, O. Lesota, E. Parada-Cabaleiro, D. Penz, N. Rekabsaz, LFM-2b: A Dataset of
Enriched Music Listening Events for Recommender Systems Research and Fairness Analysis, in:
Proceedings of CHIIR, 2022, pp. 337–341.
[48] M. Mansoury, H. Abdollahpouri, M. Pechenizkiy, B. Mobasher, R. Burke, Feedback Loop and Bias</p>
      <p>Amplification in Recommender Systems, in: Proceedings of CIKM, 2020, pp. 2145–2148.
[49] J. Xu, Y. Ren, H. Tang, X. Pu, X. Zhu, M. Zeng, L. He, Multi-VAE: Learning Disentangled
Viewcommon and View-peculiar Visual Representations for Multi-view Clustering, in: Proceedings of
ICCV, 2021, pp. 9214–9223.
[50] O. Lesota, J. Geiger, M. Walder, D. Kowald, M. Schedl, Oh, Behave! Country Representation
Dynamics Created by Feedback Loops in Music Recommender Systems, in: Proceedings of RecSys,
2024.
[51] G. Hofstede, Dimensionalizing Cultures: The Hofstede Model in Context, Online Readings in
Psychology and Culture 2 (2011).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D.</given-names>
            <surname>Kahneman</surname>
          </string-name>
          , Thinking, Fast and Slow, Penguin Books,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>R.</given-names>
            <surname>Dobelli</surname>
          </string-name>
          , The Art of Thinking Clearly: Better Thinking, Better Decisions, Hachette, UK,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J. L.</given-names>
            <surname>Eberhardt</surname>
          </string-name>
          ,
          <article-title>Biased: Uncovering the Hidden Prejudice That Shapes What We See, Think, and</article-title>
          <string-name>
            <surname>Do</surname>
          </string-name>
          , Penguin Books,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>E.</given-names>
            <surname>Bonilla-Silva</surname>
          </string-name>
          ,
          <article-title>Racism Without Racists: Color-blind Racism and the Persistence of Racial Inequality in the United States</article-title>
          , Rowman &amp; Littlefield Publishers,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Tversky</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Kahneman</surname>
          </string-name>
          ,
          <article-title>Judgment Under Uncertainty: Heuristics and Biases: Biases in Judgments Reveal Some Heuristics of Thinking Under Uncertainty</article-title>
          ,
          <source>Science</source>
          <volume>185</volume>
          (
          <year>1974</year>
          )
          <fpage>1124</fpage>
          -
          <lpage>1131</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>G.</given-names>
            <surname>Gigerenzer</surname>
          </string-name>
          , W. Gaissmaier, Heuristic Decision Making,
          <source>Annual Review of Psychology</source>
          <volume>62</volume>
          (
          <year>2011</year>
          )
          <fpage>451</fpage>
          -
          <lpage>482</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>S.</given-names>
            <surname>Fabi</surname>
          </string-name>
          , T. Hagendorf,
          <source>Why We Need Biased AI - How Including Cognitive and Ethical Machine Biases Can Enhance AI Systems, CoRR abs/2203</source>
          .09911 (
          <year>2022</year>
          ). arXiv:
          <volume>2203</volume>
          .
          <fpage>09911</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>L.</given-names>
            <surname>Azzopardi</surname>
          </string-name>
          ,
          <article-title>Cognitive biases in search: A review and reflection of cognitive biases in information retrieval</article-title>
          ,
          <source>in: Proceedings of CHIIR</source>
          ,
          <year>2021</year>
          , p.
          <fpage>27</fpage>
          -
          <lpage>37</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>J.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Azzopardi</surname>
          </string-name>
          , Search Under Uncertainty:
          <article-title>Cognitive Biases and Heuristics: A Tutorial on Testing, Mitigating and Accounting for Cognitive Biases in Search Experiments</article-title>
          , in
          <source>: Proceedings of SIGIR</source>
          ,
          <year>2024</year>
          , p.
          <fpage>3013</fpage>
          -
          <lpage>3016</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>G.</given-names>
            <surname>Gomroki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. B. and.. Rahmatolloah</given-names>
            <surname>Fattahi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. S.</given-names>
            <surname>Fadardi</surname>
          </string-name>
          ,
          <article-title>Identifying Efective Cognitive Biases in Information Retrieval</article-title>
          ,
          <source>Journal of Information Science</source>
          <volume>49</volume>
          (
          <year>2023</year>
          )
          <fpage>348</fpage>
          -
          <lpage>358</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>K.</given-names>
            <surname>Lerman</surname>
          </string-name>
          , T. Hogg, Leveraging Position Bias to Improve Peer Recommendation,
          <source>PLOS ONE 9</source>
          (
          <year>2014</year>
          )
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>E. C.</given-names>
            <surname>Teppan</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Zanker, Decision Biases in Recommender Systems</article-title>
          ,
          <source>Journal of Internet Commerce</source>
          <volume>14</volume>
          (
          <year>2015</year>
          )
          <fpage>255</fpage>
          -
          <lpage>275</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>E.</given-names>
            <surname>Lex</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Kowald</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Seitlinger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. N. T.</given-names>
            <surname>Tran</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Felfernig</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schedl</surname>
          </string-name>
          , Psychology-informed
          <source>Recommender Systems, Foundations and Trends in Information Retrieval</source>
          <volume>15</volume>
          (
          <year>2021</year>
          )
          <fpage>134</fpage>
          -
          <lpage>242</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>M.</given-names>
            <surname>Schedl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. W.</given-names>
            <surname>Anelli</surname>
          </string-name>
          , E. Lex,
          <source>Technical and Regulatory Perspectives on Information Retrieval and Recommender Systems: Fairness, Transparency, and Privacy</source>
          , Springer Cham,
          <year>2024</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>S. T.</given-names>
            <surname>Allison</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. M.</given-names>
            <surname>Messick</surname>
          </string-name>
          , The Feature-positive
          <string-name>
            <surname>Efect</surname>
          </string-name>
          ,
          <source>Attitude Strength, and Degree of Perceived Consensus, Personality and Social Psychology Bulletin</source>
          <volume>14</volume>
          (
          <year>1988</year>
          )
          <fpage>231</fpage>
          -
          <lpage>241</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>E.</given-names>
            <surname>Rassin</surname>
          </string-name>
          ,
          <article-title>Individual Diferences in the Susceptibility to the Feature-Positive Efect, Psychological Test Adaptation and Development (</article-title>
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>M. D. Ekstrand</surname>
          </string-name>
          ,
          <string-name>
            <surname>A. Das</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Burke</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Diaz</surname>
          </string-name>
          ,
          <source>Fairness in Information Access Systems, Foundations and Trends in Information Retrieval</source>
          <volume>16</volume>
          (
          <year>2022</year>
          )
          <fpage>1</fpage>
          -
          <lpage>177</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>M. I.</given-names>
            <surname>Norton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Mochon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Ariely</surname>
          </string-name>
          , The IKEA Efect:
          <article-title>When Labor Leads to Love</article-title>
          ,
          <source>Journal of Consumer Psychology</source>
          <volume>22</volume>
          (
          <year>2012</year>
          )
          <fpage>453</fpage>
          -
          <lpage>460</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>L. E.</given-names>
            <surname>Marsh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Kanngiesser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Hood</surname>
          </string-name>
          ,
          <article-title>When and How Does Labour Lead to Love? The Ontogeny and Mechanisms of the IKEA Efect</article-title>
          ,
          <source>Cognition</source>
          <volume>170</volume>
          (
          <year>2018</year>
          )
          <fpage>245</fpage>
          -
          <lpage>253</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>N.</given-names>
            <surname>Ferguson</surname>
          </string-name>
          ,
          <article-title>The False Prophecy of Hyperconnection: How to Survive the Networked Age</article-title>
          ,
          <source>Foreign Afairs</source>
          <volume>96</volume>
          (
          <year>2017</year>
          )
          <fpage>68</fpage>
          -
          <lpage>79</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>N. P.</given-names>
            <surname>Mark</surname>
          </string-name>
          ,
          <article-title>Culture and Competition: Homophily and Distancing Explanations for Cultural Niches</article-title>
          ,
          <source>American Sociological Review</source>
          <volume>68</volume>
          (
          <year>2003</year>
          )
          <fpage>319</fpage>
          -
          <lpage>345</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Jiang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. I.</given-names>
            <surname>Bolnick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kirkpatrick</surname>
          </string-name>
          , Assortative Mating in Animals,
          <source>The American Naturalist</source>
          <volume>181</volume>
          (
          <year>2013</year>
          )
          <fpage>E125</fpage>
          -
          <lpage>E138</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>O.</given-names>
            <surname>Lesota</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Parada-Cabaleiro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Brandl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Lex</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Rekabsaz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schedl</surname>
          </string-name>
          ,
          <article-title>Traces of Globalization in Online Music Consumption Patterns and Results of Recommendation Algorithms</article-title>
          , in: Proceedings of ISMIR,
          <year>2022</year>
          , pp.
          <fpage>291</fpage>
          -
          <lpage>297</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>M.</given-names>
            <surname>Mather</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. L.</given-names>
            <surname>Carstensen</surname>
          </string-name>
          ,
          <article-title>Aging and Motivated Cognition: The Positivity Efect in Attention and Memory</article-title>
          ,
          <source>Trends in Cognitive Sciences</source>
          <volume>9</volume>
          (
          <year>2005</year>
          )
          <fpage>496</fpage>
          -
          <lpage>502</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>A. R.</given-names>
            <surname>Sutin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Terracciano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Milaneschi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>An</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Ferrucci</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. B.</given-names>
            <surname>Zonderman</surname>
          </string-name>
          ,
          <source>The Efect of Birth Cohort on Well-Being: The Legacy of Economic Hard Times, Psychological Science</source>
          <volume>24</volume>
          (
          <year>2013</year>
          )
          <fpage>379</fpage>
          -
          <lpage>385</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>T. R.</given-names>
            <surname>Mitchell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Thompson</surname>
          </string-name>
          , E. Peterson,
          <string-name>
            <given-names>R.</given-names>
            <surname>Cronk</surname>
          </string-name>
          ,
          <article-title>Temporal Adjustments in the Evaluation of Events: The “Rosy View”</article-title>
          ,
          <source>Journal of Experimental Social Psychology</source>
          <volume>33</volume>
          (
          <year>1997</year>
          )
          <fpage>421</fpage>
          -
          <lpage>448</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>E.</given-names>
            <surname>Parada-Cabaleiro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mayerl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Brandl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Skowron</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schedl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Lex</surname>
          </string-name>
          , E. Zangerle,
          <article-title>Song Lyrics Have Become Simpler and More Repetitive Over the Last Five Decades</article-title>
          ,
          <source>Scientific Reports</source>
          <volume>14</volume>
          (
          <year>2024</year>
          )
          <fpage>5531</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>X. J.</given-names>
            <surname>Yang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. D.</given-names>
            <surname>Wickens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Hölttä-Otto</surname>
          </string-name>
          ,
          <article-title>How Users Adjust Trust in Automation: Contrast Efect and Hindsight Bias</article-title>
          ,
          <source>Proceedings of the Human Factors and Ergonomics Society Annual Meeting</source>
          <volume>60</volume>
          (
          <year>2016</year>
          )
          <fpage>196</fpage>
          -
          <lpage>200</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>G. B.</given-names>
            <surname>Chapman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. J.</given-names>
            <surname>Johnson</surname>
          </string-name>
          , Incorporating the Irrelevant:
          <article-title>Anchors in Judgments of Belief and Value, Heuristics and Biases: The Psychology of Intuitive Judgment (</article-title>
          <year>2002</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>J. W.</given-names>
            <surname>Payne</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. R.</given-names>
            <surname>Bettman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. J.</given-names>
            <surname>Johnson</surname>
          </string-name>
          , The Adaptive Decision Maker, Cambridge University Press,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>E. C.</given-names>
            <surname>Teppan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Felfernig</surname>
          </string-name>
          ,
          <article-title>Calculating Decoy Items in Utility-based Recommendation</article-title>
          ,
          <source>in: Proceedings of IEA/AIE</source>
          , Springer,
          <year>2009</year>
          , pp.
          <fpage>183</fpage>
          -
          <lpage>192</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>G.</given-names>
            <surname>Adomavicius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bockstedt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Curley</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. Zhang</surname>
          </string-name>
          , Recommender Systems, Consumer Preferences, and Anchoring Efects,
          <source>in: Proceedings of the Workshop on Human Decision Making in Recommender Systems</source>
          ,
          <year>2011</year>
          , pp.
          <fpage>35</fpage>
          -
          <lpage>42</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zheng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Gao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>He</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Jin</surname>
          </string-name>
          ,
          <article-title>Disentangling User Interest and Conformity for</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>