<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Retiree Volunteerism: Automating “Word of Mouth” Communication</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jefrey Black</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ishitha Michael</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dan Roberts</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Brodrick Stigall</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bart P. Knijnenburg</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Clemson University</institution>
          ,
          <addr-line>105 Sikes Hall, Clemson, SC</addr-line>
          ,
          <country country="US">United States of America</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2023</year>
      </pub-date>
      <abstract>
        <p>Many retired people engage in volunteer opportunities as a means to give back to their communities, stay physically and intellectually active, and build and expand their social networks. However, our semi-structured interviews of six retirees found that they typically avoid searching for volunteer opportunities through websites and social media due to a lack of trust in those tools and a concern for privacy. Instead, they rely on word-of-mouth communication facilitated through emails with individuals and organizations they trust. To support this type of communication, we designed an adaptive interaction mechanism in the form of a newsletter with volunteer opportunities that are personalized using recommender system technology. The newsletter mechanism leverages personal connections through user-defined preference-based communities that allow users to share volunteer opportunities with their peers.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;User-centered design</kwd>
        <kwd>Recommender Systems</kwd>
        <kwd>Seniors</kwd>
        <kwd>Volunteering</kwd>
        <kwd>Retirement</kwd>
        <kwd>Community</kwd>
        <kwd>Privacy</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. General Introduction</title>
      <p>
        portunities, relying instead on word-of-mouth
communication, internal email newsletters, and their knowledge
Retirees are a valuable asset for volunteer organizations, of their community’s needs. Secondly, while retirees do
which in turn provide retirees with a means to stay en- select volunteer activities based on personal motivations
gaged and intellectually active [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. In this paper we aim and interests, they also personalize their experience once
to discover what compels retirees to volunteer, how vol- they engage in a volunteer role—sometimes in a way
unteer opportunities are found and shared within their that reflects their past careers, but in many instances to
communities, and the extent to which volunteering is a do something completely diferent. Third, retiree
volunsocial process and a factor in self-actualization. We then teers often actively encourage their acquaintances to join
propose an adaptive decision support mechanism that them, but do this in a way that is protective of their own
helps retirees find and participate in volunteer opportu- privacy and the privacy of their peers.
nities. These findings informed the design of our interaction
      </p>
      <p>Our research team conducted semi-structured inter- mechanism that augments existing volunteer opportunity
views with six retirees representing four diferent lifestyles email newsletters with automated recommender system
to understand their decisions about volunteering. Our capabilities. Our Personal Community Volunteer System
interview focused on understanding the key factors that (PCVS) incorporates social recommender system
princimotivate retirees to volunteer, how they assimilate into ples to assimilate the word-of-mouth recruitment
stratthe roles they choose, and how they entice others in their egy retiree volunteers are familiar with, while providing
social circles to join them in volunteering. Our expecta- a balance between community-building capabilities and
tions were that the volunteering roles each retiree takes privacy.
on would be a highly personal decision, often reflecting
their past professional careers. Futhermore, we expected
that they would rely on web sources such as Volunteer- 2. Related Work
Match, the AARP Volunteering platform, or volunteer
recommendations on local websites.</p>
      <p>In analyzing our interviews, we found that retirees
typically do not use online tools to find volunteer
op</p>
      <sec id="sec-1-1">
        <title>Several prior research papers and textbooks informed</title>
        <p>
          our research on retiree volunteerism and the
development of our resulting interaction mechanism. We used
Charmaz’s textbook on grounded theory to guide our
interview study and data analysis [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. Knijnenburg et
al.’s work on recommender systems for self-actualization
provided a core motivation to design a meaningful
recommendation experience for older adults [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. Bradley’s
work on volunteering among older adults led us to probe
participants motivations to volunteer [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. Bradley’s
assertion that older adults volunteer to stay engaged and
intellectually active was echoed often in our interviews. after the protocol was explained and the consent forms
        </p>
        <p>
          In probing the user experience in seeking and react- were signed. We conducted individual interviews with six
ing to recommendations, we followed the guidance of subjects, with one or two researchers present. The
interKnijnenburg et al. [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], particularly focusing on the need views were semi-structured, allowing for a natural flow
to consider the personal and situational characteristics of conversation as the subjects shared their experiences.
of users and their intention to trust various types of sys- The interviews lasted 30–75 minutes. We asked retirees
tems. Furthermore, we considered choice overload as a about their education and work background, their
interpotential reason for retirees to avoid volunteer opportu- est in and motivations for volunteering, how they found
nity websites [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]. Our evaluation of the degree in which volunteer opportunities, and their past and current
volunvolunteers may be motivated by recommendations from teer activities. Our research protocol and list of questions
friends and acquaintances was influenced by work on is available upon request.
the need for inspectability and control [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] and the “so- The audio recordings of the interviews were
autocial matching” tendencies of individuals in reacting to transcribed and loaded into a shared spreadsheet. Our
recommendations [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]. Our interest in probing the pri- researchers individually coded each line of the
intervievacy concerns of retirees was motivated by research on wees’ comments, capturing memo notes and direct quotes
privacy in recommender systems [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] and social media in adjoining cells. These codes were then analyzed to
[
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. identify the most common codes, categories, and
con
        </p>
        <p>Finally, while we found prior research on the phe- cepts, which informed the development of theories about
nomenon of word-of-mouth communication in many how retired individuals learn about and pursue
voluncontexts, we found none specific to retiree volunteers. teer opportunities, personalize their roles, and encourage
The current paper makes important contributions on this others to volunteer. Our full data repository is available
front. upon request.</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>3. Research Methods</title>
    </sec>
    <sec id="sec-3">
      <title>4. Results</title>
      <p>
        We employed a lightweight version of Charmaz’s guide- Our initial coding eforts resulted in 287 instances of 124
lines for grounded theory research [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] to investigate the unique codes. These codes were aggregated into ten core
processes and tools utilized by older retired individuals in categories: volunteering, teaching, learning, connecting,
their pursuit of and assimilation into volunteer roles. Our escaping, staying relevant, contributing, personalizing
IRB-approved research study involved selecting a sample experience, socializing, community, and commitment.
of individuals with relevant experience, conducting open- These categories captured the diversity of motivations
ended interviews, and analyzing the transcripts through a and preferences among our volunteers, with some being
thorough coding process. These codes were subsequently dedicated to their missions and others using volunteering
distilled into concepts and categories, which informed as a social outlet. We further divided these 10 categories
the development of theories regarding the motivations into two main groups related to participation in volunteer
and behaviors of the research subjects. Throughout the opportunities.
study, researchers made memo notes and recorded key The first group consists of categories associated with
quotes for documentation purposes. opportunity-volunteer fit. This group captured the
degree to which an opportunity relates to an individual’s
3.1. Participants historical or current interests; one’s personal motivation
for volunteering (e.g., to have an impact, to socialize, to
For our study we recruited six retired volunteers from stay engaged, or to escape); aspects related to a
voluna lifelong learning institute, residents of a local retire- teer organization’s values and demographic make-up; the
ment community, and family members of one of the re- time or energy commitment required to volunteer in
varisearchers (see Table 1). We selected interviewees from ous positions; and one’s ability to participate in volunteer
the former two sources through recommendations from opportunities (e.g., accessibility considerations).
administrators, and conducted the interviews in person The second group of categories examines how
indior via Zoom. viduals find and share information about new
volunteering opportunities. This includes the concept of organic
3.2. Procedure and Data Analysis recruitment, where individuals learn about
opportunities through events, activities, and interpersonal
connections related to their interests; explicit recruitment
efforts through word-of-mouth, flyers, or websites; and the
accessibility of information about volunteering
opportu
      </p>
      <sec id="sec-3-1">
        <title>Our interviews complied with the local IRB’s guidelines for the protection of human subjects. All interviewees reviewed a consent form and agreed to have their interviews recorded. Interview questions were posed verbally</title>
        <sec id="sec-3-1-1">
          <title>4.2. Organic Recruitment</title>
        </sec>
        <sec id="sec-3-1-2">
          <title>4.1. Interests and Motivation</title>
          <p>nities, such as the medium used to share information to
older adults.</p>
          <p>Using contrastive coding practices, we then developed
several axial codes based on these groups and categories.
The major takeaways from each axial code are presented
in the following subsections.</p>
          <p>Participating in any activity (even those not related to
volunteering) can organically cultivate an interest in
volunteering and help retirees discover new volunteer
opportunities. For instance, U01 and U02 discovered
volunteering opportunities by participating in lifelong learning
classes, and were later approached about those
opportunities, which they accepted. These individuals now
regularly learn about new volunteer opportunities through
word-of-mouth because of their involvement in the
organization and organized events.</p>
          <p>Some organizations take advantage of this organic
recruitment efect by actively recruiting new volunteers
at events—participants noted that the Lifelong Learning
Institute had made eforts to get people to congregate,
such as socials and book exchanges. Finding volunteer
opportunities is often not a case of retirees outside an
organization looking in, but rather current volunteers
and staf inside an organization looking outward to find
new volunteers. U01, for example, noted that she
regularly "makes a plea" for new volunteers at such events,
and several interviewees remembered being approached
at events about opportunities within the organization.
These findings highlight the importance of existing
organizational structures in recruiting retiree volunteers.</p>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>When opportunities align with a retiree’s interests or</title>
        <p>personal motivations, they are more likely to volunteer.</p>
        <p>For example, participant U03, who used to play polo,
now volunteers to teach children how to ride horses and
play polo. They also volunteer at grade schools to
provide art presentations and encourage others to pursue
the arts, saying "I guess I’ve used volunteering as more
of an escape" and "to give back." U02, a former English
teacher, volunteers to teach reading and English, stating
"Well, I’ve been a teacher for 42 years, and they were
ofering me the opportunity to continue doing what I
always loved" and "It’s been very important. It’s changed
my life. It’s kept my brain alive." U05 believes that good
volunteers "select volunteer opportunities in which that
volunteer has a deep interest," with volunteering being
where interests meet needs. The degree to which these
volunteering interests and motivations are related to the
users’ past experiences varies, however. For instance, in
the case of U01 and U06, these users chose volunteering 4.3. Organizational Culture
roles that were not so closely related to their prior
careers. U01 moved from a career in education to a role in Organizational culture significantly influenced retirees’
administration, and U03 moved from being an assisted decision to participate in volunteer opportunities. For
inliving administrator to being a leader for the local church stance, U01 stated that when she brings friends to see the
and community. In the case of U03, in addition to vol- lifelong learning institute and they meet the organizers
unteering for opportunities related to her interests in and volunteers, and experience the general culture, "they
horseriding and polo, she is primarily involved with art are sold!" Conversely, some volunteers make substantial
events and wishes to get involved with the National Parks contributions to the organizational culture, attracting
Service. While interests and motivations may vary from many members and potential recruits. For example, U01
person to person, these findings highlight the importance mentioned volunteers with notable careers, such as a
of personalizing volunteer experiences to the individuals’ doctor who fought HIV and distinguished academics,
interests and motivations. who deliver interesting lectures and draw in potential
volunteers. This means that recruitment eforts not only
increase volunteer numbers but also enhance the
organizational culture. For example, U01 mentioned that the
doctor who fought HIV decided to start an annual re- misinformation as a reason for avoiding social media,
cruitment event for the organization, thereby making and stated that she is trying to avoid “getting hooked”
a positive impact. Again, these findings emphasize the to email. Most participants expressed a level of trust in
importance of existing organizational structures. emails from organizations and individuals they know,
but signaled a lack of trust in other resources.
4.4. Required Commitment Overall, interviewees emphasized that word-of-mouth
is the key to finding and recruiting volunteers. As U01
How much time, energy, and overall commitment is re- stated, "I have no idea of anybody who finds volunteer
quired for an individual to volunteer great impact on jobs via computers. [...] The way you find volunteers is
their ability to participate. For example, as U01, U02, through other people, word-of-mouth."
and U03 noted, retirees lead very busy lives—many visit
family members that live far away, are involved with 4.6. Volunteer Habits Change Over Time
organizations around them, or are doing other activities
with their retirement time—making regular time com- Lastly, abilities of retirees change as they advance in age,
mitments can be dificult for some. Furthermore, some which may afect their desire and ability to participate in
volunteers may experience age-related issues that reduce volunteer activities. For example, U06 participated in a
the feasibility of participating, with U02 noting the re- horse welfare camp but she felt she was getting too old
strictions of arthritic volunteers. Another restriction is for this high-energy commitment, so she terminated her
that some retirees eventually return to work in some participation. Additionally, personal motivations may
capacity—U04 and U05 both expressed that they would change, and volunteers may decide they want to try
somedo more volunteering if their job did not take up so much thing diferent. For example, U03 stated that she would
of their time. like to explore new volunteering opportunities and that</p>
        <p>Some people have personal motivations that may af- she has always wished to work for the National Parks
fect their desire to commit themselves to volunteering Service. Similarly, U06 said she would like to volunteer
opportunities. For instance, U01 started a center for help- for the Dollywood Foundation and also would like to
ing abused children. This created a high-stress, high- take care of sea turtles.
commitment role for herself, but she remained motivated It is in organizations’ best interest to accommodate
by her strong commitment to causes that help children. changes in volunteers’ motivations and abilities, as this
On the other hand, if the commitment required by an may lead to them leaving a greater impact on an
orgaopportunity exceeds one’s threshold, they may move on nization than might have otherwise been possible. For
to other volunteering opportunities that better fit their example, U01 mentioned that the doctor who fought
abilities. For example, U03 mentioned that their volun- HIV had originally made plans to give a lecture about
teer work sometimes felt more like a job than something COVID-19, but eventually decided to be more interested
she was passionate about, and she often left events feel- in organizing a variety of fundraising eforts that ended
ing dissatisfied. Likewise, U01 and U02 noted that people up drawing large crowds.
sometimes “get up to here!” with responsibilities and just
say “I’ve done enough,” ultimately quitting their volun- 4.7. A Theory of Retiree Volunteering
teering role. These findings emphasize the importance
of matching the required commitment with the abilities
of the retiree volunteer.</p>
        <p>Figure 1 summarizes our findings in a Theory of Retiree
Volunteering. Upon retiring, people often turn to
volunteer activities as a means of adapting to new life
4.5. Word-Of-Mouth Recruitment circumstances. The process of finding and committing
to a volunteer opportunity is a deeply personal process
Many of our participants reported rather limited tech- driven by retirees’ activity of seeking relevance. This
nology usage, relying on email and word-of-mouth for process crucially depends on retirees connecting with
communication more than social media or other web- available volunteer organizations—something that
prisites. This makes recruiting volunteers through word-of- marily happens through interpersonal relationships and
mouth more efective than other recruitment methods. communications. Additionally, volunteering
opportuniFor instance, U03 and her friends learned about volunteer ties must be a good fit for the volunteer (i.e., be related
possibilities mostly by word of mouth, and she suggested to their interests, fulfill their goals, and be accessible to
that many in her age group do not use online resources them). In many cases, this means personalizing the
when looking for opportunities. experience—something that also ascertains that the role</p>
        <p>Another key aspect of the retirees’ technology choice remains a good fit for the volunteer, even as their
moinvolves the desire to protect their privacy and to avoid tivations, interests, and abilities change. The ultimate
scams. For instance, U01 cited specific concerns about goal of this process is contributing to the volunteer
We designed an interaction mechanism informed by the
ifndings of our interview study (see Figure 2). Our
Personal Community Volunteer System (PCVS) builds on
existing volunteer opportunity email newsletters with
the addition of a personalized social recommender-based
organization, not only through the volunteer activities engine. This design reflects the interviewees’ feedback
themselves, but also by contributing to the organizational that volunteers find opportunities organically, and that
culture and by recruiting others to join the organization. the preferred tool for communicating within their social</p>
        <p>From finding opportunities, to participating, to recruit- circle is email.
ing others into an organization; every step in the volun- The PCVS shows opportunities sourced from
organizateering process is deeply personal for retired volunteers. tions the user has signed up for. In its full implementation,
A decision support mechanism must therefore support organizations would register with the service, and users
this highly personal process, rather than try to replace it would sign up for organizations in order to receive
inforwith a new process that will likely be abandoned. Indeed, mation about volunteering opportunities. Additionally,
our results suggest that existing attempts to replace the to allow users to organically learn about new
opportuniprocess have failed, as seen by the low prevalence of ties through volunteer social networks, we built in a peer
website-based volunteer recruitment systems being used group system (see Figure 3). That is, the second grouping
by retirees. of volunteer opportunities is based on preference-based
communities: Aided by a social recommender engine
that matches users to groups of volunteers with similar
5. Interaction Mechanism Design interests, users can create, join, and add events to these
peer groups. The events that have been added to a peer
group are included in the newsletter of each person in
the peer group. This peer group system enables users
to create small networks of volunteers that share
opportunities with each other, just like how our interviewees
told us they find opportunities. an interaction mechanism to support retirees in these</p>
        <p>To help users understand how well an opportunity tfis, activities. The findings of our semi-structured interview
we display a description of the opportunity, the location, study show that the process of finding and learning about
the number of people signed up, the date/time/frequency, new volunteering opportunities is a deeply personal and
and an image of the type of volunteer work for each organic process for retirees: Information about
volunopportunity. Lastly, users can join an opportunity by teering opportunities is spread through word-of-mouth,
pressing the “sign up” button, which takes them to a and retirees must make sure that the opportunities are—
page where they can complete any formal registration and remain—a good fit for their interests, motivations,
required for the event. and abilities. Furthermore, we found that older adults
do not use the most modern communication methods,
preferring email and face-to-face communication over
6. Discussion, Limitations, and social media or websites.</p>
        <p>Future work Based on these findings we designed the PCVS: an
email-based newsletter system that displays lists of
volunIn this paper, we present our user studies to better under- teer opportunities based on existing organization
memstand how retirees find, join, and disseminate volunteer berships and user-defined preference-based
communiopportunities. Based on our findings, we then developed ties (i.e., peer groups). For the latter, opportunities are
displayed in groupings labeled by the preference-based experience. This research was supported in part by the
community they are associated with, and a social recom- NSF award IIS 2045153.
mender engine helps users find or create new
communities, view users within the communities, and recommend
events to them. The focus on smaller communities sup- References
ports word-of-mouth recruitment while respecting their
privacy.</p>
        <p>
          Our research was constrained by a small sample size
and a short time frame of three months to design the
study and complete data collection. Additionally, all of
our interviewees were college-educated with previous
professional careers, most with connections to a local
university. Future work should expand this sample to be
more diverse, particularly in education level, past
employment roles, and geographic location. Such work can also
study the volunteer decision processes of people that are
not retired, to better understand the diferences between
those populations, and how our interaction mechanism
could be generalized to a broader audience. Future
research may explore how system preferences change with
a new generation of retirees. With the rise of ubiquitous
computing, newer retirees with more technological
experience may prefer outlets such as social media platforms
and instant messaging services for finding and sharing
information about volunteering. In the future, we aim
to implement the presented system and conduct a user
experiment [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] to evaluate the efectiveness.
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>7. Conclusion</title>
      <p>In this paper we studied what compels retirees to
volunteer, how they find and select volunteer opportunities,
and how they share opportunities with their personal
social network. We used our findings to design an
adaptive decision support mechanism to help retirees find
volunteer activities that integrates social recommender
technologies into existing email newsletters.</p>
      <p>Our results are not only useful in helping older adults
look for meaningful activities and social groups but may
also have broader implications for social decision
support systems in general. Importantly, we conjecture that
allowing users to craft their own preference-based
communities may be a broadly-applicable approach to
supporting decision contexts that are heavily guided by close,
interpersonal relationships. Recommender technologies
can further support the creation of such communities and
catalyze the word-of-mouth recommendation process.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <sec id="sec-5-1">
        <title>We would like to thank the Osher Lifelong Learning Institute at Clemson and all of the interviewed participants for their willingness to coordinate with our team and provide a rich perspective on the retiree volunteering</title>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>R.G.</given-names>
            <surname>Anaraky</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.P.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Risius</surname>
          </string-name>
          .
          <year>2020</year>
          .
          <article-title>Exacerbating mindless compliance: The danger of justifications during privacy decision making in the context of Facebook applications</article-title>
          .
          <source>AIS Transactions on Human-Computer Interaction 12</source>
          ,
          <issue>2</issue>
          (
          <year>2020</year>
          ),
          <fpage>70</fpage>
          -
          <lpage>95</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>D.</given-names>
            <surname>Bollen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.P.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.C.</given-names>
            <surname>Willemsen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Graus</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Understanding choice overload in recommender systems</article-title>
          .
          <source>In Proceedings of the fourth ACM conference on Recommender systems. 63-70.</source>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.B.</given-names>
            <surname>Bradley</surname>
          </string-name>
          .
          <year>1999</year>
          .
          <article-title>A reason to rise each morning: The meaning of volunteering in the lives of older adults</article-title>
          .
          <source>Generations: Journal of the American Society on Aging 23</source>
          ,
          <issue>4</issue>
          (
          <year>1999</year>
          ),
          <fpage>45</fpage>
          -
          <lpage>50</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>K.</given-names>
            <surname>Charmaz</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Constructing grounded theory: A practical guide through qualitative analysis</article-title>
          .
          <source>sage.</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Friedman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.P.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Vanhecke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Martens</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Berkovsky</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Privacy aspects of recommender systems</article-title>
          .
          <source>In Recommender systems handbook</source>
          . Springer, Boston, MA,
          <fpage>649</fpage>
          -
          <lpage>688</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>B.P.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bostandjiev</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          <article-title>O'Donovan, and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Kobsa</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Inspectability and control in social recommenders</article-title>
          .
          <source>In Proceedings of the sixth ACM conference on Recommender systems. 43-50.</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>B.P.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.C.</given-names>
            <surname>Willemsen</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Evaluating recommender systems with user experiments</article-title>
          .
          <source>In Recommender systems handbook</source>
          . Springer, Boston, MA,
          <fpage>309</fpage>
          -
          <lpage>352</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>B.P.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.C.</given-names>
            <surname>Willemsen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Gantner</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Explaining the user experience of recommender systems</article-title>
          .
          <source>User Model User-Adap Inter</source>
          <volume>22</volume>
          (
          <year>2012</year>
          ),
          <fpage>441</fpage>
          -
          <lpage>504</lpage>
          . https://doi.org/10.1007/ s11257-011-9118-4.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Bart</surname>
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Knijnenburg</surname>
            , Saadhika Sivakumar, and
            <given-names>Daricia</given-names>
          </string-name>
          <string-name>
            <surname>Wilkinson</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Recommender Systems for Self-Actualization</article-title>
          .
          <source>In Proceedings of the 10th ACM Conference on Recommender Systems</source>
          (Boston, Massachusetts, USA) (
          <source>RecSys '16)</source>
          .
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>11</fpage>
          -
          <lpage>14</lpage>
          . https://doi.org/10.1145/2959100.2959189
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>L.</given-names>
            <surname>Terveen</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.W.</given-names>
            <surname>McDonald</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Social matching: A framework and research agenda. ACM transactions on computer-human interaction (TOCHI 12, 3 (</article-title>
          <year>2005</year>
          ),
          <fpage>401</fpage>
          -
          <lpage>434</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>