<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Unsupervised Topic Modelling in a Book Recommender System for New Users</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Haifa Alharthi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Diana Inkpen</string-name>
          <email>Diana.Inkpen@uottawa.ca</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stan Szpakowicz</string-name>
          <email>szpak@eecs.uottawa.ca</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>EECS, University of Ottawa</institution>
          ,
          <addr-line>Ottawa</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2017</year>
      </pub-date>
      <abstract>
        <p>Book recommender systems (RSs) are useful in libraries, schools and e-commerce applications. To our knowledge, no book RS exploits social networks other than book-cataloguing websites. We propose a recommendation component that learns the user's interests from social media data and recommends books accordingly. Our new method of modelling users' interests acquires a user's distinctive topics using tf-idf and represents them as word embeddings. Even though the system is designed to complement other systems, we evaluated it against content-based RS, a traditional book RS, and obtained similar performance. So, the system's new user would receive recommendation as accurate as current users.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>INTRODUCTION</title>
      <p>The information flood on the Internet makes desirable a wide
variety of applications, among them recommender systems (RSs).
They help limit users’ choices to the possibly most preferred items.
To make suggestions, existing RSs exploit users’ rating history,
product features, user social-media content and relationships, user
personality and emotions, and more.</p>
      <p>
        Investigating book RSs is a worthwhile endeavour. They are
useful in libraries, schools and e-learning portals, as well as
bookstores and e-commerce applications. They can help libraries with
abundant unused resources—e.g., 75% of the books in the library of
Changsha University of Science and Technology have never been
checked out [
        <xref ref-type="bibr" rid="ref48">48</xref>
        ]. The practice of reading for pleasure has declined
in recent years, especially among children.1 This decline may affect
life quality: readers may be significantly more likely than
nonreaders to report better health/mental health, to volunteer and feel
strongly satisfied with life [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Exposure to fiction also correlates
with higher ability of communication, empathy and social support
[
        <xref ref-type="bibr" rid="ref27 ref28">27, 28</xref>
        ].
      </p>
      <p>One challenge facing RSs is the user cold start. It happens when
new users with no rating history are introduced to the system. A
book RS may consider non-readers as new users and recommend
books to them, and so help encourage the practice of reading. An
issue related to cold start is the lack of explicit feedback from
existing users, who may find it burdensome to assign ratings to
items.</p>
      <p>This paper proposes an automatic personalization module that
learns the users’ interests from social media data and recommends
books accordingly. The Topic-Model-Based book recommendation
component (TMB) would help existing RSs deal with new users
with no user rating history. For each user, a topic profile is created
that summarizes subjects discussed on her social media account.
User profiles are matched with descriptions of books, and the most
similar ones are suggested. To evaluate TMB, a dataset was collected
that encompasses user profiles on Twitter and Goodreads, a social
book cataloging Web site. We compared the top k recommendations
made by TMB and content-based system (CB). Both retrieved a
comparable number of books, even though CB relied on users’
rating history while TMB only needed their social profiles. We
conclude that new users would receive recommendations (made by
TMB) as accurate as those for current users (made by CB).</p>
      <p>
        Content-based RS is a standard RS which is widely used for book
recommendations [
        <xref ref-type="bibr" rid="ref22 ref31 ref35 ref44">22, 31, 35, 44</xref>
        ]. A CB recommender is a classifier
that learns the patterns and similarities in the purchase history of
one user to predict her future interests.
      </p>
      <p>
        Many book RSs exploit social media, as explained in section 2,
but they are all focused on social networks established mainly for
readers such as LibraryThing. Our research investigates the use of a
general platform, Twitter, to make book recommendations. Here is
why: Twitter is not exclusive to bookworms, so it can help address
the issue of new users who have no reading profiles. Moreover, since
its establishment, Twitter has been used to survey opinions, report
news (more than 85% of the Twitter activities are related to news
events), raise awareness, create social and political movements and
more; topics discussed on this medium have wide diversity and are
up-to-date [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. This ofers a chance to understand the reactions
and opinions of active users to their surroundings, e.g., the social
and political scene. It allows the capturing of broad topics that
the user cares about and may not read about them yet which may
help with the over-specialization issue, users receiving non-diverse
recommendation lists.
      </p>
      <p>The remainder of the paper is organized as follows. Section 2
summarizes the related work especially in the domains of social RSs
for books and news articles. Section 3 gives a high-level description
of the system and its components. Section 4 explains the details
of data collection and preprocessing, as well as the system
implementation. Section 5 defines the experiment settings and illustrates
its results. Section 6 discusses the results. Section 7 concludes and
suggests future work.
2
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>RELATED WORK</title>
    </sec>
    <sec id="sec-3">
      <title>Topic Modelling of Text in RSs</title>
      <p>
        Topic models have helped estimate preferences in many RSs. To
name a few, recommendations were based on the topics extracted
from movie plots [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], articles [
        <xref ref-type="bibr" rid="ref33 ref45">33, 45</xref>
        ], online courses syllabi [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
and trending categories on e-commerce portals [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. Unlike the
previously mentioned work which mainly analyzes textual
description of items, TMB model the topics discussed in a user profile to
capture their interests and make recommendations accordingly.
      </p>
      <p>
        Based on topics learned from users’ Twitter accounts, RSs could
suggest hashtags [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] and friends [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]. TMB, on the other hand,
addresses the new user issue by exploiting tweets to recommend
items that are not Twitter-relevant (e.g., not hashtags).
2.2
      </p>
    </sec>
    <sec id="sec-4">
      <title>Social media and the new user issue</title>
      <p>
        Social media have been a great resource to “warm up” the user cold
start. A users connections on social network were exploited in [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ],
[
        <xref ref-type="bibr" rid="ref40">40</xref>
        ], [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. In addition to using Facebook friends lists,
[
        <xref ref-type="bibr" rid="ref40">40</xref>
        ] analyzed users’ demographics and pages liked by a user.
      </p>
      <p>
        [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ] solved the new user issue by analyzing a target user ’s
tweets and identifying which movie genres she likes. The cosine
similarity between a tweet and a movie storyline is calculated. If the
similarity is higher than 0.5, the movie’s genre is added to the user’s
favourite genres. Later, movies from the most frequent genres are
recommended.
2.3
      </p>
    </sec>
    <sec id="sec-5">
      <title>Recommendations of textual items</title>
      <p>This section covers social RSs dedicated to recommending textual
items, including books and news articles. First, we need to
diferentiate the characteristics of the book and the news recommendation
tasks. News has a short lifetime and may become irrelevant within
days or even hours. On the other hand, many books have survived
hundreds of years and are still widely read and recommended.
Furthermore, news content is dynamic and changes rapidly / daily.
That requires the analysis of hashtags and entities such as names
and places that may correspond with the news. However, books
include broad aspects and are mostly unrelated to present names
and actions. Thus, unlike news, book social RSs need to look for
users’ long-term interests.</p>
      <p>
        2.3.1 Book recommendations using social media. LibraryThing
is a social book-cataloguing Web site which allows users to form
friendships and catalogue and tag books. [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ] match books that
a target user likes with books that her friends like. Each book in
LibraryThing has a cloud of tags, and the system suggests the most
similar tag-represented books, using a word correlation matrix.
Another system also uses tags to find similar books in the user’s
friends list [
        <xref ref-type="bibr" rid="ref38">38</xref>
        ]. Books are considered similar when they share
one or more tags with friends or are highly rated by a user’s most
reliable friends.
      </p>
      <p>
        Another system that exploits LibraryThing, presented by [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ],
addresses the new item issue. Each book is characterized by tf-idf
vectors of social tags (extracted from LibraryThing) and book tags
(from the whole text of a book). For new books with no available
social tags, a relevance model (RM) is adopted to learn from a
book’s tags to predict social tags. A pure RM gives results similar
to collaborative filtering. To our knowledge, no book RSs exploit
social networks other than book-cataloguing websites.
      </p>
      <p>
        2.3.2 Twiter-based news recommendations. To make news
recommendations, [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] treat a user profile as a query; the k most
similar candidate news articles are recommended. User profiles are
constructed from three elements: hashtags, entities and topics. A
concept is weighted by counting the times a user mentions it (e.g.,
#technology = 5). A framework, OpenCalais, is used to spot names
of people, places and other entities in addition to topics; there is a
limitation to 18 diferent topics ( e.g., politics or sports). Entity-based
user profiles scored the highest S@k (Success at rank k) at 0.20.
      </p>
      <p>
        [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] propose a Twitter-based URL recommender. Cosine similarity
is computed between user profiles and URL topics, and the system
recommends URL items with the highest scores. For each user,
selfprofile and followee-profile are constructed out of bag-of-words.
For a URL, a bag-of-words is also created out of terms occurring in
tweets which embed the URL. In a field experiment, 44 participants
rated the recommended URLs. The best performance was 72.1%
accuracy when the RS used self-profiles and candidate URLs from
FoF (followee-of-followees).
      </p>
      <p>
        Unlike work in [
        <xref ref-type="bibr" rid="ref1 ref11 ref20">1, 11, 20</xref>
        ] which looks for news-related and
narrow lists of entities and categories, TMB is dynamic and represents
the dominant topics discussed by a user without searching for
predefined concepts. Our system does not require entity recognition
or ontology development.
3
      </p>
    </sec>
    <sec id="sec-6">
      <title>TOPIC-MODEL-BASED BOOK</title>
    </sec>
    <sec id="sec-7">
      <title>RECOMMENDER SYSTEM</title>
      <p>This section explains the TMB components, book and user profiles,
and formally defines the recommendation process.
3.1</p>
    </sec>
    <sec id="sec-8">
      <title>Book and user profiles</title>
      <p>
        A book profile (BP) is represented as a vector of terms comprising
its description. We used short descriptions of books available online.
On the other hand, a user profile (UP) is a vector that consists of
terms extracted from the target user’s Twitter timeline. Terms are
elicited from textual content of tweets and their embedded links.
Retweets and replies are included with tweets so as to avoid sparsity,
while hashtags are counted in if they are spelled correctly. User
profiles are built automatically using topic modelling techniques
without being mapped to an external ontology or to predefined
categories. For topic modelling, we considered two techniques:
Term Frequency - Inverse Document Frequency (tf-idf) and
NonNegative Matrix Factorization (NMF). We also experimented with
Latent Dirichlet Allocation (LDA), but did not report the results
due to the low performance. This supports the finding of a previous
study [
        <xref ref-type="bibr" rid="ref39">39</xref>
        ] that NMF performs better than LDA when dealing with
tweets.
3.1.1 Term Frequency - Inverse Document Frequency. The tf-idf
weighting approach is widely used in information retrieval. Term
frequency (t ft,d ) of a term t is the number of times it occurs in
document d. A document in this context is all tweets and/or links in
one user timeline. Inverse document frequency (Equation 1) helps
distinguish the terms that are specific to a user/document.
N
d ft
N is the number of users and d ft is the number of documents
where term t occurs. Equation 2 defines the tf-idf weight of term t
in document d.
      </p>
      <p>id ft = loд
(1)
t f -id ft,d = t ft,d ∗ id ft (2)</p>
      <p>
        The terms with highest weights are considered the tf-idf topic
model [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ].
      </p>
      <p>
        3.1.2 Non-Negative Matrix Factorization. This dimensionality
reduction and topic modelling technique has been found to work
well with short text [
        <xref ref-type="bibr" rid="ref15 ref47 ref9">9, 15, 47</xref>
        ]. For a user, a term-document matrix
is created; a document here is one tweet or link. NMF factorizes the
m × n term-document matrix A into two non-negative matrices W
and H . The former represent the term-topic matrix m × k, whereas
the latter is the topic-document matrix k × n. The number of NMF
topics k should be defined ahead of decomposition. The matrix WH
approximates the original matrix A. Every document in WH
represents a linear combination of k topic vectors in W with coeficients
given by H [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>
        3.1.3 Topic embeddings. Word embeddings have gained a lot of
attention lately thanks to the revival of neural networks. They are
word vectors with fixed dimensions. We use the word2vec model,
proposed by Mikolov et al. [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]. Terms in book and user profiles are
mapped to word embeddings produced by the word2vec model. The
model is trained on a very large amount of text and can predict the
context of a given word. It represents words in a space where two
words occurring in similar contexts are neighbours. We used
pretrained word embeddings developed on the Google News dataset of
around 100 billion words. It comprises vectors of 300 dimensions for
3 million words and phrases.2 Other available pre-trained models
(e.g., Global Vectors for Word Representation3) have been built using
text from Twitter and Wikipedia, but the Google news embeddings
are more relevant to both books and tweets. While books have
formal descriptions, tweets are casual, with hashtags that require a
model which encompasses abbreviations.
3.2
      </p>
    </sec>
    <sec id="sec-9">
      <title>The recommendation procedure</title>
      <p>Let U = u1, u2, . . . un be a set of Twitter users. For user ui , a
time threshold Tui is established to avoid the overlap in
learning and prediction times. The learning timeframe LTui involves
all tweets and links created by ui before Tui , whereas the
recommendations timeframe RTui contains books read by ui after Tui .
For user ui ∈ U , a user profile U Pui is a vector comprising terms
w1, w2, . . . wm extracted from tweets or links shared by ui during
LTui . Let Bui = b1, b2, . . . bl be the set of books read by user ui
during RTui . For book bj ∈ Bui , the book profile BPj is a vector
2https://code.google.com/archive/p/word2vec/
3http://nlp.stanford.edu/projects/glove/
of words w1, w2, . . . wh found in bj ’s description. To recommend
books to ui , TMB calculates the cosine similarity (Equation 3)
between U Pui and BP for every book in Bui , and suggests the books
with k most similar BP .</p>
      <p>similarity =</p>
      <p>U Pui · BPj</p>
      <p>U Pui ∗ BPj</p>
      <p>If terms are replaced by their word embeddings, an average
vector is created for word vectors in U Pui and another for BPj .
Then, cosine similarity is performed between the resulting average
vectors.
(3)
4</p>
    </sec>
    <sec id="sec-10">
      <title>DATA PREPARATION AND SYSTEM</title>
    </sec>
    <sec id="sec-11">
      <title>IMPLEMENTATION</title>
      <p>This section describes how the dataset was collected and
preprocessed. It also presents the implementation of the system, unfolding
technical details of the creation of book and user profiles.
4.1</p>
    </sec>
    <sec id="sec-12">
      <title>Data collection</title>
      <p>We collected user data from Goodreads and Twitter, because there
are no datasets with both users social profiles and their reading
lists. The Twitter API was queried to retrieve any review shared
by Goodreads users, and more than 1000 tweets were found, from
which we accessed their authors and IDs. Twitter API allows the
collection of a maximum of 3500 tweets per user. We gathered text,
ID and date of creations of tweets for user with Goodreads review.
Links were extracted from user timelines and their textual contents
(if any) were collected. This was achieved by applying an eficient
Python library called Newspaper, which obtains a clean tag-free
text from a given Web page. Once the Twitter user profiles were
complete, we collected data from Goodreads for the book profiles.</p>
      <p>User Goodreads IDs were obtained from the tweets of default
reviews. Next, a scrapper was developed to retrieve all review IDs and
dates from users’ “read books” lists, which contain only completed
books. The Goodreads API was consulted to extract information
about all books read by a user, including book metadata, text
reviews, ratings, read date and added date. The book metadata, which
can be used to build content-based recommender systems, include
ISBN, ISBN13, title, authors, language, the average rating of all
reader, the number of pages, publisher, publication date, text review
count and book description. The read date indicates the time of
completion of a read book, while the added date is the time when a
book was catalogued.</p>
      <p>
        When users insert new books into their lists, they may discuss
them on their social media. Therefore, in TMB, the recommendation
timeframe RT considers added dates instead of read dates. The
rating scale, according to Goodreads, treats 1-2 stars as “dislike”,
and 3-5 stars as “like”; books rated 3-5 will be called relevant in the
remainder of the paper. The number of users shrunk to 69 after the
deletion of non-English users, inactive users and those with private
Goodreads accounts. Even though many datasets with large number
of users exist, some recommendation methodologies such as TMB
require personal information about users. This makes it hard to
experiment on large datasets. Examples of such work include [
        <xref ref-type="bibr" rid="ref41">41</xref>
        ]
which used a dataset of 52 users to test afective-based RS,and [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ]
which tested a context-aware RS on an 89-user dataset.
Before topic extraction, text of tweets, link, and book descriptions
must be cleaned. The tweets were tokenized using Tweet Tokenizer
from NLTK [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], which is Twitter-conscious, and tagged using the
GATE Twitter part of speech tagger [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Hashtags were checked
using aspell.4 Misspelled words were excluded because they are not
useful: the goal is to match them with book descriptions which are
spelling-error-free. For links and book descriptions, regular NLTK
Word tokenizer [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and Stanford part-of-speech tagger [
        <xref ref-type="bibr" rid="ref42">42</xref>
        ] were
applied. Only nouns (singular or plural) were kept, then lemmatized
by NLTK WordNet Lemmatizer [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. A noun, according to
MerriamWebster, represents an “entity, quality, state, action, or concept”.
Nouns, then, can capture the interests of users more than any
other part of speech. In fact, to model user interests based on their
social media accounts, other researchers also considered only nouns
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ][
        <xref ref-type="bibr" rid="ref43">43</xref>
        ].
      </p>
      <p>After building topic models from tweets and links, we noticed
that unimportant (generic) terms such as “website” are dominant.
Therefore, we went further by excluding NLTK stop words, 100
most common English nouns,5 and words of fewer than 4 letters. For
tweets, we also filtered out the 200 words with lowest idf weights. 6
Repeated content of links is deleted, and so are Web-related terms,
e.g., “website” and “Facebook”.
4.3</p>
    </sec>
    <sec id="sec-13">
      <title>System implementation</title>
      <p>
        A user Twitter timeline was divided in half, and the date of the
middle tweet was considered a time threshold that diferentiates
learning and recommendations periods. To ensure that tweets do
not address the predicted books, a one-month diference was set
between the timeframes. The average numbers of tweets and books
included in the learning period are 758 and 802, while the minimum
4http://aspell.net/
5http://www.linguasorb.com/english/most-common-nouns/
6The idf weights for tweets from all users after the deletion of stop words.
numbers are 121 and 13 respectively. The lowest number of ratings
needed to develop CB with quality recommendations is 10. This
threshold is adopted by many researchers, including [
        <xref ref-type="bibr" rid="ref46">46</xref>
        ].
      </p>
      <p>
        We developed twelve variations of user profiles. They difer in
the topic modelling technique (NMF or tf-idf), in the source of data
(tweets alone, links alone, or tweets and links) and in the word
representations (embeddings [emb] or none). The NMF algorithm
was implemented using the scikit-learn Python package [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. After
conducting many trials, the number of NMF topics was set to five,
with six words in each, because topics became redundant afterward.
The number of tf-idf topics was set to 100. To calculate cosine
similarity between words vectors, we used genism, a Python library.
Not all topics have corresponding word vectors, and a reduction in
the number of topics is expected.
5
      </p>
    </sec>
    <sec id="sec-14">
      <title>EXPERIMENTS AND RESULTS</title>
      <p>We measure the predictive power of the system using of-line
evaluation, which is appropriate for obtaining the accuracy of an RS. The
on-line appraisal would provide more performance insights, but it
is an expensive option that requires the deployment of a real-time
version of TMB. A user study is another option; it was avoided
because it usually includes a limited number of users.
5.1</p>
    </sec>
    <sec id="sec-15">
      <title>Experiment settings</title>
      <p>
        Strategies of top k recommendations are tested in a similar fashion
to the leave-one-out evaluation applied in [
        <xref ref-type="bibr" rid="ref13 ref21 ref23">13, 21, 23</xref>
        ]; it splits the
dataset into a training set and a one-item test set, then generates
a list of the top N recommendations from the training set. In our
setting, however, the training set is made up of all books not
included in the recommendation timeframe, so we cannot use it for
prediction. This is why we followed a slightly diferent assessment
methodology, used in ranking-based RSs adopted by [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] and [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
      </p>
      <p>
        We created one set of 1000 random books that are unique and
not rated by any user. For each user, we randomly selected one
relevant book from the recommendation timeframe, added it to
the 1000 books and asked our system to perform ranking. If the
rank of the relevant book is f, the RS should have the lowest f
value (preferably 1). If f ≤ k, it is a hit, otherwise it is a miss.
Similarly to many related projects, we set k to 10. Metrics adopted
are hit-rate (Equation 4), sometimes called recall, and the average
reciprocal hit-rank (Equation 5) [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. To avoid a bias, five trials
were conducted, and the reported results averaged. We measured
the statistical diference in results using the t-test at a maximum of
p-value = 0.05.
      </p>
      <p>ARH R =</p>
      <p>H R =
#hits
#users
1
#hit s 1
Õ
#users i=1 fi
(4)
(5)</p>
      <p>Our approach was compared to a content-based RS and to a
random system. CB was implemented using the default settings of
Graphlab, a well-established framework for RSs. Books in the CB
training and test sets were represented with book metadata (see
section 4.1). Although we considered a comparison with
collaborative filtering (CF), the rating matrix is highly sparse, which means
that the results would not reflect a typical CF.</p>
      <p>Some of the randomly chosen 1000 books might have topics
similar to a user profile. On the other hand, they could share similar
content, e.g., author or description with a user’s read books.
However, we did not filter out such books because this would introduce
a bias and favour one system over the other. In addition, for each
of the 69 users, we examined five books, so the overall number of
tested books is 345. If there is a bias with a few books, it should not
afect the majority of test cases.</p>
      <p>5.1.1 Results. Figure 2 shows the HR and ARHR scores of
fourteen recommendation techniques. The best-performing methods
are CB and tf-idf-emb built with links; it achieved the highest HR
results, while CB reached the best ARHR. Tweet-based tf-idf-emb
has similar results to CB. The results of these two methods are not
statistically diferent. In general, tf-idf gives better results than NMF.
This is expected due to the diference in numbers of topic terms.
Comparing the algorithms with and without word embedding
vectors, the addition of word embedding enhances the performance.
The results are statistically diferent except for the tf-idf-emb of
tweets and the tf-idf-emb of tweets and links. There is no
consistency in the efect of using tweets or links. For example, using links
with tf-idf gives the highest score but with NMF-emb the score is
the lowest among all data categories. The random system could not
bring any relevant book to the top k.
6</p>
    </sec>
    <sec id="sec-16">
      <title>DISCUSSION</title>
      <p>The field of RSs is active. Many state-of-the-art recommendation
methods have been proposed in the recent years. However, we only
compared TMB results with CB which has been around for a long
while. TMB gives similar performance to a traditional system, CB
without the need for user rating history. Nevertheless, we do not
claim that the system works independently. To verify this, more
comprehensive experiments are required.</p>
      <p>One suggested method, which gives the best results, is to use
word embeddings of top tf-idf terms. The use of tf-idf weighting
allows the capturing of distinctive topics frequently discussed by
one user in contrast with those discussed by her community. To
eliminate noise, we only kept the top tf-idf words. Otherwise, the
average word embedding of all terms in Twitter time-line would be
skewed towards less significant terms. We think that this method
obtains fine-grained interests not extensively shared among users.
For example, a term that is not as popular, like “mythology”, may
have a high idf value and be in the top tf-idf list.</p>
      <p>All variations of TMB could identify books that interest the
user out of a thousand other books, with the link-based tf-idf-emb
retrieving the highest number of books. To illustrate how word
embeddings contribute to the recommendations made by link-based
tf-idf-emb, we plotted (Figure 3) the word embeddings of one user
profile (b) and his two book profiles (c, d). Section (a) of Figure 3
shows the closeness of word vectors found the UP and BPs. One can
notice the variety of topics in the user profile. User interests might
be broad and not only related to the books they already preferred.</p>
      <p>The textual content of the links can be longer than that of the
tweets, and so possibly capturing a wider range of interests. In fact,
there is an evident diference in their efect on pure NMF and tf-idf.
Thanks to word embeddings, however, the performance of models
that adopt tweets increased dramatically. Word vectors could enrich
the topics by including the context of terms. Their improvement of
tweet-based algorithms could be due to the presence of hashtags,
which summarize a whole subject or event.</p>
      <p>We conducted error analysis to investigate the diferences in
performance between CB and TMB (tf-idf based on links and word
embeddings). In a leave-one-out evaluation, we tested five books
for each user. The two systems retrieved the same number of
relevant books when giving recommendations to 31 users. CB could
retrieve more relevant books than TMB for 17 users, whereas TMB
surpassed CB when dealing with 21 users. For better understanding,
we analyzed each system’s best recommendations.</p>
      <p>CB retrieved three out of five books relevant for users A and B,
while TMB suggested only one book to user A and none to B. User
A had 512 books in the CB training set, while user B had 542. From
the three books recommended to A, only one had the same author
as a book in the training set; that is to say, CB relied on book
descriptions to make the recommendation. The one book which TMB
recommended to user A had cosine similarity of 0.69 and shared
words that were semantically close to the user topics (e.g., drawing
vs. illustrator). Like for user A, only one book recommended by CB
to user B shared the same author with a book in the CB training
set. The possible reason why TMB could not suggest any book to
user B is that the user’s topics were related to political issues (e.g.,
abortion, immigration), while the user’s readings were diverse. For
example, user B’s five relevant books addressed history, romance,
philosophy and education. The user’s interests were broad, while
his discussed topics on Twitter were narrow and related to current
issues.</p>
      <p>Users C, D and E received five, three and two recommended
books by TMB, respectively, while CB could recommend two books
for user C and none for user D and E. User C had 140 books in
the CB training set. Most of his readings were related to religious
matters. The user topic profile reflected these interests: the top tf-idf
words were glory, theology and gospel. The lowest cosine similarity
between the user topic profile and the five retrieved books was 0.72.
User D had 13 books in the CB training set. All books in the training
and test set were written by distinct authors. The user topics were
also related to philosophy and religion, as well as the user readings
(see Figure 3). User E had 528 books in the CB training set. Her topic
profile covered wide interests ( e.g., courtroom, femininity, mutiny,
and heroin) and the two recommended books were slightly similar.
One of them, titled “Against the Country”, was described with words
such as ofender , antihero and blast. The other book was described
with such words as assassination and murder.
7</p>
    </sec>
    <sec id="sec-17">
      <title>CONCLUSION</title>
      <p>This paper proposes TMB, a system that builds a topic model for a
user from textual content shared voluntarily on her social media,
and recommends the books most related to these topics. We
acquired a user’s distinctive topics by tf-idf weighting and represent
them as word embeddings in order to capture their context. TMB
achieves a recommendation accuracy similar to CB, a commonly
used book RS, particularly when word embeddings are deployed.
Thus, TMB can aid current RSs in suggesting books to new users
without major loss in performance.</p>
      <p>For future improvement, we plan to study the temporal efect on
topic models, as well as the relationship between the level of user
activity and the accuracy of the recommendations. Since hashtags
carry more meaning than other terms on Twitter, an interesting
approach would be to create hashtag-based profiles that are
enriched with word vectors. Also, user profiles could include other
parts of speech, especially verbs and adjectives. To enhance the
performance of the system, we will train embeddings for tweets
and books.</p>
    </sec>
    <sec id="sec-18">
      <title>ACKNOWLEDGMENT</title>
      <p>Support for this work has come from the Natural Sciences and
Engineering Research Council of Canada.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Fabian</given-names>
            <surname>Abel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Qi</given-names>
            <surname>Gao</surname>
          </string-name>
          ,
          <string-name>
            <surname>Geert-Jan Houben</surname>
            , and
            <given-names>Ke</given-names>
          </string-name>
          <string-name>
            <surname>Tao</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Analyzing User Modeling on Twitter for Personalized News Recommendations</article-title>
          .
          <source>In Proc. 19th International Conference on User Modeling, Adaption, and Personalization (UMAP'11)</source>
          . Springer-Verlag, Berlin, Heidelberg,
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          . http://dl.acm.org/citation.cfm?id=
          <volume>2021855</volume>
          .
          <fpage>2021857</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Rel</given-names>
            <surname>Guzman</surname>
          </string-name>
          <string-name>
            <surname>Apaza</surname>
          </string-name>
          , Elizabeth Vera Cervantes, Laura Cruz Quispe, and Jose Ochoa Luna.
          <year>2014</year>
          .
          <article-title>Online Courses Recommendation based on LDA</article-title>
          . (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>David</given-names>
            <surname>Ben-Shimon</surname>
          </string-name>
          , Alexander Tsikinovsky, Lior Rokach, Amnon Meisles, Guy Shani, and
          <string-name>
            <given-names>Lihi</given-names>
            <surname>Naamani</surname>
          </string-name>
          .
          <year>2007</year>
          .
          <article-title>Recommender System from Personal Social Networks</article-title>
          .
          <source>In Advances in Intelligent Web Mastering: Proc. 5th Atlantic Web Intelligence</source>
          Conference - AWIC'
          <year>2007</year>
          , Fontainbleau, France, June 25 - 27,
          <year>2007</year>
          , Katarzyna M.
          <article-title>Wegrzyn-Wolska and Piotr S</article-title>
          .
          <source>Szczepaniak (Eds.)</source>
          . Springer Berlin Heidelberg, Berlin, Heidelberg,
          <fpage>47</fpage>
          -
          <lpage>55</lpage>
          . DOI:https://doi.org/10.1007/978-3-
          <fpage>540</fpage>
          -72575-
          <issue>6</issue>
          _
          <fpage>8</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Sonia</given-names>
            <surname>Bergamaschi</surname>
          </string-name>
          and
          <string-name>
            <given-names>Laura</given-names>
            <surname>Po</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Comparing LDA and LSA Topic Models for Content-Based Movie Recommendation Systems</article-title>
          .
          <source>In Web Information Systems and Technologies: 10th International Conference, WEBIST</source>
          <year>2014</year>
          , Barcelona, Spain, April 3-
          <issue>5</issue>
          ,
          <year>2014</year>
          ,
          <string-name>
            <given-names>Revised</given-names>
            <surname>Selected</surname>
          </string-name>
          <string-name>
            <given-names>Papers</given-names>
            , Valérie Monfort and
            <surname>Karl-Heinz Krempels</surname>
          </string-name>
          (Eds.). Springer International Publishing, Cham,
          <fpage>247</fpage>
          -
          <lpage>263</lpage>
          . DOI:https://doi.org/ 10.1007/978-3-
          <fpage>319</fpage>
          -27030-2_
          <fpage>16</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Steven</given-names>
            <surname>Bird</surname>
          </string-name>
          , Ewan Klein, and
          <string-name>
            <given-names>Edward</given-names>
            <surname>Loper</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Natural Language Processing with Python (1st ed.).</article-title>
          <string-name>
            <surname>O'Reilly Media</surname>
          </string-name>
          , Inc.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Lars</given-names>
            <surname>Buitinck</surname>
          </string-name>
          , Gilles Louppe, Mathieu Blondel, Fabian Pedregosa, Andreas Mueller, Olivier Grisel, Vlad Niculae,
          <string-name>
            <given-names>Peter</given-names>
            <surname>Prettenhofer</surname>
          </string-name>
          , Alexandre Gramfort, Jaques Grobler, Robert Layton,
          <string-name>
            <surname>Jake</surname>
            <given-names>VanderPlas</given-names>
          </string-name>
          , Arnaud Joly, Brian Holt, and
          <string-name>
            <given-names>Gaël</given-names>
            <surname>Varoquaux</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>API design for machine learning software: experiences from the scikit-learn project</article-title>
          .
          <source>In ECML PKDD Workshop: Languages for Data Mining and Machine Learning</source>
          .
          <fpage>108</fpage>
          -
          <lpage>122</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Eduardo</given-names>
            <surname>Castillejo</surname>
          </string-name>
          , Aitor Almeida, and
          <string-name>
            <given-names>Diego</given-names>
            <surname>López-De-Ipiña</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Alleviating cold-user start problem with users' social network data in recommendation systems</article-title>
          . In Workshop on Problems and Applications in
          <string-name>
            <surname>AI</surname>
          </string-name>
          , ECAI-
          <volume>12</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Jilin</given-names>
            <surname>Chen</surname>
          </string-name>
          , Rowan Nairn, Les Nelson,
          <string-name>
            <given-names>Michael</given-names>
            <surname>Bernstein</surname>
          </string-name>
          , and Ed Chi.
          <year>2010</year>
          .
          <article-title>Short and Tweet: Experiments on Recommending Content from Information Streams</article-title>
          .
          <source>In Proc. SIGCHI Conference on Human Factors in Computing Systems (CHI '10)</source>
          . ACM,
          <volume>1185</volume>
          -
          <fpage>1194</fpage>
          . DOI:https://doi.org/10.1145/1753326.1753503
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Xueqi</surname>
            <given-names>Cheng</given-names>
          </string-name>
          , Jiafeng Guo, Shenghua Liu,
          <string-name>
            <given-names>Yanfeng</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Xiaohui</given-names>
            <surname>Yan</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Learning Topics in Short Texts by Non-negative Matrix Factorization on Term Correlation Matrix.</article-title>
          .
          <source>In Proc. SIAM International Conference on Data Mining. SIAM</source>
          ,
          <fpage>749</fpage>
          -
          <lpage>757</lpage>
          . http://dblp.uni-trier.de/db/conf/sdm/sdm2013.html#ChengGLWY13
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>D.</given-names>
            <surname>Choi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Kim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Choi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hong</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Kim</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Research for the Pattern Analysis of Individual Interest Using SNS Data: Focusing on Facebook</article-title>
          . In 2014 Eighth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.
          <fpage>36</fpage>
          -
          <lpage>40</lpage>
          . DOI:https://doi.org/10.1109/IMIS.
          <year>2014</year>
          .94
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Gianmarco De Francisci Morales</surname>
            , Aristides Gionis, and
            <given-names>Claudio</given-names>
          </string-name>
          <string-name>
            <surname>Lucchese</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>From Chatter to Headlines: Harnessing the Real-time Web for Personalized News Recommendation</article-title>
          .
          <source>In Proc. Fifth ACM International Conference on Web Search and Data Mining (WSDM '12)</source>
          . ACM,
          <volume>153</volume>
          -
          <fpage>162</fpage>
          . DOI:https://doi.org/10.1145/2124295. 2124315
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Leon</surname>
            <given-names>Derczynski</given-names>
          </string-name>
          , Alan Ritter, Sam Clark, and
          <string-name>
            <given-names>Kalina</given-names>
            <surname>Bontcheva</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Twitter Part-of-Speech Tagging for All: Overcoming Sparse and Noisy Data</article-title>
          .
          <source>In Proc. International Conference on Recent Advances in Natural Language Processing. Association for Computational Linguistics.</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>Mukund</given-names>
            <surname>Deshpande</surname>
          </string-name>
          and
          <string-name>
            <given-names>George</given-names>
            <surname>Karypis</surname>
          </string-name>
          .
          <year>2004</year>
          .
          <article-title>Item-based top-N Recommendation Algorithms</article-title>
          .
          <source>ACM Trans. Inf. Syst</source>
          .
          <volume>22</volume>
          ,
          <issue>1</issue>
          (Jan.
          <year>2004</year>
          ),
          <fpage>143</fpage>
          -
          <lpage>177</lpage>
          . DOI: https://doi.org/10.1145/963770.963776
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>Sharon</given-names>
            <surname>Givon</surname>
          </string-name>
          and
          <string-name>
            <given-names>Victor</given-names>
            <surname>Lavrenko</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Predicting Social-tags for Cold Start Book Recommendations</article-title>
          .
          <source>In Proc. Third ACM Conference on Recommender Systems (RecSys '09)</source>
          . ACM,
          <volume>333</volume>
          -
          <fpage>336</fpage>
          . DOI:https://doi.org/10.1145/1639714.1639781
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>Daniel</given-names>
            <surname>Godfrey</surname>
          </string-name>
          , Caley Johns, Carl Dean Meyer, Shaina Race, and
          <string-name>
            <given-names>Carol</given-names>
            <surname>Sadek</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>A Case Study in Text Mining: Interpreting Twitter Data From World Cup Tweets</article-title>
          .
          <source>CoRR abs/1408</source>
          .5427 (
          <year>2014</year>
          ). http://arxiv.org/abs/1408.5427
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Fréderic</surname>
            <given-names>Godin</given-names>
          </string-name>
          , Viktor Slavkovikj, Wesley De Neve, Benjamin Schrauwen, and Rik Van de Walle.
          <year>2013</year>
          .
          <article-title>Using Topic Models for Twitter Hashtag Recommendation</article-title>
          .
          <source>In Proc. 22Nd International Conference on World Wide Web (WWW '13 Companion)</source>
          .
          <source>ACM</source>
          ,
          <volume>593</volume>
          -
          <fpage>596</fpage>
          . DOI:https://doi.org/10.1145/2487788.2488002
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Ido</surname>
            <given-names>Guy</given-names>
          </string-name>
          , Naama Zwerdling, Inbal Ronen, David Carmel,
          <string-name>
            <given-names>and Erel</given-names>
            <surname>Uziel</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Social Media Recommendation Based on People and Tags</article-title>
          .
          <source>In Proc. 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '10)</source>
          . ACM,
          <volume>194</volume>
          -
          <fpage>201</fpage>
          . DOI:https://doi.org/10.1145/1835449.1835484
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>Kelly</given-names>
            <surname>Hill</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>The Arts and Individual Well-Being in Canada</article-title>
          . (
          <year>February 2013</year>
          ). http://www.hillstrategies.com/content/arts-and
          <article-title>-individual-well-being-canada [</article-title>
          <source>Online; posted 13 February</source>
          <year>2013</year>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Diane</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Hu</surname>
            , Rob Hall, and
            <given-names>Josh</given-names>
          </string-name>
          <string-name>
            <surname>Attenberg</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Style in the Long Tail: Discovering Unique Interests with Latent Variable Models in Large Scale Social E-commerce</article-title>
          .
          <source>In Proc. 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '14)</source>
          . ACM,
          <volume>1640</volume>
          -
          <fpage>1649</fpage>
          . DOI:https://doi.org/10. 1145/2623330.2623338
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Nirmal</surname>
            <given-names>Jonnalagedda</given-names>
          </string-name>
          , Susan Gauch, Kevin Labille, and
          <string-name>
            <given-names>Sultan</given-names>
            <surname>Alfarhood</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Incorporating popularity in a personalized news recommender system</article-title>
          .
          <source>PeerJ Computer Science</source>
          <volume>2</volume>
          (
          <year>2016</year>
          ),
          <year>e63</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Zhao</surname>
            <given-names>Kang</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chong Peng</surname>
          </string-name>
          , and Qiang Cheng.
          <year>2016</year>
          .
          <article-title>Top-N Recommender System via Matrix Completion</article-title>
          .
          <source>In Proc. Thirtieth AAAI Conference on Artificial Intelligence (AAAI'16)</source>
          . AAAI Press,
          <fpage>179</fpage>
          -
          <lpage>184</lpage>
          . http://dl.acm.org/citation.cfm?id=
          <volume>3015812</volume>
          .
          <fpage>3015839</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>Hikmet</given-names>
            <surname>Kapusuzoglu</surname>
          </string-name>
          and Sule Gunduz Öguducu.
          <year>2011</year>
          .
          <article-title>A Relational Recommender System Based on Domain Ontology</article-title>
          .
          <source>In Emerging Intelligent Data and Web Technologies (EIDWT)</source>
          ,
          <source>2011 International Conference on. 36-41</source>
          . DOI: https://doi.org/10.1109/EIDWT.
          <year>2011</year>
          .15
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>George</given-names>
            <surname>Karypis</surname>
          </string-name>
          .
          <year>2001</year>
          .
          <article-title>Evaluation of Item-Based Top-N Recommendation Algorithms</article-title>
          .
          <source>In Proc. Tenth International Conference on Information and Knowledge Management (CIKM '01)</source>
          . ACM,
          <volume>247</volume>
          -
          <fpage>254</fpage>
          . DOI:https://doi.org/10.1145/502585.502627
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>Yehuda</given-names>
            <surname>Koren</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Factorization Meets the Neighborhood: A Multifaceted Collaborative Filtering Model</article-title>
          .
          <source>In Proc. 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '08)</source>
          . ACM,
          <volume>426</volume>
          -
          <fpage>434</fpage>
          . DOI:https: //doi.org/10.1145/1401890.1401944
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Qiuxia</surname>
            <given-names>Lu</given-names>
          </string-name>
          , Tianqi Chen, Weinan Zhang, Diyi Yang, and
          <string-name>
            <given-names>Yong</given-names>
            <surname>Yu</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Serendipitous Personalized Ranking for Top-N Recommendation</article-title>
          .
          <source>In Proc. The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01 (WI-IAT '12)</source>
          . IEEE Computer Society, Washington, DC, USA,
          <fpage>258</fpage>
          -
          <lpage>265</lpage>
          . http://dl.acm.org/citation.cfm?id=
          <volume>2457524</volume>
          .
          <fpage>2457692</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Christopher</surname>
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Manning</surname>
            , Prabhakar Raghavan, and
            <given-names>Hinrich</given-names>
          </string-name>
          <string-name>
            <surname>Schütze</surname>
          </string-name>
          .
          <year>2008</year>
          . Introduction to Information Retrieval. Cambridge University Press.
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <surname>Raymond</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Mar</surname>
            and
            <given-names>Keith</given-names>
          </string-name>
          <string-name>
            <surname>Oatley</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>The Function of Fiction is the Abstraction and Simulation of Social Experience</article-title>
          .
          <source>Perspectives on Psychological Science 3</source>
          ,
          <issue>3</issue>
          (
          <issue>01 May 2008</issue>
          ),
          <fpage>173</fpage>
          -
          <lpage>192</lpage>
          . DOI:https://doi.org/10.1111/j.1745-
          <fpage>6924</fpage>
          .
          <year>2008</year>
          .
          <volume>00073</volume>
          .x
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>Raymond</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Mar</surname>
          </string-name>
          , Keith Oatley, and
          <string-name>
            <surname>Jordan</surname>
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Peterson</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Exploring the link between reading fiction and empathy: Ruling out individual diferences and examining outcomes</article-title>
          .
          <source>Communications</source>
          <volume>34</volume>
          ,
          <issue>4</issue>
          (
          <issue>1</issue>
          Dec.
          <year>2009</year>
          ),
          <fpage>407</fpage>
          -
          <lpage>428</lpage>
          . DOI: https://doi.org/10.1515/comm.
          <year>2009</year>
          .025
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>Daniel</given-names>
            <surname>Mican</surname>
          </string-name>
          , Loredana Mocean, and
          <string-name>
            <given-names>Nicolae</given-names>
            <surname>Tomai</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Building a Social Recommender System by Harvesting Social Relationships and Trust Scores between Users</article-title>
          .
          <source>In Business Information Systems Workshops: BIS 2012 International Workshops and Future Internet Symposium</source>
          , Vilnius, Lithuania, May
          <volume>21</volume>
          -23, 2012 Revised Papers, Witold Abramowicz, John Domingue, and Krzysztof Węcel (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg,
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          . DOI:https://doi.org/10. 1007/978-3-
          <fpage>642</fpage>
          -34228-
          <issue>8</issue>
          _
          <fpage>1</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <surname>Tomas</surname>
            <given-names>Mikolov</given-names>
          </string-name>
          , Kai Chen, Greg Corrado, and
          <string-name>
            <given-names>Jefrey</given-names>
            <surname>Dean</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Eficient Estimation of Word Representations in Vector Space</article-title>
          .
          <source>CoRR abs/1301</source>
          .3781 (
          <year>2013</year>
          ). http://arxiv.org/abs/1301.3781
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <surname>Raymond</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Mooney</surname>
            and
            <given-names>Loriene</given-names>
          </string-name>
          <string-name>
            <surname>Roy</surname>
          </string-name>
          .
          <year>2000</year>
          .
          <article-title>Content-based Book Recommending Using Learning for Text Categorization</article-title>
          .
          <source>In Proc. Fifth ACM Conference on Digital Libraries (DL '00)</source>
          . ACM,
          <volume>195</volume>
          -
          <fpage>204</fpage>
          . DOI:https://doi.org/10.1145/336597.336662
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>P.</given-names>
            <surname>Nair</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Moh</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T. S.</given-names>
            <surname>Moh</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Using Social Media Presence for Alleviating Cold Start Problems in Privacy Protection</article-title>
          .
          <source>In 2016 International Conference on Collaboration Technologies and Systems (CTS)</source>
          .
          <volume>11</volume>
          -
          <fpage>17</fpage>
          . DOI:https://doi.org/10. 1109/CTS.
          <year>2016</year>
          .0022
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>Sergey</given-names>
            <surname>Nikolenko</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>SVD-LDA: Topic Modeling for Full-Text Recommender Systems</article-title>
          .
          <source>In Advances in Artificial Intelligence and Its Applications: 14th Mexican International Conference on Artificial Intelligence, MICAI</source>
          <year>2015</year>
          , Cuernavaca, Morelos, Mexico,
          <source>October 25-31</source>
          ,
          <year>2015</year>
          , Proceedings,
          <string-name>
            <surname>Part</surname>
            <given-names>II</given-names>
          </string-name>
          , Obdulia Pichardo Lagunas, Oscar Herrera Alcántara, and Gustavo Arroyo Figueroa (Eds.). Springer International Publishing, Cham,
          <fpage>67</fpage>
          -
          <lpage>79</lpage>
          . DOI:https://doi.org/10.1007/978-3-
          <fpage>319</fpage>
          -27101-
          <issue>9</issue>
          _
          <fpage>5</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <surname>Ante</surname>
            <given-names>Odić</given-names>
          </string-name>
          , Marko Tkalčič, Andrej Košir,
          <string-name>
            <given-names>and Jurij F.</given-names>
            <surname>Tasič</surname>
          </string-name>
          .
          <year>2011</year>
          . A.:
          <article-title>Relevant context in a movie recommender system: Users' opinion vs. statistical detection</article-title>
          .
          <source>In In: Proc. of the 4th Workshop on Context-Aware Recommender Systems</source>
          (
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35]
          <string-name>
            <surname>Dharmendra</surname>
            <given-names>Pathak</given-names>
          </string-name>
          , Sandeep Matharia, and
          <string-name>
            <given-names>C. N. S.</given-names>
            <surname>Murthy</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>NOVA: Hybrid book recommendation engine</article-title>
          .
          <source>In Advance Computing Conference (IACC)</source>
          ,
          <year>2013</year>
          IEEE 3rd International.
          <fpage>977</fpage>
          -
          <lpage>982</lpage>
          . DOI:https://doi.org/10.1109/IAdCC.
          <year>2013</year>
          . 6514359
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>Marco</given-names>
            <surname>Pennacchiotti</surname>
          </string-name>
          and
          <string-name>
            <given-names>Siva</given-names>
            <surname>Gurumurthy</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Investigating Topic Models for Social Media User Recommendation</article-title>
          .
          <source>In Proc. 20th International Conference Companion on World Wide Web (WWW '11)</source>
          . ACM,
          <volume>101</volume>
          -
          <fpage>102</fpage>
          . DOI:https://doi. org/10.1145/1963192.1963244
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>Maria</given-names>
            <surname>Soledad</surname>
          </string-name>
          <string-name>
            <given-names>Pera</given-names>
            , Nicole Condie, and
            <surname>Yiu-Kai Ng</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Personalized Book Recommendations Created by Using Social Media Data</article-title>
          .
          <source>In Proc. 2010 International Conference on Web Information Systems Engineering (WISS'10)</source>
          . Springer-Verlag, Berlin, Heidelberg,
          <fpage>390</fpage>
          -
          <lpage>403</lpage>
          . http://dl.acm.org/citation.cfm?id=
          <volume>2044492</volume>
          .
          <fpage>2044531</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [38]
          <string-name>
            <given-names>Maria</given-names>
            <surname>Soledad</surname>
          </string-name>
          Pera and
          <string-name>
            <surname>Yiu-Kai Ng</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>With a Little Help from My Friends: Generating Personalized Book Recommendations Using Data Extracted from a Social Website</article-title>
          .
          <source>In Proc. 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01 (WI-IAT '11)</source>
          . IEEE Computer Society, Washington, DC, USA,
          <fpage>96</fpage>
          -
          <lpage>99</lpage>
          . DOI:https://doi.org/10.1109/ WI-IAT.
          <year>2011</year>
          .9
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          [39]
          <string-name>
            <given-names>Ankan</given-names>
            <surname>Saha</surname>
          </string-name>
          and
          <string-name>
            <given-names>Vikas</given-names>
            <surname>Sindhwani</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Learning Evolving and Emerging Topics in Social Media: A Dynamic Nmf Approach with Temporal Regularization</article-title>
          .
          <source>In Proc. Fifth ACM International Conference on Web Search and Data Mining (WSDM '12)</source>
          . ACM,
          <volume>693</volume>
          -
          <fpage>702</fpage>
          . DOI:https://doi.org/10.1145/2124295.2124376
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          [40]
          <string-name>
            <given-names>Suvash</given-names>
            <surname>Sedhain</surname>
          </string-name>
          , Scott Sanner, Darius Braziunas, Lexing Xie, and
          <string-name>
            <given-names>Jordan</given-names>
            <surname>Christensen</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Social Collaborative Filtering for Cold-start Recommendations</article-title>
          .
          <source>In Proc. 8th ACM Conference on Recommender Systems (RecSys '14)</source>
          . ACM,
          <volume>345</volume>
          -
          <fpage>348</fpage>
          . DOI:https://doi.org/10.1145/2645710.2645772
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          [41]
          <string-name>
            <surname>Marko</surname>
            <given-names>Tkalčič</given-names>
          </string-name>
          , Andrej Košir, and
          <string-name>
            <given-names>Jurij</given-names>
            <surname>Tasič</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>The LDOS-PerAf-1 corpus of facial-expression video clips with afective, personality and user-interaction metadata</article-title>
          .
          <source>Journal on Multimodal User Interfaces</source>
          <volume>7</volume>
          ,
          <issue>1</issue>
          (
          <year>2013</year>
          ),
          <fpage>143</fpage>
          -
          <lpage>155</lpage>
          . DOI: https://doi.org/10.1007/s12193-012-0107-7
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          [42]
          <string-name>
            <surname>Kristina</surname>
            <given-names>Toutanova</given-names>
          </string-name>
          , Dan Klein,
          <string-name>
            <given-names>Christopher D.</given-names>
            <surname>Manning</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Yoram</given-names>
            <surname>Singer</surname>
          </string-name>
          .
          <year>2003</year>
          .
          <article-title>Feature-rich Part-of-speech Tagging with a Cyclic Dependency Network</article-title>
          .
          <source>In Proc. 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1 (NAACL '03)</source>
          .
          <article-title>Association for Computational Linguistics</article-title>
          , Stroudsburg, PA, USA,
          <fpage>173</fpage>
          -
          <lpage>180</lpage>
          . DOI:https://doi.org/10.3115/1073445.1073478
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          [43]
          <string-name>
            <surname>Keita</surname>
            <given-names>Tsuji</given-names>
          </string-name>
          , Nobuya Takizawa, Sho Sato, Ui Ikeuchi, Atsushi Ikeuchi, Fuyuki Yoshikane, and
          <string-name>
            <given-names>Hiroshi</given-names>
            <surname>Itsumura</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Book Recommendation Based on Library Loan Records</article-title>
          and
          <string-name>
            <given-names>Bibliographic</given-names>
            <surname>Information</surname>
          </string-name>
          . Procedia - Social and Behavioral
          <string-name>
            <surname>Sciences</surname>
          </string-name>
          (
          <year>2014</year>
          ),
          <fpage>478</fpage>
          -
          <lpage>486</lpage>
          . DOI:https://doi.org/10.1016/j.sbspro.
          <year>2014</year>
          .
          <volume>07</volume>
          .142 3rd
          <string-name>
            <surname>International</surname>
          </string-name>
          <article-title>Conference on Integrated Information (IC-ININFO)</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          [44]
          <string-name>
            <given-names>Paula</given-names>
            <surname>Cristina</surname>
          </string-name>
          <string-name>
            <surname>Vaz</surname>
          </string-name>
          , Ricardo Ribeiro, and David Martins de Matos.
          <year>2013</year>
          .
          <article-title>Book Recommender Prototype Based on Author's Writing Style</article-title>
          .
          <source>In Proc. 10th Conference on Open Research Areas in Information Retrieval (OAIR '13</source>
          <string-name>
            <surname>). LE CENTRE DE HAUTES ETUDES INTERNATIONALES D'INFORMATIQUE</surname>
            <given-names>DOCUMENTAIRE</given-names>
          </string-name>
          , Paris, France, France,
          <fpage>227</fpage>
          -
          <lpage>228</lpage>
          . http://dl.acm.org/citation.cfm?id=
          <volume>2491748</volume>
          .
          <fpage>2491800</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          [45]
          <string-name>
            <given-names>Chong</given-names>
            <surname>Wang</surname>
          </string-name>
          and
          <string-name>
            <given-names>David M.</given-names>
            <surname>Blei</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Collaborative Topic Modeling for Recommending Scientific Articles</article-title>
          .
          <source>In Proc. 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '11)</source>
          . ACM,
          <volume>448</volume>
          -
          <fpage>456</fpage>
          . DOI: https://doi.org/10.1145/2020408.2020480
        </mixed-citation>
      </ref>
      <ref id="ref46">
        <mixed-citation>
          [46]
          <string-name>
            <surname>Yiwen</surname>
            <given-names>Wang</given-names>
          </string-name>
          , Natalia Stash, Lora Aroyo, Laura Hollink, and
          <string-name>
            <given-names>Guus</given-names>
            <surname>Schreiber</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Using Semantic Relations for Content-based Recommender Systems in Cultural Heritage</article-title>
          .
          <source>In Proceedings of the 2009 International Conference on Ontology Patterns - Volume 516 (WOP'09)</source>
          .
          <article-title>CEUR-WS</article-title>
          .org, Aachen, Germany, Germany,
          <fpage>16</fpage>
          -
          <lpage>28</lpage>
          . http://dl.acm.org/citation.cfm?id=
          <volume>2889761</volume>
          .
          <fpage>2889763</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref47">
        <mixed-citation>
          [47]
          <string-name>
            <surname>Xiaohui</surname>
            <given-names>Yan</given-names>
          </string-name>
          , Jiafeng Guo, Shenghua Liu, Xue-qi Cheng, and
          <string-name>
            <given-names>Yanfeng</given-names>
            <surname>Wang</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Clustering Short Text Using Ncut-weighted Non-negative Matrix Factorization</article-title>
          .
          <source>In Proc. 21st ACM International Conference on Information and Knowledge Management (CIKM '12)</source>
          . ACM,
          <volume>2259</volume>
          -
          <fpage>2262</fpage>
          . DOI:https://doi.org/10.1145/2396761.2398615
        </mixed-citation>
      </ref>
      <ref id="ref48">
        <mixed-citation>
          [48]
          <string-name>
            <surname>Xuejun</surname>
            <given-names>Yang</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Hongchun</given-names>
            <surname>Zeng</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Weihong</given-names>
            <surname>Huang</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>ARTMAP-Based Data Mining Approach and Its Application to Library Book Recommendation</article-title>
          .
          <source>In Intelligent Ubiquitous Computing and Education</source>
          , 2009 International Symposium on.
          <fpage>26</fpage>
          -
          <lpage>29</lpage>
          . DOI:https://doi.org/10.1109/IUCE.
          <year>2009</year>
          .43
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>