<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Twixonomy Visualization Interface: How to Wander Around User Preferences</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Giorgia Di Tommaso</string-name>
          <email>M@aOgrilcando_</email>
          <email>ditommaso@di.uniroma1.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Giovanni Stilo</string-name>
          <email>stilo@di.uniroma1.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Sapienza University Rome</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <fpage>32</fpage>
      <lpage>41</lpage>
      <abstract>
        <p>User interfaces have become essential tools for a user to interact with a recommender system. In the two most common settings, the user interface either helps users to collect their preferences, or to provide an explanation of the generated recommendations. In this paper, we present the Twixonomy Visualization Interface, a tool that allows users both to explore their preferences and to discover new ones. Preferences are represented by a Wikipedia Category DAG connected with the initial (primitive) preferences implicitly or explicitly expressed by the user. Our tool can be considered as an integration of a recommender system since, by exploring the DAG, the user can both analyse the connections between his/her preferred items and other semantically related items or categories, and understand the motivations for new, serendipitous recommendations.</p>
      </abstract>
      <kwd-group>
        <kwd>Recommender system</kwd>
        <kwd>user interface</kwd>
        <kwd>twitter</kwd>
        <kwd>social media</kwd>
        <kwd>data mining</kwd>
        <kwd>graph</kwd>
        <kwd>pruning</kwd>
        <kwd>semantic</kwd>
        <kwd>user pro ling</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The scope of Recommender System (RS) is to provide suggestions, or directing
a person to a service, product or content of interest [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. It is widely-known that
the e ectiveness of a recommender systems cannot only be measured by its
accuracy, but there are other elements that play a role, in order for the user to
trust the system and perceive it as an advice-giver [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. In his ACM \Intelligent
User Interfaces" tutorial [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], Konstan highlighted the relevance that the user
interface has, in order to make a recommender system understandable by the
users. Indeed, when a user can visualize and contextualize the recommendations
with her preferences, it is more likely that she will accept what is recommended
to her.
      </p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref4 ref5">4, 5</xref>
        ], we presented a method for large-scale analysis of Twitter users
supported by a hierarchical representation of their interests, which we call a
Twixonomy. In order to build a population, community, or single-user Twixonomy we
rst associate "topical" friends in users' friendship lists (i.e. friends representing
an interest rather than a social relation between peers) with Wikipedia
categories. A word-sense disambiguation algorithm is used to select the appropriate
wikipage for each topical friend. Starting from the set of wikipages
representing the main topics of interests of the initial Twitter population, we extract all
paths connecting these pages with topmost Wikipedia category nodes, and we
then prune the resulting graph e ciently so as to induce a direct acyclic DAG
graph and signi cantly reduce over ambiguity. This graph is the Twixonomy.
      </p>
      <p>In this paper, we are going to present a tool, called Twixonomy
Visualization Interface (TVI), which allows a user to explore his/her Twixonomy,
understanding what his/her interests are, what are the high-level Wikipedia categories
associated to these preferences, and the relationship between these preferences.
Moreover, it allows to compare the Twixonomy of a user with that of another
Twitter pro le, thus having also a list of the shared interests in terms of
categories, and a compact similarity measure (known as a nity score) between the
two Twixonomies.</p>
      <p>By allowing the users to visually analyze their preferences and discover new
ones in terms of categories they are associated to will be useful from multiple
perspectives. Indeed, by seeing the correlation between the categories
represented in the Twixonomy and the preferences they explicitly expressed, it is
more likely that the user will trust the system and accept the categories as
recommendations of something they might be interested in. As a consequence, these
categories can be directly employed as an information source by a
recommendation algorithm, thus broadening the preferences of the users and generating more
rich recommendations, certainly involving new items and possibly also surprising
(serendipitous) ones.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>This section presents the works related to our purpose, mostly focusing on
recommender system in social networks and on the role of the user interface when
producing recommendations to the users.</p>
      <p>
        Recommender system in social networks In the Social Networks literature there
is a considerable number of works in which users' interests are extracted for
some speci c purpose, like detecting trending topics, i.e., topics that emerge and
become popular in a speci c time slot. Trending topics are extracted to produce
a recommendation [
        <xref ref-type="bibr" rid="ref11 ref13 ref6">11, 6, 13</xref>
        ], to model users' expertise [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], or to detect shared
interests (e.g., events) that are predominant in a given time span [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The large
majority of scholars are concerned with user recommendation, a task for which
many solutions have been presented in literature (see [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] for a survey); since
they model user interests regardless of speci c applications.
      </p>
      <p>
        The studies more closely related to our work are [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. In the former,
the authors aim to derive a categorial representation of users' interests using
Wikipedia. First, named entities are extracted from the text in micro-blogs,
then, Wikipedia pages, named primitive interests, are associated to each named
entity. To select a reduced number categories, denoted as hierarchical interests,
spreading of activation [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] is used on a pruned version of the Wikipedia graph,
where active nodes are initially the set of primitive interests. Note that, despite
their name, hierarchical interests are not hierarchically ordered: rather, they are
a set of mid-high level categories. The second related work is [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], where, similarly
to us, users' interests are inferred at a large scale. This system, named Who Likes
What, was the rst system capable of inferring Twitter users' interests at the
scale of millions of users. First, the topical expertise of popular Twitter users
is learned from the names and descriptions of Twitter lists in which such users
actively participate. Then, the interests of users who subscribe to at least 3
expert users are transitively inferred. Who Likes What is also deployed online
with a web interface; we are going to analyze further which are the di erences
and advances between the two systems.
      </p>
      <p>
        User interface and recommender systems The user interface plays a crucial role
in the way the users perceive the recommendations [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Indeed, it is either
employed in a recommender system to collect preferences from the users [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ],
or to provide a better understanding of the recommendations and allow a user
to explore them [
        <xref ref-type="bibr" rid="ref18 ref20">18, 20</xref>
        ] (our proposal ts with the second scenario). In [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], a
user-centric framework, called ResQue measures the user experience with a
recommender system. Knijnenburg et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] studied ve interaction methods of the
users with a recommender systems and showed that users have di erent preferred
methods of interaction. SmallWorlds [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] provides a graph-based explanation of
the recommendations generated with a collaborative ltering approach.
SetFusion [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] gives the users the possibility to control a hybrid recommender system,
by setting the relevance that each component should have when generating the
recommendations.
      </p>
      <p>
        Contributions Our approach provides a user interface to allow the user to get
in touch and explore his/her preferences. An interface that provides this useful
informations was never been proposed. With respect to the analyzed
bibliography, our main contribution is the visualization and the comparison between one
or more Twixonomies, providing the following advantages:
{ it allows to visualize the interests of single users, communities and
populations in a easily browsable and interpretable way, especially when compared
with the large number of unstructured and ne-grained topics extracted from
textual features in messages and lists descriptions (like in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]);
{ it allows to compare several Twixonomies giving a precise measure of
semantic symilarity;
{ it is also designed as a predictive system that aims to discover the interests
not declared directly from the users and to recommend new ones on these
basis, also in the presentation aspect.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Proposed Approach</title>
      <p>
        This Section rst brie y describes the Twixonomy algorithm as described in
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], and then discuss the functionalities exposed by Twixonomy Visualization
Interface (TVI).
      </p>
      <sec id="sec-3-1">
        <title>Twixonomy Algorithm</title>
        <p>
          1. First, we extract from the pro les of each user p in P the set F of followees,
such that each u in F is followed by at least one user p in P . Note that the
sets P and F are di erent, though possibly overlapping. We then create a
mapping between users u 2 F and wikipages in Wikipedia, if any;
2. Next, we extract all paths connecting these pages with topmost Wikipedia
category nodes in the Wikipedia Category Graph, thus inducing a graph
W G;
3. Finally, we apply a graph pruning algorithm to remove cycles and reduce
multiple inheritance, a problem that often cancels the advantage of adding
semantics [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Functionalities</title>
        <p>The Twixonomy Visualization Interface provides the following four main
functionalities:
1. Search Bar allows to the user of the visualization interface, to search for
a speci c Twitter's pro le. The user inserts into the search bar a query
string and the system shows a list of Twitter's pro les that best match the
requirements. The user can select one of the proposed pro les to visualize the
related Twixonomy. The search bar is presented to the user in the landing
page and it is also available in all the other views of the interface.
2. Graph Visualization represents the core of the Twixonomy visualization
Interface. The Twixonomy is visualized in this part of the view
(bottomright of Figure 2) as a graph and it is always possible to select between these
three sub-functionalities:</p>
        <p>Twixonomy
Society</p>
        <p>Sports</p>
        <p>Culture
Economics</p>
        <p>Basketball</p>
        <p>Basketball</p>
        <p>teams
National Basketball
Association teams</p>
        <p>Orlando
Magic</p>
        <p>Mass
media
American
magazines
Economics
organizations
wiki:en:
World
Econ.</p>
        <p>Forum</p>
        <p>USA
basketball
coaches</p>
        <p>Orlando Magic
players</p>
        <p>ABC News</p>
        <p>American news</p>
        <p>magazines
wiki:en:
John
Calipari
wiki:en:
Orlando
Magic
wiki:en:
Dwight
Howard
wiki:en:
Good
Morning
America
wiki:en:
Newsweek
wiki:en:
Time
(magazine)
Anonymize
d user
(a) Network displays the Twixonomy graph of the selected user exactly as
showed in Figure 2. In this type of visualization, nodes are disposed
using a circular layouts. Each type of node has its own logo: nodes with
Twitter logo indicate the topical friends; the associated Wikipage nodes
are identify by the Wikipedia W logo, and the other nodes in the network
are those inferred from Twixonomy. In our example it is possible to note
that the principal interest of the selected Twitter's pro le is related to
the photography domain.
(b) the Hierarchical view allows a user to navigate the Twixonomy of the
selected pro le using a hierarchical layout. Nodes are presented without
any icons and only the text label is associated to each node. Nodes are
organized in levels; this view is designed to make it easier to understand
the relations between nodes.
(c) the Compared view allows a user to navigate the Twixonomy of two
selected pro les at the same time. Nodes of each Twixonomy are disposed
using circular layouts and the same icons of the Network view are used.
This view it is designed to better understand what are the semantic
differences and the common points between two pro les.</p>
        <p>For all the above exposed views (Network, Hierarchical, Compared ), it is
possible to zoom in and zoom out the graph, move nodes and edges and pan
the view.</p>
        <p>In almost every case the Twixonomies are too big to allow a readable
navigation of the graph. To deal with this issue we allow the user of the platform
to select the depth level of the visualized Twixonomy.</p>
        <p>
          For each interest node is also possible to read the related Wikipedia
description and it is also possible to share the visualized Twixonomy over the
principals social media platforms (Twitter, Facebook).
3. Interest List is presented on left part of the interface and contains all the
nodes of the Twixonomy when the selected view is Network or Hierarchical
. When the selected view is Compared only the nodes shared between the
compared Twixonomies are displayed. In both cases the Interest List can be
downloaded as a textual le.
4. A nity Score is presented to the user on the top left part of the interface
(see Figure 2), when two Twixonomies are selected (Compared functionality).
The A nity Score is the compact representation of the semantic similarity
between the selected pro les. The semantic similarity is computed using the
following formula as proposed in [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]:
        </p>
        <p>SemSym(A; B) =</p>
        <p>PiN=k1 w(dAk )
i</p>
        <p>w(dBik )
qPiN=k1 w(dAk )2
i
qPiN=k1 w(dBik )2
(1)
In the formula, A and B are the semantic vectors, extracted from each
Twixonomy, associated to users a and b , Aik, i = 1 : : : nk, is the i-th boolean
argument of A and is non-zero if the Twixonomy of a includes the node cik
of the population's Twixonomy. The index k = 0 : : : K is the generalization
level (k = 0 indicates Wikipages, as shown in Figure 1), that we also denote
as Lk, and nk = jVkj is the total number of nodes in the Twixonomy up
to Lk. Furthermore, dAk = k is the length of the minimum path connecting
i
cik with a leaf node1. Finally w(d) = e (d+1) is a weight function with
exponential decay2, where we empirically set = 2 and = 0:5. In formula
(1), non-zero terms in the numerator are those for which Aik = Bk,
howi
ever the contribution of a match exponentially decays with the distance k
of matching categories from leaf nodes. The higher is the value of SemSym,
the more are the shared interests between the selected users.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Recommendation Purpose</title>
      <p>As we previously remarked, user interface plays a crucial role in the way the users
perceive the recommendations. Indeed, it is either employed in a recommender
system to collect preferences from the users, or to provide a better understanding
of the recommendations and allow a user to explore them. The Twixonomy
Visualization Interface is designed not only for descriptive analysis of the interest
inferred from Twitter users pro le but and even as a predictive system that aim
to discover the interests not declared directly from the users and to recommend
new ones on these basis.</p>
      <p>In a typical use-case, a user starts the investigation process by visualising
her own Twixonomy using the Network view (point 2a of the previous section).
With this type of visualization, a user should discover intuitively (also guided
by di erent icons) which are the categories that dominate his interests. Using
this visualisation mode is then possible, searching in the Interest List, to nd
a speci c interest even if the Twixonomy is huge. By taking a closer look to a
speci c node, it is then possible to understand how strong is the relation with
neighbor nodes. If the user would like to know which is the generality level of
one node, he can switch to the Hierarchical view (point 2b). Indeed, by using the
Hierarchical view, it is possible to understand what is the type of relationship
of the Twixonomy and see which categories are higher than others.
1 note that leaf nodes matches have d = 0
2 with w(d) we mean generically either w(dAik ) or w(dBik )</p>
      <p>To inspect a second use-case, suppose that a user wants to understand how
close he is (in term of interests) to another Twitter's pro le. Then is possible
to select the Compared view (Secton 2c) to immediately take a look at two
Twixonomies at the same time. The user then can visually inspect what are the
di erent or the shared interests between the compared users. If it is not possible
to e ectively understand which are the similar interests of the Twixonomies
(due to the large amount of interest of both pro les), then the Interest List
helps the user to have a more compact representation of the similarity exposed
by the pro les, by highlighting only the shared interests. Simultaneously, the
A nity Score o ers to the user the fastest way to understand what is the level
of similarity exposed by the selected pro les.</p>
      <p>At the end of the process the user can understand not only his preferences
but also how these are generated, what is the level of generalisation between
them, and which of them depends by others. User that also have to compare
their interests to those of another Twixonomy, can also understand which is
their a nity to another pro le and which are the potential new preferences that
they should be interested in.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and future work</title>
      <p>
        In this paper, we presented the Twixonomy Visualization Interface, a tool to
explore and analyze a hierarchical representation of the user preferences, called
Twixonomy. Compared to [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], that presents users' preferences as simple
tagcloud, our interface presents to the user a more detailed informations; in addition
Twixonomy Visualization Interface enables to wonder around the interest and
compare own interests with those of the community. We are actually thinking
of many possible improvements of the platform. First, we plan to embed the
Twixonomy Visualization Interface in the Twitter platform in a way that should
be easily possible to build the Twixonomy of a community (list, in Twitter
terminology). Another improvement that we plan to develop is to give the possibility
to each user to evaluate their Twixonomy by expressing a degree of precision
and allowing feedbacks on the quality of the interface. Another on-going study
regards the user interface evaluation. In particular, we would ask to users which
views is more useful between the ones that are already available and the ones
that are under developments.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>H.</given-names>
            <surname>Anderson</surname>
          </string-name>
          .
          <article-title>Fire spread and ame shape</article-title>
          .
          <source>Fire Technology</source>
          ,
          <volume>4</volume>
          (
          <issue>1</issue>
          ):
          <volume>51</volume>
          {
          <fpage>58</fpage>
          ,
          <year>1968</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>P.</given-names>
            <surname>Bhattacharya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. B.</given-names>
            <surname>Zafar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Ganguly</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Ghosh</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K. P.</given-names>
            <surname>Gummadi</surname>
          </string-name>
          .
          <article-title>Inferring user interests in the twitter social network</article-title>
          .
          <source>In Proceedings of the ACM Conference on Recommender Systems, RecSys '14</source>
          , pages
          <fpage>357</fpage>
          {
          <fpage>360</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>R.</given-names>
            <surname>Burke</surname>
          </string-name>
          .
          <article-title>Hybrid recommender systems: Survey and experiments</article-title>
          .
          <source>User Modeling</source>
          and
          <string-name>
            <surname>User-Adapted</surname>
            <given-names>Interaction</given-names>
          </string-name>
          ,
          <volume>12</volume>
          (
          <issue>4</issue>
          ):
          <volume>331</volume>
          {
          <fpage>370</fpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>S.</given-names>
            <surname>Faralli</surname>
          </string-name>
          , G. Stilo, and
          <string-name>
            <given-names>P.</given-names>
            <surname>Velardi</surname>
          </string-name>
          .
          <article-title>Large scale homophily analysis in twitter using a twixonomy</article-title>
          .
          <source>In Proc. of the 24th Int. Joint Conf. on Arti cial Intelligence</source>
          ,
          <source>IJCAI</source>
          <year>2015</year>
          ,
          <string-name>
            <given-names>Buenos</given-names>
            <surname>Aires</surname>
          </string-name>
          , Argentina,
          <source>July 25-31</source>
          ,
          <year>2015</year>
          , pages
          <fpage>2334</fpage>
          {
          <fpage>2340</fpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>S.</given-names>
            <surname>Faralli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. D.</given-names>
            <surname>Tommaso</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Velardi</surname>
          </string-name>
          .
          <article-title>Semantic enabled recommender system for micro-blog users</article-title>
          .
          <source>In 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW)</source>
          , pages
          <fpage>992</fpage>
          {
          <fpage>998</fpage>
          ,
          <string-name>
            <surname>Dec</surname>
          </string-name>
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>R.</given-names>
            <surname>Garcia</surname>
          </string-name>
          and
          <string-name>
            <given-names>X.</given-names>
            <surname>Amatriain</surname>
          </string-name>
          .
          <article-title>Weighted content based methods for recommending connections in online social networks</article-title>
          .
          <source>In The 2nd ACM Work. on Recommendation Systems and the Social Web</source>
          , Barcelona, Spain,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>B.</given-names>
            <surname>Gretarsson</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. O'Donovan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Bostandjiev</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Hall</surname>
          </string-name>
          , and T. Hollererk. Smallworlds:
          <article-title>Visualizing social recommendations</article-title>
          .
          <source>In Proceedings of the 12th Eurographics / IEEE - VGTC Conference on Visualization, EuroVis'10</source>
          , pages
          <fpage>833</fpage>
          {
          <fpage>842</fpage>
          ,
          <string-name>
            <surname>Chichester</surname>
          </string-name>
          , UK,
          <year>2010</year>
          . The Eurographs Association &amp;#
          <volume>38</volume>
          ; John Wiley &amp;#38; Sons, Ltd.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>P.</given-names>
            <surname>Kapanipathi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Jain</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Venkataramani</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <surname>A. Sheth.</surname>
          </string-name>
          <article-title>User interests identi cation on twitter using a hierarchical knowledge base</article-title>
          .
          <source>In The Semantic Web: Trends and Challenges</source>
          , volume
          <volume>8465</volume>
          , pages
          <fpage>99</fpage>
          {
          <fpage>113</fpage>
          . Springer Int. Publishing,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>B. P.</given-names>
            <surname>Knijnenburg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. J.</given-names>
            <surname>Reijmer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. C.</given-names>
            <surname>Willemsen</surname>
          </string-name>
          .
          <article-title>Each to his own: How di erent users call for di erent interaction methods in recommender systems</article-title>
          .
          <source>In Proceedings of the Fifth ACM Conference on Recommender Systems, RecSys '11</source>
          , pages
          <fpage>141</fpage>
          {
          <fpage>148</fpage>
          , New York, NY, USA,
          <year>2011</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Konstan</surname>
          </string-name>
          .
          <article-title>Tutorial / hci for recommender systems: A tutorial</article-title>
          .
          <source>In Proceedings of the 16th International Conference on Intelligent User Interfaces</source>
          ,
          <source>IUI '11</source>
          , pages
          <fpage>463</fpage>
          {, New York, NY, USA,
          <year>2011</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>S.</given-names>
            <surname>Kywe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.-P.</given-names>
            <surname>Lim</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Zhu</surname>
          </string-name>
          .
          <article-title>A survey of recommender systems in twitter</article-title>
          .
          <source>In Social Informatics</source>
          , volume
          <volume>7710</volume>
          of Lecture Notes in Computer Science, pages
          <volume>420</volume>
          {
          <fpage>433</fpage>
          . Springer Berlin Heidelberg,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>Q.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y. P.</given-names>
            <surname>Chen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Lin</surname>
          </string-name>
          .
          <article-title>User comments for news recommendation in forum-based social media</article-title>
          .
          <source>Inf. Sci.</source>
          ,
          <volume>180</volume>
          (
          <issue>24</issue>
          ):
          <volume>4929</volume>
          {
          <fpage>4939</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>C. Lu</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Lam</surname>
            , and
            <given-names>Y. Zhang.</given-names>
          </string-name>
          <article-title>Twitter user modeling and tweets recommendation based on wikipedia concept graph</article-title>
          .
          <source>Technical Report WS-12-09, AAAI Technical Report</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>P.</given-names>
            <surname>Matykiewicz</surname>
          </string-name>
          and
          <string-name>
            <given-names>W.</given-names>
            <surname>Duch</surname>
          </string-name>
          .
          <article-title>Multiple inheritance problem in semantic spreading activation networks</article-title>
          .
          <source>In Brain Informatics and Health - Int. Conf., BIH</source>
          <year>2014</year>
          , Warsaw, Poland,
          <source>August 11-14</source>
          ,
          <year>2014</year>
          , Proceedings, pages
          <volume>252</volume>
          {
          <fpage>265</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>S. M. McNee</surname>
            ,
            <given-names>S. K.</given-names>
          </string-name>
          <string-name>
            <surname>Lam</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          <string-name>
            <surname>Konstan</surname>
            , and
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>Interfaces for eliciting new user preferences in recommender systems</article-title>
          .
          <source>In Proceedings of the 9th International Conference on User Modeling</source>
          ,
          <source>UM'03</source>
          , pages
          <fpage>178</fpage>
          {
          <fpage>187</fpage>
          , Berlin, Heidelberg,
          <year>2003</year>
          . Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16. H.
          <string-name>
            <surname>Nguyen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Mastho</surname>
            , and
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Edwards</surname>
          </string-name>
          .
          <article-title>Persuasive e ects of embodied conversational agent teams</article-title>
          .
          <source>In Proceedings of the 12th International Conference on Humancomputer Interaction: Intelligent Multimodal Interaction Environments</source>
          , HCI'
          <volume>07</volume>
          , pages
          <fpage>176</fpage>
          {
          <fpage>185</fpage>
          , Berlin, Heidelberg,
          <year>2007</year>
          . Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>D. H.</given-names>
            <surname>Park</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. K.</given-names>
            <surname>Kim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. Y.</given-names>
            <surname>Choi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. K.</given-names>
            <surname>Kim</surname>
          </string-name>
          .
          <article-title>A literature review and classi cation of recommender systems research</article-title>
          .
          <source>Expert Syst. Appl.</source>
          ,
          <volume>39</volume>
          (
          <issue>11</issue>
          ):
          <volume>10059</volume>
          {
          <fpage>10072</fpage>
          ,
          <string-name>
            <surname>Sept</surname>
          </string-name>
          .
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <given-names>P.</given-names>
            <surname>Pu</surname>
          </string-name>
          and
          <string-name>
            <given-names>L.</given-names>
            <surname>Chen</surname>
          </string-name>
          .
          <article-title>Trust-inspiring explanation interfaces for recommender systems</article-title>
          .
          <source>Know.-Based Syst.</source>
          ,
          <volume>20</volume>
          (
          <issue>6</issue>
          ):
          <volume>542</volume>
          {
          <fpage>556</fpage>
          ,
          <string-name>
            <surname>Aug</surname>
          </string-name>
          .
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>P.</given-names>
            <surname>Pu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Chen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Hu</surname>
          </string-name>
          .
          <article-title>A user-centric evaluation framework for recommender systems</article-title>
          .
          <source>In Proceedings of the Fifth ACM Conference on Recommender Systems, RecSys '11</source>
          , pages
          <fpage>157</fpage>
          {
          <fpage>164</fpage>
          , New York, NY, USA,
          <year>2011</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <given-names>L.</given-names>
            <surname>Qiu</surname>
          </string-name>
          .
          <article-title>Designing social interactions with animated avatars and speech output for Product Recommendation Agents in electronic commerce</article-title>
          .
          <source>PhD thesis</source>
          ,
          <year>Jan 2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>C. Wagner</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Liao</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Pirolli</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Nelson</surname>
            , and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Strohmaier</surname>
          </string-name>
          .
          <article-title>It's not in their tweets: Modeling topical expertise of twitter users</article-title>
          .
          <source>In Privacy, Security, Risk and Trust (PASSAT)</source>
          ,
          <source>2012 Int. Conf. on and 2012 Int. Confernece on Social Computing (SocialCom)</source>
          , pages
          <fpage>91</fpage>
          {
          <fpage>100</fpage>
          ,
          <string-name>
            <surname>Sept</surname>
          </string-name>
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>K. H. Yoo</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          <string-name>
            <surname>Gretzel</surname>
            , and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Zanker</surname>
          </string-name>
          .
          <article-title>Source factors in recommender system credibility evaluation</article-title>
          . In F. Ricci,
          <string-name>
            <given-names>L.</given-names>
            <surname>Rokach</surname>
          </string-name>
          , and B. Shapira, editors,
          <source>Recommender Systems Handbook</source>
          , pages
          <volume>689</volume>
          {
          <fpage>714</fpage>
          . Springer,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>