<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Entity Recommendations Using Hierarchical Knowledge Bases</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Siva Kumar Cheekula</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pavan Kapanipathi</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Derek Doran</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Prateek Jain</string-name>
          <email>jainprateek@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Amit Sheth</string-name>
          <email>amitg@knoesis.org</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>IgnitionOne Solutions</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Kno.e.sis Center, Wright State University</institution>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Recent developments in recommendation algorithms have focused on integrating Linked Open Data to augment traditional algorithms with background knowledge. These developments recognize that the integration of Linked Open Data may o er better performance, particularly in cold start cases. In this paper, we explore if and how a speci c type of Linked Open Data, namely hierarchical knowledge, may be utilized for recommendation systems. We propose a content-based recommendation approaches that adapts a spreading activation algorithm over the DBpedia category structure to identify entities of interest to the user. Evaluation of the algorithm over the Movielens dataset demonstrates that our method yields more accurate recommendations compared to a previously proposed taxonomy driven approach for recommendations.</p>
      </abstract>
      <kwd-group>
        <kwd>Content-based recommendation</kwd>
        <kwd>Entity Relationships</kwd>
        <kwd>Wikipedia</kwd>
        <kwd>Semantics</kwd>
        <kwd>Hierarchy</kwd>
        <kwd>Knowledge Bases</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Entities are an underlying part of our everyday activities on the web. 50% of
search queries are entities [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. Recently, search engines such as Google and
Yahoo [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] include an additional feature of recommending related entities based on
the search query. Although the related entity feature has been lately added by
search companies, over the years, entity recommendations have been popular in
the name of item recommendations such as movies, song albums, e-commerce,
and locations. For example, Net ix recommends movies, Pandora recommends
songs and Amazon recommends shopping items. Recommendation engines in
these cases utilize di erent attributes of the user such as prior ratings to these
entities (movies, songs), users' demographics, and popularity of the entities among
other users. Furthermore, existing knowledge about the entities can be utilized
as an additional attribute to provide better recommendations.
      </p>
      <p>
        Knowledge infused recommendation algorithms have gained signi cant
attention due to their competitive performance [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and ability to overcome cold
Copyright c 2015 for this paper by its authors. Copying permitted for private
and academic purposes.
start challenge [
        <xref ref-type="bibr" rid="ref15 ref23">15, 23</xref>
        ]. Although many researchers are pursuing this area of
research, utilizing knowledge bases for recommendations is still largely unexplored
and holds the potential of improving entity recommendation algorithms [
        <xref ref-type="bibr" rid="ref15 ref5">5, 15</xref>
        ].
Considering this line of thought, in this work, we intent to explore hierarchical
knowledge derived from crowd sourced knowledge bases for recommendations.
Our approach is content based and adapts the spreading activation algorithm
on the pruned DBpedia [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] category structure to identify personalized entities
as recommendations.
      </p>
      <p>
        Memory in human brain has been argued to be organized as a hierarchical
structure [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. However, this theory has not been enough explored by researchers
to understand users on the web. Some who have explored this area have exploited
hierarchical structure that are either manually created [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] or automatically
created [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] from the descriptions of the items. Creating taxonomies manually is
a tedious and time intensive process whereas automatically creating them using
the descriptions of items might lack coverage due to their short descriptions. In
this context, we believe that DBpedia's category structure extracted from crowd
sourced Wikipedia overcomes the above mentioned drawbacks. Especially, since
Wikipedia is crowd sourced, the domain coverage is signi cantly better. We
utilize an automatically pruned hierarchy from DBpedia for recommendations.
      </p>
      <p>
        In this paper, we introduce a novel approach that utilizes hierarchical
structure from DBpedia for entity recommendation. The content-based approach
transforms the DBpedia category structure into a taxonomy, and utilizes an
adaptation of the spreading activation algorithm [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] to assign values to
categories in the taxonomy based on the explicit ratings provided by the user. These
scores of the categories are disseminated back to the unrated entities. The score
gained by an entity correspond to the degree to which it should be recommended
to a user. We evaluate using the Movielens dataset and show that our approach
performs better than previous work that proposed a taxonomy driven approach
for recommendations.
      </p>
      <p>The rest of the paper is organized as follows: In Section 2 we detail the
related work. Section 3 describes our approach, followed by evaluation in Section
4. Section 5 concludes with our thoughts on future work.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        Recommendation systems is a popular area of research [
        <xref ref-type="bibr" rid="ref15 ref5">5, 15</xref>
        ]. The systems
focus on recommending music [
        <xref ref-type="bibr" rid="ref18 ref2">2, 18</xref>
        ], books [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], items in e-commerce shops [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ],
and movies [
        <xref ref-type="bibr" rid="ref17 ref9">9, 17</xref>
        ]. These systems may be classi ed into three di erent types,
namely (1) content-based, where prior ratings of a user and her demographic
information may be considered; [
        <xref ref-type="bibr" rid="ref13 ref9">9, 13</xref>
        ]; (2) collaborative, where the popularity
and ratings of entities from similar or a liated other users are considered [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ];
and (3) hybrid, which is a mix of both content-based and collaborative [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
Content-based approaches focus on the individuality of a user in submitting
recommendations, making them more transparent and amenable to overcoming the
cold start problem [
        <xref ref-type="bibr" rid="ref15 ref23">15, 23</xref>
        ].
      </p>
      <p>
        Although we have explored just the hierarchical knowledge, broadly our work
is considered as a recommendation algorithm that utilizes Linked Open Data.
Other recommendation techniques that use Linked Open Data have utilized all
types of relationships for recommendations [
        <xref ref-type="bibr" rid="ref17 ref18 ref9">9, 18, 17</xref>
        ]. Passant in his work [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ],
recommends entities based on its "linked data semantic distance (LDSD)" from
other explicitly rated entities of the user. The LDSD does not restrict any
property in the DBpedia graph and considers the DBpedia as an undirected graph.
In [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], Di Noia et al. have harnessed DBpedia in order to recommend movies
based on the content of the user. Similar to Passant's work, Di Noia et al. also
utilize all the properties of DBpedia and introduce a function that measure
the similarity between the entity to be recommended and the entity rated by
the users. Ostuni et al. [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] present a hybrid recommendation system, named
Sprank, that utilize both neighborhood users ratings and the users' explicit
ratings for recommendations. They create a bipartite graph between users and
entities (rated and unrated) of length 4 from DBpedia. From the analysis of the
paths, path-based features are extracted. Then they apply a learning to rank
algorithm to recommend the most relevant items to the user. From these
approaches it is hard to analyze the value created by each property on Linked
Open Data for recommendations. We, on the other hand, have tried to explore
di erent features of hierarchical relationships on DBpedia to improve
recommendation algorithm.
      </p>
      <p>
        The integration of hierarchical knowledge in recommendation is becoming an
emerging area of interest [
        <xref ref-type="bibr" rid="ref11 ref16 ref24 ref25">11, 16, 24, 25</xref>
        ]. However, the taxonomies considered are
either manually created [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] or are automatically derived from the content
descriptions of the items [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. In our work, we instead use a hierarchical structure
in Wikipedia (DBpedia), which is a large crowdsourced taxonomy, for
recommendation. Most of the approaches are hybrid and utilize latent factor models
in order to accomplish the goal of recommendations. However, although Ziegler
et al. [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] utilize a complete di erent taxonomy (Amazon's book taxonomy)
for evaluation, their approach can be perceived as an adaptation of spreading
activation algorithm. Their approach can be clearly distinguished into
contentbased and collaborative parts. In this work, we evaluate our work against the
content-based part of Zeiegler's work as the baseline for comparison.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Approach</title>
      <p>Our algorithm recommends entities given entity ratings in the following steps,
as illustrated in Figure 1:
{ Preprocessing DBpedia Category Graph: In a one time preprocessing
step, the DBpedia category graph is transformed into a taxonomic structure
with multiple inheritance.
{ Determining Interest Categories: Explicit ratings of entities, provided
by a user as input to the algorithm, is spread to the corresponding categories
of the DBpedia taxonomy by adapting a spreading activation algorithm. The
categories in the taxonomy are scored re ecting the degree of user's interest.
{ Recommending Entities: The score of the categories from the previous
step is again spread to the unrated entities in the taxonomy. The highest
scored entities are recommended to the user.
We next detail the operation of these three steps.
3.1</p>
      <sec id="sec-3-1">
        <title>Preprocessing DBpedia Category Graph</title>
        <p>
          Wikipedia, a collaborative encyclopedia, is a source of not only human readable
knowledge but also semi-structured knowledge that is leveraged by a variety
of applications. This semi-structured data is the wikilinks added to Wikipedia
articles by users. For example, wikilinks on the Albert Einstein 3 Wikipedia
page includes an infobox with information such as birth date, profession, death
date, and awards. The semi-structured information across Wikipedia has been
extracted and transformed into a structured RDF format as DBpedia [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ], which
is one of the most popular datasets on Linked Open Data4 [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. DBpedia therefore
can be thought of as a highly structured form of Wikipedia. It has been
principally utilized to infuse knowledge for tasks such as semantic similarity [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ], and
recommendations [
          <xref ref-type="bibr" rid="ref17 ref18 ref2">2, 17, 18</xref>
          ].
        </p>
        <p>A curse of Wikipedia (and hence DBpedia) as a collaborative system is that
its category structure is not organized as a formal taxonomy. This is because
users are allowed to link any Wikipedia category as a category of an entity,
without regard to whether the categorical relationship is reasonable. If such
3 http://en.wikipedia.org/wiki/Albert_Einstein
4 http://lod-cloud.net/
a hierarchy could be extracted from DBpedia, however, it could be invaluable
for entity recommendations. For example, if we can determine that a user is
interested in category: lms by james cameron5 and category:horror lms6, it
would be reasonable to recommend entities that are children of both categories
(namely, horror movies by James Cameron to the user).</p>
        <p>
          We followed our previous approach [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ] to infer the hierarchical structure of
DBpedia category graph. The process can be summarized as follows:
1. All DBpedia categories corresponding to Wikipedia administrative
categories7 are removed based on a keyword set [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ];
2. Select "Category:Main Topic Classi cation", which subsumes more than 98%
of the categories, as the root node of the taxonomy.
3. Determine the abstract level of each category based on its shortest path
length to the root node. Our intuition is that, the closer the category is to
the root category, the more abstract it is. Hence, we assigned hierarchical
levels that re ected its shortest distance to the root category.
4. Remove all the edges in the category graph that limit the DBpedia category
graph from being structured as a taxonomy (e.g, remove all directed edges
pointing to an entity that is more abstract than its source node).
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Determining Interest Categories</title>
        <p>
          In this work, the Spreading Activation theory is used to assign appropriate scores
for the categories in the DBpedia category taxonomy. With an assumption that
human memory is represented as semantic network of concepts [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ], spreading
activation algorithms spread scores of initially activated concepts to its
neighboring concepts in the semantic network. The semantic network is formally a
network data structures consisting of nodes connected by edges. The spreading
of scores is controlled by an application dependent activation function. In order
to simulate the human memory, the activation function usually includes a decay
factor that decays the scores as and when the activation is performed for nodes
farther from the initially activated nodes. Formally, a simple activation function
is as follows:
        </p>
        <p>Ai =</p>
        <p>X
where i is the node to be activated, Ai is the activation value of node i, C(i)
is the set of activated child nodes of i, Wij is the weight of the edge connecting
i and j, and D is a decay factor.</p>
        <p>
          We rst determine the scores for each of the categories in the taxonomy
by adapting the spreading activation algorithm. The user's explicit ratings of
entities are used as an initial assignment to nd the categories of importance.
5 http://en.wikipedia.org/wiki/Category:Films_directed_by_James_Cameron
6 http://en.wikipedia.org/wiki/Category:Horror_films
7 http://en.wikipedia.org/wiki/Category:Wikipedia_administration
Although explicit ratings for entities are generally available, nding the
mappings of these entities to a DBpedia category is a challenging task. We instead
utilize an existing Movielens dataset [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] that was already mapped to DBpedia
by Di Noia et.al. [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. Entities from the Movielens dataset therefore correspond
to the leaf nodes of the taxonomy. Edges associated with an entity may point to
categories at di erent levels in the taxonomy. For example, the lm Die Hard is
associated with categories English Language Films, 1988 Films, American
Action Films, Terrorism in Fiction and Films directed by John McTiernan which
are at di erent hierarchical levels depending on their distance from the root
node. Since we have the entities that the user has rated linked to the taxonomy,
they can serve as source nodes for a spreading activation function. Based on
experiments carried out in our prior work [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], we consider the following two
spreading activation functions:
{ Bell Log - This activation function normalizes the scores based on the number
of subcategories in the next hierarchical level. This is introduced to counter
the uneven distribution of nodes at the hierarchical levels in the taxonomy.
Bell log performs a log normalization of the count. The activation function
is shown below.
        </p>
        <p>Ai = F Li</p>
        <p>
          X
1
where F Li = log(nodeshi+1) , hi is the hierarchical level of i, and nodesl is the
number of nodes at hierarchical level l.
{ Intersect booster - This activation function adds additional score to
categories that are the common ancestors of multiple initially activated entities
(i.e. the user's explicitly rated entities). This parameter has shown potential
in scoring the best categories of interest in our previous work [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. It is given
by:
        </p>
        <p>Ai = F Li</p>
        <p>Bi</p>
        <p>X
where F Li is the bell log normalization, and Bi = Max(EExxpplliicciittEEnnttiittiieessichildi ) ,
ExplicitEntitiesi is the number of entities explicitly rated by users and
are activating category i. The denominator M ax(ExplicitEntitieschildi is
the maximum of the explicitly rated entities that have activated one of the
immediate subcategory of category i.
The spreading activation functions discussed above are used to score each
categories in the taxonomy based on the degree of users' interest. We subsequently
use these scores to make recommendations for a user by spreading back these
scores to all of the unrated entities living at the bottom of the hierarchy. We
term this operation as a reverse spreading. It is important to note that the
reverse spreading is just one level deep, i.e. we spread the activation values of
categories only to the entities that are just directly below it in the taxonomy.
This is because, in Section 3.2, we utilized di erent activation functions to score
the most relevant categories of user interests in the taxonomy. In doing so, we
expect the output of the previous step to be normalized interest scores for each
category. Hence, if a category at hierarchical level 5 is scored higher than one
of its subcategory at hierarchical level 6, then it is assured that our approach
terms the category at hierarchical level 5 to be more important to the user.</p>
        <p>We initially experiment with a simple reverse spreading activation function
where the scores of the parents i.e. categories in the hierarchy of each entity is
summed up:
(4)
(5)</p>
        <p>Where N (i) is the set of category nodes associated with entity i in the
taxonomy. A challenge with 4 is that some categories have a larger number of entities,
in which case a large number of entities may be scored signi cantly higher just
due to one single category. Hence, we normalize the scores based on the number
of entities (outdegree) subsumed by the category. It is important to note that, a
category can subsume either an entity or other subcategories, hence two types
of edges exist. In this activation function, we only consider the edges that link
to an entity from the corresponding category for the outdegree. This updated
reverse activation function is thus given as:
where Outdegree(j)entity is the number of entities directly associated with
category j.</p>
        <p>Another challenge with both of these reverse activation functions is the
identical spreading of a node's value to all of its child nodes. Hence, all categories
are treated with similar importance to an entity. In contrast, the Wikipedia has
a convention that suggests its users in ordering categories to articles 8. The
convention states that the categories of a particular entity should be in order of its
signi cance to the entity. For example, the categories for the Wikipedia article
Cincinatti Reds are Major League Baseball teams, Sports in Cincinnati, Ohio,
and Sports clubs established in 1882. These categories are ordered as they are
listed, implying that Category:Major League Baseball Team is the most
significant category of Cincinnati Reds than the rest. As the intuition behind this
suggestion certainly makes the reasonable categorization, it is important to
accommodate it in our algorithm. Therefore we introduce a parameter, which is
the priority of the category to the entity. The priority is the rank of the category
in order, hence we multiply the activation value with its inverse:
8 http://en.wikipedia.org/wiki/Wikipedia:Categorization
j2N(i)
Outdegree(j)entity</p>
        <p>Pij
(6)
where Pij is the priority rank of category j to entity i.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Evaluation</title>
      <p>This section describes the evaluation of our recommendation approach against a
baseline method. As our approach aims at determining the most relevant entities
of interest to a user, we measure the quality of the approach as the capability
of listing the most interesting entities in the top ranks of the predicted entities.
In the following sections, we rst present the details of the dataset, then the
evaluation approach and nally discuss the results.
4.1</p>
      <sec id="sec-4-1">
        <title>Dataset</title>
        <p>
          We considered the data set by Movielens [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] which is widely used for
recommendation systems evaluation. The Movielens data set consists of 1,000,209
ratings for 3,883 movies by 6,040 users. As our algorithm is based on DBpedia,
it is necessary for each movie in the Movielens dataset to have a
corresponding entity/resource in DBpedia. Hence, we utilize the mappings open sourced
by Di Noia et al. [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] that maps movies in the dataset to an appropriate
DBpedia resource. The mappings contain 3,148 movies out of 3,883 total movies
in the dataset. Since we are a content-based approach, sparse data (users who
have rated very few movies), signi cantly impacts the recommendation
performance [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. Hence, similar to [
          <xref ref-type="bibr" rid="ref17 ref9">9, 17</xref>
          ] we eliminated users who has ratings for less
than 20 movies. After these ltering steps, our data set contains 3,148 movies
rated by 5,886 users with approximately 0.9M ratings.
4.2
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Baseline approach</title>
        <p>
          A similar adaptation of spreading activation theory on taxonomies has been
presented by Zeigler et al. [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]. This work presents a hybrid approach that applies
spreading activation theory on a hand crafted taxonomy. Similar to our approach
it also utilizes a normalized activation function9 to score the categories of interest
for each user. The output of this step is a vector of categories for each user vu.
Next, they perform the similar spreading for each item to be recommended
resulting in a vector of categories vi. Content-based recommendation for a user
u nds the pearson correlation between the vector of each item i, vi and vu
(vector representing the user). This is termed as the product proximity. In order
to make a fair comparison of content based recommendations, we ignore the user
proximity of Ziegler et al. [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ], which is the collaborative part of the algorithm.
9 More details of the activation function used is in [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ].
Recommendation system which predicts the user ratings for an entity are
evaluated using the error metrics(such as RMSE, MAE). However, Cremonesi et
al. [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] has argued that the recommender system which focuses on retrieving the
most relevant entities should be evaluated by means of accuracy metrics and
not error metrics. Hence, in this work, we implemented the evaluation approach
proposed by Cremonesi et al. to assess the performance of personalized,
contentbased, movie recommendations of our approach against the baseline explained
in Section 4.2. The evaluation approach is as follows:
        </p>
        <p>After applying the ltering discussed in Section 4.1 on the original Movielens
data set, we randomly selected 1.4% of the entire data set and used it as test
set T (jT j = 9805). The remaining 98.6% items are used as training set M . For
each of the test item i with 5-stars in T , we performed the following.
{ We randomly select the 1,000 items unrated by the user with an assumption
that those were uninteresting to her.
{ A ranked list of 1,001 items (i.e. 1,000 unrated plus the test item i) is formed
by our algorithm.
{ Then, we evaluate by picking the top N items. If the test item i is in the top</p>
        <p>N list, we have a hit, or a miss otherwise.</p>
        <p>The probability of hit increases as N increases. We consider recall as the ratio
of total hits and the size of the 5* test items from T. The set of 5* test items in
test set T are denoted by K. Formally, recall is as follows:
recall(N ) =
#Hits
jKj
(7)
4.4</p>
      </sec>
      <sec id="sec-4-3">
        <title>Results</title>
        <p>Summing DegreeNorm PriorityDegree</p>
        <p>In Table 1, we report the recall at top 20 achieved on the Movielens dataset.
Each cell represents the recall of the spreading (row) and reverse spreading
functions (column) we described in 3. The nal row of the Table 1 shows the
results using the baseline approach. It is evident that all the variations of our
approach beats the baseline. Plausible reasons for the poor performance of the
baseline, based on our analysis of the results are: (1) it scores abstract categories
higher due to the structure of DBpedia taxonomy. There wasn't signi cant decay
of spreading and the normalization is insu cient; and (2) the categories in the
higher level of the taxonomy were common for all the users and entities, hence
a pre-existing bias existed during the calculation of pearson correlation.</p>
        <p>
          It is not surprising that Bell Log Intersect is the best performing
spreading activation function since the parameters used in the activation function also
had signi cant impact in our previous work [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. Table 1 proves our intuition of
adding new parameters to the reverse spreading activation function. Summing
is the most simplest reverse spreading activation function used, and carries two
major drawbacks. It: (1) ignores the number of entities associated with the
category, which is important since some categories are generic and subsume many
entities; and (2) spreads the same activation value to all the entities in the
category. However, it is surprising to see that Summing with Bell Log performs better
than Summing with Bell Log Intersect. Analyzing this unexpected performance
is a part of our future work.
        </p>
        <p>Degree Normalization function normalizes the spread of values from the
category as a function of its out-degree. This hinders the importance provided
to generic categories from the spreading activation functions. This shows that
although, these activation functions achieved signi cant results in generating
hierarchical interests from tweets, there are further areas of improvement to adapt
it to recommendations. As we introduce the signi cance factor among
relationships in taxonomy using priority parameter in reverse spreading, we observed
the improvements in recommendations. This variation of the reverse spreading
activation function performs the best among others we have experimented. The
priority that users collaboratively add on Wikipedia for categories of each
article does provide enough information to make an impact on recommendations of
entities.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and Future work</title>
      <p>In this paper we have presented a content-based recommendation algorithm,
building upon our previous work, that utilizes the hierarchical structure of a
crowd sourced knowledge base. Utilizing spreading activation on a taxonomy, we
experimented with di erent activation functions that leverages various features
of the hierarchical structure. In our evaluation we have shown that we perform
signi cantly better than other approaches that harness item taxonomies derived
from crowd-sourced knowledge bases. In future, we intend to explore the category
graph of DBpedia better for recommendations. Removal of noisy categories can
make a signi cant impact in recommendations, we intend to develop techniques
that can help us ignore categories that are not helpful for recommendations. As
we have an initial result about the e ect of the hierarchical level of categories
(abstractness), we plan to optimize the activation function based on the
hierarchical levels of the categories. Finally, by experimenting with more features of
the hierarchy, we will develop a hybrid recommendation algorithm.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. Soren Auer, Christian Bizer, Georgi Kobilarov, Jens Lehmann, Richard Cyganiak, and
          <string-name>
            <given-names>Zachary</given-names>
            <surname>Ives</surname>
          </string-name>
          .
          <article-title>Dbpedia: A nucleus for a web of open data</article-title>
          . Springer,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Stephan</given-names>
            <surname>Baumann</surname>
          </string-name>
          and
          <string-name>
            <given-names>Rafael</given-names>
            <surname>Schirru</surname>
          </string-name>
          .
          <article-title>Using linked open data for novel artist recommendations</article-title>
          .
          <source>In 13th Internal Society for Music Information Retrival Conference</source>
          , Porto,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Christian</given-names>
            <surname>Bizer</surname>
          </string-name>
          , Tom Heath, and
          <string-name>
            <surname>Tim</surname>
          </string-name>
          Berners-Lee.
          <article-title>Linked data-the story so far</article-title>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Roi</surname>
            <given-names>Blanco</given-names>
          </string-name>
          , BerkantBarla Cambazoglu,
          <string-name>
            <surname>Peter Mika</surname>
            , and
            <given-names>Nicolas</given-names>
          </string-name>
          <string-name>
            <surname>Torzec</surname>
          </string-name>
          .
          <article-title>Entity recommendations in web search</article-title>
          . In Harith Alani, Lalana Kagal, Achille Fokoue, Paul Groth, Chris Biemann, JosianeXavier Parreira, Lora Aroyo, Natasha Noy, Chris Welty, and Krzysztof Janowicz, editors,
          <source>The Semantic Web ISWC</source>
          <year>2013</year>
          , volume
          <volume>8219</volume>
          of Lecture Notes in Computer Science, pages
          <volume>33</volume>
          {
          <fpage>48</fpage>
          . Springer Berlin Heidelberg,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>J.</given-names>
            <surname>Bobadilla</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ortega</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hernando</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <surname>A. GutieRrez.</surname>
          </string-name>
          <article-title>Recommender systems survey</article-title>
          .
          <source>Know.-Based Syst.</source>
          ,
          <volume>46</volume>
          :
          <fpage>109</fpage>
          {
          <fpage>132</fpage>
          ,
          <year>July 2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Laurent</given-names>
            <surname>Candillier</surname>
          </string-name>
          , Frank Meyer, and
          <string-name>
            <given-names>Marc</given-names>
            <surname>Boull</surname>
          </string-name>
          .
          <article-title>Comparing state-of-the-art collaborative ltering systems</article-title>
          . In Petra Perner, editor,
          <source>Machine Learning and Data Mining in Pattern Recognition</source>
          , volume
          <volume>4571</volume>
          of Lecture Notes in Computer Science, pages
          <volume>548</volume>
          {
          <fpage>562</fpage>
          . Springer Berlin Heidelberg,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Paolo</given-names>
            <surname>Cremonesi</surname>
          </string-name>
          , Yehuda Koren, and
          <string-name>
            <given-names>Roberto</given-names>
            <surname>Turrin</surname>
          </string-name>
          .
          <article-title>Performance of recommender algorithms on top-n recommendation tasks</article-title>
          .
          <source>In Proceedings of the Fourth ACM Conference on Recommender Systems, RecSys '10</source>
          , pages
          <fpage>39</fpage>
          {
          <fpage>46</fpage>
          , New York, NY, USA,
          <year>2010</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Rubn</given-names>
            <surname>Gonzlez</surname>
          </string-name>
          <string-name>
            <surname>Crespo</surname>
          </string-name>
          , Oscar Sanjun Martnez, Juan Manuel Cueva Lovelle,
          <string-name>
            <given-names>B.</given-names>
            <surname>Cristina Pelayo</surname>
          </string-name>
          Garca-Bustelo, Jos Emilio Labra Gayo, and Patricia Ordoez de Pablos.
          <article-title>Recommendation system based on user interaction data applied to intelligent electronic books</article-title>
          .
          <source>Computers in Human Behavior</source>
          ,
          <volume>27</volume>
          (
          <issue>4</issue>
          ):
          <volume>1445</volume>
          {
          <fpage>1449</fpage>
          ,
          <year>2011</year>
          .
          <article-title>Social and Humanistic Computing for the Knowledge Society</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Tommaso</given-names>
            <surname>Di</surname>
          </string-name>
          <string-name>
            <surname>Noia</surname>
          </string-name>
          , Roberto Mirizzi, Vito Claudio Ostuni, Davide Romito, and
          <string-name>
            <given-names>Markus</given-names>
            <surname>Zanker</surname>
          </string-name>
          .
          <article-title>Linked open data to support content-based recommender systems</article-title>
          .
          <source>In Proceedings of the 8th International Conference on Semantic Systems, I-SEMANTICS '12</source>
          , pages
          <issue>1</issue>
          {
          <fpage>8</fpage>
          , New York, NY, USA,
          <year>2012</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Jonathan L. Herlocker</surname>
          </string-name>
          , Joseph A.
          <string-name>
            <surname>Konstan</surname>
            ,
            <given-names>and John</given-names>
          </string-name>
          <string-name>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>Explaining collaborative ltering recommendations</article-title>
          .
          <source>In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, CSCW '00</source>
          , pages
          <fpage>241</fpage>
          {
          <fpage>250</fpage>
          , New York, NY, USA,
          <year>2000</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Bhargav</surname>
            <given-names>Kanagal</given-names>
          </string-name>
          , Amr Ahmed, Sandeep Pandey, Vanja Josifovski, Je Yuan, and
          <string-name>
            <surname>Lluis</surname>
          </string-name>
          Garcia-Pueyo.
          <article-title>Supercharging recommender systems using taxonomies for learning user purchase behavior</article-title>
          .
          <source>Proc. VLDB Endow</source>
          .,
          <volume>5</volume>
          (
          <issue>10</issue>
          ):
          <volume>956</volume>
          {
          <fpage>967</fpage>
          ,
          <year>June 2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Pavan</surname>
            <given-names>Kapanipathi</given-names>
          </string-name>
          , Prateek Jain, Chitra Venkataramani, and
          <string-name>
            <given-names>Amit</given-names>
            <surname>Sheth</surname>
          </string-name>
          .
          <article-title>User interests identi cation on twitter using a hierarchical knowledge base</article-title>
          .
          <source>In Valentina Presutti</source>
          , Claudia dAmato,
          <string-name>
            <surname>Fabien</surname>
            <given-names>Gandon</given-names>
          </string-name>
          , Mathieu dAquin, Ste en Staab, and Anna Tordai, editors,
          <source>The Semantic Web: Trends and Challenges</source>
          , volume
          <volume>8465</volume>
          of Lecture Notes in Computer Science, pages
          <volume>99</volume>
          {
          <fpage>113</fpage>
          . Springer International Publishing,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>Ken</given-names>
            <surname>Lang</surname>
          </string-name>
          .
          <article-title>Newsweeder: Learning to lter netnews</article-title>
          .
          <source>In Proceedings of the 12th international conference on machine learning</source>
          , pages
          <volume>331</volume>
          {
          <fpage>339</fpage>
          ,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Elizabeth</surname>
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Loftus</surname>
            and
            <given-names>Ronald W.</given-names>
          </string-name>
          <string-name>
            <surname>Sche</surname>
          </string-name>
          .
          <article-title>Categorization norms for fty representative instances</article-title>
          .
          <source>Journal of Experimental Psychology</source>
          ,
          <volume>91</volume>
          (
          <issue>2</issue>
          ):
          <fpage>355</fpage>
          ,
          <year>1971</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Pasquale</surname>
            <given-names>Lops</given-names>
          </string-name>
          , Marco de Gemmis, and
          <string-name>
            <given-names>Giovanni</given-names>
            <surname>Semeraro</surname>
          </string-name>
          .
          <article-title>Content-based recommender systems: State of the art and trends</article-title>
          . In Francesco Ricci, Lior Rokach, Bracha Shapira, and Paul B. Kantor, editors,
          <source>Recommender Systems Handbook</source>
          , pages
          <volume>73</volume>
          {
          <fpage>105</fpage>
          .
          <string-name>
            <surname>Springer</surname>
            <given-names>US</given-names>
          </string-name>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16. Aditya Krishna Menon,
          <string-name>
            <surname>Krishna-Prasad</surname>
            <given-names>Chitrapura</given-names>
          </string-name>
          , Sachin Garg, Deepak Agarwal, and
          <string-name>
            <given-names>Nagaraj</given-names>
            <surname>Kota</surname>
          </string-name>
          .
          <article-title>Response prediction using collaborative ltering with hierarchies and side-information</article-title>
          .
          <source>In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '11</source>
          , pages
          <fpage>141</fpage>
          {
          <fpage>149</fpage>
          , New York, NY, USA,
          <year>2011</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17. Vito Claudio Ostuni, Tommaso Di Noia, Eugenio Di Sciascio, and
          <string-name>
            <given-names>Roberto</given-names>
            <surname>Mirizzi</surname>
          </string-name>
          .
          <article-title>Top-n recommendations from implicit feedback leveraging linked open data</article-title>
          .
          <source>In Proceedings of the 7th ACM conference on Recommender systems</source>
          , pages
          <volume>85</volume>
          {
          <fpage>92</fpage>
          . ACM,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Alexandre</surname>
          </string-name>
          <article-title>Passant. dbrec{music recommendations using dbpedia</article-title>
          .
          <source>In The Semantic Web{ISWC</source>
          <year>2010</year>
          , pages
          <fpage>209</fpage>
          {
          <fpage>224</fpage>
          . Springer,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19. Simone Paolo Ponzetto and
          <string-name>
            <given-names>Michael</given-names>
            <surname>Strube</surname>
          </string-name>
          .
          <article-title>Deriving a large scale taxonomy from wikipedia</article-title>
          .
          <source>In Proceedings of the 22Nd National Conference on Arti cial Intelligence - Volume 2, AAAI'07</source>
          , pages
          <fpage>1440</fpage>
          {
          <fpage>1445</fpage>
          . AAAI Press,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20. Je rey Pound,
          <string-name>
            <surname>Peter Mika</surname>
            , and
            <given-names>Hugo</given-names>
          </string-name>
          <string-name>
            <surname>Zaragoza</surname>
          </string-name>
          .
          <article-title>Ad-hoc object retrieval in the web of data</article-title>
          .
          <source>In Proceedings of the 19th International Conference on World Wide Web, WWW '10</source>
          , pages
          <fpage>771</fpage>
          {
          <fpage>780</fpage>
          , New York, NY, USA,
          <year>2010</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <given-names>M</given-names>
            <surname>Ross</surname>
          </string-name>
          <article-title>Quillan</article-title>
          .
          <article-title>Semantic memory</article-title>
          .
          <source>Technical report, DTIC Document</source>
          ,
          <year>1966</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Marcin</surname>
            <given-names>Szczuka</given-names>
          </string-name>
          , Andrzej Janusz, and
          <string-name>
            <given-names>Kamil</given-names>
            <surname>Herba</surname>
          </string-name>
          .
          <article-title>Clustering of rough set related documents with use of knowledge from dbpedia</article-title>
          .
          <source>In JingTao Yao</source>
          , Sheela Ramanna,
          <string-name>
            <given-names>Guoyin</given-names>
            <surname>Wang</surname>
          </string-name>
          , and Zbigniew Suraj, editors,
          <source>Rough Sets and Knowledge Technology</source>
          , volume
          <volume>6954</volume>
          of Lecture Notes in Computer Science, pages
          <volume>394</volume>
          {
          <fpage>403</fpage>
          . Springer Berlin Heidelberg,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Li-Tung</surname>
            <given-names>Weng</given-names>
          </string-name>
          , Yue Xu,
          <string-name>
            <given-names>Yuefeng</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and Richi</given-names>
            <surname>Nayak</surname>
          </string-name>
          .
          <article-title>Exploiting item taxonomy for solving cold-start problem in recommendation making</article-title>
          .
          <source>In Tools with Arti cial Intelligence</source>
          ,
          <year>2008</year>
          . ICTAI'
          <volume>08</volume>
          . 20th IEEE International Conference on, volume
          <volume>2</volume>
          , pages
          <fpage>113</fpage>
          {
          <fpage>120</fpage>
          . IEEE,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Yuchen</surname>
            <given-names>Zhang</given-names>
          </string-name>
          , Amr Ahmed, Vanja Josifovski, and
          <string-name>
            <given-names>Alexander</given-names>
            <surname>Smola</surname>
          </string-name>
          .
          <article-title>Taxonomy discovery for personalized recommendation</article-title>
          .
          <source>In Proceedings of the 7th ACM International Conference on Web Search and Data Mining, WSDM '14</source>
          , pages
          <fpage>243</fpage>
          {
          <fpage>252</fpage>
          , New York, NY, USA,
          <year>2014</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Cai-Nicolas</surname>
            <given-names>Ziegler</given-names>
          </string-name>
          , Georg Lausen, and
          <string-name>
            <surname>Lars</surname>
          </string-name>
          Schmidt-Thieme.
          <article-title>Taxonomy-driven computation of product recommendations</article-title>
          .
          <source>In Proceedings of the Thirteenth ACM International Conference on Information and Knowledge Management</source>
          ,
          <source>CIKM '04</source>
          , pages
          <fpage>406</fpage>
          {
          <fpage>415</fpage>
          , New York, NY, USA,
          <year>2004</year>
          . ACM.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>