<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Re-CoSKQ: Towards POIs Recommendation Using Collective Spatial Keyword Queries</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ramon Hermoso∗</string-name>
          <email>rhermoso@unizar.es</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sergio Ilarri</string-name>
          <email>silarri@unizar.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Raquel Trillo-Lado</string-name>
          <email>raqueltl@unizar.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science and</institution>
          ,
          <addr-line>Systems Engineering, I3A</addr-line>
          ,
          <institution>University, of Zaragoza</institution>
          ,
          <addr-line>Zaragoza</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Computer Science and, Systems Engineering, University of</institution>
          ,
          <addr-line>Zaragoza, Zaragoza</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <fpage>42</fpage>
      <lpage>45</lpage>
      <abstract>
        <p>The goal of collective spatial keyword queries is to retrieve, from a spatial database, a group of spatial items such that the description of the items included in that set (typically based on the use of</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Retrieval tasks and goals → Recommender systems.</p>
    </sec>
    <sec id="sec-2">
      <title>INTRODUCTION</title>
      <p>
        Recommender systems (RS) have been studied for several decades,
aiming to facilitate item selection as part of the user’s
decisionmaking processes [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. One of the hard challenges of recommender
systems is to provide successful responses to user queries, especially
when little information is available. In most RS approaches,
algebraic operations with user-item rating matrices allow predicting
the future likeness of new items for a user (e.g., using collaborative
ifltering, content-based, or hybrid approaches). However, when the
suitability of the suggested items depends on diferent features such
as the location of items and users, textual descriptions of items, or
the (sometimes blurry) query description, those approaches face
new problems to address. For example, for the recommendation of
points of interest (POIs), the location of the items and the user, as
well as other context attributes, may play a key role [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        The idea of Collective Spatial Keyword Querying (CoSKQ)
emerged some years ago as a promising technique to query spatial
databases containing information about items and their location [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
It puts forward a smart solution to retrieve a group of spatial items
such that the description of the items included in that set (typically
based on the use of keywords) is completely covered by the query’s
keywords and assures that the items are as near as possible to the
query location and have the lowest inter-item distances.
∗All authors contributed equally to this research.
      </p>
      <p>We believe that exploiting spatial keyword querying as a basis
to build recommender systems is an interesting research avenue
to explore. Therefore, combining both fields of research, in this
position paper we present the idea of Re-CoSKQ, a recommender
system that uses CoSKQ to provide a set of items that semantically
covers the keywords of a query (even if they do not match perfectly)
and minimizes the cost, in terms of the distance to get to them and
the similarity between query keywords and item descriptions.</p>
      <p>As a problem statement, let us consider a set U = {u1, ..., un } of
users spending their time in a city as tourists. Let O = {o1, ..., om }
be a set of POIs, i.e., spots with some kind of relevant attraction for
visitors. Examples of POIs could be museums, monuments, parks,
or buildings with some historical flavour, just to mention a few.
Now, let oi .κ = {k1, ..., kj } be a set of keywords with which a
POI oi ∈ O is described. These keywords can usually be retrieved
in an automated way by using semantically-annotated resources.
Moreover, every POI oi ∈ O is placed in a location denoted by oi .λ.</p>
      <p>Re-CoSKQ uses collective spatial keyword querying in order to
cope with the location of POIs and users and also with the similarity
between the keywords in the user’s query and the description of
the POIs. Let q = ⟨λ, κ⟩ be a user’s query, where q.λ represents
the user’s location and q.κ stands for the query split in keywords
(only relevant words for the search are taken into account). The
main goal is to provide a method to return a set of items O′ ⊆ O
which semantically covers the keywords in q.κ and also ensures
that their cost, in terms of distance –between the POIs and the user
who issued the query– and the similarity of terms, is minimal.</p>
      <p>The next sections intend to shed some light into the problem and
present the approach we have envisioned to deal with it. Specifically,
the rest of the paper is structured as follows. First, Section 2 we
revise the concept of CoSKQ. Then, in Section 3, we present the
Re-CoSKQ approach. In Section 4, we sketch an evaluation proposal.
Finally, in Section 5, we conclude with a summary and some future
work.
2</p>
    </sec>
    <sec id="sec-3">
      <title>BACKGROUND: CoSKQ</title>
      <p>
        As we have previously stated, CoSKQ attempts to find the solution
to the problem of retrieving a group of spatial objects that
collectively match the user preferences given specific locations (of the
user and also of the objects) and a set of keywords. The method is
designed to work with spatial databases, so it does much efort on
providing an eficient computation, in terms of the data structure
used and how data are accessed [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ]. Although going in depth on
the subtle considerations of the method is out of the scope of this
paper, we summarize how it works applied to our domain.
      </p>
      <p>
        It uses the concept of IR-tree data structures [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] to eficiently
store information about POIs. This type of structure allows indexing
objects and the keywords which describe them as well as their
spatial position. IR-trees are a type of balanced trees in which each
leaf node contains an item o (a POI object), a bounding rectangle of o
and an item identifier, while each non-leaf node in the tree contains
a pointer to a child node, a Minimum Bounding Rectangle (MBR)
of all rectangles in entries of the child node, and an item identifier
containing the set of all keywords in the entries of the child node.
Moreover, each leaf node contains a pointer to an inverted file with
the keywords that describe the POIs stored in that node. Figure 1
depicts an example for which CoSKQ may ofer a solution with a
query q and a set of POIs {o1, ..., o10}. Figures 2 and 3 show how
the data are geographically partitioned and stored in an IR-tree.
o1 o2
o6
o8
q
o4
o3
o9
o5
o7
o10
      </p>
      <p>
        CoSKQ presents diferent algorithmic solutions based on
minimizing a cost function. The chosen cost function may vary
depending on the authors of each specific proposal and the scenario
where it is applied. Diferent cost functions, taking into account
the distances between items and query locations, can be found in
[
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ]. It has been proved that solving a spatial group keyword query
is an NP-complete problem [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], i.e., the performance of an exact
algorithm does not present itself as a reasonable solution, in terms
of running time and I/O cost [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. For that reason, some
approximation algorithms have been developed to calculate the output sets
of objects [
        <xref ref-type="bibr" rid="ref12 ref2 ref3 ref7">2, 3, 7, 12</xref>
        ]. Besides, in special cases, the application of
an exact algorithm may be plausible, especially when the number
of keywords in the query is small. Some exact algorithms, based
on dynamic programming for minimizing the cost function are
presented in [
        <xref ref-type="bibr" rid="ref2 ref3 ref7">2, 3, 7</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>3 Re-CoSKQ APPROACH</title>
      <p>
        We present Re-CoSKQ as an instantiation of the CoSKQ problem,
especially designed for recommendations in the tourism domain
(i.e., the user is a tourist and the items are points of interest that the
user may want to visit). The most common instantiation of CoSKQ
assumes that the set of keywords describing the POIs in the query
result must contain, at least, all the keywords contained in the
query [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Formally, q.κ ⊆ ∪oi′ ∈O′ oi′.κ, where O′ is the set of POIs
calculated as a result of a user issuing the query q; for simplicity,
from now on, we will use o ∈ O′ to avoid oi′. However, there
are scenarios in which this assumption must hold some more hard
constraints. For instance, when tackling a recommendation problem,
we need to ensure not only that the keyword query is covered by
the resulting O′ but also that both the maximum distance between
the query location and any of the POIs in O′ and the maximum
distance between any two POIs in O′ are minimized.
      </p>
      <p>Moreover, in this paper, we do not assume that q.κ can be fully
covered. Actually, we claim that this assumption may derive in
empty sets in many recommendation scenarios where queries are
expressed, for instance, with diferent vocabularies, or where they
cannot be easily solved with the given descriptions of POIs. Thus,
we believe that it is important to provide query outcomes even
when full keyword coverage is not possible. In order to do that, we
propose to use a similarity function to calculate how similar the
keywords in q.κ are compared to those in ∪o ∈O′ . For example, given
q.κ = {outdoors, animals, kids }, if located nearby, one of the POIs
included in the outcome could be a zoo, which could be described by
a set of keywords {open-air, birds, snakes, mammals, f amily}. This
object would never be returned using a classic CoSKQ approach,
but considering the semantic similarity between keywords one can
easily observe that the terms are related, since birds, snakes and
mammals are types of animals, outdoors and open-air are synonyms
and kids are part of families. We will present how to cope with this
when presenting diferent cost functions.</p>
    </sec>
    <sec id="sec-5">
      <title>3.1 Cost Analysis</title>
      <p>
        Re-CoSKQ attempts to minimize the cost of finding an appropriate
set of POIs for a given query q. This cost is modelled as a function
that depends on distances between the query and the locations of
POIs as well as between the keywords. Diferent equations have
been proposed to model cost in the CoSKQ problem [
        <xref ref-type="bibr" rid="ref1 ref10 ref2">1, 2, 10</xref>
        ]. In the
following, we redefine some of them for the Re-CoSKQ problem.
      </p>
      <p>TYPE 1. A linear combination of the maximum distance
between the query location and any POI in O′, the maximum pairwise
distance between any two POIs in O′, and the maximum of the
semantic distance between the query keywords (q.κ) and the set of
(1)
(2)
(3)
(4)
cost (q, O′) = α · om∈aOx′ [dist (q .λ, o .λ)] + β · o1m,oa2∈xO′ [dist (o1, o2)]
+ ω · k1∈q .κ,km2a∈x∪o∈O′ o.κ [dist (k1, k2)]
where α + β + ω = 1 are weights to denote the relevance of each
of the three types of distances involved, which allow adding up
distances which may have diferent ranges of values.</p>
      <p>TYPE 2. This type of function defines cost as the maximum
of the three factors in the TYPE 1 function; i.e., the highest value
between the maximum distance among the query location and
any POI in O′, the maximum pairwise distance between any two
POIs in O′, and the maximum of the semantic distance between
query keywords (q.κ) and the set of keywords in ∪o ∈O′o.κ. This is
formally defined by Eq. 2, where again weights α , β and ω are used.
cost (q, O′) = max α · om∈aOx′ [dist (q .λ, o .λ)] , β · o1m,oa2∈xO′ [dist (o1, o2)] ,
ω · k1∈q .κ,km2a∈x∪o∈O′ o.κ [dist (k1, k2)]</p>
      <p>TYPE 3. This function uses a min-max approach, linearly
combining the minimum distance between the query location and any
POI with the maximum values for pairwise distance between any
two POIs in O′ and the semantic distance between query keywords
(q.κ) and the set of keywords in O′, i.e., ∪o ∈O′o.κ (see Eq. 3).
cost (q, O′) = α · om∈iOn′ [dist (q .λ, o .λ)] + β · o1m,oa2∈xO′ [dist (o1, o2)]
+ ω · k1∈q .κ,km2a∈x∪o∈O′ o.κ [dist (k1, k2)]
again with α + β + ω = 1.</p>
      <p>
        TYPE 4. This is a unified cost function, adapted from [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], that
generalizes types 1 to 3 in one function. It is presented in Eq. 4.
cost (q, O′) =" α · Õ (dist (q .λ, o .λ))ϕ1 ϕ11 ϕ2
o∈O′
      </p>
      <p>ϕ2
+ β · o1m,oa2∈xO′ dist (o1, o2)
+ ω ·</p>
      <p>max
k1∈q .κ,k2∈∪o∈O′ o.κ
dist (k1, k2)
ϕ2 # ϕ12
with α + β + ω = 1, ϕ1 ∈ {−∞, 1, ∞} and ϕ2 ∈ {1, ∞} . The ϕ1
and ϕ2 values stand for tuning parameters, allowing to describe
the previous cost functions (types 1-3) by varying their values. For
example, an instantiation with α, β, ω = 13 , ϕ1 = ∞ and ϕ2 = 1
results in a Type 1 cost function with the weights α , β , and ω
indicated:
cost (q, O′) = 13 max Õ (dist (q .λ, o .λ))+</p>
      <p>o∈O′
+</p>
      <p>max
o1,o2∈O′
dist (o1, o2) +</p>
      <p>max
k1∈q .κ,k2∈∪o∈O′ o.κ
dist (k1, k2)</p>
    </sec>
    <sec id="sec-6">
      <title>3.2 Distance Analysis</title>
      <p>As we have pointed out, there exist diferent distance functions
needed to calculate the cost in Re-CoSKQ. Analyzing any of the
proposed cost functions, we can observe that there are three diferent
distance instantiations, as we explain in the following.</p>
      <p>Location distance. (dist (q.λ, o.λ)) refers to the physical
distance between the query location and a POI’s location. It can be
calculated with diferent geometrical approaches. In the following,
we point out some possible functions.</p>
      <p>Euclidean distance. It is probably the most common distance
function used in the literature for many diferent types of problems
and domains. It is formally defined by Eq. 5:
(5)
We assume that the position of queries and POIs are given by a pair
of coordinates ⟨lat, lonд⟩. This distance may work well when the
routes between POIs are roughly calculated or the users can walk
straight from any location to another.</p>
      <p>L1-Norm. It is another well-known distance function, also known
as Manhattan distance. It calculates the sum of the magnitudes of
the vectors in a space, i.e., the sum of absolute diference of the
components of the vectors (see Eq. 6).</p>
      <p>n
dist (q .λ, o .λ) = Õ |q .λi − o .λi | (6)
i=1
We use 2-dimension spaces, denoted by location coordinates. This
distance may be suitable for grid-based scenarios, e.g., POIs in a city
connected by roads/paths, or halls in a museum linked by corridors.</p>
      <p>Geodesic distance. It is the type of function we need if we use a
graph to model how POIs and users are connected. The geodesic
distance is defined as the shortest path between two vertices in a
graph. This is useful when modeling a scenario with weighted edges,
since some extra information can be added (e.g., about congested
routes or crowded halls). Many algorithms can be used to calculate
shortest paths in graphs (e.g., the Dijkstra’s algorithm).</p>
      <p>POI-to-POI distance. (dist (o1, o2)) could also be called
intraPOI distance, since it calculates the distance between two POIs. Note
again that the location of o ∈ O′ is denoted by o.λ. As we assume
a 2-dimension space in Re-CoSKQ, we can reduce the calculation
of this distance to the problem of calculating the location distance.
Thus, the same functions described above may apply to this case.</p>
      <p>Term distance. (dist (k1, k2)) is the distance we use to calculate
how similar two diferent keywords are. In this case, we compare
the query keywords (q.κ) and the keywords in ∪o ∈O′ o.κ. In the
cost function, we try to minimize the maximum distance between
the q.κ set and o.κ in a pairwise basis. In order to calculate the
similarity between keywords, we adhere to ontology-based measures,
typically used in semantic web approaches. This type of measures
usually calculates the similarity according to structured knowledge
defined by an ontology. In the following, we propose some functions
that we consider to be suitable for the Re-CoSKQ problem; once the
similarity has been estimated, we should provide a way to calculate
the distance associated to it, such as dist (k1, k2) = 1 − sim(k1, k2).</p>
      <p>
        Similarity based on concept closeness. This measure takes into
account the closeness of the concepts in the hierarchical tree
representing the ontology. It is based on the relatedness property
presented in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and is defined as sim(k1, k2) = 1 − sp(2kD1,k2) , where
sp(·) is a function that returns the shortest path between the two
terms in the ontology tree and 2D denotes the maximum distance
between any two concepts in the ontology (D is the ontology depth).
      </p>
      <p>
        Similarity based on closeness and concept depth. This measure,
proposed in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], takes into account the closeness of keywords in
the ontology but also the depth in the ontology tree where they can
be found (see Eq. 7). It assumes that the semantics of concepts are
more general in higher levels. Thus, the higher we find the concept
in the ontology the lower the similarity while, on the contrary, the
lower we find the concepts the higher the similarity.
( e −α l e βh −e−βh
e βh +e−βh
1
i f
      </p>
      <p>k1 , k2
ot her wise
(7)
where l is the shortest path between k1 and k2 and h is the depth of
the least common subsumer of both concepts. Parameters α, β &gt; 0
are weights to modulate the contribution of these factors.</p>
    </sec>
    <sec id="sec-7">
      <title>3.3 Outline of Processing Issues for Re-CoSKQ</title>
      <p>
        Several algorithms address the problem of implementing CoSKQ.
CoSKQ is an NP-complete problem, so exact algorithms (e.g., the
linear programming approaches presented in [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ]) only make
sense when the number of query keywords is low. However, on
average conditions, an approximate algorithm is needed. Diferent
approaches using greedy techniques and pruning steps have been
presented to reduce the needed resources. Due to lack of space, we
omit further details and refer the reader to [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ] for further revision
on approximate algorithms for CoSKQ. Re-CoSKQ needs to tackle
an optimization problem to try to minimize the cost function.
      </p>
    </sec>
    <sec id="sec-8">
      <title>4 EVALUATION PROPOSAL</title>
      <p>
        Most works on CoSKQ focus their evaluation on measuring the
performance (in terms of running time) and approximation ratio.
Nevertheless, when applying this approach to recommender
systems we are not only interested in these issues, as the quality of
the recommendation is also key. An interesting problem is that
full coverage is assumed in classic CoSKQ; that is, ∪o ∈O′ o.κ is
assumed to contain, at least, all keywords in q.κ. This is not the
case of Re-CoSKQ, where the coverage is estimated by keyword
similarity. Moreover, the evaluation usually needs a ground truth to
compare with, in order to be able to calculate accuracy metrics such
as precision and recall. As far as we know, there is no dataset
annotated with this type of information. Thus, we propose to first define
a set of interesting and representative keyword queries and then
manually annotate a dataset containing POIs descriptions with the
keywords by assigning each POI to a set of predefined categories
(much smaller than the number of keywords) defined based on the
queries that have been selected for evaluation, in order to define a
dataset with information that can represent a suitable ground truth
to compare with. Precision and recall may be calculated by
comparing the retrieved POIs according to the categories specified by
the user in the query. Regarding the items, there are many datasets
that contain information about geographic locations and keyword
descriptions; a tailored synthetic dataset could also be generated
by using DataGenCARS [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. All this could be complemented with a
user-centered evaluation.
      </p>
      <p>The main idea in the empirical evaluation is to show the benefits
of the proposal and test how diferent cost functions behave, tuning
diferent parameters. We are also interested in the scalability of the
proposal, so tests with diferent numbers of query keywords and
POIs (as well as simultaneous queries/users) should be carried out.
Moreover, in order to check the feasibility concerning the use of
resources, we will use exact and approximate algorithms to test
their performance (running time and approximation ratio).</p>
    </sec>
    <sec id="sec-9">
      <title>5 CONCLUSIONS AND FUTURE WORK</title>
      <p>In this position paper, we have presented the idea of Re-CoSKQ, a
collective spatial keyword query approach for recommender
systems, where keyword coverage is not assumed, by considering
keyword similarity. We have tackled the problem as a minimization
problem, for which we have defined some cost functions.</p>
      <p>We are currently working on an empirical evaluation to test
the approach and its benefits over other POI recommendation
approaches. Furthermore, we would like to extend the approach to
group recommendation; that is, diferent users in diferent locations
will issue their queries and the opportunity of group visits (groups
of people visiting the same items together) will be explored, so the
problem becomes more complex, since O′ must contain suitable
POIs that satisfy all users (or at least a set of them). We are also
interested in dynamic environments where both the POIs and users
could potentially be on the move and context conditions can change
quickly over time. Finally, we also intend to consider other spatial
distance calculation approaches, such as heuristic searches (e.g., by
using A⋆ algorithms), as well as other approaches to compute term
distances (e.g., a word embedding approach such as word2vec).</p>
    </sec>
    <sec id="sec-10">
      <title>Acknowledgments</title>
      <p>Work supported by the project TIN2016-78011-C4-3-R (AEI/FEDER, UE) and
the Government of Aragon (Group Reference T35_17D, COSMOS group)
and co-funded with Feder 2014-2020 “Construyendo Europa desde Aragon”.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Xin</given-names>
            <surname>Cao</surname>
          </string-name>
          , Gao Cong, Tao Guo, Christian S Jensen, and Beng Chin Ooi.
          <year>2015</year>
          .
          <article-title>Eficient processing of spatial group keyword queries</article-title>
          .
          <source>ACM Transactions on Database Systems (TODS) 40</source>
          ,
          <issue>2</issue>
          (
          <year>2015</year>
          ),
          <volume>13</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          :
          <fpage>48</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Xin</given-names>
            <surname>Cao</surname>
          </string-name>
          , Gao Cong, Christian S Jensen, and Beng Chin Ooi.
          <year>2011</year>
          .
          <article-title>Collective spatial keyword querying</article-title>
          .
          <source>In 2011 ACM SIGMOD Int. Conference on Management of Data. ACM</source>
          ,
          <volume>373</volume>
          -
          <fpage>384</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Harry</given-names>
            <surname>Kai-Ho Chan</surname>
          </string-name>
          , Cheng Long, and
          <string-name>
            <surname>Raymond</surname>
            <given-names>Chi-Wing</given-names>
          </string-name>
          <string-name>
            <surname>Wong</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>On generalizing collective spatial keyword queries</article-title>
          .
          <source>IEEE Transactions on Knowledge and Data Engineering</source>
          <volume>30</volume>
          ,
          <issue>9</issue>
          (
          <year>2018</year>
          ),
          <fpage>1712</fpage>
          -
          <lpage>1726</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Gao</given-names>
            <surname>Cong</surname>
          </string-name>
          , Christian S Jensen, and
          <string-name>
            <given-names>Dingming</given-names>
            <surname>Wu</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Eficient retrieval of the top-k most relevant spatial web objects</article-title>
          .
          <source>Proceedings of the VLDB Endowment 2</source>
          ,
          <issue>1</issue>
          (
          <year>2009</year>
          ),
          <fpage>337</fpage>
          -
          <lpage>348</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>María del Carmen</surname>
          </string-name>
          Rodríguez-Hernández, Sergio Ilarri, Ramón Hermoso, and
          <string-name>
            <surname>Raquel</surname>
          </string-name>
          Trillo-Lado.
          <year>2017</year>
          .
          <article-title>DataGenCARS: A Generator of Synthetic Data for the Evaluation of Context-Aware Recommendation Systems</article-title>
          .
          <source>Pervasive and Mobile Computing 38, Part</source>
          <volume>2</volume>
          (
          <year>2017</year>
          ),
          <fpage>516</fpage>
          -
          <lpage>541</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>María del Carmen</surname>
            Rodríguez-Hernández, Sergio Ilarri, Raquel Trillo-Lado, and
            <given-names>Ramón</given-names>
          </string-name>
          <string-name>
            <surname>Hermoso</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Location-Aware Recommendation Systems: Where We Are and Where We Recommend to Go</article-title>
          .
          <source>In Int. Workshop on Location-Aware Recommendations (LocalRec)</source>
          , Vol.
          <volume>1405</volume>
          . CEUR Workshop Proceedings, 1-
          <fpage>8</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Yunjun</given-names>
            <surname>Gao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Jingwen</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Baihua</given-names>
            <surname>Zheng</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Gang</given-names>
            <surname>Chen</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Eficient collective spatial keyword query processing on road networks</article-title>
          .
          <source>IEEE Transactions on Intelligent Transportation Systems</source>
          <volume>17</volume>
          ,
          <issue>2</issue>
          (
          <year>2015</year>
          ),
          <fpage>469</fpage>
          -
          <lpage>480</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Claudia</given-names>
            <surname>Leacock</surname>
          </string-name>
          and
          <string-name>
            <given-names>Martin</given-names>
            <surname>Chodorow</surname>
          </string-name>
          .
          <year>1998</year>
          .
          <article-title>Combining local context and WordNet similarity for word sense identification</article-title>
          .
          <source>WordNet: An electronic lexical database 49</source>
          ,
          <issue>2</issue>
          (
          <year>1998</year>
          ),
          <fpage>265</fpage>
          -
          <lpage>283</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Yuhua</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <article-title>Zuhair A Bandar,</article-title>
          and
          <string-name>
            <surname>David McLean</surname>
          </string-name>
          .
          <year>2003</year>
          .
          <article-title>An approach for measuring semantic similarity between words using multiple information sources</article-title>
          .
          <source>IEEE Transactions on Knowledge and Data Engineering</source>
          <volume>15</volume>
          ,
          <issue>4</issue>
          (
          <year>2003</year>
          ),
          <fpage>871</fpage>
          -
          <lpage>882</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Cheng</surname>
            <given-names>Long</given-names>
          </string-name>
          , Raymond
          <string-name>
            <surname>Chi-Wing</surname>
            <given-names>Wong</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Ke</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <surname>Ada</surname>
            <given-names>Wai-Chee</given-names>
          </string-name>
          <string-name>
            <surname>Fu</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Collective spatial keyword queries: a distance owner-driven approach</article-title>
          .
          <source>In 2013 ACM SIGMOD Int. Conference on Management of Data. ACM</source>
          ,
          <volume>689</volume>
          -
          <fpage>700</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Francesco</surname>
            <given-names>Ricci</given-names>
          </string-name>
          , Lior Rokach, and
          <string-name>
            <given-names>Bracha</given-names>
            <surname>Shapira</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Introduction to Recommender Systems Handbook</article-title>
          .
          <source>In Recommender Systems Handbook</source>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Pengfei</surname>
            <given-names>Zhang</given-names>
          </string-name>
          , Huaizhong Lin, Bin
          <string-name>
            <surname>Yao</surname>
            , and
            <given-names>Dongming</given-names>
          </string-name>
          <string-name>
            <surname>Lu</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Level-aware collective spatial keyword queries</article-title>
          .
          <source>Information Sciences</source>
          <volume>378</volume>
          (
          <year>2017</year>
          ),
          <fpage>194</fpage>
          -
          <lpage>214</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>