<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Workshops, Los Angeles, USA, March</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>User-relative Personalized Tour Recommendation</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Prarthana Padia∗</string-name>
          <email>ppadia@student.unimelb.edu.au</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bhavya Singhal∗</string-name>
          <email>singhalb@student.unimelb.edu.au</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kwan Hui Lim</string-name>
          <email>kwanhui_lim@sutd.edu.sg</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Information Systems Technology and, Design Pillar, Singapore University of Technology</institution>
          ,
          <addr-line>and Design</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Computing and Information</institution>
          ,
          <addr-line>Systems</addr-line>
          ,
          <institution>The University of Melbourne</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <volume>20</volume>
      <issue>2019</issue>
      <abstract>
        <p>Tour planning and recommendation is an important but tedious task for tourists visiting unfamiliar cities and places. While there are various personalized tour recommendation works, they typically adopt a simple measure of user interests based on the number of times a user has visited a place. In this paper, we propose an improved personalized tour recommendation system that considers a user's interest preferences in specific categories, relative to his/her overall interests. Using a Flickr dataset across eight cities, we compared our proposed algorithm against various baselines and experimental results show that our algorithm obtained superior performance in terms of user interest and popularity.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Information systems → Personalization; Recommender
systems; Location based services; Data mining; Web
applications.</p>
    </sec>
    <sec id="sec-2">
      <title>1 INTRODUCTION</title>
      <p>Tour planning is an important task for ensuring
satisfactory visits to unfamiliar cities and places. However, visitors
are faced with the challenge of identifying popular places
aligned with their personal interests. In addition, there is an
added complexity due to the need to schedule visits to all
∗Both authors contributed equally to this research.</p>
      <p>IUI Workshops’19, March 20, 2019, Los Angeles, USA
Copyright © 2019 for the individual papers by the papers’ authors. Copying
permitted for private and academic purposes. This volume is published and
copyrighted by its editors.
recommended places while considering the available tour
budget, time and cost.</p>
      <p>There is an abundance of information available on
Internet about travel guides and famous places, but they do not
consider the user’s personal interests and preferences nor
contemplate the trip’s constraints like time and cost. Despite
the availability of such online information, people may end
up spending excessive eforts and time to plan their itinerary,
and yet end up with an undesired itinerary thus leaving them
with an unsatisfactory and frustrating experience.</p>
      <p>In recent times, personalized tour recommendation
systems have benefited from the advancement in web
technologies and geo-location services. The large amount of online
available geo-tagged photos facilitate the modelling of user
interest, preferences and trip constraints while strategizing
itinerary planning. While many works consider user interest,
they adopt a simple measure based on the number of times
a user has visited a place.</p>
    </sec>
    <sec id="sec-3">
      <title>Contributions</title>
      <p>Unlike earlier works that adopt a simplistic definition of user
interest based on visit counts, this paper proposes a tour
recommendation system that utilizes a novel user-relative
measure of interest preferences build upon the Orienteering
problem.</p>
      <p>We propose two variation of user-specific interest
preferences. The first approach aims to recommend an itinerary
with no prior knowledge about the user by taking
advantage of the large collection of geo tagged photos available
online. Based on photo frequencies of each POI by all users,
it determines the popularity of each POI and suggests the
itinerary based on most popular POIs. The second approach
aims to improve upon the targeted personalization level for
each user. The benefits of this approach include having a
tour itinerary that is customized for each user and caters to
the user’s categories of interest. For example, in a city full
of many tourist attractions, this approach caters to specific
category the user is interested in. For example, if a user has
shown to prefer outdoors and beaches more than museums
and multiplexes, then the recommendation system takes that
into account while building the itinerary.
2</p>
    </sec>
    <sec id="sec-4">
      <title>RELATED WORK</title>
    </sec>
    <sec id="sec-5">
      <title>Orienteering problem overview</title>
      <p>
        Orienteering problem is a routing problem which can be
viewed as a contest with multiple nodes, where each node
has some specific score. The goal of the contest is to
maximize the total score which is gathered by visiting diferent
nodes. The contest is time constrained, which needs a
strategical plan to choose a subset of nodes visit in sequence, to
maximize collected budget within given time and budget [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ].
For a detailed review of Orienteering problem, [
        <xref ref-type="bibr" rid="ref13 ref23 ref25">13, 23, 25</xref>
        ]
reviews orienteering problem and its applications, discusses
and compares published approaches and heuristics of
Orienteering problem.
      </p>
    </sec>
    <sec id="sec-6">
      <title>Tour recommendation variants</title>
      <p>
        Tour recommendation is a well-studied field that typically
focus on maximizing user preferences within the given trip
constraints [
        <xref ref-type="bibr" rid="ref14 ref15 ref17 ref19 ref6">6, 14, 15, 17, 19</xref>
        ]. For example, [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] proposed a
POI recommender system based on ofline modelling (user
preferences learnt from her location history) and online
recommendation (social opinions learnt from location history
of ‘local experts’). [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] modelled tour recommendation as an
instance of the Generalized Maximum coverage problem.
Building on the same, [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] suggested a solution by exploiting
an instance of Traveling Salesman Problem (TSP). Others
modelled the tour recommendation problem as an instance
of the Orienteering problem [
        <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
        ], and various variations
based on specific POI visit sequences [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and POI category
constraints [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. A unique method of using POIs and route
information as features to a machine learning algorithm
to recommend probable tour routes was proposed by [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
Various works also considered real life constraints like POI
availability and travelling time uncertainty [
        <xref ref-type="bibr" rid="ref29 ref30">29, 30</xref>
        ],
queuing time awareness [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], visit duration and recency [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ],
pedestrian crowdedness [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ], transport costs [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Similarly,
various web and mobile applications have been developed
for tour recommendation purposes [
        <xref ref-type="bibr" rid="ref20 ref24 ref27 ref4 ref7">4, 7, 20, 24, 27</xref>
        ].
      </p>
      <p>
        Diferences with earlier work . Our proposed work
differs from these earlier works in several aspects. We
automatically derive a measure of user-based interest from the
user’s photo frequency at POIs of a specific category,
relative to: (i) The average photo frequencies of other users
at that POI; and (ii) The average photo frequency of that
user at all POIs. In contrast, these earlier works either use
time-based user interest, frequency-based user interest or
explicitly mentioned user interest preferences. In addition,
we improve upon the targeted personalization level for each
user by recommending customized itineraries that cater to
the user interest categories.
Problem Formulation. Similar to many earlier works [
        <xref ref-type="bibr" rid="ref18 ref21">18,
21</xref>
        ], we model our recommendation problem based on a
variant of the Orienteering problem [
        <xref ref-type="bibr" rid="ref13 ref23 ref25">13, 23, 25</xref>
        ]. In this tour
recommendation problem, our main objective is to
recommend a tour itinerary I = (p1, ..., pN ) that maximizes the
total profit from visiting the list of POIs p1 to PN , while
ensuring that the tour itinerary can be completed within a
specific time budget B. Given a set of POIs P , we optimize
for:
      </p>
      <p>Max Õ Õ
pi ∈P pj ∈P</p>
      <sec id="sec-6-1">
        <title>Pathpi ,pj ηIntu (pi ) + (1 − η)Pop(pi )</title>
        <p>(1)
where Pathpi ,pj = 1 if a path between POI pi and pj is
selected as part of the itinerary, and Pathpi ,pj = 0 otherwise.
Intu (pi ) represents a user-specific interest score of how
interesting POI pi is to user u, while Pop(pi ) indicates the general
popularity of POI pi . In addition, Equation 1 is subjected to
the following constraints: (i) starting and ending at specific
POIs; (ii) connectivity of POIs in the itinerary; (iii)
completing the itinerary within a specific time or distance budget
B.</p>
        <p>In addition, Equation 1 is subjected to the following
constraints:</p>
        <p>Pathps ,pi =</p>
        <p>Pathpj ,pd = 1</p>
        <p>Constraint 2 ensures that the recommended itinerary starts
at a specific POI ps , and ends at another specific POI pd . In
real-life, this starting and destination POIs would correspond
to POIs near the hotel that a tourist is staying at.</p>
        <p>Pathpi ,pk =</p>
      </sec>
      <sec id="sec-6-2">
        <title>Pathpk ,pj ≤ 1</title>
        <p>Constraint 3 ensures that the recommended itinerary
fuliflls two conditions, namely: (i) all selected paths are
connected as a full itinerary; and (ii) no POIs are visited more
than once.</p>
        <p>Õ Õ
pi ∈I pj ∈I</p>
      </sec>
      <sec id="sec-6-3">
        <title>Cost (pi , pj )Pathpi ,pj ≤ B</title>
        <p>Constraint 4 ensures that the recommended itinerary can
be completed within a specific time or distance budget B.</p>
        <p>Algorithms and Baselines. We developed an Integer
program to solve the problem defined in Section 3, along
with novel approaches to defining user interest preferences.
The two proposed approaches based on photo frequency are
as follows:</p>
        <p>(2)
(3)
(4)
(i) POI based Photo frequency (P FP ): Given a set of travel
history of all users U , the system determines the
popularity of the POI using average photo frequency at
each POI.
(ii) User based photo frequency (P FU ): Given a set of travel
history of a user u, the system determines the
popularity of that category of POI for the user using average
photos taken by that user at that category of the POI.</p>
        <p>In a city, there can be multiple categories of places
comprising of multiple POIS. Consider m POIs for a particular
city. Let P = {p1, .., pm } be the set of POIs in that city. Each
POI p has a category Catp (e.g., church, park, beach) and
latitude/longitude coordinates associated with it. The
popularity function Pop(p) that indicates the popularity of a POI
p, based on the average frequency of photos clicked at that
POI. We now introduce the key notations and definitions
used in this work.</p>
        <p>Definition 1: Travel History.</p>
        <p>(1) P FP : Given a user u who has visited n POIs, the travel
history is modelled as an ordered sequence, Sph =
((p1, f php1), (p2, f php2)...), with each duplet (px , f phpx )
comprising the visited POI px , and number of photos
at POI px .
(2) P FU : Given a POI p visited by n users, the travel record
of POI p is modelled as an ordered sequence, Sph =
((u1, f phu1 ), (u2, f phu2 )...), with each duplet (ux , f phux )
comprising the user ux , and number of photos taken
by ux .</p>
        <p>Definition 2: Average POI Photo Frequency.</p>
        <p>(1) P FP : Given a set of travel history of all users U , the
system determines the popularity of the POI using
average photo frequency at each POI.</p>
        <p>1 Õ
ph(p) = n
where n is the number of photos taken by user u at all
POIs P and δ (ux = u) = 1, if ux = u and 0, otherwise.</p>
        <p>
          In tour recommendation problems, the user interest
preferences are typically derived from POI visit frequency [
          <xref ref-type="bibr" rid="ref16 ref3 ref5 ref8">3, 5,
8, 16</xref>
          ]. In contrast, we consider a user’s POI visit frequency
(7)
(8)
(1) P FP :
        </p>
        <p>Intuf ph (c) =
(2) P FU :</p>
        <p>Intuf ph (c) =
relative to the average visit frequency for a better
personalization.</p>
        <p>Definition 3: Photo Frequency based User Interest.</p>
        <p>As described earlier, the category of a POI p is denoted as
Catp . Given that C represents the set of all POI categories,
the interest of a user u in POI category c is determined as
follows:</p>
        <p>Õ (f phpx )δ (Catpx = C) ∀c ∈ C
px ∈Sph ph(px )
where δ (Catpx = C) = 1, if Catpx = C and 0, otherwise.</p>
        <p>Õ (f phux )δ (Catp = C) ∀c ∈ C
ux ∈Sph ,p ∈P ph(ux )
where δ (Catp = C) = 1, if Catp = C and 0, otherwise.</p>
        <p>Briefly, the above equations model the interest of a user in
a particular POI category c based on photo frequency at each
POI of category c, relative to the average photo frequency
(of all users and a single user) at the same POI. The reason
is that a user is likely to click more photos of the POI that
he/she is interested in.</p>
        <p>Hence, firstly by calculating how many more (or less)
photos a user has taken, the interest level of this user in POIs
of this category can be determined. Secondly, by calculating
how many more (or less) photos have been taken by all users,
the overall interest level of all users in POIs of this category
can be determined.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>4 EXPERIMENT METHODOLOGY</title>
      <p>
        Dataset. For our experiments, we utilized the Yahoo! Flickr
Creative Commons 100M dataset [
        <xref ref-type="bibr" rid="ref22 ref28">22, 28</xref>
        ], focusing on a
dataset of 814k geo-tagged photos across eight cities
including Toronto, Osaka, Glasglow, Budapest, Perth, Vienna,
Delhi and Edinburgh. As provided in [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], these geotagged
photos were mapped to a list of POIs based on their
respective Wikipedia entries, i.e., proximity of geo-tagged
photos to Wikipedia entries of POIs based on their
latitude/longitude coordinates. Similarly, the categories of POIs
are based on their respective Wikipedia entries. The dataset
also comprises information like the geo-location coordinates,
date/timestamp of the photos taken. To ensure accuracy and
generalizability of results, only photos with the highest
geolocation accuracy have been chosen.
      </p>
      <p>Evaluation and Metrics. We evaluated our algorithm
and the baselines using leave-one-out cross-validation, which
involves evaluating a specific travel sequence of a user while
using his/her other travel sequences as training data. The
and PT − 1PU ).
starting/ending POI and travel duration are set to that of the
specific travel sequence being evaluated, which is used as
a representation of a person’s real-life visit. The following
evaluation metrics were used:
(1) Tour Popularity: Tpop (I ). The total popularity of all</p>
      <p>POIs in itinerary I.
(2) Tour Interest: T u I . The total interest of all POIs</p>
      <p>I nt ( )
in itinerary I to user u.
(3) Tour Precision: Tp (I ). The proportion of POIs
recommended in itinerary I, which matched user’s real-life
travel sequence.
(4) Tour Recall: Tr (I ). The proportion of POIs in a user’s
actual travel sequence that were also recommended in
itinerary I.</p>
      <p>Algorithm
PT − .5PU
PT − 1PU
PT − .5PA
PT − 1PA
PT − .5T
PT − 1T
Algorithm
PT − .5PU
PT − 1PU
PT − .5PA
PT − 1PA
PT − .5T
PT − 1T
Algorithm
PT − .5PU
PT − 1PU
PT − .5PA
PT − 1PA
PT − .5T
PT − 1T
Algorithm
PT − .5PU
PT − 1PU
PT − .5PA
PT − 1PA
PT − .5T
PT − 1T</p>
      <p>Popularity
(5) Tour F1−score: TF1 (I ). The harmonic mean of both
the recall and precision of a recommended tour itinerary
I.
5</p>
    </sec>
    <sec id="sec-8">
      <title>RESULTS AND DISCUSSION</title>
      <p>Table 1 show the comparison between Time-based User
Interest (PT − .5T and PT − 1T ), Photo Frequency-based User
Interest with respect to all users (PT − .5PA and PT − 1PA)
and Photo Frequency-based User Interest with respect to
single user (PT − .5PU and PT − 1PU ). Overall results show
that our Photo Frequency-based algorithms outperform the
baselines in terms of popularity and interest, while ofering
comparable performance in terms of other metrics.
Comparison of Popularity and Interest. In terms of
Interest (Tint ) metric, the proposed algortihms outperform
the baselines in all the cities, with PT − 1PA being the best
performing algorithm, followed by PT − 1PU . In terms of
Popularity (Tpop ) metric, PT − .5PU performs equally good
as the baseline PT − .5T . In four cities PT − .5PU performs
the best and in other four PT − .5T . The results show that
the Photo Frequency-based algorithms reflects on the overall
popularity and overall interests of the POIs better than the
baselines, for recommending itineraries.</p>
      <p>Comparison between Time based and Photo-Frequency
based User Interest. With regards to precision (Tp ), recall
(Tr ) and f1-score (TF1 ) the proposed algorithms outperform
one of the baselines (PT − 1T ) in all the cities, standing the
second best. In terms of Tp , PT − .5PU performs the second
best in five cities, followed by PT − .5PA performing the
second best in one city. In terms of Tr , PT − .5PU performs the
second best in four cities and PT − .5PA performs the second
best in rest four. Here, PT − .5PU and PT − .5PA perform
equally good. These two proposed algorithms outperform
the baseline (PT − 1T ) with regards to recall. In concern to
the F1-score TF1 metric, the proposed algorithm PT − 1PA
performs the best on one city, PT − .5PU performs the
second best in five cities, followed by PT − .5PA performing the
second best in two cities. The results show that the proposed
algorithms outperforms the baselines in most cities in terms
of popularity and interest. The algorithms (PT − .5PU and
PT − .5PA) outperform one baseline, performing second best
in terms of precision, recall and f1-score.</p>
    </sec>
    <sec id="sec-9">
      <title>6 CONCLUSION AND FUTURE WORK</title>
      <p>We modelled our tour recommendation problem as an
instance of the Orienteering problem and proposed two
algorithms for recommending personalized tours. We
recommend suitable POIs using both photo frequency user interest
preference and POI popularity. We used geo-tagged photos
to determine the photo frequency of the user and
automatically derive user interest and POI popularity to train the
algorithms. Our work improves upon the previous research
in following ways: (i) We introduce photo frequency based
user interest derived from the number of photos taken by
the user at a POI of a specific category, unlike earlier works
which consider time-based or frequency-based user interest;
and (ii) We improve upon the targeted personalization level
for each user by recommending customized itineraries that
cater to the user interest preferences learnt from the user
photo frequency dataset. Using Flickr dataset across eight
cities, we evaluate our algorithms in terms of precision,
recall, F1-score, tour popularity and interest. The results show
that: (i) Using photo-frequency based user interest
outperform the baselines in all cities in terms of interest. It is at
par with the baselines in terms of tour popularity by sharing
equal stand; and (ii) The proposed algorithms outperform
one of the baseline algorithms of time-based user interest in
terms of overall precision, recall and F1-score.</p>
      <p>In this work, our focus was to recommend user-relative
personalized tour itineraries. Some possible future work
directions are: (i) Using sentiment awareness on content
obtained from location based social network tags to
combine sentiment analysis techniques with personalization
approaches and path planning algorithms for recommending
itineraries that consider user interest preferences and
sentiments; and (ii) Recommending tour itineraries by considering
the public transport arrival and departure time to facilitate
realistic tour planning and minimize public transport
waiting time. Moreover, real time uncertainty of public transport
could be modelled to improve the suitability.</p>
    </sec>
    <sec id="sec-10">
      <title>ACKNOWLEDGMENTS</title>
      <p>This research is partly supported by the Singapore University
of Technology and Design under grant SRG-ISTD-2018-140,
and Defence Science and Technology, Australia. The authors
thank Jefrey Chan, Aaron Harwood and the anonymous
reviewers for their useful comments on this work.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Jie</given-names>
            <surname>Bao</surname>
          </string-name>
          , Yu Zheng,
          <string-name>
            <given-names>and Mohamed F.</given-names>
            <surname>Mokbel</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Location-based and preference-aware recommendation using sparse geo-social networking data</article-title>
          .
          <source>In Proceedings of the 20th International Conference on Advances in Geographic Information Systems (SIGSPATIAL'12)</source>
          .
          <fpage>199</fpage>
          -
          <lpage>208</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Paolo</given-names>
            <surname>Bolzoni</surname>
          </string-name>
          , Sven Helmer, Kevin Wellenzohn, Johann Gamper, and
          <string-name>
            <given-names>Periklis</given-names>
            <surname>Andritsos</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Eficient itinerary planning with category constraints</article-title>
          .
          <source>In Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL'14)</source>
          .
          <fpage>203</fpage>
          -
          <lpage>212</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Igo</given-names>
            <surname>Brilhante</surname>
          </string-name>
          , Jose Antonio Macedo, Franco Maria Nardini, Rafaele Perego, and
          <string-name>
            <given-names>Chiara</given-names>
            <surname>Renso</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Where shall we go today? Planning touristic tours with TripBuilder</article-title>
          .
          <source>In Proceedings of the 22nd ACM International Conference on Information and Knowledge Management (CIKM'13)</source>
          .
          <fpage>757</fpage>
          -
          <lpage>762</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Igo</given-names>
            <surname>Brilhante</surname>
          </string-name>
          , Jose Antonio Macedo, Franco Maria Nardini, Rafaele Perego, and
          <string-name>
            <given-names>Chiara</given-names>
            <surname>Renso</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>TripBuilder: A Tool for Recommending Sightseeing Tours</article-title>
          .
          <source>In Proceedings of the 36th European Conference on Information Retrieval (ECIR'14)</source>
          .
          <fpage>771</fpage>
          -
          <lpage>774</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Igo</given-names>
            <surname>Ramalho</surname>
          </string-name>
          <string-name>
            <surname>Brilhante</surname>
          </string-name>
          , Jose Antonio Macedo, Franco Maria Nardini, Rafaele Perego, and
          <string-name>
            <given-names>Chiara</given-names>
            <surname>Renso</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>On planning sightseeing tours with TripBuilder</article-title>
          .
          <source>Information Processing &amp; Management</source>
          <volume>51</volume>
          ,
          <issue>2</issue>
          (
          <year>2015</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>15</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Chao</given-names>
            <surname>Chen</surname>
          </string-name>
          , Daqing Zhang, Bin Guo, Xiaojuan Ma, Gang Pan, and
          <string-name>
            <given-names>Zhaohui</given-names>
            <surname>Wu</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>TripPlanner: Personalized Trip Planning Leveraging Heterogeneous Crowdsourced Digital Footprints</article-title>
          .
          <source>IEEE Transactions on Intelligent Transportation Systems</source>
          <volume>16</volume>
          ,
          <issue>3</issue>
          (
          <year>2015</year>
          ),
          <fpage>1259</fpage>
          -
          <lpage>1273</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Dawei</given-names>
            <surname>Chen</surname>
          </string-name>
          , Dongwoo Kim, Lexing Xie, Minjeong Shin, Aditya Krishna Menon, Cheng Soon Ong, Iman Avazpour,
          <string-name>
            <given-names>and John</given-names>
            <surname>Grundy</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>PathRec: Visual Analysis of Travel Route Recommendations</article-title>
          .
          <source>In Proceedings of the Eleventh ACM Conference on Recommender Systems (RecSys'17)</source>
          .
          <fpage>364</fpage>
          -
          <lpage>365</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Dawei</given-names>
            <surname>Chen</surname>
          </string-name>
          , Cheng Soon Ong, and
          <string-name>
            <given-names>Lexing</given-names>
            <surname>Xie</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Learning Points and Routes to Recommend Trajectories</article-title>
          .
          <source>In Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM'16)</source>
          .
          <fpage>2227</fpage>
          -
          <lpage>2232</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Munmun</given-names>
            <surname>De Choudhury</surname>
          </string-name>
          , Moran Feldman,
          <source>Sihem Amer-Yahia</source>
          , Nadav Golbandi, Ronny Lempel, and
          <string-name>
            <given-names>Cong</given-names>
            <surname>Yu</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Automatic construction of travel itineraries using social breadcrumbs</article-title>
          .
          <source>In Proceedings of the 21st ACM Conference on Hypertext and Hypermedia (HT'10)</source>
          .
          <fpage>35</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Munmun De Choudhury</surname>
          </string-name>
          , Moran Feldman,
          <source>Sihem Amer-Yahia</source>
          , Nadav Golbandi, Ronny Lempel, and
          <string-name>
            <given-names>Cong</given-names>
            <surname>Yu</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Constructing travel itineraries from tagged geo-temporal breadcrumbs</article-title>
          .
          <source>In Proceedings of the 19th International Conference on World Wide Web (WWW'10)</source>
          .
          <fpage>1083</fpage>
          -
          <lpage>1084</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Cheng-Yao</surname>
            <given-names>Fu</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Min-Chun</surname>
            <given-names>Hu</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jui-Hsin</surname>
            <given-names>Lai</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Hsuan</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <surname>Ja-Ling Wu</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>TravelBuddy: Interactive Travel Route Recommendation with a Visual Scene Interface</article-title>
          .
          <source>In Proceedings of the 20th International Conference on Multimedia Modeling (MMM'14)</source>
          .
          <fpage>219</fpage>
          -
          <lpage>230</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Aristides</surname>
            <given-names>Gionis</given-names>
          </string-name>
          , Theodoros Lappas, Konstantinos Pelechrinis, and
          <string-name>
            <given-names>Evimaria</given-names>
            <surname>Terzi</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Customized tour recommendations in urban areas</article-title>
          .
          <source>In Proceedings of the 7th ACM International Conference on Web Search and Data Mining (WSDM'14)</source>
          .
          <fpage>313</fpage>
          -
          <lpage>322</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Aldy</surname>
            <given-names>Gunawan</given-names>
          </string-name>
          , Hoong Chuin Lau, and
          <string-name>
            <given-names>Pieter</given-names>
            <surname>Vansteenwegen</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Orienteering Problem: A survey of recent variants, solution approaches and applications</article-title>
          .
          <source>European Journal of Operational Research</source>
          <volume>255</volume>
          ,
          <issue>2</issue>
          (
          <year>2016</year>
          ),
          <fpage>315</fpage>
          -
          <lpage>332</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Takeshi</surname>
            <given-names>Kurashima</given-names>
          </string-name>
          , Tomoharu Iwata, Go Irie, and
          <string-name>
            <given-names>Ko</given-names>
            <surname>Fujimura</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Travel route recommendation using geotags in photo sharing sites</article-title>
          .
          <source>In Proceedings of the 19th ACM International Conference on Information and Knowledge Management (CIKM'10)</source>
          .
          <fpage>579</fpage>
          -
          <lpage>588</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Takeshi</surname>
            <given-names>Kurashima</given-names>
          </string-name>
          , Tomoharu Iwata, Go Irie, and
          <string-name>
            <given-names>Ko</given-names>
            <surname>Fujimura</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Travel route recommendation using geotagged photos</article-title>
          .
          <source>Knowledge and Information Systems</source>
          <volume>37</volume>
          ,
          <issue>1</issue>
          (
          <year>2013</year>
          ),
          <fpage>37</fpage>
          -
          <lpage>60</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>Kwan</given-names>
            <surname>Hui</surname>
          </string-name>
          <string-name>
            <surname>Lim</surname>
          </string-name>
          , Jefrey Chan,
          <string-name>
            <given-names>Shanika</given-names>
            <surname>Karunasekera</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Christopher</given-names>
            <surname>Leckie</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Personalized Itinerary Recommendation with Queuing Time Awareness</article-title>
          .
          <source>In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'17)</source>
          .
          <fpage>325</fpage>
          -
          <lpage>334</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>Kwan</given-names>
            <surname>Hui</surname>
          </string-name>
          <string-name>
            <surname>Lim</surname>
          </string-name>
          , Jefrey Chan,
          <string-name>
            <given-names>Shanika</given-names>
            <surname>Karunasekera</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Christopher</given-names>
            <surname>Leckie</surname>
          </string-name>
          . In Press. Tour Recommendation and
          <article-title>Trip Planning using Location-based Social Media: A Survey. Knowledge and Information Systems</article-title>
          (In Press).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>Kwan</given-names>
            <surname>Hui</surname>
          </string-name>
          <string-name>
            <surname>Lim</surname>
          </string-name>
          , Jefrey Chan,
          <string-name>
            <given-names>Christopher</given-names>
            <surname>Leckie</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Shanika</given-names>
            <surname>Karunasekera</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Personalized Trip Recommendation for Tourists based on User Interests, Points of Interest Visit Durations</article-title>
          and
          <string-name>
            <given-names>Visit</given-names>
            <surname>Recency</surname>
          </string-name>
          .
          <source>Knowledge and Information Systems</source>
          <volume>54</volume>
          ,
          <issue>2</issue>
          (
          <year>2018</year>
          ),
          <fpage>375</fpage>
          -
          <lpage>406</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Claudio</surname>
            <given-names>Lucchese</given-names>
          </string-name>
          , Rafaele Perego, Fabrizio Silvestri, Hossein Vahabi, and
          <string-name>
            <given-names>Rossano</given-names>
            <surname>Venturini</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>How random walks can help tourism</article-title>
          .
          <source>In Proceedings of the 34th European Conference on Information Retrieval (ECIR'12)</source>
          .
          <fpage>195</fpage>
          -
          <lpage>206</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Ioannis</surname>
            <given-names>Refanidis</given-names>
          </string-name>
          , Christos Emmanouilidis, Ilias Sakellariou, Anastasios Alexiadis,
          <string-name>
            <surname>Remous-Aris</surname>
            <given-names>Koutsiamanis</given-names>
          </string-name>
          , Konstantinos Agnantis, Aimilia Tasidou, Fotios Kokkoras, and
          <string-name>
            <surname>Pavlos</surname>
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Efraimidis</surname>
          </string-name>
          .
          <year>2014</year>
          . myVisitPlanner GR:
          <article-title>Personalized Itinerary Planning System for Tourism</article-title>
          .
          <source>In Proceedings of the 8th Hellenic Conference on Artificial Intelligence (SETN'14)</source>
          .
          <fpage>615</fpage>
          -
          <lpage>629</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Kendall</surname>
            <given-names>Taylor</given-names>
          </string-name>
          , Kwan Hui Lim, and
          <string-name>
            <given-names>Jefrey</given-names>
            <surname>Chan</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Travel Itinerary Recommendations with Must-see Points-of-Interest</article-title>
          .
          <source>In Proceedings of the 2018 Web Conference Companion (WWW'18)</source>
          .
          <fpage>1198</fpage>
          -
          <lpage>1205</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <surname>Bart</surname>
            <given-names>Thomee</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>David A.</given-names>
            <surname>Shamma</surname>
          </string-name>
          , Gerald Friedland, Benjamin Elizalde, Karl Ni, Douglas Poland, Damian Borth, and
          <string-name>
            <surname>Li-Jia Li</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>YFCC100M: The New Data in Multimedia Research</article-title>
          .
          <source>Commun. ACM 59</source>
          ,
          <issue>2</issue>
          (
          <year>2016</year>
          ),
          <fpage>64</fpage>
          -
          <lpage>73</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>Theodore</given-names>
            <surname>Tsiligirides</surname>
          </string-name>
          .
          <year>1984</year>
          .
          <article-title>Heuristic methods applied to Orienteering</article-title>
          .
          <source>Journal of the Operational Research Society</source>
          <volume>35</volume>
          ,
          <issue>9</issue>
          (
          <year>1984</year>
          ),
          <fpage>797</fpage>
          -
          <lpage>809</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>Pieter</surname>
            <given-names>Vansteenwegen</given-names>
          </string-name>
          , Wouter Soufriau, Greet Vanden Berghe, and Dirk Van Oudheusden.
          <year>2011</year>
          .
          <article-title>The city trip planner: An expert system for tourists</article-title>
          .
          <source>Expert Systems with Applications 38</source>
          ,
          <issue>6</issue>
          (
          <year>2011</year>
          ),
          <fpage>6540</fpage>
          -
          <lpage>6546</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Pieter</surname>
            <given-names>Vansteenwegen</given-names>
          </string-name>
          , Wouter Soufriau, and Dirk Van Oudheusden.
          <year>2011</year>
          .
          <article-title>The Orienteering problem: A survey</article-title>
          .
          <source>European Journal of Operational Research</source>
          <volume>209</volume>
          ,
          <issue>1</issue>
          (
          <year>2011</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Xiaoting</surname>
            <given-names>Wang</given-names>
          </string-name>
          , Christopher Leckie, Jefery Chan, Kwan Hui Lim, and
          <string-name>
            <given-names>Tharshan</given-names>
            <surname>Vaithianathan</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Improving Personalized Trip Recommendation to Avoid Crowds Using Pedestrian Sensor Data</article-title>
          .
          <source>In Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM'16)</source>
          .
          <fpage>25</fpage>
          -
          <lpage>34</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>Wolfgang</given-names>
            <surname>Wörndl</surname>
          </string-name>
          and
          <string-name>
            <given-names>Alexander</given-names>
            <surname>Hefele</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Generating Paths Through Discovered Places-of-Interests for City Trip Planning</article-title>
          .
          <source>In Information and Communication Technologies in Tourism</source>
          . Springer International Publishing,
          <volume>441</volume>
          -
          <fpage>453</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>Yahoo</surname>
          </string-name>
          ! Webscope.
          <year>2014</year>
          .
          <article-title>Yahoo! Flickr Creative Commons 100M Dataset (YFCC-100M)</article-title>
          . http://webscope.sandbox.yahoo.com/catalog.php?
          <source>datatype =i&amp;did=67.</source>
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <surname>Chenyi</surname>
            <given-names>Zhang</given-names>
          </string-name>
          , Hongwei Liang, and
          <string-name>
            <given-names>Ke</given-names>
            <surname>Wang</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Trip Recommendation Meets Real-World Constraints: POI Availability, Diversity, and Traveling Time Uncertainty</article-title>
          .
          <source>ACM Transactions on Information Systems 35</source>
          ,
          <issue>1</issue>
          (
          <year>2016</year>
          ),
          <fpage>5</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <surname>Chenyi</surname>
            <given-names>Zhang</given-names>
          </string-name>
          , Hongwei Liang,
          <string-name>
            <given-names>Ke</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Jianling</given-names>
            <surname>Sun</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Personalized Trip Recommendation with POI Availability and Uncertain Traveling Time</article-title>
          .
          <source>In Proceedings of the 24th ACM International Conference on Information and Knowledge Management (CIKM'15)</source>
          .
          <fpage>911</fpage>
          -
          <lpage>920</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>