<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Itinerary Recommendation for Cruises: User Study</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Diana Nurbakova∗</string-name>
          <email>diana.nurbakova@insa-lyon.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sylvie Calabretto</string-name>
          <email>sylvie.calabretto@insa-lyon.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Léa Laporte</string-name>
          <email>lea.laporte@insa-lyon.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jérôme Gensel</string-name>
          <email>jerome.gensel@univ-grenoble-alpes.fr</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>LIRIS - INSA Lyon</institution>
          ,
          <addr-line>20 avenue Albert Einstein, Villeurbanne 69621 cedex</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Université Grenoble Alpes</institution>
          ,
          <addr-line>CNRS, Grenoble INP, LIG, Grenoble F-38000</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2017</year>
      </pub-date>
      <fpage>31</fpage>
      <lpage>34</lpage>
      <abstract>
        <p>Vacations and leisure activities constitute an important part of human life. Nowadays, a lot of attention is paid to cruising, that is reported to be a favourite vacation choice for families with kids and for Millenials. Like other distributed events (events that gather multiple activities distributed in space and time under one umbrella) such as big festivals, conventions, conferences etc., cruises ofer a vast variety of simultaneous on-board activities for all ages and tastes. This results in a cruiser's information overload, in particular given a very limited availability of activities. Recommender systems appear as a desirable solution in such an environment. Due to the number of time constraints, it is more convenient to get a personalised itinerary of activities rather than a list of top-n. In this paper, we present a user study conducted in order to create a preliminary dataset that simulates users' attendance of a cruise and sheds the light on the activity selection behaviour. We discuss challenges faced by the itinerary recommendation and illustrate them with user study examples.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Information systems → Personalization;
recommendation of leisure activities, itinerary recommendation</p>
    </sec>
    <sec id="sec-2">
      <title>INTRODUCTION</title>
      <p>Nowadays, the field of leisure activities experiences a substantial
growth. In this context, a rising phenomenon we are witnessing is
distributed events that gather various activities under one umbrella.
They attract more and more attendees. Examples of such events are
cruises, festivals, big conferences, conventions, etc.</p>
      <p>Attendees of distributed events are overwhelmed with the
number of ongoing parallel activities and are looking for personalised
experience. Recommender systems appear as a natural solution in
such an environment. It is to note that given the density of
activities and their limited availability, participants are interested in a
personalised itinerary (a sequence of activities to undertake) rather
than in a list of top-n activities that may compete in terms of time.
∗D. Nurbakova held a doctoral fellowship from la Région Auvergne-Rhône-Alpes.</p>
      <p>In this work, we consider a case of a cruise. According to
FloridaCaribbean Cruise Association (F-CCA) [6], about 25.3M passengers
are expected to cruise globally in 2017, showing a 7% average annual
passenger growth rate over the last 30 years. Cruising has become a
preferred vacation choice for families, especially with kids, making
cruisers population younger and more diverse than non-cruisers.
FCCA reports [6] that cruising is the favourite choice of Millennials
and Generation X. Cruisers appreciate the opportunity to relax and
get away from it all, see and do new things. Cruise lines ofer a vast
variety of on-board activities, as well as in ports of call.</p>
      <p>In this paper, we focus on the itinerary recommendation and
present a user study based on a 7-night Disney Fantasy cruise. More
precisely, we aim at answering the following research questions.</p>
      <p>RQ1: What is itinerary recommendation and what makes it
challenging?</p>
      <p>RQ2: What are the characteristics of the data treated by itinerary
recommendation? Is there any dataset that could be used as is?</p>
      <p>The remainder of the paper is organised as follows. In Section 2
we define the itinerary recommendation problem and the challenges
it faces. Section 3 gives an overview of existing datasets, presents
our user study that simulates users’ attendance of a cruise and
discussion over conducted analysis. Section 4 concludes the paper.
2</p>
    </sec>
    <sec id="sec-3">
      <title>PROBLEM STATEMENT AND CHALLENGES</title>
      <p>In this paper, we aim at finding a personalised itinerary for a given
user that maximises his satisfaction and takes into account
spatiotemporal constraints. More precisely, given a set of activities with
their locations, descriptions, time windows of their availability,
duration, and a vector of categories, a set of users, and users’ history
(attendance) binary matrix, find a feasible sequence of activities (or
itinerary) that maximises the user’s satisfaction for every given user.
User’s satisfaction with respect to an itinerary is defined as the sum
of the user’s satisfaction scores regarding all the activities within
the itinerary. For more details on the itinerary recommendation
problem, see [9].</p>
      <p>Itinerary recommendation faces the following challenges.</p>
      <p>C-1: Implicit Feedback. Given that activities are happening in
future as in the case of event recommendation [8], there is very little
information to handle and there is much less user-item interactions
than in traditional recommendation scenarios. We deal with implicit
feedback, implying that the degree to which a user likes or not an
item is not known. The use of multiple contexts may increase the
recommendation performance of the algorithms.</p>
      <p>C-2: Interest vs. Attendance. Due to the limited availability and
multiple parallel activities, we deal with attendance bias, as a user
may miss an activity of his/her interest or in contrast, may join an
activity that does not represent a particular interest to him/her.</p>
      <p>C-3: List vs. Itinerary. Activities are competitive and short-lived,
which results in the user’s preference for one activity over the
others in a given time slot. In this context, an itinerary (a feasible
sequence of activities) is more desirable than a list of interesting
activities.</p>
      <p>We will illustrate the challenges in the next section.
3</p>
    </sec>
    <sec id="sec-4">
      <title>USER STUDY</title>
      <p>In this section, we formulate a list of characteristics of a dataset
satisfying the needs of the target problem, provide a comparison of
available datasets (see Tab. 1) and describe a user study conducted
in order to collect data with desirable characteristics.
3.1</p>
    </sec>
    <sec id="sec-5">
      <title>Data Characteristics and Existing Datasets</title>
      <p>
        We categorise the existing datasets w.r.t. the focus of data into 3
groups: Single Item, Schedule, and Sequence. We define a list of
characteristics (column "Characteristics" in Tab. 1) based on the activity
attributes and consecutive nature of performed activities during
distributed events. We cluster the characteristics into 5 types w.r.t. the
entity they describe: item (unit under consideration), sequence
(ordered sequence of items), user (information about users), user-item
(user-item interactions), and user-user (relations between users).
We distinguish 5 essential characteristics (given in italics in Tab.
1): (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) time windows (start and end time of activity availability),
(
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) coordinates (geographical location of an activity), (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) service
time (duration of an activity), (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ) categories (associated categories),
(
        <xref ref-type="bibr" rid="ref5">5</xref>
        ) users historical data. Though we indicate only 5 elements as
essentials, all the others listed in Tab. 1 are also important as they
may enhance the recommendation. As it can be seen, none of the
existing datasets contains all the essential characteristics. Thus, we
have made an attempt to create an integral dataset that contains all
the required features and provides an insight into users’ behaviour.
3.2
      </p>
    </sec>
    <sec id="sec-6">
      <title>Data Collection</title>
      <p>In order to collect required data, we have performed a user study
via online survey. Participants were recruited via a link to the
online questionnaire sent by email to several research and university
mailing lists. The claimed aim of the study was to create a dataset
that simulates cruise attendance and could be used in order to
make personalised recommendations of itineraries. The list of
activities used in the survey was taken from the personal navigators
of Disney’s Fantasy 7-nights Eastern Caribbean cruise. Activities
dedicated exclusively for kids have been excluded from the current
list of activities. The original personal navigators can be found
online3. The deck plan of the ship can be found on the web4. The
1Yelp challenge dataset, http://www.yelp.com/dataset_challenge
2https://github.com/jalbertbowden/foursquare-user-dataset
3
http://disneycruiselineblog.com/2015/07/personal-navigators-7-night-easterncaribbean-cruise-on-disney-fantasy-itinerary-a-june-20-2015/
4http://disneycruiselineblog.com/ships/deck-plans-disney-dream-disney-fantasy/</p>
      <p>Interested &amp; Going
Interested &amp; Not Going</p>
      <p>Not Interested &amp; Going
Not Interested &amp; Not Going
questionnaire consisted of 4 parts. The overview of the survey with
examples of questions is given in Tab. 2.</p>
      <p>Thus, 23 contributions were collected. Statistics concerning the
participants are provided in Tab. 3. The main statistics of the dataset
are given in Tab. 4. The average duration of an activity is 45 minutes.
The average number of ongoing simultaneous activities is 5.
3.3</p>
    </sec>
    <sec id="sec-7">
      <title>Data Analysis</title>
      <p>The conducted user study gives a more practical insight into
personalised itinerary recommendation and the activity selection process.
In the following, we illustrate the challenges from Section 2.</p>
      <p>
        C-2: Interest vs. Attendance. Figure 1 displays the user-wise
distribution of the number of activities a user: (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) was interested in
(ratinд ≥ 4 or ratinд = 3 if the highest rating given by the user to
any activity is equal to 3) and joined (Interested &amp; Going), (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) was
interested in but did not join (Interested &amp; Not Going), (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) was not
interested in but joined (Not Interested &amp; Going), and (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ) was not
interested in and did not join (Not Interested &amp; Not Going)5. The
chart shows evidence that individuals miss many activities that
represent interest to them. Thus, the number of Interested &amp; Not
Going activities is almost twice higher (1.7621) than Interested &amp;
Going. It is also surprising that Not Interested &amp; Going activities
constitute about 43% of all joined activities.
      </p>
      <p>C-3: List vs. Itinerary. Let us consider the following settings. We
compare several top-n item recommendation algorithms against
itinerary recommendation from the literature. As history data we
consider a binary attendance matrix.</p>
      <p>- Category-based: This algorithm ranks the candidate activities
based on their weighted frequency of corresponding categories.</p>
      <p>- Content-based: The candidate activities are ranked in
descendant order of their textual similarity with the user’s past activities.
An activity is represented as a TF-IDF vector. The user’s profile is
built over TF-IDF vectors of activities joined by the user in the past.</p>
      <p>- Logistic Regression: We fed a vector of aforementioned scores
into a logistic regression model.
5Ratings are used only for this part of the study. We do not consider them in estimation
of user’s interest in activities, as we assume there exist only binary attendance matrix.</p>
      <sec id="sec-7-1">
        <title>Entity Characteristic Item Sequence</title>
        <p>311 User’s evaluation of a list of proposed activities
by selecting one of the grades for the listed
activities: 1 - Never (not interested at all and won’t
recommend to anyone to attend it); 2 - Not
interested; 3 - Neutral; 4 - Interested; 5 - Won’t miss
593 Organisation of the activities into a day-wise
itinerary. Given an ordered list of activities with
their availability hours, the respondents were
asked to indicate their intention to join the
activity or not by clicking on "Going" or "Not going".</p>
      </sec>
      <sec id="sec-7-2">
        <title>Afterwards</title>
        <p>5</p>
        <p>Conclusion questions
- ILS+Scores: We also tested a state-of-the-art itinerary
construction algorithm [9] that is based on the Iterated Local Search (ILS)
algorithm [13] with activities scores calculated using hybrid scores</p>
      </sec>
      <sec id="sec-7-3">
        <title>Question Examples</title>
        <p>Your gender: 2Female 2Male</p>
        <p>Have you already experienced DCL (Disney Cruise Line)?
Are you aiming to attend the maximum amount of activities
mentioned in your Personal Navigator or just a few must-see?
Sailing Away. Don’t Miss Event.</p>
        <p>Description: It’s time to go Sailing Away! Join Mickey and Minnie
along with Tinker Bell and the rest of the gang as they welcome
you abroad the Disney Fantasy.</p>
        <p>Available: Day 1, 16:30-17:15, Location: Deck Stage
Never #### Won’t miss</p>
      </sec>
      <sec id="sec-7-4">
        <title>Event</title>
        <p>11:30 - 15:00. Character Meet &amp; Greet
Ticket Distribution. Category:
Characters. Location: Port Adventures Desk.
Don’t Miss Event</p>
      </sec>
      <sec id="sec-7-5">
        <title>Going</title>
      </sec>
      <sec id="sec-7-6">
        <title>Not going</title>
        <p>2
2
When you were having a choice among diferent activities of
your interest, did you consider the distance to the venue while
making your choice?
How do you usually manage the list of activities to perform
during your vacations?
(content-based, category-based and time-based) and transition
probabilities between activities.</p>
      </sec>
      <sec id="sec-7-7">
        <title>Statistic</title>
        <p># Female users
# Users already experienced DCL
# Users already experienced any cruise
# Users considering the distance between venues</p>
      </sec>
      <sec id="sec-7-8">
        <title>Managing Activities. Not-to-miss List : Daily plan</title>
        <p>The algorithms were evaluated in terms of their precision. We
returned top-20 activities for each day6 using top-n
recommendation algorithms. Figure 2 displays the recommendation power of
each algorithm with varying number of history days (from 1 to
6). Itinerary recommendation algorithm shows higher precision,
proving that an itinerary satisfies better the user’s needs.
4</p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>DISCUSSION AND CONCLUSION</title>
      <p>In this paper we have considered the problem of personalised
itinerary recommendation with special interest for cruises. We
have distinguished the characteristics of data used in itinerary
recommendation and have presented an overview of available datasets.
To the best of our knowledge, this is the first attempt to classify and
summarise the existing datasets, and describe them with respect to
the aforementioned characteristics. Moreover, we have undertaken
a user study in order to build a preliminary dataset that satisfies
all the characteristics and that helps to understand individuals’
behaviour in activity selection process. Though the discussed dataset
is not large-scale, the undertaken user study reveals general trends
of users’ behaviour while on board of a cruise or while attending a
distributed event. Moreover, we have discussed the challenges faced
by the problem of itinerary recommendation and have illustrated
them with the performed data analysis.</p>
      <p>As future work, we plan to create a dataset via crowdsourcing
using CrowdFlower platform. The characteristics presented in Sec.</p>
      <sec id="sec-8-1">
        <title>6The average number of joined activities per day is 18.</title>
        <p>3.1 will serve as the basis for the new dataset. Another direction
of future work consists in proposing more accurate solution for
the itinerary recommendation that would embrace all the sides and
address all the challenges of the itinerary recommendation.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Igo</given-names>
            <surname>Brilhante</surname>
          </string-name>
          , Jose Antonio Macedo, Franco Maria Nardini, Rafaele Perego, and
          <string-name>
            <given-names>Chiara</given-names>
            <surname>Renso</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Where Shall We Go Today?: Planning Touristic Tours with Tripbuilder</article-title>
          .
          <source>In Proc. of the 22nd ACM International Conference on Information &amp; Knowledge Management (CIKM '13)</source>
          .
          <fpage>757</fpage>
          -
          <lpage>762</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Adriel</given-names>
            <surname>Dean-Hall</surname>
          </string-name>
          , Charles L. A.
          <string-name>
            <surname>Clarke</surname>
            , Jaap Kamps, Julia Kiseleva, and
            <given-names>Ellen</given-names>
          </string-name>
          <string-name>
            <surname>Voorhees</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Overview of the TREC 2015 Contextual Suggestion Track</article-title>
          .
          <source>In Proc. of the 24th Text REtrieval Conference (TREC</source>
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Adriel</given-names>
            <surname>Dean-Hall</surname>
          </string-name>
          , Charles L. A.
          <string-name>
            <surname>Clarke</surname>
            , Jaap Kamps, Paul Thomas,
            <given-names>Nicole</given-names>
          </string-name>
          <string-name>
            <surname>Simone</surname>
            , and
            <given-names>Ellen</given-names>
          </string-name>
          <string-name>
            <surname>Voorhees</surname>
          </string-name>
          .
          <article-title>Overview of the TREC 2013 Contextual Suggestion Track</article-title>
          .
          <source>In NIST Special Publication</source>
          <volume>500</volume>
          -302:
          <string-name>
            <given-names>The</given-names>
            <surname>Twenty-Second Text REtrieval Conference Proceedings</surname>
          </string-name>
          (TREC
          <year>2013</year>
          )
          <article-title>(</article-title>
          <year>2013</year>
          ), Ellen M.
          <string-name>
            <surname>Voorhees</surname>
          </string-name>
          (Ed.).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Adriel</given-names>
            <surname>Dean-Hall</surname>
          </string-name>
          , Charles L. A.
          <string-name>
            <surname>Clarke</surname>
            , Jaap Kamps, Paul Thomas, and
            <given-names>Ellen</given-names>
          </string-name>
          <string-name>
            <surname>Voorhees</surname>
          </string-name>
          .
          <article-title>Overview of the TREC 2014 Contextual Suggestion Track</article-title>
          .
          <source>In NIST Special Publication</source>
          <volume>500</volume>
          -308:
          <string-name>
            <given-names>The</given-names>
            <surname>Twenty-Third Text REtrieval Conference Proceedings</surname>
          </string-name>
          (TREC
          <year>2014</year>
          )
          <article-title>(</article-title>
          <year>2014</year>
          ),
          <string-name>
            <surname>Ellen</surname>
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Voorhees</surname>
          </string-name>
          and Angela Ellis (Eds.).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Jacob</given-names>
            <surname>Eisenstein</surname>
          </string-name>
          ,
          <string-name>
            <surname>Brendan O'Connor</surname>
          </string-name>
          ,
          <article-title>Noah A Smith,</article-title>
          and Eric P Xing.
          <year>2010</year>
          .
          <article-title>A latent variable model for geographic lexical variation</article-title>
          .
          <source>In Proc. of the 2010 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics</source>
          ,
          <fpage>1277</fpage>
          -
          <lpage>1287</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Florida-Caribbean Cruise Association</surname>
          </string-name>
          (FCCA).
          <year>2017</year>
          .
          <article-title>Cruise Industry Overview</article-title>
          . 11200
          <string-name>
            <given-names>Pines</given-names>
            <surname>Blvd</surname>
          </string-name>
          .,
          <string-name>
            <surname>Suite</surname>
          </string-name>
          201 -
          <string-name>
            <surname>Pembroke</surname>
            <given-names>Pines</given-names>
          </string-name>
          ,
          <source>Florida</source>
          <volume>33026</volume>
          . http://www.f-cca. com/downloads/2017-
          <article-title>Cruise-Industry-Overview-</article-title>
          <string-name>
            <surname>Cruise-</surname>
          </string-name>
          Line-Statistics.pdf
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Xingjie</given-names>
            <surname>Liu</surname>
          </string-name>
          , Qi He, Yuanyuan Tian,
          <string-name>
            <surname>Wang-Chien</surname>
            <given-names>Lee</given-names>
          </string-name>
          ,
          <string-name>
            <surname>John McPherson</surname>
          </string-name>
          , and Jiawei Han.
          <year>2012</year>
          .
          <article-title>Event-based Social Networks: Linking the Online and Ofline Social Worlds</article-title>
          .
          <source>In Proc. of the 18th ACM SIGKDD conference on Knowledge Discovery and Data Mining</source>
          (
          <year>2012</year>
          )
          <article-title>(KDD'12).</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Augusto</surname>
            <given-names>Q.</given-names>
          </string-name>
          <string-name>
            <surname>Macedo</surname>
          </string-name>
          , Leandro B.
          <string-name>
            <surname>Marinho</surname>
            ,
            <given-names>and Rodrygo L.T.</given-names>
          </string-name>
          <string-name>
            <surname>Santos</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>ContextAware Event Recommendation in Event-based Social Networks</article-title>
          .
          <source>In Proc. of the 9th ACM Conference on Recommender Systems (RecSys '15)</source>
          .
          <fpage>123</fpage>
          -
          <lpage>130</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Diana</given-names>
            <surname>Nurbakova</surname>
          </string-name>
          , Léa Laporte, Sylvie Calabretto, and
          <string-name>
            <given-names>Jérôme</given-names>
            <surname>Gensel</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Recommendation of Short-Term Activity Sequences During Distributed Events</article-title>
          .
          <source>Procedia Computer Science</source>
          <volume>108</volume>
          (
          <year>2017</year>
          ),
          <fpage>2069</fpage>
          -
          <lpage>2078</lpage>
          . International Conference on Computational Science, {ICCS}
          <year>2017</year>
          ,
          <fpage>12</fpage>
          -
          <lpage>14</lpage>
          June 2017, Zurich, Switzerland.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Wouter</surname>
            <given-names>Soufriau</given-names>
          </string-name>
          , Pieter Vansteenwegen, Greet Vanden Berghe, and Dirk Van Oudheusden.
          <year>2013</year>
          .
          <article-title>The Multiconstraint Team Orienteering Problem with Multiple Time Windows</article-title>
          .
          <source>Transportation Science</source>
          <volume>47</volume>
          ,
          <issue>1</issue>
          (Feb.
          <year>2013</year>
          ),
          <fpage>53</fpage>
          -
          <lpage>63</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Bart</surname>
            <given-names>Thomee</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>David A.</given-names>
            <surname>Shamma</surname>
          </string-name>
          , Gerald Friedland, Benjamin Elizalde, Karl Ni, Douglas Poland, Damian Borth, and
          <string-name>
            <surname>Li-Jia Li</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>YFCC100M: The New Data in Multimedia Research</article-title>
          .
          <source>Commun. ACM 59</source>
          ,
          <issue>2</issue>
          (
          <year>2016</year>
          ),
          <fpage>64</fpage>
          -
          <lpage>73</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Pieter</surname>
            <given-names>Vansteenwegen</given-names>
          </string-name>
          , Wouter Soufriau, and Dirk Van Oudheusden.
          <year>2011</year>
          .
          <article-title>The orienteering problem: A survey</article-title>
          .
          <source>Eur J Oper Res</source>
          <volume>209</volume>
          ,
          <issue>1</issue>
          (
          <year>2011</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Pieter</surname>
            <given-names>Vansteenwegen</given-names>
          </string-name>
          , Wouter Soufriau, Greet Vanden Berghe, and Dirk Van Oudheusden.
          <year>2009</year>
          .
          <article-title>Iterated Local Search for the Team Orienteering Problem with Time Windows</article-title>
          .
          <source>Comput. Oper. Res</source>
          .
          <volume>36</volume>
          ,
          <issue>12</issue>
          (Dec.
          <year>2009</year>
          ),
          <fpage>3281</fpage>
          -
          <lpage>3290</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Dingqi</surname>
            <given-names>Yang</given-names>
          </string-name>
          , Daqing Zhang, and
          <string-name>
            <given-names>Bingqing</given-names>
            <surname>Qu</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Participatory Cultural Mapping Based on Collective Behavior Data in Location-Based Social Networks</article-title>
          .
          <source>ACM Transactions on Intelligent Systems and Technology (TIST) 7</source>
          ,
          <issue>3</issue>
          (
          <year>2016</year>
          ),
          <fpage>30</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Yu</surname>
            <given-names>Zheng</given-names>
          </string-name>
          , Lizhu Zhang, Xing Xie, and
          <string-name>
            <surname>Wei-Ying Ma</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Mining Interesting Locations and Travel Sequences from GPS Trajectories</article-title>
          .
          <source>In Proc. of the 18th International Conference on World Wide Web (WWW '09)</source>
          .
          <fpage>791</fpage>
          -
          <lpage>800</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>