<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Recommending Crowdsourced Trips on wOndary</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Linus W. Dietz</string-name>
          <email>linus.dietz@tum.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Achim Weimert</string-name>
          <email>achim@wondary.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Technical University of Munich</institution>
          ,
          <addr-line>Garching</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>wOndary LTD</institution>
          ,
          <addr-line>London</addr-line>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <fpage>13</fpage>
      <lpage>17</lpage>
      <abstract>
        <p>Making recommendations for tourist trips is a challenging task due to the intrinsic complexity of the domain. The characterization of itineraries is non-trivial, because there is a lack of open destination databases such as regions, islands, cities or attractions that would help to understand the characteristics of destinations within a trip. For this purpose, we present wOndary, which supports the planning and sharing of worldwide trips based on crowdsourcing. We sidestep item discovery and routing challenges of the tourist trip design problem by performing content-based recommendation by facilitating a novel structured representation of itineraries. We share our experiences in the establishment of the core model for our travel recommender system and discuss future developments.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>INTRODUCTION</title>
      <p>Independent travel planning is very complex. Today’s connected
world ofers a myriad of choices of where to travel to, and there
is unlimited information based on which one can make a decision.
wOndary1 has developed a platform for independent travelers to
plan their trips. Initially, it started as a planning tool to create
personal itineraries that can be shared privately with friends and
co-travelers or that can be published as a public trip on the platform.
In this paper, we describe how we transition the wOndary platform
to a personalized recommender system for crowdsourced trips and
describe the future potential of this work.</p>
      <p>Our proposed solution involves the following contributions. We
present a data model for structuring trips into blocks that are both
useful for users and for segmenting trips. Furthermore, we present
an attractions categorization that enables content-based
recommendations via implicitly elicited preference. Utilizing this novel data
model for structured itineraries, we provide recommendations for
complete trips, and for parts of trips, i.e., blocks. The approach was
driven by the following research questions (RQs):
RQ 1: What is a suitable recommendation model that masters the
complexities of travel and enables future innovation
regarding the user experience within wOndary?
RQ 2 How can crowdsourced trips be structured and characterized
to enable content-based recommendations?
RQ 3: How can user preferences be elicited without requiring
much efort by the user?</p>
      <p>In the following section, we describe wOndary and the core of
the novel content-based travel recommender. Then, in Section 3
we survey prior literature on personalized travel recommendation
and further discuss avenues to improve the current basic system in
Section 4. We conclude this paper in Section 5.
2</p>
    </sec>
    <sec id="sec-2">
      <title>TRAVEL RECOMMENDATION FOR</title>
      <p>INDEPENDENT TRAVELERS
wOndary is a platform that allows users to save, organize and share
details about their trips. The platform helps with the structuring of
personal itineraries, enables collaboration between group
travelers, and encourages the publishing of personal itineraries so that
others can reuse and customize these crowdsourced trips for their
own purposes. wOndary currently focuses on young urbans (23–30
year olds) that strive for unique experiences during independently
planned trips.</p>
      <p>
        The user journey on wOndary reflects the travel micro-moments
as defined by Google as “dreaming, planning, booking, and
experiencing” [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. When users dream of going away, they browse
crowdsourced itineraries on wOndary or read travel-related stories.
Online travel media, such as travel blogs can include wOndary’s widget
to refer users to unique itineraries that have been created by other
travelers. In the planning phase the users save activities or copy
itineraries to quickly create their own, customized trip. The users
can search for specific locations and activities on and of the
platform and collaborate with their co-travelers. By synchronizing the
wOndary itinerary to the calendar app on their phone, the trip info
becomes available when a user is ofline to experience the foreign
culture, but can be adapted at any time if there is Internet
connectivity. Once the users return from their trip, they can privately share
their itinerary with friends and colleagues or decide to publish it to
all other users within the platform.
      </p>
      <p>wOndary features a web application that is currently available
in open beta on https://wondary.com. It is implemented as a
singlepage-application that runs on the Google Cloud Platform, and
therefore, works in web browsers on all types of devices.
2.1</p>
    </sec>
    <sec id="sec-3">
      <title>Finding Inspiration with the “Explore”</title>
    </sec>
    <sec id="sec-4">
      <title>Page</title>
      <p>The users need a structured way to access the growing number of
crowdsourced itineraries. To answer our first research question,
wOndary provides a location-based “Explore” feature that allows
querying a location, and filtering by geographical bounds and
attributes, such as trip duration. Filtering is possible by adjusting the
trip duration (72 hours, 1 week, or 2+weeks), the season, and the
query area by adjusting the map excerpt. We chose this visual
representation for the recommendations because a complex domain,
like global travel, requires an intuitive user interface instead of
a simple list. Therefore, matching items are displayed on a map
and as a list, where their ranking depends on the distance to the
queried location constituting the baseline for future improvements.
The recommended items are both full itineraries as well as blocks,
as defined below. As can be seen in Figure 1, the interface allows
users to zoom into a geographical region. The users can also view
high-level information about itineraries and focus on the ones they
would like to see further details about, or they can copy them as a
basis for their own customized trip.</p>
      <p>With an increasing number of trips being published on the
platform, it has become dificult for users to identify itineraries that
ift their travel requirements. For example, itineraries are diverse
in terms of included activities, and a user who loves sightseeing
may not be interested in a trip that features primarily beaches or
a multi-day hike through the mountains. Additionally, the users
expect websites to support them in finding relevant content. Last,
the number of trips for a popular region make it tedious for users to
review all itineraries. Therefore, recommendations are playing an
increasingly important role in wOndary’s Explore feature because
showing relevant content to the user improves their engagement
and general satisfaction with the application.
2.2</p>
    </sec>
    <sec id="sec-5">
      <title>A Data Model for Structured Itineraries</title>
      <p>wOndary’s data model for trips is based on insights from the domain.
When travelers plan their trips, they often think of destinations,
e.g., cities that they want to connectively visit. For example, a trip to
Italy would start with several days in Rome, then, a day in Florence,
visiting friends in Bologna over the weekend, and finish with three
more days in Venice. To capture this, wOndary structures trips into
blocks. A block acts as a descriptor of a partial trip that has a
duration of one or more consecutive days and links to a location. Thus,
trips are modeled as a sequence of one or more blocks. This structure
was designed using user feedback and matches the way travelers
approach planning. Additionally, it allows the normalization of trips
spanning longer periods of time (several weeks or months) into
portions that are transferable between trips of diferent travelers.
wOndary heavily relies on blocks, not only when recommending
items but also when presenting structured information about trips
to users.</p>
      <p>The next lower level of the data model is the day, consisting
of three types of entries: transportation, lodging, and activities.
Having a good overview of how to get from one place to another
and where to stay overnight is essential for planning travel, whereas,
instead, travelers define their trips based on the attractions they
visit during the day. Currently, the users can input the attractions
using venues from Google Places to ensure that they actually exist;
typos are corrected, and duplicates are eliminated. Furthermore,
the Google Places service provides further information, such as an
image, opening hours, or ratings.</p>
      <p>To perform content-based recommendations, it is necessary to
classify items and the users into some meaningful categories.
Therefore, our answer to RQ2 is the aforementioned data model using
the five categories listed below, which are influenced by the target
audience of the platform and the available attraction information.
We compiled them based on an analysis of the platform’s trips
combined with our expert knowledge on individual travel.
• Food Mainly comprises restaurants and cafés, but also
grocery stores and food markets.
• Culture Describes activities and places with cultural or
historical attributes. For example, museums, galleries, churches
and theaters fall under this category.
• Nightlife Categorizes places that are commonly related to
nightlife such as bars, night markets, and jazz clubs.</p>
      <p>Trip
Category
food
culture
nightlife
outdoor
travel
• Outdoor Includes attributes associated with natural scenery
or outdoor activities, such as parks, nature preserves, beaches,
mountains and trails.
• Transport &amp; Travel Consists of travel-related attractions,
such as ferries, train stations and airports. This indicates that
a relevant portion of the day is spent on transportation and
that the transfer itself is an attraction.
2.3</p>
    </sec>
    <sec id="sec-6">
      <title>Content-Based Travel Recommendations</title>
      <p>To categorize the attractions, we query the Google Places types2 and
directly map them into our five categories. However, the returned
place types are not primarily meant for travelers. For example, the
type query for the Colosseum of Rome, Italy returns:
"types": ["point_of_interest", "establishment"]
While these types are not totally of mark, the information is
insuficient to categorize this monument into one of our categories.
Therefore, we augment the types from Google with an additional
lookup of the attraction via the Foursquare API to allow one
attraction to be a member of several categories. Foursquare has a
rich hierarchical region categorization3 with 923 categories that
are organized in a tree to model specialized subcategories. To
locate a Google Place on Foursquare, we performed a query by name
using the exact location. By doing a bulk comparison, we found
that most attractions also exist in Foursquare, except for political
entities, such as city names. Conveniently, due to the bounded local
search, the first result for Foursquare was the correct result for the
corresponding Google Place. Recalling our example, we found that
Colosseum was categorized as a “Historic Site”, which is within the
“Arts &amp; Entertainment” category of Foursquare. Using static mapping
of all Google types and Foursquare categories, we can determine the
wOndary categorization. The Colosseum would be categorized into
Culture because the Google types (‘point_of_interest’ and
‘establishment’) are not part of the mapping, whereas a ‘Historic Site’ maps
to the Culture category. One attraction can have several wOndary
categories; however, not all venue types are relevant for travelers.</p>
      <sec id="sec-6-1">
        <title>2https://developers.google.com/places/web-service/supported_types 3https://developer.foursquare.com/docs/resources/categories</title>
        <p>food
culture
nightlife
outdoor
travel
0 50 100 150 0 50 100 150 0 50 100 150 0 50 100 150 0 50 100 150
Trip
For example, hospitals are not mapped to any of our categories,
because we argue that they are not relevant for planning a trip.</p>
        <p>Figure 2 shows the distribution of categories of a representative
sample of 150 trips from wOndary based on the top trips according
to user interactions. A closer look into the distribution of the
categories in Figure 3 shows that most venues are categorized into the
Outdoor category, whereas Nightlife is the least frequent.</p>
        <p>Having classified the items, it is also necessary to know the
user’s preferences to do content-based recommendation. The
default method would be to explicitly ask the user to indicate her
preferences regarding the five travel categories, e.g., on a scale from
1 (not interesting) to 5 (highly interesting). However, this would
require a manual interaction, which we can avoid by using synergy
efects from the categorization of attractions. To answer RQ3, we
aggregated all attractions from a user’s saved trips to create a user
preference profile. While this can be refined further with more
detailed click stream data, it is a straightforward metric for classifying
user travel preferences within wOndary.</p>
        <p>The actual ranking for the recommendations is performed by
calculating the cosine similarity using the five dimensional vector
of distinctive travel interests. Here we exploit the structure of our
data model to recommend complete trips and trip parts, i.e., blocks
or specific days. Currently, the Explore page features trips and
blocks as recommendations. In the first step, the system filters out
all trips that are not within the bounds of the map or do not match
the temporal filters (see Figure 1). When a trip is only partially in
the query region, the blocks within the area will be included. Then,
all past trips of the user are removed because we assume they are
not of interest for future travel plans. Trips and blocks as ranked
by the cosine similarity with respect to the user profile and also
listed left of the map. To keep clarity in the interface, only the top
30 items are displayed.</p>
        <p>For new users that have not yet copied any trips, the
contentbased recommender cannot compute a ranking for the trips.
Therefore, the trips displayed on the Explore page will be ranked by the
geographic distance to the center of the map.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>STATE OF THE ART OF PERSONALIZED</title>
    </sec>
    <sec id="sec-8">
      <title>TRAVEL RECOMMENDATION</title>
      <p>
        The tourism domain is a popular branch of recommender
system (RS) research because it is a highly emotional, personal, and
inherently complex topic. Early systems recommended single items,
such as attractions or bundled travel packages [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], and there are
big commercial players, such as hotels, restaurants, airlines, and
activities. In their survey, Borràs et al. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] categorized an
intelligent tourism RS into four functionalities: travel destination and
tourist packs, suggested attractions, trip planners, and social
aspects. In 2014, most approaches focused on the attraction suggestion
category; however, currently, the trend is on complex
recommendations [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ], such as sequences of attractions [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ], composite travel
regions [
        <xref ref-type="bibr" rid="ref13 ref6">6, 13</xref>
        ], and group recommendations [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] for tourism. When
it comes to complex recommendations such as enjoyable routes,
the challenge is to identify relevant points of interest (POIs) and
then connect them in a coherent trip. This problem is called the
Tourist Trip Design Problem (TTDP) [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], which is algorithmically
interesting and has been widely investigated [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ].
      </p>
      <p>
        However, in this paper, we tackled the complexities of travel
using a crowdsourcing approach by performing personalized travel
recommendations using actual trips from users. Crowdsourcing
has the advantage of being able to vary the length of travel, such
as a multi-month world trip, a week trip to an island, or a weekend
in a city, and this is an unsolved challenge in the tourist RS for
solving the TTDP. Furthermore, the structured representation of
trips allows the combination of several independent blocks into a
prolonged trip or the possibility of selecting parts of a trip if the
traveler is short on time. Determining the duration of stay at each
location can be further personalized with additional information
about the traveler, such as tourist mobility patterns [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] from past
trips.
      </p>
      <p>
        The RS of static travel items utilizes ratings as one factor of a
hybrid recommendation algorithm [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. However, because we
exploit the trip structures to aggregate and reassemble trips, ratings
are not of much use due to their high sparsity. Furthermore, we
are concerned that users are not motivated to provide ratings for
trips and blocks, and the platform’s user experience could decline
if it required users to rate trips. Therefore, we have employed the
content-based recommendation paradigm [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] to match items to
users. Content-based recommendations are commonplace as a
hybrid factor in complex domains, such as in scientific publications [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],
news articles [
        <xref ref-type="bibr" rid="ref15 ref16">15, 16</xref>
        ] or tourism [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. However, for a purely
contentbased recommendation, it is often challenging to model the user
after the very same features as the items to compute a
similarity measure, e.g., the cosine distance, for ranking items. When
investigating potential classification schemes of touristic items for
content-based recommendations, the work of Neidhardt et al. is an
established alternative to wOndary’s categorization. Based on the
Big Five Factor Model [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] from personality psychology and prior
research on tourist roles [
        <xref ref-type="bibr" rid="ref10 ref31">10, 31</xref>
        ], Neidhardt et al. developed the
Seven Factor Model of tourist behavioral patterns [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. In a follow-up
study [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], they showed that this can be used to elicit user
preferences via pictures classified by domain experts. However, the
ifnal step of using these tourist behavioral patterns to recommend
items was only recently performed [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] and required a very big
commercial data set of 30,000 tourist destinations classified along
27 motivational and 14 geographical attributes.
      </p>
      <p>
        Commercial approaches for travel recommendations range from
merchants focusing on the sale of travel-related services, such as
activities, transport and lodging, to review platforms with a business
model based on commissions. Depending on the type of business,
travel recommendations are a side-product or a main feature in
which the recommendation can include a single product or service
or complete trips. Big platforms, such as TripAdvisor and Google
Maps, recommend separate activities to users based on ratings,
reviews, and behavior on the platform. Social networks, such as
Facebook, provide less structured ways to ask friends for travel
recommendations as a way to provide crowd-sourcing
recommendations. Google Trips recommends single- or multi-day tours [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
in the vicinity based on user behavior and by scanning the user’s
booking confirmations in Gmail.
      </p>
      <p>Mafengwo4 and Qyer5 (both solely available in Mandarin) are
the closest platforms to our approach and provide travel-related
services, as well as trip planning, and sharing functionalities.
4</p>
    </sec>
    <sec id="sec-9">
      <title>AUGMENTING WONDARY’S TRAVEL</title>
    </sec>
    <sec id="sec-10">
      <title>RECOMMENDATIONS</title>
      <p>As described in this paper, its core functionality is the first step
in wOndary’s travel RS. To answer the second part of RQ1, this
section discusses wOndary’s future agenda concerning trip
recommendations. We plan to improve the item categorization, to
enable explanations and critiquing of our recommendations, and to
explicitly support the travel decision-making process for groups.</p>
      <p>As discussed at the end of Section 2, currently, new users are
not provided with content-based recommendations. We believe we
can overcome the cold start problem with an elaborate click stream
analysis and an initial preference elicitation phase in which users
provide their feedback for the five categories e.g., through small
games.</p>
      <p>
        The current categorization is based on expert knowledge and
data sources for categorization. It would be useful to do a
thorough investigation of the attraction’s attributes with unsupervised
learning to obtain data-backed clusters. Furthermore, a latent factor
analysis of the trips would be interesting to evaluate the explicit
categories. As we have rich information about the trips, the core of
our recommender system is content-based. This could be improved
in the future with more hybrid factors, e.g., knowledge-based
recommendations and collaborative ratings of items. To provide
transparency and improve trust in the recommendations, it would be
highly interesting to provide explanations of the
recommendations [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ] to the user. These explanations could be based on the
classification of items ("because you liked . . . " ), the users ("travelers
similar to you also liked . . . "), or by taking the social network on
the platform into account ("your friend traveled to . . . ") [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Another
promising technique to improve recommendations is critiquing [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ].
A conversational element [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] within the presentation of results
would enable active learning of user needs [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. This is useful
because we think that it is unlikely that recommendations in such
a complex domain are perfect on the first iteration, e.g., because
      </p>
      <sec id="sec-10-1">
        <title>4http://www.mafengwo.cn/ 5http://www.qyer.com/</title>
        <p>travelers may want to go on a diferent type of holiday than they
went on before.</p>
        <p>
          Since travel planning on wOndary is already collaborative, it is a
logical step to extend the recommendations to groups to support the
decision-making process. However, we acknowledge that this issue
has not been resolved and is still of high interest to the research
community in this area [
          <xref ref-type="bibr" rid="ref12 ref26 ref5">5, 12, 26</xref>
          ].
5
        </p>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>CONCLUSIONS</title>
      <p>In this paper, we described our approach for recommending
highquality crowdsourced trips. We presented a novel structure for
itineraries that is both useful for users to obtain an understanding
of trip characteristics and for software systems to work with. This
data model structures user-submitted trips, thereby defining items
based on diferent lengths, i.e., trips, blocks, and days. Second, we
have automatically classified the aforementioned item types using
wOndary’s categorization scheme. We exploited this categorization
scheme to perform user modeling without explicit elicitation of
preferences using the user’s past trips. Finally, we showcased a
user interface for intuitively presenting recommendations for trips
across the globe.</p>
      <p>The current version is the core part of the content-based
recommender system and will be extended with advanced features in
the future. While the recommendations of this platform are more
personalized than ranking trips by distance to the center of the
map, we want to confirm the perceived accuracy by utilizing an
automated A/B testing framework, which we will also use to
continuously measure future changes in the algorithm, of which we
have sketched several in our future work section. This will
establish wOndary’s test setup for travel recommendations to provide
informed decisions regarding improvement of the product.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Joeran</given-names>
            <surname>Beel</surname>
          </string-name>
          , Akiko Aizawa, Corinna Breitinger, and
          <string-name>
            <given-names>Bela</given-names>
            <surname>Gipp</surname>
          </string-name>
          .
          <year>2017</year>
          . Mr. DLib:
          <article-title>Recommendations-as-a-Service (RaaS) for Academia</article-title>
          .
          <source>In ACM/IEEE Joint Conference on Digital Libraries (JCDL'17)</source>
          . IEEE, 1-
          <fpage>2</fpage>
          . https://doi.org/10.1109/JCDL.
          <year>2017</year>
          . 7991606
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Philip</given-names>
            <surname>Bonhard</surname>
          </string-name>
          and
          <string-name>
            <given-names>M. Angela</given-names>
            <surname>Sasse</surname>
          </string-name>
          .
          <year>2006</year>
          . '
          <article-title>Knowing me, knowing you' - Using profiles and social networking to improve recommender systems</article-title>
          .
          <source>BT Technology Journal 24, 3 (July</source>
          <year>2006</year>
          ),
          <fpage>84</fpage>
          -
          <lpage>98</lpage>
          . https://doi.org/10.1007/s10550-006-0080-3
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Joan</given-names>
            <surname>Borràs</surname>
          </string-name>
          , Antonio Moreno, and
          <string-name>
            <given-names>Aida</given-names>
            <surname>Valls</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Intelligent tourism recommender systems: A survey</article-title>
          .
          <source>Expert Systems with Applications</source>
          <volume>41</volume>
          ,
          <issue>16</issue>
          (Nov.
          <year>2014</year>
          ),
          <fpage>7370</fpage>
          -
          <lpage>7389</lpage>
          . https://doi.org/10.1016/j.eswa.
          <year>2014</year>
          .
          <volume>06</volume>
          .007
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J. H.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <surname>K. M. Chao</surname>
            , and
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Shah</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Hybrid Recommendation System for Tourism</article-title>
          .
          <source>In 2013 IEEE 10th International Conference on e-Business Engineering. IEEE</source>
          ,
          <fpage>156</fpage>
          -
          <lpage>161</lpage>
          . https://doi.org/10.1109/icebe.
          <year>2013</year>
          .24
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Amra</given-names>
            <surname>Delic</surname>
          </string-name>
          , Judith Masthof, Julia Neidhardt, and
          <string-name>
            <given-names>Hannes</given-names>
            <surname>Werthner</surname>
          </string-name>
          .
          <year>2018</year>
          . How to Use Social Relationships in Group Recommenders:
          <article-title>Empirical Evidence</article-title>
          .
          <source>In 26th Conference on User Modeling, Adaptation and Personalization (UMAP '18)</source>
          . ACM, New York, NY, USA,
          <fpage>121</fpage>
          -
          <lpage>129</lpage>
          . https://doi.org/10.1145/3209219.3209226
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Linus</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Dietz</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Data-Driven Destination Recommender Systems</article-title>
          .
          <source>In Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization (UMAP '18)</source>
          . ACM, New York, NY, USA. https://doi.org/10.1145/3209219.3213591
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Linus</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Dietz</surname>
            , Daniel Herzog, and
            <given-names>Wolfgang</given-names>
          </string-name>
          <string-name>
            <surname>Wörndl</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Deriving Tourist Mobility Patterns from Check-in Data</article-title>
          .
          <source>In Proceedings of the WSDM 2018 Workshop on Learning from User Interactions</source>
          . Los Angeles, CA, USA.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Zachary</given-names>
            <surname>Friggstad</surname>
          </string-name>
          , Sreenivas Gollapudi, Kostas Kollias, Tamas Sarlos, Chaitanya Swamy, and
          <string-name>
            <given-names>Andrew</given-names>
            <surname>Tomkins</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Orienteering Algorithms for Generating Travel Itineraries</article-title>
          .
          <source>In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining (WSDM '18)</source>
          . ACM, New York, NY, USA,
          <fpage>180</fpage>
          -
          <lpage>188</lpage>
          . https://doi.org/10.1145/3159652.3159697
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Damianos</given-names>
            <surname>Gavalas</surname>
          </string-name>
          , Charalampos Konstantopoulos, Konstantinos Mastakas, and
          <string-name>
            <given-names>Grammati</given-names>
            <surname>Pantziou</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>A survey on algorithmic approaches for solving tourist trip design problems</article-title>
          .
          <source>Journal of Heuristics 20</source>
          ,
          <issue>3</issue>
          (
          <year>June 2014</year>
          ),
          <fpage>291</fpage>
          -
          <lpage>328</lpage>
          . https://doi.org/10.1007/s10732-014-9242-5
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Heather</given-names>
            <surname>Gibson</surname>
          </string-name>
          and
          <string-name>
            <given-names>Andrew</given-names>
            <surname>Yiannakis</surname>
          </string-name>
          .
          <year>2002</year>
          .
          <article-title>Tourist Roles: Needs and the Lifecourse</article-title>
          .
          <source>Annals of Tourism Research</source>
          <volume>29</volume>
          ,
          <issue>2</issue>
          (April
          <year>2002</year>
          ),
          <fpage>358</fpage>
          -
          <lpage>383</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Google</surname>
            <given-names>Consumer Insights. 2016. Travel</given-names>
          </string-name>
          <string-name>
            <surname>Micro-Moments Guide</surname>
          </string-name>
          .
          <source>Online. (July</source>
          <year>2016</year>
          ). https://www.thinkwithgoogle.com/marketing-resources/
          <article-title>micro-moments/ micro-moments-reshaping-travel-customer-journey/</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>Daniel</given-names>
            <surname>Herzog</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Recommending a Sequence of Points of Interest to a Group of Users in a Mobile Context</article-title>
          .
          <source>In Proceedings of the Eleventh ACM Conference on Recommender Systems (RecSys '17)</source>
          . ACM, New York, NY, USA,
          <fpage>402</fpage>
          -
          <lpage>406</lpage>
          . https: //doi.org/10.1145/3109859.3109860
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>Daniel</given-names>
            <surname>Herzog</surname>
          </string-name>
          and
          <string-name>
            <given-names>Wolfgang</given-names>
            <surname>Wörndl</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>A Travel Recommender System for Combining Multiple Travel Regions to a Composite Trip</article-title>
          . In CBRecSys@
          <source>RecSys (CEUR Workshop Proceedings)</source>
          , Vol.
          <volume>1245</volume>
          . CEUR-WS.org, Foster City, Silicon Valley, California, USA,
          <fpage>42</fpage>
          -
          <lpage>48</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>Daniel</given-names>
            <surname>Herzog</surname>
          </string-name>
          and
          <string-name>
            <given-names>Wolfgang</given-names>
            <surname>Wörndl</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Extending Content-Boosted Collaborative Filtering for Context-aware, Mobile Event Recommendations</article-title>
          .
          <source>In Proceedings of the 12th International Conference on Web Information Systems and Technologies. SCITEPRESS - Science and and Technology Publications</source>
          ,
          <fpage>293</fpage>
          -
          <lpage>303</lpage>
          . https://doi.org/10.5220/0005763702930303
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>Philip</given-names>
            <surname>Lenhart</surname>
          </string-name>
          and
          <string-name>
            <given-names>Daniel</given-names>
            <surname>Herzog</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Combining Content-based and Collaborative Filtering for Personalized Sports News Recommendations</article-title>
          . In CBRecSys@
          <source>RecSys (CEUR Workshop Proceedings)</source>
          , Vol.
          <volume>1673</volume>
          . CEUR-WS.org,
          <fpage>3</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Jiahui</surname>
            <given-names>Liu</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Peter</given-names>
            <surname>Dolan</surname>
          </string-name>
          , and Elin Rønby Pedersen.
          <year>2010</year>
          .
          <article-title>Personalized News Recommendation Based on Click Behavior</article-title>
          .
          <source>In 15th International Conference on Intelligent User Interfaces (IUI'10)</source>
          . ACM. https://doi.org/10.1145/1719970.1719976
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Qi</surname>
            <given-names>Liu</given-names>
          </string-name>
          , Yong Ge,
          <string-name>
            <given-names>Zhongmou</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Enhong</given-names>
            <surname>Chen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Hui</given-names>
            <surname>Xiong</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Personalized Travel Package Recommendation</article-title>
          .
          <source>In Proceedings of the IEEE 11th International Conference on Data Mining (ICDM '11)</source>
          . IEEE, Vancouver, BC, Canada,
          <fpage>407</fpage>
          -
          <lpage>416</lpage>
          . https://doi.org/10.1109/icdm.
          <year>2011</year>
          .118
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Robert</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>McCrae</surname>
            and
            <given-names>Oliver P.</given-names>
          </string-name>
          <string-name>
            <surname>John</surname>
          </string-name>
          .
          <year>1992</year>
          .
          <article-title>An Introduction to the Five-Factor Model and Its Applications</article-title>
          .
          <source>Journal of Personality 60</source>
          ,
          <issue>2</issue>
          (
          <year>June 1992</year>
          ),
          <fpage>175</fpage>
          -
          <lpage>215</lpage>
          . Issue 2. https://doi.org/10.1111/j.1467-
          <fpage>6494</fpage>
          .
          <year>1992</year>
          .tb00970.x
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Lorraine</surname>
            <given-names>McGinty</given-names>
          </string-name>
          and
          <string-name>
            <given-names>James</given-names>
            <surname>Reilly</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>On the Evolution of Critiquing Recommenders</article-title>
          .
          <source>In Recommender Systems Handbook</source>
          , Francesco Ricci, Lior Rokach, Bracha Shapira, and Paul B.
          <source>Kantor (Eds.)</source>
          . Springer US, Boston, MA, USA,
          <fpage>419</fpage>
          -
          <lpage>453</lpage>
          . https://doi.org/10.1007/978-0-
          <fpage>387</fpage>
          -85820-3_
          <fpage>13</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Lorraine</surname>
            <given-names>McGinty</given-names>
          </string-name>
          and
          <string-name>
            <given-names>Barry</given-names>
            <surname>Smyth</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Adaptive Selection: An Analysis of Critiquing and Preference-Based Feedback in Conversational Recommender Systems</article-title>
          .
          <source>International Journal of Electronic Commerce</source>
          <volume>11</volume>
          ,
          <issue>2</issue>
          (Dec.
          <year>2006</year>
          ),
          <fpage>35</fpage>
          -
          <lpage>57</lpage>
          . https://doi.org/10.2753/jec1086-
          <fpage>4415110202</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Julia</surname>
            <given-names>Neidhardt</given-names>
          </string-name>
          , Rainer Schuster, Leonhard Seyfang, and
          <string-name>
            <given-names>Hannes</given-names>
            <surname>Werthner</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Eliciting the Users' Unknown Preferences</article-title>
          .
          <source>In Proceedings of the 8th ACM Conference on Recommender systems (RecSys '14)</source>
          . ACM, New York, NY, USA,
          <fpage>309</fpage>
          -
          <lpage>312</lpage>
          . https://doi.org/10.1145/2645710.2645767
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <surname>Julia</surname>
            <given-names>Neidhardt</given-names>
          </string-name>
          , Leonhard Seyfang, Rainer Schuster, and
          <string-name>
            <given-names>Hannes</given-names>
            <surname>Werthner</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>A picture-based approach to recommender systems</article-title>
          .
          <source>Information Technology &amp; Tourism 15, 1 (March</source>
          <year>2015</year>
          ),
          <fpage>49</fpage>
          -
          <lpage>69</lpage>
          . https://doi.org/10.1007/s40558-014-0017-5
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>Michael</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Pazzani</surname>
            and
            <given-names>Daniel</given-names>
          </string-name>
          <string-name>
            <surname>Billsus</surname>
          </string-name>
          .
          <year>2007</year>
          .
          <article-title>Content-Based Recommendation Systems</article-title>
          . Springer Berlin Heidelberg, Berlin, Heidelberg,
          <fpage>325</fpage>
          -
          <lpage>341</lpage>
          . https://doi. org/10.1007/978-3-
          <fpage>540</fpage>
          -72079-9_
          <fpage>10</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>Neil</surname>
            <given-names>Rubens</given-names>
          </string-name>
          , Dain Kaplan, and
          <string-name>
            <given-names>Masashi</given-names>
            <surname>Sugiyama</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Active Learning in Recommender Systems</article-title>
          . In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer US, Boston, MA, USA,
          <fpage>809</fpage>
          -
          <lpage>846</lpage>
          . https://doi.org/10.1007/978-1-
          <fpage>4899</fpage>
          -7637-6_
          <fpage>24</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Mete</surname>
            <given-names>Sertkan</given-names>
          </string-name>
          , Julia Neidhardt, and
          <string-name>
            <given-names>Hannes</given-names>
            <surname>Werthner</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Mapping of Tourism Destinations to Travel Behavioural Patterns</article-title>
          .
          <source>In Information and Communication Technologies in Tourism</source>
          <year>2018</year>
          ,
          <string-name>
            <given-names>Brigitte</given-names>
            <surname>Stangl</surname>
          </string-name>
          and Juho Pesonen (Eds.). Springer International Publishing, Cham,
          <fpage>422</fpage>
          -
          <lpage>434</lpage>
          . https://doi.org/10.1007/ 978-3-
          <fpage>319</fpage>
          -72923-7_
          <fpage>32</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Kadri</surname>
            <given-names>Sylejmani</given-names>
          </string-name>
          , Jürgen Dorn, and
          <string-name>
            <given-names>Nysret</given-names>
            <surname>Musliu</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Planning the trip itinerary for tourist groups</article-title>
          .
          <source>Information Technology &amp; Tourism</source>
          <volume>17</volume>
          ,
          <issue>3</issue>
          (Sept.
          <year>2017</year>
          ),
          <fpage>275</fpage>
          -
          <lpage>314</lpage>
          . https://doi.org/10.1007/s40558-017-0080-9
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>Nava</given-names>
            <surname>Tintarev</surname>
          </string-name>
          and
          <string-name>
            <given-names>Judith</given-names>
            <surname>Masthof</surname>
          </string-name>
          .
          <year>2007</year>
          .
          <article-title>A Survey of Explanations in Recommender Systems</article-title>
          .
          <source>In 2007 IEEE 23rd International Conference on Data Engineering Workshop</source>
          . IEEE,
          <fpage>801</fpage>
          -
          <lpage>810</lpage>
          . https://doi.org/10.1109/ICDEW.
          <year>2007</year>
          .4401070
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>Pieter</given-names>
            <surname>Vansteenwegen and Dirk Van Oudheusden</surname>
          </string-name>
          .
          <year>2007</year>
          .
          <article-title>The Mobile Tourist Guide: An OR Opportunity</article-title>
          .
          <source>OR Insight 20, 3 (July</source>
          <year>2007</year>
          ),
          <fpage>21</fpage>
          -
          <lpage>27</lpage>
          . https://doi.org/ 10.1057/ori.
          <year>2007</year>
          .17
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <surname>Wolfgang</surname>
            <given-names>Wörndl</given-names>
          </string-name>
          , Alexander Hefele, and
          <string-name>
            <given-names>Daniel</given-names>
            <surname>Herzog</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Recommending a sequence of interesting places for tourist trips</article-title>
          .
          <source>Information Technology &amp; Tourism</source>
          <volume>17</volume>
          ,
          <issue>1</issue>
          (Feb.
          <year>2017</year>
          ),
          <fpage>31</fpage>
          -
          <lpage>54</lpage>
          . https://doi.org/10.1007/s40558-017-0076-5
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <surname>Min</surname>
            <given-names>Xie</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laks</surname>
            <given-names>V.S.</given-names>
          </string-name>
          <string-name>
            <surname>Lakshmanan</surname>
          </string-name>
          , and
          <string-name>
            <surname>Peter</surname>
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Wood</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Breaking out of the Box of Recommendations: From Items to Packages</article-title>
          .
          <source>In Proceedings of the Fourth ACM Conference on Recommender Systems (RecSys '10)</source>
          . ACM, New York, NY, USA,
          <fpage>151</fpage>
          -
          <lpage>158</lpage>
          . https://doi.org/10.1145/1864708.1864739
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>Andrew</given-names>
            <surname>Yiannakis</surname>
          </string-name>
          and
          <string-name>
            <given-names>Heather</given-names>
            <surname>Gibson</surname>
          </string-name>
          .
          <year>1992</year>
          .
          <article-title>Roles tourists play</article-title>
          .
          <source>Annals of Tourism Research</source>
          <volume>19</volume>
          , 2 (jan
          <year>1992</year>
          ),
          <fpage>287</fpage>
          -
          <lpage>303</lpage>
          . https://doi.org/10.1016/
          <fpage>0160</fpage>
          -
          <lpage>7383</lpage>
          (
          <issue>92</issue>
          )
          <fpage>90082</fpage>
          -
          <lpage>z</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>