<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>CHIP Demonstrator: Semantics-driven Recommendations and Museum Tour Generation</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Lora Aroyo</string-name>
          <email>l.m.aroyo@cs.vu.nl</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Natalia Stash</string-name>
          <email>n.v.stash@tue.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yiwen Wang</string-name>
          <email>y.wang@tue.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peter Gorgels</string-name>
          <email>p.gorgels@rijksmuseum.nl</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lloyd Rutledge</string-name>
          <email>Lloyd.Rutledge@cwi.nl</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Eindhoven University of Technology</institution>
          ,
          <addr-line>Computer Science</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Rijksmuseum Amsterdam</institution>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Telematica Institute</institution>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>VU University Amsterdam</institution>
          ,
          <addr-line>Computer Science</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>The main objective of the CHIP project is to demonstrate how Semantic Web technologies can be deployed to provide personalized access to digital museum collections. We illustrate our approach with the digital database ARIA of the Rijksmuseum Amsterdam5. For the semantic enrichment of the Rijksmuseum ARIA database we collaborated with the CATCH STITCH project6 to produce mappings to Iconclass7, and with the MultimediaN E-culture project8 to produce the RDF/OWL of the ARIA and Adlib databases. The main focus of CHIP is on exploring the potential of applying adaptation techniques to provide personalized experience for the museum visitors both on the Web site and in the museum. This resulted in three demonstrator components: - Artwork Recommender - a Web-based rating dialog to build a user profile, based on semantics-driven recommendations. - Tour Wizard - a Web-based tool using the user profile to generate automatically personalizated museum tours for each user, and to (semi)-automatically generate various personalized routes through the digital Rijksmuseum collection. - Mobile Tour - a PDA-based tool, which uses the results from the Tour Wizard and helps users navigate and discover artworks in the physical Rijksmuseum environment. The online version of the CHIP demonstrator as well as a tutorial with a brief walk-through of the personalization functionality can be found at: http://www.chipproject.org/demo/.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Further, we give a short introduction to the basic functionality of the
Webbased parts of the CHIP demosntrator. Please note that the CHIP project
collects feedback, on the functionality and usability of the demonstrator, on a
regular basis from studies with museum visitors. Thus, the demonstrator changes
over time as we are incorporating more functionalities and improvements to the
interface.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Usage Scenario: You Rate - We Recommend</title>
      <p>In fig. 1 we illustrates how we employ semantics in building user profiles and
using them for generating recommendations to the user, as a way of guiding
users through the museum collection. In the Artwork Recommender, the user
rates an artwork and several proporties:
– artwork Night Watch - 4 stars (i.e. ‘‘I like Night Watch’’);
– creator property Rembrandt - 4 stars (i.e. ‘‘I like Rembrandt’’);
– theme property Landscape - 4 stars (i.e. ‘‘I like landscape’’);
– theme property Self-portrait - 1 star (i.e. ‘‘I hate self-portrait’’).
The User Profile stores the user’s ratings for generating recommendations.
Now, let’s see how does the artwork and topic recommendation in CHIP work:
– Find all Night Watch-related properties, e.g. creator, creation place, creation
year, material and themes
– Find all Rembrandt -related properties, e.g. style, teacher-of and student-of.
– Find all artworks with these properties, e.g. The Jewish Bride and The Stone</p>
      <p>Bridge by Rembrandt
– Include all artworks with property Landscape, e.g. The Stone Bridge and</p>
      <p>Meadow Landscape
– Exclude all artworks with property Self-portrait, e.g. Self-portrait of Van
Gogh and Self-portrait at an early age</p>
      <sec id="sec-2-1">
        <title>This results in two sets of recommendations:</title>
        <p>– Result: recommend all artworks with the above positively rated properties.</p>
        <p>All recommended artworks are ordered by the number of matching
properties, e.g. The Stone Bridge is the first one because it has both Rembrandt
and landscape.
– Result: recommend all topics with the above positively rated properties, e.g.</p>
        <p>Rembrandt, Landscape and Baroque</p>
      </sec>
      <sec id="sec-2-2">
        <title>Two more usage scenarios are give in the online tutorial.</title>
        <p>3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>CHIP Architecture</title>
      <p>
        The demo is based on a Sesame [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] RDF store with SeRQL-based access to user
modeling, recommendation and tour generation components. The tour
generation component consists of two main parts: (1) a semantic-search facility for the
user to search for themes or topics of a possible tour (e.g. a search for Rembrandt
will result in a sub-set of Rembrandt artworks which are of interest to this user
according to her user profile); and (2) my tours visualization on a historical
timeline, museum map or as a list of artworks. In the latter the user can also
manually create a tour by giving it a name and then continuing with the search
option to find single artworks to include in the currently created tour holder. In
fig. 2 we show the current CHIP architecture and its sub-components.
      </p>
      <p>Fig. 2. CHIP Demonstrator Architecture
3.1</p>
      <p>
        Rijksmuseum Amsterdam Collection and Shared Vocabularies
Currently, the demonstrator hosts four thesauri, namely the three Getty
vocabularies9, i.e., the Art and Architecture Thesaurus (AAT), Union List of Artists
Names (ULAN) and the Thesaurus of Geographical Names (TGN), as well as
the subject classification Iconclass10. We use mappings to IconClass provided
by the STITCH project [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. We use the Getty thesauri conversion from their
original XML format into an RDF/OWL representation done by the
MultimediaN E-culture project [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. The Getty thesauri are licensed11. Following this
approach we use mappings of the ARIA terminology to the AAT, ULAN, TGN
and IconClass concepts. For example, the concepts for places in ARIA refer
to location terms in TGN; styles in AAT are linked to artists in ULAN; birth
places of artists in ULAN refer to location terms in TGN; subject themes in
ARIA refer to subjects in IconClass; names of artists in ARIA refer to ULAN
artists, etc. See fig. 3. We use the official ARIA collection of the Rijksmuseum
in Amsterdam containing images of some 750 master pieces maintained at the
Rijksmuseum Amsterdam website. However, we are now preparing for a
migration to the main Oracle database of about 70,000 objects, extending the current
RDF/OWL with not only more artworks but also shop, news and user comments
items. The current client interface is developed in HTML+CSS and Ajax [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>Build Your Profile with Artwork Recommender</title>
      <p>
        The user can start the exploration by first building a user profile in the Artwork
Recommender component. This is driven by a rating dialog [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] for artworks from
9 http://www.getty.edu/research/conducting research/vocabularies
10 http://www.iconclass.nl/libertas/ic?style=index.xsl
11 The partners in the project have acquired licenses for the thesauri. People using the
demonstrator do not have access to the full thesauri sources, but can use them to
annotate and/or search the collections.
the Rijksmuseum Amnsterdam collection. The user can express her opinion using
five stars, where the meaning of each star is shown when you hover the cursor over
it. Next to a rating the user can indicate for each artwork whether to be used in
further recommendations or not, by using the checkbox Not interested in. Rated
artworks checked as not interested in will not influence the recommendations.
The user can continue the process of rating artworks as long as she is satisfied
with the state of the user profile shown on the right, or as long as the set of
recommended artworks shown in the lower right part of the screen seem relevant.
The user can skip rating artworks by pressing the Next artwork button. There
is no avarage number of artworks the user needs to rate. In order to kick off the
recommendations the user needs to give at least one positive (3, 4 or 5 stars)
rating. The system would not be able to recommend artworks and topics based
only on negative (1 or 2 stars) ratings.
      </p>
      <p>Important here is that we recommend not only artworks but also topics
(based on the semantic description of each artwork you have already rated).
The user can provide her positive or negative feedback to each recommendation
(both topics and artworks) by rating the empty set of stars associated with it.
This would be recorded then in the user profile in order to increase the level of
certainty for related properties and artworks.</p>
      <p>
        If the user is logged with a FOAF profile in the option to view the full user
profile (right top) will show the user’s personal and social network data. In the
full profile we also store the history interaction data about tours that this user
has created and/or followed both on the Web and in the museum with the
PDAbased mobile tour. Current investigations focus on including also social filtering
[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] in order to include social aspects in recommendation and to optimize specific
cold-start problems.
      </p>
      <p>
        In this interactive way [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] the user has the opportunity to quickly get a feeling
of the Rijksmuseum collection and give her opinion on the paintings presented.
Based on a user rating the system finds artworks from the Rijksmuseum
collection that are the most probable candidates for this user to like. See fig. 4 for a
screenshot of the recommender user interface.
5
      </p>
    </sec>
    <sec id="sec-5">
      <title>Create and Personalize Your Tours with Tour Wizard</title>
      <p>The main rationale behind the CHIP demonstrator is based on the assumption
that users more and more will spend time preparing their visits to museums
and also reflecting on them after the visit. This is driven by the observation that
users have an increasing choice of digitalized collections and related information.
This leads us to our main goal to allow the users to be their own currators,
e.g. selecting the artworks they want to see, influencing the order, the overall
theme of the tour and the time to be spent in the museum. In order to realize
this we maintain a common user profile for the user on the Web and on the
mobile device, and in this way we keep track of users interaction history both in
the virtual and in the physical museum.</p>
      <p>In the Tour Wizard you have two main screens (tabs):
– My Tours: Here the user can see an overview of the current tours and can
create a new tour if desired. She can (1) select a tour and then (2) search for
a topic, artist or an artwork to include further new items in the currently
selected tour. Note that if you go straight to the search option you will not
be able to add new items to your tours; you will be able to only search for
topics, artworks or artists and browse through the search results. Among the
already existing tours we generate for each user a Tour of Recommended
Artworks, which contains 20 Rijksmuseum master pieces selected according
to user’s current user profile. If further interaction with the demo appears,
the user profile will be altered and in this way the tour of recommended
artworks will be updated as well. Each tour can be viewed by the user as a
list and on a Museum Map (see fig. 5) or on a Historical Timeline (see
fig. 6).
– Search Results: Here the user can search the Rijksmuseum collection for
topics, artists, locations, styles, artworks, etc. and browse the search results.
Idealy these results will be altered (filtered with) according to the user profile,
so that she will see the artworks related to her search query, which are of
relevance and interest to the user. However this option is still in
work-inprogress, so it might not work properly yet. Note that if you first do search
and then (while browsing the results) you want to add some of them to
an existing tour, you will not be able to do so. Unfortunately, the current
interface implementation restricts the user to first select a tour and then
perform a search for artworks to be included in this tour. We are
working on improving this interface limitation, so that you are able to add
at any point of time an artwork from the search result (or even from your
Artwork Recommender interface) to an existing tour.</p>
      <p>Acknowledgements. The CHIP (Cultural Heritage Information
Personalization) project is funded by the Dutch Science Foundation funded program CATCH
(Continuous Access to Cultural Heritage) in the Netherlands.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Broekstra</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kampman</surname>
          </string-name>
          , A.,
          <string-name>
            <surname>van Harmelen</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Sesame: A generic architecture for storing and querying rdf and rdf schema</article-title>
          . (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. van Gendt,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Isaac</surname>
          </string-name>
          , A.,
          <string-name>
            <surname>van der Meij</surname>
          </string-name>
          , L.,
          <string-name>
            <surname>Schlobach</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Semantic web techniques for multiple views on heterogeneous collections: A case study</article-title>
          .
          <source>In: ECDL'06: Proceedings of the International ECDL'06 Conference</source>
          , Berlin / Heidelberg, Springer (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3. van Assem,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Menken</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Schreiber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Wielemaker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Wielinga</surname>
          </string-name>
          ,
          <string-name>
            <surname>B.</surname>
          </string-name>
          :
          <article-title>A method for converting thesauri to rdf/owl</article-title>
          . In
          <source>: ISWC '04: Proceedings of the International Semantic Web Conference</source>
          , Berlin / Heidelberg, LNCS 3298 Springer (
          <year>2006</year>
          )
          <fpage>17</fpage>
          -
          <lpage>31</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Schreiber</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Amin</surname>
            , A., van Assem,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>de Boer</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hardman</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hildebrand</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hollink</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Huang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          , van Kersen, J., de Niet,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Omelayenko</surname>
          </string-name>
          , B.,
          <string-name>
            <surname>van Ossenbruggen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Siebes</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Taekema</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wielemaker</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wielinga</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Multimedian e-culture demonstrator</article-title>
          .
          <source>In: ISWC '06: Proceedings of the International Semantic Web Conference</source>
          , Berlin / Heidelberg, LNCS 4273 Springer (
          <year>2006</year>
          )
          <fpage>951</fpage>
          -
          <lpage>958</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Garrett</surname>
            ,
            <given-names>J.J.:</given-names>
          </string-name>
          <article-title>Ajax: A new approach to web applications</article-title>
          . http://www.adaptivepath.com/publications/essays/archives/000385.php (
          <year>February 2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aroyo</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stash</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rutledge</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Interactive user modeling for personalized access to museum collections: The rijksmuseum case study</article-title>
          .
          <source>In: UM'07: Proceedings of the International User Modeling Conference</source>
          , Berlin / Heidelberg, Springer (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. van Setten,
          <string-name>
            <surname>M.</surname>
          </string-name>
          :
          <article-title>Supporting people in finding information: Hybrid recommender systems and goal-based structuring</article-title>
          .
          <source>Telematica Instituut Fundamental Research Series</source>
          , No.
          <volume>016</volume>
          (TI/FRS/016). Universal Press. (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Rutledge</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aroyo</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stash</surname>
          </string-name>
          , N.:
          <article-title>Determining user interests about museum collections</article-title>
          .
          <source>In: WWW'06: Proceedings of the International WWW'06 Conference (poster)</source>
          , Berlin / Heidelberg, Springer (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>