<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Using Gaussian Spatial Processes to Model and Predict Interests in Museum Exhibits</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Fabian Bohnert</string-name>
          <email>fabianb@infotech.monash.edu.au</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ingrid Zukerman</string-name>
          <email>ingrid@infotech.monash.edu.au</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Daniel F. Schmidt</string-name>
          <email>dschmidt@infotech.monash.edu.au</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Faculty of Information Technology, Monash University Clayton</institution>
          ,
          <addr-line>VIC 3800</addr-line>
          ,
          <country country="AU">Australia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper adapts models from the area of spatial statistics to the task of predicting a user's interests (i. e., implicit item ratings) within a recommender system in the museum domain. We develop a model based on Gaussian spatial processes, and discuss two ways of computing item-to-item distances in the museum setting. Our model was evaluated with a real-world dataset collected by tracking visitors in a museum. Overall, our model attains a higher predictive accuracy than nearestneighbour collaborative filters. In addition, the model variant using physical distances outperforms that using distances computed from item-to-item similarities.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Spatial processes (random fields) are a subclass of stochastic
processes which are applied to domains that have a
geospatial interpretation, e. g., [Diggle et al., 1998; Banerjee et al.,
2004]. They are typically used in the field of spatial statistics
to model spatial associations between a set of observations
made at certain locations, and to predict values at locations
where no observations have been made. This paper applies
such models to the prediction of a user’s interests or item
ratings in recommender systems (RS). We develop our Spatial
Process Model (SPM) by adapting a Gaussian spatial process
model to the RS scenario, and demonstrate our model’s
applicability to the task of predicting implicit ratings in the
museum domain. The use of spatial processes requires a measure
of distance between items in addition to users’ ratings. This
measure, which is non-specific (e. g., it may be a physical or
a conceptual distance), can be readily obtained in most cases.
For example, distances could be computed from feature
vectors representing the items (similarly to content-based RS),
from item-to-item similarities
        <xref ref-type="bibr" rid="ref19">(similarly to item-to-item
collaborative filtering [Sarwar et al., 2001])</xref>
        , or from physical
distance. In this paper, we explore the latter two measures.
      </p>
      <p>Our application scenario is motivated by the need to
automatically recommend exhibits to museum visitors, based
on non-intrusive observations of their actions in the
physical space. Employing RS in this scenario is challenging due
to (1) the physical nature of the domain, (2) having exhibit
viewing times rather than explicit ratings, and (3) predictions
differing from recommendations (we do not want to
recommend exhibits that visitors are going to see anyway). We turn
the first challenge into an advantage by exploiting the fact
that physical distances between exhibits are meaningful,
enabling the use of walking distance between exhibits to
calculate (content) distance. This supports the direct, interpretable
application of spatial processes by using a simple
parametric Gaussian spatial process model (with the ensuing low
variance in parameter estimates), compared to more complex
non-parametric approaches, e. g., [Schwaighofer et al., 2005].
The second challenge, which stems from the variable
semantics of viewing times (time t for different exhibits could mean
interest or boredom), is naturally addressed by SPM’s
structure. The third challenge can be addressed by (a) using SPM
to build a model of a visitor’s interests in unseen exhibits,
(b) inferring a predictive model of a visitor’s pathway through
the remainder of the museum [Bohnert et al., 2008], and
(c) combining these models to recommend exhibits of interest
that may be overlooked if the predicted pathway is followed.</p>
      <p>SPM was evaluated with a real-world dataset of time spans
spent by museum visitors at exhibits (viewed as implicit
ratings). We compared our model’s performance to that of (1) a
baseline model which delivers a non-personalised prediction,
and (2) a nearest-neighbour collaborative filter
incorporating performance-enhancing modifications, e. g., [James and
Stein, 1961; Herlocker et al., 1999]. Our results show that
SPM significantly outperforms both models.</p>
      <p>The paper is organised as follows. In Section 2, we discuss
related research. Section 3 describes our domain and dataset.
Our spatial processes approach for modelling and predicting
exhibit interests is developed in Section 4. In Section 5, we
present the results of our evaluation, followed by a discussion
in Section 6 and our conclusions in Section 7.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Related Research</title>
      <p>Recommender systems (RS) are designed to direct users to
personally interesting items in situations where the amount
of available information exceeds the users’ processing
capability [Resnick and Varian, 1997; Burke, 2002]. Typically,
such systems (1) use information about a user (i. e., a user
model) to predict ratings of items that the user has not yet
considered, and (2) recommend suitable items based on these
predictions. Collaborative modelling techniques constitute
one of the main model classes applied in RS [Albrecht and
Zukerman, 2007]. They base their predictions upon the
assumption that users who have agreed in their behaviour in the
past will agree in the future.</p>
      <p>The greatest strength of collaborative approaches is that
they are independent of any representation of the items being
recommended, and work well for complex objects, for which
features are not readily apparent. The two main collaborative
approaches are memory-based and model-based. Previous
research has mainly focused on memory-based approaches,
such as nearest-neighbour models (classic collaborative
filtering), e. g., [Herlocker et al., 1999]. The main drawback of
memory-based algorithms is that they operate over the entire
user database to make predictions. In contrast, model-based
approaches use techniques such as Bayesian networks,
latentfactor models and artificial neural networks, e. g., [Breese et
al., 1998; Bell et al., 2007], to first learn a statistical model
in an offline fashion, and then use it to make predictions and
generate recommendations. This decomposition can
significantly speed up the recommendation generation process.</p>
      <p>Personalised guide systems in physical domains have
often employed adaptable user models, which require visitors
to explicitly state their interests in some form. For example,
the GUIDE project [Cheverst et al., 2002] developed a
handheld tourist guide for visitors to the city of Lancaster, UK.
It employed a user model obtained from explicit user input
to generate a dynamic and user-adapted city tour, where the
order of the visited items could be varied. In the museum
domain, the CHIP project [Aroyo et al., 2007] investigates how
Semantic Web techniques can be used to provide personalised
access to digital museum collections both online and in the
physical museum, based on models that require an explicit
initialisation.</p>
      <p>Less attention has been paid to predicting preferences
from non-intrusive observations, and to utilising adaptive user
models that do not require explicit user input. In the museum
domain, adaptive user models are usually updated from a
user’s interactions with the system, the focus being on
adapting content presentation as opposed to predicting and
recommending exhibits to be viewed. For example,
HyperAudio [Petrelli and Not, 2005] dynamically adapted the
presented content and hyperlinks to stereotypical assumptions
about a user, and to what a user has already accessed and
seems interested in. The augmented audio reality system for
museums ec(h)o [Hatala and Wakkary, 2005] treated user
interests in a dynamic manner, and adapted its user model on
the basis of a user’s interactions with the system. The
collected user modelling data were used to deliver personalised
information associated with exhibits via audio display. The
PEACH project [Stock et al., 2007] developed a multimedia
handheld guide which adapts its user model on the basis of
both explicit visitor feedback and implicit observations of a
visitor’s interactions with the device. This user model was
then used to generate personalised multimedia presentations.</p>
      <p>These systems, like most systems in the museum domain,
rely on knowledge-based user models in some way, and
hence, require an explicit, a-priori engineered representation
of the domain knowledge. In contrast, our research
investigates non-intrusive statistical user modelling and
recommendation techniques that do not require such an explicit domain
knowledge representation [Albrecht and Zukerman, 2007].
3</p>
    </sec>
    <sec id="sec-3">
      <title>Domain and Dataset</title>
      <p>The GECKO project endeavours to develop user modelling
and personalisation techniques for information-rich physical
spaces, relying on non-intrusive observations of users’
behaviour [Bohnert et al., 2008]. Developing such non-intrusive
user modelling and personalisation techniques for museums
requires datasets about visitor behaviour in the physical
museum space (i. e., visitor pathways). Datasets that are suitable
for the development phase can be obtained by manually
tracking museum visitors. Such a data collection methodology is
clearly inappropriate for model deployment, but it facilitates
model development by eschewing issues related to
technology selection and instrumentation accuracy.</p>
      <p>Museums such as Melbourne Museum (Melbourne,
Australia) display thousands of exhibits distributed over many
separate galleries and exhibitions. Normally, visitors do not
require recommendations to travel between individual,
logically related exhibits in close physical proximity. Rather, they
may prefer recommendations regarding physically separated
areas. In order to gather data for assessing predictive models
that support appropriate recommendations, we grouped
Melbourne Museum’s individual exhibits into semantically
coherent and spatially confined exhibit areas. This task, which
was performed with the assistance of museum staff, yielded
126 exhibit areas. Figure 1 depicts the site map of Melbourne
Museum showing these exhibit areas, together with one of the
visitor pathways we collected.</p>
      <p>To obtain our dataset, we manually tracked visitors to
Melbourne Museum from April to June 2008, using a
custommade tracking tool running on laptop computers [Bohnert and
Zukerman, 2009]. In total, we recorded over 170 visitor
pathways. We only tracked first-time adult visitors travelling on
their own, to ensure that neither prior knowledge about the
museum nor other visitors’ interests influenced a visitor’s
decisions about which exhibits to view. Prior to the data
collection, we briefed our trackers on the usage of our tracking
software, the layout of the museum, and its digital
representation on the site map. Additionally, we clarified what should
be considered a viewing event. After the data collection, the
visitor pathways were post-processed using a post-processing
tool we developed. For instance, we removed tracking events
that could not have possibly occurred, e. g., visitor transitions
from one end of the museum to the other and back within
a few seconds, or transitions outside the museum walls and
back. We also removed incomplete visitor pathways, e. g.,
due to a laptop computer running out of battery, or a
visitor leaving unexpectedly. The resulting dataset comprises
158 complete visitor pathways in the form of time-annotated
sequences of visited exhibit areas, with a total visit length
of 291:22:37 hours, and a total viewing time of 240:00:28
hours. The dataset also contains demographic information
about the visitors, which was obtained by means of post-visit
interviews conducted by our trackers. In total, we obtained
8327 viewing durations at the 126 exhibit areas, yielding an
average of 52:7 exhibit areas per visitor (41:8% of the exhibit
(a) Melbourne Museum – Ground level
(b) Melbourne Museum – Upper level
areas). Hence, on average 58:2% of the exhibit areas were
not viewed by a visitor. This indicates that there is potential
for pointing a visitor to relevant but unvisited exhibit areas.
Table 1 summarises further statistics of the dataset.</p>
      <p>
        Clearly, the deployment of an automated RS in a museum
requires suitable positioning technologies to non-intrusively
track visitors, and models to infer which exhibits are being
viewed. Although our dataset was obtained manually, it
provides information of the type that may be inferred from
sensing data
        <xref ref-type="bibr" rid="ref20 ref5 ref7">(the work described in [Schmidt et al., 2009] links
sensory and manually obtained information)</xref>
        . Additionally,
the results obtained from experiments with this dataset are
essential for model development, as they provide an upper
bound for the predictive performance of our model.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>Using Gaussian Spatial Processes to Model and Predict Visitors’ Exhibit Interests</title>
      <p>In this section, we first describe how we use viewing time to
quantify interest in exhibits (Section 4.1), and discuss the
applicability of spatial process models [Banerjee et al., 2004]
to the prediction of a visitor’s interest in exhibits in our RS
scenario (Section 4.2). We then propose a model-based
collaborative approach based on the theory of Gaussian
spatial processes for predicting a visitor’s (log) viewing times
(viewed as exhibit interests) from non-intrusive observations
of his/her (log) viewing times at visited exhibits (Section 4.3).
4.1</p>
      <sec id="sec-4-1">
        <title>From Viewing Time to Exhibit Interest</title>
        <p>In an information-seeking context, people usually spend more
time on relevant information than on irrelevant information,
as viewing time correlates positively with preference and
interest [Parsons et al., 2004]. Hence, viewing time can be used
as an indirect measure of interest. We propose to use log
viewing time (instead of raw viewing time), due to the
following reasons. When examining our dataset (Section 3), we
found the distributions of viewing times at exhibits to be
positively skewed (we use the terms ‘exhibit’ and ‘exhibit area’
synonymously in the remainder of this paper). Thus, the usual
assumption of a Gaussian model did not seem appropriate. To
select a more appropriate family of probability distributions,
we used the Bayesian Information Criterion (BIC) [Schwarz,
1978]. We tested exponential, gamma, normal, log-normal
and Weibull distributions. The log-normal family fitted best,
with respect to both number of best fits and average BIC score
(averaged over all exhibits). Hence, we transformed all
viewing times to their log-equivalent to obtain approximately
normally distributed data. This transformation fits well with the
idea that for high viewing times, an increase in viewing time
indicates a smaller increase in the modelled interest than a
similar increase in the context of low viewing times.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Spatial Statistics in the Context of Our</title>
      </sec>
      <sec id="sec-4-3">
        <title>Application Scenario</title>
        <p>
          Spatial statistics is concerned with the analysis and
prediction of geographic data [Banerjee et al., 2004]. Utilising
spatial processes, the field deals with tasks such as modelling the
associations between observations made at certain locations,
and predicting values at locations where no observations have
been made. The assumption made for spatial processes, that
correlation between observations increases with decreasing
site distance, fits well with our RS scenario, where viewing
times are usually more correlated the more related exhibits
are. Hence, by introducing a notion of spatial distance
between exhibits to functionally specify this correlation
structure, we can use spatial process models for predicting
viewing times (i. e., exhibit interests). We use s1; : : : ; sn to
denote the locations of exhibits i; j 2 I = f1; : : : ; ng in a
space providing such a distance measure, i. e., ksi sj k. For
example, ksi sj k can be computed from feature vectors
representing the items (similarly to content-based RS), from
item-to-item similarities
          <xref ref-type="bibr" rid="ref19">(similarly to item-to-item
collaborative filtering [Sarwar et al., 2001])</xref>
          , or from physical distance.
In this paper, we explore the two latter options: Item-to-Item
Distance and Physical Distance.
        </p>
        <p>Item-to-Item Distance (I2I). Item-to-item collaborative
filtering [Sarwar et al., 2001] utilises a database of
ratings to compute item-to-item similarities, and predicts
a current user’s rating of an unseen item from his/her
ratings of those items that are most similar to the item
in question. Inspired by how item-to-item similarities
are computed in this process, we use the observed log
viewing times to derive the I2I distance measure as
follows. We first transform the log viewing times into
zscores by normalising the values for each visitor
separately. This ensures that varying viewing behaviour does
not affect the similarity computation.1 Secondly, we
calculate item-to-item similarities using Pearson’s
correlation coefficient on the normalised log viewing times of
exhibits i and j (using only the normalised log viewing
times of those visitors that have viewed both exhibits i
and j). The resulting similarity value from within the
interval [ 1; 1] is finally transformed into a distance
measure by mapping it onto a value in [0; 1] (a similarity
value of 1 yields a distance of 1, and a similarity of 1
yields a distance of 0).</p>
        <p>Physical Distance (PD). Museums are carefully themed
by curatorial staff, such that closely-related exhibits are
in physical proximity. Based on this observation, we
hypothesise that physical walking distance between
exhibits is inversely proportional to their (content)
similarity. Thus, we use physical walking distance PD as
a measure of distance between exhibits. Specifically,
a SVG file-based representation of Melbourne Museum
was used to calculate the walking distances by mapping
the site map (Figure 1) onto a graph structure which
preserves the physical layout of the museum (i. e.,
preventing paths from passing through walls or ceilings). We
normalised the resulting distances to the interval [0; 1].
4.3</p>
      </sec>
      <sec id="sec-4-4">
        <title>Our Gaussian Spatial Process Model</title>
        <p>In this section, we utilise theory from the area of spatial
statistics (Section 4.2) to formulate a Gaussian spatial process
model, called Spatial Process Model (SPM), for predicting a
museum visitor’s interests in unseen exhibits (i. e., log
viewing times) from his/her viewing behaviour at visited exhibits.</p>
        <p>Let U = f1; : : : ; mg be the set of all visitors, and
I = f1; : : : ; ng be the set of all items. Typically, for a
visitor u 2 U , we have viewing times for only a subset of I , say
for nu exhibits. Denoting a visitor’s log viewing time
vector with ru, we collect all observed log viewing times into a
vector r = (r1; : : : ; rm) of dimension Pm
u=1 nu. Associated
with each exhibit i 2 I is a log viewing time mean i and
a standard deviation i. Let = ( 1; : : : ; n) be the vector
of mean log viewing times, and = ( 1; : : : ; n) the vector
of standard deviations. Furthermore, u and u are the
vectors of means and standard deviations respectively for only
those exhibits viewed by a visitor u. For example, if visitor 1
1We also tested a variant of the I2I measure without visitor-wise
normalisation. However, this variant yielded inferior results.
viewed exhibits 2, 3, 7 and 9, then 1 = ( 2; 3; 7; 9) and
1 = ( 2; 3; 7; 9).</p>
        <p>
          Similarly to spatial processes, SPM assumes a special
correlation structure between the viewing times of different
exhibits. In our experiments, we use a powered
exponential [Banerjee et al., 2004]:
(ksi
sj k; ; ) = exp (
( ksi
sj k) ) ,
where &gt; 0 and 0 &lt; &lt; 2. That is, (ksi sj k; ; )
models the correlation between the log viewing times of
exhibits i and j ( (ksi sj k; ; ) depends on the sites si
and sj of exhibits i and j only through the distance
ksi sj k). Let H ( ; ) be a correlation matrix with
components (H ( ; ))ij = (ksi sj k; ; ) collecting all these
correlations, and let Hu( ; ) denote a visitor u’s correlation
matrix (dimension nu nu). That is, Hu( ; ) corresponds
to H ( ; ) without the rows and columns for unvisited
exhibits. Also, let = ; ; 2; ; be a vector representing
the 2n + 3 model parameters, where 2 denotes the variance
of non-spatial error terms necessary to fully specify the model
(these terms model non-spatial variation in the data). Then,
modelling the data using Gaussian spatial processes
          <xref ref-type="bibr" rid="ref20 ref5 ref7">(a
detailed derivation appears in [Bohnert et al., 2009])</xref>
          , r given
is multivariate normal of dimension Pm
u=1 nu. As the
viewing times of different visitors u = 1; : : : ; m are independent,
the model simplifies to
ru j
        </p>
        <p>N ( u;
u) for all u = 1; : : : ; m,
(1)
where u = u1nu Hu( ; ) u1nu + 21nu is a visitor u’s
covariance matrix, and 1nu is the identity matrix of
dimension nu nu.</p>
        <p>
          We employ Bayesian inference using SPM’s likelihood
function derived from Equation 1 to estimate from r
          <xref ref-type="bibr" rid="ref15">(in
particular, we use slice Gibbs sampling [Neal, 2003])</xref>
          . This
solution offers attractive advantages over the classic
frequentist approach, such as the opportunity of incorporating prior
knowledge into parameter estimation via the prior
distribution, and capturing the uncertainty about the parameters via
the posterior distribution.
        </p>
        <p>Given the model parameters = ; ; 2; ; , our
model is fully specified, and we can use standard
multivariate normal theory to predict a current visitor a’s log viewing
times of unseen exhibits, say ra;1, from a vector of observed
log viewing times ra;2. This is because (ra;1; ra;2) j is
normally distributed (similarly to Equation 1). If we use the
following notation
ra;1
ra;2
j</p>
        <p>N
a;1
a;2
;
a;11
T
a;12
a;12
a;22
then the conditional distribution p (ra;1jra;2; ) is normal
with mean vector and covariance matrix</p>
        <p>E (ra;1jra;2; )
Cov (ra;1jra;2; )
=
=
a;1 +
a;11
a;12 a;122 (ra;2</p>
        <p>1 T
a;12 a;22 a;12,
a;2) ,
where E (ra;1jra;2; ) represents a personalised prediction
of the log viewing times ra;1. Additionally, a measure
of confidence in this prediction can be easily derived from
Cov (ra;1jra;2; ), i. e., by using the variances on the
diagonal of this matrix.</p>
        <p>Being a model-based approach, SPM offers advantages
over memory-based collaborative filters. For instance, the
model parameters = ; ; 2; ; have a clear
interpretation, and the confidence measure provided by the model
supports an informed interpretation of the model’s
predictions. Additionally, recommendation generation is sped up by
decoupling the model-fitting phase from the prediction phase.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Evaluation</title>
      <p>This section reports on the results of an evaluation performed
with our dataset (Section 3), including comparison with a
nearest-neighbour collaborative filter.2
5.1</p>
      <sec id="sec-5-1">
        <title>Experimental Setup</title>
        <p>To evaluate the predictive performance of our Spatial Process
Model (SPM), we implemented two additional models: Mean
Model (MM) and Collaborative Filter (CF). MM, which we
use as a baseline, predicts the log viewing time of an
exhibit area i to be its (non-personalised) mean log viewing
time i. For CF, we implemented a nearest-neighbour
collaborative filtering algorithm, and added modifications from
the literature that improve its performance, such as
shrinkage to the mean [James and Stein, 1961] and significance
weighting [Herlocker et al., 1999]. Additionally, to ensure
that varying exhibit area complexity does not affect the
similarity computation for selecting the nearest neighbours
(viewing time increases with exhibit complexity), we transformed
the log viewing times into z-scores by normalising the values
for each of the exhibit areas separately. Visitor-to-visitor
differences with respect to their mean viewing durations were
removed by transforming predictions to the current visitor’s
viewing-time scale [Herlocker et al., 1999]. Refer to
[Bohnert and Zukerman, 2009] for a detailed description of CF. We
tested several thousand different parameterisations, but in this
paper, we report only on the performance of the best one.</p>
        <p>Due to the relatively small dataset, we used leave-one-out
cross validation to evaluate the performance of the different
models. That is, for each visitor, we trained the models with
a reduced dataset containing the data of 157 of the 158 visit
trajectories, and used the withheld visitor pathway for
testing. To train and instantiate the SPM variants (i. e., SPM-I2I
and SPM-PD), we obtained a sample of = ; ; 2; ;
from p( jr) by performing slice Gibbs sampling [Neal, 2003]
on the training data. For each of the 129 free model
parameters,3 we used (uninformative) independent uniform prior
distributions. We used every 20-th sample after a burn-in phase
of 1000 iterations as a sample of from p( jr), and stopped
the sampling procedure after 8000 iterations. Thus, in total,
we obtained 350 samples of from p( jr). This procedure
2For our experiments, we ignore travel between exhibit areas,
and collapse multiple viewing events of one area into one event.</p>
        <p>3We set i = q r2;i 2 to speed up the sampling process,
where 2</p>
        <p>r;i denotes the sample variance of the log viewing times at
exhibit i, calculated from the observed log viewing times rui. This
reduces the number of free parameters from 255 (126 2+3) to 129.
was followed to obtain samples of for both SPM variants,
i. e., for both distance measures I2I and PD (Section 4.2). We
then used the posterior means estimated from these samples
to compute predictions by conditioning a multivariate normal
distribution (Section 4.3). We improved SPM-I2I’s
predictive performance by using the (non-personalised) mean log
viewing time i as a prediction whenever the conditioning
would have been based on fewer than K log viewing times
(in our case, K = 19). This modification was not applied to
SPM-PD. For CF, predictions were computed from the
ratings of the nearest neighbours; and for MM, we used i,
estimated from the appropriate reduced dataset, as a prediction.</p>
        <p>We performed two types of experiments: Individual
Exhibit and Progressive Visit.</p>
        <p>Individual Exhibit (IE). IE evaluates predictive
performance for a single exhibit. For each observed
visitorexhibit area pair (u; i), we removed the observation rui
from the vector of visitor u’s log viewing durations, and
computed a prediction r^ui from the other observations.
This experiment is lenient in the sense that all available
observations except the observation for exhibit area i are
kept in a visitor’s viewing duration vector.</p>
        <p>Progressive Visit (PV). PV evaluates performance as a
museum visit progresses, i. e., as the number of viewed
exhibit areas increases. For each visitor, we started with
an empty visit, and iteratively added each viewed exhibit
area to the visit history, together with its log viewing
time. We then predicted the log viewing times of all yet
unvisited exhibit areas.</p>
        <p>For both experiments, we used the mean absolute error
(MAE) to measure predictive accuracy as follows:
MAE = P
1</p>
        <p>X X
u2U jIuj u2U i2Iu
jrui
r^uij,
where Iu denotes a visitor u’s set of exhibit areas for which
predictions were computed. For IE, we calculated the total
MAE for all valid visitor-exhibit area pairs; and for PV, we
computed the MAE for the yet unvisited exhibit areas for all
visitors at each time fraction of a visit (to account for different
visit lengths, we normalised all visits to a length of 1).
5.2</p>
      </sec>
      <sec id="sec-5-2">
        <title>Results</title>
        <p>Table 2 shows the results for the IE experiment, where both
spatial models (SPM-I2I and SPM-PD) outperform both MM
and CF. Specifically, SPM-I2I achieves an MAE of 0:7756
(stderr 0:0068), and SPM-PD attains an MAE of 0:7548
(stderr 0:0066), outperforming SPM-I2I as well. The
pairwise performance differences are statistically significant with
p 0:01 for all model pairings.</p>
        <p>The performance of SPM-PD, SPM-I2I, CF and the
baseline MM for the PV experiment is depicted in Figure 2. CF
outperforms MM slightly (statistically significantly for visit
fractions 0:191 to 0:374 and for several shorter intervals later
on, p &lt; 0:05). More importantly, both SPM-I2I and SPM-PD
perform significantly better than MM and CF. For SPM-I2I,
this performance increase is statistically significant for visit
fractions 0:189 to 0:960 when comparing to MM, and except</p>
      </sec>
      <sec id="sec-5-3">
        <title>Mean Model (MM)</title>
      </sec>
      <sec id="sec-5-4">
        <title>Collaborative Filter (CF)</title>
      </sec>
      <sec id="sec-5-5">
        <title>Spatial Process Model using I2I (SPM-I2I)</title>
      </sec>
      <sec id="sec-5-6">
        <title>Spatial Process Model using PD (SPM-PD)</title>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Discussion</title>
      <p>MAE
for a few short intervals, for visit fractions 0:375 to 0:902
when comparing to CF. In comparison, SPM-PD performs
significantly better than both MM and CF for visit fractions
0:019 to 0:922 (statistically significantly, p &lt; 0:05).
Additionally, SPM-PD outperforms SPM-I2I until visit fraction
0:660 (statistically significantly, p &lt; 0:05). Drawing
attention to the initial portion of the visits, SPM-PD’s MAE
decreases rapidly, whereas the MAE for MM and CF remains
at a higher level. Generally, the faster a model adapts to
a visitor’s interests, the more likely it is to quickly deliver
(personally) useful recommendations. Such behaviour in the
early stages of a museum visit is essential in order to build
trust in the RS, and to guide a visitor in a phase of the visit
where such guidance is most likely needed. A similar
improvement in performance cannot be observed for SPM-I2I,
which suggests that a visitor’s exhibit interests observed in
close physical proximity are better predictors of interests in
unseen exhibits than interests in exhibits with positively
correlated viewing times. As expected, MM performs at a
relatively constant MAE level. For CF, SPM-I2I and SPM-PD
we expected to see an improvement in performance
(relative to MM) as the number of visited exhibit areas increases.
However, this trend is rather subtle (it can be observed when
plotting the models’ performance relative to MM).
Additionally, for all four models, there is a performance drop towards
the end of a visit. We postulate that these phenomena may be
explained, at least partially, by the increased influence of
outliers on the MAE as the number of exhibit areas remaining to
be viewed is reduced with the progression of a visit. This
influence in turn offsets potential gains in performance obtained
from additional observations. Our hypothesis is supported by
a widening in the standard error bands for all models as a
visit progresses, in particular towards the end (not shown in
Figure 2 for clarity of presentation). However, this behaviour
requires further, more rigorous investigation.</p>
      <p>SPM offers advantages over other model-based approaches in
that, unlike neural networks (and memory-based techniques),
it returns the confidence in a prediction, and its parameters
have a clear interpretation; unlike Bayesian networks, our
model does not require a domain-specific adaptation, such
as designing the network topology. In addition, the
distance measure endows our model with capabilities of hybrid
RS [Burke, 2002; Albrecht and Zukerman, 2007] by
seamlessly supporting the incorporation of other types of models
(e. g., content-based). The distance measure also alleviates
the cold-start problem. The new-item problem is addressed
by utilising the (distance-based) correlation between this item
and the other items. The new-user problem is similarly
handled through the correlation between items rated by a user
and the other items (when utilising Physical Distance as the
distance measure, our model can make useful personalised
predictions after only one item has been rated).</p>
      <p>Our dataset is relatively small compared to other real-world
RS applications. Although a high number of ratings per user
slows down the slice Gibbs sampler due to repeated inversion
of matrices of high dimension, employing our model with
larger datasets should not represent a problem in practice.
This is because the number of ratings per user is usually small
compared to the number of users and items, and the
computational complexity of evaluating the likelihood function
depends only linearly on the number of users in the database.
7</p>
    </sec>
    <sec id="sec-7">
      <title>Conclusions and Future Work</title>
      <p>In this paper, we utilised the theory of spatial processes to
develop a model-based approach for predicting users’ interests
in exhibits (i. e., implicit item ratings) within a RS in the
museum domain. We applied our model to a real-world dataset
collected by tracking visitors in a museum, using two
measures of item-to-item (content) distance: (1) distances
computed from item-to-item similarities (as in item-to-item
collaborative filtering), and (2) physical walking distance. For
both distance measures, our model attains a higher predictive
accuracy than nearest-neighbour collaborative filters.
Additionally, the model variant using physical distances
outperforms that using distances computed from item-to-item
similarities. Under the realistic Progressive Visit setting, our
model using physical distance to measure item-to-item
distance rapidly adapts to a user’s ratings (starting from as little
as one rating), thus alleviating the new-user problem common
to collaborative filtering. This is not the case for the model
variant based on distance computed from item-to-item
similarities, which suggests that a visitor’s interests observed for
exhibits in close physical proximity are better predictors of
interests in unseen exhibits than those interests for exhibits
with positively correlated viewing times.</p>
      <p>In the future, we intend to hybridise our model by
incorporating content-based item features into our distance
measure, and to explore hybrids of models utilising a variety of
item-to-item distances. We also plan to extend our model
to fit non-Gaussian item ratings, e. g., [Diggle et al., 1998;
Yu et al., 2006].</p>
    </sec>
    <sec id="sec-8">
      <title>Acknowledgments</title>
      <p>This research was supported in part by grant DP0770931
from the Australian Research Council. The authors thank
Carolyn Meehan and her team from Museum Victoria for
their assistance; and David Abramson, Jeff Tan and Blair
Bethwaite for their help with the computer cluster.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <source>[Albrecht and Zukerman</source>
          , 2007]
          <string-name>
            <given-names>D.W.</given-names>
            <surname>Albrecht</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Zukerman.</surname>
          </string-name>
          <article-title>Introduction to the special issue on statistical and probabilistic methods for user modeling</article-title>
          .
          <source>User Modeling</source>
          and
          <string-name>
            <surname>User-Adapted</surname>
            <given-names>Interaction</given-names>
          </string-name>
          ,
          <volume>17</volume>
          (
          <issue>1-2</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [Aroyo et al.,
          <year>2007</year>
          ]
          <string-name>
            <given-names>L.</given-names>
            <surname>Aroyo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Stash</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Gorgels</surname>
          </string-name>
          , and
          <string-name>
            <surname>L. Rutledge.</surname>
          </string-name>
          <article-title>CHIP demonstrator: Semantics-driven recommendations and museum tour generation</article-title>
          .
          <source>In Proceedings of the Sixth International Conference on the Semantic Web (ISWC-07)</source>
          , pages
          <fpage>879</fpage>
          -
          <lpage>886</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [Banerjee et al.,
          <year>2004</year>
          ]
          <string-name>
            <given-names>S.</given-names>
            <surname>Banerjee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.P.</given-names>
            <surname>Carlin</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.E.</given-names>
            <surname>Gelfand</surname>
          </string-name>
          .
          <article-title>Hierarchical Modeling and Analysis for Spatial Data</article-title>
          . Chapman &amp; Hall/CRC,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [Bell et al.,
          <year>2007</year>
          ]
          <string-name>
            <given-names>R.</given-names>
            <surname>Bell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Koren</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Volinsky</surname>
          </string-name>
          . Chasing $
          <volume>1</volume>
          ,
          <issue>000</issue>
          ,000:
          <article-title>How we won the Netflix progress prize</article-title>
          .
          <source>ASA Statistical and Computing Graphics Newsletter</source>
          ,
          <volume>18</volume>
          (
          <issue>2</issue>
          ):
          <fpage>4</fpage>
          -
          <lpage>12</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <source>[Bohnert and Zukerman</source>
          , 2009]
          <string-name>
            <given-names>F.</given-names>
            <surname>Bohnert</surname>
          </string-name>
          and
          <string-name>
            <given-names>I.</given-names>
            <surname>Zukerman</surname>
          </string-name>
          .
          <article-title>Non-intrusive personalisation of the museum experience</article-title>
          .
          <source>In Proceedings of the 1st and 17th International Conference on User Modeling, Adaptation, and Personalization (UMAP-09)</source>
          , pages
          <fpage>197</fpage>
          -
          <lpage>209</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [Bohnert et al.,
          <year>2008</year>
          ]
          <string-name>
            <given-names>F.</given-names>
            <surname>Bohnert</surname>
          </string-name>
          , I. Zukerman,
          <string-name>
            <given-names>S.</given-names>
            <surname>Berkovsky</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Baldwin</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.</given-names>
            <surname>Sonenberg</surname>
          </string-name>
          .
          <article-title>Using interest and transition models to predict visitor locations in museums</article-title>
          .
          <source>AI Communications</source>
          ,
          <volume>21</volume>
          (
          <issue>2-3</issue>
          ):
          <fpage>195</fpage>
          -
          <lpage>202</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [Bohnert et al.,
          <year>2009</year>
          ]
          <string-name>
            <given-names>F.</given-names>
            <surname>Bohnert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.F.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          ,
          <string-name>
            <surname>and I. Zukerman.</surname>
          </string-name>
          <article-title>Spatial processes for recommender systems</article-title>
          .
          <source>In Proceedings of the 21st International Joint Conference on Artificial Intelligence (IJCAI-09)</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [Breese et al.,
          <year>1998</year>
          ]
          <string-name>
            <given-names>J.S.</given-names>
            <surname>Breese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Heckerman</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Kadie</surname>
          </string-name>
          .
          <article-title>Empirical analysis of predictive algorithms for collaborative filtering</article-title>
          .
          <source>In Proceedings of the 14th International Conference on Uncertainty in Artificial Intelligence (UAI-98)</source>
          , pages
          <fpage>42</fpage>
          -
          <lpage>52</lpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <source>[Burke</source>
          ,
          <year>2002</year>
          ]
          <string-name>
            <given-names>R.</given-names>
            <surname>Burke</surname>
          </string-name>
          .
          <article-title>Hybrid recommender systems: Survey and experiments</article-title>
          .
          <source>User Modeling</source>
          and
          <string-name>
            <surname>User-Adapted</surname>
            <given-names>Interaction</given-names>
          </string-name>
          ,
          <volume>12</volume>
          (
          <issue>4</issue>
          ):
          <fpage>331</fpage>
          -
          <lpage>370</lpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [Cheverst et al.,
          <year>2002</year>
          ]
          <string-name>
            <given-names>K.</given-names>
            <surname>Cheverst</surname>
          </string-name>
          , K. Mitchell, and
          <string-name>
            <given-names>N.</given-names>
            <surname>Davies</surname>
          </string-name>
          .
          <article-title>The role of adaptive hypermedia in a contextaware tourist guide</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>45</volume>
          (
          <issue>5</issue>
          ):
          <fpage>47</fpage>
          -
          <lpage>51</lpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [Diggle et al.,
          <year>1998</year>
          ]
          <string-name>
            <given-names>P.J.</given-names>
            <surname>Diggle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.A.</given-names>
            <surname>Tawn</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.A.</given-names>
            <surname>Moyeed</surname>
          </string-name>
          .
          <article-title>Model-based geostatistics</article-title>
          .
          <source>Applied Statistics</source>
          ,
          <volume>47</volume>
          (
          <issue>3</issue>
          ):
          <fpage>299</fpage>
          -
          <lpage>350</lpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <source>[Hatala and Wakkary</source>
          , 2005]
          <string-name>
            <given-names>M.</given-names>
            <surname>Hatala</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Wakkary</surname>
          </string-name>
          .
          <article-title>Ontology-based user modeling in an augmented audio reality system for museums</article-title>
          .
          <source>User Modeling and UserAdapted Interaction</source>
          ,
          <volume>15</volume>
          (
          <issue>3-4</issue>
          ):
          <fpage>339</fpage>
          -
          <lpage>380</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [Herlocker et al.,
          <year>1999</year>
          ]
          <string-name>
            <given-names>J.L.</given-names>
            <surname>Herlocker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.A.</given-names>
            <surname>Konstan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Borchers</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.T.</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>An algorithmic framework for performing collaborative filtering</article-title>
          .
          <source>In Proceedings of the 22th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR99)</source>
          , pages
          <fpage>230</fpage>
          -
          <lpage>237</lpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <source>[James and Stein</source>
          , 1961]
          <string-name>
            <given-names>W.</given-names>
            <surname>James</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.M.</given-names>
            <surname>Stein</surname>
          </string-name>
          .
          <article-title>Estimation with quadratic loss</article-title>
          .
          <source>In Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability</source>
          , vol.
          <volume>1</volume>
          , pages
          <fpage>361</fpage>
          -
          <lpage>379</lpage>
          ,
          <year>1961</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <source>[Neal</source>
          ,
          <year>2003</year>
          ]
          <string-name>
            <given-names>R.M.</given-names>
            <surname>Neal</surname>
          </string-name>
          .
          <article-title>Slice sampling</article-title>
          .
          <source>The Annals of Statistics</source>
          ,
          <volume>31</volume>
          (
          <issue>3</issue>
          ):
          <fpage>705</fpage>
          -
          <lpage>767</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [Parsons et al.,
          <year>2004</year>
          ]
          <string-name>
            <given-names>J.</given-names>
            <surname>Parsons</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Ralph</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Gallager</surname>
          </string-name>
          .
          <article-title>Using viewing time to infer user preference in recommender systems</article-title>
          .
          <source>In Proceedings of the AAAI Workshop on Semantic Web Personalization (SWP-04)</source>
          , pages
          <fpage>52</fpage>
          -
          <lpage>64</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <source>[Petrelli and Not</source>
          , 2005]
          <string-name>
            <given-names>D.</given-names>
            <surname>Petrelli</surname>
          </string-name>
          and
          <string-name>
            <surname>E. Not.</surname>
          </string-name>
          <article-title>User-centred design of flexible hypermedia for a mobile guide: Reflections on the HyperAudio experience</article-title>
          .
          <source>User Modeling</source>
          and
          <string-name>
            <surname>User-Adapted</surname>
            <given-names>Interaction</given-names>
          </string-name>
          ,
          <volume>15</volume>
          (
          <issue>3-4</issue>
          ):
          <fpage>303</fpage>
          -
          <lpage>338</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <source>[Resnick and Varian</source>
          , 1997]
          <string-name>
            <given-names>P.</given-names>
            <surname>Resnick</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.R.</given-names>
            <surname>Varian</surname>
          </string-name>
          .
          <article-title>Recommender systems</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>40</volume>
          (
          <issue>3</issue>
          ):
          <fpage>56</fpage>
          -
          <lpage>58</lpage>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [Sarwar et al.,
          <year>2001</year>
          ]
          <string-name>
            <given-names>B.</given-names>
            <surname>Sarwar</surname>
          </string-name>
          , G. Karypis,
          <string-name>
            <given-names>J.A.</given-names>
            <surname>Konstan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.T.</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <article-title>Item-based collaborative filtering recommendation algorithms</article-title>
          .
          <source>In Proceedings of the 10th International Conference on the World Wide Web (WWW-01)</source>
          , pages
          <fpage>285</fpage>
          -
          <lpage>295</lpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [Schmidt et al.,
          <year>2009</year>
          ]
          <string-name>
            <given-names>D.F.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Zukerman</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.W.</given-names>
            <surname>Albrecht</surname>
          </string-name>
          .
          <article-title>Assessing the impact of measurement uncertainty on user models in spatial domains</article-title>
          .
          <source>In Proceedings of the 1st and 17th International Conference on User Modeling, Adaptation, and Personalization (UMAP-09)</source>
          , pages
          <fpage>210</fpage>
          -
          <lpage>222</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [Schwaighofer et al.,
          <year>2005</year>
          ]
          <string-name>
            <given-names>A.</given-names>
            <surname>Schwaighofer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Tresp</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Yu</surname>
          </string-name>
          .
          <article-title>Learning Gaussian process kernels via hierarchical Bayes</article-title>
          .
          <source>In Advances in Neural Information Processing Systems 17 (NIPS-04)</source>
          , pages
          <fpage>1209</fpage>
          -
          <lpage>1216</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <source>[Schwarz</source>
          , 1978]
          <string-name>
            <given-names>G.E.</given-names>
            <surname>Schwarz</surname>
          </string-name>
          .
          <article-title>Estimating the dimension of a model</article-title>
          .
          <source>The Annals of Statistics</source>
          ,
          <volume>6</volume>
          (
          <issue>2</issue>
          ):
          <fpage>461</fpage>
          -
          <lpage>464</lpage>
          ,
          <year>1978</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [Stock et al.,
          <year>2007</year>
          ]
          <string-name>
            <given-names>O.</given-names>
            <surname>Stock</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Zancanaro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Busetta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Callaway</surname>
          </string-name>
          ,
          <string-name>
            <surname>A</surname>
          </string-name>
          . Kru¨ger, M. Kruppa,
          <string-name>
            <given-names>T.</given-names>
            <surname>Kuflik</surname>
          </string-name>
          , E. Not, and
          <string-name>
            <given-names>C.</given-names>
            <surname>Rocchi</surname>
          </string-name>
          .
          <article-title>Adaptive, intelligent presentation of information for the museum visitor in PEACH. User Modeling</article-title>
          and
          <string-name>
            <surname>User-Adapted</surname>
            <given-names>Interaction</given-names>
          </string-name>
          ,
          <volume>18</volume>
          (
          <issue>3</issue>
          ):
          <fpage>257</fpage>
          -
          <lpage>304</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>[Yu</surname>
          </string-name>
          et al.,
          <year>2006</year>
          ]
          <string-name>
            <given-names>S.</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Tresp</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.-P.</given-names>
            <surname>Kriegel</surname>
          </string-name>
          .
          <article-title>Collaborative ordinal regression</article-title>
          .
          <source>In Proceedings of the 23rd International Conference on Machine Learning (ICML-06)</source>
          , pages
          <fpage>1089</fpage>
          -
          <lpage>1096</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>