<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>June</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>User Categories for Digital Cultural Heritage</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>David Walsh</string-name>
          <email>djwalsh1@shef</email>
          <email>djwalsh1@sheffield.ac.uk</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Paul Clough Jonathan Foster</string-name>
          <email>j.j.foster@shef</email>
          <email>p.d.clough@shef</email>
          <email>p.d.clough@sheffield.ac.uk j.j.foster@sheffield.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Digital Cultural Heritage, User Modelling, User Studies</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Sheffield University of Sheffield</institution>
          ,
          <addr-line>Sheffield Sheffield</addr-line>
          ,
          <country>United Kingdom United Kingdom</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Sheffield</institution>
          ,
          <addr-line>Sheffield</addr-line>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2016</year>
      </pub-date>
      <volume>22</volume>
      <issue>2016</issue>
      <abstract>
        <p>Increasingly information systems and services are being tailored to the needs of individuals and groups through the use of user-centred design techniques. In this paper we consider the ways in which the users of digital cultural heritage have been previously characterised and grouped. Despite recognising the importance of adopting user-centred techniques, there appears to be little prior work that has compared user groupings across user studies. Through a preliminary review of previous literature we compare ways in which users have been categorised and provide points for open discussion. The dimensions of domain knowledge, technical experience and motivation provide a way of distinguishing previously identi ed groups. We believe discussions about user categories and models is warranted and will help in the future design of digital cultural heritage services.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>
        As far back as the 1980's Robert Taylor highlighted the
importance of developing information systems from the
perspective of human actors and their environment [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
Taylor argued that only by understanding the user's
environment could the value of information within speci c contexts
be determined. Over the years many studies have sought
to determine the information behaviour of users with
various demographics, domains, professions and roles [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ].
Such studies have highlighted the diversity of users with
respect to age, gender, personality, interests, expertise,
profession, role, socio-economic background, motivation, intent
and task. Understanding and categorising users can help to
develop, adapt and evaluate information systems from the
perspective of the user and their environment. For example,
users with a lack of archival expertise may nd formulating
search requests and interpreting and contextualising search
results di cult [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Knowing this would allow speci c search
aids to be designed and implemented to support these users.
      </p>
      <p>Similarly, users from diverse backgrounds come to
Digital Cultural Heritage (DCH) collections with varying goals,</p>
      <sec id="sec-1-1">
        <title>This is the primary contact author.</title>
        <p>
          tasks and information needs [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. A consequence of this is
the wide variety of requirements that service providers and
content creators have to consider when designing methods
of information access [
          <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
          ]. Increasingly, cultural heritage
services are being tailored to individuals and groups (i.e.,
via personalisation and adaptive systems) and therefore
require some kind of di erentiation between user groups [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
However, despite the wealth of studies carried out to
identify and characterise users, many of the categories appear
general (e.g., historian vs. student; novice vs. expert), often
without precise de nition and therefore making comparisons
between studies di cult. An examination of the literature
suggests a lack of agreement on the appropriate terminology
for categorising users of digital cultural heritage and their
characteristics and needs (e.g., exactly who are the \general
public"?). Also, within groups users and their
characteristics may vary widely and types of user are often abstract and
generic. Similarly to the view of Normore [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] with respect to
digital library users, we propose to better understand di
erences between user communities to provide a more \nuanced
view of the user".
        </p>
        <p>In this paper we discuss and compare user categories across
studies. With this in mind a review of relevant literature is
undertaken to identify the ways in which the users of digital
cultural heritage systems and services have been categorised
in past studies. We believe this may aid both practitioners
and academics alike with the design of future digital
cultural heritage systems. The following objectives were
addressed: [OB1:] To gather relevant literature describing
different types of user within digital cultural heritage; [OB2:]
To analyse types of user commonly discussed in the
literature; and [OB3:] To compare types of user based on generic
dimensions, such as level of domain knowledge and
technical skill. The remainder of the paper is organised as follows:
Section 2 discusses related work with respect to categorising
users; Section 3 describes an approach to identifying
relevant literature, in which di erent categories of users are
mentioned; Section 4 provides an analysis of the past work
and provides a summary of user groups; Section 5 compares
user groups and provides areas of discussion; nally Section
6 concludes the paper.
2.</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>RELATED WORK</title>
      <p>
        The access to and discovery of cultural heritage materials
has been long studied. However, similar to perspectives on
information seeking and behaviour [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], the access to
cultural heritage is no longer just about the physical visit, but
rather the entire visitor experience that begins prior to the
actual visit and after the visit has ended [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Such
activities are usually initiated by some interaction with a
museum/library/archive website made available by a plethora of
technological devices. Alternatively, virtual collections are
being visited by users who never physically visit the
museum [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. An enduring e ort has been to study and
categorise users or visitors. The diversity in users of digital
cultural heritage has resulted in a strategy that simpli es
the virtually unlimited possibilities of user pro les by
creating generic groups or categories of users - `stereotypes' [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
These groups are sometimes as abstract as novice or
expert [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], but more commonly user groups are created based
on profession (e.g., curator, librarian, researcher, teacher or
student). Alternative groups have been based on user
interest or motivations (e.g., tourist, explorer, general user),
or age group (e.g., adult, child). These archetypal users are
often described using personas [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>
        More widely, users have commonly been categorised and
modelled within the elds of information seeking and
contextaware systems. For example, Russell-Rose &amp; Tate [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]
consider the behavioural di erences of search system users and
focus on two dimensions: domain expertise and technical
expertise. They focus on expertise as this can have signi cant
e ects on how people nd and use information. Domain
expertise re ects familiarity (or experience) with a subject;
technical expertise captures pro ciency with using
computers, search systems and the internet. Users are mapped to
these two dimensions as novices or expert. The authors
also highlight how experience can move users from novices
to experts over time. Aspects of users that are less likely to
change over time include their psychological attributes, such
as cognitive style. Such aspects of the user constitute their
personal context. Modelling the user's context allows
systems to personalise and adapt to the user's situation and will
also attribute to variations in their information behaviour
[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. User modelling is also a widely researched and
important topic in its own right1 [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Within the scope of this
paper it is therefore pertinent to consider to what extent
categorisations of users in digital cultural heritage should take
into account users' individual di erences, as well as their
group attributes, and broader contexts, e.g. geographical,
social, cultural [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        In this paper we consider how categories of user are
distinguished by the dimensions of domain and technical
expertise, as well as user motivation. These dimensions have been
widely used in past studies [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] and we posit are able to help
distinguish and compare types of user in cultural heritage.
We review past literature in which the users of (mainly
digital) cultural heritage are identi ed to help categorise types
of user and their distinguishing characteristics. We believe
that such a review will provide useful insights and o er a
basis for future discussions.
      </p>
    </sec>
    <sec id="sec-3">
      <title>METHODOLOGY</title>
      <p>
        A review of existing studies of digital cultural heritage was
conducted to identify and compare how users had been
identi ed and categorised (addressing Objective 1). Once
relevant articles were gathered they were analysed to identify
themes, such as user group and characteristics,
methodology used to study users, etc. The articles gathered provide
a dataset for subsequent analysis (see, Section 4). More
1For example, see: http://www.um.org/
speci cally, the following approach was used in conducting
this review [
        <xref ref-type="bibr" rid="ref17 ref18">17, 18</xref>
        ]: (1) identify studies relevant to the scope
and purpose of the review; (2) develop inclusion and
exclusion criteria to guide the selection of articles; and (3) analyse
each study and synthesise the results. These steps are
further described below:
      </p>
      <p>
        Step 1: Relevant articles were identi ed using a search
strategy based upon keyword search and Google Scholar [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ].
A separate search on the ACM Digital Library2 and
Museums and the Web3 was not conducted as both are indexed
by Google Scholar [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. Keywords used to identify
potentially relevant articles included: `virtual museum visitors',
`cultural heritage users', `museum website users', `museum
personas', `digital cultural heritage user studies' and `CH
website professionals'. Types of articles included studies of
museum websites and online digital collections, digital
cultural heritage users and user behaviour, and search patterns
and visitor journeys. Also included were whitepapers (often
unpublished) from funded projects, such as Europeana, and
the PATHS4 and CULTURA5 projects. This step resulted
in 86 papers for review.
      </p>
      <p>
        Step 2: Articles were included if: (i) a user category,
role or group was identi ed, together with users'
motivations within a group; or (ii) user categories were identi able
even though motivations were less clear, but the boundaries
of the groups were apparent; or (iii) user motivations were
identi ed for groups of users accessing DCH websites.
Papers that did not meet the inclusion criteria were excluded,
along with studies identifying user groups only in physical
cultural heritage settings. Also reviewed were articles cited
in digital cultural heritage referring to prior categories, such
as those used in healthcare [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. Papers in which a user
group could be identi ed resulted in 34 papers to analyse.
      </p>
      <p>
        Step 3: Identi ed articles were analysed and user groups
compared. For every category a low, medium, or high rating
for domain knowledge and technical skills was assigned. We
did this as Russell-Rose &amp; Tate [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] used these dimensions
to categorise users and we found these often mentioned in
the DCH literature. In some cases the dimensions and rating
was clearly identi able (\Casual users are not domain or
system experts" [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] and \a novice user may become confused
and give up using them [interfaces]" [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]). But occasionally
the dimensions and rating were interpreted from the textual
content in the article (\Since novice end-user searchers
typically do not possess much search experience, subject
knowledge is their only asset" [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] where the subject knowledge
was interpreted as medium). At the same time any
motivations for the user's engagement were also identi ed as this
was found to be another common attribute used to
distinguish users [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. The results of the ndings and analysis
are shown in Table 2. The coding was carried out by the
rst author, and to improve coding reliability 10% of articles
were checked by another author.
      </p>
    </sec>
    <sec id="sec-4">
      <title>ANALYSIS OF LITERATURE</title>
      <p>2http://dl.acm.org/
3http://www.museumsandtheweb.com/
4http://www.paths-project.eu/
5http://www.cultura-strep.eu/</p>
      <p>The collection of relevant articles were then analysed, in
order to identify the di erent labels used by studies to
identify distinct user types (addressing Objective 2). Overall, we
identi ed 58 distinct labels. On average, each study
studied 2 user types. The number of user types ranged from
2 to 6. Studies in which the user types studied was quite
large in number, e.g. 5 user types, all closely aligned with
one another; covering the full spectrum from Professional to
Novice. The labels most frequently used were Lay User (7
uses) and Professional User (3 uses). 3 studies contained
a `facilitator' type group, where the characteristics are
centred around planning a visit or creating a virtual tour for
others to use; 2 studies contain a group catering for personal
curiosity, as opposed to any other information need; and 2
studies contained a `hobbyist' user type. .</p>
      <p>
        As mentioned earlier, if the user groups are considered to
be part of a spectrum, with professional at one extreme and
novice user at the other, we nd that studies which identify
more than 4 groups appear to deal with the full spectrum,
i.e. from end to end. When more groups are added, this
increases the number of levels in between the poles [
        <xref ref-type="bibr" rid="ref21 ref24 ref26 ref27 ref28">21, 26,
27, 24, 28</xref>
        ]. Studies with less than 4 groups tend to focus on
a group of users, from only one pole of the spectrum, e.g.
all professionals [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ] or all novices [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. From the 58 labels
originally identi ed in the literature, only 19 (identi ed in
Table 2) met all 3 areas of the inclusion criteria
(methodology Step 2), by identifying levels of domain knowledge
and technical expertise, as well as users' motivations. We
use these dimensions to help compare and aggregate groups
(see Section 5).
4.1
      </p>
    </sec>
    <sec id="sec-5">
      <title>Broad Categories of User</title>
      <p>
        Within the literature user groups were described in
varying levels of detail. One clear distinction that emerges
repeatedly are the broad classes of expert/professional,
semiexpert/hobbyist and novice/non-expert. Cifter et al. [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]
focus on two user groups: the lay user category borrowed from
Hogg et al. [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ], and Ludvall's [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ] professional user
category. Johnson [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] identi es three categories of user, later
rened to just two: the expert/professional and the lay/novice
user. The criteria or dimensions against which users are
categorised as novice or expert are discussed in Section 5, but
broadly fall into domain knowledge, technical expertise and
motivation, similar to [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
4.1.1
      </p>
      <sec id="sec-5-1">
        <title>Professionals and experts</title>
        <p>
          Much of the literature considers those employed by
cultural heritage organisations (e.g., curator or librarian) or
trained scholars (e.g., historian) as professional or expert
users. Vilar et al. [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ] de ne professional users as \those
who act within the formal part of a profession, having good
knowledge of the task, being trained and usually having
experience with it and deep understanding of its context". In
addition, Pantano [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ] uses this de nition for experts:
\specialists in the eld of cultural heritage." Marty [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ] uses the
notion of Museum Information Professional (MIP), someone
working with information resources and a desire for
meeting user needs by ensuring that the right information
resources are available at the right time and place, whether
users are inside or outside the museum. This categorisation
was adopted by Amin et al. [
          <xref ref-type="bibr" rid="ref34">34</xref>
          ] who focussed only on
cultural heritage experts and the actions they were required
to undertake in relation to more complex searches and the
strategies and workarounds employed to overcome de
ciencies in existing tools.
4.1.2
        </p>
      </sec>
      <sec id="sec-5-2">
        <title>Semi-experts and hobbyists</title>
        <p>
          As institutions open their collections to the world via the
internet, attention is being paid to di erences of domain
knowledge and domain system expertise. There are
essentially many groups of users who interact with collections
alongside the museum/heritage expert [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. Consideration of
other user categories which are not speci cally job related,
but can be considered as expert in a particular eld, are
also beginning to be incorporated into the research
relating to the user. A number of recently completed studies
have focused on hobbyists [
          <xref ref-type="bibr" rid="ref29 ref35 ref36 ref37 ref5">35, 5, 29, 36, 37</xref>
          ], highlighting a
group of specialists undertaking research for personal
reasons. Stebbins [
          <xref ref-type="bibr" rid="ref38">38</xref>
          ] describes hobbyists within the context
of serious leisure: \hobbyists are serious about and
committed to their endeavors, even though they frequently feel no
necessity or obligation to engage in them. In other words,
they are not dabblers or people aimlessly doing something
as a temporary diversion. A hobby is a specialized pursuit
beyond one's occupation, a pursuit one nds particularly
interesting and enjoys doing because of its durable bene ts."
4.1.3
        </p>
      </sec>
      <sec id="sec-5-3">
        <title>Lay users and non-experts</title>
        <p>
          Hogg et al. [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ] de ne lay users as \those who have not
gone through the training or socialisation in a particular
profession". The professional user is identi ed as having
good knowledge of the task and the system they are using,
usually based on prior training or previous experience.
Subcategories of lay user are also discussed: the experienced lay
user and the novice lay user [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ]. The experienced lay user
is identi ed as having some previous experience with the
system/task, but in comparison to the professional user their
knowledge of the task and system experience is limited. In
contrast, the novice lay user is someone new to the entire
environment and usually unable to perform the task
requirements successfully. The main factors separating these two
groups, according to Cifter et al. [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ] are: knowledge of the
task, information needs and expectations from the system.
Similarly, Pantano (cited in Ibrahim [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]) describe the
general user as those who usually visit the website more for
some passing curiosity rather than to retrieve information
to improve their knowledge of cultural heritage. Skov [
          <xref ref-type="bibr" rid="ref39">39</xref>
          ]
identi es that further work on the novice user group would
provide interesting improvements to the understanding of
this main group and its sub-groups.
4.2
        </p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Other Groups of User</title>
      <p>Beyond the broad groups of users based upon their
expertise, categories have also been used to re ect other aspects,
such as information need, motivation or purpose of
engagement and role. Further examples of user category for speci c
case studies are provided in Section 4.4.
4.2.1</p>
      <sec id="sec-6-1">
        <title>Groups based on information need</title>
        <p>
          Booth [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ] undertook an extensive analysis of visitors to
the London Science Museum, including virtual visitors, and
formed groups based on their information need :
General visitors: users who require general
information, e.g., opening hours, prices, facilities, and what's
on.
        </p>
        <p>Educational visitors: users who required additional
information to that of the general visitor, e.g., more
detailed information to plan a visit and project based
information.</p>
        <p>
          Specialist visitors: also recognised by Skov [
          <xref ref-type="bibr" rid="ref39">39</xref>
          ] as
those who require further information in addition to
the general visitor in terms of more detailed
information on museum collections and also access to expertise
in the museum via additional links.
4.2.2
        </p>
      </sec>
      <sec id="sec-6-2">
        <title>Groups based on motivation and role</title>
        <p>
          Fantoni et al. [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ] describe ve reasons for users
engaging with the Indianapolis Museum of Art (IMA) website:
(i) plan a visit to the museum; (ii) nd speci c information
for research or professional purposes; (iii) nd speci c
information for personal interest; (iv) engage in casual
browsing without looking for something speci c; and (v) make
a transaction on the website. Fantoni et al. [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ] state
that many museums and other cultural organisations have
adopted Falk's [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ] user classi cations as a means of
segmenting online audiences, even though these classi cations
were devised for the physical museum. Falk believed that
user classi cations should not be based on demographics
only and devised ve groups of users based on their
motivations for visiting:
1. Explorer: motivated by a need to satisfy personal
curiosity and interest in an intellectually challenging
environment.
2. Facilitator: motivated by the wish to engage in a
meaningful social experience with someone whom they
care about in an educationally supported environment.
3. Experience seeker: aspires to be exposed to the
things and ideas that exemplify what is best and
intellectually most important within a culture or
community.
4. Professional/Hobbyist: possess the desire to
further speci c intellectual needs in a setting with a
speci c subject-matter focus.
5. Recharger: motivated by the yearning to physically,
emotionally, and intellectually recharge in a beautiful
and refreshing environment.
        </p>
        <p>
          Similarly, users are commonly categorised by their role,
such as tourist or teacher. For example, Pantano (cited in
Ibrahim [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]) use the following:
1. General users: are those who usually visit the
website more for some passing curiosity rather than to
retrieve information to improve their knowledge of
cultural heritage.
2. Enjoyers: are those who appreciate the virtual
exploration of the cultural heritage for personal pleasure.
3. Informationalists: are those who have the intent of
improving their knowledge.
4. Tourists: are those who visit the site to help organise
their personal tours.
        </p>
        <p>
          Whilst these categories and motivations have been used
for virtual museums, they were never designed to be used
in this way. Goldman and Schaller [
          <xref ref-type="bibr" rid="ref41">41</xref>
          ] and Peacock and
Brownbill [
          <xref ref-type="bibr" rid="ref42">42</xref>
          ] had begun to undertake similar studies and
provide classi cations for the motivations of online museum
users. Sweetenham et al.'s [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] work on the CULTURA project
presented a system that was speci cally designed to work for
and with a range of the user groups: professional researchers,
apprentice investigators, informed users and general public.
4.3
        </p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Moving between Roles and Expertise</title>
      <p>
        Prior studies have shown how people can play multiple
roles in relation to a single system [
        <xref ref-type="bibr" rid="ref43">43</xref>
        ] and that roles can
change over time depending on age, personal/social
circumstances and motivations, as well as users' relationship with
technology [
        <xref ref-type="bibr" rid="ref44">44</xref>
        ]. This change in needs and expectations can
also occur either because interest in the domain and domain
knowledge has increased, or that once the initial experience
has been satis ed, users look for what else is on o er [
        <xref ref-type="bibr" rid="ref45">45</xref>
        ].
      </p>
      <p>
        As mentioned by Russell-Rose &amp; Tate [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], users move
from novice to expert through experience. This is described
more fully in Cifter et al's `process of gaining experience'
[
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. In the case of subject or domain knowledge this may
occur through learning. Figure 1 shows this process of
gaining experience in a graphical form based on Cifter et al.
We include multiple dimensions (including subject
knowledge and technical skill) where users can advance in one or
multiple dimensions, all the time moving towards
becoming an expert. The diagram includes an element of iterative
feedback. For example, in the case of domain knowledge the
knowledge gained in turn leads to insight and action as users
develop (and apply) their knowledge (see [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]). Note that a
hobbyist can be either a novice hobbyist or an expert
hobbyist. This is because in literature hobbyists are sometimes
highlighted as being as knowledgeable, if not more so than
professionals [
        <xref ref-type="bibr" rid="ref26 ref29 ref38">38, 26, 29</xref>
        ].
4.4
      </p>
    </sec>
    <sec id="sec-8">
      <title>Example User Groups</title>
      <p>4.4.1</p>
      <sec id="sec-8-1">
        <title>Europeana</title>
        <p>
          Chowdhury [
          <xref ref-type="bibr" rid="ref46">46</xref>
          ] considers the challenge set by the
European Commission to Europeana, Europe's largest
aggregated collection of cultural heritage, to create a platform for
the European citizen to view heritage artefacts. She
highlights the vastness of user cultures, ages, academic levels
and behaviours in order to highlight the frailty of
attempting to standardise a European user. However, the creation
of archetypal users has been necessary in the development
and evaluation of Europeana. Users have been characterised
using personas whereby \each persona represents many users
and a set of personas represents a spectrum of the target user
groups" [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. The use of a persona provides characteristics
such as: names, jobs, feelings, interests, goals they wish to
ful l, turning the abstract and very short descriptive role
category into a `real' person [
          <xref ref-type="bibr" rid="ref47">47</xref>
          ].
        </p>
        <p>
          Personas can provide detailed knowledge on the users
domain knowledge as they are always written with a scenario in
mind where the user performs a task on the system they are
being used for. Their technical knowledge is often indicated
by nothing more than a few words \Tech-Savy" or \some web
usage". To date the development of personas has undergone
3 revisions [
          <xref ref-type="bibr" rid="ref48">48</xref>
          ] that are derived from various forms of data:
user studies, transaction log analyses and demographic data.
The Europeana Persona Catalogue v3 comprises of 5
personas (previously 7). The personas are developed around
the broad dimensions of search literacy (e.g., IT knowledge,
task knowledge and language), and information seeking
behaviour (e.g., search strategy and personality). An example
persona is the following: \Jukka: PhD in music and
professor at a university. Very con dent about technology and
always on the look-out for new stu and new ways of
communicating, on the computer as well as on his iPhone. Very
con dent about searching and nding useful and relevant
results."
4.4.2
        </p>
      </sec>
      <sec id="sec-8-2">
        <title>Library of Congress NDL</title>
        <p>
          Marchionini et al. [
          <xref ref-type="bibr" rid="ref49">49</xref>
          ] describe users and their needs
within the context of the Library of Congress (LC) National
Digital Library (NDL) Program. The authors provide
detailed discussions around user categories, which are derived
from users' motivations (related to speci c information
seeking task), domain knowledge, library system knowledge,
focus of the task (e.g. amount of information needed) and time
allocated to task. This resulted in the following categories:
1. LC sta : high motivation, medium domain
knowledge, high library system knowledge, high focus, and
limited time allocations.
2. Hobbyists: e.g., genealogy, Civil War, railroads, other
examples), high motivation, typically high domain
knowledge, a range of library system knowledge, high focus,
and high time allocations.
3. Scholars: e.g., historians, sociologists,
anthropologists, authors, high motivation, high domain
knowledge, high library system knowledge, high focus, and
high time allocations.
4. Professional researchers: e.g., picture researchers,
high motivation, medium domain knowledge, average
to high library system knowledge, very high focus, and
medium time allocations.
5. Rummagers (browsers): e.g., PhD students looking
for topics; scholars looking for new directions, topics,
high motivation, medium domain knowledge, range of
library system knowledge, low focus, and medium to
high time allocations.
6. Object seekers: e.g., some authors, CD-ROM/
multimedia developers, TV/video producers, and
instructional materials developers, high motivation, range of
domain knowledge, low library system knowledge, high
focus, and low to medium time allocations.
7. Surfers e.g., those who are curious, those who bump
into the NDL, etc., low motivation, low domain
knowledge, low library system knowledge (but may be high
computing system knowledge), low focus, and very low
time allocations.
8. Teachers K-16: medium motivation, medium to high
domain knowledge, low to medium library system
knowledge, medium focus, and low time allocations.
9. Students K-16: low to medium motivation, low
domain knowledge, low library system knowledge, low to
medium focus, and low to medium time allocations.
        </p>
        <p>Consideration of personal attributes (e.g. age, gender and
cognition), domain expertise and technical expertise is given
in producing categories, along with consideration of
information seeking task.
5.</p>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>DISCUSSION</title>
      <p>Analysis of how users are categorised shows a high
degree of variation (58 distinct labels) and range in types of
user identi ed. However, in many cases similarities between
the user groups could be observed leading us to consider
whether a smaller and more generic set of groups exist and
could lead to a `standard' set of user types. We aimed to
identify commonalities between di erent user groups across
studies (addressing Objective 3). To compare user groups
we consider them based on the dimensions of users' domain
expertise, technical skill and motivation or purpose for
engagement. These are commonly used in elds beyond
cultural heritage and were observed from reviewing the DCH
literature. Values for domain expertise and technical skill
were reduced to `high', `medium' and `low' as these are
often used. To compare motivations (or roles) we attempted
to identify a common set of types (see Section 5.1). To allow
comparison of user groups we used a subset of the studies
in which the three dimensions were listed and ndings are
discussed in Section 5.2. A number of open questions have
emerged from the analysis of user groups which we discuss
in Section 5.3.
5.1</p>
    </sec>
    <sec id="sec-10">
      <title>Common Motivations for Engagement</title>
      <p>
        The motivations identi ed by Fantoni et al. [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] are
commonly cited in the cultural heritage literature. Ham [
        <xref ref-type="bibr" rid="ref50">50</xref>
        ]
identi ed two additional motivations related to learning
\captive" and \noncaptive". Ibrahim [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] describes captive users
as \those who learn something because they are required to
(e.g., students or employees)"; in contrast noncaptive users
have \the option to ignore the information without bearing
any punishment or loss of potential reward. They are also
free to walk away anytime they want to, and are driven to
pay attention due to intrinsic satisfaction related to what
they are hearing, seeing, or reading, and will continue to
pay attention as long as the information they are receiving
continues to be more interesting and engaging. Typical
settings where we can nd noncaptive users are museums and
parks". We propose a generic set of motivations that we use
to analyse user groups across studies (see Table 1).
      </p>
      <p>To compare the groups across studies and enable us to
identify generic groupings we mapped categories against
domain expertise, technical skill and motivation. From this
exercise, six main groupings of categories emerge (see Table
2). These six groups are based on similarities in level of
domain knowledge and technical skill. We can observe, for
example, that the `general public' and `casual user' are similar
with respect to domain and technical expertise (low), even
though they are referred to with di erent names. However,
what may distinguish these are their motivations.
Additionally, `professionals' and `scholars' may be considered similar
with respect to domain and technical expertise (high).</p>
      <p>An additional two groups (Object seekers and Teacher
K12) are identi ed, but in the literature they are described
as having varying levels of at least one dimension. It is not
thought that these are separate groups, but would sit within
one of the main six once the variation level has been set
(e.g., if the Object Seekers' domain knowledge was low then
this would belong to Group 1; if the domain knowledge was
medium then it would belong to Group 3. If, however, the
domain knowledge was high then this would form a separate
Group 7).</p>
      <p>
        Whilst the ndings have shown these six high-level groups,
there is evidence that there are sub-groups within the groups.
For example, Skov [
        <xref ref-type="bibr" rid="ref39">39</xref>
        ] demonstrates that, even in rather
narrow groupings, there are sub-groups: e.g., hobbyist may
have sub-groups of `collectors' and `liberal arts enthusiasts'.
The number of di erently named and motivated roles in the
rst group of Table 2 (novice/lay/casual user) also highlights
that there are sub-groups with only minor di erences. More
work is needed to identify if these di erences in motivation
make these a unique group or if they should be grouped
together. The `lay experienced user' is an interesting group
as this group could have a low or medium level of domain
knowledge and an opposite low/ medium level of
technical skill; which di erentiates this into two possible separate
groups (1 &amp; 2) when considering the dimensions but the
motivation is the same and it is appears as an intermediate
level from `lay novice' user and the `professional' user.
      </p>
      <sec id="sec-10-1">
        <title>Expert (High)</title>
        <p>
          The aim of this review was to better understand the range
of user categories being used in digital cultural heritage. As
Taylor [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] advocates, information systems and services must
seek to understand users and their environments to fully
provide value-add. The use of fairly generic categories (i.e.,
stereotypes) allows tailoring cultural heritage to particular
user groups, although personalisation would only be
possible with a richer and more individual user pro le. Reviewing
previous literature has led us to consider the following open
questions for discussion:
        </p>
        <p>Stereotypes: it is unclear to what extent a standardised
and generic set of user templates (i.e., stereotypes) for DCH
can be developed. These would capture goals, information
needs, behaviours, tasks and categories, and would aid in
the provision of of digital cultural heritage services/systems,
and aidcomparison across studies. It would be interesting to
Low
Low
Low
Low
Low
Low
Med
Med
Med
Med
Med</p>
      </sec>
      <sec id="sec-10-2">
        <title>High</title>
      </sec>
      <sec id="sec-10-3">
        <title>High</title>
      </sec>
      <sec id="sec-10-4">
        <title>High</title>
      </sec>
      <sec id="sec-10-5">
        <title>High</title>
        <p>Low
Low
Low
Low
Low
Med
Low
Low
High
High
High
Med
Med
Med</p>
      </sec>
      <sec id="sec-10-6">
        <title>High</title>
      </sec>
      <sec id="sec-10-7">
        <title>Curiosity / Learn non-captive</title>
      </sec>
      <sec id="sec-10-8">
        <title>Learn non-captive / plan visit (public)</title>
      </sec>
      <sec id="sec-10-9">
        <title>Learn non-captive</title>
      </sec>
      <sec id="sec-10-10">
        <title>Pleasure</title>
        <p>Learn captive
Learn non-captive
Learn non-captive
Learn captive / work
Work
Work
Work
Learn captive / Plan visit (educational)
/ Work
Learn non-captive / Pleasure / Plan
visit (professional)
Learn captive / Pleasure / Plan visit
(professional)
Work
User category</p>
      </sec>
      <sec id="sec-10-11">
        <title>Casual user / Tourist / Informationalist /</title>
        <p>
          Enjoyer / General user [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ], Surfers [
          <xref ref-type="bibr" rid="ref49">49</xref>
          ]
General public / Lay person [
          <xref ref-type="bibr" rid="ref51">51</xref>
          ]
Novice user [
          <xref ref-type="bibr" rid="ref23 ref52 ref6">6, 52, 23</xref>
          ]/Lay novice user
[
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]
General visitor [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ]
Student k-16 [
          <xref ref-type="bibr" rid="ref49">49</xref>
          ]
Lay experienced users [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]
Lay experienced users [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]
Novice end user searchers [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]
Professional searchers [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]
Professional researchers [
          <xref ref-type="bibr" rid="ref49">49</xref>
          ]
LC Sta (Library of Congress) [
          <xref ref-type="bibr" rid="ref49">49</xref>
          ]
determine to what extent there exist generic pro les,
independent of speci c collections, systems and situations. On
the one hand, the stereotypical or archetypal user is helpful
since it provides a fairly abstract user pro le, with which to
categorise users. However, such an approach is less helpful
for other purposes, e.g. personalisation.
        </p>
        <p>
          User dimensions: typically the users of digital cultural
heritage systems are categorised with respect to some aspect
of their job or role. However, if the purpose of modelling
users is to tailor services or systems then other aspects of
the user's context may better categorise types of user, such
as technical ability and subject knowledge. Mapping users
to dimensions beyond job or role may help to better model
and contextualise them and it would be interesting to
explore the use of various aspects of context as described in
[
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. It is also unclear which dimensions are likely to form a
minimum set and to what extent the dimensions should be
task independent.
        </p>
        <p>Scales of measurement: for each of the dimensions used
to categorise users, some kind of measurement scale must be
to quantify and situate users on the dimensions. In many
cases the measurement is often binary (e.g., novice vs.
expert), but a more ne-grained scale could be used (e.g., a
5-point scale) that better captures nuances of the user.</p>
        <p>Purposes of study: the selection of categories and
dimensions will typically re ect the purposes of categorising
users. For example, if the purpose is to help users learn
then the use of personal attributes, such as cognitive style,
or strategy, may help with developing suitable support
tailored to individual users' learning needs. For developing IR
support, then modelling users' subject knowledge may be
important (e.g., subject novices may require help with
for</p>
      </sec>
      <sec id="sec-10-12">
        <title>Low - High</title>
        <p>Med - High
Low
Low - Med</p>
      </sec>
      <sec id="sec-10-13">
        <title>Work</title>
        <p>Learn - captive / Work
mulating suitable queries or interpreting search results).</p>
        <p>
          User prediction: one purpose of user modelling is to
make predictions. It is therefore an open question to what
extent we could predict categories of user and what forms
of evidence could be used for this. For example, Zhang &amp;
Kamps [
          <xref ref-type="bibr" rid="ref54">54</xref>
          ] use features derived from transaction logs to
predict users as novice vs. expert. It would be interesting to
investigate what features could be derived for which
dimensions to predict users.
        </p>
        <p>General users: who are `general' users? The literature
suggests this can be anyone from a novice to a professional
with anything in between, and it appears this group is used
more as a catch-all category for a user who does not t
within into any other category.</p>
        <p>User visits: given that users can take on di ering roles
each visit (e.g., in one visit they could be an expert; another
a novice), then it may be more pertinent to characterise
users on a per-visit basis. In practice, this may be modelled
as more stable characteristics (e.g., demographics) compared
to more visit-speci c characteristics (e.g., particular tasks or
information needs).</p>
        <p>Sub-categories: often users are grouped into broad
categories, such as general public. We would suggest that these
should be re ned and further sub-divided into sub-groups.
For example, users identi ed as `the general public' or
`nonexperts' may be divided into more ne-grained categories
common across services/systems. However, it is unclear
what sub-categories should be created and how.</p>
        <p>
          Value of digital cultural heritage: To date emphasis
has been mainly placed on the information provider's
perspective, and the delivery of cultural heritage content to the
user, albeit with an increased sense of who the user is, and
what their group and individual di erences are. Can
cultural heritage services begin to see things more from the
users' point of view; and via greater understanding of the
uses of cultural heritage, "negotiate" the delivery and
creation of more value-added services? [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ].
        </p>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>CONCLUSIONS</title>
      <p>The purpose of this paper has been to review the
relevant literature in order to identify the ways in which users
of DCH systems and services have been categorised. We
demonstrate that, despite the wide variety of labels and user
types discussed in previous studies, a comparison of these
has been possible, based on the criteria of domain expertise
and technical skill. In conclusion, it may be better to
consider categorising users by expertise, than by label or user
type. Alternatively some combination of both, since this
would potentially enable the delivery and creation of more
value-added services. This paper contains an initial review
of the literature, and a comparison of the labels used and
user types identi ed within digital cultural heritage. Future
plans include: conducting a broader review, in order to
further substantiate our comparison, and from which a set of
generic labels and user types can be developed.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Taylor</surname>
          </string-name>
          , R.S.:
          <article-title>Value-added processes in the information life cycle</article-title>
          .
          <source>Journal of the American Society for Information Science</source>
          <volume>33</volume>
          (
          <year>1982</year>
          )
          <volume>341</volume>
          {
          <fpage>346</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Case</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Looking for information: a survey of research on information seeking, needs, and behavior</article-title>
          .
          <source>Library and information science</source>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Dobreva</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>O</given-names>
            <surname>'Dwyer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Feliciati</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.:</surname>
          </string-name>
          <article-title>User studies for digital library development</article-title>
          .
          <source>Facet</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Du</surname>
            ,
            <given-names>W.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Monks-Leeson</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Galey</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al.:
          <article-title>Contexts built and found: a pilot study on the process of archival meaning-making</article-title>
          .
          <source>Archival Science</source>
          <volume>12</volume>
          (
          <year>2012</year>
          )
          <volume>69</volume>
          {
          <fpage>92</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Skov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ingwersen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Exploring information seeking behaviour in a digital museum context</article-title>
          .
          <source>In: Proceedings of the Second International Symposium on Information Interaction in Context. IIiX '08</source>
          , New York, NY, USA, ACM (
          <year>2008</year>
          )
          <volume>110</volume>
          {
          <fpage>115</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Johnson</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Users, use and context: supporting interaction between users and digital archives</article-title>
          .
          <source>What Are Archives?: Cultural and Theoretical Perspectives: A Reader</source>
          (
          <year>2008</year>
          )
          <volume>145</volume>
          {
          <fpage>64</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Sweetnam</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Siochru</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agosti</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Man</surname>
            <given-names>oletti</given-names>
          </string-name>
          , M.,
          <string-name>
            <surname>Orio</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ponchia</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Stereotype or spectrum: Designing for a user continuum</article-title>
          .
          <source>In: the Proceedings of the First Workshop on the Exploration</source>
          ,
          <article-title>Navigation and Retrieval of Information in Cultural Heritage</article-title>
          , ENRICH. (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Ardissono</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , Ku ik, T.,
          <string-name>
            <surname>Petrelli</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Personalization in cultural heritage: The road travelled and the one ahead. User Modeling and User-Adapted Interaction 22 (</article-title>
          <year>2012</year>
          )
          <volume>73</volume>
          {
          <fpage>99</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Normore</surname>
            ,
            <given-names>L.F.</given-names>
          </string-name>
          :
          <article-title>Characterizing a digital library's users: steps towards a nuanced view of the user</article-title>
          .
          <source>Proceedings of the American Society for Information Science and Technology</source>
          <volume>45</volume>
          (
          <year>2008</year>
          ) 1{
          <fpage>7</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Blandford</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Adams</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , Att eld, S.,
          <string-name>
            <surname>Buchanan</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gow</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Makri</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rimmer</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Warwick</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The pret a rapporter framework: Evaluating digital libraries from the perspective of information work</article-title>
          .
          <source>Information Processing &amp; Management</source>
          <volume>44</volume>
          (
          <year>2008</year>
          )
          <volume>4</volume>
          {
          <fpage>21</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Devine</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The Museum Digital Experience: Considering the Visitor's Journey</article-title>
          .
          <source>In: MWA2015: Museums and the Web Asia</source>
          <year>2015</year>
          . (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Schweibenz</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>Virtual museums</article-title>
          .
          <source>The Development of Virtual Museums, ICOM News Magazine</source>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Allen</surname>
            ,
            <given-names>R.B.</given-names>
          </string-name>
          :
          <article-title>Chapter 3 - mental models and user models</article-title>
          . In Helander, M.G.,
          <string-name>
            <surname>Landauer</surname>
            ,
            <given-names>T.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prabhu</surname>
          </string-name>
          , P.V., eds.:
          <article-title>Handbook of Human-Computer Interaction (Second Edition)</article-title>
          .
          <article-title>Second edition edn</article-title>
          . North-Holland, Amsterdam (
          <year>1997</year>
          )
          <volume>49</volume>
          {
          <fpage>63</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Rasmussen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Petersen</surname>
          </string-name>
          , G.:
          <article-title>Personas</article-title>
          . In Dobreva, M.,
          <string-name>
            <given-names>O</given-names>
            <surname>'Dwyer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Feliciati</surname>
          </string-name>
          , P., eds.:
          <article-title>User studies for digital library development</article-title>
          .
          <source>Facet</source>
          (
          <year>2012</year>
          )
          <volume>105</volume>
          {
          <fpage>113</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Russell-Rose</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tate</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Designing the search experience: The information architecture of discovery</article-title>
          .
          <source>Newnes</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Tamine-Lechani</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boughanem</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Daoud</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Evaluation of contextual information retrieval e ectiveness: overview of issues and research</article-title>
          .
          <source>Knowl. Inf. Syst</source>
          .
          <volume>24</volume>
          (
          <year>2010</year>
          )
          <volume>1</volume>
          {
          <fpage>34</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Bryman</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <source>Social Research Methods. fourth edn</source>
          . oxford univerity press (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Kelly</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sugimoto</surname>
            ,
            <given-names>C.R.:</given-names>
          </string-name>
          <article-title>A systematic review of interactive information retrieval evaluation studies, 1967{2006</article-title>
          .
          <source>Journal of the American Society for Information Science and Technology</source>
          <volume>64</volume>
          (
          <year>2013</year>
          )
          <volume>745</volume>
          {
          <fpage>770</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Jean-Francois</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laetitia</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stefan</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Is the coverage of google scholar enough to be used alone for systematic reviews. BMC medical informatics and decision making 13 (</article-title>
          <year>2013</year>
          )
          <fpage>1</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20] ACM:
          <article-title>Acm fair access - association for computing machinery</article-title>
          . http://www.acm.org/publications/ fair-access/
          <article-title>acm-fair-access?pageIndex=4 (</article-title>
          <year>2015</year>
          ) (Accessed on 05/02/
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Cifter</surname>
            ,
            <given-names>A.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dong</surname>
            ,
            <given-names>H.:</given-names>
          </string-name>
          <article-title>User characteristics: Professional vs</article-title>
          .
          <source>lay users</source>
          . (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <surname>Ibrahim</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mohamad Ali</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mohd Yatim</surname>
            ,
            <given-names>N.F.</given-names>
          </string-name>
          :
          <article-title>Factors facilitating cultural learning in virtual architectural heritage environments: End user perspective</article-title>
          .
          <source>Journal on Computing and Cultural Heritage (JOCCH) 8</source>
          (
          <issue>2015</issue>
          )
          <fpage>8</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>Bohnert</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zukerman</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laures</surname>
          </string-name>
          , J.: Geckommender:
          <article-title>Personalised theme and tour recommendations for museums</article-title>
          .
          <source>In: User Modeling, Adaptation, and Personalization</source>
          . Springer (
          <year>2012</year>
          )
          <volume>26</volume>
          {
          <fpage>37</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>Hsieh-Yee</surname>
          </string-name>
          , I.:
          <article-title>E ects of search experience and subject knowledge on the search tactics of novice and experienced searchers</article-title>
          .
          <source>Journal of the American Society for Information Science</source>
          <volume>44</volume>
          (
          <year>1993</year>
          )
          <fpage>161</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Fantoni</surname>
            ,
            <given-names>S.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stein</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bowman</surname>
          </string-name>
          , G.:
          <article-title>Exploring the relationship between visitor motivation and engagement in online museum audiences</article-title>
          .
          <source>In: Museums and the Web</source>
          .
          <article-title>(</article-title>
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Falk</surname>
            ,
            <given-names>J.H.</given-names>
          </string-name>
          :
          <article-title>Identity and the museum visitor experience</article-title>
          . Left Coast Press (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <surname>Pantano</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>Virtual cultural heritage consumption: a 3d learning experience</article-title>
          .
          <source>International Journal of Technology Enhanced Learning</source>
          <volume>3</volume>
          (
          <year>2011</year>
          )
          <volume>482</volume>
          {
          <fpage>495</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>Goodale</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hall</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>MDR</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.F.</given-names>
            ,
            <surname>Archer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Tavanti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Clough</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.:</surname>
          </string-name>
          <article-title>D 1.1 user requirements analysis (</article-title>
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <surname>Skov</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>The reinvented museum: Exploring information seeking behaviour in a digital museum context. K benhavns Universitet'K benhavns Universitet', Det Humanistiske FakultetFaculty of Humanities, Det Informationsvidenskabelige AkademiRoyal School of Library and Information Science, Det Informationsvidenskabelige Akademi-Teknologi og serviceRoyal School of Library and Information Science (</article-title>
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <surname>Hogg</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Williamson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Whose interests do lay people represent? towards an understanding of the role of lay people as members of committees</article-title>
          .
          <source>Health Expectations 4</source>
          <volume>(2001) 2</volume>
          {
          <fpage>9</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <surname>Lundvall</surname>
            ,
            <given-names>B.A.</given-names>
          </string-name>
          :
          <article-title>Product innovation and user-producer interaction</article-title>
          .
          <source>Aalborg Universitetsforlag</source>
          (
          <year>1985</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <surname>Vilar</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sauperl</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Archival literacy: Di erent users, di erent information needs, behaviour and skills</article-title>
          .
          <source>In: Information Literacy. Lifelong Learning and Digital Citizenship in the 21st Century</source>
          . Springer (
          <year>2014</year>
          )
          <volume>149</volume>
          {
          <fpage>159</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <surname>Marty</surname>
            ,
            <given-names>P.F.</given-names>
          </string-name>
          :
          <article-title>Meeting user needs in the modern museum: Pro les of the new museum information professional</article-title>
          .
          <source>Library &amp; information science research</source>
          <volume>28</volume>
          (
          <year>2006</year>
          )
          <volume>128</volume>
          {
          <fpage>144</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <surname>Amin</surname>
            ,
            <given-names>A.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hardman</surname>
          </string-name>
          , L.,
          <string-name>
            <surname>van Ossenbruggen</surname>
            ,
            <given-names>J.R.:</given-names>
          </string-name>
          <article-title>Searching in the cultural heritage domain: Capturing cultural heritage expert information seeking needs</article-title>
          .
          <source>Information Systems [INS]</source>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35]
          <string-name>
            <surname>Kelly</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The interrelationships between adult museum visitors` learning identities and their museum experiences. chapter 3</article-title>
          .
          <string-name>
            <surname>Methodology</surname>
          </string-name>
          (
          <year>2007</year>
          )
          <volume>3</volume>
          {
          <fpage>46</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <surname>Elsweiler</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , Wilson,
          <string-name>
            <given-names>M.L.</given-names>
            ,
            <surname>Lunn</surname>
          </string-name>
          ,
          <string-name>
            <surname>B.K.</surname>
          </string-name>
          :
          <article-title>Chapter 9 understanding casual-leisure information behaviour</article-title>
          .
          <source>New Directions in Information Behaviour (Library and Information Science</source>
          , Volume
          <volume>1</volume>
          ) Emerald Group Publishing Limited
          <volume>1</volume>
          (
          <year>2011</year>
          )
          <volume>211</volume>
          {
          <fpage>241</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <surname>Spellerberg</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Granata</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wambold</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          : Visitor- rst, mobile
          <article-title>- rst: Designing a visitor-centric mobile experience</article-title>
          .
          <source>In: Museums and the Web</source>
          .
          <article-title>(</article-title>
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [38]
          <string-name>
            <surname>Stebbins</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          :
          <article-title>Amateurs, professionals, and serious leisure. McGill-Queen's Press-MQUP (</article-title>
          <year>1992</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          [39]
          <string-name>
            <surname>Skov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Hobby-related information-seeking behaviour of highly dedicated online museum visitors</article-title>
          .
          <source>Information Research</source>
          <volume>18</volume>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          [40]
          <string-name>
            <surname>Booth</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Understanding the information needs of visitors to museums</article-title>
          .
          <source>Museum Management and Curatorship</source>
          <volume>17</volume>
          (
          <year>1998</year>
          )
          <volume>139</volume>
          {
          <fpage>157</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          [41]
          <string-name>
            <surname>Goldman</surname>
            ,
            <given-names>K.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schaller</surname>
            ,
            <given-names>D.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Adventures</surname>
            ,
            <given-names>E.W.</given-names>
          </string-name>
          , et al.:
          <article-title>Exploring motivational factors and visitor satisfaction in on-line museum visits</article-title>
          . In: In D. Bearman &amp; J.
          <string-name>
            <surname>Trant</surname>
          </string-name>
          (Eds.),
          <source>Museums and the Web</source>
          <year>2004</year>
          ,
          <string-name>
            <surname>Citeseer</surname>
          </string-name>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          [42]
          <string-name>
            <surname>Peacock</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brownbill</surname>
          </string-name>
          , J.:
          <article-title>Audiences, visitors, users: Reconceptualising users of museum on-line content and services</article-title>
          .
          <source>In: Museums and the Web</source>
          ,
          <source>Citeseer</source>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          [43]
          <string-name>
            <surname>Van Hooland</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>From spectator to annotator: possibilities o ered by user-generated metadata for digital cultural heritage collections</article-title>
          .
          <source>In: Immaculate Catalogues: Taxonomy, Metadata and Resource Discovery in the 21st Century, Proceedings of CILIP Conference</source>
          .
          <article-title>(</article-title>
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          [44]
          <string-name>
            <surname>Kelly</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Russo</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>From Ladders Of Participation To Networks Of Participation: Social Media And Museum Audiences</article-title>
          .
          <source>In: Museums and the Web</source>
          .
          <article-title>(</article-title>
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          [45]
          <string-name>
            <surname>Marty</surname>
            ,
            <given-names>P.F.</given-names>
          </string-name>
          :
          <article-title>The changing nature of information work in museums</article-title>
          .
          <source>Journal of the American Society for Information Science and Technology</source>
          <volume>58</volume>
          (
          <year>2007</year>
          )
          <volume>97</volume>
          {
          <fpage>107</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref46">
        <mixed-citation>
          [46]
          <string-name>
            <surname>Chowdhury</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Cultural heritage information and usability</article-title>
          .
          <source>In: Cultural Heritage Information Access and Management</source>
          . Facet
          <string-name>
            <surname>Publishing</surname>
          </string-name>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref47">
        <mixed-citation>
          [47]
          <string-name>
            <surname>Roussou</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Katifori</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pujol</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vayanou</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rennick-Egglestone</surname>
            ,
            <given-names>S.J.:</given-names>
          </string-name>
          <article-title>A life of their own: museum visitor personas penetrating the design lifecycle of a mobile experience</article-title>
          .
          <source>In: CHI'13 Extended Abstracts on Human Factors in Computing Systems</source>
          , ACM (
          <year>2013</year>
          )
          <volume>547</volume>
          {
          <fpage>552</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref48">
        <mixed-citation>
          [48]
          <string-name>
            <surname>Bergstrom</surname>
            ,
            <given-names>D.M.</given-names>
          </string-name>
          :
          <article-title>Personas Catalogue V.3 An Update</article-title>
          .
          <source>Technical report, Europeana</source>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref49">
        <mixed-citation>
          [49]
          <string-name>
            <surname>Marchionini</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Plaisant</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Komlodi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>The people in digital libraries: Multifaceted approaches to assessing needs and impact. Digital library use: Social practice in design and evaluation (</article-title>
          <year>2003</year>
          )
          <volume>119</volume>
          {
          <fpage>160</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref50">
        <mixed-citation>
          [50]
          <string-name>
            <surname>Ham</surname>
            ,
            <given-names>S.H.</given-names>
          </string-name>
          :
          <article-title>Interpretation: Making a di erence on purpose</article-title>
          .
          <source>Fulcrum publishing</source>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref51">
        <mixed-citation>
          [51]
          <string-name>
            <surname>Schouten</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Improving visitor care in heritage attractions</article-title>
          .
          <source>Tourism Management</source>
          <volume>16</volume>
          (
          <year>1995</year>
          )
          <volume>259</volume>
          {
          <fpage>261</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref52">
        <mixed-citation>
          [52]
          <string-name>
            <surname>Warwick</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Studying users in digital humanities. Digital humanities in practice (</article-title>
          <year>2012</year>
          )
          <volume>1</volume>
          {
          <fpage>21</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref53">
        <mixed-citation>
          [53]
          <string-name>
            <surname>Booth</surname>
            ,
            <given-names>B.K.W.:</given-names>
          </string-name>
          <article-title>An investigation of museum data storage and access technologies including case studies on archaeological records at the National Maritime Museum and Visitor information at the Science Museum</article-title>
          .
          <source>PhD thesis</source>
          , University of London (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref54">
        <mixed-citation>
          [54]
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kamps</surname>
          </string-name>
          , J.:
          <article-title>Search log analysis of user stereotypes, information seeking behavior, and contextual evaluation</article-title>
          .
          <source>In: Proceedings of the Third Symposium on Information Interaction in Context</source>
          , New York, NY, USA, ACM (
          <year>2010</year>
          )
          <volume>245</volume>
          {
          <fpage>254</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>