<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Social approach to context-aware retrieval</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Luca Vassena</string-name>
          <email>vassena@dimi.uniud.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Udine via delle Scienze</institution>
          ,
          <addr-line>206 Udine</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2010</year>
      </pub-date>
      <fpage>27</fpage>
      <lpage>28</lpage>
      <abstract>
        <p>In this paper we present a general purpose solution to Web content perusal by means of mobile devices, named Social Context-Aware Browser. This is a novel approach for the information access based on the users' context, whose aim is to retrieve what the user needs, even if she did not issue any query. Our solution is built upon a social model that exploits the collaborative e orts of the whole community of users to control and manage contextual knowledge, related both to situations and resources. This paper presents a general survey of our solution, describing the idea and presenting an implementation approach.</p>
      </abstract>
      <kwd-group>
        <kwd>Context-aware retrieval</kwd>
        <kwd>mobile search</kwd>
        <kwd>social</kwd>
        <kwd>folksonomy</kwd>
        <kwd>Web 2</kwd>
        <kwd>0</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>
        Context-aware computing is a computational paradigm
that has faced a rapid growth in the last few years,
especially in the eld of mobile devices. A key-role in this new
approach is played by the notion of context, that is roughly
described as the situation the user is in. This concept
encloses important information that could be used to a ect the
capabilities of mobile devices, adapting them to the user's
needs. In particular, contextual data can be used to
predict the user needs and to seek and retrieve information,
thereby reducing the complexity of the user-device
interaction and providing the right information in the right place
at the right time. From this point of view, because of the
huge amount of contextual information and its
heterogeneity and uncertainty, the mobile and context-aware
computing environments represent a new challenge for Information
Retrieval (IR). The combination of IR and context-aware
computing has been named context-aware retrieval [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        These considerations guided us towards a new approach
to Web contents production and fruition, where contextual
data are exploited to capture the dynamic nature of the user
needs, of the information available, and of the relevance of
this information, typical of a mobile user in the real world.
This approach is named Social Context-Aware Browser and
its novelty is threefold. First of all this is a new radical
approach that aims at discovering \the query behind the
context": to retrieve what the user needs, even if she did not
issue any query [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Second this is not a domain
dependent application, but a new generic way of interaction and
information access, able to adapt to every domain. Third,
as current models for context-awareness are too limited for
very general applications, this approach brings new models
built upon the social dynamics at the basis of Web 2.0.
      </p>
      <p>This paper is structured as follows. We rst brie y
survey related work (Section 2), presenting the Context-Aware
Retrieval eld and introducing the main ideas behind Web
2.0. We then describe our solution (Section 3), presenting
a general survey, the main ideas, and an implementation
approach. In Section 4 we present a brief discussion and
nally we draw some conclusions and we present future work
(Section 5).
2.
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>RELATED WORK</title>
    </sec>
    <sec id="sec-3">
      <title>Context-Aware Retrieval</title>
      <p>
        Context-Aware Retrieval (CAR) is an extension of
classical Information Retrieval (IR) that incorporates the
contextual information into the retrieval process, with the aim
of delivering information to the users that is relevant within
their current context [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. CAR systems are concerned with
the acquisition of context, its understanding, and the
application of behaviour based on the recognized context [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>
        Typical CAR applications present the following
characteristics [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]: a mobile user, i.e., a user whose context is
changing; interactive or automatic actions, if there is no need to
consult the user; time dependency, since the context may
change; appropriateness and safety to disturb the user.
Although CAR applications can be both interactive and
proactive in their communication with the user, we concentrate
on the proactive aspects, since they are more relevant to
our proposal. Besides, we concentrate on the association
between CAR and mobile application, as they can be
considered as the prime eld for CAR [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        An example of CAR system is the Ubiquitous Web [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], a
solution based on the spontaneous annotation by a
community of users of objects, places, and other people with Web
accessible content and services. A more general system is
represented by the MoBe framework [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. In this
application, a general inferential framework (based on ontologies
and Bayesian networks) combines the information coming
from sensors to infer new and more abstract contexts (user
activities, needs, etc.), that are used to retrieve and execute
the most relevant applications.
2.2
      </p>
    </sec>
    <sec id="sec-4">
      <title>Web 2.0, the social web</title>
      <p>
        With Web 2.0 [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and social software we represent all
webbased services with \an architecture of participation", that
is, an architecture featuring a high interaction level among
users and allowing users to generate, share, and take care
of the content. In the plenty of tools provided by Web
2.0, we are mainly focusing on social bookmarking and
folksonomies.
      </p>
      <p>Social bookmarking is a method for organizing,
searching, and managing documents of interest among users. In
a social bookmarking system, users save links to documents
of interest in order to remember or share them with the
community. Social bookmarking is strictly related with the
concept of folksonomy, that is the practice of annotating
and categorizing content in a collaborative way, by means
of informal tags. Folksonomies, that is a portmanteau of
folk and taxonomy, allow users to easyly and informally
descrive documents and content. This represents a powerful
combination that has gained popularity as it allows a more
natural and simpler management of the knowledge. The use
of freely choosen categorizations and the collaborative
aspect in fact allow also non-expert users to classify and nd
information. Folksonomies and social bookmarking for
example are used in well-known Web 2.0 systems like Flickr1,
Youtube2, Del.icio.us3, etc.</p>
      <p>
        Folksonomies however are criticized because the lack of
terminological control could lead to unreliable and
inconsistent results [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
    </sec>
    <sec id="sec-5">
      <title>3. SOCIAL CONTEXT-AWARE BROWSER 3.1</title>
    </sec>
    <sec id="sec-6">
      <title>Description</title>
      <p>
        The Social Context Aware Browser (sCAB for short) [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]
is a general purpose solution to Web content navigation by
means of context-aware mobile devices. It allows a \physical
browsing": browsing the digital world based on the
situations in the real world. The main idea behind sCAB is to
empower a generic mobile device with a browser able to
automatically and dynamically retrieve and load Web pages,
services, and applications according to the user's current
context.
      </p>
      <p>The sCAB acquires information related to the user and
the surrounding environment, by means of sensors installed
on the device or through external servers. This information,
combined with the user's personal history and the
community behaviour, is exploited to infer the user's current
context (and its likelihood). In the subsequent retrieval process,
a query is automatically built and sent to an external search
engine, in order to nd the most suitable Web pages for the
sensed context and present them to the user.</p>
      <p>As current models for context-awareness are too limited
for very general applications like the sCAB, this approach
brings new social models for CAR that exploit the
collabo1www.flickr.com
2www.youtube.com
3www.del.icio.us.com
rative e orts of the community of users. The community, in
fact, is encouraged to de ne the contexts of interest, share,
use and discuss them, associate context to content (web
pages, applications, etc.), to have a dynamic and more
usertailored context representation and to enhance the process
of retrieval based on users' actual situation.</p>
      <p>In particular users can freely interact with resources and
can de ne that a resource is useful (or not adapt) to their
current context, can associate resources to particular
contexts, can explicitly de ne the context their are in, and
nally can browse resources relevant for their current context.
3.2</p>
    </sec>
    <sec id="sec-7">
      <title>Model</title>
      <p>3.2.1</p>
      <sec id="sec-7-1">
        <title>Context representation</title>
        <p>
          We represent the context as a folksonomy. Each tag is
banally a keyword or string of text and represents a single
contextual value [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. We divide the contextual tags into two
categories:
        </p>
        <p>Concrete tags: represent the information obtained by
a set of sensors. These information can be read from
the surrounding environment through physical sensors
(e.g., temperature sensor), or can be obtained by other
software (e.g., calendar) through logical sensors.
Concrete tags that directly refers to sensors values are
represented using the triple tags notation that are tags
that uses a particular syntax (namespace:predicate=value)
to de ne extra information.</p>
        <p>For example, geo:longitude=12.456 is tag for the
geographical longitude coordinate whose value is 12.456.
Other concrete tags, can be automatically obatined by
the sensed values (e.g. afternoon, summer, ...).</p>
        <p>Abstract tags: represent the high level contextual
information that are freely associated by the users to
the concrete contexts, in order to detail their context
description. Some examples are: home, shopping, etc.
The di erence between the two categories is faded since the
contexts cannot be unambiguously assigned to one or the
other category. However this partition is helpful in order
to distinguish the low level information coming from
sensors and the high level contextual information intoduced by
users.</p>
        <p>The user context is a \cloud" composed by an unde ned
number of concrete and abstract tags (Figure 1).</p>
        <p>
          In the sCAB conceptual model [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ] there are six main
operations. The rst two are performed automatically and
continuosly by the system. With the inference operation
(Figure 2), starting from the concrete tags sensed by sensors,
the most relevant abstract tags are retrieved and become
part of the user's context representation. Then with the
retrieval operation (Figure 2), starting from the set of all
the tags in the user's current context, the most relevant
resources are retrieved. For example, starting from the GPS
coordinates, the system enhance the user's context with the
abstract tags \walk out park dog"; then starting from all
the tags, the system retrieves resources relevant to the given
context, as Web pages that teaches how to train dogs, etc.
        </p>
        <p>The other four operations are strictly related to the user
interaction: the main two are de nition and annotation
(Figure 3). The de nition is used to manage the contextual
information and it is performed when a user directly de ne
her context, or when she provides contextual tags during the
annotation of a resource. In particular, this operations
manages the associations between concrete and abstract tags,
and the strength of their relationships. The annotation on
the contrary is used to manage the association between
contextual tags and resources and it is performed when the users
link resources to particular contexts. We can imagine a user
at a park with her dog: she wants to associate to her context
a particular Web page teaching dog training. For this reason
she bookmarks that resource with the contextual tags \out
dog park sunny train". Doing so, rst the added abstract
tags are related to the sensed concrete tags and for all the
users with a similar concrete tag cloud, these abstract tags
(or part of them) can become part of the their context
representation. Second, that particular Web page is enhanced
with all the tags, and it will be automatically proposed to
users every time they will be in a similar context.</p>
        <p>
          As the users are the main actors in the process of context
de nition and resource annotation, problems related to the
quality of context and resources are likely to appear. To
cope with this problem we propose the adoption of a social
evaluation/reputation mechanism. We exploit the ideas
presented in [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]: every element in the model (users, contexts,
resources) has a score that increases or decreases based on
the community behavior. The score of each user is used to
weight the operations she performs, while the scores of
contextual tags and resources de ne their quality and relevance.
If a resource annotated with contextual information is never
used in that context, the related score decreases and more
relevant resources will stand out.
3.3
        </p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>Implementation approach</title>
      <p>Concrete and abstract tags, and resources are the main
elements in our implementation model. Concrete tags, as
output of sensors, are exploited to retrieve the most relevant
abstract tags, and in the same way all the tags are exploited
to retrieve the most relevant resources.</p>
      <p>In the following sections we show an implementation
proposal and how the di erent operations in the model have
e ect on the system, from a low level point of view.
3.3.1</p>
      <sec id="sec-8-1">
        <title>Indexes</title>
        <p>We exploit two indexes. In the rst one, called contexts
index, abstract tags are indexed over concrete tags, while in
the second one, called resources index, resources are indexed
over the set of all tags (both concrete and abstract). The
proposed approach is community based, thus the indexes
and the inferential system are managed by remote servers
and not stored on the mobile device. Since the approach is
similar for both the indexes, we are going to show just the
rst one.</p>
        <p>The contexts index is a matrix that describes the
frequency of abstract tags over the concrete ones. Each column
corresponds to a concrete tag, and each row corresponds to
an abstract tag. Each entry in the matrix has three values
(Figure 4):</p>
        <p>Uij : represents the user that has associated the
abstract tag i to the concrete tag j rst;
Sij : a score that de nes how relevant the abstract tag
i is for the concrete tag j. This value is in the interval
[0; 1];</p>
        <p>ij : steadiness value that de nes how steady is the
association between the abstract tag i and the concrete
tag j.</p>
        <p>a1
a2
.
.
.</p>
        <p>
          Intuitively, since not all the abstract tags can be related
to all concrete tags, the proposed index will be a very sparse
matrix. At the same time, because of the very high number
of both concrete and abstract tags, the index can assume
very huge dimensions. However a lot of research is being
performed on indexes designing and analysis, also in the
CAR eld [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]. The related discussion is out of the scope this
work.
3.3.2
        </p>
      </sec>
      <sec id="sec-8-2">
        <title>Users’ score</title>
        <p>In our approach two values are associated to each user
and they de ne the goodness of the user in working with
contextual information:</p>
        <p>SUc : a score that de nes how good the user is in
associating concrete tags to abstract tags;
SUr : a score that de nes how good the user is in
associating resources to contexts;
As previously, we are concentrating only on the management
of values related to concrete and abstract tags, since the
approach is exactly the same working at the higher level of
tags and resources.</p>
        <p>Every time a new relation between abstract and concrete
tags is created with a de nition (\ lling a hole" in the index),
the user who performed the operation is associated to that
relation. Then on the basis of how the community
interacts with those contextual information, the user's score will
be update. It is calculated as follows: for each association
among tags ij performed by the user U , SUc corresponds to
the mean of the products ij Sij, where max is the
max
max steadiness value in the index.</p>
        <p>New associations have a low steadiness value, thus their
score, as their have not steadied yet, will have low in uence
on the user's score. Good associations will have high score
and steadiness values, and they will re ect on high users'
score. In the same way, low users' scores are due to bad
associations between contextual tags. Since Sij 2 [0; 1], also
SUc 2 [0; 1].</p>
        <p>In this approach, for simplicity, only new associations
between tags are considered for the computation of the users'
score. An extension could consider all the existing
associations. In this way a user is \good" because she de nes good
new associations and because she exploits existing good
association.
3.3.3</p>
      </sec>
      <sec id="sec-8-3">
        <title>Values update</title>
        <p>The proposed indexes are not static, but the values related
to the association between concrete and abstract tags and
resources are continuosly updated, based on the interaction
of users with resources in context.</p>
        <p>With every de nition operation the values in the contexts
index are updated according to the following system (for the
values in the resources index with the annotation operation
the approach is similar) :
ij(ti+1) = ij(ti) + SUc (ti)
ij(ti)</p>
        <p>Sij(ti)</p>
        <p>SUc (ti)
v =
Sij(ti+1) =</p>
        <p>ij(ti+1)
v if v &gt; 0
0 otherwise
where ti represents a discrete time instant and ti+1 the
subsequent time instant.</p>
        <p>While the score is a value in the interval [0; 1], the
steadiness is an always increasing value. The higher the steadiness
of an association is, the more stable the association is, and
then the lesser e ect each update operation will have. The
user's score is exploited for the update of the values in the
index. It can both increase an association, or decrease it
(e.g. a user removes a tags from his context). The higher
the user's score is, the more e ective the update operation
will be. This means that good users have more in uence on
the system than bad users. Finally, is a parameter greater
than 0 and it is used to weight the user score: operation
performed explicitly by users (inclusion or removal of abstract
tags) have more e ect than implicit update performed
automatically based on the interaction of the community with
the resources.</p>
      </sec>
      <sec id="sec-8-4">
        <title>3.3.4 Inference and retrieval</title>
        <p>The inference and retrieval operations works respectively
on the rst and second index, but they are similar, thus in
the following we are explaining just the inference one.</p>
        <p>The approach is the following:
1. starting from the concrete tags in input, we consider
only the set of abstract tags that have been associated
at least with one of the concrete tags;
2. for each abstract tag we compute a rank value, to
dene an order of relevance for the abstract tags;
3. in order to limit the number of retrievd tags, we
retrieve the abstract tags whose rank value is higher than
the mean of all rank values.</p>
        <p>The rank value is computed following an adapted version
of the tf.idf weighting scheme. In particular for each
considered abstract tag ai we have:</p>
        <p>A = Pcj ij</p>
        <p>Sij, for each sensed concrete tag cj
B = jCj , where jCj is the total number of
jfc : ai 2 cgj
sensed concrete tags, and jfc : ai 2 cgj is the number
of concrete tags to which the abstract tag ai has been
associated;
rank value = A B , where ; are parameters
exploited to weight the di erent values.</p>
        <p>Some considerations can be drawn. First, more are the
concrete tags in the current context to which an abstract
tag is associated, the higher will be its rank value. Second,
abstract tags with high score and steadiness will have an
higher rank value. Third, abstract tags related to particular
sets of concrete tags will have an higher rank value than
very general ones that are associated to an high number of
concrete tags (high frequency).</p>
        <p>In addition, starting from this basic approach, we can
enhance the rank value computation exploiting other
information. For example a reasonable idea is to weight the tags
based on their age in the user's context representation,
giving more importance to the newest tag. In this we enhance
the importance of new contexts.</p>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>DISCUSSION</title>
      <p>Although the conceptual ideas are clear, the
implementation approach we propose is in an initial stage of de nition.
We suggested a possible solution, but several are the ways
to re ne it and several are the algorithms to be exploited.
For this reason the evaluation hold an important role in our
work: since di erent alternative solution exist, it is
important to evaluate them and compare their e ectiveness.</p>
      <p>Even if the knowledge related to the whole community is
exploited to infer and re ne the current context of single
users, the proposed model di erentiates the personal from
the community level, giving more importance to the rst
one. For example if a user annotates a situation as \play",
she is considered to be in \play" context, even if most people
annotate the same situation as \work". On the contrary, if
a user is for the rst time in a situation (e.g. location never
visited), her context is re ned just with the information from
the community. Considering the previous example, as most
people annotate the situation with \work", the user is
considered to be in \work" context.</p>
      <p>In the last case, the assumption performed by the system
in order to provide the user with relevant resources could be
wrong. However this is not a problem. Since we are working
with people, it will be hardly possible to provide results that
totally satisfy each user, due the intrinsic di erence of views
and needs in a community. Rather our solution aims at and
averagely good behavior.</p>
      <p>Talking about the indexes, we have seen how the related
information are changed dynamically based on community
interaction. However this is not the only possible approach.
We can imagine complementary approaches that can
support the community statistical one. For example, we could
use some geographic gazetteer for associating geonames to
geographic coordinates provided from the concrete tags, so
as to reinforce the rank of associated abstract tags that
contain the same geographic names or names of close
localities. The geonames could be useful also for retrieving more
relevant resources, those containing the geonames ore close
geonames.</p>
    </sec>
    <sec id="sec-10">
      <title>CONCLUSIONS</title>
      <p>In this paper we have presented the Social Context-Aware
Browser, a general purpose solution to Web content perusal
by means of mobile devices. The sCAB is a novel approach
for the information access based on context, where the
community of users is called to manage the contextual
knowledge, both related to situations and resources, through
collaboration and participation. In particular we presented a
general survey, the main ideas, and an implementation
approach.</p>
      <p>
        As future work we aim at implementing a prototype of the
proposed system, and, in particular, we suggest a multistage
approach, where implementation and evaluation processes
will proceed hand in hand. As rst step we want to exploit
benchmarks to evaluate detailed implementation solutions,
like, for example, di erent algorithms to assess the relevance
of tags for situations and resources. After that, we plan to
apply an IIR evaluation methodology, involving users in a
controlled environments, following the ideas presented [
        <xref ref-type="bibr" rid="ref1 ref10">1,
10</xref>
        ]. Finally a broader user-centred evaluation will help us
to understand if the sCAB is e ective in the real world.
      </p>
    </sec>
    <sec id="sec-11">
      <title>Acknowledgements</title>
      <p>The authors acknowledge the nancial support of the
Italian Ministry of Education, University and Research (MIUR)
within the FIRB project number RBIN04M8S8, and the
region Friuli Venezia Giulia. This research has been partially
supported by MoBe Ltd. (www.mobe.it), an academic
spino company specializing in software for mobile devices.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>P.</given-names>
            <surname>Borlund</surname>
          </string-name>
          .
          <article-title>The IIR evaluation model: a framework for evaluation of interactive information retrieval systems</article-title>
          .
          <source>Information Research</source>
          ,
          <volume>8</volume>
          (
          <issue>3</issue>
          ):8{
          <issue>3</issue>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.</given-names>
            <surname>Go</surname>
          </string-name>
          <article-title>ker</article-title>
          , S. Watt,
          <string-name>
            <given-names>H. I.</given-names>
            <surname>Myrhaug</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Whitehead</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Yakici</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Bierig</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. K.</given-names>
            <surname>Nuti</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Cumming</surname>
          </string-name>
          .
          <article-title>An ambient, personalised, and context-sensitive information system for mobile users</article-title>
          .
          <source>In EUSAI '04: Proceedings of the 2nd European Union symposium on Ambient intelligence</source>
          , pages
          <volume>19</volume>
          {
          <fpage>24</fpage>
          . ACM,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Golder</surname>
          </string-name>
          and
          <string-name>
            <given-names>B. A.</given-names>
            <surname>Huberman</surname>
          </string-name>
          .
          <article-title>The structure of collaborative tagging systems</article-title>
          .
          <source>Arxiv preprint cs.DL/0508082</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>G. J. F.</given-names>
            <surname>Jones</surname>
          </string-name>
          and
          <string-name>
            <given-names>P. J.</given-names>
            <surname>Brown</surname>
          </string-name>
          .
          <article-title>Context-aware retrieval for ubiquitous computing environments</article-title>
          .
          <source>In Mobile HCI Workshop on Mobile and Ubiquitous Information Access</source>
          , volume
          <volume>2954</volume>
          , pages
          <fpage>227</fpage>
          {
          <fpage>243</fpage>
          .
          <string-name>
            <surname>Springer</surname>
            <given-names>LNCS</given-names>
          </string-name>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>D.</given-names>
            <surname>Lopez</surname>
          </string-name>
          de Ipin~a,
          <string-name>
            <given-names>J. I.</given-names>
            <surname>Vazquez</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Abaitua</surname>
          </string-name>
          .
          <article-title>A context-aware mobile mash-up plaftorm for ubiquitous web</article-title>
          .
          <source>In Proc. of 3rd IET Intl. Conf. on Intelligent Environments</source>
          , pages
          <volume>116</volume>
          {
          <fpage>123</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>S.</given-names>
            <surname>Mizzaro</surname>
          </string-name>
          .
          <article-title>Quality control in scholarly publishing: A new proposal</article-title>
          .
          <source>J. of the Am. Soc. for Information Science and Technology</source>
          ,
          <volume>54</volume>
          (
          <issue>11</issue>
          ):
          <volume>989</volume>
          {
          <fpage>1005</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>S.</given-names>
            <surname>Mizzaro</surname>
          </string-name>
          , E. Nazzi, and
          <string-name>
            <given-names>L.</given-names>
            <surname>Vassena</surname>
          </string-name>
          .
          <article-title>Retrieval of context-aware applications on mobile devices: how to evaluate?</article-title>
          <source>In Proc. of Information Interaction in Context (IIiX '08)</source>
          , pages
          <fpage>65</fpage>
          {
          <fpage>71</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>S.</given-names>
            <surname>Mizzaro</surname>
          </string-name>
          , E. Nazzi, and
          <string-name>
            <given-names>L.</given-names>
            <surname>Vassena</surname>
          </string-name>
          .
          <article-title>Collaborative annotation for context-aware retrieval</article-title>
          .
          <source>In ESAIR '09: Proceedings of the WSDM '09 Workshop on Exploiting Semantic Annotations in Information Retrieval</source>
          , pages
          <volume>42</volume>
          {
          <fpage>45</fpage>
          . ACM,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>T. O'Reilly</surname>
          </string-name>
          .
          <article-title>What is web 2.0, design patterns and business models for the next generation of software</article-title>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>D.</given-names>
            <surname>Petrelli</surname>
          </string-name>
          .
          <article-title>On the role of user-centred evaluation in the advancement of interactive information retrieval</article-title>
          .
          <source>Inf</source>
          . Process. Manage.,
          <volume>44</volume>
          (
          <issue>1</issue>
          ):
          <volume>22</volume>
          {
          <fpage>38</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Schmidt. Ubiquitous</surname>
          </string-name>
          Computing - Computing in Context.
          <source>PhD thesis</source>
          , Lancaster University,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>L.</given-names>
            <surname>Vassena</surname>
          </string-name>
          .
          <article-title>Context-aware retrieval going social</article-title>
          .
          <source>In 3rd Symposium on Future Directions in Information Access (FDIA)</source>
          .,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>