<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Catching the User - Logging the Information Retrieval Dialogue</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Paul Landwich</string-name>
          <email>paul.landwich@fernuni-hagen.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Claus-Peter Klas</string-name>
          <email>claus-peter.klas@fernuni-hagen.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matthias Hemmje</string-name>
          <email>matthias.hemmje@fernuni-hagen.de</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>FernUniversität in Hagen</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>FernUniversität in Hagen</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>FernUniversität in Hagen</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2009</year>
      </pub-date>
      <fpage>19</fpage>
      <lpage>23</lpage>
      <abstract>
        <p>This position paper supports the idea of the information dialog between IR systems and users during an information search task. In order to satisfy the communication and interaction needs of humans, IR systems should explicitly support the cognitive abilities of the users. An information dialogue which does not only support an individual query but also the complete search process is necessary. Only in this way it is possible to satisfy an information need.</p>
      </abstract>
      <kwd-group>
        <kwd>information retrieval</kwd>
        <kwd>visualization</kwd>
        <kwd>interactive systems</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>Information seeking is usually not a single step to recover a
piece of information, but a cyclic, highly interactive process
with the aim to satisfy a speci c information need. Within
such a process the user builds a cognitive model, which helps
her to re ect and advance the search process.Within user
interfaces, it is necessary to integrate tools and
functionalities within existing tools, in order to develop this cognitive
perception and derive a context model of the users.
Requirements for this are logging of all user and system activities
ranging from entered queries to the result sets, tools to
visualize the context and system support based on a context
analysis.</p>
    </sec>
    <sec id="sec-2">
      <title>ASPECTS</title>
      <p>In order to support the statement of the introduction, we
would like to dwell on three aspects.</p>
    </sec>
    <sec id="sec-3">
      <title>Logging</title>
      <p>As stated above we need to log all user and system
activities and the corresponding result sets within a task to
catch the users context. From the experience one knows
that a search task is usually not concluded with the rst
query. Rather a working context through the interaction is
elaborated. When this understanding becomes clear, there
must be some kind of accompanying information dialogue.
A dialogue consists of a sequence of activities and results.</p>
      <p>
        In the past initial research ([
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]) focused on the
human users not only as a part of the system but also as
an important component. In later works it was recognized
that the search is a process. In other papers (e.g. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]) the
search strategies and search patterns where investigated.
The overall complexity of the search process was exposed
([
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ],[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]). In [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] a continuation models of information
dialogue was introduced, to cover this search process.
      </p>
      <p>The process of the related research was consistent:
Starting from the support and improvement of individual queries,
up to a more global view of the search process and dialogue.
But this global view must become granular again. In order
to interpret a process or a dialog, the individual steps must
be identi ed and formalized within this dialog.</p>
      <p>
        [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] identi ed six activities { exploration, navigation, focus,
inspection, evaluation and store { to focus on to derive a
context model of the user.
      </p>
      <p>1. Exploration: The access to set of information
objects in the form of a query and the visualization and
realisation of the produced result set de nes the
Exploration. A change respectively an enlargement of
the informal context is caused by it.
2. Focus: The focus set represents the subset of
information objects of a result set which reach the eld of
vision of the user through a visualisation and is the
result of the activity Focus
3. Navigation: The movement within a set of
information objects (information room) or between di erent
information rooms. This causes a change of the focus.
4. Inspection: Inspection is used for the cognitive
determination of the state of an information object.
5. Evaluation: Evaluation gives the system a
feedback of the user's understanding of relevance and
appoints the veri ed recall set.
6. Store: This activity allows to store found documents.</p>
      <p>It either happens logically in form of a storage box on
the user interface or physically when a document is
downloaded or printed.</p>
      <p>Based on these de nitions we can log a dialog or the
whole search process with the system. Because some of
these acitivities correlate we can identify three interactive
modes. The user nds oneself in one of theses modes and will
change cicular the mode. The rst mode is every time access.
Within this mode there is only one activity, Exploration.
Already after the rst Exploration the user changes into
the second mode Orientation. Activities for this mode are
Navigation, Focus and Inspection. The user is now in
the ability to change the visual as well as the informational
focal point in an information visualisation of the dialogue
context. The mode Assessment is reached, if the user nds
objects of interest during his ispection. For this mode the
activities Evaluation and Store are available. They help
to express the users appreciation of relevance and to de ne
the identi ed recall set.</p>
      <p>
        Beside di erent models for information searching ([
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ],
[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]) it was [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] who combined these approaches in a new
model. Based on idea we can enhance this model with our
activities and interactive modes (see gure 1).
      </p>
      <p>Interactive
Session 1</p>
      <p>
        The past research ([
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]) showed that information
visualization is an important concept for the cognitive support
of the user. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] said: "`Visual interfaces to IR systems
exploit powerful human vision and spatial cognition to help
humans mentally organize and electronically access and
manage large, complex information spaces. The aim is to shift
the user's mental load from slow reading to faster perceptual
processes such as visual pattern recognition."'.
      </p>
      <p>
        This statement leads us to the second aspect of our
position. If we understand search as a process, whose
progression lls our context, then we need also support, in order to
understand and interpret this context. So the visualization
of results must go beyond the usual measure. Especially the
di erent sets of information objects shown in [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] seems to be
useful to visualize (see gure 2). The user needs a portfolio
of visualization tools which approach his cognitive abilities.
Furthermore, the user must be able to get the full control
of his search history and the developed information context.
By logging all activities and the sets of information objects
resulting from it, we are able to get a rst formal overview
of our context.
      </p>
      <p>A rst prototype is developed which visualize the di
erent sets of information objects during an information search</p>
      <p>R
rtotal: Context set
ke,1,ke,2,ke,3: Explored recall set
kf,1,kf,2,kf,3: Fokused recall set
kv,1,kv,2,kv,3: Verified recall set
process (see gure 3). In a next step we will evaluate this
prototype.</p>
      <p>Following the formal description of the information
dialogue and given the demands we want to introduce the
Da odil-system as an experimental system for further
development and evaluation of the above described model. It
provides already, up to a certain extend, the demand for
mapping the user activities to existing available tools.</p>
      <p>With the information of our context model including the
search path we identifed the following challenges:
Relevance Feedback The users implicit and explicit
relevance assessments must be captured and related to
possible relevant documents.</p>
      <p>Search strategy With the help of the user or by
monitoring the activities the system must provide di erent
search strategies to raise e ciency.</p>
      <p>Collaborative recommendations By logging many
different searches in form of a set of activities, it is
possible to support a user through collaborative
recommendations. Analyzing a new search from the beginning,
the system is able to identify similar stored search
processes. If this knowledge is visualized for the user, he
could get bene t for his own search task.</p>
    </sec>
    <sec id="sec-4">
      <title>CONCLUSIONS</title>
      <p>The idea of this position paper is to support users within
a search task by logging all activities between the user and
the system. For this, we are able to visualize the context
and make it cognitive perceptible. Furthemore, we are able
to draw conclusions from this activities. This captured
information represents the basis to further understand and
support the user. Such support could be done through
recommendation via implicit relevance feedback as well as
collaborative recommendations through other users in a similar
situation. We think, that given the context model within
the Da odil-Framework, we are able to understand and
categories user behavior and provide solid data to support
system oriented IR evaluation, e.g. based on user simulation.</p>
      <p>
        We currently investigate and evaluate our research using
the Da odil - framework ([
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]) as an experimental system. In
order to evaluate the listed aspects, we momentarily work
on the following projects:
      </p>
      <p>Task manager: A tool to capture and log all activities
and resulting sets of information objects of a search
task over more then one session.</p>
      <p>Visualization: Visualize the context and search path
with help of venn diagrams.</p>
      <p>Relevance feedback: Interpretation of activities as
implicit relevance feedback with term suggestions and
reranked result lists.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>N. J.</given-names>
            <surname>Belkin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Cool</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Stein</surname>
          </string-name>
          , and
          <string-name>
            <given-names>U.</given-names>
            <surname>Thiel</surname>
          </string-name>
          . Cases, scripts, and
          <article-title>information-seeking strategies: On the design of interactive information retrieval systems</article-title>
          .
          <source>In Arbeitspapiere der GMD</source>
          . GMD,
          <string-name>
            <surname>Sankt</surname>
            <given-names>Augustin</given-names>
          </string-name>
          ,
          <year>November 1994</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>R. . B. H.</given-names>
            <surname>Belkin</surname>
          </string-name>
          ,
          <string-name>
            <surname>N. J.</surname>
          </string-name>
          ; Oddy.
          <article-title>Ask for information retrieval</article-title>
          .
          <source>Journal of Documentation</source>
          ,
          <volume>38</volume>
          :
          <fpage>61</fpage>
          {71 (
          <issue>Teil 1</issue>
          ) &amp;
          <volume>145</volume>
          {164 (
          <issue>Teil 2</issue>
          ),
          <year>1982</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>K.</given-names>
            <surname>Bo</surname>
          </string-name>
          <article-title>rner and C. Chen. Visual interfaces to digital libraries: Motivation, utilization, and socio-technical challenges</article-title>
          . In Visual Interfaces to Digital Libraries, pages
          <volume>1</volume>
          {
          <fpage>12</fpage>
          , London, UK,
          <year>2002</year>
          . Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>N.</given-names>
            <surname>Fuhr</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.-P.</given-names>
            <surname>Klas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schaefer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Mutschke</surname>
          </string-name>
          .
          <article-title>Da odil: An integrated desktop for supporting high-level search activities in federated digital libraries</article-title>
          .
          <source>In Research and Advanced Technology for Digital Libraries. 6th European Conference, ECDL 2002</source>
          , pages
          <fpage>597</fpage>
          {
          <fpage>612</fpage>
          , Heidelberg et al.,
          <year>2002</year>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>P.</given-names>
            <surname>Ingwersen</surname>
          </string-name>
          .
          <article-title>Cognitive perspectives of information retrieval interaction: elements of a cognitive ir theory</article-title>
          .
          <source>Journal of Documentation</source>
          ,
          <volume>52</volume>
          :3{
          <fpage>50</fpage>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>C. C.</given-names>
            <surname>Kuhlthau</surname>
          </string-name>
          .
          <article-title>Longitudinal case studies of the information search process of users in libraries</article-title>
          .
          <source>Library &amp; Information Science Research</source>
          ,
          <volume>10</volume>
          :
          <fpage>257</fpage>
          {
          <fpage>304</fpage>
          ,
          <year>1988</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>P.</given-names>
            <surname>Landwich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Vogel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.-P.</given-names>
            <surname>Klas</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Hemmje</surname>
          </string-name>
          .
          <article-title>Supporting patent retrieval in the context of innovation-processes by means of information visualisation</article-title>
          .
          <source>In Proceedings of ECKM</source>
          <year>2008</year>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>P.</given-names>
            <surname>Landwich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Vogel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.-P.</given-names>
            <surname>Klas</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Hemmje</surname>
          </string-name>
          .
          <article-title>Model to support patent retrieval in the context of innovation-processes by means of dialogue and information visualisation</article-title>
          .
          <source>Electronic Journal of Knowledge Management</source>
          ,
          <volume>7</volume>
          :
          <fpage>87</fpage>
          {
          <issue>98</issue>
          ,
          <fpage>1</fpage>
          <lpage>2009</lpage>
          . http://www.ejkm.com/volume-7
          <source>/v7-1/v7-i1-art9.htm.</source>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>L.</given-names>
            <surname>Nowell</surname>
          </string-name>
          , E. Hetzler, and
          <string-name>
            <given-names>T.</given-names>
            <surname>Tanasse</surname>
          </string-name>
          .
          <article-title>Change blindness in information visualization: A case study</article-title>
          .
          <source>In INFOVIS '01: Proceedings of the IEEE Symposium on Information Visualization</source>
          <year>2001</year>
          (INFOVIS'01), page 15, Washington, DC, USA,
          <year>2001</year>
          . IEEE Computer Society.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>R.</given-names>
            <surname>Oppermann</surname>
          </string-name>
          .
          <article-title>Adaptive user support: ergonomic design of manually and automatically adaptable software</article-title>
          . L. Erlbaum Associates Inc., Hillsdale, NJ, USA,
          <year>1994</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>N.</given-names>
            <surname>Pharo</surname>
          </string-name>
          .
          <article-title>A new model of information behaviour based on the search situation transition schema</article-title>
          .
          <source>Inf. Res.</source>
          ,
          <volume>10</volume>
          (
          <issue>1</issue>
          ),
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>D. E.</given-names>
            <surname>Rose</surname>
          </string-name>
          .
          <article-title>Reconciling information-seeking behavior with search user interfaces for the web</article-title>
          .
          <source>J. Am. Soc. Inf. Sci. Technol</source>
          .,
          <volume>57</volume>
          (
          <issue>6</issue>
          ):
          <volume>797</volume>
          {
          <fpage>799</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>T.</given-names>
            <surname>Saracevic</surname>
          </string-name>
          .
          <article-title>The strati ed model of information retrieval interaction: Extension and applications</article-title>
          .
          <source>In Proceedings of the American Society for Information Science</source>
          , volume
          <volume>34</volume>
          , pages
          <fpage>313</fpage>
          {
          <fpage>327</fpage>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>B.</given-names>
            <surname>Shneiderman</surname>
          </string-name>
          .
          <article-title>The eyes have it: A task by data type taxonomy for information visualizations</article-title>
          .
          <source>In VL '96: Proceedings of the 1996 IEEE Symposium on Visual Languages</source>
          , pages
          <volume>336</volume>
          {
          <fpage>343</fpage>
          , Washington, DC, USA,
          <year>1996</year>
          . IEEE Computer Society.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>Spink</surname>
          </string-name>
          .
          <article-title>A user-centered approach to evaluating human interaction with web search engines: an exploratory study</article-title>
          .
          <source>In Information Processing and Management</source>
          , pages
          <volume>401</volume>
          {
          <fpage>426</fpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>M.</given-names>
            <surname>Twidale</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Nichols</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. B.</given-names>
            <surname>Twidale</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D. M.</given-names>
            <surname>Nichols</surname>
          </string-name>
          .
          <article-title>Collaborative browsing and visualisation of the search process</article-title>
          . In
          <source>In Proceedings of ELVIRA-96</source>
          , Milton Keynes, pages
          <volume>48</volume>
          {
          <fpage>7</fpage>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Xu</surname>
          </string-name>
          .
          <article-title>The dynamics of interactive information retrieval behavior, part i: An activity theory perspective</article-title>
          .
          <source>J. Am. Soc. Inf. Sci. Technol</source>
          .,
          <volume>58</volume>
          (
          <issue>7</issue>
          ):
          <volume>958</volume>
          {
          <fpage>970</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>