<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Visualization Tool of Probabilistic Models for Information Access Components</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Giorgio Maria Di Nunzio Dept. of Information Engineering University of Padua Via Gradenigo 6/a</institution>
          ,
          <addr-line>35131 Padua</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2010</year>
      </pub-date>
      <fpage>27</fpage>
      <lpage>28</lpage>
      <abstract>
        <p>An e ective graphic interface is a key tool to improve the fruition of the results retrieved by an Information Retrieval (IR) system. In this work, we describe a two-dimensional interface that represents the documents ranked on a Cartesian space and allows the user to interact with the documents in order to improve the results of the search engine. Results are classi ed and ranked according to the best separating line of the two classes of documents: relevant and non relevant documents. Mathematical tools such as least squares distances are used to train the supervised algorithm that nds the separating and ranking lines.</p>
      </abstract>
      <kwd-group>
        <kwd>Information Visualization</kwd>
        <kwd>Machine Learning</kwd>
        <kwd>Nave Bayes Models</kwd>
        <kwd>Relevance Feedback</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>
        Visualization is the process of transforming data,
information, and knowledge into graphic presentations to support
tasks such as data analysis and information exploration. The
de nition of a spatial structure for information visualization
is challenging because data in an information space may be
multi-faceted, relationships of data are interwoven and are
complicated. Moreover, the de nition of such a space means
a complex process of extracting displayable attributes from
objects, organizing the information, projecting objects onto
This is an extended abstract of [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
the structure, and synthesizing search features, objects and
object relationships into the visual space [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        The introduction of visualization environments may add
cognitive processes to the user who needs to understand and
learn the characteristics of the new environment and
interact with them to get the best from the system. In fact,
the aim of visualization environments, as external
representation of the world of interest, is to reduce the amount of
cognitive e ort required to solve informationally equivalent
problems [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In particular, an IR system should provide
users an environment in which they can exploit their skills
to maximize their cognitive abilities. The visualization of an
IR system is nothing but a process that transforms invisible
abstract data and their semantic relationships in a visible
collection on a display in order to nd the user information
need more easily.
      </p>
      <p>
        In this paper, we present the design and implementation a
tool for the visualization of Nave Bayes (NB) probabilistic
models for information access components that represents
digital objects on the two-dimensional space [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">2, 3, 1</xref>
        ]. The
demonstration will applied to the task of automatic text
classi cation and text retrieval.
2.
      </p>
    </sec>
    <sec id="sec-2">
      <title>DESIGN</title>
      <p>The model which upholds the visualization tool de nes
a direct relationship between the probability of an object
given a category of interest and a point on a two-dimensional
space. In this light, it is possible to graph entire collections
of objects on a Cartesian plane, and to design algorithms
that categorize and retrieve documents directly on this
twodimensional representation. This tool demonstrates to be a
valid visualization tool also for understanding the
relationships between categories of objects.</p>
      <p>The design of the two-dimensional visualization tool
follows two main requirements:
for end-user, the interface should give the opportunity
to de ne the query with simple or advanced options,
and to express judgements for the documents retrieved
which will be used to re-rank documents;
for researchers, the interface should display the
decisions taken by the search engine in terms of separating
line and explain how the relevance feedback given by
the user a ects the list of ranked documents.</p>
      <p>The interface o ers the possibility to write free text queries,
as any other search engine, or load prede ned queries;
prede ned queries are used for research purposes and recreates
the environment of evaluation tasks organized by campaign
such as TREC1 or CLEF2.</p>
      <p>The interface associate each document of the collection to
a point in the two-dimensional space according to a
probabilistic algorithm: the abscissa re ects how much the
document is relevant to the query, the ordinate re ects how
much the document is not relevant to the query. The pair of
numbers gives an indication of the fraction of relevance for
that particular document given the query, this pair is
plotted on a frame and the relative position of this point with
respect to the other documents in the collection determines
its position in the list of ranked documents.</p>
      <p>
        In the two-dimensional representation of documents, the
equation of the ranking or the classi cation function has to
be written in such a way that each coordinate of a document
is the sum of two addends: a variable component P(djci),
the probability of a document d given a category of interest
ci, and a constant component P(ci), the prior of the category
of interest ci [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] For example, in the case of NB models the
equation becomes:
      </p>
      <p>X{i(zd)
log (P(djci)) + log (P(ci)) &gt; log (P(djci)) + log (P(ci))
| } | }
Yi{(zd)
When the inequality holds, the document is considered an
element of category ci. If ci and ci are considered
respectively the set of relevant documents and the set of non
relevant documents, we can divide the collection of documents
in these two sets; if we are only interested in the ranking of
documents, we can compute the list of retrieved documents
by combining the two components into one relevance weight.</p>
      <p>
        Documents can be classi ed or ranked di erently
according to the Focused Angular Region algorithm which
computes the best separating (or ranking) line by means of
regression techniques and least squares orthogonal, and
vertical, distances. Information about the categories of
documents are collected during the interaction of the user with
the interface; in particular, the relevance judgements that
the user expresses for the documents are used to re-compute
the probabilities and train the algorithm (details of this
supervised algorithm are given in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]). This part can be done
automatically by selecting in the interface the option \Blind
relevance feedback", which takes the rst n documents of
the current list of documents and set them as relevant.
      </p>
    </sec>
    <sec id="sec-3">
      <title>RESULTS AND OPEN QUESTIONS</title>
      <p>
        This visualization tool was tested on standard benchmark
collections and a demonstration was presented at [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] in
order to answer the following research questions: how well the
ranking or classi cation functions are learned from the data
as separating lines; how particular unbalanced distribution
of documents can be corrected by means of parameter
estimation; how the multivariate model and the multinomial
model perform on di erent languages; how blind and/or
explicit relevance feedback a ect ranking list, and how the
selection of relevant documents changes the shape of the
clouds of relevant and non-relevant documents.
      </p>
      <p>During the interaction with the system, new questions and
new research ideas were collected about advances types of
interaction: changing the estimated probability of terms
directly; smoothing parameters in order to see how the clouds
of points move in the space and how the performance changes
accordingly; drawing the clouds of points incrementally,
highlighting the contribution of each term to understand which
terms better discriminate the two sets of points.</p>
      <p>In Figure 1, a screen-shot of the main window of the
visualization tool si shown. The example shows the interface
used by researchers. The di erent separating lines are
calculated for a blind relevance feedback of 10 documents: the
category of relevant documents in blue, the category of non
relevant documents in red, the best separating line in
purple. The list of retrieved documents is presented on the
right. The user can choose to select a document, read it,
and judge it as relevant or non relevant. This information is
stored and used to train the supervised algorithm when the
user selects the \update search" box.
4.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>L.</given-names>
            <surname>De Stefani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. M.</given-names>
            <surname>Di Nunzio</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G.</given-names>
            <surname>Vezzaro</surname>
          </string-name>
          .
          <article-title>A visualization tool of probabilistic models for information access components</article-title>
          .
          <source>In Proceedings of Research and Advanced Technology for Digital Libraries (ECDL</source>
          <year>2009</year>
          ), Corfu, Greece, September/
          <year>October 2009</year>
          . LNCS, Springer.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>G. M. Di</given-names>
            <surname>Nunzio</surname>
          </string-name>
          .
          <article-title>Visualization and Classi cation of Documents: A New Probabilistic Model to Automated Text Classi cation</article-title>
          .
          <source>Bulletin of the IEEE Technical Committee on Digital Libraries (IEEE-TCDL)</source>
          ,
          <volume>2</volume>
          (
          <issue>2</issue>
          ),
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>G. M. D.</given-names>
            <surname>Nunzio</surname>
          </string-name>
          .
          <article-title>Using Scatterplots to Understand and Improve Probabilistic Models for Text Categorization and Retrieval</article-title>
          .
          <source>Journal of Approximate Reasoning</source>
          ,
          <volume>50</volume>
          (
          <issue>7</issue>
          ):
          <volume>945</volume>
          {
          <fpage>956</fpage>
          ,
          <year>July 2009</year>
          . http://dx.doi.org/10.1016/j.ijar.
          <year>2009</year>
          .
          <volume>01</volume>
          .002.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Scaife</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Scaife</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Rogers</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Rogers</surname>
          </string-name>
          .
          <article-title>External cognition: how do graphical representations work</article-title>
          ?
          <source>International Journal of Human-Computer Studies</source>
          ,
          <volume>45</volume>
          :
          <fpage>185</fpage>
          {
          <fpage>213</fpage>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>J. Zhang.</surname>
          </string-name>
          <article-title>Visualization for Information Retrieval</article-title>
          , volume
          <volume>23</volume>
          <source>of The Information Retrieval Series</source>
          . Springer,
          <year>2008</year>
          . ISBN:
          <fpage>978</fpage>
          -3-
          <fpage>540</fpage>
          -75147-2.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>