<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards a Visualization of Multi-faceted Search Results</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Bilal Alsallakh</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Silvia Miksch</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andreas Rauber</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Software Technology &amp; Interactive Systems Vienna University of Technology</institution>
          ,
          <country country="AT">Austria</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>A common way of formulating search queries over a set of items is to select facets these items should satisfy. For example, when searching for a specific person based on specific skills, the user wants to specify the skills she is searching for. Very often, few or no search results are returned that satisfy all search facets, which leads the user to iteratively refine her search. This process is not only tedious and time consuming, but it might cause the user to miss relevant results that partially satisfy the search constraints. We present a visualization of multi-faceted data which provides an overview of which data items satisfy each combination of search facets. By means of interaction and visual guidance, the user can interactively refine her search queries and retrieve the items that satisfy as much of the desired search facets as possible.</p>
      </abstract>
      <kwd-group>
        <kwd>Multi-faceted search</kwd>
        <kwd>search interface</kwd>
        <kwd>visual queries</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        With the advances of user interfaces, new search modalities have emerged beyond
classical text-based search mechanisms. The field of Information Visualization offers
several possibilities to explore search spaces and conduct visual queries on the data [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],
and to visualize the query results in intelligible and engaging ways [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        Faceted search [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] is an information-retrieval technique which assumes that the data
items being searched can be multi-classified into facets. Such classification paradigm
assigns one or more facets to each data item, based on its properties. The items are
retrieved based on these facets, where users can define which facets they want to include
in the search results.
      </p>
      <p>
        Several visualization techniques have been proposed to support conducting faceted
search and browsing multi-faceted data. MetaCrystal [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] was originally proposed to
visualize meta-search results, where one search item can be retrieved by one or more
search engines. The system uses labeled and colored glyphs to indicate results retrieved
by different combinations of search engines. A follow-up system called
searchCrystal [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] demonstrates additional views and capabilities to analyze individual search
results. PivotPaths [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] is an exploration interface for strolling through faceted
information spaces. The items are depicted in a row and are connected to facets via links.
FacetMap [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] is designed to assist users in selecting search facets as filters and in
browsing the results.
      </p>
      <p>We propose a visual metaphor and a search interface to support users in
exploring faceted data and in conducting faceted search on the data. Our proposals combine
several ideas from previous visualization techniques, as explained next.</p>
    </sec>
    <sec id="sec-2">
      <title>The Proposed Search Interface</title>
      <p>The search facets used to classify data items define sets over these items. Each of these
sets contains the items that satisfy the respective facet. Analyzing which facets can
be satisfied together is hence equivalent to analyzing the overlaps (i.e. intersections)
between the respective sets.</p>
      <p>
        A variety of techniques has been proposed to visualize overlapping sets [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. These
techniques vary in how they visually represent the sets, which set-related tasks they
support, and how scalable they are in the number of sets and elements.
      </p>
      <p>
        Our visualization approach for multi-faceted data is based on the Radial Sets [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
technique for visualizing overlapping sets. This technique uses a radial layout to show
the search facets in separate regions, with a histogram in each region showing the data
items that satisfy each facet (Fig. 1). We distinguish between the items in each facet
by how many other facets they satisfy. Items that satisfy only one facet are included at
the outermost histogram bars next to the facet label. Items that satisfy two facets are
included in the next histogram bar, and so on. Hence, the histogram bars closer to the
central area contain items that satisfy to the largest possible number of facets.
      </p>
      <p>It is possible to see immediately from the visualization, if items satisfying a certain
search facet tend to satisfy other facets or not. For example items satisfying ‘facet A’ in
Fig. 1 cannot satisfy other search facets, since all of them lie in the 1st and outermost
bar in the respective region. On the other hand, all items satisfying ‘facet D’ satisfy
three other facets, since all of them lie in the 4th and innermost bar in the respective
region.</p>
      <p>Besides showing how data items are distributed according to individual facets, the
visualization also shows how these items are distributed into facet combinations. These
combinations are visualized as bubbles in the inner area, organized into concentric rings
(Fig. 1). The outermost ring contains combinations between pairs of facets, the next ring
contains combinations between three facets, and the innermost ring contains
combinations between four facets. The size of a bubble encodes the number of data items that
satisfy the respective facet combination. The bubbles are sorted by size in the respective
ring. To avoid visual clutter, the visualization initially does not indicate which facets are
involved in a specific bubble. This information can be obtained on demand by hovering
the mouse over a bubble. The respective facet combination is shown in a tooltip and
can additionally be highlighted by means of visual links between the bubble and the
respective regions. Alternatively, links can be depicted to show facet combinations of
certain degrees. Fig. 2 show combinations between pairs of facets, where the link
thickness indicates the number of items that satisfy the respective pair. It is possible to select
the rings starting for a specific number of facets, to focus on items that satisfy as many
facets as possible.</p>
      <p>Interaction allows selecting certain items in the visualization to explore these items
in detail. The search interface contains multiple views that allow showing the
information at multiple levels of detail (Fig. 2). Two views on the left side contain bar charts
that show how many items belong to each facet, and how many facets the items can
belong to. The central view shows the facets and their combinations, with possibility
to select certain items. Selected items are shown in detail as a list on the right side.
They are also highlighted in the histograms to indicate to which facets or facet
combinations these items belong. The selection can hence be refined using set operations by
iteratively clicking on further visual elements in any of the views, in combination with
certain keyboard modifiers 1.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Discussion and Conclusion</title>
      <p>The presented search interface offers a compact overview of how many results will
be retrieved according to different facets and facet combinations. The visual metaphor
scales up to 20-30 search facets that are shown in the sectors. The ‘Items by #facets’
histogram indicates the largest number of facets that can be satisfied at once. Based
on this number, the user can select the most relevant facets for her search query. For
example, the user can start by selecting ‘English’ and an important skill when searching
for a job candidate. This highlights matching portions in all histograms for all facets.
Based on this visual guidance, the user can iteratively check and decide which facets can
still be satisfied, and narrow the search by combining selections using ‘AND’ operator.</p>
      <p>The user needs to learn the visual metaphor in order to make effective use of the
presented search interface. An evaluation study is needed to assess the usability and
effectiveness of the proposed visual interface, and to refine the design accordingly. Also,
more work is needed to allow users to interactively define their search facets, and to
specify which ones are required and which ones are optional in the search results.
1 A video and an interactive prototype that demonstrate possible interactions are available at
www.radialsets.org</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Czerwinski</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meyers</surname>
            ,
            <given-names>B.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Robertson</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tan</surname>
            ,
            <given-names>D.:</given-names>
          </string-name>
          <article-title>FacetMap: A scalable search and browse visualization</article-title>
          .
          <source>Visualization and Computer Graphics, IEEE Transactions on 12(5)</source>
          (
          <year>2006</year>
          )
          <fpage>797</fpage>
          -
          <lpage>804</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. Do¨rk,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Carpendale</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Williamson</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          :
          <article-title>Fluid Views: a zoomable search environment</article-title>
          .
          <source>In: Proceedings of the International Working Conference on Advanced Visual Interfaces</source>
          ,
          <source>ACM</source>
          (
          <year>2012</year>
          )
          <fpage>233</fpage>
          -
          <lpage>240</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Tunkelang</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Faceted search</article-title>
          .
          <source>Synthesis lectures on information concepts</source>
          ,
          <source>retrieval, and services 1</source>
          (
          <issue>1</issue>
          ) (
          <year>2009</year>
          )
          <fpage>1</fpage>
          -
          <lpage>80</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Spoerri</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>MetaCrystal: visual interface for meta searching</article-title>
          .
          <source>In: ACM SIGCHI Conference on Human Factors in Computing Systems</source>
          (CHI)
          <article-title>- extended abstracts</article-title>
          . Volume
          <volume>24</volume>
          . no 29., ACM (
          <year>2004</year>
          )
          <fpage>1558</fpage>
          -
          <lpage>1558</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Spoerri</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Visual mashup of text and media search results</article-title>
          . In: International Conference Information Visualization (
          <article-title>IV), IEEE (</article-title>
          <year>2007</year>
          )
          <fpage>216</fpage>
          -
          <lpage>221</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6. Do¨rk,
          <string-name>
            <surname>M.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Henry</given-names>
            <surname>Riche</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Ramos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Dumais</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.:</surname>
          </string-name>
          <article-title>PivotPaths: Strolling through faceted information spaces</article-title>
          .
          <source>Visualization and Computer Graphics</source>
          , IEEE Transactions on
          <volume>18</volume>
          (
          <issue>12</issue>
          ) (
          <year>2012</year>
          )
          <fpage>2709</fpage>
          -
          <lpage>2718</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Alsallakh</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Micallef</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aigner</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hauser</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miksch</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rodgers</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Visualizing sets and set-typed data: State-of-the-art and future challenges</article-title>
          . In: Eurographics conference on Visualization (
          <article-title>EuroVis) State of The Art Reports</article-title>
          ,
          <string-name>
            <surname>Eurographics</surname>
          </string-name>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Alsallakh</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aigner</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miksch</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hauser</surname>
          </string-name>
          , H.:
          <article-title>Radial Sets: Interactive visual analysis of large overlapping sets</article-title>
          .
          <source>Visualization and Computer Graphics</source>
          , IEEE Transactions on
          <volume>19</volume>
          (
          <issue>12</issue>
          ) (
          <year>2013</year>
          )
          <fpage>2496</fpage>
          -
          <lpage>2505</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>