<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>a Case Study of Aesthetics and Interaction in a Generative Information Visualization Method</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Luca Buriano Telecom Italia Lab Via Reiss Romoli</string-name>
          <email>luca.buriano@telecomitalia.it</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Torino</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Italy</string-name>
        </contrib>
      </contrib-group>
      <abstract>
        <p>Interactive applications can greatly benefit from Information Visualization (Infovis) methods addressing aesthetic and creative design aspects, to help in effectively conveying the meaning of complex data. We present a novel Infovis design and method, applied to the interactive visual exploration of Italian wines' properties. This work adopts a generative approach, based on automatic creation of the visual layout according to functional as well as aesthetic and perceptual criteria.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Information visualization</kwd>
        <kwd>graphic design</kwd>
        <kwd>generative art</kwd>
        <kwd>generative design</kwd>
        <kwd>visual recommender systems</kwd>
        <kwd>interactive data exploration</kwd>
        <kwd>wine culture</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>
        Aesthetic and creative design aspects are essential to the
development of a successful Information Visualization (Infovis)
project, helping to immediately and effectively convey the
meaning of complex data [
        <xref ref-type="bibr" rid="ref6">10</xref>
        ]. To this end, we think that
inspiration can be found in the approach of generative visual art
and generative graphic design, where the artist/designer, after
envisioning a set of aesthetic, functional and semantic criteria,
models them as a process and lets the resulting system organize
into the actual, emergent visual patterns [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ][
        <xref ref-type="bibr" rid="ref5">5</xref>
        ][6]. This kind of
flexibility can greatly benefit interactive applications, where the
visualized data are dynamic by nature. Following this framework,
we present a demonstration of a novel Infovis visual concept and
method, applied to an interactive application scenario. This
concept emphasizes, in addition to its specific visual design: a)
visual layout creation driven by a fitness function taking into
account not only data relationships, but also aesthetic, perceptual
Presented at EuroHCIR2012. Copyright © 2012 for the individual
papers by the papers' authors. Copying permitted only for private and
academic purposes. This volume is published and copyrighted by its
editors.
and graphic design aspects; b) immediacy and easiness in the
interactive exploration of the resulting visualization.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. RELATED WORK</title>
      <p>
        The aesthetic features of an Infovis project depend primarily on
the human designer's creative design insights and skills [
        <xref ref-type="bibr" rid="ref6">10</xref>
        ][9]
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. When dealing with dynamic and interactive applications,
where the data to visualize are selected on the fly, the designer
faces the additional challenge of managing the layout and
aesthetics of unpredictable data configurations. In the Infovis
field, this is usually addressed in essentially two ways: a) letting
the aesthetic features emerge from layout algorithms designed to
show data properties and relationships with clarity (see, for
example, graph layout algorithms[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ][11]); b) directly embedding
aesthetic criteria into the visualization algorithm (see, for
example, circle packing layout algorithms [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]). However, the
combined use of a) and b) and the embedding of multiple,
potentially complex aesthetic factors remain challenging and
relatively unexplored areas. Our work aims to integrate the
approaches a) and b) in a single generative framework. The
generative process is applied to a visual concept with many
degrees of freedom, related to the family of grid visualizations
(see for example [8]). The process is driven by a fitness function,
able to take into account multiple data-driven, aesthetic and
graphic design visual factors. The flexibility and modularity of the
fitness function allows the designer to experiment with different
aesthetic criteria and styles. Moreover, the generative approach
naturally leads to the creation of a diverse set of visual solutions
for a given data set, enriching the user's experience with a source
of visual novelty.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. APPLICATION SCENARIO</title>
      <p>Our work's example application scenario is a visual recommender
system on the domain of Italian wines from the Piemonte region,
based on a database of these wines and their properties related to
smell, taste, grapes and production locations. This application
scenario has been envisioned in the context of the “PIEMONTE
Project”1, a research project whose core concept is that “smart
things” can play the role of gateways for enhancing the interaction
between people and a territory with its cultural heritage.
When the user chooses a wine from the list, the system extracts
from the database a set of wines with similar properties (according</p>
      <sec id="sec-3-1">
        <title>1 http://www.piemonte.di.unito.it/index.html</title>
        <p>to a given similarity function) and creates an interactive
visualization of this set, allowing visual exploration of wines'
properties.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. VISUALIZATION</title>
      <p>Our visualization method works on a set of n items, where each
item, identified by a name label, is linked to a list of properties
taken from a domain-specific dictionary and categorized in
property groups. In the wine recommendation scenario, items and
item properties become wines and wine properties, categorized in
the following property groups: smell, taste, primary grape,
secondary grape and production location.</p>
      <p>The algorithm is composed by the following steps:
1) An initial visualization layout is built as a n x m matrix, where
each row corresponds to a distinct item and each column
corresponds to a distinct property (m is the number of distinct
properties appearing in the given item set). Each element in this
matrix, corresponding to a item-property combination, is assigned
a color, determined by the property group the element's property
belongs to, according to a given color table. For the wine domain,
we chose the following color table association: taste = red, smell
= indigo, primary grape = green, secondary grape = cyan,
production location = yellow. Elements corresponding to
itemproperty combinations not appearing in the visualized item set
(called in the following "empty elements") are assigned the
background color. A special column in the matrix will contain
item's name labels.
2) A large number of candidate visualization layouts is
generated, where each candidate is obtained by randomly
rearranging rows and columns in the matrix (keeping individual
rows and columns intact, for data coherence). Candidate layouts
are assigned a score according to a fitness function; the actual
visualization layout is randomly selected among the candidates
with the highest scores. The fitness function takes into account a
set of factors related to the visualization's functional, aesthetic and
graphic design factors, including:
•
•
•
•
minimization of the distance between rows
corresponding to similar items (the similarity between
two items is calculated as a function of the properties
they share);
preference for visual grouping of columns linked to the
same property group (i.e., of the same color);
preference for specific shape properties of local or
global visual emergent patterns (e.g., preference for
spatially compact patterns, minimizing the number of
gaps between colored matrix elements);
preference for specific color pairings of matrix
elements, according to a given color theory (e.g.,
preference for complementary colors of adjacent
elements).</p>
      <p>The fitness function is calculated as a weighted sum of
components, where each component calculates the score assigned
to a given layout with respect to a different design factor. This
modular structure allows for seamless modelization and inclusion
of other design factors when needed, for example when the
designer wants to experiment with different visual and interaction
styles.</p>
      <p>During this step, groups of two or more columns can be optionally
fused together into one column, provided that non-empty elements
from these columns won't overlap in the resulting column. These
column fusion operations generate new candidate layouts.
3) Finally, the chosen visualization layout is displayed (Figure 1).
Each matrix's element is drawn as a borderless tile painted with
the color associated to the element. Item names are displayed in
their column, with the tile belonging to the chosen item
highlighted by a thin border. Optionally, the brightness and width
of adjacent columns of the same color is slightly modified, in
order to increase visual diversity and allow the user to tell these
columns apart more easily.</p>
    </sec>
    <sec id="sec-5">
      <title>5. INTERACTION</title>
      <p>Interactive exploration of the resulting visualization can be
performed in several ways, including:
•
•
•
•
•
•
selecting a wine in the name column: all the wine's
properties in the corresponding row will be highlighted,
by showing their labels (e.g. in Figure 1, the 5th wine
from the top is selected) ;
selecting a property column: the property's label will be
shown at the interaction point and all the wines sharing
that property will be highlighted, emphasizing their
name labels' font and/or coloring their tiles with the
same color as the property tiles (e.g. in Figure 2, the
“amarognolo” (slighty bitter) taste property is selected).
It should be noted that, by default, properties' labels are
intentionally not shown until they (or related wine
names) are selected, in order to encourage visual data
exploration and reduce information overload. At any
moment the user can, of course, ask for permanent
display of a given label, or all labels;
asking for alternate layouts (from the best candidates
found in the step 2) of the visualization algorithm);
making a new recommendation/visualization query,
choosing one of the visualized wines, or a wine from the
global list;
changing the visualization's settings, e.g. setting the
number of similar wines shown as the result of a query,
or setting the minimum number of wines a property
must belong to, in order for the property to be shown;
manually rearranging the layout of rows and columns
with drag-and-drop actions.</p>
      <p>When the user makes a new query, a smooth visual transition
between visualization layouts is provided by animations
“dissolving” the current layout (by moving tiles outwards in
random directions and fading them out) and “assembling” the
new one (by moving tiles from random outscreen positions to
their actual position in the layout, and fading them in).</p>
    </sec>
    <sec id="sec-6">
      <title>6. IMPLEMENTATION</title>
      <p>The Infovis method described in this paper has been implemented
as a prototype application for the wine recommendation scenario
using Processing2, an open source programming language and
environment for creating images, animations, and interactions [7].
The availability of a powerful language for building visual
structures, together with the compatibility with the Java
programming language, made Processing an excellent rapid</p>
      <sec id="sec-6-1">
        <title>2 http://processing.org</title>
        <p>development environment for both the visual design and the
algorithmic aspects of our work.</p>
        <p>So far, we ran the prototype on standard PCs and on an interactive
whiteboard, the latter's large touchscreen providing a natural
environment for our work's visual and interactive features.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>7. PUBLIC DEMONSTRATION</title>
      <p>The prototype application was exhibited at the CHEESE 2011
festival3. We were located in the headquarters of Slow Food4, the
event's organizer and PIEMONTE Project's partner. At this place,
one of the event's focal points, people attending the event could
see the application, interact with it and comment on it. We
received a strong positive feedback from the event's visitors, about
both the usefulness and the aesthetic value of the presented
application.</p>
    </sec>
    <sec id="sec-8">
      <title>8. ACKNOWLEDGMENTS</title>
      <p>We wish to thank Slow Food for providing the database of wines'
properties used in our work.
[6] Mueller, B. VisualPoetry - generative graphic design for
poetry on the road. SIGGRAPH '09.</p>
      <p>DOI=http://dx.doi.org/10.1145/1667265.1667310
[7] Reas, C., Fry, B. Processing, a Programming Handbook for</p>
      <p>Visual Designers and Artists. The MIT Press (2007).
[8] Shneiderman, B, Feldman, D, Rose, A., Ferré Grau, X.</p>
      <p>Visualizing digital library search results with categorical and
hierarchical axes. In Proceedings of the fifth ACM
conference on Digital libraries (DL '00), 57-66.</p>
      <p>DOI=http://doi.acm.org/10.1145/336597.336637
[9] Tufte, E.R., Goeler, N.H., Benson, R. Envisioning
information. Graphics Press (1999).
[11] Visual Complexity. http://www.visualcomplexity.com/vc/</p>
      <sec id="sec-8-1">
        <title>4 http://www.slowfood.it/</title>
        <p>Figure 2.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Bateman</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mandryk</surname>
            ,
            <given-names>R.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gutwin</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Genest</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McDine</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brooks</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <article-title>Useful Junk?: the Effects of Visual Embellishment on Comprehension and Memorability of Charts</article-title>
          .
          <source>In Proceedings of the 28th international conference on Human factors in computing systems (CHI '10)</source>
          ,
          <fpage>2573</fpage>
          -
          <lpage>2582</lpage>
          . DOI=http://doi.acm.
          <source>org/10</source>
          .1145/1753326.1753716
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2] Collins,
          <string-name>
            <given-names>C.R.</given-names>
            ,
            <surname>Stephenson</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
          <article-title>A Circle Packing Algorithm</article-title>
          .
          <source>Compuntational Geometry</source>
          <volume>25</volume>
          (
          <year>2003</year>
          ),
          <fpage>233</fpage>
          -
          <lpage>256</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Galanter</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <article-title>What is Generative Art? Complexity theory as a context for art theory</article-title>
          .
          <source>In GA2003-6th Generative Art Conference</source>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Heer</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bostock</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ogievetsky</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <article-title>A Tour Through the Visualization Zoo</article-title>
          .
          <source>Communications of the ACM</source>
          , Volume
          <volume>53</volume>
          ,
          <source>Number</source>
          <volume>6</volume>
          (
          <year>2010</year>
          ), Pages
          <fpage>59</fpage>
          -
          <lpage>67</lpage>
          . DOI=http://doi.acm.
          <source>org/10</source>
          .1145/1743546.1743567
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>McCormack</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dorin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Innocent</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Generative</surname>
          </string-name>
          <article-title>Design: a paradigm for design research</article-title>
          . In Redmond, J. et. al. (eds) Proceedings of Futureground, Design Research Society, Melbourne (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Vande</given-names>
            <surname>Moere</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          <article-title>Infosthetics: the beauty of data visualization (interview for PingMag magazine)</article-title>
          . http://pingmag.jp/
          <year>2007</year>
          /03/23/infosthetics-form
          <article-title>-follows-data/</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>