<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Reframing Cultural Heritage Collections in a Visualization Framework of Space-Time Cubes</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Florian Windhager</string-name>
          <email>florian.windhager@donau-uni.ac.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Eva Mayr</string-name>
          <email>eva.mayr@donau-uni.ac.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Günther Schreder</string-name>
          <email>guenther.schreder@donau-uni.ac.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Michael Smuc</string-name>
          <email>michael.smuc@donau-uni.ac.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Paolo Federico</string-name>
          <email>federico@ifs.tuwien.ac.at</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Silvia Miksch</string-name>
          <email>miksch@ifs.tuwien.ac.at</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Danube University Krems</institution>
          ,
          <addr-line>Krems</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Technology Vienna</institution>
          ,
          <addr-line>Vienna</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>During the last decades, digitization broadened access to cultural heritage collections for public audiences. Large online databases have been prepared for open access with simple search interfaces or visual exploration methods. In this position paper we discuss new challenges arising from these initiatives with regard to casual users. To meet their specific needs, we introduce a novel method for synoptic collection visualization which makes use of parallel space-time cubes to provide multiple spatiotemporal overviews, support free exploration, and to specifically engage casual audiences.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        To facilitate sustainable access to our cultural achievements, cultural heritage collections provide
windows into the past and store data on their objects in multiple dimensions. Curiously enough, it is
the successful development of big cultural heritage databases like europeana.eu, which generates new
challenges of (in)accessibility: Existing user interfaces require prior knowledge about what is to be
found [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and thus introduce a potential barrier for non-professional visitors or casual users, who just
want to explore the collection, as we will discuss in chapter 2. Chapter 3 and 4 discuss how
Information Visualization (InfoVis) interfaces can provide the means to address these issues - and
how some of their limitations could be overcome by a novel interface design, making use of multiple
space-time cube representations. As an outlook we discuss possible implementation scenarios in
chapter 5.
      </p>
      <p>* Corresponding author</p>
    </sec>
    <sec id="sec-2">
      <title>Cultural Heritage and Casual Audiences</title>
      <p>
        Cultural heritage databases aggregate massive amounts of digitized artefacts and associated metadata
and allow for queries according to the users’ prior knowledge on various metadata dimensions. Yet,
just as in museums, visitors often come without prior knowledge. Without a clear goal, they want to
interact with a digital collection in an exploratory way [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], browsing through the cultural
information, rather than searching for specific details [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Also in InfoVis, the needs of casual users
in everyday leisure settings have been reconsidered [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Their intrinsic factors are to learn something
and gain a deeper understanding, but also to simply get entertained [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. From the outlined research we
can derive design recommendations for collection visualizations:



      </p>
      <p>
        Visitors to digital cultural heritage collections need an orientation phase before they start
browsing or searching [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Also in information seeking a sense of overview and
orientation is regarded important [3:1218]. Design recommendation 1 [DR1]: InfoVis
interfaces should provide effective overviews and conceptual orientation of a collections
extension, its major components and arrangement.
      </p>
      <p>
        Museum research shows that only limited cognitive resources are available for learning
and exploration [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Design recommendation 2 [DR2]: InfoVis interfaces should offer a
maximum of overview, while keeping the cognitive load, required for cognitive
information integration and orientation low [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        With exploration being the central activity in such settings [
        <xref ref-type="bibr" rid="ref10 ref12">10,12</xref>
        ], casual users often
explore InfoVis interfaces without a clear goal in mind. Design recommendation 3
[DR3]: New interfaces should support exploratory behavior, e.g. by offering multiple
perspectives and a rich set of interaction methods to explore object collections on
overview and detail levels.
      </p>
      <p>We consider these specific needs of casual audiences to play a crucial role when it comes to the future
acceptance and factual use of public interfaces to digital object collections.</p>
    </sec>
    <sec id="sec-3">
      <title>3 Visual Interfaces to Cultural Heritage Collections</title>
      <p>While physical object collections are commonly explored in a close-up perspective (Figure 1, left)
traditional means for overviews are floor plans, as well as lists, slideshows or grids in case of virtual
collections. Several InfoVis methods have been proposed to widen the options for visual exhibition
exploration. We distinguish between the visual encoding of spatial (i.e. cross-sectional, non-temporal)
data aspects, and of temporal (i.e. longitudinal) data aspects (see figure 1, right), with “spatial” not
only referring to geographic metadata, but also to their distributions in algebraic or vector spaces.</p>
      <p>Visual Encoding of Spatial Data Dimensions: As place of origin counts among the most frequently
documented data dimensions of cultural artifacts, geographic maps often serve as a standard
visualization method to show the spatial distribution of artifacts’ origins. Given different thematic or
stylistic classifications of cultural artifacts, set diagrams or treemaps offer insights into categorically
or hierarchically structured data constellations. As for relational data (e.g. influences, references,
inter-artifact relations) network diagrams or graphs enable users to explore the proximities and
distances of artifacts or cultural actors in relational or topological spaces.</p>
      <p>Visual Encoding of Temporal Data Dimensions: Especially in cultural heritage contexts, interfaces
have to encode temporal information too. One prominent option to do so are linked timelines, usually
implemented as a coordinated temporal view in addition to a spatial representation. Other prominent
options are animation and superimposition with the former merging multiple temporal snapshots
(often distinguished by different colors), and the latter mapping time to time. Another hybrid
technique is the space-time cube (STC), mapping time to an additional spatial dimension.</p>
      <p>
        As most of these methods have already been implemented in the cultural heritage data domain, we
focus on the specific needs of casual users: Which visualizations provide effective overviews while
keeping cognitive load low? Which methods provide conceptual orientation as an entry point and
support multiple ways of exploration, but also navigating between alternating views? With regard to
these questions, we will make the case for a more thorough consideration of space-time cube (STC)
representations (cf. figure 2), which have been shown in user studies to have unique strengths in
displaying multidimensional data [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], yet have not been implemented and evaluated in the cultural
heritage domain until now.
4 A Visualization Framework of Multiple Space-Time Cubes
A visualization framework based on STC representations could support casual users’ exploration of
digital object collections in various ways, which we will discuss in relation to the design
recommendations in chapter 2.
      </p>
      <p>
        First, the STC supports perceptual integration of multiple data dimensions: As a generic
spatiotemporal visualization method, the STC can display various spatial layouts on its data plane –
including maps, sets, and network graphs – and consistently map temporal information to its z-axis.
This genuine spatiotemporal layout principle provides “naturally” integrated views of three data
dimensions for synchronous perception, which conjoin into characteristically shaped point clouds,
clusters, flows, trees, or any other combination thereof (cf. figure 2). Experimental studies show that
the STC supports the identification of clusters or overall spatiotemporal patterns fast and efficiently
[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], especially in larger data sets [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Deduction: This integrative character of the STC matches the
requirement for effective multidimensional overviews and conceptual orientation [DR1], while
keeping cognitive load low [DR2]. Multiple interaction options for STCs further support open
exploration [DR 3].
      </p>
      <p>FFigure 2: Coordinated multiple space-time cubes, with a geo-temporal (left), a categorial-temporal (center), and a
genealogical (right) layout, displaying the same data collection, subselection, and single artifact.</p>
      <p>
        But the STC also allows higher dimensional integration: More than three data dimensions could
be perceptually integrated by either using other visual encodings (like color, size, shape, etc.) within a
STC, or by the InfoVis technique of coordinated multiple views, which also can be implemented as
coordinated, multiple space-time cubes (figure 2). The data planes of such parallel STCs can cover
different data dimensions and layouts while sharing the same selection of time. Further interactive
integration thus is available through the method of coordinated highlighting of selected data elements
or linking and brushing [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Deduction: The implementation of coordinated multiple STCs extends the
method’s potential to provide synoptic overviews [DR 1] and allow users to synchronously explore
multiple dimensions in parallel [DR 3].
      </p>
      <p>
        The STC can also enhance navigation: Bach et al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] showed how STC representations can
provide a navigational device to better understand various temporal encoding methods: The STC
integrates multiple well-established 2D perspectives while demonstrating their operating principles by
seamless canvas transitions [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Deduction: As an advanced navigator, STCs can support the
exploration of a collection’s temporal aspects with multiple methods [DR3], while simultaneously
showing how different methods of temporal encoding translate into each other, thus reducing the
cognitive load for required operations of perspective and information integration [DR2].
      </p>
      <p>Based on these results we conclude that a visualization framework based on (multiple) STCs
meets a substantive amount of design requirements for casual users. With regard to expected
additional cognition and navigation support in connection with regular 2D views we consider its
further evaluation in the cultural heritage data domain to be a productive research endeavor.</p>
    </sec>
    <sec id="sec-4">
      <title>5 Discussion and Outlook</title>
      <p>In this article we introduced an InfoVis approach to answer new challenges arising from the
paradoxical (in)accessibility of cultural heritage databases for casual audiences. We found strong
evidence that a multi-method interfaces based on the STC has the potential to meet essential design
requirements delineated for casual audiences: They provide a synoptic overview on multidimensional
collection data and enable users to generously explore collections from various spatiotemporal
vantage points, while offloading data integration to 3D perception and keeping cognitive load low.</p>
      <p>As a conceptual draft, this framework will be able to demonstrate its efficiency only in a series of
user studies to come. Since implementations in the cultural heritage contexts have been missing until
now, we expect a combination of comparative prototype evaluations to bring along new insights,
about how different encoding methods (cf. figure 1) will perform with casual audiences. Possible
implementation scenarios range from local implementations for visual collection exploration to
extended knowledge communication initiatives in collaboration with various historically oriented
disciplines, including Art History, Classical Philology, History of Science, History of Technology,
Literary and Media Studies, etc. We further expect contributions to pedagogic and didactic methods
development within these fields, i.e. on methods which support the multimodal teaching, presentation
and collective exploration of historically oriented topics.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>This research has been supported by the Austrian Science Fund (FWF), Project No. P28363 and
the Austrian Research Promotion Agency (FFG), Project No. 835937.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Bach</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dragicevic</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Archambault</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hurter</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Carpendale</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <article-title>A Descriptive Framework for Temporal Data Visualizations Based on Generalized Space-Time Cubes</article-title>
          . Computer Graphics Forum, Wiley Online Library
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Davey</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <article-title>What is museum fatigue</article-title>
          .
          <source>Visitor Studies Today</source>
          <volume>8</volume>
          (
          <issue>3</issue>
          ),
          <fpage>17</fpage>
          -
          <lpage>21</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Dörk</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carpendale</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Williamson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <article-title>The information flaneur: A fresh look at information seeking</article-title>
          .
          <source>Proceedings of the SIGCHI conference on human factors in computing systems</source>
          , (Vancouver,
          <year>2011</year>
          ), ACM,
          <fpage>1215</fpage>
          -
          <lpage>1224</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Kosara</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sahling</surname>
            ,
            <given-names>G.N.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Hauser</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          <article-title>Linking scientific and information visualization with interactive 3D scatterplots</article-title>
          .
          <source>in 12th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision</source>
          , (Plzen,
          <year>2004</year>
          ), Union Agency,
          <fpage>133</fpage>
          -
          <lpage>140</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Kristensson</surname>
            ,
            <given-names>P.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dahlbäck</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anundi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , et al.
          <article-title>An evaluation of space time cube representation of spatiotemporal patterns</article-title>
          .
          <source>Visualization and Computer Graphics, IEEE Transactions on 15 (4)</source>
          ,
          <fpage>696</fpage>
          -
          <lpage>702</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Kveladze</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kraak</surname>
          </string-name>
          , M.
          <article-title>-</article-title>
          <string-name>
            <surname>J.</surname>
            , and van Elzakker,
            <given-names>C.P.</given-names>
          </string-name>
          <article-title>A Methodological Framework for Researching the Usability of the Space-Time Cube</article-title>
          .
          <source>The Cartographic Journal</source>
          <volume>50</volume>
          (
          <issue>3</issue>
          ),
          <fpage>201</fpage>
          -
          <lpage>210</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Pousman</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stasko</surname>
            ,
            <given-names>J.T.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Mateas</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>Casual information visualization: Depictions of data in everyday life</article-title>
          .
          <source>Visualization &amp; Computer Graphics, IEEE Transactions on 13(6)</source>
          ,
          <fpage>1145</fpage>
          -
          <lpage>1152</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Smuc</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Federico</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Windhager</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aigner</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zenk</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Miksch</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <article-title>How do you connect moving dots? Insights from user studies on Dynamic Network Visualizations</article-title>
          . in Huang, T. ed.
          <source>Human Centric Visualization: Theories, Methodologies and Case Studies</source>
          . Springer, New York, NY,
          <year>2012</year>
          ,
          <fpage>623</fpage>
          -
          <lpage>650</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Sprague</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Tory</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>Exploring how and why people use visualizations in casual contexts: Modeling user goals and regulated motivations</article-title>
          .
          <source>Information Visualization</source>
          <volume>11</volume>
          (
          <issue>2</issue>
          ),
          <fpage>106</fpage>
          -
          <lpage>123</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Villa</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clough</surname>
            ,
            <given-names>P.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hall</surname>
            ,
            <given-names>M.M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Rutter</surname>
            ,
            <given-names>S.A.</given-names>
          </string-name>
          <article-title>Search or Browse? Casual Information Access to a Cultural Heritage Collection</article-title>
          . EuroHCIR,
          <string-name>
            <surname>Citeseer</surname>
          </string-name>
          (
          <year>2013</year>
          ),
          <fpage>19</fpage>
          -
          <lpage>22</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Vrotsou</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Forsell</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Cooper</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>2D and 3D representations for feature recognition in time geographical diary data</article-title>
          .
          <source>Information Visualization</source>
          <volume>9</volume>
          (
          <issue>4</issue>
          ),
          <fpage>263</fpage>
          -
          <lpage>276</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12] Wilson,
          <string-name>
            <given-names>M.L.</given-names>
            and
            <surname>Elsweiler</surname>
          </string-name>
          ,
          <string-name>
            <surname>D.</surname>
          </string-name>
          <article-title>Casual-leisure Searching: the Exploratory Search scenarios that break our current models</article-title>
          .
          <source>in HCIR'10: 4th International Workshop on Human-Computer Interaction and Information Retrieval</source>
          , (New Brunswick, NJ,
          <year>2010</year>
          ), ACM,
          <fpage>28</fpage>
          -
          <lpage>31</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>