<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The Data in Your Hands: Exploring Novel Interaction Techniques and Data Visualization Approaches for Immersive Data Analytics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>NATALIE HUBE</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>MATHIAS MÜLLER</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Technische Universität Dresden</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Chair for Media Design</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Additional Key Words and Phrases: Data Analysis, Information Visualization</institution>
          ,
          <addr-line>Human Computer Interaction, Virtual Reality, Immersive Analytics</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <fpage>2</fpage>
      <lpage>11</lpage>
      <abstract>
        <p>In this paper, we describe a concept for visualization and interaction with a large data set in an virtual environment. The core idea uses the traditional flat 2D representation as a base visualization but lets the user transform it into a spatial 3D visualizations on demand. Our visualization and interaction concept targets data analysts to use it for exploration and analysis, utilizing virtual reality to gain insight into complex data sets. The concept is based on the use of Parallel Sets for the representation of categorical data. By extending the conventional 2D Parallel Sets with a third dimension, correlations between path variables and the related number of items belonging to a specific node can be visualized. Furthermore, the concept uses virtual reality controllers in combination with a head-mounted display to control additional views. The purpose of the paper is to describe the core concepts and challenges for this type of spatial visualization and the related interaction design, including the use of gestures for direct manuipulation and a hand-attached menu for complex actions. CCS Concepts: • Information systems → Users and interactive retrieval; Search interfaces; • Human-centered computing → Interaction paradigms; Information visualization; Virtual reality; Virtual Reality (VR) ofers potential to develop new visualization and interaction techniques. As a powerful tool it enables users to work in an encapsulated environment, without external influences, in which they can go through the most personal and immersive experience [1]. This kind of experience can be used to support human perception, as it focuses on natural visual representations that ofer potential to communicate faster and more efective than traditional 2D visualizations. In opposite to real environments, there are no spatial limitations: the visualization and interaction space can be infinitely large, displaying millions or billions of items. Especially in the industrial context with e-commerce and business intelligence, these potential data sizes are of special interest. In our example use case, we look at product data distributed within a time dimension. Possible questions for analysis include revenue or price developments. Our approach for improved Immersive Analytics is two-fold, focusing on both visualization and interaction. The basic visualization technique for our concept and considerations are 2D Parallel Coordinates, more precisely Parallel Sets, due to their capability to represent multidimensional categorical data, hence, supporting the analysis of distributions. Basic techniques for 2D planar data visualization are extended with spatial 3D features, thus, aiming to facilitate the understanding of complex data relationships. In addition, the concept of an interactive hand-attached menu combined with a linked view is presented (cf. Fig. 5). The purpose of this paper is to discuss these concepts based on a work-in-progress prototype and the observations made during the concept and implementation process.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>INTRODUCTION</title>
      <p>VisBIA 2018 – Workshop on Visual Interfaces for Big Data Environments in Industrial Applications. Co-located with AVI 2018 – International
Conference on Advanced Visual Interfaces, Resort Riva del Sole, Castiglione della Pescaia, Grosseto (Italy), 29 May 2018
© 2018 Copyright held by the owner/author(s).
2</p>
    </sec>
    <sec id="sec-2">
      <title>RELATED WORK</title>
      <p>The core idea of the presented visualization concept is to combine the strengths of 2D and 3D representations
(cf. Sec. 4.1) and take advantage of their inherited benefits. Additionally, we want to explore advantages and
challenges of immersive Virtual Reality environments as a visualization medium in the given context. In order to
give an overview, the following section describes the comparably new research field of Immersive Analytics in
the context of industrial analysis of large data sets followed by a short overview of work on Parallel Sets.
2.1</p>
    </sec>
    <sec id="sec-3">
      <title>Immersive Analytics</title>
      <p>
        Due to the increasing amount of data and the demand for intuitive and eficient solutions to access data, several
new concepts and tools using new technologies such as VR have emerged in recent years. Olshannikova et al.
propose that visualization techniques need to be improved based on the complexity of big data, and identifies
three main challenges in this context: human cognition, adopting mixed reality towards Big Data and targeting
issues of visualizations regarding cognition and perceptual properties as well as interaction [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. West et al. also
demand to use the benefits of Virtual Reality, since it allows the user to accomplish or display things that are
usually not possible within a real environment, e.g. deforming structures or walking through solid formations, and
adopt it for a data-driven experience [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. In addition, research shows that interactive systems can significantly
influence and improve the user experience [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. The newly emerged research field Immersive Analytics addresses
these challenges to develop eficient visual analysis tools for immersive environments [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] while emphasizing
the combination of 2D (statistical and abstract data) and 3D (physical science, engineering and design data)
visualizations. Various work is also dealing with research questions targeting interaction with 3-dimensional
visualizations from egocentric viewpoints [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ], visualization optimization regarding clutter and occlusion with
head-mounted displays [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], spatial perception in regard to depth cues and cognition [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], as well as movement in
3D environments [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] in the context of Immersive Analytics.
2.2
      </p>
    </sec>
    <sec id="sec-4">
      <title>Parallel Coordinates and Parallel Sets</title>
      <p>
        The technique of Parallel Coordinates was first introduced by [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] to represent high-dimensional structures
and multivariate data. In this case, the coordinates do not run at right angles but parallel, which means that
theoretically any number of data dimensions can be visualized. Objects are plotted as polylines based on their
values, which intersect each axis. Detecting relationships between distant axes is dificult and barely diferentiable
unless there is further support for interaction [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] or dimensionality reduction [
        <xref ref-type="bibr" rid="ref25 ref29 ref3">3, 25, 29</xref>
        ]. Further research is
dedicated to multiresolutional views, for example in combination with Scatterplots [
        <xref ref-type="bibr" rid="ref27 ref3 ref6">3, 6, 27</xref>
        ] to help connect
certain data points visually and mentally. For large data sets, Huang et al. developed further dynamic interaction
for specific data selection in an 2D environment [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] while Heinrich et al. added supplementary analytic features
and rendered the density of lines instead of individual ones to reduce visual clutter [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. While [
        <xref ref-type="bibr" rid="ref15 ref5">5, 15</xref>
        ] investigated
Parallel Coordinates showing 2D relationships in a 3D visualization, [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] developed the visualization technique
of Parallel Sets due to the growing amount of data and to prevent overplotting. Parallel Sets divide each axis into
categories and the number of items is mapped to the line thickness. Hence, the number of lines and their overlap
can be decreased, and the item distribution is also visualized. In a comparative study, [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] and [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] found that
Parallel Sets are better suited for analytic tasks such as cluster analysis and determining correlations, whereas
Parallel Coordinates are more suitable for ordinal data, especially numerical data that can not easily divided into
few categories. Thus, we focus on the use of Parallel Sets in the process of concept development.
3
      </p>
    </sec>
    <sec id="sec-5">
      <title>USE CASE AND RELATED DATA STRUCTURES</title>
      <p>The role of a data analyst in sales and marketing is to plan the selling of products, collect revenue data, and
maintain data sources. Thus, the main task is to transform data into a form that provides meaningful insight
14 •</p>
      <sec id="sec-5-1">
        <title>Type</title>
        <sec id="sec-5-1-1">
          <title>Product</title>
        </sec>
        <sec id="sec-5-1-2">
          <title>Segment</title>
        </sec>
        <sec id="sec-5-1-3">
          <title>Price</title>
        </sec>
        <sec id="sec-5-1-4">
          <title>Rating</title>
          <p>Platform-dependent values
with temporal component
Sales</p>
        </sec>
      </sec>
      <sec id="sec-5-2">
        <title>Description</title>
        <p>Name, release date, category, image and further product
specific information
Information about the product segment, like segment name, associated
categories, etc.</p>
        <sec id="sec-5-2-1">
          <title>Sales numbers on the corresponding platform, e.g. 10,000</title>
        </sec>
        <sec id="sec-5-2-2">
          <title>Price value on the corresponding platform, e.g. 5,99</title>
          <p>Customer rating in the range from 1 to 10 on the corresponding platform,
e.g. 6 of 10
and recommendations. In our use case, the data analyst wants to understand how customers perceive products
and segments on diferent sales platforms to control the eficiency of price changes and marketing campaigns
to increase revenue through targeted adjustments. At this correlation, the main investigation targets revenue
progress, price changes on specific platforms or the comparison of price developments across several platforms.
For these targets, the representation of a temporal component is significant to meet these needs.</p>
          <p>Thus, we want to address these challenges in our concept to provide a data analyst tool using emerging
technologies to adopt for data exploration and analysis. Targeting this use case, we need to consider a data
structure with multivariate data consisting of diferent time stamps (see Tab. 1) to target the required goal.
4</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>GENERAL CONCEPT</title>
      <p>
        The proposed concept is based on [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] regarding the use of Parallel Sets for visual data exploration in
2D and 3D. The findings suit as a foundation about the applicability of a dynamic on demand extension of a 2D
(flat) to 3D (spatial) visualization. In a previous work, we proposed a animated transition to transform the 2D
representation into a 3D visualization [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] (see Fig. 1). The novel aspect is the adaptation of the core concepts
to be used in a VR environment and the use of suitable interaction techniques within this context. The overall
concept therefore consists of two main components: the visualization of Parallel Sets in VR and the hand-attached
menu to provide additional information and interaction. In the following sections we will first discuss the terms
immersion and emersion and how they relate to our concept. Subsequently, concrete aspects of this concept are
explained, including the core features related to visualization and interaction. Finally, we outline the technical
setup and development.
      </p>
    </sec>
    <sec id="sec-7">
      <title>4.1 Emersive and Immersive Visualizations</title>
      <p>
        When dealing with interactive data visualizations, Shneidermans Visual Information Seeking Mantra - "Overview
ifrst, zoom and filter, then details-on-demand" [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] - is often mentioned. The first and the last part, can be related
to the idea of emersive and immersive representation. The concept of Emersion describes a representation in
which the views from specific distance to gain an overview, like a commander observes the battlefield from an
elevated point. The idea of Immersion refers to the opposite: The user is positioned inside the visualization and
therefore is able to perceive all the details that surround him. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
      </p>
      <p>Further attributes that can be derived from the properties of an emersive visualization: Diferent elements are
(mostly due to missing or reduced perspective distortions) comparable, the visualization is rather static and clean
/ clearly ordered, because relative item positions are preserved when viewing direction or the view point changes.
Due to the large viewing distance, the emersive visualization behaves like a 2D visualization - the importance of
depth information is minimized. Therefore the amount on perceivable information in terms of data dimensions is
smaller than in an immersive environment.</p>
      <p>Where an emersive visualization ofers an overview and depicts mainly global relationships, the immersive
representation shows more detail and can reveal local relationships between elements relative to the current view
point and direction. Due to this dependency, it feels more dynamic and allows for perspective-based comparisons,
e.g. alignment to a certain viewing direction. By using the third dimension for data visualization more data
dimensions can be visualized. However, the drawbacks are more visual clutter, occlusion, size and position
ambiguity which makes comparison more dificult.</p>
      <p>Based on these observations, the presented concept focuses on two characteristics of flat-emersive and
spatiallyimmersive visualizations: 2D can be utilized to gain a quick overview of the whole problem space, whereas
3D is more suitable for detailed investigations on specific points. The visualization starts with a flat 2D graph
visualization using Parallel Sets (see Fig. 4, left) to enable an assessment of the complete data space - to get the
big picture. From there, the user may zoom into a specific area or Point of Interest - which relates to the zoom
and filter idea of Shneidermans mantra. From this point, we started to explore benefits of an extra dimension: the
user can expand the Parallel Sets into a spatial visualization - details on demand by revealing an additional data
dimension.</p>
      <p>The characteristics of this 3D representation has the typical drawbacks of 3D visualizations: overlapping paths,
occlusion issues, inaccuracies derived from the perspective projection (see Fig. 4, right). On the other hand new
opportunities are available: more possible relations between data dimensions can be visualized and detailed
spatial structures are revealed. If the user really gets into the visualization, a new perspective can be obtained:
the inner view of a single data set and its relations to its neighbors through a combination of complementary
views on diferent visualization techniques (cf. Sec. 2.2). Additionally, it is possible to follow the path of a data set
and see how these relation changes over the course through the whole visualization. In its core, the presented
concept tries to combine these two diferent perspectives in one single interactive visualization, primarily by
switching between visualization modes in combination with immersive travelling inside the visualization.
4.2</p>
    </sec>
    <sec id="sec-8">
      <title>Extending Parallel Sets into Depth</title>
      <p>
        The visualization concept initially consists of a flat Parallel Sets graph, which visualizes the categorical distribution
of the data and can be expanded into depth. Thus, this visualization supports the unification of paths from [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]
(see Fig. 2). Basically, every axis has a diferent scale when extended into the depth direction. Unification visualizes
relative size of the path to the current axis instead of absolute size over the complete visualization. The motivation
behind this approach is again related to the immersive view: local dependencies and relative size are more
important than global relations and absolute numbers. These aspects are of particular interest to data analysts,
as they enable them to quickly move from one view to the next (flat to spatial), while preserving the context,
at the same time adjusting to depth increases the weighting of each individual path. Thus, this supports the
comparability of parameter trails and volume ratios within sections of parameters
      </p>
      <p>Furthermore, this depth expansion results in diferent options for the sorting algorithm (see Fig. 3 and Fig.
4). While the 2D visualization seems more arranged with the standard sorting (top-down) for the categorical
distribution, the 3D visualization seems clearer when applying the approach path weighting (next-neighbor)
resulting in less visual clutter due to reduced overlapping paths. Here, the paths of nodes which are closer to the
same height level, are visualized in the foreground of the axis. This feature is important to support tracing lines
along the graph and supports the correct assignment of values.</p>
      <p>
        4.2.1 Version control. Another facet is the depiction of diferent versions alongside to quickly visualize
changes, or to highlight developments. For data analysts, it is important to view and examine data flows in order
to understand specific trends. Here, visual data exploration is particularly helpful when little is known about
the data and the analysis goals are vague [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Thus, comparing data from diferent points in time (cf. Sec. 3) is
reasonable and allows the analyst to retrace developments. When displaying multiple data versions, they initially
have a spatial ofset to one another and can be moved to all axes, thus, this allows to sort and place them as
required. In the 2D visualization, both visualizations can be overlaid or displayed close to each other in order to
be able to compare the categorical distribution of the data without perspective leverage. Although this is also
possible in 3D, it creates a diferent visual representation. In the overlaid 3D representation, the distribution over
the time course can be followed based on the unification of the axes (cf. Sec. 4.2) to compare both graphs and
can be modified by the dynamic change from 3D to 2D, without losing context. However, it may be practical
to separate both graphs spatially and look at them using the perspective leverage and spatial ofset to compare
both graphs like the idea of a picture puzzle as a contrasting juxtaposition. Thus, to reduce memory efort for the
analyst [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], the selection of paths and nodes is highlighted in the other graph by brushing to visualize the time
distribution and changes of an item. In addition to selecting ranges of values, certain items can also be directly
highlighted using the hand menu (cf. Sec. 4.3) to track the development of a single item or a set of items.
18 •
      </p>
      <p>
        4.2.2 Virtual Interaction. By means of interacting with the visualization, the data analyst preserves the
ability to look deeper into the data, and thus, to draw new conclusions. It is important to integrate the human into
the data analysis process to take advantage on the benefits of human perception while using today’s technical
capabilities to analyze large data sets. Therefore, the interaction should be as intuitive and natural as possible to
achieve the most immersive data-driven experience claimed by [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. This is realized by the use of a head-mounted
display for the immersion and virtual reality controllers serving as the users hands in the virtual environment.
Here, it is important to recap the challenges mentioned by [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] and include the advantages of Virtual Reality
presented by [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. On one hand, the user receives the power to move freely in a (delimited) space that is not only
limited to the hands, but also to the position and rotation of the body and head (virtual camera). On the other
hand, through the use of virtual hands, whose Position and posture corresponds to the real hands of the user, it is
possible to adjust and interact with the visualization. The analyst can naturally select or deselect paths and nodes
by touching them (see Fig. 5, left) comparable to reshaping a fabric in the real world. At the same time, grabbing
and dragging a node creates a new range of values on the parameter axis or merges values ranges. The simple
gestures replace complex menu operations. Furthermore, the entire visualization can be scaled using the hand
interaction as well as changing the position and rotation (see Fig. 6, right). As a result, an overview of the entire
data space can be obtained quickly in form of a miniature, which can then be enlarged to dive into the data to a
specific view point.
4.3
      </p>
    </sec>
    <sec id="sec-9">
      <title>Hand-atached menu</title>
      <p>Interacting with large and complex data sets require sophisticated interaction techniques. While selecting
and deselecting items for filtering purposes can be done directly on the graph, brushing and linking several
supplementary or independent visualizations represents be a helpful tool.</p>
      <p>By mapping the menu selection directly to the hand in form of tiles (see Fig. 6, left) and dispensing button
input, creates an easily accessible and natural interaction. In the concept these interaction tiles can be placed on
every fingertip except the thumb. The following interaction options are provided: axis interaction mode, selection
of data items, Scatterplot visualization mode and query history.</p>
      <p>The axis interaction mode allows the user a menu-based assistance to manipulate axes. Additionally to moving
and replacing axes, it also includes adding new or already existing axes as well as to remove them. This ofers the
opportunity to compare diferent parameters side-by-side. Furthermore, the direct selection mode of individual
data items or specific data records with the help of a further interaction tile is possible. The selection is performed
using a list of data items from which the user can select appropriate elements.</p>
      <p>
        4.3.1 Scaterplot . Another part of the hand-attached tile menu is the Scatterplot graph providing a
complementary visualization as proposed by [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Here, the data analyst can display a 2D or 3D Scatterplot graph from
previously selected axes. If required, the corresponding value range of the Parallel Sets nodes can also be specified
here to limit the axis values. The menu is anchored to the palm of the user’s virtual hand so the visualization is
ifrmly anchored to the user’s spatial position and movement. In addition, the user can select a data item using a
laser beam, which is generated by a pointing gesture of the user’s hand. This selection also brushes the course
of the data item in the paths of the Parallel Sets (see Fig. 5, right). By synchronizing changes between both
representation, the visualizations complement each other: The Scatterplot provides enhanced object visibility,
whereas the parallel sets emphasize attribute visibility. A combination of both allows for better transferability.
      </p>
      <p>4.3.2 uQery history . An selection or specific configuration of the Parallel Sets can be saved and used to
compare with another query. Thus, a subset of information objects can be extracted based on selected parameters.
The stored query histories are displayed as miniature thumbnails within a scrollable list and are then displayed
similar to mapping diferent versions of data as a stand-alone graph visualization. Thus, both selection queries
can be visually and spatially compared additionally to the version control described in Sec. 4.2.1. The data analyst
can then view both graphs from diferent perspectives, on the one hand as a flat or spatial representation and on
the other hand from diferent viewing angles and positions.
5</p>
    </sec>
    <sec id="sec-10">
      <title>PROTOTYPICAL IMPLEMENTATION</title>
      <p>The technical setup for the development of our work-in-progress prototype consists of an Oculus Rift CV1 and
Oculus Touch Controllers. Unreal Engine 4 (UE4) serves as a software development environment as the Blueprint
system of the 3D Engine is perfectly suited for rapid prototyping, especially for interaction and visualization.
UE4 also ofers the ability to use C++ in combination with the development environment Visual Studio for
data manipulation and computational tasks. Specific C++ macros for properties and functions exposes them
to the Blueprint system of Unreal Engine 4, ofering a great level interoperability between the visual scripting
environment and the low level programming components. The engine also ofers the option to refactor Blueprint
scripts into C++ classes to increase performance.</p>
      <p>The example data record used for our prototype consists of corresponding data from 10,000 products. Besides
diferent multivariate categorical properties, the data set contains a temporal determinant to diferent temporal
variants of the data (see Tab. 1). In addition to the product characteristics, the product data record also contains
information on diferent sales figures, ratings and prices, which were obtained on diferent sales platforms. The
data is available in json format, which can be called and deserialized by an annotated C++ function within
Blueprints. Since data initially is available as individual data items within a json array, it must be preprocessed
ifrst. For this purpose, an initial specification of parameter axes and value ranges triggers a creation of the
categories to be used. After deserializing the json array, the data elements are mapped to the categories. In the
next step, paths are generated according to the data items assigned to the categories. This indicates which data
item corresponds to which category or path and can be dynamically adjusted at runtime.
6</p>
    </sec>
    <sec id="sec-11">
      <title>CONCLUSION</title>
      <p>In this paper, we presented a concept with a prototypical implementation for analysis of large data sets by a data
analyst. Our focus was on the usage of virtual reality as an interactive medium and the visualization of large
data sets. Our concept serves as a first step in the direction of abstract data visualization and usage of inherited
properties of virtual reality to allow a more natural and intuitive interaction with data, especially when the
concrete analysis goals are not yet specified and diferent views and filter configurations are evaluated in rapid
succession.</p>
      <p>In addition to the presentation of Parallel Sets, we have also linked a Scatterplot graph visualization, as
these visualization types nicely complement each other. Furthermore, any number of additional Parallel Sets
graphs can be added to the virtual environment, allowing the comparison on a global and detail scale. The basic
20 •
concept of the hand menu shows potential for future extension and enhancement of existing functionality. One
important challenge is related to the question of overview and orientation in abstract virtual environments. When
navigating inside the Parallel Set visualization on a very close perspective, the user may lose the overview of
the whole visualization. Observations show that this issue is less significant than in other visualization types,
e.g. Scatterplots. However, with growing amount of data or increasing zoom factor this aspect may represent an
issue. In any case, an important aspect is the investigation of the immersion on the user and the consideration of
the application of emersive visualization concepts within the immersive environment, e.g. a map or providing
directions to significant points inside the visualization. Comparable to landmarks (Buildings, Surface formations,
Points-of–interest) in a natural virtual environment, specific values on the nearest values axis could be used
for orientation in the immersive visualization. Another factor may be to restrict movement directions or ofer
additional navigation modes, e.g. surfing in a specific data item. Regarding visualization, the extension of the
concept in terms of subtle assistive components is reasonable, such as the support of depth perception by using
color perspective elements or the use of cutting planes on the spatial depth axes in order to filter the data space
even further. The arrangement of data axes in the spatial representation is another open question. In the current
concept, we did not adapt the position of the axes - they stay aligned to the x-axis when extending the graph
into depth. However, spatial arrangements of coordinate axes allow to compare more than two axes, providing
another advantage of the spatial visualization. Hovewer, it also widens the visual gap between flat and spatial
representation, which bears the risk to lose orientation when switching between both visualizations or being
confused by the transition. One aspect of the selection within the Scatterplot representation and Parallel Sets is the
extension of the pointing beam for the selection in form of a resizable sphere to capture not only one but multiple
data points within a certain radius. Additionally, it is conceivable to work co-located and cooperatively, thus,
allowing multiple users to interact and collaborate in this environment. This includes questions for highlighting
regions, specific data sets or structures in the visualization. Further collaboration concepts aim at roles between
users, and how they navigate together through data, share their position, view point or current perspective on
the data.</p>
      <p>However, the paper serves as a basis for the investigation of further presentation and interaction possibilities
in connection with virtual reality in order to carry out future studies on the basis of minimal prototypes and
staked problem areas. Furthermore, technical considerations have to be made to determine in what way the
concept is feasible in its current state.</p>
    </sec>
    <sec id="sec-12">
      <title>7 ACKNOWLEDGEMENTS</title>
      <p>This research (project no. 100271686) has been funded by the European Social Fund and the Free State of Saxony.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Ejder</given-names>
            <surname>Bastug</surname>
          </string-name>
          , Mehdi Bennis, Muriel Medard, and
          <string-name>
            <given-names>Merouane</given-names>
            <surname>Debbah</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Toward Interconnected Virtual Reality: Opportunities, Challenges, and Enablers</article-title>
          .
          <source>IEEE Communications Magazine</source>
          <volume>55</volume>
          ,
          <issue>6</issue>
          (
          <year>2017</year>
          ),
          <fpage>110</fpage>
          -
          <lpage>117</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>T.</given-names>
            <surname>Chandler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Cordeil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Czauderna</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Dwyer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Glowacki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Goncu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Klapperstueck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Klein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Marriott</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Schreiber</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E. Wilson. 2015. Immersive</given-names>
            <surname>Analytics</surname>
          </string-name>
          .
          <article-title>In 2015 Big Data Visual Analytics (BDVA). 1-8</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Jaegul</given-names>
            <surname>Choo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Hanseung</given-names>
            <surname>Lee</surname>
          </string-name>
          , Zhicheng Liu, John Stasko, and
          <string-name>
            <given-names>Haesun</given-names>
            <surname>Park</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>An interactive visual testbed system for dimension reduction and clustering of large-scale high-dimensional data</article-title>
          .
          <source>In Visualization and Data Analysis</source>
          <year>2013</year>
          , Vol.
          <volume>8654</volume>
          .
          <source>International Society for Optics and Photonics</source>
          ,
          <volume>865402</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Grégoire</given-names>
            <surname>Cliquet</surname>
          </string-name>
          , Matthieu Perreira, Fabien Picarougne, Yannick Prié, and
          <string-name>
            <given-names>Toinon</given-names>
            <surname>Vigier</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Towards HMD-based Immersive Analytics</article-title>
          .
          <source>In Immersive analytics Workshop</source>
          , IEEE VIS
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Elena</given-names>
            <surname>Fanea</surname>
          </string-name>
          , Sheelagh Carpendale, and
          <string-name>
            <given-names>Tobias</given-names>
            <surname>Isenberg</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>An interactive 3D integration of parallel coordinates and star glyphs</article-title>
          .
          <source>In Information Visualization</source>
          ,
          <year>2005</year>
          .
          <article-title>INFOVIS 2005</article-title>
          .
          <article-title>IEEE Symposium on</article-title>
          . IEEE,
          <fpage>149</fpage>
          -
          <lpage>156</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Ying-Huey</surname>
            <given-names>Fua</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Matthew O. Ward</surname>
          </string-name>
          , and
          <string-name>
            <surname>Elke</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Rundensteiner</surname>
          </string-name>
          .
          <year>1999</year>
          .
          <article-title>Hierarchical Parallel Coordinates for Exploration of Large Datasets</article-title>
          .
          <source>In Proceedings of the Conference on Visualization '99: Celebrating Ten Years (VIS '99)</source>
          . IEEE Computer Society Press, Los Alamitos, CA, USA,
          <fpage>43</fpage>
          -
          <lpage>50</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Michael</given-names>
            <surname>Gleicher</surname>
          </string-name>
          , Danielle Albers, Rick Walker, Ilir Jusufi,
          <string-name>
            <given-names>Charles D.</given-names>
            <surname>Hansen</surname>
          </string-name>
          , and
          <string-name>
            <surname>Jonathan</surname>
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Roberts</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Visual comparison for information visualization</article-title>
          .
          <source>Information Visualization 10</source>
          ,
          <issue>4</issue>
          (
          <year>2011</year>
          ),
          <fpage>289</fpage>
          -
          <lpage>309</lpage>
          . arXiv:https://doi.org/10.1177/1473871611416549
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Rainer</given-names>
            <surname>Groh</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>An Iconography of Interaction (1st ed</article-title>
          .).
          <source>TUDpress.</source>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Marc</given-names>
            <surname>Hassenzahl</surname>
          </string-name>
          and
          <string-name>
            <given-names>Noam</given-names>
            <surname>Tractinsky</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>User experience-a research agenda</article-title>
          .
          <source>Behaviour &amp; information technology 25</source>
          ,
          <issue>2</issue>
          (
          <year>2006</year>
          ),
          <fpage>91</fpage>
          -
          <lpage>97</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Julian</given-names>
            <surname>Heinrich</surname>
          </string-name>
          and
          <string-name>
            <given-names>Bertjan</given-names>
            <surname>Broeksema</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Big data visual analytics with parallel coordinates</article-title>
          .
          <source>In Big Data Visual Analytics (BDVA)</source>
          ,
          <year>2015</year>
          . IEEE, 1-
          <fpage>2</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>Mao</given-names>
            <surname>Lin</surname>
          </string-name>
          <string-name>
            <given-names>Huang</given-names>
            ,
            <surname>Tze-Haw Huang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and Xuyun</given-names>
            <surname>Zhang</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>A novel virtual node approach for interactive visual analytics of big datasets in parallel coordinates</article-title>
          .
          <source>Future Generation Computer Systems 55 (Feb</source>
          .
          <year>2016</year>
          ),
          <fpage>510</fpage>
          -
          <lpage>523</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Natalie</surname>
            <given-names>Hube</given-names>
          </string-name>
          , Mathias Müller, and
          <string-name>
            <given-names>Rainer</given-names>
            <surname>Groh</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Additional On-Demand Dimension for Data Visualization</article-title>
          . In EuroVis 2017 -
          <string-name>
            <given-names>Short</given-names>
            <surname>Papers</surname>
          </string-name>
          .
          <source>The Eurographics Association.</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>Alfred</given-names>
            <surname>Inselberg</surname>
          </string-name>
          and
          <string-name>
            <given-names>Bernard</given-names>
            <surname>Dimsdale</surname>
          </string-name>
          .
          <year>1990</year>
          .
          <article-title>Parallel Coordinates: A Tool for Visualizing Multi-dimensional Geometry</article-title>
          .
          <source>In Proceedings of the 1st Conference on Visualization '90 (VIS '90)</source>
          . IEEE Computer Society Press, Los Alamitos, CA, USA,
          <fpage>361</fpage>
          -
          <lpage>378</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>J.</given-names>
            <surname>Johansson</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Forsell</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Evaluation of Parallel Coordinates: Overview, Categorization and Guidelines for Future Research</article-title>
          .
          <source>IEEE Transactions on Visualization and Computer Graphics</source>
          <volume>22</volume>
          ,
          <issue>1</issue>
          (Jan
          <year>2016</year>
          ),
          <fpage>579</fpage>
          -
          <lpage>588</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Jimmy</surname>
            <given-names>Johansson</given-names>
          </string-name>
          , Camilla Forsell, and
          <string-name>
            <given-names>Matthew</given-names>
            <surname>Cooper</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>On the usability of three-dimensional display in parallel coordinates: Evaluating the eficiency of identifying two-dimensional relationships</article-title>
          .
          <source>Information Visualization 13</source>
          ,
          <issue>1</issue>
          (
          <year>2014</year>
          ),
          <fpage>29</fpage>
          -
          <lpage>41</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Mandy</surname>
            <given-names>Keck</given-names>
          </string-name>
          , Martin Herrmann, Andreas Both, Dana Henkens, and
          <string-name>
            <given-names>Rainer</given-names>
            <surname>Groh</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Exploring Similarity. In Human Interface and the Management of Information. Information and Knowledge in Applications</article-title>
          and Services, Sakae Yamamoto (Ed.). Springer International Publishing, Cham,
          <fpage>160</fpage>
          -
          <lpage>171</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Mandy</surname>
            <given-names>Keck</given-names>
          </string-name>
          , Martin Herrmann, Dana Henkens, Severin Taranko, Viet Nguyen, Fred Funke, Stefi Schattenberg, Andreas Both, and
          <string-name>
            <given-names>Rainer</given-names>
            <surname>Groh</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Visual Innovations for Product Search Interfaces</article-title>
          .
          <source>In 1st International Workshop on Future Search Engines at INFORMATIK</source>
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Daniel</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Keim</surname>
          </string-name>
          .
          <year>2001</year>
          .
          <article-title>Visual Exploration of Large Data Sets</article-title>
          .
          <source>Commun. ACM 44</source>
          ,
          <issue>8</issue>
          (Aug.
          <year>2001</year>
          ),
          <fpage>38</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>R.</given-names>
            <surname>Kosara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Bendix</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Hauser</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Parallel Sets: interactive exploration and visual analysis of categorical data</article-title>
          .
          <source>IEEE Transactions on Visualization and Computer Graphics</source>
          <volume>12</volume>
          ,
          <issue>4</issue>
          (
          <year>July 2006</year>
          ),
          <fpage>558</fpage>
          -
          <lpage>568</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>A.</given-names>
            <surname>Moran</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Gadepally</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Hubbell</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Kepner</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Improving Big Data visual analytics with interactive virtual reality</article-title>
          .
          <source>In 2015 IEEE High Performance Extreme Computing Conference (HPEC)</source>
          .
          <article-title>1-6</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Ekaterina</surname>
            <given-names>Olshannikova</given-names>
          </string-name>
          , Aleksandr Ometov, Yevgeni Koucheryavy, and
          <string-name>
            <given-names>Thomas</given-names>
            <surname>Olsson</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Visualizing Big Data with augmented and virtual reality: challenges and research agenda</article-title>
          .
          <source>Journal of Big Data</source>
          <volume>2</volume>
          ,
          <issue>1</issue>
          (
          <issue>01</issue>
          <year>Oct 2015</year>
          ),
          <fpage>22</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>B.</given-names>
            <surname>Shneiderman</surname>
          </string-name>
          .
          <year>1996</year>
          .
          <article-title>The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations</article-title>
          .
          <year>1996</year>
          . Proceedings.,
          <source>IEEE Symposium on Visual Languages</source>
          (
          <year>1996</year>
          ),
          <fpage>336</fpage>
          -
          <lpage>343</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>Harri</given-names>
            <surname>Siirtola</surname>
          </string-name>
          and
          <string-name>
            <surname>Kari-Jouko Räihä</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Interacting with parallel coordinates</article-title>
          .
          <source>Interacting with Computers</source>
          <volume>18</volume>
          ,
          <issue>6</issue>
          (
          <year>2006</year>
          ),
          <fpage>1278</fpage>
          -
          <lpage>1309</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>Mark</given-names>
            <surname>Simpson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Jiayan</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and Alexander</given-names>
            <surname>Klippel</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Take a Walk: Evaluating Movement Types for Data Visualization in Immersive Virtual Reality</article-title>
          . (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>Alexandru</given-names>
            <surname>Telea</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Data visualization principles</article-title>
          and practice /. (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Jorge</surname>
            <given-names>A Wagner</given-names>
          </string-name>
          <string-name>
            <surname>Filho</surname>
          </string-name>
          , Marina F Rey,
          <source>Carla MDS Freitas, and Luciana Nedel</source>
          .
          <year>2017</year>
          .
          <article-title>Immersive Analytics of Dimensionally-Reduced Data Scatterplots</article-title>
          . (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>J.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. W.</given-names>
            <surname>Shen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G.</given-names>
            <surname>Lin</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Multi-Resolution Climate Ensemble Parameter Analysis with Nested Parallel Coordinates Plots</article-title>
          .
          <source>IEEE Transactions on Visualization and Computer Graphics</source>
          <volume>23</volume>
          ,
          <issue>1</issue>
          (Jan
          <year>2017</year>
          ),
          <fpage>81</fpage>
          -
          <lpage>90</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>Ruth</surname>
            <given-names>West</given-names>
          </string-name>
          , Max J Parola, Amelia R Jaycen, and Christopher P Lueg.
          <year>2015</year>
          .
          <article-title>Embodied information behavior, mixed reality and big data</article-title>
          .
          <source>In The Engineering Reality of Virtual Reality</source>
          <year>2015</year>
          , Vol.
          <volume>9392</volume>
          . International Society for Optics and Photonics,
          <year>93920E</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>Xin</given-names>
            <surname>Zhao</surname>
          </string-name>
          and
          <string-name>
            <given-names>Arie</given-names>
            <surname>Kaufman</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Multi-dimensional reduction and transfer function design using parallel coordinates</article-title>
          . In Volume graphics.
          <source>International Symposium on Volume Graphics. NIH Public Access</source>
          ,
          <volume>69</volume>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>