<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Declarative 3D Approaches for Distributed Web-based Scientific Visualization Services</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Timm Drevensek Fraunhofer IGD Darmstadt</string-name>
          <email>jbehr@igd.fhg.de</email>
          <email>sewagner@igd.fhg.de</email>
          <email>yjung@igd.fhg.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Germany tidreven@igd.fhg.de</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Johannes Behr Fraunhofer IGD Darmstadt</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Sebastian Wagner Fraunhofer IGD Darmstadt</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Yvonne Jung Fraunhofer IGD Darmstadt</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Recent developments in the area of e cient web-service architectures and the requirement to provide applications not just for a small expert group lead to new approaches in the eld of web-based (scienti c) visualization. The just emerging support for GPU-supported and therefore highperformance 2D and 3D graphics in modern web-client implementations and standards provide new application environments, which are especially interesting for the demands of scienti c visualization solutions. Thus, in this paper we present a web application deployment architecture that aims at supporting decision making processes more e ciently. We also show that current approaches in the eld of declarative 3D techniques are useful for client-side rendering as well as for a large number of processing and visualization aspects.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;X3D</kwd>
        <kwd>HTML5</kwd>
        <kwd>WebGL</kwd>
        <kwd>DOM</kwd>
        <kwd>Web Integration</kwd>
        <kwd>Transcoder</kwd>
        <kwd>Web Services</kwd>
        <kwd>Service-oriented Architectures</kwd>
        <kwd>X3DOM</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Copyright c 2012 for the individual papers by the papers'
authors. Copying permitted only for private and academic purposes.
This volume is published and copyrighted by its editors.
Dec3D2012 workshop at WWW2012, Lyon, France
Android, RIM, WindowsPhone), di erent desktop systems,
cloud bases etc., which typically make cross-platform
development complicated and time consuming. In this regard,
web technologies incl. web-service architectures are rather
common and can overcome these issues by interconnecting
all these diverse approaches. Moreover, web browsers are
converting more and more towards full runtime
environments for whole applications and with WebGL or Stage3D,
3D-capable browsers are now broadly available, too.
However, this does not solve the often intricate processes
to develop applications, where one can distinguish between
two main types. For one thing, we have interactive processes
with creative and individual components such as games with
their manual or semi-automatic tool chains (e.g., DCC tools
like 3ds Max and game editors like Unity3D) that focus on
isolated applications. For another, there are automatable
processes that typically are complex and distributed, which
can be realized by means of a web-service architecture. In
the context of this paper, we focus onto the latter approach
by presenting a fully automated Web Service Portal, which
thereby allows generating e.g. 2D/3D mash-ups for design
review, city planning or similar decision making tasks.
Generally spoken, distributed data-centered applications are
one of the common implementation concepts for scienti c
visualization solutions today to process huge data sets.
Therefore, utilizing web-service architectures or even cloud-based
solutions are just the next logical step. Recent
developments in the area of high-performance web-service
architectures and the requirement to provide applications not
just for a small expert group lead to new approaches in
the eld of web-based visualization. The emerging support
for hardware-accelerated and therefore high-performance 2D
and 3D graphics in modern web clients and standards
provide a new application environment, which is especially
interesting for the demands of scienti c visualization solutions.
Therefore, some visualization packages (like ParaView with
ParaViewWeb from Kitware1) already use this opportunity
to move the established application model to a web and
cloud-based solution. Deploying current application models
to a new environment is just the rst step. However, this
eld is not yet explored to utilize its full potential.
1http://paraview.org/Wiki/ParaViewWeb
Thus, the web-application deployment component presented
in this paper helps supporting decision making processes
more e ciently, and the bene ts include the following four
major aspects:
{ leveraging new GPU-accelerated 2D and 3D client APIs;
{ achieving interactivity while combining traditional
clientand server-side rendering techniques;
{ providing new user experiences while considering
scalability and security in open web-based environments;
{ automating and optimizing data preparation processes for
web-speci c environments through web server infrastructures.</p>
    </sec>
    <sec id="sec-2">
      <title>2. RELATED WORK</title>
      <p>For the design of the proposed web-service architecture
several domains and technologies are relevant. Corresponding
work is thus brie y described within this section.</p>
    </sec>
    <sec id="sec-3">
      <title>2.1 Scientific Visualization</title>
      <p>
        To provide important features for scienti c visualization (cf.
e.g. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]) in a specialized web application, the
application must be able to handle visualization-speci c
representations that consist of registered and merged point, surface,
and even volume data as well as the corresponding meta
information. But having the raw data to be visualized readily
available is only the very rst step, as is shown in Figure 1
with a rather simpli ed visualization pipeline. Usually, after
data acquisition the information is re-sampled onto a
structured regular grid before ltering the data accordingly (a
discussion of common data representations including
multiresolution and adaptive resolution representations for large
data sets can be found in [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]). Then, the scalar, vector, or
tensor values of the data set are mapped to visual
representations that can be rendered [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Well-known examples here
are volume rendering or ow visualizations in CFD [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
For multi-dimensional, multi-variate/ multi-modal, and
probably even time-varying data, visualization is much more
intricate, since rst the registration between di erent data
sets including the thereby introduced uncertainties has to be
handled as well as data fusion aspects and the calculation
of derived quantities (e.g. the strength of correlation
between two di erent variables) to improve the visualization
[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. In this regard, not only the choice of an appropriate
visualization technique but also the possibility to
interactively explore the data set (e.g. by changing the value range
or transfer function) is of great importance for grasping and
analyzing the information and therefore requires real-time
capable mapping and rendering methods, which nowadays
is often achieved using GPU-based methods [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>2.2 3D Graphics in the Web</title>
      <p>
        Direct volume rendering in general is an alternative form
of visual data representation compared to the traditional
polygonal form. In [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] the implementation of a direct
volume rendering system for the Web is presented. In this
publication the authors discuss their WebGL-based volume
rendering approach using ray-casting in two di erent but
challenging application domains: medical imaging and radar
meteorology. Performance, scalability, accuracy, and
security are some of the many challenges that must be solved
for 3D web applications, esp. since WebGL is still based on
the old Shader Model 2.0 (like on the NVidia GeForce 5900
series introduced in 2003).
      </p>
      <p>
        Another alternative method for representing 3D graphics is
using point clouds, which is a set of points in 3D space with
attributes. This is especially of interest, since 3D scanning
devices such as LiDAR equipment and sonar scanners
deliver their data as point clouds. One recent framework to
simplify the streaming and rendering of point clouds based
on JavaScript and WebGL [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] is \XB PointStream" [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
In [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], the authors propose a WebGL-based framework for
representing re ectance information via Bidirectional
Texture Functions (BTF), which allows for the progressive
transmission and interactive rendering of digitized artifacts
consisting of 3D geometry and re ectance information. This
is achieved by employing a novel progressive streaming
approach for the huge BTF data set that allows the smooth
interactive inspection of a steadily improving model during
download. Analogously, the X3DOM framework [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]
currently follows a similar approach for lightweight geometry
compression and transmission via so-called image geometries
that likewise utilizes image compression techniques.
      </p>
    </sec>
    <sec id="sec-5">
      <title>2.3 Declarative (X)3D in HTML5</title>
      <p>
        The open ISO standard X3D [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] provides interactive 3D
graphics for the web and is the only standardized 3D
deployment format. It di ers from other 3D formats like the
interchange format Collada [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] in that it also includes the
scene's runtime behavior. The X3D standard already
provides point and surface primitives. Typically, the visual
elements are described by their boundary representation, e.g.
via an \IndexedTriangleSet" node. Volume rendering will be
part of the next spec revision. Therefore, the Web3D
medical working group has presented a sample implementation
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] and an ISO/ IEC PDAM extension for a volume
rendering component in X3D, which also has answers to DICOM
requirements for n-D presentation states [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ].
      </p>
      <p>
        In addition, since most geo-referenced data is provided in
a geodetic or projective spatial reference frame, the X3D
Geospatial component includes conventions that are de ned
by the Spatial Reference Model and thereby provides
support for geographic and geospatial applications [
        <xref ref-type="bibr" rid="ref16 ref8">8, 16</xref>
        ]. With
surface, volume, and geo-spatial components X3D already
provides a solid foundation for scienti c visualization tasks
and thus enables an automated connection of existing data
with e.g. atmospheric, oceanographic, or geological data to
be visualized in the Web.
      </p>
      <p>
        However, all existing and proposed X3D components only
extend X3D for various application and visualization
scenarios but do not address one of the essential issues of X3D
right now, namely that X3D is still bound to a plugin-based
integration model that has major usability and performance
issues especially for large data sets [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. All plugin-based
systems have two major drawbacks. First, they are only
plugins and not installed by default on most systems.
Therefore, the user has to deal with plugin installation, security,
and browser or OS incompatibility issues, not to mention
the lack of accessibility. Second, the presented systems
dene an application and event model inside the plugin, which
is decoupled from the DOM content. Developers, who try to
develop integrated web applications that use both, the DOM
and the plugin-model, have to deal with small plugin-speci c
interfaces and synchronization problems.
      </p>
      <p>
        WebGL (a JavaScript binding for OpenGL ES 2.0 in the
Web Browser [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]), Adobe's Flash 11 with Stage3D [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ],
and Microsoft's Silverlight 5 [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] now all provide access to
the native GPU layer without any further plugin
installation process, but the issue of the missing DOM integration
still exists. Hence, what is still missing is a better
integration with open architectures, which integrate well with
existing web technologies like CSS(3), HTML(5), JavaScript,
DOM scripting and Ajax. In this regard, with the X3DOM
project recently a DOM-based integration model for
declarative (X)3D in HTML5 was proposed [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ], that allows a
seamless integration of 3D contents into the HTML
document model by utilizing standard web APIs for integrating
content and interactions.
      </p>
    </sec>
    <sec id="sec-6">
      <title>2.4 Service-oriented Architectures</title>
      <p>
        Finally, we have to shortly review service-oriented
architectures (SOA). An SOA is a software architecture paradigm
for structuring and using distributed functionalities that are
managed by various owners. Comparable to business
transactions an SOA composes several low-level services to more
complex services with a higher level of abstraction [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Here,
web-services help supporting the collaboration between
different applications running on di erent platforms by
utilizing REST, JSON, and XML-based standards like UDDI,
WSDL, and SOAP as web-service protocols. In this regard,
one prominent application of web-services are the
standardized geo-services (such as WCS [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]) provided by the Open
GeoSpatial Consortium (OGC) to make spatial geo-data
accessible in a structured way.
      </p>
      <p>
        Hence, some 3D rendering systems already make
prototypical use of REST and JSON for scene-graph manipulation
and distributed rendering [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] within a service-oriented
platform. To demonstrate the full potential of their web-service
interface, the authors additionally included a second
visualization backend that provides global illumination algorithms
that are evaluated on a server farm whereas the web frontend
only shows the nal image and the UI elements. Likewise,
in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] a full work ow pipeline from data acquisition up to
interactive web-based visualization in the Cultural Heritage
domain was proposed. Remote or server-based rendering in
general is a very active research discipline for the last 20
years. Visualization servers or services are build to
overcome the performance issues with client solutions or provide
speci c systems to protect the 3D dataset while not or only
partially distributed to the client. Koller et al. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] provide
an interesting proposal to the protection system with a
remote rendering service that not just only transfers images
to the client but also includes a number of active defense
method to guard against 3D reconstruction attacks.
A streaming-based remote visualization for mobile devices
was presented in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], where complex 3D models are
rendered on a cluster of PCs and transferred to the client via
MPEG video streaming. Smart environments consisting of
several interconnected devices, which can change
dynamically whenever mobile devices enter or leave the
environment, are speci cally addressed in [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. To utilize such
environments e ciently for information visualization, the
authors also propose a service-oriented architecture. Although
their work still focuses on the speci cities of certain display
devices, it nevertheless already also addresses issues such as
caching strategies and compression methods.
      </p>
    </sec>
    <sec id="sec-7">
      <title>3. SYSTEM ARCHITECTURE</title>
      <p>Within this section, we focus onto automatable processes for
web application development by designing and
implementing a fully automated Web Service Portal, which provides
services that automatically combines application templates
and raw data into interactive 3D visualizations for the web.</p>
    </sec>
    <sec id="sec-8">
      <title>3.1 Use Cases and Design Considerations</title>
      <p>The goal here is to provide web services that automatically
convert raw 3D data (e.g. geo-spatial data, simulation
results, and architectural models) into interactive 3D
visualizations for the Web that can be delivered as a cloud service.
For example, value ranges that can be interactively explored
like a temperature or density distribution are automatically
tagged, like e.g. it is often done in modern IDEs such as
the CG FX Composer framework, to provide all data that
is necessary for an appropriate user interface, like a slider
with a corresponding value range as shown in Figure 4.
This enables the user (in our case typically a decision maker)
to interactively explore the presented 3D data, which is
achieved with the help of two approaches. On the one hand,
certain data values and ranges are re ected in such a way,
that the application service can directly derive appropriate
UI elements (e.g. a slider from x meters to y meters that
allows visualizing di erent water-levels in a disaster
management scenario). On the other hand, the user must be
able to directly interact with the visualization, e.g. by
selecting a certain region for which he wants to obtain more
information (which e.g. in a GIS scenario might be \show
buildings and trees in marked area") or by clicking onto a
certain POI, which in turn delivers other information from
the processing backend.</p>
      <p>
        Therefore, the visualization needs to be scalable in such
a way that { depending on the desired application type {
mobile and desktop machines with rather di erent
computing and 3D capabilities are supported alike. For example
this can be achieved via a hybrid approach that provides
both, server-side streaming for low-end mobile clients
(using InstantPlayer as render server [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]) and direct web-based
3D rendering for desktop machines via X3DOM. Moreover,
cross-platform and cross-browser issues need to be addressed.
Finally, especially when also CAD and PDM or highly
classi ed data is used, security aspects are of high importance.
Here again, streaming technologies help with information
hiding in that only image streams but no 3D models are
transferred over the network to the client for display.
As mentioned, the proposed software architecture is based
on web services. As described in section 2.4, these are
intended for being used in broader software ecosystems, which
automatically exchange data. Usually, the service interfaces
are described by XML documents such as SOAP. Obviously,
utilizing a uni ed standard for shared services and
communication is essential here. Furthermore, declarative
XMLbased languages such as X3D are suited well for SOAs in
that 3D content, such as CAD/ CAM data or a given WCS
response in a GIS application, can be directly transformed,
e.g. via an XSLT or similar transform, from one
representation to another (such as an X3D world that can be rendered
in real-time in the web browser using the X3DOM
framework). As shown in Figure 2, this transformation is done
with the help of a transcoder service, which also needs to
consider the respective client capabilities (e.g. mobile device
vs. desktop system) to provide an appropriate visualization.
For being able to present even large-scale big data, suitable
compression schemes are required for both, the client (esp.
when considering mobile devices) and the server (where esp.
latency is an issue). In our implementation this is handled by
utilizing image-based compression and delivery algorithms
that can encode geometric as well as material data. In
addition, appropriate server-side caching strategies allow for
faster delivery of 3D contents.
      </p>
    </sec>
    <sec id="sec-9">
      <title>3.2 Web-Service Architecture</title>
      <p>Figure 2 coarsely shows the concept of the proposed
serviceoriented architecture. The core component is the \Instant3D
Hub" that acts as application provider, whereas the
application identi cation is resolved via a URI. Thereto, the
application service takes a request from the so-called Hub and
extracts an application template, which speci es the data
and application characteristics. For data preparation, the
template provides at least the HTML page, the necessary
meta-information of the respective application, as well as
descriptions of all required data containers, e.g. in the
declarative X3D format for 3D contents.</p>
      <p>After that, the Hub invokes the appropriate transcoder
service for providing the concrete data (like a 3D world with
a certain camera pose). Therefore, the transcoder service
translates and, where required, caches the 3D data from
already existing descriptions by converting them from
various resources and formats, which are not yet suitable for
real-time web presentation, to a declarative deployment
format for nal presentation. Here we use X3D in combination
with HTML5, since declarative formats nicely t to SOA
pipelines. The result is then provided under a new URI.
This basic architecture tries to ful ll three basic
requirements that are outlined next.</p>
      <p>Scalability The central HUB recognizes the browser
criteria (e.g. mobile or desktop) and can use those to ask
for a device- and/ or context-speci c application UI.
The application uses a scene-graph manipulation layer,
which maps the actual changes to browser local (e.g.</p>
      <p>DOM content) or remote scene representations.
E ciency The overall structure is build to produce very
interactive and pleasant user experiences. All main UI
pages should get delivered immediately and all further
data sets should be provided with a exible caching
infrastructure on request. The whole service
architecture is build asynchronous and does not wait at any
point for any data conversion process at all. The client
and server side rendering processes are both built to
be able to stream e cient binary updates to the server
for highly responsive environments.</p>
      <p>Flexibility The architecture is not bound to a speci c
application model and very open through the web-service
infrastructure. It provides an environment useful to
a large number of applications by harmonizing three
basic steps: application-UI retrieval, continuous
datapreparation and a hybrid visualization approach, which
can map to client and server side rendering.</p>
    </sec>
    <sec id="sec-10">
      <title>3.3 Application and UI retrieval</title>
      <p>The goal of the framework is to deliver context- and
browserspeci c web applications. The application service provides
templates for those applications, which are retrieved on
request. Those templates consist of the following parts:
HTML documents HTML documents at rst can be seen
as the building ground for all application-speci c
structures. Those documents are provided by the
application service for a speci c browser and therefore device
(e.g. tablet or desktop).</p>
      <p>Data references The application includes usually a list of
external resources, which should be delivered to the
browsers while running. This could be resources like
XML documents or images, which do not need any
further processing but also link to data sets that need
to be converted before viewed (e.g. a speci c 3D data
set) or transformed for a speci c device class.</p>
      <p>Metadata The metadata describes criteria for the
conversion and transcoding process. This can e.g. control
whether optimizations on the graph are allowed or not
and how identi cation of objects should be performed.
The hub requests this information from the application
service, requests then data sets from the transcoder service
with the data references and metadata settings and delivers
the nal HTML document with the not yet existing external
references.</p>
    </sec>
    <sec id="sec-11">
      <title>3.4 Transcoder</title>
      <p>The transcoder service converts the data of a given resource
to a new single resourc or set of resources while considering
the guidelines provided by the application metadata. The
resulting URI's are provided immediately as result of the
transcoding request even so the data may not be available
yet. The basic HTTP return code is used to communicate
the availability of a speci c resource while requesting.
200 OK: the request has succeeded and the entity
corresponding to the requested resource is sent in the
response.
404 Not Found: the conversion job could not be completed
successfully and the sources will not be available
without it.
503 Service Unavailable: The service is not yet available
since the conversion process is still running. The HTML
head includes a standard Retry-After element that
denes when the resources is expected to be available.
The transcoder also includes an e cient caching and
updating mechanism, which allows to convert the data only once
for similar requests, but also updates the converted data as
soon as new data sets are available.</p>
    </sec>
    <sec id="sec-12">
      <title>3.5 Rendering</title>
      <p>The converted data is fetched to a real-time rendering
system, which consists of a scene-graph whose elements can be
identi ed and modi ed during runtime. This scene-graph
is manipulated through a client-side abstraction layer that
allows mapping those changes to local or remote
representations of the graph.</p>
      <sec id="sec-12-1">
        <title>3.5.1 Client-side Rendering</title>
        <p>
          Depending on data security aspects and the respective web
browser capabilities, the Hub generates a concrete
visualization application from a given pre-prepared scenario
template. For one thing, this can be realized via client-side
rendering by utilizing X3DOM, which either uses JavaScript
with WebGL or Flash 11 with Stage 3D for real-time
rendering. Open research issues here are suitable caching strategies
for fast content delivery as well as scalable methods for
binary compression of high-end material data (compare [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ])
and of big geometric data (i.e. vertex attributes).
The latter can be achieved by utilizing our image geometry
approach. This method not only allows to asynchronously
deliver and compress vertex attribute data but it also allows
to nicely separate the structure of the 3D content from raw
vertex data that usually only bloats the HTML document.
The advantages of client-side rendering are a rather simple
server infrastructure and highly interactive apps since
everything is rendered on the client. Disadvantages are that
the data-load can easily overburden the client, that lots of
3d data needs to be transferred, and security or IPR issues.
        </p>
      </sec>
      <sec id="sec-12-2">
        <title>3.5.2 Server-side Rendering</title>
        <p>
          The second option is server-side rendering. In this case, for
instance an X3D-based runtime environment [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] is utilized
for rendering and the rendered image frames are transferred
(e.g. as an MJPEG stream) to the client. Since interactions
are handled via WebSockets and XMLHttpRequest (XHR),
the latency is much higher than for client-side rendering.
Therefore, we are currently exploring suitable interaction
methods and message protocols.
        </p>
        <p>Another disadvantage here is the fact that a complex server
infrastructure is required. However, since no 3D data but
only images are transferred over the network, there are no
IPR issues concerning the 3D data, and data security is
inherently given as a nice side e ect. Also, the visualization
application can be executed on arbitrary clients, which is
another advantage of utilizing server-side rendering.</p>
      </sec>
    </sec>
    <sec id="sec-13">
      <title>4. RESULTS AND DISCUSSION</title>
    </sec>
    <sec id="sec-14">
      <title>4.1 Application Examples</title>
      <p>In this section a few use cases are exemplarily described to
demonstrate the potential of the proposed service
architecture. In the area of cultural heritage for instance, working
with 3D scanner data for preservation is getting more and
more common. Figure 3 shows an example of a web
application for the visualization of scanned historical 3D objects,
which was generated using the proposed transcoder
architecture by automatically processing and converting the scanned
data to create an interactive viewer.</p>
      <p>
        Figure 4 shows a 3D CAE prototype for the visualization
of simulation data in the web browser using X3DOM [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ],
where two examples from the domain of sheet metal forming
(left) and electromagnetic eld simulation (right) are taken
to allow the exploration of FEM results. These application
prototypes have a huge potential for communicating and
presenting e.g. simulation results towards decision makers
or consumers, without distributing a whole application while
providing the user with more information than a static image
or a boring fact sheet.
      </p>
      <p>The example to the left in Figure 4 shows the results of a
sheet metal forming simulation in automotive environments.
The material thickness after the forming process is
colorcoded and applied via a look-up texture. By clicking onto a
colored region, the corresponding thickness value is obtained
and marked with a yellow arrow and textual information in
the top right of the application. The slider elements below
are implemented using the JavaScript library jQuery (http:
//jquery.com/) and can be used to interactively modify the
color-coding by setting o set, bias, and threshold.</p>
    </sec>
    <sec id="sec-15">
      <title>4.2 Standardization Aspects</title>
      <p>
        Another point is the lack of open standards in scienti c
visualization and 3D graphics as well as in mobile and interactive
systems. Although current visualization systems are often
highly specialized and rather sophisticated, they still utilize
proprietary formats and methods that are neither
compatible in their concepts of operation nor in their supported data
formats. On the one hand this prevents a harmonization of
data from di erent sources and thereby hinders its
distribution and utilization. On the other this also leads to parallel
developments of incompatible and isolated technologies.
In this context, the open ISO standard X3D [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] is the only
standardized 3D deployment format that also de nes the
runtime behavior. Hence, there are ongoing e orts [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] to
develop an open interoperable standard for the
representation of volumetric data based on input from a wide variety
of modalities. The proposed X3D volume rendering
component [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] therefore aims at the exchange and interactive
exploration of volumetric data and at industrial applications
that use X3D as interchange format, but can link to
proprietary databases and hardware, too.
      </p>
      <p>
        A service for open, exible, and scalable access and
processing of Earth data is the OGC Web Coverage Service
(WCS) 2.0 Standard, which now allows providing a
comprehensive portion of Earth science data categories through
one coherent and implementation-independent interface [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
The coverage model of WCS 2.0 transcends pure raster data
and includes almost all relevant categories, such as irregular
and curvilinear grids, general meshes, trajectories, surfaces,
solids, and point clouds.
      </p>
      <p>
        In this regard, X3D already incorporates basic means for
point rendering, as well as a geospatial component. Since
most geo-referenced data are provided in a geodetic or
projective spatial reference frame, X3D therefore provides
support for a number of nodes that can use spatial reference
frames for modeling purposes. However, there are still
several drawbacks like the lack of well-de ned terrain rendering
etc., which for instance were addressed in [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. In addition,
with the X3D Earth working group there is a strong
collaboration of the Web3D Consortium with the OGC, because
as mentioned, X3D provides a solid foundation here and is
a good starting point for further standardization e orts to
enable an automated connection of existing data sources for
further visualization.
      </p>
      <p>Hence, a pro-active participation in several standardization
bodies (ISO, W3C, Khronos) helps preventing parallel
developments of isolated technologies by harmonizing the general
understanding. Therefore, the \Declarative 3D for the Web
Architecture" W3C Community Group was founded in 2011
with the objective to standardize a declarative approach to
interactive 3D graphics as part of HTML documents.</p>
    </sec>
    <sec id="sec-16">
      <title>5. CONCLUSIONS</title>
      <p>Traditional scienti c visualization approaches are extremely
demanding in regards to software and hardware
requirements. Thus, today's visualization solutions are tailored
for speci c data representations and application scenarios
to cope with several soft- and hardware limitations, which
led to extremely specialized software packages that are built
and run by professionals in high-cost scenarios. However,
recent developments in the area of web applications and the
requirement to provide applications not only for a small group
of experts lead to new approaches for web-based
visualization. Morever, since data-centered, distributed applications
were one of the common concepts to process huge data sets
for visualization, web-service architectures and cloud-based
solutions are just the next step. Additionally, the emerging
support for GPU-accelerated high-performance 3D
rastergraphics in modern web clients and standards provide an
application environment that is especially interesting for the
demands of scienti c visualization solutions.</p>
      <p>In this regard, the approach we presented in this paper does
not only implement an established application model in a
new web- and cloud-based environment, but it also
introduces a web-service architecture as core of the application
distribution and deployment infrastructure. Instead of
simply delivering data to a rigid viewer like in conventional
applications, our proposed architecture delivers a user
experience that is tailored for speci c user scenarios and the
actual context. Thereby, the nal environment is able to
derive and deliver a dynamic application with regards to user,
system, security, and data requirements.</p>
      <p>This allows the system to provide dynamic technical
solutions and to automatically choose a client, server, or even
hybrid visualization method for an unchanged application
at runtime, while also considering the device capabilities as
well as IPR and security concerns. What is even more
important, besides the technical aspects, is the architecture's
ability to provide very speci c applications for certain user
groups, since the system is not built as a rigid application
model for a small user group. Thus, the presented service
architecture enables new application scenarios, including
scienti c visualization for decision support or visual analytics
applications, as well as e.g. corresponding web applications
for public information scenarios.</p>
    </sec>
    <sec id="sec-17">
      <title>6. ACKNOWLEDGMENTS</title>
      <p>The work described in this paper was carried out in the
project EarthServer, which has received funding from the
European Community's Seventh Framework Programme (EU
FP7-INFRA) under grant agreement no 283610.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>R.</given-names>
            <surname>Arnaud</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Barnes</surname>
          </string-name>
          . Collada.
          <source>AK Peters</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>P.</given-names>
            <surname>Baumann</surname>
          </string-name>
          .
          <article-title>Beyond rasters: introducing the new ogc web coverage service 2.0</article-title>
          .
          <source>In Proceedings GIS '10</source>
          , pages
          <fpage>320</fpage>
          {
          <fpage>329</fpage>
          , New York, NY, USA,
          <year>2010</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J.</given-names>
            <surname>Behr</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Jung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Drevensek</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Aderhold</surname>
          </string-name>
          .
          <article-title>Dynamic and interactive aspects of X3DOM</article-title>
          .
          <source>In Proceedings Web3D 2011</source>
          , pages
          <fpage>81</fpage>
          {
          <fpage>87</fpage>
          , New York, USA,
          <year>2011</year>
          . ACM Press.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J.</given-names>
            <surname>Behr</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Jung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Keil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Drevensek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Eschler</surname>
          </string-name>
          , M. Zollner, and
          <string-name>
            <given-names>D. W.</given-names>
            <surname>Fellner</surname>
          </string-name>
          .
          <article-title>A scalable architecture for the HTML5/ X3D integration model X3DOM</article-title>
          . In S. Spencer, editor,
          <source>Proceedings Web3D</source>
          <year>2010</year>
          , pages
          <fpage>185</fpage>
          {
          <fpage>193</fpage>
          , New York, USA,
          <year>2010</year>
          . ACM Press.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>R.</given-names>
            <surname>Berndt</surname>
          </string-name>
          , G. Buchgraber,
          <string-name>
            <given-names>S.</given-names>
            <surname>Havemann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Settgast</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D. W.</given-names>
            <surname>Fellner</surname>
          </string-name>
          .
          <article-title>A publishing work ow for cultural heritage artifacts from 3d-reconstruction to internet presentation</article-title>
          .
          <source>In Proceedings of the 3rd intl. conf. on digital heritage</source>
          , pages
          <volume>166</volume>
          {
          <fpage>178</fpage>
          , Berlin,
          <year>2010</year>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>R.</given-names>
            <surname>Bu</surname>
          </string-name>
          <article-title>rger and</article-title>
          <string-name>
            <given-names>H.</given-names>
            <surname>Hauser</surname>
          </string-name>
          .
          <article-title>Visualization of multi-variate scienti c data</article-title>
          .
          <source>In Eurographics 2007 State of the Art Reports</source>
          , pages
          <volume>117</volume>
          {
          <fpage>134</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.</given-names>
            <surname>Congote</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Segura</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Kabongo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Moreno</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Posada</surname>
          </string-name>
          , and
          <string-name>
            <given-names>O.</given-names>
            <surname>Ruiz</surname>
          </string-name>
          .
          <article-title>Interactive visualization of volumetric data with webgl in real-time</article-title>
          .
          <source>In Proceedings Web3D 2011</source>
          , pages
          <fpage>137</fpage>
          {
          <fpage>146</fpage>
          , New York, NY, USA,
          <year>2011</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>W.</given-names>
            <surname>Consortium</surname>
          </string-name>
          .
          <source>Extensible 3d (X3D)</source>
          ,
          <year>2011</year>
          . http://www.web3d.org/x3d/speci cations/.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>T.</given-names>
            <surname>Erl</surname>
          </string-name>
          .
          <article-title>Service-Oriented Architecture: Concepts, Technology, and</article-title>
          <string-name>
            <given-names>Design. Prentice</given-names>
            <surname>Hall</surname>
          </string-name>
          <string-name>
            <surname>PTR</surname>
          </string-name>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>FhG. Instant Reality</surname>
          </string-name>
          ,
          <year>2012</year>
          . www.instantreality.org.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>N.</given-names>
            <surname>John</surname>
          </string-name>
          , M. Aratow,
          <string-name>
            <given-names>J.</given-names>
            <surname>Couch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Evestedt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hudson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Polys</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Puk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ray</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Victor</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Q.</given-names>
            <surname>Wang</surname>
          </string-name>
          . MedX3D:
          <article-title>Standards enabled desktop medical 3d</article-title>
          .
          <source>In MMVR: Medicine Meets Virtual Reality</source>
          , pages
          <volume>189</volume>
          {
          <fpage>194</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>D.</given-names>
            <surname>Koller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Turitzin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Levoy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Tarini</surname>
          </string-name>
          , G. Croccia,
          <string-name>
            <given-names>P.</given-names>
            <surname>Cignoni</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Scopigno</surname>
          </string-name>
          .
          <article-title>Protected interactive 3d graphics via remote rendering</article-title>
          .
          <source>In ACM SIGGRAPH 2004 Papers, SIGGRAPH '04</source>
          , pages
          <fpage>695</fpage>
          {
          <fpage>703</fpage>
          , New York, NY, USA,
          <year>2004</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>F.</given-names>
            <surname>Lamberti</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Sanna</surname>
          </string-name>
          .
          <article-title>A streaming-based solution for remote visualization of 3d graphics on mobile devices</article-title>
          .
          <source>IEEE Transactions on Visualization and Computer Graphics</source>
          ,
          <volume>13</volume>
          (
          <issue>2</issue>
          ):
          <volume>247</volume>
          {
          <fpage>260</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>D. R.</given-names>
            <surname>Lipsa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. S.</given-names>
            <surname>Laramee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. D.</given-names>
            <surname>Bergeron</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T. M.</given-names>
            <surname>Sparr</surname>
          </string-name>
          .
          <article-title>Data representation for scienti c visualization: An introduction</article-title>
          . In Computer Graphics, chapter
          <volume>6</volume>
          , pages
          <fpage>121</fpage>
          {
          <fpage>136</fpage>
          . Nova Science Publishers,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>C.</given-names>
            <surname>Marrin</surname>
          </string-name>
          . Webgl speci cation,
          <year>2011</year>
          . https://www.khronos.org/registry/webgl/specs/1.0/.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>M. McCann</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Puk</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Hudson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Melton</surname>
            , and
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Brutzman</surname>
          </string-name>
          .
          <article-title>Proposed enhancements to the x3d geospatial component</article-title>
          .
          <source>In Proceedings Web3D 2009</source>
          , pages
          <fpage>155</fpage>
          {
          <fpage>158</fpage>
          , New York, NY, USA,
          <year>2009</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>T. McLoughlin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. S.</given-names>
            <surname>Laramee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Peikert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. H.</given-names>
            <surname>Post</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Chen</surname>
          </string-name>
          .
          <article-title>Over two decades of integration-based, geometric ow visualization</article-title>
          .
          <source>Computer Graphics Forum</source>
          ,
          <volume>29</volume>
          (
          <issue>6</issue>
          ):
          <year>1807</year>
          {
          <year>1829</year>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Microsoft</surname>
          </string-name>
          . Silverlight,
          <year>2011</year>
          . http://www.microsoft.com/SILVERLIGHT/.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Polys</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. W.</given-names>
            <surname>John</surname>
          </string-name>
          , D. Evestedt, and
          <string-name>
            <given-names>M.</given-names>
            <surname>Aratow</surname>
          </string-name>
          .
          <article-title>Unifying iso standards for medical image presentation</article-title>
          .
          <source>In Workshop on Medical Virtual Env. IEEE</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>A.</given-names>
            <surname>Salga</surname>
          </string-name>
          .
          <source>XB PointStream</source>
          ,
          <year>2011</year>
          . http://scotland.proximity.on.ca/asalga/demos/freecam/.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>T.</given-names>
            <surname>Schi</surname>
          </string-name>
          <string-name>
            <surname>er</surname>
          </string-name>
          , A. Schiefer,
          <string-name>
            <given-names>R.</given-names>
            <surname>Berndt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Ullrich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Settgast</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D. W.</given-names>
            <surname>Fellner</surname>
          </string-name>
          .
          <article-title>Enlightened by the web { a service-oriented architecture for real-time photorealistic rendering</article-title>
          .
          <source>In Tagungsband 5. Kongress Multimediatechnik Wismar</source>
          , pages
          <fpage>1</fpage>
          <issue>{8</issue>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>C.</given-names>
            <surname>Schwartz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Ruiters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Weinmann</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Klein</surname>
          </string-name>
          .
          <article-title>Webgl-based streaming and presentation framework for bidirectional texture functions</article-title>
          .
          <source>In Proceedings VAST</source>
          <year>2011</year>
          , pages
          <fpage>113</fpage>
          {
          <fpage>120</fpage>
          .
          <string-name>
            <surname>Eurographics</surname>
          </string-name>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>A.</given-names>
            <surname>Systems</surname>
          </string-name>
          . Flash,
          <year>2011</year>
          . http://www.adobe.com/products/ ashplayer.html.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>C.</given-names>
            <surname>Thiede</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Tominski</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Schumann</surname>
          </string-name>
          .
          <article-title>Service-oriented information visualization for smart environments</article-title>
          .
          <source>In 13th Intl. Conf. on Information Visualisation</source>
          , pages
          <volume>227</volume>
          {
          <fpage>234</fpage>
          . IEEE,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>