<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>A Trajectory-preserving
Synchronization method for Collaborative Visualization. IEEE Transac-
tions on Visualization and Computer Graphics</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>BioMixer: A Web-based Collaborative Ontology Visualization Tool</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Bo Fu</string-name>
          <email>bofu@uvic.ca</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lars Grammel</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Margaret-Anne Storey</string-name>
        </contrib>
      </contrib-group>
      <pub-date>
        <year>2008</year>
      </pub-date>
      <volume>12</volume>
      <issue>5</issue>
      <fpage>417</fpage>
      <lpage>423</lpage>
      <abstract>
        <p>Ontology   development   often   requires   the   participation   of   various   col-­laborators.   Web-­‐based   ontology   editors,   such   as   WebProtégé,   have   been   developed   to   provide   users   with   collaborative   support   such   as   comments   and   discussions.   There   is   a   large   body   of   work   concerning   ontology  visualization  techniques;  however,  less  research  attention  has   been   placed   on   providing   the   necessary   support   for   collaborative   on-­tology   visualization.   To   explore   this   research   gap,   the   web-­‐based   col-­laborative   ontology   visualization   tool   BioMixer   is   presented   in   this   paper.   In   order   to   assist   the   collaborative   visualization   process,   Bio-­Mixer  provides  users  with  sharable  workspaces  and  embeddable  visu-­alizations  that  can  be  seamlessly  inserted  into  external  websites.    </p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Department  of  Computer  Science,  University  of  Victoria,  Canada  
 </p>
    </sec>
    <sec id="sec-2">
      <title>1 INTRODUCTION</title>
      <p>
        Visualizations can provide essential cognitive support when
trying to make sense of the semantics embedded in
ontologies. Improving cognitive support for ontology
understanding is particularly important in the domain of biomedical
ontologies, as such ontologies are typically large and rely on
collaborative development (Noy et al., 2008). Despite a
large amount of research effort in developing ontology
visualization techniques
        <xref ref-type="bibr" rid="ref8">(Katifori &amp; Halatsis, 2007)</xref>
        , there has
been relatively little attention placed on providing
collaborative visualization support.
      </p>
      <sec id="sec-2-1">
        <title>Real world applications of collaborative visualization</title>
        <p>
          include social data analysis websites (such as Many Eyes1
(Viégas et al., 2007)), scientific research projects (such as
National Fusion Collaboratory (Schissel et al., 2004)) and
environmental planning
          <xref ref-type="bibr" rid="ref3">(Brewer et al., 2000)</xref>
          . However, in
the field of ontology visualization, collaborative
visualization has not received much attention. Although collaborative
support is provided in ontology editors such as WebProtégé2
(Tudorache et al., 2008), however, existing ontology
visualization tools lack collaborative visualization support
          <xref ref-type="bibr" rid="ref8">(Sivakumar &amp; Arivoli, 2011; Katifori &amp; Halatsis, 2007; Katifori
et al., 2006)</xref>
          .
        </p>
        <p>In an attempt to address the need for collaborative
ontology visualization, this paper presents the BioMixer3 tool that
allows users to share visualization workspaces and to embed
visualizations in websites. The vision for BioMixer is that
collaborative ontology visualization will improve ontology
authoring activities and foster collaboration across groups.</p>
      </sec>
      <sec id="sec-2-2">
        <title>The remainder of this paper is organized as follows. A brief</title>
        <p>overview on related work is presented in Section 2. The
design, implementation and key features of BioMixer are
presented in Section 3. Finally, Section 4 outlines
BioMixer’s future research directions.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>2 RELATED WORK</title>
      <sec id="sec-3-1">
        <title>Building tools for collaborative visualization is identified as</title>
        <p>
          one of the key challenges in visual analytics (Thomas &amp;
Cook, 2005) and design considerations for such tools have
been recommended (Heer &amp; Agrawala, 2007). Collaborative
visualization can be described as “the intersection of two
major research fields: traditional visualization and computer
supported cooperative working”
          <xref ref-type="bibr" rid="ref6">(Isenberg et al., 2011)</xref>
          . In
computer supported cooperative working (CSCW), one of
the most widely cited classifications to describe
collaborative aspects is Applegate’s place-time matrix
          <xref ref-type="bibr" rid="ref2">(Applegate,
1991)</xref>
          . Applegate states that cooperative work can take place
in the same or different place at the same or different time.
In the context of CSCW, synchronous collaboration will
typically occur at different places at the same time, e.g.
video conferencing. Asynchronous collaboration will typically
take place at different places at different times, e.g. editing
ontologies using WebProtégé. The current BioMixer release
can be categorized as an asynchronous collaboration tool for
ontology visualization, however, support for synchronous
collaboration is planned for a future release.
        </p>
        <p>
          Expanding on the place-time matrix, Brodlie et al.
          <xref ref-type="bibr" rid="ref4">(Brodlie et al., 2004)</xref>
          further distinguish distributed
visualization from collaborative visualization and distributed
collaborative visualization. Distributed visualization involves
collaboration at the system level, whereas collaborative
visualization refers to collaboration at the human level.
Distributed collaborative visualization combines distributed
visualization and collaborative visualization by allowing
collaboration at both the system and the human level. Other
definitions for collaborative visualization have also been
proposed in the literature
          <xref ref-type="bibr" rid="ref7">(Raje et al., 1998; Johnson, 1998;
Li et al., 2006, Wattenberg, 2005)</xref>
          . This paper adopts the
definition of collaborative visualization proposed by
Isenberg et al., which is “the shared use of computer-supported,
(interactive) visual representations of data by more than one
person with the common goal of contribution to joint
information processing activities”
          <xref ref-type="bibr" rid="ref6">(Isenberg et al., 2011)</xref>
          .
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>The benefits of using collaborative visualization have</title>
        <p>been studied in social data analysis websites such as Many
Eyes (Viégas et al., 2007). The goal of Many Eyes is
twofold. First, the creation and publication of visualizations can
reach out to a larger audience, not just experts. Second, the
social potential of web-based visualizations enables
discussions among the wider audience. The advantages of
collaborative visualization in social data analysis may also hold true
for the domain of ontology visualization. As with
collaborative support, visualizations will not only serve as a tool for
sense-making, but also as a channel to stimulate discussions
between users.</p>
        <p>
          This trend of collaborative support is already embraced
by existing ontology editors. For instance, WebProtégé
(Tudorache et al., 2008) aims to support the collaborative
ontology development process by providing an online
environment for users to edit, discuss and annotate ontologies.
visCOntE (Vonrueden &amp; Hampel, 2005) provides support
for searching, creating and editing ontologies among
collaborators. COVE
          <xref ref-type="bibr" rid="ref1">(Allemang et al., 2004)</xref>
          emphasizes the
evolution of ontologies and provides collaborative editing
support for ontologies in the space shuttle domain.
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>Despite the uptake of collaborative support in ontology</title>
        <p>
          development tools, little research attention has focused on
providing collaborative support for ontology visualization.
An extensive review of existing ontology visualization
approaches is presented in
          <xref ref-type="bibr" rid="ref8">(Katifori &amp; Halatsis, 2007)</xref>
          . A key
observation from this review is that most existing ontology
visualization tools have focused on providing users with
sophisticated views; however, few have explored enabling
collaboration among the users. Although a web-based
visualization service, FlexViz, has successfully demonstrated
the application of online visualizations in the BioPortal
ontology library (Noy et al., 2009), so far it has not leveraged
the social potential of the web. In order to bring the benefits
of the social web to biomedical ontology visualization,
BioMixer has been designed with collaborative visualization
in mind from the beginning.
3
        </p>
        <p>BIOMIXER DESIGN, FEATURES &amp;</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>IMPLEMENTATION</title>
      <p>
        Inspired by previous design recommendations (Heer &amp;
Agrawala, 2007) and tool requirements
        <xref ref-type="bibr" rid="ref6">(Isenberg et al.,
2011)</xref>
        for collaborative visualization, a list of design
considerations for collaborative ontology visualization has been
derived and is discussed next. Collaborative ontology
visualization tools need to (but not limited to):
• support social interactions around the data, so that a
group of collaborators working on the same
visualizations can provide commentary and discuss relevant
implications on common ground;
• engage a wider audience and provide support for
users to share and publish their findings, so that
information is appropriately distributed for group decision
making;
• support long-term use by people with distinct
backgrounds and different goals, so that personal
visualization preferences and styles can be fully elaborated;
and
• enhance decision making by providing collaborative
support from the beginning of the design process, so
that collaborative features are included in the design
process of a visualization tool to prevent these
features being developed just as an afterthought.
      </p>
      <p>In order to address the needs identified above, BioMixer
is being designed to support visualizations in collaborative
settings. In particular, BioMixer:
• supports social interaction around the visualization.</p>
      <p>A user can send an existing visualization workspace
to his/her collaborators via email, as well as initiate
discussions by adding notes to the visualizations.
• engages a wider audience by providing a web-based
interface. A user can easily access BioMixer using a
web browser and does not need to download or
install any software.
• supports the publication of visualizations by
providing interactive visualization embeds that can be
easily inserted into external websites.
• supports users with diverse backgrounds and
preferences by presenting multiple coordinated views,
which aim to engage the audience from different
viewpoints.</p>
      <p>Figure 1 illustrates an example of using BioMixer for
collaborative ontology visualization, exemplifying the
features listed above. In this example, the user searches for
tissue and is given a list of ontologies that contain this term
in the Search view (see top left window in Fig. 1)4. The user
then selects the Cell Line Ontology, the RadLex Ontology,
the BioTop Ontology and the Gene Regulation Ontology in
the search results and subsequently creates Selection 1 in the
view frame. By selecting the Graph button under Views, an
empty graph view is created in the workspace. The user can
then drag Selection 1 and drop this selection onto the graph
view. He/she can also add comments by adding a Note view
(see bottom right view in Fig. 1). To explore the nodes
shown in the graph view, the user can select a node and
choose to visualize its associated concepts or mappings. In
Fig. 1, four ontologies (color coded) are visualized in the
circle layout, the is-a relations are visualized by solid
directional lines and the mappings are visualized by grey dashed
lines. Visualizing different types of mappings (e.g. exact,
close, related, broad and narrow mappings) are not
supported in the current graph view, but will be included in a future
release. This visualization can also be displayed using other
layouts as shown in Fig. 1 (the panel to the right includes</p>
      <sec id="sec-4-1">
        <title>4 Searching for ontologies by name is not supported in the current release</title>
        <p>
          of BioMixer, but is to be included in a future release.
tree, spring, grid layout, etc.). For example, the spring
layout may be appropriate when presenting an overview of
several ontologies and how the mappings relate them to one
another (an example is shown in Fig. 2), however the tree
layout may be more suitable for visualizing the hierarchical
relationships among the nodes (an example is shown in Fig.
3). As pointed out in
          <xref ref-type="bibr" rid="ref8">(Motta et al., 2011; Katifori &amp;
Halatsis, 2007)</xref>
          and demonstrated by Wang &amp; Parsia (Wang
&amp; Parsia, 2006), each type of visualization is associated
with its own strengths and weaknesses. Thus, BioMixer
supports a variety of layouts in an effort to better assist the
user with his/her understanding of the ontology(ies) at hand
through the use of flexible visualization layouts. It is
recognized that the graph view can quickly become unusable as
the number of nodes increases in a visualization. This
scalability issue may be overcome by using other types of
visualizations, e.g. nodes can be visualized on the axes and
mappings can be visualized in the cells of a matrix layout.
Additional types of visualization such as the matrix layout are
currently being developed for BioMixer.
        </p>
        <p>In BioMixer, the user can further explore any subset of
the current visualization by selecting the nodes he/she is
interested in viewing. In the example shown in Fig. 1, the
user selects the nodes connected by mapping which
subsequently creates Selection 2. By selecting the show mapping
nodes checkbox in Nodes, this second selection can be
dragged and dropped onto the Timeline view, which will
then show the creation dates of these mappings (e.g. May
17th, 2010 in Fig. 1). If the user is only interested in an
overview of all the terms used in the ontology irrespective of the
relationships between them, a tag cloud can be generated in
the Text view.</p>
        <p>
          BioMixer also visualizes mappings between multiple
ontologies. This differs from existing tools, such as Optima
          <xref ref-type="bibr" rid="ref9">(Kolli &amp; Doshi, 2008)</xref>
          , AlViz (Lanzenberger &amp; Sampson,
2006) and CogZ
          <xref ref-type="bibr" rid="ref5">(Falconer &amp; Storey, 2009)</xref>
          , where
mappings are often visualized between only one pair of
ontologies. In contrast, mappings in BioMixer are visualized
between two or more ontologies at a time (as shown in Fig. 1,
and Fig. 2). This feature presents the user with a much
broader view on the relationships among a number of
ontologies in one visualization. It supports the user in the process
of exploring existing mappings and determining the
similarities among the given ontologies more efficiently.
        </p>
        <sec id="sec-4-1-1">
          <title>NCBO%BioPortal%REST%Services%</title>
        </sec>
        <sec id="sec-4-1-2">
          <title>BioMixer%Client%(in%Browser)%</title>
        </sec>
        <sec id="sec-4-1-3">
          <title>Search%Services%</title>
        </sec>
        <sec id="sec-4-1-4">
          <title>Term%Services%</title>
        </sec>
        <sec id="sec-4-1-5">
          <title>Mapping%Service%</title>
        </sec>
        <sec id="sec-4-1-6">
          <title>BioMixer%Server%(on%GAE)%</title>
        </sec>
        <sec id="sec-4-1-7">
          <title>User%Authen&gt;ca&gt;on%</title>
          <p>%IsPA Embed%Persistence%
%
EA Workspace%Persistence%
G</p>
        </sec>
        <sec id="sec-4-1-8">
          <title>Workspace%Sharing%</title>
          <p>%sscceA %taaD
gaanM rkoW
em sap
%ten %ce</p>
        </sec>
        <sec id="sec-4-1-9">
          <title>Undo% Redo%</title>
          <p>V
i
s
u
a
li
z
a
&gt;
o
n
s
%</p>
        </sec>
        <sec id="sec-4-1-10">
          <title>Graph%</title>
        </sec>
        <sec id="sec-4-1-11">
          <title>Tag%Cloud%</title>
        </sec>
        <sec id="sec-4-1-12">
          <title>Timeline%</title>
        </sec>
        <sec id="sec-4-1-13">
          <title>Visualiza&gt;on% Coordina&gt;on%</title>
        </sec>
        <sec id="sec-4-1-14">
          <title>Window% Management%</title>
        </sec>
        <sec id="sec-4-1-15">
          <title>Notes%</title>
        </sec>
        <sec id="sec-4-1-16">
          <title>Help%</title>
          <p>To share the workspace shown in Fig. 1 with a
collaborator, the user can click the Share button and enter the
collaborator’s email address. An email containing the URL of
the workspace will be sent to the collaborator, who can then
load this workspace into his/her browser by simply opening
the URL. To publish visualizations online, inline frames are
provided to the user, which enable the insertion of
visualizations in external websites (currently, users must sign in to
use this feature). This feature allows the user to quickly
update visualizations on external websites when required.
Figure 4 demonstrates these Share and Embed features.</p>
        </sec>
      </sec>
      <sec id="sec-4-2">
        <title>BioMixer is a client-server web application. It is built on</title>
        <p>top of the Google Web Toolkit5 (GWT) and the Google App
Engine6 (GAE) technologies, and integrates visualization
components written in Flash, Java and JavaScript. Figure 5
presents the BioMixer architecture. The three key
components are the BioMixer Client, the BioMixer Server and the
BioPortal REST Services7 provided by the National Center
for Biomedical Ontology8 (NCBO). The BioMixer client is
an ontology visualization environment that runs in the user’s
browser. It is written in Java and compiled to JavaScript
using the GWT. The client currently supports graph, text,
timeline and note views; however, additional types of
visualization can be easily integrated given the extensible
architecture of BioMixer. The client also provides visualization
coordination such as synchronized highlighting (brushing),
filtering and selections across multiple views. In addition, it
supports basic features such as window management and
undo/redo. The client accesses the data stored in BioPortal
through the NCBO BioPortal REST services. To enable
workspace sharing and persistence, the BioMixer client uses
services offered by the BioMixer server. The BioMixer</p>
      </sec>
      <sec id="sec-4-3">
        <title>5 http://code.google.com/webtoolkit/</title>
      </sec>
      <sec id="sec-4-4">
        <title>6 http://code.google.com/appengine/</title>
      </sec>
      <sec id="sec-4-5">
        <title>7 http://www.bioontology.org/wiki/index.php/BioPortal_REST_services</title>
      </sec>
      <sec id="sec-4-6">
        <title>8 http://www.bioontology.org/</title>
        <p>server runs on GAE and provides services that require
longterm data storage, email notification and user authentication.</p>
      </sec>
      <sec id="sec-4-7">
        <title>More specifically, the BioMixer server is responsible for user authentication, embed persistence, workspace persistence and workspace sharing.</title>
        <p>4</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>FUTURE WORK</title>
      <p>BioMixer is an on-going research effort. This paper is
among the first attempts at applying collaborative support in
the field of ontology visualization. The current
implementation of BioMixer focuses on the visualization of ontologies
from the biomedical domain. However, the underlying
architecture is domain independent and could therefore be
applied to visualize ontologies from other domains of
interest. Future research in BioMixer includes improving its
technical infrastructure as well as conducting rigorous
evaluation of its usability through real-world case studies.</p>
      <sec id="sec-5-1">
        <title>Moreover, we plan to investigate the impact of synchronous</title>
        <p>and asynchronous collaborative visualization on
collaborative biomedical ontology development. In particular, we will
continue interacting with different user groups and improve
the visualization and collaboration features in BioMixer
based on user feedback.</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>ACKNOWLEDGEMENT</title>
      <sec id="sec-6-1">
        <title>This research is supported by the National Center for Bio</title>
        <p>medical Ontology (NCBO), the NHGRI, the NHLBI, the</p>
      </sec>
      <sec id="sec-6-2">
        <title>NIH Common Fund under Grant #U54-HG004028 and IBM</title>
      </sec>
      <sec id="sec-6-3">
        <title>CAS PhD Fellowship. The authors would like to thank Cassandra Petrachenko for her editing assistance.</title>
        <p>dez V., Zablith F. (2011), A novel approach to visualizing and
navigating ontologies. In Proceedings of the 10th International Conference
on the Semantic Web - Volume Part I, 470-486.</p>
        <p>Noy N. F., Shah N. H., Whetzel P. L., Dai B., Dorf M., Griffith N.,
JonBioPortal: ontologies and integrated data resources at the click of a
mouse. Nucleic Acids Res. Jul 1;37 (Web Server issue):W170-3. Epub
2009 May 29. PubMed PMID: 19483092; PubMed Central PMCID:
PMC2703982.
Biomedical Ontologies Collaboratively. American Medical Informatics
Association Annual Symposium Proceeding, 520-524.
for Visualization using Java RMI. Concurrency and Computation:
PracBuilding the US National Fusion Grid: Results from the National
Fu245-250.
and Development Agenda for Visual Analytics. IEEE Computer Society,</p>
      </sec>
      <sec id="sec-6-4">
        <title>Ontology Editor for the Web. In Proceedings of the 5th International</title>
        <p>Workshop on OWL: Experiences and Directions.
Visualization in CSCW Systems. ICEIS 2005 – Information Systems
zation of Owl Class Hierarchies. In Proceedings of the 5th International
sis. In Proceedings of the Symposium on Information Visualization,
17.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>Allemang D.</given-names>
            ,
            <surname>Polikoff</surname>
          </string-name>
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Hodgson</surname>
          </string-name>
          <string-name>
            <surname>R.</surname>
          </string-name>
          (
          <year>2004</year>
          ),
          <article-title>COVE - Collaborative Ontology Visualization and Evolution</article-title>
          . IEEE Aerospace Conference,
          <volume>1</volume>
          -
          <fpage>10</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Applegate L. M.</surname>
          </string-name>
          (
          <year>1991</year>
          ),
          <article-title>Technology Support for Cooperative Work: A Framework for Studying Introduction and Assimilation in Organizations</article-title>
          .
          <source>Journal Organizational Computing I</source>
          ,
          <fpage>11</fpage>
          -
          <lpage>39</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Brewer</surname>
            <given-names>I.</given-names>
          </string-name>
          ,
          <article-title>MacEachren</article-title>
          <string-name>
            <given-names>A. M.</given-names>
            ,
            <surname>Abdo</surname>
          </string-name>
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Gundrum</surname>
          </string-name>
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Otto</surname>
          </string-name>
          <string-name>
            <surname>G.</surname>
          </string-name>
          (
          <year>2000</year>
          ),
          <article-title>Collaborative Geographic Visualization: Enabling Shared Understanding of Environmental Processes</article-title>
          .
          <source>In Proceedings of the Symposium on Information Visualization</source>
          ,
          <fpage>137</fpage>
          -
          <lpage>141</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Brodlie</surname>
            <given-names>K. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Duce</surname>
            <given-names>D. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gallop</surname>
            <given-names>J. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walton</surname>
            <given-names>J. P. R. B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wood</surname>
            <given-names>J. D.</given-names>
          </string-name>
          (
          <year>2004</year>
          ),
          <article-title>Distributed and Collaborative Visualization</article-title>
          .
          <source>Computer Graphics Forum</source>
          <year>2004</year>
          ,
          <volume>23</volume>
          :
          <fpage>223</fpage>
          -
          <lpage>251</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Falconer</surname>
            ,
            <given-names>S. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Storey</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          (
          <year>2009</year>
          ),
          <article-title>CogZ: Cognitive Support and Visualization for Semi-Automatic Ontology Mapping</article-title>
          . International Conference on Biomedical Ontology, Software Demonstration Heer,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Agrawala</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2007</year>
          ),
          <article-title>Design Considerations for Collaborative Visual Analytics</article-title>
          ,
          <source>IEEE Symposium on Visual Analytics Science and Technology</source>
          ,
          <volume>171</volume>
          -
          <fpage>178</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <given-names>Isenberg P.</given-names>
            ,
            <surname>Elmqvist</surname>
          </string-name>
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Scholtz</surname>
          </string-name>
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Cernea</surname>
          </string-name>
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Ma</surname>
          </string-name>
          <string-name>
            <given-names>K. L.</given-names>
            ,
            <surname>Hagen</surname>
          </string-name>
          <string-name>
            <surname>H.</surname>
          </string-name>
          (
          <year>2011</year>
          ), Collaborative Visualization: Definition, Challenges, and Research Agenda.
          <source>Information Visualization</source>
          ,
          <volume>10</volume>
          (
          <issue>4</issue>
          ),
          <fpage>310</fpage>
          -
          <lpage>326</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Johnson G.</surname>
          </string-name>
          (
          <year>1998</year>
          ),
          <source>Collaborative Visualization 101. ACM Siggraph Computer Graphics</source>
          ,
          <volume>32</volume>
          (
          <issue>2</issue>
          ),
          <fpage>8</fpage>
          -
          <lpage>11</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>Katifori A.</given-names>
            ,
            <surname>Halatsis</surname>
          </string-name>
          <string-name>
            <surname>C.</surname>
          </string-name>
          (
          <year>2007</year>
          ),
          <source>Ontology Visualization Methods - A Survey. ACM Computing Surveys</source>
          ,
          <volume>39</volume>
          ,
          <fpage>4</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Kolli</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Doshi</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2008</year>
          ),
          <article-title>OPTIMA: Tool for Ontology Alignment with Noy N</article-title>
          . F.,
          <string-name>
            <surname>Tudorache</surname>
            <given-names>T.</given-names>
          </string-name>
          , de Coronado S.,
          <string-name>
            <surname>Musen</surname>
            <given-names>M. A.</given-names>
          </string-name>
          (
          <year>2008</year>
          )
          <string-name>
            <surname>Developing Viégas F. B.</surname>
          </string-name>
          ,
          <string-name>
            <surname>Wattenberg</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>van Ham F.</given-names>
            ,
            <surname>Kriss</surname>
          </string-name>
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>McKeon</surname>
          </string-name>
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2007</year>
          ),
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>