<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Using Multiple Views for Visual Exploration of Ontologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Isabel Cristina Siqueira da Silva</string-name>
          <email>isabels@inf.ufrgs.br</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Carla Maria Dal Sasso Freitas</string-name>
          <email>carla@inf.ufrgs.br</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Instituto de Informática - Universidade Federal do Rio Grande do Sul (UFRGS) Caixa Postal 15.</institution>
          <addr-line>064 - 91501-970 - Porto Alegre - RS -</addr-line>
          <country country="BR">Brasil</country>
        </aff>
      </contrib-group>
      <fpage>25</fpage>
      <lpage>36</lpage>
      <abstract>
        <p>In this paper, we present a multiple views approach for exploring relationships between ontology classes and their instances. We employ thumbnails, 2D and 2.5D hyperbolic trees, which capture the hierarchical feature of parts of the ontology, while preserving the different categories of relationships between classes. In 2.5D visualization, the ontology is displayed as a tree on a plane, representing only the hierarchical relationships between concepts, and the user can explore other connections by creating projections of nodes (concepts) in another plane and linking them according to the relationships to be analysed. We report the comparison of our tool to Ontograf and propose a visualization method for the representation of instances of ontology classes.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>ambiguous or vacuous due to lack of relevant information or by excess of irrelevant
information.</p>
      <p>
        This work presents a visualization tool for exploring classes, instances and
relationships in ontologies. In our previous works, we investigated ontology creation
and visualization
        <xref ref-type="bibr" rid="ref21 ref22">(Silva et al., 2009a, 2009b)</xref>
        ; performed requirements analyses and
proposed a visualization tool based on interviews with experts who work with
conceptual modeling and ontologies in two specific domains
        <xref ref-type="bibr" rid="ref23 ref24">(Silva and Freitas, 2011a)</xref>
        ;
and proposed a multiple views ontology visualization tool that aims at systematizing
and transmitting knowledge more efficiently
        <xref ref-type="bibr" rid="ref23 ref24 ref3">(Silva and Freitas, 2011b)</xref>
        . In this paper we
also report the comparison of our tool with Ontograf, which is also used for modeling
and visualization of ontologies. The text is organized as follows. Section 2 briefly
reviews related work. Section 3 summarizes our previous work and presents our new
proposal. Finally, conclusions and future work are drawn in Section 4.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Related Works</title>
      <p>
        Different alternatives for visualization and interaction with ontologies have been
proposed
        <xref ref-type="bibr" rid="ref13">(Katifori et al., 2007)</xref>
        . In their work, Katifori el al. discuss different techniques
that could be adapted for ontology representation, such as indented lists, trees and
graphs, zooming, space subdivision (treemaps, information slices), focus+context and
landscapes. Besides that, tools for ontology visualization and interaction are reviewed.
      </p>
      <p>
        The OntoSphere tool
        <xref ref-type="bibr" rid="ref6">(Bosca et al., 2005)</xref>
        uses two techniques - 3D visualization
and focus+context – for providing overview and details according to user needs.
        <xref ref-type="bibr" rid="ref4">Baehrecke et al. (2004)</xref>
        and
        <xref ref-type="bibr" rid="ref2">Babaria (2004)</xref>
        proposed the use of treemaps to visualize
data from GO (Gene Ontologies Consortium) database. In a treemap, color, size and
grouping are used for facilitating user interaction and information extraction.
        <xref ref-type="bibr" rid="ref10">Fluit et al.
(2005)</xref>
        present the cluster map technique as a simple and intuitive method for
visualizing complex ontologies.
      </p>
      <p>
        Mostly, researchers use Protégé
        <xref ref-type="bibr" rid="ref18">(Noy et al., 2000)</xref>
        for the creation and
visualization of ontologies. Protégé’s main visualization for the ontology hierarchy is a
tree view (Class Browser). However, different visualization techniques have been
proposed:
        <xref ref-type="bibr" rid="ref14">Katifori et al. (2008)</xref>
        present a comparative study of four visualization
techniques available in past versions of Protégé: Class Browser, Jambalaya
(discontinued), TGVizTab (discontinued) and OntoViz (discontinued). The information
retrieval features provided by these tools were evaluated.
      </p>
      <p>
        The works by
        <xref ref-type="bibr" rid="ref19">Samper et al. (2008)</xref>
        and
        <xref ref-type="bibr" rid="ref1">Amaral (2008)</xref>
        address semantics
aspects.
        <xref ref-type="bibr" rid="ref1">Amaral (2008)</xref>
        proposes a semantics-based framework for visualizing
descriptions of concepts in OWL. The framework aims at allowing users to obtain deep
insights about the meaning of such descriptions, thereby preventing design errors or
misconceptions. Icons and symbols are used in diagrams to characterize classes that
represent concepts. One can combine information visualization techniques, as in the
work by
        <xref ref-type="bibr" rid="ref20">Schevers et al. (2006)</xref>
        , where the user interacts with the ontology in the Protégé
tool. Classes representing spatial information (like polygons, points, etc.) are presented
in a second graphical interface that is used to mimic the functionality of a GIS
(Geographic Information System).
      </p>
      <p>
        Erdmann et al. (2008) presents the NeOn Toolkit, an open-source multi-platform
environment, which provides comprehensive support for the ontology engineering
lifecycle. The toolkit is based on the Eclipse platform, and provides an extensive set of
plug-ins (currently 45 plug-ins are available) covering a variety of ontology engineering
activities.
        <xref ref-type="bibr" rid="ref7">Catenazzi et al. (2009)</xref>
        present a study about tools for ontologies visualization
and propose the OWLeasyViz tool. This tool combines textual and graphical
representations for displaying class hierarchies, relationships and data properties.
Interaction techniques such as zooming, filtering and search are available.
        <xref ref-type="bibr" rid="ref16">Lanzenberger
et al. (2010)</xref>
        discuss the visualization of ontology alignment as well as solutions for
dealing with the inherent complexity of large ontologies. The presented techniques are
also compared.
      </p>
      <p>
        Recently,
        <xref ref-type="bibr" rid="ref15">Kriglstein and Wallner (2011)</xref>
        presented Knoocks, a visualization tool
focused on the interconnections between the ontology, its concepts and instances. This
tool employs the overview + details approach, and was evaluated against another tools,
although three of these tools are not available anymore in Protégé last versions
(TGVizTab, OntoViz and Jambalaya). Also recently,
        <xref ref-type="bibr" rid="ref3">Bach et al. (2011)</xref>
        proposed
OntoTrix, a visualization technique designed to enable users to visualize large OWL
ontology instance sets. The technique uses both node-link and adjacency matrix
representations of graphs to visualize ontology data.
3.
      </p>
    </sec>
    <sec id="sec-3">
      <title>Multiple Views Tool</title>
      <p>
        A multiple view system uses two or more distinct views to support the investigation of a
single conceptual entity
        <xref ref-type="bibr" rid="ref5">(Baldonado et al., 2000)</xref>
        . Multiple views can help users
understand complex relationships among different data sets. They are particularly
helpful when coupling two or more views showing otherwise hidden relations.
      </p>
      <p>As presented in section 2, many studies have addressed the importance of
ontology visualization in creation, manipulation and inference processes. Different
visualization methods have been proposed, but there are still many gaps to be filled in
by efficient methods of visualization and interaction. The solution for these problems
may be the simultaneous use of different techniques. In order to pursue an effective
visualization tool, our study was divided in three steps:


</p>
      <p>
        Interviews with four experts in creation and manipulation of ontologies to
identify the requirements for an ontology visualization tool
        <xref ref-type="bibr" rid="ref23 ref24">(Silva and
Freitas, 2011a)</xref>
        ;
Proposition and evaluation of a 2D and 2.5D hyperbolic tree visualization for
exploring relationships between classes of ontologies
        <xref ref-type="bibr" rid="ref23 ref24 ref3">(Silva and Freitas,
2011b)</xref>
        ;
Proposition of a multiple views approach combining thumbnails and tree
view visualization for exploring instances of classes in ontologies.
      </p>
      <p>These three steps are described in details in the following sections.
3.1.</p>
      <sec id="sec-3-1">
        <title>Requirements Investigation</title>
        <p>The study started with interviews with four people, all experts in the creation and
manipulation of ontologies. The following questions were posed to the experts:
1. Which aspects could be improved with visualization when an ontology is
created?
2. Which information is searched more often after the ontology was created,
and how this information could be displayed in order to make understanding
more efficient?
3. Why (and when) is a visualization better than another?</p>
        <p>From the results of the interviews, we reached the following requirements for an
ontology visualization tool:





</p>
        <p>Provide overview of the ontology hierarchy, with the possibility of detailing
some parts.</p>
        <p>Avoid presenting the different aspects of a specific ontology (classes,
description, relationships, instances) together in a unique visualization.
Optimize the results from ontology validation generated by inference
processes.</p>
        <p>Explore the use of visual attributes such as color, transparency and shapes.
Provide display filters based on different techniques of focus+context and/or
overview+detail, zoom, pan and rotation of the image.</p>
        <p>Allow rapid and simple inclusion of visual elements in the visualization, as
well as their removal.</p>
        <p>These requirements were considered the starting point to propose our tool
described below. There was also a last requirement – “Allow printing the entire
ontology in paper sizes commonly used, such as A4”, which was considered less
important for the visualization design.
3.2.</p>
      </sec>
      <sec id="sec-3-2">
        <title>2D and 2.5D Tree Visualization and Evaluation: Hierarchy and</title>
      </sec>
      <sec id="sec-3-3">
        <title>Relationships</title>
        <p>
          We propose a visualization method that fits the requirements pointed out by users as
well as the tasks listed by
          <xref ref-type="bibr" rid="ref13">Katifori et al. (2007)</xref>
          . In this step, we have chosen to focus on
visualizing the hierarchy of the ontology and the relationships between concepts
employing multiple views. For the hierarchy, we employ a 2D hyperbolic tree, a
focus+context technique, which reduces the cognitive overload and the user
disorientation that might happen during the interaction with the nodes, tree expansion
and contraction, especially in ontologies with many concepts (Figure 1a).
        </p>
        <p>However, besides the class hierarchy (relationship "is a"), users of ontologies
need to analyze the other relationships in an integrated way. Thus, we use a second view
to display a third dimension showing one or more relationships (object properties)
selected by the user. To display them, we take the plane where the tree is displayed, and
perform a 90° rotation around the X-axis (Figure 1b). The rotated plane, positioned in
3D as an XZ-plane, displays the hyperbolic tree, and selected relationships are
represented as curved lines in space, connecting the related concepts, without interfering
with the display of the hierarchical relationship.</p>
        <p>Figure 1c shows the proposed 2.5D scheme applied to an ontology
hierarchy/graph.
The main aspects of our technique regarding visualization and interaction are:</p>
        <p>Nodes are displayed with different geometric forms according to their type
(root, subtree and leaf).</p>
        <p>Edges of hierarchy are displayed with solid lines and edges of relationships
are displayed with dashed curves, the colors being related to the different
relationships.</p>
        <p>In 2D hyperbolic tree view, the user can choose which nodes will be in focus
on the image, hiding the other ones.</p>
        <p>Both 2D and 2.5D views can be displayed together, side by side, so the user
remains "aware" of the ontology hierarchy and visualizes one or more
relationships in a separate spatial dimension.</p>
        <p>The user can choose to display one or more relationships at the same time or
hide them.</p>
        <p>In 3D space, the user can choose which levels of the tree view or hide,
reducing the cognitive overload.</p>
        <p>In addition to rotations around the X-axis, rotations around the axes Y and Z,
zoom and pan are also allowed, providing full 3D navigation.</p>
        <p>The background color can be changed.</p>
        <p>Tooltips are displayed over nodes and edges as additional information.</p>
        <p>Such usability features aimed at reducing the cognitive effort of the user in
analyzing the image and, at the same time, add functionality to the tool.</p>
        <p>
          In order to evaluate our 2.5D visualization method, we have chosen to compare
it with Ontograf
          <xref ref-type="bibr" rid="ref9">(Falconer, 2010)</xref>
          , a 2D tool for visualizing hierarchy and relationships
of ontologies, which is available in the current version (4.1) of Protégé.
        </p>
        <p>Ontograf presents seven visualization possibilities: alphabetical grid, radial and
spring graphs, and four implementations of tree visualization: vertical, horizontal,
directed vertical and directed horizontal. Figures 2a and 2b show two Ontograf
visualization examples.</p>
        <p>(a)
(b)</p>
        <p>The four experts interviewed in the first phase of our study (as described in
Section 3.1) were invited again to perform evaluations of our 2.5D visualization and
Ontograf. Moreover, we invited two other experts in ontology specification to
participate, so we had a sample of 6 people.</p>
        <p>For the evaluations we used two ontologies as case study: a large ontology
related to Stratigraphy concepts, and a smaller one, representing cities’ urban
performance. Before the participants started with the tasks, we shortly introduced them
to the important functionalities of the tools, and they explored them in many ways using
a training ontology. After the participants had finished their training, we started the
evaluation process.</p>
        <p>The tools were presented in different order for the participants. For each tool,
they were asked to perform an analysis based on four questions that were defined in
order to obtain the requirements listed in Section 3. The questions are listed below:
1. Is the initial layout clear?
2. Is it possible to clearly separate the concepts’ hierarchy from the other
relationships between these concepts?
3. Does the possibility of rotating the ontology representation improve the
analysis of relationships?
4. Do the pruning and expansion of the ontology levels enhance the
understanding of hierarchical relationships?</p>
        <p>Three possibilities of answers were defined: Yes, Partially and No. Figure 3
summarizes the users’ answers for these questions.</p>
        <p>Regarding question (1), the majority of users (67%) responded that the initial
2.5D layout is clearer when compared with Ontograf. Among the reasons for that, users
pointed out the large amount of information displayed at the same time (nodes overlap)
in the image of Ontograf. This is a problem of scale versus amount of information, and
causes user disorientation. In our 2.5D method, this problem is solved due to the nature
of the hyperbolic tree.</p>
        <p>In relation to question (2), users were divided (50%) between “Partially” and
“No” answers for Ontograf, because nodes and edges overlap. Usually, users do not
want to see relationships simultaneously, due to the cognitive overload that would arise.
Thus, the possibility of analyzing the “is a” (hierarchy) and other relationships in
different dimensions helps the user to understand the ontology. Another problem
reported for Ontograf is that the user needs to change the positions of nodes in order to
reveal the relationships occluded by them.</p>
        <p>An important positive aspect noticed by users in both tools is the presence of
tooltips when the mouse is over the nodes or relationships. The use of tooltip texts can
help in the encoding of the displayed information, because they contain high loads of
information, and are presented selectively as the user explores the visualization of the
ontology.</p>
        <p>
          Users also approved different colors for different types of relationships. Colors
are mainly a resource for information categorization, and graphical elements like shapes
and location of elements in the space help the user in mapping the concepts
          <xref ref-type="bibr" rid="ref25">(Ware,
2008)</xref>
          , and these features are present in our 2.5D method.
        </p>
        <p>Regarding question (3), this functionality is not present in Ontograf, and the
users considered it an important interaction mode. In our 2.5D method, rotations around
the three axes (X, Y and Z) are possible, and complemented by zoom and pan. Thus,
users have more freedom to interact with the visualization, and are able to reset to the
original layout at any moment. One of the users reported that when interacting with
the 2.5D view, he did not feel claustrophobia, which is common in other tools,
including Ontograf.</p>
        <p>Finally, in relation to question (4), while 100% of users answered “Yes”, for the
2.5D view, for Ontograf, most users (83%) answered “Partially” and “No”. This result
is due to the feature of Ontograf related to the repositioning of nodes when it is pruned
or expanded, this fact causing disorientation on users. On the other hand, the 2.5D
allows pruning and expansion in two ways: through the hyperbolic tree functionality of
repositioning nodes, and through hiding/showing levels of the hierarchy.</p>
        <p>These results indicate that the use of 2.5D visualization might be a solution to
common problems presented by 2D and 3D ontology visualization tools, mainly
cognitive overload and user disorientation.
3.3.</p>
      </sec>
      <sec id="sec-3-4">
        <title>Thumbnails and Treeview Visualization: Instances</title>
        <p>
          Ontologies provide the explicit formalization and specification of the classes and their
corresponding relationships
          <xref ref-type="bibr" rid="ref11">(Gruber, 1996)</xref>
          . Ontologies can have associated specific
instances for the corresponding classes, which represent an essential part of any
knowledge base, and are often orders of magnitude more numerous than the concept
definitions. Thus, besides the class hierarchy and relationships, the visualization of
instances of classes in ontologies is another important aspect.
        </p>
        <p>
          The traditional way of displaying instances of classes in ontologies is through
lists of items or indented lists (Figures 4a and 4b). We do not consider these the best
modes of visualizing instances of classes because a lot of instances displayed together
can generate cognitive overload.
          <xref ref-type="bibr" rid="ref3">Bach et al. (2011)</xref>
          present OntoTrix (Figure 4c), which
employed a hybrid visualization introduced as NodeTrix
          <xref ref-type="bibr" rid="ref12">(Henry et al., 2007)</xref>
          in order to
visualize the structure of ontologies. However, NodeTrix representations are less
familiar to users than graphs and trees, making ontologies analysis more difficult and
are likely to increase user’s cognitive load.
        </p>
        <p>(a)
(b)
(c)</p>
        <p>Based on the previous interviews with experts and in solutions adopted by other
authors, we propose a visualization for showing instances of ontology classes, which
employed thumbnails and a schematic treeview, as shown in Figure 5.</p>
        <p>The classes of the ontology are exhibited as miniatures at the topmost part of the
visualization (overview area), and the whole set can be navigated using shifting buttons
as in common pictures displays. The detail area shows the selected class in treeview
representation at the center of this view. This approach helps users to understand how
the entire collection is organized, keeping both views visible for quick interaction. The
classes can also be found by a search function of a typed keyword.</p>
        <p>We adopted icons with a textual description because this representation gives a
better comprehension than icons alone or text alone. The icons are related to two main
categories of concepts of the urban ontology used in this example (agents and space)
and are based on the work of Murray et al. (1994).</p>
        <p>This schematic view is shown along two other views that show the 2D and 2.5D
hyperbolic tree visualizations (Figure 6).</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>Ontologies tend to grow, incorporating new concepts and relationships, therefore
increasing the visualization complexity. Static graphs, commonly used for ontology
representation, are not the best alternative for such visualizations. Thus, we need
efficient visualization and interaction methods tailored to ontologies. Information
visualization techniques amplify cognition and reduce the exploration time of data sets,
allowing the recognition of patterns and facilitating inferences about different concepts.</p>
      <p>In this work, we have designed a visual and interactive method for exploring
ontologies, aiming at improving the insight from such data. For this, we employed
multiple views; a common and useful system that offer advantages like improved user
performance, discovery of unforeseen relationships, and unification of the workspace.</p>
      <p>We started this study with the definition of requirements for visualization and
interaction with ontologies in order to support our design decisions for helping users to
perform different operations on ontologies more easily and efficiently.</p>
      <p>In our 2.5D visualization tool, we combine aspects of both 2D and 3D
techniques. During its development we have taken into account the aspects pointed out
by expert users. We evaluated the 2.5D visualization proposal by comparing it with the
Ontograf tool, available in the version 4.1 of Protégé.</p>
      <p>Besides the 2.5D visualization, we explore two other views: hierarchy classes
and instances of classes. For the first, we use 2D hyperbolic tree, an intuitive
focus+context technique that aims at representing very large trees. On the other hand,
instances of classes are displayed as a hybrid view, exploring thumbnails and treeview
methods. The main idea is to provide a visual representation that is intuitive and allows
efficient analysis of the ontology concepts.</p>
      <p>As future work, we intend to perform new evaluation experiments while
investigating interactive visualization techniques for displaying data related to
inferences.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgements</title>
      <p>We would like to thank the users that participated in the interviews and evaluation
processes. Part of this work is financed by CNPq.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Amaral</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <article-title>Visualizing the semantics (not the syntax) of concept descriptions</article-title>
          .
          <source>In VI Workshop em Tecnologia da Informação e da Linguagem Humana (TIL</source>
          <year>2008</year>
          ), Vila Velha,
          <string-name>
            <surname>ES</surname>
          </string-name>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Babaria</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <article-title>Using Treemaps to Visualize Gene Ontologies</article-title>
          . Human Computer Interaction Lab and Institute for Systems Research, University of Maryland, College Park, MD USA,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Bach</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pietriga</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liccardi</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          <article-title>OntoTrix: A Hybrid Visualization for Populated Ontologies</article-title>
          .
          <source>In: 20th Internacional Word Wide Web Conference. Hyderabad, India</source>
          .
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Baehrecke</surname>
            ,
            <given-names>E. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dang</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Babaria</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Shneiderman</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <article-title>Visualization and analysis of microarray and gene ontology data with treemaps</article-title>
          .
          <source>BMC Bioinformatics</source>
          .
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Baldonado</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Woodruff</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Kuchinsky</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <article-title>Guidelines for Using Multiple Views</article-title>
          .
          <source>In Information Visualization. Advanced Visual Interfaces</source>
          ,
          <string-name>
            <surname>AVI</surname>
          </string-name>
          ,
          <year>2000</year>
          . p.
          <fpage>110</fpage>
          -
          <lpage>119</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Bosca</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bomino</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pellegrino</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <article-title>OntoSphere: more than a 3D ontology visualization tool</article-title>
          .
          <source>In Proceedings of SWAP, the 2nd Italian Semantic Web Workshop</source>
          , Trento, Italy, December
          <volume>14</volume>
          -16, CEUR,
          <source>Workshop Proceedings, ISSN 1613-0073</source>
          , Vol-
          <volume>166</volume>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Catenazzi</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sommaruga</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mazza</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>User-friendly ontology editing and visualization tools: the OWLeasyViz approach</article-title>
          .
          <source>In: Proceedings of the 13th IEEE International Conference on Information Visualisation. Barcellona, Spain</source>
          .
          <fpage>14</fpage>
          -
          <issue>17</issue>
          <year>July 2009</year>
          . pp.
          <fpage>283</fpage>
          -
          <lpage>288</lpage>
          . IEEE.
          <source>ISBN: 978-0-7695-3733-7.</source>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Erdmann</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peter</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holger</surname>
            ,
            <given-names>L</given-names>
          </string-name>
          , Studer,
          <string-name>
            <surname>R.</surname>
          </string-name>
          <article-title>NeOn - Ontology Enggenering and Plugin Development with the NeOn Toolkit</article-title>
          . Url: http://www.neontoolkit.org/images/tutorials/tutorial%20eswc08.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Falconer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <article-title>OntoGraf</article-title>
          . URL: http://protegewiki.stanford.edu/wiki/OntoGraf. Last access in
          <year>2010</year>
          october.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Fluit</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sabou</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harmelen</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <article-title>Ontology-based Information Visualisation: Towards Semantic Web Applications</article-title>
          .
          <source>In International Symposium of Visualisation of the Semantic Web (VSW'05)</source>
          .
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Gruber</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>1996</year>
          ).
          <article-title>What is an ontology? [S.l</article-title>
          .: s.n.],
          <year>1996</year>
          . Url: http://wwwksl.stanford.edu/ kst/ what-is
          <article-title>-an-ontology</article-title>
          .html.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Henry</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fekete</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuffin</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>Nodetrix: a hybrid visualization of social networks</article-title>
          .
          <source>IEEE TVCG</source>
          ,
          <volume>13</volume>
          (
          <issue>6</issue>
          ):
          <fpage>1302</fpage>
          -
          <lpage>1309</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Katifori</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Halatsis</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Lepouras</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ; Vassilakis,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Giannopoulou</surname>
          </string-name>
          ,
          <string-name>
            <surname>E.</surname>
          </string-name>
          <article-title>Ontology visualization methods - a survey</article-title>
          .
          <source>ACM Comput. Surv</source>
          .
          <volume>39</volume>
          ,
          <issue>4</issue>
          (Nov.
          <year>2007</year>
          ),
          <fpage>10</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Katifori</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Torou</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vassilakis</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lepouras</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Halatsis</surname>
            <given-names>C</given-names>
          </string-name>
          :
          <article-title>Selected results of a comparative study of four ontology visualization methods for information retrieval tasks</article-title>
          .
          <source>In: Research Challenges in Information Science</source>
          ,
          <year>2008</year>
          RCIS 2008 Second International Conference on:
          <year>2008</year>
          ;
          <year>2008</year>
          :
          <fpage>133</fpage>
          -
          <lpage>140</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Kriglstein</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Wallner</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <article-title>Development Process and Evaluation of the Ontology Visualization Tool Knoocks - A case study</article-title>
          .
          <source>In: International Conference on Information Visualization Theory and Applications IVAPP</source>
          ,
          <year>2011</year>
          , VilamouraAlgarve.
          <source>Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications</source>
          .
          <source>Portugal: SciTePress Science and Technology Publications</source>
          ,
          <year>2011</year>
          . p.
          <fpage>187</fpage>
          -
          <lpage>197</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Lanzenberger</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sampson</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rester</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>Visualization in Ontology Tools. Ontology Visualization: Tools and Techniques for Visual Representation of Semi-Structured Meta-Data</article-title>
          .
          <source>Journal of Universal Computer Science</source>
          , vol.
          <volume>16</volume>
          , no.
          <issue>7</issue>
          (
          <issue>2010</issue>
          ),
          <fpage>1036</fpage>
          -
          <lpage>1054</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Murray</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paton</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goble</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bryce</surname>
            ,
            <given-names>J..</given-names>
          </string-name>
          <article-title>Kaleidoquery: a flow-based visual language and its evaluation</article-title>
          .
          <source>Journal of Visual Languages and Computing</source>
          ,
          <volume>11</volume>
          :
          <fpage>151</fpage>
          -
          <lpage>189</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fergerson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>The knowledge model of Protege-2000: Combining interoperability and flexibility</article-title>
          .
          <source>In Proceedings of 2nd International Conference on Knowledge Engineering</source>
          and
          <article-title>Knowledge Management (EKAW'</article-title>
          <year>2000</year>
          ), Juanles-Pins, France,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Samper</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tomás</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carrillo</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nascimento</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>Visualization of ontologies to specify semantic descriptions of services</article-title>
          .
          <source>IEEE Transactions on Knowledge and Data Engineering</source>
          .
          <volume>20</volume>
          (
          <issue>1</issue>
          ): p.
          <fpage>130</fpage>
          -
          <lpage>134</lpage>
          .
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Schevers</surname>
            ,
            <given-names>H.A.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Trinidad</surname>
            , G.; Drogemuller,
            <given-names>R.</given-names>
          </string-name>
          <article-title>M. Towards Integrated Assessments for Urban Development</article-title>
          .
          <source>Journal of Information Technology in Construction (ITcon)</source>
          , Vol.
          <volume>11</volume>
          ,
          <string-name>
            <surname>Special</surname>
          </string-name>
          <article-title>Issue Decision Support Systems for Infrastructure Management, pg</article-title>
          .
          <fpage>225</fpage>
          -
          <lpage>236</lpage>
          . Url: http://www.itcon.org/
          <year>2006</year>
          /17.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Silva</surname>
            ,
            <given-names>I. C. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Netto</surname>
            ,
            <given-names>V.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Freitas</surname>
            ,
            <given-names>C. M. D. S.</given-names>
          </string-name>
          <article-title>Novos caminhos para simulação urbana: integrando métodos</article-title>
          de visualização de Informações e modelagem de agentes e redes espaciais In: XIII Congreso
          <string-name>
            <surname>Iberoamericano de Gráfica Digital - Sigradi</surname>
          </string-name>
          , Sao Paulo - SP.
          <year>2009</year>
          (a)
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Silva</surname>
            ,
            <given-names>I. C. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Freitas</surname>
            ,
            <given-names>C. M. D. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Netto</surname>
            ,
            <given-names>V.M.</given-names>
          </string-name>
          <article-title>Ontologia para Sistemas Configuracionais Urbanos In: II Seminário em Ontologia no Brasil, (Ontobras)</article-title>
          , Rio de Janeiro.
          <year>2009</year>
          .
          <article-title>(b)</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Silva</surname>
            ,
            <given-names>I. C. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Freitas</surname>
          </string-name>
          ,
          <string-name>
            <surname>C. M. D. S</surname>
          </string-name>
          .
          <article-title>Requirements for Interactive Ontology Visualization - Using Hypertree+2.5D Visualization for Exploring Relationships between Concepts</article-title>
          .
          <source>In: International Conference on Information Visualization Theory and Applications IVAPP</source>
          ,
          <year>2011</year>
          , Vilamoura-Algarve.
          <source>Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications</source>
          .
          <source>Portugal: SciTePress Science and Technology Publications</source>
          ,
          <year>2011</year>
          . p.
          <fpage>242</fpage>
          -
          <lpage>248</lpage>
          . (a)
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Silva</surname>
            ,
            <given-names>I. C. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Freitas</surname>
            ,
            <given-names>C. M. D. S.</given-names>
          </string-name>
          <article-title>Using Visualization for Exploring Relationships between Concepts in Ontologies</article-title>
          .
          <source>In: 15th International Conference on Information Visualisation</source>
          ,
          <string-name>
            <surname>IV</surname>
          </string-name>
          <year>2011</year>
          ,
          <year>2011</year>
          , London, UK. Information Visualization: Visualization, BioMedical Visualization,
          <source>Visualization on Built and Rural Environments &amp; Geometric Modelling and Imaging</source>
          ,
          <year>2011</year>
          . p.
          <fpage>317</fpage>
          -
          <lpage>322</lpage>
          . (b)
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Ware</surname>
          </string-name>
          , Colin. Visual Thinking for Design. Morgan Kaufmann, Burlington, MA,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>