<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Visualizing the Evolution of Ontologies: A Dynamic Graph Perspective</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Michael Burch</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Steffen Lohmann</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>VIS, University of Stuttgart</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>VISUS, University of Stuttgart</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <fpage>69</fpage>
      <lpage>76</lpage>
      <abstract>
        <p>Ontologies can be represented as graphs, since they essentially comprise a set of interconnected concepts describing a certain field of knowledge. Consequently, ontologies are often visualized as graphs, using different visual notations and common graph drawing techniques. The visualization of static graphs has been researched a lot, but when it comes to time-varying graphs, researchers face much more challenges in order to design useful, readable, and intuitive visualizations. If we have to deal with dynamic, i.e., evolving and time-dependent ontologies, we have to adapt existing visualization techniques to this challenging problem or develop new ones. In this position paper, we take a look at the visual representation of time-varying ontologies, and provide a discussion from a dynamic graph visualization perspective.</p>
      </abstract>
      <kwd-group>
        <kwd>time-varying ontologies</kwd>
        <kwd>graph-based ontology visualization</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Visualization can be a powerful tool in the exploration and analysis of ontologies.
Advanced visual designs are demanded to effectively and efficiently manage,
browse, and navigate ontologies, and to finally gain insights and conclusions. The
growing number and size of ontologies, on the other hand, require sophisticated
visualization techniques that are capable to handle algorithmic, perceptual, and
visual scalability problems. Consequently, developers of ontology visualizations
need to enhance their visual designs by developing faster and better layouts, by
providing more visual features, and by improving existing approaches based on
user studies and other evaluation methods.</p>
      <p>
        Although various techniques for ontology visualization have flourished over
the past years [
        <xref ref-type="bibr" rid="ref10 ref26 ref28 ref31">10,26,28,31</xref>
        ], we are still facing the challenging problem of
visually handling time-varying ontologies, i.e., ontologies that change over time.
Ontologies are often not static but have an inherent dynamic behavior, making
them an evolving data structure that is worth researching.
      </p>
      <p>
        Since time-varying ontologies can be regarded as some kind of dynamic graph,
we discuss the applicability of existing visualization techniques for dynamic
graphs surveyed by Beck et al. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], while we basically distinguish between
timeto-time mappings (animations) and time-to-space mappings (static displays).
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        Numerous approaches for ontology visualization have been presented in the last
couple of years [
        <xref ref-type="bibr" rid="ref10 ref26 ref28 ref31">10,26,28,31</xref>
        ]. Most of them represent ontologies as graphs, while
the graphs are typically rendered as node-link diagrams in a force-directed,
hierarchical, or radial layout [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ].
      </p>
      <p>
        Examples for force-directed graph visualizations of ontologies are provided by
TGViz [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], NavigOWL [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ], and VOWL [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ]. Hierarchical graph layouts depicting
the inheritance tree of ontologies are used in OWLViz [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] and OntoTrack [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ],
among others. There are also approaches that represent the inheritance tree with
treemaps [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ], nested circles [
        <xref ref-type="bibr" rid="ref40">40</xref>
        ], or other visualization techniques for
hierarchical tree structures, such as hyperbolic trees [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>
        Fu et al. [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] conducted a user study where they compared graph
visualizations of ontologies with indented tree representations. They found that the
graph visualizations are perceived as “more controllable and intuitive without
visual redundancy, especially for ontologies with multiple inheritance”. They are
considered “more suitable for overviews” and “held [the] attention” of the study
participants better than trees [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>
        Some approaches combine different techniques to visualize ontologies, such as
node-link diagrams and adjacency matrices [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], or provide various graph layouts
that the users can choose from depending on their task [
        <xref ref-type="bibr" rid="ref13 ref22">13,22</xref>
        ]. Others apply
techniques such as hierarchical edge bundling [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] to increase the readability
of the graph visualization, while yet others propose 3D graph visualizations for
ontologies [
        <xref ref-type="bibr" rid="ref15 ref7">7,15</xref>
        ].
      </p>
      <p>
        Furthermore, there are diagrammatic approaches that use UML [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] or
similar graph-based notations [
        <xref ref-type="bibr" rid="ref12 ref38">12,38</xref>
        ] to visualize ontologies. For instance, COE [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]
adopts the popular idea of Concept Maps [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ] and applies it to the
visualization of OWL ontologies, while a similar attempt has been made with Concept
Diagrams [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] that particularly consider the logic of OWL.
      </p>
      <p>
        However, the visualization of time-varying ontologies has not received any
attention in all these approaches. Although the evolution of ontologies has been
subject to research [
        <xref ref-type="bibr" rid="ref20 ref33 ref36">20,33,36</xref>
        ], we are not aware of any approach that visualizes
evolving ontologies over time. There are methods to compute and analyze
differences between two or more versions of an ontology [
        <xref ref-type="bibr" rid="ref16 ref17 ref34">16,17,34</xref>
        ], and tools that
display such differences using rudimentary visual properties [
        <xref ref-type="bibr" rid="ref17 ref27 ref35">17,27,35</xref>
        ]. However,
we do not know of any sophisticated visualization that supports the detailed
analysis of ontologies at different points in time and assists users in the
detection of dynamic patterns and trends in time-varying ontologies.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Visualization of Time-Varying Ontologies</title>
      <p>Visualizing time-varying data is challenging due to the fact that users need to
obtain an overview of a longer subsequence of individual time steps. This
aspect must also be considered for dynamic, i.e., evolving ontologies. Usually, the
users have to solve comparison tasks in order to reliably derive trends and
countertrends or to find outliers and anomalies. In general, two paradigms for
timeoriented visualizations are distinguished: 1) time-to-time mappings (animated
diagrams), and 2) time-to-space mappings (static displays, often enhanced by
interaction techniques). In the following, we discuss these two alternatives and
address some of their benefits and drawbacks.
3.1</p>
      <sec id="sec-3-1">
        <title>Representation of Vertices and Edges</title>
        <p>If ontologies are visualized as graphs in the form of node-link diagrams, the
vertices and edges can have various visual appearances. The vertices usually carry
different semantic information as well as additional attributes. If the attributes
are of a rather categorical nature, color coding and shape can be used as
visual features to support the viewer to efficiently distinguish vertices of different
types. Quantities may be visually indicated by varying the sizes of the graphical
primitives (circles, triangles, rectangles and the like, see Figure 1a).</p>
        <p>
          Using too many visual features at once, however, can make it troublesome to
visually analyze the ontology for certain aspects. This can be seen as a
conjunction search that does not allow for preattentive processing [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], i.e., elements
have to be explicitly searched, which is more time-consuming. Consequently, our
suggestion is to use as little visual features as possible—less is more in this case.
        </p>
        <p>Thing</p>
        <p>Item
(external)
dateTime
taggingIcre... SubclassIof
(functional)
taggedIres...
(functional)
taggedIwith
hasIaccess Tagging
grantIaccess
creatorIof
ha(fusnIcctrioenaatl)or SubclassIof
taggingImod...</p>
        <p>dateTime
UserAccount
(external)
hasItag
tagIof
(functional)
(c)
PrivateITagging</p>
        <p>AutomaticITag</p>
        <p>Edges can be directed, weighted, attributed, and they can occur multiple
times between the same pair of vertices, turning the ontology representation into
a multigraph. Directions are typically indicated by arrowheads, color gradients,
or with tapered representation styles. Weights can be expressed by color coding
or by using differently thick link representations, which produce additional visual
clutter on the negative side. Figure 1b illustrates several link representations for
directed edges (namely, arrows, partial, tapered, animated, orthogonal, colored,
curved, and dark-to-light links).</p>
        <p>
          Figure 1c shows a node-link representation of the small MUTO ontology [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ],
using the VOWL notation [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ]. Classes are represented by circles and property
labels by rectangles. Datatypes are also depicted as rectangles but with a border
and in a different color. Dashed and dotted lines indicate special types of classes
and properties. The visual graph elements are not weighted in this example.
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Topology, Structure, and Hierarchy</title>
        <p>The topology of the graph representation is important, since it conveys useful
information on the structure of subgraphs, clusters, or cliques. This aspect is
also crucial in ontology visualization, as it can provide useful insights into the
ontology structure.</p>
        <p>
          In graph visualization (which is mainly applying node-link visual metaphors),
layout algorithms are typically following aesthetic graph drawing criteria that
produce diagrams with reduced visual clutter, which is “the state in which excess
items, or their representation or organization, lead to a degradation of
performance at some task” [
          <xref ref-type="bibr" rid="ref37">37</xref>
          ]. In the example of Figure 1c, a force-directed algorithm
has been used to generate the initial layout, which was then manually optimized.
        </p>
        <p>In many graph datasets, a hierarchical organization among the vertices is of
special interest. Either it is inherently present in the data or it can be generated,
for example, by a hierarchical clustering algorithm. Ontologies often contain
concept hierarchies that have to be visualized in order to visually explore the
ontology on different levels of hierarchical granularity or to use the hierarchy as
a means to interact, filter, aggregate, and navigate in the ontology.</p>
        <p>
          In Figure 1c, there are only two relatively flat hierarchies, each consisting of
three classes, which can be easily spotted due to the small number of well
arranged vertices. For ontologies with large inheritance trees, other graph layouts,
or even tree visualizations, might be more appropriate to clearly depict the
different hierarchy levels. However, since ontologies allow for multiple inheritance,
simple tree visualizations can be confusing [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. Also, most approaches have their
limitations when it comes to the visualization of very large ontologies, at least
when a node-link representation of the graph is used.
3.3
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>Visual Encoding of Time</title>
        <p>The representation of time-varying ontologies demands for sophisticated
visualization techniques that consider all the aforementioned features in order to
sufficiently support the visual exploration of ontologies for dynamic patterns.
Consequently, vertices, edges, the topology and structure, as well as any existing
hierarchical organization among the vertices are of special interest.</p>
        <p>
          One major type of tasks that users typically want to answer when inspecting
time-varying data are comparison tasks. Several time steps are visually compared
to derive insights by detecting changes or stabilities over time. To answer such
tasks, the human visual system has to rely on its short term memory allowing
to briefly remember visual patterns which are then compared at different spatial
positions. Only by this internal cognitive process we are able to come up with
the detection of trends, countertrends, or anomaly patterns over time [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
        </p>
        <p>
          If animated diagrams were used for the exploration of dynamic ontologies,
we soon reach a point where the cognitive load becomes high. The human viewer
may have difficulties to visually analyze the time-varying ontology for dynamic
patterns. Advanced and time-complex layout algorithms have to be used to
guarantee a high degree of dynamic stability [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ], with the goal to preserve a viewer’s
mental map while inspecting the graph [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. However, in the end, the detection of
trends can be challenging anyway, even if the animation is replayed several times.
Moreover, interaction techniques cannot be integrated in a traditional way, since
the graphical elements are moving around in the worst case, which demands to
stop the animation to meaningfully interact with the dynamic ontology.
        </p>
        <p>
          Another option for displaying dynamic ontologies is by means of static
diagrams [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] that map the time dimension to display space, which are known as
time-to-space mappings. Such diagrams can, for example, use a vertex-aligned
representation that allows to attach a hierarchical organization in a static way.
Other than in ontology animation, the users can decide where to look at in the
display in order to search for static or dynamic visual patterns. They can perform
comparison tasks visually, not mentally as in animated diagrams that demand
for higher cognitive efforts and are usually performing worse for time-oriented
tasks.
        </p>
        <p>
          To illustrate this second approach, we created different versions of the MUTO
ontology [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ] that was already shown in Figure 1c. We visualized these ontology
versions with VOWL [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ] in small display regions next to each other, which is
known as a small multiples visualization [
          <xref ref-type="bibr" rid="ref39">39</xref>
          ]. If the vertices are roughly aligned
and the visual features are not encoded differently over time (apart from
changing variables), this approach leads to a good means to derive time-dependent
patterns.
        </p>
        <p>In Figure 2, we see the VOWL representations of six of the MUTO versions,
starting with version 0.1 in the upper left and ending with version 1.0 in the
lower right. We can observe how the ontology has changed over time. At first,
the key concepts and links are defined, which are gradually extended by further
concepts and links. At some point, alignments to existing ontologies are added,
followed by the definition of datatype properties describing attributes for the
key concepts. Finally, subclasses are introduced providing specializations of the
key concepts.
3.4</p>
      </sec>
      <sec id="sec-3-4">
        <title>Interaction Techniques</title>
        <p>It must be noted that small multiples visualizations usually serve as an overview
representation for the time dimension. If users detect a dynamic pattern of
interest, they can apply interaction techniques to zoom and filter, and finally get
details on demand also for individual ontology versions. The individual ontology</p>
        <sec id="sec-3-4-1">
          <title>Visualizing the Evolution of</title>
        </sec>
        <sec id="sec-3-4-2">
          <title>Ontolo gies: A</title>
        </sec>
        <sec id="sec-3-4-3">
          <title>Dynamic</title>
        </sec>
        <sec id="sec-3-4-4">
          <title>Graph Perspective</title>
          <p>Thing
versions might b e represented with existing ontology visualization techniques,
as describ ed in Section 2 and applied in Figure 2.</p>
          <p>However, interacting with visual representations of time-varying data can b e
challenging, in particular, when the visualization is animated, i.e., when the
single snapshots are changing over time. Users have to stop the animation when
they like to interact with the visualization, otherwise a detected pattern might
have already b een disapp eared until the users realize, for example, that they
would like to select it for a more detailed exploration. Consequently,
time-tospace mappings usually provide b etter means to visualize time-varying
ontologies from the p ersp ective of applying interaction techniques, since the ontology
sequence is shown in a static fashion. Different ontology versions can b e
individually explored and visually connected by linking and brushing, even if this form
of graphical representation usually do es not scale to very long time sequences.
4</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion and</title>
    </sec>
    <sec id="sec-5">
      <title>Future</title>
    </sec>
    <sec id="sec-6">
      <title>Work</title>
      <p>In this p osition pap er, we discussed the challenge of visualizing time-varying
ontologies. We describ ed b enefits and drawbacks of common visualization
techniques for dynamic graphs, since ontologies can b e considered as a sp ecial typ e
of graphs with additional attributes attached to the vertices and edges.</p>
      <p>The visualization of ontologies has mainly b een researched from the p ersp
ective of static graphs so far, which is – at least in our opinion – only half of
the truth. Ontologies – as many other data structures – are typically not staying
static but evolve over time. Consequently, the visualization of ontology evolution
is a topic of its own and worth discussing.</p>
      <p>For future work, we plan to apply dynamic graph visualization techniques
to time-varying ontologies. Typically, we first need an overview representation
which shows dynamic patterns in a static view, allowing the user to effectively
and efficiently dig deep er and analyze the time-varying ontology.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>H.</given-names>
            <surname>Alani. TGVizTab</surname>
          </string-name>
          :
          <article-title>An ontology visualisation extension for Prot´eg´e</article-title>
          .
          <source>In 2nd Workshop on Visualizing Information in Knowledge Engineering</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>D.</given-names>
            <surname>Archambault</surname>
          </string-name>
          and
          <string-name>
            <given-names>H. C.</given-names>
            <surname>Purchase</surname>
          </string-name>
          .
          <article-title>The mental map and memorability in dynamic graphs</article-title>
          .
          <source>In IEEE Pacific Visualization Symposium</source>
          , pages
          <fpage>89</fpage>
          -
          <lpage>96</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>D.</given-names>
            <surname>Archambault</surname>
          </string-name>
          and
          <string-name>
            <given-names>H. C.</given-names>
            <surname>Purchase</surname>
          </string-name>
          .
          <article-title>The “map” in the mental map: Experimental results in dynamic graph drawing</article-title>
          .
          <source>International Journal on Human-Computer Studies</source>
          ,
          <volume>71</volume>
          (
          <issue>11</issue>
          ):
          <fpage>1044</fpage>
          -
          <lpage>1055</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>B.</given-names>
            <surname>Bach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Pietriga</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Liccardi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G.</given-names>
            <surname>Legostaev. OntoTrix</surname>
          </string-name>
          :
          <article-title>A hybrid visualization for populated ontologies</article-title>
          .
          <source>In 20th International Conference on World Wide Web, Companion Volume</source>
          , pages
          <fpage>177</fpage>
          -
          <lpage>180</lpage>
          . ACM,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5. J. Ba¯rzdin¸ˇs,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>B¯arzdin¸ˇs, K</article-title>
          . Cˇera¯ns, R. Liepin¸ˇs,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Sprog</surname>
          </string-name>
          <article-title>`is. OWLGrEd: A UML style graphical notation and editor for OWL 2</article-title>
          . In International Workshop on OWL:
          <article-title>Experiences and Directions, CEUR-WS</article-title>
          , vol.
          <volume>614</volume>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>F.</given-names>
            <surname>Beck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Burch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Diehl</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Weiskopf</surname>
          </string-name>
          .
          <article-title>The state of the art in visualizing dynamic graphs</article-title>
          .
          <source>In EuroVis - STARs</source>
          , pages
          <fpage>83</fpage>
          -
          <lpage>103</lpage>
          . EA,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>A.</given-names>
            <surname>Bosca</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Bonino</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Pellegrino</surname>
          </string-name>
          . OntoSphere:
          <article-title>More than a 3D ontology visualization tool</article-title>
          .
          <source>In 2nd Italian Semantic Web Workshop</source>
          , CEUR-WS, vol.
          <volume>166</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>M.</given-names>
            <surname>Burch</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Weiskopf</surname>
          </string-name>
          .
          <article-title>Visualizing dynamic quantitative data in hierarchies - TimeEdgeTrees: Attaching dynamic weights to tree edges</article-title>
          .
          <source>In International Conference on Information Visualization Theory and Applications</source>
          , pages
          <fpage>177</fpage>
          -
          <lpage>186</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>S.</given-names>
            <surname>Diehl</surname>
          </string-name>
          and
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Go¨rg. Graphs, they are changing</article-title>
          .
          <source>In International Symposium on Graph Drawing</source>
          , pages
          <fpage>23</fpage>
          -
          <lpage>30</lpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. M. Duda´ˇs,
          <string-name>
            <given-names>O.</given-names>
            <surname>Zamazal</surname>
          </string-name>
          , and
          <string-name>
            <given-names>V.</given-names>
            <surname>Sva</surname>
          </string-name>
          <article-title>´tek. Roadmapping and navigating in the ontology visualization landscape</article-title>
          .
          <source>In 19th International Conference on Knowledge Engineering and Knowledge Management</source>
          , pages
          <fpage>137</fpage>
          -
          <lpage>152</lpage>
          . Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>P.</given-names>
            <surname>Eklund</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Roberts</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Green</surname>
          </string-name>
          .
          <article-title>OntoRama: Browsing RDF ontologies using a hyperbolic-style browser</article-title>
          .
          <source>In 1st International Symposium on Cyber Worlds</source>
          , pages
          <fpage>405</fpage>
          -
          <lpage>411</lpage>
          . IEEE,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>R.</given-names>
            <surname>Falco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gangemi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Peroni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Shotton</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Vitali</surname>
          </string-name>
          .
          <article-title>Modelling OWL ontologies with graffoo</article-title>
          .
          <source>In ESWC 2014 Satellite Events</source>
          , pages
          <fpage>320</fpage>
          -
          <lpage>325</lpage>
          . Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. S. Falconer. OntoGraf. http://protegewiki.stanford.edu/wiki/OntoGraf,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>B.</given-names>
            <surname>Fu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.-A.</given-names>
            <surname>Storey</surname>
          </string-name>
          .
          <article-title>Indented tree or graph? A usability study of ontology visualization techniques in the context of class mapping evaluation</article-title>
          .
          <source>In 12th International Semantic Web Conference</source>
          , pages
          <fpage>117</fpage>
          -
          <lpage>134</lpage>
          . Springer,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <given-names>S. S.</given-names>
            <surname>Guo</surname>
          </string-name>
          and
          <string-name>
            <given-names>C. W.</given-names>
            <surname>Chan</surname>
          </string-name>
          .
          <article-title>A tool for ontology visualization in 3D graphics: Onto3DViz</article-title>
          .
          <source>In 23rd Canadian Conference on Electrical and Computer Engineering</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          . IEEE,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>M. Hartung</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <article-title>Gro´ı, and</article-title>
          <string-name>
            <given-names>E.</given-names>
            <surname>Rahm.</surname>
          </string-name>
          COnto-Diff:
          <article-title>Generation of complex evolution mappings for life science ontologies</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          ,
          <volume>46</volume>
          (
          <issue>1</issue>
          ):
          <fpage>15</fpage>
          -
          <lpage>32</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>M. Hartung</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Kirsten</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Groß</surname>
            , and
            <given-names>E. Rahm.</given-names>
          </string-name>
          <article-title>OnEX: Exploring changes in life science ontologies</article-title>
          .
          <source>BMC Bioinformatics</source>
          ,
          <volume>10</volume>
          (
          <issue>250</issue>
          ),
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18. P. Hayes,
          <string-name>
            <given-names>T. C.</given-names>
            <surname>Eskridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Saavedra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Reichherzer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mehrotra</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Bobrovnikoff</surname>
          </string-name>
          .
          <article-title>Collaborative knowledge capture in ontologies</article-title>
          .
          <source>In International Conference on Knowledge Capture</source>
          , pages
          <fpage>99</fpage>
          -
          <lpage>106</lpage>
          . ACM,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>C.</given-names>
            <surname>Healey</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Enns</surname>
          </string-name>
          .
          <article-title>Attention and visual memory in visualization and computer graphics</article-title>
          .
          <source>IEEE Transactions on Visualization and Computer Graphics</source>
          ,
          <volume>18</volume>
          (
          <issue>7</issue>
          ):
          <fpage>1170</fpage>
          -
          <lpage>1188</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <given-names>J.</given-names>
            <surname>Heflin</surname>
          </string-name>
          and
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Hendler</surname>
          </string-name>
          .
          <article-title>Dynamic ontologies on the web</article-title>
          .
          <source>In 17th National Conference on Artificial Intelligence and 12th Conference on Innovative Applications of Artificial Intelligence</source>
          , pages
          <fpage>443</fpage>
          -
          <lpage>449</lpage>
          . AAAI,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <given-names>D.</given-names>
            <surname>Holten</surname>
          </string-name>
          .
          <article-title>Hierarchical edge bundles: Visualization of adjacency relations in hierarchical data</article-title>
          .
          <source>IEEE Transactions on Visualization and Computer Graphics</source>
          ,
          <volume>12</volume>
          (
          <issue>5</issue>
          ):
          <fpage>741</fpage>
          -
          <lpage>748</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22. W. Hop, S. de Ridder,
          <string-name>
            <given-names>F.</given-names>
            <surname>Frasincar</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Hogenboom</surname>
          </string-name>
          .
          <article-title>Using hierarchical edge bundles to visualize complex ontologies in GLOW</article-title>
          .
          <source>In 27th Annual ACM Symposium on Applied Computing</source>
          , pages
          <fpage>304</fpage>
          -
          <lpage>311</lpage>
          . ACM,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          . OWLViz. http://protegewiki.stanford.edu/wiki/OWLViz,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>J. Howse</surname>
            , G. Stapleton,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Taylor</surname>
            , and
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Chapman</surname>
          </string-name>
          .
          <article-title>Visualizing ontologies: A case study</article-title>
          .
          <source>In 10th International Semantic Web Conference</source>
          , pages
          <fpage>257</fpage>
          -
          <lpage>272</lpage>
          . Springer,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <given-names>A.</given-names>
            <surname>Hussain</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Latif</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rextin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hayat</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Alam</surname>
          </string-name>
          .
          <article-title>Scalable visualization of semantic nets using power-law graphs</article-title>
          .
          <source>Applied Mathematics &amp; Information Sciences</source>
          ,
          <volume>8</volume>
          (
          <issue>1</issue>
          ):
          <fpage>355</fpage>
          -
          <lpage>367</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <given-names>A.</given-names>
            <surname>Katifori</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Halatsis</surname>
          </string-name>
          , G. Lepouras,
          <string-name>
            <given-names>C.</given-names>
            <surname>Vassilakis</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E.</given-names>
            <surname>Giannopoulou</surname>
          </string-name>
          .
          <article-title>Ontology visualization methods - a survey</article-title>
          .
          <source>ACM Computer Surveys</source>
          ,
          <volume>39</volume>
          (
          <issue>4</issue>
          ),
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>M. C.</surname>
          </string-name>
          <article-title>A</article-title>
          .
          <string-name>
            <surname>Klein</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Fensel</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Kiryakov</surname>
            , and
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Ognyanov</surname>
          </string-name>
          .
          <article-title>Ontology versioning and change detection on the web</article-title>
          .
          <source>In 13th International Conference on Knowledge Engineering and Knowledge Management</source>
          , pages
          <fpage>197</fpage>
          -
          <lpage>212</lpage>
          . Springer,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>M. Lanzenberger</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Sampson</surname>
            , and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Rester</surname>
          </string-name>
          .
          <article-title>Visualization in ontology tools</article-title>
          .
          <source>In International Conference on Complex, Intelligent and Software Intensive Systems</source>
          , pages
          <fpage>705</fpage>
          -
          <lpage>711</lpage>
          . IEEE,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <given-names>T.</given-names>
            <surname>Liebig</surname>
          </string-name>
          and
          <string-name>
            <surname>O. Noppens.</surname>
          </string-name>
          <article-title>OntoTrack: A semantic approach for ontology authoring</article-title>
          .
          <source>Web Semantics</source>
          ,
          <volume>3</volume>
          (
          <issue>2</issue>
          -3):
          <fpage>116</fpage>
          -
          <lpage>131</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30. S. Lohmann, P. D´ıaz,
          <string-name>
            <surname>and I. Aedo. MUTO:</surname>
          </string-name>
          <article-title>The modular unified tagging ontology</article-title>
          .
          <source>In 7th International Conference on Semantic Systems (I-SEMANTICS '11)</source>
          , pages
          <fpage>95</fpage>
          -
          <lpage>104</lpage>
          . ACM,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <given-names>S.</given-names>
            <surname>Lohmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Negru</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Haag</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Ertl</surname>
          </string-name>
          .
          <article-title>Visualizing ontologies with VOWL</article-title>
          .
          <source>Semantic Web Journal</source>
          , to appear.
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>J. D. Novak</surname>
            and
            <given-names>A. J.</given-names>
          </string-name>
          <string-name>
            <surname>Can</surname>
          </string-name>
          <article-title>˜as. The theory underlying concept maps and how to construct them</article-title>
          .
          <source>Technical Report IHMC CmapTools</source>
          <year>2006</year>
          -
          <volume>01</volume>
          , Florida Institute for Human and
          <source>Machine Cognition</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Klein</surname>
          </string-name>
          .
          <article-title>Ontology evolution: Not the same as schema evolution</article-title>
          .
          <source>Knowledge and Information Systems</source>
          ,
          <volume>6</volume>
          (
          <issue>4</issue>
          ):
          <fpage>428</fpage>
          -
          <lpage>440</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          and
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Musen. PromptDiff</surname>
          </string-name>
          :
          <article-title>A fixed-point algorithm for comparing ontology versions</article-title>
          .
          <source>In 18th National Conference on Artificial Intelligence</source>
          , pages
          <fpage>744</fpage>
          -
          <lpage>750</lpage>
          . AAAI,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <given-names>D.</given-names>
            <surname>Perrin</surname>
          </string-name>
          .
          <article-title>PROMPT-Viz: ontology version comparison visualizations with treemaps</article-title>
          .
          <source>Master thesis</source>
          , University of Victoria,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <given-names>P.</given-names>
            <surname>Plessers</surname>
          </string-name>
          ,
          <string-name>
            <surname>O. De Troyer</surname>
            , and
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Casteleyn</surname>
          </string-name>
          .
          <article-title>Understanding ontology evolution: A change detection approach</article-title>
          .
          <source>Web Semantics</source>
          ,
          <volume>5</volume>
          (
          <issue>1</issue>
          ):
          <fpage>39</fpage>
          -
          <lpage>49</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <given-names>R.</given-names>
            <surname>Rosenholtz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Mansfield</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Jin</surname>
          </string-name>
          .
          <article-title>Feature congestion: A measure of display clutter</article-title>
          .
          <source>In Conference on Human Factors in Computing Systems</source>
          , pages
          <fpage>761</fpage>
          -
          <lpage>770</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38.
          <string-name>
            <given-names>M.</given-names>
            <surname>Sintek</surname>
          </string-name>
          . OntoViz. http://protegewiki.stanford.edu/wiki/OntoViz,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          39.
          <string-name>
            <given-names>E. R.</given-names>
            <surname>Tufte</surname>
          </string-name>
          .
          <article-title>The visual display of quantitative information</article-title>
          . Graphics Press,
          <year>1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          40.
          <string-name>
            <surname>T. D. Wang</surname>
            and
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Parsia</surname>
          </string-name>
          . CropCircles:
          <article-title>Topology sensitive visualization of OWL class hierarchies</article-title>
          .
          <source>In 5th International Semantic Web Conference</source>
          , pages
          <fpage>695</fpage>
          -
          <lpage>708</lpage>
          . Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>