<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Improving the experience of ontology design, management and enquiry with concept diagrams</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Jim Burton University of Brighton</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2000</year>
      </pub-date>
      <fpage>509</fpage>
      <lpage>518</lpage>
      <abstract>
        <p>-Ontology engineers use a variety of software tools to design, manage and interrogate their ontologies. These tools often include visualisation features which provide a graphical depiction of parts of the ontology. In this paper we describe a new tool, ConceptViz, which uses a novel notation called concept diagrams, based on Euler diagrams. Although work is at an early stage, ConceptViz is highly expressive, allowing information to be expressed in a single diagram that would normally need to be gathered from several parts of an ontology management tool. To further motivate the use of concept diagrams we highlight their balance of iconic and symbolic notation and show how symbolic features can be used to reduce clutter in diagrams.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The secondary topic of this work is the problem of
devising effective formal visual languages. In order to justify its
existence, we believe that each such language should benefit
the user by exploiting the particular cognitive properties of
predominately iconic (as opposed to symbolic) languages.
A solution to this problem has been the explicit goal of
researchers in visual reasoning since the time of Peirce. A
number of logicians and computer scientists have addressed the
same problem since, such as Shin and Hammer [
        <xref ref-type="bibr" rid="ref5">6</xref>
        ], Gurr [
        <xref ref-type="bibr" rid="ref12">13</xref>
        ]
and Shimojima [
        <xref ref-type="bibr" rid="ref17">18</xref>
        ]. Meanwhile, the same problem has been
examined in depth by the cognitive science (e.g., [
        <xref ref-type="bibr" rid="ref7">8</xref>
        ]) and
semiotic [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] communities. These studies have normally been
carried out in a more ethnographic way (i.e. by studying found
notations rather than devising new ones), and have not tended
to focus on the domain of visual logic. This, and the fact that
few cognitive scientists are also logicians and vice versa, has
meant that the findings of each community are not always
well-known or exploited enough outside of that community.
Our analysis of the strengths and weaknesses of approaches to
ontology visualisation, including our own, represents a attempt
at reconciling these different bodies of knowledge.
      </p>
      <p>II.</p>
    </sec>
    <sec id="sec-2">
      <title>ONTOLOGIES AND VISUALISATION</title>
      <p>
        An ontology represents knowledge as a set of concepts
(sets, classes) within a particular domain, along with
individuals inhabiting the concepts and roles (relations) between
concepts and/or individuals. Thus, an ontology is a “formal,
explicit specification of a shared conceptualisation” [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. We
can also think of an ontology simply as a collection of axioms,
or as a taxonomy plus some roles. The taxonomy distinguishes
the is-a relation as central to understanding the structure of the
ontology.
Ontologies have found many and diverse applications,
some of the most well known being medicine and the semantic
web. Figure 2 shows an informal visualisation of the semantic
web ontology produced by the W3 standards organisation.
      </p>
      <p>Fig. 1. The ConceptViz plugin</p>
      <p>OWL semantics are based on description logics (DLs),
decidable fragments of FOL with efficient SAT solvers. These
have been incorporated into ontology management tools,
allowing users to reason about their ontology.</p>
      <p>There are a diverse range of tasks involved in the creation,
use and maintenance of ontologies. These include design,
debugging, comprehension/discovery (bottom-up and top-down),
maintenance, query and reasoning. However, although
visualisation tools have long been recognised as an essential part of
ontology workflows, most visualisations focus almost entirely
on comprehension.</p>
      <p>
        Shneiderman [20] identified a number of high-level tasks a
visualisation should support: overview, zoom, filter, details on
demand (e.g. right click a concept to see properties, roles etc),
and so on. There are a wide variety of ontology visualisations
available, many described in a useful survey by Katifori [
        <xref ref-type="bibr" rid="ref10">11</xref>
        ],
and ontology visualisation continues to be an active area,
testifying to their importance to ontology users. Katifori categorises
the visualisations according to their approach to information
visualisation and user interaction. The most basic category is
the indented list of the taxonomic structure, as seen in Prote´ge´.
This can be useful in getting a feel for the overall structure of
an ontology but has several drawbacks. For instance, no roles
or properties are shown, parts of the structure may be hidden,
and it is not clear how multiple inheritance (concepts which
appear in several parts of the taxonomy) should be handled.
      </p>
      <p>The next most common representations are tree-based, such
as OntoGraf, which is a Prote´ge´ plugin. OntoGraf provides
a powerful and intuitive visualisation of the hierarchy, but
one which makes poor use of space and can quickly become
cluttered. OntoGraf can be used to visualise concepts, roles and
individuals, making it more expressive than most other
visualisations. It offers the user a great deal of flexibility about which
parts of the ontology are displayed and which are hidden. This
flexibility comes at a cost, however, since it makes it easy
to create diagrams which may be misleading. OntoGraf users
can reduce clutter in their diagrams by choosing not to show
certain relations: in figure 3 the is-a relation between Country
and Thing is not shown, which may surprise or confuse novice
users. In contrast, diagrams in ConceptViz are produced using
an unambiguous visual logic (concept diagrams). Thus, the
inferences a user may draw from a diagram are always valid,
provided that they draw these inferences correctly.</p>
      <p>
        One of the most important developments since Katifori’s
survey is the idea of key concepts [
        <xref ref-type="bibr" rid="ref15">16</xref>
        ]. Heuristics are applied
to identify the concepts which are key to understanding an
ontology. These include the number of sub-concepts, density
of role-based information and coverage, so that sparse sections
of the ontology are not ignored. Key concepts are used in
KCViz [
        <xref ref-type="bibr" rid="ref13">14</xref>
        ], a plugin for the Swoon editor that uses key concepts
to orient the user and convey a “gestalt” impression of the
whole ontology. A recent tool that uses the key concepts idea in
a more general setting is TriView [
        <xref ref-type="bibr" rid="ref8">9</xref>
        ]. Key concepts, which they
call landmarks, are shown in an overview window. A second,
larger window shows the local taxonomic sub-tree in detail,
while a third shows roles and other axioms. The position of
the local sub-tree, relative to the whole ontology, is indicated
in the overview window. In this way, the user is helped to
understand the overall structure of the ontology at the same
time as focusing on a small area of it.
      </p>
      <p>While all visualisations have strengths and weaknesses and
are more suitable for some tasks than others, it seems fair to
say that they all leave something to be desired. Key problems
identified by Katifori include clutter and other scalability
issues. There are also crucial features we may want which
go beyond visualisation. Reasoning is not supported to any
significant degree by any of the tools (e.g. OWLViz can
indicate inconsistent concepts but that is about as far as it
goes).</p>
      <p>Also, editing is not supported: several tools allow the user
to add a new concept, but then resort to forms etc to specify the
details. Finally, existing tools focus on taxonomy: support for
individuals is unusual, and support for roles and other
axiombased information more so.</p>
    </sec>
    <sec id="sec-3">
      <title>III. THE AFFORDANCES OF CONCEPT DIAGRAMS</title>
      <p>In the previous section we described some existing
approaches to ontology visualisation and identified important
gaps in functionality. ConceptViz is our work-in-progress
ontology visualisation based on concept diagrams. In this section
we aim to motivate the use of concept diagrams (CDs) as the
basis of an alternative visualisation.</p>
      <p>Our first observation is that CDs are more expressive than
most existing visualisations. CDs are expressive enough to
represent entire ontologies diagrammatically. Figure 4 shows
a concept diagram with syntactic features that we intend
to incorporate into ConceptViz. These features allow the
representation of individuals (using solid dots), roles (using
arrows) and quantification (using extra-diagrammatic symbolic
expressions).</p>
      <p>The second observation is that, alone among the
visualisations we have considered, CDs are formal and come
equipped with a framework for developing proofs and carrying
out reasoning. This property enables a visualisation based on
CDs to cover all stages of the ontology workflow described
in the previous section, providing the potential for purely
diagrammatic ontology management. This expressiveness and
inferential capability doesn’t imply, however, that CDs are fit
for purpose. For that to be true, they must also be “easy” to
understand relative to other approaches, for some measure of
ease.</p>
      <p>The question of the usability, or relative ease of
comprehension, of a visualisation based on CDs can only be definitively
answered by empirical studies. As well as “road testing” the
usability of CDs, we can also attempt to show that their use
is justified from a theoretical perspective. This requires an
analysis of the affordances of CDs – the possible meanings
of some piece of notation, and the ways in which an actor
perceives and constructs that meaning. The starting point for
.
.</p>
      <p>
        Fig. 4. A concept diagram
this analysis is the work of C.S. Peirce, who founded the
field of semiotics. Peirce categorised the modes by which we
construct the meaning of signs as iconic, symbolic and
indexical [
        <xref ref-type="bibr" rid="ref14">15</xref>
        ]. Icons depict by resemblance, symbols by convention,
and indices by “pointing” to their meaning. An important point
to retain is that no sign is purely iconic, symbolic or indexical
– each sign makes use of these modes to various degrees,
and each mode relies on inferences gained using other modes.
For Peirce, each mode is best suited to a different type of
information: symbols are best suited to represent general rules,
icons should be used to represent a particular hypothesis or
“state of affairs”, and indices are best used to represent the
existence of an entity.
      </p>
      <p>Although he stressed the interdependence of the modes,
Peirce privileged the iconic mode as the most “natural” and in
designing his systems of existential graphs, Peirce’s aim was
to create a system which was as iconic as possible. Iconicity
is related to Gurr’s notion of well-matchedness [5]. The Euler
basis of CDs is well-matched to meaning, in that the syntax
corresponds in a natural way to the semantics (e.g. topological
separation means disjointness). Individuals are well-matched
(relatively iconic) too. Placing a dot in a region asserts the
existence of an individual in the concept modelled by that
region and outside the others. Two separate dots assert the
existence of two separate individuals.</p>
      <p>
        Hammer and Shin [
        <xref ref-type="bibr" rid="ref5">6</xref>
        ] noted that the many of the additions
made to Euler’s original notation over the years do not always
provoke the same natural associations in the reader. Shading,
for instance, first introduced by Venn, bears no resemblance
to the emptiness of a set and has a purely conventional
meaning (apart from a slightly tenuous connection between
shading, darkness and the emptiness of a void). Elsewhere Shin
argues [
        <xref ref-type="bibr" rid="ref18">19</xref>
        ] that resemblance is not, in fact, inversely
proportional to conventionality. Two cognitive properties of diagrams
which are inversely proportionate to each other, however, are
conventionality and the use of perceptual inferences. That is,
the less a notation relies on convention, the more perceptual
inferences are introduced. This seems convincing but it also
seems likely that conventional symbols can be internalised,
giving us indexical or immediate access to their meaning.
      </p>
      <p>
        We can think of the number of perceptual inferences
required by a given notation to convey a particular statement
as its relative efficiency [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. This efficiency is determined by
the choices made by the designers of the notation; consider the
observation made by Blackwell and Green, that “every notation
highlights some kinds of information, at the cost of obscuring
other kinds” [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. For an analysis of the implications of these
choices made by a comparison between spider diagrams and
existential graphs, see Burton &amp; Coppin’s paper in Euler
Diagrams 2012 [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Furthermore, Shin points out that several of the conditions
we might want to represent are incapable of depiction without
convention, particularly disjunctive information and certain
types of negative information. Thus, although advocates of
Euler-based notations have typically argued for their
effectiveness by an appeal to their well-matched features, an expressive
notation needs to make use of non-iconic features. In order
to understand the real nature of well-matchedness we need to
focus on the correspondence between topological and semantic
structure rather than any idea of physical resemblance. In
recent work, Legg [
        <xref ref-type="bibr" rid="ref11">12</xref>
        ] makes the point that by doing so, we
can see that the use of inference rules in any (visual) logic is
iconic, since the application of the rule is defined via syntactic
changes to the diagram which correspond to structural changes
on the semantic level.
      </p>
      <p>
        To expand on Peirce’s dictum that symbolic notation
should be used to represent “general rules”, symbolic features
have the capacity for a very compact expression, freed of
the responsibility to depict structural correspondence. The
designers of CDs add several symbolic features, neither of
which adds to expressiveness, but which can both be used to
reduce clutter in diagrams: dashed arrows and nested bounding
boxes (also called nested universes). As well as inheriting the
benefits of Euler diagrams, CDs inherit some limitations: an
Euler diagram can quickly become cluttered [
        <xref ref-type="bibr" rid="ref9">10</xref>
        ]. In addition,
we’ve seen that clutter is identified as a key usability problem
in ontology visualisation. We explain the issues of clutter
reduction in the following examples. The examples relate to
communicative goals held by the diagram creators, in which
the creators want to draw attention to a particular piece of
information.
      </p>
      <p>Each arrow in a concept diagram has a source, a target and
a label. The arrow tells us that when the domain of the role
represented by the label is restricted to the concept represented
by the source, then the image of that role is the concept
represented by the target. Informally, 5 tells us that members of
the concept A are related to members of the unlabelled concept
under f . The semantics of the arrow assert that elements of A
are not related to anything else under f .</p>
      <p>Assume that the creators of figure 5 want to focus on
the presence of B in the target of the arrow. One way of
drawing attention to B is to remove other concepts from the
diagram, resulting in figure 6. This is a limited solution; the
creators cannot now reintroduce C or D to the diagram without
reintroducing clutter and losing the focus on B in the target
of the arrow.</p>
      <p>In contrast to arrows drawn with a solid line, dashed arrows
provide partial information. The dashed arrow in figure 7 tells
us that elements of A are related to at least elements of B
under f . The diagram creators could reintroduce C and D
to figure 7 without needing to change the target of the arrow.
Howse et al.[ISWC TUTORIAL] show several larger examples
in which the “savings” (in terms of clutter reduction) are
amplified further still.</p>
      <p>In our next example we consider nested bounding boxes.
The bounding box of each concept diagram represents the
concept Thing or, in set-theoretic terms, the universe of
discourse. Diagrams may include several bounding boxes, each of
which represents Thing. Suppose that we want to add a fourth
concept, D, to figure 8, so that D is disjoint from B. Also,
D is the source of an arrow which has C as its target. This
arrow is the main focus of what the diagram creator wants to
convey.</p>
      <p>.</p>
      <p>.
.</p>
      <p>.
.</p>
      <p>.
.</p>
      <p>The result of adding D to figure 8 in this way is shown
in figure 9. We can see that the resulting diagram is rather
cluttered. The diagram creators goal of highlighting the
information provided by the arrow depends partly on the way we
lay out the diagram, but is hard to achieve.</p>
      <p>When a concept diagram includes several bounding boxes,
the spatial relations between elements in separate boxes has
no meaning. Thus, nested universes allow us to add D without
specifying its disjointness or otherwise from A, B and C. This
results in the diagram in figure 10, which is less cluttered than
figure 9, making the communicative goal of focusing on the
arrow easier to achieve.</p>
      <p>Dashed arrows and nested bounding boxes can reduce
clutter because they allow us to convey partial information
in an unambiguous way. As stated above, OntoGraf users
can reduce clutter by choosing not to show some relations
in the diagram, but this may lead to results that are difficult
to understand out of their original context.</p>
      <p>IV.</p>
    </sec>
    <sec id="sec-4">
      <title>CONCLUSIONS AND FURTHER WORK</title>
      <p>We have seen that concept diagrams contain both iconic
and symbolic features and noted that, historically, the main
claim for the usability of Euler-based notations has been
the iconic nature of the underlying Euler circles. However,
symbolic features have great expressive potential and we have
shown examples of symbolic syntax in concept diagrams
that allows the compact representation of ontologies. Given
that clutter is recognised as a common problem in ontology
visualisation and that a medium-sized ontology may contain
thousands of concepts, we see this as a strong point of
concept diagrams. Although the current version of ConceptViz
contains only Euler diagrams, it provides an adequate basis for
implementing more of the concept diagram notation.</p>
      <p>We conclude by providing a few details of the
implementation of ConceptViz and the goals for its future development.
The plugin uses the Inductive Circles (iCircles) library by
Jean Flower. iCircles uses ideas and algorithms developed by
Stapleton, Flower, Rodgers and Howse (2012) [CITE] to draw
Euler diagrams using circles. To ensure that the diagram can
be drawn, it relaxes a topological property, normally desirable,
which states that labels should be unique.</p>
      <p>There is a growing number of ontology visualisation tools
in existence, but none that support the entire ontology
management workflow. A major goal for the plugin is to incorporate
editing functionality, enabling ConceptViz to go beyond
visualisation to ontology design and maintenance. Users will be able
to generate and alter ontologies diagrammatically, observing
the changes in other parts of the Prote´ge´ interface, and vice
versa. This will result in “round-trip” diagrammatic ontology
engineering. The interface for the tool will make a number of
ontology design patterns available (such as applying a domain
restriction to a role), giving users a toolkit for assembling
ontologies from frequently used components.</p>
      <p>One of the interesting problems is to ensure predictability
when drawing the same or similar diagrams – when we reveal
sub-concepts in one part of the diagram, we want the rest of the
diagram to be as unchanged as possible. Unpredictability may
cause serious usability problems (Herman, 1998) [CITE]. The
layouts of diagrams produced by iCircles are currently rather
unpredictable, since layout choices are based on heuristics.
Work is underway to abstract these choices into reusable layout
policies.
[20] B. Shneiderman. The eyes have it: A task by data type taxonomy for
information visualizations. In Proceedings of the IEEE Symposium on
Visual Languages, VL’96, page 336. IEEE, 1996.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Jacques</given-names>
            <surname>Bertin</surname>
          </string-name>
          .
          <source>Semiology of Graphics: Diagrams</source>
          , Networks, Maps. University of Wisconsin Press.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Alan</given-names>
            <surname>Blackwell</surname>
          </string-name>
          and
          <string-name>
            <given-names>Thomas R.</given-names>
            <surname>Green</surname>
          </string-name>
          .
          <article-title>Notational systems - the cognitive dimensions of notations framework</article-title>
          . In John M. Carroll, editor,
          <source>HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science</source>
          , Interactive Technologies, chapter
          <volume>5</volume>
          , pages
          <fpage>103</fpage>
          <lpage>+</lpage>
          . Morgan Kaufmann, San Francisco, CA, USA,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J.</given-names>
            <surname>Burton</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Coppin</surname>
          </string-name>
          .
          <article-title>Understanding and predicting the affordances of visual logics</article-title>
          . In submitted to 3rd
          <source>International Workshop on Euler Diagrams</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Thomas</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Gruber</surname>
          </string-name>
          .
          <article-title>A translation approach to portable ontology specifications</article-title>
          .
          <source>KNOWLEDGE ACQUISITION</source>
          ,
          <volume>5</volume>
          :
          <fpage>199</fpage>
          -
          <lpage>220</lpage>
          ,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>E.</given-names>
            <surname>Hammer</surname>
          </string-name>
          and
          <string-name>
            <given-names>S. J.</given-names>
            <surname>Shin</surname>
          </string-name>
          .
          <article-title>Euler's visual logic</article-title>
          .
          <source>History and Philosophy of Logic</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>29</lpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>John</given-names>
            <surname>Howse</surname>
          </string-name>
          , Gem Stapleton, Kerry Taylor, and
          <string-name>
            <given-names>Peter</given-names>
            <surname>Chapman</surname>
          </string-name>
          .
          <article-title>Visualizing ontologies: A case study</article-title>
          .
          <source>In Lora Aroyo</source>
          , Chris Welty, Harith Alani, Jamie Taylor, Abraham Bernstein, Lalana Kagal, Natasha Noy, and Eva Blomqvist, editors,
          <source>The Semantic Web ISWC</source>
          <year>2011</year>
          , volume
          <volume>7031</volume>
          of Lecture Notes in Computer Science, pages
          <fpage>257</fpage>
          -
          <lpage>272</lpage>
          . Springer Berlin Heidelberg,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [8]
          <string-name>
            <surname>James</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Hurford</surname>
          </string-name>
          .
          <article-title>The neural basis of Predicate-Argument structure</article-title>
          .
          <source>Behavioral and Brain Sciences</source>
          ,
          <volume>23</volume>
          (
          <issue>6</issue>
          ),
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Zong</surname>
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Jiao</surname>
          </string-name>
          , Qiang Liu,
          <string-name>
            <surname>Yuan-Fang</surname>
            <given-names>Li</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Kim</given-names>
            <surname>Marriott</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Michael</given-names>
            <surname>Wybrow</surname>
          </string-name>
          .
          <article-title>Visualization of large ontologies with landmarks</article-title>
          .
          <source>In Sabine Coquillart</source>
          , Carlos Andu´jar, Robert S. Laramee, Andreas Kerren, and Jose´ Braz, editors,
          <source>GRAPP/IVAPP</source>
          , pages
          <fpage>461</fpage>
          -
          <lpage>470</lpage>
          . SciTePress,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [10]
          <string-name>
            <surname>C. John. Measuring</surname>
          </string-name>
          <article-title>and reducing clutter in euler diagrams</article-title>
          .
          <source>In Proceedings of the First International Workshop on Euler Diagrams, Euler</source>
          <year>2004</year>
          , volume
          <volume>134</volume>
          <source>of ENTCS</source>
          , pages
          <fpage>103</fpage>
          -
          <lpage>126</lpage>
          . Elsevier,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Akrivi</surname>
            <given-names>Katifori</given-names>
          </string-name>
          , Constantin Halatsis, George Lepouras, Costas Vassilakis, and
          <string-name>
            <given-names>Eugenia</given-names>
            <surname>Giannopoulou</surname>
          </string-name>
          .
          <article-title>Ontology visualization methods a survey</article-title>
          .
          <source>ACM Comput. Surv.</source>
          ,
          <volume>39</volume>
          (
          <issue>4</issue>
          ):
          <fpage>10</fpage>
          +,
          <year>November 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>Catherine</given-names>
            <surname>Legg</surname>
          </string-name>
          .
          <article-title>What is a logical diagram? In Amirouche Moktefi</article-title>
          and
          <string-name>
            <surname>Sun-Joo</surname>
            <given-names>Shin</given-names>
          </string-name>
          , editors,
          <source>Visual Reasoning with Diagrams</source>
          ,
          <source>Studies in Universal Logic</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          . Springer Basel,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [13]
          <string-name>
            <surname>D. L. Moody.</surname>
          </string-name>
          <article-title>The ”physics” of notations: Toward a scientific basis for constructing visual notations in software engineering</article-title>
          .
          <source>Software Engineering</source>
          , IEEE Transactions on,
          <volume>35</volume>
          (
          <issue>6</issue>
          ):
          <fpage>756</fpage>
          -
          <lpage>779</lpage>
          ,
          <year>November 2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Enrico</surname>
            <given-names>Motta</given-names>
          </string-name>
          , Silvio Peroni, Jose´Manuel Go´
          <article-title>mez-Pe´rez, Mathieu d'Aquin, and</article-title>
          <string-name>
            <given-names>Ning</given-names>
            <surname>Li</surname>
          </string-name>
          .
          <article-title>Visualizing and navigating ontologies with KCviz</article-title>
          . In Mari C.
          <article-title>Sua´rez-</article-title>
          <string-name>
            <surname>Figueroa</surname>
          </string-name>
          ,
          <article-title>Asuncio´n Go´mez-Pe´rez, Enrico Motta</article-title>
          , and Aldo Gangemi, editors,
          <source>Ontology Engineering in a Networked World</source>
          , pages
          <fpage>343</fpage>
          -
          <lpage>362</lpage>
          . Springer Berlin Heidelberg,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>C. S.</given-names>
            <surname>Peirce</surname>
          </string-name>
          .
          <source>Collected Papers</source>
          , volume
          <volume>4</volume>
          . Harvard University Press,
          <year>1933</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>S.</given-names>
            <surname>Peroni</surname>
          </string-name>
          , E. Motta, and
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>d'Aquin. Identifying key concepts in an ontology, through the integration of cognitive principles with statistical and topological measures</article-title>
          .
          <source>In The Semantic Web</source>
          , pages
          <fpage>242</fpage>
          -
          <lpage>256</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [17]
          <article-title>The Pro`te`ge Team. The Pro`te`ge website</article-title>
          . urlhttp://protege.stanford.edu/,
          <year>September 2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>A.</given-names>
            <surname>Shimojima</surname>
          </string-name>
          .
          <article-title>Inferential and expressive capacities of graphical representations: Survey and some generalizations</article-title>
          .
          <source>In Proceedings of 3rd International Conference on the Theory and Application of Diagrams</source>
          , volume
          <volume>2980</volume>
          <source>of LNAI</source>
          , pages
          <fpage>18</fpage>
          -
          <lpage>21</lpage>
          , Cambridge, UK,
          <year>2004</year>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>S. J.</given-names>
            <surname>Shin</surname>
          </string-name>
          .
          <source>The Logical Status of Diagrams. CUP</source>
          ,
          <year>1994</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>