<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Graphol: Ontology Representation Through Diagrams</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Marco Console</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Domenico Lembo</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Valerio Santarelli</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Domenico Fabio Savo</string-name>
          <email>savog@dis.uniroma1.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dipartimento di Ing. Informatica, Automatica e Gestionale “Antonio Ruberti” S</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this paper we present Graphol, a novel language for the diagrammatic representation of Description Logic (DL) ontologies. Graphol is designed with the aim of offering a completely visual representation to the users (notably, no formulas need to be used in the diagrams), thus helping the understanding of people not skilled in logic. At the same time, it provides designers with simple mechanisms for ontology editing, which free them from having to write down complex textual syntax. Through Graphol we can specify SROIQ(D) ontologies, thus our language essentially captures the OWL 2 standard. In this respect, we developed a basic software tool to translate Graphol ontologies realized with the yEd graph editor into OWL 2 functional syntax specifications. We conducted some initial user evaluation tests, involving designers skilled in conceptual or ontology modeling and users without specific logic background. From these tests, we obtained promising results about the effectiveness of our language for both visualization and editing of ontologies.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Ontologies are widely recognized as the best means to share domain knowledge in a
formal way. This implies that the representation they provide has to be agreed upon by
all their users, so that ontologies can act as reference models across groups of people,
communities, institutions, and applications. The relevance of this problem is also
amplified by the increased uptake of ontologies in several contexts, such as biomedicine, life
sciences, e-commerce, cultural heritage, or enterprize applications [25]. Obviously, it is
very likely that people operating in such contexts are not experts in logic and generally
do not possess the necessary skills to interpret formulas through which ontologies are
typically expressed. This turns out to be a serious problem also (and probably mainly) in
the development of an ontology. Indeed, ontologists usually work together with domain
experts, the first providing their knowledge about ontology modeling and languages,
the latter providing their expertise on the domain of interest. During this phase,
communication between these actors is fundamental for the ontology to eventually become
a formal specification which faithfully represents the domain requirements.</p>
      <p>We also notice that, despite the recent popularity of ontologies, there is still a
serious lack of designers with the right skills for their modeling. In this respect, analysts
and experts in conceptual modeling for software and database design might be good
candidates to compensate for this lack, provided that they are trained to acquire the
needed knowhow. However, they need the right tools to approach the problem, possibly
close in spirit to those they usually adopt for conceptual modeling.</p>
      <p>
        In the past years, some efforts have been made in this direction, and graphical
syntaxes for ontologies based on the use of standard conceptual modeling languages have
been devised. In particular, UML profiles for OWL DL have been proposed in [
        <xref ref-type="bibr" rid="ref16 ref8">8,16,24</xref>
        ],
with the aim of making off-the-shelf UML tools usable for the purpose of ontology
development. These profiles have been devised for OWL 1 [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], but did not evolve
thereafter towards OWL 2 [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], and extending them to all new features of the current standard
is not straightforward. An UML-based language for graphical editing of OWL 2
ontologies is instead at the basis of the more recent OWLGrEd tool [
        <xref ref-type="bibr" rid="ref6 ref9">6,9</xref>
        ]. In OWLGrEd,
however, many complex OWL expressions are specified through formulas in
Manchester syntax [19]. This somehow affects the graphical nature of the representation,
especially for complex ontologies, where the proliferation of such formulas can compromise
intuitive understanding of the final ontology. The use of (variants of) UML for
ontology representation is also proposed in [17,18]. The first work, however, is focused on
foundational conceptual modeling languages, rather than on DL ontologies. Instead,
the tool described in [17] supports standard UML class diagrams (and also
EntityRelationship ones), where complex definitions of ontology classes and roles must be
expressed through, e.g., OWL views. Thus, it does not provide extensions of standard
conceptual modeling languages to capture OWL. Another graphical notation for OWL,
not based on UML, is that adopted by the GrOWL ontology editor [22], which
models ontologies as labeled graphs. Notably, the representation in GrOWL is completely
graphical, even though it relies on a quite large set of symbols and makes use of various
kinds of labeled edges. Also in this case the proposal is tailored to OWL 1, and it seems
that the development of the tool has been discontinued to date. We further notice that
other several formalisms for the graphical representation of knowledge have been
proposed during the years (see, e.g., [
        <xref ref-type="bibr" rid="ref1 ref10 ref14">10,14,1</xref>
        ]). Such approaches are either not tailored to
DLs or limited in their expressive power, i.e., they do not capture the OWL 2 standard,
or large fragments thereof. We finally point out that, besides the attempts to provide
languages for the graphical specification of ontologies, much attention has been dedicated
to the issue of ontology visualization and various tools for it have been proposed, such
as the popular Prote`ge` plugins OntoGraf1 and OWLViz2. The aim of such solutions is to
ease navigation of the ontology, and thus typically they allow the user to obtain various
possible views of it, according to some graphical format. Such formats are therefore not
thought also for the editing task (see [21] for a survey on this matter).
      </p>
      <p>
        In this paper we present our proposal for the graphical representation of DL
ontologies and introduce the novel Graphol language. The main characteristics of Graphol
can be summarized as follows:
– Similarly to previous UML-based approaches, it is rooted in a standard language
for conceptual modeling. Indeed the basic components of Graphol are taken from
the Entity-Relationship (ER) model. Notably, simple ontologies that correspond to
classical ER diagrams (e.g., some ontologies specified in OWL 2 QL [23]) have in
Graphol a representation that is isomorphic to the ER one;
– Similarly to OWLGrEd, it is tailored to OWL 2, and thus it overcomes the limits of
previous UML profiles for OWL 1 and of other graphical notations for ontologies
1 http://protegewiki.stanford.edu/wiki/OntoGraf
2 http://protegewiki.stanford.edu/wiki/OWLViz
that capture less expressive DLs. More precisely, Graphol subsumes SROIQ(D),
the logical underpinning of OWL 2 [
        <xref ref-type="bibr" rid="ref13">13,20</xref>
        ]. Differently from OWLGrEd, however,
it offers a completely visual representation to the users (notably, no formulas need
to be used in Graphol diagrams);
– As in GrOWL, which as said is limited to OWL 1, a Graphol ontology is a graph,
but to draw it we resort to some standard symbols for denoting roles, concepts, and
attributes (those of the ER model), and do not use labeled edges. More precisely,
graph nodes represent either predicates from the ontology alphabet or constructors
used to build complex expressions from named predicates. Then, two kinds of edges
are adopted: Input edges, used to specify arguments of constructors, and inclusion
edges, used to denote inclusion axioms between (complex) expressions.
– Graphol has a precise syntax. The structure of its graphical assertions traces that
of typical DL axioms, so that our language has a natural encoding in DL. Through
such encoding, we assign our language with a clear and formal semantics. Syntax
and semantics of Graphol are presented in Section 2.
      </p>
      <p>To support the graphical modeling of ontologies and at the same time foster the
interoperation with standard OWL reasoners and development environments, we have
devised a process that leads the designer from the drawing of a Graphol diagram, through
the use of the open source graph editor yEd3, to the production of the corresponding
OWL 2 specification. We discuss these aspects in Section 3.</p>
      <p>
        Finally, to verify the effectiveness of our language, we have conducted some user
evaluation tests, where both designers skilled in conceptual or ontology modeling and
users without specific logic background were involved. Our tests, though preliminary,
showed that Graphol has been perceived as a valuable and easy to use tool for both
ontology editing and visualization, and confirmed the importance for a visual
ontology language to be completely graphical, which is one of the distinguishing feature
of Graphol. A synthesis of our tests is given in Section 4, whereas for a complete
description of our evaluation study, we refer the reader to the full version of the present
paper [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>The Graphol language</title>
      <p>Graphol syntax. The terms that make up the alphabet of the ontology, meaning the
named concepts, roles, attributes, value-domains (i.e., predetermined datatypes), and
constants (both individuals and values) are modeled by labeled rectangles, diamonds,
circles, rounded corner rectangles, and octagons, respectively. These symbols are called
predicate nodes, and the associated labels refer to predicates in the ontology alphabet.</p>
      <p>We reserve two special labels, “Top” and “Bottom”, to represent, respectively,
the universal concept, value-domain, role, or attribute, and the empty concept,
valuedomain, role, or attribute. For instance, a rectangle labeled “Top” represents the
universal concept (&gt;C ), while a rectangle labeled “Bottom” represents the empty concept
(?C ). Similarly for roles, attributes, and value-domains.</p>
      <p>Other types of nodes, called constructor nodes, correspond to logical operators such
as intersection, union, negation (i.e., complement of), or restrictions on the domain and
3 http://www.yworks.com/en/products_yed_about.html
Restriction type
inv
chain</p>
      <p>Name
Concept node
Value-domain</p>
      <p>node
Range restriction</p>
      <p>node
Inverse node
Chain node</p>
      <p>Symbol
and
oneOf</p>
      <p>Name
Inclusion edge</p>
      <p>Name
Role node
Individual/</p>
      <p>Value node
Intersection node</p>
      <p>One-of node</p>
      <p>Symbol
Restriction type
or
not</p>
      <p>Name</p>
      <p>Attribute node
Domain restriction</p>
      <p>node</p>
      <p>Union node
Complement node</p>
      <p>Name
Input edge
Symbol</p>
      <p>Symbol
range of roles and attributes, and are used to graphically construct concept, role,
attribute, or value-domain expressions. Graphol nodes are shown in the top part of
Figure 1, where the “Restriction type” label of the domain and range restriction nodes can
be equal to: “exists”, “forall”, “(x; )”, or “( ; x)”, where x is a positive integer.</p>
      <p>In Graphol, an edge can be of two types: input edge or inclusion edge. The former
is a dashed directed diamond edge, where the diamond indicates the target end, and
is used to construct complex expressions in the ontology by linking constructor and
predicate nodes. The latter is a solid directed arrow edge, where the arrow indicates
the target end, and is used to represent an inclusion assertion between expressions. The
input edge and the inclusion edge are depicted in the bottom part of Figure 1.</p>
      <p>A Graphol expression is a weakly-connected acyclic directed graph, whose nodes
are both predicate and constructor nodes and whose edges are only input edges, that has
exactly one node with no outgoing edges. We call such node the sink of the expression.
We recall that a directed graph is called weakly-connected if replacing all of its directed
edges with undirected edges produces a connected (undirected) graph. The definition of
expressions in our language is formalized below. In such definition, when we mention
constructor nodes with input expressions we mean a (portion of a) graph where an input
edge goes from the sink of the expression to the constructor node.</p>
      <p>Definition 1. A Graphol expression is built through one of the following specifications.
1. A concept expression is a weakly-connected acyclic graph, defined as follows.
– a concept node is a concept expression, whose sink node is the concept itself;
– a domain or range restriction node, labeled “exists”, “forall”, “(x; )”, or
“( ; x)”, with one input role expression and one input concept expression, is
a concept expression, whose sink node is the domain or range restriction node;
– a domain restriction node, labeled “exists”, “forall”, “(x; )”, or “( ; x)”,
with one input attribute expression and one input value-domain expression, is
a concept expression, whose sink node is the domain restriction node;
– an intersection or union node with n 2 input concept expressions is a concept
expression, whose sink node is the intersection node or the union node;
– a complement node with one input concept expression is a concept expression,
whose sink node is the complement node;
– a one-of node with n 1 input individual nodes is a concept expression, whose
sink node is the one-of node.
2. A role expression is a weakly-connected acyclic graph, defined as follows.
– a role node is a role expression, whose sink node is the role itself;
– an intersection or union node with n 2 input role expressions is a role
expression, whose sink node is the intersection or the union node;
– an inverse node with one input role expression is a role expression, whose sink
node is the inverse node;
– a complement node with one input role expression is a role expression, whose
sink node is the complement node;
– a chain node with n 2 input role expressions, each one labeled with i such
that 1 i n and i 6= j for any two labels i and j, is a role expression, whose
sink node is the chain node.
3. An attribute expression is a weakly-connected acyclic graph, defined as follows.
– an attribute node is an attribute expression, whose sink node is the attribute
itself;
– an intersection or union node with n 2 input attribute expressions is an
attribute expression, whose sink node is the intersection or the union node;
– a complement node with one input attribute expression is an attribute
expression, whose sink node is the complement node.
4. A value-domain expression is a weakly-connected acyclic graph, defined as follows.
– a value-domain node is a value-domain expression, whose sink node is the
value-domain node itself;
– a range restriction node, labeled “exists”, with one input attribute expression
is a value-domain expression, whose sink node is the range restriction node;
– an intersection or union node with n 2 input value-domain expressions is
a value-domain expression, whose sink node is the intersection or the union
node;
– a complement node with one input value-domain expression is a value-domain
expression, whose sink node is the complement node;
– a one-of node with n 1 input value nodes is a value-domain expression,
whose sink node is the one-of node.</p>
      <p>As usual in ontology languages and DLs, intentional axioms are specified through
inclusions. In Graphol, an inclusion assertion is expressed through an inclusion edge
going from the (sink node of the) subsumed expression to the (sink node of the)
subsumer. In detail, a concept (resp., role, attribute, value-domain) inclusion assertion is
obtained by linking two sink nodes of concept (resp., role, attribute, value-domain)
expressions. Inclusion edges between expressions of different types (e.g., a concept
expression with a role expression) are not allowed. Finally, we define a Graphol ontology
as a set of Graphol assertions.</p>
      <p>
        Graphol semantics. We start with Graphol expressions and give their semantics by
providing their representation in terms of DL expressions, which in turn have a
formal semantics [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. To this aim, we define a function that takes as input a Graphol
expression EG and returns a DL expression that represents it.
      </p>
      <p>In formalizing , we denote with sink(EG) the sink node of EG, and with arg(EG)
the possibly empty set of Graphol expressions that are linked to sink(EG) by means of
input edges. Then, we define as follows:
– if sink(EG) is a concept, role, attribute, value-domain, or individual/value node
labeled S, then (EG) = S4;
– if sink(EG) is a domain restriction node labeled “exists” (resp., “forall”, “(x; )”,
“( ; x)”), and arg(EG) = f RA; CV g, then (EG) = 9 ( RA): ( CV ) (resp.,
(EG) = 8 ( RA): ( CV ), (EG) = x ( RA): ( CV ), (EG) =
y ( RA): ( CV ));
– if sink(EG) is a range restriction node labeled “exists” (resp. “forall”, “(x; )”,
“( ; x)”), and arg(EG) = f R; C g, then (EG) = 9( ( R)) : ( C ) (resp.</p>
      <p>(EG) = 8( ( R)) : ( C ), (EG) = x ( ( R)) : ( C ), (EG) =
y ( ( R)) : ( C ));
– if sink(EG) is a range restriction node labeled “exists” and arg(EG) = f Ag, then
(EG) = 9( ( A)) ;
– if sink(EG) is a complement node and arg(EG) = f g, then (EG) = : ( );
– if sink(EG) is an intersection (resp. a union or a one-of node) and arg(EG) =
Sin=1 i, then (EG) = din=1 ( i) (resp. (EG) = Fin=1 ( i), (EG) =
f ( 1); : : : ; ( n)g);
– if sink(EG) is an inverse node and arg(EG) = f Rg, then (EG) = ( ( R)) ;
– if sink(EG) is a chain node and arg(EG) = f 1R; : : : nRg, where each iR, with
1 i n, is a Graphol role expression linked to sink(EG) by an input edge
labeled i, then (EG) = ( 1R) ( 2R) ( nR).</p>
      <p>
        Similarly, in order to provide the semantics of Graphol inclusion assertions, we
define a function that takes as input one such inclusion AG and returns its DL
representation. We denote with source(AG) the Graphol expression whose sink node is the
source of the inclusion edge in AG, and with target(AG) the Graphol expression whose
sink node is the target of the inclusion edge in AG. The function is thus defined as
(AG) = (source(AG)) v (target(AG)). Given a Graphol ontology OG, we are
able to translate it into a DL ontology ODL by applying to each assertion in OG. The
semantics of OG coincides with the semantics of ODL, for which we refer to [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>In Tables 1 and 2 we provide an example of the application of the function to
Graphol expressions of “depth” 0 or 1, i.e., expressions formed only by predicate nodes
or by a constructor node taking as input only predicate nodes.</p>
      <p>It is easy to see that any DL ontology produced by the function subsumes a
SROIQ(D) ontology. Furthermore, the inverse of the functions and can be
defined analogously, thus showing that SROIQ(D) is indeed subsumed by Graphol.
4 We assume the alphabets for concepts, roles, attributes, value-domains, individuals, and values
to be pairwise disjoint, so that it is clear which kind of predicate S represents. Also, with a little
abuse of notation, if S =“Top” (resp. S =“Bottom”), we assume the returns the correct DL
universal (resp. empty) predicate, depending on whether sink(EG) is a concept, role, attribute,
or value-domain.</p>
      <sec id="sec-2-1">
        <title>Graphol syntax</title>
        <p>Expression
Atomic Concept
Domain restriction
on role
Range restriction
on role
Domain restriction
on attribute
Concept Intersection</p>
        <p>Concept Union</p>
      </sec>
      <sec id="sec-2-2">
        <title>Concept Complement</title>
      </sec>
      <sec id="sec-2-3">
        <title>Concept One-of</title>
      </sec>
      <sec id="sec-2-4">
        <title>Atomic Role</title>
      </sec>
      <sec id="sec-2-5">
        <title>Role Intersection Role Union Role Inverse Role Complement</title>
      </sec>
      <sec id="sec-2-6">
        <title>Role Chain</title>
      </sec>
      <sec id="sec-2-7">
        <title>Expression</title>
        <p>Attribute
Attribute Intersection</p>
        <p>Attribute Union
Attribute Complement</p>
        <p>Value-domain</p>
        <p>Range existential
restriction on attribute
Value-domain</p>
        <p>Intersection
Value-domain Union
Value-domain</p>
        <p>Complement</p>
      </sec>
      <sec id="sec-2-8">
        <title>Value-domain One-of</title>
      </sec>
      <sec id="sec-2-9">
        <title>DL-syntax</title>
        <p>A
9R:C 8R:C
xR:C xR:C
9R :C 8R :C
xR :C xR :C
9U:V 8U:V
xU:V xU:V</p>
        <p>C u D
C t D</p>
        <p>:C
fa; b; cg</p>
        <p>R
Q u R
Q t R</p>
        <p>R
:R</p>
        <p>Q R</p>
      </sec>
      <sec id="sec-2-10">
        <title>DL-syntax</title>
        <p>U
U1 u U2
U1 t U2
:U1</p>
        <p>V
9U
V1 u V2
V1 t V2
:V
f1; 2; 3g</p>
      </sec>
      <sec id="sec-2-11">
        <title>Graphol syntax</title>
        <p>Shortcuts. In order to aid the user in the design of a Graphol ontology, we have
defined some shortcuts that allow for a more compact representation of frequently used
expressions and assertions. Here we introduce two of them.</p>
        <p>The first shortcut is the disjoint union node, which is shaped as a black hexagon.
This special node is used to represent a union expression, and at the same time it
imposes the disjointness between its arguments. Therefore, it also represents negative
inclusion assertions involving its arguments. An example of its use is given in Figure 2.</p>
        <p>We also define a new edge, called global functionality edge. which is an input edge
with an additional vertical line on its source end. It is used to define the functionality of
a role (resp. an inverse role), by linking it to a domain (resp. range) “exists” restriction
node. Similarly for the functionality of an attribute. An example is given in Figure 3.</p>
        <p>Example. In Figure 4, we provide the Graphol specification of a portion of the Pizza
ontology. We also present below a logically equivalent representation of such ontology
given in terms of DL assertions.</p>
        <p>CheeseT opping v P izzaT opping F ood v 9calories
CheeseT opping v :M eatT opping P izza v F ood
M eatT opping v P izzaT opping P izza v :P izzaT opping
M eatT opping v :CheeseT opping CheeseyP izza v P izza
P izzaT opping v F ood M eatyP izza v P izza
P izzaT opping v :P izza M eatyP izza v :V egetarianP izza
V egetarianP izza v P izza 9hasIngredient v F ood
9hasIngredient v F ood hasT opping v hasIngredient
9hasT opping v F ood 9hasT opping v P izzaT opping
9calories v F ood 9calories v xsd : integer
V egetarianP izza :hasT opping:M eatT opping
As a must-have for Graphol, we singled out the importance of having an automated
translation tool to produce OWL 2 specifications from Graphol ones that are compatible
with this standard. We also tried to provide this new language with an easy way to
design, edit, and debug the graphical specifications. To these aims, we devised a process
for ontology designers that relies on both existing open source tools and originally
developed software components.</p>
        <p>The process starts specifying, by means of the yEd editor, a Graphol diagram,
encoded in the graphml format5. The use of a third party software provides the developers
with a large set of features, professionally devised for supporting the editing of
diagrams of all sorts. To further support editors, we packed up a yEd palette containing all
and only the symbols needed for editing a Graphol ontology. This comes in handy in
trying to overcome the lack of specificity of the editor.</p>
        <p>We then implemented a tool capable of translating a set of yEd diagrams
specifying a Graphol ontology into an equivalent OWL 2 encoding, if any. More precisely, the
tool is devised to be both a support for the editing tasks and an automatic translator
that produces an OWL 2 functional syntax specification. The latter is achieved by
parsing the yEd files and translating each portion with the corresponding OWL statement,
straightforwardly applying the rules sketched in Section 2. As for the editing aids, the
tool provides a syntactic validation of a given diagram. While parsing, if a portion of the
graph is found such that either it is non well-formed, i.e., it does not respect the Graphol
syntax, or does not correspond to any OWL 2 statement, the process terminates. If the
translation was not successful, the tool shows, by means of an external yEd viewer, one
of the nodes in the identified untranslatable portion and describes the recognized error
in a pop-up window. Both the translator tool and the yEd palette for Graphol can be
downloaded from the web site http://www.dis.uniroma1.it/˜graphol/.
4</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>User Evaluation</title>
      <p>In this section we briefly discuss the user evaluation tests we have conducted for the
Graphol language. The goal of these tests is to evaluate the effectiveness of Graphol
5 http://graphml.graphdrawing.org/index.html
for ontology comprehension and design by users with different backgrounds and
varying levels of expertise. To achieve this goal, we have conducted two separate studies,
designed around a series of model comprehension and model editing tasks which were
performed individually by the participants.</p>
      <p>– The first is a comparative study in which participants were asked to perform two
series of eight comprehension tasks on two ontologies modeled respectively in
Graphol and in a different graphical ontology language. For this study we chose
a group of ten computer science Ph.D. and Master’s students with only basic skills
in conceptual modeling, and whose experience with ontologies (if any) is limited
to working with ontologies defined by others. We refer to this group as ontology
consumers.
– The second is a non-comparative user study in which participants were asked to
answer ten questions and to perform ten editing tasks on two Graphol ontologies.
For this study we selected a group of twelve computer science Ph.D. students,
postdocs, and researchers with advanced knowledge in conceptual modeling and some
basic skills in logic (but only a small subset of them with some experience in
ontology design). We refer to this group as ontology designers.</p>
      <p>
        We point out that the number of participants to both our evaluation study is in line
with guidelines on usability testing [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>
        The language we chose for the comparative study was OWLGrEd [
        <xref ref-type="bibr" rid="ref6 ref9">6,9</xref>
        ]. OWLGrEd
was chosen because its UML-based design principles and visual representation are quite
different from Graphol, but are, at least in principle, easily accessible to users who are
familiar with UML class diagrams. We point out that this requirement was fulfilled by
all participants to this test, though at different expertise levels, and that such participants
only had limited knowledge on ontology languages (or none).
      </p>
      <p>We avoided extending the second study with comparative test between Graphol and
OWLGrEd for ontology editing purposes because this test would have been strongly
influenced by the tools used for the task, and an evaluation of these tools was outside the
scope of the experiments (in particular because OWLGrEd comes with its own editor
while Graphol currently does not). Furthermore, on a more practical note, this would
have excessively drawn out the duration of the test (as it is, it exceeded two hours). We
also did not conduct a comparative evaluation of Graphol against ontology editors such
as Prote`ge`, or simply against modeling through DL axioms, because these approaches
obviously do not offer graphical editing solutions, whereas our main aim has been to
test the evaluation of consumers and designers not necessary skilled in ontologies.</p>
      <p>In Figure 5 we provide some of the results we obtained through our tests. From
left to right, the figure shows the average results in terms of correctness (percentage of
correct answers) for the comprehension tasks in Graphol and OWLGrEd conducted by
ontology consumers, the average correctness results for the comprehension and editing
tasks in Graphol conducted by ontology designers, and the overall average times for the
Graphol comprehension and editing tasks (in minutes, where 2.5 minutes for
comprehension questions and 4 minutes for editing questions were the predetermined
benchmark values). Clearly, the very high average correctness scores and low average times
produced by the ontology designers in both tasks show an excellent comprehension
of the Graphol language by these users, and a good ability in performing the required
4
3,5
3
2,5
2
1,5
1
0,5
0
100,0%
75,0%
50,0%
25,0%
0,0%
100,0%
75,0%
50,0%
25,0%
0,0%
Ontology Consumers: Average Correctness</p>
      <p>Ontology Designers: Average Correctness
74,50%
74%
84%
75%
2,51
Graphol Comprehension OWLGrEd Comprehension</p>
      <p>Graphol Comprehension</p>
      <p>Graphol Editing</p>
      <p>Graphol Comprehension</p>
      <p>Graphol Editing
Graphol ontology modeling tasks. Furthermore, the ontology consumers, who did not
have advanced knowledge on conceptual modeling, nevertheless showed a good level of
comprehension of the Graphol language, comparable to, and in some cases better than,
the one showed for OWLGrEd, which is strongly based on a formalism which they were
familiar with. According to our results and to the feedback we obtained by users from
several open questions that were presented in a post-test questionnaire and from a brief
discussion that concluded the tests, we also observed that Graphol has been perceived
as easier than OWLGrEd for more complex expressions, which in OWLGrED require
the use of Manchester syntax formulas.
5</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>
        Besides the user evaluation tests we have described in Section 4, we could assess the
effectiveness of Graphol also through its use in some industrial projects in which we
have been recently involved (see, e.g., [
        <xref ref-type="bibr" rid="ref2 ref3">2,3</xref>
        ]). In these projects, we developed quite
large ontologies, comprising hundreds of predicates and axioms, and have been in touch
with domain experts without any background on ontologies or formal languages. This
has also been a valuable test bed for the design process we have described in
Section 3, which allowed us to automatically obtain processable OWL encodings from our
Graphol specification, which instead turned out to be crucial for communication with
domain experts.
      </p>
      <p>
        Both user evaluation tests and practical experience however have highlighted the
need of a dedicated editing tool specifically built to support the Graphol ontology
specification. The development of such tool is our main future work on Graphol. At the same
time, we are working to improve Graphol visualization. A first step on this direction has
been the use of a specific component for visualizing Graphol ontologies in Mastro
Studio [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], a tool for the management of ontology-based data access applications. In this
tool, Graphol ontologies are suitable connected to wiki-like ontology documentation,
through hyperlinks from the elements of the diagrams to wiki pages associated to such
elements. For the future, we plan to enrich such features, e.g., by enabling construction
of on the fly Graphol excerpts of the ontology, based on specific user requests.
Acknowledgments. This research has been partially supported by the EU under FP7
project Optique (grant n. FP7-318338).
17. Fillottrani, P.R., Franconi, E., Tessaris, S.: The ICOM 3.0 intelligent conceptual modelling
tool and methodology. Semantic Web J. 3(3), 293–306 (2012)
18. Guizzardi, G.: Ontological Foundations for Structural Conceptual Models. Ph.D. thesis,
University of Twente, The Netherlands (2005)
19. Horridge, M., Patel-Schneider, P.F. (eds.): OWL 2 Web Ontology Language Manchester
Syntax (Second Edition). W3C Working Group Note (11 december 2012), available at
http://www.w3.org/TR/owl2-manchester-syntax/
20. Horrocks, I., Kutz, O., Sattler, U.: The even more irresistible SROIQ. In: Proc. of the 10th
Int. Conf. on the Principles of Knowledge Representation and Reasoning (KR 2006). pp.
57–67 (2006)
21. Katifori, A., Halatsis, C., Lepouras, G., Vassilakis, C., Giannopoulou, E.G.: Ontology
visualization methods - a survey. ACM Comput. Surv. 39(4) (2007)
22. Krivov, S., Williams, R., Villa, F.: GrOWL: A tool for visualization and editing of OWL
ontologies. J. of Web Semantics 5(2), 54–57 (2007)
23. Motik, B., Cuenca Grau, B., Horrocks, I., Wu, Z., Fokoue, A., Lutz, C.: OWL 2 Web
Ontology Language profiles (second edition). W3C Recommendation, World Wide Web
Consortium (Dec 2012), available at http://www.w3.org/TR/owl2-profiles/
24. Object Management Group: Ontology definition metamodel. Tech. Rep. formal/2009-05-01,
      </p>
      <p>OMG (2009), available at http://www.omg.org/spec/ODM/1.0
25. Staab, S., Studer, R. (eds.): Handbook on Ontologies. International Handbooks on
Information Systems, Springer, 2nd edn. (2009)</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>do Amaral</surname>
            ,
            <given-names>F.N.</given-names>
          </string-name>
          :
          <article-title>Model outlines: A visual language for DL concept descriptions</article-title>
          .
          <source>Semantic Web J</source>
          .
          <volume>4</volume>
          (
          <issue>4</issue>
          ),
          <fpage>429</fpage>
          -
          <lpage>455</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Antonioli</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Castano`</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Civili</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coletta</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grossi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lembo</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lenzerini</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poggi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Savo</surname>
            ,
            <given-names>D.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Virardi</surname>
          </string-name>
          , E.:
          <article-title>Ontology-based data access: the experience at the Italian Department of Treasury</article-title>
          .
          <source>In: Proc. of the Industrial Track of the 25th Int. Conf. on Advanced Information Systems Engineering (CAiSE</source>
          <year>2013</year>
          ).
          <source>CEUR Electronic Workshop Proceedings</source>
          , http://ceur-ws.
          <source>org/</source>
          , vol.
          <volume>1017</volume>
          , pp.
          <fpage>9</fpage>
          -
          <lpage>16</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Antonioli</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Castano`</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coletta</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grossi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lembo</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lenzerini</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poggi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Virardi</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Castracane</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Ontology-based data management for the italian public debt</article-title>
          .
          <source>In: Proc. of the 8th International Conference on Formal Ontology in Information Systems (FOIS</source>
          <year>2014</year>
          )
          <article-title>(</article-title>
          <year>2014</year>
          ), to Appear
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Baader</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Calvanese</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nardi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P.F</given-names>
          </string-name>
          . (eds.):
          <source>The Description Logic Handbook: Theory, Implementation and Applications</source>
          . Cambridge University Press, 2nd edn. (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Bao</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , et al.:
          <article-title>OWL 2 Web Ontology Language document overview (second edition)</article-title>
          .
          <source>W3C Recommendation, World Wide Web Consortium (Dec</source>
          <year>2012</year>
          ), available at http://www. w3.org/TR/owl2-overview/
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Barzdins</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cerans</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liepins</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sprogis</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Advanced ontology visualization with OWLGrEd</article-title>
          .
          <source>In: Proc. of the 8th Int. Workshop on OWL: Experiences and Directions (OWLED</source>
          <year>2011</year>
          ).
          <source>CEUR Electronic Workshop Proceedings</source>
          , http://ceur-ws.
          <source>org/</source>
          , vol.
          <volume>796</volume>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Bechhofer</surname>
          </string-name>
          , S., van
          <string-name>
            <surname>Harmelen</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horrocks</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>PatelSchneider</surname>
            ,
            <given-names>P.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stein</surname>
            ,
            <given-names>L.A.</given-names>
          </string-name>
          :
          <article-title>OWL Web Ontology Language reference</article-title>
          .
          <source>W3C Recommendation, World Wide Web Consortium (Feb</source>
          <year>2004</year>
          ), available at http://www.w3.org/ TR/owl-ref/
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Brockmans</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Volz</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eberhart</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , Lo¨ffler, P.:
          <article-title>Visual modeling of OWL DL ontologies using UML</article-title>
          .
          <source>In: Proc. of the 3rd Int. Semantic Web Conf. (ISWC</source>
          <year>2004</year>
          ). pp.
          <fpage>198</fpage>
          -
          <lpage>213</lpage>
          . Springer (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Cerans</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ovcinnikova</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liepins</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sprogis</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <source>Advanced OWL 2</source>
          .
          <article-title>0 ontology visualization in OWLGrEd</article-title>
          .
          <source>In: Databases and Information Systems VII - Selected Papers from the 10th Int. Baltic Conference (DB&amp;IS)</source>
          . pp.
          <fpage>41</fpage>
          -
          <lpage>54</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Chein</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mugnier</surname>
            ,
            <given-names>M.L.</given-names>
          </string-name>
          :
          <article-title>Graph-based Knowledge Representation: Computational Foundations of Conceptual Graphs</article-title>
          . Springer (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Civili</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Console</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Giacomo</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lembo</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lenzerini</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lepore</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mancini</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poggi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosati</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruzzi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Santarelli</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Savo</surname>
            ,
            <given-names>D.F.</given-names>
          </string-name>
          :
          <string-name>
            <surname>MASTRO</surname>
            <given-names>STUDIO</given-names>
          </string-name>
          :
          <article-title>Managing ontology-based data access applications</article-title>
          .
          <source>Proc. of the VLDB Endowment 6</source>
          ,
          <fpage>1314</fpage>
          -
          <lpage>1317</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Console</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lembo</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Santarelli</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Savo</surname>
            ,
            <given-names>D.F.</given-names>
          </string-name>
          :
          <article-title>The Graphol language for ontology specification, manuscript, available from the authors</article-title>
          .
          <source>2012</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>Cuenca</given-names>
            <surname>Grau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Horrocks</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Motik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Parsia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Patel-Schneider</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Sattler</surname>
          </string-name>
          ,
          <string-name>
            <surname>U.</surname>
          </string-name>
          :
          <article-title>OWL 2: The next step for OWL</article-title>
          .
          <source>J. of Web Semantics</source>
          <volume>6</volume>
          (
          <issue>4</issue>
          ),
          <fpage>309</fpage>
          -
          <lpage>322</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Dau</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eklund</surname>
            ,
            <given-names>P.W.:</given-names>
          </string-name>
          <article-title>A diagrammatic reasoning system for the description logic ALC</article-title>
          .
          <source>J. Vis. Lang. Comput</source>
          .
          <volume>19</volume>
          (
          <issue>5</issue>
          ),
          <fpage>539</fpage>
          -
          <lpage>573</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Dix</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finlay</surname>
            ,
            <given-names>J.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abowd</surname>
            ,
            <given-names>G.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beale</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          :
          <article-title>Human-Computer Interaction (3rd Edition)</article-title>
          .
          <source>Prentice Hall</source>
          ,
          <volume>3</volume>
          <fpage>edn</fpage>
          .
          <source>(Dec</source>
          <year>2003</year>
          ), http://www.worldcat.org/isbn/0130461091
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Djuric</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gasevic</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Devedzic</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Damjanovic</surname>
          </string-name>
          , V.:
          <article-title>A UML profile for OWL ontologies</article-title>
          .
          <source>In: Revised Selected Papers of the European Workshop on Model Driven Architecture</source>
          . pp.
          <fpage>204</fpage>
          -
          <lpage>219</lpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>