<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Ontology Visualization: a Systematic Literature Analysis</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sergei Mikhailov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mikhail Petrov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Birger Lantow</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ITMO University</institution>
          ,
          <addr-line>Saint Petersburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Rostock</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>The aim of this work is summarizing the current state of the art in the eld of ontology visualization. For this purpose the method of systematic literature analysis has been applied. Publications on and in ESWC, ISWC, KEOD, AVI, and JUCS have been systematically searched for research results regarding ontology visualizations. Besides a general map of activity in the area, especially the context of ontology visualization and the nature of presented artefacts have been investigated. Furthermore, topics for future research are derived.</p>
      </abstract>
      <kwd-group>
        <kwd>visualization tools</kwd>
        <kwd>ontology</kwd>
        <kwd>visualization</kwd>
        <kwd>systematic literature analysis</kwd>
        <kwd>SLA</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        Visualization is an important task related to ontologies. Visualization is mainly
based on a mapping from information to a graphical representation in order to
facilitate data interpretation. It also provides ways to limit the amount of
information that users receive, while keeping them "aware" of the total information
space and reducing cognitive e ort. For ontology visualization, this rule is also
true. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
      </p>
      <p>Visualization of ontologies is needed for showing their content and relations
between their elements. A successfully generated visual representation of an
ontology allows to reduce time spent working with the ontology. Visualization
tools can also provide users an opportunity to create and edit ontologies.</p>
      <p>
        Visualization is a powerful tool in the exploration and analysis of
ontologies. On the other hand, the growing number and size of ontologies requires
sophisticated visualization techniques that are capable to handle algorithmic,
perceptual, and visual scalability problems [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        This article aims to provide an overview of current state of the art in the
eld of ontology visualization. Thus, the central research question (RQ) is: "How
is the area of ontology visualization covered by current scienti c publications?"
For this purpose the "Structured Literature Analysis" method (SLA) was used
(e.g. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]). The idea of an SLA is to give a summary of activity in an scienti c
area. Thus, identifying major research topics and problems and assessing the
current level of activity.
      </p>
      <p>The structure of this paper is organized as follows. The next section describes
the SLA method and provides a description of the method's steps. This includes
breaking down the central research question to more speci c RQs. Sections 3
and 4 present the results of the SLA. The nal section is devoted to conclusions.</p>
    </sec>
    <sec id="sec-2">
      <title>2 Study Design and Overview</title>
      <p>
        The following section describes the process of developing a systematic literature
review. Prior to the review process, a topic of interest must be de ned. This has
been done by formulating the central research question in the previous section.
Furthermore, research questions regarding this topic of interest need to be
formulated. They represent the basis of the study and serve as a guidance during
the data extraction. Regarding the topic of ontology visualization, the following
research questions are in focus:
{ RQ1: How much activity in the eld of ontology visualization has been in the
years 2007{2015?
{ RQ2: What research topics (methods, tools, theories, examples, deployments,
etc.) are being investigated?
{ RQ3: Who is active in area of ontology visualization?
{ RQ4: What research approaches are being used?
{ RQ5: How is the context of ontology visualization approaches described?
{ RQ6: Which topics in the eld of ontology visualization need further research
according to the authors?
The review process is divided into four di erent parts (see gure 1). The rst
activity is to identify conference series, journals and catalogues that are likely
to represent the state of the art of research on the topic of interest. Here a base
set of papers for review is extracted by keyword search. The second step is the
exclusion/inclusion of papers based on title and abstract. Then, the remaining
papers have to be classi ed and data has to be extracted with regard to the
research questions. The fourth and last step is to analyse the extracted data.
This review process is based on the guidelines for systematic literature reviews
by Kitchenham [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] .The next paragraphs describe the performance of these steps
in detail.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3 Identi cation and Selection of Papers</title>
      <p>The rst step is the identi cation of ontology visualization related papers in
a selection of appropriate literature sources. As well-known representatives of
conferences targeting at ontologies and semantic technologies, the International
Semantic Web Conference (ISWC), the European Semantic Web Conference
(ESWC), and the International Conference on Knowledge Engineering and
Ontology Development (KEOD) have been selected. For the visualization domain,
the Workshop on Advanced Visual Interfaces(AVI) has been chosen as a
representative. Additionally, the Journal of Universal Computer Science (JUCS) has
been searched for the occurrence of the topic in general computer science. For
searching relevant information in the eld of ontology visualization and reducing
the number of articles the time-frame from 2007 to 2015 has been selected.</p>
      <p>Major scienti c data bases have been used for searching. ISWC and ESWC
are indexed at the Web of Science by Thomson/Reuters, KEOD, AVI, and JUCS
at SCOPUS. The following search terms have been used:</p>
      <sec id="sec-3-1">
        <title>SCOPUS:</title>
        <sec id="sec-3-1-1">
          <title>TITLE-ABS-KEY ( visual* ontolog* ) ) AND</title>
        </sec>
        <sec id="sec-3-1-2">
          <title>PUBYEAR &gt; 2006</title>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>Web of Science:</title>
        <p>TS=(Ontolog* AND Visual*)
Thus, title, abstract, and keywords have been searched for the occurrence of
words containing `ontolog'and words containing `visual'. The search terms have
been modi ed for each selected source in order to restrict results to that source.
For example,</p>
        <sec id="sec-3-2-1">
          <title>AND ( CONF ( keod ))</title>
          <p>has been used in SCOPUS for selecting papers published at KEOD. The search
form for the Web of Science separates the time frame from the search term.
Therefore, the publication years are not part of the used search term. A summary
of paper identi cation is shown in table 1. 52 papers have been identi ed in total.</p>
          <p>A selection of the papers which are relevant to the area of ontology
visualization had to be made. For this purpose criteria for innexcluding were formulated:
{ The paper must contain information about ontology visualization or at least
mention some techniques or theories regarding the research area;
{ Every paper should give some new information about the topic. Papers about
approaches that have already been discussed in other papers, should be
excluded.</p>
          <p>For the selection, a table has been created, which contains the title, the
status (acceptedndeclined) of a paper and the reason for declining. E.g.
"Hontology: A Multilingual Ontology for the Accommodation Sector in the Tourism
Industry" was declined with the reason that "No information was found about
visualization". Applying these criteria, 17 articles have been selected.</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4 Data Extraction and Analysis</title>
      <p>This section describes results of the data analysis of resulting papers after
collection and selection. It is based on the research questions that were given in
section 2. For the data extraction, the selected articles have been read and their
relevant data has been collected in a table for further working. An example of
the data for a paper is presented in table 2.
activity was reached in 2010 and 2011| 3 articles were published. After only 1
published article in 2012 an 2013, the number of relevant publications increased
again in the year 2014 and 2015. In average 2 articles were published per year
from 2007 to 2015. Activity in the eld of ontology visualization is low (only 18
papers in 9 years were written and published in our dataset.), but stable.
4.2 RQ2: What research topics are being investigated?
The eld of ontology visualization contains many topics and themes: e.g.
methods, tools, theories, examples, deployment, case studies, etc. There are many
possible ways to group papers into topics. However, the focus lies on the created
artefact. Thus, 3 clusters have been identi ed (see g. 3):
1. Visualization tools | this topic describes creating new visualization tools.</p>
      <p>
        This usually includes creating algorithmsnmethods, which provide
visualization. Examples of this kind of papers are: [
        <xref ref-type="bibr" rid="ref19 ref6 ref9">9, 19, 6</xref>
        ]; There are also some
articles ([
        <xref ref-type="bibr" rid="ref5 ref7">7, 5</xref>
        ]) that do not describe stand-alone ontology visualization tools but
plug-ins for existing ontology editing and visualization applications.
Concretely, Protege 1 was chosen as base application, because this project is
1 http://protege.stanford.edu/
widely used in the ontology community and provides users an e cient
system for implementing own plug-ins, which signi cantly increase Protege's
functionality.
2. Comparative Study | this kind of article describes methods, tools and
techniques of ontology visualization and makes detailed comparisons with
each other. Examples: [
        <xref ref-type="bibr" rid="ref13 ref20">13, 20</xref>
        ].
3. Visualization Approach | these papers o er something new in the eld of
ontology visualization. E.g. using extended Euler diagrams for data
visualization ([
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]) or using UML Activity diagrams for identical purposes [
        <xref ref-type="bibr" rid="ref11 ref16 ref17">17, 11, 16</xref>
        ].
4.3 RQ3: Who is active in area of ontology visualization?
This question aims to highlight scienti c groups or individuals who work in
the eld of ontology visualization. Most of the active institutesnuniversities are
located in Europe | 19 of 26 di erent universities are involved in ontology
visualization research. The most active countries in the eld of ontology visualization
are:
{ UK (papers: [
        <xref ref-type="bibr" rid="ref11 ref12 ref14 ref15 ref17">11, 12, 17, 14, 15</xref>
        ], total amount of authors: 15);
{ USA (papers: [
        <xref ref-type="bibr" rid="ref13 ref14 ref7">13, 7, 14</xref>
        ], total amount of authors: 7);
{ Germany (papers: [
        <xref ref-type="bibr" rid="ref15 ref5">5, 15</xref>
        ], total amount of authors: 4);
{ Latvia (paper: [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], total amount of authors: 5);
{ Belgium (paper: [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], total amount of authors: 4);
{ Greece (paper: [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], total amount of authors: 4).
      </p>
      <p>
        The average number of authors, who worked on the articles is 3.65 persons
per article. Most of papers (9) were written by teams from within one country.
None of the authors of the selected papers created more than one paper. Also,
only one university (Stanford University ) published papers from di erent
authors. Summarizing these facts, it seems, that working in the eld of ontology
visualization is complicated and consumes a lot of time.
4.4 RQ4: What research approaches are being used?
For a complete analysis of the eld of ontology visualization it is necessary to
gather the research approaches chosen by the respective authors. The classi
cation of research approaches is based on the work of Robson [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. 3 main groups
have been identi ed in the selected papers: Case study, Prototyping, and Survey.
Additionally, one of the papers is based on Grounded Theory. The distribution of
group members is shown in g. 4. As expected from RQ2 | most of the papers
belong to the Prototyping group, because most papers describe new visualization
tools and plug-ins.
      </p>
      <p>
        The apers in the prototyping group have content about creating, developing,
and evaluation of visualization tools or plug-ins. Also, the papers describe main
features of visualization tools. An example of this kind of paper is: [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        The Case study group includes papers, which o er some speci c case and
provide a detailed description of this case. For example, paper [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] shows how to use
concept diagrams (extended Eulers diagrams) on detailed examples. Some
papers, that are included in the prototyping group, also use the case study method.
E.g. paper [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] describes how to use the visualization of ontologies for helping
a military commander to make decisions or paper [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] describes how to use
ontology visualization in ornithology.
      </p>
      <p>
        The last group | Survey | contains papers that used data from
questionnaires, interviews and observation for research. E.g. paper [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] used data from
surveys and questionnaires for deciding which way of ontology visualization is
better: indented tree or graph visualization. Also, some papers, which describe
prototypes additionally use this research approach. E.g. paper [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] used experts
for evaluating task performance of the presented visualization tool (survey ), and
also used Grounded Theory in order to build categories for expert's comments.
Overall, some of the papers used triangulation (a method mix) in order to
improve validity. Research on ontology visualization is mainly tool driven. Thus,
research methods that support artefact evaluation prevail (Prototyping, Case
Study,Expert Survey ).
4.5 RQ5: How is the context of ontology visualization approaches
described?
This question aims to highlight the context in which the approaches and tools are
intended to be applied. The following aspects of context have been selected for
investigation: (1) User Groups (2) Application Domains (3) Data Representation
(4) Visualization Techniques and (5) Problems and Issues.
1. User groups | Tools for visualization of ontologies can be designed for the
use by domain experts, who aren't familiar with ontologies and for ontology
engineers, who work in this eld. The choice of targeted end users has an
signi cant impact on tool's design and features and usually it is hard to
combine both user's way of working.
      </p>
      <p>
        The papers [
        <xref ref-type="bibr" rid="ref19 ref5 ref6">5, 6, 19</xref>
        ] describe tools for users, who are not familiar with
ontologies, and the papers [
        <xref ref-type="bibr" rid="ref12 ref7 ref8">12, 7, 8</xref>
        ] are positioned as tools for experts in
eld of ontology engineering.
2. Application Domains | Visualization of ontologies can be applied in
various domains. Papers present cases of using ontology visualization in research
and education [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], shared development [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], military [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], medicine [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ],
biology science [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].Thus, 5 papers discussed domain speci c visualizations of
ontologies [
        <xref ref-type="bibr" rid="ref10 ref14 ref15 ref16 ref9">16, 9, 10, 14, 15</xref>
        ] while the rest provided general approaches.
3. Data Representation | In most cases visualization tools of ontologies
work with RDF and OWL data. But some authors o ers other data
structures. E.g., paper [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] works with UML Activity diagrams which could be
converted into OWL ontologies. The authors of paper [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] work with OWL
extended by SWRL (Semantic Web Rule Language) rules. Hence, 7 papers
addressed the visualization of OWL ontologies while 6 considered RDF/S.
Among all the presented tools for ontology visualization only 8 were able to
address A-Box data. A special example is [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], it presents a tool for SWRL
rule visualization. Thus, an additional ontology part is in focus here.
4. Visualization Techniques | Data can be presented in di erent ways.
      </p>
      <p>
        Choosing a method of visualization has e ects on quality and
understandability of models. It is required to choose right view for various purposes.
The most common way of ontology visualization is using plain 2D graphs.
This form of ontology data presentation is familiar and intuitive to users.
Papers [
        <xref ref-type="bibr" rid="ref12 ref18 ref5 ref6 ref7">12, 7, 6, 5, 18</xref>
        ] use this method for data visualization. But other
authors of the selected papers used other or more specialized solutions:
{ 3-dimensional graph visualization layout was used by the authors of
paper [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] ;
{ OWL classes in paper [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] were presented as UML classes, data properties
as class attributes, object properties as associations, individuals as objects,
cardinality restrictions on association domain class as UML cardinalities;
{ The authors of article [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] have adopted the single-view visualizing paradigm
enabling selective detailed views which has turned out to be adequate for
visualizing concept and property hierarchies of a large amount of data in
ontologies;
{ Radial tree was used in paper [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] for representing all available OWL
classes of DBpedia and various kinds of charts were chosen for showing
information extracted from DBpedia;
{ Concept diagrams (extended Euler diagrams) were used for allowing
disparate groups of ontology developers and users to communicate e ectively
by the authors of paper [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
5. Issues and problems | The authors describe di erent problems, which
they faced during their research. One of the issues is making tools more
friendly for end users. Articles said, that "ontologies are no longer
developed and used exclusively by specialized researchers and practitioners"
(paper [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]), "visualizations for ontologies have been developed in the last couple
of years, they either focus on speci c ontology aspects or are hard to read for
non-expert use" (paper [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]). This issue has been tried to solve by adding such
capabilities as zooming and hiding parts of the ontology, history browsing,
saving and loading of customized ontologies views, graphical zooming,
layout customization (paper [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]); colour schema for elements, using force-direct
layout, layout animation (paper [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]).
      </p>
      <p>
        Another issue addressed by the authors is working with large data
ontologies. "Little has yet been done to support ontology users or developers to
visually edit or explore such large volumes of interrelated individuals"
(paper [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]), "ontologies can encapsulate a large amount of information (hundreds
of thousands of classes and relationships, for example). The main problems
of current tools for ontology visualization are common to any tool for graph
visualization: problems of scale versus amount of information that need to
be presented." (paper [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]).
4.6 RQ6: What are Future Research Topics?
The papers that presented visualization tools generally named adding
functionality, proving scalability, and tool integration into ontology engineering
environments as future tasks. Those who presented visualization approaches named the
development of tools as the next step. However, most of the identi ed papers
stress the fact of lacking evaluation of approaches and tools. Evaluation so far is
only based on small samples, uses cases and speci c domains. Thus, a
generalization and the practical usage in research or industry scenarios are also topics
for future research.
      </p>
      <p>
        At last, two papers named virtual reality applications as a eld for future
research [
        <xref ref-type="bibr" rid="ref14 ref18">18, 14</xref>
        ].
      </p>
    </sec>
    <sec id="sec-5">
      <title>5 Conclusion</title>
      <p>There is constant activity on the eld of ontology visualization. This fact proves
that this topic is of interest today and it may evolve in the near future. Many
tools and methods for ontology visualization appear in the literature. Most of
the analyzed papers focus on concrete tools, but not on the algorithms or usage
of ontologies and ontology visualization.</p>
      <p>
        The authors of the selected papers have pointed on the next topics that need
further research:
{ Further development, improvement and integration into enterprise of
visualization tools (papers [
        <xref ref-type="bibr" rid="ref12 ref5">12, 5</xref>
        ]);
{ More functionality for user-friendly interface (paper [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]);
{ Scalability (papers [
        <xref ref-type="bibr" rid="ref15 ref6 ref8">6, 8, 15</xref>
        ]).
      </p>
      <p>The fact that no second publications on the area have been found for the authors
of the selected papers leads to the assumption that these issues for future research
are still open and di cult to handle.</p>
      <p>Regarding the quality of the performed SLA, publication sources of the
semantic web community (ESCW, ISWC, KEOD) are over-represented. Thus, the
literature search can be extended for example by looking into the visualization
community. Furthermore, the search terms could be extended. A possible
additional term would be `Conceptual Model'. Though Ontologies and Conceptual
Models are not the same, they are quite similar.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgement</title>
      <p>This work has been partially supported by the Government of the Russian
Federation, Grant 074-U01.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>da</surname>
            <given-names>Silva</given-names>
          </string-name>
          , Isabel Cristina Siqueira, Freitas, Carla Maria Dal Sasso, Santucci,
          <string-name>
            <surname>G.</surname>
          </string-name>
          :
          <article-title>An integrated approach for evaluating the visualization of intensional and extensional levels of ontologies</article-title>
          .
          <source>In: Proceedings of the 2012 BELIV Workshop:</source>
          Beyond Time and
          <article-title>Errors-Novel Evaluation Methods for Visualization. (</article-title>
          <year>2012</year>
          )
          <fpage>2</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Burch</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lohmann</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Visualizing the evolution of ontologies: A dynamic graph perspective</article-title>
          .
          <source>In: Proceedings of the International Workshop on Visualizations and User Interfaces for Ontologies and Linked Data (VOILA'15)</source>
          . Volume
          <volume>1456</volume>
          . 69{
          <fpage>76</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Kitchenham</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Procedures for performing systematic reviews</article-title>
          . Keele, UK, Keele University 33(
          <year>2004</year>
          ) (
          <year>2004</year>
          )
          <volume>1</volume>
          {
          <fpage>26</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Ivarsson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gorschek</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Technology transfer decision support in requirements engineering research: a systematic review of REj</article-title>
          . Requirements engineering
          <volume>14</volume>
          (
          <issue>3</issue>
          ) (
          <year>2009</year>
          )
          <volume>155</volume>
          {
          <fpage>175</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Lohmann</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Negru</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bold</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>The ProtegeVOWL Plugin: Ontology visualization for everyone</article-title>
          .
          <source>The Semantic Web: ESWC 2014 Satellite Events. Revised Selected Papers: LNCS 8798</source>
          .
          <article-title>(</article-title>
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Zampetakis</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tzitzikas</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leonidis</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kotzinos</surname>
            ,
            <given-names>D.:</given-names>
          </string-name>
          <article-title>StarLion: Autocon gurable Layouts for Exploring Ontologies</article-title>
          .
          <source>The Semantic Web: Research and Applications. 7th Extended Semantic Web Conference</source>
          ,
          <string-name>
            <surname>ESWC</surname>
          </string-name>
          <year>2010</year>
          . Proceedings,
          <string-name>
            <surname>Part</surname>
            <given-names>II</given-names>
          </string-name>
          (
          <year>2010</year>
          )
          <volume>446</volume>
          {
          <fpage>450</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Hassanpour</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>O</given-names>
            <surname>'Connor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.J.</given-names>
            ,
            <surname>Das</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.K.</surname>
          </string-name>
          :
          <article-title>A Software Tool for Visualizing, Managing and Eliciting SWRL Rules</article-title>
          .
          <source>The Semantic Web: Research and Applications. Proceedings 7th Extended Semantic Web Conference</source>
          ,
          <string-name>
            <surname>ESWC</surname>
          </string-name>
          <year>2010</year>
          (
          <year>2010</year>
          )
          <volume>381</volume>
          {
          <fpage>385</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Noppens</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liebig</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Understanding large volumes of interconnected individuals by visual exploration. System description</article-title>
          .
          <source>Semantic Web: Research and Applications. Proceedings 4th European Semantic Web Conference</source>
          ,
          <string-name>
            <surname>ESWC</surname>
          </string-name>
          <year>2007</year>
          (
          <year>2007</year>
          )
          <volume>799</volume>
          {
          <fpage>808</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Cerans</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liepins</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sprogis</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ovcinnikova</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barzdins</surname>
          </string-name>
          , G.:
          <article-title>Domain-Speci c OWL Ontology Visualization with OWLGrEd. The Semantic Web: ESWC 2012 Satellite Events</article-title>
          .
          <source>Revised Selected Papers: LNCS</source>
          <volume>7540</volume>
          (
          <year>2015</year>
          )
          <volume>419</volume>
          {
          <fpage>424</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Koho</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hyvonen</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lehikoinen</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Ornithology based on linking bird observations with weather data. The Semantic Web: ESWC 2014 Satellite Events</article-title>
          .
          <source>Revised Selected Papers: LNCS 8798</source>
          .
          <article-title>(</article-title>
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Howse</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stapleton</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Taylor</surname>
          </string-name>
          , K.,
          <string-name>
            <surname>Chapman</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Visualizing Ontologies:
          <string-name>
            <given-names>A Case</given-names>
            <surname>Study</surname>
          </string-name>
          .
          <source>The Semantic Web. Proceedings 10th International Semantic Web Conference</source>
          . (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Motta</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mulholland</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peroni</surname>
          </string-name>
          , S.,
          <string-name>
            <surname>d'Aquin</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gomez-Perez</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mendez</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zablith</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>A Novel Approach to Visualizing and Navigating Ontologies. The Semantic Web</article-title>
          .
          <source>Proceedings 10th International Semantic Web Conference</source>
          . (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Bo</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Storey</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          :
          <article-title>Indented Tree or Graph? A Usability Study of Ontology Visualization Techniques in the Context of Class Mapping Evaluation. The Semantic Web</article-title>
          - ISWC
          <year>2013</year>
          .
          <article-title>12th International Semantic Web Conference</article-title>
          .
          <source>Proceedings: LNCS 8218</source>
          .
          <article-title>(</article-title>
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Halpin</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zielinski</surname>
            ,
            <given-names>D.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brady</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kelly</surname>
          </string-name>
          , G.:
          <article-title>Exploring semantic social networks using virtual reality</article-title>
          .
          <source>The Semantic Web - ISWC 2008. Proceedings 7th International Semantic Web Conference</source>
          ,
          <string-name>
            <surname>ISWC</surname>
          </string-name>
          <year>2008</year>
          .
          <article-title>(</article-title>
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Hauer</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rogulin</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zillner</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Branson</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shamdasani</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsymbal</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Huber</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Solomonides</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McClatchey</surname>
            ,
            <given-names>R.:</given-names>
          </string-name>
          <article-title>An architecture for semantic navigation and reasoning with patient data - experiences of the Health-e-Child project</article-title>
          .
          <source>The Semantic Web - ISWC 2008. Proceedings 7th International Semantic Web Conference</source>
          ,
          <string-name>
            <surname>ISWC</surname>
          </string-name>
          <year>2008</year>
          .
          <article-title>(</article-title>
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Gavrilova</surname>
            ,
            <given-names>T.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leshcheva</surname>
            ,
            <given-names>I.A.</given-names>
          </string-name>
          :
          <article-title>Cognitive style a ecting visual ontology design: KOMET project results</article-title>
          .
          <source>KEOD 2014 - Proceedings of the International Conference on Knowledge Engineering and Ontology Development</source>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Olszewska</surname>
            ,
            <given-names>J.I.</given-names>
          </string-name>
          :
          <article-title>UML activity diagrams for OWL ontology building</article-title>
          .
          <source>IC3K 2015 - Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management</source>
          <volume>2</volume>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Hodicky</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Frantis</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Decision support system for a commander at the operational level</article-title>
          .
          <source>KEOD 2009 - 1st International Conference on Knowledge Engineering and Ontology Development</source>
          ,
          <string-name>
            <surname>Proceedings</surname>
          </string-name>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Dumas</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Broche</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hoste</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Signer</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>ViDaX: An interactive semantic data visualisation and exploration tool</article-title>
          .
          <source>Proceedings of the Workshop on Advanced Visual Interfaces AVI</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>M. Lanzenberger</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Sampson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>Rester: Ontology Visualization: Tools and Tecniques for Visual representation of Semi-Structrured Meta-Data</article-title>
          .
          <source>In: JUCS</source>
          . Volume
          <volume>16</volume>
          . 1036{
          <fpage>1054</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Garc</surname>
            <given-names>a</given-names>
          </string-name>
          , J.,
          <string-name>
            <surname>Garc</surname>
            a-Pen~alvo,
            <given-names>F.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Theron</surname>
          </string-name>
          , R., de Pablos, P.O.:
          <article-title>Usability evaluation of a visual modelling tool for OWL ontologies</article-title>
          .
          <source>Journal of Universal Computer Science</source>
          <volume>17</volume>
          (
          <issue>9</issue>
          ) (
          <year>2011</year>
          )
          <volume>1299</volume>
          {
          <fpage>1313</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Robson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          : Real World Research:
          <article-title>A resource for social scientists and resources (</article-title>
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>