<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Conceptual Knowledge Management: the Case of Biomedical Information</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Roberto Enea</string-name>
          <email>r.enea@unimarconi.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Maria Teresa Pazienza</string-name>
          <email>pazienza@info.uniroma2.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andrea Turbati</string-name>
          <email>turbati@info.uniroma2.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Davide Vitiel- lo</string-name>
          <email>DavideVitiello@mail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>DII, ART Group, University of Rome</institution>
          ,
          <addr-line>Tor Vergata</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Guglielmo Marconi University</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Ontologies are commonly used resources: we are witnessing to the constant grow, in number and heterogeneity, of communities working with large volumes of data. Researchers, practitioners, developers and end users deal with a huge amount of data from different perspective, topics, cultures, languages. For people involved in governing both data and processes this remains a difficult task. End users and practitioners are usually interested in merging, data generated from connected objects in customizable ways. Even if a lot of algorithms and tools have been created to achieve such goal in a full automatic manner, human contribution is nonetheless still important. On the way to reach the aforementioned results, researchers concentrated their effort in making easier both representation and visualization of data, thus simplifying user interaction with the system. The main aspect to deal with is how to represent an ontology alignment providing a good overview of the alignment and whatever is recognized to be an important detail for the user, both at the same time. Indeed, the overall view makes easier for the users to be aware of the level of interconnection between ontologies, while details allow them to evaluate the alignments and, possibly, give feedback on each of them. These two levels of information's combined requirements suggests that a static visualization of the alignment is not effective. To enhance human involvement and judgment, interactivity becomes a key issue. These tasks become much more complex when considering very large ontologies like biomedical ones. We have developed a framework for supporting easy ontology matching processes (GENOMA) that provides a user friendly graphical interface (OntoChord) to visualize structured information and reason over them. Framework's technical details will be outlined. Furthermore, examples of user sessions and testing evaluations over biomedical ontologies will be considered.</p>
      </abstract>
      <kwd-group>
        <kwd />
        <kwd>ontology</kwd>
        <kwd>knowledge management</kwd>
        <kwd>data visualization</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Life science involves the scientific study of living organisms: from plants, to
animals and human beings. Overall, the study of organisms’ behaviors (that includes not
only biology, but also all related technological advances in biotechnology) led to a
flourishing of specializations and new, interdisciplinary, research fields. As a
consequence of all those activities, the amount of data produced has become impressive and
hardly manageable in a unique systematic assessment. Several ontologies were defined
as an attempt to make knowledge underlying biological and medical experiments
suitable for sharing. Most of them are freely accessible.</p>
      <p>This attempt led to several outcomes; one important research activity focuses on
the possibility to structure all those heterogeneous contributions in a unique conceptual
framework. Thus the interest in merging different ontologies to approach a unique
knowledge representation.</p>
      <p>Data dimension represents a further problem for both structuring and relating data
in a unique context meant for end-user visualization.</p>
      <p>Starting from such premises we developed a large framework in which the two
actions (ontology matching and visualization) were feasible for any kind of user.</p>
      <p>In order to do that, data representation and visualization was certainly one key
issue. Indeed, we wanted to simplify user interaction with the automated system to
achieve a better understanding of phenomena. Although this may seem a secondary
aspect of ontology matching, it is nevertheless a difficult one to deal with, especially
when involved ontologies reach considerable size (thousands of concepts) and
consequently does their alignment. The main obstacle to overcome is to provide a good
overview of the alignment without sacrificing important details. While the overall view
shows the user the level of interconnection between compared ontologies, details allow
to evaluate alignments and provide feedback on each of them. Having said that, a static
visualization of the alignment is not effective. To enhance human involvement and
judgment, interactivity becomes a key issue.</p>
      <p>Our approach has been based on an interactive visualization method of ontology
matching results (OntoChord). The functionalities of the tool are not limited to the
visualization of the alignment but also let the user return feedbacks on the alignment
process. In the first part of the paper we introduce the main problems regarding ontology
alignments’ visualization (while presenting a brief state of the art).</p>
      <p>The second part is dedicated to the presentation of the tool OntoChord and the
framework upon which it runs (GENOMA). Then we present some Chord Graphs
generated by alignments via different matching architectures.</p>
      <p>Finally, in the last section we will discuss about the system’s future developments.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Visualization of Ontology Alignments in literature</title>
      <p>When presenting an alignment between ontologies we need to find the right
balance between overview and detail. Both aspects of the alignment cannot be omitted. If
on the one hand the overall view gives the user the level of interconnection between the
compared ontologies, the detail allows him to evaluate and then provide feedback on
each alignment. The combined needs of these two levels of detail causes a static
visualization of the alignment is not such a good method. Interactivity becomes a key issue.
Following previous concept is useful to present the state of the art of the visualization
tools highlighting the different approaches used.</p>
      <p>
        Tree view is one of the most used methods. COMA++
        <xref ref-type="bibr" rid="ref1">(Aumueller, Do, Massmann, &amp;
Rahm, 2005)</xref>
        , an ontology matching tool, represents the alignments as chords
connecting entities between two ontologies. Tools following the same approach are
AgreementMaker
        <xref ref-type="bibr" rid="ref7">(Li, Stroe, &amp; Cruz, 2015)</xref>
        and PROMPT
        <xref ref-type="bibr" rid="ref8">(Noy &amp; Musen, 2003)</xref>
        .
AgreementMaker combines the tree view visualization with the list of matching results and
PROMPT, a Protégé plugin, visualizes the alignment in a tree view fashion, showing
alignments as an interactive list such that the selection of a list item highlights the
entities aligned in the tree view.
      </p>
      <p>The advantage of the approach used by the tools above is showing each entity in its
context inside the belonging ontology. The disadvantage is not being able to scale
when we are dealing with very dense alignments or with large ontologies: the
interpretation of the graph could thus become difficult for the user.</p>
      <p>
        Other tools adopt simple graphs instead of trees, to address the issues connected to
the tree view (or they add a graph to the classical tree representation). AlViz
        <xref ref-type="bibr" rid="ref6">(Lanzenberger &amp; Sampson, 2006)</xref>
        uses both a tree and “small world graphs”
        <xref ref-type="bibr" rid="ref3">(Ham &amp;
Wijk, 2004)</xref>
        to help the user to examine the structure of the ontology intuitively. This
method uses clusters to group the nodes of a graph according to the selected level of
detail. The nodes represent the entities (concepts or instances) connected to each other,
according to the selected relations.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. OntoChord, a visualization tool for ontology alignments</title>
      <p>
        OntoChord has been developed as part of a broader framework dedicated to the
Ontology Matching, called GENOMA
        <xref ref-type="bibr" rid="ref2">(Enea, Pazienza, &amp; Turbati, 2015)</xref>
        (GENeric
Ontology Matching Architecture, which can be downloaded from
https://bitbucket.org/aturbati/ontologymatching-architecture). It supplies a user friendly
graphical tool to build different architectures using existing matchers. The system is
already provided with several matchers (string-based, language-based, graph-based)
and can be extended and customized by end users. GENOMA generates the final
alignment report in RDF format according to the OAEI standard (Ontology Alignment
Evaluation Initiative, http://oaei.ontologymatching.org/), which is a filtered similarity
matrix.
      </p>
      <p>Even if OntoChord has been designed as part of the framework GENOMA, it can
be used also as a stand-alone tool.</p>
      <p>
        As previously mentioned, the main problem to be addressed in the visualization of
ontologies alignments relates to the possibility to find the right balance between
overview and details. In a process of ontology matching each entity of the first ontology is
compared with each entity of the other, thus generating a two-dimensional matrix.
Alignment between two ontologies may be considered as the filtering of more complex
data: the similarity matrix resulting from the matching operation. We adopted as a
model for the representation of alignments between ontologies one of the most used
diagrams in complex adjacency matrix and networks visualization
        <xref ref-type="bibr" rid="ref4">(Komarek, Pavlik, &amp;
Sobeslav, 2015)</xref>
        , the chord graph, better known as chord diagram.
      </p>
      <p>
        The chord diagrams
        <xref ref-type="bibr" rid="ref5">(Krzywinski, et al., 2009)</xref>
        became popular in 2007 after their
use in representing similarities between the human genome and the one of other
species. The diagram consists of a circumference around which related entities are
arranged. The relationships between entities are represented by chords.
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. The OntoChord tool functionalities</title>
      <p>OntoChord receives a set of filtering settings input parameters. For example, it is
possible to filter the entities that we want to be included in the diagram, like classes,
datatype properties, object properties or instances. The filter flags are defined during
the composition of the architecture in the Engine Configurator tool. GENOMA
generates an XML output file including the similarity matrix and the names of the entities,
together with the URIs of the matched ontologies.</p>
      <p>OntoChord graphical interface (Figure 1) makes the alignment readable also to
non-experts through the chord graph. We structured the GUI trying to focus on the
chord graph functionality for viewing relations and saving the user feedback. We also
made it possible to change the cut-off threshold: this functionality is of vital importance
to the phase of fine tuning. OntoChord was developed using web technologies (HTML,
javascript1, JSP, RDF4J) and can be accessed using a common browser. It gets as input
the full URL of the XML file generated by a dedicated module in GENOMA.</p>
      <p>This feature makes the graphical interface of the OntoChord completely
independent from the framework GENOMA: it can be used by any other tool that can populate
the XML file with the required information.</p>
      <p>The chords in the graph are colored in green or in red depending on the similarity
value they represent; the green chords are the ones that overcome the threshold while
the red ones stay below the threshold. In such a way, the user has a glance at existing
similarity relations between the two ontologies and how many of them may be valid.</p>
      <p>1 We used D3.JS (d3js.org) for the creation of the chord graph and hierarchy
graphs. The overall functions are built on native JavaScript and D3.JS.
The threshold is dynamic and can be modified by the user acting on a slider bar (see
Figure 1) The presence of a dynamic threshold is a very important aspect of the
analysis phase because it helps the user to assess the best cut-off threshold to be applied. The
importance lies in the fact that usually the cut-off threshold must be adapted to the
architecture used for matching and therefore is part of the fine-tuning phase of the
system. There are no effective thresholds in advance.</p>
      <p>To attain interactivity, mouse events are used to highlight the details of the graph
in a very comfortable way. For example, it is possible to select a single chord or, to
select only the similarity relations existing between that entity and the others entities of
the opposite ontology, respectively by moving the mouse pointer over the graph until
reaching the chord, or by moving the mouse pointer over one entity in the semi-arc.
Once a relation is selected, the user can accept or reject the alignment suggested by the
system for that relation.</p>
      <p>OntoChord can provide three different diagrams depending on how the filtering
flag is set:
• class comparison,
property (datatype and object) comparison and
instance comparison.</p>
      <p>In the graph interface menu, it is possible to select which diagram is to be shown.
The similarity matrix has been generated through GENOMA. By combining
GENOMA and OntoChord changing matchers to get new results visualized becomes
very easy and fast for the end user.</p>
      <p>OntoChord is an innovative tool which visually exposes ontologies matchings
while providing further support to user for a better understanding of interconnections.</p>
      <p>The philosophy behind OntoChord is that once an ontology matching has been
computed the human agent should be able to go through the entities deemed similar by
the matching algorithm. Then, he should be allowed to accept or reject the similarity
relations encompassing the entities. When aligned ontologies are big and when the
alignment is very dense, going through this process can be difficult and slow.</p>
      <p>It should also address density issues, in the sense of presenting all the similarities
relations in the clearer fashion possible, without, however, hiding details.</p>
      <p>The capability of OntoChord tool can be assessed from different perspectives.
•
•
•
•
•
•</p>
      <sec id="sec-4-1">
        <title>Raw visualization of alignment relations</title>
      </sec>
      <sec id="sec-4-2">
        <title>Interaction with relations</title>
      </sec>
      <sec id="sec-4-3">
        <title>Visualization of hierarchy</title>
      </sec>
      <sec id="sec-4-4">
        <title>Interaction with hierarchy graph</title>
        <p>So far OntoChord has evolved from being a convenient alignment tool to a
detailoriented inspection and modification tool for ontologies and matching results.</p>
        <p>Indeeed, while a simple syntactic matching task, whereby two classes must be
considered similar if they share the first n letters of their labels does not need any human
intervention, more complex semantic matchings probably needs corrections.</p>
        <p>The functions immediately available as the tool opens acts upon the relations
shown as Chord Graph’s chords. A secondary set of functions, which acts upon single
ontologies hierarchies, becomes available through click events on chords.</p>
        <sec id="sec-4-4-1">
          <title>4.1. Class Hierarchy in OntoChord</title>
          <p>The Chord representation is only one way to see and understand the results of the
matching process. The limit of such depiction is that it is not able to show the context
of the classes/concepts that were matched.</p>
          <p>An ontology (and a thesaurus as well) places each resource in a hierarchy through
the relations between them.</p>
          <p>In the absence of this kind of representation, the user might have a hard time
validating the alignment since he may not be able to fully understand the meaning of a
class/concept.</p>
          <p>Such a limitation can be overcome through:
• The hierarchical view of both ontologies (one centered in an ‘A’</p>
          <p>ontology’s resource and the other in a ‘B’ ontology’s resource)
•</p>
          <p>The value associated to both resources in respect to both the original
ontologies (such as labels, descriptions, notes) and aligment (such as
resources’ properties similarities, which will be subsequently shown).</p>
        </sec>
      </sec>
      <sec id="sec-4-5">
        <title>An example of the hierarchical view can be seen in Figure 2. We now describe more in details the features of OntoChord, providing some explanatory examples.</title>
        <sec id="sec-4-5-1">
          <title>4.1.1. Static features</title>
          <p>CutChordGraph makes use of a simple diagram to show all the entities deemed
similar by the matching algorithm in use.</p>
          <p>The problem underlying such a visualization is the cost-benefit ratio of the overall
view on the detailed one.</p>
        </sec>
        <sec id="sec-4-5-2">
          <title>4.1.2. Dynamic features</title>
        </sec>
      </sec>
      <sec id="sec-4-6">
        <title>The dynamic features of CutChordGraph are:</title>
      </sec>
      <sec id="sec-4-7">
        <title>Zooming (see Figure 1)</title>
      </sec>
      <sec id="sec-4-8">
        <title>Adjustable similarity acceptance threshold (see Sect. 4.1.2.1)</title>
      </sec>
      <sec id="sec-4-9">
        <title>Chords Acceptance/Rejection (see Sect. 4.1.2.2)</title>
      </sec>
      <sec id="sec-4-10">
        <title>Accepted / Rejected Chords filter (see Sect. 4.1.2.3) As the alignments become numerous CutChordGraph can be zoomed into internal arches representing the entities.</title>
        <sec id="sec-4-10-1">
          <title>4.1.2.1. Use of the acceptance threshold</title>
          <p>The threshold adjustment (Figure 3) is meant to help the final user in speeding up
the validation process: by changing the acceptance threshold the distribution of green
and red chords changes accordingly. This is meant as a starting point, in that the next
steps are manual, user-driven acceptances or rejections of single chords (relations). The
feature is especially useful when considering the big size of some ontology matchings.
In a sense, setting the threshold is a first pass, which can automatically set a wide group
of relations as accepted or rejected.</p>
          <p>From another point of view, the threshold helps the user to visually spot relations
with marginal values, evidencing most probably similar and dissimilar relations.</p>
          <p>After accepting or rejecting a chord the related relation will be green or red due to
its similarity value been set to 1 or 0 respectively. This prevents accepted and rejected
chord color changes as the threshold is being readjusted.</p>
          <p>The value can then be reset to its original value at will and CutChordGraph will
keep track of all accepted, rejected and reset relations during the whole session. This
can be especially useful when relations are many and the updating task spans over
several sessions.</p>
        </sec>
        <sec id="sec-4-10-2">
          <title>4.1.2.2. Acceptation of chords</title>
          <p>Recording feedback from the user is another important feature of the tool. It can be
done by clicking on a single relation. That switches the current acceptance value of the
relation assigning to it the minimum or maximum value coloring the relative chord
accordingly. Despite the change, the original value is memorized by OntoChord.</p>
          <p>Acceptation, rejection and reset of chords is done by hovering them and clicking a,
r and s .</p>
        </sec>
        <sec id="sec-4-10-3">
          <title>4.1.2.3. Filter on chords</title>
          <p>To better work on big alignments, CutChordGraph implements a filter for accepted
and rejected chords, in order to free the view from unnecessary relations.</p>
        </sec>
        <sec id="sec-4-10-4">
          <title>4.1.3. Hierarchy Graphs</title>
          <p>The features comprising all the interactions with the single ontologies are not
immediately available and can be accessed by hovering and pressing g over a relation.</p>
          <p>That will spawn the hierarchical graphs of all the entities of ontologies A and B.
Due to the graph dimensions and the fact that end users can be interested in deeply
understand interrelations among a few specific concepts, only a subgraph of the
hierarchies is initially shown: the entity nodes that make up the selected relations, its parent
entities and its child entities.</p>
          <p>The overall hierarchy is totally available and different nodes can be inspected both
through the graphs itself when an adjacent node is clicked or by pressing g over a
different relation of the CutChordGraph. While the hierarchy is meant to aid the user in
gathering information about the entities deemed similar, the graphs are an overall
hierarchy view per se. That means the user can also navigate a single ontology graph (even
in those nodes that are not present in the alignment), thus evaluating the alignment in
light of a wider context.</p>
          <p>The hierarchy tool is very flexible, allowing a dynamic popup view of entities with
many child or parent nodes (Figure 4). The aim of the hierarchy tool is to help users in
deciding whether they should consider entities as similar basing the decision on a
different kind of information.</p>
          <p>Very interconnected hierarchies are manageable by the Ontochord GUI thanks to
the subgraph-like fashion in which it displays the entity nodes. In this example of the
figure the number of subclasses exceeds the default limit of 3, but they can be still
inspected using navigation arrows.</p>
          <p>To assess the functionality of the tool in the field of biomedicine, we hereby show
in Figure 5 the graphical interface of OntoChord with the alignment between the AEO
(Anatomical Entity Ontology: http://obofoundry.org/ontology/aeo.html) and the
DDANAT (Dictyostelium Discoideum Anatomy:
http://obofoundry.org/ontology/ddanat.html).
ties.</p>
          <p>•
•</p>
          <p>Once most trivial similarities have been validated by the end-user, the available
space can be freed from unnecessary chords, making it easier to manage less connected
entities. Even when considering a very dense CutChordGraph, relations can be safely
selected thanks to the top panel that shows which chord the cursor is hovering.</p>
          <p>At the same time, a Bottom-left popup will show the current state of the relation
(Figure 6).</p>
        </sec>
        <sec id="sec-4-10-5">
          <title>4.1.3.1. Comparison of entities’ properties</title>
          <p>To add even more useful data to the context, the user can see entity nodes’
properLeft-clicking on nodes opens a table showing all the properties of that entity in
ontology A and B and highlights differences between them (Figure 7).</p>
        </sec>
      </sec>
      <sec id="sec-4-11">
        <title>Indeed, the table is comprised of 3 sections:</title>
        <p>• Properties shared by the related entities in ontology A and B whose values are
identical.</p>
        <p>Properties shared by the related entities in ontology A and B whose values are
different.</p>
      </sec>
      <sec id="sec-4-12">
        <title>Properties missing in ontology A but present in B, or viceversa.</title>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Future development</title>
      <p>In order to manage the matching between big ontologies, OntoChord will be
provided with a double threshold filter. Using a double cursor slider bar, the user will be
able to set the value range of the relations he wants to show. As an example, the user
will be able to choose to see just the relations that have a similarity value included in
the range [0.8,1.0] to reduce the numbers of chords and entities showed.</p>
      <p>In any case OntoChord by itself will automatically reduce the number of entities
showed if it exceeds a predefined threshold to avoid browser’s memory overload.</p>
    </sec>
    <sec id="sec-6">
      <title>6. Conclusions</title>
      <p>In this paper, we presented a tool for ontology alignment visualization called
OntoChord. that has been implemented as part of the GENOMA framework but can be
also used as a stand-alone service. The novelty of the tool is the use of a Cut Chord
Graph to show the similarity matrix resulting from the matching operation. This kind of
visualization gives to the user a good overview of the similarity relations existing
between the ontologies matched and, at the same time, through the interactive features of
the tool, provides the user with good details and also the opportunity to edit the graph
returning a feedback on each relation.</p>
      <p>The thickness of the chord depends on the similarity value of the link. This feature
allows the user to give a quick glance at the level of importance of the relation at hand.
Furthermore, the user can also set an acceptance threshold that paints the chord green if
its similarity value is over the threshold and red otherwise.</p>
      <p>The tool is also provided with some features that can return important information
regarding the structure of the ontologies matched. The hierarchy graphs give an idea of
the context of the entities matched and further information related to the comparison of
their properties. This view is a key feature for the visualization of alignments of
biomedical ontologies where knowledge is predominantly structured in taxonomies based
on subclass_of and part_of relationships. OntoChord is able to show also complex
hierarchies focusing the attention of the user to the two matched entities’ neighbors,
where it is most likely to find correspondences.</p>
    </sec>
    <sec id="sec-7">
      <title>Refererences</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Aumueller</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Do</surname>
          </string-name>
          , H.-H.,
          <string-name>
            <surname>Massmann</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Rahm</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Schema and ontology matching with COMA++</article-title>
          .
          <source>SIGMOD '05 Proceedings of the 2005 ACM SIGMOD international conference on Management of data</source>
          (pp.
          <fpage>906</fpage>
          -
          <lpage>908</lpage>
          ). Baltimore,
          <string-name>
            <surname>MD</surname>
          </string-name>
          , USA: ACM.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Enea</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pazienza</surname>
            ,
            <given-names>M. T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Turbati</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>GENOMA: GENeric Ontology Matching Architecture</article-title>
          .
          <source>AI*IA 2015 Advances in Artificial Intelligence</source>
          (pp.
          <fpage>303</fpage>
          -
          <lpage>315</lpage>
          ). Ferrara, Italy: Springer.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Ham</surname>
            ,
            <given-names>F. v.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Wijk</surname>
            ,
            <given-names>J. J.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <source>Interactive Visualization of Small World Graphs. Proc. of IEEE Symposium on Information Visualization</source>
          <year>2004</year>
          (pp.
          <fpage>199</fpage>
          -
          <lpage>206</lpage>
          ). CSPRess.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Komarek</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pavlik</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sobeslav</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Network Visualization Survey</article-title>
          . 7th International Conference,
          <string-name>
            <surname>ICCCI</surname>
          </string-name>
          <year>2015</year>
          (pp.
          <fpage>275</fpage>
          -
          <lpage>284</lpage>
          ). Madrid: Springer.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Krzywinski</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schein</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Birol</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Connors</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gascoyne</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horsman</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , . . .
          <string-name>
            <surname>Marra</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Circos: an Information Aesthetic for Comparative Genomics</article-title>
          .
          <source>Genome Research</source>
          ,
          <fpage>1639</fpage>
          -
          <lpage>1645</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Lanzenberger</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sampson</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>AlViz - A Tool for Visual Ontology Alignment</article-title>
          .
          <source>Information Visualization</source>
          ,
          <year>2006</year>
          .
          <article-title>IV 2006</article-title>
          . Tenth International Conference on. London, United Kingdom.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stroe</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Cruz</surname>
            ,
            <given-names>I. F.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <source>Interactive Visualization of Large Ontology Matching Results. 14th International Semantic Web Conference (ISWC).</source>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N. F.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>The PROMPT suite: interactive tools for ontology merging and mapping</article-title>
          .
          <source>International Journal of Human-Computer Studies</source>
          ,
          <fpage>983</fpage>
          -
          <lpage>1024</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>