<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Real Time Summarization and Visualization of Ontology Change in Protégé</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Christopher Ochs</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>James Geller</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mark A. Musen</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yehoshua Perl</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>NJIT</institution>
          ,
          <addr-line>Newark NJ 07102</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Stanford University</institution>
          ,
          <addr-line>Stanford, CA 94305</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <fpage>75</fpage>
      <lpage>86</lpage>
      <abstract>
        <p>Property restrictions play an important definitional role in an ontology. The correct introduction and inheritance of restrictions is important for ensuring the correct modeling of a domain. Many ontologies have large, complex class hierarchies, and many classes are defined with restrictions. When editing such an ontology, it is often difficult to determine the global impact of a local change. For example, removing a subclass link (axiom) can result in the unintentional loss of inherited restrictions over many levels. In this paper, we introduce a dynamic summarization and visualization methodology, called a Live Difference Taxonomy (LDT), to succinctly display a summary of the effects of changes to the ontology. LDTs are created on-the-fly as the ontology is edited, allowing an ontology developer to view the overall impact of their changes in a compact, visual display. We introduce an open-source plugin for the Protégé ontology editor that implements LDTs. It lets the users choose from several kinds of LDT summaries and lets them control the degree of summarization. The LDT Plugin supports heuristics-based alerts that inform the user of changes to sets of classes that are modeled with the same types of restrictions.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology change visualization</kwd>
        <kwd>ontology summarization</kwd>
        <kwd>Protégé plugin</kwd>
        <kwd>Live Difference Taxonomy</kwd>
        <kwd>dynamic ontology visualization</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        In Web Ontology Language (OWL) ontologies, property restrictions are used to place
constraints on class descriptions [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Property restrictions express semantic
relationships between classes and they play a critical role in the reasoning process. A
restriction consists of a property (e.g., an object property) and a range (e.g., a class),
along with other constraints (e.g., someValuesFrom). In a previous analysis of the
biomedical ontologies hosted on the NCBO BioPortal we found that restrictions are
widely used in class definitions [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] (i.e., 279/373=74.8% ontologies included object
property restrictions and 123/373=33.0% included data property restrictions).
      </p>
      <p>Many ontologies have thousands of classes, each of which may have several
property restrictions. While editing a large and complex ontology, it can be difficult to
identify the global impact that one local change, or a sequence of changes, has on the
ontology’s structure. For example, removing an asserted superclass can affect the
inheritance of restrictions and removing a restriction may affect the inferred class
hierarchy. Identifying incorrect and unwanted changes is an important step in
ensuring the quality of an ontology. The goal of this research is to develop a
principlebased software tool that displays the global effect of local ontology editing operations.</p>
      <p>
        Various diff techniques, which identify changes (“differences”) between two
releases of an ontology, have been developed (e.g., PromptDiff [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and OWLDiff [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]).
These tools typically only identify individual changes (e.g., additions of asserted
restrictions). They do not identify the overall impact of a set of changes and do not
provide details about the implicit changes that occur at other classes (e.g., inferred
descendants). Ochs et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] identified these and other deficiencies in previous ontology
diff techniques and they introduced diff partial-area taxonomies to address them.
      </p>
      <p>Definition: A difference partial-area taxonomy (“diff taxonomy” for short)
visually summarizes changes to subhierarchies of structurally similar ontology classes.</p>
      <p>
        We have used diff taxonomies [
        <xref ref-type="bibr" rid="ref5 ref6 ref7">5-7</xref>
        ] to analyze changes in several ontologies (e.g.,
NCIt [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], SNOMED CT [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]). We were able to identify incorrect and unintended
changes in these ontologies. One major deficiency of diff taxonomies, however, is
that they need to be applied in an a posteriori change analysis process. Previously,
diff taxonomies could only be created from two fixed versions of an ontology.
      </p>
      <p>
        In this paper, we introduce Live Difference Taxonomies (“LDTs”), which are diff
taxonomies created on-the-fly while an ontology is edited. LDTs dynamically
summarize and visualize changes to the introduction and inheritance of restrictions in an
ontology. To integrate LDTs into the ontology development workflow, we have
developed a Plugin for Protégé [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Using this plugin, an ontology developer is
provided with a visual summary that captures the overall impact of a set of local changes.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Background</title>
      <p>
        Various diff techniques have been developed to identify changes between two
ontology releases. Examples include PromptDiff [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], OWLDiff [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], and Ecco [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. These
tools display a list of individual changes or display changes in the indented hierarchy
view of an ontology. Lambrix et al. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] describe a set of functional requirements for
tools that visualize ontology evolution. As described below, the LDT technique
addresses several of the requirements identified by Lambrix et al. (e.g., summarization
of changes, identification of dependent changes, and change metrics).
      </p>
      <p>
        Ochs et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] introduced a graphical, summary-based ontology diff technique
called a difference partial-area taxonomy (or diff taxonomy), which visually
summarizes changes to sets of structurally and semantically similar classes (i.e., those
modeled with similar restrictions). We will now briefly describe, using Fig 1, how diff
taxonomies are derived using an example based on the Pizza Ontology [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. The
complete derivation algorithm for diff taxonomies was described by Ochs et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>Definition: A diff area is a summary of changes to a set of classes that are all
modeled with restrictions that utilize the same property types.</p>
      <p>For example, we are starting with the ontology in Fig 1(a) and apply several
changes, resulting in the ontology in Fig 1(b). Fig 1(c) shows a succinct summary,
using a diff taxonomy, of these changes. The black box (in the middle) in Fig 1(c)
summarizes two classes that had no changes to their restrictions.
Fig 1. (a) A small ontology with six classes. Pizza and Deep Dish Pizza are modeled with Has
crust someValuesFrom restrictions. (b) The ontology from (a) after several changes were
applied. A subhierarchy of pizza toppings, modeled without restrictions, was added. Deep Dish
Pepperoni Pizza was added as a subclass of Deep Dish Pizza and with a Has topping
someValuesFrom restriction with a range of Pepperoni. (c) The diff taxonomy for going from (a) to (b).</p>
      <p>The green (bottom) box in Fig 1(c) “summarizes” one class that was added to the
ontology when going from Fig 1(a) to Fig 1(b), and it is modeled using restrictions
with two property types. The three “outside” boxes in Fig 1(c) are diff areas. Seven
classes without restrictions (without red arrows, and without ancestors with red
arrows) in Fig 1(b) are summarized by Thing (7) in Fig 1(c).</p>
      <p>Definition: The state of a diff area is one of {unmodified, modified, introduced,
removed}, depending on the differences in the set of classes of this diff area between
two ontology releases.</p>
      <p>For example, consider the set of classes in Fig 1 without restrictions (i.e., they have
no “outgoing” red arrows and none of their ancestor classes has an outgoing red
arrow). This set changed when three pizza topping classes were added to the ontology
(and the pizza topping classes have no restrictions). Thus, the diff area for the set of
classes with no restrictions is modified, since the set of classes is different in Fig 1(a)
and Fig 1(b). A modified area is color-coded with a yellow border.</p>
      <p>The set of classes modeled with only Has crust restrictions did not change between
the two releases, thus, the diff area {Has crust} is unmodified (black box). In Fig 1(b)
there is a new class Deep Dish Pepperoni Pizza, which inherits a Has crust restriction
from its superclass and introduces a new Has topping restriction. In Fig 1(a) there are
no classes with both Has crust and Has topping restrictions. Thus, the diff area
containing Deep Dish Pepperoni Pizza is introduced (border color: green). A diff area is
removed when there are no longer any classes with a given set of properties used in
restrictions (examples will be shown in Fig 2 and Fig 3).</p>
      <p>Within each diff area there may be one or more subhierarchies of classes that are
(or were, in the case of removed areas) modeled with the same set of property types.
In Fig 1(c), each diff area only has one such subhierarchy. However, there may be
several subhierarchies in an area. In such a case, there would be several “inner boxes”
in an “outer box.” We will now formalize this idea.</p>
      <p>Definition: A root class of a diff area is a class where none of its superclasses
exists in the same diff area.</p>
      <p>In Fig 1, Pizza is a root in {Has crust} and Deep Dish Pepperoni Pizza is a root in
the introduced area {Has crust, Has topping}. The classes in a diff area are
structurally similar, since they all have restrictions with the same types of properties. Classes in
a diff area are semantically similar when they are descendants of the same root class.</p>
      <p>Subhierarchies in a given diff area will change, in terms of the set of classes in
these subhierarchies, when an ontology is modified. For example, adding another
subclass of Pizza, Thin Crust Pizza, modeled with no additional restrictions, will
result in the set of Pizza classes with only Has crust restrictions changing. We capture
this idea in the following definition.</p>
      <p>Definition: A diff partial-area is a summary of changes to the set of classes in a
specific subhierarchy inside of a diff area.</p>
      <p>In Fig 1(c), Thing (7), Pizza (2), and Deep Dish Pepperoni Pizza (1) are the diff
partial-areas derived from the differences between Fig 1(a) and Fig 1(b). Fig 4 below
will show examples of several diff areas that contain multiple diff partial-areas.</p>
      <p>Definition: The state of a diff partial-area is one of {unmodified, modified,
introduced, removed}, according to the difference in the set of classes in the subhierarchy
between two releases (just like for a diff area).</p>
      <p>Thing (7) is a modified diff partial-area, as the subhierarchy of classes with no
restrictions under Thing had three additional pizza topping classes added. Pizza (2) is
unmodified, as there were no additional descendants of Pizza with only Has crust
restrictions added, and Deep Dish Pepperoni Pizza (1) is an introduced diff
partialarea, since there was previously no Deep Dish Pepperoni Pizza class and there were
no subhierarchies of classes with Has crust and Has topping restrictions in Fig 1(a).</p>
      <p>Diff partial-areas highlight changes to the introduction of additional property types
used in restrictions. The root class of a diff partial-area has at least one additional type
of property in a restriction in comparison to all of its superclasses. Diff partial-areas
also highlight changes to the inheritance of restrictions, as all of the classes in a diff
partial-area inherit or refine the restrictions of the root class (e.g., the Deep Dish
Pizza’s Has Crust restriction has a range of Deep Dish, more refined then Pizza Crust).</p>
      <p>Definition: A diff taxonomy is a diagram of all of the diff areas and diff
partialareas derived from two releases of the same ontology. It summarizes the structural
and semantic changes that occurred when going from the old to the new release.</p>
      <p>Diff taxonomies provide a summary of changes that highlights significant
differences in the introduction and inheritance of restrictions, while hiding other
information (e.g., lists of changes to individual classes).</p>
      <p>Diff taxonomies are represented as graphical diagrams as follows. Diff areas are
shown as boxes with a bold outline, labeled with the set of properties used in
restrictions. Diff areas are organized into levels according the number of property types.
The box of a diff area is black for unmodified, yellow for modified, green for
introduced, and red for removed. For example, in Fig 1(c), the diff area for the set of
classes with no restrictions is outlined in yellow, since it is modified.</p>
      <p>Diff partial-areas are shown embedded in their respective diff areas. Each diff
partial-area is labeled with the name of the subhierarchy’s root class and the number of
classes in the subhierarchy (in parenthesis) in the current ontology release. The fill
color of diff partial-areas is white for unmodified, and the same as for areas otherwise.</p>
      <p>Thus, diff taxonomies visually identify changes to the introduction and inheritance
of restrictions (according to the types of properties in the restrictions; Fig 1(c)). For
example, the introduced partial-area Deep Dish Pepperoni Pizza (1), with a green
background in a green bordered diff area, identifies a new combination of properties
used in restrictions in the ontology. The diff partial-area of Pizza classes in the diff
area Has crust did not change, as it has a white fill in a diff area with a black outline.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Methods</title>
      <p>Given an ontology O, we define Obefore as O prior to a sequence of changes being
applied. Similarly, we define Oafter as O after one or more changes have been applied.
For the example, Fig 1(a) is Obefore and Fig 1(b) is Oafter. Diff taxonomies summarize
the changes between Obefore and Oafter. In our previous research, both Obefore and Oafter
had to be completely known. This requirement severely limited the utility of diff
taxonomies, as they could not be applied dynamically during the ontology development
process. In this section, we describe how we overcame this limiting restriction.</p>
      <p>We define a Live Difference Taxonomy (LDT) as a diff taxonomy that is updated
dynamically, as changes are applied to its underlying ontology. Given a sequence of n
changes C = {c1, c2, c3, …, cn} an LDT highlights the effect of each change
immediately in a visual manner (following the graphical scheme described in the Key of Fig
1). The development of LDTs required significant enhancements to the diff taxonomy
methodology, which we will now describe in detail.
3.1</p>
      <sec id="sec-3-1">
        <title>Fixed-point LDT and Progressive LDT</title>
        <p>As changes are applied, an ontology developer may be interested in viewing the
overall effects of a sequence of changes or the intermediate effects of every individual
change. To accommodate these different needs we define two types of LDTs:</p>
        <p>A Progressive LDT is an LDT that shows the effects of exactly one change. Given
a change c, in a Progressive LDT, Obefore is the ontology before c was applied and
Oafter is the ontology after c was applied. Using a Progressive LDT will show the
intermediate effects of each change. Fig 2 illustrates a series of six changes and the six
corresponding Progressive LDTs, starting with the class Thing only, and no
restrictions.
Fig 2. An example of a Progressive LDT, where, for each change {c1, c2, c3, …, c6}, the
ontology is shown to the left and the corresponding Progressive LDT to the right.
Fig 3. An example of a Fixed-Point LDT, using Obefore in Fig 2 as the starting point. For each
change in Fig 2, the Fixed-Point LDT is shown.</p>
        <p>A Fixed-Point LDT is an LDT generated according to a selected “starting point” s,
which defines Obefore. All changes prior to s are ignored. As each change is applied,
the LDT is updated to capture the effects of the whole sequence of changes up to the
current change. When deriving a Fixed-Point LDT Oafter is the ontology resulting from
the sequence of changes up to the current change. A Fixed-Point LDT, thus,
summarizes the overall effects of several changes. Fig 3 illustrates the sequence of
FixedPoint LDTs for the same sequence of six changes, again starting with Thing only.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Subsets of Live Difference Taxonomies</title>
        <p>For large ontologies it may be impractical, or undesirable, to view an LDT for the
complete ontology. An ontology developer may only be interested in specific parts of
the ontology or in specific change operations. We have developed four such
specialized LDTs which we will now describe.</p>
        <p>Subhierarchy LDT: An ontology developer may want to focus on changes in a
specific subhierarchy of classes (e.g., only the Pizza Topping subhierarchy). In a
Subhierarchy LDT a class c is selected and the subhierarchy of classes rooted at c is used
when deriving the LDT.</p>
        <p>Property Type and Use LDT: An ontology developer may only be interested in
the changes of a specific type of restriction (e.g., a restriction with an object property
or a restriction with a data property). Restrictions may be used in different ways. Uses
include restrictions that appear as superclasses and restrictions that appear in class
equivalences (i.e., as necessary conditions or as necessary and sufficient conditions).
Further refinements (e.g., only someValuesFrom or allValuesFrom) are also possible.
In a Property Type and Use LDT a type of property and a use of that property, are
selected. The LDT is derived using only the restrictions that meet the selected criteria;
all other restrictions are ignored.</p>
        <p>Property Subset LDT: A developer may only be interested in restrictions that
utilize a certain subset of property types (e.g., only restrictions with the Has crust
property). In a Property Subset LDT a subset of properties is selected and the LDT is
derived using restrictions that utilize these selected properties.</p>
        <p>Combinations of the above three LDTs can be expressed by a developer to specify
subset(s) of an ontology, from which an LDT is derived and displayed. This will
allow the developer to focus in on small, specific areas of the ontology that are of
interest. Given the large size of ontologies such as NCIt and SNOMED CT, such focusing
mechanisms are essential. Lastly, when deriving an LDT, an ontology developer may
only be interested in specific kinds of changes.</p>
        <p>Change Type LDT: In a Change Type LDT a subset of diff areas and diff
partialareas is selected according to their state. An ontology developer can create a display
containing only introduced areas. A Change Type LDT allows an ontology developer
to focus on specific types of changes in the LDT. For example, in Fig 3, only green
(i.e., introduced) diff areas and green diff partial-areas would appear in this case.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Asserted LDTs and Inferred LDTs</title>
        <p>In prior research we derived diff taxonomies using an ontology’s inferred class
hierarchy, as we were interested in how classes changed from the perspective of an end
user. However, ontology developers modify the asserted axioms of an ontology. Thus,
it is necessary to provide an LDT view that can also capture changes to the asserted
class hierarchy. For each of the above-described LDT types, the asserted class
hierarchy or the inferred class hierarchy can be utilized as the starting point.
3.4</p>
      </sec>
      <sec id="sec-3-4">
        <title>Protégé LDT Plugin</title>
        <p>
          Protégé [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] is a widely used software tool for editing OWL ontologies. To integrate
LDTs into the ontology development workflow, we have designed and implemented a
plugin for Desktop Protégé. The LDT Plugin provides an interactive, graphical
display for LDTs. Whenever a user makes a change to the ontology in Protégé, the LDT
Plugin immediately displays the corresponding LDT. Using the LDT Plugin,
developers can immediately see the impact of the changes as they affect the ontology. The
plugin was developed using components from the Ontology Abstraction Framework
(OAF) [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], our software framework for creating visual summaries of ontologies, the
OWL API [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ], and Protégé’s APIs.
        </p>
        <p>Unlike the Ontology Abstraction Network (OAF) software tool, which shows
ontology summaries in a full screen display, the Live Difference Taxonomy Plugin was
designed to be included anywhere in the Protégé user interface. A user may even
include multiple LDT displays on one Protégé tab, e.g., one for an Asserted LDT and
one for an Inferred LDT, or one for a Subhierarchy LDT and another one for a
Property Type and Use LDT.</p>
        <p>The guiding design principle for the LDT Plugin was the minimization of
information displayed to avoid information overload of the user. The options menus were
also designed to enable one-click functionality (e.g., for resetting the starting point of
a Fixed-Point LDT, switching between different types of LDTs, and switching
between asserted and inferred axioms).</p>
        <p>
          LDT-based Alerts: According to the type(s) of changes applied to an ontology,
and the resulting LDT, we can define various heuristics that can be used to alert
ontology developers to potentially unintended consequences of their changes. These
heuristics are partially based on findings from our previous change analysis [
          <xref ref-type="bibr" rid="ref5 ref6 ref7">5-7</xref>
          ] of
NCIt, SNOMED CT, etc.
        </p>
        <p>
          For example, in NCIt we found [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] that when a class moves to the special diff area
for classes with zero restrictions in an Inferred LDT, this may be unintended, as the
class previously had at least one restriction (either an asserted restriction or an
inherited restriction) and now it has none. If an ontology developer did not explicitly remove
the restriction from the class, the LDT plugin can display an alert that identifies the
details of the change. It is up to the developer to undo or keep the change.
        </p>
        <p>Source code: The Live Difference Taxonomy plugin is provided as open source
software on the GitHub web site (https://github.com/NJITSABOC/oaf-protege) and
reference implementations of the algorithms for the above LDT types are available in
the source code.</p>
        <p>
          In SNOMED CT we identified [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] significant (unintended) changes in the
ontology’s inferred hierarchy after a subset of classes had their asserted modeling changed.
These unintended changes were captured as over 100 introduced partial-areas that
contained only classes with no changes in their asserted axioms. When introduced and
removed diff partial-areas appear in an Inferred LDT, and none of the classes in the
diff partial-areas were edited by the developer, the changes exposed by the LDT may
have been unintentional, and the ontology developer should be alerted.
Fig 5. (a) LDT change details for the introduced area {hasCrust, hasTopping}. (b) LDT change
details for Pizza introduced partial-area, showing LDT state of more/less refined diff
partialareas. (c) Change explanation for AmericanHotPizza(1) introduced partial-area.
4
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Results</title>
      <p>Live Difference Taxonomies, and Subset LDTs, have been implemented in the
Protégé LDT Plugin. The Protégé LDT Plugin is available as open source software. A beta
version of the plugin is available at http://saboc.njit.edu/software.php for Protégé 5.</p>
      <p>Fig 4 shows the user interface of the LDT Plugin with the Pizza Ontology. The
LDT displayed in this example is an Asserted Fixed-Point LDT after hasCrust
restrictions were added to Pizza and its descendants. At the bottom left of the plugin the
LDT options panel is displayed. From this options panel a user can reset the starting
point for a Fixed-Point LDT, choose between Fixed-Point LDTs and Progressive
LDTs (Section 3.1), toggle the use of inferred axioms (after a reasoner had been
applied; Section 3.3), and choose to view a subset of an LDT (Section 3.2).</p>
      <p>Clicking on any diff area (“outer box”) or diff partial-area (“inner box”) provides
a menu for obtaining information about it and more details about what it represents.
Fig 5(a) shows details for the diff area {hasCrust, hasTopping}. Fig 5(b) shows
details for the set of classes with hasCrust and hasTopping restrictions.</p>
      <p>When selecting an LDT diff area or diff partial-area, a list of ontology changes that
affected its classes can also be displayed. For example, for each class in the
{hasCrust, hasTopping} diff area, the addition of the hasCrust restriction caused the diff
area, and its diff partial-areas, to be introduced. The plugin identifies the addition of
the hasCrust restriction on Pizza, and its inheritance by its descendants, as the cause
for the introduction of the diff area and diff partial-areas (Fig 5(c)).</p>
      <p>Selecting a class from within Protégé will center the LDT Plugin view on the diff
area that contains the selected class. Similarly, selecting a class from within the LDT
Plugin display will display the selected class in the Protégé editor. This allows a user
to quickly transition between the Protégé view and the LDT Plugin view.</p>
    </sec>
    <sec id="sec-5">
      <title>Discussion and Future Work</title>
      <p>
        As part of a long-term research project, we have developed various types of ontology
summaries called abstraction networks [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] to compactly visualize the structure and
semantics of an ontology. In this paper, we have extended this notion from abstraction
networks of ontologies to dynamic abstraction networks of changes in ontologies.
While we have previously investigated diff taxonomy abstractions networks, those
were always static. The algorithms for deriving such abstractions networks had to be
applied a posteriori to two fixed versions of an ontology.
      </p>
      <p>Live Difference Taxonomies, and the development of the Protégé LDT Plugin, are
important steps toward (1) creating dynamic, visual summaries of an ontology’s
structure and how that structure changes, (2) integrating abstraction networks (and
abstraction-network-based methodologies) into the ontology development workflow, and (3)
developing software tools for dynamic ontology summarization.</p>
      <p>LDTs allow an ontology developer to zero in on the effects of changes
immediately after making them and let her/him identify incorrect and inconsistent changes in the
asserted and inferred relationships in the ontology and, ideally, correct them. This
study has covered the underlying theory and implementation of the LDT Plugin. We
are planning evaluation studies to investigate the usability of the Plugin user interface
and its efficacy for enabling the correction of errors during ontology development.</p>
      <p>One issue we are currently investigating is the scalability of the LDT user interface
and derivation methodology to large ontologies. In terms of the user interface, the
subset LDTs described in this paper can control the amount of information displayed
on screen. We are investigating a heuristic-based system for automatically creating
subset LDTs that focus-in on the most important changes in a large ontology.</p>
      <p>The current LDT derivation methodology requires two copies of the ontology
(Obefore and Oafter). For very large ontologies, with tens of thousands of classes, this causes
slowdowns in the LDT Plugin, (i.e., when creating inferred LDTs, as the entire
ontology has to be reasoned before the inferred LDT is derived). Optimizations for large
ontologies will be investigated during the continued development of the LDT Plugin.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusions</title>
      <p>Live Difference Taxonomies dynamically summarize, in a visual way, changes to the
introduction and inheritance of restrictions in an ontology. Several types of LDTs can
be derived using both asserted and inferred axioms. An LDT Plugin for Protégé was
described and is available for download. Any changes of the ontology in Protégé are
dynamically reflected in the Live Difference Taxonomy displayed in its own tab.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgements</title>
      <p>We thank Hao Liu and Kevyn Jaremko for their contributions to the LDT Plugin.
Research reported in this publication was supported by the National Cancer Institute
of the National Institutes of Health under Award Number R01 CA190779. The
content is solely the responsibility of the authors and does not necessarily represent the
official views of the National Institutes of Health.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Motik</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <article-title>OWL 2 Web Ontology Language Structural Specification and Functional Style Syntax</article-title>
          .
          <fpage>W3C</fpage>
          --
          <source>World Wide Web Consortium</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Ochs</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zheng</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , et al.
          <article-title>Utilizing a structural meta-ontology for familybased quality assurance of the BioPortal ontologies</article-title>
          .
          <source>J Biomed Inform</source>
          .
          <year>2016</year>
          ;
          <volume>61</volume>
          :
          <fpage>63</fpage>
          -
          <lpage>76</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>Promptdiff: A fixed-point algorithm for comparing ontology versions</article-title>
          .
          <source>AAAI/IAAI</source>
          <year>2002</year>
          .
          <year>2002</year>
          :
          <fpage>744</fpage>
          -
          <lpage>50</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Kremen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smid</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kouba</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          <article-title>OWLDiff: A Practical Tool for Comparison and Merge of OWL ontologies</article-title>
          .
          <source>22nd International Workshop on Database and Expert Systems Applications</source>
          .
          <year>2011</year>
          :
          <fpage>229</fpage>
          -
          <lpage>33</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Ochs</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perl</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Geller</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , et al.
          <article-title>Summarizing and Visualizing Structural Changes during the Evolution of Biomedical Ontologies Using a Diff Abstraction Network</article-title>
          .
          <source>Journal Of Biomedical Informatics</source>
          .
          <year>2015</year>
          ;
          <volume>56</volume>
          :
          <fpage>127</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Perl</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ochs</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coronado</surname>
          </string-name>
          , S. d., et al.
          <article-title>Visualizing the “Big Picture” of Change in NCIt's Biological Processes</article-title>
          . ICBO.
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Ochs</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Case</surname>
            ,
            <given-names>J. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perl</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <article-title>Analyzing Structural Changes in SNOMED CT's Bacterial Infectious Diseases Using a Visual Semantic Delta</article-title>
          .
          <string-name>
            <given-names>J Biomed</given-names>
            <surname>Inform</surname>
          </string-name>
          .
          <year>2017</year>
          :
          <fpage>101</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Fragoso</surname>
            , G., de Coronado,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haber</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , et al.
          <article-title>Overview and utilization of the NCI thesaurus</article-title>
          .
          <source>Comp Funct Genomics</source>
          .
          <year>2004</year>
          ;
          <volume>5</volume>
          (
          <issue>8</issue>
          ):
          <fpage>648</fpage>
          -
          <lpage>54</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Stearns</surname>
            ,
            <given-names>M. Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Price</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Spackman</surname>
            ,
            <given-names>K. A.</given-names>
          </string-name>
          , et al.
          <article-title>SNOMED clinical terms: overview of the development process and project status</article-title>
          .
          <source>Proc AMIA Annu Symp</source>
          .
          <year>2001</year>
          :
          <fpage>662</fpage>
          -
          <lpage>6</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          <article-title>The protégé project: a look back and a look forward</article-title>
          .
          <source>AI Matters</source>
          .
          <year>2015</year>
          ;
          <volume>1</volume>
          (
          <issue>4</issue>
          ):
          <fpage>4</fpage>
          -
          <lpage>12</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Gonçalves</surname>
            ,
            <given-names>R. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          <article-title>Ecco: A Hybrid Diff Tool for OWL 2 ontologies</article-title>
          . OWLED.
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Lambrix</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dragisic</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ivanova</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          , et al.
          <article-title>Visualization for Ontology Evolution</article-title>
          .
          <source>VOILA</source>
          .
          <year>2016</year>
          :
          <fpage>54</fpage>
          -
          <lpage>67</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>A Practical Guide to Building OWL Ontologies Using Protege 4</article-title>
          and
          <string-name>
            <surname>CO-ODE Tools</surname>
          </string-name>
          : University of Manchester;
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Ochs</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Geller</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perl</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          , et al.
          <article-title>A Unified Software Framework for Deriving, Visualizing, and Exploring Abstraction Networks for Ontologies</article-title>
          .
          <source>J Biomed Inform</source>
          .
          <year>2016</year>
          ;
          <volume>62</volume>
          :
          <fpage>90</fpage>
          -
          <lpage>105</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bechhofer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <article-title>The OWL API: A Java API for Working with OWL 2 Ontologies</article-title>
          . OWLED.
          <year>2009</year>
          ;
          <volume>529</volume>
          :
          <fpage>11</fpage>
          -
          <lpage>21</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Halper</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gu</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perl</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          , et al.
          <article-title>Abstraction Networks for Terminologies: Supporting Management of “Big Knowledge”</article-title>
          .
          <source>Artificial intelligence in medicine</source>
          .
          <year>2015</year>
          ;
          <volume>64</volume>
          (
          <issue>1</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>