<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>WebProtege: a Web-based Development Environment for OWL 2 Ontologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Matthew Horridge</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tania Tudorache</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Csongor Nyulas</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mark Musen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Stanford Biomedical Informatics Research Group Stanford University</institution>
          ,
          <addr-line>California</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We present the latest version of WebProtege: a free, opensource Web-based tool for editing OWL ontologies. WebProtege allows users to create, upload, share and collaboratively edit OWL ontologies. It contains various tools that are designed to support collaborative editing processes, including issue discussion, complete change tracking support and watches. Besides providing complete OWL 2 editing capabilities, WebProtege also features a default simpli ed user interface that is targeted at OWL neophytes. This simpli ed interface, which we have designed using empirical techniques, o ers a quick and easy way to edit commonly used OWL 2 axiom and class constructors. In this paper we describe these features and the main ideas behind the tool. WebProtege is available for use at http://webprotege.stanford.edu.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>WebProtege is a web-based, multi-user, collaborative editing environment for
OWL ontologies. It is perhaps best thought of as a kind of \GoogleDocs" for
ontologies. We use this analogy because WebProtege assumes a very similar
application model: When a user logs in they see a list of the ontologies that they
own or the ontologies that other WebProtege users have shared with them. They
can control who can view, comment on and edit their ontologies, thus they can
share ontologies with collaborators for editing or viewing. They can also make
an ontology completely public so that it can be viewed and commented on by
anyone who visits WebProtege.</p>
      <p>
        While WebProtege has been around for some time|the rst version was
made available around 2008 [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]|this latest version was released in 2013 and is
a complete rewrite. The major change is that WebProtege is now underpinned by
the OWL API [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], it now has complete support for editing OWL 2 ontologies [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ],
and it now features a simpli ed user interface that is designed to be used by OWL
neophytes [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>In this paper, we present the main motivation for WebProtege, we
examine features that are salient for editing OWL 2 ontologies, and we discuss our
roadmap and planned features for the system.</p>
    </sec>
    <sec id="sec-2">
      <title>WebProtege Overview</title>
      <p>When a user logs into WebProtege they are presented with a list of the projects
that they either own, or for which they have editing, commenting or viewing
rights. A project is essentially a set of ontologies plus metadata, sharing settings
and user interfaces settings. Users create their own projects, which are hosted
on our servers at Stanford (http://webprotege.stanford.edu).1 They either
start by creating a new ontology, or they start by uploading a set of existing
ontologies that they have already worked on. Having created a project, a user
can then \share" it, adding the names of collaborators to the list of those who
can edit it, comment on it, or view it.</p>
      <p>The default WebProtege user interface is shown in Figure 1. In essence it
consists of a series of tabs that provide links to pre-con gured perspectives. Each
perspective consists of a layout of views known as portlets. Each portlet presents
a speci c portion of the ontologies in a project or information about a project.
For example, the class hierarchy portlet displays the asserted class hierarchy (left
hand side of Figure 1), the entity description portlet displays information about
the selected entity (middle pane in Figure 1), while the notes and discussions
portlet displays issues that pertain to the selected entity (right hand side of
Figure 1).
1 Users can also set up local WebProtege installations if they have a desire to do
so. For more details see the link to the admin guide at https://github.com/
protegeproject/webprotege/</p>
      <p>A key feature of the WebProtege user interface is that project owners are able
to con gure their projects with custom perspectives and custom layouts within
these perspectives. This means that other users see these layouts by default when
they view the project in question. Furthermore, each user is able to override a
project con guration in order to satisfy their own tastes and to meet the needs of
the tasks that they personally have to accomplish. One bene t to this approach
is that di erent con gurations can be used to suit di erent groups of users that
may have di erent levels of expertise in OWL.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Revision-based Change Tracking</title>
      <p>Structured change tracking support, which records the changes made to
ontologies in a project, is built into the core of WebProtege. Changes are recorded as
axiom additions and removals using structures borrowed from the OWL API.
Metadata about each axiom change set is also recorded, in particular, the
author, the timestamp of the change, and a high level comment that describes
the change. High level comments are either automatically generated by the user
interface, and are thus related to a user interface operation for example \Added
A as a subclass of B", or they may be manually speci ed in the form of commit
comments.</p>
      <p>The change history can be viewed in a number of ways including viewing
changes over a particular time period, viewing changes made by a particular
author, or viewing changes that a ect a particular entity (class, property,
individual etc.). Figure 2 shows an example of the \changes by entity" portlet, which
groups together changes that are syntactically related to the selected entity.</p>
      <p>
        The change tracking support also facilitates revision based history control.
For a given project, it is possible to retrieve the ontology changes that are
associated with a speci c revision of that project. Although WebProtege does not
currently feature the ability to produce a di between two versions of an
ontology, the revision based change support allows prior versions of ontologies to be
downloaded and compared in external di tools such as Ecco [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], Bubbastis [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]
or the OWL di erence engine [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>Finally, in relation to change tracking support, users can \watch" ontologies
for changes. They can watch changes that a ect the syntactic frame of a speci c
entity, changes that a ect the frames of subclasses of a given class, or watch all
possible changes to an ontology. When changes occur that fall into a scope of a
watch, the user for that watch is noti ed via email.
4</p>
    </sec>
    <sec id="sec-4">
      <title>A Simpli ed User Interface for OWL Neophytes</title>
      <p>Although WebProtege o ers full-blown editing support for OWL 2 ontologies
the default user interface con guration, which a user is presented with when
they create a project, is the simple user interface that is shown in Figure 1.
The display shown in Figure 1 is for editing class descriptions, however similar
displays exists for property and individual descriptions.</p>
      <p>
        This simple interface shows forms that are capable of editing a subset of the
types of axiom and class constructors that are available in OWL 2. The initial
design of this user interface was based on an empirical analysis of commonly
used OWL constructs in a corpus of biomedical ontologies. Over the course
of ve months we analysed the projects that were created by users uploading
existing OWL ontologies into WebProtege in order to analyse the \ t" of the
simple user interface against a wider corpus of (non-biomedical) ontologies. We
found that this UI design captures much of what users need to say while shielding
them from the direct use of class expressions, quanti ers and Manchester syntax
details. A complete description of the design and evaluation of the UI may be
found in our ISWC 2013 paper [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]; we simply present the main ideas here.
      </p>
      <p>The simpli ed user interface that we have developed is shown as the centre
pane in Figure 1 and an enlarged view is shown in Figure 3. The particular
UI shown here is the main editing form for class frames. The form is
composed of elds which constitute tables of property{value pairs. The elds feature
auto-completion for property, class, individuals and datatype names. The
autocompletion is type sensitive: it will o er only the types of entities that can be
entered based on the information in the ontology up to this point. For example,
the auto-completion prevents the user from entering datatypes as llers for
object property restrictions. In terms of OWL, one row in the table corresponds
to one or more axioms. In the example in Figure 3, the row hasFlightControlSystem
and FlyByWireSystem corresponds to the axiom SubClassOf(:A320,
ObjectSomeValuesFrom(:hasFlightControlSystem :FlyByWireSystem)).</p>
      <p>
        A key feature of this simpli ed UI is that it minimises the distinctions that
users have to make explicitly. For example, in previous versions of the tool [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ],
when a user created a new property, they had to decide explicitly whether the
property was an object or a data one. Similarly, when entering class expressions
Fig. 3: Property{value pairs being edited. The class frame in the gure contains mixed
object and data property usage. It also contains a mix of ObjectSomeValuesFrom,
ObjectHasValue and DataHasValue class expressions. The auto-completion box prompts the
user to create new entities where necessary. We eliminated the need to choose explicitly
between object and data properties; we determine property types based on ller values.
the user had to make various choices such as choosing between SomeValuesFrom and
AllValuesFrom restrictions, and between SomeValuesFrom and HasValue restrictions.
In this simpli ed UI, we use simple and reliable heuristics to determine the
type of property and the type of restriction that the user creates based on the
llers that she speci es. Figure 3 displays a class description that has mixed
use of data and object properties. It also contains mixed use of di erent types
of class expressions, individuals, and data values: the rst row corresponds to
an ObjectSomeValuesFrom class expression whose ller is a class, the second row
an ObjectHasValue class expression whose ller is an individual, and the third row
a DataHasValue class expression whose value is an integer literal. At no point
when entering the information shown in Figure 3 has the user explicitly had
to decide upon and choose the types of class expressions, or decide upon and
choose the types of properties|the system determines these distinctions in a
straightforward but highly e ective way.
      </p>
      <p>Finally, this UI also supports a kind of on-the- y object creation and type
inference. In the fourth row in Figure 3 the user wants to specify a new type of
ap for the class (aircraft) they are describing. However, hasFlap is a new property
name. In this case, the system accepts the new property name, warns the user
that it is new (in case the user has simply made a typo) and allows them to move
on to specify a ller. In this case, the user speci es a new class (DoubleSlottedFlap).
Once they enter this information, WebProtege creates the necessary declarations
of the appropriate type and generates the class expressions and axioms under
the hood.</p>
      <p>
        In addition to editing logical information, WebProtege provides support for
describing extra-logical information about entities through OWL annotations.
These annotations are part of the class frame (Figure 1). WebProtege provides
auto-completion support that allows users to reuse annotation vocabulary from
well known metadata sets such as DublinCore and SKOS [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] (Figure 1).
5
      </p>
    </sec>
    <sec id="sec-5">
      <title>Complete Editing Support for OWL 2 Ontologies</title>
      <p>
        At the other end of the scale from the simpli ed UI, WebProtege provides
complete syntactic editing support for OWL 2 ontologies. One of the main changes
in this latest version of WebProtege is that it underpinned by the OWL API|
the de-facto standard API for working with OWL 2 ontologies. This means that
WebProtege \natively" supports OWL 2 both on the back-end and on the
frontend. Indeed, the user interface can be con gured with components that allow
OWL 2 entity frames to be edited. Descriptions are presented using a slightly
extended version of the Manchester OWL Syntax [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The extensions, which are
minor, allow source ontologies in an imports closure to be speci ed for sets of
axioms. For example, in Figure 4, the syntax \[in root-ontology]" speci es that
associated annotation assertions and subclass axioms reside in the project root
ontology (the root of the project imports closure). This small extension allows
axioms to easily be moved between ontologies in an imports closure.
      </p>
      <p>Figures 4, 5 and 6 show di erent aspects of the main view for full-blown
OWL 2 entity description editing. As can be seen, WebProtege supports
integrated development environment (IDE) style code editing. It o ers many of the
standard code features that are expected of IDEs.</p>
      <p>Auto-completion As a user types in expressions they can invoke the
autocompletion facility (Figure 4) so that they can easily re-use existing entity names
and built in keywords. Auto-completion is context sensitive so that it only
offers names corresponding to entity types that can be entered into the current
location.</p>
      <p>Error checking and on-the- y object creation Descriptions of entities
are checked as a user enters them into the editing area. If unrecognised entity
names are encountered they are highlighted in red (Figure 5). Unlike the desktop
version, WebProtege allows inline entity creation. For example, in Figure 5, the
user has typed hasRange, but this name is not recognised as it is not bound to an
existing entity. At this point the user can decide that hasRange is indeed a new
entity and they can choose to create it on the y|in this case as a data-property.
Change committing Once a user has nished editing the description of an
entity they can choose to \commit" the changes to the project so that other
users can see them. As shown in Figure 6, they can either choose to commit the
changes with or without a high level comment. This allows users to elaborate
on the reasons for multiple, possibly complex changes in the context of a change
to an entity description. If a user chooses not to explicitly commit changes they
will be auto-committed when the selected entity changes.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Form-based Ontology Editing</title>
      <p>
        Another major feature of the UI, which has successfully been used in a very large
project that is producing the next version of the International Classi cation of
Diseases [
        <xref ref-type="bibr" rid="ref14 ref15">14, 15</xref>
        ], is that it can display ne-grained customised Web-forms for
editing descriptions of entities and for instance acquisition. An example of such
a form is shown in Figure 7. The form is created with a markup language that
allows the layout of widgets to be speci ed along with a description of how these
widgets should behave with respect to the underlying ontology.
      </p>
      <p>In contrast to the forms in Protege 3, which are automatically generated
from the TBox in an ontology, the forms in WebProtege are designed by hand
and manually linked to the underlying ontology. While this requires some
initial setup, we have found that there are several bene ts to this loosely coupled
approach. In particular, the underlying ontology does not need to be polluted
with a tangled mess of expressive axioms or baroque modelling choices in order
to get \the forms to come out right". For example, it is not necessary to make a
property functional in order to make the form display radio buttons instead of
check boxes, or a drop down box instead of a list box. Similarly, domains need
not be speci ed in order to get entry elds for properties on a form, and ranges
need not be speci ed to restrict values for a form eld to speci c entities in an
ontology.
7</p>
    </sec>
    <sec id="sec-7">
      <title>Current and Future Work</title>
      <p>Reasoning support Our top priority at the moment is OWL reasoner
integration. We intend to o er cloud-based reasoning to support to projects that
require it (resource permitting). The end functionality will be similar to the
functionality that is o ered in the desktop suite. That is, WebProtege will allow
users to check the consistency of ontologies in their project, all users to view an
entailed class and property hierarchies, and entailed types for individuals. We
Fig. 7: A sample of some of the forms used to edit the International Classi cation
of Diseases (ICD) ontology. The forms are created using a markup language, which
speci es the form controls to use, the layout and how to bind these controls to the
underlying ontology. This lose coupling o ers a great deal of exibility.
will also support DL queries in a similar manner to the DL query tab in the
desktop version.</p>
      <p>We envisage that, at least by default, users will not interact with a
reasoner directly. Instead, a reasoner will be enabled for a project and it will run
in the background, with consistency checking and satis ability checking being
performed automatically against each project revision. As users perform edits
the reasoner will automatically catch up and users will be able to query against
the latest revision that has been processed by the reasoner.</p>
      <p>
        Integration with third party tools such as GitHub In the software
engineering world the software \Git" is rapidly becoming the tool of choice for
version control and collaborative software engineering projects. GitHub2 is a
social coding website that hosts Git-based projects and provides tools such as wikis,
release pages and issue trackers. While GitHub primarily hosts software projects,
it is also used by some ontology authors in the Biomedical Ontology Community
for hosting ontology-based projects. For example, the Uber Anatomy Ontology
(UBERON) project [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] is hosted on GitHub.3 Projects such as UBERON take
advantage of the GitHub's social coding tools, in particular issues trackers, and
also use it to keep track of previous versions. Given the rising popularity of
GitHub-based ontology projects, it is our intention to provide some kind of
integration with tools like GitHub. In particular, we imagine that project releases
could be pushed from WebProtege to an associated GitHub repository and that
GitHub issue trackers could also be linked to from within WebProtege.
Support for di erent ontological sources Recent work on tools such as
RightField [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], Populous [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and Tawny OWL [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] has taken a somewhat di erent
approach to ontology editing for domain experts than traditional tools such
as Protege. Rather than having domain experts directly edit and manipulate
ontologies in ontology editors, these tools have them edit raw source material
for ontologies, which then gets \compiled" into OWL. This raw source material
has take the form of spreadsheets and comma separated value (CSV) les in
tools such as RightField and Populous, and in the case of Tawny-OWL it has
taken the form of a particular dialect of the Clojure programming language. We
believe that this kind of approach has certain advantages over direct ontology
manipulation. In particular, domain experts can work with tools such as
MSExcel that they have experience with and are comfortable working with; they can
perform bulk manipulation or bulk data entry if working with spreadsheet like
tools; and nally, the translation to OWL can be speci ed in a stando way that
can be re-run, altered, optimised and experimented with in order to produce an
end ontology that meets application requirements. While WebProtege currently
supports a form of bulk data entry whereby users can work in Excel and import
the resulting spreadsheets and CSV les into the system, we intend to evolve
this idea so that multiple di erent source le formats can be used. We can also
imagine that data entered through WebProtege forms could be stored in its
rawdata state, which could later be compiled into OWL, thus allowing a exible
translation process. Ultimately, we envisage that any translation and import
process will be declaratively speci ed using a tool such as Mapping Master [
        <xref ref-type="bibr" rid="ref11 ref12">12,
11</xref>
        ].
8
      </p>
    </sec>
    <sec id="sec-8">
      <title>Availability and Uptake</title>
      <p>WebProtege is open source and freely available at http://webprotege.stanford.
edu. We encourage potential users to take advantage of this hosted solution as it
can be used with zero setup costs. Furthermore, we have a strict privacy policy;
2 http://www.github.com
3 https://github.com/obophenotype/uberon
we regularly update it in a seamless fashion so that it has the latest bug xes
and features; and we provide nightly project backup.</p>
      <p>At the time of writing the version of WebProtege hosted at http://webprotege.
stanford.edu contains just over 10,000 ontology projects. While there are many
small ontologies, the largest ontologies that have been loaded into the system
are hundreds of thousands of axioms in size and there are projects that have
tens of thousands of changes.</p>
      <p>For users who are unable to use our hosted solution, WebProtege is also
freely available for download from our GitHub site: http://www.github.com/
protegeproject/webprotege. It can be set up on a local network, which is
convenient for users working behind a corporate rewall, for example.</p>
      <p>Finally, WebProtege is written using the Google Web Toolkit. All code and
developer documentation is available on our GitHub site.</p>
      <p>Acknowledgements This work was supported by Grants GM103316 and
R01GM086587 from the National Institute of General Medical Sciences of the
United States National Institutes of Health.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Thomas</given-names>
            <surname>Baker</surname>
          </string-name>
          , Sean Bechhofer, Antoine Isaac, Alistair Miles, Guus Schreiber, and Ed Summers.
          <article-title>Key choices in the design of simple knowledge organization system (SKOS)</article-title>
          .
          <source>Journal of Web Semantics</source>
          ,
          <volume>20</volume>
          :
          <fpage>35</fpage>
          {
          <fpage>49</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Rafael</surname>
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Goncalves</surname>
            , Bijan Parsia, and
            <given-names>Ulrike</given-names>
          </string-name>
          <string-name>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>Ecco: A hybrid di tool for OWL 2 ontologies</article-title>
          . In Pavel Klinov and Matthew Horridge, editors,
          <source>Proceedings of OWL: Experiences and Directions Workshop</source>
          <year>2012</year>
          , volume
          <volume>849</volume>
          <source>of CEUR Workshop Proceedings</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Melissa</given-names>
            <surname>Haendel</surname>
          </string-name>
          , James P. Balho , Frederic B.
          <string-name>
            <surname>Bastian</surname>
          </string-name>
          , David C.
          <article-title>Blackburn, Judith A</article-title>
          .
          <string-name>
            <surname>Blake</surname>
          </string-name>
          , Yvonne Bradford, Aurelie Comte,
          <string-name>
            <surname>Wasila M. Dahdul</surname>
            , Thomas Dececchi, Robert E. Druzinsky, Terry F. Hayamizu, Nizar Ibrahim,
            <given-names>Suzanna E.</given-names>
          </string-name>
          <string-name>
            <surname>Lewis</surname>
          </string-name>
          ,
          <string-name>
            <surname>Paula M. Mabee</surname>
            , Anne Niknejad, Marc Robinson-Rechavi,
            <given-names>Paul C.</given-names>
          </string-name>
          <string-name>
            <surname>Sereno</surname>
            , and
            <given-names>Christopher J.</given-names>
          </string-name>
          <string-name>
            <surname>Mungall</surname>
          </string-name>
          .
          <article-title>Uni cation of multi-species vertebrate anatomy ontologies for comparative biology in uberon</article-title>
          .
          <source>Journal of Biomedical Semantics</source>
          ,
          <volume>5</volume>
          :
          <fpage>21</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Matthew</given-names>
            <surname>Horridge</surname>
          </string-name>
          and
          <string-name>
            <given-names>Sean</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          .
          <article-title>The OWL API: A Java API for OWL ontologies</article-title>
          .
          <source>Semantic Web</source>
          ,
          <volume>2</volume>
          (
          <issue>1</issue>
          ):
          <volume>11</volume>
          {
          <fpage>21</fpage>
          ,
          <year>February 2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Matthew</given-names>
            <surname>Horridge</surname>
          </string-name>
          , Nick Drummond, John Goodwin, Alan L. Rector, Robert Stevens, and
          <string-name>
            <given-names>Hai</given-names>
            <surname>Wang</surname>
          </string-name>
          .
          <article-title>The Manchester OWL syntax</article-title>
          . In Bernardo Cuenca Grau, Pascal Hitzler, Conor Shankey, and Evan Wallace, editors,
          <source>OWLED</source>
          , volume
          <volume>216</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Matthew</given-names>
            <surname>Horridge</surname>
          </string-name>
          , Tania Tudorache, Jennifer Vendetti, Csongor Nyulas,
          <string-name>
            <given-names>Mark A.</given-names>
            <surname>Musen</surname>
          </string-name>
          , and Natalya Fridman Noy.
          <article-title>Simpli ed OWL ontology editing for the Web: Is WebProtege enough</article-title>
          ? In Harith Alani et al, editor,
          <source>International Semantic Web Conference (1)</source>
          , volume
          <volume>8218</volume>
          of Lecture Notes in Computer Science, pages
          <volume>200</volume>
          {
          <fpage>215</fpage>
          . Springer,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Simon</given-names>
            <surname>Jupp</surname>
          </string-name>
          , Matthew Horridge, Luigi Iannone, Julie Klein, Stuart Owen, Joost Schanstra, Katy Wolstencroft, and
          <string-name>
            <given-names>Robert</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Populous: a tool for building OWL ontologies from templates</article-title>
          .
          <source>BMC Bioinformatics</source>
          , 13(S-1):
          <fpage>S5</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Phillip</given-names>
            <surname>Lord</surname>
          </string-name>
          .
          <article-title>The semantic web takes wing: Programming ontologies with TawnyOWL</article-title>
          . In Mariano Rodriguez-Muro,
          <string-name>
            <given-names>Simon</given-names>
            <surname>Jupp</surname>
          </string-name>
          , and Kavitha Srinivas, editors,
          <source>Proceedings of the 10th International Workshop on OWL: Experiences and Directions (OWLED</source>
          <year>2013</year>
          )
          <article-title>co-located with 10th Extended Semantic Web Conference (ESWC</article-title>
          <year>2013</year>
          ), Montpellier, France, May
          <volume>26</volume>
          -27,
          <year>2013</year>
          , volume
          <volume>1080</volume>
          . CEURWS.org,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>James</given-names>
            <surname>Malone</surname>
          </string-name>
          , Ele Holloway, Tomasz Adamusiak, Misha Kapushesky, Jie Zheng, Nikolay Kolesnikov, Anna Zhukova, Alvis Brazma, and
          <string-name>
            <given-names>Helen</given-names>
            <surname>Parkinson</surname>
          </string-name>
          .
          <article-title>Modelling sample variables with and experimental factor ontology</article-title>
          .
          <source>Bioinformatics</source>
          ,
          <volume>26</volume>
          (
          <issue>8</issue>
          ):
          <volume>1112</volume>
          {
          <fpage>1118</fpage>
          ,
          <string-name>
            <surname>March</surname>
          </string-name>
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Boris</surname>
            <given-names>Motik</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peter F. Patel-Schneider</surname>
          </string-name>
          ,
          <article-title>and Bijan Parsia. OWL 2 Web Ontology Language structural speci cation and functional style syntax</article-title>
          .
          <source>W3C Recommendation</source>
          , W3C { World Wide Web Consortium,
          <year>October 2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Martin J. O'Connor</surname>
            ,
            <given-names>Christian</given-names>
          </string-name>
          <string-name>
            <surname>Halaschek-Wiener</surname>
            , and
            <given-names>Mark A.</given-names>
          </string-name>
          <string-name>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>M2: A language for mapping spreadsheets to OWL</article-title>
          . In Evren Sirin and Kendall Clark, editors,
          <source>OWLED</source>
          , volume
          <volume>614</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Martin J. O'Connor</surname>
            ,
            <given-names>Christian</given-names>
          </string-name>
          <string-name>
            <surname>Halaschek-Wiener</surname>
            , and
            <given-names>Mark A.</given-names>
          </string-name>
          <string-name>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>Mapping master: A exible approach for mapping spreadsheets to OWL</article-title>
          . In Peter F.
          <string-name>
            <surname>Patel-Schneider</surname>
            , Yue Pan, Pascal Hitzler,
            <given-names>Peter</given-names>
          </string-name>
          <string-name>
            <surname>Mika</surname>
            , Lei Zhang, Je
            <given-names>Z.</given-names>
          </string-name>
          <string-name>
            <surname>Pan</surname>
          </string-name>
          , Ian Horrocks, and Birte Glimm, editors,
          <source>International Semantic Web Conference (2)</source>
          , volume
          <volume>6497</volume>
          of Lecture Notes in Computer Science, pages
          <volume>194</volume>
          {
          <fpage>208</fpage>
          . Springer,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>Timothy</given-names>
            <surname>Redmond and Natalya F. Noy</surname>
          </string-name>
          .
          <article-title>Computing the changes between ontologies</article-title>
          . In Vit Novacek, Zhisheng Huang, and Tudor Groza, editors,
          <source>EvoDyn 2011 Knowledge Evolution and Ontology</source>
          Dynamics., volume
          <volume>784</volume>
          <source>of CEUR Workshop Proceedings</source>
          . CEUR-WS.org,
          <year>October 2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Tania</surname>
            <given-names>Tudorache</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sean M. Falconer</surname>
          </string-name>
          , Natalya Fridman Noy, Csongor Nyulas, Tevk Bedirhan Ustun,
          <string-name>
            <surname>Margaret-Anne D. Storey</surname>
            , and
            <given-names>Mark A.</given-names>
          </string-name>
          <string-name>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>Ontology development for the masses: Creating ICD-11 in webprotege</article-title>
          .
          <source>In Philipp Cimiano and Helena So a Pinto</source>
          , editors,
          <source>EKAW</source>
          , volume
          <volume>6317</volume>
          of Lecture Notes in Computer Science, pages
          <volume>74</volume>
          {
          <fpage>89</fpage>
          . Springer,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Tania</surname>
            <given-names>Tudorache</given-names>
          </string-name>
          , Csongor Nyulas, Natalya Fridman Noy, and
          <string-name>
            <given-names>Mark A.</given-names>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>Using semantic web in ICD-11: Three years down the road</article-title>
          . In Harith Alani et al, editor,
          <source>International Semantic Web Conference (2)</source>
          , volume
          <volume>8219</volume>
          of Lecture Notes in Computer Science, pages
          <volume>195</volume>
          {
          <fpage>211</fpage>
          . Springer,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Tania</surname>
            <given-names>Tudorache</given-names>
          </string-name>
          , Csongor Nyulas, Natalya Fridman Noy, and
          <string-name>
            <given-names>Mark A.</given-names>
            <surname>Musen. WebProtege</surname>
          </string-name>
          :
          <article-title>A collaborative ontology editor and knowledge acquisition tool for the web</article-title>
          .
          <source>Semantic Web</source>
          ,
          <volume>4</volume>
          (
          <issue>1</issue>
          ):
          <volume>89</volume>
          {
          <fpage>99</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Tania</surname>
            <given-names>Tudorache</given-names>
          </string-name>
          , Jennifer Vendetti, and Natalya Fridman Noy.
          <article-title>WebProtege: A lightweight owl ontology editor for the web</article-title>
          . In Catherine Dolbear, Alan Ruttenberg, and Ulrike Sattler, editors,
          <source>OWLED</source>
          , volume
          <volume>432</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Katy</surname>
            <given-names>Wolstencroft</given-names>
          </string-name>
          , Stuart Owen, Matthew Horridge, Wolfgang Muller, Finn Bacall, Jacky L. Snoep, Franco du Preez, Quyen Nguyen, Olga Krebs, and
          <string-name>
            <surname>Carole</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Goble</surname>
          </string-name>
          .
          <article-title>Right eld: Scienti c knowledge acquisition by stealth through ontologyenabled spreadsheets</article-title>
          .
          <source>In Annette ten Teije</source>
          et al, editor,
          <source>Knowledge Engineering and Knowledge Management - 18th International Conference, EKAW</source>
          <year>2012</year>
          ,
          <string-name>
            <given-names>Galway</given-names>
            <surname>City</surname>
          </string-name>
          , Ireland, October 8-
          <issue>12</issue>
          ,
          <year>2012</year>
          . Proceedings, volume
          <volume>7603</volume>
          of Lecture Notes In Computer Science, pages
          <volume>438</volume>
          {
          <fpage>441</fpage>
          . Springer,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>