<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>User and Developer Interaction with Editable and Readable Ontologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Aisha Blfgeh</string-name>
          <email>a.blfgeh1@newcastle.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Phillip Lord</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Faculty of Computing and Information Technology, King Abdulaziz University</institution>
          ,
          <addr-line>Jeddah</addr-line>
          ,
          <country country="SA">Saudi Arabia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Computing Science, Newcastle University</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The process of building ontologies is a difficult task that involves collaboration between ontology developers and domain experts and requires an ongoing interaction between then. This collaboration is made more difficult, because they tend to use different tool sets, which can hamper this interaction. In this paper, we propose to decrease this distance between domain experts and ontology developers by creating more readable forms of ontologies, and further to enable editing in normal office environments. Building on a programmatic ontology development environment, such as Tawny-OWL, we are now able to generate these readable/editable from the raw ontological source and its embedded comments. We have this translation to HTML for reading; this environment provides rich hyperlinking as well as active features such as hiding the source code in favour of comments. We are now working on translation to a Word document that also enables editing. Taken together this should provide a significant new route for collaboration between the ontologist and domain specialist.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 INTRODUCTION</title>
      <p>
        Ontologies are wide-spread in the field of biology and biomedicine,
as they facilitate the management of knowledge and the integration
of information, as in the Semantic Web
        <xref ref-type="bibr" rid="ref3">(Bermejo, 2007)</xref>
        .
Additionally, biological data are not only heterogeneous but also
require complex domain knowledge to be dealt with
        <xref ref-type="bibr" rid="ref15">(Stevens et al.,
2000)</xref>
        . Therefore, ontologies are useful models for representing
this complex knowledge that is potentially changing and are
also widely used in biomedicine, examples being the GO (Gene
Ontology)
        <xref ref-type="bibr" rid="ref1">(Ashburner et al., 2000)</xref>
        , SNOMED (Systematized
Nomenclature of Medicine)
        <xref ref-type="bibr" rid="ref7">(IHTSDO, 2016)</xref>
        .
      </p>
      <p>
        However, building an ontology is a challenging task due to the
use of languages with a sophisticated formalism (such as OWL),
especially when combined with a complex domain such as biology
or medicine. Normally ontologies are built as a collaboration
between domain specialists who have the knowledge of the domain
and ontology developers who know how to structure and represent
the knowledge; they have to work together to construct a robust
and accurate ontology. Often, community involvement during the
process of building ontologies using meetings, focus groups and the
like is very important
        <xref ref-type="bibr" rid="ref12">(Mankovskii et al., 2009)</xref>
        , as in GO where
biological community involvement is important for successful
uptake
        <xref ref-type="bibr" rid="ref2">(Bada et al., 2004)</xref>
        . In addition,
        <xref ref-type="bibr" rid="ref5">Bult et al. (2011)</xref>
        state
that the development of Protein Ontology requires wider range of
involvement to include other users and developers of the associated
ontologies (such as GO) to ensure consistent architecture of the
ontology.
      </p>
      <p>Biologists represent, manipulate and share their data in a
widevariety of tools such as Microsoft Excel spreadsheets and Word
documents. Unfortunately, these environments are far removed from
the formal structured representation of the ontology development
environments with which the ontologists work to build ontologies.
As a result of this difference in tools it is unclear how we can bridge
the gap between the the two groups; this would be useful to facilitate
the interaction between domain specialists and ontologists and help
to make more convenient for both sides to read and/or manipulate
the ontology.</p>
      <p>
        Ontology development environments are designed to produce
formal structured representation of any domain. Either using GUI
software such as Prote´ge´ 1 or a textual programmatic environment
such in Tawny-OWL
        <xref ref-type="bibr" rid="ref10">(Lord, 2013)</xref>
        . The next section describes these
tools in more details.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>BUILDING ONTOLOGIES</title>
      <p>
        There are various tools for constructing and developing ontologies
with a variety of user interfaces and environments. The most popular
is Prote´ge´ which is an open-source tool that provides a user interface
to develop and construct ontologies of any domain. It has been
widely used for developing ontologies due to the variety of
plugins and frameworks
        <xref ref-type="bibr" rid="ref13">(Noy et al., 2003)</xref>
        . Prote´ge´ provides an easy
interface for editing, visualisation and validation of ontologies as
well as a useful tool for managing large ontologies
        <xref ref-type="bibr" rid="ref6">(Horridge et al.,
2011)</xref>
        .
      </p>
      <p>
        Conversely, Tawny-OWL is a textual interface for developing
ontologies in a fully programmatic manner
        <xref ref-type="bibr" rid="ref11 ref16 ref17">(Warrender, 2015)</xref>
        .
This provides a convienient and readable syntax which can be
edited directly using an IDE or text editor; in this style of
ontology development, the ontologist ceases to mainpulate an
OWL representation directly, and instead develops the ontology as
programmatic source code. In contrast to developing ontologies in
OWL, the ontologist can introduce new abstractions and syntax as
they choose, whether for general use or specifically for a single
ontology. An OWL version of the ontology can then be generated
as required. It has been implemented in Clojure, which is a dialect
of lisp and runs on the Java Virtual Machine
        <xref ref-type="bibr" rid="ref10">(Lord, 2013)</xref>
        . Like
Prote´ge´, it also wraps the OWL-API
        <xref ref-type="bibr" rid="ref12">(Mankovskii et al., 2009)</xref>
        which performs much of the actual work, including interaction with
reasoners, serialisation and so forth.
      </p>
      <p>
        Recently, we have developed tolAPC ontology using a new
document-centric approach by including an Excel spreadsheet
directly in the development pipeline. The spreadsheet contains all
knowledge for the ontology which has been created and maintained
by a biologist. Meanwhile, we design the ontology patterns using
Tawny-OWL, then generate the axioms by extracting data from
the spreadsheet using Clojure. Thus, Tawny-OWL contains the
1 http://protege.stanford.edu/
spreadsheet as a part of the source code; which can be freely updated
and the ontology regenerated when needed. Hence, it remains as a
part of the ontology development process
        <xref ref-type="bibr" rid="ref4">(Blfgeh et al., 2016)</xref>
        .
      </p>
      <p>In this approach, the Excel spreadsheet is totally developed
by biologists; this has a significant advantage because it is a
tool which they are familiar with and find convenient. However,
we cannot ensure that the programmatic transformation of the
values in the spreadsheet to the final ontology conforms with the
domain specialists understanding, without the biologists reading and
interacting with source code. Therefore, next we will discuss the
probabilities of making this ontological source more readable by
the specialists.
3</p>
    </sec>
    <sec id="sec-3">
      <title>MULTILINGUAL ONTOLOGIES</title>
      <p>The first and most obvious mechanism for increasing ontology
readability is to enable users to read and write the ontology
using their native language. Internationalisation technologies
are widespread and enable support for multiple languages for
applications with a graphical user interface.</p>
      <p>We next consider how we can enable support for multiple
languages in textual user interface such as Tawny-OWL, giving the
ontologist the ability to use their own native language for all parts
of the development process.</p>
      <p>The first option is using polyglot library. This part of the
system mimics a fairly standard technique for internationalisation
of programmatic code; the ontology is developed with a set of
programmatic labels which are then referenced in a language, or
locale bundle with an appropriate translation. In the case of
TawnyOWL, this translation appears as rdfs:label annotations on the
ontology entities (classes, properties etc). This overall process is
shown in Figure 1, placing Italian and Arabic language translations
onto the pizza ontology.</p>
      <p>
        While this may enable internationalisation for users of
the ontology, it does not change the English-centric editing
environment. We would wish, instead, to internationalise the
entire source code of the ontology. This will make the entire
ontology more comprehensible and readable for all developers who
communicate in Italian and/or Arabic. This is fully supported with
a full conversion of the environment using the multilingual feature
of Tawny-OWL as in Figure 2, which shows the English, Italian
and Arabic version of the pizza ontology
        <xref ref-type="bibr" rid="ref9">(Lord, 2012)</xref>
        . The latter
of these is a right-to-left alphabet, and we can use the IDE to
change the direction that Tawny-OWL code is rendered in. This
demonstrates the capability of Tawny-OWL to adapt with any
language. The next language to be implemented will be French.
      </p>
      <p>These multilingual environments are advantageous for being
readable and comprehensible by users when using their own
language. This still leaves us in a programming environment, which
is an environment unlikely to be familiar or comfortable to the most
domain users. Moreover the ontology lacks a narrative structure,
which means that it cannot be read in a literate fashion. We consider
how to enable this in the next section.
4</p>
    </sec>
    <sec id="sec-4">
      <title>LITERATE ONTOLOGIES</title>
      <p>
        The term literate programming was invented by
        <xref ref-type="bibr" rid="ref8">(Knuth, 1992)</xref>
        where the program is treated as a piece of literature rather than
a program. The main idea in this paradigm is to insert text along
with code and the program will also be its own documentation.
The intentionality here is that the program should become easier
to understand and, conversely, that the documentation is less likely
to become out-of-date, as it is maintained in the same place.
      </p>
      <p>As Tawny-OWL is a fully programmatic environment, we can add
comments freely, along with any additional mark-up that we wish.
This enables us to produce different representation of the ontology.</p>
      <p>
        We have previously discussed two examples of literate ontologies:
the first is the Amino Acid Ontology, taken from a previous
ICBO2015 tutorial about Tawny-OWL 2, while the second is a
version of the Karyotype ontology
        <xref ref-type="bibr" rid="ref11 ref16 ref17">(Lord and Warrender, 2015)</xref>
        .
In both cases, they have been produced using the Tawny-OWL
source code, with markup in the comments being interpreted using
a markup processing tool. Figure 3 shows a snippet from the literate
ontology Amino Acids as a webpage. The result appears as a normal
web page, with syntax highlighting for the source code.
2 http://homepages.cs.ncl.ac.uk/phillip.lord/
take-wing/take_wing.html
(a) English Pizza Ontology
(b) Italian Pizza Ontology
(c) Arabic Pizza Ontology
      </p>
      <p>Literate ontologies can be represented in different forms; using
the various techniques for converting the markup text into different
formalisms; webpages for example. Representing the ontology as
an HTML webpage gives us the ability to navigate and browse
the documentation either in order (section by section) or with a
navigation facility (jumping between sections). It is also possible to
hide or expose the “source” sections, leaving the reader to see just
the documentation as appropriate. From the developer perspective,
while the reader may still not be able to see the axiomatization in this
way, the comments that they have checked are embedded directly
next to the code which is an interpretation of them.</p>
      <p>It is interesting to enable specialists to read and navigate through
the ontology and its documentation. However, with HTML there are
no editing facilities to modify and update the ontology. Therefore,
rather than using HTML, we have also investigated the possibility
to turn the whole ontology into a Word document, an environment
which can also be modified, changed or updated. Now biologists
and domain specialists are placed in an environment in which they
can freely provide feedback on an existing ontology simply by
interacting with Word documents.
5</p>
    </sec>
    <sec id="sec-5">
      <title>DISCUSSION</title>
      <p>In this paper, we have described our approach to the translation of
ontologies into a form that domain users can interact with more
naturally.</p>
      <p>We have shown that it is possible to translate a textual
environment like Tawny-OWL into another human language, or
indeed a different script, including right-to-left text. To our
knowledge, this is the first ontology editing environment with such
textual and syntactic flexibility. Despite the fact that the multilingual
ontologies approach is less relevant for scientific ontologies, it is
already applied by some means in some cases of terminologies.
For example, the use of some and only in Tawny-OWL rather
than using universal and existential notations which implies the
agreement for using alternative language for ontology development.</p>
      <p>Further than this, however, we also translate the ontological
source code into alternative visualisations such as HTML and Word
documents which map directly back to the source, but which can
differ from it: for instance, by enabling hyperlinks, adding section
links and hide source code in favour of commentary. Especially
with a Word document, this should enable a novel mechanism for
interacting with an ontology: users can see and edit comments, with
change tracking switched on, and use this as mechanism for feeding
back to the ontology developer.</p>
      <p>
        Using this approach, of course, only enables us to visualise
ontologies developed using Tawny-OWL. While a migration path
is provided
        <xref ref-type="bibr" rid="ref11 ref16 ref17">(Warrender, 2015)</xref>
        , a whole-sale switch to
TawnyOWL is not effort-free. We note, however, that many ontologies
are developed partly in Prote´ge´ and partly using OWL generated
from other sources; a secondarly migratory path would be to use
Tawny-OWL for these sections.
      </p>
      <p>We still need to evaluate this kind of interaction rigorously. For
this, we are proposing a focus group test which will be include
specialists participants to read the document of the ontology and
provide their opinion about it and whether they prefer to update any
terminologies according to their expertise.</p>
      <p>
        We are not proposing that Word documents will be directly used
by domain specialists for editing ontologies. We expect that an
ontologist will be involved with incorporating changes suggested
back to the domain user; in this sense, we are using a Word
document as an intermediate representation
        <xref ref-type="bibr" rid="ref14">(Rector et al., 2001)</xref>
        .
Our hope is that the reviewing features of Word should, however,
enable us to provide a rich environment to support the ontologist
in this process. Taken together, these should provide us with a
significantly enhance process for the knowledge capture, ontology
development and refinement from the process that we currently
have.
      </p>
    </sec>
    <sec id="sec-6">
      <title>ACKNOWLEDGEMENTS</title>
      <p>Thanks to Newcastle university for supporting this research. Also,
thanks to King Abdulaziz University, Jeddah, Saudi Arabia for
funding and supporting the study.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Ashburner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ball</surname>
            ,
            <given-names>C. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blake</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Botstein</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Butler</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cherry</surname>
            ,
            <given-names>J. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Davis</surname>
            ,
            <given-names>A. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dolinski</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dwight</surname>
            ,
            <given-names>S. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eppig</surname>
            ,
            <given-names>J. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harris</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hill</surname>
            ,
            <given-names>D. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>IsselTarver</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kasarskis</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewis</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Matese</surname>
            ,
            <given-names>J. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Richardson</surname>
            ,
            <given-names>J. E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ringwald</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rubin</surname>
            ,
            <given-names>G. M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Sherlock</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Gene ontology: tool for the unification of biology. the gene ontology consortium</article-title>
          .
          <source>Nat Genet</source>
          ,
          <volume>25</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Bada</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goble</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gil</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ashburner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blake</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cherry</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harris</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Lewis</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>A Short Study on the Success of Gene Ontology</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          ,
          <volume>1</volume>
          (
          <issue>2</issue>
          ),
          <fpage>235</fpage>
          -
          <lpage>240</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Bermejo</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>A Simplified Guide to Create an Ontology. ASLab.org</article-title>
          . http://tierra.aslab.upm.es/documents/controlled/ ASLAB-R-2007-004.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Blfgeh</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Warrender</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hilkens</surname>
            ,
            <given-names>C. M. U.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Lord</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>A documentcentric approach for developing the tolapc ontology</article-title>
          . In F. Loebe,
          <string-name>
            <given-names>M.</given-names>
            <surname>Boeker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Herre</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Jansen</surname>
          </string-name>
          , and D. Schober, editors,
          <source>Proceedings of the 7th Workshop on Ontologies and Data in Life Sciences, ODLS</source>
          <year>2016</year>
          ,
          <article-title>organized by the GI Workgroup Ontologies in Biomedicine and Life Sciences (OBML), Halle (Saale</article-title>
          ),
          <source>Germany, September 29-30</source>
          ,
          <year>2016</year>
          ., volume
          <volume>1692</volume>
          <source>of CEUR Workshop Proceedings</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . CEUR-WS.org. http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>1692</volume>
          /paperB.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Bult</surname>
            ,
            <given-names>C. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drabkin</surname>
            ,
            <given-names>H. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evsikov</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Natale</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arighi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roberts</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruttenberg</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>D'Eustachio</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blake</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Wu</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>The representation of protein complexes in the protein ontology (pro)</article-title>
          .
          <source>BMC Bioinformatics</source>
          ,
          <volume>12</volume>
          (
          <issue>1</issue>
          ),
          <fpage>371</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Knublauch</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rector</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wroe</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jupp</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moulton</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drummond</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Brandt</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>A Practical Guide To Building OWL Ontologies Using Prote´ge´ 4 and CO-ODE Tools Edition 1.3</article-title>
          . http://dio.freelabs.net/downloads/ ProtegeOWLTutorialP4{_}v1{_}3.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>IHTSDO</surname>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>International health terminology standards development organisation</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Knuth</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>1992</year>
          ).
          <article-title>Literate Programming</article-title>
          .
          <source>Center for the Study of Language and Information Publication Lecture Notes</source>
          . Cambridge University Press.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Lord</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Tawny-owl pizza</article-title>
          . https://github.com/phillord/ tawny-pizza.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Lord</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>The Semantic Web takes Wing: Programming Ontologies with TawnyOWL</article-title>
          .
          <source>CoRR, abs/1303</source>
          .0. http://arxiv.org/abs/1303.0213.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Lord</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Warrender</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>A highly literate approach to ontology building</article-title>
          .
          <source>abs/1512</source>
          .04250.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Mankovskii</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gogolla</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Urban</surname>
            ,
            <given-names>S. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dietrich</surname>
            ,
            <given-names>S. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Urban</surname>
            ,
            <given-names>S. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dietrich</surname>
            ,
            <given-names>S. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>M.-H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dobbie</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ling</surname>
            ,
            <given-names>T. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Halpin</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kemme</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schweikardt</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abello</surname>
            <given-names>´</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Romero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            ,
            <surname>Jimenez-Peris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Stevens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Lord</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Gruber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Leenheer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. D.</given-names>
            ,
            <surname>Gal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Bechhofer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Paton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. W.</given-names>
            ,
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Buchmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Hardavellas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Pandis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Shapiro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Bellatreche</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Gray</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. M. D.</given-names>
            ,
            <surname>Aalst</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. M. P.</given-names>
            ,
            <surname>Palmer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Palmer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Risch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Galuba</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            ,
            <surname>Girdzijauskas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            , and
            <surname>Bechhofer</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>OWL: Web Ontology Language</article-title>
          .
          <source>In Encyclopedia of Database Systems</source>
          , pages
          <fpage>2008</fpage>
          -
          <lpage>2009</lpage>
          . Springer US, Boston, MA. http://www.springerlink.com/index/10.1007/ 978-0-
          <fpage>387</fpage>
          -39940-9{_}
          <fpage>1073</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N. F.</given-names>
          </string-name>
          , Crube´zy,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Fergerson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. W.</given-names>
            ,
            <surname>Knublauch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Tu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. W.</given-names>
            ,
            <surname>Vendetti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            , and
            <surname>Musen</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. A.</surname>
          </string-name>
          (
          <year>2003</year>
          ). Prote´ge´
          <article-title>-2000: An Open-Source Ontology-Development and Knowledge-Acquisition Environment</article-title>
          .
          <source>AMIA Annu Symp Proc</source>
          ,
          <volume>953</volume>
          , 953. http: //protege.stanford.edu.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Rector</surname>
            ,
            <given-names>A. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wroe</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rogers</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Roberts</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>Untangling taxonomies and relationships: Personal and practical problems in loosely coupled development of large ontologies</article-title>
          .
          <source>In Proceedings of the 1st International Conference on Knowledge Capture, K-CAP '01</source>
          , pages
          <fpage>139</fpage>
          -
          <lpage>146</lpage>
          , New York, NY, USA. ACM.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goble</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <article-title>a</article-title>
          ., and
          <string-name>
            <surname>Bechhofer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Ontology-based knowledge representation for bioinformatics</article-title>
          . Briefings in bioinformatics,
          <volume>1</volume>
          (
          <issue>4</issue>
          ),
          <fpage>398</fpage>
          -
          <lpage>414</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Warrender</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>The Consistent Representation of Scientific Knowledge: Investigations into the Ontology of Karyotypes and Mitochondria</article-title>
          .
          <source>Ph.D. thesis</source>
          , Newcastle University. https://theses.ncl.ac.uk/dspace/
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>bitstream/10443/2910/1/Warrender,J2015.pdf.</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>