<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A document-centric approach for developing the tolAPC Ontology</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Aisha Blfgeh</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jennifer D. Warrender</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Catharien M. U. Hilkens</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Phillip Lord</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Cellular Medicine, Newcastle University</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Computer Science and Information Technology, King Abdulaziz University</institution>
          ,
          <addr-line>Jeddah, Saudia Arabia</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>School of Computing Science</institution>
          ,
          <addr-line>Newcastle University</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>Motivation: There are many challenges associated with ontology building, as the process often touches on many different subject areas; it needs knowledge of the problem domain, an understanding of the ontology formalism, software in use and, sometimes, an understanding of the philosophical background. In practice, it is very rare that an ontology can be completed by a single person, as they are unlikely to combine all of these skills. So people with these skills must collaborate. One solution to this is to use face-to-face meetings, but these can be expensive and timeconsuming for teams that are not co-located. Remote collaboration is possible, of course, but one difficulty here is that domain specialists use a wide-variety of different “formalisms” to represent and share their data - by the far most common, however, is the “office file” either in the form of a word-processor document or a spreadsheet. We consider here, how to use a highly-programmatic and pattern driven development to enable direct incorporation of office technology into the ontology pipeline. Specifically, we are developing an ontology of immunological cell types using spreadsheets. We also consider how this could be extended to other tools and environments. Results: We have developed a new ontology, built by instantiating ontology design patterns written programmatically, using values from a spreadsheet catalogue of cell types. The spreadsheet was developed by domain experts, is unconstrained in its usage and can be freely updated, resulting in a new ontology. This provides a general methodology for working with data generated by domain specialists. Availability: The software tool, Tawny-OWL, is available from http:// github.com/phillord/tawny-owl. The tolAPC ontology is currently not available. * Contact: a.blfgeh1@newcastle.ac.uk, abelfaqeeh@kau.edu.sa</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 INTRODUCTION</title>
      <p>Ontologies have been used extensively to describe many parts
of biology. They have two key features which make their usage
attractive: first, they can provide a mechanism for standardizing and
sharing the terms used in descriptions, and secondly, they provide a
computationally amenable semantics to these descriptions, making
it possible to draw conclusions which are not explicitly stated.</p>
      <p>
        Ontologies are increasingly used to facilitate the management of
knowledge and the integration of information as in the Semantic
Web [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Biological data is not only heterogeneous but requires
special knowledge to deal with and can be large [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. Ontologies
are good for representing complex and potentially changeable
knowledge. Therefore, they are widely used in biomedicine
with examples such as the Gene Ontology [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], ICD-10 [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] or
SNOMED [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] being the best known.
      </p>
      <p>
        However, building an ontology is a challenging task [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
Ontologies use a complex formalism (such as OWL for instance)
especially when modelling complex domain area such as biology or
medicine. Moreover, normally ontology building is a collaboration
between domain specialists and ontology developers. However, any
form of multi-disciplinary collaboration is difficult. In the case, for
example, of the Gene Ontology, these challenges were addressed
through explicit community involvement using meetings, focus
groups and the like [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Other methodologies have adopted a more
distributed approach [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        It is, perhaps, because of these challenges that, despite the
computational advantages of ontologies, the oldest and most
common form of description in biology is free text, or a
semistructured representation through the use of a standardised fill-in
form. These representations have numerous advantages compared
to ontologies: they are richly expressive, widely supported by
tooling and while the form of language used in science (“Bad
English” [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ]) may not be easy to use, understand or learn, it is
widely taught and most scientists are familiar with it. Similarly,
most biologists are familiar with the tools used for producing
freetext and forms, either a word-processor document or a spreadsheet.
Tools for producing this form of knowledge are wide-spread, richly
functional both in application and cloud-delivered form, and support
highly collaborative development.
      </p>
      <p>
        The ontology community, conversely, has largely built its own
tool-chain for development. Tools such as Prote´ge´ are highly
functional in their own right, but have a user interface which is
far removed from those that biologists are used to. There have
been several responses to this problem. First, it is possible to
take existing ontology tools and customize them for use within a
specific community, so that they have a familiar look and feel;
this is the approach taken by iCAT – a version of WebProte´ge´
built explicitly for the ICD-11 community [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. A second approach
is to enable existing ontology tools to ingest office documents;
for example, Cellfie is a Prote´ge´ plugin which can transform a
spreadsheet into an OWL ontology, which can then be developed
further; however this is a one-off process – once ingested, the data
in the spreadsheet is converted into OWL; further updates cannot be
made using the original spreadsheet formalism. Finally, tools such
as RightField [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ] and Populous [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] add ontological features to
office documents, by allowing selection of spreadsheet cells from a
controlled vocabulary, followed by export to OWL using OPPL [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]
to express the patterns used in the transformation [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>
        These tools, however much they support the use of office
software, at some point require leaving this software and moving
into an ontology specific environment. We have developed a new,
highly-programmatic environment for ontology development called
Tawny-OWL [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. With this approach the ontology is developed
as programmatic source code, which is then evaluated to generate
the final ontology, either in memory or as an OWL file. This offers
a new methodology. In this research, we developed a
documentcentric workflow centred on the use of office tooling to construct
the ontology; biologists generate and maintain their dataset in
an unconstrained Excel spreadsheet; we then use this spreadsheet
directly as part of our source code, driven by Tawny-OWL. In
this model, we can apply arbitrary validation and transformation of
the data held in the spreadsheet, into an ontological form. As the
spreadsheet is now part of the source code, rather than being used as
knowledge capture interface, it can be freely updated and the final
ontology regenerated.
      </p>
      <p>In this paper, we describe the application of this methodology to
the generation of a catalogue of immunological cell types, called
the tolAPC catalogue. We discuss the background technology, the
design decisions that we have faced and the general implications
that this approach has for ontology development.
2</p>
    </sec>
    <sec id="sec-2">
      <title>BACKGROUND</title>
      <p>
        The tolAPC catalogue is a list of immunological cell types. It has
been captured as part of the EU Cost Action BM1305 (A-FACTT)
which is aimed at increasing data sharing and collaborative working
across the community [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. These cell types have been “tolerized”
– that is treated so that they suppress the immune response –
and have been created with the intention that they will be used
therapeutically in a variety of situations including: the treatment
of auto-immune disease such as rheumatoid arthritis; or to reduce
rejection following transplantation [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Information about these cells
is, therefore, high value. The tolAPC catalogue contains extensive
details about these cell lines, including 9 “sheets” of data. The
catalogue has been created as an Excel spreadsheet, although it uses
the spreadsheet only to represent tabular information (i.e. there is no
use of equations or calculation in the spreadsheet). The spreadsheet
has been created by individual scientists freely; that is, there is no
formal constraint on the legal set of values in each cell, just the
social convention of copying previous cells.
      </p>
      <p>
        Tawny-OWL is a fully programmatic development environment
for OWL. It has been implemented in Clojure, which is a dialect of
lisp, running on the Java Virtual Machine. It wraps the OWL-API [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
which performs much of the actual work, including interaction with
reasoners, serialisation and so forth. Tawny-OWL has a simple
syntax which was originally modelled on the Manchester OWL
notation [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], modified to conform to standard Clojure syntax and
to increase regularity [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. For example, we can create a new class
with an existential restriction as follows:
(defclass A :super (some r B))
      </p>
      <p>Or, we can define a new individual with a property assertion:
(defindividual i :fact (is r j))</p>
      <p>As a domain specific language embedded in a full programming
language, we also gain all the features of that environment; for
instance, we can create arbitrary patterns simply by using a Clojure
function. Consider for example:
(defn some-only [property &amp; classes]
(list (some property classes)
(only property</p>
      <p>(or classes))))</p>
      <p>Here defn introduces a new function, property &amp; classes
are the arguments, and list packages the return values as a
list. some, only and or1 are defined by Tawny-OWL as the
appropriate OWL class constructors. This allows a definition
specifying an existential relationship with a closure axiom as
follows:
(defclass D :super (some-only r A B))</p>
      <p>We also gain access to the full Clojure infrastructure: we can edit
and evaluate terms in a power editor or IDE 2; write unit tests and
run them through a build tool, publish and version using git, and
continuously integrate our work with other ontologies.</p>
      <p>
        We have previously used this functionality to create the
karyotype ontology which is generated from a series of interlocking
patterns [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ], parameterised using literal data structures in the
source code. The karyotype ontology is highly patternised, with
almost all of the classes coming from a single large pattern.
      </p>
      <p>
        As a full programming environment, Clojure can also read and
parse arbitrary data formats, which can operate as additional source
during the generation of the ontology. We have previously used
this to scaffold a mitochondrial ontology from a varied set of input
files [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ], or to add multi-lingual annotation using key=value
properties files to the pizza ontology. We have also used this
technology with a spreadsheet to specify a set of ontological unit
tests for the karyotype ontology [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. In this case, the values in
the spreadsheet are used to generate a set of OWL classes which
are then checked for correct subsumption using a reasoner. In this
case, however, these ontological statements are used only as part
of a test suite, rather than intended for downstream usage, and the
spreadsheet was created specifically for this purpose.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>BUILDING THE TOLAPC ONTOLOGY</title>
      <p>The data for the tolAPC catalogue was captured directly in a
spreadsheet largely co-ordinately through email. As a pre-existing
resource, it made little sense to rewrite directly in OWL either
using Prote´ge´ or Tawny-OWL– to do so would have resulted in
transcription errors, and made updates more complex. However, as
described in Section 2, we have all the components that we need to
build an ontology directly from a spreadsheet.</p>
      <p>In this section, we describe the issues that have arisen during the
process which can conceptually be split into three phases 3:
1 We have elided namespaces: or and some are also core Clojure functions.
2 We use Emacs but there is rich support in Vim, Eclipse, IntelliJ, or
LightTable
3 In practice, the tolAPC ontology is developed iteratively.</p>
      <sec id="sec-3-1">
        <title>1. Extraction</title>
      </sec>
      <sec id="sec-3-2">
        <title>2. Validation</title>
      </sec>
      <sec id="sec-3-3">
        <title>3. Ontologisation</title>
        <p>
          The extraction phase is straight-forward. Clojure offers a number
of libraries capable of reading a spreadsheet. In the case of the
tolAPC catalogue, we read the spreadsheet using the Docjure
library 4, accessed directly from the file system. It would be simple
and straight-forward to read from a network which would support
building ontologies from cloud hosted spreadsheets. Previously, for
performance reasons, we have read and then cached the results
of tests generated from a spreadsheet [
          <xref ref-type="bibr" rid="ref29">29</xref>
          ]; however, for the
tolAPC catalogue performance is such that the spreadsheet can be
read in full every time the environment is initialised, significantly
simplifying the development.
        </p>
        <p>In the second phase, values extracted are validated against a set of
constraints specifying those which are legal. For many of the fields,
values are highly stereotyped having only a few different options;
for example, cells can either be Autologous or Allogeneic,
while expression levels can either be + or -. Currently, validation is
performed through the use of ad hoc testing – we expect to move
to a more formal data constraint language in future. The choice
of validation depends on the requirements and modelling choices
made, which will be discussed later.</p>
        <p>In the third phase, values are “ontologised”. The top level of
the ontology which provides what we describe as schema terms
is written by hand using Tawny-OWL. In the case of the tolAPC
catalogue, this includes terms such as CellType, Species and
AntigenLoad. Next, a set of patterns is defined using these
schema terms. Finally, these patterns are instantiated using the
values from the second phase, generating entities that we call
patternised terms.</p>
        <p>During the development process, both reasoning and manual
inspection of the created ontology is used to ensure that the process
is happening as expected; for the latter process, the ontology is saved
to file and examined, either in the Clojure development environment
or within Prote´ge´, as shown in Figure 1.</p>
        <p>We next discuss the modelling issues that have arisen.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>MODELLING IN THE TOLAPC ONTOLOGY</title>
      <p>All entities in the ontology need to be represented by an
IRI. Two broad schemes are used to generate IRIs: semantics
free identifiers which are generally numeric; and semantically
meaningful identifiers which are normally derived from the common
name for the entities. Generally, the latter are easier to work with,
while the former are easier to keep stable over releases.</p>
      <p>Currently, for the tolAPC ontology, schema terms have IRIs
which reflect their names (CellType uses an IRI with a fragment
of “CellType”), while patternised terms use an ad hoc schema based
on several of their properties (a single property is not enough to
ensure uniqueness). If we wish to re-evaluate this situation at a later
date, however, Tawny-OWL simplifies the situation; we can easily</p>
      <sec id="sec-4-1">
        <title>4 https://github.com/mjul/docjure</title>
        <p>allocate IRIs to entities according to any scheme that we choose, by
changing a single function.</p>
        <p>
          A recurrent issue in ontology modelling is whether to use
classes or individuals; within the tolAPC ontology, we faced this
question for cell types. There are a number of different criteria
for making this decision [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ]. We considered briefly a “realist”
perspective: modelled as a single entity, cell types are probably
best represented as a metaclass, akin to a taxonomic species [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ];
modelling as multiple entities (differentiating between the protocol
and the cell type produced) would also be possible. However,
there appears to be no clear principle to distinguish between
these options. Similar problems also arise for proteins/cell-surface
markers which are described in the ontology. As an additional
problem, these representations introduce considerable unnecessary
complexity [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ].
        </p>
        <p>We considered therefore the needs of our application: it seems
unlikely that we will ever need subclasses of a cell type, but might
reasonably wish for cell types to be unique – to state that two cell
types are necessarily the same individual. For these reasons, we
model cell types as individuals.</p>
        <p>
          The tolAPC ontology largely models a set of cell types, with the
rest of the ontology designed to support these descriptions. The
ontology, as a result, contains very little hierarchy, and is at the
extreme end of a normalised ontology [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. Cell types are defined
as individuals with a large set of different property assertions, as can
be seen from the following definition:
        </p>
        <p>Here, cell-line, group, loc and others are variables,
therefore, this definition describes a pattern. fromGroup,
hasLocation and others are specific object properties from the
schema terms of the ontology. individual, :fact: and is are
part of Tawny-OWL syntax. The whole definition defines a new cell
type, and its association with a set of individuals.</p>
        <p>The values of the property assertions fall into one of three main
categories.</p>
        <p>Open but Limited: Many properties support a very limited,
but nonetheless open, range of values. Examples of these are
withStartMaterial which describes the tissue or part of the
tissue from which the cells are derived. These values are modelled
as disjoint classes, explicitly stated in the ontology. Although, we
could have used an external ontology at this point, as only a few
options are actually used, we have not imported one. The same
principle applies to Species, as the cells are extracted from only
three species.</p>
        <p>
          Constrained Partition: Many properties support an exact
number of options. These are modelled using a Value Partition [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
Fortunately, Tawny-OWL provides explicit support for this design
pattern, which allows a relatively succinct definition. An example
of this is CellOrigin which is defined as follows:
(defpartition CellOrigin
[[Allogeneic
:comment "Allogeneic is a cell from
        </p>
        <p>a donor blood"]
[Autologous
:comment "Autologous is a cell from</p>
        <p>a patient own blood"]])</p>
        <p>Unconstrained Values: Some properties have unconstrained
values such as Location, Group (i.e. the people responsible for
the cell type) or AntigenLoad. These are currently modelled as
individuals, created on-demand.</p>
        <p>
          In addition to these three main categories, we are adding
phenotype descriptors to the cell types, in terms of raised or lowered
expression levels. For these, we are modelling the expression levels
as a value partition, while the overall phenotype is modelled using
the N-ary relationship pattern [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], as shown in Figure 3.
5
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>DISCUSSION</title>
      <p>In this paper, we have described the development of the tolAPC
ontology, describing data about immunological cell types. This
ontology is unusual in that it is derived directly from another
data resource, the tolAPC catalogue which is maintained as an
Excel spreadsheet. Essentially, the ontology provides context and
semantics to data which is available in another form.</p>
      <p>The value of recasting a spreadsheet into a form with strong
machine interpretable semantics is obvious, but there are less
apparent virtues arising from the process. In the initial validation
step, for example, we have had to clarify parts of the tolAPC
catalogue which are otherwise unclear. For example, one cell-line
is described as “Autologous/Allogeneic”. The original author intent
here is unclear: this could be intended to mean either autologous
or allogeneic (possible), both (probably inconsistent) or just the
absence of knowledge. Similarly the process of ontologisation
forces us to clarify some areas of the biology; including questions
about whether cell types produced by the same protocol at different
times are “the same” or otherwise, which touches on issues of
reproducibility. Where these issues have arisen, either the ontology
schema, patterns or the spreadsheet can be modified accordingly. As
shown in Figure 4, information flows in both directions between the
speadsheet and ontology.</p>
      <p>
        The development of the tolAPC ontology is a work in progress.
As can be seen from Table 1, while parts of the tolAPC catalogue
have been recast, there are significantly more spreadsheet cells
which need to be converted. However, while including machine
interpretable semantics is useful in its own right, we have not yet
addressed the issue of interoperability with other ontologies. For
example, concepts such as “species” and “clinical disease” have
clearly be described in (many) other ontologies. Currently, these
terms are not reused inside the tolAPC ontology. At the current
time, we have not prioritized this process because confidentiality
restrictions on the tolAPC catalogue limit our ability to share the
results anyway. We do not expect the addition of this interoperability
to be complex though, as we can reuse the “scaffolding” process
described previously [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ].
      </p>
      <p>tolAPC Catalogue
tolAPC Ontology</p>
      <p>Number of Sheets
Number of Cells
Number of Cell types
Number of Classes
Number of Individuals
Number of relations</p>
      <p>
        This work is a further demonstration of the value of programmatic
and pattern-driven ontology development using the Tawny-OWL
library; it builds on earlier work on a karyotype ontology where
patterns are instantiated using in-code literal data structures, the
mitochondrial ontology which is scaffolded using a variety of
different input formats, or our reworking of SIO which patternises
a pre-existing ontology [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]. Patternization allows the development
of an ontology to be performed rapidly and repeatedly.
      </p>
      <p>The fully programmatic environment also demonstrates its value,
as we have been able to add a new input format, even a very
complex format such as an Excel spreadsheet with relative ease,
building on tools provided by other people. This validates our earlier
experiences with Tawny-OWL, where we have easily adapted a
complete software development environment to the task of ontology
development.</p>
      <p>The use of Excel spreadsheets to drive ontology patterns is not
new of course; it is directly supported with Prote´ge´ plugins as well
as with tools such as RightField and Populous. The key addition
of our methodology is to incorporate the spreadsheet as a part of
the ontology source code. The spreadsheet can be updated, changed
and consulted with by the domain specialists who created it, and still
remain part of the ontology development process. The importance
of the right format should not be under-estimated; for example,
early versions of the Gene Ontology were developed in their own
bespoke syntax (later to evolve into OBO Format), something
which persisted for a considerable time after the development and
release of OWL. The reasons for this were simple: OBO Format
behaved well in a version control system, and can be easily created,
edited and manipulated in a text editor, something not true of
RDF serialisations of OWL. We wish to build on these lessons:
ontologists should seek to interact and build on the tools that domain
specialists already use, if they hope to describe the knowledge that
these specialists have.</p>
      <p>
        The tolAPC ontology and the document-centric approach it
embodies is a first step toward establishing a richer methodology,
where we interact with domain specialists using their own tool chain
to capture knowledge. While spreadsheets are a first useful step,
we plan to next focus on word processors and, more generally, the
narrative document. It is the most common format for representing
and transferring knowledge – indeed, it is what you are reading now.
Currently, there has been significant interest in recasting scientific
papers into semantic documents [
        <xref ref-type="bibr" rid="ref11 ref16">16, 11</xref>
        ], so that the semantics can
add value to the papers. Conversely, we wish to incorporate these as
part of our ontology development methodology, so that the papers
can add value to our semantics.
      </p>
    </sec>
    <sec id="sec-6">
      <title>ACKNOWLEDGEMENT</title>
      <p>We thank Dr Paloma Riquelme (University Hospital Regensburg)
for help in generating the tolAPC catalogue and participants of the
AFACTT network for providing data for the tolAPC catalogue.</p>
      <p>Funding: COST is part of the EU Framework Programme
Horizon 2020 (action to focus and accelerate cell-based
toleranceinducing therapies, BM1305, http://www.afactt.eu).</p>
      <p>Also, thanks to King Abdulaziz University, Jeddah, Saudia Arabia
for granting a scholarship and supporting the study.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>WHO</given-names>
            <surname>International</surname>
          </string-name>
          <article-title>Classification of Diseases (ICD), 2016 (accessed June 20,</article-title>
          <year>2016</year>
          ). http://www.who.int/ classifications/icd/en/.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M.</given-names>
            <surname>Bada</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Goble</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Gil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ashburner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Blake</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Cherry</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Harris</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Lewis</surname>
          </string-name>
          .
          <article-title>A Short Study on the Success of Gene Ontology</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          ,
          <volume>1</volume>
          (
          <issue>2</issue>
          ):
          <fpage>235</fpage>
          -
          <lpage>240</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M.</given-names>
            <surname>Bada</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Goble</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Gil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ashburner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Blake</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. M.</given-names>
            <surname>Cherry</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Harris</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Lewis</surname>
          </string-name>
          .
          <article-title>The Gene Ontology: What It Is (and What It Isn't) - go-websemantics</article-title>
          .pdf,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>P.</given-names>
            <surname>Bernus</surname>
          </string-name>
          and
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Shaw</surname>
          </string-name>
          .
          <source>International Handbooks on Information Systems</source>
          .
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>M.</given-names>
            <surname>Egan</surname>
          </string-name>
          <article-title>˜a</article-title>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E.</given-names>
            <surname>Antezana</surname>
          </string-name>
          .
          <article-title>Transforming the Axiomisation of Ontologies: The Ontology Pre-Processor Language</article-title>
          .
          <source>Proceedigns of OWLED</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Garcia</surname>
          </string-name>
          ,
          <string-name>
            <surname>K. O'Neill</surname>
            ,
            <given-names>L. J.</given-names>
          </string-name>
          <string-name>
            <surname>Garcia</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Lord</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Stevens</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          <string-name>
            <surname>Corcho</surname>
            , and
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Gibson</surname>
          </string-name>
          .
          <article-title>Developing ontologies within decentralised settings</article-title>
          . In H. Chen,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          K.-H. Cheung, editors,
          <source>Semantic e-Science</source>
          , pages
          <fpage>99</fpage>
          -
          <lpage>140</lpage>
          . Springer,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>C.</given-names>
            <surname>Hilkens</surname>
          </string-name>
          .
          <article-title>Cell therapies: From the laboratory to the clinic</article-title>
          . https://www.youtube.com/watch?v=
          <fpage>Y1ESfJBxvqY</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          .
          <article-title>The OWL API: A Java API for OWL Ontologies</article-title>
          .
          <source>Semantic Web Journal</source>
          ,
          <volume>2</volume>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Patel-Schneider</surname>
          </string-name>
          .
          <article-title>Owl 2 web ontology language manchester syntax</article-title>
          . http://www.w3.org/TR/ owl2-manchester-syntax/,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]IHTSDO.
          <source>International health terminology standards development organisation</source>
          ,
          <source>2016 (accessed June 17</source>
          ,
          <year>2016</year>
          ). http://www.ihtsdo.org/snomed-ct/.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>A. D. Iorio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Gonzalez-Beltran</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Osbourne</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Peroni</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Poggi</surname>
            , and
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Vitali</surname>
          </string-name>
          . It rocs!
          <article-title>- the rash online conversion service</article-title>
          . https://rawgit.com/essepuntato/rash/ master/papers/rash-poster-www2016.
          <fpage>html</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>S.</given-names>
            <surname>Jupp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Iannone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Klein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Owen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Schanstra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Wolstencroft</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Populous: a tool for building OWL ontologies from templates</article-title>
          .
          <source>Semantic Web Applications and Tools for Life Sciences</source>
          ,
          <volume>13</volume>
          (
          <issue>Suplement1</issue>
          ):
          <fpage>55</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>S.</given-names>
            <surname>Jupp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Iannone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Klein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Owen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Schanstra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Wolstencroft</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Populous: a tool for building owl ontologies from templates</article-title>
          .
          <source>BMC Bioinformatics</source>
          ,
          <volume>13</volume>
          (
          <issue>Suppl 1</issue>
          ):
          <fpage>S5</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lord</surname>
          </string-name>
          .
          <article-title>The Semantic Web takes Wing: Programming Ontologies with Tawny-OWL</article-title>
          .
          <source>OWLED</source>
          <year>2013</year>
          , Mar.
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lord</surname>
          </string-name>
          .
          <article-title>Manchester syntax is a bit backward</article-title>
          . http://www. russet.org.uk/blog/2985,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lord</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Cockell</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Three steps to heaven: Semantic publishing in a real world workflow</article-title>
          .
          <source>Future Internet</source>
          ,
          <volume>4</volume>
          (
          <issue>4</issue>
          ):
          <fpage>1004</fpage>
          -
          <lpage>1015</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>P.</given-names>
            <surname>Lord</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Adding a little reality to building ontologies for biology</article-title>
          .
          <source>PLoS One</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>N.</given-names>
            <surname>Noy</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Rector. Defining</surname>
          </string-name>
          n
          <article-title>-ary relations on the semantic web</article-title>
          . https://www.w3.org/TR/ swbp-n-aryRelations/,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>A.</given-names>
            <surname>Rector</surname>
          </string-name>
          .
          <article-title>Normalisation of ontology implementations: Towards modularity, re-use, and maintainability</article-title>
          .
          <source>Proceedings Workshop on Ontologies for Multiagent Systems (OMAS) in conjunction with European Knowledge Acquisition Workshop</source>
          ,
          <year>2002</year>
          . Siguenza, Spain.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>A.</given-names>
            <surname>Rector</surname>
          </string-name>
          .
          <article-title>Representing specified values in owl: “value partitions” and “value sets”</article-title>
          . W3C Working Group Note,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>S.</given-names>
            <surname>Schulz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Stenzhorn</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Boeker</surname>
          </string-name>
          .
          <article-title>The ontology of biological taxa</article-title>
          .
          <source>Bioinformatics</source>
          ,
          <volume>24</volume>
          (
          <issue>13</issue>
          ):
          <fpage>i313</fpage>
          -
          <lpage>i321</lpage>
          ,
          <year>Jul 2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>a</article-title>
          . Goble, and
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          .
          <article-title>Ontology-based knowledge representation for bioinformatics</article-title>
          . Briefings in bioinformatics,
          <volume>1</volume>
          (
          <issue>4</issue>
          ):
          <fpage>398</fpage>
          -
          <lpage>414</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          and
          <string-name>
            <given-names>U.</given-names>
            <surname>Sattler</surname>
          </string-name>
          .
          <article-title>An object lesson in choosing between a class and an object</article-title>
          . http://ontogenesis. knowledgeblog.
          <source>org/1418</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>A.</given-names>
            <surname>Ten Brinke</surname>
          </string-name>
          ,
          <string-name>
            <surname>C. M. U. Hilkens</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Cools</surname>
            ,
            <given-names>E. K.</given-names>
          </string-name>
          <string-name>
            <surname>Geissler</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          <string-name>
            <surname>Hutchinson</surname>
            , G. Lombardi,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Lord</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Sawitzki</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Trzonkowski</surname>
            ,
            <given-names>S. M.</given-names>
          </string-name>
          <string-name>
            <surname>Van Ham</surname>
          </string-name>
          , and et al.
          <article-title>Clinical use of tolerogenic dendritic cells-harmonization approach in european collaborative effort</article-title>
          .
          <source>Mediators of Inflammation</source>
          ,
          <year>2015</year>
          :
          <volume>18</volume>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>T.</given-names>
            <surname>Tudorache</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. I.</given-names>
            <surname>Nyulas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Redmond</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>icat: A collaborative authoring tool for icd11</article-title>
          . http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>809</volume>
          /paper-09.pdf,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>J.</given-names>
            <surname>Warrender</surname>
          </string-name>
          .
          <article-title>The Consistent Representation of Scientific Knowledge: Investigations into the Ontology of Karyotypes and Mitochondria</article-title>
          .
          <source>PhD thesis</source>
          , School of Computing Science, Newcastle University,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>J.</given-names>
            <surname>Warrender</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Lord</surname>
          </string-name>
          .
          <article-title>Scaffolding the mitochondrial disease ontology from extant knowledge sources</article-title>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Warrender</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Lord</surname>
          </string-name>
          .
          <article-title>The Karyotype Ontology: a computational representation for human cytogenetic patterns</article-title>
          .
          <source>Bio-Ontologies</source>
          <year>2013</year>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Warrender</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Lord</surname>
          </string-name>
          . How,
          <article-title>What and Why to test an ontology</article-title>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>K.</given-names>
            <surname>Wolstencroft</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Owen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Krebs</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Mueller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. L.</given-names>
            <surname>Snoep</surname>
          </string-name>
          , F. du
          <string-name>
            <surname>Preez</surname>
            , and
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Goble</surname>
          </string-name>
          .
          <article-title>RightField: embedding ontology annotation in spreadsheets</article-title>
          .
          <source>Bioinformatics</source>
          (Oxford, England),
          <volume>27</volume>
          (
          <issue>14</issue>
          ):
          <fpage>2021</fpage>
          -
          <lpage>2</lpage>
          , jul
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>A.</given-names>
            <surname>Wood</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Flowerdew</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Peacock</surname>
          </string-name>
          .
          <article-title>International scientific english: The language of research scientists around the world</article-title>
          .
          <source>Research Perspectives on English for Academic Purposes</source>
          , pages
          <fpage>71</fpage>
          -
          <lpage>83</lpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>