<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Populous: A tool for populating Templates for OWL ontologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Simon Jupp</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matthew Horridge</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Luigi Iannone</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Julie Klein</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stuart Owen</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Joost Schanstra</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Robert Stevens</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Katy Wolstencroft</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institut National de la Sant ́e et de la Recherche M ́edicale</institution>
          ,
          <addr-line>Toulouse</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Computer Science, University of Manchester</institution>
          ,
          <addr-line>Manchester</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We present Populous, a tool for gathering content with which to populate an ontology. Domain experts need to add content, that is often repetitive in its form, but without having to tackle the underlying ontological representation. Populous presents users with a table based form in which columns are constrained to take values from particular ontologies; the user can select a concept from an ontology via its meaningful label to give a value for a given entity attribute. Populated tables are mapped to patterns that can then be used to automatically generate the ontology's content. Populous's contribution is in the knowledge gathering stage of ontology development. It separates knowledge gathering from the conceptualisation and also separates the user from the standard ontology authoring environments. As a result, Populous can allow knowledge to be gathered in a straight-forward manner that can then be used to do mass production of ontology content.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology</kwd>
        <kwd>OWL</kwd>
        <kwd>Spreadsheet</kwd>
        <kwd>Template</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Ontologies are being developed to provide controlled vocabularies for the
annotation of life science data. Annotating data with ontologies adds semantics to
the data that can facilitate data integration and enrich data analysis[
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ],
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. For ontologies to have a faithful representation of a domain, experts from
that domain must have input to the authoring process. There are barriers that
prevent domain experts engaging in an ontology’s development; in particular,
the semantics of an ontology language, or the intricacies of the authoring tools.
To address this issue we have developed Populous that allows users to contribute
their knowledge by populating simple templates that are then transformed to
statements in the underlying representation language.
      </p>
      <p>
        When designing an ontology it is often the case that repeating patterns occur
in the modelling. These patterns can be abstracted from the ontology and used to
specify simple templates that could be populated by domain experts [
        <xref ref-type="bibr" rid="ref2 ref6 ref7">7, 6, 2</xref>
        ]. As
an example of a pattern, consider an ontology about cells; eukaryotic cells can be
classified as being either anucleate, mono-nucleate, binucleate or multinucleate.
We can abstract over this pattern to say that every cell can be classified by
its nucleation. This pattern is repeated for all cell types; the only variables are
the cell name and the value for its nucleation. We can now use this pattern to
build a simple template that could be populated by a cytologist, without him or
her ever knowing about the underlying ontological representation. This type of
pattern is common in ontology development where you have one set of entities
being described in terms of another set of entities [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>The tabular layout provides a simple and intuitive form fill-in style of user
interface for a user to populate such templates. Typically, each row corresponds
to a set of related entities and each column represents the type of relationship.
The intersection of row and column holds the ‘filler’ for the given entity’s
relationship of that column’s type. By adopting templates ontology developers can
separate the pattern from its population; this allows the domain expert to
focus on the knowledge without the distraction of the knowledge representation
language.</p>
      <p>Templates are useful when data needs to be collected in a regular form.
Applying constraints to the template reduces the amount of discrepancies in the
input data. A common tool for collecting data in this form is the spreadsheet;
spreadsheets provide a tabular interface, where columns and rows represent
certain attributes, and individual cells capture the data. Tables help users to
structure data in a logical way, that is useful for both its maintenance and processing.
In ontology development spreadsheets can be used to gather and organise
information about concepts and their relationships. Previous work in this area has
focused on the transformation of data into ontologies, but little attention has
been paid to supporting the population of the templates at the point of data
entry and this is where Populous’s main contribution lies.
1.1</p>
      <p>
        Previous work
Various tools are available to support the conversion of spreadsheet data into
statements in a knowledge representation language. Excel2RDF3, Convert2RDF4
and RDF123 [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] are three tools that allow users to generate Resource Description
Framework (RDF) statements from spreadsheets. Despite RDF being the
reference syntax for the Web Ontology Language (OWL), its serialisation is complex
and not intended for humans, making it inappropriate for defining higher level
OWL construct in patterns.
      </p>
      <p>
        The ExcelImporter plugin5 for Prot´eg´e 4.0 was a step up from these tools
and enabled users to transform spreadsheets content directly into OWL axioms.
It was, however, limited to only a small set of OWL constructs. The more
recent tools to support template data and pattern instantiation include Mapping
Master [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], OPPL 2 [
        <xref ref-type="bibr" rid="ref11 ref6">11, 6</xref>
        ] and the Prot´eg´e Matrix plugin6:
3 http://www.mindswap.org/∼rreck/excel2rdf.shtml
4 http://www.mindawap.org/∼mhgoeve/convert/
5 http://protegewiki.stanford.edu/wiki/Excel Import
6 http://protegewiki.stanford.edu/wiki/Matrix
– The MappingMaster plugin for the Prot´eg´e 3.4 ontology editor is a more
flexible tool for transforming arbitrary spreadsheet data into OWL.
MappingMaster moves away from the row centric view of spreadsheets and has
an expressive macro language called M2 [
        <xref ref-type="bibr" rid="ref14 ref15">15, 14</xref>
        ] that can handle non-uniform
and complex spreadsheets. M2 combines a macro language for referring to
cells in a spreadsheet with a human readable syntax for generating OWL
expressions called the Manchester OWL Syntax [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. MappingMaster and M2
are primarily designed for the transformation of spreadsheet data to OWL,
but provides little in the way of support for populating and validating the
spreadsheet data.
– The Ontology Pre-Processing Language (OPPL) [
        <xref ref-type="bibr" rid="ref11 ref6">6, 11</xref>
        ] (version 2) is a
scripting language similar to M2. OPPL 2 is also Manchester OWL Syntax based
and allows for the manipulation of OWL ontologies at the axiom level. OPPL
2 has support for the use of variables and the addition and removal of
logical axioms from an ontology. OPPL 2 is a powerful scripting language for
OWL and a user interface is provided via the OPPL plugin for Prot´eg´e 4.0.
OPPL, however, does not currently support working with tabular data and
is decoupled from any knowledge gathering.
– The MatrixPlugin for Prot´eg´e 4.0 allows users to specify simple OWL
patterns in a tabular interface that can be used to populate repeating patterns
with existing concepts from an ontology. This plugin is useful for ontology
developers that have repetitive patterns to instantiate, and has the added
benefit of cell validation and auto-completion at the point of data entry.
The Matrix plugin is limited by the type of patterns that can be expressed
along with the fact that it is tightly integrated with the Prot´eg´e interface,
therefore, not suitable for all users. It does, however, combine knowledge
gathering and axiom generation.
1.2
      </p>
      <p>Requirements
All of the previous tools developed in this area tend to focus on the
transformation from the template to the ontology. They provide little or no support for
populating and validating template content. Furthermore, tools like ExcelImporter,
OPPL and MappingMaster are integrated into the ontology development tool,
so they are aimed at users that are already familiar with ontology development.
A table based tool for ontology authoring should shield the user from the
underlying ontology and help guide the user when populating the template. Providing
validation at the time of authorship should significantly reduce the amount of
time required to debug and process the data captured in the spreadsheet. Here
we list some key requirements for an ontology based table editor:
1. Concepts may be described in terms of other concepts from other ontologies.</p>
      <p>In setting up Populous the users must be able to load and browse ontologies.
2. The contents in the column of a table need to be restricted to concepts from
imported ontologies, or parts of imported ontologies.
3. To improve human comprehension the concept should be rendered using only
the URI fragment, or optionally a human readable label from the ontology.
4. Each time a concept is added to a cell within the table Populous needs to
check that the concept is valid according to the constraints resulting from
requirement 2.
5. A cell might have multiple values; for example, when the concept being
described has multiple parts.
6. Users should be free to suggest new concepts when an appropriate concept
is not available.
2</p>
      <p>
        Populous
Populous is an extension of RightField[21]; RightField is for creating Excel
documents that contain ontology based restrictions on spreadsheets content.
RightField enables users to upload Excel spreadsheets, along with ontologies from
their local file systems, or from the BioPortal [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] (a repository of biological
ontologies available at http://bioportal.bioontology.org). RightField
supports OWL, OBO and RDFS ontologies. Using RightField, individual cells, or
whole columns or rows can be marked with the required ranges of ontology
terms. For example, they could include all subclasses from a chosen class,
direct subclasses only, all individuals, or only direct individuals. Each spreadsheet
can be annotated with terms from multiple ontologies. RightField is primarily
designed for generating spreadsheet templates for data annotation; Populous
extends RightField to support knowledge gathering and ontology generation.
Populous and RightField are both open source cross platform Java
application. They use the Apache-POI 7 for interacting with Microsoft documents and
manipulating Excel spreadsheets. Populous is available for download from here
http://www.e-lico.eu/populous.
      </p>
      <p>Requirement 1 is already addressed using RightField functionality to upload
both OWL and OBO ontologies. In order to better serve the life science
community, users can also browse and load ontologies directly from BioPortal. Once
the ontologies are loaded they are classified by a reasoner and the basic class
hierarchy can be viewed.</p>
      <p>Requirement 2 is met by the ability to select terms from the ontology to create
validation sets. A data validation restricts the set of values that are valid for a
particular cell in the table. Validations can span multiple rows and columns and
be composed of classes, properties or individuals from the ontology. These data
validations are stored in hidden worksheets along with additional information
such as the full URI for the term, a label and the source ontology URI. These
templates can also be exported as Microsoft Excel documents, which include the
data validations on cells.</p>
      <p>We address requirement 3 by allowing users to populate cells using ontology
labels. Once data has been entered the default will be to render the ontology
term using its label; if no label is specified the URI fragment is used. RightField
7 http://poi.apache.org
already supports reading Microsoft Excel workbooks so users are free to
populate the templates in external tools before importing them into Populous for
validation and transformation.</p>
      <p>By using Populous directly users will benefit from having instant validation
of the input data, satisfying requirement 4, along with some advanced features
such as regular expression based auto-completion as they type into annotated
cells. Additionally Populous supports the addition of multiple values into a single
cell that are validated individually according to requirement 5. This can be
particularly useful for certain kinds of patterns where a conjunction of variables
is required to construct the axiom (see Section 3 for example). Populous also
allows the addition of free text values, even if the cell has an associated validation
range, thus satisfying requirement 6. These values are highlighted to the user
in red and can act as placeholders for new or suggested terms when no suitable
candidate could be found in the validation set.</p>
      <p>Populous supports the use of OPPL patterns in order to generate new OWL
axioms from the populated template. OPPL scripts can be written directly in
Populous’s design mode or imported from scripts generated in the OPPL
plugin. Variables from the OPPL pattern must be mapped to columns from the
table using the column name. A pattern Wizard guides the user through the
generation and execution of the OPPL scripts. When the template is processed
new identifiers for unknown terms can be auto-generated and exported from
Populous.</p>
      <p>
        We can demonstrate Populous in building a simple ontology about cell types
as described in Section 1. The pattern in the ontology states that every cell must
have a nucleation. We need to create a template with two columns, column A
is for cell type concepts, whilst column B is for nucleation concepts. Ontologies
describing cells and their nucleation already exist that we can import into
Populous. By connecting to BioPortal we can load the Cell Type Ontology (CTO) [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]
and Phenotype and Trait Ontology (PATO) [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. In order to restrict column A
to terms from the CTO, we highlight all the cells in column A and restrict them
to all subclasses of the root class. Column B is restricted subclasses of the
nucleation concept from PATO. The template is now ready to be populated by the
domain expert.
      </p>
      <p>Figure 2 shows a part populated template. The terms in green indicate a
valid term has been entered into the cell. The term in Column A5, Proximal
tubule epithelial cell is red because it is not a valid term from the CTO. Cell A6
is in the process of being edited with the auto-completer offering valid suggestion
for input.</p>
      <p>The populated spreadsheet can now be transformed into an ontology. This
can be done using the pattern wizard in Populous (Figure 3). The first step in
the pattern wizard asks the user to select the columns and rows that contain
populated data. In this example the pattern creates a restriction on each cell
stating that all cells have a relationship, called hasNucleation, to an instance of
the class nucleation. This pattern can be expressed in OPPL 2 with the syntax
shown in Figure 4.
?cell:CLASS,
?nucleation:CLASS
BEGIN
ADD ?cell SubClassOf hasNucleation some ?nucleation
END;</p>
      <p>
        There are two variables in the pattern, ?cell and ?nucleation. These
variable are mapped to column A and B respectively. The pattern is to be
instantiated using data from rows one to six that must be specified in the Wizard. The
next step involves validating the pattern, given that Proximal tubule epithelial
cell is unknown by the validator, the user is given the option to assign a new
URI for this concept. The final step generated the full OPPL script for applying
this pattern. The Manchester OWL syntax generated for row one is shown in
Figure 5. A complete grammar for the OPPL 2 syntax is available here8.
8 http://oppl2.sourceforge.net
Class: cto:CL 0000113
SubClassOf:
hasNucleation some pato:PATO 0001407
In order to evaluate Populous in a real ontology building scenario, it has been
used to populate a template for gathering knowledge about the kidney and
urinary system. The kidney is a complex organ composed of several distinct
anatomical compartments that together enable the filtration of waste from the blood
in the form of urine. Each of the kidney compartments is formed from a wide
variety of cell types, and the specificity of the compartments relies on these
specialised cell functions. The Kidney and Urinary Pathway Ontology (KUPO) [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]
describes kidney cells, their function and their anatomical locations. KUPO is
being built to annotate and integrate a variety of KUP related data held in the
Kidney and Urinary Pathway Knowledge Base (KUPKB)9.
      </p>
      <p>
        A simple template was designed for experts from the KUP domain to capture
the relationships between cell types, their anatomical location and their
biological functions. The template has three main columns; column A is for entering
cell type terms, column C is for anatomy terms and column D for biological
process terms. Populous was used to constrain the allowable values in columns A, C
and D to concepts from the Open Biomedical Ontology Cell Type Ontology [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ],
subclasses or part of the Kidney or Urinary system concepts from the Mouse
Adult Gross Anatomy Ontology [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], and all subclasses of the Biological Process
concept from the Gene Ontology [20], respectively. The experts were instructed
that the relationship between concepts in column A and C was part of, and the
relationship between column A and D, participates in. For concepts that were
related to multiple concepts they were allowed to list concepts in a cell separated
by a comma. Figure 6 is a screen shot of Populous populated with data from the
domain experts.
      </p>
      <p>
        In order to transform the tabular data into an OWL representation the OPPL
pattern in Figure 7 was created by the ontology engineers. This pattern states
that a cell type is equivalent to a cell that is part of an anatomy term and a
subclass of cells that participate in biological processes.10 For both restrictions
the existential (some) quantification is used. The two differentia in this pattern
for a cell genus are the anatomical location and the biological process, which
is retrieved from column A, B and C respectively in the template. The entire
KUP ontology is generated from the template data combined with the ontology
9 http://www.e-lico.eu/kupkb
10 Where possible we use the relationships from [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ].
pattern. Figure 8 shows the Manchester OWL syntax generated from the pattern
and data from row 13 for the Juxtaglomerular complex cell.
      </p>
      <p>Using this template approach the domain experts described over 140 cell
types, many of which are absent from the current CTO. Figure 9 shows the
inferred hierarchy after classifying the ontology in Prot´eg´e 4.0. Note the asserted
class hierarchy is simply a flat list of cell types, the partonomy of the mouse
anatomy is used to drive inferences about super/sub class relationships between
cell types. Leaving the reasoner to compute the class hierarchy allows the domain
experts to inspect the ontology for missing or incorrect inferences. These often
indicate some missing information in the template, or an error in the imported
ontologies. This methodology was successful in engaging the domain experts to
both contribute to the KUP ontology and generate new term requests for the
imported ontologies.
4</p>
      <p>Discussion
Populous is designed for domain experts to gather knowledge that can be
subsequently used to populate ontologies. Whilst previous tools have provided support
for transforming templates into ontologies, they lacked basic support to help the
user at the point of data entry. Populous was designed to fill this niche and
meet the requirements outlined in section 1. The simple tabular interface used
Pattern 1
?cell:CLASS,
?anatomyPart:CLASS,
?partOfRestriction:CLASS = cell and part of some ?anatomyPart,
?anatomyIntersection:CLASS = createIntersection(?partOfRestriction.VALUES)
BEGIN
ADD ?cell equivalentTo ?anatomyIntersection
END;
Pattern 2
?participant:CLASS,
?participatesRestriction:CLASS = ?cell and participates in some
?participant,
?participatesIntersection:CLASS = createIntersection(?participatesRestriction.VALUES)
BEGIN
ADD ?cell SubClassOf ?participatesIntersection
END;
in Populous is familiar to users who have already used a spreadsheet application.
Populous should lower the entry requirements for domain experts to contribute
to ontology development projects.</p>
      <p>The release of Populous as presented is an early version; there remains many
possible additions, some of which are:
1. Populous can handle multiple values in a cell that maps to conjunctions of
properties. Extensions to Populous such that some minor syntax can be used
to extend the ability to use OWL’s syntax would be useful. In particular,
being able to specify numbers for cardinality and numbers and other literals
for datatype properties.
2. As already described, Populous uses a row centric model. We aim to use M2
to enable more variety in how tables are mapped to templates or patterns.
For example, only portions of columns may be required to be mapped to
certain axiom patterns and M2 enables this sort of mapping. OPPL and M2
together should cover our mapping needs.
3. Populous currently gathers domain knowledge for the ontology, but not
about the ontology. We aim to extend Populous to support various metadata
such as editorial metadata and definitional metadata etc.
4. Populous is a single user application. Making Populous collaborative such
that contributors may collectively add material to the same spreadsheet.
5. Feedback from the generated ontology to fix or extend data in Populous is
currently ad hoc. A tighter coupling of this feedback cycle, without having
to go into an axiom based editor, will increase the quality assurance aspects
of Populous.</p>
      <p>We have demonstrated how Populous can be used to develop an ontology
describing cells of the kidney and urinary pathway system. This demonstration
highlights how domain experts managed to generate a real application ontology
without being exposed to an ontology language like OWL, or a tool like Prot´eg´e.
Populous’s main purpose is for knowledge gathering and not ontologising. By
shielded users from the ontology, except for review later in the process, they
are left to concentrate on the biology and not worry about the axioms needed
to represent it. This separation is particularly useful should the ontologist wish
to change the conceptualisation or experiment with different patterns for the
representation.</p>
      <p>
        Our experience in developing the KUPO with domain experts provided
interesting insights into the benefits of developing an ontology in this way. Classical
approaches to ontology development in the life science have tended to focus on
building rich asserted hierarchies of concepts. The KUPO approach exploits the
expressiveness of an ontology language like OWL to describe the cells in such a
way that the class hierarchy is computed by the reasoner. This means we have
a logical explanation for all the subsumptions in the hierarchy, that is useful
for spotting erroneous or missing information. For example, there are cell types
for the vasa recta descending limb and the vasa recta ascending limb, both of
which have different functions. The imported anatomy ontology, however, only
describes a vasa recta. The domain experts were able to spot this and can now
submit a request for these two new concepts to be added to the anatomy
ontology. Building normalised ontologies that facilitate the kinds of inferences we
see in KUPO are generally considered to be harder and more time consuming
than constructing class hierarchies manually, despite offering a clear benefit [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
However, in cases where a repeating pattern can be abstracted from the
ontology, as in the case of KUP cells, we see that domain experts can rapidly produce
rich ontologies with considerably less investment using Populous.
      </p>
      <p>The question now arises as to how far can you go with a tool like Populous?
Populous is by no means a replacement for full blown ontology editors, nor is
it intended to be. The scenarios where Populous is of benefit assume that the
ontology being developed has repeating patterns in the modelling. Furthermore,
specifying the patterns for new ontologies before they exist is particularly
difficult and is often something that emerges later as the ontology matures. For
example, it was assumed with the kidney cells that we could describe them all
in terms of their anatomy, only to later find some exceptions to the pattern.
Renal principal and renal intercalated cells are currently indistinguishable by
anatomy and function alone. There are always going to be exceptions, especially
when modelling a complex domain like biology. We hope that Populous can bring
more domain experts into the ontology development process and engage them
in the development process.</p>
      <p>
        The template approach can be particularly advantageous in scenarios where
the modelling needs to change. [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] showed how templates can be used to
generate different ontological representations of the same data. The KUPO is also
being used to link data in an RDF store to support the KUP KB, where only
limited support for OWL inferences is possible. By developing a different set
of patterns we could generate a simpler version of the KUP ontology from the
same Populous data for use in such an application. This again highlights an
added benefit of separating the pattern from its population.
      </p>
      <p>OPPL provides an expressive language for generating OWL patterns. OPPL’s
support for variables make mapping single columns from tabular data to
variables convenient. The built in macros means we can create abstract pattern
where the axioms can be generated dynamically depending on the number of
values stored in a variable. Populous is currently limited to working with
uniform spreadsheets and assumes a row-per-entity paradigm, where single columns
map to a particular variable. This structure keeps the template simple and should
cover the majority of use cases for populating an ontology in this way. The
extension to support multi-values per cell offers some additional flexibility over
existing spreadsheet based approaches. In order to accommodate more complex
spreadsheets we plan to extend Populous to support more complex mappings
from columns to spreadsheets. We are also exploring integrating the M2
language from MappingMaster directly into Populous, we note that templates
created in Populous can already be exported as Excel document and loaded into
MappingMaster for transformation should the user desire.</p>
      <p>Populous offers a means of creating ontology content without the use of a
standard ontology development tool. Just as data-entry tools exist for populating
databases, so we also need such tools for populating ontologies. It is possible to
separate knowledge gathering from conceptualisation and axiomatisation and
Populous is one means of achieving this goal. Such a separation offers flexibility
and simple form fill-in style of knowledge gathering that should make generation
of axiomatically rich ontologies increasingly straight-forward.</p>
      <p>Acknowledgements: We kindly acknowledge Mikel Egan˜a Aranguren for
advice, requirements and testing Populous. This work is funded by the e-LICO
project—EU/FP7/ICT-2007.4.4 and by SysMO-DB - BBSRC grant BBG0102181.
20. The Gene Ontology Consortium. Gene Ontology: Tool for the Unification of
Biology. Nature Genetics, 25:25–29, 2000.
21. Katy Wolstencroft, Stuart Owen, Matthew Horridge, Olga Krebs, Wolfgang
Mueller, and Carole Goble. RightField: Rich Annotation of Experimental
Biology Through Stealth Using Spreadsheets. In Proceedings of the 7th Microsoft
eScience Workshop, pages 117–119., Berkeley, California, 2010.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. L. ]
          <string-name>
            <surname>Han</surname>
            ,
            <given-names>T.W.</given-names>
          </string-name>
          <string-name>
            <surname>Finin</surname>
            ,
            <given-names>C.S.</given-names>
          </string-name>
          <string-name>
            <surname>Parr</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Sachs</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <surname>A. Joshi.</surname>
          </string-name>
          <article-title>RDF123: From Spreadsheets to RDF</article-title>
          .
          <source>In ISWC 2008 LNCS 5318</source>
          , pages
          <fpage>451</fpage>
          -
          <lpage>466</lpage>
          . Springer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Mikel</given-names>
            <surname>Egan</surname>
          </string-name>
          <article-title>˜a Aranguren, Erick Antezana, Martin Kuiper, and Robert Stevens. Ontology Design Patterns for bio-ontologies: a case study on the Cell Cycle Ontology</article-title>
          .
          <source>BMC bioinformatics</source>
          ,
          <volume>9</volume>
          (
          <issue>Suppl 5</issue>
          ):
          <fpage>S1</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Michael</given-names>
            <surname>Ashburner</surname>
          </string-name>
          ,
          <article-title>Catherine A. Ball, Judith A</article-title>
          .
          <string-name>
            <surname>Blake</surname>
            , David Botstein,
            <given-names>Heather</given-names>
          </string-name>
          <string-name>
            <surname>Butler</surname>
            ,
            <given-names>J. Michael</given-names>
          </string-name>
          <string-name>
            <surname>Cherry</surname>
          </string-name>
          , Allan P. Davis, Kara Dolinski, Selina S. Dwight, Janan T. Eppig, Midori A.
          <string-name>
            <surname>Harris</surname>
            ,
            <given-names>David P.</given-names>
          </string-name>
          <string-name>
            <surname>Hill</surname>
            , Laurie Issel-Tarver,
            <given-names>Andrew</given-names>
          </string-name>
          <string-name>
            <surname>Kasarskis</surname>
            ,
            <given-names>Suzanna</given-names>
          </string-name>
          <string-name>
            <surname>Lewis</surname>
          </string-name>
          , John C. Matese, Joel E. Richardson, Martin Ringwald,
          <string-name>
            <surname>Gerald M. Rubin</surname>
            , and
            <given-names>Gavin</given-names>
          </string-name>
          <string-name>
            <surname>Sherlock</surname>
          </string-name>
          .
          <article-title>Gene ontology: tool for the unification of biology</article-title>
          .
          <source>Nature Genetics</source>
          ,
          <volume>25</volume>
          (
          <issue>1</issue>
          ):
          <fpage>25</fpage>
          -
          <lpage>29</lpage>
          , May
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>J.</given-names>
            <surname>Bard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. Y.</given-names>
            <surname>Rhee</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Ashburner</surname>
          </string-name>
          .
          <article-title>An ontology for cell types</article-title>
          .
          <source>Genome Biology</source>
          ,
          <volume>6</volume>
          (
          <issue>2</issue>
          ),
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Olivier</given-names>
            <surname>Bodenreider</surname>
          </string-name>
          .
          <article-title>Ontologies and data integration in biomedicine: Success stories and challenging issues</article-title>
          .
          <source>In DILS '08: Proceedings of the 5th international workshop on Data Integration in the Life Sciences</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          , Berlin, Heidelberg,
          <year>2008</year>
          . Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Mikel</given-names>
            <surname>Egan</surname>
          </string-name>
          <article-title>˜a, Alan Rector, Robert Stevens, and Erick Antezana. Applying Ontology Design Patterns in Bio-ontologies</article-title>
          .
          <source>In A. Gangemi and J</source>
          . Euzenat, editors,
          <source>EKAW 2008, LNCS 5268</source>
          , pages
          <fpage>7</fpage>
          -
          <lpage>16</lpage>
          . Springer-Verlag,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Aldo</given-names>
            <surname>Gangemi</surname>
          </string-name>
          .
          <article-title>Ontology design patterns for semantic web content</article-title>
          .
          <source>In International Semantic Web Conference</source>
          , pages
          <fpage>262</fpage>
          -
          <lpage>276</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Georgios</surname>
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Gkoutos</surname>
          </string-name>
          , Eain C. Green,
          <string-name>
            <surname>Ann-Marie M. Mallon</surname>
          </string-name>
          ,
          <string-name>
            <surname>John M. Hancock</surname>
            , and
            <given-names>Duncan</given-names>
          </string-name>
          <string-name>
            <surname>Davidson</surname>
          </string-name>
          .
          <article-title>Using ontologies to describe mouse phenotypes</article-title>
          .
          <source>Genome biology</source>
          ,
          <volume>6</volume>
          (
          <issue>1</issue>
          ),
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Terry F Hayamizu</surname>
          </string-name>
          ,
          <string-name>
            <surname>Mary</surname>
            <given-names>Mangan</given-names>
          </string-name>
          , John P Corradi,
          <article-title>James A Kadin, and Martin Ringwald. The adult mouse anatomical dictionary: a tool for annotating and integrating data</article-title>
          .
          <source>Genome biology</source>
          ,
          <volume>6</volume>
          (
          <issue>3</issue>
          ),
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>M</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N</given-names>
            <surname>Drummond</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J</given-names>
            <surname>Goodwin</surname>
          </string-name>
          ,
          <string-name>
            <surname>A Rector</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R</given-names>
            <surname>Stevens</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H</given-names>
            <surname>Wang</surname>
          </string-name>
          .
          <article-title>The Manchester OWL syntax</article-title>
          . In OWLed,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Luigi</surname>
            <given-names>Iannone</given-names>
          </string-name>
          , Alan L.
          <string-name>
            <surname>Rector</surname>
            , and
            <given-names>Robert</given-names>
          </string-name>
          <string-name>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Embedding knowledge patterns into owl</article-title>
          .
          <source>In ESWC</source>
          , pages
          <fpage>218</fpage>
          -
          <lpage>232</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Simon</surname>
            <given-names>Jupp</given-names>
          </string-name>
          , Julie Klein, Joost Schanstra, and
          <string-name>
            <given-names>Robert</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Developing a Kidney and Urinary Pathway Knowledge Base</article-title>
          . In
          <string-name>
            <surname>Bio-ontologies</surname>
            <given-names>SIG</given-names>
          </string-name>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Natalya F. Noy</surname>
          </string-name>
          ,
          <string-name>
            <surname>Nigam H. Shah</surname>
          </string-name>
          , Patricia L. Whetzel, Benjamin Dai, Michael Dorf, Nicholas Griffith, Clement Jonquet, Daniel L. Rubin,
          <string-name>
            <surname>Margaret-Anne</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <string-name>
            <surname>Storey</surname>
            , Christopher G. Chute, and
            <given-names>Mark A.</given-names>
          </string-name>
          <string-name>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>Bioportal: ontologies and integrated data resources at the click of a mouse</article-title>
          .
          <source>Nucleic acids research</source>
          ,
          <volume>37</volume>
          (
          <issue>Web Server issue</issue>
          ):
          <fpage>W170</fpage>
          -
          <lpage>173</lpage>
          ,
          <year>July 2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>M. J. O'Connor</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Halaschek-Wiener</surname>
            , and
            <given-names>M. A.</given-names>
          </string-name>
          <string-name>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>M2: a Language for Mapping Spreadsheets to OWL</article-title>
          .
          <source>In OWL: Experiences and Directions (OWLED)</source>
          ,
          <source>Sixth International Workshop</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>M. J. O'Connor</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Halaschek-Wiener</surname>
            , and
            <given-names>M. A.</given-names>
          </string-name>
          <string-name>
            <surname>Musen</surname>
          </string-name>
          .
          <article-title>Mapping Master: a Spreadsheet to OWL Mapping Language</article-title>
          . In
          <source>International Semantic Web Conference (ISWC)</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Bjoern</surname>
            <given-names>Peters</given-names>
          </string-name>
          , Alan Ruttenberg, Jason Greenbaum, Melanie Courtot, Ryan Brinkman, Patricia Whetzel, Daniel Schober, Susanna Assunta Sansone, Richard Scheuerman, and
          <string-name>
            <surname>Philippe</surname>
          </string-name>
          . Rocca-Serra.
          <article-title>Overcoming the ontology enrichment bottleneck with quick term templates</article-title>
          .
          <source>International Conference on Biomedical Ontology.</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Alan</surname>
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Rector</surname>
          </string-name>
          .
          <article-title>Modularisation of domain ontologies implemented in description logics and related formalisms including owl</article-title>
          .
          <source>In Proceedings of the 2nd International Conference on Knowledge Capture, October</source>
          ,
          <year>2003</year>
          ,
          <string-name>
            <given-names>Sanibel</given-names>
            <surname>Island</surname>
          </string-name>
          , USA.
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Barry</surname>
            <given-names>Smith</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Michael</given-names>
            <surname>Ashburner</surname>
          </string-name>
          , Cornelius Rosse, Jonathan Bard,
          <string-name>
            <given-names>William</given-names>
            <surname>Bug</surname>
          </string-name>
          , Werner Ceusters,
          <string-name>
            <given-names>Louis J.</given-names>
            <surname>Goldberg</surname>
          </string-name>
          , Karen Eilbeck, Amelia Ireland,
          <string-name>
            <given-names>Christopher J.</given-names>
            <surname>Mungall</surname>
          </string-name>
          , Neocles Leontis, Philippe Rocca-Serra, Alan Ruttenberg, SusannaAssunta Sansone, Richard H. Scheuermann, Nigam Shah, Patricia L.
          <string-name>
            <surname>Whetzel</surname>
            , and
            <given-names>Suzanna</given-names>
          </string-name>
          <string-name>
            <surname>Lewis</surname>
          </string-name>
          .
          <article-title>The obo foundry: coordinated evolution of ontologies to support biomedical data integration</article-title>
          .
          <source>Nature Biotechnology</source>
          ,
          <volume>25</volume>
          (
          <issue>11</issue>
          ):
          <fpage>1251</fpage>
          -
          <lpage>1255</lpage>
          ,
          <year>November 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Barry</surname>
            <given-names>Smith</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Werner</given-names>
            <surname>Ceusters</surname>
          </string-name>
          , Bert Klagges,
          <article-title>Jacob K¨ohler</article-title>
          , Anand Kumar, Jane Lomax, Chris Mungall, Fabian Neuhaus, Alan L.
          <string-name>
            <surname>Rector</surname>
            , and
            <given-names>Cornelius</given-names>
          </string-name>
          <string-name>
            <surname>Rosse</surname>
          </string-name>
          .
          <article-title>Relations in biomedical ontologies</article-title>
          .
          <source>Genome Biol</source>
          ,
          <volume>6</volume>
          :
          <fpage>R46</fpage>
          ,
          <string-name>
            <surname>Apr</surname>
          </string-name>
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>