<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>ICEO: a biological ontology for representing and analyzing the bacterial integrative and conjugative element</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Meng Liu</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hong-Yu Ou</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yongqun He</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>State Key Laboratory of Microbial Metabolism, School of Life Sciences &amp; Biotechnology, Shanghai Jiao Tong University</institution>
          ,
          <addr-line>Shanghai</addr-line>
          ,
          <country country="CN">China</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Michigan Medical School</institution>
          ,
          <addr-line>Ann Arbor, MI 48109</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Bacterial integrative and conjugative elements (ICEs) are mobile genetic elements critical to horizontal gene transfer and organism evolution. To better understand and analyze ICEs, it is critical to systematically represent, integrate and classify gene components, functional modules and related information of available ICEs archived in the ICEberg database. Toward this goal, we developed a community-driven ICE ontology (ICEO). ICEO is aligned with the Basic Formal Ontology (BFO) to allow the integration with other ontologies. ICEO reused the existing reliable ontologies, such as Ontology of Gene and Genome, Protein Ontology and NCBITaxon. ICEO now represents the information about over 270 experimentally verified ICEs from 235 bacterial strains. Two query use cases were provided, including a DL query of ICE-contained genes that are also virulence factors and a SPARQL query of ICEs under an upper level taxonomy type of Gammaproteobacteria. Our study demonstrated that ICEO supports computer-assisted reasoning and efficient SPARQL query.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Integrative and conjugative elements (ICEs), also called
conjugative transposons before, are a large family of the bacterial
mobile genetic elements (MGEs) (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ). ICEs are integrative to the
bacterial chromosome and encode functional conjugation
machinery for the self-transmission between bacterial cells.
Similar to all other bacterial MGEs, typically, ICEs have a highly
modular structure with three core genetic modules: (i)
recombination (integration and excision) module; (ii) conjugation
module; and (iii) regulation module. The recombination module
refers to those genes and sequence within the ICE responsible for
the site-specific integration and excision of the element from the
host chromosome, including genes encoding the integrase and or
recombination directionality factor (also known as excisionase,
which influences the direction of recombination mediated by the
integrase to favor excision). The conjugation module denotes
those gene and sequence involved in the conjugal process, such
as genes encoding relaxase and the type IV secretion system
(T4SS). The regulation module refers to those genes and sequence
contributing to stabilization and maintenance of ICEs. Besides,
virulence factors (VFs) and acquired antibiotic resistance genes
(ARGs) often exist inside ICEs as the cargo genes (also called the
accessory module of ICEs) and can confer the hosts with selective
advantages, which make ICEs a vital role in the process of
bacterial adaptation and evolution (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ). Based on two different
conjugal manners, ICEs can be categorized as T4SS-type ICEs
and actinomycete ICEs (AICEs). T4SS-type ICEs are widely
distributed both in Gram-negative and Gram-positive bacteria,
while actinomycete ICEs (AICEs) only have been found in
      </p>
      <sec id="sec-1-1">
        <title>Actinobacteria, mainly in Streptomyces. And T4SS-type ICEs are</title>
        <p>transferred as linear single-stranded DNA (ssDNA) typically
depended on a relaxase and a conjugative type IV secretion
system (T4SS). AICEs are delivered as double-stranded DNA
(dsDNA) relied on proteins for replications and translocation.</p>
        <p>
          The information about thousands of experimentally validated or
computationally predicted bacterial ICEs is freely accessible in
ICEberg (http://db-mml.sjtu.edu.cn/ICEberg/), a comprehensive
web-based ICE database that is developed by our group at the
Shanghai Jiao Tong University (
          <xref ref-type="bibr" rid="ref3">3</xref>
          ). However, to make the best
use of these available data and the ongoing increase of
information, and to facilitate more effective and accurate
identification and annotation of ICEs from single bacterial
genomes or even metagenomes, a knowledge base about available
bacterial ICEs in a format compliant for computer analysis is
desired (
          <xref ref-type="bibr" rid="ref4 ref5">4, 5</xref>
          ). Ontology, a hierarchical and interconnected
controlled vocabulary that emphasizes the logical organization
and representation of complex data and knowledge, provides such
a platform to achieve this goal. In this big data and IT era,
structured ontology has been widely used in biological data and
metadata standardization, integration, sharing, and analysis (
          <xref ref-type="bibr" rid="ref6">6</xref>
          ).
        </p>
        <p>
          For example, one of the most successful and widely-used
ontology, Gene Ontology (GO; http://www.geneontology.org/)
(
          <xref ref-type="bibr" rid="ref7">7</xref>
          ), which represents the information of cellular components,
biological processes, and molecular functions, is often used as
the standard to describe the function of gene and gene products
across different databases and to conduct various gene expression
analyses. The usage of ontology supports better representation,
integration, and analysis of big data.
        </p>
        <p>In this study, we report the development strategy of a
communitydriven Ontology of the Integrative and Conjugative Element</p>
        <p>
          Copyright © 2019 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
(ICEO), which is aimed to ontologically represent and integrate
the ICE gene information and functional modules to support
computer-assisted reasoning. There are 260 experimentally
verified T4SS-type ICEs (113 with the entire nucleotide
sequences) and 11 experimentally validated AICEs (7 with the
entire nucleotide sequences) in ICEberg. The current ICEO is
focused on ontological organization of the information about
these 271 experimentally validated ICEs for now here. ICEO is
developed by reusing many terms from existing ontologies and
using the state-of-the-art ontology engineering technologies (
          <xref ref-type="bibr" rid="ref8 ref9">8,
9</xref>
          ). A systematic analysis of the ICEO-represented knowledge
base allows us to generate new insights about these widely
distributed integrative genetic elements.
        </p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Methods</title>
      <sec id="sec-2-1">
        <title>1. ICEO ontology development strategy</title>
        <p>
          The development of ICEO follows the Open Biological and
Biomedical Ontologies (OBO) Foundry principles (
          <xref ref-type="bibr" rid="ref10">10</xref>
          ), such as
openness, collaboration, use of a common shared syntax and so on.
Therefore, the ICEO information can be easily integrated and
processed with other ontologies in the OBO library. To support the
data FAIRness (Findable, Accessible, Interoperable and
Reusable) (
          <xref ref-type="bibr" rid="ref11">11</xref>
          ), the eXtensible Ontology Development (XOD) strategy
(
          <xref ref-type="bibr" rid="ref9">9</xref>
          ) was also applied for the ontology development of ICEO.
Basically, the XOD strategy recommends the reuse of existing terms
and semantic relations from reliable ontologies, development and
application of well-established ontology design patterns (ODPs),
and involvement of community efforts for new ontology
development (
          <xref ref-type="bibr" rid="ref9">9</xref>
          ).
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2. ICE-related ontology term reuse</title>
        <p>
          To support ontology interoperability and avoid reinventing the
wheel, related existing terms from reliable ontologies were
imported into ICEO via an Ontofox (http://ontofox.hegroup.org)
import strategy (
          <xref ref-type="bibr" rid="ref12">12</xref>
          ). The external ontologies used here include
Ontology of Genes and Genomes (OGG) (
          <xref ref-type="bibr" rid="ref13">13</xref>
          ), PRotein Ontology
(PR) (
          <xref ref-type="bibr" rid="ref14">14</xref>
          ), Gene Ontology (GO) (
          <xref ref-type="bibr" rid="ref7">7</xref>
          ) and a taxonomy ontology of
NCBI organismal classification (NCBITaxon) (15).
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>3. New ICEO term generation</title>
        <p>Based on the available information, an ontology design pattern
(ODP) was developed. Many new annotations and relations
between different entities were added by utilizing the Ontorat
(http://ontorat.hegroup.org/) (16), an online program designed to
support ODP-based creation of new ontology terms, hierarchies,
annotations, and logical axioms.</p>
        <p>The Protégé-OWL editor (version 5.2)
(http://protege.stanford.edu/) was used for the ICEO manual
processing and editing, ontology term merging and visualization.
ICEO-specific terms were generated using new ICEO identifiers
with the prefix “ICEO_” followed by auto-generated 7 digits. The
Hermit reasoner (http://hermit-reasoner.com/) was applied for
semantic consistency checking and inferencing.</p>
      </sec>
      <sec id="sec-2-4">
        <title>4. ICEO format, source code, and access</title>
        <p>
          The ICEO is developed using the format of W3C standard Web
Ontology Language (OWL2)
(https://www.w3.org/TR/owlguide/) (
          <xref ref-type="bibr" rid="ref10">10</xref>
          ). The source code of ICEO is open and available for
public view and download on the GitHub website:
https://github.com/ontoice/ICEO. The ICEO source code is freely
available under the Creative Commons 4.0 License
(http://creativecommons.org/licenses/by/4.0/), which allows
ICEO users to freely distribute and use ICEO. The latest version
of ICEO is also accessible for visualization and downloading
from Ontobee (17, 18) ontology repository website:
http://www.ontobee.org/ontology/ICEO, or NCBO’s BioPortal
website: https://bioportal.bioontology.org/ontologies/ICEO.
        </p>
      </sec>
      <sec id="sec-2-5">
        <title>5. ICEO knowledge query and analysis</title>
        <p>The knowledge stored in the ICEO ontology can be queried
through different approaches. In this study, we used the
Description Logic (DL) query and SPARQL (a recursive acronym for
SPARQL Protocol and RDF Query Language) query. The DL
query was performed using the Protégé OWL editor. For the
SPARQL query, ICEO was stored in the Resource Description
Framework (RDF; https://www.w3.org/RDF/) triples in the
Ontobee RDF triple store (17, 18). The Ontobee SPARQL query
interface (http://www.ontobee.org/sparql) was then used for ICEO
specific SPARQL query.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <sec id="sec-3-1">
        <title>1. ICEO top-level design and development</title>
        <p>
          a. ICEO is aligned with BFO and OBO foundry ontologies
Fig. 1B represents the basic top-level ICEO hierarchical structure
in accordance with the ICE genetic functional modules (Fig. 1A).
Specifically, ICEO is aligned to the upper-level Basic Formal
Ontology (BFO) 2.0 version (
          <xref ref-type="bibr" rid="ref15">19, 20</xref>
          ). BFO consists of
‘continuant’ and ‘occurrent’ branches. The ‘continuant’ branch
stands for time-independent entities (e.g., material entity and their
quality and roles), while the ‘occurrent’ branch represents
timerelated entities (e.g. process and time). Since BFO has been used
as the upper-level ontology by over 100 ontologies, the alignment
of ICEO with BFO facilitates the effective integration of ICEO
with many other ontologies.
        </p>
        <p>
          To enable the reusability of existing ontologies, ICEO imports
many related terms and relations from OBO library ontologies.
As shown in Fig. 1B, ICEO imports OGG and PR to represent the
genes and proteins of ICEs. NCBITaxon terms are imported to
represent various ICE-containing organisms in the taxonomic
organism hierarchy. GO terms are imported to represent the
processes in the whole life cycle of ICEs.
b. Modified and extensive gene and protein ID assignments
and label naming strategy
Given the ever-growing number of genes sequenced and
annotated, the phenomena of having genes or proteins in different
organisms but with the same names archived in the NCBI
GenBank database is inevitable. To avoid name conflicts, the
original OGG designed a special scheme to automatically assign
gene IDs by mapping ontology ID with NCBITaxon IDs and
NCBI Gene IDs (
          <xref ref-type="bibr" rid="ref13">13</xref>
          ). However, the integer sequence identifiers
known as “GIs” and Gene ID are no longer provided and used by
NCBI for the sequence records in non-reference strains since
September 2016 (
          <xref ref-type="bibr" rid="ref16">21</xref>
          ). Furthermore, for many organisms
harboring ICEs, for example, Escherichia coli strain ECOR31
that carries ICE gene components, there are no available
NCBITaxon IDs. In addition, OGG still faces the gene label
redundancy since OGG only used the gene name or locus tag as
the ontology label of genes.
Due to these reasons, we have worked with the OGG development
team and developed an OGG-based extended strategy of
generating new OGG IDs for gene assignments for ICE-related
genes. Simply put, this strategy assigns OGG gene IDs using
NCBI locus_tag identifiers commonly seen in GenBank gene
records. Generally, if gene name is available for a gene, then it’s
gene label will be assigned as ‘locus_tag(gene_name)’; if not, the
gene label will be ‘locus_tag’. In addition, ‘product’ information
will be added to ‘dc:description’ property of the corresponding
protein. Such a naming strategy allows us to develop and design
computer programs to automatically generate readable and
nonredundant ICEO gene label. For example, the yetE gene in
Klebsiella pneumoniae strain NTUH-K2044 has a locus tag of
KP1_5092. Accordingly, we assign this yetE gene as
‘KP1_5092(yetE)’ and assign its ID as “OGG_KP1_5092” (Fig.
2).
        </p>
        <p>ICE is essentially a genetic feature so that the gene representation
is our priority. Since the Protein Ontology (PR) does not include
all the proteins included in ICEO, we applied a similar strategy to
represent protein names in ICEO (Fig. 2). We have also contacted
the Protein Ontology (PR) team, and will request new classes in
the PR to improve ICEO.</p>
      </sec>
      <sec id="sec-3-2">
        <title>2. ICEO ontology design pattern</title>
        <p>top-level hierarchy (Fig. 1) which shows the hierarchical
relationships among different terms, Fig. 3 shows the logical
relations of related terms across different hierarchical structures
in ICEO. Together, the combination of Fig. 1 and Fig. 3 presents
us a general framework of the ontological design of ICEO.
As shown in Fig. 3A, the basic ICEO design pattern is to represent
ICE from the view of typical function modules. ICE ‘has part’
integration, conjugation, regulation and accessory module
components, and these components and or their encoding proteins
‘participants in’ specific ICE life process.</p>
        <p>
          An example of applying this general design pattern to a concrete
example is shown in Fig. 3B where the design pattern is used to
represent ICEKp1, a virulence-associated ICE found in Klebsiella
pneumoniae subsp. pneumoniae NTUH-K2044 causing a primary
liver abscess (
          <xref ref-type="bibr" rid="ref17 ref18">22, 23</xref>
          ). Basically, ICEKp1 contains all essential
genes necessary to the whole life cycle of ICEKp1 (that is, the
process of excision, conjugation, regulation, and integration)
(Fig. 3B). Besides, a virulence factor gene cluster within
ICEKp1 responsible for the synthesis, regulation, and transport
of the siderophore yersiniabactin confers the high virulence to
the K. pneumoniae NTUH-K2044 (
          <xref ref-type="bibr" rid="ref17 ref18">22, 23</xref>
          ). Fig. 4 is the more
specific demonstration of such an example visualized by Protégé.
The latest release of ICEO contains a total of 7738 terms,
including 7604 classes, 52 object properties, and 78 annotation
properties. Among these terms, 1713 terms have ICEO_
namespace. The full ontology statistics of ICEO is accessible in
the Ontobee ICEO statistics page
(http://www.ontobee.org/ontostat/ICEO).
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>4.ICEO applications</title>
        <p>ICEO is formatted in the machine-interpretable OWL format,
which is easily understood by computer programs and can support
various advanced queries and analyses. Therefore, ICEO can be
used for various applications, such as DL query and SPARQL
query, which is designed for RDF triple and cannot be done
directly in ICEberg. Two ICEO use cases are provided in the
study as follows:
Use Case 1: Use DL Query to query the specified group of
genes of an ICE
ICEO supports OWL-based automated reasoning using reasoning
programs within OWL editors. As an example, we designed the
following question for query the ontology:</p>
        <sec id="sec-3-3-1">
          <title>What genes in the ICEKp1 encode virulence factors?</title>
          <p>
            In ICEO, a virulence factor gene is logically defined as
“something that has role some virulence factor gene role”. To
answer this question, the following query was simply performed
using the DL Query function in ProtégéOWL editor version 5.2
(Fig. 5):
('has role' some 'virulence factor gene role') and ('part
of' some ICEKp1)
As shown in Fig. 5, our query identified 15 genes that are part of
the specific ICEKp1 and also encode for virulence factors in the
host bacterium of the ICEKp1. The result indicates that ICEKp1
is responsible for transporting this set of virulence factor genes to
Klebsiella pneumoniae strain NTUH-K2044, the bacterium that
hosts the ICE. ICEKp1 is indeed critical to make the bacterium
virulent (
            <xref ref-type="bibr" rid="ref17 ref18">22, 23</xref>
            ).
          </p>
          <p>Fig. 5. DL Query window in Protégé5. The query of all the virulence factor genes of ICEKp1 was performed using the DL Query of OWL
editor Protégé5.2. The query code is shown on the top, and the query results are displayed at the bottom.</p>
          <p>Use Case 2: Use SPARQL query for advanced analysis
As the OWL-formatted ICEO is stored in the Ontobee RDF triple
store (17, 18), the ICEO information can be also queried and
analyzed using the RDF query language, SPARQL
(https://www.w3.org/TR/rdf-sparql-query-protocol/).</p>
          <p>Fig. 6 demonstrates a SPARQL query over ICEO. This example
includes only a few lines of SPARQL query code. However, it
enabled the identification of the organisms under the taxonomic
class of ‘Gammaproteobacteria’ (NCBITaxon_1236) that include
experimentally verified ICEKp1 family ICEs. A variety of queries
can be achieved with new SPARQL query scripts for more
practical and advanced analysis.</p>
          <p>Fig. 6. SPARQL query of all the ICEKp1 family ICEs in the taxonomy rank of Gammaproteobacteria. The ICEO term ICEO_0000141
is ‘ICEKp1 family ICE’ class, ICEO_0000020 refers to an object property ‘is ICE of organism’, and the NCBITaxon term
NCBITaxon_1236 points to ‘Gammaproteobacteria’ class. The query was performed using the Ontobee SPARQL query interface
(http://www.ontobee.org/sparql/).
In this study, we developed a community-driven Integrative and
Conjugative Element Ontology (ICEO). ICEO
ontologically represents the complex hierarchical structure of
ICEs, ICE components, and the relations among ICE and ICE
components. As demonstrated in two use cases, the ICEO
representation of the experimentally verified ICE knowledge
supports computer-assisted data integration, efficient query, and
reasoning.</p>
          <p>ICEO now is built by standardizing and integrating the rich
information from ICEberg database. And ICEO can perform tasks
that cannot be done in current ICEberg. For example, in our use
case 1, we were able to easily query any virulence factors for any
level of MGEs. Currently, ICEberg will label VF for those MGEs
that are virulence factors. However, it is still impossible for users
to query all VFs for a specific bacterial group. In our use case 2,
we further illustrate an efficient way of using ICEO to query ICEs
under any specific bacterial taxon level like class, species or
family. ICEberg can only query based on species level. However,
rather than being only a complement or translation of ICEberg
database, ICEO and ICEO-based features will be explored to be
integrated into ICEberg in the future.</p>
          <p>
            ICEO is the first BFO-based ICE ontology. Toussaint et al.
developed the MeGO, a Gene Ontology dedicated to the functions
of mobile genetic elements, and used it in the ACALME database
(A CLAssification of Mobile genetic Elements,
http://aclame.ulb.ac.be/) (
            <xref ref-type="bibr" rid="ref19 ref20 ref21">24–26</xref>
            ). MeGO is a non-OBO ontology
expanded from the Phage Ontology (PhiGO). MeGO contains 375
classes, a single object property (which is “part of”), and 22
annotation properties. Most of MeGO terms are related to phages,
GO, and sequences. Only a few terms directly related to ICE are
included in MeGO. MeGO does not include any specific ICEs and
ICE gene components. In addition, MeGO terms are poorly
aligned. It is also noted that the MeGO and ACALME database
have not been updated in the past six years. In comparison, ICEO
is systematically developed by aligning with the widely used BFO
upper level ontology and following the OBO Foundry principles.
          </p>
          <p>ICEO represents the complicated gene components, functional
modules and related information about T4SS-type ICEs and
AICEs, making it possible to perform the automatically
computer-assisted reasoning, query, and advanced analysis of
ICE.</p>
          <p>
            However, ICEO is currently at its early development stage and
will be further developed in the future. We will represent more
known information about T4SS-type ICEs. Due to differences in
cell membrane structure, Gram-positive and Gram-negative
bacteria have different T4SS organization and features and are
associated with different T4SS-type ICEs information. Such
differential characteristics will be further categorized, modeled,
and represented in ICEO. Besides, only 11 experimentally
verified AICE are included in ICEO. Compared with T4SS-type
ICEs, AICE is less commonly seen in bacteria. However, AICE
is also important in terms of developing useful tools for genetic
engineering of Actinobacteria (
            <xref ref-type="bibr" rid="ref22">27</xref>
            ). In the future, we plan to more
systematically represent and analyze AICE information in ICEO.
          </p>
          <p>ICEO will be also be used for more applications. A major
application is to apply ICEO as the base of the next version of the
ICEberg database to standardize and integrate the rich ICE
information for the advanced data sharing and organization.</p>
          <p>
            Second, we are going to combine and integrate the structured
ICEO ontology into the ICEfinder (
            <xref ref-type="bibr" rid="ref3">3</xref>
            ), an ICE prediction tool
developed also by our group with both web server and standalone
versions available. With the use of ICEO, the enhanced ICEfinder
will facilitate more effective, accurate prediction of ICE and
powerful sequence analysis from the raw genome sequence.
          </p>
          <p>
            Furthermore, ICEO may also facilitate ontology-based literature
mining, which has been shown in many other ontology-based
research domains (
            <xref ref-type="bibr" rid="ref23 ref24">28, 29</xref>
            ).
          </p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>To conclude, ICEO is a biological ontology and a
knowledgecentric platform of the bacterial integrative and conjugative
element. ICEO can serve as an ICE knowledgebase and facilitate
the systematical representation, integration and automatical
computer-assisted reasoning of ICE data.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>National Key R&amp;D Program of China [2017YFC1600100 to
H.Y.O.]; ML was supported by a jointly funded
Ph.D.studentship of the China Scholarship Council and University of
Michigan Medical School (Grant No. 201806230209).</p>
    </sec>
    <sec id="sec-6">
      <title>Address for correspondence</title>
      <p>YH and HYO are the co-corresponding authors. Their email
addresses are yongqunh@med.umich.edu and hyou@sjtu.edu.cn
respectively. Any suggestions or questions are highly welcomed.
15. NCBITaxon: An ontology representation of the NCBI
organismal taxonomy.
http://obofoundry.org/ontology/ncbitaxon.html.
16. Xiang,Z., Zheng,J., Lin,Y. and He,Y. (2015) Ontorat:
automatic generation of new ontology terms, annotations, and
axioms based on ontology design patterns. Journal of biomedical
semantics, 6, 4.
17. Xiang,Z., Mungall,C., Ruttenberg,A. and He,Y. (2011)
Ontobee: A linked data server and browser for ontology terms. In
ICBO.
18. Ong,E., Xiang,Z., Zhao,B., Liu,Y., Lin,Y., Zheng,J.,
Mungall,C., Courtot,M., Ruttenberg,A. and He,Y. (2016)
Ontobee: A linked ontology data server to support ontology term
dereferencing, linkage, query and integration. Nucleic acids
research, 10.1093/nar/gkw918.
19. Grenon,P. (2003) Spatio-temporality in basic formal ontology
Ifomis.</p>
      <sec id="sec-6-1">
        <title>Responses to the Reviewers:</title>
        <p>----------------------------------------------------------------We appreciate the time and efforts of the reviewers who
reviewed our manuscript. Their suggestions and comments are
constructive and helpful. We have revised our manuscript by
incorporating these comments accordingly as described below. It
is noted that the italicized paragraphs below are the reviewer’s
comments and our followed replies are in regular font style.
----------------------- REVIEW 1
--------------------</p>
        <sec id="sec-6-1-1">
          <title>SUBMISSION: 23</title>
        </sec>
        <sec id="sec-6-1-2">
          <title>TITLE: ICEO: a biological ontology for representing and ana</title>
          <p>lyzing the bacterial integrative and conjugative element</p>
        </sec>
        <sec id="sec-6-1-3">
          <title>AUTHORS: Meng Liu, Hong-Yu Ou and Yongqun He</title>
          <p>----------- Overall evaluation
----------</p>
        </sec>
        <sec id="sec-6-1-4">
          <title>SCORE: 2 (accept) ----- TEXT:</title>
        </sec>
        <sec id="sec-6-1-5">
          <title>Nice, clearly written paper on the development of an application ontology for bacterial mobile genetic elements. Good strong use-case and I liked the inclusion of example queries that the ontology could be used for.</title>
        </sec>
        <sec id="sec-6-1-6">
          <title>The gene-naming issue seems like it might be an issue long-term, but this is largely out of the authors control and they seem to address it in a pragmatic way.</title>
          <p>Reply: Thanks for your kind and positive comments.
The authors mention their use of the "eXtensive Ontology
Development (XOD) strategy" which includes the involvement of
community efforts to develop ontologies, but how they in fact involve
the community is not discussed. The paper would be improved
by the authors discussing how they had approached their
interaction with the community - e.g. by providing the ontology to
experts for review.</p>
          <p>Reply: We have submitted the ICEO to the OBO Foundry
community and have been checking and refining the ICEO according
to the community’s comments.
----------------------- REVIEW 2
--------------------</p>
        </sec>
        <sec id="sec-6-1-7">
          <title>SUBMISSION: 23</title>
        </sec>
        <sec id="sec-6-1-8">
          <title>TITLE: ICEO: a biological ontology for representing and ana</title>
          <p>lyzing the bacterial integrative and conjugative element</p>
        </sec>
        <sec id="sec-6-1-9">
          <title>AUTHORS: Meng Liu, Hong-Yu Ou and Yongqun He</title>
          <p>----------- Overall evaluation
----------</p>
        </sec>
        <sec id="sec-6-1-10">
          <title>SCORE: 1 (weak accept) ----- TEXT:</title>
        </sec>
        <sec id="sec-6-1-11">
          <title>This paper describes the translation of a database (ICEberg) of</title>
          <p>bacterial integrative and conjugative elements (ICEs) into an
ontology (ICEO). ICEO builds on existing OBO ontologies such
as the Basic Formal Ontology, the Protein Ontology, and the</p>
        </sec>
        <sec id="sec-6-1-12">
          <title>Ontology of Genes and Genomes. The authors explain the design patterns used to build ICEO and demonstrate how the results can be queried. The presentation is clear and the subject is in scope for ICBO, however the novelty is limited.</title>
          <p>Reply: We appreciate the reviewer’s summary and positive
comments.</p>
        </sec>
        <sec id="sec-6-1-13">
          <title>The greatest shortcoming of this paper is that it does not clearly</title>
          <p>demonstrate the benefits of the ontological translation. Are the</p>
        </sec>
        <sec id="sec-6-1-14">
          <title>DL and SPARQL queries doing work that could not be done directly in ICEberg?</title>
          <p>Reply: This is a good point. We have added a new paragraph in
the Discussion part to address the reviewer’s comment:
“ICEO now is built by standardizing and integrating the
rich information from ICEberg database. And ICEO can
perform tasks that cannot be done in current ICEberg.
For example, in our use case 1, we were able to easily
query any virulence factors for any level of MGEs.
Currently, ICEberg will label VF for those MGEs that
are virulence factors. However, it is still impossible for
users to query all VFs for a specific bacterial group. In
our use case 2, we further illustrate an efficient way of
using ICEO to query ICEs under any specific bacterial
taxon level like class, species or family. ICEberg can
only query based on species level. However, rather than
being only a complement or translation of ICEberg
database, ICEO and ICEO-based features will be
explored to be integrated into ICEberg in the future.”
(Discussion part, column 1, paragraph 2)</p>
        </sec>
        <sec id="sec-6-1-15">
          <title>I reviewed the paper and looked at the project's GitHub reposi</title>
          <p>tory and OWL files. The `iceo_merged.owl` file loaded in
Protege and reasoned under HermiT. ICEO claims to be
developed according to OBO principles. It uses an OBO namespace
&lt;http://purl.obolibrary.org/obo/ICEO_&gt;, however no OBO ID
has been requested for ICEO. The paper claims a CC-BY 4.0
license, but the GitHub repository and OWL files contain no
license information. I did not see any textual definitions for ICEO
terms.</p>
          <p>Reply: We have submitted the OBO ID request for ICEO and
have been refining the ICEO according to the community’s
comments. CC-BY 4.0 license and all the textual definitions have
been added to the ICEO.</p>
        </sec>
        <sec id="sec-6-1-16">
          <title>Minor points:</title>
          <p>- p2 "eXtensive Ontology Development" should be "eXtensible</p>
        </sec>
        <sec id="sec-6-1-17">
          <title>Ontology Development" - Figure 3 "particpants in" should be "participates in".</title>
          <p>Reply: All the above points have been corrected in the latest
version manuscript.
----------------------- REVIEW 3
--------------------</p>
        </sec>
        <sec id="sec-6-1-18">
          <title>SUBMISSION: 23</title>
        </sec>
        <sec id="sec-6-1-19">
          <title>TITLE: ICEO: a biological ontology for representing and ana</title>
          <p>lyzing the bacterial integrative and conjugative element</p>
        </sec>
        <sec id="sec-6-1-20">
          <title>AUTHORS: Meng Liu, Hong-Yu Ou and Yongqun He</title>
          <p>----------- Overall evaluation
----------</p>
        </sec>
        <sec id="sec-6-1-21">
          <title>SCORE: 2 (accept) ----- TEXT:</title>
        </sec>
        <sec id="sec-6-1-22">
          <title>Liu et al. present the ICEO ontology for the representation of bacterial integrative and conjugative element, ICE. In general the presentation is clear and the paper is fairly well written with just a few errors.</title>
        </sec>
        <sec id="sec-6-1-23">
          <title>Positive points:</title>
        </sec>
        <sec id="sec-6-1-24">
          <title>1) The ontology is grounded in BFO and OBO-Foundry princi</title>
          <p>ples quite well, and the authors make an appropriate nod to the</p>
        </sec>
        <sec id="sec-6-1-25">
          <title>FAIR principles.</title>
        </sec>
        <sec id="sec-6-1-26">
          <title>2) The design patterns presented seem appropriate for repre</title>
          <p>senting the domain of ICE.</p>
        </sec>
        <sec id="sec-6-1-27">
          <title>3) The authors present the use of ICEO for querying of ICE via</title>
        </sec>
        <sec id="sec-6-1-28">
          <title>DL and SPARQL, and presumably the results would be useful to researchers in this domain.</title>
          <p>Reply: Thanks for your positive comments and advice.</p>
        </sec>
        <sec id="sec-6-1-29">
          <title>Of interest:</title>
          <p>The Authors state: "Since the Protein Ontology (PR) does not
include all the proteins included in ICEO. We applied a similar
strategy to represent protein names in ICEO (Fig. 2)." The
should be a single sentence, but more importantly, the authors
should request classes in the PR to cover the protein entities of
interest, and then revise their ontology appropriately. This is
part of working within the OBO Foundry community.</p>
        </sec>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Johnson</surname>
            ,
            <given-names>C.M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Grossman</surname>
            ,
            <given-names>A.D.</given-names>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>Integrative and Conjugative Elements (ICEs): What They Do and How They Work</article-title>
          .
          <source>Annu Rev Genet</source>
          ,
          <volume>49</volume>
          ,
          <fpage>577</fpage>
          -
          <lpage>601</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Delavat</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miyazaki</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carraro</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pradervand</surname>
          </string-name>
          ,N. and
          <string-name>
            <surname>van der Meer</surname>
            ,
            <given-names>J.R.</given-names>
          </string-name>
          (
          <year>2017</year>
          )
          <article-title>The hidden life of integrative and conjugative elements</article-title>
          .
          <source>FEMS microbiology reviews</source>
          ,
          <volume>41</volume>
          ,
          <fpage>512</fpage>
          -
          <lpage>537</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xie</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sun</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tai</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Deng</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Ou</surname>
          </string-name>
          ,H.-
          <source>Y. ICEberg 2</source>
          .
          <article-title>0: an updated database of bacterial integrative and conjugative elements</article-title>
          .
          <source>Nucleic Acids Res</source>
          ,
          <volume>10</volume>
          .1093/nar/gky1123.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Frost</surname>
            ,
            <given-names>L.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leplae</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Summers</surname>
            ,
            <given-names>A.O.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Toussaint</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2005</year>
          )
          <article-title>Mobile genetic elements: the agents of open source evolution</article-title>
          .
          <source>Nature</source>
          Reviews Microbiology,
          <volume>3</volume>
          ,
          <fpage>722</fpage>
          -
          <lpage>732</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Toussaint</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Chandler</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Prokaryote Genome Fluidity: Toward a System Approach of the Mobilome</article-title>
          . In van Helden,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Toussaint</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Thieffry</surname>
          </string-name>
          ,
          <string-name>
            <surname>D</surname>
          </string-name>
          . (eds),
          <source>Bacterial Molecular Networks: Methods and Protocols, Methods in Molecular Biology</source>
          . Springer New York, New York, NY, pp.
          <fpage>57</fpage>
          -
          <lpage>80</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Hoehndorf</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schofield</surname>
            ,
            <given-names>P.N.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Gkoutos</surname>
            ,
            <given-names>G.V.</given-names>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>The role of ontologies in biological and biomedical research: a functional perspective</article-title>
          .
          <source>Brief Bioinform</source>
          ,
          <volume>16</volume>
          ,
          <fpage>1069</fpage>
          -
          <lpage>1080</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>The</given-names>
            <surname>Gene Ontology Consortium</surname>
          </string-name>
          (
          <year>2019</year>
          )
          <article-title>The Gene Ontology Resource: 20 years and still GOing strong</article-title>
          .
          <source>Nucleic Acids Research</source>
          ,
          <volume>47</volume>
          ,
          <fpage>D330</fpage>
          -
          <lpage>D338</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ashburner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosse</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bard</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bug</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ceusters</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goldberg</surname>
            ,
            <given-names>L.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eilbeck</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ireland</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mungall</surname>
            ,
            <given-names>C.J.</given-names>
          </string-name>
          , et al. (
          <year>2007</year>
          )
          <article-title>The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration</article-title>
          .
          <source>Nat Biotechnol</source>
          ,
          <volume>25</volume>
          ,
          <fpage>1251</fpage>
          -
          <lpage>5</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zheng</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Overton</surname>
            ,
            <given-names>J.A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Ong</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2018</year>
          )
          <article-title>The eXtensible ontology development (XOD) principles and tool implementation to support ontology interoperability</article-title>
          .
          <source>J Biomed Semantics</source>
          ,
          <volume>9</volume>
          ,
          <fpage>3</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Group</surname>
            ,
            <given-names>O.W.</given-names>
          </string-name>
          <article-title>and others (2009) OWL 2 Web Ontology Language Document Overview: W3C Recommendation 27 October 2009</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Wilkinson</surname>
            ,
            <given-names>M.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aalbersberg</surname>
          </string-name>
          ,Ij.J.,
          <string-name>
            <surname>Appleton</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Axton</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baak</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blomberg</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boiten</surname>
            ,J.-W., da Silva Santos,
            <given-names>L.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bourne</surname>
            ,
            <given-names>P.E.</given-names>
          </string-name>
          , et al. (
          <year>2016</year>
          )
          <article-title>The FAIR Guiding Principles for scientific data management and stewardship</article-title>
          .
          <source>Scientific Data</source>
          ,
          <volume>3</volume>
          ,
          <fpage>160018</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Xiang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Courtot</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brinkman</surname>
            ,
            <given-names>R.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruttenberg</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2010</year>
          )
          <article-title>OntoFox: web-based support for ontology reuse</article-title>
          .
          <source>BMC research notes</source>
          ,
          <volume>3</volume>
          ,
          <fpage>175</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Zhao</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>OGG: a Biological Ontology for Representing Genes and Genomes in Specific Organisms</article-title>
          .
          <source>In ICBO. Citeseer</source>
          , pp.
          <fpage>13</fpage>
          -
          <lpage>20</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Natale</surname>
            ,
            <given-names>D.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arighi</surname>
            ,
            <given-names>C.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blake</surname>
            ,
            <given-names>J.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bult</surname>
            ,
            <given-names>C.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Christie</surname>
            ,
            <given-names>K.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cowart</surname>
          </string-name>
          ,J.,
          <string-name>
            <surname>D'Eustachio</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Diehl</surname>
            ,
            <given-names>A.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drabkin</surname>
            ,
            <given-names>H.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Helfer</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          , et al. (
          <year>2014</year>
          )
          <article-title>Protein Ontology: a controlled structured network of protein entities</article-title>
          .
          <source>Nucleic Acids Res</source>
          ,
          <volume>42</volume>
          ,
          <fpage>D415</fpage>
          -
          <lpage>D421</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          20.
          <string-name>
            <surname>Arp</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Spear</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>Building Ontologies using basic formal ontology</article-title>
          . Cambridge, MA, USA,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          21.
          <article-title>NCBI is phasing out sequence GIs -</article-title>
          use
          <string-name>
            <surname>Accession</surname>
          </string-name>
          .Version instead! (
          <year>2012</year>
          ) https://www.ncbi.nlm.nih.gov/books/NBK431010/#news_
          <fpage>03</fpage>
          -
          <lpage>02</lpage>
          -2016
          <article-title>-phase-out-of-GI-numbers.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          22.
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>T.-L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>C.-Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hsieh</surname>
          </string-name>
          ,P.-F.,
          <string-name>
            <surname>Tsai</surname>
            ,
            <given-names>S.-F.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.-T.</surname>
          </string-name>
          (
          <year>2008</year>
          )
          <article-title>Characterization of Integrative and Conjugative Element ICEKp1-Associated Genomic Heterogeneity in a Klebsiella pneumoniae Strain Isolated from a Primary Liver Abscess</article-title>
          .
          <source>J Bacteriol</source>
          ,
          <volume>190</volume>
          ,
          <fpage>515</fpage>
          -
          <lpage>526</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          23.
          <string-name>
            <surname>Wu</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.-M.</surname>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>L.-H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yan</surname>
          </string-name>
          ,J.-J.,
          <string-name>
            <surname>Tsao</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liao</surname>
          </string-name>
          ,T.-L.,
          <string-name>
            <surname>Tsai</surname>
          </string-name>
          ,H.- C.,
          <string-name>
            <surname>Fung</surname>
            ,
            <given-names>C.-P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,H.-J., Liu,
            <given-names>Y.-M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
          </string-name>
          ,J.
          <string-name>
            <surname>-T.</surname>
          </string-name>
          , et al. (
          <year>2009</year>
          )
          <article-title>Genome sequencing and comparative analysis of Klebsiella pneumoniae NTUH-K2044, a strain causing liver abscess and meningitis</article-title>
          .
          <source>J. Bacteriol.</source>
          ,
          <volume>191</volume>
          ,
          <fpage>4492</fpage>
          -
          <lpage>4501</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          24.
          <string-name>
            <surname>Leplae</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hebrant</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wodak</surname>
            ,
            <given-names>S.J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Toussaint</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2004</year>
          )
          <article-title>ACLAME: A CLAssification of Mobile genetic Elements</article-title>
          .
          <source>Nucleic Acids Res</source>
          ,
          <volume>32</volume>
          ,
          <fpage>D45</fpage>
          -
          <lpage>D49</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          25.
          <string-name>
            <surname>Toussaint</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lima-Mendez</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Leplae</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2007</year>
          )
          <article-title>PhiGO, a phage ontology associated with the ACLAME database</article-title>
          . Research in microbiology,
          <volume>158</volume>
          ,
          <fpage>567</fpage>
          -
          <lpage>71</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          26.
          <string-name>
            <surname>Leplae</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lima-Mendez</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Toussaint</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2010</year>
          )
          <article-title>ACLAME: A CLAssification of Mobile genetic Elements, update 2010</article-title>
          .
          <source>Nucleic Acids Research</source>
          ,
          <volume>38</volume>
          ,
          <fpage>D57</fpage>
          -
          <lpage>D61</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          27.
          <string-name>
            <surname>Raynal</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karray</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tuphile</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Darbon-Rongère</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Pernodet</surname>
            ,
            <given-names>J.-L.</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>Excisable Cassettes: New Tools for Functional Analysis of Streptomyces Genomes</article-title>
          . Appl. Environ. Microbiol.,
          <volume>72</volume>
          ,
          <fpage>4839</fpage>
          -
          <lpage>4844</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          28.
          <string-name>
            <surname>Hur</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ozgur</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          and
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Identification of fever and vaccine-associated gene interaction networks using ontology-based literature mining</article-title>
          .
          <source>Journal of biomedical semantics</source>
          ,
          <volume>3</volume>
          ,
          <fpage>18</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          29.
          <string-name>
            <surname>Hur</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Özgür</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          and
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>Development and application of an interaction network ontology for literature mining of vaccine-associated gene-gene interactions</article-title>
          .
          <source>Journal of Biomedical Semantics</source>
          ,
          <volume>6</volume>
          ,
          <fpage>2</fpage>
          . Reply:
          <article-title>Thanks for your advice. We have added a new paragraph in the Results part to address the reviewer's comment: “ICE is essentially a genetic feature so that the gene representation is our priority. Since the Protein Ontology (PR) does not include all the proteins included in ICEO, we applied a similar strategy to represent protein names in ICEO (Fig. 2). We have also contacted the Protein Ontology (PR) team, and will request new classes in the PR to improve ICEO.” (Results part, column 1</article-title>
          , paragraph 4)
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>