<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Modeling Logical Definitions in Biomedical Ontologies by Reusing Ontology Design Patterns</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mirna El Ghosh</string-name>
          <email>mirna.el-ghosh@inserm.fr</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fethi Ghazouani</string-name>
          <email>fethi.ghazouani@inserm.fr</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Benjamin Birene</string-name>
          <email>benjamin.birene@etu.sorbonne-universite.fr</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Elise Akan</string-name>
          <email>elise.akan@sorbonne-universite.fr</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jean Charlet</string-name>
          <email>jean.charlet@sorbonne-universite.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ferdinand Dhombres</string-name>
          <email>ferdinand.dhombres@inserm.fr</email>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>AP-HP/DRCI</institution>
          ,
          <addr-line>Paris</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>INSERM, Sorbonne Université, Univ. Sorbonne Paris-Nord, LIMICS</institution>
          ,
          <addr-line>Paris</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Médecine Sorbonne Université, GRC-26, Service de Médecine Foetale, AP-HP, Hôpital Armand Trousseau</institution>
          ,
          <addr-line>Paris</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Logical definitions are addressed in biomedical ontologies such as the Human Phenotype Ontology (HPO) to allow cross-species mapping by means of automated semantic reasoning. These definitions aim to associate ontological terms within an ontology to external species-neutral ontological resources. However, applying logical definitions manually in ontologies under development is a challenging issue. Thus, approaches supporting extensible ontology development and pattern-based ontology design are tackled to reuse logical definitions as Ontology Design Patterns (ODPs) and apply them in the context of the SUOG project. ODPs are reusable modeling solutions used to facilitate ontology development.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology</kwd>
        <kwd>logical definitions</kwd>
        <kwd>ontology reuse</kwd>
        <kwd>Ontology Design Patterns</kwd>
        <kwd>biomedical ontologies</kwd>
        <kwd>HPO</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction and Motivation</title>
      <p>
        Logical definitions in biomedical ontologies such as HPO 1 [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and MPO2 [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] allow cross-species
mapping, using automated semantic reasoning. Besides, they support quality control [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and
classifications (is-a/subclass relationships inferences). These definitions aim to associate terms
within an ontology with terms in external species-neutral ontological resources such as PATO3
an ontology of phenotypic qualities. For example, consider the following logical definition of
the HPO term I m m u n o d e f i c i e n c y (HP:0002721).
      </p>
      <p>
        ' h a s p a r t ' s o m e ( ' d e c r e a s e d r a t e '
a n d ( ' i n h e r e s i n ' s o m e ' i m m u n e r e s p o n s e ' )
CEUR
Workshop
Proceedings
I m m u n o d e f i c i e n c y refers to the failure of the immune system to protect the body adequately from
infection, due to the absence or insuficiency of some component process or substance . In its logical
definition, I m m u n o d e f i c i e n c y is defined as being equivalent to the intersection of all classes of
things that are “a rate which is lower relative to the normal” (d e c r e a s e d r a t e ), “deviate from
the normal or average” (a b n o r m a l ), and inhering in the “immune system” using the term i m m u n e
r e s p o n s e from Gene Ontology. The logical definition uses relations such as has part, inheres in,
and has modifier reused from logically well-formed ontologies [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] such as BFO4 and RO5.
      </p>
      <p>
        Encoding logical definitions manually in ontologies under development is a challenging
task. Thus, approaches supporting extensible ontology development (e.g., MIREOT [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]) and
pattern-based ontology engineering approaches (e.g., eXtreme Design (XD) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]) are tackled.
Such approaches bring solutions to reuse and apply generic logical definitions as ontology
patterns. While extensible ontology development permits the extraction of ontology subsets
for term reuse and semantic alignment, pattern-based approaches aim to model new parts of
an ontology using Ontology Design Patterns (ODPs)6. ODPs are defined as reusable modeling
solutions to frequently occurring ontology design problems [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. In the biomedical domain, ODPs
are encouraging to capture common modeling situations, help facilitate ontology development
and avoid common mistakes [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>
        In the SUOG (Smart Ultrasound in Obstetrics and Gynecology) project7, an ontology-based
decision support system for complex ultrasound diagnosis in obstetrics and gynecology is
intended [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. The SUOG ontology, which is under development, distinguishes two main
subontologies: (1) disorders that describe the pregnancy state concepts (e.g., alagille syndrome, limb
dysostosis, cerebral midline anomaly, congenital anomaly of truncal valve, etc.) and prenatal
ifndings (e.g. abnormal atrial arrangement finding, absent right superior caval vein finding,
cerebral arteriovenous malformation finding, etc.), that suggest one or more disorders. Aiming
to enrich the SUOG ontology semantically, logical definitions are required to define findings
and disorders concepts in terms of other more elementary (atomic) concepts [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. This work
proposes combining extensible ontology development and pattern-based approaches to reuse
(from HPO) shared and validated logical definitions as ODPs and adapt and apply them in the
SUOG ontology. The remainder of this paper is organized as follows. Section 2 outlines the
related work. In section 3, the proposed approach is presented. Section 4 discusses applying the
approach in the SUOG ontology. Finally, section 5 concludes the paper.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Related Works</title>
      <p>
        This section outlines briefly the eXtensible Ontology Development (XOD) strategy [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and
Dead Simple Ontology Design Patterns (DOS-DPs) [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] as related works. XOD is based mainly
on two principles: ontology term reuse from existing reliable ontologies that are commonly
used by the ontology community and ODP usage for new term generation and existing term
editing. For ontology reuse, XOD suggests applying MIREOT strategy [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] as a commonly known
      </p>
      <sec id="sec-2-1">
        <title>4Basic Formal Ontology, http://www.obofoundry.org/ontology/bfo.html 5Relation Ontology, http://www.obofoundry.org/ontology/ro.html 6http://ontologydesignpatterns.org 7https://www.suog.org/</title>
        <p>approach. Meanwhile, for ODP usage, the definition of an ODP-based strategy is required.
DOSDP is a pattern-based ontology development practice used to manage the generation of logical
definitions in HPO. This approach contributed to developing common patterns valuable for
phenotype ontologies which can be applied to a whole branch of an ontology at once. DOS-DPs,
which are encoded using JSON8, are intended for ontology editors with limited computational
expertise. Each pattern is composed of core specification fields such as classes, relations, and
vars that range over OWL classes. Thus, DOS-DPs rely mainly on developing ontology patterns
to define ontology terms. Meanwhile, in the SUOG ontology, to not reinvent the wheel, we seek
to reuse shared and validated ontology patterns for modeling logical definitions.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Proposed Approach: Reusing Logical Definitions as ODPs</title>
      <p>
        Our main objective is to define an approach permitting to reuse (from HPO) and apply (in the
SUOG ontology) logical definitions based on ODPs. Thus, combining pattern-based and
extensible ontology development approaches is proposed. Therefore, we tackled pattern-oriented
ontology design methodologies such as the eXtreme Design (XD) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. XD describes strategies for
selecting ODPs for reuse purposes. ODPs are classified into diferent types such as, Presentation,
Reasoning, Content, and Structural. We are interested in Content ODPs that solve modeling
issues regarding ontology content, either in the general or a specific domain of the study [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
This study explores Content ODPs in the specific domain which is the modeling of logical
definitions. Inspired by XOD [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and based on XD [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], the following steps are defined.
1. Ontology requirements: describe the main requirements related to logical definitions in
the context of the ontology under development.
2. Competency questions (CQs): translate the ontology requirements into natural or formal
language (e.g., SPARQL) questions. CQs will be used further to validate the ontology
parts concerned with logical definitions.
3. Pattern selection: aims to select ontology patterns related to logical definitions from
ontological resources (HPO in our case). More specifically, common patterns representing
the “blueprint of logical definitions” [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and matching the defined competency questions
are selected and not the actual definition of terms.
4. Pattern reuse: proposes to reuse the selected pattern(s) in the target ontology. Diferent
reuse operations are identified [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. We are interested in: import of ontology pattern as a
“building block”, specialization that creates an ODP version to specialize concepts and
relations conceptually, and composition that combines diferent ODPs to solve the design
problem. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
5. Ontology reuse: to apply the selected patterns, ontology reuse is required. It is prescribed
as content-based reuse of ontological concepts, or classes, and relations, or properties,
from existing validated biomedical ontologies called source ontologies [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] (e.g., PATO,
BFO, and RO). For implementing the content-based reuse, MIREOT [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] can be applied
using automated tools such as ROBOT [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] and OntoFox [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. MIREOT proposes using
the minimal information of an external ontology term that is of direct interest to a target
ontology. Thus, when a class is reused, an ontology module that contains the class unique
identifier, superclasses, and annotations is built automatically [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] and imported to the
ontology under development.
6. Pattern verification and integration : aims to verify that the reused pattern covers the
requirements. Furthermore, the pattern is integrated in the ontology module [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
These steps are performed iteratively for each selected pattern under the supervision and
validation of domain experts.
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Application in the SUOG Ontology</title>
      <p>This section presents preliminary work on applying the proposed approach (Section 3) for
defining prenatal findings in the SUOG ontology logically.</p>
      <p>1. Ontology requirements: in SUOG, prenatal findings are “signs” identified using echographic
mechanisms. They are classified into diferent categories regarding the afected global
anatomical structure. Examples of findings categories are f e t a l a b d o m e n f i n d i n g , f e t a l
b r a i n f i n d i n g , f e t a l h e a r t f i n d i n g , etc. Following HPO logical definitions of phenotype
abnormalities, findings can be recognized as signs having some abnormal qualities. Thus,
the main requirement in SUOG is to associate quality-oriented logical definitions to
prenatal findings categories and their subclasses. A q u a l i t y is defined in PATO as a
dependent entity that inheres in a bearer by virtue of how the bearer is related to other
entities. Moreover, to diferentiate prenatal findings from other types of findings (e.g.,
adult findings), an additional requirement is specified to define the human life cycle stage
at which the finding’s existence begins or appears.
2. Competency questions: examples of CQs describing the ontology requirements in SUOG
represented in natural language are: (CQ1) What are the main qualities related to prenatal
ifndings? (CQ2) How are these qualities defined? (CQ3) What are the basic anatomical
structures that the defined qualities inhere in? (CQ4) What are the specific modifiers
associated to the defined qualities? (CQ5) At which age do the findings existence appear?
3. Pattern selection: diferent definitions patterns in HPO matched our competency questions.</p>
      <p>
        Thus, a selection of blueprint logical definition patterns is performed such as the following
existence ( 1 ) and quality ( 2 ) patterns. While  2 describes quality-oriented definitions,
 1 aims to define the stage at which manifestation, or existence, of findings, starts. As in
DOS-DPs [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], these patterns are composed of basic categories (classes and relations) and
variables   that span across OWL classes.
      </p>
      <p>P1: 'existence starts during' some var
P2: 'has part' some ('quality'
and ('inheres in' some var)
and ('has modifier' some var))
4. Pattern reuse: since all prenatal findings in SUOG are commonly existent at the fetal stage,
 1 is required to define the diferent categories of p r e n a t a l f i n d i n g . In the current work,
 1 and  2 are applied by composition 107 times to define p r e n a t a l f i n d i n g , prenatal
findings categories (e.g., f e t a l b r a i n f i n d i n g , f e t a l h e a r t f i n d i n g , etc.) and subcategories
(e.g., c e r e b e l l u m f i n d i n g , c o r t e x f i n d i n g , and 4 t h v e n t r i c l e f i n d i n g are subcategories
of f e t a l b r a i n f i n d i n g ). In the following, p r e n a t a l f i n d i n g and f e t a l b r a i n f i n d i n g
are defined.</p>
      <p>
        ' p r e n a t a l f i n d i n g ' E q u i v a l e n t T o ' h a s p a r t ' s o m e ( ' q u a l i t y '
a n d ( ' i n h e r e s i n ' s o m e ' a n a t o m i c a l s t r u c t u r e ' )
a n d ( ' h a s m o d i f i e r ' s o m e ' a b n o r m a l ' ) )
a n d ' e x i s t e n c e s t a r t s d u r i n g ' s o m e ' F e t a l s t a g e '
' f e t a l b r a i n f i n d i n g ' E q u i v a l e n t T o ' h a s p a r t ' s o m e ( ' q u a l i t y '
a n d ( ' i n h e r e s i n ' s o m e ' b r a i n ' )
a n d ( ' h a s m o d i f i e r ' s o m e ' a b n o r m a l ' ) )
a n d ' e x i s t e n c e s t a r t s d u r i n g ' s o m e ' F e t a l s t a g e '
Besides, the pattern specialization operation is feasible in the SUOG ontology for
defining more specific findings (e.g., e n l a r g e d 4 t h v e n t r i c l e and d i l a t e d 4 t h v e n t r i c l e are
specific findings of 4 t h v e n t r i c l e f i n d i n g ). In the following, an example of defining
e n l a r g e d 4 t h v e n t r i c l e is presented by specializing some concepts of the pattern  2 .
' e n l a r g e d 4 t h v e n t r i c l e ' E q u i v a l e n t T o ' h a s p a r t ' s o m e ( ' i n c r e a s e d q u a l i t y '
a n d ( ' i n h e r e s i n ' s o m e ' f o u r t h v e n t r i c l e ' )
a n d ( ' h a s m o d i f i e r ' s o m e ' a b n o r m a l ' ) )
a n d ' e x i s t e n c e s t a r t s d u r i n g ' s o m e ' F e t a l s t a g e '
5. Ontology reuse: to apply the selected patterns, there is a need to reuse concepts such as
q u a l i t y , b r a i n , f o u r t h v e n t r i c l e , and F e t a l s t a g e , and relations such as has part, inheres
in, and has modifier . The ontological resources for reuse purposes are defined by fetal
ultrasound experts. Figure 1 depicts an example of ontology modules (e.g., anatomical
entity, Onset, quality) reused from UBERON9, HPO, and PATO using Ontofox [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. These
modules are imported in the SUOG ontology using owl:import.
6. Pattern verification and integration : the associated logical definitions are verified against
the CQs, validated by the domain experts, and integrated in SUOG. Figure 2 depicts the
logical definition of f e t a l b r a i n f i n d i n g .
      </p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion</title>
      <p>
        Modeling logical definitions is a promising research field to enrich biomedical ontologies
semantically. At the early stages of ontology development, logical definitions associate the
terms to external validated ontological resources. In this work, combining pattern-based and
extensible ontology development is proposed to select and reuse logical definitions as ODPs. In
the SUOG ontology, ODPs reused from HPO are adapted to define prenatal findings logically.
The preliminary results are encouraging, 35 findings categories and 72 subcategories are defined
by reusing a quality-oriented HPO pattern. In further works, we will accomplish the definitions
of findings subcategories and specific classes. ROBOT [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] will be applied for ontology reuse.
Besides, patterns adapted to define pregnancy disorders will be considered. In this regard, unlike
ifndings, which are based on qualities, disorders will be based on dispositions (BFO:disposition).
      </p>
      <sec id="sec-5-1">
        <title>9http://www.obofoundry.org/ontology/uberon.html</title>
        <p>
          This decision is grounded on the assumption of representing disorders as material basis of
dispositions realized in pathological processes [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. Moreover, this work will support the ongoing
HPO evolution to cover the fetal phenotype.
        </p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>This project is funded by the EIT-Health Innovation program, selected as part of the bp2020#20062.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.</given-names>
            <surname>Köhler</surname>
          </string-name>
          , et al.,
          <article-title>Expansion of the human phenotype ontology (hpo) knowledge base and resources</article-title>
          ,
          <source>Nucleic Acids Research</source>
          <volume>47</volume>
          (
          <year>2019</year>
          ).
          <article-title>doi:1 0 . 1 0 9 3 / n a r / g k y 1 1 0 5</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>C. L.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.-A. W.</given-names>
            <surname>Goldsmith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. T.</given-names>
            <surname>Eppig</surname>
          </string-name>
          ,
          <article-title>The mammalian phenotype ontology as a tool for annotating, analyzing and comparing phenotypic information</article-title>
          ,
          <source>Genome Biology</source>
          <volume>6</volume>
          (
          <year>2005</year>
          ). doi:h t t p s : / / d o i .
          <source>o r g / 1 0 . 1 1</source>
          <volume>8 6</volume>
          / g b -
          <volume>2 0 0 4 - 6</volume>
          - 1 - r 7 .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>S.</given-names>
            <surname>Köhler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bauer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Mungall</surname>
          </string-name>
          , G. Carletti,
          <string-name>
            <given-names>C. L.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Schofield</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. V.</given-names>
            <surname>Gkoutos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. N.</given-names>
            <surname>Robinson</surname>
          </string-name>
          ,
          <article-title>Improving ontologies by automatic reasoning and evaluation of logical definitions</article-title>
          ,
          <source>BMC Bioinformatics 12</source>
          (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ashburner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Rosse</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Bug</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Ceusters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. J.</given-names>
            <surname>Goldberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Eilbeck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ireland</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Mungall</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Leontis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Rocca-Serra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ruttenberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.-A.</given-names>
            <surname>Sansone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. H.</given-names>
            <surname>Scheuermann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Shah</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. L.</given-names>
            <surname>Whetzel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Lewis</surname>
          </string-name>
          ,
          <article-title>The obo foundry: coordinated evolution of ontologies to support biomedical data integration</article-title>
          ,
          <source>Nat Biotechnol</source>
          <volume>25</volume>
          (
          <year>2007</year>
          ).
          <source>doi:1 0 . 1 0 3 8 / n b t 1 3</source>
          <volume>4 6 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>M.</given-names>
            <surname>Courtot</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Gibson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. L.</given-names>
            <surname>Lister</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Malone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Schobe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. R.</given-names>
            <surname>Brinkman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ruttenberg</surname>
          </string-name>
          ,
          <article-title>Mireot: the minimum information to reference an external ontology term</article-title>
          ,
          <source>Nature</source>
          Precedings (
          <year>2011</year>
          ).
          <source>doi:1 0 . 1 0</source>
          <volume>3 8</volume>
          / n p r
          <source>e . 2 0</source>
          <volume>0 9 . 3 5 7 6</volume>
          · .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>E.</given-names>
            <surname>Blomqvist</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Hammar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Presutti</surname>
          </string-name>
          ,
          <article-title>Engineering ontologies with patterns: The extreme design methodology, in: Ontology Engineering with Ontology Design Patterns</article-title>
          , IOS Press,
          <year>2016</year>
          , pp.
          <fpage>23</fpage>
          -
          <lpage>50</lpage>
          . doi:h t t p : / / d x .
          <source>d o i . o r g / 1 0 . 3 2</source>
          <volume>3 3 / 9 7 8 - 1 - 6 1 4 9 9 - 6 7 6 - 7 - 2</volume>
          <fpage>3</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>A.</given-names>
            <surname>Gangemi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Presutti</surname>
          </string-name>
          ,
          <article-title>Ontology design patterns</article-title>
          ,
          <source>in: Handbook on Ontologies</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J. M.</given-names>
            <surname>Mortensen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Musen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          ,
          <article-title>Applications of ontology design patterns in biomedical ontologies</article-title>
          ,
          <source>in: AMIA</source>
          ,
          <year>2012</year>
          , pp.
          <fpage>643</fpage>
          -
          <lpage>652</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>F.</given-names>
            <surname>Dhombres</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Maurice</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Guilbaud</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Franchinard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Dias</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Charlet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Blondiaux</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Khoshnood</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Jurkovic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Jauniaux</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.-M. Jouannic</surname>
          </string-name>
          ,
          <article-title>A novel intelligent scan assistant system for early pregnancy diagnosis by ultrasound: Clinical decision support system evaluation study</article-title>
          ,
          <source>JOURNAL OF MEDICAL INTERNET RESEARCH 21</source>
          (
          <year>2019</year>
          ).
          <source>doi:1 0 . 2 1</source>
          <volume>9 6 / 1 4 2 8 6 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Y.</given-names>
            <surname>He</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Xiang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Lin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Overton</surname>
          </string-name>
          ,
          <string-name>
            <surname>E. Ong,</surname>
          </string-name>
          <article-title>The extensible ontology development (xod) principles and tool implementation to support ontology interoperability</article-title>
          ,
          <source>Journal of Biomedical Semantics</source>
          <volume>9</volume>
          (
          <year>2019</year>
          ).
          <source>doi:1 0 . 1 1 8 6 / s 1 3</source>
          <volume>3 2 6 - 0 1 7 - 0 1 6 9 - 2</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D.</given-names>
            <surname>Osumi-Sutherland</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Courtot</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. P.</given-names>
            <surname>Balhof</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Mungall</surname>
          </string-name>
          ,
          <article-title>Dead simple owl design patterns</article-title>
          ,
          <source>J. Biomed. Semantics</source>
          <volume>8</volume>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>K.</given-names>
            <surname>Hammar</surname>
          </string-name>
          , Content Ontology Design Patterns: Qualities, Methods, and Tools,
          <source>Ph.D. thesis</source>
          , Linkoping University,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>C.</given-names>
            <surname>Ochs</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Perl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Geller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Arabandi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Tudorache</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Musen</surname>
          </string-name>
          ,
          <article-title>An empirical analysis of ontology reuse in bioportal</article-title>
          ,
          <source>Journal of Biomedical Informatics</source>
          <volume>71</volume>
          (
          <year>2017</year>
          )
          <fpage>165</fpage>
          --
          <lpage>177</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>R. C</given-names>
            .
            <surname>Jackson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. P.</given-names>
            <surname>Balhof</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Douglass</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. L.</given-names>
            <surname>Harris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Mungall</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Overton</surname>
          </string-name>
          ,
          <article-title>Robot: A tool for automating ontology workflows</article-title>
          ,
          <source>BMC Bioinformatics 20</source>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Xiang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Courtot</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. R.</given-names>
            <surname>Brinkman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ruttenberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>He</surname>
          </string-name>
          ,
          <article-title>Ontofox: web-based support for ontology reuse</article-title>
          ,
          <source>BMC Research Notes</source>
          <volume>3</volume>
          (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>R. H.</given-names>
            <surname>Scheuermann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Ceusters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <article-title>Toward an ontological treatment of disease and diagnosis, in: AMIA Summit Transl</article-title>
          . Bioinforma,
          <year>2009</year>
          , pp.
          <fpage>116</fpage>
          -
          <lpage>120</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>