<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Drug Ontology for the Public Mexican Health System ?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Cecilia Reyes-Pen~a</string-name>
          <email>reyesp.cecilia@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mireya Tovar Vidal</string-name>
          <email>mtovar@cs.buap.mx</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Maricela Bravo</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Regina Motz</string-name>
          <email>rmotz@fing.edu.uy</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Benemerita Universidad Autonoma de Puebla</institution>
          ,
          <country country="MX">Mexico</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Universidad Autonoma Metropolitana</institution>
          ,
          <country country="MX">Mexico</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Universidad de la Republica</institution>
          ,
          <country country="UY">Uruguay</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>With the emergence of the COVID-19 pandemic, a growing need has emerged for well-structured medical knowledge bases that are accessible to physicians, specialists, pharmacists, patients, and the general public. This article describes the process of development and evaluation of an Mexican Drug Ontology4 with information from the \Basic Table and Catalog of Medicines" published by the Secretary of Public Health. The resulting ontology is composed by 64 classes, 5 object properties, 18 data properties, and has a value ALCQ(D) of \DL Expressivity" measure. The evaluation ontology was carried out in two ways: through the competence of the model and through the review of the quality criteria.</p>
      </abstract>
      <kwd-group>
        <kwd>Drug Ontology</kwd>
        <kwd>Medical Knowledge Representation</kwd>
        <kwd>Ontology Design</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        With the emergence of the COVID-19 pandemic, a growing need has emerged
for well-structured medical knowledge bases that are accessible to physicians,
specialists, pharmacists, patients, and the general public. The Secretary of
Public Health in Mexico, through the General Directorate of Health Information,
is responsible for preparing, disseminating and monitoring the regulations for
health information management. Among the regulations and standards it
establishes, is the Basic Table of Medicines which is an important reference catalog
that groups the drugs that can be prescribed. The catalog of medicines contains
the keys, description, indication, administration, dose, generalities, adverse
effects, contraindications, precautions and risk during pregnancy. Despite the fact
that the catalog has clear sections about its content, it lacks a structure that
facilitates its management, since queries do not allow lters to be applied to
? Copyright c 2020 for this paper by its authors. Use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).
4 Mexican Drug Ontology project is available on
http://caliope.cs.buap.mx/IngenieriaOntologica/recursos/medicamentos.owl
obtain speci c results. In the last decades, the use of ontologies for the
representation of drugs and medicines has proliferated [1{3]. According with Gruber [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ],
an ontology is a formal and explicit speci cation of a shared conceptualization;
that is, a formal abstraction to represent a domain using speci c information
such as objects, properties and relations by means of a normally hierarchical
type structure [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Ontologies can be seen as a set of components among which
are: instances, properties, concepts and axioms. The main advantages of using
ontologies for the medical domain are:
{ Exchange of medical information. The use of ontologies facilitates the
interoperability between di erent medical information systems.
{ Dynamic search of pharmaceutical information. The use of ontologies enables
the search for information on medications considering di erent criteria:
therapeutic indication, ingredients with a speci c mechanism of action, among
others.
{ Integration of knowledge. The use of ontologies facilitates the integration of
knowledge and information, making it reusable by various applications and
usable for di erent roles of users, for example: a drug ontology can be used
from an application for patients, indicating useful information regarding their
treatments; while for a doctor the type of information he needs to consult
from a drug ontology focuses on specialized pharmacological and medical
aspects; on the other hand, for the pharmaceutical industry the use of a
drug ontology has other purposes.
      </p>
      <p>This article describes the design, implementation and evaluation of an
ontology for the representation of drugs, with the speci c purpose of meeting the
regulations and standards established by the Secretary of Public Health in
Mexico5. For the construction of the ontology, a design methodology was used that
reuses methods from some well-known methodologies. The resulting ontology
was evaluated using a set of competency questions established in the early
design stages. The rest of the paper is organized as follows: Section 2 presents
related ontologies that represent information about drugs included in the
catalog of medications established by the Secretary of Public Health in Mexico; in
Section 3 the methodology used for the construction of the ontology proposed
in this work is described; in Section 4 the results obtained are presented and
discussed, as well as the evaluation of the resulting ontology; nally Section 5
contains the conclusions of this work and future directions.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Revision of Related Ontologies and Catalogs</title>
      <p>
        The use of ontologies for the representation and management of information
about drugs and medicines is not a recent research topic. Since 2005, there have
been initiatives aiming at integrating data and knowledge in the pharmaceutical
domain [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ]. In this section a comparative analysis of related ontologies and
5 https://www.gob.mx/salud
catalogs that address the representation and management of drugs and medicines
is presented.
      </p>
      <p>
        ChEBI6 Ontology [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ] is a database and ontology of chemical entities of
biological interest. ChEBI is a freely available dictionary of molecular entities
focused on \small" chemical compounds.
      </p>
      <p>
        DINTO [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] is a Drug Interaction Ontology that represents the mechanisms
that can produce drug-drug interactions, including pharmacodynamic and
pharmacokinetic mechanisms. The objective of DINTO is to support applications
in the pharmacovigilance domain. The concepts included in DINTO are: drug
information imported from ChEBI Ontology, the e ects of the drugs, the role
or bioactivity of a drug, the pharmacokinetic processes that drugs undergo in
the body, the pharmacokinetic parameters, the drug related procedures intended
to avoid or reduce the e ects of the drug-drug interactions, the drug-drug
interactions among other important concepts. DrugBank7 [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] is a database that
provides bioinformatics and cheminformatics data about drugs and drug targets.
DrugBank is similar to a drug encyclopedia, is widely used by the drug industry,
medicinal chemists, pharmacists, physicians, students and the general public.
      </p>
      <p>RxNorm8 is a normalized naming system for generic and branding drugs,
it supports semantic interoperation between drug terminologies and pharmacy
knowledge base systems. RxNorm is produced by the National Library of Medicine.
RxNorm provides a set of REST Web services to allow any application to
interact with the vocabulary. RxNorm can be downloaded in RDF format to be used
as an ontological resource.</p>
      <p>DRON9, the Drug Ontology is an ontology of drug products, their
ingredients, and their packaging, it reuses contents from RxNorm.</p>
      <p>
        The Systematized Nomenclature of Medicine Clinical Terms
(SNOMEDCT)10[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] is a comprehensive, multilingual clinical healthcare terminology, that
enables consistent representation of clinical content in electronic records,
supports the exchange of health information, and is mapped to other international
standards. SNOMED CT was designed with the cooperation of United Sates,
United Kingdom, Canada, New Zealand and Australia, and is used across these
countries as the recommended clinical reference terminology for clinical
information systems.
      </p>
      <p>Mexican Catalog of Medicines11. In accordance with the regulations
of the Secretary of Public Health in Mexico regarding information systems for
health electronic registration, it is the obligation of health service providers that
use the Electronic Health Data Registration Information System (SIRES), to
maintain updated catalogs and comply with their guidelines. The objective of
this standard is to guarantee the exchange and interpretation of information
6 https://www.ebi.ac.uk/chebi/init.do
7 https://www.drugbank.ca
8 https://www.nlm.nih.gov/research/umls/rxnorm/index.html
9 https://bitbucket.org/uamsdbmi/dron/src/master/
10 http://www.snomed.org/
11 http://www.dgis.salud.gob.mx/contenidos/intercambio/medicamentos gobmx.html
from electronic records that allow the correct coding, recording and subsequent
exploitation of health information. Regarding medicines, the Secretary of Public
Health publishes annually the \Basic Table and Catalog of Medicines" with the
purpose of keeping the registry of medicines in prescriptions and for
administrative purposes of the supply of medicines. This catalog of medications allows
consulting the drug indications and verify interactions with other medications
and allergies, as well as adequate doses and administration.</p>
      <p>There are several international sources of standardized and ontology-based
medical information for drug representation and drug interactions. However, all
these references require that medical personnel in Mexico be able to understand
the structure and organization of ontologies, for example SNOMED, despite
the existence of a Spanish version, it is di cult to access in countries that are
not collaboratorsl and requires a high computational performance. Although
the fact that the drug catalogs in Mexico follow international standards, the
information exchange system established by the Mexican standard has very strict
speci cations that must be met by health service providers in Mexico. Therefore,
it is necessary to develop a speci c drug ontology that meets and complies with
Mexican regulations. Likewise, this ontology must follow the principles of design
and approval of international references.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Design Methodology</title>
      <p>
        In this section, the proposed design methodology for working with information
from catalogs is described (see Fig. 1), as well as some generalities of its
application to the catalog of medicines. This methodology is composed of nine stages
and reuse some resources from other well-know methodologies as Knowledge
Adquisition stage from Methontology [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]; Class, hierarchy and Properties de
nition from DMTO (Diabetes Mellitus Treatment Ontology ) [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]; and Evaluation
from MODC (Methodology for Ontology Design and Construction ) [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], these
stages are describes in next:
1. Ontology Purpose Identi cation. At this stage the answers to the following
question must be visualized: What task do you want the ontology to
perform?. For the information representation about drugs, it is necessary that
the ontology serves as a drugs search engine where it indicates the features
of the same.
2. Ontology Scope Delimitation. In order to measure the scope of the ontology
it is necessary to specify the purpose formally and speci cally to determine
which entities will be involved within the ontology. So the scope of the
ontology is indicated to comply with the representation of the drugs, their doses
and route of administration, their classi cation and the active ingredients
involved. To reinforce these rst two stages of design, it is necessary to ask
competency questions that represent real situations about the handling of
information within the ontology.
3. Available Resources Acquisition. At this stage, the necessary information and
knowledge are collected to represent the entities that have been visualized
during the scope delimitation, as well as intermediate entities that serve for
relating all the elements. To complement the information in the catalog of
medicines, information was sought about the classi cation of pharmaceutical
forms and their relationship to routes of administration.
4. Instance De nition. The purpose of this stage is de ning which elements can
be characterized as instances. For this, it is analyzed which elements behave
as a minimum unit of information and the relationship they have with others.
In Fig. 2 it can be seen that for each presentation of the medicine there is
a unique key, so it can be said that the key indicates a minimum unit of
information because is associated to well-de ned values (others instances)
and, has attributes related to data as oats or strings, for example portion of
active pharmaceutical ingredients (Pincipio activo), portion (Porcion) and
content per container (Contenido por envase). For example 010.000.0101.00
is related to a pharmaceutical form \Tablet" (Tableta), a set of doses, one or
more routes of administration as \Oral" (Oral ), and 20 tablets per container
(20 tabletas por envase) as integer value.
5. Identi cation of the categories used in the catalogs: For working with
information from catalogs, it is essential to identify the categories that will be
used for the classi cation and de ne if they can be used as concepts in the
ontology because they group a set of minimum units of information with
the same features and formats. In the case of the catalog of medicines, the
categories found are:
{ Drug Type (basic table or catalog): indicates the stock availability of
drugs in the medical centers.
{ Therapeutic Group: group the drugs according its use in the treatment
of the same symptoms or diseases
{ Active Pharmaceutic Ingredient: group the drugs according its active
pharmaceutical ingredient. This groups can be associated to di erent
therapeutic groups or drug types.
6. Class Hierarchy Design. In this stage, previously identi ed concepts are
considered as well as new ones that help complement the hierarchy. During the
class identi cation stage, classes that do not belong to the same taxonomy
were identi ed, so it is necessary to integrate the relevant concepts obtained
in stage number 2. The main taxonomies identi ed include the concepts:
dose, active pharmaceutical ingredient, therapeutic group, drug,
pharmaceutical form, route of administration, and risk of pregnancy. The Table 1
indicates part of the class hierarchy.
7. Object and Data Type Relationships Implementation. Once the objects have
been identi ed, it is possible to de ne which elements should be represented
as object relationships or data type relationships. The implemented object
relationships are about with the drug de nition; i.e. for each instance
belonging to Catalog or Basic Table Drug classes, it is necessary being associated
to some doses, risk of pregnancy, active pharmaceutical ingredient,
pharmaceutical form, and route of administration. On the other hand, in data
relationships, there are some classes in which their individuals contains
information such as names, quantities and descriptions that requires to be
represented by data variables (see Table 2).
8. Rules and Axioms De nition. This stage aims to identify if there are patterns
within the information that are constantly repeated and can be generalized.
The found pattern is about rule de nition, and indicates the cardinality of
the object properties in the Drug class de nition.
12 http://www.dgis.salud.gob.mx/contenidos/intercambio/medicamentos gobmx.html
9. Evaluation. The evaluation is based on applying the consistency criterion by
a reasoner agent, as well as, the answer to previously established competence
questions by means of the ontology query language.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>Mexican Drug Ontology</title>
      <p>
        Applying the design methodology described in the section 3, we obtain the
Mexican Drug Ontology depicted in Fig. 3, it is composed by 64 classes (part of
hierarchy classes are described in the Table 1), 5 object properties (see Table 2),
18 data properties, and a value ALCQ(D) of \DL Expressivity" measure. The
Medicamento (Drug) class and Grupo Terapeutico (Therapeutic Group) class
are only classes that share individuals; while the rest of classes are disjointed.
The evaluation of the ontology was carried out in two ways: through the
competence of the model and through the review of the quality criteria (consistency and
coverage). This section rst introduces the translation of competency questions
to SPARQL queries and presents the results of those questions. The questions
are presented in English (see Table 3), but the ontology model is actually
implemented in Spanish to facilitate its use by health experts in Mexico; also are
translated to two query language, SPARQL to verify the ful llment of the
purpose and DL-Query because is supported by the use of reasoner agent (HermiT
tienePrincipioActivo Principio Activo
(hasActivePharmaceuticalIngredient)Medicamento (Active Pharmaceuti- 1:N
(Drug) cal Ingredient)
tieneViaDeAdministracion Via De Administracion
(hasRouteOfAdministration) Medicamento (Route of 1:N
(Drug) Administration)
[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] version 1.4.3.456). The answers of some competency questions are shown
in the Fig. 4, 5, and 6. About the quality criteria, the ontology was evaluated
by consistency and coverage. Consistency, it indicates that there are not
contradictions on the ontology [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], and it is checked by an agent reasoner; while
coverage, is about how well the ontology represents the domain [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], the
ontology, by satisfactorily answering all the questions, indicates that the coverage
is complete, since the competency questions contain the relevant terms of the
domain established in the early stages of the design methodology.
      </p>
    </sec>
    <sec id="sec-5">
      <title>Conclusions and Future Work</title>
      <p>This work describes the process of development and evaluation of Mexican Drug
Ontology with information from \Basic Table and Catalog of Medicines" used
by the Secretary of Health in Mexico, through a design methodology that starts
from the information from catalogs. The ontology obtained was evaluated by
answering the competence questions posed in the initial stages of the
methodology in order to guarantee the ful llment of the task for which it was designed
through the answers.</p>
      <p>For future work, the Mexican Drug Ontology will be enriched with
nonontological resources about generalities, interactions, contraindications and
cau</p>
      <p>Competency DL-Query SPARQL
Question
What are the (tieneDosisIndicada PREFIX
medicamentos:&lt;http://www.owlmedications some Do- ontologies.com/Medicamentos#&gt;
SEfor children sis Indicada Para Ninos) LECT ?med ?nombre ?dosis ?cant
that are ad- and (tieneViaDeAdminis- ?ind WHERE f?med
medicamenministered tracion value Oral) tos:tieneNombre ?nombre. ?med
medicaorally? mentos:tieneDosisIndicada ?dosis. ?dosis a
medicamentos:Dosis Indicada Para Ninos.
?dosis medicamentos:tieneCantidadMaxima
?cant. ?dosis
medicamentos:tieneIndicacionAdicional ?ind.g
Which drugs Medicamento and Aneste- PREFIX
medicamentos:&lt;http://www.owlare given sia and (tieneViaDeAd- ontologies.com/Medicamentos#&gt; SELECT
orally and ministracion value Oral) ?med ?nombre WHERE f ?med
medicabelong to mentos:tieneNombre ?nombre. ?med a
the anesthe- medicamentos:Anestesia. ?med
medicamensia therapy tos:tieneViaDeAdministracion
medicamengroup? tos:Oral.g
What are (Medicamento De CatalogoPREFIX
medicamentos:&lt;http://www.owlthe drugs or Medica- ontologies.com/Medicamentos#&gt; SELECT
that have mento De Cuadro Basico) DISTINCT ?med ?nombre ?principio
an amount and (tienePrincipioAc- ?medida ?cant WHERE f?med
medicamenof active tivoPorPorcion some tos:tieneNombre ?nombre. ?med
medicaingrediente ((tieneMedida value mentos:tienePrincipioActivoPorPorcion
per serving "MG") and (tieneCan- ?principio. ?principio
medicamengreater than tidadDeActivo some tos:tieneMedida ?medida. ?principio
50 mg? xsd: oat[&gt;=50f]))) medicamentos:tieneCantidadDeActivo
?cant. FILTER (str(?medida) = "MG").</p>
      <p>FILTER (?cant &gt;= 50).g
What drugs (tieneViaDeAdministracionPREFIX
medicamentos:&lt;http://www.owlthat are ad- value Oral) and ontologies.com/Medicamentos#&gt;
SEministered (provocaRiesgoDuran- LECT DISTINCT ?med ?nombre ?riesgo
orally are teElEmbarazo value ?desc WHERE f?med
medicamenassociated Riesgo Embarazo D) tos:tieneNombre ?nombre. ?med
medicawith of risk of mentos:provocaRiesgoDuranteElEmbarazo
pregnancy D? ?riesgo. ?riesgo
medicamentos:tieneDescripcion ?desc.g
What are the (inverse tieneDosisIndi- PREFIX
medicamentos:&lt;http://www.owlrecommended cada some (tienePrin- ontologies.com/Medicamentos#&gt; SELECT
doses for cipioActivoPorPorcion DISTINCT ?med ?nombre ?dosis ?principio
children of some (tieneActivo value ?activo WHERE f?med
medicamenmedicines \IBUPROFENO"))) and tos:tieneNombre ?nombre . ?med
medicathat have Dosis Indicada Para Ninos mentos:tieneDosisIndicada ?dosis. ?dosis a
ibuprofen medicamentos:Dosis Indicada Para Ninos.
as an active ?med
medicameningredient? tos:tienePrincipioActivoPorPorcion
?principio. ?principio medicamentos:tieneActivo
?activo. FILTER (str(?activo)=
\IBUPRO</p>
      <p>FENO").g
tions, and secondary e ects of the drugs in order to expand the model coverage;
Also, the ontology will integrate into another ontology that represents an active
pharmaceutical ingredient classi cation standard so that it can be used by
international users. Finally, the ontology will be validated by experts in order to
determine a set of requirements related to application ontology, which is a web
drug searcher by SPARQL queries.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgement</title>
      <p>This work is supported by the Sectoral Research Fund for Education with the
CONACyT project 257357, and partially supported by the VIEP-BUAP project.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>M.</given-names>
            <surname>Herrero-Zazo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hastings</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            <surname>Segura-Bedmar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Croset</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Martinez</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Steinbeck</surname>
          </string-name>
          , \
          <article-title>An ontology for drug-drug interactions,"</article-title>
          <source>CEUR Workshop Proceedings</source>
          , vol.
          <volume>1114</volume>
          , 01
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>D. S.</given-names>
            <surname>Wishart</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y. D.</given-names>
            <surname>Feunang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. C.</given-names>
            <surname>Guo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. J.</given-names>
            <surname>Lo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Marcu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. R.</given-names>
            <surname>Grant</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Sajed</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Johnson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Sayeeda</surname>
          </string-name>
          , et al.,
          <source>\Drugbank 5</source>
          .
          <article-title>0: a major update to the drugbank database for 2018,"</article-title>
          <source>Nucleic acids research</source>
          , vol.
          <volume>46</volume>
          , no.
          <issue>D1</issue>
          , pp.
          <source>D1074{D1082</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>K.</given-names>
            <surname>Donnelly</surname>
          </string-name>
          , \
          <article-title>Snomed-ct: The advanced terminology and coding system for ehealth," Studies in health technology and informatics</article-title>
          , vol.
          <volume>121</volume>
          , p.
          <fpage>279</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>T. R.</given-names>
            <surname>Gruber</surname>
          </string-name>
          et al.,
          <article-title>\A translation approach to portable ontology speci cations," Knowledge acquisition</article-title>
          , vol.
          <volume>5</volume>
          , no.
          <issue>2</issue>
          , pp.
          <volume>199</volume>
          {
          <issue>220</issue>
          ,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>S. P.</given-names>
            <surname>Gardner</surname>
          </string-name>
          , \
          <article-title>Ontologies in drug discovery,"</article-title>
          <source>Drug Discovery Today: Technologies</source>
          , vol.
          <volume>2</volume>
          , no.
          <issue>3</issue>
          , pp.
          <volume>235</volume>
          {
          <issue>240</issue>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>S. P.</given-names>
            <surname>Gardner</surname>
          </string-name>
          , \
          <article-title>Ontologies and semantic data integration," Drug discovery today</article-title>
          , vol.
          <volume>10</volume>
          , no.
          <issue>14</issue>
          , pp.
          <volume>1001</volume>
          {
          <issue>1007</issue>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>J.</given-names>
            <surname>Hastings</surname>
          </string-name>
          , P. de Matos,
          <string-name>
            <given-names>A.</given-names>
            <surname>Dekker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ennis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Harsha</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Kale</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Muthukrishnan</surname>
          </string-name>
          , G. Owen,
          <string-name>
            <given-names>S.</given-names>
            <surname>Turner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Williams</surname>
          </string-name>
          , et al., \
          <article-title>The chebi reference database and ontology for biologically relevant chemistry: enhancements for 2013,"</article-title>
          <source>Nucleic acids research</source>
          , vol.
          <volume>41</volume>
          , no.
          <issue>D1</issue>
          , pp.
          <source>D456{D463</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>J.</given-names>
            <surname>Hastings</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Owen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Dekker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ennis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Kale</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Muthukrishnan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Turner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Swainston</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Mendes</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Steinbeck</surname>
          </string-name>
          , \Chebi in 2016:
          <article-title>Improved services and an expanding collection of metabolites,"</article-title>
          <source>Nucleic acids research</source>
          , vol.
          <volume>44</volume>
          , no.
          <issue>D1</issue>
          , pp.
          <source>D1214{D1219</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>M.</given-names>
            <surname>Fernandez-Lopez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gomez-Perez</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>N.</given-names>
            <surname>Juristo</surname>
          </string-name>
          , \
          <article-title>Methontology: from ontological art towards ontological engineering,"</article-title>
          <source>Engineering Workshop on Ontological Engineering (AAAI97)</source>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>S.</given-names>
            <surname>El-Sappagh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Kwak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ali</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          K.-S. Kwak, \
          <article-title>Dmto: a realistic ontology for standard diabetes mellitus treatment,"</article-title>
          <source>Journal of biomedical semantics</source>
          , vol.
          <volume>9</volume>
          , no.
          <issue>1</issue>
          , p.
          <fpage>8</fpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>M. Bravo</surname>
            ,
            <given-names>L. F.</given-names>
          </string-name>
          <string-name>
            <surname>Hoyos Reyes</surname>
            , and
            <given-names>J. A.</given-names>
          </string-name>
          <string-name>
            <surname>Reyes-Ortiz</surname>
          </string-name>
          , \
          <article-title>Methodology for ontology design and construction,"</article-title>
          <source>Contadur a y Administracion</source>
          , vol.
          <volume>64</volume>
          , no.
          <issue>4</issue>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>R.</given-names>
            <surname>Shearer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Motik</surname>
          </string-name>
          ,
          <string-name>
            <surname>and I. Horrocks</surname>
          </string-name>
          , \
          <article-title>Hermit: A highly-e cient owl reasoner</article-title>
          .,
          <source>" in Owled</source>
          , vol.
          <volume>432</volume>
          , p.
          <fpage>91</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>J. Morbach</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Wiesner</surname>
          </string-name>
          , and W. Marquardt, \
          <article-title>Ontocape|a (re) usable ontology for computer-aided process engineering,"</article-title>
          <source>Computers &amp; Chemical Engineering</source>
          , vol.
          <volume>33</volume>
          , no.
          <issue>10</issue>
          , pp.
          <volume>1546</volume>
          {
          <issue>1556</issue>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>H.</given-names>
            <surname>Hlomani</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Stacey</surname>
          </string-name>
          , \Approaches, methods, metrics, measures, and
          <article-title>subjectivity in ontology evaluation: A survey,"</article-title>
          <source>Semantic Web Journal</source>
          , vol.
          <volume>1</volume>
          , no.
          <issue>5</issue>
          , pp.
          <volume>1</volume>
          {
          <issue>11</issue>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>