<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>October</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.1038/s41540-024-00384-y</article-id>
      <title-group>
        <article-title>An ontology-based approach to streamline the reconstruction of genome-scale metabolic models</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nahim Alves de Souza</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Renata Wassermann</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Instituto de Matemática e Estatística, Universidade de São Paulo</institution>
          ,
          <addr-line>Rua do Matão, 1010, Cidade Universitária, São Paulo, SP</addr-line>
          ,
          <country country="BR">Brasil</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2025</year>
      </pub-date>
      <volume>02</volume>
      <issue>2025</issue>
      <fpage>0000</fpage>
      <lpage>0001</lpage>
      <abstract>
        <p>The reconstruction of genome-scale metabolic models (GEMs) is a complex and laborious process that depends significantly on expert manual curation. It involves integrating data from diverse sources, such as biochemical databases and scientific literature, which often contain inconsistencies due to the lack of standardized representations for metabolites and reactions. Since current solutions cannot fully resolve these discrepancies, domain experts have to manually identify and correct them, which is a time-consuming task. This paper proposes an ontology-based approach to streamline the reconstruction of GEMs. This work proposes developing a GEM ontology to formally represent both GEM structures and the expert knowledge used during reconstruction. In the future, this ontology can be integrated into the reconstruction workflow through an application that takes draft models as input and produces enhanced models by incorporating additional information from biochemical datasets. This approach is expected to reduce manual curation efort and consequently simplify the overall reconstruction process.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Genome-scale metabolic models</kwd>
        <kwd>Ontology</kwd>
        <kwd>Semantic interoperability</kwd>
        <kwd>Data integration</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Metabolism is defined as a series of chemical reactions that occur continuously within living organisms
to sustain life, particularly those associated with energy production and growth [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Nevertheless,
mapping the entire metabolism of an organism is a highly complex task due to the vast number of
compounds and reactions involved. The process of building a computational representation of an
organism’s metabolism is known as reconstruction, while the resulting model is often referred to as a
genome-scale metabolic model (GEM) – since it is based on organism’s genome.
      </p>
      <p>Over the years, several computational resources have been developed to support the reconstruction
of metabolic models, including databases, tools, and ontologies. However, these resources present
significant limitations, especially in unifying data from multiple sources [ 2, 3, 4]. Moreover, none of the
available ontologies (e.g., ChEBI [5], GO [6], SBO [7]) comprehensively represent GEMs or are actively
applied in GEM reconstruction, as they contain little information about the complex relationships
between reactions, metabolites, and genes – which are essential for integrating data during GEM
reconstruction. Consequently, experts must rely on their domain knowledge to manually resolve
data inconsistencies, suggesting that the necessary semantic information exists but is not explicitly
represented in current databases and ontologies.</p>
      <p>Based on these premises, this work proposes the development of a new ontology for representing
GEMs with two main objectives: (1) to enable the integration and reconciliation of models across
diferent datasets, and (2) to facilitate the quality assessment of GEMs through the use of logical
inferences to identify (and potentially repair) inconsistencies in models. The following sections present
the GEM reconstruction process and its main challenges, along with the proposed approach to address
them.</p>
    </sec>
    <sec id="sec-2">
      <title>2. GEM reconstruction</title>
      <p>GEM reconstruction is a complex process that involves integrating data from diverse sources, conducting
thorough literature reviews, performing manual curation, running mathematical simulations, and
validating results through biological experiments. Each of these activities need to be carefully conducted
in order to ensure the accuracy and quality of the resulting model. Thiele and Palsson [8] proposed
a detailed five-stage protocol for the construction high-quality GEMs, summarized in Figure 1. The
reconstruction process begins with the creation of a draft model, derived from the organism’s genome
and biochemical datasets. This initial model is then refined by experts, supported by computational
tools that assess model quality and simulate the organism’s metabolic behavior. Finally, the curated
model, along with documentation of the reconstruction process, is compiled and published.</p>
      <sec id="sec-2-1">
        <title>2.1. Key challenges</title>
        <p>Integrating information on metabolites and reactions is fundamental to GEM reconstruction. Although
various eforts have been made over the years to establish representation standards for biochemical
data, a universal consensus has not yet been reached [4]. For instance, while the chemical structures
of metabolites can be represented as SMILES strings [9], this format does not establish a unique
representation for each molecule1 [2] – water, for example, can be represented as [OH2], [H]O[H], or
simply O2. The InChI system [10] addresses some of these ambiguities by providing a more detailed
representation of molecular structures. However, certain molecules representable in SMILES may
lack proper encoding in InChI, and the optional nature of some fields in the InChI format can result
in incomplete representations in certain contexts [2]. Beyond variations in metabolite naming, the
representation of reactions adds another layer of complexity to the reconciliation of biochemical data.
The multiple ways of expressing reactions – ranging from chemical equations [3] to more complex
representations such as reaction graphs, hypergraphs, or stoichiometric matrices [11, 12, 13, 14] – hinder
data comparison across diferent datasets.</p>
        <p>
          In GEMs, each reaction is associated with genes and enzymes through GPRs (gene-protein-reaction)
rules, along with other attributes essential for simulating organism behavior. SBML remains the
dominant format for representing GEMs, as its design facilitates model exchange, reuse, and supports
simulation-related properties [15]. While its flexible design allows core capabilities to be extended,
it lacks a formal specification for mandatory fields, which results in inconsistently populated fields,
containing incomplete or inappropriate information [16]. Furthermore, even when the same data
sources are used, GEM reconstructions can difer due to variations in methods, algorithms, and expert
decisions throughout the process [
          <xref ref-type="bibr" rid="ref2 ref3">17, 18</xref>
          ].
        </p>
        <p>
          Some approaches, such as MNXref [2] and MetRxn [3], were designed to provide a unified, reliable
data source by implementing iterative reconciliation processes that utilize identifiers, names and
crossreferences to resolve ambiguities. Nevertheless, these methods may overlook crucial factors such
as reaction directionality, compartmentalization, mass- and charge-balance, potentially leading to
1While Isomeric SMILES addresses some ambiguities, multiple representations remain possible [2].
2Although this last representation may seem unusual, it is adopted by ModelSEED (https://modelseed.org/biochem/compounds/
cpd00001) and PubChem (https://pubchem.ncbi.nlm.nih.gov/compound/Water#section=SMILES)
inaccurate results. Additionally, internal and external inconsistencies in names and identifiers, often
found in biochemical databases [
          <xref ref-type="bibr" rid="ref4">19</xref>
          ], make automated data unification particularly challenging.
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. An ontology for GEMs</title>
      <p>
        Ontologies have proven to be powerful tools for addressing challenges related to data integration
and system interoperability [
        <xref ref-type="bibr" rid="ref5 ref6">20, 21</xref>
        ]. In the fields of chemistry and biology, numerous ontologies
have been developed to establish unified vocabularies and facilitate integration across heterogeneous
systems. The Basic Formal Ontology (BFO) [
        <xref ref-type="bibr" rid="ref7">22</xref>
        ], for example, is a widely adopted upper ontology that
provides foundational concepts for constructing domain-specific ontologies. Notable examples include
ChEBI, which models chemical entities and their relationships [5], and the Gene Ontology (GO), which
represents genes along with their functions and associated products [6].
      </p>
      <p>
        The ontology most directly associated with GEM reconstruction is the Systems Biology Ontology
(SBO) [7], which defines terms related to Systems Biology, including physical entities (e.g., metabolites,
genes, biomass) and processes (e.g., biochemical reactions). SBO terms can be used to annotate tags
in SBML files, facilitating the integration of models originated from diferent sources [
        <xref ref-type="bibr" rid="ref8">23</xref>
        ]. However,
despite these features, SBO does not adequately capture the complex relationships between entities,
limiting its efectiveness in representing the full structure and semantics of GEMs. Furthermore, to the
best of our knowledge, no existing ontology addresses this level of detail, highlighting an opportunity
to overcome these challenges through the development of an ontology for GEMs, capable of enabling
concept disambiguation and data integration.
      </p>
      <sec id="sec-3-1">
        <title>3.1. Ontology development</title>
        <p>Initially, we conducted a literature review to understand the GEM reconstruction process, existing
solutions, and available databases and tools. Subsequently, in collaboration with systems biology experts,
the project scope and objectives were established, and competency questions (Table 1) were formulated
based on the activities typically performed during GEM reconstruction (e.g., comparing metabolites and
reactions, evaluating the metabolic network). Based on these questions we identified the core concepts
and relationships of the ontology and designed an initial domain model (Figure 2).</p>
        <p>Although this model still requires refinement, it already provides a strong foundation for
understanding the domain. The central component of the model is the MetabolicModel class, which serves as an
information aggregator, encompassing properties of the organism and a list of metabolites, reactions,
genes, and compartments. A BiologicalEntity, corresponds to entities that physically exist in the
real world, which contains a unique ID, name, and a list of cross references including external data
and metadata (CrossReference class). A Metabolite correspond to any molecule participating in
metabolic reactions, either as a reactant, product, cofactor, or intermediate. In GEMs, each metabolite is
located in a specific Compartment (a region within the cell, e.g., glucose in the cytosol vs. extracellular
glucose are distinct). A Reaction is a biochemical transformation that converts a set of reactants into
products. Reactions can be enzymatic (catalyzed by a single enzyme or by an enzymatic complex)
or non-enzymatic (occurring spontaneously). An Enzyme is a special type of protein involved in
the catalysis of biochemical reactions. A single enzyme may catalyze multiple reactions, and a single
reaction may be catalyzed by diferent enzymes (the same applies to enzymatic complexes). Additionally,
each enzyme can be encoded by one or more genes. A Gene is a DNA sequence that encodes a protein
(in this context, an enzyme). Genes and reactions are linked through GPR associations, which are
boolean formulas represented in the diagram through the relationships among the Gene, Enzyme,</p>
      </sec>
      <sec id="sec-3-2">
        <title>EnzymeAssociation, and Reaction classes.</title>
        <p>
          In order to fully support concept disambiguation, and promote explainability and systems
interoperability, the current model still requires further enhancements. For instance, several terms mentioned in
the competency questions lack clear and explicit definitions, such as “same” in CQ02, “blocked reaction”
in CQ07, and “required” in CQ12. Therefore, the next step, which we are currently working on, involves
using the initial model as a foundation to create a more explicit model with the necessary
semantic information. Recent studies have demonstrated that the application of ontological unpacking
techniques, combined with the modeling language OntoUML, yields promising results by enriching
concept definitions and making implicit knowledge explicit [
          <xref ref-type="bibr" rid="ref10 ref5 ref9">24, 25, 20</xref>
          ]. Applying these techniques to
the current model can lead to a more comprehensive and semantically rich representation of GEMs.
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>3.2. Evaluation</title>
        <p>
          The evaluation of the proposed approach must be twofold: (1) assessing the consistency and accuracy
of the GEM ontology in representing domain knowledge and (2) verifying the quality of the GEMs
generated using this ontology-based approach. For the first part, the representation can be assessed
by encoding the ontology in OWL and using automated reasoners to detect logical inconsistencies
in the knowledge base – for example, defining a reaction as occurring in one compartment while its
metabolites are located in another, or incorrectly declaring two entities equivalent when they have
diferent property values. In addition, competency questions can be translated into SPARQL queries and
used to evaluate whether the ontology can answer the questions proposed by domain experts, thereby
assessing the correctness and completeness of the representation [
          <xref ref-type="bibr" rid="ref11">26</xref>
          ].
        </p>
        <p>
          The second part of the evaluation can be carried out by comparing the model generated by an
application based on the GEM ontology with manually curated models from well-studied organisms,
such as Escherichia coli (an approach commonly adopted in the literature [
          <xref ref-type="bibr" rid="ref12 ref13 ref14 ref6">27, 28, 29, 21</xref>
          ]). In this scenario,
the evaluation pipeline would consist of: (1) generating a draft model from the genome of the selected
organism (e.g., E. Coli3); (2) using the application to load and enhance the model; and (3) comparing the
resulting model with a manually curated reference model (e.g., model iJO13664). To achieve a more
comprehensive evaluation of the application’s efectiveness, the comparison should include models
of varying quality (highly curated and poorly curated) from organisms of diferent types (eukaryotes
and prokaryotes, well-studied and less-studied). The criteria for comparing models may include, for
instance, the number and presence or absence of metabolites, genes, and reactions [
          <xref ref-type="bibr" rid="ref12 ref15">30, 27</xref>
          ], the ability
to directly perform FBA (Flux Balance Analysis) [
          <xref ref-type="bibr" rid="ref13 ref6">28, 21</xref>
          ], and reports from tools such as FROG [31] and
MEMOTE [32], which provide additional insights into the metabolic network (e.g., mass and charge
balancing, stoichiometric consistency, FVA, and gene/reaction deletion fluxes).
3E. Coli genome is available at NCBI website: https://www.ncbi.nlm.nih.gov/datasets/genome/GCF_000005845.2
4This is the most recent E. Coli model available in BiGG: http://bigg.ucsd.edu/models/iJO1366
        </p>
      </sec>
      <sec id="sec-3-4">
        <title>3.3. Application</title>
        <p>To seamlessly integrate the GEM ontology into the GEM reconstruction workflow, a user-friendly
software application must be developed in the future. This application should be able to load a draft
model (any valid SBML file) and automatically retrieve additional data from biochemical databases (e.g.,
BiGG, KEGG, MetaCyc, MetaNetX) and relevant ontologies (e.g., Gene Ontology, ChEBI) to enrich the
model and build a standardized representation, while the ontology would provide a formal structure
for the data, facilitating data integration and logical consistency verification. The application should
also generate a report summarizing reconciliation results – logging automated decisions, describing
unresolved issues, providing qualitative and quantitative model evaluations, and presenting additional
information to assist domain experts in refining the model, either manually or automatically, depending
on the nature of the issues detected. Finally, it should also allow the experts to edit, refine, and
subsequently export the model in multiple formats.</p>
        <p>The technical details of such an application should be defined during the implementation phase.
This includes selecting the most appropriate biochemical databases and ontologies for data enrichment,
defining mechanisms for data access (e.g., APIs, SPARQL endpoints), and establishing strategies for data
management and storage. In addition, the deployment and documentation of the application should be
carefully planned to ensure long-term maintainability, reproducibility, and ease of use for both users
and developers.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>This work proposed an ontology-based approach to streamline the reconstruction of genome-scale
metabolic models (GEMs), comprising both a GEM ontology and an application to integrate it into the
reconstruction workflow. The ontology – currently under development – is expected to facilitate data
reconciliation across biochemical databases and enable automated reasoning. The application is intended
to centralize information retrieval from multiple datasets, thereby reducing manual efort and improving
eficiency. Developing both the ontology and the application is complex and time-consuming; therefore,
the work can be divided into two phases. The first phase should focus on ontology development and
evaluation, while the second should focus on building an application on top of the ontology to generate
enhanced models.</p>
      <p>In addition, the comparison of GEMs remains an open challenge, as it requires the unambiguous
identification of model components such as metabolites and reactions. Defining comparison criteria for
metabolic models is expected to provide a novel standard for evaluating the quality of GEMs generated
by diferent tools in future studies.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>This work was supported by a doctoral scholarship from CAPES/PROEX and CNPq (140323/2025-2),
and by funding from Inria ERABLE – University of Lyon, which enabled a research visit to the LBBE
(Laboratoire de Biométrie et Biologie Évolutive) in Lyon, France, to foster collaboration between our
research teams.</p>
      <p>Special thanks to Gabriela Torres Montanaro (ICB-USP), Ariel Mariano Silber (ICB-USP), Lucas Gentil
Azevedo (Cidacs/FIOCRUZ, BA), Mariana Galvão Ferrarini (Max Planck Institute for Chemical Ecology
in Jena, Germany) and Marie-France Sagot (University of Lyon, France) for their valuable contributions
to this work.</p>
    </sec>
    <sec id="sec-6">
      <title>Declaration on Generative AI</title>
      <p>During the preparation of this work, the author(s) used ChatGPT (GPT-4o) and Claude Sonnet 4 in
order to: Grammar and spelling check, paraphrase and reword. After using these tool(s)/service(s), the
author(s) reviewed and edited the content as needed and take(s) full responsibility for the publication’s
content.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Judge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. S.</given-names>
            <surname>Dodd</surname>
          </string-name>
          , Metabolism, Essays in Biochemistry 64 (
          <year>2020</year>
          )
          <fpage>607</fpage>
          -
          <lpage>647</lpage>
          . URL: https: //doi.org/10.1042/EBC20190041. doi:
          <volume>10</volume>
          .1042/EBC20190041.
          <article-title>structions: unification, transcript specificity and beyond</article-title>
          ,
          <source>Briefings in Bioinformatics</source>
          <volume>17</volume>
          (
          <year>2015</year>
          )
          <fpage>1060</fpage>
          -
          <lpage>1069</lpage>
          . URL: https://doi.org/10.1093/bib/bbv100. doi:
          <volume>10</volume>
          .1093/bib/bbv100.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Carey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Dräger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. E.</given-names>
            <surname>Beber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Papin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. T.</given-names>
            <surname>Yurkovich</surname>
          </string-name>
          ,
          <article-title>Community standards to facilitate development and address challenges in metabolic modeling</article-title>
          ,
          <source>Molecular Systems Biology</source>
          <volume>16</volume>
          (
          <year>2020</year>
          )
          <article-title>e9235</article-title>
          . URL: https://www.embopress.org/doi/abs/10.15252/msb.20199235. doi:https: //doi.org/10.15252/msb.20199235.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [18]
          <string-name>
            <surname>D. B. Bernstein</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Sulheim</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Almaas</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Segrè</surname>
          </string-name>
          ,
          <article-title>Addressing uncertainty in genome-scale metabolic model reconstruction and analysis</article-title>
          ,
          <source>Genome Biology</source>
          <volume>22</volume>
          (
          <year>2021</year>
          )
          <article-title>64</article-title>
          . URL: https://doi.org/10.1186/ s13059-021-02289-z. doi:
          <volume>10</volume>
          .1186/s13059-021-02289-z.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>N.</given-names>
            <surname>Pham</surname>
          </string-name>
          ,
          <string-name>
            <surname>R. G. A. van Heck</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. C. J. van Dam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. J.</given-names>
            <surname>Schaap</surname>
          </string-name>
          , E. Saccenti,
          <string-name>
            <given-names>M.</given-names>
            <surname>Suarez-Diez</surname>
          </string-name>
          , Consistency, Inconsistency, and
          <article-title>Ambiguity of Metabolite Names in Biochemical Databases Used for GenomeScale Metabolic Modelling</article-title>
          ,
          <source>Metabolites</source>
          <volume>9</volume>
          (
          <year>2019</year>
          ). URL: https://www.mdpi.com/2218-1989/9/2/28. doi:
          <volume>10</volume>
          .3390/metabo9020028.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>G.</given-names>
            <surname>Guizzardi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Guarino</surname>
          </string-name>
          , Explanation, semantics, and ontology,
          <source>Data and Knowledge Engineering</source>
          <volume>153</volume>
          (
          <year>2024</year>
          )
          <article-title>102325</article-title>
          . URL: https://www.sciencedirect.com/science/article/pii/S0169023X24000491. doi:https://doi.org/10.1016/j.datak.
          <year>2024</year>
          .
          <volume>102325</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [21]
          <string-name>
            <surname>S. M. D. Seaver</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Jefryes</surname>
            ,
            <given-names>J. P.</given-names>
          </string-name>
          <string-name>
            <surname>Faria</surname>
            ,
            <given-names>J. N.</given-names>
          </string-name>
          <string-name>
            <surname>Edirisinghe</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Mundy</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Chia</surname>
            , E. Noor,
            <given-names>M. E.</given-names>
          </string-name>
          <string-name>
            <surname>Beber</surname>
            ,
            <given-names>A. A.</given-names>
          </string-name>
          <string-name>
            <surname>Best</surname>
            , M. DeJongh,
            <given-names>J. A.</given-names>
          </string-name>
          <string-name>
            <surname>Kimbrel</surname>
            , P. D'haeseleer,
            <given-names>S. R.</given-names>
          </string-name>
          <string-name>
            <surname>McCorkle</surname>
            ,
            <given-names>J. R.</given-names>
          </string-name>
          <string-name>
            <surname>Bolton</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Pearson</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Canon</surname>
            ,
            <given-names>E. M.</given-names>
          </string-name>
          <string-name>
            <surname>Wood-Charlson</surname>
            ,
            <given-names>R. W.</given-names>
          </string-name>
          <string-name>
            <surname>Cottingham</surname>
            ,
            <given-names>A. P.</given-names>
          </string-name>
          <string-name>
            <surname>Arkin</surname>
            ,
            <given-names>C. S.</given-names>
          </string-name>
          <string-name>
            <surname>Henry</surname>
          </string-name>
          ,
          <article-title>The ModelSEED Biochemistry Database for the integration of metabolic annotations and the reconstruction, comparison and analysis of metabolic models for plants, fungi and microbes</article-title>
          ,
          <source>Nucleic Acids Research</source>
          <volume>49</volume>
          (
          <year>2020</year>
          )
          <fpage>D575</fpage>
          -
          <lpage>D588</lpage>
          . URL: https://doi.org/10.1093/nar/gkaa746. doi:
          <volume>10</volume>
          . 1093/nar/gkaa746.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>J. N.</given-names>
            <surname>Otte</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Beverley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ruttenberg</surname>
          </string-name>
          , Bfo: Basic formal ontology,
          <source>Applied ontology 17</source>
          (
          <year>2022</year>
          )
          <fpage>17</fpage>
          -
          <lpage>43</lpage>
          . doi:
          <volume>10</volume>
          .3233/ao-220262.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>M.</given-names>
            <surname>Hucka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. T.</given-names>
            <surname>Bergmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Chaouiya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Dräger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Hoops</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. M.</given-names>
            <surname>Keating</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>König</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. L.</given-names>
            <surname>Novère</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Myers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. G.</given-names>
            <surname>Olivier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Sahle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Schaf</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Sherif</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. P.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Waltemath</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. J.</given-names>
            <surname>Wilkinson</surname>
          </string-name>
          ,
          <string-name>
            <surname>F. Zhang,</surname>
          </string-name>
          <article-title>The systems biology markup language (sbml): Language specification for level 3 version 2 core release 2</article-title>
          ,
          <source>Journal of Integrative Bioinformatics</source>
          <volume>16</volume>
          (
          <year>2019</year>
          )
          <article-title>20190021</article-title>
          . URL: https://doi.org/10.1515/jib-2019-0021. doi:doi:10.1515/jib-2019-0021.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [24]
          <string-name>
            <surname>A. García S.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Bernasconi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Guizzardi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Pastor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. C.</given-names>
            <surname>Storey</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Panach</surname>
          </string-name>
          ,
          <article-title>Assessing the value of ontologically unpacking a conceptual model for human genomics</article-title>
          ,
          <source>Information Systems</source>
          <volume>118</volume>
          (
          <year>2023</year>
          )
          <article-title>102242</article-title>
          . URL: https://www.sciencedirect.com/science/article/pii/S0306437923000789. doi:https: //doi.org/10.1016/j.is.
          <year>2023</year>
          .
          <volume>102242</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>A.</given-names>
            <surname>Bernasconi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Guizzardi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Pastor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. C.</given-names>
            <surname>Storey</surname>
          </string-name>
          ,
          <article-title>Semantic interoperability: ontological unpacking of a viral conceptual model</article-title>
          ,
          <source>BMC Bioinformatics 23</source>
          (
          <year>2022</year>
          )
          <article-title>491</article-title>
          . URL: https://doi.org/10. 1186/s12859-022-05022-0. doi:
          <volume>10</volume>
          .1186/s12859-022-05022-0.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>G. K. Q.</given-names>
            <surname>Monfardini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. S.</given-names>
            <surname>Salamon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. P.</given-names>
            <surname>Barcellos</surname>
          </string-name>
          ,
          <article-title>Use of competency questions in ontology engineering: A survey</article-title>
          , in: J. P. A.
          <string-name>
            <surname>Almeida</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Borbinha</surname>
            , G. Guizzardi,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Link</surname>
          </string-name>
          , J. Zdravkovic (Eds.),
          <source>Conceptual Modeling</source>
          , Springer Nature Switzerland, Cham,
          <year>2023</year>
          , pp.
          <fpage>45</fpage>
          -
          <lpage>64</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>S. N.</given-names>
            <surname>Mendoza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. G.</given-names>
            <surname>Olivier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Molenaar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Teusink</surname>
          </string-name>
          ,
          <article-title>A systematic assessment of current genomescale metabolic reconstruction tools</article-title>
          ,
          <source>Genome Biology</source>
          <volume>20</volume>
          (
          <year>2019</year>
          )
          <article-title>158</article-title>
          . URL: https://doi.org/10.1186/ s13059-019-1769-1. doi:
          <volume>10</volume>
          .1186/s13059-019-1769-1.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>J.</given-names>
            <surname>Zimmermann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Kaleta</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          <article-title>Waschina, gapseq: informed prediction of bacterial metabolic pathways and reconstruction of accurate metabolic models</article-title>
          ,
          <source>Genome Biology</source>
          <volume>22</volume>
          (
          <year>2021</year>
          )
          <article-title>81</article-title>
          . URL: https://doi.org/10.1186/s13059-021-02295-1. doi:
          <volume>10</volume>
          .1186/s13059-021-02295-1.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>M.</given-names>
            <surname>Di Filippo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Damiani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Pescini</surname>
          </string-name>
          , Gpruler:
          <article-title>Metabolic gene-protein-reaction rules automatic reconstruction</article-title>
          ,
          <source>PLOS Computational Biology</source>
          <volume>17</volume>
          (
          <year>2021</year>
          )
          <fpage>1</fpage>
          -
          <lpage>25</lpage>
          . URL: https://doi.org/10.1371/journal. pcbi.1009550. doi:
          <volume>10</volume>
          .1371/journal.pcbi.
          <volume>1009550</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>Y. E.</given-names>
            <surname>Hsieh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Tandon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Verbruggen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Nikoloski</surname>
          </string-name>
          ,
          <article-title>Comparative analysis of metabolic models of microbial communities reconstructed from automated tools and consensus approaches</article-title>
          ,
          <source>npj Systems Biology and Applications</source>
          <volume>10</volume>
          (
          <year>2024</year>
          )
          <article-title>54</article-title>
          . URL: https://doi.org/10.1038/s41540-024-00384-y.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>