<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Survey of Multilingual OWL Ontologies in BioPortal</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Frances Gillis-Webber</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>C. Maria Keet</string-name>
          <email>mkeet@cs.uct.ac.za</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, University of Cape Town</institution>
          ,
          <addr-line>Cape Town</addr-line>
          ,
          <country country="ZA">South Africa</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The internationalisation goal for OWL sought to ofer support for multilingual ontologies. User-displayable labels were suggested as a way to realise this, by means of rdfs:label. However, because each label is a language-tagged string, this hampers accurate representation of strings in languages that require grammatical features such as inflected forms and gender. At least eight linguistic models have been proposed to address this key shortcoming, with OntoLex-Lemon now the de facto standard. The purpose of this survey was to determine if there has been any adoption of linguistic models within OWL ontologies. As OWL ontologies are widely used in the biomedical domain, the survey was limited to those ontologies in NCBO BioPortal, a biomedical repository. The results indicate that OntoLex-Lemon was not used in any production OWL ontology at time of review, nor that of any other linguistic model. In addition, the adoption rate of multilingualism in OWL ontologies in BioPortal was observed to be 5%, with English the primary language, followed by French and German.</p>
      </abstract>
      <kwd-group>
        <kwd>OWL ontologies</kwd>
        <kwd>Linguistic Model</kwd>
        <kwd>Multilingualism</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        There has been wide adoption of ontologies in the biomedical domain [
        <xref ref-type="bibr" rid="ref14 ref15 ref40">14, 15,
40</xref>
        ]. Multilingual ontologies are highly relevant, particularly as their use in a
medical context afects a diverse range of language speakers. In the context of a
global pandemic, there are requirements for biomedical and healthcare tools, as
well as data integration at the national level. When considering the many
languages spoken in the world, this suggests multilingual bio-ontologies will be
of use. An example is OpenMRS, the medical record system used in 40
countries [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ], which in turn uses SNOMED CT, a vocabulary of medical terms
formalised in UMLS and OWL1 [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. SNOMED CT’s multilingual range
extends to French, Danish, Dutch, European Spanish and Swedish only [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ].
The lack of broader multilinguality is recognised by SNOMED CT as a
possible barrier to adoption [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ]. The translation of SNOMED CT into other
      </p>
      <sec id="sec-1-1">
        <title>1 SNOMED CT is only available on BioPortal in UMLS format, with English labels,</title>
        <p>so it was not able to be included in the review.</p>
        <p>
          Copyright © 2022 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
languages is not without challenge. For instance, Keet and Khumalo took steps
to translate SNOMED CT into isiZulu (a Niger-Congo B (‘Bantu’) language),
with the aim to provide localised electronic health records and patient
discharge note generation [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. However, the translation of OWL ran into
encoding issues due to the ubiquitous ‘part of’ relation as there is no single
term to denote this relation in isiZulu. Instead, it is constructed depending on
the category of things that play the part and the whole [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ].
        </p>
        <p>
          When developing multilingual ontologies, there are several options [
          <xref ref-type="bibr" rid="ref13 ref2 ref26">2, 13, 26</xref>
          ].
        </p>
        <p>
          The standard approach is to set multiple language-tagged annotations using
rdfs:label [
          <xref ref-type="bibr" rid="ref11 ref39">11, 39</xref>
          ]. The use of a linguistic model, such as OntoLex-Lemon [
          <xref ref-type="bibr" rid="ref23 ref9">9,
23</xref>
          ], is another possible approach, where each language-specific sense (from lexical
entries) is associated with an ontological entity. Mapping models between classes
or individuals from monolingual ontologies is also an option [
          <xref ref-type="bibr" rid="ref38">38</xref>
          ], where SKOS
is typically used to align individuals [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]. Language-tagged annotations is the
simplest way to model multilinguality, however its limitations are numerous,
particularly when representing languages that have grammatical features such
as inflected forms, gender, dependent prepositions, double negation, concordial
agreement, and agglutination (see [
          <xref ref-type="bibr" rid="ref16 ref17 ref18">16–18</xref>
          ]). An example of grammatical gender
is given by the “linked to” object property in the Organization Ontology2, which
has two labels in Spanish: “esat´ relacionado con” and “esat´ relacionada con”.
        </p>
        <p>
          Use of either one is determined by the gender of the noun of the class in the
domain position, or the subject of the sentence. As rdfs:labels are relied upon
in question-answering and similar systems [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], it is more dificult to represent
languages that have one or more of the above features in a way that also allows
for accurate verbalisation of ontologies.
        </p>
        <p>
          OntoLex-Lemon and its precursor, Lemon [
          <xref ref-type="bibr" rid="ref20 ref22">20, 22</xref>
          ], has been proposed as a
possible solution by providing rich linguistic grounding for ontologies. Other
linguistic models, such as LingInfo [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ], LexOnto [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], Linguistic Information
Repository (LIR) [
          <xref ref-type="bibr" rid="ref25 ref33">25, 33</xref>
          ], Linguistic Watermark 3.0 [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ], LexInfo [
          <xref ref-type="bibr" rid="ref5 ref7">5, 7</xref>
          ], and
GOLD [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ] have been proposed to solve similar problems. OntoLex-Lemon has
shown significant adoption within the Linguistic Linked Data cloud [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ], with
it now being the de facto model for linguistic representation [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. As a step in
the analysis of uptake of multilingual ontologies, we were interested to see if
the adoption of a linguistic model such as OntoLex-Lemon has extended to
OWL ontologies as well. We did this by collecting and analysing ‘production’
ontologies from BioPortal. Of the multilingual ontologies identified, we also
wanted to identify the use of more expressive OWL profiles in these ontologies,
where this expressivity allows for more complex reasoning, useful for
question-answering and other natural language generation.
        </p>
        <p>The primary purpose of this study was thus to identify the ratio of
multilingual OWL ontologies to monolingual ones, the modelling options used
for multilingual ontologies, as well as the OWL profile used. A core aspect of
multilingualism for ontologies is the identification of elements using URIs. An
identifier is a fragment of the URI that uniquely identifies the entity in</p>
      </sec>
      <sec id="sec-1-2">
        <title>2 https://lov.linkeddata.es/dataset/lov/vocabs/org</title>
        <p>
          question. A URI fragment can be opaque (semantic-free) or descriptive
(meaningful) [
          <xref ref-type="bibr" rid="ref19 ref27 ref3">3, 19, 27</xref>
          ]. For a descriptive identifier, there is a direct
relationship between the natural language term used as an identifier and its
semantics [
          <xref ref-type="bibr" rid="ref21 ref37">21, 37</xref>
          ]. If an opaque identifier is used as part of the URI, then a
human agent will require an additional sign in order to interpret the URI, and
this is realised using the rdfs:label annotation. OBO is well-known to have
taken a natural language-independent approach [
          <xref ref-type="bibr" rid="ref35">35</xref>
          ], with opaque URI
identifiers and mandatory labels, which also assume that if there is a
translation, it would be a 1:1 translation of the term. In addition, due to
OBO’s diferent take with identifiers, we wanted to determine if this approach
has extended to any other ontologies.
        </p>
        <p>
          We also analysed coverage of each natural language compared to the total
entity count within an ontology. As part of this work, we used the LLC lang metric
for multilinguality identified by Ell et al. [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ], that measures the completeness
for a given language within a corpus. The results show that there are only a few
production ontologies in BioPortal that are multilingual to a greater or lesser
degree. Of those multilingual ontologies, all use the multilingual labels option.
Three of the ontologies had less than 5% language-specific coverage.
        </p>
        <p>In the next section, the methodology for data collection and preparation is
described. In Section 3, the ontologies are analysed for their multilingual aspects
and discussed. We close with the conclusion in Section 4.
2</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Methodology and Overview</title>
      <p>Data collection was conducted using the REST API3 provided by BioPortal.
The steps to collect the required data are listed below.
1. Using the /ontologies endpoint within Postman4, a list of ontologies were
downloaded and saved as a JSON lfie.
2. Using the /categories endpoint, the process in Step 1 was repeated to get
the list of categories, with both files then imported into a MySQL database.
3. A script was written which queried each ontology using the
/ontologies/{acronym}/latest submission and
/ontologies/{acronym}/categories endpoints. The following data was
then saved for each ontology: the list of linked categories, the ontology
language used, the namespace acronym, URI, status, and description.
4. Only ‘OWL’ ontologies were selected, with all other formats excluded.
5. Only ‘production’ ontologies were selected, with all other statuses excluded.
6. Ontologies in the ‘Upper Level Ontology’ and ‘Vocabularies’ categories were
then excluded.
7. Thereafter, each remaining ontology was downloaded, using the
/ontologies/{acronym}/download endpoint.</p>
      <sec id="sec-2-1">
        <title>3 http://data.bioontology.org/documentation</title>
      </sec>
      <sec id="sec-2-2">
        <title>4 https://www.postman.com/</title>
        <p>BioPortal provides categories into which each ontology is classified. Ontologies
in the ‘Upper Level Ontology’ were excluded in Step 6 as the focus was on
domain ontologies. Ontologies in the ‘Vocabularies’ category were also excluded
as these are controlled vocabularies and thesauri, which are typically lightweight
ontologies at best. For Step 7, if the file size was large and resulted in timeout
errors, the file was manually downloaded. If the Download endpoint returned
an error for an ontology, the ontology would be manually inspected online. If
the latest submitted version had an ‘Error RDF’ annotation, then no further
download attempt was made.</p>
        <p>
          Steps 1–7 were run on the 30/12/2020. Step 1 resulted in a dataset of 912
ontologies5. At the end of Step 7, a dataset of 220 ontologies remained. The
review of ontologies for their multilingualism were conducted on this dataset. The
possible options were multilingual labels, linguistic models, and mapping models.
A diagrammatic representation of the multilingual labels option is shown in
Figure 1 for the class ‘Enzyme’ from the Ontology for Biomedical Investigations
(OBI) [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. Alignment of monolingual instances using SKOS is shown in Figure
2. An example linguistic modelling option is shown in Figure 3 using
OntoLexLemon for the class from Figure 1.
        </p>
        <p>Each ontology file was loaded in memory, using a script to loop through
each line therein. For multilingual labels, @ and xml:lang was searched for,
and if found, that line was saved to the database. For linguistic models, any
line which contained the namespaces: ontolex (OntoLex-Lemon), linginfo,
lexonto, lexinfo, gold and lemon was saved to the database. Likewise for
mapping models, any line which contained skos was saved to the database.
Thereafter, these saved rows were manually inspected for their multilingual
aspects. The natural languages used in each ontology were easily identified;
however, identification of those as primary language(s) was more subjective. To
determine an ontology’s primary language, an ontology was manually
inspected, focussing on the labels used, and the consistency thereof for each of
its languages. To qualify as language-independent, there would have to be
near-equal support for the natural languages therein, as well as opaque URI
identifiers. We applied LLC lang per multilingual ontology to support
identification of those as primary language ontologies.</p>
        <p>
          Of the multilingual ontologies identified, the OWL prolfie(s) of each were then
determined using the OWL Classifier [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. Our inspection was limited to OWL 2
only. For the ontologies classified as OWL 2 Full, the profile violations for OWL
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>5 The dataset is available here: https://fynbosch.com/article-2021-bioportal-review</title>
        <p>2 DL were examined and if determined to be related to annotations only, the
ontology was reclassified as OWL 2 DL as these violations can be patched easily.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Assessment of Ontologies for their Multilingualism</title>
      <p>
        The dataset of 220 ontologies was analysed on the diferent types of modelling
options. Only 11 were identified as being multilingual, which are listed in Table
1. As can be observed, they all use the multilingual labels option and mostly
opaque identifiers. The latter is likely a follow-on efect from OBO, which has a
principle that identifiers should not have a label meaningful to humans [
        <xref ref-type="bibr" rid="ref35 ref36">35, 36</xref>
        ].
Of those ontologies identiefid with more than one primary language, this
suggests they are language-independent. Only four ontologies were identified as
being language-independent: ATOL, CIDOC-CRM, PDRO, and RADLEX.
The remaining ontologies were identified as being of a primary language, with
translations into other languages. Only one primary-language multilingual
ontology was identified to be in a language other than English.
      </p>
      <p>We highlight the multilingual aspects of some of the identified ontologies that
prompted classification as ‘language-independent’ or ‘primary language’; Table 2
refers. Both CIDOC-CRM and RADLEX are language-independent ontologies.
Although CIDOC-CRM does indeed have its rdfs:comments only in English,
comments are ignored in parsing, whereas annotations and labels remain
“firstclass citizens” of the ontology, and its rdfs:labels were observed to provide
near-complete coverage in English, French, German, Greek, Portuguese, Russian
and Chinese, with opaque identifiers as well; hence, the classification as being
a language-independent ontology. In RADLEX, English and German are the
primary languages, with opaque identifiers. The ontology has its own annotation
properties: Preferred_name and Preferred_name_German, with both observed
to be used in equal proportion. The ontology also has definitions in English only,
but as these are imported from Medical Subject Headings (MeSH), the ontology
has been classiefid as a language-independent ontology.</p>
      <p>COVIDCRFRAPID, ONTOLURGENCES and UBERON are three primary
language ontologies. In COVIDCRFRAPID, in addition to English rdfs:labels,
the occasional use of Brazilian Portuguese was also observed. The ontology also
made use of skos:prefLabel, but only English was indicated. An OWL fragment
showing multilingual annotations for COVIDCRFRAPID is shown in Listing 1.
1 Prefix (:= &lt; http :// purl . org / vodan / whocovid19crfsemdatamodel / &gt;)
2
3 AnnotationAssertion ( rdfs : label : Chest_pain " Chest pain "@ en )
4 AnnotationAssertion ( rdfs : label : Chest_pain " Dor no peito "@pt - br )
5 AnnotationAssertion ( skos : prefLabel : Chest_pain " Chest pain "@ en )
Listing 1. Example multilingual annotations from COVIDCRFRAPID</p>
      <p>In ONTOLURGENCES, French is the primary language, with descriptive
identifiers, also in French. The ontology made use of SKOS’ prefLabel,
hiddenLabel and definition properties, with a limited number of English
prefLabels observed. In UBERON, English is the primary language, with
German, Spanish and French used as well. The ontology has used the
OboInOwl metamodel to define SKOS-like relations for classes, such as:
oboInOwl:hasExactSynonym and oboInOwl:hasRelatedSynonym. It was
observed that some exact/related synonyms are provided in other languages,
but not all equally. Very few of the English annotations were language-tagged.</p>
      <p>We expand on the metrics for multilingual ontologies identified, shown in
Table 2. The total number of classes, properties and named individuals for an
ontology, prior to any imports, is shown in the ‘Elements’ column. LLC lang is
then applied to each applicable natural language, where its coverage is indicated
as a percentage relative to the total number of elements for that ontology. Using
UBERON as an example, coverage is so low for German, Spanish, and French,
that it hardly qualifies as a multilingual ontology.</p>
      <p>
        Size of the ontology varied significantly per multilingual ontology. For
example, CIDOC-CRM required only 372 annotations, but RADLEX required
45 852. RADLEX required significantly more efort to achieve complete
coverage to that of CIDOC-CRM. For some smaller ontologies, such as LABO
and PDRO, where there was incomplete coverage per natural language, the use
of multilingualism was limited at best. Seven of the eleven multilingual
ontologies were identified to have relations with OboInOwl [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ] or other OBO
relations. The current modelling practice for multilingual ontologies is
multilingual labels, with opaque identifiers. Of the languages identified, English
was predictably represented in every multilingual ontology, followed by French
(6) and German (4).
      </p>
      <p>Only ‘production’ ontologies were considered, but if ontologies with
alternative statuses were also analysed, it is possible that the newer ontologies
put into production in the past months may have used an alternative modelling
option. The evidence indicates that there has been no uptake of any linguistic
model for OWL ontologies. Likewise for mapping models, there was no use of
SKOS for multilingual alignments. Due to insuficient data, we were unable to
determine why this is the case from the analysis conducted. A possible reason
may be insuficient tooling—there are limited tools to support the
development, maintenance, and coordination of multilingual ontologies or
multiple monolingual ontologies. It is unclear if the low number of multilingual
ontologies is a bias in BioPortal or the resources themselves. It might be the
case that there is limited need for multilingualism depending on the subject
domain, such as a higher relevance in healthcare and administration rather
than for biomedical research. We are currently finalising a more comprehensive
review of multilingualism in ontologies, including ontologies from other subject
domains. Its outcomes will be used in other ontologies and tools, such as the
MoReNL project6, whose foundations assist in the development of
ontology-driven multilingual tools.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>The assessment of use of multilingualism in production-level BioPortal
ontologies revealed a low adoption rate. The 11 out of the 220 that were
multilingual, predominantly used opaque identifiers with multilingual labels.
The ratio of multilingual OWL ontologies to monolingual ones was thus
identified to be 5%, however coverage of multilingual labels did not exceed 50%
for 3 of these ontologies. There was also no adoption of any linguistic model.
The OWL profile was identified to be primarily OWL 2 DL, but some
ontologies would require minor patching of the annotations to achieve this. Of
interest here is that these annotation profile violations were not identified when
developing the ontology, so a better mechanism may be needed to address this.</p>
      <p>For the modelling options, both multilingual labels and linguistic models
present areas of opportunity for future research. Of the ontologies analysed, the
reuse of OBO-related ontologies was observed to be substantive, and this presents
the opportunity to represent the shared lexicons for each using a linguistic model.
Acknowledgements This work was financially supported by Hasso Plattner
Institute for Digital Engineering through the HPI Research School at UCT
[FGW] and the National Research Foundation (NRF) of South Africa (Grant
Number 120852) [CMK].</p>
      <sec id="sec-4-1">
        <title>6 http://www.meteck.org/MoReNL/</title>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>OWL</given-names>
            <surname>Classifier</surname>
          </string-name>
          <article-title>v1.3</article-title>
          . https://github.com/muhummadPatel/OWL Classifier (
          <year>2016</year>
          ), online; accessed: 2020,
          <article-title>July 05</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Adamou</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Palma</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haase</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montiel-Ponsoda</surname>
            , E., de Cea,
            <given-names>G.A.</given-names>
          </string-name>
          , Go´mezPer´ez,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Peters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            ,
            <surname>Gangemi</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          :
          <article-title>The NeOn Ontology Models</article-title>
          . In: Ontology Engineering in a Networked World, pp.
          <fpage>65</fpage>
          -
          <lpage>90</lpage>
          . Springer Berlin Heidelberg (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Archer</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goedertier</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loutas</surname>
          </string-name>
          , N.:
          <source>D7.1</source>
          .3
          <article-title>- Study on persistent URIs, with identification of best practices and recommendations on the topic for the MSs and the EC</article-title>
          .
          <source>Tech. rep., Interoperability Solutions for European Public Administrations (12</source>
          <year>2012</year>
          ), accessed: 2021, June 12
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Bandrowski</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brinkman</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brochhausen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , et al.:
          <article-title>The Ontology for Biomedical Investigations</article-title>
          .
          <source>PLOS ONE 11(4)</source>
          ,
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          (04
          <year>2016</year>
          ). https://doi.org/10.1371/journal.pone.0154556
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haase</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sintek</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Towards Linguistically Grounded Ontologies</article-title>
          . In: Aroyo,
          <string-name>
            <surname>L.</surname>
          </string-name>
          , et al.
          <source>(eds.) Proc. of ESWC</source>
          <year>2009</year>
          , Heraklion, Crete, Greece, May 31-June 4,
          <year>2009</year>
          , LNCS, vol.
          <volume>5554</volume>
          , pp.
          <fpage>111</fpage>
          -
          <lpage>125</lpage>
          . Springer (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Declerck</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Frank</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al.:
          <article-title>LingInfo: Design and Applications of a Model for the Integration of Linguistic Information in Ontologies</article-title>
          .
          <source>In: Proc. of the OntoLex Workshop</source>
          ,
          <string-name>
            <surname>LREC</surname>
          </string-name>
          <year>2006</year>
          . pp.
          <fpage>28</fpage>
          -
          <lpage>32</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCrae</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sintek</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>LexInfo: A declarative model for the lexicon-ontology interface</article-title>
          .
          <source>Journal of Web Semantics</source>
          <volume>9</volume>
          (
          <issue>1</issue>
          ),
          <fpage>29</fpage>
          -
          <lpage>51</lpage>
          (03
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haase</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herold</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mantel</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.:</given-names>
          </string-name>
          <article-title>LexOnto: A Model for Ontology Lexicons for Ontology-based NLP</article-title>
          . In: Proc.
          <article-title>of OntoLex - From Text to Knowledge: The Lexicon/Ontology Interface (</article-title>
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCrae</surname>
            ,
            <given-names>J.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Lexicon Model for Ontologies:
          <source>Community Report. Final Community Group Report, 10 May</source>
          <year>2016</year>
          ,
          <article-title>OntologyLexicon Community Group under the W3C Community Final Specification Agreement (FSA) (05</article-title>
          <year>2016</year>
          ), https://www.w3.org/
          <year>2016</year>
          /05/ontolex/
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Diefenbach</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Both</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Singh</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maret</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Towards a question answering system over the Semantic Web</article-title>
          .
          <source>Semantic Web</source>
          <volume>11</volume>
          (
          <issue>3</issue>
          ),
          <fpage>421</fpage>
          -
          <lpage>439</lpage>
          (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Ell</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , Vrandceciˇ,´ D.,
          <string-name>
            <surname>Simperl</surname>
          </string-name>
          , E.:
          <article-title>Labels in the web of data</article-title>
          . In: Aroyo,
          <string-name>
            <surname>L.</surname>
          </string-name>
          , et al. (eds.)
          <source>The Semantic Web - ISWC</source>
          <year>2011</year>
          ,
          <article-title>LNCS</article-title>
          , vol.
          <volume>7031</volume>
          , pp.
          <fpage>162</fpage>
          -
          <lpage>176</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Farrar</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Langendoen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>A linguistic ontology for the semantic web</article-title>
          .
          <source>GLOT International</source>
          <volume>7</volume>
          (
          <issue>3</issue>
          ),
          <fpage>97</fpage>
          -
          <lpage>100</lpage>
          (03
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Gracia</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montiel-Ponsoda</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , et al.:
          <article-title>Challenges for the Multilingual Web of Data</article-title>
          .
          <source>Journal of Web Semantics</source>
          <volume>11</volume>
          ,
          <fpage>63</fpage>
          -
          <lpage>71</lpage>
          (03
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Hoehndorf</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gkoutos</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>Evaluation of research in biomedical ontologies</article-title>
          .
          <source>Briefings in Bioinformatics</source>
          <volume>14</volume>
          (
          <issue>6</issue>
          ),
          <fpage>696</fpage>
          -
          <lpage>712</lpage>
          (11
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Hoehndorf</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schofield</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gkoutos</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>The role of ontologies in biological and biomedical research: a functional perspective</article-title>
          .
          <source>Briefings in Bioinformatics</source>
          <volume>16</volume>
          (
          <issue>6</issue>
          ),
          <fpage>1069</fpage>
          -
          <lpage>1080</lpage>
          (11
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Keet</surname>
            ,
            <given-names>C.M.</given-names>
          </string-name>
          :
          <article-title>Representing and aligning similar relations: parts and wholes in isiZulu vs</article-title>
          . English. In: Gracia,
          <string-name>
            <surname>J.</surname>
          </string-name>
          , et al.
          <source>(eds.) Proc. of LDK</source>
          <year>2017</year>
          , Galway, Ireland, June 19-20,
          <year>2017</year>
          , LNCS, vol.
          <volume>10318</volume>
          , pp.
          <fpage>58</fpage>
          -
          <lpage>73</lpage>
          . Springer
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Keet</surname>
            ,
            <given-names>C.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khumalo</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>On the verbalization patterns of part-whole relations in isiZulu</article-title>
          . In: Bond,
          <string-name>
            <surname>F.</surname>
          </string-name>
          , et al.
          <source>(eds.) Proc. of INLG'16</source>
          , pp.
          <fpage>174</fpage>
          -
          <lpage>183</lpage>
          . ACL (09
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Keet</surname>
            ,
            <given-names>C.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khumalo</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>On the Ontology of Part-Whole Relations in Zulu Language and Culture</article-title>
          .
          <source>In: Proc. of FOIS 2018</source>
          . vol.
          <volume>15</volume>
          , pp.
          <fpage>361</fpage>
          -
          <lpage>384</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>Labra</given-names>
            <surname>Gayo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Kontokostas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Auer</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          :
          <article-title>Multilingual Linked Data Patterns</article-title>
          .
          <source>Semantic Web Journal</source>
          <volume>6</volume>
          (
          <issue>4</issue>
          ),
          <fpage>319</fpage>
          -
          <lpage>337</lpage>
          (01
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <article-title>lemon: The Lexicon Model for Ontologies</article-title>
          . https://lemon-model.net, online; accessed:
          <fpage>18</fpage>
          -
          <lpage>09</lpage>
          -2021
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Manaf</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bechhofer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stevens</surname>
          </string-name>
          , R.:
          <article-title>A Survey of Identifiers and Labels in OWL Ontologies</article-title>
          .
          <source>In: Proc. of OWLED</source>
          <year>2010</year>
          , San Francisco, California, USA, June 21-22,
          <year>2010</year>
          , CEUR Workshop Proceedings, vol.
          <volume>614</volume>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>McCrae</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , de Cea,
          <string-name>
            <given-names>G.A.</given-names>
            ,
            <surname>Buitelaar</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.</surname>
          </string-name>
          , et al.:
          <article-title>Interchanging lexical resources on the Semantic Web</article-title>
          .
          <source>Language Resources and Evaluation</source>
          <volume>46</volume>
          ,
          <fpage>701</fpage>
          -
          <lpage>719</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>McCrae</surname>
            ,
            <given-names>J.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bosque-Gil</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gracia</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>The OntoLexLemon model: development and applications</article-title>
          . In: Kosem,
          <string-name>
            <surname>I.</surname>
          </string-name>
          , et al.
          <source>(eds.) Proc. of eLex 2017</source>
          . pp.
          <fpage>587</fpage>
          -
          <lpage>597</lpage>
          .
          <article-title>Lexical Computing CZ s</article-title>
          .
          <source>r.o. (September</source>
          <volume>19</volume>
          -21
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Miles</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bechhofer</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>SKOS Simple Knowledge Organization System Reference: W3C Recommendation 18 August 2009</article-title>
          .
          <source>Tech. rep., World Wide Web Consortium</source>
          (
          <year>2009</year>
          ), https://www.w3.org/TR/skos-reference/
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Montiel-Ponsoda</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , Aguado de Cea, G.,
          <article-title>Go´mez-Per´ez,</article-title>
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Peters</surname>
          </string-name>
          ,
          <string-name>
            <surname>W.</surname>
          </string-name>
          :
          <article-title>Modelling Multilinguality in Ontologies</article-title>
          .
          <source>In: Coling</source>
          <year>2008</year>
          : Companion volume:
          <source>Posters</source>
          . pp.
          <fpage>67</fpage>
          -
          <lpage>70</lpage>
          .
          <article-title>Coling 2008 Organizing Committee</article-title>
          , Manchester, UK (08
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Montiel-Ponsoda</surname>
            , E., de Cea,
            <given-names>G.A.</given-names>
          </string-name>
          ,
          <article-title>Gom´ez-Per´ez,</article-title>
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Peters</surname>
          </string-name>
          ,
          <string-name>
            <surname>W.</surname>
          </string-name>
          :
          <article-title>Enriching ontologies with multilingual information</article-title>
          .
          <source>Natural Language Engineering</source>
          <volume>17</volume>
          (
          <issue>3</issue>
          ),
          <fpage>283</fpage>
          -
          <lpage>309</lpage>
          (07
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Montiel-Ponsoda</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vila-Suero</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Terrazas</surname>
            ,
            <given-names>B.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dunsire</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rodriguez</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gomez-Perez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Style Guidelines for Naming and Labeling Ontologies in the Multilingual Web</article-title>
          .
          <source>In: Proc. of DCMI'11</source>
          . pp.
          <fpage>105</fpage>
          --
          <volume>115</volume>
          (09
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <article-title>National Center for Biomedical Ontology: OboInOwl:Main Page</article-title>
          . https://www.bioontology.org/wiki/OboInOwl:Main Page (
          <year>2008</year>
          ), online; accessed: 2020, October 12
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>NCBO</surname>
          </string-name>
          <article-title>BioPortal: SNOMED CT</article-title>
          . https://bioportal.bioontology.org/ontologies/ SNOMEDCT (
          <year>2021</year>
          ), online; accessed:
          <fpage>28</fpage>
          -
          <lpage>09</lpage>
          -2021
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30. Open Linguistics Working Group:
          <article-title>The Linguistic Linked Open Data cloud diagram (draft), version of</article-title>
          . http://linguistic-lod.
          <source>org</source>
          (
          <year>2018</year>
          ), online; accessed:
          <fpage>28</fpage>
          -
          <lpage>09</lpage>
          -2021
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31. OpenMRS: OpenMRS:
          <article-title>Medical Record System</article-title>
          . https://openmrs.org/ (
          <year>2021</year>
          ), online; accessed: 2021, September 28
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Pazienza</surname>
            ,
            <given-names>M.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stellato</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Turbati</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Linguistic Watermark 3.0: an RDF framework and a software library for bridging language and ontologies in the Semantic Web</article-title>
          .
          <source>In: Proc. of SWAP2008</source>
          . vol.
          <volume>426</volume>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          . Rome, Italy (01
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Peters</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montiel-Ponsoda</surname>
            , E., de Cea,
            <given-names>G.A.</given-names>
          </string-name>
          ,
          <article-title>Go´mez-Per´ez, A.: Localizing Ontologies in OWL</article-title>
          .
          <source>In: Actas OntoLex</source>
          <year>2007</year>
          (
          <year>2007</year>
          ), http://oa.upm.es/5195/
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34. SNOMED International:
          <article-title>Use SNOMED CT</article-title>
          . https://www.snomed.org/snomedct/sct-worldwide (
          <year>2021</year>
          ), online; accessed: 2021, September 28
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35. The OBO Foundry: Principle: URI/Identifier Space. http://www.obofoundry.org/ principles/fp-003-uris.html (
          <year>2020</year>
          ), online; accessed:
          <fpage>12</fpage>
          -
          <lpage>10</lpage>
          -2020
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <article-title>The OBO Foundry: OBO Foundry Identifier Policy</article-title>
          . http://www.obofoundry.org/id-policy (
          <year>2021</year>
          ), online; accessed:
          <fpage>12</fpage>
          -
          <lpage>06</lpage>
          -2021
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Third</surname>
          </string-name>
          , A.:
          <article-title>”Hidden semantics”: what can we learn from the names in an ontology</article-title>
          ? In: Bond,
          <string-name>
            <surname>F.</surname>
          </string-name>
          , et al.
          <source>(eds.) Proc. of INLG 2012</source>
          . pp.
          <fpage>67</fpage>
          -
          <lpage>75</lpage>
          . ACL (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38.
          <string-name>
            <surname>Trojahn</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fu</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zamazal</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ritze</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>State-of-the-Art in Multilingual and Cross-Lingual Ontology Matching</article-title>
          .
          <source>In: Towards the Multilingual Semantic Web: Principles, Methods and Applications</source>
          , pp.
          <fpage>119</fpage>
          -
          <lpage>135</lpage>
          . Springer (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          39. W3C OWL Working Group:
          <article-title>OWL Web Ontology Language Use Cases and Requirements: W3C Recommendation 10 February 2004</article-title>
          . Tech. rep.,
          <source>World Wide Web Consortium (02</source>
          <year>2004</year>
          ), https://www.w3.org/TR/webont-req/
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          40.
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>A.C.</given-names>
          </string-name>
          :
          <article-title>Methods in biomedical ontology</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          <volume>39</volume>
          (
          <issue>3</issue>
          ),
          <fpage>252</fpage>
          -
          <lpage>266</lpage>
          (06
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>