<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <issn pub-type="ppub">1613-0073</issn>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Enhancing semantic interoperability across materials science with HIVE4MAT</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jane Greenberg</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kio Polson</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Scott McClellan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Xintong Zhao</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alex Kalinowski</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yuan An</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Conference on Semantic Systems</institution>
          ,
          <addr-line>SEMANTiCS</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Metadata Research Center, College of Computing and Informatics, Drexel University</institution>
          ,
          <addr-line>3675 Market St., Philadelphia, PA</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Ontology, Materials science, Simple Knowledge Organization Systems (SKOS)</institution>
          ,
          <addr-line>Metadata, Software</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2024</year>
      </pub-date>
      <abstract>
        <p>HIVE4MAT is a linked data interactive application for navigating ontologies of value to materials science. HIVE enables automatic indexing of textual resources with standardized terminology. This article presents the motivation underlying HIVE4MAT, explains the system architecture, reports on two evaluations, and discusses future plans.</p>
      </abstract>
      <kwd-group>
        <kwd>development</kwd>
        <kwd>application seeks to address this challenge</kwd>
        <kwd>HIVE4MAT allows exploration multiple ontologies</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>CEUR
ceur-ws.org</p>
    </sec>
    <sec id="sec-2">
      <title>1. Introduction</title>
      <p>
        Data infrastructure advancements over the last two decades have supported the development
of a rich ecosystem of machine readable semantic vocabularies across many domains. These
advances have enabled a number of materials science initiatives, e.g.[
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ] to leverage
individual ontologies for data organization, access, interoperability, and support for the FAIR data
principles[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Even with this progress, limited attention has been directed to exploring the
broad array of ontologies and other semantic systems both within materials science and across
interconnected disciplines. One likely reason for this condition is the general evolution of
ontologies. Ontological development and use-case scenarios represent a first-phase priority, while
human and financial resources for exploring the larger spectrum of semantic systems require
more time and investment. Another factor is limited availability of applications that provide
researchers and data custodians capacity to easily explore and use of the broader spectrum of
relevant semantics systems. Research is necessary to allow for greater exploration of a wide
array of semantic systems of value to materials science researchers for organizing and providing
access to their data assets and other scientific and scholarly outputs.
LGOBE
research development, the support for breaking down research silos of terminologies, baseline
evaluations, and future plans.
      </p>
    </sec>
    <sec id="sec-3">
      <title>2. Case for HIVE4MAT</title>
      <p>
        Technical advanecments have greatly accelerated the capacity for machine readable, shared
semantic systems, including ontologies. This progress has largely been motivated by
BernersLee’s vision of the Semantic Web as a world of linked data[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] together with the development and
adoption of encoding standards underlying machine-readable ontological systems[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Primary
standards supported by the World Wide Web Consortium (W3C) include the the Resource
Description Framework (RDF) data model and the Web Ontology Language (OWL). Another
standard is the Simple Knowledge Organization Systems (SKOS) for representing
terminological and classificatory Knowledge Organization Systems (KOS), such as thesauri, taxonomies,
classification schemes, controlled vocabularies, and keyword lists. SKOS is defined using an
RDF schema and supports linked data and the Semantic Web ecosystem[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. While less logically
complex than OWL, the SKOS data model can better support collective analysis of multiple
ontologies through a set of taxonomic relationships among concepts.
      </p>
      <p>
        Over the past several decades, the availability of these encoding standards, examples of
ontology development in biology and bio-medicine, and, more recently, national and international
data-driven initiatives have motivated ontology development in materials science. For example
the U.S. Materials Genome Initiative[
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ] calls for accelerated, data-driven innovation and
discovery of materials which are less environmentally harmful. Robust, standardized metadata
and the use of ontologies are key to this aim. Another example is the extensive efort of the
European Materials Modelling Council[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and the support for the Elementary Multiperspective
Material Ontology (EMMO). Other developments include the global adoption of the FAIR
principles, advancements in knowledge graph research[
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ], and the rapid growth of artificial
intelligence[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <p>
        Advancement in the overall ontology landscape has also involved development of trusted
registries for sharing these semantic systems for broader community use. The biomedical and
biology communities have led in this area with the National Center for Biological Ontologies
(NCBO) Bioportal1[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] and the OBO foundry2[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. These registries have allowed biomedical,
bio-science, earth science, and other discipline researchers a greater opportunity to explore and
use multiple ontologies. In fact, a number of ontologies found in these registries are applicable
to materials science research, given its interdisciplinary nature. There has also been increased,
complementary activity to deploy materials science registries, with NOMAD[
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], NIST Materials
Registry3[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], the Industrial Ontology Foundry4, and most recently MatPortal5, based on The
Bioportal’s technology[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>
        Even with these developments, materials science ontology advancements have primarily been
siloed, with use of an individual ontology to support and organize the underlying a specific data
1http://bioportal.bioontology.org/
2http://www.obofoundry.org/
3https://materials.registry.nist.gov/
4https://www.industrialontologies.org/
5https://matportal.org/ontologies
model of a single project. Examples include Nanomine[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], NOMAD vocabulary[
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], and Process
Material Digital Core ontology[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. These developments have been significant for advancing the
semantic space in materials science. However, leveraging a broader collection of ontologies in
a single workflow will enhance semantic interoperability and support of the FAIR principles
both within materials science and in relation to other disciplines. To this end, there is a need
for applications that allow researchers and data custodians to explore and implement multiple
ontologies and determine their applicability. This is a key goal of the HIVE4MAT application
presented in this paper.
      </p>
    </sec>
    <sec id="sec-4">
      <title>3. Developing Solution: HIVE4MAT</title>
      <sec id="sec-4-1">
        <title>3.1. HIVE4MAT Overview</title>
        <p>HIVE4MAT is a linked data, interactive application for navigating ontologies, automatically
indexing text, and generating metadata with standardized terms drawn from ontologies.
HIVE4MAT is led by the Metadata Research Center at Drexel University. This initiative is
also connected with the National Science Foundations Harnessing the Data Revolution’s
Institute for Data Driven Dynamical Design (NSF/HDR-ID4)6, where one of the Institute’s aims is to
facilitate greater interoperability and communication among diferent facets of materials science.
The intended user audience for HIVE4MAT includes material science researchers, curators, and
data custodians; although, researchers who regularly interact with ontologies may also find this
application of interest. HIVE4MAT features simplify ontology use for semantic representation
and curation activities, as the chief audience is generally not sophisticated ontology developers.</p>
        <p>
          The main functions of HIVE4MAT is to provide users with standardized semantics
terminology for metadata representations drawing from multiple ontologies and semantic systems.
HIVE4MAT does not aim to support reasoning and complex relationships represented in OWL,
but instead retains basic taxonomic equivalency, hierarchy, and associative relationships[
          <xref ref-type="bibr" rid="ref19">19</xref>
          ].
While HIVE4MAT does not perform sophisticated reasoning, the SKOS encoded relationships
ofer a pragmatic approach for navigating and comparing multiple ontologies in a single
sequence, and a good place to initiate ontology exploration. Finally, while HIVE4MAT’s use of
SKOS collapses OWL ontologies, users of this application are able to find, explore, and use the
full OWL ontology through other systems.
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>3.2. Functionality</title>
        <p>The HIVE4MAT application has three main user features: 1. Navigation, 2. Search, and 3.
Indexing. These three features are discussed below in more detail.</p>
        <sec id="sec-4-2-1">
          <title>3.2.1. Navigation</title>
          <p>
            The navigation feature allows a user to select and explore an ontology tree hierarchically
from the top level concepts down to any child or descendant concepts. Ontologies included
in HIVE4MAT are converted from any RDF-based format into the SKOS schema. While this
translation may eliminate some of the initial OWL functionality, it does not reduce users’
ability to efectively explore ontological concepts within a simple taxonomic tree structure.
Moreover, the use of a single standard reduces the ambiguity between super- and sub-class
relationships[
            <xref ref-type="bibr" rid="ref20">20</xref>
            ]. Users can launch their ontology navigation at an ontology’s top level concept,
a node concept, or a leaf concept. Once the user selects a concept, they may view the full SKOS
encoded metadata for that particular concept. The HIVE4MAT SKOS includes the following
attributes:
• Preferred label (SKOS:preflabel)
• URI
• Alternate label (SKOS:altlabel)
• Notes
• SubClassOf (SKOS:broader)
• SuperClassOf (SKOS:narrower)
• Related Concepts (SKOS:related)
          </p>
          <p>If the user identifies a concept that they plan to use in their metadata, HIVE4MAT allows
the user to copy the concept and the preferred encoding. HIVE4MAT supported metadata
encodings include:
• JSON-LD
• SKOS RDF/XML
• Dublin Core XML
• “Plain” XML</p>
          <p>These metadata encodings are components of HIVE4MAT’s additional features described
below.</p>
        </sec>
        <sec id="sec-4-2-2">
          <title>3.2.2. Searching</title>
          <p>HIVE4MAT allows a user to search for a concept within an ontology or across multiple
ontologies. The search feature permits the user to select one or a set of ontologies to search,
and then search to retrieve relevant terms in the selected ontology or ontologies. Following
the search, HIVE4MAT returns a list of relevant terms grouped by ontology for the user to
browse. A HIVE4MAT search query is run against the following concept fields: preferred label
(SKOS:preflabel) the alternate label (SKOS:altlabel), and the annotations (SKOS:scopenote). As
a result, retrieved concepts may not contain the initial search term entered by the user as a
preferred term. This helps users identify a more robust terminology for their metadata record.</p>
          <p>As with the navigation feature, once the list of relevant terms is displayed, the user can click
on any of the terms and see the associated metadata of the concept. The user can also copy the
metadata for one concept at a time in the encoding formats listed earlier.</p>
        </sec>
        <sec id="sec-4-2-3">
          <title>3.2.3. Automatic Indexing</title>
          <p>
            HIVE4MAT also has an automatic indexing feature for processing text and assisting users in the
selection of standard ontology terms for area-specific descriptive metadata. The HIVE4MAT
uses Natural Language Processing (NLP) and then maps keyword phrases to the the selected
ontologies. A user can select to use either the Rapid Automatic Keyword Extraction (RAKE)[
            <xref ref-type="bibr" rid="ref21">21</xref>
            ]
or Yet Another Keyword Extractor (YAKE)[
            <xref ref-type="bibr" rid="ref22">22</xref>
            ] algorithm. Following the indexing sequence, the
user (e.g., a researcher, curator, data custodian) is presented with indexing results and selects the
desired terms from one or more ontologies for the metadata representation they are creating.
          </p>
          <p>Figure 1 provides an overview of HIVE4MAT workflow, and a detailed scenario follows here:
The user first selects which ontologies they would like to consider for the automatic indexing
sequence. Next the user can either upload a text file, an MSWord document, or a PDF which
HIVE4MAT converts to text can then index. Alternatively, the user may type in a URI of a web
page or another accessible digital resource, and HIVE4MAT will then scrape for the textual
content of the page for automatic indexing. HIVE4MAT provides options for the user to select
and modify algorithm settings and word count lengths. The last step in the indexing workflow
requires the user to click the indexing button. This step initiates automatic indexing of text that
has been either uploaded or identified with a URI. HIVE4MAT also has a script to support batch
up-loading and indexing if there is collection of documents to process.</p>
          <p>HIVE4MAT takes several seconds to index against multiple ontologies. This greatly expedites
the process of having to index an article against one ontology at a time. We should note that the
larger ontologies can slow down this process to anywhere between seven and thirty seconds,
although this time lag is still more expedient than indexing a resource against each ontology,
one at a time; and our development team continues to work on improvements in this area.</p>
          <p>After the indexing activity, candidate terms are displayed and grouped together by ontology.
Relevancy for candidate terms is indicated by font size and order. The user can further
manipulate the results, as there are four diferent sort and display options. The automatic indexing
results focus only on terms in in the SKOS preferred label, and the alternate labels and notes
are not part of the sequence. Finally, as with the search and navigation features, users can click
on any term and the associated metadata for that concept will be displayed, which can then be
copied using the encodings listed above.</p>
        </sec>
        <sec id="sec-4-2-4">
          <title>3.2.4. Application Architecture</title>
          <p>
            HIVE4MAT is written in Python 3, and it follows the framework of general HIVE, and the
ontologies are stored as SQL databases. With the exception of three ontologies generated in
Protege, the selection of ontologies currently in HIVE4MAT were retrieved from the Bioportal
[
            <xref ref-type="bibr" rid="ref13">13</xref>
            ] and MatPoral 7. They were converted to SKOS on loacal computers using one of the team’s
python scripts, and uploaded into HIVE4MAT one at a time. A key goal is to automate this
process.
          </p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>4. Evaluation and Current Development</title>
      <p>Over the last several years, the HIVE4MAT team has conducted several evaluations that
impact current development works. Two key evaluations eforts pursued with materials science
researchers are shared here.</p>
      <p>
        The first evaluation was 2021 study comparing the performance of HIVE4MAT, as a basic
knowledge extraction automatic indexing application to MatScholar, a named entity recognition
(NER) application[
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. A sample of 60 abstracts from inorganic materials research articles were
processed through both HIVE4MAT, which at the time used classic RAKE (rapid automatic
keyword extraction) algorithm [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] at this time, and MatScholar, which uses name entity
recognition (NER) along with an RNN-LSTM (recurrent neural network-long short term memory)
structure. This comparison extended an exploratory, first-phase evaluation comparing these two
applications that was reported at the the ACM/IEEE Joint Conference on Digital Libraries[
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
For the 2021 study, material science researchers assessed the relevance of the results, and were
asked for feedback on the two applications. For the HIVE4MAT application they indicated the
ease in selecting relevant terminology for representing the content of scientific research articles
or data sets they aimed publish. The combined relevant and partially relevant performance was
66% as reported in Table 1 (next page).
      </p>
      <p>Researchers found HIVE4MAT was helpful in that it provided access to knowledge recorded
in articles, as well as insight into a terminological structure. Another noted benefit was
recognizing that HIVE4MAT’s supports the reuse of existing ontologies and other semantic systems.
This permits greater data interoperability and breaks down existing semantic silos. On the
development end, HIVE4MAT does not require a large dataset and LLM training. In terms
of HIVE4MAT’s limitations, the knowledge extraction and indexing capabilities rely on the
composition of terms in the ontology and the algorithm used, and the results lack the specificity
found with MatScholar.</p>
      <p>The second evaluation tested the performance of HIVE4MAT’s automatic indexing feature
and focused Metal Organic Frameworks (MOFs) research. A sample of 10 articles reporting on
MOF research were run through the HIVE4MAT, and processed against ten material science
ontologies. A total of 282 candidate terms were returned, resulting in an average of 28 terms
per article, and 28 terms per ontology. The articles had a standard deviation of 12 terms (Max
42, Min 3), and the vocabularies had a standard deviation of 23 terms (Max 67, Min 0). Five
MOFs researchers participated in an evaluation and rated whether each of the 282 terms was
relevant to it’s corresponding article. The evaluators worked with a three-tiered evaluation
system consisting of the following measures: relevant, partially relevant, or not relevant, and
the result are reported in Table 2 (above) and Table 3 (next page).</p>
      <p>
        Any candidate term that was deemed relevant or partially relevant by four or five of the
ifve experts was considered relevant, while all other terms were considered not relevant as
they did not meet this threshold. Of the 282 candidate terms corresponding to an article, 110
were considered relevant, giving a precision of 39%. This is a vast improvement given that
the relevancy results for some initial testing of HIVE4MAT’s automatic indexing feature on
MOF-related articles had performed extremely poorly. The initial improvements found during
this evaluation were the result HIVE4MAT algorithm modification reported in [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
      </p>
      <p>Work is now underway to further streamline the process of automatically downloading
ontologies from common repositories and adding updates to HIVE4MAT. This enhancement
will both expedite and simplify HIVE4MAT updates and insure the most current versions of
ontologies are employed for automatic indexing, and accessible to users for searching search
and navigation. This enhancement is a top priorities that is part of the HIVE4MAT development
road map.</p>
    </sec>
    <sec id="sec-6">
      <title>5. Implications and Future Plans</title>
      <p>
        Preliminary testing of HIVE4MAT has been promising in selecting relevant terms for materials
science [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. While some may raise an questions with translating an ontology into SKOS, there
are benefits and other considerations that need to be considered. First, HIVE4MAT does not
strive to be a registry and the original OWL ontology is still available for each ontology’s
respective host, thus maintaining its complexity.
      </p>
      <p>Second, HIVE4MAT focuses on the human discovery by bringing together ontologies that
have emerged as standards in the field of material science. The benefit of HIVE4MAT is allowing
users to comfortably interact and explore rich collections of semantics relevant for indexing
textual resources or textual components of resources that may have other associated media.
Indeed, inference based features can be explored by other applications.</p>
      <p>Third, OWL implementations vary across schemas, presenting significant mapping challenges.
While SKOS may reduce relationship specificity, it allows for greater interoperability when
investigating multiple ontologies at a first pass or when ontologies are being explored for simply
indexing. Many ontologies utilize the RDF schema comment as a field to annotate ontology
concepts, but other ontologies within HIVE4MAT only use SKOS scopeNote, or the Common
Core Ontology definition. While each ontology may use diferent fields for recording notes
about a concept, translating these schemas all to SKOS within HIVE4MAT allows for schema
to be interoperable at a general level, without changing the basic hierarchy of the original
ontology.</p>
      <p>
        Once research and implementation on automatic ontology ingestion into HIVE4MAT is
complete, the HIVE4MAT team will turn their attention to other development roadmap plans.
First, the front end will be overhauled so that the back end logic and the front end logic can be
easier to maintain and further develop. This will make it easier to add new features, and for
users to access the code and implement similar features in their own systems. Second, we will
implement a new feature which will allow an ”ontology to ontology” search. The goal is to allow
a user to input a list of terms they use at an individual, project, institution, or discipline level, and
see if that list of terms has a best match with an existing ontology, or a set of ontologies. While
there is a growing body of work on ontology alignment[
        <xref ref-type="bibr" rid="ref26 ref27 ref28">26, 27, 28</xref>
        ], applications supporting
easy ”ontology to ontology” search appears limited. Third, we aim to provide more provenance
metadata about each ontology in the HIVE4MAT system. Each ontology has a context for when
and where the ontology was created, who (individual or group) created the ontology, and where
it’s used. Making that historical context more visible to users may help with discerning which
ontologies a project should consider implementing.
      </p>
      <p>Overall our development roadmap will contribute to more robust HIVE4MAT infrastructure.
As HIVE4MAT advances we will more widely share our developments with the materials science
community, and other communities seeking to leverage multiple ontologies.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgments</title>
      <p>We acknowledge the support of NSF-OAC#2118201
6. Online Resources</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>B.</given-names>
            <surname>Bayerlein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schilling</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Birkholz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Jung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Waitelonis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Mädler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Sack</surname>
          </string-name>
          ,
          <article-title>Pmd core ontology: Achieving semantic interoperability in materials science</article-title>
          ,
          <source>Materials &amp; Design</source>
          <volume>237</volume>
          (
          <year>2024</year>
          )
          <fpage>112603</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>H.</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Hu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Yan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>McCusker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. L.</given-names>
            <surname>McGuinness</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Schadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. C.</given-names>
            <surname>Brinson</surname>
          </string-name>
          ,
          <article-title>Nanomine schema: An extensible data representation for polymer nanocomposites</article-title>
          ,
          <source>APL Materials 6</source>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M. D.</given-names>
            <surname>Wilkinson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dumontier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. J.</given-names>
            <surname>Aalbersberg</surname>
          </string-name>
          , G. Appleton,
          <string-name>
            <given-names>M.</given-names>
            <surname>Axton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Baak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Blomberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.-W.</given-names>
            <surname>Boiten</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. B. da Silva</given-names>
            <surname>Santos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. E.</given-names>
            <surname>Bourne</surname>
          </string-name>
          , et al.,
          <article-title>The fair guiding principles for scientific data management and stewardship</article-title>
          ,
          <source>Scientific data 3</source>
          (
          <year>2016</year>
          )
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. Hendler,</surname>
          </string-name>
          <article-title>Publishing on the semantic web</article-title>
          ,
          <source>Nature</source>
          <volume>410</volume>
          (
          <year>2001</year>
          )
          <fpage>1023</fpage>
          -
          <lpage>1024</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>C.</given-names>
            <surname>Bizer</surname>
          </string-name>
          ,
          <article-title>The emerging web of linked data</article-title>
          ,
          <source>IEEE intelligent systems 24</source>
          (
          <year>2009</year>
          )
          <fpage>87</fpage>
          -
          <lpage>92</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Miles</surname>
          </string-name>
          , S. Bechhofer,
          <article-title>SKOS Simple Knowledge Organization System Reference</article-title>
          ,
          <source>W3C Recommendation, W3C</source>
          ,
          <year>2009</year>
          . Https://www.w3.org/TR/2009/REC-skos-reference-
          <volume>20090818</volume>
          /.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>A.</given-names>
            <surname>Dima</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bhaskarla</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Brady</surname>
          </string-name>
          , C. Campbell,
          <string-name>
            <given-names>P.</given-names>
            <surname>Dessauw</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Hanisch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            <surname>Kattner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kroenlein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Newrock</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Peskin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Plante</surname>
          </string-name>
          , S.-
          <string-name>
            <given-names>Y.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.-F.</given-names>
            <surname>Rigodiat</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. S.</given-names>
            <surname>Amaral</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Trautt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Schmitt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Warren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Youssef</surname>
          </string-name>
          ,
          <article-title>Informatics infrastructure for the materials genome initiative</article-title>
          ,
          <source>JOM</source>
          (
          <year>1989</year>
          )
          <volume>68</volume>
          (
          <year>2016</year>
          )
          <fpage>2053</fpage>
          -
          <lpage>2064</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Materials</given-names>
            <surname>Genome</surname>
          </string-name>
          <article-title>Initiative strategic plan</article-title>
          ,
          <source>Executive Ofice of the President, National Science and Technology Council, Committee on Technology, Subcommittee on the Materials Genome Initiative</source>
          , Washington, District of Columbia,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>G.</given-names>
            <surname>Goldbeck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Ghedini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hashibon</surname>
          </string-name>
          , G. Schmitz,
          <string-name>
            <given-names>J.</given-names>
            <surname>Friis</surname>
          </string-name>
          ,
          <article-title>A reference language and ontology for materials modelling</article-title>
          and interoperability,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>S. P.</given-names>
            <surname>Voigt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. R.</given-names>
            <surname>Kalidindi</surname>
          </string-name>
          , Materials graph ontology,
          <source>Materials letters 295</source>
          (
          <year>2021</year>
          )
          <fpage>129836</fpage>
          -.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D.</given-names>
            <surname>Mrdjenovich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. K.</given-names>
            <surname>Horton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. H.</given-names>
            <surname>Montoya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. M.</given-names>
            <surname>Legaspi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Dwaraknath</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Tshitoyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Jain</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
          <article-title>A. Persson, propnet: A knowledge graph for materials science</article-title>
          ,
          <source>Matter</source>
          <volume>2</volume>
          (
          <year>2020</year>
          )
          <fpage>464</fpage>
          -
          <lpage>480</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>B.</given-names>
            <surname>Ma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. J.</given-names>
            <surname>Finan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Jany</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. E.</given-names>
            <surname>Deagen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. S.</given-names>
            <surname>Schadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. C.</given-names>
            <surname>Brinson</surname>
          </string-name>
          ,
          <article-title>Machine-learningassisted understanding of polymer nanocomposites composition-property relationship: A case study of nanomine database</article-title>
          ,
          <source>Macromolecules</source>
          <volume>56</volume>
          (
          <year>2023</year>
          )
          <fpage>3945</fpage>
          -
          <lpage>3953</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>P. L.</given-names>
            <surname>Whetzel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. H.</given-names>
            <surname>Shah</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. R.</given-names>
            <surname>Alexander</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Nyulas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Tudorache</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Musen</surname>
          </string-name>
          ,
          <article-title>Bioportal: enhanced functionality via new web services from the national center for biomedical ontology to access and use ontologies in software applications</article-title>
          ,
          <source>Nucleic acids research</source>
          <volume>39</volume>
          (
          <year>2011</year>
          )
          <fpage>W541</fpage>
          -
          <lpage>W545</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ashburner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Rosse</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Bug</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Ceusters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. J.</given-names>
            <surname>Goldberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Eilbeck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ireland</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Mungall</surname>
          </string-name>
          , et al.,
          <article-title>The obo foundry: coordinated evolution of ontologies to support biomedical data integration</article-title>
          ,
          <source>Nature biotechnology 25</source>
          (
          <year>2007</year>
          )
          <fpage>1251</fpage>
          -
          <lpage>1255</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>C.</given-names>
            <surname>Draxl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schefler</surname>
          </string-name>
          ,
          <article-title>Nomad: The fair concept for big data-driven materials science</article-title>
          ,
          <source>Mrs Bulletin</source>
          <volume>43</volume>
          (
          <year>2018</year>
          )
          <fpage>676</fpage>
          -
          <lpage>682</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>R. L.</given-names>
            <surname>Plante</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. A.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Medina-Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Brady</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Dima</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Long</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. M.</given-names>
            <surname>Bartolo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Warren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. J.</given-names>
            <surname>Hanisch</surname>
          </string-name>
          ,
          <article-title>Implementing a registry federation for materials science data discovery</article-title>
          ,
          <source>Data science journal 20</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>C.</given-names>
            <surname>Jonquet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bouazzouni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Graybeal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. L.</given-names>
            <surname>Vendetti</surname>
          </string-name>
          ,
          <source>OntoPortal Workshop 2023 Report, Ph.D. thesis</source>
          , INRAE, Université de Montpellier, Stanford University,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>C.</given-names>
            <surname>Draxl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schefler</surname>
          </string-name>
          ,
          <article-title>The nomad laboratory: from data sharing to artificial intelligence</article-title>
          ,
          <source>JPhys materials 2</source>
          (
          <year>2019</year>
          )
          <fpage>36001</fpage>
          -.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>N. I. S.</given-names>
            <surname>Organization</surname>
          </string-name>
          ,
          <article-title>Guidelines for the construction, format, and management of monolingual controlled vocabulary</article-title>
          , ???? doi:10.3789/ansi.niso.
          <year>z39</year>
          .
          <fpage>19</fpage>
          -
          <lpage>2005R2010</lpage>
          , OCLC:
          <fpage>59757037</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>T.</given-names>
            <surname>Baker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Isaac</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Miles</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Schreiber</surname>
          </string-name>
          , E. Summers,
          <article-title>Key choices in the design of simple knowledge organization system (skos)</article-title>
          ,
          <source>Journal of Web Semantics</source>
          <volume>20</volume>
          (
          <year>2013</year>
          )
          <fpage>35</fpage>
          -
          <lpage>49</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>S.</given-names>
            <surname>Rose</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Engel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Cramer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Cowley</surname>
          </string-name>
          ,
          <article-title>Automatic keyword extraction from individual documents, Text mining: applications and theory (</article-title>
          <year>2010</year>
          )
          <fpage>1</fpage>
          -
          <lpage>20</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>R.</given-names>
            <surname>Campos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Mangaravite</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Pasquali</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Jorge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Nunes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Jatowt</surname>
          </string-name>
          ,
          <article-title>Yake! keyword extraction from single documents using multiple local features</article-title>
          ,
          <source>Information Sciences 509</source>
          (
          <year>2020</year>
          )
          <fpage>257</fpage>
          -
          <lpage>289</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>X.</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Greenberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Meschke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Toberer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Hu</surname>
          </string-name>
          ,
          <article-title>An exploratory analysis: extracting materials science knowledge from unstructured scholarly data</article-title>
          ,
          <source>The Electronic Library</source>
          <volume>39</volume>
          (
          <year>2021</year>
          )
          <fpage>469</fpage>
          -
          <lpage>485</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>X.</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <article-title>Scholarly big data: computational approaches to semantic labeling in materials science</article-title>
          ,
          <source>in: IEEEACM Joint Conference on Digital Libraries JCDL</source>
          ,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>K.</given-names>
            <surname>Polson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Greenberg</surname>
          </string-name>
          ,
          <string-name>
            <surname>S. McClellan</surname>
          </string-name>
          ,
          <article-title>Aligning Keywords from Long Form Prose to Controlled Vocabulary</article-title>
          ,
          <year>2024</year>
          . URL: https://osf.io/2kub9/, publisher: OSF.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>X.</given-names>
            <surname>Xue</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Huang</surname>
          </string-name>
          ,
          <article-title>Generative adversarial learning for optimizing ontology alignment</article-title>
          ,
          <source>Expert Systems</source>
          <volume>40</volume>
          (
          <year>2023</year>
          )
          <article-title>e12936</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>Y.</given-names>
            <surname>He</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Antonyrajah</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Horrocks</surname>
          </string-name>
          ,
          <article-title>Bertmap: a bert-based ontology alignment system</article-title>
          ,
          <source>in: Proceedings of the AAAI Conference on Artificial Intelligence</source>
          , volume
          <volume>36</volume>
          ,
          <year>2022</year>
          , pp.
          <fpage>5684</fpage>
          -
          <lpage>5691</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>A.</given-names>
            <surname>Lateef Haroon</surname>
          </string-name>
          <string-name>
            <surname>PS</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. N.</given-names>
            <surname>Patil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Bidare Divakarachari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Falkowski-Gilski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Rafeeq</surname>
          </string-name>
          ,
          <article-title>An optimized system for sensor ontology meta-matching using swarm intelligent algorithm</article-title>
          ,
          <source>Internet Technology Letters</source>
          (
          <year>2024</year>
          )
          <article-title>e498</article-title>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>