<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Conference platform metadata and functions: existing platforms analysis and ontology-based approach</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Yevhenii B. Shapovalov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Viktor B. Shapovalov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>National Center “Junior Academy of Science of Ukraine”</institution>
          ,
          <addr-line>38-44 Dehtiarivska Str., Kyiv, 04119</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Ukrainian Scientific Center for the Development of Information Technologies</institution>
          ,
          <addr-line>180 Antonovycha Str., Kyiv, 03150</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <fpage>177</fpage>
      <lpage>192</lpage>
      <abstract>
        <p>The academic landscape is currently marred by the rise of predatory conferences, which are more concerned with profits than with promoting genuine scholarly discourse. These events often lack the stringent peer review processes necessary to ensure the dissemination of high-quality research. To address this issue, the academic community urgently requires robust conference management platforms capable of discerning and filtering out such dubious gatherings. These platforms should be designed not only to facilitate the search and participation in conferences but also to rigorously evaluate and ensure the quality of the conferences listed. Incorporating insights from various studies, it becomes evident that an ideal platform would merge the functionalities of advanced peer review, decision-making tools based on ethical considerations, and concrete quality metrics. By implementing these features, conference management platforms can become the bulwark against the dilution of research integrity and play a pivotal role in nurturing the value of scientific conferences. The literature underscores a shift towards focusing on the core issue of quality in conferences, suggesting that a multifaceted platform could successfully address both the problems of questionable conference quality and predatory nature.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;predatory conferences</kwd>
        <kwd>conference platforms</kwd>
        <kwd>ontology</kwd>
        <kwd>metadata</kwd>
        <kwd>automation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The collective literature points to the growing concern of predatory conferences, which are
characterized by their profit-driven motives and lack of rigorous peer review, leading to the
dissemination of low-quality research. The term “questionable conference”, as suggested by
McCrostie [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], aligns with a more precise identification of these events based on specific red
lfags. This nomenclature shift directs the focus towards the quality problem rather than merely
labeling the conferences as predatory.
      </p>
      <p>
        Chartier’s work underlines the rise of such conferences, hinting at the critical need for reliable
platforms that ensure trusted selection and peer review processes [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Pecorari introduces a
tool designed to assist researchers in making informed decisions about conference participation,
thereby equipping them with the means to discern quality. This suggests that platforms could
integrate such tools to facilitate ethical decision-making for prospective attendees [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Ibrahim’s discussion on the adverse efects of predatory practices on scientific literature
further substantiates the necessity for heightened awareness and educational resources within
conference platforms to combat these issues [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        Stevic’s hybrid model provides a framework for evaluating conference quality through
measurable aspects. By embedding such a model into conference platforms, it could systematically
assess and ensure the quality of conferences listed or hosted on the platform [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        Martins’ proposition of new quality metrics tailored for conferences could be utilized by
platforms to standardize quality assessment, moving beyond subjective perceptions to more
concrete and comparative measures [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        Laplante’s emphasis on the importance of paper quality for the reputation of conferences
suggests that platforms could enforce strict peer review guidelines and quality checks for paper
submissions [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        Berndtsson et al. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], Hagemann-Wilholt et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], Bentlage et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], Iana et al. [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] explore
various aspects of conference systems and platforms, from subjective quality assessment to
the practicalities of online conference management and the development of recommendation
systems. Integrating these insights could lead to the creation of multifaceted platforms that not
only focus on quality control but also enhance the overall user experience through pervasive
computing, metadata curation, and personalized recommendations.
      </p>
      <p>By converging these diverse perspectives, the argument shifts from evaluating the quality
of conferences to addressing the core issue of quality itself. This approach underscores the
potential of conference platforms to serve as a solution to the problems of quality and the
predatory nature of some conferences. Such platforms could incorporate advanced peer review
processes, ethical decision-making tools, quality metrics, and pervasive computing to ensure
the integrity and value of scientific conferences.</p>
      <p>
        Currently, Ukrainian Research Information System (URIS) is being developing [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and the
system that will ensure accounting of the scientific data is developing as sub-system of it
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Therefore, to ensure consideration of existing experience during development of national
platform of conferences, this study aims to analyze metadata and functions of existing conference
platforms.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Methods</title>
      <sec id="sec-2-1">
        <title>2.1. Data collection</title>
        <p>We analyzed the 6 most well-known conference platforms. The platforms that being
analyses included two groups of software: informational-oriented and process-oriented. The
ifrst group principle is just to provide information and structure. This group included
ConfiDent (https://www.confident-conference.org/index.php/Main_Page), Conference Index (https:
//conferenceindex.org/), OpenResearch (https://www.openresearch.org/wiki/Main_Page) and
WikiCFP (http://www.wikicfp.com/cfp/). In other hand, process-oriented systems provide whole
cycle of processes that are being required to providing conferences. It could include processes
of submission, reviewing and publishing. As examples we took Morressier and EasyChair.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Data processing</title>
        <p>We provided data aggregation using Pivot tables in MS Excel. To ensure correct structural data
representation based on the type of data that we collected, we added colonum that describes
the type of characteristics of data that we collected. This colonum included Presence of event
class, Basic metadata of conferences, User fields, Identifiers, Functionality, Planned functionality,
Organizational data, and Additional data. It is worth noting that we analyze web pages and
scholar papers, but it ensures that we obtained full information about the systems due to some
ifelds of functions may be not described or shown through the privacy settings. We have
legginged in all systems where it was possible to avoid to, but there is still a possibility of it.
That’s why we each function or field in our analysis could be in the state “no data” for cases
when we did not find the relative function /field or “yes” for cases when this field or fucntion
was available. Those classes were used as filters in Pivot table and graphs were built for each
such class separately.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Results</title>
      <sec id="sec-3-1">
        <title>3.1. Description ot the conference platform</title>
        <sec id="sec-3-1-1">
          <title>3.1.1. Description of the informational-oriented systems</title>
          <p>
            ConfIDent [
            <xref ref-type="bibr" rid="ref9">9</xref>
            ], Conference Index, OpenResearch [
            <xref ref-type="bibr" rid="ref9">9</xref>
            ], and WikiCFP [
            <xref ref-type="bibr" rid="ref11">11</xref>
            ] are four distinct
platforms, each with its unique focus on academic and scientific events, albeit with some overlap in
their oferings.
          </p>
          <p>ConfIDent is a platform that aims to ensure the persistent accessibility of scientific events
such as conferences in high quality. It appears to focus on the longevity and quality of the
information regarding scientific meetings, ensuring that records of these events are maintained
over time 1.</p>
          <p>Conference Index categorizes and indexes conferences globally. It organizes information by
category (such as engineering, physics, health science), by tag (like education, environment,
medicine), and by country, highlighting the international span of its listings. The platform
emphasizes its role in reaching potential participants through its indexing services 2.</p>
          <p>OpenResearch seeks to make descriptive metadata on conferences and other scientific events
permanently accessible, with high quality through automated processes and scientific data
curation. It serves a broad audience including researchers, universities, specialized societies,
and funding agencies. The platform provides information on thousands of events and event
series, and allows browsing by fields of science, type of content, and region, thus facilitating a
targeted search for scientific events and resources.</p>
          <p>WikiCFP is a semantic wiki dedicated to Calls for Papers (CFPs) in the fields of science and
technology. It hosts over 100,000 CFPs and is utilized by a large number of researchers monthly.
The platform is essentially a repository and dissemination point for upcoming calls related to
conferences, workshops, and journals, focusing on the early stages of conference participation
and paper submission. This table provides a high-level overview of the platforms’ purposes
and services, although it does not capture all requested parameters due to limited information
availability. For specific details such as the number of visitors or more precise ownership and
location data, further in-depth research or direct inquiry with the platforms may be necessary.</p>
          <p>A general description of those systems is presented in table 1.</p>
        </sec>
        <sec id="sec-3-1-2">
          <title>3.1.2. Description of the process-oriented systems</title>
          <p>Morressier and EasyChair are both platforms that cater to the needs of the academic and research
communities, albeit with diferent approaches and services.</p>
          <p>Morressier is designed to support the pre-publishing journey of scholarly communications.
It provides an array of services that support the early stages of research dissemination, from
managing hybrid and virtual conferences to facilitating journal submissions, peer-review
worklfows, and implementing AI-powered integrity checks. The platform’s vision is to enhance
eficiency and trust in the scientific communication process using technology.</p>
          <p>EasyChair ofers a comprehensive conference management system that supports the
organization of scientific conferences, both virtually and in-person. It encompasses a virtual
conference solution to facilitate scientific conferences of any size, a conference management
system for handling everything from program committees to publishing proceedings, and
a registration system that allows for the creation of complex registration forms and online
payment processing in multiple currencies. EasyChair also includes ‘Smart Slides’, a feature
that enables the publication and distribution of presentation slides, and ‘Smart CFP’, a tool
for publishing conference calls for submissions. In addition, their publishing services ofer a
seamless submission-to-publication process for reviewed content in various scientific areas.</p>
          <p>These platforms highlight the diverse technological tools available to modern researchers
and conference organizers, aiming to streamline the scientific communication lifecycle from
initial call for papers to post-conference publication and dissemination. A general description
of those systems is presented in table 2.</p>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. Frequency of fields usage</title>
        <p>Fields such as ‘Title’, ‘Type’, ‘Country’, ‘City’ used in four systems, indicate that users often
delineate conferences based on these categorical distinctions. These could serve as primary
iflters when searching for events relevant to an individual’s location preference or subject
matter.</p>
        <p>The fields that are used in 3 systems are ‘Venue’, ‘The term of notification of assignment’,
‘The start date’, ‘The oficial website of the conference’, ‘Serial number (series of events)’,
‘Organizers’, ‘Final submission’, ‘Direction’, ‘Date of completion’, ‘Acronym’, and ‘A series of
events’ — reflect a middle tier of frequency in usage. Those fields underscore general aspects
of conferences including the logistical aspects of conferences, including information on event
timelines, locations, and organizational details, which are critical for planning and attendance.
The inclusion of ’Final submission’ indicates a focus on the deadlines for academic contributions,
while ’Direction’ may refer to the thematic or disciplinary orientation of the conference.</p>
        <p>Fields like ‘Region’, ‘Reference to registration’, ‘Mode (form of conduct)’, ‘Hashtags’, ‘Address’,
and ‘Academic sphere’ with a using in two systems are used less frequently but suggest a nuanced
approach to categorizing and promoting conferences. ‘Mode (form of conduct)’ could indicate
whether the conference is virtual or in-person, an increasingly relevant distinction in the
post-pandemic landscape.</p>
        <p>Finally, ‘Website’, ‘URL program’, ‘Status’, ‘Reference to external id’, ‘ID’, ‘Doi’, ‘Contact’ is
used least frequently. These may represent specific details that are occasionally sought after or
are relevant only in certain contexts, such as scholarly communication or detailed inquiries.</p>
        <p>The usage frequency of these fields can serve as an indicator of the priorities and behaviors
of conference stakeholders. High-frequency fields are likely to be deemed essential for the
discovery, selection, and participation in academic conferences, while lower-frequency fields
may represent specialized interests or administrative concerns. This data informs platform
developers and conference organizers about which features to emphasize or streamline for
better user engagement and operational eficiency.</p>
        <p>The fields ‘Surname’, ‘Name’, and ‘Web Page’ are used in 5 systems, emerge as the most
commonly used. This suggests a strong emphasis on personal identification and online presence,
To support the entire Supports hybrid and More than
pre-publishing jour- virtual conferences, 200
profesney of scholarly com- journal submis- sional and
munications. sions, peer-review scientific
workflows, and organizations
AI-powered checks. use
Mor</p>
        <p>ressier
To organize research A conference man- 111106
conferpaper submission agement system pro- ences (as of
and review for the vides various services the page’s last
scientific commu- including a virtual update)
nity. conference solution.
which are typically crucial for networking, identification, and accessibility purposes.</p>
        <p>In contrast, fields with usage in only one system reflect a diverse array of individual and
organizational attributes. ‘Type of organization’ could be indicative of the structure or sector
(e.g., non-profit, corporate, academic) an individual is associated with. ‘Profile type (open/closed)’
might relate to the privacy settings of a user’s profile within the organization’s database or
network.</p>
        <p>‘Position until’, ‘Position since’, and ‘Position’ fields are indicative of employment status and
history. These would be key in understanding tenure, career progression, and current roles
within the organization. ‘Phone number’ and ‘Login’ are used for communication or system
entry purposes.</p>
        <p>‘Degree’, ‘Name of the organization’, and ‘Name of position’ provide specific professional and
educational details that are important for delineating qualifications and organizational hierarchy.
‘Annual income of the organization’ is a more specialized field that could be relevant for financial
analysis, funding, or economic status reporting within the organization. Considering that annual
income of the organization is used for this Morressier system, that is paid system, it seems that
this parameter is using to analyze advertising strategies with specific organizations.</p>
        <p>The low frequency of these latter fields could suggest that they are either less frequently
accessed due to their specificity, or they are utilized in more targeted queries where detailed
individual or organizational information is necessary. This distribution indicates a focus on
essential identification and communication data over more detailed personal or organizational
information in common use cases. Such an analysis can guide the design of information systems,
ensuring that frequently used fields are more accessible, while less frequently used data can be
structured in a way that is unobtrusive yet available when needed.</p>
        <p>Conference management platforms serve as pivotal tools in the orchestration of scholarly
meetings, encompassing a wide array of functions tailored to enhance the academic conference
lifecycle as well as only for providing information about specific events. An analysis of common
features across such platforms reveals a hierarchy of functionalities, often reflected by their
implementation frequency or utility prominence.</p>
        <p>The most prevalent function that is implemented in the 4 systems is the search capability.
It allows for an intricate querying of conferences based on a multitude of criteria including
geographic location (country and city), academic discipline, and specific conference titles. This
omnipresent feature underscores the critical importance of discoverability and accessibility in
academic conferencing, suggesting that users place significant value on the ease with which
they can locate relevant events.</p>
        <p>Peer reviewing and conference registration features implemented only in two systems that are
process-oriented systems, indicative of their essential but secondary status in comparison to the
search functionality. Peer reviewing is integral to the academic rigor of conference proceedings,
enabling the evaluation and selection of scholarly works for presentation. Concurrently, the
registration function encapsulates attendee management and may include financial transactions,
emphasizing the operational backbone of the conference experience.</p>
        <p>Similarly valued, the submission function is an essential one in the academic exchange,
facilitating the contribution of research findings to the conference corpus. This is often paralleled
by the feature for viewing the list of events, which is equally important for attendees to navigate
the conference program efectively.</p>
        <p>Publication of materials is in use in two systems, reflecting the necessity for a platform to act
as a repository for conference outputs such as proceedings, abstracts, and papers. This feature
is crucial for the dissemination of knowledge post-conference and for ensuring the academic
contributions are recorded and made accessible.</p>
        <p>Less prevalent, yet still integral to the suite of services ofered by these platforms, is the
capability to manage a series of events, as well as tools to aid in indexing conferences within
recognized scientometric databases like Scopus. These functionalities are used only in one
system and are suggestive of a more specialized but vital role in enhancing the conference’s
reach and academic credibility.</p>
        <p>This tiered analysis of platform functionalities illustrates a direct correlation between the
numerical values and the perceived utility of each feature. The popularity of these functions
suggests a prioritization aligned with the primary needs of conference attendees and organizers,
which includes finding and participating in relevant academic gatherings, ensuring the quality
of content, and the broad dissemination of scholarly work.</p>
        <p>‘Internal ID’ is used in all systems, suggests it is the primary means of identifying records
within the system. This high usage underscores the necessity for a unique identifier within an
organization’s database, enabling eficient management and retrieval of records.</p>
        <p>The ‘Doi’ (Digital Object Identifier) is used in two systems, and it is a widely recognized
identifier for electronic documents, which indicates its significant role in the persistent referencing
of research articles, datasets, and other academic materials.</p>
        <p>‘Wikicfp’ used in two systems, pointing to their roles as important but less central compared
to ‘Internal ID’ and ‘Doi’. ‘Wikicfp’ might refer to a specific database or index for calls for
papers in academic conferences.</p>
        <p>The ‘Wikidata id’, ‘ISBN’, and ‘Dblp’ each used only in one system, denoting their specialized
use cases. ‘Wikidata id’ could be a unique identifier for conference series or events within the
organization. ‘ISBN’ (International Standard Book Number) is a familiar identifier for books
and other standalone publications, indicating its relevance in academic material management.</p>
      </sec>
      <sec id="sec-3-3">
        <title>3.3. Ontologies as a tool to provide flexible data structures for conferences</title>
        <p>
          Ontologies can ensure flexible data structure that gives an opportunity to both, modify it for each
separate conference and modify approach in general when it will be required. CIT Polyhedron
is one of the most promising ontology-generating systems that provides generation ontologies
and visualization of graphs. Modern ontology systems can make an efective decision-making
[
          <xref ref-type="bibr" rid="ref14 ref15">14, 15</xref>
          ]. It can be efectively used in the in the field of science [
          <xref ref-type="bibr" rid="ref16 ref17 ref18">16, 17, 18</xref>
          ]. It could provide
structured view of graph 11 and processing view of table 11. The main advantages of it are the
high speed of providing such a system, the possibility to use exchange fields to fill the ontology
and interoperability between diferent knowledge fields.
        </p>
        <p>An ontology-based approach for organizing conference data could counteract the
proliferation of predatory and low-quality conferences. This is due to it will promote healthy competition
among conference providers by mandating the completion of structured fields. Similar
functionalities might be integrated into various systems, but ontology stands out due to its superior
level of structuring. An ontology-based system leverages the full potential of consolidating
informational resources within the CIT Polyhedron framework. This integration not only
enhances data accessibility and organization but also contributes to the overall robustness and
eficiency of the system.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>Conference management platforms are indispensable in the efective management and
facilitation of academic conferences. These platforms embody a suite of features that cater to
various stages of the conference lifecycle, from initial discovery to post-conference knowledge
dissemination. An in-depth analysis of these functionalities reveals a tiered system of
importance. At the forefront is the sophisticated search capability, deemed most critical for its role in
enabling users to find relevant conferences easily. Subsequent features include peer reviewing
and registration, which are crucial for maintaining academic rigor and managing conference
operations, respectively. Additionally, the submission of research and the publication of
conference materials are fundamental for the scholarly exchange of ideas. Emerging technologies
such as VCS for presentation version control and Smart Slide for enhancing presentations are
gaining importance. At the base of the hierarchy are internal management and referencing
systems, which ensure eficient record management and retrieval. The use of globally recognized
identifiers like DOI, along with subject-specific databases, supports the accurate cataloging
and citation of academic work. The collective use of these features aims to not only meet the
primary needs of conference attendees and organizers but also to extend the conference’s reach
and uphold its academic standing</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>J. McCrostie</surname>
          </string-name>
          ,
          <source>Predatory Conferences: A Case of Academic Cannibalism, International Higher Education</source>
          (
          <year>2018</year>
          )
          <fpage>6</fpage>
          -
          <lpage>8</lpage>
          . doi:
          <volume>10</volume>
          .6017/ihe.0.93.10425.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M.</given-names>
            <surname>Chartier</surname>
          </string-name>
          ,
          <source>The Alarming Rise of Predatory Conferences, Eos</source>
          <volume>103</volume>
          (
          <year>2022</year>
          ). doi:
          <volume>10</volume>
          .1029/ 2022EO220449.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.</given-names>
            <surname>Pecorari</surname>
          </string-name>
          , Predatory Conferences:
          <article-title>What Are the Signs?</article-title>
          ,
          <source>Journal of Academic Ethics</source>
          <volume>19</volume>
          (
          <year>2021</year>
          )
          <fpage>343</fpage>
          -
          <lpage>361</lpage>
          . doi:
          <volume>10</volume>
          .1007/s10805-021-09406-4.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S.</given-names>
            <surname>Ibrahim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Saw</surname>
          </string-name>
          ,
          <source>The Perils of Predatory Journals and Conferences, Malaysian Orthopaedic Journal</source>
          <volume>14</volume>
          (
          <year>2020</year>
          )
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . doi:
          <volume>10</volume>
          .5704/MOJ.
          <year>2007</year>
          .
          <volume>003</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Stevic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            <surname>Dalic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Pamucar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Nunic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Veskovic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Vasiljevic</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Tanackov,</surname>
          </string-name>
          <article-title>A new hybrid model for quality assessment of scientific conferences based on Rough BWM and SERVQUAL</article-title>
          , Scientometrics
          <volume>119</volume>
          (
          <year>2019</year>
          )
          <fpage>1</fpage>
          -
          <lpage>30</lpage>
          . doi:
          <volume>10</volume>
          .1007/s11192-019-03032-z.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>W. S.</given-names>
            <surname>Martins</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Gonçalves</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. H. F.</given-names>
            <surname>Laender</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. L.</given-names>
            <surname>Pappa</surname>
          </string-name>
          ,
          <article-title>Learning to assess the quality of scientific conferences: a case study in computer science</article-title>
          ,
          <year>2009</year>
          , p.
          <fpage>193</fpage>
          -
          <lpage>202</lpage>
          . doi:https://doi.org/10.1145/1555400.1555431.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>P.</given-names>
            <surname>Laplante</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Rockne</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Montuschi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Baldwin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Hinchey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Shafer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Voas</surname>
          </string-name>
          , Quality in conference publishing,
          <source>IEEE Transactions on Professional Communication</source>
          <volume>52</volume>
          (
          <year>2009</year>
          )
          <fpage>183</fpage>
          -
          <lpage>196</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>G.</given-names>
            <surname>Berndtsson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Folkesson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Kulyk</surname>
          </string-name>
          ,
          <article-title>Subjective quality assessment of video conferences and telemeetings</article-title>
          , IEEE,
          <year>2012</year>
          , pp.
          <fpage>25</fpage>
          -
          <lpage>30</lpage>
          . doi:
          <volume>10</volume>
          .1109/PV.
          <year>2012</year>
          .
          <volume>6229740</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>S.</given-names>
            <surname>Hagemann-Wilholt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Hauschke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Plank</surname>
          </string-name>
          ,
          <string-name>
            <surname>Confident -</surname>
          </string-name>
          <article-title>An open platform for FAIR conference metadata</article-title>
          ,
          <source>Grey Journal</source>
          <volume>16</volume>
          (
          <year>2020</year>
          )
          <fpage>95</fpage>
          -
          <lpage>100</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>E.</given-names>
            <surname>Bentlage</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Roekens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Bußmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Brach</surname>
          </string-name>
          ,
          <source>Planning and Conducting an Online Conference at the time of COVID-19 : Lessons Learned from EGREPA</source>
          <year>2021</year>
          ,
          <article-title>BioRxiv (</article-title>
          <year>2021</year>
          )
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          . doi:
          <volume>10</volume>
          .1101/
          <year>2021</year>
          .09.19.460976.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Iana</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Jung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Naeser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Birukou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Hertling</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Paulheim</surname>
          </string-name>
          ,
          <article-title>Building a Conference Recommender System Based on SciGraph and WikiCFP</article-title>
          , in: M.
          <string-name>
            <surname>Acosta</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Cudré-Mauroux</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Maleshkova</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Pellegrini</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          <string-name>
            <surname>Sack</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Sure-Vetter</surname>
          </string-name>
          (Eds.),
          <source>Semantic Systems. The Power of AI and Knowledge Graphs</source>
          , Springer International Publishing, Cham,
          <year>2019</year>
          , pp.
          <fpage>117</fpage>
          -
          <lpage>123</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -33220-
          <issue>4</issue>
          _
          <fpage>9</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>S.</given-names>
            <surname>Zharinov</surname>
          </string-name>
          ,
          <article-title>The role of the library in the digital economy</article-title>
          ,
          <source>Information Technology and Libraries</source>
          <volume>39</volume>
          (
          <year>2020</year>
          ). doi:
          <volume>10</volume>
          .6017/ITAL.V39I4.12457.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>Y. B.</given-names>
            <surname>Shapovalov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. B.</given-names>
            <surname>Shapovalov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. G.</given-names>
            <surname>Zharinova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. S.</given-names>
            <surname>Zharinov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. O.</given-names>
            <surname>Tsybenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. S.</given-names>
            <surname>Krasovskiy</surname>
          </string-name>
          ,
          <article-title>An academic events sub-system of the URIS and its ontology representation to improve scientific usability and motivation of scientists in terms of European integration</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          <volume>3374</volume>
          (
          <year>2023</year>
          )
          <fpage>130</fpage>
          -
          <lpage>140</lpage>
          . URL: https://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>3374</volume>
          / paper10.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>O. Y.</given-names>
            <surname>Stryzhak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Horborukov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Prychodniuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Franchuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chepkov</surname>
          </string-name>
          ,
          <article-title>Decision-making System Based on The Ontology of The Choice Problem</article-title>
          ,
          <source>Journal of Physics: Conference Series</source>
          <year>1828</year>
          (
          <year>2021</year>
          )
          <fpage>012007</fpage>
          -
          <lpage>0</lpage>
          . doi:
          <volume>10</volume>
          .1088/
          <fpage>1742</fpage>
          -
          <lpage>6596</lpage>
          /
          <year>1828</year>
          /1/012007.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>O.</given-names>
            <surname>Stryzhak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Prykhodniuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Popova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Nadutenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Haiko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chepkov</surname>
          </string-name>
          ,
          <article-title>Development of an Oceanographic Databank Based on Ontological Interactive Documents</article-title>
          , in: K. Arai (Ed.),
          <source>Intelligent Computing</source>
          , Springer International Publishing, Cham,
          <year>2021</year>
          , pp.
          <fpage>97</fpage>
          -
          <lpage>114</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -80126-
          <issue>7</issue>
          _
          <fpage>8</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>R. A.</given-names>
            <surname>Tarasenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Usenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y. B.</given-names>
            <surname>Shapovalov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. B.</given-names>
            <surname>Shapovalov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Paschke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. M.</given-names>
            <surname>Savchenko</surname>
          </string-name>
          ,
          <article-title>Ontology-based Learning Environment Model of Scientific Studies</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          <volume>3083</volume>
          (
          <year>2022</year>
          )
          <fpage>43</fpage>
          -
          <lpage>58</lpage>
          . URL: https://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>3083</volume>
          /paper278.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>Y. B.</given-names>
            <surname>Shapovalov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. B.</given-names>
            <surname>Shapovalov</surname>
          </string-name>
          ,
          <source>A Taxonomic Representation of Scientific Studies, CEUR Workshop Proceedings</source>
          <volume>3013</volume>
          (
          <year>2021</year>
          )
          <fpage>353</fpage>
          -
          <lpage>360</lpage>
          . URL: https://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>3013</volume>
          / 20210353.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>L.</given-names>
            <surname>Globa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Novogrudskaya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Zadoienko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. Y.</given-names>
            <surname>Stryzhak</surname>
          </string-name>
          ,
          <article-title>Ontological Model for Scientific Institutions Information Representation</article-title>
          , IEEE,
          <year>2020</year>
          , pp.
          <fpage>255</fpage>
          -
          <lpage>258</lpage>
          . doi:
          <volume>10</volume>
          .1109/ PICST51311.
          <year>2020</year>
          .
          <volume>9467984</volume>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>