<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Conceptualizing and Formalizing Requirements for Ontology Engineering</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Svitlana Moiseyenko</string-name>
          <email>svitlana.moiseyenko@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, Zaporizhzhia National University</institution>
          ,
          <addr-line>Zhukovskogo st. 66, Zaporizhzhia</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0001</lpage>
      <abstract>
        <p>This paper presents the PhD project, by the first author, that develops, in frame of the OntoElect methodology, the methods, techniques, and software tools for conceptualizing and formalizing the requirements for engineering an ontology in an arbitrary domain. It takes in the terms extracted from a representative collection of high-quality textual documents written by the experts in the target domain and therefore describing this domain. It produces the representative set of the requirements by the knowledge stakeholders as ontological fragments conceptualized as UML class diagrams and formalized in OWL+SWRL. The paper presents the vision of the solution and the plan towards building it based on the background knowledge and related work in the fields of Conceptual Modeling and Ontology Engineering. It also outlines the plan for experimental evaluation and validation of the solution.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology</kwd>
        <kwd>Feature Conceptualization</kwd>
        <kwd>Semantic Relation Extraction</kwd>
        <kwd>Ontology Concept Identification</kwd>
        <kwd>Ontology Engineering</kwd>
        <kwd>OntoElect</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        This paper presents the Ph.D. project that further develops, in frame of the OntoElect
methodology [
        <xref ref-type="bibr" rid="ref1 ref2">1,2</xref>
        ], the methods, techniques, and software tools for conceptualizing
and formalizing the requirements for developing an ontology in an arbitrary domain.
It takes in the terms extracted from a representative collection of high-quality textual
documents written by the experts in the target domain and therefore describing this
domain. The terms are extracted by the prior phase of OntoElect in a way to ensure
that these terms indicate the significant features corresponding to the prevailing
sentiment of the knowledge stakeholders about this domain. The developed phase of
OntoElect outputs the representative set of the requirements by the knowledge
stakeholders as ontological fragments conceptualized as UML1 class diagrams and
formalized in OWL 22 (and additionally in SWRL3 if there is a need to use rules in the
on
      </p>
    </sec>
    <sec id="sec-2">
      <title>UML 2.0: http://www.omg.org/spec/UML/2.0/About-UML/ OWL 2: https://www.w3.org/TR/owl2-overview/ SWRL: https://www.w3.org/Submission/SWRL/</title>
      <p>tology). OntoElect is the basic methodological and theoretical framework for this
project.</p>
      <p>Conceptualization and Formalization phase builds and refines the high-level
contexts (instances) during ontology development process.</p>
      <p>In general, knowledge stakeholders in a domain, like for example, Tourism or
Finance, are clearly not knowledge engineers. Therefore, it is naive to request that they
provide their requirements using an ontology representation language, like OWL.
Moreover, it is naive to expect that they will readily provide their requirements as it is
not their business. Therefore, OntoElect solicits their requirements indirectly, relying
on the existence of a high-quality and representative collection of documents
describing the domain. The documents come as texts in a natural language. Hence, the input
and any other supplementary data for conceptualization are natural language text
fragments. From the other hand, the output has to come in a formal ontology
representation language in order to enforce single interpretation and be machine
processable. This is why the task of conceptualizing and formalizing requirements for
ontology development is challenging. This challenge includes several complex problems
that will be attacked in this PhD project.</p>
      <p>The reminder of the paper is structured as follows. Section 2 Outlines these
problems and offers a high-level vision of the overall solution. Section 3 looks at the
related work in the fields of Conceptual Modeling and Ontology Engineering to seek
insights, relevant background knowledge, and the bits of already existing technologies
that may help solve the challenge of the project. Section 4 explains how the developed
solutions will be evaluated experimentally. Finally, Section 5 concludes the paper.
2</p>
      <sec id="sec-2-1">
        <title>The Vision of the Solution and the Problems to Solve</title>
        <p>
          There is a problem with meaning interpretation for the different terms and contexts
which appears between people in different communities. For example, a particular
term may have a more specific interpretation by a domain expert which may well
differ from the interpretation by an ontology engineer. Regarding engineering, it can
be called as a lack of specification when different engineers have different ideas about
the particular requirement and its context. Hence, conceptualization and formalization
phase is designed to solve this problem. To overcome this mismatch in
interpretations, the project bases itself on the approach of stepwise elimination of different
aspects that cause mismatches. This approach has been framed out as a part of
OntoElect methodology [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] and is outlined in Fig. 1. However, OntoElect relies on
manual performance of all these steps. The technical objective of this project is to
develop the techniques and software tools to partially automate the process and
substantially lower manual effort.
        </p>
        <p>The outlined sequence of steps takes in the ranked list of the terms describing the
domain. These terms are guaranteed to be significant and saturated by the Feature
Elicitation phase of OntoElect. Therefore, the input is regarded as the list of the
required features. The objective is to transform this list of the required features to
formalized ontological fragments (requirements), carrying the positive and negative
votes of the involved features in their aggregated significance scores. Requirements
are further used in Ontology Evaluation phase to compute the fitness of the ontology.</p>
        <p>Conceptualization and formalization is done by a knowledge engineer, using the
suite of software instruments that will be developed in this project, through: (i)
grouping and categorizing extracted required features; (ii) selecting the significant concepts
from the list of required features and forming the feature taxonomy; (iii) computing
the propagated scores up the concept/property hierarchies; (iv) selecting the most
significant concept features; (v) elaborating natural language definitions for the most
significant concept features and formalizing these as ontological fragments using
UML and OWL; and (vi) documenting requirements.</p>
        <p>
          Feature grouping is merging several features which are lexically different but
carry equivalent semantics. The relevant cases include: plural and singular forms of the
same term, for example “temporal constraints” and “temporal constraint” are the same
terms and have to be merged; the terms that had or had not lost two-letter
combinations due to peculiarities of their representation in PDF documents due to the
differences in Adobe versions, for example “de nition” and “definition” are also the same
terms. The significance scores of the merged terms are summarized. One possible
solution to group features semi-automatically using a proper string similarity measure,
as suggested in [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. The problem could also be attacked by applying an appropriate
clustering algorithm (a.k.a. conceptual clustering [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]) based on computing the
minimal threshold using string similarity (syntactic) measures to evaluate if a feature
belongs to a group.
        </p>
        <p>Analyzing the individuals (see also feature categorization below), for example
taken from a relevant linked open data repository or the individual features available
from the required feature list, may help receive more confidence in the relevance of a
property to a concept.</p>
        <p>Looking at feature groups may reveal important information about their
subsumption or meronymy (and, possibly, other interesting properties). Indeed, the most
abstract feature in a group may be interpreted as the root in the group hierarchy.
Consequently, the features which are extended from the root feature by adding words most
probably subsume to the root. Meronymy hierarchies involve the features which are
either parts of a whole or the wholes for their parts. Putting together all these group
hierarchies will result in a feature taxonomy, which is the output of the Feature
Grouping step.</p>
        <p>
          Building the feature taxonomy for the set of required features is important as both
types of hierarchical relationships among features influence the significance of
features through inheritance. Indeed, if a feature subsumes to another feature then it
inherits some of its properties, so its significance is formed to a particular extent by
these inherited properties. Hence, a parent in a hierarchy may expect that it is
rewarded by its children through the propagation of their significance scores. OntoElect
suggests [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] that score propagation adds one fifth of the children’ scores to their
parent’s score. An example of computing propagated scores is pictured in Fig. 2.
        </p>
        <p>A step which is somewhat orthogonal to grouping, as it looks into the semantic
nature of a feature is categorization. Feature categorization stands for deciding if a
feature, due to its semantics, represents a concept, a property, or an individual. Property
features are further grouped in relevant ontological fragments to represent formalized
requirements. Individual features – by being the instances of a concept or a property
– form the corpus of evidence pointing that the concept possesses the property at the
schema level. Concept features are further used to form subsumption or meronymy
hierarchies in the concept taxonomy and form the “anchors” for ontological
fragments.</p>
        <p>The most significant concept features (due to their scores in the feature taxonomy),
having the potential for high impact on the requirements, may be selected. For that,
concept features are viewed in a ranked list and the group of features covering the
desired proportion of importance is promoted.</p>
        <p>The promoted concept features are used to form the concept taxonomy and be the
central concepts for the formalized requirements. Each of these promoted concept
features is, at the end of the workflow, conceptualized in a formalized ontological
fragment – as a conceptual model (in UML) and a piece of code in an ontology
specification language (in OWL+SWRL). Conceptualization means that all the relevant
property features and features representing individuals are consolidated in the
ontological fragment in a harmonized way to form a coherent piece of a required
descriptive theory for the domain.</p>
        <p>
          Conceptualizing a concept feature starts with elaborating its natural language
definition based on the high-impact documents describing the domain. These
documents may be acquired from the document collection from which the required
features have been extracted. To ensure the relevance and high impact of these sources, a
snowball sampling in citation networks approach (e.g. [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]) may be tried. The task of a
knowledge engineer, supported by a software tool, at this step is to ensure that all the
required property features are taken into this definition and do not contradict
each other.
        </p>
        <p>Based on the natural language definition, a conceptual model is developed for a
concept feature, including also its properties and relationships to the other relevant
concept features.</p>
        <p>
          Currently, OntoElect does not recommend any instrumental software tool to help
transform the definition of a concept written using a natural (e.g. English) language to
a UML model. Current working practice suggests that it is a two-step process. The
first step is elaborating the model manually, using the ArgoUML editor4. Protégé
ontology editor5 is further used at the second step for manual coding the ontology in
OWL 2 with an account for DL restrictions [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. The transformation patterns from
UML to OWL follow the recommendations by Schreiber6. There are several possible
ways to partially automate this process and hence lower the effort for these
operations.
        </p>
        <p>
          One potentially interesting idea is inspired by the works in automatic program
generation. The instructions in a programming language are generated from natural
language sentences using different techniques. One of the promising approaches is to
employ machine learning approach. To do so, it is required that a set of typical
sentences and resulting code instructions is provided to train the model. When done, the
trained model is applied to incoming sentences and outputs code instructions. A
similar approach may be used for descriptive sentences from one side and UML model
outputs from the other side – please see an example in Fig. 3. An appropriate starting
point for the training set could be the library of ontology design patterns [
          <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
          ].
An alternative way to transform a text to a UML model is to use NLP technology
stack. For example, Stanford Core NLP 7 allows analyzing a text by applying
linguis4 ArgoUML is an open source UML modeling tool: http://argouml.tigris.org/
5 Protégé Ontology Editor: https://protege.stanford.edu/
6 OWL Restrictions: http://www.cs.vu.nl/~guus/public/owl-restrictions/
7 Stanford CoreNLP: https://stanfordnlp.github.io/CoreNLP/
tic and syntactic analysis tools. It facilitates extracting dependency structures from
phrases or sentences, determining the part of speech of the words, indicating which
noun phrases refer/relate to what, etc.
        </p>
        <p>The transformation of a UML model of an ontological fragment to OWL + SWRL
could also be automated. The approach could be using a rule-based technique, or a
machine-learning approach described above.</p>
        <p>OntoElect is more specific in recommending a way for documenting the ontology
under development. It suggests that the ontology is documented in a set of Semantic
MediaWiki8 pages. Some of those pages provide the overviews of the ontology
modules, but the rest, which are the majority, are dedicated to documenting the concepts –
one page per concept. A documentation wiki page of a particular concept contains:
the natural language definition of the concept; the UML class diagram of the
concept’s conceptual model; the description of the properties grouped according to the
property types: datatype and object properties. This sort of documentation, for
requirements, would be straightforwardly generated based on the results of
conceptualization and formalization.
3</p>
      </sec>
      <sec id="sec-2-2">
        <title>Some Insightful Related Work</title>
        <p>Ontology engineering is a broad field which a substantially big research community
devoting their effort to push forward the State-of-the-Art. Therefore, it is not tractable
to overview all the achievements in ontology engineering. In this paper we focus, in
our review of the related work, only on those results that gave us insights in
developing our vision and circumscribing the problems to be solved, as presented in Section
2. Therefore, our concise related work review is grouped below along the problems
that need to be solved.</p>
        <sec id="sec-2-2-1">
          <title>Feature Grouping and Taxonomy Generation. Feature grouping has been stud</title>
          <p>
            ied in the Knowledge Acquisition and Information retrieval fields. There were plenty
approaches developed by applying syntactic, semantic, and linguistics analysis (e.g.
Jaccard, Jaro, Euclidean algorithms) be revealing the degree of the measure similarity.
Using clustering algorithms like K-means, Agglomerative Hierarchical, or EM and
methods such as pattern-based extraction, conceptual clustering, concept learning,
ontology learning from instances [
            <xref ref-type="bibr" rid="ref9">9</xref>
            ], Aussenac-Gilles method [
            <xref ref-type="bibr" rid="ref10">10</xref>
            ]) significantly
enhanced the process of assigning terms into groups for discovering concepts or
constructing hierarchy.
          </p>
          <p>Feature Categorization. A lot of existing approaches are based on the predefined
tokenization or part-of-speech tagging (POS) patterns for identifying relatedness
which developed by NLP techniques. The most well-known comprehensive toolkits
for natural language processing are General Architecture for Text Engineering
(GATE), Natural Language Toolkit (NLTK), and Stanford Core NLP.
Conceptualization. Several methodologies contributed the techniques for
conceptualization in ontology engineering. The Klagenfurt Conceptual Pre-Design Model</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>8 Semantic MediaWiki: http://semantic-mediawiki.org/</title>
      <p>
        (KCPM) an intermediate phase between requirements analysis and conceptual design.
The proposed approach was targeted on harmonization the developer’s and user’s
view. The relevant part of this work for the presented project is in particular in the
modeling notions: thing and connection types, a perspective view and constraint [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
METHONTOLOGY is an ontology engineering methodology that enables
constructing ontologies at the knowledge level. This methodology includes the identification of
the ontology development process, a life cycle based on evolving prototypes, and
techniques to carry out each activity in the management, development-oriented, and
support activities [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Special attention is paid to the ontology construction. The
methodology also provides a detailed description of how to organize and structure the
conceptual models in order to build taxonomies. OntoElect [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] offers a
methodological framework for all the necessary steps for the presented work. It also outlines the
approaches and points to some techniques relevant to develop the software solutions
for the required tools, in particular for knowledge extraction, grouping and
categorization, building concepts and taxonomies. The work on ontology design patterns, such
as Logical and Content Ontology Design Patterns aimed at solving design problems
for domain concepts and properties [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], is also relevant for the part of building
ontological fragments in our project.
      </p>
      <sec id="sec-3-1">
        <title>Significance Scores Propagation and Aggregation. The topic about the compu</title>
        <p>ting significance scores is very specific in the ontology development process. Hence,
to the best of our knowledge, there is no published work that uses feature significance
scores for requirements (or ontology) conceptualization.</p>
      </sec>
      <sec id="sec-3-2">
        <title>Assembling the Natural Language Definition for a Concept Feature. Lexico</title>
        <p>
          Syntactic ontology design pattern (OPs) was developed based on the linguistic
structures or schemas in order to extract some conclusions about the meaning of the words
they express [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ].
        </p>
        <p>
          Text to UML model Transformation. Several publications deal with the
transformation of text to UML. Most of them use XML serializations and XSLT [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ], [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
Cranefield and Purvis investigated the use of UML class diagrams in order to
represent ontologies and UML object diagrams for representing the knowledge instances
[
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. An interesting approach based on using machine learning techniques was
presented in [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] to transform natural text sentences to programming language
instructions. It would be a good point to use a similar technique in transforming stakeholder
requirements to the formalized UML models.
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>UML model to OWL+SWRL Code Transformation. Transformation, Reengi</title>
        <p>
          neering, Schema reengineering, and Transformation of Logical Patterns techniques
were developed for relevant transformations, for example a non-OWL DL or informal
concept models to OWL DL ontology fragments. The conceptualization activity in
METHONTOLOGY provide a full-stack guide for converting informally presented
concepts and relations into semi-formal specifications. Several tools have also been
developed for the purpose of this or similar transformation, such as LEXTER [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ],
Géditerm [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], TERMINAE [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ].
        </p>
        <p>Ontology engineering methods9 were developed not only for the creating
ontology from scratch but also to be able to reuse the already existed ontologies. Here are
several purposes that they are used for: (i) building ontology from scratch, (ii)
upgrading an existing ontology, (iii) acquiring knowledge for particular tasks, (iv) solving
particular problems during ontology development process. The most well-known
ontology engineering methods are alignment, merging, evaluating (e.g., Cyc, Uschold
and King’s, re-engineering (METHONTOLOGY), etc.) which allow ontology
engineers to build and edit ontologies using the combination of frames, description logic,
first logic order and other different approaches.</p>
      </sec>
      <sec id="sec-3-4">
        <title>Generating Semantic Media Wiki Pages for Documentation. Wiki-based pro</title>
        <p>
          cess editor was developed to enable the ontology documenting process. This approach
is based on combining graphical process modeling techniques, wiki-based
lightweight knowledge capturing approach, and a background semantic knowledge
base [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
4
        </p>
        <sec id="sec-3-4-1">
          <title>Planned Evaluation</title>
          <p>The envisioned approach, together with the instrumental software tools, for
conceptualizing and formalizing requirements in ontology engineering needs to be
experimentally evaluated and validated. A straightforward way to evaluate the (correctness) of
the solution is to compare its results to a Golden Standard. Consequently, a way to
validate the solution is to offer it to knowledge engineers for a trial. Further, their
impression of the usability and performance of the solution is compared to their
normal mode of work – without the solution.</p>
          <p>As a Golden Standard for evaluation, it is planned to use the available working
repository of the Syndicated Ontology of Time (SOT). SOT is developed using
OntoElect as the ontology engineering methodology. Therefore, this repository contains all
the types of intermediate and final results for the key concepts of the currently
developed ontology for the Time Representation and Reasoning domain. The repository
belongs to our group and therefore is fully available as background knowledge. In
evaluation, it is planned to compare the outputs of the developed tools to the same
outputs developed by human knowledge engineers.</p>
          <p>
            In validation experiments, the knowledge engineers who developed SOT manually
will do the same development for the selected key concept features [
            <xref ref-type="bibr" rid="ref2">2</xref>
            ] using the
developed instrumental tool suite. Their effort spent in this activity and their subjective
assessments of the usability and usefulness of the tools will be collected by offering a
questionnaire.
          </p>
          <p>
            After the evaluation and validation of the solution in the SOT use case, another use
case in a different domain will be elaborated. One of the potential candidate domains
is Knowledge Management. An industrial use case for this domain is framed out
9 This description has been deliberately kept concise because of the page limit.
Definitely, more relevant ontology engineering methods exist, including ontology
learning, and will be reviewed in the planned survey paper.
based on the full text document collection of 15 journals provided by Springer Nature.
For a part of this domain the work on extracting features is in progress [
            <xref ref-type="bibr" rid="ref21">21</xref>
            ].
5
          </p>
        </sec>
        <sec id="sec-3-4-2">
          <title>Some Conclusions</title>
          <p>The PhD project presented in this paper is in its initial phase. So, the only preliminary
result is the vision of the solution that will help achieve the goal of the project: help
domain knowledge stakeholders and knowledge engineers be coherent in interpreting
the requirements for representing knowledge to describe the domain formally, in an
ontology.</p>
          <p>While elaborating our vision of the research problem and possible solution to it, we
also presented a workflow that will help solve the challenge in several interrelated
steps. These steps are, in their turn, the problems that require solutions. These
solutions are planned to be sought in the project.</p>
          <p>Our initial plan for evaluating and validating the solution is also presented in the
paper. We hope that the outcome of the project will be beneficial for the Ontology
Engineering community at broad and also for the experts who carry their knowledge
about various domains of interest.</p>
        </sec>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Tatarintseva</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ermolayev</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          , Keller,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Matzke</surname>
          </string-name>
          , W.-E.:
          <article-title>Quantifying ontology fitness in OntoElect using saturation- and vote-based metrics</article-title>
          . In: Ermolayev,
          <string-name>
            <surname>V.</surname>
          </string-name>
          , et al. (eds.)
          <source>Revised Selected Papers of ICTERI</source>
          <year>2013</year>
          ,
          <article-title>CCIS</article-title>
          , vol.
          <volume>412</volume>
          , pp.
          <fpage>136</fpage>
          -
          <lpage>162</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Ermolayev</surname>
          </string-name>
          , V.:
          <article-title>OntoElecting requirements for domain ontologies: the case of time domain</article-title>
          .
          <source>EMISA Int J of Conceptual Modeling</source>
          ,
          <volume>13</volume>
          (Sp.I.),
          <fpage>86</fpage>
          -
          <lpage>109</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Chugunenko</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kosa</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Popov</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chaves-Fraga</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ermolayev</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Refining terminological saturation using string similarity measures</article-title>
          . In: Ermolayev,
          <string-name>
            <surname>V.</surname>
          </string-name>
          et al.
          <source>(eds.) Proc. ICTERI</source>
          <year>2018</year>
          ,
          <article-title>CEUR-WS, online (</article-title>
          <year>2018</year>
          )
          <article-title>- to appear</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Michalsky</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,:
          <article-title>Knowledge acquisition through conceptual clustering: a theoretical framework and algorithm for partitioning data into conjunctive concepts</article-title>
          .
          <source>International Journal of Policy Analysis and Information Systems</source>
          <volume>4</volume>
          (
          <issue>3</issue>
          ),
          <fpage>219</fpage>
          -
          <lpage>243</lpage>
          (
          <year>1980</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Dobrovolskyi</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Keberle</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Todoriko</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Probabilistic topic modelling for controlled snowball sampling in citation network collection</article-title>
          . In: Różewski P.,
          <string-name>
            <surname>Lange</surname>
            ,
            <given-names>C. (eds.) KESW</given-names>
          </string-name>
          <year>2017</year>
          .
          <article-title>CCIS</article-title>
          , vol.
          <volume>786</volume>
          . Springer, Cham (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Motik</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>P. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parisa</surname>
            ,
            <given-names>B</given-names>
          </string-name>
          . (eds.):
          <article-title>OWL 2 Web ontology language. Structural specification and functional-style syntax</article-title>
          .
          <source>2nd edn. W3C recommendation</source>
          ,
          <source>W3C</source>
          (
          <year>2012</year>
          ) http://www.w3.org/TR/2012/REC-owl2
          <string-name>
            <surname>-</surname>
          </string-name>
          syntax-20121211/
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Gangemi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Presutti</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Ontology design patterns</article-title>
          . In: Staab,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Studer</surname>
          </string-name>
          ,
          <string-name>
            <surname>R</surname>
          </string-name>
          . (eds.) Handbook on Ontologies.
          <source>International Handbooks on Information Systems</source>
          . Springer, Berlin, Heidelberg (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Poveda-Villalón</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Suárez-Figueroa</surname>
            ,
            <given-names>M.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gómez-Pérez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Validating ontologies with OOPS!</article-title>
          . In: ten Teije,
          <string-name>
            <surname>A.</surname>
          </string-name>
          et al.
          <source>(eds.) Proc. EKAW</source>
          <year>2012</year>
          .
          <article-title>LNCS</article-title>
          , vol.
          <volume>7603</volume>
          . Springer, Berlin, Heidelberg (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Morik</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kietz</surname>
            ,
            <given-names>J.U.</given-names>
          </string-name>
          :
          <article-title>A bootstrapping approach to conceptual clustering</article-title>
          . In: Segre,
          <string-name>
            <surname>A.M.</surname>
          </string-name>
          (ed.)
          <source>Proceedings of the Sixth International Workshop on Machine Learning</source>
          , Ithaca, New York. Morgan Kaufmann Publishers, San Francisco, California, pp.
          <fpage>503</fpage>
          -
          <lpage>504</lpage>
          (
          <year>1989</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Kietz</surname>
            ,
            <given-names>J.U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maedche</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Volz</surname>
          </string-name>
          , R.:
          <article-title>A method for semi-automatic ontology acquisition from a corporate intranet</article-title>
          . In:
          <string-name>
            <surname>Aussenac-Gilles</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Biébow</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Szulman</surname>
          </string-name>
          , S. (eds.)
          <source>EKAW'00 Workshop on Ontologies and Texts. Juan-Les-Pins, France. CEUR Workshop Proceedings 51:4</source>
          .
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          .
          <fpage>14</fpage>
          . Amsterdam, The Netherlands (
          <year>2000</year>
          ) http://CEUR-WS.org/Vol51/
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Kop</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mayr</surname>
            ,
            <given-names>H.C.</given-names>
          </string-name>
          :
          <article-title>Conceptual predesign bridging the gap between requirements and conceptual design</article-title>
          .
          <source>In: Proceedings of IEEE International Symposium on Requirements Engineering: RE '98</source>
          , pp.
          <fpage>90</fpage>
          -
          <lpage>98</lpage>
          . IEEE Comput.
          <source>Soc</source>
          (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Gómez-Pérez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fernández-López</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Corcho</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Ontological engineering</article-title>
          . 1st ed., Springer-Verlag, London (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Cranefield</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Networked knowledge representation and exchange using UML and RDF</article-title>
          .
          <source>Journal of Digital information 1</source>
          (
          <issue>8</issue>
          ), (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14. Djuri ́c, D.:
          <article-title>MDA-based ontology infrastructure</article-title>
          .
          <source>Computer Science and Information Systems</source>
          <volume>1</volume>
          (
          <issue>1</issue>
          ),
          <fpage>91</fpage>
          -
          <lpage>116</lpage>
          (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Cranefield</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Purvis</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>UML as an ontology modeling language</article-title>
          .
          <source>In: Proc. of the Workshop on Intelligent Information Integration, 16th Int. Joint Conference on AI (IJCAI-99)</source>
          , Stockholm (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Stehnii</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hryniv</surname>
          </string-name>
          , R.:
          <article-title>Generation of code from text description with syntactic parsing and Tree2Tree model</article-title>
          .
          <source>Master thesis</source>
          , Ukrainian Catholic University (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Bourigault</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>González</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gros</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>LEXTER, a natural language tool for terminology extraction</article-title>
          . In: Gellerstam,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Järborg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Malmgren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.G.</given-names>
            ,
            <surname>Norén</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            ,
            <surname>Rogström</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Papmehl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            R. (eds.) 7th EURALEX International Congress,
            <surname>Part</surname>
          </string-name>
          <string-name>
            <surname>II</surname>
          </string-name>
          , pp.
          <fpage>771</fpage>
          -
          <lpage>779</lpage>
          . Goteborg,
          <string-name>
            <surname>Sweden</surname>
          </string-name>
          (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Aussenac-Gilles</surname>
          </string-name>
          , N.: Gediterm, un logiciel de gestion de bases de connaissances terminologiques.
          <source>Terminologies Nouvelles</source>
          <volume>19</volume>
          :
          <fpage>111</fpage>
          -
          <lpage>123</lpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Aussenac-Gilles</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Biébow</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Szulman</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Modelling the travelling domain from a NLP description with TERMINAE</article-title>
          . In: Angele,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Sure</surname>
          </string-name>
          ,
          <string-name>
            <surname>Y</surname>
          </string-name>
          . (eds.)
          <source>EKAW'02 Workshop on Evaluation of Ontology-based Tools (EON2002)</source>
          , Sigüenza, Spain.
          <source>CEUR Workshop Proceedings</source>
          <volume>62</volume>
          :
          <fpage>112</fpage>
          -
          <lpage>128</lpage>
          . Amsterdam, The Netherlands (
          <year>2002</year>
          ) http://CEUR-WS.org/Vol-
          <volume>62</volume>
          /
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Dengler</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vrandečič</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Simperl</surname>
          </string-name>
          , E.:
          <article-title>Comparison of wiki-based process modeling systems</article-title>
          .
          <source>In: Proceedings of the 11th International Conference on Knowledge Management and Knowledge Technologies. i-KNOW'11</source>
          , pp.
          <volume>30</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>30</lpage>
          :
          <fpage>4</fpage>
          . ACM, New York, NY, USA (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Kosa</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          , Chaves-fraga, D.,
          <string-name>
            <surname>Naumenko</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yuschenko</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Badenes-Olmedo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ermolayev</surname>
            ,
            <given-names>V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Birukou</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Cross-evaluation of auomated term extraction tools by measuring terminological saturation</article-title>
          . In: Bassiliades,
          <string-name>
            <surname>N.</surname>
          </string-name>
          , et al. (eds.)
          <source>ICTERI</source>
          <year>2017</year>
          ,
          <article-title>Revised Selected Papers,</article-title>
          .
          <source>CCIS</source>
          , vol.
          <volume>826</volume>
          , pp.
          <fpage>135</fpage>
          -
          <lpage>163</lpage>
          , Springer, Cham (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>