<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Machine learning of software agents for classification sociotypes</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Serhii Holub</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oleksandr Mоrushko</string-name>
          <email>oleksandr.o.morushko@lpnu.ua</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nataliia Khymytsia</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Maria Holub</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Marek Aleksander</string-name>
          <email>aleksandermarek4@gmail.com</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Cherkasy State Technological University</institution>
          ,
          <addr-line>460 Shevchenko Boulevard, Cherkasy, 18006</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Lviv Polytechnic National University</institution>
          ,
          <addr-line>12 Stepana Bandera Street, 79013, Lviv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>State Higher Vocational School in Nowy Sacz</institution>
          ,
          <addr-line>z, Staszica st. 1, Nowy Sacz, 33300</addr-line>
          ,
          <country country="PL">Poland</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>For the first time, it was proposed to use the information technology of intellectual monitoring to classify the authors of printed texts by sociotypes. The relevance of the work is determined by the need to automate the processes of describing the properties of the authors of messages, in particular in social networks, in order to develop controlling influences on a group of individuals and individuals. There is a relatively detailed description of the properties of a person belonging to one or another sociotype. This allows for the development of effective management influences. The use of this tool of information warfare aims to protect the information space of Ukraine from hostile actions. Research tasks are formalized as the task of classifying authors of printed texts. Sociotypes were used as classes. Each of the classes contained texts by 3 authors who had already passed the examination and their belonging to one of the sociotypes was established. To build text classifier models, one of the methods of machine learning is used - the method of group consideration of arguments (Group Method of Data Handling). To conduct the experiment, a monitoring software agent was built to perform Text Mining tasks. For each class of messages, a separate dictionary of features was formed and an array of numerical characteristics of texts based on these features was built, which is called the Array of Input Data. The agent was trained on massive input data describing the texts of 2 authors belonging to each class. Testing of agent models was based on the numerical descriptions of the 3rd author of each of the classes. In this way, the testing of models took place on the basis of data that did not participate in the creation of models. As a result of testing, all texts and, accordingly, their authors have been correctly classified. The hypothesis about the possibility of classifying people according to sociotypes through the intellectual analysis of their text messages has been experimentally confirmed.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Intelligent monitoring</kwd>
        <kwd>classification</kwd>
        <kwd>sociotypes</kwd>
        <kwd>software agents</kwd>
        <kwd>machine learning</kwd>
        <kwd>1</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>The main purpose of monitoring software agents is to provide decision-making processes with
information in the relevant subject area. An agent approach to the construction of intellectual
monitoring tools allows to increase the variety of processes of extracting knowledge from the
results of observations of research objects.</p>
      <p>A person is a complex object of research. Obtaining information about the properties of this
object and their change is an urgent task when planning many strategies in modern information
wars. Today, the Ukrainian information space, in particular social networks, is a testing ground
for both attack and manipulation technologies, as well as methods and means of protecting the
self-awareness of Ukrainians. Printed texts are one of the means of conveying governing
influences.</p>
      <p>
        Each person in one way or another has a selective attitude to what surrounds him. She
chooses to use certain texts that meet her requirements. In this sense, a selective assignment of
verbal material is carried out, which a person structures, supplements, and enriches in the
future. Many great writers and poets created their texts from the social mass of language. But
these texts are again appropriated both by their contemporaries and descendants, spiritually
enriching and developing [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>One of the possible methods of studying verbal and non-verbal behavioural reactions is the
use of socionic analysis. This method is based on the so-called Jungian framework. It contains
four pairs of dichotomous traits, namely: extraversion-introversion, logic-ethics,
sensoryintuition, rationality-irrationality. By consistently identifying the dominant dichotomous trait
in each of the four pairs, we can determine the psychological type of personality. Since there is
a considerable amount of scientific research with a detailed description of the features inherent
in a particular psychological type, the information obtained as a result of such typing can be of
practical use, in particular when choosing the optimal use of one's abilities.</p>
      <p>It should be noted that the psychological type of personality is an innate property of each
individual. It does not change throughout a person's life.</p>
      <p>There are 16 different psychological types in total. They will demonstrate completely
different behavioural reactions under stressful conditions. At the same time, individuals with
the same (identical) psychological type will behave in almost the same way under the same
conditions.</p>
      <p>Socionics provides tools for identifying the properties of an individual person, classifying
people according to these properties, and constructing mass self-awareness management
technologies. Knowing the type of person allows you to actualize your abilities, functionally
apply your natural inclinations, and achieve maximum self-realization. On the other hand, an
incorrect definition of a person's sociotype can provoke the emergence of additional complexes.</p>
      <p>In the context of sociology, these types have a lot in common. In particular, each of them
has certain characteristic facial features and similar behavioural reactions, especially in extreme
situations. In addition, since identical socionic types have exactly the same mental model, they
also profess similar values. Therefore, there is a high probability of a reliable determination of
a psychological type by marker words and the general tone of communication.</p>
      <p>It is clear that such a determination will be correct only if we can compare verbal and
nonverbal signals. This is important in order to exclude the possibility of social mimicry, when
someone tries to disguise themselves as another type. In this case, verbal signals will always lag
behind non-verbal signals. If we don't have this option, then when communicating exclusively
verbally (in particular, through social media or audio communication), we should focus on the
speed of communication. The less time a person has to think about their statements or
responses, the more likely they are to work ‘in their own way’.</p>
      <p>Based on this assumption, the following conclusions can be drawn:
•
•
•
the speech characteristics of identical psychological types in communication are similar;
certain characteristic words and methods of communication inherent in each sociotype
can be identified;
computer technologies can be used to reliably recognise a sociotype.</p>
      <p>The latter conclusion is extremely important, since the use of computer technologies to
recognise the psychological profile of the interlocutor can lead to significant competitive
advantages. At the same time, the range of applications for such technologies is extremely wide
- from hiring and managing personnel to modelling various types of negotiations. The main
advantage is that the computer program that will perform the recognition functions has the
ability to constantly improve and expand its capabilities based on the array of data that is
constantly being analysed. The more this programme operates, the more accurate the analysis
results it will provide.</p>
      <p>The initial stage of such a programme may be the selection of texts by several representatives
of the same sociotype for initial synthesis by the programme and the creation of an algorithm
for recognising similar texts. When we have created 16 different text recognition programs
(according to the number of available basic sociotypes), we can start the process of identifying
an unknown text by recognising the sociotype of its author.</p>
      <p>The purpose of this work is to create and test a method of machine learning of software
agent models designed to classify authors of printed texts by sociotypes. The results of the work
will be used to build virtual robots that will automate the processes of monitoring large volumes
of text messages on social networks and simplify the processes of identifying the properties of
their authors.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Processes of classification of authors by sociotypes</title>
      <p>
        Today, it is common to use machine learning models for intellectual analysis of text in order to
solve the problem of attribution - determining their authorship [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The task of text
classification is also referred to in the literature as typing. Solving the problem of correct typing
is very important. Knowing the type of person allows you to actualize your abilities,
functionally apply your natural inclinations and achieve maximum self-realization. On the
other hand, an incorrect definition of a person's sociotype can provoke the emergence of
additional complexes.
      </p>
      <p>
        There are three main socionic methods of determining a person's type: visual, verbal and
testing. They are based on the use of Jung's basis - the definition of the dominant trait in four
dichotomous pairs: extraversion-introversion, logic-ethics, sensory-intuition,
rationalityirrationality. The best results are obtained by the simultaneous use of all these methods [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. But
in practice, such a comprehensive approach is rarely used, so one of these methods has to be
preferred.
      </p>
      <p>The visual definition is based on the features of the physique, depending on the combination
of four dichotomous features. It is not difficult to calculate that the number of different possible
combinations is 16. This number is the number of basic socionic types. Therefore, experts who
carry out typing can also belong to any of these types. Therefore, it is difficult to determine
which visual signs are dominant and which are additional. To a certain extent, this leads to the
subjectivity of the evaluation, since the probability of the determination largely depends on the
level of the expert's qualification.</p>
      <p>Verbal definition consists in the analysis of speech features of the subjects under study. You
should pay attention to the tempo rhythm of speech, its phonetic coloring, information
saturation and emotional coloring. All this, under the condition of live communication, should
be compared with non-verbal reactions, which are also quite informative.</p>
      <p>Testing as a research method can be used only with the prior consent of the subject. In
addition, the reliability of the obtained results when using this method largely depends on the
objectivity and truthfulness of the answers to the test questions. That is why to verify the results
obtained as a result of testing, a further interview is used, during which methods of visual and
verbal analysis are used.</p>
      <p>The main problem that should be solved is the maximum reliability of the classification
results. Therefore, the question arises whether it is possible to use the capabilities of
information technologies for such an analysis, which would significantly reduce the factor of
subjectivity when determining a person's sociotype.</p>
      <p>In our opinion, the most adaptive for computer processing and analysis can be the use of
machine learning models to analyze the features of the text written by the author of the
sociotype, which was previously established by a group of experts. This text should have a
sufficient number of characters (at least 500-1000) so that the software agent can find out the
speech features of each of the 16 basic sociotypes.</p>
      <p>
        Psycholinguistic classification of texts is studied by many authors. In scientific research [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]
the concept of the psychiatrist K. Leonhard, who first investigated the clinical features of
accented personalities and pointed out the nature of the accentuation of characters in artistic
texts, is represented. The novelty of the article is that it for the first time synthesizes the
opinions of scientists regarding the implementation of the accentuation theory, substantiates
the importance of the accentuation approach for the analysis of linguistic factage. On the basis
of the generalized results, the scientists came to a conclusion about the dynamics of the
mentioned problem, as well as determined the possibility of its deepening and implementation
in new interpretive linguistic directions. The authors present a classification of texts based on
the theory of psychoaccentuation proposed by V. Belyanin. This scientist singles out a system
of texts, offers a psycholinguistic classification of them: they are "light", "dark", "funny", "sad",
"beautiful", "complex" texts. In the scientist's metalanguage, metaphorized terms for delineating
text types appeared.
      </p>
      <p>Galustyan O.A., Zakharenko L.M. and Kazmirenko V.O. in their work consider
psycholinguistic text analysis as a method of identification of an unidentified person. Determine
the profile of the author of texts in social Internet networks and propose a general scheme for
compiling the profile of an unknown author of a written text [8].</p>
      <p>According to the classification proposed in the study [9] the corpus is divided into classes
determined by application-specific criteria. The authors demonstrate tutorial examples that
associate data points with labels that indicate they belong to a particular class. Specifically,
training examples extracted from the political news dataset can have one of three labels that
assign them to one of the classes: "senate," "congress," and "legislature." The "With the teacher"
classifier model is trained on these educational examples. At the next stage, the test examples
that remained unmarked are placed into one of these class-categories using a classifier model.</p>
      <p>The history of machine learning methods for classifier models of short texts from social
networks is presented in the paper [10].</p>
      <p>In the study [11] the definition of the psychological type of a person through social networks
with the help of sociological analysis is described. Methods of visual and verbal determination
of a person's sociotype are used. The practical examples considered by the authors clearly
demonstrate that knowing certain features of the body or the style of human speech with a high
probability helps to predict how they can behave in certain situations.</p>
      <p>In the paper [12] proposed to determine the human psyche using four pairs of Jung's
dichotomous signs. For this, the authors suggest using the following methods of analysis: visual,
verbal, and, if possible, testing. An algorithm for using these methods to form teams, assess
their cohesion, and determine the optimal leader is proposed.</p>
      <p>A work describing the process of using machine learning technologies to classify authors of
printed texts by sociotypes could not be found.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Research tasks and hypotheses</title>
      <p>The purpose of the work is formalized as the task of classifying the authors of the texts.
Sociotypes are used as classes.</p>
      <p>16 classes are given, the name of which coincides with the name of sociotypes. Each of the
classes contains the texts of messages from 3 authors, which are expertly assigned to one of the
sociotypes.</p>
      <p>It is necessary to assign the author of the new text to one of the available classes.
To solve the problem, it is necessary to build a dictionary of classification features, according
to which the authors of other texts would be assigned to one of the sociotype classes with an
acceptable level of adequacy.</p>
      <p>Since it is not possible to build a dictionary of classification signs in an explicit form, it was
decided to build a decisive rule.</p>
      <p>The following hypotheses were formulated to fulfil the tasks:</p>
      <p>Classification of persons according to belonging to one of the sociotypes is possible
through intellectual analysis of their text messages.</p>
      <p>The decisive rule should combine the classification features into a single system, the
uniqueness of which is the ability to classify the author of the text.</p>
      <p>To build a decision rule, it is advisable to use one of the Text Mining methods described
in [13]. This method has already been used to solve the task of classifying authors of
texts [14], but other agent tasks were performed. Thus, we are talking about adapting a
known method to perform a new agent task.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Research and discussion of their results</title>
      <p>An experiment was conducted to test the proposed hypotheses. One of the monitoring software
agents, which is an element of the structure of the virtual robot, described in [15]. To build a
decision rule in the form of a model-classifier, the agent synthesizer of models used a multi-line
algorithm of the method of group consideration of arguments Group Method of Data Handling
(GMDH) [16].</p>
      <p>16 classes have been identified for training. Each of the classes contained texts by 3 authors,
regarding which their belonging to a given sociotype was established Table 1.</p>
      <p>Characteristics of classes provides a list of classes for model training.</p>
      <p>Clаss
Logic-Intuitive Extrovert</p>
      <sec id="sec-4-1">
        <title>Sensory-Ethical Extrovert</title>
      </sec>
      <sec id="sec-4-2">
        <title>Intuitively-Logical Introvert</title>
      </sec>
      <sec id="sec-4-3">
        <title>Ethical-Sensory Introvert</title>
      </sec>
      <sec id="sec-4-4">
        <title>Sensory-Logical Extrovert</title>
        <p>logic-Sensory Introvert</p>
      </sec>
      <sec id="sec-4-5">
        <title>EthicalIntuitive Extrovert</title>
      </sec>
      <sec id="sec-4-6">
        <title>Intuitively-Ethical Introvert</title>
      </sec>
      <sec id="sec-4-7">
        <title>Intuitively-Logical Extrovert</title>
      </sec>
      <sec id="sec-4-8">
        <title>Author Jack London Steve Jobs Stephen King</title>
      </sec>
      <sec id="sec-4-9">
        <title>Mykhailo Gorbachev Alexander Pushkin Leo Tolstoy</title>
      </sec>
      <sec id="sec-4-10">
        <title>Mykhailo Zhvanetskyi Niccolo Machiavelli Viktor Saltykov</title>
      </sec>
      <sec id="sec-4-11">
        <title>Volodymyr Vysotskyi Marilyn Monroe Ivan Turgenev</title>
      </sec>
      <sec id="sec-4-12">
        <title>Volodymyr Ulyanov</title>
        <p>Mykhailo Lomonosov
Napoleon Bonaparte</p>
      </sec>
      <sec id="sec-4-13">
        <title>Mykhailo Bulgakov Yosyp Dzhugashvili Vasyl Shukshin</title>
      </sec>
      <sec id="sec-4-14">
        <title>Mykola Gogol Mykhailo Lermontov Faina Ranevska</title>
      </sec>
      <sec id="sec-4-15">
        <title>Ivan Goncharov Sergey Yesenin Mykhailo Kalinin</title>
      </sec>
      <sec id="sec-4-16">
        <title>Karl Marx Yury Nikulin Oleksandr Suvorov</title>
      </sec>
      <sec id="sec-4-17">
        <title>Sensory-Ethical Introvert Evgeny Leonov 29 30</title>
        <p>…</p>
      </sec>
      <sec id="sec-4-18">
        <title>Ethical-Sensory Extrovert</title>
        <p>…</p>
      </sec>
      <sec id="sec-4-19">
        <title>Mykola II Romanov Antoine de Saint</title>
        <p>Exupéry</p>
      </sec>
      <sec id="sec-4-20">
        <title>Victor Hugo</title>
        <p>Jules Verne
Ernesto Che Guevara
…</p>
        <p>The dictionary of features was built according to the adaptive method described in 0. When
building an array of input data (AID), this method provides an individual list of features in the
dictionary for each of the classes. All other texts are described by features. Figure 1: A fragment
of the input data array shows a fragment of the AID created for the Sensory-Logical Extrovert
class from the individual dictionary created for the class of texts, which is designated as "Own".</p>
        <p>The texts of two authors from the respective classes were used to train the models. Learned
models were tested on an array of input data formed from the features of the texts of the third
author of each of the classes (Figure 2: Results of testing the classifier model for the
"SensoryLogical Introvert" sociotype).</p>
        <p>The results of the test of the classifier model show that the software agent managed to
separate the observation points of the Array of Input Data, which describe the texts of authors
belonging to the "Sensory-Logical Extravert" sociotype, from the tests whose authors belong to
other sociotypes.</p>
        <p>A separate classifier model was built for each class. These models were tested on the Array
of Input Data, which was built from the features of the texts of third authors. The test of the
Array of Input Data contained 211 observation points. The results of testing agent-classifier
models are presented in Table 2.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions</title>
      <p>The sociotype to which a person belongs can be determined by intellectual analysis of his text
message. For this, a monitoring software agent and machine learning technology of its models
are used.</p>
      <p>An experimentally confirmed hypothesis about the construction of a decisive rule by
combining the numerical characteristics of the features of the printed text into a single system
of the model-classifier features in the form of a classifier model.</p>
      <p>It is concluded that the use of the method of adaptive formation of a feature dictionary when
converting printed text into an array of its numerical characteristics allows ensuring the
necessary informativeness of the input data set and synthesise useful classifier models.</p>
      <p>The results of the experiments presented in Table 2 prove the effectiveness of the application
of machine learning technology of software agent models to determine the sociotype of a person
based on his printed message.
[8] O. A. Galustyan, L.M. Zakharenko, V.O. Kazmirenko (under the editorship of O.I.</p>
      <p>Motlyakh), Compilation of a psychological profile of an unidentified person based on the
characteristics of his written text. Kyiv, (2020).
[9] C. C. Aggarwal, Text classification: basic models. In Machine Learning for Text, Springer,</p>
      <p>Cham. (2022). https://doi.org/10.1007/978-3-030-96623-2_5
[10] N. Khymytsia, S. Holub, M. Holub, O. Mоrushko, Personality prediction from social
networks: a review of works, CEUR Workshop Proceedings, (2022), 3296, 72–82.
[11] О. Morushko, N. Khymytsia, N. Shakhovska, Determining the psychological portrait of
members of web communities through socionic analysis, CEUR Workshop Proceedings,
(2020), 2616, 112–124.
[12] О. Morushko, N. Khymytsia, V. Teslyuk, Remote selection of staff based on socionic
analysis of social network, Content CEUR Workshop Proceedings, (2022), 3171, 138–149.
[13] S. V. Holub, H. I Martynova, M. S. Holub, Modelyuvannya dialektnoho tekstu v
tekhnolohiyi bahatorivnevoho informatsiynoho monitoringu, Matematychni mashyny i
systemy, (2016), № 4, 76-83.
[14] S. Holub, N. Khymytsia, M. Holub, O. Mоrushko: Machine learning of the classifier of
authors of social network messages, SCIA-2022, 1st International Workshop on Social
Communication and Information Activity in Digital Humanities, October 20, (2022), Lviv,
Ukraine. Сeur-ws.org.Vol-3296.paper11.
[15] D. Tolbatov, S. Holub, Construction of models of monitoring agents on several reference
forms. CEUR Workshop Proceedings Volume 3126, (2021), 108-112, Short Paper
Proceedings of the 2nd International Conference on Intellectual Systems and Information
Technologies (ISIT 2021) co-located with 1st International Forum "Digital Reality"
(DRForum 2021) Odesa, Ukraine, September 13-19, 2021.
[16] A.G. Ivakhnenko, Inductive method of self-organization of models of complex systems.</p>
      <p>Kiev, Naukova Dumka, (1981).</p>
      <p>M. Holub, O. Piven, Classification of texts in the technology of multilevel information
monitoring. Inzynier XXI wieku, Monografia, Wydawnictwo naukowe Akademii
Techniczno-Humanistycznej w Bielsku-Bialej, (2016), 119-122.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>T. S.</given-names>
            <surname>Yatsenko</surname>
          </string-name>
          ,
          <article-title>The problem of verbalisation and cognition of systemic characteristics of the unconscious content of the subject's psyche. Professional education: pedagogy and psychology (</article-title>
          <year>1999</year>
          )
          <fpage>391</fpage>
          -
          <lpage>402</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>E.</given-names>
            <surname>Stamatatos</surname>
          </string-name>
          ,
          <article-title>A survey of modern authorship attribution methods</article-title>
          .
          <source>Journal of the American Society for information Science and Technology</source>
          , Vol.
          <volume>60</volume>
          , no 3, (
          <year>2009</year>
          ),
          <fpage>538</fpage>
          -
          <lpage>556</lpage>
          . doi:
          <volume>10</volume>
          .1002/asi.21001.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>R.</given-names>
            <surname>Zheng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Li. J.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Huang</surname>
          </string-name>
          ,
          <article-title>A framework for authorship identification of online messages: Writing‐style features and classification techniques</article-title>
          .
          <source>Journal of the American society for information science and technology</source>
          , Vol.
          <volume>57</volume>
          . №. 3, (
          <year>2006</year>
          ), pp.
          <fpage>378</fpage>
          -
          <lpage>393</lpage>
          . doi:
          <volume>10</volume>
          .1002/asi.20316.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>AlSallal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Iqbal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Palade</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Amin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Chang</surname>
          </string-name>
          ,
          <article-title>An integrated approach for intrinsic plagiarism detection</article-title>
          .
          <source>Future Generation Computer Systems</source>
          , Vol.
          <volume>96</volume>
          ., (
          <year>2019</year>
          ) pp.
          <fpage>700</fpage>
          -
          <lpage>712</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.future.
          <year>2017</year>
          .
          <volume>11</volume>
          .023.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>B.</given-names>
            <surname>Alhijawi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Hriez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Awajan</surname>
          </string-name>
          ,
          <article-title>Text-based authorship identification - A survey</article-title>
          .
          <source>Paper presented at the 5th International Symposium on Innovation in Information and Communication Technology</source>
          ,
          <string-name>
            <surname>ISIICT</surname>
          </string-name>
          <year>2018</year>
          .
          <article-title>(</article-title>
          <year>2018</year>
          ), pp.
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
          . doi:
          <volume>10</volume>
          .1109/ISIICT.
          <year>2018</year>
          .
          <volume>8613287</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>O. O.</given-names>
            <surname>Morushko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.O.</given-names>
            <surname>Khymytsia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.O.</given-names>
            <surname>Holoshchuk</surname>
          </string-name>
          ,
          <article-title>Modeling of social information exchange: study guide</article-title>
          .
          <source>Lviv, Publishing House of Lviv Polytechnic</source>
          , (
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>V.</given-names>
            <surname>Papish</surname>
          </string-name>
          , et al.
          <article-title>Origins and development of the theory of psychoaccentuation in East Slavic linguistics: a fragmentary review (end of the 20th-beginning of the 21st centuries)</article-title>
          .
          <source>Acta Polono-Ruthenica</source>
          ,
          <article-title>(</article-title>
          <year>2021</year>
          ),
          <article-title>3</article-title>
          .XXVI:
          <fpage>101</fpage>
          -
          <lpage>118</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>