<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Application of Chatbot Technology in the Study of the Discipline «Quality Management»*</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sevastopol State University</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sevastopol</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Russia tsukanov@sevsu.ru</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Sevastopol State University</institution>
          ,
          <addr-line>Sevastopol</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>003</lpage>
      <abstract>
        <p>An automation system based on two technologies is considered: automation of business processes using software robots (RPA) and the technology of automating a dialogue with a user Chat-Bot. The possibility of using these technologies in teaching students is analyzed. An example of training in the discipline "Quality Management" is given. The situation is considered when it is not enough just a chatbot created based on a well-thought-out algorithm and prepared answers to possible questions in advance. For high-quality learning and communication, you need a chatbot with artificial intelligence, a chatbot with an analytical component, and an intelligent assistant based on RPA (Robotic Process Automation) systems. The article presents the advantages of using robots in the educational process: the ability to repeat explanations to complete student tasks, save information on previous requests, and choose the best program for training. Robots are emotionless and will never scold a student. The example shows the interaction of a system of robots with the resources of the university for the implementation of the training system. The possibilities of using big data in such a system are analyzed for such tasks as collecting information about students and disciplines, statistics on student logins in the system, time spent in the system, about files used, lectures passed, assignments completed, coursework, and laboratory work completed and faulty tests. To implement the project of such a training system, the following six stages are required: collecting requirements for the chatbot, robot training, and testing, collective programming, a publication of a pilot chat-bot, verification of the developed system, completion, and development of the project.</p>
      </abstract>
      <kwd-group>
        <kwd>Chatbot</kwd>
        <kwd>Software Robots</kwd>
        <kwd>Artificial Intelligence</kwd>
        <kwd>Learning Automation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Chatbot technology involves the use of special computer applications for automated
and personalized dialogue between the computer system and the user. The use of
Chatbots is becoming increasingly widespread in all areas of human activity. From ordering
goods online and choosing dishes in a restaurant to consulting cosmonauts or pilots in
difficult situations. Virtual robots are also increasingly used in higher education.
Currently, students spend most of their time in various messengers and social networks,
communicating through messages. It is natural to use these technologies to improve the
effectiveness of the educational process. With the transfer of the educational process to
a distance format in many universities, this trend has increased, which has affected the
desire of students to receive advice and explanations for tasks in disciplines during
hours that are not tied to the class schedule [
        <xref ref-type="bibr" rid="ref1 ref4 ref7">1,4,7</xref>
        ]. Getting advice in groups and
communities using chatbots, they are already ready for this technology in the learning
process. On the other hand, the teacher can't answer all the questions of each student
directly at the moment when the student has this question. Teaching practice shows that
when studying traditional subjects, most student questions are repeated and have a
standard character. This allows you to pre-think and structure scenarios for answering
questions that can be uploaded to computer systems with chatbots.
      </p>
      <p>
        At the same time, it should be borne in mind that the market for computer
applications with chatbots tends to grow significantly in the next few years. At the same time,
in 2019, its volume in Russia amounted to 1.5 billion rubles [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. This is primarily due
to the widespread development of automation of business processes of enterprises [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
1
      </p>
    </sec>
    <sec id="sec-2">
      <title>Chatbots, Robotic process automation, Big data</title>
      <p>Considering a chatbot as a complex program that implements a dialog with the user, it
is necessary to understand that it primarily processes lexical data to form the correct
logical response. Such systems belong to the class of intelligent learning systems that
mimic the behavior of the teacher. To do this, first, you need to teach the robot to
correctly answer the questions posed by the student. This is not enough for the "Quality
Management" discipline. The problem is that when studying this discipline, you need
to perform mathematical calculations. Based on this, a distance learning system with
chatbots for the discipline under consideration should have at least the following four
types of software robots:</p>
      <p>1. Chatbots were created based on a well-thought-out fixed algorithm and
pre-designed answers to possible standard questions. Such simple chatbots have limited use,
but they can be used to solve some simple tasks.</p>
      <p>2. Chatbots with artificial intelligence. These robots use a logical processor, the
knowledge base of the discipline, and methods of machine learning. In practice, these
are expert systems with a developed dialog subsystem.</p>
      <p>
        3. Chatbots with an analytical component, that is, robots based on a dialogue with a
person carried out using a linguistic processor, have additional opportunities to perform
some mathematical calculations and simulations.
4. Intelligent assistant systems based on the RPA (Robotic Process Automation)
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. In such systems, automation of the entire process of studying a discipline in a
complex is considered. The technology of modeling and managing business processes,
which has found wide application in business, is used.
      </p>
      <p>In Fig 1 the advantages of using robot systems in training in comparison with
traditional technologies are systematized.</p>
      <p>Using chatbots is not a substitute for live communication with the teacher, but it can be
a good auxiliary tool to support the learning process due to some of its advantages:
- robots never lose patience and can endlessly try to explain to the student how to
solve a problem;</p>
      <p>- robots save the history of communication with the student in the database, which
allows the teacher to constantly improve the learning process and strengthen individual
components of the educational process, if necessary;</p>
      <p>- robots can make the learning process more efficient by offering student-specific
training programs. Adaptive learning systems bring mass higher education closer to
personal learning;</p>
      <p>- robot systems can change the way the material is studied depending on the student's
motivation and abilities. At the same time the learning process becomes more extensive
with many decision-making nodes and cycles;
- robots are not subject to emotions and will never scold a student.</p>
      <p>The use of intelligent robots saves time not only for students but also for teachers,
allowing them to more effectively use their time for developing educational materials
and in-depth personal work with students. Individual tasks and tests take a significant
amount of time for the teacher to check, and the options are often repeated in them.
This is especially important for mass open online courses, where the bill goes to
hundreds and thousands of students, which makes individual feedback almost inaccessible.</p>
      <p>To be used in the educational process, the proposed technology should be used in
conjunction with other information systems used at the University. So in Fig. 2 shows
the structure of an automated system with intelligent robots, which is proposed to be
used for teaching the discipline "Quality Management".</p>
      <p>The proposed system performs the following functions:</p>
      <p>- interacts with the student by answering questions and sending messages on the
subject;</p>
      <p>- retrieves up-to-date data from the task completion database with daily or weekly
results for sending notifications about task completion dates and deadlines;
- extracts data from a database and knowledge base for answers to questions on the
topics of discipline;
- records sent tasks to the cloud storage.
- if the task is standardized, it evaluates the task completion;
- uses the analytical capabilities of the DBMS to perform analytical calculations
using machine learning methods;</p>
      <p>
        - manages the learning process based on a WorkFusion-type business process
automation system [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] or another [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ];
- interacts with the University's information and management systems.
      </p>
      <p>
        The system is also supposed to use Big Data technology, which, in particular, is
supported by the database management system. Figure 3 shows the main parameters
that the Big Data system must meet [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>This figure shows the following parameters:
- V1 (Volume) – the ability to store a large amount of information;
- V2 (Velocity) – data processing speed sufficient for the user's requirements;
- V3 (Variety) – the ability to store and interact with unstructured data;
- V4 (Variability) – availability of tools for analyzing multidimensional and
multifactor data (usually using machine learning methods);
- V5 (Value) – storage and selection of up-to-date and economically valuable data;
- V6 (Veracity) – data must be adequate to the tasks being solved, and not contain
erroneous or false information;
- V7 (Validity) – data storage must comply with laws and national requirements;
- V8 (Volatility) – data should reflect the variability, dynamics, and volatility of the
subject area.</p>
      <p>The database should contain large amounts of information accumulated within the
University: for example, data about students, the educational process, plans and
programs, and literature. This data should be collected, structured, analyzed, and studied
as much as possible. This helps you analyze the course of the educational process,
students ' behavior, and understand what processes can be automated.</p>
      <p>Academic departments and departments can collect information about students and
disciplines and use it to set up databases and knowledge. Even statistics on conventional
inputs of students into the system of interest. But there is still a lot of data about the
time spent in the system, about the files used, lectures passed, tasks completed, course
and laboratory work, passed and erroneous tests.
2</p>
    </sec>
    <sec id="sec-3">
      <title>The Project of Automating the Educational Process</title>
      <p>To complete the project of automating the educational process using a robot system,
you need to perform several stages of work.</p>
      <p>Stage I - collecting requirements for the chatbot.</p>
      <p>The goal of this stage is to understand and analyze potential chatbot scenarios that
could be used in the study of the discipline. This phase involves a teacher and a
specialist in robot programming. The teacher must provide scenarios for conversations.
However, he needs to answer the following questions:
- What problem should solve the chatbot?
- What steps should be automated in the context of the conversation?
- Which external systems should be integrated with?
- What analytical calculations should be performed using a machine learning
system?
- What are the endpoints of the algorithm that the chatbot will use?</p>
      <p>When developing a scenario, you need to define expressions, specific sentences, and
phrases or keywords that should be used in the conversation. All necessary checks or
restrictions must be taken into account. The teacher must provide a list of questions and
answers that are intended for the chatbot. The list should strive to be complete. Minor
changes in the following stages are acceptable.</p>
      <p>
        Figure 4 shows a fragment of the interaction scenario with a student for the “Quality
Management” discipline.
This fragment describes only the dialog part of the robot system operation, without
affecting the analytical part that requires calculations. Here it would be possible to use
the automation system to generate questions. A good overview of these methods is
given in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>Stage II – robot training and testing.</p>
      <p>At this stage, specific software products are selected to support the training system
with robots. For example, the NativeChat system for organizing a dialog, the Vertuca
system for supporting databases, and others. The work at this stage involves a teacher
of the discipline and a technical expert on software robots. The following questions are
studied: an overview of possible systems and their components, creation of accounts,
system management technologies, creation, and management of robots, organization of
cognitive flows, robot learning process.</p>
      <p>
        At this stage, a tutorial or video training on working with the robot is created for
teachers. The main focus should be on the features and concepts that are relevant to the
chatbot scenario for a specific subject, such as the "Quality Management" discipline.
Here you can also use machine learning methods to process the received data to test
and verify the system [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>
        Stage III - collective programming [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>At this stage, a team of technical experts and teachers work together to implement
the selected flow of dialogues using the method of collective or pair programming.
Developers remain in constant contact through the online exchange of software screens
or other forms of communication (Slack, Microsoft Teams). As a result of this stage, at
least one conversation thread on the subject must be completed. At this stage, there is
no need to implement all conversation flows for the subject. If time permits, the
technical expert and the teacher can work on additional questions and answers on the
subject.</p>
      <p>The main task of collective programming at this stage is to create a high-quality
program scenario that should contain a minimum of errors. At the same time,
programmers work in the same team as teachers. The team of programmers and teachers copes
with the task more effectively when they work together. The result is a software bot
that meets the requirements of the discipline and effectively answers the student's
questions.</p>
      <p>It should be noted that this stage also provides effective training for programmers
and teachers themselves. They ask each other "uncomfortable" questions, try to take
into account more nuances in the algorithm, and look for alternative solutions.</p>
      <p>Phase IV - publication of a pilot chat-bot.</p>
      <p>The developed and accepted chatbot should be published on one of the chat
publishing channels available at the University. To do this, you can use software applications
for smartphones and computers such as various types of messengers, such as Viber,
Telegram, WhatsApp, or various social networks. Of particular interest is the use of
systems for mobile learning, for example, for training in the workplace, in the field, at
the enterprise.</p>
      <p>Stage V – verification of the developed system.</p>
      <p>At this stage, there is a check developed by the conversation in the study of discipline
students. Students are actively involved in testing the system. This usually further
encourages students to study the discipline, as they can show their creative abilities and
see the results of their work. During the test, the system's shortcomings are analyzed
and ways to improve it are determined.</p>
      <p>Stage VI – completion and development of the project.</p>
      <p>
        At this stage, the project is demonstrated to the University management and the
system's knowledge base continues to be filled. The issue of all real channels for
implementing chatbots is being resolved [
        <xref ref-type="bibr" rid="ref3 ref5">3,5</xref>
        ].
3
      </p>
    </sec>
    <sec id="sec-4">
      <title>The Education Chatbots System</title>
      <p>A chatbot for automating training in the discipline "Quality Management" should not
only increase students' interest in learning, since they will be able to ask questions at
any time convenient for them and receive notifications about the grades received and
the time of completion of work but also actively perform laboratory work.</p>
      <p>Considering a chatbot as a complex program that implements a dialog with the user,
it is necessary to understand that it primarily processes lexical data to form the correct
logical response. To do this, you need to teach them how to answer the questions
correctly. This is not enough for the discipline "quality management. The problem is that
when studying this discipline, you need to perform mathematical calculations.</p>
      <p>Figure 5 shows an extended diagram of the system for automating the training
process in the discipline "Quality Management".
It also uses spreadsheets and statistical modeling systems with machine learning.
Machine learning here refers to a type of artificial intelligence technology that allows
computers to learn themselves and use methods for optimal forecasting of future events.
The main idea is that the computer constantly selects the best model for the forecast
using additional information.</p>
      <p>
        In the developed system, the linguistic processor [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] plays an important role, the
algorithm of which is shown in Fig. 6.
      </p>
      <p>The figure shows the main actions of the dialogue process with the student. It is
necessary to perform the tasks of morphological analysis and synthesis, syntactic
analysis and synthesis, semantic analysis and synthesis.</p>
      <p>Morphological analysis algorithms match individual words and user forms to a given
dictionary system. At the same time, grammatical characteristics of words are extracted
from existing dictionaries. Here it is important to pre-configure the vocabulary of
algorithms to the vocabulary system of the discipline being studied. In the process of
morphological analysis, specific questions of the student are embedded in the system
structure of the discipline being studied.</p>
      <p>At the next stage, based on the morphological analysis of words in the process of
syntactic analysis, the language sentence is parsed. During parsing, the source text is
transformed into a formal network structure, which is formalized in various ways. In
particular, neural networks can be used here. Information structures in the form of a
tree are also often used.</p>
      <p>At the stage of semantic analysis, semantic relations are extracted from the sentence
and the semantic representation of the text is formed. In General, a semantic
representation is a graph or semantic network that reflects the relationships between semantic
units of a text.
For the discipline "Quality Management", the analysis of the problem, its mathematical
solution, and interpretation are of conceptual importance. In particular, it is necessary
to perform statistical calculations based on real or simulated data. It is important to
interpret the results obtained for specific areas of business or production.</p>
      <p>The use of intelligent robots and bots in the educational process is not without its
drawbacks. It is necessary to note the following:
- students prefer to communicate with the teacher, not with the robot;
- when communicating, the student may make mistakes that the robot may
misinterpret;
- students are used to working with websites, and they don't like working with a bot;
- students are used to working with certain social networks, such as Facebook, and
the transition to other networks where the learning system works causes some
resistance;</p>
      <p>- the student may be annoyed by a certain stupidity of the chatbot and the inability
to stop it.
4</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusions</title>
      <p>Research has shown the possibility of using intelligent bots to develop automated
training systems.</p>
      <p>- The use of a prototype of an automated system for the discipline "Quality
Management" revealed some difficulties for the implementation of the proposed technology.</p>
      <p>- For this class of subjects, in addition to dialogue with the teacher, it is necessary to
use technologies for modeling and processing statistical data.</p>
      <p>- Machine learning methods can be used not only for processing statistical data but
also for analyzing the learning process itself.</p>
      <p>- To create automated training courses, it is necessary to use the technology of
modeling and optimizing business processes together with monitoring and selection of
business processes.</p>
      <p>- The effectiveness of projects for creating automated disciplines can be significantly
improved if a team of teachers and engineers works on each discipline, not just one
person.</p>
      <p>- One of the main difficulties in creating automated disciplines is the development
of a language processor. To solve this problem, you need to have a team of experienced
developers or involve software manufacturing enterprises.</p>
      <p>- Research in this direction can continue through the wider use of machine learning,
mathematical modeling, and artificial intelligence methods.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Colace</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Santo</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lombardi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pascale</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pietrosanto</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lemma</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Chatbot for E-Learning: A Case of Study</article-title>
          ,
          <source>International Journal of Mechanical Engineering and Robotics Research</source>
          <volume>5</volume>
          (
          <issue>7</issue>
          ),
          <fpage>528</fpage>
          -
          <lpage>533</lpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Ghader</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jared</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bijan</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Uli</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Salam</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>A Systematic Review of Automatic Question Generation for Educational Purposes</article-title>
          ,
          <source>International Journal of Artificial Intelligence in Education (30)</source>
          ,
          <fpage>121</fpage>
          -
          <lpage>204</lpage>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Grivokostopoulou1</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Perikos</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hatzilygeroudis</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>An Educational System for Learning Search Algorithms</article-title>
          and Automatically Assessing Student Performance,
          <source>International Journal of Artificial Intelligence in Education (27)</source>
          ,
          <fpage>207</fpage>
          -
          <lpage>240</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Korovina</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <article-title>Learning as a game and a chatbot instead of a teacher: the main trends in future education</article-title>
          ,
          <year>2018</year>
          , https://knife.media/edcrunch, last accessed
          <year>2020</year>
          /07/16.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Kurdi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leo</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sattler</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Al-Emari</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>A Systematic Review of Automatic Question Generation for Educational Purposes</article-title>
          ,
          <source>International Journal of Artificial Intelligence in Education (30)</source>
          ,
          <fpage>121</fpage>
          -
          <lpage>204</lpage>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Ramachandran</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gehringer</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yadav</surname>
          </string-name>
          , R.
          <source>Automated Assessment of the Quality of Peer Reviews using Natural Language Processing Techniques</source>
          ,
          <source>International Journal of Artificial Intelligence in Education (27)</source>
          ,
          <fpage>534</fpage>
          -
          <lpage>581</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Shah</surname>
            <given-names>H</given-names>
          </string-name>
          .
          <article-title>How to Make a Messaging App like WhatsApp, Telegram</article-title>
          , Slack, https://www.simform.com/how-to
          <article-title>-build-messaging-app-whatsapp-telegram-slack</article-title>
          ,
          <source>last accessed</source>
          <year>2020</year>
          /07/16.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Tärning</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Silvervarg</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gulz</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haake</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Instructing a Teachable Agent with Low or High Self-Efficacy - Does Similarity Attract?</article-title>
          ,
          <source>International Journal of Artificial Intelligence in Education (29)</source>
          ,
          <fpage>89</fpage>
          -
          <lpage>121</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Thomas</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <source>Automated Analysis of Reflection in Writing: Validating. Machine Learning Approaches</source>
          ,
          <source>International Journal of Artificial Intelligence in Education (29)</source>
          ,
          <fpage>217</fpage>
          -
          <lpage>257</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Tsukanov</surname>
            ,
            <given-names>A.V.</given-names>
          </string-name>
          :
          <article-title>Extraction of Business Processes from Large Databases</article-title>
          .
          <source>In: Scientific and practical conference Information Systems and Technologies in Modeling and Control</source>
          <year>2018</year>
          , pp
          <fpage>334</fpage>
          -
          <lpage>338</lpage>
          . ARIAL,
          <string-name>
            <surname>Simferopol</surname>
          </string-name>
          (
          <year>2018</year>
          )
          <article-title>(In Russian)</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Tsukanov</surname>
          </string-name>
          , А. V.,
          <string-name>
            <surname>Potanina</surname>
            ,
            <given-names>M. V.</given-names>
          </string-name>
          :
          <article-title>Statistical Modeling and Business Process Optimization</article-title>
          ,
          <source>Druker Gazette</source>
          <volume>1</volume>
          (
          <issue>5</issue>
          ),
          <fpage>118</fpage>
          -
          <lpage>128</lpage>
          (
          <year>2018</year>
          )
          <article-title>(in Russian)</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <article-title>WorkFusion Home page</article-title>
          , https://www.workfusion.com,
          <source>last accessed</source>
          <year>2020</year>
          /07/16.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Wray</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <source>How Pair Programming Really Works, IEEE Software</source>
          ,
          <volume>1</volume>
          (
          <issue>27</issue>
          ),
          <fpage>50</fpage>
          -
          <lpage>55</lpage>
          (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>