<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Information Technology for Foreign Languages Remote Learning with Adaptation to the User Based on Machine Learning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Taras Sopin</string-name>
          <email>taras.sopin.itisz.2019@lpnu.ua</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Victoria Vysotska</string-name>
          <email>victoria.a.vysotska@lpnu.ua</email>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oksana Markiv</string-name>
          <email>oksana.o.markiv@lpnu.ua</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lyubomyr Chyrun</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Vasyl Andrunyk</string-name>
          <email>Vasyl.A.Andrunyk@lpnu.ua</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sofia Chyrun</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oleh Naum</string-name>
          <email>oleh.naum@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ivan Franko Drohobych State Pedagogical University</institution>
          ,
          <addr-line>I. Franko Street, 24, Drohobych, 82100</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Ivan Franko National University of Lviv</institution>
          ,
          <addr-line>University Street, 1, Lviv, 79000</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Lviv Polytechnic National University</institution>
          ,
          <addr-line>S. Bandera Street, 12, Lviv, 79013</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Osnabrück University</institution>
          ,
          <addr-line>Friedrich-Janssen-Str. 1, Osnabrück, 49076</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Since the goal of the work is to improve the process of remote learning of foreign languages, it was chosen to create an application for translation based on the choice of the native language and the language being studied. An educational process using a set of telecommunication technologies aimed at enabling students to learn the basic amount of information they need without direct contact between students and teachers during the learning process (which can take place both synchronously and asynchronously), and can be both an independent form of education, as well as a supplement to another more traditional form of education (full-time, part-time, extramural or externship), if necessary, giving a person the opportunity to study a foreign language training course. So, on the basis of this concept, a translation application was developed, which accurately translates both ordinary language and phraseological units, slang expressions, etc. The model is used as the basis of training, so let's analyze the model according to the main indicators. The model was pre-trained on BookCorpus, a dataset consisting of 11,038 unpublished books and the English Wikipedia (excluding lists, tables and titles). The texts are written in lowercase and tokenized using WordPiece and a dictionary size of 30,000. With probability 0.5, sentence A and sentence B match two consecutive sentences in the original corpus, and in other cases it is another random sentence in the corpus. Note that a sentence here is a continuous stretch of text, usually longer than one sentence. The only limitation is that the result with two "sentences" has a total length of less than 512 tokens. The masking procedure details for each sentence are as follows: 15% of tokens are masked; in 80% of cases masked tokens are replaced by [MASK]; 10% of the time, masked tokens are replaced by a random token from the one they replace; in the remaining 10% of cases, masked markers remain unchanged. The model was trained on 4 Cloud TPUs in a Pod configuration (16 TPUs in total) for one million steps with a batch size of 256. The sequence length was limited to 128 markers for 90% of the steps and 512 for the remaining 10%. Adam optimizer is used with learning rate: β1=0.9, and β2=0.999, weight decay 0.01, learning rate warm-up for 10,000 steps and learning rate linear decrease after. After training the network, the mean squared error decreased from 34.2 to 3.3. Also, training the network made it possible to reduce overtraining and improve its ability to generalize to new data. In the trained network, the number of layers and neurons was increased, which allowed it to reproduce more complex dependencies in the input data. Training the network made it possible to improve its results on test data, increase its ability to generalize, optimize its structure and parameters, choose a more effective activation function, and reduce the risk of overtraining.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Foreign language training, machine learning, neuron network, neuron network training</p>
      <p>2023 Copyright for this paper by its authors.</p>
    </sec>
    <sec id="sec-2">
      <title>1. Introduction</title>
      <p>
        Nowadays, there is a certain class of topical tasks, the solution of which is impossible or difficult to
implement without the use of artificial neural networks (ANNs) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. To solve such problems, human
intelligence is ineffective, and traditional calculations are time-consuming or physically inadequate,
because they do not reflect or poorly reflect real physical processes and objects [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Accordingly, it
becomes necessary to use artificial neural networks to solve classification tasks. A distinctive feature
of neural networks is that they are not programmed, they do not use any inference rules to make a
diagnosis [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], but they learn to do this from examples diagnosis is a special case of event classification,
and the greatest value is the classification of those events that are not in the training neural network set
data. The use of remote techniques for foreign languages is widely used in modern institutions. Distance
learning of foreign languages involves the use of modern information technologies [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. This determined
the purpose of the study, which is to improve the process of remote learning of foreign languages, with
adaptation to the user's language based on machine learning by developing and implementing an
application that will be used to classify operations using neural networks [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>To achieve the goal, the following tasks were set:
1. Conduct an analysis of the literature on the use of neural network technology.
2. Analyze and describe the necessary tools for creating classification software based on neural
networks.
3. Build a classification model based on neural networks.
4. Analyze materials for working with programming languages.
5. Build the software architecture.
6. Develop software.
7. Test software.
8. Analyse work results.</p>
      <p>The object of research concerns processes for remote learning of foreign languages with adaptation
to the user based on machine learning. The subject of research comprises methods and tools for
developing a software product for teaching foreign languages based on neural networks. The
methodological basis of the research is general scientific and special methods, which made it possible
to study the subject and the object of research, to explore directions and ways of optimizing the process
of remote learning of foreign languages with adaptation to the user based on machine learning. The
practical significance of the obtained results is that the use of the developed software will allow to
improve translation from any selected pairs of languages, which will serve as a basis for remote training
of users.</p>
    </sec>
    <sec id="sec-3">
      <title>2. Related works</title>
      <p>
        Intelligent adaptive learning systems are emerging rapidly, but are still in the experimental stage
[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. The intended design of these data-responsive solutions is aimed at providing differentiated learning
at a personalized level of learning [
        <xref ref-type="bibr" rid="ref7 ref8">7-8</xref>
        ]. New approaches to the development of diagnostic and
formative assessment using adaptive intelligence are becoming more common [
        <xref ref-type="bibr" rid="ref10 ref11 ref12 ref9">9-12</xref>
        ]. Adaptive
learning systems are designed to dynamically adjust to the level or type of course content based on an
individual learner's ability or skill achievement in a way that accelerates learner performance through
both automated and instructor-assisted intervention [
        <xref ref-type="bibr" rid="ref13 ref14 ref15 ref16 ref17 ref18">13-18</xref>
        ]. Adaptive systems achieve this by helping
to address learning challenges such as different student learning abilities, different student backgrounds,
and resource constraints. The goal of these machine learning systems is to leverage skills and determine
what a student actually knows, and move students along a consistent learning path toward established
learning outcomes and skill mastery in a precise and logical manner. Nowadays, many platforms use
adaptive systems, in order to better understand how they differ, let's compare the 3 most popular
resources used by students from all over the world: Eduflow, eloomi, ISpringLearn.
      </p>
      <p>
        Adaptive platforms based on machine learning are the most advanced scientific method for
establishing a truly adaptive state. Machine learning (ML) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] is synonymous with pattern recognition,
statistical modeling, predictive analytics, statistical regularities, and other forms of advanced adaptive
capabilities. MN-based systems use programmed algorithms to create an adaptive scientific core and
predict in real time about the student's mastery of the subject. Adaptive MN-based platforms use
learning algorithms, also known as “learners,” to create other algorithms that in turn create adaptive
sequences and predictive analytics that can continuously collect data and use it to move the learner
along a guided learning path.
      </p>
      <p>
        What is unique about adaptive systems based on machine learning is their ability to determine how
an individual learns and approaches a learning task within these intelligent systems, as well as provide
accurate and timely feedback and improve student performance. Since MN-based systems are
computationally intensive and analyze billions of bits of data in real time, system scalability can be an
issue from two perspectives: how these systems are efficiently coded [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]; and the provisioning
architecture used to process, load, and balance massive amounts of data.
      </p>
      <p>
        In order to be able to guide the user through the learning and assessment process [
        <xref ref-type="bibr" rid="ref18 ref19 ref20 ref21">18-21</xref>
        ], information
about the user and his/her actions must be collected and recorded in a user profile. The user profile will
have to record both static and more dynamic information. The user profile as a cornerstone component
of the proposed e-learning system is well studied and documented in the development process. Fig. 1
shows a schematic overview of the proposed user profile.
      </p>
      <p>
        Security information relates to the user's authority to use the system and takes the form of User
name; Password. The OAuth 2.0 protocol (OAuth 2.0, 2012) provides the necessary security for secure
user login. Role information provides an understanding of the relationship between system users and
can be described as: Administrator; Tutor and Student/Apprentice. Thus, the system can easily provide
different services to different types of users. Personal information is mostly static data that records some
basic information about the user: Name; Address; Telephone; School; Email; Gender; Telephone. It
may also contain useful information such as postcode, which may help identify other users living in the
area that an active user may connect to, as this may be useful for identification/placement within a group
or beyond [
        <xref ref-type="bibr" rid="ref21 ref22 ref23 ref24 ref25 ref26 ref27 ref28">21-28</xref>
        ]. The user's interests in the system essentially represent the topics that the learner is
working on (or wants to work on) and improves their performance. User interests can be collected in
two ways: implicitly and explicitly [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. Indirectly capturing user interests will mean that user behavior
(topics selected for reading or specific tests selected for specific topics) will need to be observed and
then mapped to the system's database (RDF database) using semantic similarity measures. Dynamic
data in a user profile is essentially data created by the user while running tests. Such information as:
Test ID; Overall Score; Date of shooting; Time to Completion; Qx-id, score (or just true/false).
      </p>
      <p>
        We may wish to record the time it takes a user to answer a question because: a) this may vary from
user to user; b) it can be used to distinguish between difficult and easier questions (and even use this
information later to adjust the difficulty level of the question). In addition, the level of difficulty of
individual questions in the test can give an idea of the overall level of difficulty of the test [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. The
data obtained from the tests will be used to capture and record the user's progress on the topic. The test
can cover several topics with questions.
      </p>
      <p>
        When a user interacts with an e-learning system, he/she does so by performing a set of actions [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
Because a user logs in with a unique ID, their activity can be tracked. Assume that the log data is "raw".
Assuming activity is recorded in sessions, the raw data would look like this: Session ID/User ID;
Date/Timestamp; Duration; Action x, timestamp x. Where the action can be:
1. Test_Taken, TestID;
2. Topic_Browsed, TopicID
3. Topic_searched, TopicID
4. Talked to a Tutor, TutorID
      </p>
      <p>
        In the educational platform, we can distinguish between self-directed and directed learning. The
actions we might want to record differ slightly between them, although they share many elements. In
both areas, the concept of "engagement" is very important. Engagement can be measured using a
combination of the following [
        <xref ref-type="bibr" rid="ref29 ref30 ref31 ref32 ref33 ref34 ref35">29-35</xref>
        ]:
 Self-direction:
(i) How often a person logs in;
(ii) Duration of the session;
(iii) Duration of page view;
(i) Interrupted Tests;
(i) View results (has the student always viewed results?) by links;
(ii) Repetition of topics, i.e., taking another test on the same topic.
 Direction:
(i) How often the student contacted the teacher;
(ii) Teacher-provided feedback;
(iii) Additional tests assigned by the teacher;
(iv) Whether or not the user actually accepted them;
(v) References recommended by the instructor.
      </p>
      <p>
        Evaluating the effectiveness of the use of distance education systems is impossible without studying
statistical data on the organization of educational content, its quality and compliance with the
educational and calendar plans of the organization of the educational process in general educational
institutions [
        <xref ref-type="bibr" rid="ref36 ref37 ref38 ref39">36-52</xref>
        ]. Building a unified information system of an organization requires the integration
of various information systems [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. In the context of the tasks solved by the distance learning system,
it is advisable to integrate it with the following information systems [53-62]:
 personnel management system;
 personnel evaluation system;
 knowledge management system;
 talent management system.
      </p>
      <p>The integration of the systems presented above in most cases ensures the organization of information
exchange between them [63-69].</p>
    </sec>
    <sec id="sec-4">
      <title>3. Methods and materials</title>
      <p>Nowadays, there are a large number of different programming languages and each of them has its
own scope of application, but still, in order to conduct an analysis on the choice of the best language, it
is necessary to select several of the most popular languages to conduct an analysis between them, so in
this section we will turn to statistics by popularity as. The following technology stack is selected for
work: JavaScript, HTML, CSS, TAILWIND, Node Js.</p>
      <p>The following main dependencies were used for development:
 "@types/node": "18.11.3",
 "@types/react": "18.0.21",
 "@types/react-dom": "18.0.6",
 "autoprefixer": "^10.4.12",
 "eslint": "^8.30.0",
 "postcss": "^8.4.18",
 "prisma": "^4.8.0",
 "tailwindcss": "^3.2.4",
 "typescript": "4.9.4"</p>
      <p>Visual Studio Code was used as the code editor. Visual Studio Code is a full-featured text editor for
editing local files or the code base. It includes various features for editing the code base, which helps
developers track changes. Various features supported in VSC: Syntax highlighting, Auto indent,
Recognition of file types, Sidebar with files of the specified directory, macro, Plugin and packages.
Visual Studio Code is used as an integrated development editor (IDE) like Sublime text and NetBeans.
The current version of the VS code editor is compatible with various operating systems such as
Windows, Linux and MacOS.</p>
      <p>
        When searching the Internet, users often feel overwhelmed by the amount of data that comes back
to them. Methods and systems are needed to help users navigate the Internet and filter information. This
is especially important for distance learning sites, as it is important that every user stays on the platform.
Current work has combined user profiling and a responsive user interface to help satisfy all users. User
profiling [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] can be approached in one of three ways:
(1) the use of stereotypes;
(2) use of surveys/questionnaires;
(3) the use of a “learned model.
      </p>
      <p>The first two approaches rely on traditional marketing techniques using known information or
information gathered in person or over the phone to create relevant profiles. A third approach that uses
"learned models" is our area of interest. The approach involves creating a system that initially does not
know its users, but over time develops a profile model based on user interactions. Profile models can
be created individually, for each user, or collectively, gathering all user data together to form an overall
profile of interests and behavior.</p>
      <p>The developed product has a simple interface consisting of intuitive blocks. The program, the main
direction of which is to help with the translation of text from different languages into a language
understandable to the user, works according to the following principle: To begin with, the user is
presented with a reserved set of phrases for translation, based on this neuron, the network collects data
to form a user profile. Data-sets and models for training were used from the resource that collects all
data-sets and models for training neural networks using languages https://huggingface.co/.</p>
      <p>After training the network, it becomes possible to use the selected languages based on the translation
made during initialization of the application. In order for the neural network to be able to perform the
task, it must be trained. Training a neural network is a process in which the parameters of a neural
network are adjusted by simulating the environment in which the network is embedded. The type of
training is determined by the method of adjusting the parameters. The learning process of the neural
network is shown in Fig. 4.</p>
      <p>In the process of functioning, the neural network forms an output signal Y, implementing some
function Y = G(X). If the architecture of the network is given, then the form of the function G is
determined by the values of the synaptic weights and the biased network. Let the solution of some
problem be the function Y = F(X), given by the input-output data parameters (X1, Y1), (X2, Y2), ..., (XN,
YN), for which Yk = F(Xk) (k = 1, 2, ..., N). Learning consists in finding (synthesis) a function G close to
F in the sense of some error function E. If a set of training examples is selected - pairs (XN, YN) (where
k = 1, 2, ..., N) and the method of calculating the error function E is selected, then the training of the
neural network turns into a multidimensional optimization task that has a very large dimension, and
since the function E can have an arbitrary form, learning in the general case is a multi-extremal
nonconvex optimization problem.</p>
    </sec>
    <sec id="sec-5">
      <title>4. Experiments</title>
      <p>According to different aspects of application and use of e-learning systems, adaptability can be
defined in different ways. It is proposed to define adaptability as the property of a learning system that
adapts and changes itself according to the requirements and characteristics of users before and during
its use. On this basis, the following adaptive levels are distinguished: elementary adaptive level; static
adaptive level; dynamic adaptive level.</p>
      <p>Goal tree is a logical thinking tool that starts with the goal which the organization is trying to achieve
and breaks down all the necessary conditions to achieve it. The goal tree is depicted in the Fig. 5.</p>
      <p>Fig. 6 demonstrates the Activity diagram that has such main control points: Entry point
(initialization); Data; Prism (orm db); Interaction with the user; Operation of the program; Termination</p>
      <p>At the first stage - program execution, the application is initialized. The application receives initial
assets, interface, data. At the second stage, after loading the main components, database data and
software Json files are checked. At the third stage, a module with a prism is executed, which allows you
to process requests and data sent/extracted from the database. We receive json, after processing requests
and transfer the user to the main application in the translation tab.</p>
      <p>The fourth stage is the stage of interaction with the user. If translation is selected - user data is
accepted -&gt; request processing -&gt; providing results -&gt; record in json -&gt; record in db. Another option is
model training, which works as follows: Training is selected -&gt; We download json assets -&gt; We expect
a translation from the user -&gt; We send data to the database -&gt; We randomly generate the next
translation. If the training is finished or another tab is selected, proceed to the fifth stage.</p>
      <p>The fifth stage - The operation of the application is indicated on the activity diagram (Fig. 6). The
application, at this stage, interacts with data and user requests and interacts programmatically between
components and user requests. If the transition to models is selected or the application is closed, we
proceed to stage six. The sixth stage – the transition to the review of models and training or closing the
application is selected – we save the received data, initialize the completion of the program.</p>
      <p>The class diagram is clear and simple, when the user interacts with the application, he chooses one
of the available buttons. If you choose to translate, the data is sent to prisma using download-data, which
accepts the main parameters: language, request, status. If training is selected, we receive data by request
in the post_data file, we have several request\status parameters, after which we interact with
random_data, which, using chat.json, randomly generates and sends sentences to the user for translation
from the selected asset.</p>
      <p>The state diagram is as follows: Interaction with the user starts the initialization of the program, after
which the initial configuration is performed.</p>
      <p>System analysis relies on a number of applied logical-mathematical disciplines, technical procedures
and methods that are widely used in management activities, including formalized and informal means
of research, as well as on a set of principles, that is, basic rules accepted as truth, which are used as a
basis for building methods of analysis. Flowchart analysis is usually applied to fairly simple systems,
while fault tree synthesis is applied to more complex systems.</p>
    </sec>
    <sec id="sec-6">
      <title>5. Results and discussions</title>
      <p>Today, the Internet offers various ways to learn foreign languages. Thespecial variation is the study
of English as the main language of communication of the global community. We will try to analyze the
most effective methods of learning English using some online resources. Today there are 4 main
methods of teaching English:
 Grammar Translation – a classic method of learning English (translation from the native
language into a foreign language and vice versa).
 Direct Method - direct method (The main attention is paid to good pronunciation, spontaneous
use of language without the use of translation, little attention is paid to grammar analysis).
 Audio-lingualism is one of the first modern methods (the method of repeating and memorizing
standard phrases).
 Communicative Language Teaching – modern standard method (communicative learning
method is based on the idea that successful learning of a foreign language occurs with the help of its
study in real situations, which, in turn, leads to natural mastery and ability to use a foreign language).</p>
      <p>So, for our developed application, we will use grammar translation and direct method, for use by
one user, and also to increase the functionality of the application, we will use phraseological units,
dialect words and slang elements for it. That will improve understanding and learning of the chosen
language. To start the application, it is necessary to connect the necessary libraries and modules. First,
let's install the modules and dependencies correctly:</p>
      <p>The main logic of the application is written using the Java Script language, Tailwind Css is used for
styling. Prisma is used to place data obtained in the process of interaction with the user. The Prisma
schema is intuitive and allows you to declare database tables in an understandable way, simplifying the
data modeling process. Models are defined manually or analyzed from an existing database. The Prisma
schema file is the main configuration file for setting up Prisma. It is usually called schema.prisma and
consists of the following parts:
 Data Sources: Specify the details of the data sources to which Prisma should connect (for
example, a PostgreSQL database);
 Generators: Defines which users should be generated based on the data model (eg Prisma
Client);
 Data model definition: defines application models (data form per data source) and their
relationships.</p>
      <p>So, let's make the necessary settings:</p>
      <p>After creating and configuring Prisma, it is necessary to create interface elements for interaction
with the user:</p>
      <p>To begin with, we define what the client will use, then we import the necessary: Fonts (pictures for
the menu), fonts, styles. After that, we connect the objects defined in other modules. After receiving
the objects, we "lay out" them in containers and fill them with content. According to this logic, the
necessary interface elements were created: Sections, buttons, electronic links, etc. After connecting the
styles and the styling process, our app looks like this:</p>
      <p>Next, we need to create some data, send some to the server, and take some from the server, the
following modules perform these actions:</p>
      <sec id="sec-6-1">
        <title>We upload models and datasets for the neural network to the prism. а</title>
        <p>
          When the user interacts with the application, data is sent to the prism. POST [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] data transfer method.
In programming, POST is one of many request methods supported by the HTTP protocol used on the
World Wide Web. The POST request method is designed to send a request in which the web server
accepts the data contained in the message body for storage. It is often used to upload a file or submit a
completed web form.
        </p>
        <p>To train the network, we use a ready-made collection of data (Assets), in the training application we
have the following interface:</p>
        <p>Assets are extracted from our json file and provided to the user. After the user offers his version of
the translation, the data will go to the server, after which the neural network will improve the translation
based on what was sent. The main function of the developed application is translation. For the user, it
is possible to configure a selected pair of languages for training. For example, you can use the pair:
English-Ukrainian, after which the user will receive a correct translation. There are several important
aspects here, the translator uses neural networks for training, and therefore each accurate translation
contributes to the improvement of the app's translation. The neural network is trained to perform a more
accurate translation by studying: phraseological units, a separate dialect, slang. The second aspect is
when using models. Each model has its own initial settings, for example, one of the models we use:</p>
        <p>General information: T5-Base is a control point with 220 million parameters.</p>
        <p>Developers: Colin Raffel, Noam Shazir, Adam Roberts, Catherine Lee, Sharan Narang, Michael
Mathena, Yanqi Zhou, Wei Li, Peter J. Liu. Check out the related article and the GitHub repository
Model type: Language model. Language(s) (NLP): English, French, Romanian, German.
License: Apache 2.0. Related Models: All T5 control points
So, this is a big plus, we can choose a specific learning model for each user or group of users.</p>
        <p>Data for translation is obtained with the help of the hugginface API using a token:</p>
        <p>So, since the application is deployed locally, first it is necessary to unpack its styles with the
following command: npx create-next-app --example with-tailwindcss with-tailwindcss-app.</p>
        <p>When we see that all the necessary modules are assembled, it is necessary to run the application
locally, for this we use Versel. Go to https://vercel.com/dashboard, log in and add the project:</p>
      </sec>
      <sec id="sec-6-2">
        <title>After launching on the platform, we can get to the application itself:</title>
      </sec>
      <sec id="sec-6-3">
        <title>On the left side, we will see a menu containing 4 buttons:</title>
        <p> Translate - perform a translation.
 About\Help improve - used for network training.
 Learn More – an electronic link to a web application that contains models and datasets, so we
will work with each button.</p>
        <p>In the current section, the application needs to translate the given phrase, to improve the translation
and train the neural network, after we send the translation, we receive an alert that the data has been
sent:</p>
        <p>When you click the Learn More button, you are redirected to a web resource with models and
datasets:</p>
        <p>Since the goal of the work is to improve the process of remote learning of foreign languages, it was
chosen to create an application for translation based on the choice of the native language and the
language being studied. An educational process using a set of telecommunication technologies aimed
at enabling students to learn the basic amount of information they need without direct contact between
students and teachers during the learning process (which can take place both synchronously and
asynchronously), and can be both an independent form of education, as well as a supplement to another
more traditional form of education (full-time, part-time, extramural or externship), if necessary, giving
a person the opportunity to study a foreign language training course. So, on the basis of this concept, a
translation application was developed, which accurately translates both ordinary language and
phraseological units, slang expressions, etc. The model is used as the basis of training, so let's analyze
the model according to the main indicators. The model was pre-trained on BookCorpus, a dataset
consisting of 11,038 unpublished books and the English Wikipedia (excluding lists, tables and titles).</p>
        <p>The texts are written in lowercase and tokenized using WordPiece and a dictionary size of 30,000.
Then the model input looks like this: [CLS] Sentence A [SEP] Sentence B [SEP].</p>
        <p>With probability 0.5, sentence A and sentence B match two consecutive sentences in the original
corpus, and in other cases it is another random sentence in the corpus. Note that a sentence here is a
continuous stretch of text, usually longer than one sentence. The only limitation is that the result with
two "sentences" has a total length of less than 512 tokens.</p>
        <p>The masking procedure details for each sentence are as follows:
 15% of tokens are masked.
 In 80% of cases masked tokens are replaced by [MASK].
 10% of the time, masked tokens are replaced by a random token (different) from the one they
replace.
 In the remaining 10% of cases, masked markers remain unchanged.</p>
        <p>The model was trained on 4 Cloud TPUs in a Pod configuration (16 TPUs in total) for one million
steps with a batch size of 256. The sequence length was limited to 128 markers for 90% of the steps
and 512 for the remaining 10%. Adam optimizer is used with learning rate : 1e-4, β 1=0.9β1=0.9 and β
2=0.999β2=0.999 weight decay 0.01, learning rate warm-up for 10,000 steps and learning rate linear
decrease after.</p>
        <p>With fine-tuning for further tasks, this model achieves the following results:</p>
        <p>Regarding the advantages and disadvantages of the application, the following can be highlighted:
 Advantages:
1. Simple and clear interface
2. Possibility of specific selection of models and data sets
3. Used and supported by free resources
4. Easy access to data with Prisma
5. High degree of protection
 Cons:
1. It is necessary to train the network a lot for quality learning
2. Since the application is hosted locally, it is impossible to train in large groups until there is
compatible access.</p>
        <p>So, the developed application has great advantages and few disadvantages that can be easily fixed,
the application is ready to be made and tested.</p>
        <p>Timely detection of cyber-threats is important, but in our case we have a high degree of protection
of modules, files and the application, and therefore the probability of a cyber-threat is almost 0%. For
each module and library, in our case, the acquisition proceeds as follows:</p>
        <p>Wesee: name, version of theclosedfile(set whenstartingtheproject andNodeassembly), requires
- a parameter that determines whether this module is needed, version, resolved - where we get it from,
and integrity - integrity\protection of the file. All modules in the project are protected by a SHA-512
key. SHA-512 is a hashing algorithm that performs the function of hashing some data given to it.</p>
        <p>Hashing algorithms are used in many things, such as Internet security, digital certificates, and even
blockchains. It is part of a group of hashing algorithms called SHA-2, which also includes SHA-256,
which is used on the Bitcoin blockchain for hashing.</p>
        <p>The project is protected by SHA-512 keys and Versel authentication mechanisms, and in order to
start working with Versel, you need to have a Git Hub account that also protects your repositories, based
on this we conclude that the probability of cyber-attacks is minimal.</p>
        <p>Training a network is the process of optimizing its weights and biases to reduce the prediction error
on the training data. At the same time, the network "learns" to recognize regularities in the data and
form its own representations of objects. When comparing a trained and untrained network, the following
advantages of training can be noted:
 Better prediction accuracy: Training the network allows for better prediction accuracy on test
data compared to an untrained network. For example, if we consider the problem of image
classification, training the network can reduce the error of image classification from 30% to 5%.
 Generalization ability: Training a network allows you to increase its generalization ability. This
means that the network can correctly classify new data that it has not seen before. For example, if a
network has been trained to classify images from two classes (cat and dog), it can correctly classify
images from three classes (cat, dog, and rabbit) if it has been trained on a large enough number of
images.
 Optimization of the structure and parameters: Training the network allows you to optimize its
structure and parameters to obtain better prediction accuracy. For example, you can change the
number of layers and neurons in each layer, choose different activation functions and loss functions,
change the batch size for training, use different optimization methods such as Adam, SGD,
RMSProp, etc. Various regularization techniques can also be applied, such as Dropout, L1 and L2
regularization, as well as data augmentation to avoid overtraining.</p>
        <p>Now let's compare our trained network and untrained network:</p>
        <p>A trained network is better than an untrained network for several reasons. First, training the network
allowed it to improve its performance on test data. For example, after training the network, the mean
squared error decreased from 34.2 to 3.3. Also, training the network made it possible to reduce
overtraining and improve its ability to generalize to new data. The second reason is that training the
network allowed it to optimize its parameters and structure to enable more efficient pattern recognition
in the input data. For example, the number of layers and neurons was increased in the trained network,
which allowed it to reproduce more complex dependencies in the input data. The third reason is that
training the network allowed us to choose a more efficient activation function (in this case, the relay),
which allowed us to improve the convergence speed of the network and reduce the training time. So,
training the network made it possible to improve its results on test data, increase its ability to generalize,
optimize its structure and parameters, choose a more effective activation function, and also reduce the
risk of overtraining.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>6. Conclusions</title>
      <p>The information system for remote learning of foreign languages with adaptation to the user based
on machine learning has been created. Moreover, features of use, adaptive learning systems, existing
methods, profile modelling standards and architecture have been considered and analysed. Also, the
research task has been formulated. The systematic analysis of the research object has been performed,
namely, the main provisions of fuzzy logic, its architecture, advantages and disadvantages have been
considered. Thus, the model of the process of forming user parameters in adaptive learning systems,
the tree of goals, have been analysed. The main languages and software tools used for development
have been defined. So, Java Script has been chosen as the main language for development and the main
software for work such as VS code (as a code editor), Versel (as a web application for testing) have
been analysed. The formation of the user profile and the choice of architecture have been reviewed.</p>
      <p>Practical implementation of the designed software product has been carried out. Also, the
initialization process of the data set for neural network training has been described, the architecture and
models have been explored and visualized, data preparation has been carried out, model construction
has been implemented. So, the developed application has several minor disadvantages that can be easily
corrected, and many advantages that are not found in analogues. A trained network is better than an
untrained network for several reasons. First, training the network allowed it to improve its performance
on test data. For example, after training the network, the mean squared error decreased from 34.2 to
3.3. So, training the network made it possible to improve its results on test data, increase its ability to
generalize, optimize its structure and parameters, choose a more effective activation function, and also
reduce the risk of overtraining.
7. References
[40] D. Malikin, I. Kyrychenko, Research of Methods for Practical Educational Tasks Generation</p>
      <p>Based on Various Difficulty Levels, CEUR Workshop Proceedings Vol-3171 (2022) 1030-1042.
[41] R. Yurynets, Z. Yurynets, N. Danylevych, Innovative Methods of Assessing the Academic Success
of Students in Higher Education Institutions, CEUR Workshop Proceedings Vol-3171 (2022)
1297-1307.
[42] N. Pasieka, N. Lysenko, O. Lysenko, V. Sheketa, M. Pasieka, M. Varvaruk, Activating the Process
of Educational Services Using Independent Computing Resources to Manage and Monitor the
Quality of Learning, CEUR Workshop Proceedings Vol-2917 (2021) 62-74.
[43] V. Lytvynenko, N. Savinа, М. Voronenko, N. Doroschuk, S. Smailova, О. Boskin, T. Kravchenko.</p>
      <p>Development, Validation and Testing of the Bayesian Network of Educational Institutions
Financing, in: The crossing point of Intelligent Data Acquisition &amp; Advanced Computing Systems
and East &amp; West Scientists (IDAACS-2019), September 18-21, Metz, France, pp. 412-418.
[44] O. Pronina, O. Piatykop, The Decision Support System Education Career Choice Using Fuzzy</p>
      <p>Model, CEUR Workshop Proceedings Vol-2870 (2021) 1204-1214.
[45] R. Yurynets, Z. Yurynets, M. Denysenko, I. Myshchyshyn, A. Pekhnyk, The Influence of
Educational Competencies of the Staff on the Efficiency of Hotel Companies in the Tourism
Sector, CEUR Workshop Proceedings Vol-2870 (2021) 1225-1237.
[46] L. Halkiv, O. Karyy, I. Kulyniak, Y. Kis, A. Tsapulych, The National System of Higher Education
and Government Procurement for Its Services as Activators of the Development of IT
Entrepreneurship, CEUR Workshop Proceedings Vol-2870 (2021) 1338-1349.
[47] N. Pasieka, Y. Romanyshyn, S. Chupakhina, M. Oliinyk, M. Pasieka, Activation of the Educational
Process by Changing the Curriculum in Higher School, CEUR Workshop Proceedings Vol-2870
(2021) 1350-1364.
[48] Z. Myna, Т. Bilushchak, Social Networks as Tools to Promote the Majors of Higher Education</p>
      <p>Institutions During the Pandemic, CEUR Workshop Proceedings Vol-2870 (2021) 1365-1375.
[49] А. Taran, Information-retrieval System "Base of the World Slavic Linguistics (iSybislaw)" in</p>
      <p>Language Education, CEUR workshop proceedings Vol-2604 (2020) 590-599.
[50] O. Cherednichenko, O. Yanholenko, Information Technology of Web-Monitoring and
Measurement of Outcomes in Higher Education Establishment, in proceedings of 7th
SIGSAND/PLAIS EuroSymposium, Springer, 232 (2015) 103-116.
[51] A. Bomba, M. Nazaruk, N. Kunanets, V. Pasichnyk, Modeling the Dynamics of Knowledge
Potential of Agents in the Educational Social and Communication Environment, Advances in
Intelligent Systems and Computing 1080 (2020) 17-24.
[52] R. Holoshchuk, V. Pasichnyk, N. Kunanets, N. Veretennikova, Information Modeling of Dual
Education in the Field of IT, Advances in Intelligent Systems and Computing 1080 (2020)
637646.
[53] M. Konyk, V. Vysotska, S. Goloshchuk, R. Holoshchuk, S. Chyrun, I. Budz, Technology of
Ukrainian-English Machine Translation Based on Recursive Neural Network as LSTM, CEUR
Workshop Proceedings Vol-3387 (2023) 357-370.
[54] M. Garcarz, Legal Language Translation: Theory behind the Practice, CEUR Workshop</p>
      <p>Proceedings Vol-3171 (2022) 2-2.
[55] N. Hrytsiv, I. Bekhta, M. Tkachivska, V. Byalyk, Sylvia Plath’s I felt-Narrative Label of The Bell
Jar in Ukrainian Translation: Tagging Textness Features, CEUR Workshop Proceedings Vol-3171
(2022) 240-255.
[56] M. Bekhta-Hamanchuk, H. Oleksiv, T. Shestakevych, Y. Shyika, Quantitative Parameters of J.</p>
      <p>London's Short Stories Collection “Children of the Frost” and its Translation, CEUR Workshop
Proceedings Vol-3171 (2022) 697-710.
[57] K. Mandziy, U. Yurlova, M. Dilai, English-Ukrainian Parallel Corpus of IT Texts: Application in</p>
      <p>Translation Studies, CEUR Workshop Proceedings Vol-3171 (2022) 724-736.
[58] N. Hrytsiv, T. Shestakevych, J. Shyyka, Corpus Technologies in Translation Studies: Fiction as</p>
      <p>Document, CEUR Workshop Proceedings Vol-2917 (2021) 327-343.
[59] A. Lutskiv, R. Lutsyshyn, Corpus-Based Translation Automation of Adaptable Corpus Translation</p>
      <p>Module, CEUR Workshop Proceedings Vol-2870 (2021) 511-527.
[60] A. Kopp, D. Orlovskyi, S. Orekhov, An Approach and Software Prototype for Translation of
Natural Language Business Rules into Database Structure, CEUR Workshop Proceedings
Vol2870 (2021) 1274-1291.
[61] T. Anokhina, I. Kobyakova, S. Shvachko, Going parallel: using earlier translations as background
for facilitating re-translation technique, CEUR workshop proceedings Vol-2604 (2020) 249-258.
[62] M.-A. Lefer, N. Grabar, Super-creative and overbureaucratic: A cross-genre corpusbased study on
the use and translation of evaluative prefixation in ted talks and EU parliamentary debates, Across
Languages and Cultures 16(2) (2015) 187-208.
[63] S. Tetiana, The method of education format ascertaining in program system of inclusive education
support, in: proceedings of International Scientific and Technical Conference on Computer
Sciences and Information Technologies, CSIT, 2017, pp. 279-283.
[64] V. Pasichnyk, T. Shestakevych, The application of multivariate data analysis technology to support
inclusive education, in: Proceedings of the International Conference on Computer Sciences and
Information Technologies, CSIT, 2015, pp. 88-90.
[65] T. Shestakevych, V. Pasichnyk, N. Kunanets, Information and technology support of inclusive
education in Ukraine, Advances in Intelligent Systems and Computing 754 (2019) 746-758.
[66] T. Shestakevych, V. Pasichnyk, N. Kunanets, M. Medykovskyy, N. Antonyuk, The content
webaccessibility of information and technology support in a complex system of educational and social
inclusion, in: International Scientific and Technical Conference on Computer Sciences and
Information Technologies, CSIT, 1, 2018, pp. 27-31.
[67] V. Pasichnyk, T. Shestakevych, N. Kunanets, V. Andrunyk, Analysis of completeness, diversity
and ergonomics of information online resources of diagnostic and correction facilities in Ukraine,
CEUR Workshop Proceedings 2105 (2019) 193-208.
[68] T. Shestakevych, V. Pasichnyk, M. Nazaruk, M. Medykovskiy, N. Antonyuk, Web-Products,
Actual for Inclusive School Graduates: Evaluating the Accessibility, Advances in Intelligent
Systems and Computing 871 (2019) 350-363.
[69] Y. Bobalo, P. Stakhiv, N. Shakhovska, The system of remote Education Resource Center elements
development, in: proceedings of International Conference Computational Problems of Electrical
Engineering, CPEE, 2016, 7738729.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Esteva</surname>
          </string-name>
          , et al.,
          <article-title>A guide to deep learning in healthcare</article-title>
          ,
          <source>Nature medicine 25(1)</source>
          (
          <year>2019</year>
          )
          <fpage>24</fpage>
          -
          <lpage>29</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.</given-names>
            <surname>Nistor</surname>
          </string-name>
          ,
          <string-name>
            <surname>E. Zadobrischi,</surname>
          </string-name>
          <article-title>The influence of fake news on social media: analysis and verification of web content during the COVID-19 pandemic by advanced machine learning methods and natural language processing</article-title>
          ,
          <source>Sustainability</source>
          <volume>14</volume>
          (
          <issue>17</issue>
          ) (
          <year>2022</year>
          )
          <fpage>10466</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>P.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Wang, Application of convolutional neural network in natural language processing</article-title>
          ,
          <source>in Proceedings of IEEE 15th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP)</source>
          ,
          <year>2018</year>
          , December, pp.
          <fpage>120</fpage>
          -
          <lpage>122</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>L.</given-names>
            <surname>Deng</surname>
          </string-name>
          , Y. Liu, Deep learning in
          <source>natural language processing</source>
          , Springer, Singapore,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Cai</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. W.</given-names>
            <surname>Tan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Huang</surname>
          </string-name>
          , H. Liu,
          <article-title>Natural language processing (NLP) in management research: A literature review</article-title>
          ,
          <source>Journal of Management Analytics</source>
          <volume>7</volume>
          (
          <issue>2</issue>
          ) (
          <year>2020</year>
          )
          <fpage>139</fpage>
          -
          <lpage>172</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D.</given-names>
            <surname>Rothman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gulli</surname>
          </string-name>
          ,
          <article-title>Transformers for Natural Language Processing: Build, train, and fine-tune deep neural network architectures for NLP with Python, PyTorch, TensorFlow</article-title>
          , BERT, and
          <article-title>GPT3</article-title>
          . Packt Publishing Ltd. ,
          <year>2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>V.</given-names>
            <surname>Lytvyn</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Pukach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Vysotska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Vovk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Kholodna</surname>
          </string-name>
          ,
          <source>Identification and Correction of Grammatical Errors in Ukrainian Texts Based on Machine Learning Technology, Mathematics</source>
          <volume>11</volume>
          (
          <issue>4</issue>
          ) (
          <year>2023</year>
          )
          <fpage>904</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A.</given-names>
            <surname>Nistor</surname>
          </string-name>
          ,
          <string-name>
            <surname>E. Zadobrischi,</surname>
          </string-name>
          <article-title>The influence of fake news on social media: analysis and verification of web content during the COVID-19 pandemic by advanced machine learning methods and natural language processing</article-title>
          ,
          <source>Sustainability</source>
          <volume>14</volume>
          (
          <issue>17</issue>
          ) (
          <year>2022</year>
          )
          <fpage>10466</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>W. E.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q. Z.</given-names>
            <surname>Sheng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Alhazmi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <article-title>Adversarial attacks on deep-learning models in natural language processing: A survey</article-title>
          ,
          <source>ACM Transactions on Intelligent Systems and Technology (TIST) 11(3)</source>
          (
          <year>2020</year>
          )
          <fpage>1</fpage>
          -
          <lpage>41</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <article-title>How to Digitize Texts with Open-Source Command-Line Optical Character Recognition (OCR) Software</article-title>
          . URL: https://hdw.artsci.wustl.edu/articles/154.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Karpathy</surname>
          </string-name>
          , et al.,
          <article-title>Convolutional Neural Networks for Visual Recognition</article-title>
          . URL: http://www.cs231n.stanford.edu.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <article-title>The Mnist Database of handwritten digits</article-title>
          . URL: http://yann.lecun.com/exdb/mnist/.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Kay</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Tesseract</surname>
          </string-name>
          <article-title>: Open-Source Optical Character Recognition Engine</article-title>
          . URL: http://www.linuxjournal.com/article/9676.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Nielsen</surname>
            <given-names>MA</given-names>
          </string-name>
          <article-title>Neural Networks and Deep Learning</article-title>
          . URL: http://www.neuralnetworksanddeeplearning.com.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <article-title>OCRopy: Python-based tools for document analysis and OCR</article-title>
          . https://github.com/tmbdev/ocropy
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>S.</given-names>
            <surname>Theodoridis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            ,
            <surname>Koutroumbas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Pattern</given-names>
            <surname>Recognition</surname>
          </string-name>
          . New York: Elsevier Science. URL: https://books.google.com/books?id=QgD-3Tcj8DkC.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>U.</given-names>
            <surname>Baumann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Shelley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Murphy</surname>
          </string-name>
          ,
          <article-title>New challenges, the role of the tutor in the teaching of languages at a distance</article-title>
          .
          <source>Distances et Savoirs</source>
          <volume>6</volume>
          (
          <issue>3</issue>
          ) (
          <year>2009</year>
          )
          <fpage>365</fpage>
          -
          <lpage>392</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>J.-C. Bertin</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Grave</surname>
            ,
            <given-names>J.-P.</given-names>
          </string-name>
          <string-name>
            <surname>Narcy-Combes</surname>
          </string-name>
          ,
          <article-title>Second language distance learning and teaching: Theoretical perspectives and didactic ergonomics</article-title>
          .
          <source>Hershey, PA: Information Science Reference</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>A.</given-names>
            <surname>Comas-Quinn</surname>
          </string-name>
          , B. de los Arcos, R. Mardomingo,
          <article-title>Virtual learning environments (VLEs) for distance language learning: Shifting tutor roles in a contested space for interaction</article-title>
          ,
          <source>Computer Assisted Language Learning</source>
          <volume>25</volume>
          (
          <issue>2</issue>
          ) (
          <year>2012</year>
          )
          <fpage>129</fpage>
          -
          <lpage>143</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>M.</given-names>
            <surname>Grgurović</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. A.</given-names>
            <surname>Chapelle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. C.</given-names>
            <surname>Shelley</surname>
          </string-name>
          ,
          <article-title>A meta-analysis of effectiveness studies on computer technology-supported language learning</article-title>
          ,
          <source>ReCALL</source>
          <volume>25</volume>
          (
          <issue>2</issue>
          ) (
          <year>2013</year>
          )
          <fpage>1</fpage>
          -
          <lpage>32</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>M. S.</given-names>
            <surname>Andrade</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. L.</given-names>
            <surname>Bunker</surname>
          </string-name>
          ,
          <article-title>A model for self-regulated distance language learning</article-title>
          .
          <source>Distance Education</source>
          <volume>30</volume>
          (
          <issue>1</issue>
          ) (
          <year>2009</year>
          )
          <fpage>47</fpage>
          -
          <lpage>61</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>A.</given-names>
            <surname>Kukulska-Hulme</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Shield</surname>
          </string-name>
          ,
          <article-title>An overview of mobile assisted language learning: From content delivery to supported collaboration and interaction</article-title>
          ,
          <source>ReCALL</source>
          <volume>20</volume>
          (
          <issue>3</issue>
          ) (
          <year>2008</year>
          )
          <fpage>271</fpage>
          -
          <lpage>289</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>K.</given-names>
            <surname>Kostolányová</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Juřičková</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Šimonová</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Poulová</surname>
          </string-name>
          .
          <article-title>Flexible hybrid learning: comparative study, in Proceeding of Hybrid learning</article-title>
          .
          <source>Innovation in educational practices. 8th international conference. Lecture Notes in Computer Science</source>
          <volume>9167</volume>
          (
          <year>2015</year>
          )
          <fpage>70</fpage>
          -
          <lpage>81</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>G.</given-names>
            <surname>Fulcher</surname>
          </string-name>
          ,
          <article-title>Practical language testing</article-title>
          .
          <source>London: Hodder Education</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>C. M. Chen</surname>
            ,
            <given-names>C. J.</given-names>
          </string-name>
          <string-name>
            <surname>Chung</surname>
          </string-name>
          ,
          <article-title>Personalized mobile English vocabulary learning system based on item response theory and learning memory cycle</article-title>
          .
          <source>Computers &amp; Education</source>
          <volume>51</volume>
          (
          <issue>2</issue>
          ) (
          <year>2008</year>
          )
          <fpage>624</fpage>
          -
          <lpage>645</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>M.</given-names>
            <surname>Horbova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Andrunyk</surname>
          </string-name>
          , L. Chyrun,
          <article-title>Virtual reality platform using ml for teaching children with special needs</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          <volume>2631</volume>
          (
          <year>2020</year>
          )
          <fpage>209</fpage>
          -
          <lpage>220</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>K.</given-names>
            <surname>Supruniuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Andrunyk</surname>
          </string-name>
          ,
          <string-name>
            <surname>L. Chyrun,</surname>
          </string-name>
          <article-title>AR interface for teaching students with special needs</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          <volume>2604</volume>
          (
          <year>2020</year>
          )
          <fpage>1295</fpage>
          -
          <lpage>1308</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>V.</given-names>
            <surname>Andrunyk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Pasichnyk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Antonyuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Shestakevych</surname>
          </string-name>
          ,
          <article-title>A Complex System for Teaching Students with Autism: The Concept of Analysis. Formation of IT Teaching Complex</article-title>
          ,
          <source>Advances in Intelligent Systems and Computing</source>
          <volume>1080</volume>
          (
          <year>2020</year>
          )
          <fpage>721</fpage>
          -
          <lpage>733</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>A.</given-names>
            <surname>Badan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Onishchenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Zeniakin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Yanholenko</surname>
          </string-name>
          ,
          <article-title>Online Communication Simulating Spaces for Teaching Effective Foreign Language Communication</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          , Vol-
          <volume>3387</volume>
          (
          <year>2023</year>
          )
          <fpage>180</fpage>
          -
          <lpage>201</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>T.</given-names>
            <surname>Basyuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Vasyliuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Lytvyn</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Vlasenko</surname>
          </string-name>
          ,
          <article-title>Features of designing and implementing an information system for studying and determining the level of foreign language proficiency</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          Vol-
          <volume>3312</volume>
          (
          <year>2022</year>
          )
          <fpage>212</fpage>
          -
          <lpage>225</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>A.</given-names>
            <surname>Badan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Onishchenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Zeniakin</surname>
          </string-name>
          ,
          <article-title>Digital Technologies for Communication Simulation in Foreign Language Learning under Pandemic</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          Vol-
          <volume>3171</volume>
          (
          <year>2022</year>
          )
          <fpage>1160</fpage>
          -
          <lpage>1180</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>O.</given-names>
            <surname>Krupii</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kasian</surname>
          </string-name>
          ,
          <article-title>A Neural Network-Based Study of the Performance of a Developed Foreign Language Teaching System</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          Vol-
          <volume>2870</volume>
          (
          <year>2021</year>
          )
          <fpage>191</fpage>
          -
          <lpage>205</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>A.</given-names>
            <surname>Badan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Onishchenko</surname>
          </string-name>
          ,
          <article-title>Multimedia Technologies in Foreign Language Learning under Pandemic</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          Vol-
          <volume>2870</volume>
          (
          <year>2021</year>
          )
          <fpage>642</fpage>
          -
          <lpage>656</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>M.</given-names>
            <surname>Hrendus</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Andrunyk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Yavir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Ryshkovets</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Khudyi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Hryhorovych</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Korobchynskyi</surname>
          </string-name>
          ,
          <article-title>Developing an Intelligent Online Learning System for Foreign Language Vocabulary Training Based on Gamification</article-title>
          .
          <source>In: CEUR workshop proceedings</source>
          Vol-
          <volume>2604</volume>
          (
          <year>2020</year>
          )
          <fpage>1075</fpage>
          -
          <lpage>1101</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35]
          <string-name>
            <given-names>V.</given-names>
            <surname>Lytvyn</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Danylyk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Bublyk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Chyrun</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Panasyuk</surname>
          </string-name>
          ,
          <string-name>
            <surname>O. Korolenko,</surname>
          </string-name>
          <article-title>The lexical innovations identification in English-languagee eurointegration discourse for the goods analysis by comments in e-commerce resources</article-title>
          ,
          <source>in: Proceedings of IEEE 16th International conference on Computer science and information technologies, Lviv</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>85</fpage>
          -
          <lpage>97</lpage>
          . doi:
          <volume>10</volume>
          .1109/CSIT52700.
          <year>2021</year>
          .
          <volume>9648594</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>N.</given-names>
            <surname>Shakhovska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Vovk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Hasko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kryvenchuk</surname>
          </string-name>
          ,
          <article-title>The method of big data processing for distance educational system</article-title>
          ,
          <source>Advances in Intelligent Systems and Computing</source>
          <volume>689</volume>
          (
          <year>2018</year>
          )
          <fpage>461</fpage>
          -
          <lpage>473</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>V.</given-names>
            <surname>Andrunyk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Shestakevych</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kryvoshyya</surname>
          </string-name>
          ,
          <article-title>Choosing an Educational Application for Children with ASD</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          Vol-
          <volume>3171</volume>
          (
          <year>2022</year>
          )
          <fpage>642</fpage>
          -
          <lpage>652</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [38]
          <string-name>
            <given-names>S.</given-names>
            <surname>Chupakhina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Pasieka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Matishak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Pasieka</surname>
          </string-name>
          , Y. Romanyshyn, Mathematical Models of Group Dynamics When Working in Teams of Developers of Training Distance Courses,
          <source>CEUR Workshop Proceedings</source>
          Vol-
          <volume>2917</volume>
          (
          <year>2021</year>
          )
          <fpage>51</fpage>
          -
          <lpage>61</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          [39]
          <string-name>
            <given-names>S.</given-names>
            <surname>Lienkov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Gakhovych</surname>
          </string-name>
          , I. Tolok,
          <string-name>
            <given-names>G.</given-names>
            <surname>Zhyrov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Bakhvalov</surname>
          </string-name>
          ,
          <article-title>An Option of Building the Distance Learning System with Artificial Intelligence Elements</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          Vol-
          <volume>2870</volume>
          (
          <year>2021</year>
          )
          <fpage>1194</fpage>
          -
          <lpage>1203</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>