<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Method to Ensure the Effectiveness and Attractiveness of E-Learning. Human-Oriented Systemic Ergonomic Approach</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Central Scientific Research Institute of the Army of the Armed Forces of Ukraine</institution>
          ,
          <addr-line>Kyiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Sumy State University</institution>
          ,
          <addr-line>Sumy</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Taras Shevchenko National University of Kyiv</institution>
          ,
          <addr-line>Kyiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The article deals with the problems of the low efficiency of elearning systems. We reveal the main ergonomic problems of computer systems for training and propose the concept of a man-system approach to the creation of e-learning systems. We have developed a method and information technology for optimizing man-machine dialogue interaction, taking into account the characteristics of a particular person, working in the e-learning system.</p>
      </abstract>
      <kwd-group>
        <kwd>e-learning</kwd>
        <kwd>human-operator</kwd>
        <kwd>ergonomics</kwd>
        <kwd>educational environment</kwd>
        <kwd>optimization</kwd>
        <kwd>information technology</kwd>
        <kwd>agent-manager</kwd>
        <kwd>cyberspace</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        The introduction of computers has completely changed the educational process in
schools, universities, as well as the processes of training and retraining of employees
of firms and corporations [
        <xref ref-type="bibr" rid="ref1 ref2 ref3 ref4 ref5">1-5</xref>
        ].Learning becomes continuous (both throughout life
and throughout the day)[
        <xref ref-type="bibr" rid="ref6 ref7 ref8">6-8</xref>
        ]. People spend hours on a computer or mobile device
daily[
        <xref ref-type="bibr" rid="ref1 ref7 ref9">1,7,9</xref>
        ].You can study, take tests and exams, being thousands of kilometers from
the university campus[
        <xref ref-type="bibr" rid="ref1 ref10">1,10</xref>
        ].Even the defense of the thesis can be carried out
remotely.
      </p>
      <p>
        For these purposes[
        <xref ref-type="bibr" rid="ref11 ref12 ref13 ref14 ref15">11-15</xref>
        ]:
• Expensive equipment is purchased.
• Powerful databases and repositories are created.
• Organized are:
• Technical support groups.
• Scientific laboratories of distance learning, virtual and augmented reality.
• Projects of remote access to unique technical equipment to study complex
      </p>
      <p>objects and conduct technical experiments and medical operations.</p>
      <p>
        Thus, recent years can be associated with a revolutionary change in technical,
software and information support, with a jump in technology, including artificial
intelligence and an increase in capital investment in education[
        <xref ref-type="bibr" rid="ref16 ref17 ref18 ref19 ref20">16-20</xref>
        ].
      </p>
      <p>Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).</p>
    </sec>
    <sec id="sec-2">
      <title>Problem Statement</title>
      <p>
        Despite the sound statements made by many universities about the victory of the
concept of “paperless education”, the return on investments does not correspond to the
expenditures of financial, technical and human resources[
        <xref ref-type="bibr" rid="ref1 ref21 ref22 ref23 ref24 ref25 ref26">1,21-26</xref>
        ].
      </p>
      <p>
        The expected massive “world” leap in improving the quality of students' knowledge
did not happen[
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. Moreover, there is a tendency towards a decrease in the quality of
fundamental and natural science training (physics, mathematics, chemistry, biology,
etc.)[
        <xref ref-type="bibr" rid="ref28">28</xref>
        ].
      </p>
      <p>Students unlearn how to think and solve complex problems (if you have a smartphone
with a calculator or a computer with a modeling program at hand).</p>
      <p>
        The ability to explain the result, to analyze cause-effect relationships is
reduced[
        <xref ref-type="bibr" rid="ref15 ref22 ref28">15,22,28</xref>
        ].
      </p>
      <p>
        In the field of humanitarian training, the thoughtless unsystematic mass use of
computer training leads, for example, to “coaching for tests” the journalist who is afraid
and cannot work “live”, etc.[
        <xref ref-type="bibr" rid="ref1 ref15">1,15</xref>
        ].
      </p>
      <p>Twenty years ago, the author of this article was the head of the project for the
introduction of information technology for the management of the educational process at
the Theological Academy (Sergiev Posad) and defended the concept of “maximum
computerization of the educational process”. At the same time, the administration has
proposed the concept of “intelligent automation”, figuratively explaining this by
saying that a “robot priest” is unlikely to be useful in the field of serving God and People.
(Of course, this is a unique but instructive story).</p>
      <p>
        Often unsystematic informatization without focusing on a person gives only harm.
We even discuss a problem like “when the computer kills us”[
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]! At the same time,
many researchers are concerned about the harmfulness of the Internet and social
networks associated with the described problem. A number of scientists even set the task
of ensuring cyber-security of e-learning and the health of
students[
        <xref ref-type="bibr" rid="ref24 ref29">24,29,3234</xref>
        ].Modern people cannot and do not want to work with complex software
environments and training materials that are not adaptable to their needs and
features[
        <xref ref-type="bibr" rid="ref19 ref2 ref27 ref3">2,3,19,27</xref>
        ].
      </p>
      <p>Thus, the task of this work is defined as follows: to identify the reasons for the low
efficiency of e-learning and to develop a method that provides flexible adaptation of
electronic educational environments to the psychophysiological and motivational
characteristics of people working with the system, based on advanced achievements
in engineering psychology, ergonomics, and the theory of adaptive systems.
3
3.1</p>
      <p>Research of the Problem and Development of Methodological
Basis for its Solution</p>
      <p>Reasons for the Low Efficiency of E-Learning. Students Survey Results
Very often, students drop out of school because “they don’t get what they expect from
the system.”We organized a special survey of students (Ukraine, Poland, Belarus,
The complexity and imperfection of the learning environment
The difficulty of establishing a dialogue with the teacher to
solve problematic issues
Inability to flexibly change the structure of the dialogue
Problems with modality, inconsistency of the presentation
of information to the style convenient for the student
The inability to flexibly change the complexity of the
material (depending on motivation and level of
preparedness)
Lack of ability to evaluate quickly possible learning
outcomes (to predict the time spent and assessment)
Lack of uniform standards for learning management
Errors, poor formatting, color gamut, etc.</p>
      <p>Low flexibility to enable self-monitoring of the learning
process and error explanations
Etc.
27.3
25.1
19.5
8.8
7.9
6.2
3.1
1.1
1.0
23.0
20.0
17.4
17.2
11.9
3.3
3.0
3.3
0.9
Kazakhstan and Germany - 389 students in total) about their assessment of the
reasons for the low efficiency of e-learning systems (Table 1).
These results allowed us to find “painful” problematic issues that scientists and
practitioners need to work on.
3.2</p>
      <p>
        Development of a Methodology for an Ergonomic Approach to the Design
of an Information Learning Environment
Disappointing assessments of existing e-learning technologies are forcing scientists
and developers to turn to the ergonomic methodology of complex systems
“mantechnology-environment”[
        <xref ref-type="bibr" rid="ref35 ref36 ref37">35-40</xref>
        ].
      </p>
      <p>Today, there is an opinion that the operator is a person who controls the
technological process or watches the target on the radar screen, etc. Moreover, engineering
psychology and ergonomics are mainly engaged in ensuring their comfort. At the
same time, it is subjected to no less influence of negative factors, including stress than
the operator managing the blast furnace or the call center operator. Only the nature of
these negative influences is completely different. In this regard, when developing
elearning systems, it is necessary not to mechanically accumulate training electronic
materials, but to design individual interactive training procedures that can flexibly
adapt to a particular operator and environmental conditions.</p>
      <p>In science, there are the following concepts for taking into account the
characteristics of man and technology:
o Technical approach (today prevails in electronic education).
o Equal-element approach.
o Humanitarian approach (a person is at the forefront, technical features are not
taken into account).
o human-system approach (man is the main element, but working in a specific
system and environment, the features of which should be taken into account.</p>
      <p>Obviously, it is necessary to reorient in the models of creating e-learning,
switching from a technical approach to a human-system approach.</p>
      <p>Using the principles of ergonomics and a human-system approach can
dramatically change the situation with the attractiveness and effectiveness of e-learning.
However, this is due to a lot of scientific, technical and organizational work.
4
4.1</p>
      <p>Organization of Works for the Creation of Adaptive
HumanMachine Training Systems</p>
      <p>Creation of Prerequisites
Adaptive e-learning technology is possible only in the conditions of a developed
electronic university management system [41] with:
• Developed database system and documentation of the learning process and
outcomes.
• Unified electronic document management system
4.2</p>
      <p>Technology for the Development and Certification of Electronic Training
Modules
Preparation of training modules should not be entrusted only to the teacher. A whole
group is being created, including (except for leading teachers):
• Content specialists.
• Designers, videographers.
• Programmers.
• Testers.</p>
      <p>• Ergonomists.</p>
      <p>Module requirements:
• A group of experts.
• A working group (analysts, cognitologists, managers, and technical
personnel).</p>
      <p>Thus, evaluation criteria are created, some of which are given in the article [42]
and a bank of mathematical methods and interactive procedures for processing expert
estimates.</p>
      <p>The idea of a certification system based on the principles of multicriteria
assessment “on the scale of a thermometer with a slider” and fuzzy logic [42] is shown in
Fig. 1</p>
      <p>Emodules</p>
      <p>Evaluation
of Local
Ergonomic
Quality
Indicators
Experts</p>
      <p>Comprehensive
Quality
Assessment</p>
      <p>Certified
For revision
Not certified
Solution
Classes</p>
      <p>E-Modules</p>
      <p>Library
Revision</p>
      <p>Recommendati
ons Protocol
Thus, only certified training modules that meet all the requirements relevant to the
system are allowed to operate.</p>
      <p>Study of Characteristics and Maintaining Models of Trainees (Operators)
For each system operator are determined:
•
•
•
•
•
•
•</p>
      <p>H1- Psychophysiological characteristics.</p>
      <p>H2- Learning Styles (desired).</p>
      <p>H3- Level of motivation (for discipline).</p>
      <p>H4- Preparedness for the study of discipline.</p>
      <p>H5- Functional Status (current).</p>
      <p>H6- Results (“history”, protocol) of all previous sessions of working with the
system (which module was studied, how much time was spent, what were
the results of self-monitoring and final control).</p>
      <p>To determine the characteristics of H1 and H2, computer diagnostic tools are
stored in the database of the university management system. Such testing is
carried out once, and the results are entered into the database of user models
of the system and are used to adapt to each specific person..</p>
      <p>H3 and H4 are determined before starting the study of discipline.</p>
      <p>H5 is constantly monitored (after 10-30 minutes of operation in the system).</p>
      <p>H6 is ongoing. The results are required to predict the reliability and timing of
the implementation of elementary learning operations both for a given student and for
others.
4.4</p>
      <p>Information Support for Adaptive Interactive Learning Processes
The system “man-equipment-environment”, which we analyze, for making optimal
decisions should be described in all necessary “sections”. These include:
•Modules.
•Students.
•Hardware and software.
•Communication channels.</p>
      <p>•Resource constraints.</p>
      <p>
        We describe the entire list of such necessary “sections” (there are more than 50)
and, accordingly, the databases that we have developed in [
        <xref ref-type="bibr" rid="ref37">37,43,44</xref>
        ].Such
information is required to generate the initial data necessary for assessing the likely
learning outcomes and time spent in each specific situation in order to offer optimal
interactive learning technology.
4.5
      </p>
      <p>
        Method for Evaluating the Effectiveness of Learning and Cognitive
Activities and Optimizing Dialogue Interaction
In order to conduct an assessment, the system builds a functional network [
        <xref ref-type="bibr" rid="ref35 ref36">35,36,38</xref>
        ]
that describes the dialogue interaction and, using the mathematical models that we
have developed for the probability of error-free execution of procedures and time
costs [
        <xref ref-type="bibr" rid="ref36">36,38,45</xref>
        ], makes a forecast of the results and proposes an adjustment of the
learning technology. Such adjustment is carried out according to the results of the
study of each submodule.
4.6
      </p>
      <p>Program-Manager to Manage the Learning Process
To manage the adaptive dialogue process, a special program has been developed that
on-line solves a number of optimization problems for choosing the structure of
dialogue interaction (Fig. 2).
We used this method in the framework of complex projects for the introduction of
computer control systems at 20 universities of Ukraine (Kharkiv, Kremenchug,
Vinnitsa, Sumy, Kryvyi Rih and other cities) and confirmed its effectiveness. Let us show
just one indicator (for Sumy Agrarian University, Ukraine) for example [41]:
• In 2018, the average grade point at the Faculty of Agriculture was 72.1, and after
the introduction of the system, it was 81.6 (on a 100-point scale).</p>
      <p>The percentage of students refusing to use e-learning technology decreased from 25.8
percent to 7.0 percent.
6</p>
    </sec>
    <sec id="sec-3">
      <title>Conclusion</title>
      <p>The effectiveness of existing e-learning projects does not match the efforts and
resources expended. Students do not want to work with uncomfortable and
nonadaptive learning systems. The revealed list of claims to modern e-learning systems
made it possible to justify the need for a transition to the human-system principle of
designing such technologies. The transition to adaptive learning becomes possible if
the system is described in the required sections and the corresponding databases are
created, as well as if the functional network is used as a dialogue model. The
adaptation process is reduced to the sequential solution of a number of optimization
problems and can be implemented in the environment of a specially developed
agentmanager.</p>
      <p>Using the proposed technology can significantly improve the quality of the
educational process and the attractiveness of e-learning.
nomic quality of human-computer interaction. Eastern-European Journal of Enterprise
Technologies. Ser. “Information technology”, 2/2(86), 4–13 (2017) doi:
10.15587/17294061.2017.97718
38. Lavrov , Е., Volosiuk, A., Pasko, N., Gonchar , V. and Kozhevnikov, G. : Computer
Simulation of Discrete Human-Machine Interaction for Providing Reliability and
Cybersecurity of Critical Systems. In Proceedings of the Third International Conference
Ergo2018: Human Factors in Complex Technical Systems and Environments (Ergo-2018) July
4 – 7, 2018, St. Petersburg Russia, pp.67–70 (2018) doi:10.1109/ERGO.2018.8443846
39. Cacciabue, P. C. : Human error risk management for engineering systems: a methodology
for design, safety assessment, accident investigation and training. Reliability Engineering
&amp; System Safety, 83(2), 229–269 (2014) doi: 10.1016/j.ress.2003.09.013.
40. Havlikovaa, M., Jirglb, M.and Bradac, Z.: Human reliability in man-machine systems.</p>
      <p>Proc.Engineering, 100,1207–1214 (2015)
41. Lavrov, E. and Lavrova, O.: Intelligent adaptation method for human-machine interaction
in modular E-learning systems”, in. Proceedings of the 15th International Conference on
ICT in Education, Research and Industrial Applications. Integration, Harmonization and
Knowledge Transfer. Volume II: Workshops, Kherson, Ukraine, June 12-15,
pp.10001010 (2019)
42. Lavrov, E., Kupenko, O., Lavryk , T. and Barchenko, N.: Organizational Approach to the
Ergonomic Examination of E-Learning Modules. Informatics in Education, 12(1), 107-124
(2013)
43. Lavrov, E., Barchenko, N., Pasko,N. and Tolbatov, A.: Development of Adaptation
Technologies to Man-Operator in Distributed E-Learning Systems. In Proceedings of 2nd
International Conference on Advanced Information and Communication Technologies-2017
(AICT-2017), Lviv, Ukraine, July 4-7, pp. 83-87 (2017)
44. Lavrov, E., Barchenok,N., Lavrova, O. and Savina, N. : Models of the Dialogue “Human
Computer” for Ergonomic Support of E-Learning. In 3rd International Conference on
Advanced Information and Communications Technologies (AICT), Lviv, Ukraine, pp.
187190 (2019) doi: 10.1109/AIACT.2019.8847763
45. Lavrov, E.A., Paderno, P. I., Volosiuk, A. A., Pasko,N.B. and Kyzenko, V.I.: Automation
of Functional Reliability Evaluation for Critical Human-Machine Control Systems. In
2019 III International Conference on Control in Technical Systems (CTS), St. Petersburg,
Russia, 2019, pp. 144-147(2019) doi: 10.1109/CTS48763.2019.8973294.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Mehzbin</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rahman</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Sarma</surname>
          </string-name>
          , P.:
          <article-title>e-Learning for Children on Flora of North East India</article-title>
          . In 2019 Second International Conference on Advanced Computational and
          <article-title>Communication Paradigms (ICACCP), Gangtok</article-title>
          , India, pp.
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
          . (
          <year>2019</year>
          ) doi: 10.1109/ICACCP.
          <year>2019</year>
          .8882971
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Verkhova</surname>
            ,
            <given-names>G. V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Akimov</surname>
            ,
            <given-names>S. V.</given-names>
          </string-name>
          :
          <article-title>Electronic educational complex for training specialists in the field of technical systems management</article-title>
          .
          <source>In Proceedings of IEEE II International Conference on Control in Technical Systems (CTS)</source>
          , pp.
          <fpage>26</fpage>
          -
          <lpage>29</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Costa</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Souza</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Salvador</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Amorim</surname>
          </string-name>
          , R.:
          <article-title>Monitoring Students Performance in E-Learning Based on Learning Analytics and Learning Educational Objectives</article-title>
          .
          <source>In IEEE 19th International Conference on Advanced Learning Technologies (ICALT)</source>
          , Maceió, Brazil, pp.
          <fpage>192</fpage>
          -
          <lpage>193</lpage>
          (
          <year>2019</year>
          ) doi: 10.1109/ICALT.
          <year>2019</year>
          .00067
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Zubov</surname>
            ,
            <given-names>I. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gorin</surname>
            ,
            <given-names>A. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shahgeldyan</surname>
            <given-names>K. I.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Berlova</surname>
            ,
            <given-names>N. V.</given-names>
          </string-name>
          :
          <article-title>The Introduction of ELearning Technologies Using Agile Software Development Methodology</article-title>
          .
          <source>In 2019 International Science and Technology Conference "EastConf"</source>
          , Vladivostok, Russia, pp.
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          (
          <year>2019</year>
          ) doi: 10.1109/EastConf.
          <year>2019</year>
          .8725421
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Blaschke</surname>
            ,
            <given-names>L. M.</given-names>
          </string-name>
          :
          <article-title>Heutagogy and lifelong learning: A review of heutagogical practice and self-determined learning</article-title>
          .
          <source>The International Review of Research in Open and Distributed Learning</source>
          ,
          <volume>13</volume>
          (
          <issue>1</issue>
          ),
          <fpage>56</fpage>
          -
          <lpage>71</lpage>
          (
          <year>2012</year>
          ) doi: 10.19173/irrodl.
          <source>v13i1.1076 2.</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Pereira</surname>
            ,
            <given-names>O. R. E.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Rodrigues</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. J. P. C.</surname>
          </string-name>
          <article-title>: “Survey and analysis of current mobile learning applications and technologies”</article-title>
          .
          <source>ACM Computing Surveys</source>
          ,
          <volume>46</volume>
          (
          <issue>2</issue>
          ),
          <fpage>28</fpage>
          -
          <lpage>35</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Cochrane</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Narayan</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oldfield</surname>
            ,
            <given-names>J. :</given-names>
          </string-name>
          <article-title>iPadagogy: Appropriating the iPad within pedagogical contexts”</article-title>
          .
          <source>International Journal of Mobile Learning and Organisation</source>
          ,
          <volume>7</volume>
          (
          <issue>1</issue>
          ),
          <year>2013</year>
          ,
          <fpage>48</fpage>
          -
          <lpage>65</lpage>
          (
          <year>2013</year>
          ) doi: 10.1504/ijmlo.
          <year>2013</year>
          .051573
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Semingson</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Crosslin</surname>
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Dellinger</surname>
          </string-name>
          , J. :
          <article-title>Microlearning as a tool to engage students in online and blended learning</article-title>
          .
          <source>In Proc of Society for Information Technology &amp; Teacher Education International Conference</source>
          ,pp.
          <fpage>474</fpage>
          -
          <lpage>479</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Pereira</surname>
            ,
            <given-names>O. R. E.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Rodrigues</surname>
            ,
            <given-names>J. J. P. C.</given-names>
          </string-name>
          :
          <article-title>Survey and analysis of current mobile learning applications and technologies”</article-title>
          .
          <source>ACM Computing Surveys</source>
          ,
          <volume>46</volume>
          (
          <issue>2</issue>
          ),
          <fpage>28</fpage>
          -
          <lpage>35</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>AlQahtani</surname>
            ,
            <given-names>A. A. Y.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Higgins</surname>
            ,
            <given-names>S. E. :</given-names>
          </string-name>
          <article-title>Effects of traditional, blended and e-learning on students' achievement in higher education”</article-title>
          .
          <source>Journal of Computer Assisted Learning</source>
          ,
          <volume>29</volume>
          (
          <issue>3</issue>
          ),
          <fpage>220</fpage>
          -
          <lpage>234</lpage>
          (
          <year>2012</year>
          ) doi: 10.1111/j.1365-
          <fpage>2729</fpage>
          .
          <year>2012</year>
          .
          <volume>00490</volume>
          .x
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Subha</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Priya</surname>
          </string-name>
          , S. B. :
          <article-title>A Model For Enhancing The Structure And Strategy In An ELearning Environment</article-title>
          .
          <source>In 2019 3rd International Conference on Computing and Communications Technologies (ICCCT)</source>
          , Chennai, India, pp.
          <fpage>141</fpage>
          -
          <lpage>148</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Islam</surname>
            ,
            <given-names>A. N.:</given-names>
          </string-name>
          <article-title>E-learning system use and its outcomes: Moderating role of perceived compatibility</article-title>
          .
          <source>Telematics and Informatics</source>
          ,
          <volume>33</volume>
          (
          <issue>1</issue>
          ),
          <fpage>48</fpage>
          -
          <lpage>55</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Joshua</surname>
          </string-name>
          , D. :
          <article-title>E-Learning platform system for the department of library and information science</article-title>
          , Modibbo Adama University of Technology,
          <article-title>Yola: A Developmental plan</article-title>
          .
          <source>Information Impact. Journal of Information and Knowledge Management</source>
          ,
          <volume>7</volume>
          (
          <issue>1</issue>
          ),
          <fpage>51</fpage>
          -
          <lpage>69</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Tawafak</surname>
            ,
            <given-names>R. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Romli</surname>
            ,
            <given-names>A. B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Arshah</surname>
            ,
            <given-names>R. B. A.</given-names>
          </string-name>
          :
          <article-title>E-learning Model for Students' Satisfaction in Higher Education Universities: Review Paper</article-title>
          .
          <source>In International Conference on Fourth Industrial Revolution (ICFIR)</source>
          , Manama, Bahrain, pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Khramova</surname>
            ,
            <given-names>L.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsakhaeva</surname>
            ,
            <given-names>A.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Posokhova</surname>
            ,
            <given-names>A.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lavrov</surname>
            ,
            <given-names>E.A.</given-names>
          </string-name>
          ,.
          <string-name>
            <surname>Litvishkov</surname>
            ,
            <given-names>V.M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Vilkova</surname>
            ,
            <given-names>A.V.</given-names>
          </string-name>
          :
          <article-title>Modern managers training in the context of competence approach</article-title>
          .
          <source>The Journal of Social Sciences Research, S5</source>
          ,
          <fpage>194</fpage>
          -
          <lpage>199</lpage>
          (
          <year>2018</year>
          ) doi.10.32861/jssr.spi5.
          <volume>194</volume>
          .199
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Kotova</surname>
            ,
            <given-names>E. E.</given-names>
          </string-name>
          :
          <article-title>Communication Technologies in the Training of IT Specialists in the Digital Economy</article-title>
          . In Communication Strategies in Digital Society Workshop (ComSDS),
          <source>Saint Petersburg, Russia</source>
          , pp.
          <fpage>30</fpage>
          -
          <lpage>33</lpage>
          (
          <year>2019</year>
          ) doi: 10.1109/COMSDS.
          <year>2019</year>
          .8709638
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Atto</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Kotova</surname>
            ,
            <given-names>E. E.</given-names>
          </string-name>
          :
          <article-title>Communication models in the E-learning environment based on intelligent agents</article-title>
          .
          <source>In IEEE Communication Strategies in Digital Society Workshop (ComSDS)</source>
          ,
          <source>St. Petersburg</source>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>6</lpage>
          (
          <year>2018</year>
          ) doi: 10.1109/COMSDS.
          <year>2018</year>
          .8354952
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Morozov</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shelest</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          and.
          <string-name>
            <surname>Proskurin</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Create the Model for Development of Virtual Reality E-Learning</article-title>
          .
          <source>In IEEE 2nd Ukraine Conference on Electrical and Computer</source>
          Engineering (UKRCON), Lviv, Ukraine, pp.
          <fpage>1265</fpage>
          -
          <lpage>1270</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Kotova</surname>
            ,
            <given-names>E. E.</given-names>
          </string-name>
          :
          <article-title>Application of intelligent agents to control the process of blended learning in an educational environment</article-title>
          .
          <source>In IEEE V Forum Strategic Partnership of Universities and Enterprises of Hi-Tech Branches (Science. Education. Innovations)</source>
          ,
          <source>St. Petersburg</source>
          , pp.
          <fpage>39</fpage>
          -
          <lpage>42</lpage>
          (
          <year>2016</year>
          ) doi: 10.1109/IVForum.
          <year>2016</year>
          .7835848
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Verkhova</surname>
            ,
            <given-names>G. V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Akimov</surname>
            ,
            <given-names>S. V.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Gusev</surname>
            ,
            <given-names>A. N.</given-names>
          </string-name>
          :
          <article-title>Information environment for the training of highly qualified personnel in the system of continuous education</article-title>
          .
          <source>In IEEE VI Forum Strategic Partnership of Universities and Enterprises of Hi-Tech Branches (Science. Education. Innovations) (SPUE)</source>
          ,
          <source>St. Petersburg</source>
          , pp.
          <fpage>77</fpage>
          -
          <lpage>80</lpage>
          (
          <year>2017</year>
          ).doi:
          <volume>10</volume>
          .1109/IVForum.
          <year>2017</year>
          .8246056
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Mahajan</surname>
          </string-name>
          , R. K. :
          <article-title>E-learning and pedagogical challenges: A study in student's response</article-title>
          .
          <source>In 4th International Conference on Distance Learning and Education</source>
          , San Juan, PR, pp.
          <fpage>159</fpage>
          -
          <lpage>162</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Cochrane</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Secrets of mlearning failures: confronting reality</article-title>
          . Research in Learning Technology,
          <volume>20</volume>
          ,
          <fpage>123</fpage>
          -
          <lpage>134</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Rajab</surname>
          </string-name>
          , K. D.:
          <article-title>The Effectiveness and Potential of E-Learning in War Zones: An Empirical Comparison of Face-to-Face and Online Education in Saudi Arabia</article-title>
          .
          <source>IEEE Access</source>
          ,
          <volume>6</volume>
          ,
          <fpage>6783</fpage>
          -
          <lpage>6794</lpage>
          (
          <year>2018</year>
          ) doi: 10.1109/ACCESS.
          <year>2018</year>
          .2800164
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24. .
          <string-name>
            <surname>Burov</surname>
            ,
            <given-names>O. Y</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pinchuk</surname>
            ,
            <given-names>O. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pertsev</surname>
            ,
            <given-names>M. A .</given-names>
          </string-name>
          and
          <string-name>
            <surname>Vasylchenko</surname>
            ,
            <given-names>Y. V.</given-names>
          </string-name>
          :
          <article-title>Using the students' state indices for design of adaptive learning systems”</article-title>
          .
          <source>Information Technologies and Learning Tools</source>
          ,
          <volume>68</volume>
          (
          <issue>6</issue>
          ),
          <fpage>20</fpage>
          -
          <lpage>32</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Burov</surname>
            ,
            <given-names>O.Y.</given-names>
          </string-name>
          :
          <article-title>ICT for performance assessment of emergent technologies operators</article-title>
          .
          <source>In Proceedings of the 13th International Conference on ICT in Education, Research and Industrial Applications</source>
          . Integration, Harmonization and
          <string-name>
            <given-names>Knowledge</given-names>
            <surname>Transfer</surname>
          </string-name>
          , Kyiv, Ukraine, May
          <volume>15</volume>
          -18, CEUR-WS
          <year>2017</year>
          , Vol.
          <year>1844</year>
          , pp.
          <fpage>127</fpage>
          -
          <lpage>138</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Bisikalo</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kovalenko</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Palamarchuk</surname>
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Models of Behavior of Agents in the Learning Management System</article-title>
          .
          <source>In IEEE 14th International Conference on Computer Sciences and Information Technologies (CSIT)</source>
          , Lviv, Ukraine, pp.
          <fpage>222</fpage>
          -
          <lpage>227</lpage>
          (,
          <year>2019</year>
          ) doi: 10.1109/STC-CSIT.
          <year>2019</year>
          .8929751
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Bagrova</surname>
            ,
            <given-names>E. V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kruchinin</surname>
            ,
            <given-names>S. V.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Nazarenko</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          :
          <article-title>Quantity Measures of Quality in Higher Education in Russia. How Information Technologies Can Help?</article-title>
          .
          <source>In IEEE International Conference "Quality Management, Transport and Information Security</source>
          ,
          <string-name>
            <surname>Information Technologies</surname>
          </string-name>
          <article-title>" (IT&amp;QM</article-title>
          &amp;IS),
          <source>St. Petersburg</source>
          , pp.
          <fpage>557</fpage>
          -
          <lpage>560</lpage>
          (
          <year>2018</year>
          ) doi: 10.1109/ITMQIS.
          <year>2018</year>
          .8525044
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Iwane</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Saito</surname>
          </string-name>
          , N.:
          <article-title>Reuse of mathematical problems and answers with e-learning system</article-title>
          .
          <source>In IEEE Region 10 Humanitarian Technology Conference, Sendai</source>
          , pp.
          <fpage>227</fpage>
          -
          <lpage>231</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Etelson</surname>
          </string-name>
          ,E.:
          <article-title>Is modern technology killing us?” Truthout (</article-title>
          <year>2014</year>
          ) Available at: http://www.truth-out.org/opinion/item/26295-is
          <article-title>-modern-technology-killing-us</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Alqahtani</surname>
          </string-name>
          , N. et al. :
          <article-title>Internet risks for children: Parents' perceptions and attitudes: An investigative study of the Saudi Context</article-title>
          .
          <source>In Internet Technologies and Applications</source>
          (ITA), Wrexham, pp.
          <fpage>98</fpage>
          -
          <lpage>103</lpage>
          (
          <year>2017</year>
          ) doi: 10.1109/ITECHA.
          <year>2017</year>
          .8101918
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Alqahtani</surname>
            ,
            <given-names>N. :</given-names>
          </string-name>
          <article-title>A state of the art review of Internet risks on children</article-title>
          .
          <source>In 2nd International Conference on Anti-Cyber Crimes (ICACC)</source>
          , Abha, pp.
          <fpage>108</fpage>
          -
          <lpage>112</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Žufić</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Žajgar</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Prkić</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Children online safety</article-title>
          .
          <source>In 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)</source>
          , Opatija, pp.
          <fpage>961</fpage>
          -
          <lpage>966</lpage>
          (
          <year>2017</year>
          ) doi: 10.23919/MIPRO.
          <year>2017</year>
          .7973563
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Tsirtsis</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsapatsoulis</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stamatelatos</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Papadamou</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Sirivianos</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Cyber security risks for minors: A taxonomy and a software architecture</article-title>
          .
          <source>In 11th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)</source>
          , Thessaloniki, pp.
          <fpage>93</fpage>
          -
          <lpage>99</lpage>
          (
          <year>2016</year>
          ) doi: 10.1109/SMAP.
          <year>2016</year>
          .7753391
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Pinchuk</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burov</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lytvynova</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Learning as a Systemic Activity</article-title>
          .
          <source>Advances in Intelligent Systems and Computing</source>
          , Vol.
          <volume>963</volume>
          , pp.
          <fpage>335</fpage>
          -
          <lpage>342</lpage>
          , doi.org/10.1007/978-3-
          <fpage>030</fpage>
          - 20135- 7_
          <fpage>33</fpage>
          ). URL: link.springer.com/content/pdf/10.1007%
          <fpage>2F978</fpage>
          -
          <fpage>3</fpage>
          -
          <fpage>030</fpage>
          -20135- 7_
          <fpage>33</fpage>
          .pdf. (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Popovich</surname>
            ,
            <given-names>P. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gubinskiy</surname>
            ,
            <given-names>A. I.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Kolesnikov</surname>
            ,
            <given-names>G.M.</given-names>
          </string-name>
          :
          <article-title>Ergonomic support of astronauts' activities</article-title>
          . Мoscow, Russia: Mechanical Engineering,
          <year>1985</year>
          . (In Russian).
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Lavrov</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Pasko</surname>
          </string-name>
          , N. :
          <article-title>Automation of Assessing the Reliability of Operator's Activities in Contact Centers that Provide Access to Information Resources</article-title>
          .
          <source>In Proceedings of the 14th International Conference on ICT in Education, Research and Industrial Applications. Integration, Harmonization and Knowledge Transfer</source>
          , vol. I: Main Conference. - Kyiv, Ukraine, May
          <volume>14</volume>
          -
          <issue>17</issue>
          , pp.
          <fpage>445</fpage>
          -
          <lpage>448</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Lavrov</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barchenko</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pasko</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Borozenec</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>Development of models for the formalized description of modular e-learning systems for the problems on providing ergo-</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>