<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Artificial Intelligence as an Instrument of Successful Pedagogical Monitoring and Affect Assessment for Disa- bled People Employment*</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>National Research Tomsk Polytechnic University</institution>
          ,
          <addr-line>Lenina prosp. 30, 634050 Tomsk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The article presents the influence of artificial intelligence on the quality of the criteria-diagnostic apparatus of the system of pedagogical monitoring. The necessity of creating automated tools for assessing the existing competencies of the listener and necessary for participating in the process of mastering the discipline is noted; automated diagnostic systems in digitalization to form an individual training route. The authors have developed methods for providing an automated process of pedagogical monitoring, describe the principles of work of the developed methods from the technical and pedagogical side, and also give examples of their implementation. It also offers the implementation of an expert assessment method using image theory and machine learning. The article confirms that AI allows you to expand the range of possibilities of pedagogical monitoring in digitalization, while maintaining the principles of traditional pedagogy. Based on the proposed technology and the creation of a training automated system, the proposed approach will solve this problem and improve the accuracy of the individual educational route and disabled people employment.</p>
      </abstract>
      <kwd-group>
        <kwd>Digital transformation</kwd>
        <kwd>Learning platform</kwd>
        <kwd>E-learning</kwd>
        <kwd>Pedagogical monitoring</kwd>
        <kwd>Competency matrix</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>The structural components of the existing information educational environment
including the up-to-date computing aids due to difficulties in relation to analysis of texts
with competency subject don’t provide the possibility for the teacher to manage the
diagnostics of the students’ results and control the student knowledge.</p>
      <p>None of the organizations will be able to maintain the high growth rates without
qualified employees. Considering this the stable trend on study issues concerning
motivation theories (as one of the main tasks during human resource management) for
employees in order to increase their labour efficiency is currently formed in the
organizations. Moreover, the organizations starts working out issues concerning
improvement of the personnel professional competency as one of the elements
influencing the personal motivation aspect of each employee and the whole staff in general. In
fact, the process of development and improvement of the professional competency for
the whole staff will contribute to increase in the level of motivation environment in
the organization.</p>
      <p>Under current conditions informational support and improvement of education
become the most important means for implementation of new educational paradigm,
creation of favourable conditions for achievement of new educational results.
Moreover, the educational process is considered as forming the special information
and educational environment based on application of achievement in the up-to-date
information technologies. But the components of the existing information and
educational environment don’t consider non-linear nature of the dependences between
competencies, when the superposition principle is violated, and this unavoidably
results in system errors and restricted possibilities for use of e-learning functional for
more exact knowledge diagnostics.</p>
      <p>
        At the present time the scientific works in the area of automated knowledge
diagnostic systems only partially cover the certain problems. Therefore, the system, where
all scientific methods will be combined in this trend, shall be developed. A substantial
contribution to development of artificial intelligence and computer-aided learning for
informational support of the education and creation of more exact knowledge
diagnostic systems were made by the foreign scientists: B. Widrow, P. J. Werbos, S.
Papert and domestic ones: A.B. Novikov, A.N. Gorban, V.A. Okhonin, V.N. Vapnik,
Yu.I. Zhuravlev, K.V. Rudakov, etc. [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1-3</xref>
        ].
2
      </p>
      <p>The Algorithm of Successful Pedagogical Monitoring with the
Help of AI</p>
      <p>The scientific idea consists in development of knowledge diagnostic system, which
would allow evaluating knowledge not only by the results of testing or ready canned
responses, but also diagnosing any responses of the students and comparing the
results with the expert evaluation. For this purpose, it is necessary to create information
classifier including linguistic structures. This classifier will allow forming the pattern
of the interesting expert opinion for search of the more approximate response.
Moreover, it is necessary to create the algorithm for collection and selection of the most
relevant materials according to the user’s request based on the developed information
classifier.</p>
      <p>It has been experimentally proven that when using the integrated system of
semantic analysis accuracy of search is significantly increased in comparison with separate
use of the semantic analysis methods, as well as that use of SVD decomposition
during implementation of matrix LSA-algorithm efficiency of rules construction for
obtaining of definitions and relevant terms from the texts containing materials for search
of the more approximate replay of the student is increased.</p>
      <p>Based on the obtained algorithm, single adapted software has been created for
students’ knowledge diagnostics. The program analyses the text inside the document and
compares it with the request. Thus, semantic kernel is formed. When adding the
certain document/response into the kernel, it is indexed, the program form the semantic
pattern by one or another criteria as per the information in the header and any
sections, identifies the key words and forms the tree/cloud from them separating the
document semantic kernel. The request can be composed in standard form and then
compared with the base upon conversion by the program into the semantic tree. In case of
inclusions, one or other documents meeting the request will be issued.
For the set problems the original competency models shall be created, as well as a
new approach, which will allow determining previously unforeseen competencies for
different categories of users considering different presentations of connections both
between users and between the complexes of expert evaluations.</p>
      <p>It is necessary to implement the special database management system and create
the algorithm of intelligent search for the complex of learning programs allowing
software management for the scheme of these aids, as well as user self-learning.
Development of neural networks allows implementing the principle of education
democratization and development of the individual track, as there is a possibility of
individual approach to the student requests. Thus, for example, if in its result the listener
represents a part of words, which is in the expert card, during execution of the case
task, then the algorithm of the neural network will be able to easily recognize these
words and give the result. The present-day development of the pattern recognition
algorithms with high accuracy allows diagnosing terms, figures, tables, etc. Let’s
make one of the examples of our experiment. Table 1 shows the results of case
execution, which is intended for development of communicative competency, where m –
additional features for more accurate diagnostics of the result.</p>
      <p>Table 1 shows that to organize the process of forming an individual route
using machine learning theory, a teacher needs only to form a database of competencies
(a list of competencies) that a student can acquire when passing the case.</p>
      <p>This method gives to electronic space the following functionality: the
interface adapted to the user displays a list of competencies, when one of them is selected,
there is a selection of business cases and business games that must be performed to
develop the selected competence; determination of the level of existing competence
and the potential for its growth.</p>
      <p>If we compare the expert opinion or assessment of this case and the result of
that will be displayed in their work the listener, then the matrix relevance of the
results will be in the s look as shown in Figures 1, 2.</p>
      <p>The experiment has shown that the developed diagnostics system works with high
accuracy and the ratio of the expert opinion and the listener response is 0.999999.
High value of correlation factor means that the student has shown a high positive
result when using the case technology.</p>
      <p>Many authors in their works offer several technical possibilities with the help of
which it is possible to implement the search for cases according to the development of
the required competence, for example: the clustering method, the method of the latent
semantic algorithm, but it was experimentally revealed that the Template matching
method described above gives more clear results. With the advent of opportunities for
using information technology methods in pedagogy, it is possible to build a trajectory
of individual learning, both for the student himself, and reduce and optimize the
teacher's work (presentation of material, diagnostics of knowledge, building
communications, creating groups, interactivity).
2.1</p>
      <p>Example of Developed Method Affect Assessment for Disabled People
Employment</p>
      <p>For The developed method, which includes the special database management
system and the algorithm of intelligent search for the complex of learning programs
allowing software management for the scheme of these aids, as well as user
selflearning, is a tool for implementation of the continuous education for disabled people
and their employment. The algorithm affect assessment is confirmed by the
correlation methods and regression. Let’s consider the example of such an algorithm (Figure
3).</p>
      <p>– to ensure the individualization and personalization of the learning process
(optimal methods, forms, and teaching methods, including the organization of project
activities of students, the use of the potential of e-learning, etc.) through:
1) A large volume of educational material and its availability;
2) Variability of formats and forms of presentation of educational content:
inclusion of asynchronous elements of e-learning, offering a wide range of types of tasks,
etc. The more variations in content management, the more opportunities for students
to demonstrate their knowledge and develop the necessary competencies;
3) A variety of forms of interactive interaction between subjects of the information
and pedagogical platform and elements of electronic educational content;
4) Adjustment of the pace of learning and navigation system (structure, design,
toolkit): use headings on each web page to organize e-learning content and avoid
confusion; providing students with extra time to complete assignments;
5) Designing ready-made templates for placing a wide range of material without
the need to master a specialized design, both for the listener and the teacher;
6) Flexible educational content so that you can use the same educational program
for different purposes.</p>
      <p>The formation of ICT competencies is becoming critically important for every
teacher and student in the field of education. A superficial knowledge of the theory of
AI and machine learning will allow solving many pedagogical problems (for example,
pedagogical monitoring of project activities and the use of case technologies for
selflearning in the context of digital transformation). The study showed that in order to
organize work in electronic space using AI and machine learning methods, it is
enough for a teacher to be able to:
– to form a competence base according to the discipline assigned to it,
– to upload educational and methodological materials into ready-made templates,
– to form a database of expert assessments to compare learning outcomes using
case technologies,
– to use various types of communication tools (wiki, skype, zoom, etc..).</p>
      <p>In the field of information technology, there is an imbalance between the
requirements of the labour market and the actual training of graduates, which is why it is
necessary to change the trajectory and automate many pedagogical processes in order
to eliminate the backlog of curricula from the requirements of the labour market. The
most suitable solution is to create a unified electronic platform, the database of which
has a certain set of competencies that meet the needs of graduates. Thus, an individual
educational track is designed. It is for this reason that a lot of online courses have
appeared today, in particular massive open online courses (MOOCs), but their design
and creation does not speak of the successful implementation and organization of
pedagogical monitoring.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Zhu</surname>
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>An efficient learning algorithm for improving generalization performance of radial basis function neural networks</article-title>
          .
          <source>Neural Networks</source>
          . Vol.
          <volume>13</volume>
          , no.
          <volume>13</volume>
          ,
          <fpage>545</fpage>
          -
          <lpage>553</lpage>
          (
          <year>2000</year>
          ) doi: 10.1016/s0893-
          <volume>6080</volume>
          (
          <issue>00</issue>
          )
          <fpage>00029</fpage>
          -
          <lpage>0</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Schwenker</surname>
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kestler</surname>
            <given-names>H. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Palm</surname>
            <given-names>G.</given-names>
          </string-name>
          <article-title>P: Three learning phases for radial basis function networks</article-title>
          .
          <source>Neural Networks</source>
          . Vol.
          <volume>14</volume>
          , no.
          <volume>14</volume>
          ,
          <fpage>439</fpage>
          -
          <lpage>458</lpage>
          (
          <year>2001</year>
          ) doi: 10.1016/s0893-
          <volume>6080</volume>
          (
          <issue>01</issue>
          )
          <fpage>00027</fpage>
          -
          <lpage>2</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Freitas</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oliver</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Does E-learning Policy Drive Change in Higher Education? A Case Study Relating Models of Organizational Change to E-Learning Implementation</article-title>
          .
          <source>Journal of Higher Education Policy and Management</source>
          . Vol.
          <volume>27</volume>
          , no.
          <issue>1</issue>
          ,
          <fpage>81</fpage>
          -
          <lpage>95</lpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Thakral</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Manhas</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kumar</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Virtual Reality and M-Learning</article-title>
          .
          <source>International Journal of Electronic Engineering Research</source>
          . Vol.
          <volume>2</volume>
          , no.
          <issue>5</issue>
          ,
          <fpage>659</fpage>
          -
          <lpage>661</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Singatulin</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grishchenko</surname>
            ,
            <given-names>E.A.</given-names>
          </string-name>
          :
          <article-title>The Use of Multispectral Diagnostic Systems in a Virtual Learning Environment</article-title>
          .
          <source>Information Technologies in Providing New Quality of Higher Education. Coll. scientific. Art</source>
          . Moscow: ITSPKPS Publ., vol.
          <volume>2</volume>
          ,
          <fpage>246</fpage>
          -
          <lpage>249</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Serditova</surname>
            <given-names>N.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Luchinina</surname>
            <given-names>N.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pavlova</surname>
            <given-names>L.S.</given-names>
          </string-name>
          :
          <article-title>Project approach to the organization of education activities at the university</article-title>
          .
          <source>Higher Education in Russia. No. 5</source>
          ,
          <fpage>141</fpage>
          -
          <lpage>147</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Than</surname>
            ,
            <given-names>C.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Werner</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          :
          <article-title>Designing and Evaluating ENLearning in Higher Education: A Review and Recommendations</article-title>
          .
          <source>Journal of Leadership and Organizational Studies</source>
          . Vol.
          <volume>11</volume>
          , no.
          <issue>2</issue>
          ,
          <fpage>15</fpage>
          -
          <lpage>25</lpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Segal</surname>
            <given-names>A.P.</given-names>
          </string-name>
          : «Digit»
          <article-title>and «digital society» as simulacra of XXI century (On the terminological rigor in the description of communication processes). Professional education in the modern world</article-title>
          .
          <source>No. 3</source>
          (
          <issue>9</issue>
          ),
          <fpage>2898</fpage>
          -
          <lpage>2908</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Zaripova</surname>
            <given-names>R.S.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>O.A.</given-names>
            <surname>Pyrnova</surname>
          </string-name>
          <article-title>: The features and development trends of modern engineering education. Modern studies of social issues</article-title>
          .
          <source>No.8</source>
          (
          <issue>9</issue>
          ),
          <fpage>43</fpage>
          -
          <lpage>46</lpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Boronenko</surname>
            ,
            <given-names>T.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fedotova</surname>
            ,
            <given-names>V.S.</given-names>
          </string-name>
          :
          <article-title>Pedagogical Monitoring of Student Research Activity Performance Via Electronic Portfolio</article-title>
          .
          <article-title>Higher Education in Russia</article-title>
          . No.
          <volume>5</volume>
          (
          <issue>212</issue>
          ),
          <fpage>118</fpage>
          -
          <lpage>122</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Bershadskaya</surname>
            ,
            <given-names>M.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Serova</surname>
            ,
            <given-names>A.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chepurenko</surname>
            ,
            <given-names>A.Yu.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zima</surname>
            ,
            <given-names>E.A.</given-names>
          </string-name>
          :
          <article-title>Competence-based Approach to the Evaluation of Learning Outcomes: Russian Experience in Sociological Education. Higher Education in Russia</article-title>
          . Vol.
          <volume>28</volume>
          . No.
          <volume>2</volume>
          ,
          <fpage>38</fpage>
          -
          <lpage>50</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Romanova</surname>
            ,
            <given-names>M.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karaseva</surname>
            <given-names>A. E.</given-names>
          </string-name>
          :
          <article-title>Modern methods for competencies and personallyprofessional abilities behavioral component assessment. Scientific works of the Kuban State Technological University</article-title>
          . No.
          <volume>2</volume>
          ,
          <fpage>285</fpage>
          -
          <lpage>299</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Andreev</surname>
            <given-names>A.A.</given-names>
          </string-name>
          :
          <article-title>Pedagogy in the Information Society</article-title>
          . Higher Education in Russia. No.
          <volume>11</volume>
          ,
          <fpage>113</fpage>
          -
          <lpage>117</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Shaposhnikova</surname>
            ,
            <given-names>T.L.</given-names>
          </string-name>
          :
          <article-title>Modern models and assessment method of higher educational establishment graduate competitiveness. Scientific works of the Kuban State Technological University</article-title>
          . No.
          <volume>8</volume>
          ,
          <fpage>385</fpage>
          -
          <lpage>398</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Khutorskoy</surname>
            ,
            <given-names>A.V.</given-names>
          </string-name>
          :
          <article-title>Technology of the Design of General and Subject-Based Competencies</article-title>
          . Eidos -
          <source>Internet journal. No. 4</source>
          . (
          <year>2005</year>
          ) http://www.eidos.ru/journal/2005/1212.htm
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>