<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>EVALUATION THE PSYCHOLOGICAL STATE OF A LEARNER IN THE E-LEARNING SYSTEM*</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Ryazan State Radio Engineering University</institution>
          ,
          <addr-line>Ryazan</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>91</fpage>
      <lpage>97</lpage>
      <abstract>
        <p />
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Introduction</p>
      <p>
        Nowadays, e-learning systems or distance learning has become very popular among part-time
students or for independent works of full-time students. The users study the data proposed to them on
HTML pages in those systems. The advantages of using those systems not only include the ability of the
student to choose an optimal schedule, but also the possibility to personalize [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and adapt the learning
process, taking into account the individual properties of the learner, and his current training level [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. An
analysis of works dedicated to improving the efficiency of e-learning systems, has shown that they are
mainly directed precisely at evaluating the initial or the current level of knowledge and skills of the students.
      </p>
      <p>
        Courses in which the individual abilities, knowledge and skills of the student are evaluated are
called intellectual or adaptive [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. Approaches to the creation of adaptive and intellectual technologies for
training courses on the Web-platform, that will enable the development of a curriculum based on the level
of the learner are porposed in [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ]. The plugin for the adaptation of the course structure built in the
distance learning management system is described in [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ]. It was proposed in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] to take into account the
properties of the learner while creating the test tasks.
      </p>
      <p>The disadvantages of e-learning include the fact that on-screen reading is a labor-intensive process,
which creates a large load on the brain. Failure to monitor the psychophysiological condition of the learner
may lead to him operating in the system in a non-optimal condition, which may occur due to a low efficiency
level during the course of learning over time, as well as, due to the fact that his state before the course was
not optimal.</p>
      <p>Since psychophysiological state affects effective learning it is relevant to evaluate the state of the
learner during training. Proper fulfilment of this task can improve the efficiency of effective learning.</p>
      <p>The aim of the work is the development of means to evaluate the psychophysiological state of the
learner and e-learning system models considering its state.</p>
      <p>In order to attain the goal set, it is proposed to use psychophysiological testing, recording and
analysis of bioelectric signals of the learner, state models to assess the ability of the learner to work
effectively in the system, fatigue and emotional stress.</p>
      <p>Evaluation of the initial state of the learner</p>
      <p>Using the evaluation of the initial state will allow to predict the ability for effective learning of the
learner before he starts to work on the system. This can be accomplished through the application of the
model, which according to the indicator values for cognitive processes, produced as a result of
psychophysiological testing, will predict the probability of successful learning.</p>
      <p>Based on the data obtained in a series of experiments, a logistic model (classifier) was built for the
predicted work with data on the values of performance, memory and attention to be a success. These
cognitive processes were chosen based on the fact that they are basic for data processing.</p>
      <p>Experimental method
a. Subjects. The subjects were 30 students of the 2-5 courses of Ryazan State Radio
Engineering University. The number of male students - 19, female - 11. The average age of the subjects was
20.4 years with a standard deviation of 0.72.</p>
      <p>
        b. Material. Kraepelin test was used in the experiment for ability, Bourdon-Anfimov test for
attention and memorization [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and a test to understand the technical and scientific meaning of the
material [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>c. Investigation procedure. Experiments were carried out for 3 days under the same
conditions in groups of 8-12 people. After the meaning was explained and the subjects of the experiment
briefed, trial tests for memory, attention and performance were held. The subjects reported the two letters
they had to find and delete in the test for attention. Then they had to reproduce 10 two-digit numbers that
they had to remember for 30 seconds within 1 minute. The number of correctly reproduced numbers was
recorded for each test. After 4 minutes of rest, Kraepelin test was carried out, which involves adding two
sequences of numbers, and then, after 4 minutes - Bourdon-Anfimov test was proposed, where for a
sequence of letters, two given letters had to be found and deleted in their own way. The total number of
additions made and the number of correct / incorrect operations, the number of scanned letters, the number
of true / false crossed out letters were recorded. A small unfamiliar text from the technical discipline was
proposed as a test for work success evaluation, which they had to learn for 2 minutes, and then reproduce
within 1 minute, setting out the basic content and meaning. The result of this test was evaluated on a scale
of "Pass/Fail" response for analyzing the text, whereby "Pass" was attributed when a large part of the
content and meaning of the original text was transferred.</p>
      <p>Obtained results</p>
      <p>According to the results of the experiment 30 observation sets were formed, based on which the
following parameters were calculated:</p>
      <p>x1 - performance ratio as the ratio of the number of additions made in Kraepelin test for the first
half of the test time to the number of operations for the second half,
x2 – the average addition speed in the Kraepelin test,
х3 - accuracy index in the test for attention, which is a ratio of the difference between the number of
correct letters crossed out and the number of errors (omissions and unnecessary crossed out) to the number
of letters that have to be crossed,
х4 - concentration ratio of attention as a result of the Bourdon-Anfimov test,
х5 - memory ratio representing the percentage of correctly stored and reproduced two-digit
numbers,</p>
      <p>Y – the result of successfully reproducing the proposed data on the scale «Pass/Fail».</p>
      <p>The results of the subjects of the experiment are shown in Fig. 1. Each point corresponds to the
results of a specific subject, the effect of the average speed of addition x2 and the accuracy indices x3 are
shown for the success in reproducing the data on a «Pass/Fail» scale, whereby the size of the point is directly
proportional to the work-ability coefficient x1. It can be seen that those subjects with low values for precision
work, average addition speed and performance coefficient obtained «Fail». Among those with «Fail» there
were those with high precision - indices of work and average addition speed, however, they had low indices
for attention and memory. In addition, a small number of subjects were unable to understand the meaning
of the text submitted, although they had average values for attention and memory.</p>
      <p>The Y value evaluates the success of the work with data and accepts two values: «Pass» and «Fail».
For its analytic description the logistic regression can be used
y  x1, x2 , x3 , x4 , x5  </p>
      <p>e f x1,x2 ,x3 ,x4 ,x5 
1  e f x1,x2 ,x3 ,x4 ,x5  ,
y  x1, x2 , x3 , x4 , x5  
which depending on the values of x1, x2, x3, x4, x5 form the value of y for the interval 0 to 1. The obtained value
for y is the predicted probability of successful work with data. In order to move to Y it is required to have a
threshold value level Δy and create the value of Y according to the rule:</p>
      <p>Fail, if y  y;
Y  </p>
      <p>Pass, if y  y. .</p>
      <p>The regression analysis of data was performed in the statistic packet R. Different possible functions
f(x1, x2, x3, x4, x5) were considered, where the function for each was defined as a percentage of proper
classification and descriptive statistics. It was found that when using a logistic regression type
ea0 a1x1 a2x2 a3x3  a4 x4 a5x5 1a15x1 a25x2 a12x1x2
1  ea0  a1x1  a2x2  a3x3 a4x4 a5x5 1a15x1 a25x2 a12x1x2
and a threshold value Δy equaling 0.62, it is possible to properly predict the success of the work with data
for 90% of the test subjects. The classification was wrong for 10% of the subjects, which could be linked to
the fact that these subjects «carelessly» passed the test. This model has a value of the Akaike information
criterion (AIC) equal to 37.975.</p>
      <p>We estimate the predictive ability of the model with the help of ROC-analysis. The Fig. 3 shows the
ROC-curve. The area under the ROC-curve is equal to 0.9276, which indicates good prognostic properties of
the developed model.</p>
      <p>If upon prediction, the value obtained is Y = «Fail», this may show the absence of readiness for
learning or poor psychophysiological state. In any case, the learner needs to be prepared to work in the
system.</p>
      <p>This is how a model was obtained to evaluate the success of a learner to effectively process data in
the e-learning system according to the valued of cognitive process indices. It is expected to improve the
model in the future, performing more experiments and adding other cognitive process indices to the model.</p>
      <p>If a browser is used for the e-learning system, the given psychophysiological tests can be in the form
of plugins written on JavaScript or PHP. Fig. 3 shows an example of a Bourdon-Anfimov test.</p>
      <p>Psychophysiological testing cannot be used for the dynamic evaluation of the current
psychophysiological state of the learner while working in the e-learning system as the learner needs to be
directed to the test as a distraction. Bioelectric signal analysis can be used, in particular, galvanic skin
response (GSR). This requires hardware to record the GSR signal and software to analyze it. The software
part can be in the form of a plugin in the e-learning system and for a modified manipulator «mouse» can be
used as hardware.</p>
      <p>It is proposed to use a schematic based on voltage divider from the resistance of the palm portion
and a resistor embedded in the arm to record the GSR signal. The distance between the index and middle
fingers can be used. In that case, the GSR electrodes may be arranged on the left and right buttons of the
manipulator «mouse». A layout of this manipulator was created, allowing the transfer galvanic skin response
signals to a PC (Fig. 4).</p>
      <p>
        In order to evaluate the psychophysiological state of the learner based on GSR analysis, two
components should be isolated: the tone and the phase. The tone is a low frequency component which
characterizes the psychophysiological state of the person. Accordingly, the smaller the resistance of the skin,
the higher the activity of the nervous system, reduction of skin resistance indicates that the person is tired.
The phase is a high-frequency which characterizes the fluctuation of the signal under the influence of
emotionally significant factors. Accordingly, a large number of signal fluctuations per unit of time may be
indicative of a negative impact on the current human psycho-emotional factors. Using a combination of tonic
and phasic components, a conclusion about the current functional status of the learner can be made. An
algorithm can be used for GSR analysis as in [
        <xref ref-type="bibr" rid="ref12 ref13 ref14">12-14</xref>
        ].
      </p>
      <p>Threshold levels for the components of GSR can be set based on the value of the GSR signal at the
time of joining the e-learning system. In this case the results of psychophysiological testing with skin
resistance values of the learner can compared.</p>
      <p>The network model of the e-learning system work</p>
      <p>The following algorithm can be proposed for the e-learning system using the developed hardware
and software and logistic model to control and evaluate the psychophysiological state of the learner:
1. Implementation of psychophysiological testing before starting to work;
2. Predicting of the success of this training based on the logistic model;
3. If the result of the prediction is poor, the learner is prepared to work in the system until after
repeated testing the psychophysiological prediction result is satisfactory;</p>
      <p>4. With a satisfactory prognosis the learner is allowed to work in the e-learning system. Based on the
analysis and evaluation of GSR level critical levels of the functional status indicators are formed;
5. While working in the system, GSR is recorded and analyzed and the indicators of the current
functional status of the learner are controlled. If as a result of such a control, the values of the indicators of
the functional state reach critical levels, in particular, fatigue, then the learner is banned from the system
and is given an interval for rest and recovery (Fig. 5).</p>
      <p>We create a Petri network model to describe the working of the e-learning system based on the
psychophysiological state of the learner.</p>
      <p>We single out the set {Bi} of possible states of the learner in the process of interaction with the
elearning system:</p>
      <p>B0 – the initial state of the learner before entering the system,</p>
      <p>B1 – preparation of the learner for training in case the prediction for successful training is not
satisfactory,</p>
      <p>B2 – permission to work in the e-learning system,
B3 – work in the e-learning system,
B4 – rest and time-off while working in the e-learning system.</p>
      <p>Set {dj} of possible transitions, describing the transition from one state to another, as follows:
d0 – initial psychophysiological test, allowing to predict the success of learning in the system,
d1 – beginning of work in the e-learning system,
d2 – control of the current functional state while working in the system.</p>
      <p>GSR level</p>
      <p>Study - fatigue accumulation</p>
      <p>Recreation</p>
      <p>First level
Critical level</p>
      <p>Start learning bPaanusoefssttaurdty- bPeaguisne oefndstu-dy
Fig. 5. The principle of using GSR-level changes to organize work in the e-learning system
Time
Then the Petri network model will be a as follows (Fig. 6).</p>
      <p>A demo version of the course was created in Moodle system with a module that allows to analyze
the level of galvanic skin response, recorded with a manipulator «mouse» and affect the availability of the
various components of the course accordingly, denying access for a poor psychophysiological state (Fig. 7).</p>
      <p>B0</p>
      <p>B2
d1</p>
      <p>B3
d2</p>
      <p>B4</p>
      <p>The article showed the means and ways to improve the efficiency of the e-learning process based
on the evaluation of the psychophysiological state of the learner. Logistic models were proposed to evaluate
the readiness of the pupil to work in the e-learning system. In case the results of prediction are not
satisfactory, the student may be asked to train for work in the system and re-tested for the acquisition of the
appropriate attitude towards work. In the future we plan to improve the model, conduct a large number of
experiments and add more cognitive process indices to the model, including the use of fuzzy logic to build
the model.</p>
      <p>GSR control of the learner during the learning process will allow to assess the dynamics of his
psychophysiological state, including the development of fatigue during training, which later can be used to
optimize the e-learning process and the selection of appropriate teaching loads.</p>
      <p>The proposed hardware and software are described using the Petri network model, which is
intended for the formalization of the system. Using this model, a dynamic description of the working process
of the e-learning system can be made, based on the functional state of the learner, to illustrate the transition
of the system from one state to another under certain conditions.</p>
      <p>References
Varnavsky Alexander Nikolaevich, Ph.D., assistant professor of department of automation of information and technological processes</p>
      <p>Ryazan State Radio Engineering University, varnavsky_alex@rambler.ru.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>K.</given-names>
            <surname>Chrysafiadi</surname>
          </string-name>
          , M. Virvou, “
          <article-title>Dynamically Personalized E-Training in Computer Programming and the Language C,”</article-title>
          IEEE Transactions on Education,
          <year>2013</year>
          , Volume:
          <volume>56</volume>
          , Issue: 4, pp.
          <fpage>385</fpage>
          -
          <lpage>392</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>S.</given-names>
            <surname>Kopeinik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nussbaumer</surname>
          </string-name>
          , L.-
          <string-name>
            <surname>C. Winter</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Albert</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Dimache</surname>
          </string-name>
          , T. Roche, “
          <article-title>Combining Self-Regulation and Competence-Based Guidance to Personalise the Learning Experience in Moodle</article-title>
          ,”
          <source>2014 IEEE 14th International Conference on Advanced Learning Technologies</source>
          ,
          <year>2014</year>
          , pp.
          <fpage>62</fpage>
          -
          <lpage>64</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>C.</given-names>
            <surname>Hampson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Conlan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Wade</surname>
          </string-name>
          , “
          <article-title>Challenges in Locating Content</article-title>
          and
          <article-title>Services for Adaptive eLearning Courses,” Advanced Learning Technologies (ICALT</article-title>
          ),
          <year>2011</year>
          11th IEEE International Conference on,
          <year>2011</year>
          , pp.
          <fpage>157</fpage>
          -
          <lpage>159</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>R.</given-names>
            <surname>Shahin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Barakat</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Mahmoud</surname>
          </string-name>
          , M. Alkassar, “Dynamic Generation of Adaptive Courses,” Information and Communication Technologies:
          <source>From Theory to Applications</source>
          ,
          <year>2008</year>
          .
          <source>ICTTA</source>
          <year>2008</year>
          . 3rd International Conference on,
          <year>2008</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>H.T.</given-names>
            <surname>Kahraman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Sagiroglu</surname>
          </string-name>
          , I. Colak, “
          <article-title>Development of adaptive and intelligent web-based educational systems</article-title>
          ,
          <source>” Application of Information and Communication Technologies (AICT)</source>
          ,
          <year>2010</year>
          4th International Conference on,
          <year>2010</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>P.</given-names>
            <surname>Robert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Livia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.M.</given-names>
            <surname>Cisar</surname>
          </string-name>
          , “
          <article-title>Examples of adaptive Web-based educational systems</article-title>
          ,
          <source>” 2009 7th International Symposium on Intelligent Systems and Informatics</source>
          ,
          <year>2009</year>
          , pp.
          <fpage>297</fpage>
          -
          <lpage>300</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>H.</given-names>
            <surname>Moutachaouik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Douzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Marzak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Behja</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ouhbi</surname>
          </string-name>
          , “
          <article-title>Recommendation plugin to facilitate student learning of the platform e-learning,</article-title>
          <source>” 2011 3rd International Conference on Next Generation Networks and Services (NGNS)</source>
          ,
          <year>2011</year>
          , pp.
          <fpage>6</fpage>
          -
          <lpage>11</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>I.A.</given-names>
            <surname>Kautsar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Musashi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.-I.</given-names>
            <surname>Kubota</surname>
          </string-name>
          , K. Sugitani, “
          <article-title>Developing Moodle plugin for creating learning content with another REST function call</article-title>
          ,”
          <source>2014 IEEE Global Engineering Education Conference (EDUCON)</source>
          ,
          <year>2014</year>
          , pp.
          <fpage>784</fpage>
          -
          <lpage>787</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>I.H.</given-names>
            <surname>Galeev</surname>
          </string-name>
          , “
          <article-title>Problems and experience in designing ITS,” International e-magazine “Educational Technology</article-title>
          &amp;
          <string-name>
            <surname>Society (Educational Technology</surname>
          </string-name>
          &amp; Society)”,
          <year>2014</year>
          , Vol.
          <volume>17</volume>
          , Issue 4, pp.
          <fpage>526</fpage>
          -
          <lpage>542</lpage>
          . URL: http://ifets.ieee.org/russian/periodical/journal.html
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>A.N.</given-names>
            <surname>Varnavsky</surname>
          </string-name>
          , “
          <article-title>Research of preferences dependence in hierarchical text menus of user interface from performance cognitive processes</article-title>
          ,
          <source>” 2016 Cognitive Sciences, Genomics and Bioinformatics (CSGB)</source>
          ,
          <year>2016</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>A.N.</given-names>
            <surname>Varnavsky</surname>
          </string-name>
          , “
          <article-title>Research of preference in playback speed of learning video material depending on indicators of cognitive processes</article-title>
          ,
          <source>” 2016 Cognitive Sciences, Genomics and Bioinformatics (CSGB)</source>
          ,
          <year>2016</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12. D.G. Domingues,
          <string-name>
            <given-names>C.J.</given-names>
            <surname>Miosso</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.E.</given-names>
            <surname>Paredes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.F.</given-names>
            <surname>Rocha</surname>
          </string-name>
          , “
          <article-title>Module for the acquisition and processing of biological signals related to the emotional state</article-title>
          ,” 2011
          <string-name>
            <given-names>Pan</given-names>
            <surname>American Health Care Exchanges</surname>
          </string-name>
          ,
          <year>2011</year>
          , pp.
          <fpage>237</fpage>
          -
          <lpage>238</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>F.</given-names>
            <surname>Liu</surname>
          </string-name>
          , G. Liu,
          <string-name>
            <given-names>X.</given-names>
            <surname>Lai</surname>
          </string-name>
          , “
          <source>Emotional Intensity Evaluation Method Based on Galvanic Skin Response Signal,” 2014 Computational Intelligence and Design (ISCID)</source>
          ,
          <source>2014 Seventh International Symposium on, 2014</source>
          , Volume
          <volume>1</volume>
          , pp.
          <fpage>257</fpage>
          -
          <lpage>261</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>A.N.</given-names>
            <surname>Varnavsky</surname>
          </string-name>
          , “
          <article-title>Automated system for correction of functional state of production workers</article-title>
          ,
          <source>” 2015 Control and Communications (SIBCON)</source>
          , 2015 International Siberian Conference on,
          <year>2015</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          Сведения об авторе:
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>