<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>ORCID:</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Models and Software for Intelligent Web-Based Testing System in Mathematics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Andrey Chukhray</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Elena Yashina</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>National Aerospace University «Kharkiv Aviation Institute»</institution>
          ,
          <addr-line>Chkalova 17, 61070 Kharkov</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2021</year>
      </pub-date>
      <volume>000</volume>
      <fpage>0</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>In this paper computer models and software for intelligent web-based testing system in mathematics are described. The analysis of computer web-based testing systems in mathematics is carried out, Parameterized mathematical models for different tasks, including algebra and geometry, are synthesized, Architecture and software of intelligent web-based testing system are presented. Knowledges and skills evaluation model on the base of fuzzy logic is developed. Now system is working in two modes: a mode of training and a control mode.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Intelligent tutoring systems</kwd>
        <kwd>e-learning</kwd>
        <kwd>educational software</kwd>
        <kwd>mathematical models</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>In the past few years e-learning experiences true boom. The driving force of it is continuous
computer potential growth: increase of processor power and memory capacity, improvement of I/O
facilities, perfection of network technologies, boost of efficiency of modern software development
tools. The Covid-19 pandemic gave a powerful impetus to the computer-aided learning growth.</p>
      <p>
        Artificial intelligence techniques allow to individualize and personalize the educational process [
        <xref ref-type="bibr" rid="ref1 ref2">1,
2</xref>
        ] and improve feedback from students [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. At the same time scientific theory of artificial intelligence
for e-learning is developing not so fast as developers would like. Artificial intelligence techniques are
successfully used in teaching computer and mathematical sciences [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. But today it is not possible yet
to replace a good teacher with a computer tutor system. There is insuperable complexity of synthesis of
models and methods for adaptation to mental work features, repertoire of knowledge and skills of each
learner [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        Therefore efforts of many developers aim at more utilitarian tasks where considerable progress is
achieved at interactive intelligent tutoring system, such as evaluation of mathematical expressions [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ],
models constructing [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], solving algebra [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and geometry [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] problems, online and web-based tutoring
systems [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ], web-based test systems [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <p>Within the framework of the Ukrainian project of external independent evaluation before authors
there was a task of intelligent web-based testing system creation. The purpose of it was increase of
effectiveness of school graduates preparation to external independent evaluation in mathematics by
means of availability assurance of tests examples through the Internet, introduction of interactive modes
of training and control for improvement contents of tasks and technologies of answers filling
understanding, economy of expenses for manufacture and distribution of test tasks paper collections,</p>
      <p>As analysis of world experience of interactive testing systems in mathematics making has shown the
most creative way is development of parameterized mathematical models for automatic generation
unique tasks, right answers and wrong but plausible answers for closed tests.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Task definition</title>
      <p>This article is dedicated to solving the problems.</p>
      <p>1. To synthesize parameterized mathematical models for automatic generation unique tasks,
right answers and wrong but plausible answers for closed tests.</p>
      <sec id="sec-2-1">
        <title>2. On the base of fuzzy logic to develop knowledges and skills evaluation model. 3. To create algorithms and the software for intelligent web-based testing system in mathematics which must work in two modes: a mode of training and a control mode.</title>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Task solution</title>
    </sec>
    <sec id="sec-4">
      <title>3.1. Parameterized mathematical models</title>
      <p>We described 26 different mathematical tasks, including algebra and geometry ones, were
parametrical. There were 12 tasks of closed type and 14 tasks of open type.</p>
      <p>Let's consider some examples of parameterization.
(1)
(2)
(3)
(4)
(5)
3.1.1. Example I</p>
    </sec>
    <sec id="sec-5">
      <title>3.1.2. Example II</title>
      <sec id="sec-5-1">
        <title>Therefore</title>
        <p>=
are generated. BC is calculated as</p>
      </sec>
      <sec id="sec-5-2">
        <title>Then desired value is</title>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>3.1.3. Example III</title>
      <p>To solve equation
(7)
(8)
(9)
(10)
(11)
(12)
2√3
∗</p>
      <p>AC ∗ BD =
AD + BC
∗
1
√3
∗ EF.
2 +2 − 2 = 96.</p>
      <sec id="sec-6-1">
        <title>In general we have</title>
        <p>(−1) 1  + 1 + (−1) 2  + 2+. . . +(−1)    +  =  .
The model of the task consists of following actions:
1) n ∈ {2,3, . . . , 10} is randomly chosen;
2) a,x ∈ {2,3, . . . , 10} are randomly chosen;
3)   ∈ {0,1,3, . . . , 10},  = ̅1̅̅,̅̅ are randomly chosen;
4)   ∈ {0, 1},  = ̅1̅̅,̅̅ are randomly chosen;</p>
      </sec>
      <sec id="sec-6-2">
        <title>5) P is calculated:</title>
      </sec>
      <sec id="sec-6-3">
        <title>6) right answer is compared with answer of graduate.</title>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>3.1.4. Example IV</title>
      <p>Areas of bounds of rectangular parallelepiped are equal  1,  2,  3. To find volume of parallelepiped.</p>
      <sec id="sec-7-1">
        <title>The model of the task includes:</title>
        <p>1) generation random  ,  ,  ∈ {2,3, . . . ,10};
2) calculation  1 =  ;  2 =  ;  3 =  ;</p>
      </sec>
      <sec id="sec-7-2">
        <title>3) check graduate answer against x ⋅y ⋅z.</title>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>Knowledges and skills evaluation model</title>
      <p>
        To create evaluation model fuzzy approach was chosen because of its closeness to teacher qualitative
Let us consider input linguistic variables:
reasoning.
as in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ];
and
described by the term set
      </p>
      <p>=”Tasks solving speed”,
 ( 1)={Slow, Medium, Fast}</p>
      <p>2=”The number of errors” ,
 ( 2)={Zero, Very small, Average, Large, Very large};</p>
      <p>3=”Help reference”,
 ( 3)={Without help, With small help, With help, With great help}.</p>
      <sec id="sec-8-1">
        <title>For example, membership functions for  ( 3) are presented in Figure 2.</title>
        <p>be an output linguistic variable with term set

= ”


”
 ( )={ Excellent, Good, Satisfactory, Bad }
T(Y)={Excellent, Good, Satisfactory, Bad}.</p>
        <sec id="sec-8-1-1">
          <title>Then rules can be expressed in the Mamdani form:</title>
          <p>If   is Fast and  2 is Zero and  3 is Without help then Y is Excellent.
If   is Fast and  2 is Very small and  3 is With help then Y is Good.</p>
        </sec>
      </sec>
      <sec id="sec-8-2">
        <title>If   is Slow and  2 is Very large and  3 is With great help then Y is Bad.</title>
        <p>Let
…</p>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>4. Software</title>
      <p>The main task of this work is intelligent computer system for testing knowledge and skills in
mathematics software development. We have collected and analyzed the system requirements. Based
on this the architecture of system and main components software was developed.</p>
    </sec>
    <sec id="sec-10">
      <title>System architecture</title>
      <p>As a result of the analysis of the system requirements, the main components and the connections
between them were identified. The system architecture model is shown in Figure 3.</p>
      <p>The system consists of the following levels:
- the database level, which contains the database for accounting information about users
(registration, test results);
- the business logic level, which includes the APP Server;
- the communication level, that is, the level that carries out network interaction with the user;
- presentation layer, which includes tools for development and presentation of data, such as ASP
.NET, WinForms, as well as directly displaying Web sites, that is, various browsers;
- user level.</p>
      <sec id="sec-10-1">
        <title>DATABASE</title>
      </sec>
      <sec id="sec-10-2">
        <title>LAYER</title>
      </sec>
      <sec id="sec-10-3">
        <title>BUSINESS</title>
      </sec>
      <sec id="sec-10-4">
        <title>LOGIC LAYER</title>
      </sec>
      <sec id="sec-10-5">
        <title>COMMUNICATI</title>
      </sec>
      <sec id="sec-10-6">
        <title>ON LAYER</title>
      </sec>
      <sec id="sec-10-7">
        <title>PRESENTA</title>
      </sec>
      <sec id="sec-10-8">
        <title>TION</title>
      </sec>
      <sec id="sec-10-9">
        <title>LAYER</title>
        <p>Components for generating problem conditions and answer options for them are stored in separate
library DLL files.</p>
        <p>To provide versatility multilevel architecture of system was developed. It consists of four levels:
database level, business logic level, communication level and presentation one. Main components of
business logic layer are presented in Figure 4.
Control
Agent
WCF</p>
        <p>Statement</p>
        <p>TaskPresentation</p>
        <p>(graphic
presentation)
AnswerVariant</p>
        <p>XML</p>
        <p>After an entrance of the user in system, which happens at ASP layer WCF layer begins work. WCF
represents an intermediate link witch connects parts of display and logic. WCF contacts library with
tasks and through interface ITaskGenerator by means of reflection operation receives the list of tasks.
Each element of the task list, i.e. a copy of class Task, contains a task condition, variants of answers
and a right answer as XML-code. Control agent cuts right answer leaving it on a server and directs the
remained elements (a condition and answer variants) to layer WCF. Thus, right answers in no way
cannot become accessible to the user. Therefore security is provided.</p>
        <p>The diagram of the main classes of an intelligent computer system for testing knowledge and skills
in mathematics is shown in Figure 5.</p>
        <p>The basic abstract class Task has two inheritors: the EnclosedTask class a of a closed type task; the
OpenTask class of an open type task. Both classes override the base class's Check() method and have
several constructors.</p>
        <p>The Task class defines a Statement class that represents a task condition. It is associated with the</p>
      </sec>
      <sec id="sec-10-10">
        <title>AnswerVariant class, which generates answer options.</title>
        <p>The Statement and AnswerVariant classes through the TaskPresentation class form the expression
of the condition of the task and the options for responding to it in the form of an XML representation.</p>
        <p>In addition to the AnswerVariant class, there is an abstract RightAnswer – correct answer class. Its
inheritors are the classes of the correct answer to tasks of the private EnclosedRightAnswer and public
OpenedRightAnswer types.</p>
        <p>The Task class, through the TaskPresentation class, generates conditions and response options in
the form of XML code containing tags of a specific purpose, for example, the &lt;expression /&gt; tag
contains an expression for building a mathematical formula, the &lt;plot /&gt; tag is a directive for plotting
a function graph. ASPNetPresentationProvider class implements transformation of task XML-code for
its presentation on WEB-form. To implement tags such as a formula or graph, the
ASPNetPresentationProvider class includes the appropriate libraries to represent them graphically.</p>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>System Interface Development</title>
      <p>The system must have an advanced user interface for visualizing formulas, graphs and other
graphical objects. One of the system components is a module for constructing mathematical formulas
designed for visual output of mathematical formulas of any complexity. The formula is specified as a
sequence of elementary instructions that determine the location of the formula elements. After the
structure of the formula is formed, the elements are arranged, the formula enters to the graphical
module, which draws it on the Bimap object and displays it on the web form. The example of formula
visualization is given in Figure 6.</p>
      <p>Also, a module for dynamic plotting of various mathematical functions has been implemented.</p>
      <sec id="sec-11-1">
        <title>Examples of dynamic output of function graph are shown in the Figure 7. Figure 7: The example of function graph output</title>
      </sec>
      <sec id="sec-11-2">
        <title>Screenshots of the system are presented in figures 8 – 10.</title>
        <p>Through interface IPresentationProvider the task in the form of a XML-code arrives to object
ASPNetPresentationProvider where its analysis and split are executed. The task can consist of the text
and pictures with formulas and graphs. In case of formulas object EquationPresentation provides
creation of a demanded picture. Similar technology is used for creation plots of functions. Then controls
arrive to ASP.NET Pages where they are displayed. Now system is being passed beta testing in site of</p>
      </sec>
      <sec id="sec-11-3">
        <title>Kharkov regional centre of education quality evaluation.</title>
      </sec>
    </sec>
    <sec id="sec-12">
      <title>5. Summary</title>
      <p>
        Parameterized mathematical models, knowledges and skills evaluation model and software for
intelligent web-based testing system in mathematics are developed. The system has multilevel
architecture and flexible interface to provide versatility and security. The next step may be creation of
diagnostic models to adapt system to mental work features, knowledges and skills of each graduate
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>This system joined in single complex meant for learners testing (http://zno-kharkiv.org.ua/cimt/). In
the perspective, it is planned to integrate the math web-tests system with other software tutoring
products [14].
6. References</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Nkambou</surname>
            , Roger,
            <given-names>Riichiro</given-names>
          </string-name>
          <string-name>
            <surname>Mizoguchi</surname>
          </string-name>
          , and Jacqueline Bourdeau, eds.
          <source>Advances in intelligent tutoring systems</source>
          . Vol.
          <volume>308</volume>
          . Springer Science &amp; Business
          <string-name>
            <surname>Media</surname>
          </string-name>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Muangprathub</surname>
            , Jirapond,
            <given-names>Veera</given-names>
          </string-name>
          <string-name>
            <surname>Boonjing</surname>
            , and
            <given-names>Kosin</given-names>
          </string-name>
          <string-name>
            <surname>Chamnongthai</surname>
          </string-name>
          .
          <article-title>"Learning recommendation with formal concept analysis for intelligent tutoring system</article-title>
          .
          <source>" Heliyon 6</source>
          .10 (
          <year>2020</year>
          )
          <article-title>: e05227</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.heliyon.
          <year>2020</year>
          .e05227.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Putnam</surname>
            , Vanessa, and
            <given-names>Cristina</given-names>
          </string-name>
          <string-name>
            <surname>Conati</surname>
          </string-name>
          .
          <article-title>"Exploring the Need for Explainable Artificial Intelligence (XAI) in Intelligent Tutoring Systems</article-title>
          (ITS).
          <source>" IUI Workshops</source>
          . Vol.
          <volume>19</volume>
          .
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Abu-Naser</surname>
          </string-name>
          ,
          <article-title>Samy S. "Predicting learners performance using artificial neural networks in linear programming intelligent tutoring system</article-title>
          .
          <source>"</source>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Hasan</surname>
            ,
            <given-names>Muhammad</given-names>
          </string-name>
          <string-name>
            <surname>Asif</surname>
          </string-name>
          , et al.
          <article-title>"The Transition From Intelligent to Affective Tutoring System: A Review and Open Issues."</article-title>
          <source>IEEE Access</source>
          (
          <year>2020</year>
          ). doi:
          <volume>10</volume>
          .1109/ACCESS.
          <year>2020</year>
          .
          <volume>3036990</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Pacheco-Venegas</surname>
            ,
            <given-names>Nancy D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gilberto</surname>
            <given-names>López</given-names>
          </string-name>
          , and
          <string-name>
            <surname>María</surname>
          </string-name>
          Andrade-Aréchiga.
          <article-title>"Conceptualization, development and implementation of a web-based system for automatic evaluation of mathematical expressions."</article-title>
          <source>Computers &amp; Education</source>
          <volume>88</volume>
          (
          <year>2015</year>
          ):
          <fpage>15</fpage>
          -
          <lpage>28</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.compedu.
          <year>2015</year>
          .
          <volume>03</volume>
          .021.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7] VanLehn,
          <string-name>
            <surname>Kurt</surname>
          </string-name>
          , et al.
          <article-title>"Learning how to construct models of dynamic systems: An initial evaluation of the dragoon intelligent tutoring system</article-title>
          .
          <source>" IEEE Transactions on Learning Technologies 10.2</source>
          (
          <year>2016</year>
          ):
          <fpage>154</fpage>
          -
          <lpage>167</lpage>
          . doi:
          <volume>10</volume>
          .1109/TLT.
          <year>2016</year>
          .
          <volume>2514422</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8] VanLehn,
          <string-name>
            <surname>Kurt</surname>
          </string-name>
          , et al.
          <article-title>"Teaching Algebraic model construction: a tutoring system, lessons learned and an evaluation."</article-title>
          <source>International Journal of Artificial Intelligence in Education 30.3</source>
          (
          <year>2020</year>
          ):
          <fpage>459</fpage>
          -
          <lpage>480</lpage>
          . doi:
          <volume>10</volume>
          .1007/s40593-020-00205-3.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <surname>Ke</surname>
            , and
            <given-names>Zhendong</given-names>
          </string-name>
          <string-name>
            <surname>Su</surname>
          </string-name>
          .
          <article-title>"Automated geometry theorem proving for human-readable proofs."</article-title>
          <source>Twenty-Fourth International Joint Conference on Artificial Intelligence</source>
          .
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Kefalis</surname>
            , Chrysovalantis, and
            <given-names>Athanasios</given-names>
          </string-name>
          <string-name>
            <surname>Drigas</surname>
          </string-name>
          .
          <article-title>"Web Based and Online Applications in STEM Education."</article-title>
          <source>Int. J. Eng. Pedagog. 9</source>
          .
          <issue>4</issue>
          (
          <year>2019</year>
          ):
          <fpage>76</fpage>
          -
          <lpage>85</lpage>
          . doi:
          <volume>10</volume>
          .3991/ijep.v9i4.
          <fpage>10691</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Nye</surname>
            ,
            <given-names>Benjamin D.</given-names>
          </string-name>
          , et al.
          <article-title>"SKOPE-IT (Shareable Knowledge Objects as Portable Intelligent Tutors): overlaying natural language tutoring on an adaptive learning system for mathematics."</article-title>
          <source>International journal of STEM education 5</source>
          .1 (
          <year>2018</year>
          ):
          <fpage>1</fpage>
          -
          <lpage>20</lpage>
          . doi:
          <volume>10</volume>
          .1186/s40594-018-0109-4
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Hostovecky</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Misut</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Pribilova</surname>
          </string-name>
          .
          <source>"Web Based Testing in Science Education." Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering</source>
          <volume>313</volume>
          (
          <year>2014</year>
          ):
          <fpage>247</fpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>319</fpage>
          -06773-5_
          <fpage>33</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Chukhray</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Havrylenko</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mygal</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Mygal</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <article-title>"Models and Methods for Computer Support of Adaptive Training of Algorithmic Tasks Solution."</article-title>
          <source>ICTERI</source>
          .
          <year>2020</year>
          :
          <fpage>408</fpage>
          -
          <lpage>415</lpage>
          . Chukhray, Andrey, and
          <string-name>
            <given-names>Olena</given-names>
            <surname>Havrylenko</surname>
          </string-name>
          .
          <article-title>"The engineering skills training process modeling using dynamic bayesian nets." Radioelectronic and Computer Systems 2 (</article-title>
          <year>2021</year>
          ):
          <fpage>87</fpage>
          -
          <lpage>96</lpage>
          . doi:
          <volume>10</volume>
          .32620/reks.
          <year>2021</year>
          .
          <volume>2</volume>
          .08.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>