<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>L. A. Ponomareva);</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>management model for a large educational complex</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ludmila A. Ponomareva</string-name>
          <email>ponomarevala@bk.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oxana N. Romashkova</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yuliya V. Gaidamaka</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>38</institution>
          ,
          <addr-line>Ostozhenka St., Moscow, 119034</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Applied Probability and Informatics, Peoples' Friendship University of Russia</institution>
          ,
          <addr-line>6, Miklukho-Maklaya St.</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Department of applied Informatics, Moscow City University</institution>
          ,
          <addr-line>4, Vtoroy Selskohoziajstvenny, Moscow, 129226</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Department of international information security Institute of information sciences, Moscow State Linguistic University</institution>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>Moscow</institution>
          ,
          <addr-line>117198</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <volume>000</volume>
      <fpage>0</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>Efective management of the national educational system is a strategically important direction for further development of the entire state [1]. Management of educational processes is the most dificult direction in the theory and practice of management because of their multiplicity and formalization [2]. In connection with the reorganization of the Russian educational system, large educational complexes (LEC) have appeared [3], which are a new structural unit in the national education system.</p>
      </abstract>
      <kwd-group>
        <kwd>management</kwd>
        <kwd>methods</kwd>
        <kwd>rating evaluation models</kwd>
        <kwd>eficiency</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>(Y. V. Gaidamaka)
(Y. V. Gaidamaka)
Workshop on information technology and scientific computing in the framework of the X International Conference</p>
      <p>CEUR
Workshop
Proceedings
htp:/ceur-ws.org
IS N1613-073</p>
      <p>CEUR Workshop Proceedings (CEUR-WS.org)</p>
    </sec>
    <sec id="sec-2">
      <title>1. Introduction</title>
      <p>
        The functioning of a large educational complex is characterized by a variety of functions, levels
of educational activity, adaptability, flexibility, and dynamism, which creates dificulties for
efective management [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. The search for efective management options leads to the need to
use formalized, unified methods and mathematical models. In this regard, there is a need to
use information tools that automate the implementation and use of models in making efective
decisions at all stages of management [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        The development of models and methods for assessing the quality of education and
educational activities in educational complexes, as well as efective management of the functioning
of such complex socio-economic systems, is becoming an extremely urgent task [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>Purpose and objectives of scientific research . The purpose of the study is to improve the
efectiveness of the LEC management by creating a set of models, methods, algorithms and
tools for rating the activities of educational organizations.</p>
      <p>
        To achieve the goal of scientific research , the following tasks were solved:
• an information model of LEC management is built [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ];
• criteria and indicators for a comprehensive assessment of LEC management efectiveness
have been developed [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ];
• a management information system has been designed to automate rating evaluation of
educational organizations in accordance with the developed methodology, algorithms
and models [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ];
• a neural network model is proposed to support the management decision-making of
heads of educational organizations [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>
        The scientific novelty of the study is that:
• criteria (quality of education, accessibility of education, eficiency of resource use) and
indicators have been developed to determine the criteria for a comprehensive
assessment of the efectiveness of LEC management, taking into account current trends in the
development of the education system [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ];
• an information system for automating rating evaluation and monitoring the activities of
educational organizations is proposed [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ];
• a neural network model is proposed for the system of support for management
decisionmaking of heads of educational organizations [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
    </sec>
    <sec id="sec-3">
      <title>2. Theoretical Research</title>
      <p>
        The efectiveness of managing the education system in Russia is determined by the structure
of the system itself, which consists of regional, sub-regional, territorial, inter-municipal and
municipal educational systems, as well as educational organizations and their associations [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
Therefore, one of the important tasks is a formalized description of the system model and
a unified approach to solving the problem of efective management of all components of the
system.
      </p>
      <p>
        The activities of education management bodies are aimed at ensuring Federal programs for
the development of education, state educational standards, and the functioning of the education
system at the level of state standards [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>
        Organizational structure of education system management (Figure 1) reflects the composition
and subordination of various elements, links and levels of management that function to achieve
certain goals [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. The functions and structure of management are two components of a single
whole-the organization of the management system of the education system and act, respectively,
as the content and form of the management process [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Certain management issues are within
the competence and responsibility of the educational organization.
In this study, managed systems (management objects) are divided into groups [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]:
1. An education system consisting of education management bodies and the infrastructure
of the education system (scientific and methodological centers, resource centers, repair
and supply services, and so on).
2. Educational system — a set of educational organizations and educational programs (EP)
implemented by them.
      </p>
      <p>The educational system (ES) includes not only educational organization (EO) and EP, but also
the infrastructure (educational and methodological ofices, resource centers, etc.), as well as
education management bodies of the appropriate level. Within this definition, the “minimum”
educational system is a separate educational organization.</p>
      <p>
        In the most General form, the management process in the education system can be divided
into three components, mutually dependent and interrelated forms of its implementation [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]
(Figure 2):
• administrative, whose task is to develop and define policies;
• economic, which determines the material and financial resources, motives and financial
results of the management system;
• operational, providing operational, Executive, aimed primarily at the technological
organization of the control object.
      </p>
      <p>
        Any ES is defined by setting [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] the following parameters:
• the composition of the ES (participants-people, their groups and collectives that are part
of the ES, that is, its elements and the composition of the ES implemented in the OP);
• ES structures (sets of information, management, technological, and other relationships
between ES participants);
• restrictions and norms of activity of ES participants, reflecting, among other things,
institutional, technological and other restrictions (conditions) and norms of their joint
activity. In particular, the demand and supply for educational services and for graduates
(taking into account the criteria of both quantity and quality) of the ES can be considered
as a managed (including self-managed) restriction of the ES activity;
• preferences of the ES participants;
• awareness — the information about the essential parameters that the ES participants have
at the time of their decision-making.
      </p>
      <p>Restrictions on the activities of ES participants are, in particular, their powers.
List of business processes of the regional educational system:
1. Business management processes:
• development and implementation of regional education development programs
taking into account regional socio-economic, environmental, demographic,
ethnocultural and other features;
• planning and development of the regional educational system;
• distribution of responsibilities and powers;
• analysis of the quality system of the regional educational system.</p>
      <sec id="sec-3-1">
        <title>2. Main business processes:</title>
        <p>• creation, reorganization, liquidation of educational organizations, implementation
of functions and powers of founders of educational organizations;
• ensuring state guarantees of the rights to receive public preschool education, primary</p>
        <p>General education, basic General education, and secondary General education;
• organizing the provision of secondary vocational education, including ensuring state
guarantees of the right to receive public and free secondary vocational education;
• organization of additional education for children;
• organization of additional professional education.
3. Enabling business processes:
• material support of the regional education system (including textbooks in
accordance with the established Federal list, and textbooks approved for use in the
implementation of these educational programs);
• financial support for the regional education system;
• stafing of the regional education system;
• information support for the regional education system;
• normative and methodological support of the regional education system;
• social security of the regional education system (including the organization of
providing psychological and pedagogical, medical and social assistance to students
who are experiencing dificulties in mastering basic General education programs,
their development and social adaptation);
• subcontracting processes.
4. Business processes for monitoring, measuring, evaluating, and developing:
• monitoring, measurement, and quality control of the regional educational system
(including creating conditions for organizing an independent assessment of the
quality of educational activities of organizations engaged in educational activities;
• internal audits and self-assessment;
• managing monitoring and measurement devices;
• assessment of satisfaction of consumers of educational services of the regional
educational system.</p>
        <p>The diagram of business processes of the educational system is shown in Figure 3.</p>
        <p>
          The criteria for efective management of the educational complex can be presented using
Figure 4 [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ].
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>3. Research Methods and Tools</title>
      <p>
        One of the most popular and popular tools for managing and informing consumers of educational
services is the rating of educational organizations. To build a rating of General education
organizations in the Ulyanovsk region on the quality of education, the following areas have
been identified:
• learning outcome;
• participation of students in procedures for independent assessment of the quality of
knowledge;
• ensuring a systematic approach in the procedures for independent assessment of the
quality of knowledge;
• the efectiveness of the internal monitoring;
• compliance of the educational organization’s activities with accreditation indicators.
The following data types are used to calculate indicator values [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]:
• data from monitoring conducted by the Committee for supervision and control of
education in the Ulyanovsk region;
• data of monitoring conducted by the regional state Autonomous institution Ulyanovsk
regional center for information, methodological, organizational and technical support of
supervision and control procedures in the field of education;
• data of educational organizations.
      </p>
      <p>The rating of educational organizations is formed for each direction separately and as a whole
(summary rating). The algorithm that reflects the main stages of rating formation is shown in
Figure 5.</p>
      <p>The efectiveness of management has two aspects: the efectiveness of the functioning of the
managed system itself and / or the efectiveness of the actual management activity.</p>
      <p>The main tool for optimizing decision-making in this study was mathematical methods. The
technological process of functioning of the rating evaluation model of educational organizations
for managing the educational system is shown in Figure 6.</p>
      <p>For efective management of educational organizations, information about the final rating
is not enough. This indicator allows you to get a General idea of the situation in educational
complexes and draw appropriate conclusions. To make specific management decisions to
improve performance, it is necessary to analyze the rating for each criterion.</p>
      <p>Evaluating the management of a large regional educational system is a multi-component
process that involves a detailed analysis of the functioning of each component of the object
under study. Based on the above material, we can conclude that in order to organize a qualitative
assessment of the management of a large regional educational system, it is necessary to develop
an appropriate model.</p>
      <p>The authors propose a model that allows us to evaluate each component of the management
of an educational organization (Figure 7). The model represents a directed graph. Each criterion
is a composite criterion.</p>
      <p>The criterion for managing the quality of education (criterion 1) consists of four groups of
indicators:
• indicators of individual educational results-allow you to characterize the learning
dynamics of each individual student;
• indicators of the overall level of academic performance-aimed at creating a holistic picture
of learning material by students;
• indicators of high educational achievements-help to get information about the number of
winners of Olympiads and various competitions at various levels;
• the performance of graduates.</p>
      <p>The criterion for managing the availability of education (criterion 2) is also divided into three
groups of indicators, which will allow us to summarize the data obtained on the functioning of
the management system of an individual organization:
• indicators of overall access to education for children of appropriate ages;
• indicators of access to continuing education-create an idea of the efectiveness of the
education system as a whole, and therefore allow you to assess the quality of management
of this system;
• indicators of access to education for children with special needs.</p>
      <p>The third component of the model (criterion 3) is a criterion for managing the eficiency
of resource use. This component is a financial indicator of the functioning of the educational
system, since most educational institutions in Russia are fully supported by the state. This
component is also divided into components:
• indicators of efective use of financial resources;
• indicators for creating appropriate conditions for students;
• indicators of efective use of school premises;
• indicators of efective work of teachers.</p>
    </sec>
    <sec id="sec-5">
      <title>4. Research Result</title>
      <p>
        Let’s consider the application of this mathematical model on the example of calculating the
ifnal value for three criteria for 4 educational organizations that are combined in an educational
complex [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. The data is presented in Table 1.
      </p>
      <p>Based on the selected indicators and the final assessment of the educational institutions of
the complex, a neural network model was built that allows making a forecast of the final rating
value of the entire complex as a whole (Figure 8).
u
S</p>
      <p>3
n va itr ,15 ,7 09 ,26 ,62
o d c 0 1 ,1 2 2
f
n
io 5 6
ia re ,1 0 ,0 1 1
r t 0 0
e i
t r
i
r C
c
lu io 4 4 4</p>
      <p>r 0 1 ,0 ,5 ,5
a e
v it 0 0 0
d r
o io 0 32 32
N itre 0 ,70 1 ,70 ,70
r
n
o 2 7 8 9 9
ir ,4 ,0 ,5 ,9 ,9
a e 6 5 5 3 3
ir it 1 1 1 2 2
e r
y
b 2
s
e n
e C
z
i
l
a 1
rm n</p>
      <p>C
3
it C
r
c
ro 2
f n
s o
u r ,35 ,152 ,356 ,437 ,743
e i
l e
a it
v r
d C
sn r</p>
      <p>a</p>
      <p>The input variables of the neural network are as follows:
1. Quality criterion:
• The share of individual educational cards with a positive growth rate in the total
number for the considered educational organization;
• Decile coeficient of positive growth rate (the ratio of the average score for the year
of 10% of students with the best results to the average score for the year of 10% of
students with the worst results);
• Growth rate of student’s educational results;
• Share (percentage) of students who have mastered the program on “good” and
“excellent”;
• Percentage of graduates who passed the final exam with a score higher than 160
points in three subjects;
• Percentage of graduates who passed the final exam with a score higher than 220
points in three subjects;
• Average score of independent diagnostics conducted by the regional center for
education quality assessment;
• Share of medalists among graduates of an educational organization;
• Number of students-winners, prize-winners (laureates) of Olympiads, competitions
of all-Russian and regional levels from the Federal and regional list;
• The number of subjects in which the educational organization has winners or
prize-winners of Olympiads, competitions of the all-Russian, district, regional, and
municipal levels;
• Percentage of students enrolled in additional education programs implemented by
the educational organization itself and other organizations.</p>
      <sec id="sec-5-1">
        <title>2. Accessibility criteria:</title>
        <p>• Percentage of students registered (and staying) in this territory who receive basic</p>
        <p>General education services;
• Percentage of students registered (and staying) in this territory who receive
additional education services;
• Percentage of students enrolled in pre-school education programs;
• The percentage of students who continued their education in the basic General
education program, out of the number of those who completed their education in
the primary General education program;
• The percentage of students who continued their education in the secondary General
education program, out of the number of those who completed their education in
the basic General education program;
• Percentage of students receiving basic General education services in specialized
educational institutions;
• Percentage of students receiving basic General education services in inclusive
educational institutions;
• The presence of a regularly updated website of the educational organization.
3. The criterion of eficiency of resource use:
• Share of extra-budgetary funds in the total amount of financial resources of the
educational organization;
• The share of funds spent on the remuneration of teaching staf in relation to the
total remuneration Fund;
• Share of funds from the extra-budgetary Fund spent on remuneration of teaching
staf;
• The number of students per teaching staf;
• The density of the load (average number of training hours) one of the school’s ofice;
• The decile ratio of the density of loading one of the school’s ofice;
• Number of innovative projects implemented;
• Number of target programs implemented;
• Availability of experimental sites at the Federal, regional, and municipal levels;
• Percentage of teachers with the highest qualification category;
• Percentage of teachers who have passed independent certification;
• Percentage of teachers who have completed advanced training courses in the past
three years;
• Share of teachers of the organization who prepared winners, prize-winners
(laureates) of competitions of all-Russian, district / regional, municipal levels during the
last three years;
• Percentage of teachers whose efective teaching experience was distributed at the
national and regional level;
• Total number of downloaded lesson scenarios;
• Total Russian scientific citation index;
• Number of students per computer compared to the municipal average;
• The proportion of computers with access to the Internet;
• Number of media library programs implemented in the educational process;
• Availability of extended day groups;
• Providing students with free hot meals;
• The presence of the gym;
• The presence of the stadium;
• Availability of specialized workshops/land plots;
• The ratio of the total area of the educational organization to the number of students;
• The ratio of the classroom area to the total number of students;
• The ratio of the number of specialized ofices and laboratories to the total number
of classrooms;
• Share of funds for the creation and development of the educational environment
(including material and technical support).</p>
        <p>Output is the final value of the rating of the educational organization.</p>
        <p>The nodes of the graph shown in blue are the incoming numeric values of the quality criteria,
availability, and eficiency of the use of resources of each individual educational organization.
The nodes of the graph, colored in red, represent the numeric value of the individual criteria of
the educational organization. Finally, the graph node, colored green — is the final numerical
value of the evaluation of an educational organization, taking into account all three criteria, on
the basis of which the overall rating for 50 educational organizations will be compiled.</p>
        <p>Using the scatter plot (Figure 9) it is possible to estimate the degree of deviation of the
predicted data from the accepted standard. In this case, it is possible to visually determine the
correctness of calculating the final values of the assessment for educational organizations from
which the rating is compiled. When visualizing the chart, two lines were drawn that form a
confidence interval.</p>
        <p>Almost all points (all received rating numerical values for educational organizations) lie
within the “corridor” set by them. This means that we can say that the built neural network
model of managing a large educational system works efectively.</p>
        <p>The rating score calculated using the neural network model allows us to develop efective
control actions aimed at achieving the goals of functioning of a large educational complex.</p>
        <p>The model can be applied autonomously, or as a module of the decision support system for
managers and specialists of educational management bodies.</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>5. Conclusion</title>
      <sec id="sec-6-1">
        <title>As a result of the study, the authors proposed:</title>
        <p>• mathematical model of the process of calculating the values of indicators that fully
characterize the activities of an educational organization. The criteria are best represented
as a directed graph whose vertices correspond to the stages of calculating the rating score,
and their weight is equal to the corresponding numerical values obtained at each stage;
• the problem of optimization of control over a given set of elements of a hierarchical
structure is formulated. using dynamic programming methods, the solution of the problem
is described and the values of labor intensity are obtained;
• an example of the proposed information system that implements a mathematical model
for building a rating of an educational complex is given.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Orlov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Zenyuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Samuylov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Moltchanov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Andreev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Gaidamaka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Samouylov</surname>
          </string-name>
          ,
          <article-title>Time-dependent SIR modeling for D2D communications in indoor deployments</article-title>
          ,
          <source>in: Proceedings - 31st European Conference on Modelling and Simulation, ECMS</source>
          <year>2017</year>
          ,
          <year>2017</year>
          , pp.
          <fpage>726</fpage>
          -
          <lpage>731</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>I. A.</given-names>
            <surname>Gudkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. E.</given-names>
            <surname>Samoylov</surname>
          </string-name>
          ,
          <article-title>Determination of the Range of the Guaranteed Radio Communication in Wireless Telecommunication Networks of IEEE 802.11 Standard with the Use of Ping Program</article-title>
          ,
          <source>in: CEUR Workshop Proceedings 8. ”ITTMM 2018 - Proceedings of the Selected Papers of the 8th International Conference ”Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”</source>
          , volume
          <volume>2177</volume>
          ,
          <year>2018</year>
          , pp.
          <fpage>54</fpage>
          -
          <lpage>59</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2177</volume>
          /#paper-08-1060.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y. V.</given-names>
            <surname>Gaidamaka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. P.</given-names>
            <surname>Vasilyuk</surname>
          </string-name>
          ,
          <article-title>Application of Information Technology for the Analysis of the Rating of University</article-title>
          , in: CEUR
          <source>Workshop Proceedings 8. ”ITTMM 2018 - Proceedings of the Selected Papers of the 8th International Conference ”Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”</source>
          , volume
          <volume>2177</volume>
          ,
          <year>2018</year>
          , pp.
          <fpage>46</fpage>
          -
          <lpage>53</lpage>
          . URL: http: //ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2177</volume>
          /#paper-07-1010.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. E.</given-names>
            <surname>Golosov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. B.</given-names>
            <surname>Mosyagin</surname>
          </string-name>
          ,
          <string-name>
            <surname>V. I. Gorelov</surname>
          </string-name>
          ,
          <article-title>Method of efective management of competence development processes in educational environments, Modern science: actual problems of theory and practice</article-title>
          .
          <source>Series: natural and technical 9</source>
          (
          <year>2017</year>
          )
          <fpage>48</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. I.</given-names>
            <surname>Kumskov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. A.</given-names>
            <surname>Smolenskii</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. F.</given-names>
            <surname>Mityushev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. S.</given-names>
            <surname>Zefirov</surname>
          </string-name>
          ,
          <article-title>Method of computer aided formation of organic compound descriptors for quantitative structureproperty relationships</article-title>
          ,
          <source>News of the Academy of Sciences. Chemical series 8</source>
          (
          <year>1994</year>
          )
          <fpage>1391</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>E.</given-names>
            <surname>Prokhorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          , E. Permyakov,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kumskov</surname>
          </string-name>
          ,
          <article-title>Fuzzy classification and fast rules for refusal in the QSAR problem</article-title>
          ,
          <source>Pattern Recognition and Image Analysis</source>
          <volume>21</volume>
          (
          <year>2011</year>
          )
          <fpage>542</fpage>
          -
          <lpage>544</lpage>
          .
          <source>doi:1 0 . 1 1 3 4 / S 1 0</source>
          <volume>5 4 6 6 1 8 1 1 0 2 0 9 1 X .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M. I.</given-names>
            <surname>Kumskov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. E.</given-names>
            <surname>Peshkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <surname>K. I. Rezchikova</surname>
          </string-name>
          ,
          <article-title>Estimation of activation energies of thermal decomposition of nitro compounds based on structural descriptors</article-title>
          ,
          <source>Russian Chemical Bulletin</source>
          <volume>45</volume>
          (
          <year>1996</year>
          )
          <fpage>1840</fpage>
          -
          <lpage>1843</lpage>
          .
          <source>doi:1 0 . 1 0 0 7 / B F 0 1</source>
          <volume>4 5 7 7 6 0 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>E.</given-names>
            <surname>Bobrikova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Gaidamaka</surname>
          </string-name>
          ,
          <string-name>
            <surname>O. Romashkova,</surname>
          </string-name>
          <article-title>The application of a fluid-based model for the analysis of the distribution time of a file among users in peer-to-peer network</article-title>
          ,
          <source>in: Selected Papers of the II International Scientific Conference ”Convergent Cognitive Information Technologies” (Convergent</source>
          <year>2017</year>
          ).
          <source>CEUR Workshop Proceedings</source>
          , volume
          <year>2064</year>
          ,
          <year>2017</year>
          , pp.
          <fpage>55</fpage>
          -
          <lpage>61</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-2064/paper06.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>E. I.</given-names>
            <surname>Prokhorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. A.</given-names>
            <surname>Permyakov</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. I. Kumskov</surname>
          </string-name>
          ,
          <article-title>Fuzzy classification and fast rejection rules in the structure-property problem</article-title>
          ,
          <source>Pattern Recognition and Image Analysis: Advances in Mathematical Theory and Applications</source>
          <volume>23</volume>
          (
          <year>2013</year>
          )
          <fpage>130</fpage>
          -
          <lpage>138</lpage>
          .
          <source>doi:1 0 . 1 1 3 4 / S 1 0</source>
          <volume>5 4 6 6 1 8 1 3 0 1 0 1 0 0 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>E.</given-names>
            <surname>Prokhorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          , E. Permyakov,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kumskov</surname>
          </string-name>
          , Fuzzy Predicting Models in ”Structure - Property” Problem, in
          <source>: Proceedings of the International Workshop on Soft Computing Applications and Knowledge Discovery (SCAKD</source>
          <year>2011</year>
          ), Moscow, Russia, June 25,
          <year>2011</year>
          .,
          <year>2011</year>
          , pp.
          <fpage>89</fpage>
          -
          <lpage>93</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>G. V.</given-names>
            <surname>Gorelov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <article-title>Influence of russian, spanish and vietnamese speech characteristics on digital information transmission quality</article-title>
          ,
          <source>in: IEEE International Symposium on Industrial Electronics Proceedings of the IEEE International Symposium on Industrial Electronics, ISIE'96. Part 1 (of 2)</source>
          . sponsors: IEEE, Warsaw University of Technology. Warsaw, Poland,
          <year>1996</year>
          , pp.
          <fpage>311</fpage>
          -
          <lpage>313</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y. V.</given-names>
            <surname>Gaidamaka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. P.</given-names>
            <surname>Vasilyuk</surname>
          </string-name>
          ,
          <article-title>Application of Information Technology for the Analysis of the Rating of University</article-title>
          , in: CEUR
          <source>Workshop Proceedings 8. ”ITTMM 2018 - Proceedings of the Selected Papers of the 8th International Conference ”Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”</source>
          , volume
          <volume>2177</volume>
          ,
          <year>2018</year>
          , pp.
          <fpage>46</fpage>
          -
          <lpage>53</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2177</volume>
          /#paper-07-1010.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. P.</given-names>
            <surname>Vasilyuk</surname>
          </string-name>
          ,
          <article-title>The process of automating the rating of russian universities</article-title>
          ,
          <source>in: CEUR Workshop Proceedings 9. ”ITTMM 2019 - Proceedings of the Selected Papers of the 8th International Conference ”Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”</source>
          ,
          <year>2019</year>
          , pp.
          <fpage>109</fpage>
          -
          <lpage>117</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2407</volume>
          /paper-12-121.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>G. V.</given-names>
            <surname>Gorelov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. A.</given-names>
            <surname>Kazanskii</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Lukova</surname>
          </string-name>
          ,
          <article-title>Communication quality assessment in speech packet transmission networks with random service interrupts</article-title>
          ,
          <source>Automatic Control and Computer Sciences</source>
          <volume>27</volume>
          (
          <year>1993</year>
          )
          <fpage>62</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. V.</given-names>
            <surname>Chiskidov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <article-title>Instrumental implementation of the educational process model to improve the rating of the universities</article-title>
          ,
          <source>in: CEUR Workshop Proceedings 9. ”ITTMM 2019 - Proceedings of the Selected Papers of the 8th International Conference ”Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”</source>
          , volume
          <volume>2407</volume>
          ,
          <year>2019</year>
          , pp.
          <fpage>92</fpage>
          -
          <lpage>101</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2407</volume>
          /paper-10-120.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. N.</given-names>
            <surname>Pavlicheva</surname>
          </string-name>
          ,
          <article-title>Resource management in distance and mobile education systems</article-title>
          ,
          <source>in: CEUR Workshop Proceedings 9. ”ITTMM 2019 - Proceedings of the Selected Papers of the 8th International Conference ”Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”</source>
          , volume
          <volume>2407</volume>
          ,
          <year>2019</year>
          , pp.
          <fpage>102</fpage>
          -
          <lpage>108</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2407</volume>
          /paper-11-119.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. L.</given-names>
            <surname>Kodanev</surname>
          </string-name>
          ,
          <article-title>Development module of the corporate information system ”educational environment of the university” based on cloud technologies, in: Computer science: problems, methodology, technology the collection of materials of XVII international scientific conference: in 5 t</article-title>
          .,
          <year>2017</year>
          , pp.
          <fpage>393</fpage>
          -
          <lpage>398</lpage>
          . URL: https://elibrary.ru/item. asp?id=
          <fpage>28952199</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>A. I.</given-names>
            <surname>Kapterev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <article-title>Challenges for russian ecosystem of higher education for on board communications</article-title>
          ,
          <source>in: 2019 Systems of Signals Generating and Processing in the Field of on Board Communications</source>
          , volume
          <volume>1</volume>
          ,
          <year>2019</year>
          , pp.
          <fpage>227</fpage>
          -
          <lpage>232</lpage>
          .
          <source>doi:1 0 . 1 1 0 9 / S O S G . 2 0</source>
          <volume>1 9 . 8 7 0 6 7 1 9 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. E.</given-names>
            <surname>Golosov</surname>
          </string-name>
          ,
          <article-title>Development of a mathematical model of the educational process at the university to improve the quality of education, Fundamental research (</article-title>
          <year>2017</year>
          )
          <fpage>77</fpage>
          -
          <lpage>81</lpage>
          . URL: https://elibrary.ru/item.asp?id=
          <fpage>28800201</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>E. N.</given-names>
            <surname>Pavlicheva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <article-title>Model of functioning of information system for institute of distance education of specialists of onboard communications</article-title>
          ,
          <source>in: 2019 Systems of Signals Generating and Processing in the Field of on Board Communications</source>
          , volume
          <volume>1</volume>
          ,
          <year>2019</year>
          , pp.
          <fpage>382</fpage>
          -
          <lpage>386</lpage>
          .
          <source>doi:1 0 . 1 1 0 9 / S O S G . 2 0</source>
          <volume>1 9 . 8 7 0 6 7 8 3 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <article-title>Model of educational process in high school using Petri nets, Modern information technologies</article-title>
          and
          <source>IT education 13</source>
          (
          <year>2017</year>
          )
          <fpage>131</fpage>
          -
          <lpage>139</lpage>
          . URL: http: //sitito.cs.msu.ru/index.php/SITITO/article/view/244.
          <source>doi:1 0 . 2 5 5 5 9 / S I T I T O . 2 0 1 7 . 2 . 2 4 4 .</source>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>G. V.</given-names>
            <surname>Gorelov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. N.</given-names>
            <surname>Romashkova</surname>
          </string-name>
          ,
          <article-title>Influence of russian, spanish and vietnamese speech characteristics on digital information transmission quality</article-title>
          ,
          <source>in: IEEE International Symposium on Industrial Electronics Proceedings of the IEEE International Symposium on Industrial Electronics, ISIE'96. Part 1 (of 2)</source>
          . sponsors: IEEE, Warsaw University of Technology. Warsaw, Poland,
          <year>1996</year>
          , pp.
          <fpage>311</fpage>
          -
          <lpage>313</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Ponomareva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. L.</given-names>
            <surname>Kodanev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. V.</given-names>
            <surname>Chiskidov</surname>
          </string-name>
          ,
          <article-title>Model of management of process of development of competences in educational organizations, in: New information technologies in scientific research materials of the XXII all-Russian scientific-technical conference of students, young scientists and specialists</article-title>
          . Ryazan state radio engineering University,
          <year>2017</year>
          , pp.
          <fpage>20</fpage>
          -
          <lpage>22</lpage>
          . URL: https://elibrary.ru/item.asp?id=
          <fpage>30521104</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>