Instrumental implementation of the educational process model to improve the rating of the universitiesLudmila A. Ponomarevaponomarevala@bk.ru0Sergey V. Chiskidov0Oxana N. Romashkova0Department of Applied Informatics, Moscow City University 29 Sheremetevskaya str.
,
Moscow, 127521
,
Russia201992101
Taking into account the requirements of modern society for future specialists, the learning process becomes more complex and many-sided every year. At the same time the time frame of training cannot be increased. In such contradictory conditions, electronic means of management and support of the learning process come to the rescue. The purpose of this research is the development of an information system that would allow to carry out quality management in terms of the results of the learning process. The work is of practical importance, as algorithm for assessing the learning process is proposed, which is implemented and integrated into the information system of monitoring, evaluation, correction of the learning process for any discipline. With the help of the developed module it is possible to evaluate the degree of mastering competences by students and to carry out long-term planning of the educational process. In the work, the process of teaching students is modeled on the basis of studies of general information processes in educational environments. A dynamic model is constructed in the notation of colored hierarchical Petri nets. The simulation model of one of the stages of mastering the discipline of the curriculum is analyzed. Methods of statistical analysis developed an algorithm for rating the work of the department. The equation of the discriminant function was obtained, which served as a rating for real departments of the Moscow City University. The model of the educational process and the rating algorithm of the departments is implemented in the additional module of the corporate system of the university. This module is located in the subsystem of department management. When designing the module, functional requirements were formulated. The processes that automate the information system are described. The prototype information was developed on the platform ”1C: Enterprise”.
and phrasesmodelassessment of the departmenteducational processratinginformation system-
In: K. E. Samouylov, L. A. Sevastianov, D. S. Kulyabov (eds.): Selected Papers of the IX Conference
“Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”,
Moscow, Russia, 19-Apr-2019, published at http://ceur-ws.org
1. Introduction
Relevance of the topic. A specific indicator of the development of national Russian
higher education is the position of universities in world university rankings [
1
]. The
popularity of various systems for assessing the activities of a higher educational institution
has determined their recognition and widespread usage [
2
]. One of the indicators of a
high rating of the university is the quality of education [
3
].
The key structural element that is responsible for the educational process is the
academic department (department). Evaluation of the results of the department is an
important indicator of the university’s assessment in the educational services market in
general [
4
].
Efective management of the university is impossible without a corporate information
system, which is an integrated system consisting of many subsystems [
5
]. One of these
subsystems is the module for managing the activities of the department.
The task of the authors is to modernize the module by implementing the proposed
algorithms for evaluating the activities of the department and for planning the educational
process on the basis of its analysis.
The objects of the research are the informational processes taking place in the
structural subdivision of the university aimed at teaching students.
The subject of the study is the process of developing an information system unit for
evaluating and adjusting learning process of students of a higher education institution.
2.
Problem Statement
Analyze the existing processes associated with the study of students of a certain
discipline:
– Construct a dynamic model of the learning process;
– Carry out a research into the activities of the Moscow University Department;
– Build a mathematical model of the rating evaluation of the department;
– Formulate the requirements for the module being developed;
– Develop a prototype of the information system module for strategic planning of
the educational process.
3.
Modeling the Education Process
The study of the process of education is a very important task for the management of
educational institutions, and consequently, an improvement of training quality of future
specialists [
6
]. The construction of mathematical models makes it possible to study the
regularities of the process of the educational process, which is part of the educational
process.
A change in the state of an object is called a process [
7
]. Educational process can be
discussed in relation to students as studied objects. The educational process is part of
the educational system [
8
]. The diferences are presented in table 1.
To construct a mathematical model, the authors proposed the definition of an
informational object – an educational process that reflects its formalized structure.
The educational process (UE) is a continuous, dynamic, deterministic process with
rigidly defined, limited resources, consisting of elements:
– lecture forms of training;
– laboratory forms of training;
– Seminar classes;
– practical lessons;
– technological practice;
– independent work;
– internship;
– Knowledge control.
Resources for the implementation of the educational process:
Comparison of Educational Process and Educational System [
9
]
ObjectivesContentProcessEducational system
The main goal – the
development of individual
characteristics of the student,
the promotion of his
cognitive independence through
subject knowledge, skills
and habits.
On the forefront are general cultural values.The activity of the teacher is the unity of education and upbringing.Educational processThe main goal is the assimilation of subject knowledge, skillsThe content is determined
by the curricula.
Training is conducted with
the teacher’s dominant
role
– faculty;
– the audience;
– various benefits;
– computer and multimedia audiences;
– corporate networks, etc.
The authors have studied information flows that occur during training [
10
].
A student can be represented as a finite automaton, with a finite set of states
that depend on external influences. Therefore, it was decided to construct a dynamic
model in the notation of Petri nets. To implement the dynamic model, the CPN Tools
software [
11
] is used, which is freely distributed for non-profit organizations.
Each network position corresponds to the state of the learning process. Transition is
the study of any topic: tests, completion of laboratory work, exams, course projects,
etc. Transition triggering corresponds to the successful completion of the study of the
topic. Each token is added a color that stores the attributes: either “passed” or “failed”.
Following the instructions, the chip moves along the network (Figure 1).
To evaluate the performance of the model, the matrix method of network analysis
was applied [
12
]. A necessary condition for the attainability of any network marking
was fulfilled. The analysis showed that only two combinations of transitions are suitable:
3, 2, 1 and 1, 2, 3. This conclusion is confirmed by figure 2.
Algorithm of the Rating Evaluation of the University Departments’Work
Experimental data of the twelve departments of the Moscow City University for 25
indicators was used to construct a mathematical model [
13
]. To reduce the dimensionality
of the model, the most significant indicators were selected using the correlation analysis.
The significance was verified on the basis of a matrix of correlation coeficients.
As a result, construction of the model involved 16 indicators: Hirsch index, the
average wage, the average score of students on admission exam, etc. With the help of
cluster analysis (hierarchical clustering) department were divided into two classes: the
“efective” and “inefective”. The selection was based on the diference in the mean values
of the metric variable. The generalized indicator of the activities of the departments
was calculated (Fig. 3).
The investigated objects were divided into “Efective” — K5, K4, K10, K1, K2, K7;
“Ineficient” — K3, K9, K6, K11, K8.
In the process of analysis, the equation of the discriminant function was
constructed (1)
= − 7, 458 * 1 + 5, 762 * 2 + 3, 481 * 3 + 30, 173 * 4 − 16, 599 * 5 + 8, 190 * 6−
− 11, 449 * 7 + 6, 867 * 8 − 3, 367 * 9, (1)
where is the indicator of the department.
Using the constructed model with a probability of 0.999, it is possible to predict the
evaluation of the work of structural units without special studies of their indicators.
The prototype of the information system implementing the algorithms described
above was developed on the “1C: Enterprise” platform [
15–17
].
Basic Concepts Used in the Information System Module
The performance indicators of the department and the results of students’ training
are assessed with points for each unit of work. Objects of accounting are various types
of work performed by the department or students in the learning process. Achievements
are indicators for a certain period of time. The rating of the department is the sum
of all points scored for the whole period of work. Accounting rules are automated
summation [
18, 19
].
Processes that automate the module of the information system [
20–22
]
– Definition of the system of indicators for evaluating the work of the department.
– Determination the success of student learning.
– Determination of rules for calculating the rating of the department and the
performance of each student.
– Formation of recommendations on the prospective planning of the educational
process.
– Construction of rules for the success of the department.
– Creation of a variety of customizable reports.
Functional requirements for the information system module [
23
]
– Ensure the collection of data on the learning process in the system;
– Ensure the storage in a single database of all information about the activities
conducted, the type of employment, the completed, unsuccessful tasks, tests, the
number of students who have passed and not passed control, various types of
activities of the department;
– Provide preprocessing of data using methods of statistical data analysis;
– Automate the construction of a learning process model based on data on the
learning process in the electronic learning system and its editing on the basis of a
hierarchical colored Petri net;
– Automate the process of creating various reports.
The database stores lists of students and lists of the faculty members of the department
(Figure 4).
To account for the progress of students, scores are added for each reporting period
for each subject in the schedule (Figure 5).
In general, the repository information system of the department are various test and
verification tasks. The results of the checks are sent to the developed module, where the
rating of the student is evaluated.
Examples of summary reports of the results of the department are presented in
Figures 7, 8.
The dynamic model of the educational process in the notation of Petri nets allowed
to assess the degree of mastering the educational material on discipline based on class
performance and performing practical work by a group of 16 students. One person was
unsuccessful, which coincides with the real results.
The algorithm of the department’s activity was developed for eleven departments of
the Moscow City University with 25 indicators. The twelfth department served to test
the performance of the model. The faculties were divided into two groups: “efective” and
“not efective.” A discriminant equation has been constructed, which made it possible to
assign the twelfth department to the group “efective”, which corresponds to reality.
The proposed model and algorithm are implemented as a module of the information
system of the department on the platform “1C: Enterprise”. Examples of interfaces are
shown in Figures 4–7.
7.
Conclusions
The developed model of the educational process and the algorithm of the rating
evaluation of the structural subdivision of the university is implemented in the module
of the information management system of the department. This will improve the quality
and efectiveness of university management in general, as based on reliable and objective
methods of evaluation and prospective planning. The implementation of the module
will simplify the collection of data on the work of departments and the quality of the
educational process and assist with formation of various types of reporting.
1.
O. N.Romashkova
,
L. A.Ponomareva
,
I. P.Vasilyuk
,
Y. V.Gaidamaka
,
Application of information technology for the analysis of the rating of university
,
in: CEUR Workshop Proceedings 8. “ITTMM 2018 - Proceedings of the Selected Papers of the 8th International Conference “Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”
,
2018
, pp.
46
-
53
.
2.
E.Bobrikova
,
Y.Gaidamaka
,
O. Romashkova,The application of a fluid-based model for the analysis of the distribution time of a file among users in peer-to-peer network
,
in: Selected Papers of the II International Scientific Conference “Convergent Cognitive Information Technologies” (Convergent2017
).
CEUR Workshop Proceedings
, Vol.
2064
,
2017
, pp.
55
-
61
. URL http://ceur-ws.
org/
Vol-2064/paper06.pdf
3.
I.Gudkova
,
O. N.Romashkova
,
V.Samoylov
,
Determination of the range of the guaranteed radio communication in wireless telecommunication networks of IEEE 802.11 standard with the use of ping program
,
in: CEUR Workshop Proceedings 8. “ITTMM 2018 - Proceedings of the Selected Papers of the 8th International Conference “Information and Telecommunication Technologies and Mathematical Modeling of High-Tech Systems”
,
2018
, pp.
54
-
59
.
4.
V. S.Kireev
,
Development of fuzzy cognitive map for optimizing e-learning course
,
Communications in Computer and Information Science706
(
2017
)
47
-
56
.
5.
G.Gorelov
,
N.Kazanskii
,
O.Lukova
,
Communication quality assessment in speech packet transmission networks with random service interrupts
,
Automatic Control and Computer Sciences27
(
1
) (
1993
)
62
-
64
.
6.
G.Gorelov
,
O.Romashkova
,
Influence of Russian, Spanish and Vietnamese speech characteristicson digital information quality
,
in: IEEE International Symposium on Industrial Electronics Proceedings of the IEEE International Symposium on Industrial Electronics, ISIE'96. Part 1 (of 2)
. sponsors: IEEE, Warsaw University of Technology. Warsaw, Poland,
1996
, pp.
311
-
313
. doi:
10
.1109/ISIE.
1996
.
548438
.
7.
L.Ponomareva
, G. Gorelov,
Development of a mathematical model of the educational process at the University to improve the quality of education
,
Fundamental research (2)
(
2017
)
77
-
81
. URL https://elibrary.ru/item.asp?id=
28800201
8.
O.Romashkova
, T. Ermakova,
Monitoring the quality of education in secondary organizations with the use of modern means of Informatization, Bulletin of the Russian University of friendship of peoples
.
Series: Informatization of education (4)
(
2014
)
10
-
17
. URL https://elibrary.ru/contents.asp?issueid=
1345001
9.
E.Ovchinnikova
,
S.Chiskidov
,
Problems of development and application of interactive educational modules in learning, in: Science, education, society: trends and perspectives the Collection of scientific works on materials of the International scientific-practical conference: in 7 parts. OOO "Ar.Consult"
.,
2014
, pp.
80
-
85
.
10. L.
Ponomareva
,
L.Kodanev
,
Development module of the corporate information system "Educational environment of the University" based on cloud technologies, in: Computer science: problems, methodology, technology the collection of materials of XVII international scientific conference: in 5 t
.,
2017
, pp.
393
-
398
. URL https://elibrary.ru/item.asp?id=
28952199
11.
O.Romashkova
,
A.Morgunov
,
Information system for evaluation of results of activity of educational institutions of Moscow, Bulletin of the Russian University of friendship of peoples
.
Series: Informatization of education (3)
(
2015
)
88
-
95
. URL https://elibrary.ru/item.asp?id=
24323920
12.
Y. Y.Orlov
,
D.Zenyuk
,
A.Samuylov
,
D.Moltchanov
,
Y.Gaidamaka
,
K.Samouylov
,
S.Andreev
,
O.Romashkova
,
Time-dependent sir modeling for d2d communications in indoor deployments
,
in: Proceedings - 31st European Conference on Modelling and Simulation
, ECMS.,
2017
, pp.
726
-
731
.
13.
A.Drozdova
,
A. I. Guseva
,
Modern Technologies of E-learning and its Evaluation of Eficiency, Procedia - Social andBehavioral Sciences237
(
2017
)
1032
-
1038
.
14. V. S. Kireev,
Development of fuzzy cognitive map for optimizing e-learning course
,
Communications in Computer and Information Science706
(
2017
)
47
-
56
.
15.
V.Kireev
,
A.Silenko
,
G. A.
,
Cognitive competence of graduates, oriented to work in the knowledge management system in the state corporation "Rosatom"
,
Journal of Physics: Conference Series781
(
1
) (
2017
)
012060
. doi:
10
.1088/
1742
-6596/781/ 1/012060.
16.
O. N.Romashkova
,
S. V.Chiskidov
,
P. A.Frolov
,
Improvement of information technologies of the decision of problems of management in ec
.
onomic systems
,
Modern high technologies (10)
(
2017
)
63
-
67
.
17.
O. N.Romashkova
,
L. A.Ponomareva
,
Model of educational process in high school using Petri nets, Modern information technologies and it education 13 (2) (2017
)
131
-
139
. doi:
10
.25559/SITITO.
2017
.
2
.244.
18.
L. A.Ponomareva
,
K.Litvinova
,
V. I. Gorelov
,
Comparative analysis of the Russian rating systems of the University assessment, in: Methods, mechanisms and factors of international competitiveness of national economic systems collection of articles of the International scientific
and practical conference: in 2 parts,
2017
, pp.
55
-
58
. URL https://elibrary.ru/item.asp?id=
30378977
19.
O. N.Romashkova
,
L. A.Ponomareva
,
Model of efective management of the United educational system (structure), in: New information technologies in scientific researches materials of the XXI all-Russian scientific and technical conference of students, young scientists and specialists
. Ryazan state radio engineering University,
2017
, pp.
16
-
18
. URL https://elibrary.ru/item.asp?id=
30521101
20.
L. A.Ponomareva
,
V.Kodanev
,
S. V.Chiskidov
,
Model of management of process of development of competences in educational organizations, in: New information technologies in scientific research materials of the XXII all-Russian scientific-technical conference of students, young scientists and specialists
. Ryazan state radio engineering University,
2017
, pp.
20
-
22
. URL https://elibrary.ru/item.asp?id=
30521104
21.
L. A.Ponomareva
,
O. N.Romashkova
,
I. Vasilyuk
,
Conceptual model of changing the rating assessment of the University, in: Methods, mechanisms and factors of international competitiveness of national economic systems
.
Collection of articles of the international scientific-practical conference: in 2 parts
,
2017
, pp.
75
-
77
. URL https://elibrary.ru/item.asp?id=
30378981
22.
L. A.Ponomareva
,
P. E.Golosov
,
A. B.Mosyagin
,
V. I. Gorelov
,
Method of efective management of competence development processes in educational environments, Modern science: actual problems of theory and practice
.
Series: Natural and technical Sciences (9)
(
2017
)
48
-
53
. URL https://elibrary.ru/item.asp?id=
30281545
23.
L. A.Ponomareva
,
G. M.Kochergina
,
E. N.Perelygina
,
The use of information and communication technologies in the study of banking in College, in: Theoretical and applied issues of science and education. Collection of scientific works on the materials of the International scientific-practical conference
: in 16 parts,
2015
, pp.
104
-
107
. doi:
10
.17117/na.
2015
.
02
.083.