<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Potential of State Information Systems in Assessing the Quality of Education*</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Northern (Arctic) Federal University named after M.V. Lomonosov</institution>
          ,
          <addr-line>163002, Arkhangelsk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0001</lpage>
      <abstract>
        <p>The analysis of the trends in the educational policy of the state and the Federal State Educational Standard requirements for the modern school has led to the necessity of introducing the “Digital School” model of the educational information environment, which will combine new information and communication technologies and educational practices in the educational process, as well as ensure their effective use in the educational process. The issues of managing educational activities of students, the use of new methods, organizational forms, and teaching digital resources based on developing modern information technologies are becoming the most relevant. The conditions for the organization of the educational process are substantially changing following the development of the information educational environment of the educational institution. Modern learning tools using cloud computing, virtual laboratories, artificial intelligence, social services, robotics, digital educational resources, and others are changing the requirements for the educational environment and the organization of the learning process. At the same time, the issue of the effectiveness of using the methods of organizing the educational process in the information and educational environment using state information systems has been insufficiently studied. This leads to a contradiction between the presence of state information systems and the lack of methods for their use in the educational process for the administration, teachers, students, and parents. The article discusses the implementation of automated information systems Dnevnik.ru and E-education in secondary schools and their impact on education quality management.</p>
      </abstract>
      <kwd-group>
        <kwd>State Information Systems</kwd>
        <kwd>Information Educational Environment</kwd>
        <kwd>Quality of Education</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>In some countries, educational networks are used that unite educational institutions of
the country to monitor the achievements of students. For example, in Greece - GRNET,
Slovenia – ARNES, in Austria - ACOnet, in the UK - Janet, in Ireland - HEAnet, etc.</p>
      <p>The analysis of foreign countries' experience (the USA, China, Finland, and others)
shows that the quality of education is affected so much not by providing all students
with computer equipment and Internet access, but by organizing IOS and using its
capabilities for educational purposes.</p>
      <p>At the same time, there is the Russian experience in organizing IOS, which has led
to positive results, since in the international ranking in terms of Internet use Russia has
risen from 70th place to 24th place in the world.</p>
      <p>The basic requirements for the information and educational environment of an
educational organization are written into the Federal State Educational Standard. Currently,
most schools in Russia have completed the transition to the Federal State Educational
Standard (FGOS) of primary, basic, and general secondary education. Following its
introduction, the goals of education have also changed: the transition from “universal
education” to a system-active paradigm. Currently, the objectives of education are
aimed at developing the learner's personality, his or her personal, social, cognitive, and
communicative abilities, that is, now the requirements for learning outcomes are
evaluated in the form of personal, meta-subject, and subject results.</p>
      <p>
        In these conditions, an essential role is given to information support of the
educational process using modern information technologies, digital information, and
educational resources in academic disciplines. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]
      </p>
      <p>IT development of the education sector, the organization of the information and
educational environment in each school in the context of the introduction of the Federal
State Educational Standard significantly increased the role of state IT systems
(hereinafter GIS) in educational management. It becomes necessary to cooperate with
educational organizations and IT companies that carry out automation and further support of
GIS implemented in schools.</p>
      <p>
        Thus, the state with the help of normative legal documents regulates the implementation
of information systems in the educational information environment of educational
institutions, designed to ensure the transition to a new quality in the general system of
continuing education [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] (see Ошибка! Источник ссылки не найден.).
Article 98 of the Federal Law “On Education in the Russian Federation” provides for
the creation of several IT systems used in education. Decree of the Government of the
Russian Federation as of August 8, 2013, No. 755 introduced a federal system to ensure
the realization of state final certification of students. The second mandatory automated
GIS is the “Register of organizations engaged in educational activities with
state-accredited educational programs” (http://accredreestr.obrnadzor.gov.ru/). Information in
this system is publicly available. The formation of information is conducted by
Rosobrnadzor of Russia [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>Also, there is a GIS of state supervision in the sphere of education, ensuring the unity
of the requirements of state supervision in the field of education and taking into account
its results. It is regulated by the Decree of the Government of the Russian Federation
as of August 20, 2013, No. 719.</p>
      <p>Another state GIS is the “Federal register of information on documents on education
and (or) on qualifications, documents on training issued by organizations engaged in
educational activities. (http://frdocheck.obrnadzor.gov.ru/).</p>
      <p>The Federal GIS “The Federal Register of Apostilles affixed to the documents on
education and (or) on qualifications” is necessary for work in countries that have joined
The Hague Convention as of October 5, 1961. Check the information on the conferment
of academic degrees and titles on the website http://apostille.obrnadzor.gov.ru/.</p>
      <p>Currently, a federal interdepartmental accounting system (FMSU) for organizations
and their students is being introduced, which is associated with the IT systems of public
authorities and is used in the providing of online public services.</p>
      <p>All these systems are designed to regulate control over the issuance of
state-recognized documents on education, but cannot be used to organize the information and
educational environment in educational institutions.</p>
      <p>The problem of implementing state information systems in Russian educational
institutions is that each region of Russia chooses a GIS that meets the requirements of the
educational policy in the field of education and is based on the financial capabilities of
the region. One of the most popular GIS in the field of education, supported by the
Government of the Russian Federation and used to improve the quality of the
educational process, is Dnevnik.ru and Online Education.
2</p>
      <p>Analysis of the Possibilities of State Information Systems
“Dnevnik.ru” and “Online Education”
GIS Dnevnik.ru was developed under the auspices of the national project "Education
as a unified educational network, forming an online educational environment for all
participants in the educational process (administration, teachers, students, parents).
This project was supported by regional ministries, education departments, and the
Plenipotentiary Representative of the President of the Russian Federation in the
Northwestern Federal DistrictToday, according to the site https://dnevnik.ru/news/89333, more
than 15 800 schools from 75 regions of Russia, 6 countries of near and far abroad have
become participants in this project. The campaign is located in St. Petersburg, and
campaign offices are located in 10 cities of Russia.</p>
      <p>Dnevnik.ru is a closed IT system that guarantees the security of personal data. To
enter the system requires user registration through the portal of public services. The
system provides access to information around the clock and free basic functionality for
users. Registered users can visit an online journal, a student’s diary, a library of
literature, an online test exam testing, competitions held by the country's largest universities,
and other services.</p>
      <p>Dnevnik.ru provides great opportunities for teachers. It stores information about the
administration of the educational institution, news, legal documentation, there is access
to a photo gallery, class schedule, homework control, reporting, generation of sheets,
online testing, and more. The teacher can add comments and additional materials to any
lesson. The interactive control module allows you to give homework to all or individual
students, copy exercises for different classes and monitor progress. You can attach links
to Internet resources, video tutorials, and tests.</p>
      <p>School reports, which were previously filled in manually, are now generated
automatically. All data is updated in real-time. The possibilities of conducting tests in the
online form are also presented. In tests, the teacher can add illustrations, media files.</p>
      <p>It is also possible to exchange opinions on homework, storing class files, a library,
and a hybrid library of finished teaching materials. The class page contains a news feed
where the teacher can post-operational information and announcements.</p>
      <p>For students, the system offers an online diary, provides access to online educational
resources, a personal profile, information about contests in which students can
participate. Students have the opportunity to send the teacher their work, photographs of
written work, etc. The student and teacher can also exchange comments on the work being
done.</p>
      <p>For parents, the system provides viewing of the student’s online diary, homework,
messages about changes in the schedule, correspondence with the teacher, selection of
a tutor, and tracking of the student’s location are implemented.</p>
      <p>If a parent has several children of school age, it is possible to “link” all student
profiles in one parent account. The function is available even if children attend various
educational organizations.</p>
      <p>
        Another state IT system “Online Education” is a product developed by the IRTech
company in Samara, which is a leader in the field of IT solutions for the education
system. The product is designed to support the innovative development of educational
organizations. This complex automated information system is being tested in
educational organizations of different regions of the Russian Federation. It unites preschool
and educational institutions in a single network, organizations of additional and
vocational education, and public authorities within the region. This system allows schools
to almost completely automate management activities and the educational process. The
system unites all participants in the educational process, which positively affects the
activation of their educational activities, increasing its effectiveness [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>On the other hand, this system allows federal, regional, and municipal education
authorities to monitor the activities of educational institutions throughout the power
vertical. The system complies with the legislation of the Russian Federation.</p>
      <p>State IT system "Online Education" provides the user with the opportunity to create
a complete school curriculum; calendar-thematic planning in all subjects and its use in
an online journal; the lesson schedule window is associated with an online classroom
journal; placing and saving files with educational materials. GIS "Online Education"
allows you to record the entire course of the educational process and its results in the
subject; maintain a portfolio of projects and personal portfolios; create thematic, lesson
plans and planning for each subject (and other teachers leading this subject will be able
to use this planning). This provides a professional discussion by teachers of the content
of training, forms, and methods of control on methodological advice.</p>
      <p>Like Dnevnik.ru, “Online Education” contains an online journal, standard reports on
academic performance and attendance, provides interaction between participants in the
educational process; has a bulletin board, a catalog of school resources; internal email,
the ability to organize a forum; send SMS.</p>
      <p>Also, the GIS OE generates all administrative and final reports, can monitor and
interact between educational organizations and education management bodies. To
transfer a student from one school to another within the municipality, the system enrolls
him in another organization while maintaining the student’s basic data and personal
file.</p>
      <p>GIS “Online Education” is installed on the administrator’s server computer, and you
can work in the system from any computer connected to the Internet. On users'
computers, only a standard browser program is required. A student, parent, the teacher has
the opportunity to work from a home computer, entering the program with his username
and password. For registered users, logging into the system from 2018 can be carried
out through the portal of public services or HTTP: //giseo.rkomi.ru. At the user's
request, the system constructs reports with various data: reports on employees, on
students, according to estimates, reports on additional education, on the movement of
students, according to the curriculum.</p>
      <p>In the GIS “Online Education” report designer, it is possible to create two types of
reports - intra-school and system, where data from all schools in a district or region are
combined. An employee can combine several roles: administrator, teacher, class
teacher, parent. For each role, access rights to different parts of the system are
configured, combinations of access rights can be set, which helps to determine who edited the
information.</p>
      <p>GIS “Online Education” allows you to create a plan and a protocol of control work
indicating the difficulty levels of the tasks and the maximum score for its
implementation, which fully complies with the requirements of the Federal State Educational
Standard of all levels of education.</p>
      <p>From the analysis of the capabilities of the two-state IT systems, it follows that each
of them performs similar functions used by all participants in educational relations.
However, for a more objective description of these systems, we decided to evaluate
their capabilities in terms of managing the educational process, reports preparations,
and assessing the quality of the educational process.</p>
      <p>In terms of educational process management in the considered GIS, most of the
functions coincide. In managing the quality of education, they provide more rapid feedback
from parents due to the possibility to track learning progress in an online diary, thereby
increasing the student's responsibility for the results of their studies in completing
homework.</p>
      <p>GIS “Online Education” is distinguished by the additional possibility to post courses
developed by teachers. The administrative unit has the function of further education,
informing parents about the results of the basic state examination and unified state
examination.</p>
      <p>It should be noted that GIS developers are constantly improving systems following
the order of educational organizations.
3</p>
      <p>
        Experience in Implementing GIS to Improve the Quality of
Education
Schools in which GIS OE is being introduced have appreciated some advantages over
similar systems. Among them, it should be noted: an integrated monitoring system
within the educational institution and the municipality; the possibility of switching to
online document management [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and optimizing access to operational information;
minimum requirements for the organization of the workplace and compatibility with
Linux, installation of special programs is not required, compatibility with the mobile
application.
      </p>
      <p>With the implementation of state IT systems, the process of making managerial
decisions changes, namely, based on the translation of standard reports into the online
form, the time of the teacher and administrator is saved; always relevant and accessible
information on the class and individual students; the frequency of decision-making has
increased almost 2 times; now you can forecast the outcome of the educational process.</p>
      <p>Of particular interest in the GIS “Online Education” is the MSOKO analytical
section - a multilevel system for assessing the quality of education - a report designer that
makes it possible to analyze objective results at various levels. Assessing the quality of
education solves one of the main tasks: to monitor the current state of training of
students in the subject, to monitor changes observed during training in grades 9 and 11 in
preparation for basic state examination and unified state examination on the subject, to
plan the work of the teacher taking into account the changes.</p>
      <p>In terms of reports preparation on the educational process, the GIS “Online
Education” contains a multi-level system for assessing the quality of education (MSOKO),
which has a diagnostic map, personal monitoring, the disjunction between the results
of the tests, and assessment indicators, a text analysis of the educational process, etc.
The first step in testing MSOKO is tracking the results of control and diagnostic works
on Mathematics, with the aim of planning and conducting differential correction work
with students and increase the personal level in mastering the basic elements of the
subject content.</p>
      <p>To compare class results for the study period, both the subject and the class teacher
need to study the report “Analysis of the results of tests (results of tests in comparison
with the predicted results - IRO)”.</p>
      <p>The report “Diagnostic card” contains information on the dynamics of the average
individual score of the student on the subject according to the results of all the work
performed by him and allows you to judge the level of standard acquisition by the
student.</p>
      <p>You should pay attention to a report such as “The disjunction between the results of
tests and assessment indicators” to make grading of oral answers in the lesson and
written work more objective. When working with the MSOKO module, we have the
opportunity to see the scores of two years in the “Preliminary Exam Results” report and get
a more objective overview. After passing the exams of the current school year, it is
necessary to analyze the work performed.</p>
      <p>It is necessary to pay attention to all teachers of the educational institution on
“School Reports”. You can see and analyze your work with the help of the material
“Results of teachers’ activities on subjects” and “Personal control of the results of
teachers’ activities”.</p>
      <p>The MSOKO module prepares reports objectively. We get used to evaluating the
work of the student, and then suddenly the teacher finds himself in a situation where
his work is evaluated and evaluated in comparison with colleagues in other subject
areas. This should be taken correctly: do not engage in self-discipline, you need to analyze
the result and draw competent conclusions, outline ways to solve problems, organize
differentiated work with students with one mark “4”, with one mark “3”, with
underperforming. The whole system with its analytical reports is designed to help the teacher
organize daily work in such a way that the quality of education becomes higher.</p>
      <p>You rarely see a teacher at school without classroom guidance. There are always a
lot of concerns for this category of teachers. The existing MSOKO section “Student
Reports” and “Class Reports” will help you, colleagues, work in all directions: with
students and subject teachers. “Estimated indicators” will reveal subjects in which the
student needs to strengthen the work to improve results. If you want, you can see the
predicted exam results of your wards. The generated individual “Diagnostic card” will
show objective results with an assessment of the standard development level (mastered
/ not mastered), and the report “Test results” will help to see undeveloped content
elements.</p>
      <p>You can make use of it and carry out daily, hard work with students, and with their
parents, and with colleagues.</p>
      <p>But. There is one significant addition: all of this you will see and be able to apply in
your work if, when filling out the online journal, you correctly indicate the type of task.
To do this, just be attentive and not rush. It is necessary to respect the work of
colleagues, to be careful, and then the results of your joint work will please both yourself
and your students. Do not be afraid to study, do not be afraid of the assessments of your
work, do not be afraid to learn new technologies, improve, improve your professional
level!</p>
      <p>To create a plan of diagnostic or thematic test work, you must:
1. Before you start filling out the test reports, you need to check the link of the subject
and codifiers of the subject.</p>
      <p>For primary and basic school classes, content element codes are taken from the
codifier for compiling monitoring and measuring material for the basic state examination,
content element codes are taken from the codifier for the unified state examination.</p>
      <p>To adjust the link of subjects in an educational institution, you must contact the user
with administrator rights.</p>
      <p>2. The test report can be filled in the GIS “Online Education” for the following types
of tasks:</p>
      <sec id="sec-1-1">
        <title>To fill out the test report, you need to create a test plan.</title>
        <p>3. To create a test plan in the window that appears, you need:
 select the difficulty level (basic or advanced);
 indicate the maximum score for the selected level;
 mark with flags the necessary coding of content elements.</p>
      </sec>
      <sec id="sec-1-2">
        <title>Filling the test report takes place on the screen.</title>
        <p>The protocol has scored for each student for each assignment.</p>
        <p>The report “Test work protocol” contains summary information on the test work, its
analysis, and results. Here it is important to see the level of fulfillment of the test work,
the correspondence to the index of expected performance (its calculation is already in
the system), the objectivity of the marks set, and, of course, a fairly detailed analysis of
the control work.</p>
        <p>The system further indicates verifiable content elements that have a low level of
solvability. Summing up, we obtain data on academic performance, performance, level
of failure, as well as recommendations for conducting individual work with students.</p>
        <p>It is safe to conclude that the testing of MSOKO has yielded positive results:
1. We have come to such optimistic results in a long and difficult way, and the
identification of difficult topics has allowed us to reduce the percentage of unsolvability
of tasks during correctional work and in individual lessons with students.
2. The level of training in the last administrative training work as of 04.16.19 was 100%
compared with the previous ones.
3. Significantly reduced time during analysis
4. Analysis of the test work has become more detailed and informative, including
recommendations in working with specific students on difficult topics.
5. Monitoring is quite transparent; it allows providing objective results to all
participants in the educational process.</p>
        <p>Thus, by analyzing the work carried out according to the parameters proposed by
MSOKO, it becomes possible to obtain visual objective results of the work of the school
and teachers, which can be reviewed, analyzed, and included in the annual statistics.</p>
        <p>This problem is now being solved by using information technology and
mathematical methods of analysis and storage of information used in statistics. The MSOKO
module allows the teacher to use the following types of reports: class reports, test results,
class teacher reports, diagnostic cards, final grades - personal control, personal student
reports. MSOKO module allows the head, deputy head to use various types of reports.
The most demanded making management decisions are personal control, the gap
between the results of control work, and estimated indicators. Using the MSOKO module
reports allows you to provide objective results for all participants in the educational
process, to get visual objective results of the school.</p>
        <p>Thus, having analyzed the capabilities of two-state IT systems and our own
experience in both systems, we are more inclined to implement GIS “Online Education” as
the most convenient to use, fill out, conduct systemic and multi-level monitoring of
educational activities, and ensure the transition of an educational organization to new
quality education.</p>
        <p>In the Russian Federation today, the Unified System for Assessing the Quality of
Education (ESOKO) has been formed, which makes it possible to timely identify and
solve problems in the education system, monitor students' knowledge at different levels
of education. This system allows you to have a complete picture of the quality of
education in the country, analyze and take into account the influence of various factors on
the results of educational institutions, conduct self-diagnostics and identify problems
for schools, and parents to have information about the quality of children's knowledge.</p>
        <p>Besides, the center of national and international studies of the quality of education
of the Federal Institute for Educational Quality Assessment conducts in the Russian
Federation national studies on the quality of education (NIKO), all-Russian verification
work (VPR), and internationally comparative studies on the quality of education (PISA,
TIMSS, PIRLS, ICCS, TALIS, PIAAC). All these studies make it possible to assess
the competitiveness of schools, identify problems, compare changes taking place in the
educational system. Assessment of the knowledge of schoolchildren is supplemented
by studies of the professional competencies of teachers. This will provide a complete
and objective assessment of the quality of education in an educational organization.</p>
        <p>
          Assessment of school students’ knowledge is supplemented by studies of teachers’
professional competencies in the field of DRIN-IT and digital technologies [
          <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
          ]. This
will provide a complete and objective assessment of the quality of education in an
educational institution.
        </p>
        <p>
          In the Russian Federation, the assessment of educational achievements of students
is carried out during the "state final certification of secondary school graduates in the
form of unified state examination; state final certification of graduates of a primary
school in the form of a basic state examination; international comparative studies
(PISA, PIRLS, TIMSS, etc.); monitoring studies at the federal and regional levels;
accreditation of educational institutions; various research projects carried out by
individual research teams and organizations of the country; intermediate certification of
students, organized at the level of class and school” [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ].
        </p>
        <p>
          A comprehensive quality assessment is carried out based on students' educational
achievements (assessment of the subject, meta-subject, and personal results of general
education); assessing the success of mastering the content of individual academic
subjects; the dynamics of educational achievements of students; integrated use of
procedures for the final assessment and certification of students and monitoring studies;
tiered approach to the development of planned results; the use of a cumulative
assessment system (portfolio), which characterizes the dynamics of individual educational
achievements; the use of “along with standardized written or oral works of assessment
methods such as projects, practical works, creative work, introspection and
self-assessment, observation, etc.; the use of contextual information about the conditions and
features of the implementation of educational programs” [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ].
4
        </p>
        <p>An Educational Quality Model of an Educational Institution
After analyzing the literature on the quality of the educational process, we have
compiled a model of the quality of education implemented in the educational organization.
It includes 7 modules.</p>
        <p>Module 1. Policy and quality assurance (regulatory documentation, license, the main
activities of the educational organization, cooperation with other institutions).</p>
        <p>Module 2. Educational programs (educational programs of the primary general
education, basic general education, secondary general education, requirements for the
development of educational programs for educational subjects, work programs in all
subjects).</p>
        <p>Module 3. Educational resources and student support system (information and
educational environment and its components, the material and technical base of the
educational organization).</p>
        <p>Module 4 Assessment of the level of training and tools (results of the unified state
examination, basic state examination, all Russian testing work, intermediate
certification of students, MSOKO).</p>
        <p>Module 5. The level of professionalism of teachers (professional development
programs, methodological associations, individual portfolio of teachers, effective contract,
etc.).</p>
        <p>Module 6. Communication system (GIS OE, school website, VKontakte corporate
group, e-mail, etc.).</p>
        <p>Module 7. Informing the public about the learning outcomes (in-school newspaper,
“Journalist” project, video news, media, self-examination, conference, parent-teacher
meetings, etc).</p>
        <p>Each of the modules performs its functions, the integration of which allows us to
build a systematic assessment of the quality of the entire educational process in the
educational organization and the educational process, in particular, based on the use of
GIS OE as a component of online information educational environment.</p>
        <p>To control the degree of teacher's knowledge of the GIS OE system, we developed
criteria for filling out an online journal. Assessment of the teacher’s work in the system
was checked according to the parameters: timeliness of filling the lesson topics and the
conformity of their course schedule, homework, making current grades, filling out the
plan and protocol of the test work, the timeliness of making grades for the test work,
final grades for the quarter, six months and other parameters (see Ошибка! Источник
ссылки не найден.).</p>
        <p>These diagrams clearly show the dynamics of the development of the skill of
working with an online journal by teachers over the three years of implementation of GIS.
Fig. 2. Dynamics of the degree of mastering the skills of working in an electronic journal by
teachers over three years figure caption is always placed below the illustration
5</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Conclusion</title>
      <p>
        Thus, the use of automated state systems based on cooperation with IT companies [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]
allows not only to save the working time of the teacher and administrator but also
significantly affect the quality of education.
      </p>
      <p>State IT systems ensure the use of a single information educational space for each
region and the provision of state and municipal services in the field of education in an
online form.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Russian</given-names>
            <surname>Federation</surname>
          </string-name>
          .
          <article-title>The laws</article-title>
          .
          <source>On education in the Russian Federation [Electronic source]: federal law: Dec</source>
          <volume>29</volume>
          ,
          <year>2012</year>
          , No.
          <fpage>273</fpage>
          -FZ: adopted by the
          <source>State Duma Dec</source>
          <volume>21</volume>
          ,
          <fpage>2012</fpage>
          - Electronic data. - Access mode: http://fzrf.su/zakon/ob-obrazovanii-273-fz, free (access date:
          <volume>05</volume>
          /05/
          <year>2018</year>
          ).
          <article-title>- Headline from the screen</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Bolotov</surname>
            ,
            <given-names>V.A.</given-names>
          </string-name>
          :
          <article-title>The head of the Federal Service for Supervision of Education and Science spoke about the creation of OSOKO. Moscow: All-Russian system for assessing the quality of education in the Russian Federation</article-title>
          . - Electronic
          <string-name>
            <surname>data</surname>
          </string-name>
          . - Access mode: http://www.astcentre.ru/poleznaya_informaciy/publikacii_statii/870/, free (accessed: 03/21/
          <year>2018</year>
          ).
          <article-title>- Headline from the screen</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Chirkova</surname>
            ,
            <given-names>L.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Borshchik</surname>
            ,
            <given-names>L.N.</given-names>
          </string-name>
          :
          <article-title>On the development of didactics in online education</article-title>
          [Text] / L.N. Chirkova, // Modern information technologies and IT education.
          <year>2014</year>
          . No.
          <volume>10</volume>
          . p.
          <fpage>221</fpage>
          -
          <lpage>228</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Testova</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chirkova</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The Development of the Informative Line ”Modelling” Using Fractals in a Continuous Multi-Level Education System</article-title>
          .
          <source>Proceedings of the International Scientific Conference Innovative Approaches to the Application of Digital Technologies in Education and Research</source>
          (SLET-2019)
          <article-title>Stavropol-Dombay, Russia</article-title>
          , Vol-
          <volume>2494</volume>
          , May 20-23,
          <year>2019</year>
          . http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2494</volume>
          / urn:nbn:de:
          <fpage>0074</fpage>
          -
          <lpage>2494</lpage>
          -6.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Chirkova</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Testova</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>Designing a system for conducting educational and methodical documentation based on cloud service. Materials of the International Conference “Scientific research of the SCO countries: synergy and integration”</article-title>
          .
          <source>Part 4 - Reports in English (February 11-12</source>
          ,
          <year>2019</year>
          . Beijing, PRC) р.
          <fpage>253</fpage>
          -
          <lpage>260</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Taran</surname>
            ,
            <given-names>V.N.</given-names>
          </string-name>
          :
          <article-title>Use of Elements of Augmented Reality in the Educational Process in Higher Educational Institutions</article-title>
          . CEUR Workshop Proceedings. In 2019 International Conference on
          <article-title>Innovative approaches to the application of digital technologies in education and research SLET-2019</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Taran</surname>
            ,
            <given-names>V.N.</given-names>
          </string-name>
          :
          <article-title>Quality Criteria for Professional Training of Personnel in IT Industry</article-title>
          .
          <year>2019</year>
          .
          <article-title>Proceedings of 2018 17th Russian Scientific and Practical Conference on Planning and Teaching Engineering Staff for the Industrial and Economic Complex of the Region</article-title>
          ,
          <string-name>
            <surname>PTES</surname>
          </string-name>
          <year>2018</year>
          . pp.
          <fpage>47</fpage>
          -
          <lpage>50</lpage>
          . DOI:
          <volume>10</volume>
          .1109/PTES.
          <year>2018</year>
          .8604267/ WOS:000458979100013 https://www.scopus.com/authid/detail.uri?authorId=
          <fpage>57197982001</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Pankratova</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konopko</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mezentseva</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nemkov</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          :
          <article-title>The Preparation of a Modern Computer Science Teacher with the Help of Resource-Saving Technologies and Green IT Implementation</article-title>
          .
          <source>Proceedings of the 2018 multidisciplinary symposium on computer science and ICT. Stavropol, Russia, October</source>
          <volume>15</volume>
          ,
          <year>2018</year>
          . URL: http://ceur-ws.org/Vol2254/10000222.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Konopko</surname>
            ,
            <given-names>E</given-names>
          </string-name>
          , Pankratova,
          <string-name>
            <given-names>O.</given-names>
            ,
            <surname>Nersesyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Abdullaev</surname>
          </string-name>
          , J.:
          <article-title>Training of Teachers for Professional Activity in the Digital Environment of the Educational Space</article-title>
          .
          <source>Proceedings of SLET2019 - International Scientific Conference Innovative Approaches to the Application of Digital Technologies in Education and Research</source>
          , Stavropol - Dombay, Russia,
          <fpage>20</fpage>
          -
          <lpage>23</lpage>
          May
          <year>2019</year>
          , pp.
          <fpage>205</fpage>
          -
          <lpage>212</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2494</volume>
          /paper_18.pdf.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>