=Paper= {{Paper |id=Vol-3104/paper028 |storemode=property |title=A Self-Assessment Tool of the Level of Digital Competence of Ukrainian Teachers in the Context of Lifelong Learning: The Results of an Online Survey 2021 |pdfUrl=https://ceur-ws.org/Vol-3104/paper028.pdf |volume=Vol-3104 |authors=Oksana Ovcharuk,Iryna Ivaniuk |dblpUrl=https://dblp.org/rec/conf/icteri/OvcharukI21 }} ==A Self-Assessment Tool of the Level of Digital Competence of Ukrainian Teachers in the Context of Lifelong Learning: The Results of an Online Survey 2021== https://ceur-ws.org/Vol-3104/paper028.pdf
A Self-Assessment Tool of the Level of Digital Competence of
Ukrainian Teachers in the Context of Lifelong Learning: The
Results of an Online Survey 2021

Oksana Ovcharuk1,, Iryna Ivaniuk 2
1
  Institute for Digitalisation of Education of the National Academy of Educational Sciences of Ukraine, 04060,
Kyiv, UKRAINE
2
  Institute for Digitalisation of Education of the National Academy of Educational Sciences of Ukraine, 04060,
Kyiv, UKRAINE

                 Abstract
                 Reforms in education today are due to many factors, including globalization, the transition to
                 a digital economy and citizenship, the formation of a knowledge society. That is why human
                 digital competencies are becoming increasingly important in the development of education
                 and affect the quality of life of every person. Modern teachers must not only possess his
                 professional knowledge and skills but must also be able to learn throughout life. And in this
                 context, their digital competencies play a crucial role. An important role in clarifying the
                 state of possession of strong digital skills of teachers is played by the need for distance
                 learning, which took place during the COVID-19 pandemic around the world, as well as in
                 Ukraine. In order to clarify the level of digital competence of teachers in Ukraine, the
                 Comparative Studies Department for Information and Education Innovations of the Institute
                 of Information Technologies and Learning Tools of the National Academy of Educational
                 Sciences of Ukraine conducted an all-Ukrainian online survey in January 2021 [[1]]. 1463
                 educators took part in the online survey, they answered five blocks of questions about their
                 competence in the use of digital tools and instruments for distance learning and self-
                 education: information and digital literacy, communication and cooperation, digital content
                 creation, security and problem solving. The purpose of the article is to present the survey
                 results and provide proposals regarding the development of teachers’ digital competence and
                 professional development.

                 Keywords 1
                 Digital Competence, Teacher, Professional development, ICT, Online Survey, COVID-19
                 Pandemic, Distance Teaching and Learning, Lifelong Learning.

1. Introduction

   Today, Ukrainian teachers and schools are in a situation where distance learning has become a
necessity. These circumstances are closely related to the introduction of quarantine measures in all
countries of the world in connection with the COVID-19 pandemic. That is why the digital
competencies of teachers and school administrators are on the agenda in the education system. What
matters today is how teachers and schools develop digital learning environments, what tools they use,
what digital skills they can apply for these purposes. The education system, for its part, should
support teachers, provide them with lifelong learning, quality training and retraining given a person-
centered approach. To determine the prospects for such support, it is important to find out what level


3L-Person 2021: VI International Workshop on Professional Retraining and Life-Long Learning using ICT: Person-oriented Approach, co-
located with 17th International Conference on ICT in Education, Research, and Industrial Applications: Integration, Harmonization, and
Knowledge Transfer (ICTERI 2021), October 1, 2021, Kherson, Ukraine
EMAIL: oks.ovch@hotmail.com (A. 1); irinaivanyuk72@gmail.com (A. 2);
ORCID: 0000-0001-7634-7922 (A. 1); 0000-0003-2381-785X (A. 2);
            © 2022 Copyright for this paper by its authors.
            Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
            CEUR Workshop Proceedings (CEUR-WS.org)
of digital competence teachers have, how they assess it, and whether they can develop their digital
skills on their own.
    An online survey was aimed at implementing the following tasks: identifying public opinion of
general secondary school teachers and school administrators about the problems, needs, and
challenges that arise during distance and blended learning in quarantine; determining the degree of
readiness of teachers to use online tools and online resources during distance and blended learning in
quarantine; comparison of the results of the 2021 survey on the use of online tools and online
resources with the results of the first survey in the spring of 2020 [[2]]; determining the level of
digital competence of teachers through self-assessment based on the DigComp 2.0, 2.1 [[2]] and the
international practice [[5]]; providing appropriate recommendations to stakeholders based on an
assessment of the situation during the quarantine. An online survey revealed the level of development
of teachers' digital competence, their ability to carry out self-assessment. The obtained results of the
research allowed formulating recommendations for institutions that conduct trainings for teachers and
their professional development, as well as for school principals on the use of ICT for the organization
of distance learning.

2. Literature Review

   The problems of using ICT for distance learning by teachers in educational institutions are covered
in the works of researchers V.Yu. Bykov, O. Yu. Burov, О.М. Spirin, V.I. Lugovy, V.V. Oliynyk,
N.P Morse, M.P Shyshkina, S.H. Lytvynova and others [[6]; [7]; [12]]. These researchers raise
questions about the methodology of using digital tools, creating a digital environment for teachers and
students. The main issue, researchers consider the creation of the necessary educational and
methodological support of the process of creating a digital environment of the educational institution,
determining the structure of such an environment and its main components.Issues of formation of
digital competence of teachers are covered in the works of M.P.Leshchenko, I.V. Ivaniuk, O.O.
Gritsenchuk, N.V. Soroko, O.V. Ovcharuk and others [[1]; [2];[4];[6];[8]; [9]; [10]]. The focus of
researchers is on international approaches, as well as on the components of the teacher's digital
competence. In their works, scientists emphasize the need to harmonize the framework for the
development of digital competence of students and teachers with international approaches and the
need to create effective mechanisms for assessing the level of digital literacy of educators in Ukraine.

2.1.    Research Method

   A phenomenon study of the development of teachers’ digital competence; a systematic approach to
information retrieval; the data gathering about the readiness of teachers towards the use of ICT tools
and their problems were applied. An online questionnaire was based on European documents,
including the DigComp 2.0 and 2.1 (2017) [[2]]. Importance was given to the analysis, synthesis of
information based on common scientific methods of analysis and synthesis. In addition,
computational methods of information processing were applied during the data processing online
survey.

2.1.1. Research results

   The study was conducted in the period from 10.01.2021 to 10.03.2021.The empirical data of the
online survey was collected from 12.01.2021 to 28.02.2021.Teachers from the following regions took
part in the online survey: Vinnytsia, Volyn, Dnipropetrovsk, Donetsk, Zakarpattia, Zaporizhia,
Zhytomyr, Ivano-Frankivsk, Kyiv, Kirovohrad, Luhansk, Lviv, Mykolaiv, Odesa, Poltava, Rivne,
Sumy, Ternopil,Kharkiv, Kherson, Khmelnytsky, Cherkasy, Chernivtsi, and Kyiv.Thus,
geographically the online survey covered East, West, South, North and Center of Ukraine. The study
covers a non-representative sample of the target group. A random type of sample was used to conduct
an online survey of teachers. The number of respondents is 1463 people, including 1298 women and
149 men. The survey identified three main age categories: 40-55 years - 42.6%; 26-40 years - 32.9%;
55 and older - 20.5%. By type of educational institutions among the respondents - the most
representatives of such institutions are secondary school - 67.2%, lyceum - 13.9%; educational
complex - 10.3%; gymnasium - 3.4%. Distribution of respondents by type of settlements is the
following: 46.8% - city; 36.7% - village; 16.5% is an urban-type settlement.
    The form of the online questionnaire was filled in only at one's own request.The survey was
anonymous. The questionnaire was published on the websites of the IITLT of the NAES of Ukraine,
the website of the Presidium of the National Academy of Educational Sciences of Ukraine, the in-
service teacher training institutes mailing list, and through the Facebooksocial network.All study
participants were informed about the objectives of the study.
    The analysis and interpretation of quantitative data was carried out using the methods of
descriptive and mathematical statistics, the results are presented in the form of diagrams and their
interpretations, which are arranged in the relevant thematic blocks. The general scientific approaches
to the analysis of the results are outlined in the “Regulations on the Procedure for Forming,
Conducting and Controlling the Performance of Scientific Research and Scientific and Technical
(Experimental) Developments at the National Academy of Pedagogical Sciences of Ukraine” from
December 20, 2018). These approaches are the followings: novelty and relevance; compliance with
the priorities of state policy and thematic areas of research and scientific and technical development;
practical usefulness, possibility of implementation of the given recommendations and conclusions;
availability of previous experience and achievements of scientists in performing scientific research.
    As was stated above, all questions are based on international approaches, including the Digital
Competence Framework for Citizens: Eight Skills with Examples of Use (DigComp 2.1: Digital
Competence Framework for Citizens) [[2]], and adapted to the current version of the online
questionnaire [[1]]. The DigComp 2.1 includes the following levels: basic user, independent user,
professional user. It outlines five areas of this competence: information and digital literacy,
communication and collaboration, digital content creation, security, and problem solving. The study
was constructed according these areas and levels.
    In the area of "Information and digital literacy" when asked about the ability to search for
information, 33.9% of respondents said that they can do search for information in the Internet using a
search engine that corresponds to the basic level of the user; 44.6% of respondents said that they can
use different search engines to find information that corresponds to the level of an independent user;
21.5% of respondents said that they can use advanced search strategies to find reliable information in
the Internet, for example, using web channels that corresponds to the level of a professional user(see
Fig.1).




Figure 1: The sample of the answers of the respondents about the area of "Information and digital
literacy".

   When asked about the ability to assess the accuracy of information during a search 30.5% of
respondents stated that they know that not all information on the network is reliable, which
corresponds to the basic level of the user; 22.3% of respondents stated that they use some filters when
searching to compare and evaluate the reliability of information they find that corresponds to the level
of an independent user; 47.1% of respondents said they could assess the accuracy of the information
using a number of criteria that meet the level of a professional user.
   When asked about the ability to store the information found, 23.7% of respondents said that they
can save files or content and receive them after saving, which corresponds to the basic level of the
user; 28% of respondents stated that they classify information methodically using folders; back up
information or files that store that corresponds to the level of the independent user; 48.3% of
respondents stated that they can store information found on the Internet in various formats; can use
cloud storage services that correspond to the level of a professional user.
   In the field of "Communication and Cooperation" on the question of the ability to communicate
using various means of communication 21.8% of respondents said that they can communicate with
other users via Skype or chat - using basic functions (eg, voice messages, SMS, text exchange), which
corresponds to the basic level of the user; 11.5% of respondents said that they could use the advanced
features of several means of communication (for example, using Skype and file sharing), which
corresponds to the level of an independent user; 66.7% of respondents said that they actively use a
wide range of means of communication (e-mail, chat, SMS, instant messaging, blogs, micro-blogs,
social networks) for online communication, which corresponds to the level of a professional user(see
Fig.2).




Fig.2. The sample of the answers of the respondents about the area of "Communication and
Cooperation".

   When asked about the ability to create and manage content using collaboration tools, 27.1% of
respondents said that they can share files and content using simple tools that correspond to the basic
level of the user; 50.1% of respondents indicated that they could use collaboration tools and
distribute, for example, shared documents / files created by other people, which corresponds to the
level of an independent user; 22.8% of respondents said that they can create and manage content
using tools for collaboration (eg, project management systems, spreadsheets on the Internet), which
corresponds to the level of a professional user.
   When asked about the ability to use online services 22.1% of respondents stated that they can use
online services (e.g. e-banks, e-governments, e-hospitals, etc.), which corresponds to the basic level of
the user; 44% of respondents stated that they use the functions of online services (e.g., public services,
e-banking, online stores, etc.), which corresponds to the level of an independent user; 34% of
respondents said that they take an active part in online spaces and use several online services (eg,
public services, e-banking, online store, etc.), which corresponds to the level of a professional user.
   When asked about the available knowledge and ability to use online tools for collaboration 30.3%
of respondents stated that they know social networking sites and online collaboration tools, which
corresponds to the basic level of the user; 23% of respondents stated that they pass on knowledge to
other users on the Internet (for example, through social networking tools or in online communities),
which corresponds to the level of an independent user; 46.7% of respondents stated that they can use
additional functions of communication means (e.g. video conferencing, data exchange, sharing),
which corresponds to the level of a professional user.
   In the field of "Digital content creation" when asked about the ability to create multimedia content
in different formats using various digital tools and environments, 55.6% of respondents said that they
can create simple digital content (eg text, tables, images, audio files) in at least one format using
digital tools that corresponds to the basic level of the user; 38.1% of respondents said that they can
create complex digital content in various formats (eg text, tables, images, audio files) and use tools to
create web pages or blogs that correspond to the level of an independent user; 6.3% of respondents
said that they can produce complex multimedia content in different formats, using a variety of digital
tools and environments, can create a website using a programming language that corresponds to the
level of a professional user(see Fig.3).
Fig.3. The sample of the answers of the respondents about the area of "Digital Content creation".

   When asked about the ability to use the formatting features of content and various tools, 27.6% of
respondents said that they can make basic editing of content created by other users (for example, add
and remove), which corresponds to the basic level of the user; 63.4% of respondents stated that they
can apply basic formatting (for example, insert links, charts, tables) to content created by themselves
or other users that corresponds to the level of an independent user; 8.8% of respondents said that they
can use the functions of advanced formatting of various tools (eg, merging e-mail, merging
documents of different formats, using advanced formulas, macros), which corresponds to the level of
a professional user.
   When asked about the knowledge regarding the rules of using content in accordance with
copyright protection, 44.7% of respondents said that they know that content can be protected by
copyright, which corresponds to the basic level of the user; 42.9% of respondents stated that they
know how to refer to and use copyrighted content that corresponds to the level of an independent
user; 12.4% of respondents said that they know how and when to apply for licenses and copyrights,
which corresponds to the level of a professional user.
   When asked about programming skills 67.7% of respondents said that they can change simple
software functions by changing the default settings, which corresponds to the basic level of the user;
25.3% of respondents stated that they know the basics - the principles of one programming language,
which corresponds to the level of an independent user; 7% of respondents said that they can use
several programming languages. I know how to design, create and modify databases with a computer
tool that matches the level of a professional user.
   In the area of Safety, when asked about the ability to protect the system of devices and programs,
54.7% of respondents said that they can take basic steps to protect their devices (eg, use of antivirus
and password), which corresponds to the basic level of the user; 32.5% of respondents stated that they
can install security programs on devices that use to access the Internet (eg, antivirus, firewall), which
corresponds to the level of an independent user; 12.8% of respondents said that they often check the
security configuration and systems of devices and / or programs that they regularly use to access the
Internet, which corresponds to the level of a professional user(see Fig.4).




Fig.4. The sample of the answers of the respondents about the area of "Safety".

   When asked about the ability to protect personal information on their digital devices, 47.3% of
respondents said they knew that credentials (username and password) could be stolen and that they
should not disclose personal information on the Internet, which corresponds to the basic user level;
34.9% of respondents stated that they use different passwords to access equipment, devices and digital
services, periodically changing them to match the level of the independent user; 17.9% of respondents
said they know how to react if a computer is infected with a virus, can configure or change the
antivirus and configure the security of their digital devices, which corresponds to the level of a
professional user.
    When asked about the ability to use ICT safely for their own health, 22.1% of respondents said
that they know that the use of digital technologies has too much impact on their health, which
corresponds to the basic level of the user; 34% of respondents stated that they understand the health
risks associated with the use of digital technologies (for example, the risk of dependence), which
corresponds to the level of the independent user; 43.9% of respondents said that they can use ICT in
such a way as to avoid health problems (physical and psychological), which corresponds to the level
of a professional user.
    When asked about knowledge about the impact of digital technologies on everyday life and the
environment, 12.5% of respondents said that they take basic measures to save energy, which
corresponds to the basic level of the user; 44% of respondents said that they understand the positive
and negative impact of technology on the environment, which corresponds to the level of the
independent user; 43.5% of respondents stated that they have an informed view on the impact of
digital technologies on everyday life and the environment, which corresponds to the level of a
professional user.
    In the area of “Problem Solving”, when asked about the ability to solve problems that arise when
using digital technologies, 56.5% of respondents said that they find support when a technical problem
arises or when a new program is used that meets the basic level of the user; 37.3% of respondents said
that they can solve most of the problems that most often arise when using digital technology, which
corresponds to the level of independent user; 6.2% of respondents said that they can solve almost all
the problems that arise when using digital technologies, which corresponds to the level of a
professional user(see Fig.5). When asked about the ability to choose and use an appropriate digital
tool or service to solve non-technical problems, 42.6% of respondents know that digital tools can help
solve problems that correspond to the basic level of the user; 36.9% of respondents stated that they
can use digital technologies to solve non-technical problems, which corresponds to the level of an
independent user; 20.6% of respondents said that they can often choose the right tool, device,
application, software or service to solve non-technical problems that corresponds to the level of a
professional user.




Fig.5. The sample of the answers of the respondents about the area of "Problem solving".

    When asked about the ability to choose and use an appropriate digital tool to solve technological
problems, 54.7% of respondents said that they can use familiar tools to solve a technological problem
that corresponds to the basic level of the user; 38.6% of respondents said that they can solve
technological problems by studying the settings of programs or tools that correspond to the level of an
independent user; 6.7% of respondents said that they know about new technological developments
and understand how new tools work, which corresponds to the level of a professional user.
    On the question of awareness of the need to update skills in the field of digital technologies 36.6%
of respondents said that they are aware of the need to regularly update their skills in the field of digital
technology, which corresponds to the basic level of the user; 47.5% of respondents said that they
regularly update their skills in the field of digital technology, know their limitations and try to fill the
gaps that correspond to the level of an independent user; 15.9% of respondents said that they often
update their skills in the field of digital technology to reduce their limitations and increase knowledge
in this area, which corresponds to the level of a professional user.
    The results obtained by teachers' self-assessment of the level of digital competence indicate the
following.
    A positive trend is observed in the field of "Information and digital literacy". The vast majority of
teachers are able to search for information at the level of independent (44.6%) and professional
(21.5%) users; assess the reliability of information at the level of professional (47.1%) and
independent (22.3%) user; store the found information at the level of professional (48.3%) and
independent (28%) user. Approximately 29% of respondents have a basic user level and need
advanced training.
    In the field of "Communication and Cooperation" teachers also have high levels. The vast majority
of respondents are able to communicate using various means of communication at the level of
professional (66.7%) and independent (11.5%) user; create and manage content at the level of
independent (50.1%) and professional (22.8%) users; use online services at the level of independent
(44%) and professional (34%) users; know and are able to use online tools for cooperation at the level
of professional (46.7%) and independent (23%) user. Approximately 25% of respondents have a basic
user level and need advanced training.
    In the field of "Digital Content Creation" the situation with the existing levels of digital
competence of teachers is changing. The vast majority of respondents are able to create multimedia
content in different formats, using a variety of digital tools and environments at the level of basic
(55.6%) and independent (38.1%) user; use the formatting functions of content and various tools at
the level of independent (63.4%) and basic (27.6%) user, know the rules of using content in
accordance with the protection of copyright legal levels of basic (44.7%) and independent (42.9%) )
user; have programming skills at the level of basic (67.7%) and independent (25.3%) users. On
average, only 8% of respondents have the level of a professional user. It is in this area that problems
arise that affect the formation of a culture of academic integrity in society.
    In the area of "Safety", the issues concerned two areas (ensuring the safety of their digital devices
and safety related to their own health and the environment) and each of them has different indicators
on the levels of digital competence of teachers. The first direction involved the ability to protect the
system of devices and programs (baseline - 54.7%, independent level - 32.55) and protect personal
information on their digital devices (baseline - 47.3%, independent level - 34.9). The second area
included the ability to use ICT safely for one's own health (professional level - 43.9%, independent
level - 34%) and knowledge about the impact of digital technologies on everyday life and the
environment (independent level - 44%, professional level - On average, 15% of respondents have the
level of a professional user to ensure the security of their digital devices and personal data, so this
issue should be given more attention.
    In the field of "Problem Solving", the professional level of the user is on average 12% of
respondents, which indicates certain gaps in the system of professional development of teachers in
need of refinement. Half of the respondents have a basic level of user in this area, as evidenced by the
following data: the ability to solve problems arising from the use of digital technologies (basic level -
56.5%, independent level - 37.3%); ability to choose and use an appropriate digital tool or service to
solve non-technical problems (basic level - 42.6, independent level - 36.9); ability to choose and use
the appropriate digital tool to solve technological problems (basic level - 54.7, independent level -
38.6); awareness of the need to update skills in the field of digital technologies (independent level -
47.5, basic level - 47.5).

3. Conclusions and Recommendations

    The conducted survey allowed the authors to use the tool of self-assessment of digital competence
of teachers based on the Digital Competence Framework for Citizens (DigComp 2.0 and 2.1) and the
Digital Competence Framework for educators (DigCompEdu) for the first time in Ukrainian context.
Based on the results of the assessment of the current state of the level of teachers’ digital competence,
the recommendations were developed and presented to stakeholders, in particular, for the network of
the in-service teacher training institutions [[8]; [11]]. For these institutions we recommend to
introduce the already tested self-assessment tool as a part of the regular and voluntary instruments to
help teachers to identify needs and gaps into their level of digital competence. This instrument can be
used also as a source of the information about possible topics and modules for the in-service teacher
training programs and future trainings.
    Researchers expect that by the end of the 2020/2021 school year, regional ITTIs will assess the
level of digital competence of teachers, using the proposed tool for self-assessment, which will
determine the real situation in each area. By the beginning of the 2021/2022 school year, each
regional in-service teacher training institute will be informed on how to develop appropriate in-
service training programs for teachers in the region based on the results of the current study. A group
of researchers plans to conduct an All-Ukrainian online survey at the end of the 2021/2022 school
year and compare how much the situation has changed regarding the development of digital
competence levels of teachers.

4. References

    [1] I.V.Ivaniuk, O.V.Ovcharuk, Results of an online survey of teachers' readiness and needs for
        the use of digital tools and ICT during quarantine: 2021. Analytical report. Institute of
        Information Technologies and Learning Tools of the NAES of Ukraine, 2021. URL:
        https://lib.iitta.gov.ua/724564/.
    [2] Ivaniuk, I.V., Ovcharuk, O.V, The results of the online survey ‘Teachers’ needs for raising
        the level on the use of digital and ICTs in quarantine’. Herald of the National Academy of
        Educational Sciences of Ukraine, volume 2 No1, 2020. doi:10.37472/2707-305X-2020-2-1-7-1.
    [3] S.Carretero, R.Vuorikari, Y. Punie, DigComp 2.1: The Digital Competence Framework for
        Citizens with eight proficiency levels and examples of use. Publications Office of the European
        Union, Luxembourg, 2017.
    [4] I. Ivaniuk, O. Ovcharuk, The response of Ukrainian teachers to СOVID-19: challenges and
        needs in the use of digital tools for distance learning. In: Informational Technologies and
        Learning Tools. (2020) 282 – 291. doi.org/10.33407/itlt.v77i3.3952.
    [5] M. Al Khateeb Abdulteeef, Measuring Digital Competence and ICT Literacy: An Exploratory
        Study of In-Service English Language Teachers in the Context of Saudi Arabia. In:
        International       Education    Studies.   CCSE,      volume     10     (12)     38     –   51
        (2017).doi:10.5539/ies.v10n12p38.
    [6] V.Yu.Bykov, O.Yu. Burov, S.G.Lytvynova, V.I.Lugovy, V.V.Oliynyk, O.M.Spirin,
        Development of theoretical bases of informatization of education and practical realization of
        information and communication technologies in the educational sphere of Ukraine. Zhytomyr
        University by I.Franko, Zhytomyr, 2019.
    [7] S.G. Lytvynova, Cloud-oriented learning environment of secondary school. In: Proceedings of the
          5th Workshop on Cloud Technologies in Education, vol-2168, Kryvyi Rih, 2017, pp. 7-12.
    [8] O. Ovcharuk, Attitude of Ukrainian Educators toward the Use of Digital Tools for Teaching
          and Professional Development: Survey Results. In: 16th International Conference on ICT in
          Research, Education and Industrial Applications. Workshops, vol.2, Kharkiv, 2020, pp. 746-
          755.
    [9] Ovcharuk, O., Ivaniuk, I., Soroko, N., Gritsenchuk, O., Kravchyna,O.: The Use of Digital
          Learning Tools in the Teachers' Professional Activities to Ensure Sustainable Development
          and Democratization of Education in European Countries. E3S Web of Conferences. The
          International Conference on Sustainable Futures: Environmental, Technological, Social and
          Economic Matters. ICSF, vol. 166, art. 10019 (2020). doi:10.1051/e3sconf/202016610019.
    [10] Ovcharuk, O., Current approaches to the development of digital competence of human and
          digital citizenship in European countries. In: Information Technologies and Learning Tools.
          IITLT, vol. 76 (2), pp. 1-13 (2020).doi:10.33407/itlt.v76i2.3526.
    [11] Redecker, C., Punie, Y.: European Framework for the Digital Competence of Educators:
          DigCompEdu. Publications Office of the European Union, Luxembourg, 2017. DOI:
          10.2760/178382.
    [12] M. Shyshkina, The General Model of the Cloud-Based Learning and Research Environment
          of Educational Personnel Training. In: Advances in Intelligent Systems and Computing.
          ICL, vol. 715, 2017. doi:10.1007/978-3-319-73210-7_94.