Development of an electronic system for remote assessment of students’ knowledge in cloud-based learning environment Mykhailo I. Sherman1 , Yaroslava B. Samchynska1 and Vitaliy M. Kobets1 1 Kherson State University, 27 University Str., Kherson, 73003, Ukraine Abstract The system for remote assessment of knowledge automates formation of task (tickets) with questions and tasks for conducting intermediate and final monitoring of knowledge of students is offered. In the process of developing an electronic system for knowledge assessment, the basic requirements for a web application and the modules that the system consists of were determined, the main roles of users in the system and their functionality were identified, access rights were established. The technical, functional, and non-functional features of the software product are described, web technologies for creating an application for knowledge assessment are considered. The diagram of system sequences, the use-case diagram, which schematically describing roles and functions of agents in an information system, the diagram of classes of a database structure are presented with UML description. Based on the defined requirements for the resource in cloud-based learning environment, the following technologies for its development were chosen: the server programming language PHP, JavaScript programming language and its libraries were used, as well as the MySQL database with PhpMyAdmin tool for administration of chosen database management system. OpenServer software complex system was used to develop and test the application functionality. The usage of the proposed electronic assessment system of knowledge contributes to the formation of an open information and cloud-based learning environment of a modern educational institution, enhances the efficiency and more rational distribution of teacher time in preparing tests or exams, activates repetition of educational material and knowledge assimilation, indirectly motivates students to more honest learning. Keywords Knowledge Assessment, e-Assessment, Monitoring of Knowledge, Web Application, Distance Learning CTE 2021: 9th Workshop on Cloud Technologies in Education, December 17, 2021, Kryvyi Rih, Ukraine " sherman-m@ukr.net (M. I. Sherman); samchynskaya@gmail.com (Y. B. Samchynska); kobetz@ukr.net (V. M. Kobets) ~ https://www.kspu.edu/About/Faculty/FPhysMathemInformatics/ChairInformatics/Staff/Sherman.aspx (M. I. Sherman); https://www.kspu.edu/About/Faculty/FPhysMathemInformatics/ChairInformatics/Staff/Samchinska.aspx (Y. B. Samchynska); https://www.kspu.edu/About/Faculty/FPhysMathemInformatics/ChairInformatics/Staff/KobetzVN.aspx (V. M. Kobets)  0000-0001-5120-620X (M. I. Sherman); 0000-0003-1582-8129 (Y. B. Samchynska); 0000-0002-4386-4103 (V. M. Kobets) © 2022 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). CEUR Workshop Proceedings http://ceur-ws.org ISSN 1613-0073 CEUR Workshop Proceedings (CEUR-WS.org) 290 1. Introduction Control of students’ knowledge and skills is an important component of the cloud-based learning environment, which should be conducted throughout the educational period. The assessment of students’ level of knowledge depends, for example, on the motivation of students to acquire knowledge, the desire for in-time quality performance of exercises set by the teacher. In 2020, the governments of more than 190 countries closed their educational institutions in order to prevent the rapid spread of COVID-19 [1]. With the changeover of educational institutions to distance learning, the problems of timely, objective and sound assessment and monitoring of student achievements in the digital space is becoming increasingly important and requires such forms and methods of solution, as cloud-oriented learning systems. 2. Related work The assessment of students’ academic achievements is understood as a system of indicators that reflect their objective knowledge and skills, that is this process can be considered as determining the degree of acquisition of knowledge, skills and achievements in accordance with the requirements of the curriculum [2]. The assessment consists of such components as a score, which is an actual fixed value that describes the level of student achievement, his skills, abilities, and may contain the teacher judgments about the characteristics of student achievement while education period, what disadvantages and achievements were formed during this process. Due to the closure of university campuses and the necessity to maintain social distance, world organizations such as UNESCO [3], the International Association of Universities [4], the OECD Center for Educational Research and Innovation [5], OECD Education and Skills Today [6] began to work actively on the development of solutions for the organization of online examinations of students. However, even before the COVID-19 pandemic, the benefits and strategic directions of using e-assessment were discussed in the works of Alruwais et al. [7], Arend [8], Crisp [9], Guàrdia et al. [10], Shalatska et al. [11]. Issues of analysis and assessment of student achievement during distance learning and cloud technologies were studied in the works of Bondarchuk et al. [12], Harrison and Hutton [13], Tomaino et al. [14], Kiv et al. [15], Kostikov et al. [16], Proskura et al. [17], Sherman and Samchynska [18], Samchynska and Vinnyk [19, 20], Spivakovskiy et al. [21], Todeush and Sherman [22], Vincent-Lancrin [6], Wang [23], Wijekumar et al. [24], Zaytseva [25]. OES is the complex platform – online examination system, which has been developed in PHP script with MySQL Database [26]. This system is aimed at automated creation of tests for the exam based on questions, which are already entered in the database. The OES platform is capable to identify the strengths and weaknesses of the student after passing the exam tests. The disadvantage of this system is that it supports different types of questions, so it can generate only the tests with one or more answers. ConductExam platform is an online examination software that includes a large combo of software applications for web-based exam software, offline exam, computer-based test, control- 291 based exam, online assessment software, and many more [27]. With this system, teachers can add questions or tasks. The student has the opportunity to take the exam on the Internet in accordance with the specified date, time and with the help of a registered login ID and secret key. However, the capabilities of this platform do not include an automatic parsing of questions from training educational materials files. The system of online education of Kremenchug Mykhailo Ostrohradskyi National University contains a testing system with which teachers can create courses, test tasks, conduct exams and assess the quality of students’ knowledge [28]. Applicants for higher education can take exams in the form of tests, communicate with teachers online and receive advice. The system supports only test tasks. The considered systems of knowledge assessment do not have sufficient flexibility in the for- mation of questions and tasks of different types, the functionality does not provide information about the results of students’ completed tasks, and does not contain an automated selection of questions from different types of documents. Therefore, these features and capabilities need to be considered when developing an advanced online system for knowledge assessment. 3. Research questions In the circumstances of distance learning there appear certain difficulties and consequently drawbacks in the assessment of educational achievements of higher education students. They are associated with insufficiently objective and non-transparent assessment and recording of the level of knowledge acquired by the student during the education period, insufficient attention to the individual achievements of the student, technical difficulties in creating quality e-tickets, tests and other control tasks. Concerning the features of electronic assessment of higher education applicants’ achieve- ments, ensuring its quality and objectivity require a description of the technical characteristics of the information system, functional and non-functional parameters of the software product to provide an online assessment of the acquired knowledge level. The development and use of a web application for online assessment of higher education as a part of a sophisticated system of monitoring the levels of higher education applicants’ achievements, which is being developed at Kherson State University, will help to improve the process of assessing students’ knowledge and skills during distance learning. The aim of the study is the development of an electronic system for assessing the level of knowledge, which automatically generates tickets, tasks for tests, exams and other control measures in the form of a web application for remote assessment of the level of knowledge acquired by students. The following research tasks were set: 1. To determine the requirements that must be met by an electronic system of remote knowledge assessment. 2. To choose methods of generating control tasks (tickets) using web technologies. 3. To define the architecture and describe the modules of the electronic system. 4. To choose programming technologies for developing the online assessment system. 292 5. To create a SQL database project based on determined system modules and to develop the system using the PHP programming language. 4. Research results 4.1. Defining requirements for software and e-system modules The following list of requirements has been formed for the system of online assessment of students’ academic achievements: • Availability of educational courses that contain certain topics and lectures. For each topic, there is a set of control questions, tasks or tests. Tickets for exams are automatically created based on these control materials. • The teacher can enter questions on the discipline into the database using a special input form, as well as upload lectures, laboratory work, guidelines, etc. The online system uses a parser to receive questions and tasks from these files and enters them into a database. • Using the task generator, the teacher receives tickets with tasks. To do this, the generator receives information from the system database and in accordance with the configured parameters creates tickets with control questions. A ticket is a form with control tasks, designed for different types of control measures, such as tests, modular control tests, final certification. • The student can view the content of the disciplines he is studying. For each discipline, which is located in the system, the applicant of higher education sees the scheduled exams, date and time of their holding. When the time to start the exam comes, the student receives a ticket with a specific task and can answer questions. At the end of the time specified by the exam, the ticket with the student’s answers is sent for verification to the online assessment system. If the ticket contains tests, the student and the teacher receive the result of the test immediately. If the ticket contains questions that require a detailed answer, it is sent to the teacher for re-view. After the test, the teacher gives an assessment. In accordance with the above requirements, the main modules of which the information system should consist were defined. These are presented in figure 1 [22]. The “Catalog of academic disciplines” part of the system includes pages of the site, which displays a list of academic disciplines for the student, defined by his curriculum. Each discipline consists of a number of modules, these modules consist of a number of study topics, which in turn contain questions. The teacher inputs questions into the database himself using the form on the system page. The teacher can upload to the system such educational materials as lectures, practical works or a list of control questions. After this, the system automatically enters questions from these files into the database. In the future, these materials are used to generate tickets with questions or tasks for the test, credit test or exam. The student can overview the files of lectures or other educational materials in the content of the discipline, as well as see the date when the exam will be held. During the exam, the student 293 Figure 1: The modules of e-assessment system of students’ knowledge. proceeds to the control tasks which he received in the ticket. A list of control questions for the student is not available until the beginning of the exam. The “Generation of control tasks” part of the system includes the function of creating tickets with different types of tasks, in particular with questions that require an open answer, as well as tests with the choice of one or more correct answers. On the page with the list of disciplines, the teacher chooses academic discipline and moves to the page of the website containing educational subject topics. The function of creating an exam is available for the teacher. The ticket generator works according to the parameters specified by the teacher in the modal window of presets. The teacher sets the date and time of the test, chooses the type of exam (individual work, modular test, modular test or exam), sets the duration of the exam, specifies the number of test questions and points for the correct answer. After selecting the required parameters, the system generates the appropriate ticket with the task. The teacher can also add any question to the ticket and assess the answer. The “Execution of control tasks” part of the system provides functionality to the process of passing the exam. The student with access to the exam, provided by the teacher, receives a ticket generated by the system and begins to pass the test. A list of different types of questions reveals. Upon accomplishing the ticket tasks, the completed form with answers is sent to the server, where the answers are processed. If the ticket contains only test questions, the system immediately provides a result on the correctness of the answers. If the ticket contains questions that require a written answer, the system sends a ticket with the answers to the teacher for verification. The sequence of actions for passing the exam within the information system of assessment is presented in figure 2. The “Assessment of results” part of the system provides functionality to the process of checking the form of control passed by the student and providing results to the teacher and the student in the form of a PDF file. If the higher education applicant does not pass the exam, this 294 Figure 2: Diagram of actions of passing the exam by the student within the information assessment system. feature will be unavailable and he will need to take the exam again. The student can review the questions, answers and analyze the result, seeing which questions were answered correctly or incorrectly. The teacher receives the results of the student’s control measure in order to analyze the level of student achievement, to determine which topics need to be finalized. According to the results, the teacher assesses the exam. In the “Statistics / Reports” part of the system, the processing of the general statistical information of educational achievements of the higher education applicant on disciplines takes place and also based on all points for educational disciplines the general rating of success of students is formed. The student has an opportunity to view a list of their subjects, current and final marks in the form of a record book. The “User Management / Access Control” part of the system provides functionality to manage user rights. The features for each user are defined, as well as the level of access to certain 295 data. A teacher can review his own academic disciplines, make changes to the uploaded files of educational materials, edit the points which are given to a certain student in discipline but cannot amend the disciplines of other teachers. The student cannot modify the content of their subjects or the results of assessing the levels of their academic achievements. The administrator can edit the roles of system users, make changes to the database, perform general system management. The sequence of actions in the proposed system is presented in figure 3. Figure 3: Sequence diagram of the e-assessment system. 4.2. Establishing roles and their functions in the assessment system An electronic system for remote assessment created in the form of a web application is basically a website with the following functionality: • registration of students and teachers; • generation of tickets with control questions or tests from documents prepared by teachers and uploaded to this web resource; • passing exams or other control measures within the higher education system; • providing detailed results on passing the exam (test) by the student; • formation of a students’ rating based on assessments of levels of their knowledge on educational disciplines. Within the developed e-assessment system, three roles were defined: system administrator, teacher and student. The roles of the system and their functions are shown in the form of a use-case UML diagram (figure 4). The administrator in the electronic assessment system obtains the following functions: 296 Figure 4: Users roles within e-assessment system and their functions. • development and maintenance of a web resource, improvement and updating its current structure; • technical support and security control of the website; • updating and editing the content of the site, order materials for the site through outsourc- ing, if necessary; • feedback from the web resource users; • control of the correct functioning of the site, tracking its availability for users on the network. The teacher has the following functions within the e-assessment system: • organization and support of the learning process; • monitoring of the success training program completion in accordance with the curriculum; • providing feedback to students; • uploading of educational materials and tasks to the web resource in the form of tests or questions with detailed answers. 297 The student within the system of remote assessment has the opportunity to receive tick- ets with control tasks, execute the proposed tasks, and review statistical information on the discipline he/she is studying. 4.3. Choice of technologies for a software development The choice of programming technologies for the developed assessment system was made due to some specialties: it will store information about students, teachers, files with educational materials, as well as user interaction with this information. At this stage of system development, you need to choose the technology for database management, the programming language to execute the logic and functionality of the program, as well as the technology for displaying this data. Also, a platform for testing the web resource is chosen. The OpenServer software complex was chosen as the platform for developing and testing web applications [29]. The architecture of the location of the catalogs of the software complex implies a clear separation of two different types of data: variable user data (settings, temporary files, logs, etc.) and immutable service data (modules, programs, service files) [29]. In particular, the developed information system uses the following rules: in the modules folder the data never changes, here the standard libraries of the software complex, modules and settings are stored, and in the domains and user data folders, there is information that the software developer can change in accordance with website requirements and configuration. In the process of developing an electronic assessment system, SQL technology was used for the MySQL database management system in the PhpMyAdmin web application. The Structured Query Language or SQL is a language for executing database queries, which is also used to manage and update databases [30]. The creation of the basic functionality for the e-assessment system was performed using the server-side programming language PHP. The main purpose of this programming language is to create scripts for web pages, as well as programming commands that run on server side. All operating systems, which support the web server maintenance, support PHP. To build the structure of the website pages, HTML and the JavaScript programming language jQuery library were used, as well as the technology of accessing the server without reloading the page to update Ajax data, which is organized using JavaScript. Using Ajax helps us to avoid page reloading after each request sent to API, i.e. increases the system efficiency and improves overall user impression on interaction with the website [31]. PHPWord is a library written in pure PHP that provides a set of classes to write to and read from different document file formats. Using a software product such as PHPWord is required to read data from Word files. MySQL technology was used to store system information and data. The language of structured queries is the standard language for executing queries, updating relational databases and managing them. SQL does not determine the sequence, but the result of some operations [30]. 4.4. Development of the database structure of the e-assessment system The structure of the database, designed during the creation of the remote assessment system and developed with the PhpMyAdmin environment using the MySQL data-base management 298 system, is shown in figure 5. Figure 5: Users roles within e-assessment system and their functions. Database tables of the developed electronic assessment system: • Faculty-tb – a table with the names of the faculties of the higher education institution. • Specialty-tb – a table with the names of the specialties of the faculty. • Specialization-tb – a table, which contains the names of specializations of the university. • Group-of-students-tb – a table with numbers of students’ academic groups. • Record-book-tb – a table with basic students’ data. • Teacher-tb – a table with basic teachers’ data. • Discipline-of-spec-tb – a table, which contains academic disciplines of the educational institution. • Discipline-tb – a table with disciplines related to a particular specialization. • Task-tb – a table, which contains control questions and tasks. • Test-tb – a table containing tickets with questions and tasks. • Survey-question-tb – a table with control tasks or questions related to a specific ticket. • Module-tb – a table, which contains the ordinal numbers of the constituent educational materials of the disciplines. • Topic-of-lesson-tb – a table with the topics of lecture materials. • Question – a table that contains test questions for each lecture, practical work, case study or collection of educational materials. • Answer-of-question – a table with the answers to the control questions are stored. 299 Thus, in accordance with the requirements for the application, a database was designed and developed for the electronic assessment system using PHPMyAdmin and the MySQL database management system. 4.5. Implementation of the electronic assessment system functionality To use the electronic evaluation system and view its web pages, user must register and authorize. Registration is conducted for teachers and students. An email is sent to confirm registration for security purposes. After confirming the registration, a corresponding account is created. After authorization, the student in the “Personal Profile” tab can see a table that contains information about his faculty, specialty, course, group and email. In the “Disciplines” tab, the student can see the list of disciplines and the average score in these subjects, which calculated of current points. In the “Catalog of academic disciplines” module, depending on the user role, the teacher can see only his disciplines and the student has access to the disciplines, which are available in accordance with the curriculum. In the “Generation of control tasks” module in the discipline, the teacher can create a control measure, such as an exam or test, plan the date and time of its conduct, select the training modules, which would be assessed during the control measure. The teacher specifies the required number of questions in the form of tests, points for the correct answers, number of questions which requiring a detailed answer. The created exam (figure 6) is inserted into the Task table. Figure 6: Page of the e-assessment system with the created exam. The list of questions is retrieved from the Question table, to which the teacher can input questions manually or the system adds them automatically from the files of educational materials (lectures, practical work, etc.). Number of questions and tasks that require a detailed answer is defined in accordance with the parameters set in the settings menu. If there are not enough questions of a particular type in the database, the web system will create a ticket with the possibility for the teacher to add tasks to the ticket later. The ticket generator creates a ticket and inserts it into the Test-tb table, questions are inserted into the Survey-question-tb table. The teacher can view the generated ticket, add or delete questions. The ticket created in the system is presented in figure 7. 300 Figure 7: Generated ticket with questions in the e-assessment system. In the “Task execution” module of the electronic assessment system, the higher education applicant gets access (previously provided by the teacher) to the exam at the time set when creating the exam and gets the opportunity to take a test, answering the ticket questions. The student studying a certain discipline receives a question from the table Survey-question-tb. After answering the questions and taking the exam (or other tests), the student has the opportunity to download a PDF file that displays statistical information about the exam: question number, the text of the question or task, answer options, the option chosen by the applicant, the number of points for answers, as well as the final assessment for the exam. The system sends questions that require a detailed answer as a form with answers after the exam to the teacher for verification. The rating of higher education applicants consists of the points they receive while determining the levels of their knowledge within a 100-point scale. Thus, a system for assessing the levels of acquired knowledge of higher education applicants was developed, the interaction of modules which generate and process the information, with database tables, which contain that information aimed at assessing and monitoring students’ academic achievements, was set up. 4.6. Approbation of the developed system for remote assessment of knowledge The developed system for remote assessment of knowledge was used as part of the system for monitoring the levels of academic achievement of higher education applicants at Kherson State University for Master qualification level of “Software Engineering”, “ Computer Science”, “ Information Systems and Technologies” specialties. The electronic assessment system was used to control the level of acquired knowledge of students at full-time and part-time education forms in the total number of 39 people in the “IT Governance” discipline in 2019-2021 academic 301 year at the Faculty of Computer Science, Physics and Mathematics of Kherson State University. Students were offered a final test in the “IT Governance”, the tasks for which were generated by the proposed electronic assessment system, access to the system is presented on the KSUOnline distance learning platform of Kherson State University as part of the “IT Governance” distance course (figure 8). Figure 8: Using the electronic assessment system to control the knowledge of students as part of the “IT Governance” distance learning course in the KSUOnline of Kherson State University. The usage of the proposed electronic assessment system of knowledge contributes to the formation of an open information and educational environment of a modern educational institution, enhances the efficiency and more rational distribution of teacher time in preparing tests or exams, activates repetition of educational material and knowledge assimilation, indirectly motivates them to more honest learning through the ability to compare their own academic achievements with similar indicators of other applicants for higher education. 302 5. Concluding remarks and future work The conducted researches allow us to formulate certain results and to target directions of further developments in the field of higher education in the conditions of modern challenges. In particular, the expediency of development of the electronic system for assessment of students’ knowledge was justified to ensure the efficiency and quality of learning, notedly in the context of distance learning. The system of remote monitoring of knowledge which automates the formation of tickets with questions and tasks for conducting control measures, examinations is offered. In the process of developing an electronic system for knowledge assessment, the basic requirements for a web application and the modules that the system consists of were determined, the main roles of users in the system and their functionality were identified, access rights were established. The technical, functional, and non-functional features of the software product are described, web technologies for creating an application for knowledge assessment are considered. The diagram of system sequences, the use-case diagram, which schematically describing roles and functions of agents in an information system, the diagram of classes of a database structure are presented with UML description. Based on the defined requirements for the web resource, the following technologies for its development were chosen: the server programming language PHP, JavaScript programming language and its libraries were used, as well as the MySQL database with PhpMyAdmin tool for administration of chosen database management system. OpenServer software complex system was used to develop and test the application functionality. The vector of further scientific development should be aimed at the formation of methodology and software for a common database for a group of higher education institutions on control tasks and tickets, which will provide greater objectivity, transparency and diversity of methods for assessing students’ knowledge. Also, further research should focus on the integration of the electronic journal into the developed electronic system, which will allow forming a ranking of the success of higher education applicants. References [1] S. Giannini, R. Jenkins, J. Saavedra, Reopening schools: When, where and how, 2020. URL: https://blogs.worldbank.org/education/reopening-schools-when-where-and-how. [2] H. M. Shalatska, O. Y. Zotova-Sadylo, O. Y. Makarenko, L. S. Dzevytska, Implementation of e-assessment in higher education, CEUR Workshop Proceedings 2732 (2020) 1172–1186. [3] UNESCO, Exams and assessments in COVID-19 crisis: fairness at the centre, 2020. URL: https://en.unesco.org/news/exams-and-assessments-covid-19-crisis-fairness-centre. [4] G. Marinoni, H. van’t Land, T. Jensen, The Impact of COVID-19 on Higher Education around the World, International Association of Universities, Paris, 2020. URL: https://www. iau-aiu.net/IMG/pdf/iau_covid19_and_he_survey_report_final_may_2020.pdf. [5] OECD, Remote online exams in higher education during the COVID-19 crisis, OECD Education Policy Perspectives (2020). URL: https://www.oecd-ilibrary.org/content/paper/ f53e2177-en. doi:10.1787/f53e2177-en. 303 [6] S. Vincent-Lancrin, Frontiers of smart education technology: Opportunities and challenges, in: OECD Digital Education Outlook 2021 Pushing the Frontiers with Artificial Intelligence, Blockchain and Robots: Pushing the Frontiers with Artificial Intelligence, Blockchain and Robots, OECD Publishing, Paris, 2021, p. 19. URL: https://www.oecd-ilibrary.org/education/ oecd-digital-education-outlook-2021_d3153fcd-en. doi:10.1787/d3153fcd-en. [7] N. Alruwais, G. Wills, M. Wald, Advantages and challenges of using e-assessment, International Journal of Information and Education Technology 8 (2018) 34–37. URL: http://www.ijiet.org/show-96-1158-1.html. doi:10.18178/ijiet.2018.8.1.1008. [8] B. Arend, Course assessment practices and student learning strategies in online courses, Online Learning 11 (2019). URL: https://olj.onlinelearningconsortium.org/index.php/olj/ article/view/1712. doi:10.24059/olj.v11i4.1712. [9] G. Crisp, Teacher’s handbook on e-assessment: A handbook to support teachers in Us- ing e-assessment to improve and evidence student learning and outcomes, Transform- ing Assessment, 2011. URL: http://transformingassessment.com/sites/default/files/files/ Handbook_for_teachers.pdf. [10] L. Guàrdia, G. Crisp, I. Alsina, Trends and challenges of e-assessment to enhance student learning in higher education, in: E. Cano, G. Ion (Eds.), Innovative practices for higher education assessment and measurement, IGI Global, Hershey, PA, 2017, pp. 36–56. doi:10. 4018/978-1-5225-0531-0.ch003. [11] H. M. Shalatska, O. Y. Zotova-Sadylo, O. Y. Makarenko, L. S. Dzevytska, Implementation of e-assessment in higher education, CEUR Workshop Proceedings 2732 (2020) 1172–1186. [12] O. I. Bondarchuk, V. V. Balakhtar, Y. O. Ushenko, O. O. Gorova, I. M. Osovska, N. I. Pinchuk, N. O. Yakubovska, K. S. Balakhtar, M. V. Moskalov, The psychological safety of the educa- tional environment of Ukrainian higher education institutions in a pandemic: empirical data of a comparative analysis of participants’ assessments studying online, in: S. Se- merikov, V. Osadchyi, O. Kuzminska (Eds.), Proceedings of the Symposium on Advances in Educational Technology, AET 2020, University of Educational Management, SciTePress, Kyiv, 2022. [13] A. Harrison, L. Hutton, Design for the changing educational landscape: Space, place and the future of learning, Routledge, 2013. [14] M. A. E. Tomaino, A. L. Greenberg, S. A. Kagawa-Purohit, S. A. Doering, E. S. Miguel, An assessment of the feasibility and effectiveness of distance learning for students with severe developmental disabilities and high behavioral needs, Behavior Analysis in Practice (2021). doi:10.1007/s40617-020-00549-1. [15] A. E. Kiv, M. P. Shyshkina, S. O. Semerikov, A. M. Striuk, M. I. Striuk, H. M. Shalatska, CTE 2019 - When cloud technologies ruled the education, CEUR Workshop Proceedings 2643 (2020) 1–59. URL: http://ceur-ws.org/Vol-2643/paper00.pdf. [16] A. A. Kostikov, K. V. Vlasenko, I. V. Lovianova, S. V. Volkov, E. O. Avramov, The algorithm for knowledge assessment based on the Rusch model, CEUR Workshop Proceedings (2022). [17] S. L. Proskura, S. G. Lytvynova, O. P. Kronda, Students academic achievement assessment in higher education institutions, CEUR Workshop Proceedings 2732 (2020) 734–745. [18] M. I. Sherman, Y. B. Samchynska, The information and reference system on rare and endangered species of animals as a computer tool for the formation of future ecologists digital competency, Information Technologies and Learning Tools 72 (2019) 121–135. URL: 304 https://journal.iitta.gov.ua/index.php/itlt/article/view/2479. doi:10.33407/itlt.v72i4. 2479. [19] Y. Samchynska, M. Vinnyk, Decision making in information technologies governance of companies, CEUR Workshop Proceedings 1844 (2017) 96–110. URL: http://ceur-ws.org/ Vol-1844/10000096.pdf. [20] Y. B. Samchynska, M. O. Vinnyk, Specific features of educational software promotion at Ukrainian market, Actual problems of economics 157 (2014) 534–540. [21] O. Spivakovskiy, N. Kushnir, N. Valko, M. Vinnyk, ICT Advanced Training of University Teachers, CEUR Workshop Proceedings 1844 (2017) 176–190. URL: http://ceur-ws.org/ Vol-1844/10000176.pdf. [22] A. Todeush, M. Sherman, Methods of generating tasks for knowledge assessment, Young Scientist (2020) 198–204. doi:10.32839/2304-5809/2020-10-86-42. [23] T. Wang, What strategies are effective for formative assessment in an e-learning envi- ronment?, Journal of Computer Assisted Learning 23 (2007) 171–186. doi:10.1111/j. 1365-2729.2006.00211.x. [24] K. Wijekumar, L. Ferguson, D. Wagoner, Problems with assessment validity and reliability in web-based distance learning environments and solutions, Journal of Educational Multimedia and Hypermedia 15 (2006) 199–215. URL: https://www.learntechlib.org/p/6259. [25] T. Zaytseva, The introduction of the competence-based approach in educational process of training of skipper, CEUR Workshop Proceedings 1614 (2016) 687–699. URL: http: //ceur-ws.org/Vol-1614/paper_25.pdf. [26] DesignDirect, Custom online examination solution, online exam software, 2022. URL: https://www.designdirectuk.com/online-examination-system. [27] Conduct Exam Technologies LLP, Online Exam Software, 2022. URL: https://www. conductexam.com/. [28] KrNU: Pro sait ta onlain systemu, 2018. URL: http://krnu.org/mod/page/view.php?id=1. [29] Dokumentatsyia Open Server Panel, 2021. URL: https://ospanel.io/docs/. [30] Bringing MySQL to the web, 2022. URL: https://www.phpmyadmin.net/. [31] Fetch, 2020. URL: https://learn.javascript.ru/fetch. 305