An important role in the organization of the educational process is played by the use of the modern information technologies in the process of selection, accumulation, systematization and transfer of knowledge. The provided new technological and methodological opportunities are a priority in the developed methods of control and testing of knowledge, skills and abilities of students [1].
One of the tools for managing the learning process is test control [2,3]. That is why one of the problems that require priority attention is to improve the testing process, to increase its efficiency.
Computer testing can be used in three ways: computer testing as an alternative form of test presentation (options, and, consequently, the order of presentation of tasks are fixed); computer testing with automatic generation of different test options (options are formed automatically from the existing set of tasks according to the rules set by the developer); computer adaptive testing (for each subject in the testing process an individual set of tasks is formed) [4].
Adaptive testing is generally adequate to modern trends in distance education and opens up new opportunities for improving the efficiency of educational processes [5].
Our common educational model of adaptive school is based, in fact, on the general ideas of adaptive learning and adaptive knowledge control [6,7]. The origins of this approach can be traced back to the pedagogical works of Comenius [8], Pestalozzi et al. [9] and Diesterweg [10]. At the center of their pedagogical systems was the Student. In their works, they called for starting teaching with what the student stopped to study, because without the "knowledge base" it is impossible to learn new material further. Insufficient awareness of the real level of knowledge of students and their ability to assimilate the proposed knowledge, have become the main reason for the emergence of adaptive systems based on the principle of individualization of learning, so this principle cannot be implemented in traditional, classroom form [11].
Analyzing recent research, we can see many scientists who have dealt with the problem of implementing adaptive tests in the educational process. Modern researchers related to the problem of adaptive testing include Albano et al. [12], Austin et al. [13], Cetin-Berber et al. [14], Collares and Cecilio-Fernandes [15], Istiyono et al. [16], Kang et al. [17], Kozmina et al. [18], Lin and Chang [19], Paap et al. [20], Samsudin et al. [21], van der Linden and Choi [22], van der Linden and Ren [23], Wang et al. [24], Yasuda et al. [25].
Bradác and Klimes [26] created a model of adaptive e-learning system for significant optimisation of language learning with the primary focus on the English language, which is based on using Learning management systems (LMS). Created by them adaptive system for decision-making support enables automated creation of study variants which are suited to each individual student's needs, which current LMSs do not enable.
Souki et al. [27] have placed an emphasis on preferred ways of studying. Scientists provided evidence about the potential of the framework in increasing specific aspects of self-regulated learning and students' performance.
The use of adaptive testing is usually possible in personalized learning. Thus, Balogh et al. [28] dealing with the way of personalizing the teaching of IT subjects from the point of view of a constructivist approach towards the learner proposed their e-course creation methodology that fulfils the assumptions to personalize the education.
The study of Susanti et al. [29] experimentally proved computerised adaptive tests' advantages comparing with the baseline, a linear test.
However, the study of computerized adaptive testing in the training of maritime professionals (teaching English for professional purposes) has not been fully implemented [30].
Therefore, the purpose of this work is to analyze the content of tests and results of computer testing of students to assess the effectiveness of this type of teaching and improve testing methods in teaching English for professional purposes.
The tasks of our work include the following: description of types of adaptive testing, examples of adaptive testing, analysis of its advantages and disadvantages, evaluation of testing.
The participants of this research are a total of 90 cadets (male) aged 17-18 from Ukrainian maritime education establishment (Maritime College of Kherson State Maritime Academy). They are cadets of three departments: navigation, ship engineering and electrical engineering one.
The participants of the research were asked to study in an educational electronic environment including study on Learning Management System (LMS) Moodle and its activities (Forum, Chat, Lesson, Assignment). The materials to be used on LMS Moodle e-course are from "Welcome Aboard: course book" created by English teachers of Kherson State Maritime Academy [31].
A range of interrelated methods was used to solve the formulated tasks for achieving the goal and verification the hypothesis:
• theoretical: terminological analysis -to define the basic concepts of the investigation "communicative competence", "gamification approach"; analysis and generalization of these concepts from the standpoint of different scientific approaches; synthesis, comparison and generalization of theoretical provisions, normative documents, and experience of teaching English in a professional direction by future ship engineers to determine the most appropriate approaches for solving the problem; generalization of scientifictheoretical and practical data for scientific substantiation of structural training of future ship engineers; modeling for the development of a structural model for the formation of foreign language communicative competence of future ship engineers based on a gamification approach; • empirical: pedagogical monitoring of the state of preparation of future ship engineers for professional activity in order to identify the levels of the specified training, experimental verification of effectiveness developed methods of forming foreign language communicative competence of future ship engineers on the basis of a gamification approach and pedagogical conditions of its implementation; interviewing; questionnaires; analysis results of sea practices; • statistical: methods of mathematical statistics in order to analyze experimental research data and their interpretation.
Computer adaptive tests, which are a fast and quite effective way to measure the level of learning, are becoming more and more widely used for input diagnostic, intermediate and final testing [32].
To determine the level of knowledge of the student, you can conduct initial testing, and then conduct a control test with questions of this level. This type of adaptive tests is more appropriate to conduct at the initial stage of studying the topic, in order to diagnose the initial level of knowledge of the student, and further correction by presenting tasks of optimal complexity. Currently, there are three options for forming an adaptive test. The first one is pyramidal, when without a preliminary assessment, each student is given a task of medium difficulty and then, depending on the answer, the next task is formed, the scale of which is lower or higher by 2 times [33].
When creating computerized adaptive testing of this type, we use LMS Moodle [34], which supports the "Lesson" activity. This activity allows to create a single task (add a page with data), and after the answer to move to the next page with a question that will depend on the answer provided by the student.
The example of a test of this kind in the author's electronic course LMS Moodle is illustrated below. The first page of the test consists of a task (Read the case and choose the correct answer to the question below), quasi-professional situations, the authentic text of which was taken from the Internet newspaper, the question (What has crewmembers of Pacific Express done while pirates attack? Where their actions correct or not?), Four possible answers and the scale of progress that is element of gamification and reflects the percentage of correctly completed tasks [35].
Depending on the chosen answer, the next page, if the answer is correct, will have the text of the next question and four possible answers to it. The example of the second page can be seen in figure 2.
If the answer to the question is incorrect, then the next page contains a repetition of the text, a simpler question (What type of ship was attacked by pirates?) and fewer options for answering it [36]. Figure 3 shows the page with incorrect answer.
The second method (flexy level) initially uses any level of difficulty, gradually selecting the appropriate one for the student [37]. Using the "Lesson" activity of LMS Moodle when creating the first page of the test and the question to it, the average level of difficulty is selected. Teacher manages settings of "Lesson" activities: progress bar -to see student's progress while completion; ongoing score -to know the grade to pass; menu -to choose previous page any minute. He also provides the option to try a question again, chooses maximum number of attempts, restricts the access, links this activity with previous one.
The linked media chosen by teacher is instructions on how to use "Lesson" activities. The maximum number of answers is four. The time limit is 60 minutes. The activity is attempted offline using the mobile application. Students are allowed to review. There is a special setting called Competencies which allows teacher to connect the activity with course competencies from Competency framework. Competency framework allows teacher to add the list of competencies added by an administrator from Standards of training, certification and watchkeeping international convention and IMO Model course 3.17 Maritime English [38]. Competency framework also has progress bar where students see the list of activities needed to achieve competencies of the course.
When a student answers the questions created by teacher correctly all the time, the questions become more difficult.
If a student makes a mistake at least once, the questions become easier. In the third stratified method (stratified adaptive) tasks are taken from the bank of tasks, divided by levels of difficulty. If the answer is correct, the next task is taken from the upper level, if it is incorrect, it is taken from the lower level [39].
Distinctive features of adaptive testing in comparison with other forms of testing are the following: each subject receives his own set of tasks, so the content and length of the test may differ for different subjects; each subject is evaluated individually (at his level) with a minimum measurement error [40].
The example of a stratification testing method on LMS Moodle "Lesson" activity where a student can choose his level of knowledge about burns by himself can be seen in figure 4.
Such tests have advantages and disadvantages. The advantages of adaptive tests include a reduction in testing time, as the student may be presented with far fewer tasks. At the same time diagnostic possibilities are not reduced. High measurement accuracy is also achieved. The reliability of test results in this case is the highest. Also, these tests allow flexible and accurate measurement of students' knowledge, identify topics that are poorly known and allow you to ask them a number of additional questions [41].
Disadvantages include the fact that it is not known in advance how many questions need to be asked to determine the level of knowledge of the student; if the student did not answer all the questions, then you can evaluate the result by the number of questions answered. can be used only on a computer [42]. Another important question that arises when using monitoring programs is the question of how to evaluate the results. There are different assessment methods for adaptive testing [43].
The first method is when the assessment is based on the number of correctly performed tasks, without taking into account their complexity. For example, if a student performed correctly from 0-40% of tasks -"unsatisfactory", from 40-70% of tasks -"satisfactory", from 70-90% of tasks -"good", and more than 90% -"excellent".
The second method is when first all the questions are broken down by levels of difficulty and the correct implementation of the next level (in the presence of previous ones) leads to an increase of 1 point (if we talk about the traditional five-point grading system). This method takes into account the quality of the test and makes it possible to somehow differentiate students, even with insufficient adequacy of the test material.
When grading by the third method, the best result among the test participants is taken into account, which is evaluated as "excellent", and all other marks are already set taking into account this result [44].
The fourth method, as well as the second, is based on the initial distribution of all questions by levels of complexity, each of which has its own assessment. And in contrast to the second method, which is taught immediately determined by the level of complexity that he can and works within this level. At correct performance of all tasks the corresponding estimation is exposed. If the number of incorrect answers exceeds 30%, the level of complexity is reduced [45]. When testing, three criteria of test quality are taken into account: reliability, validity, objectivity. The reliability index is characterized by the accuracy and stability of the measurement results using the test with its repeated use. In order for the test to really perform its functions, it is also necessary that its compliance with the requirement of "validity", e.g. the reflection of the scientific content of the discipline and its suitability to serve as a means of measurement. The most common reasons for the invalidity of control: there is a write-off, hint, "teaching" tutors, indulgence, excessive demands, the use of any method in the absence of appropriate conditions [46].
In order to increase the validity of pedagogical control, expert assessments of control material are usually used. Objectivity -a criterion that combines reliability, validity and a number of aspects of psychological, pedagogical, ethical, value nature. When developing this test, all these requirements must be taken into account, but the final conclusions can be made only after its repeated practical application [47].
The analysis of scientific knowledge and pedagogical practice demonstrates that the student's tests can be effective. By analyzing the data of success after using the tests in the electronic course, one can observe that the current state of formation of the communicative competence of future ship engineers of the 2nd year 2019-2020 Maritime College of KSMA is better compared with 2018-2019 academic year.
According to the results, we see an increase in the success (by 17%) and knowledge quality (by 9%). Qualitative indicator of success was taken as the number of students by "good" and "very good" multiplied by 100% and divided by the total number of students. An absolute success indicator was taken as number of students by "good", "very good" and "sufficient" multiplied by 100% and divided by the total number of students.
The data was taken from the processing of control testing results on LMS Moodle of Kherson State Maritime Academy (Stop and checks activities and Progress tests). Stop and check is testing conducted by the end of every module. Progress tests are conducted twice a semester. The surveys conducted by cadets of Kherson State Maritime Academy were created by English teachers in Google forms. Links to the surveys were located in LMS Moodle English for professional purpose courses. The results of survey have showed the following data graphically represented in figure 6.
The cadets were asked to answer few questions on the usefulness of new system of computerized adaptive testing on e-course of English for specific purpose. The course contained adaptive tests of the following topics: First aid on board; Emergency situations onboard a vessel; Lifesaving appliances and their use; Marine Environment and its protection; Maritime security. The computerized adaptive tests were located on LMS Moodle with the help of Lesson activity which enables a teacher to deliver content and/or practice activities in interesting and flexible way. Teacher can also create 'branching' exercises where students are presented with content and then, depending on their responses, are directed to specific pages. The content may be text or multimedia [48].
According to survey results the biggest part of students find adaptive testing useful and comfortable for English for specific purpose studying.
Today, learning through the use of computer technology has a number of features that significantly distinguish it from the traditional. Studies have shown that the use of adaptive computer testing technologies can reduce testing time by 50-60%, helps to individualize each test and get a more accurate assessment of knowledge and skills. The tasks offered to the student become more complex gradually and ideally suit his knowledge and skills, increasing his motivation to pass the test.
The expediency of adaptive control follows from the need to streamline traditional testing. Every teacher understands that a well-prepared student does not need to be given easy tasks, as they do not have significant developmental potential. Similarly, due to the high probability of the wrong decision, it makes no sense to give difficult tasks to a weak student. It is known that difficult and very difficult tasks reduce the learning motivation of many students.
The use of tasks that correspond to the level of preparedness significantly increases the accuracy of measurements and minimizes the time of individual testing to about 5-10 minutes. Adaptive testing allows to provide computer delivery of tasks at the optimal, approximately 50% level of probability of the correct answer.
We see the prospects for our further research in this direction in the study of adaptive testing in the system of in-depth learning.