330 Augmented Reality in the Training Process of Children with Hearing Disorders* Lilia A. Nebytova 1[0000-0002-4396-9415], Marina V. Katrenko 2[0000-0002-8470-9249], Denis I. Savin 2[0000-0002-2328-6027] and Yulia I. Zhuravleva 3[0000-0003-2196-6245] 1 Stavropol regional institute for the development of education, advanced training and retrain- ing of educators, 355000, Stavropol, Russia 2 North-Caucasian Federal University, 355009, Stavropol, Russia 3 Volgograd State Medical University, 357528, Pyatigorsk, Russia Abstract. The relevance of the present research stems from the fact that the struc- ture of sports activity of hearing-impaired athletes has objective features and de- pends on their psychophysiological potential. To modernize educational and training activities, to demonstrate practice exercises in detail, and to intensify the mastering of the movement technique enables the technology of augmented real- ity (AR). The purpose of this research is to prove the effectiveness of the tech- nology of augmented reality to enhance learning in the educational and training process on track and field athletics by the hearing-impaired children of the basic level. In the course of the writing of the present work the following learning methodology was used: theoretical methods of the generalization of scientific and methodological literature, testing, analysis method, data processing, and interpre- tation. For the processing of quantitative results obtained the methods of mathe- matical statistics were used. In our research the main tests for the evaluation of the training effect with the use of AR technology are a 20-meters run at flying start, 100-meter race, standing long jump, jumping rope time trial. The effective- ness of the use of AR technology has shown positive dynamics by all criteria of the tests applied in this study. This technology is quite simple in application and use. Apart from the above hearing-impaired athletes, the results of this research can be applied to some other special needs children engaged in sports. Keywords: education, information technologies, augmented reality, AR tech- nology, hearing-impaired patients, health limitations, deaf and hearing-impaired athletes, educational and training process, sports and game method, training by visual aids, track and field athletics. 1 Introduction Practical implementation of information technology in human activity is very intensive in today’s world. Accordingly, information processes in the field of education are * Copyright 2021 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). 331 tightly connected with the overall computerization of society. It is necessary to empha- size that individual empowerment and realization of human potential is one of the most essential requirements of modern society, especially it concerns disabled people. As evidenced in practice, social integration is more challenging for persons with disabili- ties due to their physical and mental specifics. It’s not uncommon for they have to adapt to social milieu, looking for a place of their own in social life [11]. According to the WHO data, presented in the summary of the World Report on Disability (2011), 10 – 12% of the global population belong to the category of persons with health limitations. The United Nations specialized agency for Educational, Scientific, and Cultural Or- ganization (UNESCO) has initiated the "Education for All" program in the frame of the world movement. It’s purposed to ensure inclusive and quality education for all. Along with inclusive education, UNESCO considers the further extension of social integra- tion; the engagement of adaptive physical education and Paralympic sport to meet the needs of children, youth, and adults [1]. Today in Russia alone there live 1.7 million children related to the category of health limitations, building the higher risk group of various pathologies and complex developmental delays. A large part of these children is deaf and hearing-impaired [2]. Development of the children with hearing disorders cannot be wholesome without physical education and sports. Owing to the introduction of physical activity into vari- ous spheres of deaf children, it is possible to correct the hearing disorders, so to improve their physical condition [5]. The potentialities of diverse activities (pedagogic, educational, recreational, sport- ing, etc.) devoted to such category of children are determined by the extent of disease. Modern researchers in the field of sign language teachers (V.P. Lebedev, D.I. Tarasov, A.N. Nasedkin, et al.) subdivide the reasons for hearing disorders into three groups. The first two groups combine the hereditary and congenital factors leading to deafness or relative deafness. The third group includes hearing-impaired patients with the ac- quired hearing disorder [9]. This implies that deafness is a biological factor, not a social one. L.S. Vygotsky wrote, – “The fact is that the educator has to deal not so much with these biological factors, but with their social consequences" [3]. Besides, the hearing disorder can cause the associated diseases to have their specif- ics. To this category belong the persons whose scope of external information is limited, when there is no internal speech and verbal mediation, which causes inhibition in de- velopment and a certain decrease in perception, thinking, memory, imagination and the whole cognitive activity at large. This is because the speech is not involved in the so- lution of evident tasks. However, there is an area in which children with hearing disorders do not feel re- strained when compared to normal people - it is physical education and sport, whose system-oriented character is increasingly important in this context. Sport makes it pos- sible to level the communication between the deaf and the hearing-impaired and the normal people, for both as athletes compete under the same rules. Functionally, sports activities with the hearing-impaired in terms of their tasks can be divided into two directions: general and specific (correctional). The priorities of the first direction are training basic movement skills and transfer of knowledge connected with sports training. The former direction is focused on the correction of physiological 332 disturbances and the compensation of body systems, thus defining a selection of peda- gogical technologies [4]. To maintain the sports activity of deaf and hearing-impaired children and teenagers we have used information technologies as a management tool for their cognitive activ- ity. In the frame of modern means of communications, information technologies sig- nificantly expand the educational opportunities of an individual on basis of free access to information. Being a social, moral, and economic imperative worldwide, information technologies are also an important instrument of social integration of hearing-impaired people [6]. The significance of using information technologies in sport consists in a wide range of possibilities:  increase the interest in a training process;  expand communication possibilities;  form a psychologically acceptable and comfortable work style of a trainer-teacher, allowing to mobilize creative and athletic abilities, activate an intellectual potential of deaf and hearing-impaired athletes;  improve the trainer teachers strategy in selecting the contents of educational and training programs, as well as means and methods of teaching and training according to the tasks, thus making deaf and hearing-impaired athletes develop independent learning skills, using means of communication with simulated model objects;  simplify individualization of the training process;  develop the confidence of hearing-impaired athletes in overcoming information bar- riers. Subsequently, the use of information technologies in the educational and training pro- cess due to the visual presentation and the involvement of visual memory enables to enhance mastering the movement technique and to hold training at a whole new level, facilitates communication, help achieve autonomy in training and to set individual tasks with the respect to opportunities and abilities of each athlete. It says of the efficient use of information technologies available in sport and emphasizes their advantages, first of all as an aid to maximize the effect of visual presentation. A significant breakthrough concerning new possibilities as to deliver educational and training material, so to master the movement technique has been made with the introduction of the technology of augmented reality (AR) [14]. On basis of existing scientific analysis on didactic aspects of modern information technologies, means, and considerations on physical and psychomotor development of children, it is the AR tech- nology that allows to considerably expand educational and training process. In this re- spect, the American philosopher and teacher, John Dewey’s words "If we teach today as we taught yesterday, we rob our children of tomorrow", said at the beginning of the XX century, seem even more appropriate today. Therefore, what concerns the educa- tional and training process with deaf and hearing-impaired children the use of new and effective tools enabling better presentation and a more clear demonstration of the sports moving techniques, is a priority to be focused on soon. 333 2 Goal Setting The educational process for the hearing-impaired should be built up concerning certain specific characteristics of the nervous system, namely fragmentariness and slowness of acoustical perception, distortion, and incompletion of verbal representations connected with sensory-sound derivation [10]. In the working process with this category of chil- dren, the information on the further movement or action should be transmitted mainly by the means of visualization. Among these are posters, photo, and video displays, etc. For this reason, in training with deaf and hearing-impaired athletes, the applications of visual methods of training and exercising are mainly used, thus facilitating communi- cation, building rapport between trainer and athlete, as well as taking an individual ap- proach to the correction of the faults [15]. Accordingly, the purpose of our research is to prove the use of AR technology to enhance moving technique in educational and training process on track and field for the hearing-impaired children of the basic level [13]. It is because the use of AR technology allows animating images, including digital sound recording and video. In the working process with hearing-impaired athletes, this technology has clear advantages: visualization, involvement, functionality, and other features increasing motivation and interest in sports activities, stimulating ability to master the moving technique, and bridging communication. On basis of the above, the use of AR technology in the educational and training process for track and field athletics with hearing-impaired children contains a great po- tential, which might and must be realized in sports practice. This technology is simple in application and it can be used for multi-age audiences. Its appliance enables to meet a wide range of educational and cognitive needs. Moreover, the use of AR technology makes it possible to deliver learning material in a more interesting and accessible form. 3 Development of Method The AR technology (AR – "augmented reality") is based on the result of the introduc- tion of sensory data into the field of perception, purposing to augment data about the environment and to improve the perception of information [7]. The augmented reality allows imposing images, text, video, and audio components on the existing image or space using computer technologies. Generated this way the augmented information can be read from the marker by various digital devices, such as smartphones, tablets, AR- glasses, and helmets, etc. As a marker any graphic visual object on which can be added multi-format virtual objects by special software tools [8]. The scientific novelty of this work is that at present the technology of augmented reality has not been a topic yet with the education institutions in Russia. It has been practically out of the scope of adaptive physical culture either. This work represents the first case of using AR in sports training with deaf and hearing-impaired children. The practical importance of this work is that hereby offered methodic can be intro- duced in educational and training process for more effective work not only for children 334 with a hearing disorder but also for those physically challenged having other restrictions in health. The methodic for the use of AR technology offered by has been used in work with hearing-impaired children in the educational and training process on track and field athletics (the group of basic level, age of 7 - 10 years). The use of the offered technology is reflected in the following principles: individu- ality, availability, effectiveness. It is presented in forms and methods of training (group and individual training, individual work, participation in competitions); in methods of control and management of the educational and training process (in-training control, testing, and analysis of activity results); in tutorials (use of technical means; smartphones, tablets). Our choice of the training resource is based on the advantages of online access providing AR technology to combine speed and convenience in obtaining the information. The decisions taken in the course of the movement training should be consecutive and directed to hold the attention of the athletes. At the same time, it is instrumental to set the tasks feasible for the students. The student should realize and clearly understand the training goal. As a way of the organization of educational and training process, we offer sports and game method, providing a wide use (especially in the first two years of training) of the specialized game complexes and training tasks, which along with comprehensive phys- ical training, allows bringing the athletes to the understanding of the essence of track and field athletics as a sport. The elementary preparation is based on gradual stepping up the training requirements, simultaneously targeting health promotion, development of physical qualities required in the chosen sport. It is also devoted to getting the stu- dents acquainted with the technical range of track and field athletics and develop a steady interest in the perspectives of sports activity. 4 Results At present, the introduction of information technologies in all spheres of human activity shows that common methods of sports training are getting less effective. Augmented reality makes it possible to get sports activity modernized. AR technology enables the involvement of athletes in the educational and training process, to visually illustrate exercises of various characters. At the initial stage of studying and training on track and field athletics of children with the hearing disorder the following methods were used; integral and split skill activity, single motion, and lead-up skills. The basic and the most effective way to reinforce the learning material when working with hearing-impaired children is the sports and game training method. In our research, the use of AR technology has acted as a didactic tool to create a suitable training environment for children with a hearing disorder, from the State Cor- rectional Boarding School No.36 (“Spetsialnaya (Korrektsionnaya) Obshcheobra- zovatelnaya boarding school), Stavropol. According to the results, the technology of augmented reality effectively influences the above-mentioned children’s training movement technique, as AR can demonstrate it at any level of information. Hearing- 335 impaired athletes with hearing disorders can see with an equal degree of reliability the reference elements of different exercises in all details. They can compare the technique, identify their errors, and insight into all facets, which in actual practice would hardly be possible to realize. The educational and training process based on AR technology has its material ad- vantages: there is no need to acquire stands, posters, blackboards, and other visual aids. The two-dimensional marker is placed in front of the camera from which all the infor- mation is read out and analyzed, that's all you need to get the effect of augmented real- ity. However, although AR technology is on the list of the most promising technological trends, it is yet to come and present its use in a sports activity is practically uncommon (table 1). Table 1. Physical Fitness Index for deaf and hearing-impaired children. The initial and final test measurements № Performance Baseline M ± m Endpoints M ± m M1 – M2 P 1 Run 100 m, (s) 16,74±0,06 16,28 ±0,06 0,46 < 0,001 2 Run 20 m, (s) 2,96±0,04 2,66±0,04 0,3 < 0,001 3 Standing long jump (m) 1,65±0,01 1,84 ±0,01 0,19 < 0,001 4 Jump Rope 30 (s) 32,63±0,36 48,75±1,21 16,12 < 0,001 5 Discussion By reference to the available psychological and pedagogical characteristics of hearing- impaired patients, it follows that disorder of the auditory analyzer leads to the impair- ment of locomotory memory, thus affecting coordination of movements. The physical development of deaf people yields to normal people. In this relation, in modern society all persons with limited opportunities, notwithstanding their physical, mental, intellec- tual, cultural and ethnic, language, and other specifics, experience enormous difficulties in their sports activity. The driving force enabling to optimize educational and training process is the use of information technologies. Provided the correct methodological approach is taken, the implementation of AR technology into a given sports activity will be expedient, open- ing wide opportunities and initiating new pedagogical approaches to sports training. This transformation is directed at the conditioning of sports accessibility to physically challenged children. The evaluation of the current situation concerning the implemen- tation of augmented reality into the Russian sports training for disabled children indi- cates that currently there are no elaborations in this direction. We emphasize that the advantages of this technology have a correctional and a compensatory focus. The revealed contradiction facilitated research purposing to prove the efficiency of information technologies in the sports training of deaf and hearing-impaired children. Children with the hearing disorder from the State Correctional Boarding School No.36 of Stavropol, participated in the research. At the preliminary stage of preparation, the groups were formed from children of 7 - 10 years old. The division of the educational 336 process into periods is conventional, the emphasis is on the all-around physical and functional training, placing a great deal of focus on general physical conditioning and the development of technique and skills. Sports activities with this category have specific features. In this connection, the thematic development of each training will be goal-oriented and aimed at either the separate or multi-purposed tasks. The main direction of work is in the training of basic movement skills and transfer of knowledge on the sports training. The key method ap- plied in the working process with children, both with or without health limitations, is sports and games. In the process of the game, motor activity is organized based on a figurative or conditional plot, the character and the ways of the actions are subject to the logic of the game and their choice is up to a changing situation. Training activities comprise relays, outdoor games, repeated tasks, subject game compositions, circuit training, etc. Speech insufficiency of the deaf and hearing-impaired children engaged in track and field athletics influences the perception of the information connected with the description and learning off-track and field exercises. Augmented reality facilitates make young athletes dip into the playing environment to allow them to obtain the nec- essary information and further to show performance results of the movements they have learned. It is relevant since at the end of the circannual training period the athletes will reach qualifying standards for general physical preparedness. The use of AR technology promotes mastering sports techniques, stimulation of ed- ucational and training process, correction of motor skills disorder, interpretation of mo- tor and speech information, enrichment by target language and phraseology, activation of intellectual activity. It also stimulates the development of spatial thinking and im- proves the quality of the received information and its assimilation. Concerning sports activity for deaf and hearing-impaired children, the augmented reality makes training more attractive and enjoyable. Using this technology, either trainer or athlete has an opportunity to select an AR-application on a specific subject of the program. AR appli- cations are useful as at an initial approach to the new material, so in further acquiring of it. Athletes either independently or with the trainer control AR-objects: moving, turn- ing, changing scale, studying in a multi-dimensional way, that is interact with different interactive elements. Owing to this they can perceive the reference elements of different exercises observed at a reliable angle, thus enabling them to identify their errors and to correct the execution of the exercises, which in real conditions seems hardly possible to do. Synchronization of visual and auditory information that is happening, in reality, creates full immersion into the information environment and activates the perception, thus making the static content of the application pages animated. Consequently, AR technology is an actual viable alternative in sports training as compared to the conventional approach to work with deaf and hearing-impaired chil- dren. Again, the evident positive aspects are visual presentation, information exhaust- iveness, and interactivity. Nowadays, electronic means of information technology are widely used in education and training. However, so far, the technology of augmented reality has not seen its implementation yet, as it is desired. Especially it concerns sports training. 337 The analysis of existing educational, pedagogical, and scientific literature on this subject, allowed us to conclude that this technology is being a seldom tool in the edu- cational and training process. It is confirmed by Katkhanova I. F. and Bestybayeva K. I., stating that at the moment there is no possibility to apply AR technology in educa- tion, for no unified approach to its use has been developed yet in the educational envi- ronment [10]. Drawing on the results of sports activity of the hearing-impaired athletes it can be concluded that the technology of augmented reality renders the training a consistent, well-targeted, and motivated character. Its use is most effective for the identification and subsequent correction of errors, in the aspect of motivation, stimulation, and in- volvement into the training, when there are some difficulties with a concentration of attention and focusing and keen interest is urged. The more evident it is regarding deaf and hearing-impaired athletes, when AR-applications seem a really valuable tool to op- timize the organizing of educational and training process, rendering a positive influence both on the athletes (providing better acquisition of the information) and the teacher- trainer (helping optimize the training process). For the realization of the full-scale implementation of information technologies in Paralympic sport, it is necessary to create and put into practice innovative training methods and adapt the existing approaches according to new opening possibilities to integrate the most advanced technologies into sports. Despite the recognition of the huge potential of information technologies for educa- tion and training in respect of the people with special needs, i.e. limitations of health, their appliance does not always meet the expectations. The reason for such insufficient efficiency might be connected with the uncoordinated functioning of the educational platform with software and hardware aids, incompatibility with the assistive technology to access the Internet. Moreover, there is a certain risk that the first unsuccessful attempt with the assistive technology either by students or by trainers, can result in a negative reaction towards them further on. However, the systemic use of the technology of augmented reality together with other information technologies required to work out an individual training rule for movement technique in track and field athletics purposed for deaf and hearing-impaired children becomes the desired element of sports activity. 6 Conclusion Information technologies are the most suitable tool which can help people with special needs in their sports activities. The use of information technologies in the sphere of sports activity increases independence, integration, and equal opportunities for all peo- ple with health limitations, and those with hearing disorders in particular. In our opinion, information technologies in sports offer higher didactic efficiency as compared to conventional methods and means of training, especially at the early stages of preparation. At the same time a keen interest of young athletes, aroused at the start by the technical component of the electronic means used, further grows into a higher interest towards the content of theoretical and methodical aspects of the chosen sport. 338 The success in the training of deaf and hearing-impaired children with the use of information technologies applied in sports training depends on the choice of technol- ogy. Guided by the purpose designated in this research, to solve the tasks, we have made our choice in favor of the technology of augmented reality. The reason is that the technology of augmented reality that we used in the educa- tional and training process, for the time being, has no solid scientific and methodical base. It is practically simple and available to any trainer-teacher possessing computer skills at the non-programming level. Besides, it allows creating high-quality electronic tools for the didactic support of training in track and field athletics. The developed training complexes for preliminary exercises in track and field ath- letics with the use of AR technology have been successfully tested in the conditions of the actual training of the children with the hearing disorder from the State Correctional Boarding School № 36 of Stavropol. The developed training complexes can be recommended to be introduced into the educational and training process organized in groups of children with hearing disorders and other limitations of health. References 1. The Analytical Note [The Analytical Note]. IT for inclusive education [IT for inclusive ed- ucation], 2010, pp. 1. Available at: URL: https://iite.unesco.org/pics/publications/ru/ files/3214675.pdf (Accessed 10-09-2019). (In Russ.) 2. Bogdanova, of T.G. Surdopsychology: Manual for students of higher education institutions for Pedagogics. [Surdopsychology: Manual for students of higher education institutions for Pedagogics] M.: Academy, 2002, 203 p. Available at: URL: http://sdo.mgaps.ru/books/K17/M13/p1/4.pdf (Accessed 10-09-2019). (In Russ.) 3. Vygotsky, L. S. Fundamentals of defectology [Fundamentals of defectology]. SPb.: Lan, 2003, 654 p. Available at: http://pedlib.ru/Books/1/0453/1_0453-1.shtml (Accessed 10-09- 2019). (In Russ.) 4. Additional preprofessional program "Sport for deaf people" [Additional preprofessional pro- gram "Sport for deaf people"]. Voronezh. pp. 59–62. (2016). (Accessed 10-09-2019). (In Russ.) 5. Katrenko, M. V., Nebytova, L. A., Savin, D. I., Sasin, A. A. Using augmented reality tech- nology as a means of increasing the effectiveness of the training process in athletics for children with audiological disorders. Vestnik Severo-Kavkazskogo federal university, 2019, 5 (74), pp. 169–173. DOI: 10.37493/2307-907X-2019-74-5-169-173 (In Russ.). 6. Katrenko, M. V., Nebytova, L. A., Schekin, A. F., Zhuravleva, Yu. I. The role of augmented reality technology in organizing independent work on physical culture at a university. Ped- agogy and education, 2019, 2, pp. 35–39. DOI: 10.7256/2454-0676.2019.2.28943 URL: https://nbpublish.com/library_read_article.php?id=28943 (In Russ.). 7. Kozin, V. V., Vitman, D. Yu. Methods and approaches of augmented reality in tactical and technical training of athletes of team and game sports [Methods and approaches of aug- mented reality in tactical and technical training of athletes of team and game sports]. Modern high technologies [Modern high technologies], 2018, 5, pp. 199–203, Available at: https://top-technologies.ru/ru/article/view?id=37015 (Accessed 10-09-2019). (In Russ.) 339 8. Kulikova, T. A., Poddubnaya, N.A. AR technology in educational process of higher educa- tion institution. [Bulletin of Tver State University. ‘’Pedagogics and Psychology’’]. Availa- ble at: https://www.elibrary.ru/item.asp?id=36650816 (Accessed 10-09-2019). (In Russ.). 9. Nebytova, L. A., Chibisov, A. M. Adaptive physical culture as a means of self-education of hearing impaired students [Adaptive physical culture as a means of self-education of hearing impaired students]. Physical culture and sport: integration of science and practice. Materials of the XV International Scientific and Practical Conference 2018 [Physical culture and sport: integration of science and practice. Materials of the XV International Scientific and Practical Conference 2018], SKFU publishing house, Stavropol, 2018, pp. 200–202. Available at: https://elibrary.ru/item.asp?id=36840841 (Accessed 10-09-2019). (In Russ.) 10. Stepanenko, D.I., Pechko, A. Yu. The organizational and methodical recommendations on the training of track and field athletes with hearing disorder [The organizational and me- thodical recommendations on the training of track and field athletes with hearing disorder]. Applied sports science [The organizational and methodical recommendations on the training of track and field athletes with hearing disorder], 2016, 2 (4), pp. 37–40. Available at: https://www.elibrary.ru/title_about.asp?id=57215 (Accessed 10-09-2019). (In Russ.) 11. Apokin, V.V., Usaeva, N.R. Academic mental stressors in academic inclusive sports [Aca- demic mental stressors in academic inclusive sports]. Theory and Practice of Physical Cul- ture [Theory and Practice of Physical Culture], 2019, 7, pp. 29–30. Available at: http://siteresources.worldbank.org/DISABILITY/Resources/Data/MontPrevalence.pdf (Ac- cessed 10-09-2019). (In Russ.) 12. Forlin, C., Lian, J. “Contemporary trends and issues in educational reform for special and inclusive education”. In Reform, inclusion and teacher education: Towards a new era of special education in the Asia-Pacific region, Edited by: Forlin, C. and Lian, M.-G.J. 2008, pp. 3–12. DOI: https://doi.org/10.4324/9780203895313 13. Malova, E.N., Shubovich, V.G., Shubovich, M.M. Health-promoting aspect of use of infor- mation and communication technologies in additional education of elementary students. Theory and Practice of Physical Culture 2019, 12, pp. 70–72. Available at: https://www.eli- brary.ru/item.asp?id=41748296 (Accessed 27.08.2019). (In Russ.) 14. Shagrova, G., Kulikova, T., Poddubnaya, N., Ardeev, A. Innovative approaches to the or- ganization of students» independent learning by the digital economy requirements. CEUR Workshop Proceedings, International Scientific Conference Innovative Approaches to the Application of Digital Technologies in Education and Research, Stavropol-Dombay, Rus- sian Federation, 2019. Available at: https://www.elibrary.ru/item.asp?id=41822703 (Ac- cessed 10-09-2019). 15. Rasskazov, F.D., Muller, O.Y. Professional competency advancement trainings for adaptive physical education specialists. Theory and Practice of Physical Culture, 2018, 11, pp. 30– 31. Available at: https://www.elibrary.ru/item.asp?id=38168789 (Accessed 10-09-2019).