ASTRAS: a software for the assessment and training of executive functions in children Raffaele Nappo1-2 Michele Iorio1 Federica Somma1-3 1 Centro di riabilitazione NeapoliSanit, Via Funari, 80044, Ottaviano, Italia 2 Dipartimento di psicologia, Università degli studi della Campania Luigi Vanvitelli, Viale El- littico 31, 81100, Caserta, Italia 2 Dipartimento di studi umanistici, Università degli studi di Napoli Federico II, Via Porta di Massa 1, 80133, Napoli, Italia Abstract. Executive functions are a set of cognitive processes (working memory, cogni- tive flexibility, attention, inhibition and planning), which are crucial for a goal- oriented behavior. A deficit of the executive functions has been reported in several neurodevel- opmental disorders, chiefly among them attention deficit/hyperactivity disorder (ADHD) and learning specific disorder (LSD). In these clinical conditions, the impairment of the executive functioning has a significant impact on the therapy and its gains. Hence, the assessment and training of these cognitive processes should always be a matter of special attention by the therapist. Consistently with this, we developed “ASTRAS”, an application for the as- sessment and training of the executive functions in children with neurodevelop- mental disorders. ASTRAS has two main features: 1) two types of use (therapists and parents), which offer the opportunity to start (therapists)/run (parents) the assess- ment/training session from remote. In other words, ASTRAS can be used as a tool for the telerehabilitation (or e-rehabilitation); 2) gamification, which offers the opportunity to work on both specific executive skills and motivation. In conclusion, ASTRAS will improve executive functions in children enhanc- ing their engagement/motivation about the therapy. Keywords: Executive Functions, Telerehabilitation, Computer-Based rehabili- tation. Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribu- tion 4.0 International (CC BY 4.0). 2 1 Introduction Executive functions (EFs) is an umbrella term which encompasses a set of interrelated cognitive processes, such as planning, working memory, inhibition, cognitive flexibil- ity and attention [1, 2]. These processes are associated with problem-solving, decision making and goal-oriented behavior, which in turn allow the individual to cope with novel situations and complex or conflictual information [3]. In other words, EFs under- lie individuals’ adaptive behaviors to the changing environment. Childhood is a highly sensitive period regarding the development of EFs [4] and since these higher order functions play a fundamental role in cognitive development, there is no doubt that deficits of executive functioning may be reported in several neu- rodevelopmental disorders such as attention deficit/hyperactivity disorder (ADHD[5, 6], learning specific disorder (LSD [5, 7]), autism spectrum disorder (ASD; [8, 9]), in preterm children [10] and in several genetic syndromes (Prader-Willis and phenylke- tonuria). Deficits of executive functioning in these populations affect the severity of the dis- orders. For example, in children with ADHD a dysexecutive syndrome has been asso- ciated to learning impairment, problems with academic achievement as well as mala- daptive and/or aggressive behaviors[11]. In their study, Schreiber et al.[12] reported that children with ADHD performed worse on the working memory task as compared with the controls. In this group, the score in a working memory task predicted learning problems. Other studies confirmed these results [13, 14]. Watson et al. (2016) discussed the impact of EF in learning disorder (LD). The au- thors stated that “students with LD often evidence significant problems in EFs which includes working memory operations (updating), inhibitions of impulses (inhibiting), and mental set or task shifting (shifting)”. These problems “are usually manifested by ineffective ways to plan, monitor their own learning, and detect and correct their er- rors.” Considering the importance of EFs in children with both typical and atypical devel- opment the assessment and the training of these particular cognitive processes has re- ceived considerable attention [4, 15]. Notably, in children with neurodevelopmental disorders, deficits of executive functions -and their impact on the severity of syndrome- should always be taken into account and interventions fostering EF in these children should be provided along with the traditional therapy. Among several tools for the assessment (see Poletti and Montanari, 2014[16] for a review) and training of executive functions [4, 17] alternative methods - widely used for other cognitive processes [18–21]- are receiving a growing interest. A good example are the computer-based tools (i.e. software, apps, videogames and serious games). These tools have several advantages. For example, assessment or train- ing tasks can be converted into games (i.e. gamification). Gamification, that is the ap- plication of typical elements of game playing (e.g. point scoring, competition with oth- ers, rules of play) to other areas of activity [22, 23] in order to encourage children’s engagement and motivation. Furthermore, computer games allow to progressively in- crease -or decrease- the load of a specific executive domain relying on individual’s 3 performance. Thus, they avoid frustration and therapy drop-out. The efficacy of com- puterized training has been reported in literature. For example, Klingberg et al.[24] conducted a trial to investigate the effect a computer-based training of working memory in a sample of children with ADHD. In this study, working memory significantly im- proves after the training. The effects were observed even on untrained tasks (i.e. re- sponse inhibition, and complex reasoning) and were observed at the follow-up (i.e. three months later). Similar results with computerized training of executive functions have been reported in literature by Thorell et al. [25], Holmes et al. [26]and Karbach & Kray[27]. Although an increasing number of technological platforms have been released (e.g. CogMed; CogniFit; Neurnation; ACTIVATE), this research field is still young and a lot of work is needed. For example, to our knowledge, to date no one has developed a computer-based tool for the assessment of executive functions in children with neuro- developmental disorder or at least a software in which the assessment part communi- cates with the training part. Additionally, computer-based tools should allow therapist to start the assessment/training session from remote offering the opportunity to provide a telerehabilitation or e-rehabilitation service. Here, we described ASTRAS, a software developed in our lab, aiming at assessing and training EFs in children with neurodevelopmental disorders. 2 ASTRAS ASTRAS1 is a cross-platform software (iOS, Windows, macOS and Android) for the assessment and training of EFs. The software is designed for children, with neurode- velopmental disorders (e.g. ADHD, LSD, ASD), in which these particular cognitive domains are impaired (see above). The software uses some gamification principles. That is, assessment and training tasks share the characteristics of game elements such as: 1) design: the assets of each task (i.e., scenario and characters) are cartoon-like. Furthermore, training’s tasks have a common theme, the space; 2) mechanics: tasks have been designed as challenges in which children can also compete with others. Ad- ditionally, children receive a feedback about their performance (only in the practice session of the assessment tasks and in each training tasks, see below) and a reward each time they successfully accomplish a training task; 3) components: assessment and train- ing tasks have been designed with different levels of difficulty, thus increasing the load of the specific executive domain. Bind together, these game features aim to improve children engagement, motivation as well as learning. 1 For a demo version of the software contact the authors. 4 2.1 General structure ASTRAS is designed for children from six to eleven. We targeted this range because even though rudiments of EFs emerge before early childhood [28], and a rapid improve- ment in EFs tasks have been observed in preschoolers [29], these particular cognitive processes are more likely to mature in scholar period and adolescence [30, 31]. There are two types of use/access in ASTRAS. Each type of use/access includes different features as reported below: - Therapists/Tutors: this type of use/access is designed for those professionals (psychologist, neuropsychiatrist, speech therapist, etc.) who work with chil- dren with neurodevelopmental disorders. This type of use allows to: 1) register a new child, modify his/her data or delete his/her profile; 2) open an individual or group assessment/training session; 3) assign exercises to a singular child or a group of children; 4) visualize children’s scores. - Parents: this type of use/access is designed for children. This type of use al- lows to visualize and run the assessment tasks or the training exercises as- signed by the therapist. The two types of use/access and their features foster the feasibility of the e-rehabilita- tion. In fact, therapists can use ASTRAS software in clinical context (vis-à-vis), but also from remote. ASTRAS also includes two different sessions, namely an assessment and training. Both sessions take into account five main executive domains, commonly reported in the literature [32, 33], that is: selective attention, inhibition, cognitive flexibility, plan- ning and working memory. Specifically, we referred to Myake et al.[34] as theoretical framework. The model posits that there are three core EFs: 1) inhibition: reflects the ability to control own behavior, thoughts, and/or emo- tions to override a strong internal predisposition. Inhibition can be divided in behavioral inhibition (i.e. the suppression of a prepotent motor reaction) and cognitive inhibition (i.e. the suppression of a prepotent mental representation); 2) working memory (WM): reflects the ability to hold verbal (verbal WM) or spatial (spatial WM) information in mind and mentally working with/on it. Additionally, WM includes the updating, that is the incorporation of new in- formation into the old ones; 3) cognitive flexibility: refers to the ability to switch between thinking about two different concepts or to think about multiple concepts simultaneously. From these core EFs, is built the planning. Planning is a higher order EF and reflects the ability to set goals, develop action plans to achieve those goals, and to choose the most appropriate actions based on the anticipation of consequences. Additionally, in this model, selective attention, namely the ability to selectively focusing on a target stimulus and suppressing attention to other stimuli or external lure, has been conceived playing a crucial role in the correct development of EFs. 5 Below we provide a more accurate description of the assessment and training ses- sions (i.e. their general structure and their respective tasks). 2.2 Assessment Assessment includes ten tasks, two for each executive domain (selective attention, working memory, inhibition, cognitive flexibility and planning, see figure 1 for the in- terface). Fig. 1. The assessment interfaces for therapists (A) and parents/children (B) are shown. Thera- pist interface reports the list of tasks and their respective scores (yellow box) and the button to start the assessment session (blue box). Parents interface reports the icon of each assessment task. Additionally, other two tasks have been developed to assess the updating of working memory. Each task consists of trials, which progressively increase in difficulty. Tasks are preceded by four steps (Figure 2): 1) starting: a traffic light which informs children that the task is going to start; 2) pre-test session: this step taps whether children have developed those cogni- tive processes mandatory to run the test (e.g. in the cancellation task, the pre- test verifies whether children are able to discriminate a target picture). If this session is failed twice the task ends; 3) simulations: in this step a video shows an example of trial; 4) practice session: in this step children are provided a practice trial. The aim of this step is twofold: a) to allow the participant to practice with the task; b) ensure that children have clearly understood the instructions. If the patients fail this session once, the simulation will be provided again. If the patients fail twice, the task ends. The score in each task range from 0 to 100 in terms of accuracy. Further data such as reaction times, omissions and commissions errors (e.g. selective attention tasks), number of moves (e.g. in the maze task) are stored into ASTRAS’s database. These additional data make ASTRAS useful for research purposes or to address other clinical issues. Below a small description of the tasks for each cognitive domain has been provided. 6 - Cancellation: it assesses the visual selective attention. In this task, children are shown a clutter of items, and asked to tap with their finger the target item (e.g. a star), ignoring the other stimuli. - Listening: it assesses the auditory selective attention. In this task, children are provided a sequence of animal sounds. They have to tap a paw on the center of the screen when they hear a target sound (e.g. a frog). - Sequence of quantity: it assesses the working memory. In this task, a sequence of numbers appears on the screen. Children have to repeat the sequence either forward or backward. - Visual sequence: it assesses the visuo-spatial working memory. In this task, a sequence of flashing stars is visualized on the screen. The participant has to reproduce the sequence either forward or backward. - Auditory updating: it assesses the auditory updating of working memory. In this task, children listen to the tones in sequence. After each tone is heard chil- dren decide whether the new tone is the same from 1 (1-Back) or 2 trials (2- Back) before. - Visual updating: it assesses the visuo-spatial updating of working memory. In this task, children have to decide whether the position of a ghost is the same of 1 (1-Back) or 2 trials (2-Back) before. - Go-No Go: it assesses the motor inhibition. In this task, children have to move a penguin only when he/she listen to a GO sound. - Matching: it assesses the cognitive inhibition. In this task, children have to identify, from a subsequent set of stimuli, the one that “matches” the sample. - Color-shape association: it assesses the cognitive flexibility. In this task, chil- dren have to choose, from two stimuli displayed on the top of the screen, the one that has the same target criterion of the sample (shape or color). The target criterion is provided by the software. - Trail: it assesses the cognitive flexibility. In this task, children have to tap in ascending order a clutter of numbers and letters. - Maze: it assesses the planning. In this task, children must trace through a maze without crossing the maze lines. - Planning: it assesses planning. In this task, children have to reproduce a pic- ture (e.g. a cake) in a given number of steps. 2.3 Training Training includes ten tasks/games, two for each executive domain. Here, the therapist chooses: 1) the executive domain to train; 2) the specific task/game for that executive domain; 3) the number of exercises; 4) the difficulty (1 to 4); 5) the prompt (i.e. the visual or auditory support to help children in accomplishing the task). Figure 2 reports the training interface. 7 Fig. 2. The training interfaces for therapists (A) and parents/children (B) are shown. Therapist interface reports the list of assessment tasks and their respective scores (yellow box), the inter- face to choose exercises (green box), the difficulty (black box), the prompt (red box), the prac- tice (purple box) and the button to start the training session (blue box). Parents interface reports the icon of each training task and the number of exercises for each task. Below a small description of the tasks for each cognitive domain has been provided. - Fix the spaceship: it trains the visual selective attention. In this task, children have to drag a target object (e.g. pliers) into a toolbox, ignoring the other stim- uli. - Find the toy: it trains the visual selective attention. In this task, children have to choose the correct color of a target stimulus (e.g. a teddy bear) -ignoring the non-target stimuli- by pressing the correct button. - Unlock the code: it trains the working memory. In this task, children have to memorize the code of letters and numbers and type it on a safe’s keyboard by pressing first the numbers and then the letters in ascending order. - Count the toys: it trains the updating of working memory. In this task, the trial is visualized as a sequence of dolls and teddy bears falling into two separate boxes. When the sequence ends, children have to report the number of either dolls or bears in one of the two boxes (target box). - “Whac-an-alien”: it trains the motor inhibition. In this task, aliens pop up from some holes disposed on the screen. Children have to hit the red alien and not the green one. Red aliens are more likely to occur. - “Check the toys”: it trains the motor inhibition. In this task, children have to decide whether a toy is broken or it is different from the target by pressing the relative buttons. No button needs to be pressed if the target toy is intact. - “Charge the robot”: it trains the cognitive flexibility. In this task, children have to choose the correct battery: if the robot dreams an empty geometrical figure the correct battery is the one with the same figure; if the robot dreams a colored geometrical figure the correct battery is the one with the same color. - “Dodge the asteroids”: it trains the cognitive flexibility. In this task, children have to dodge the asteroids. The correct direction is given by the color of an arrow displayed on the screen: The direction is congruent if the arrow is green; incongruent if the arrow is red. 8 - “Pile the stones”: it trains the planning. In this task, children have to pile a set of stones in the correct order. - “Reach the star”: it trains the planning. In this task, children have to decide the sequence of rightward and/or leftward movements in order to reach the goal. 3 Conclusion In conclusion, our software can be thought as a platform hosting several tasks/games for the assessment and training of executive functions in children with neurodevelop- mental disorders. ASTRAS offers the advantage to provide training tasks from remote and control patients’ score ongoing and to change: 1) the type of executive domain to train; 2) the difficulty level; 3) the prompt. In other words, the software might be a useful tool for telerehabilitation. Furthermore, gamification has been applied in our software in order to increase children’s engagement and make the experience of the therapy more enjoyable as well as avoid drop-out. Acknowledgment We are grateful to Irene Mammarella and Giulia Crisci for discussing the structure of our software. We appreciated the constructive suggestions and encouraging feed- back. They suggest to design and develop the two tasks of auditory and visual updating working memory. References 1. Anderson P (2002) Assessment and development of executive function (EF) during childhood. Child Neuropsychol 8:71–82. https://doi.org/10.1076/chin.8.2.71.8724 2. McKenna R, Rushe T, Woodcock KA (2017) Informing the structure of executive function in children: A meta-analysis of functional neuroimaging data. Front Hum Neurosci 11:1–17. https://doi.org/10.3389/fnhum.2017.00154 3. Shallice T (1988) From Neuropsychology to Mental Structure 4. Takacs ZK, Kassai R (2019) The efficacy of different interventions to foster children’s executive function skills: A series of meta-analyses. Psychol Bull 145:653–697. https://doi.org/10.1037/bul0000195 5. Faedda N, Romani M, Rossetti S, et al (2019) Intellectual functioning and executive functions in children and adolescents with attention deficit hyperactivity disorder (ADHD) and specific learning disorder (SLD). Scand J Psychol 60:440–446. https://doi.org/10.1111/sjop.12562 6. Rapport MD, Orban SA, Kofler MJ, Friedman LM (2013) Do programs designed to train working memory, other executive functions, and attention benefit children with ADHD? A meta-analytic review of cognitive, academic, and behavioral outcomes. Clin Psychol Rev 33:1237–1252. 9 https://doi.org/10.1016/j.cpr.2013.08.005 7. MR Watson S (2016) The Role of Executive Functions in Classroom Instruction of Students with Learning Disabilities. Int J Sch Cogn Psychol 03:1–5. https://doi.org/10.4172/2469-9837.1000167 8. Otterman DL, Koopman-Verhoeff ME, White TJ, et al (2019) Executive functioning and neurodevelopmental disorders in early childhood: A prospective population-based study. Child Adolesc Psychiatry Ment Health 13:1–12. https://doi.org/10.1186/s13034-019-0299-7 9. Kaur Pany S (2017) Efficacy of Computer Based Intervention in Improving Executive Function of Autism Spectrum Disorder Children 10. Aarnoudse-Moens CSH, Duivenvoorden HJ, Weisglas-Kuperus N, et al (2012) The profile of executive function in very preterm children at 4 to 12 years. Dev Med Child Neurol 54:247–253. https://doi.org/10.1111/j.1469- 8749.2011.04150.x 11. Jacobson LA, Williford AP, Pianta RC (2011) The role of executive function in children’s competent adjustment to middle school. Child Neuropsychol. https://doi.org/10.1080/09297049.2010.535654 12. Schreiber JE, Possin KL, Girard JM, Rey-Casserly C (2014) Executive function in children with attention deficit/hyperactivity disorder: The NIH EXAMINER battery. J Int Neuropsychol Soc. https://doi.org/10.1017/S1355617713001100 13. Willcutt EG, Doyle AE, Nigg JT, et al (2005) Validity of the executive function theory of attention-deficit/ hyperactivity disorder: A meta-analytic review. Biol. Psychiatry 14. Martinussen R, Hayden J, Hogg-Johnson S, Tannock R (2005) A meta-analysis of working memory impairments in children with attention- deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. https://doi.org/10.1097/01.chi.0000153228.72591.73 15. Stubberud J, Holthe IL, Løvstad M, et al (2020) The feasibility and acceptability of goal management training of executive functions in children with spina bifida and acquired brain injury. Neuropsychol Rehabil 0:1–20. https://doi.org/10.1080/09602011.2020.1723649 16. Poletti M, Montanari P (2014) Valutazione Dell ’Attenzione E Delle Funzioni Esecutive in Età Evolutiva : Rassegna Degli Strumenti Italiani. G di Neuropsichiatr dell’età Evol di Neuropsichiatr dell’età Evol 34:1–7 17. Diamond A, Ling DS (2016) Conclusions about interventions, programs, and approaches for improving executive functions that appear justified and those that, despite much hype, do not. Dev Cogn Neurosci 18:34–48. https://doi.org/10.1016/j.dcn.2015.11.005 18. Ponticorvo M, Di Fuccio R, Ferrara F, et al (2019) Multisensory educational materials: Five senses to learn. In: Advances in Intelligent Systems and Computing 19. Ponticorvo M, Rega A, Miglino O (2018) Toward tutoring systems inspired by applied behavioral analysis. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10 20. Ponticorvo M, Di Ferdinando A, Marocco D, Miglino O (2016) Bio-inspired computational algorithms in educational and serious games: Some examples. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 21. Somma F, Rega A (2019) Assessment and assisted training software for ADHD. In: CEUR Workshop Proceedings 22. Robson K, Plangger K, Kietzmann JH, et al (2015) Is it all a game? Understanding the principles of gamification. Bus Horiz. https://doi.org/10.1016/j.bushor.2015.03.006 23. Huotari K, Hamari J (2012) Defining gamification - A service marketing perspective. In: Proceedings of the 16th International Academic MindTrek Conference 2012: “Envisioning Future Media Environments”, MindTrek 2012 24. Klingberg T, Fernell E, Olesen PJ, et al (2005) Computerized training of working memory in children with ADHD - A randomized, controlled trial. J Am Acad Child Adolesc Psychiatry. https://doi.org/10.1097/00004583- 200502000-00010 25. Thorell LB, Lindqvist S, Nutley SB, et al (2009) Training and transfer effects of executive functions in preschool children. Dev Sci. https://doi.org/10.1111/j.1467-7687.2008.00745.x 26. Holmes J, Gathercole SE, Place M, et al (2010) Working memory deficits can be overcome: Impacts of training and medication on working memory in children with ADHD. Appl Cogn Psychol. https://doi.org/10.1002/acp.1589 27. Karbach J, Verhaeghen P (2014) Making Working Memory Work: A Meta- Analysis of Executive-Control and Working Memory Training in Older Adults. Psychol Sci. https://doi.org/10.1177/0956797614548725 28. DIAMOND A (1990) Developmental Time Course in Human Infants and Infant Monkeys, and the Neural Bases of, Inhibitory Control in Reaching. Ann N Y Acad Sci. https://doi.org/10.1111/j.1749-6632.1990.tb48913.x 29. Zelazo PD, Müller U, Frye D, et al (2003) The development of executive function in early childhood. Monogr Soc Res Child Dev 30. Visu-Petra L, Benga O, Miclea M (2007) Dimensions of attention and executive functioning in 5-to 12-years-old children: Neuropsychological assessment with the NEPSY battery. Cogniţie Creier Comport 31. Carlson SM (2005) Developmentally sensitive measures of executive function in preschool children. Dev Neuropsychol. https://doi.org/10.1207/s15326942dn2802_3 32. Miyake A, Friedman NP, Emerson MJ, et al (2000) The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis. Cogn Psychol. https://doi.org/10.1006/cogp.1999.0734 33. Pennington BF, Ozonoff S (1996) Executive functions and developmental psychopathology. J Child Psychol Psychiatry Allied Discip 37:51–87. https://doi.org/10.1111/j.1469-7610.1996.tb01380.x 34. Lehto JE, Juujärvi P, Kooistra L, Pulkkinen L (2003) Dimensions of executive functioning: Evidence from children. Br J Dev Psychol.