Identifying Factors which Critically Affect Students’ Failure in Blended Courses Ioannis Georgakopoulos1, Miltiadis Chalikias2, Vassilis Zakopoulos3, Evangelia Kossieri4 1 Department of Accounting and Finance, University of West Attica, Athens, Greece; e- mail: igtei@uniwa.gr 2 Department of Accounting and Finance, University of West Attica, Athens, Greece; e- mail: mchalik@uniwa.gr 3 Department of Accounting and Finance, University of West Attica, Athens, Greece; e- mail: v.zakopoulos@uniwa.gr 4 Department of Accounting and Finance, University of West Attica, Athens, Greece; e- mail: kossieri@uniwa.gr Abstract. Our modern era has brought about radical changes in the way courses are delivered. To meet the new challenges, a new course type has emerged, the blended course in the context of which online teaching and conventional instruction are efficiently mixed. This paper demonstrates a way to identify factors affecting students’ critical performance in blended courses through the development of a potent risk model. The risk model is demonstrated in the context of two specific blended courses, sharing the same learning design. Keywords: risk model; risk factors; students’ achievement; engagement; blended courses. 1 Introduction Blended learning (BL), also known and as hybrid learning, is a way of teaching that combines traditional face to face classroom methods (with technology mediated) and on-line educational material. This allows students to have access to teaching material, even after the lesson is finished and provides them with a more personalized learning environment. Blended learning differs from other on-line methods in the aspect of counting on “face to face” teaching methods as well (Friesen, 2012). It also provides a shift from traditional teaching to a more interactive one, where teachers act more as guides and supervisors, establishing a more personal relation with their students, than simply act as the ones who deliver knowledge to a large audience. It could be argued that there are many blended learning models available which can be adopted by schools and institutions. This can depend on, content, scale, technology, learning spaces, students’ age, etc. (PERC, 2014). Comes to no surprise that education has been transformed the recent decades by the rapid spread of technology (Drosos et al., 2016; Skordoulis et al., 2014; Skordoulis et al., 2016; Drosos et al., 2015). Higher institutions, as the leading force in delivering 12 educational innovations, are trying to adopt to modern society’s educational needs (Skordoulis et al., 2015; Ntanos et al., 2020; Skordoulis et al., 2020). Therefore, Blended Learning can be used in a wide range of academic disciplines through a variety of pedagogical approaches and models. In terms of the students’ attitude towards blended courses, one study (Wu & Liu, 2013) has indicated that in general, students show positive attitude towards blended courses and that factors affiliated with learning climate; perceived enjoyment; perceived usefulness; system functionality; social interaction; content feature and performance expectation are also significantly related to students’ satisfaction in blended courses (Skordoulis et al., 2014; Skordoulis et al., 2015; Zapantis et al., 2017). Another study (Wang, 2018) has proved that a lot of students who attend blended courses not only show positive attitude towards these courses but they also achieve better results in the context of their performance in comparison to students enrolled in conventional courses. That finding is also in line with the studies (Akbarov et al., 2018; Bakeer, 2018; Maccoun, 2016; Vernadakis et al., 2012; Alsalhi et al., 2019; Saritepeci & Cakir, 2015) which have pointed out that blended learning has positive impact on students’ performance. In the context of students’ performance in blended courses, one study (Ismail et al., 2018) has considered the following four main categories as especially important and significant factors that have great effect on academic performance: • the use of technology; • the interaction processes; • the characteristics of the students; • the characteristics of the class. Another study (Ramirez et al., 2018) has attempted to describe the relationships concerning motivations; emotions, cognitive; meta-cognitive and learning strategies and their impact on learning performance in blended courses. Their results suggested that negative emotions play a meaningful role between expectancy (a component of motivation) and learning strategies and that the expectancy component of motivation positively influences meta-cognitive strategies. The issue of students’ performance in blended courses has also been addressed in another work (Wenchieh & Lan-Yin, 2010). This study has clarified that students’ performance in blended courses is affected by the success of two systems, the technical system and the social system. In a more elaborate detail, the technical system is reflected on the role of e-learning and the social system is reflected on the motivation and learning climate. In parallel manner, another research (Owson et al., 2013) proved that high achievers in a blended course were students who had fully participated into online activities. Another work (Filippidi et al., 2010) focuses on the Moodle usage practices and their impact on students’ performance in the context of a specific blended course proving that the Moodle system usage has accounted for the 20.2 % of variance in the students’ final grade. It is also important to refer to another study (Keskin & Yurdugul, 2019) which has indicated that students’ achievement in blended courses bears on their self- efficacy and e-learning motivation highlighting the important role of e-learning part. It is also vital to refer to a study (Volchok, 2018) which made use of a binary logistics regression analysis to predict students’ performance in two blended business 13 courses. The binary logistics’ regression outcome on a data set including social; individual and academic factors indicated that students’ self-regulation; skills and learning presence in the community are strong predictors of students’ final achievement. Needless to say that the academic factors were reflected by students’ engagement data including attendance; credit assignments; first quiz grades and semester grades. In the area of students at risk, there are a lot of researches (Macfadyen & Dawson, 2010; Anagnostopoulos et al., 2020; Marks, 2000; Newmann et al., 1992; Willms, 2003; Fredericks et al., 2004; Zhang et al., 2004; Appleton et al., 2008) which have stress on engagement data as strong predictors of students’ critical performance. 2 Research methodology In the risk factors’ identification process, appropriate data are analyzed in terms of a statistic method or a machine learning technique (Marks, 2000; Georgakopoulos et al., 2018; Georgakopoulos et al., 2020) in order to come up with the risk model which identifies the risk factors (Vose, 2008). The risk model development process is demonstrated for two courses having the same instructional design. The number of students who participated in the first course was 144; whereas the corresponding number in terms of the second course was 150. The instructional design was exported to Moodle LMS. Students were deemed to pass the course if they achieved a final grade greater or equal to 5. We modeled a binomial variable student risk describing students who were about to face the risk of failing the course (Macfadyen & Dawson, 2010; Anagnostopoulos et al., 2020). The state “0” was modeled to indicate students who were not about to face the risk of failing the course; whereas the state “1” was modeled to indicate students at risk. In parallel manner a set of variables was modeled, describing the students’ interaction with the course activities. These variables are listed below: • Number of Slides completed (“0”: not completed, “1”: completed); • Number of Self-assessment quizzes completed (“0”: not completed, “1”: • completed); • Number of Exercises done/completed; • Number of videos watched/completed; • Forum used (“0”: not used, “1”: used); • Total absences (skipping class); • Test grade (before the final exams); After the final exams, the below variables along with the student risk variable were deployed in terms of a binary logistics regression analysis (Volchok, 2018; Macfadyen & Dawson, 2010). 14 3 Results 3.1 Binary Logistics Analysis Outcome (Course 1) The significant risk factors, which have significant contribution to the reduction of the risk probability are those factors, the significance value of which is equal or less than 0.05. Thereby, according to the Sig. column on table 1, these factors are the Test Grade and the Total Absences. Table 1. Coefficients (Regression Model-Course 1). B S.E. Wald Sig. Exp (B) Test grade -0.654 0.123 28.232 0.000 0.520 Total 0.463 0.149 9.646 0.002 1.589 absences Constant -0.198 0.809 0.060 0.807 0.821 3.2 Binary Logistics Analysis Outcome (Course 2) According to the Sig. column on table 2, the significant factor is the Number of Slides completed. Table 2. Coefficients (Regression Model-Course 2). B S.E. Wald Sig. Exp (B) Number of -0.654 0.123 28.232 0.000 0.520 slides Constant -0.198 0.809 0.060 0.807 0.821 4 Conclusions The results have proved that there is not a specific factor that always has contribution to risk occurrence in the blended courses. The risk factors vary among courses. Shedding more light on these cases we can deduct that factors related to a conventional way of course delivery (lectures attended) and factors which are affiliated with a modern way of course delivery (slides completed mounted on Moodle LMS and online test grade) appear to be significant in the reduction of the probability of risk occurrence. 15 References 1. Akbarov, A., Gonen, K. and Aydogan, H. (2018) Students’ attitudes toward blended learning in EFL context. Acta Didact. Napoc., 11, (1), p. 61-68. 2. Alsalhi, N.R., Eltahir, M.E. and Al-Qatawneh, S.S. (2019). The effect of blended learning on the achievement of ninth grade students in science and their attitudes towards its use. Heliyon, Vol. 5, No 9, e02424. 3. Appleton, J., Christenson, S. & Furlong, M. (2008). Student Engagement with School: Critical Conceptual and Methodological Issues of the Construct. Psychology in the Schools, Vol. 45(5). 4. Bakeer, A.M. (2018). Students' Attitudes towards Implementing Blended Learning in Teaching English in Higher Education Institutions: A Case of Al- Quds Open University. International Journal of Humanities and Social Science Vol. 8. No 6. 5. Drosos, D., Chalikias, M., Skordoulis, M., & Mandalenaki, M. (2016, July). The Role of Information Technology and Knowledge Management in Higher Education. In Proceedings of 2nd International Conference on Lifelong Education and Leadership for All (ICLEL 2016). Liepaja (pp. 395-403). 6. Drosos, D., Tsotsolas, N., Chalikias, M., Skordoulis, M., & Koniordos, M. (2015). A survey on the use of social networking sites in Greece. Creativity in Intelligent, Technologies and Data Science, 556-570. 7. Georgakopoulos, I., Kytagias, C., Psaromiligkos, Y. Voudouri, A. (2018). Identifying risks factors of students’ failure in e-learning systems: towards a warning system. International Journal of Decision Support Systems, Vol.3, no3. 8. Georgakopoulos, I., Chalikias, M., Zakopoulos, V., & Kossieri, E. (2020). Identifying Factors of Students’ Failure in Blended Courses by Analyzing Students’ Engagement Data. Education Sciences, 10(9), 242. 9. Filippidi, A., Tselios N., Komis V. (2010). Impact of Moodle usage practices on students’ performance in the context of a blended learning environment. Social Applications for Lifelong Learning, Patra, Greece, 4-5. 10. Fredericks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74, 59 – 109. 11. Friesen, N. (2012). Report: Defining Blended Learning. 12. Ismail, A.O., Mahmood, A.K. Abdelmaboud, A. (2018). Factors Influencing Academic Performance of Students in Blended and Traditional Domains. International Journal of Emerging Technologies in Learning, Vol. 13, No 02, p.170-187. 13. Keskin, S. and Yurdugul, H. (2019) Factors Affecting Students’ Preferences for Online and Blended Learning: Motivational Vs. Cognitive. European Journal of Open, Distance and E-Learning, Vol. 22, No 2, pp. 72-86. 14. Maccoun, H. (2016). The effect of using blended learning on the achievement of students and information retention of fifth graders in the biology course. J. Fac. Educ., 22 (95), p.209-240. 16 15. Macfadyen, L., Dawson S. (2010). Mining LMS data to develop an ‘‘early warning system” for educators: A proof of concept. Computer and Education, Vol.54, No2, p. 588-599. 16. Marks, H. M. (2000). Student engagement in instructional activity: Patterns in the elementary, middle and high school years. American Educational Research Journal, 37, 153 – 184. 17. Newmann, F. M., Wehlage, G. G., & Lamborn, S. D. (1992). The significance and sources of student engagement. In F. M. Newmann (Ed.), Student engagement and achievement in American secondary schools (pp. 11 – 39). New York: Teachers College Press. 18. Ntanos, S., Asonitou, S., Kyriakopoulos, G., Skordoulis, M., Chalikias, M., & Arabatzis, G. (2020). Environmental Sensitivity of Business School Students and Their Attitudes towards Social and Environmental Accounting. In Strategic Innovative Marketing and Tourism (pp. 195-203). Springer, Cham. 19. Owson, R., York D., Murtha S. (2013). Student perceptions and achievement in a university blended learning strategic initiative. The Internet and Higher Education. Vol. 18, p. 38-46. 20. Philadelphia Education Research Consortium (PERC) (2014). Blended learning Defining Models and Examining Conditions to Support Implementation. 21. Ramirez, A., Acosta, E., Bory R, Hernández, L.M. (2018). Factors affecting student learning performance: A causal model in higher blended education. Journal of Computer Assisted Learning, Vol. 34, No 6, p. 807-815. 22. Saritepeci, M. and Cakir, H. (2015). The Effect of Blended Learning Environments on Student Motivation and Student Engagement: A Study on Social Studies Course. Education and Science, Vol. 40, No 177, p. 203-216. 23. Skordoulis, M., Sparangis, P., Stampolis, O., Mougkolia, I., Papageorgiou, A., & Chondreli, C. (2015). A framework for quality in education: Applying quality function deployment to a higher education institute. In 10th ERA International Scientific Conferences. Egaleo, Greece. 24. Skordoulis, M., Chalikias, M., & Koniordos, M. (2014, September). Students’ satisfaction from their educational context through DREEM and LOT-R. In Joint Conference on Knowledge-Based Software Engineering (pp. 113-122). Springer, Cham. 25. Skordoulis, M., Drosos, D., & Mandalenaki, M. (2016, July). An analysis of students’ satisfaction using a multicriteria method. In Proceedings of the 2nd International Conference on Lifelong Education and Leadership for All-ICLEL, Liepaja, Latvia (pp. 21-23). 26. Skordoulis, M., Koukounaras Liagkis, M., Sidiropoulos, G., & Drosos, D. (2020). Emotional intelligence and workplace conflict resolution: The case of secondary education teachers in Greece. International Journal of Research in Education and Science, Vol. 6, No 4, p. 521-533. 27. Vernadakis, N., Giannousi, M., Derri, V., Michalopoulos, M. and Kioumourtzoglou, E. (2012). The impact of blended and traditional instruction in students’ performance. Procedia Technol., 1, p.439-443. 28. Volchok, E. (2018). Toward a Predictive Model of Community College Student Success in Blended Classes. Community College Journal of Research and Practice, 42 (4), p. 274-288. 17 29. Vose, D. (2008). Risk Analysis: A Quantitative Guide, 3rd Edition. Hoboken NJ Wiley, ISBN 978-0-470-51284-5. 30. Wang, Y.S. (2018). Effects of Using a Blended Learning Method on Students’ Achievement and Motivation to Learn English in Jordan: A Pilot Case Study. Education Research International. Volume 2018, Article ID 7425924 7pages, https://doi.org/10.1155/2018/7425924. 31. Wenchieh W., Lan-Yin Hwang, (2010). The effectiveness of e-learning for blended courses in colleges: a multi-level empirical study. International Journal of Electronic Business Management, Vol. 8, No. 4, p.312-32. 32. Willms, J. D. (2003). Student engagement at school: A sense of belonging and participation. Paris: Organisation for Economic Co-Operation and Development. 33. Wu, J. and Liu, W. (2013). An Empirical Investigation of the Critical Factors Affecting Students’ Satisfaction in EFL Blended Learning. Journal of Language Teaching and Research, Vol. 4, No. 1, p. 176-185. 34. Zapantis, G., Skordoulis, M., Chalikias, M., Drosos, D., & Papagrigoriou, A. (2017). Measuring the impact of burnout on job satisfaction and organizational commitment. In Strategic Innovative Marketing (pp. 51-55). Springer, Cham. 35. Zhang, T. J. Anderson, M. W. Ohland, and B. R. Thorndyke. (2004). Identifying factors influencing engineering student graduation: A longitudinal and cross- institutional study. Journal of Engineering Education, 93(4):313{320, 2004. 18