=Paper=
{{Paper
|id=Vol-2359/paper5
|storemode=property
|title=Investigating the effects of gamifying homework on students’ perceived satisfaction, behavioral intention and intrinsic motivation
|pdfUrl=https://ceur-ws.org/Vol-2359/paper5.pdf
|volume=Vol-2359
|authors=Ahmed Hosny Saleh Metwally,Ahmed Mohamed Fahmy Yousef,Wang Yining
|dblpUrl=https://dblp.org/rec/conf/gamifin/MetwallyYW19
}}
==Investigating the effects of gamifying homework on students’ perceived satisfaction, behavioral intention and intrinsic motivation==
https://ceur-ws.org/Vol-2359/paper5.pdf
Investigating the effects of gamifying homework on
students’ perceived satisfaction, behavioral intention and
intrinsic motivation
Ahmed Hosny Saleh Metwally1* [0000-0002-9545-5870]; Ahmed Mohamed Fahmy Yousef2
[0000-0003-0522-0734]
and Wang Yining3
1
School of Information Science and Technology, Northeast Normal University, Changchun,
China, ahmed_hosny@nenu.edu.cn
2
Faculty of Specific Education, Educational Technology Department, Fayoum University,
Egypt, ahmed.fahmy@fayoum.edu.eg
3
School of Media Science, Northeast Normal University, Changchun, China,
Wangyn814@nenu.edu.cn
Abstract. Gamification initiatives in learning contexts acknowledge that massive
numbers of students play video games. Gamification in education, therefore, is
based on introducing models to enhance psychological aspects within learning
processes. These models come from the internal motivations, such as the human
natural predisposition to learn, the desire for improvement, the desire to
overcome obstacles and win, or the fun aspect that students find it in social
relationships. The objectives of this study are examining the following research
questions: a) What are the students’ levels of satisfaction after using a gamified
homework app (Pomawin)? b) what are students’ attitudes and their behavioral
intention towards gamifying homework? and c) how does implementing
Pomawin for homework correction plan effect students’ intrinsic motivation?
The data has been collected and statistically analyzed from 53 primary school
children at fifth grade (23 boys, 30 girls) after they achieved their homework by
using Pomawin. The results of this study indicate that gamification can be used
as an educational tool to improve student’s satisfaction, behavioral intention and
intrinsic motivation.
Keywords: Gamification, Homework, Behavioral Intention, Motivation.
1 Introduction
There is a growing body of literature that recognizes the importance of gamification of
learning, especially in smart learning environments to motivate students learning
process. Gamification is a learning approach that utilizing gameful design into the
educational-professional field in order to absorb knowledge, improve some ability to
reward concrete actions, and increase the engagement [1,2]. Gamification has many
Both authors contributed equally to this study as co-first authors.
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 47
features that make it powerful vehicles for students learning. One of the main keys
when applying it is that the students have perfectly assimilated the dynamics of the
game that will be carried out. Moreover, it promotes communication, cooperation, and
even competition amongst students [3].
The gamification in education is therefore based on introducing models to enhance
psychological aspects within learning processes. These models come from the internal
motivations, such as the human natural predisposition to learn, the desire for
improvement, the desire to overcome obstacles and win, or the fun aspect that students
find it in social relationships. But it also takes aspects of external motivation to maintain
the participation of students in these learning processes, such as rewards, challenges,
incentives or public recognition.
How can we gamify education in our classrooms? This question has occupied the
minds of researchers for a while. Educators have tested this research question and have
seen positive results. However, these results should be taken into consideration with
caution [4,5]. Furthermore, these efforts have stepped slowly toward developing
methods to design gamified services and systems [6]. Thus, promoting a new forms of
research consequences and results which maximize the benefits of design research are
desirable matter [7].
1.1 Research Motivation
The concept of homework is one of the most controversial issues in education today,
particularly in primary schools. Due to the limited amount of time in the classroom to
cover everything on the intended learning subject, teachers assigned some homework
for their students to be completed outside the class time. However, there is increasing
concern that homework inserts students under a lot of pressure and if they spend their
free time on doing homework, they miss out on chances to go outside and play and have
fun.
On one hand, Galloway, Conner & Pope [8] surveyed 4,317 students, and pointed
out that most of those surveyed spend more than 3 hours on daily homework. Almost
two-thirds of the participants (72%) considered homework a primary source of stress,
and 82% reported physical symptoms. The students slept an average of 6 hours 48
minutes, lower than the recommendations prescribed by various health agencies. On
the other hand, children are digital natives and offering alternatives to traditional
homework assignments is an urgent need. Gamification apps can be a great resource
for visual examples and games that help children to practice concepts they are
struggling with. Thus, the specific objective of this study is how to gamify homework
by shaping the game around assignment context. Some systems have implemented
attributing points and giving out badges to students when they reach a certain number
[9].
Recent evidence suggests that using a wide spread from points, leaderboards, direct
competitions and stickers or badges, to other game design aspects with respecting to
motivation, participation as the main concern of gamification [7]. Challenge established
through the game seems to be a prior for engagement and crucial for learning through
the game [10]. Butler and Bodnar [11] draw our attention to that, gamification has an
impartial effect on students’ academic motivation towards homework, however,
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 48
gamification platform had a positive impact on student motivation which concerned
with student’s capability to dominate their education and receiving continued feedback
on their homework. The current study examines the following research questions: a)
What are the students’ levels of satisfaction after using a gamified app (Pomawin)? b)
what are students’ attitudes and their behavioral intention towards gamifying
homework? and c) how does implementing Pomawin for homework correction plan
effect students’ intrinsic motivation?
2 Method
Research-based design process was adopted to replicate the students’ learning effects
in this study. The research-based design process is proposed by Teemu Leinonen
inspired by design theories [12]. The purpose of this approach is to generate new ideas
and frameworks for conceptualizing learning towards building of prototypes and it
emphasizes creative human computer interaction, exploration of various design
concepts, continuous usability testing and redesign of the developing applications. The
phases of this research design are as follows: contextual inquiry, participatory design
sessions, design prototype, and case study as illustrated in figure 1.
Fig. 1. Research design.
3 Contextual Inquiry
Experience points (XP), leaderboards, badges, levels, achievements, progress bars, and
awards have been used as a gamification mechanics in a gamified homework portal for
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 49
students which implemented quests to be achieved with unlimited number of attempts,
so they were awarded based on the quality of their work [11]. Another study shows that
rising the engagement and positive feedback of students when they achieved a gamified
assignment and tasks to be presented like a game in web development, while this study
uses points, levels, progress bar, immediate feedback as game elements [13].
In order to gamify homework, the authors have to achieve some contextual inquiries
which can be presented in the following items: selecting the educational course, grade,
and unit; framing the types of homework assignment; formulating different kinds of
questions which cover different parts and skills in the unit; planning for gamification
scenario and mechanics. Moreover, we gathered some applications from app stores to
find out if we can use it for gamifying homework.
4 Participatory Design
In this phase, the study considered to inspect closely the children’s opinions and the
obstacles with achieving their homework. So, the study surveyed 11 fifth grade primary
school children (6 boys and 5 girls) on their difficulties with homework through an
interactive workshop. The authors found that they feel bored while doing the home-
work, and it is not an important matter to be done. They pointed out to some issues
related to the homework in English course; unit five; so, the authors selected the Eng-
lish course “Time for English” for the fifth grade of the primary education, the first
semester of the academic year 2018-2019. The authors also held an interview with Eng-
lish teachers with good knowledge of using technology to determine the unit assign-
ment and different kinds of questions of unit five “At the Food Festival”.
5 Pomawin design
In this section, after fulfilling the last procedures for designing, the next step is devel-
oping the software “Pomawin” as summarized in figure 2.
Fig. 2. Visual Representation of the Pomawin Design.
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 50
In this design phase, the authors follow the cognitive theory of multimedia learning by
Mayer [14] who presents principles to guide designers of learning technologies to re-
consider how students get engage with the learning material without the traditional pa-
per-based methods as shown in figure 3.
Fig. 3. Visual Representation of the Cognitive Theory of Multimedia Learning.
In the light of the cognitive theory, we designed a gamification scenario to present the
homework with a gamification interface and game elements. We assigned the home-
work in four levels, each level could include tasks, competitions, quizzes, challenges,
rewards, feedback and game like. We used different components of gamification such
as; points, badges, achievements, gifting, countdown timer, and progress bar. Providing
multimedia resources is very important to be embedded in the homework. Based on
gamification scenario we developed the homework with gamification elements. We ac-
complished basic tests to make sure there are not technical mistakes that will appear
while using as shown in Figure 4. We collected the feedback of users and English
teacher then, we edited some items upon their feedback.
Fig. 4. Some screenshot form Pomawin.
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 51
6 Case Study
In this study, the sample consisted of 53 primary school children at fifth grade (23 boys,
30 girls). Convenience sampling was applied because the primary school were selected
according to accessibility and willingness to participate.
6.1 Data Collection
The following part of this paper moves on to describe in greater detail the quantitative
and qualitative data from students’ experience in this homework session. The Evalua-
tion methodology falls under three headings: (1) application usability; (2) behavioral
intention evaluation; and (3) children motivation.
Application Usability
The first question in this study sought to determine the students’ levels of satisfaction
after using Pomawin. The System Usability Scale (SUS) invented by Brooke [15] is a
simple, ten-item attitude Likert scale from Strongly agree to Strongly disagree for
measuring the systems usability. This study used this questionnaire as a general usabil-
ity evaluation for the Pomawin application. The total number of completed responses
for this questionnaire was 53 collected over a period of two weeks. The table below
illustrates the summary of the SUS usability evaluation.
Table 1. Usability Evaluation of Pomawin application.
System Usability Scale (N=53)
(1) strongly disagree and (5) strongly agree
NO Item M
1 I think that I would like to use this system frequently 4.6
2 I found the system unnecessarily complex 1.5
3 I thought the system was easy to use 4.4
4 I think that I would need the support of a technical person to be able to 3.6
use this system
5 I found the various functions in this system were well integrated 4.2
6 I thought there was too much inconsistency in this system 1.9
7 I would imagine that most people would learn to use this system very 4.7
quickly
8 I found the system very cumbersome to use 1.4
9 I felt very confident using the system 4.5
10 I needed to learn a lot of things before I could get going with this system 1.8
Sum 32.6
M= Mean; N = number of completed responses.
The overall value of SUS = 81.50
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 52
Simple statistical analysis was used to calculate the SUS score, first sum the score con-
tributions from each item. Each item's score contribution will range from 0 to 4. For
items 1,3,5,7, and 9 the score contribution is the scale position (0) for strongly disagree
and (4) for strongly agree. For items 2,4,6,8 and 10, the contribution is (4) for strongly
disagree and (0) for strongly agree. Multiply the sum of the scores by 2.5 to obtain the
overall value of SUS [15].
The overall value of SUS score from the questionnaires was 81.50, which reflects
that “Everything is well, and the children are pleased with the application and will rec-
ommend it to their friends” Currently there is no need to make changes to the software
in regards of usability. Figure 5 provides an interpreting of SUS score.
Fig. 5. The overall value of SUS = 81.50
Behavioral Intention
The second question in this study was what students’ attitudes and their behavioral in-
tention towards gamifying homework? To measure attitude and behavioral intention,
we developed a form according to Giannakos [16], who administered a survey assessing
enjoyment and happiness. For happiness, a single visual scale ranging from very happy
(5) to very unhappy (1) was offered to students to describe how they felt about doing
homework with the Pomawin as presented in figure 6.
Fig. 6. Emoticons used in the survey to measure students’ happiness using Pomawin.
In this study, students’ happiness when using Pomawin were determined by a 5-point
Likert scale (5) very happy, (1) very unhappy. Most of them reported feeling very happy
(M 4.41, SD 5.951) as shown in Figure 7. A possible explanation for this might be that
achievements and levels are common gamification mechanics which have been applied
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 53
in online homework system and made the students enthusiasm to achieve the assign-
ment with possibility to try unlimited numbers to solve the homework problems [17].
Fig. 7. Students’ self-reported happiness level after doing homework using Pomawin.
In this study, to assess students’ enjoyment of Pomawin, a 3-point ordinal scale was
used. Giannakos [16] and Venkatesh [18] used the same items in their studies to deter-
mine the degree to which Pomawin were perceived to be enjoyable. Cronbach’s alpha
for the attitude form was 0.86.
Table2. Enjoyment items (N = 53).
No Item Yes Neutral No
1 Doing homework is more interesting using Pomawin 44 5 4
2 Doing homework with Pomawin games is funny 42 7 4
3 I like using Pomawin for doing my homework 46 4 3
4 I think I will learn something in the next six months with 45 5 3
Pomawin
In this study, students’ enjoyment of Pomawin was determined by an ordinal scale (“I
agree,” “Neutral,” “Disagree”). One interesting finding is that all students enjoyed the
activity (M = 2.82, SD = 0.553). They found that the Pomawin interesting (M = 2.85,
SD = 0.443) and fun (M = 2.76, SD = 0.253) and stated that “I like using it” (M = 2.96,
SD = 0.253) and “I think I will learn something in the next six months with Pomawin”
(M= 2.84, SD = 0.519). It refers to the positive impact of gamification on perceived
enjoyment [19]. Below are comments made by parents on our trial with a group of
students.
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 54
Parent A
“I was very surprised when I saw my child doing the homework without
difficulty. I let him do his homework independently and he says that he
enjoyed it and it was fun.”
Parent B
“I was very happy when I saw my son enjoying the time to do homework
with Pomawin and it was fun for him.”
Intrinsic Motivation
Motivation is one's direction to behavior. In fact, there is a set of forces that act behind
the motives. The present study was designed to explore the relationship between stu-
dents’ motivation for learning when engaging with gamification activities during the
homework time. In order to assess the motivation considering the attention, relevance,
confidence and satisfaction dimensions, the Instructional Materials Motivation Survey
(IMMS) [20] was conducted based on the ARCS motivation model [21]. Data for per-
ceived motivation were collected with 5 points Likert scale questionnaires and the re-
sults are summarized in table 3.
Table 3. Results of the IMMS instrument applied for each dimension of the ARCS model
M SD
Motivation Dimensions
Attention 3.79 0.81
Relevance 4.13 0.94
Confidence 4.31 0.61
Satisfaction 4.40 0.87
In general, it seems that the results are promising since they indicate a positive impact
on all four dimensions. Relevance (M=4.13; SD=0.94) and satisfaction (M=4.40;
SD=0.87) dimensions rated better than the other two. One of the most important factors
to empower and engage learners around the world to participate in learning activities is
attention [21]. In this study, there was a significant improvement of students’ attention
during achieving their gamified homework. Using gamification elements like points,
levels, badges can help students positively to engage and achieve online homework
[22]. This finding broadly supports the work of other studies in this area linking gami-
fication with doing homework. These factors may explain the relatively good correla-
tion between the cognitive theory of multimedia learning and gamification design. On
one hand, gamification design principles including providing coherent verbal, pictorial
information, guiding the learners to select relevant words and images, and reducing the
load for a single processing channel etc. [14].
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 55
Conclusion
In recent times, the massive reach that the use of the Internet, social networks and video-
games have had led specialists in social sciences, psychology, and technologies to look
for entertaining ways to use these forms together. Pomawin is a new homework app
that is designed to make it easier than ever for parents to motivate their children to finish
their assignments on time. Pomawin includes points, leaderboards, direct competitions
and stickers or badges, levels to motivate learners and facilitate learning. In this study,
attitudes towards Pomawin were analyzed to examine the correlation between gamify-
ing homework and increasing student’s enjoyment and motivation. Results showed that
the students were satisfied with the Pomawin, were happy while using this application
during their homework time. In accordance with these findings, we make some recom-
mendations of the potential benefits of successful gamification initiatives in the class-
room including:
Gamification should give students the freedom to fail and try again without
negative repercussions.
Inspiring students to discover intrinsic motivators for learning.
The relationship between enjoyment and homework achievement should be
explored in future researches.
Developing the affordances of immersion like avatar, virtual world, the 3D
world in gamified homework software.
Expand investigating the psychological and behavioral outcomes in gami-
fying homework to include social interaction and performance.
Future research in gamification of education should concern more on dif-
ferent affordances when applying them and extend the scope of affordances
in the context of education.
Examining the effectiveness of implementing immersive technologies with
gamification in education.
Children perceive Pomawin as “fun” and enjoy human‐like interaction.
References
1. Huotari, K., & Hamari, J. (2017). A definition for gamification: anchoring gamification in
the service marketing literature. Electronic Markets, 27(1), 21-31.
2. da Rocha Seixas, L., Gomes, A. S., & de Melo Filho, I. J. (2016). Effectiveness of gamifi-
cation in the engagement of students. Computers in Human Behavior, 58, 48-63.
3. Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A
systematic mapping study. Journal of Educational Technology & Society, 18(3).
4. Majuri, J., Koivisto, J., Hamari, J., Group, G., Group, G., & Group, G. (2018, May). Gami-
fication of education and learning: A review of empirical literature. In the 2nd International
GamiFIN Conference (pp. 11–19). Pori, Finland.
5. Hamari, J., Koivisto, J., & Sarsa, H. (2014, January). Does Gamification Work? — A Liter-
ature Review of Empirical Studies on Gamification. In proceedings of the 47th Hawaii In-
ternational Conference on System Sciences (HICSS) (pp. 3025-3034). IEEE. Hawaii, USA.
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 56
6. Rapp, A., Hopfgartner, F., Hamari, J., Linehan, C., & Cena, F. (2018). Strengthening gami-
fication studies: Current trends and future opportunities of gamification research. Interna-
tional Journal of Human-Computer Studies. https://doi.org/10.1016/j.ijhcs.2018.11.007
7. Nacke, L., & Deterding, S. (2017). The maturing of gamification research. Computers in
Human Behavior, 71, 450–454. https://doi.org/10.1016/j.chb.2016.11.062
8. Galloway, M., Conner, J., & Pope, D. (2013). Nonacademic effects of homework in privi-
leged, high-performing high schools. The journal of experimental education, 81(4), 490-
510.
9. Sheldon, L. (2011). The multiplayer classroom: Designing coursework as a game. Cengage
Learning.
10. Hamari, J., Shernoff, D. J., Rowe, E., Coller, B., Asbell-clarke, J., & Edwards, T. (2016).
Challenging games help students learn: An empirical study on engagement, flow and im-
mersion in game-based learning. Computers in Human Behavior, 54, 170–179.
https://doi.org/10.1016/j.chb.2015.07.045
11. Butler, B. L., & Bodnar, C. A. (2017, June). Establishing the Impact that Gamified Home-
work Portals Can Have on Students’ Academic Motivation Establishing the Impact Gami-
fied Homework Portals Can Have on Students’ Academic Motivation. In 2017 ASEE Annual
Conference & Exposition. Columbus, Ohio. Retrieved from https://peer.asee.org/28295
12. Leinonen, T. (2010). Designing learning tools: Methodological insights. Espoo: Aalto Uni-
versity.
13. Pastushenko, O., Hruška, T., & Zendulka, J. (2018, October). Increasing students’ motiva-
tion by using virtual learning environments based on gamification mechanics: Implementa-
tion and evaluation of gamified assignments for students. In Proceedings of the Sixth Inter-
national Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM
2018) (pp. 755-760). ACM.
14. Mayer, R. E. (2002). Multimedia learning. In Psychology of learning and motivation, 41,
pp. 85–13. Academic Press.
15. Brooke, J. (1996). SUS-A quick and dirty usability scale. Usability evaluation in industry,
189(194), 4-7.
16. Giannakos, M. N. (2013). Enjoy and learn with educational games: Examining factors af-
fecting learning performance. Computers & Education, 68, 429-439.
17. Goehle, G. (2013). Gamification and Web-based Homework. PRIMUS: Problems, Re-
sources, and Issues in Mathematics Undergraduate Studies, 23(3), 234–246.
https://doi.org/10.1080/10511970.2012.736451
18. Venkatesh, V. (2000). Determinants of perceived ease of use: Integrating control, intrinsic
motivation, and emotion into the technology acceptance model. Information systems re-
search, 11(4), 342-365.
19. Fitz-Walter, Z., Johnson, D., Wyeth, P., Tjondronegoro, D., & Scott-Parker, B. (2017).
Driven to drive? Investigating the effect of gamification on learner driver behavior, per-
ceived motivation and user experience. Computers in Human Behavior, 71, 586-595.
20. Keller, J. M. (2009). Motivational design for learning and performance: The ARCS model
approach. Springer Science & Business Media.
21. Keller, J. M. (1987). IMMS: Instructional materials motivation survey. Florida State Uni-
versity.
22. Goehle, G., & Wagaman, J. (2016). The Impact of Gamification in Web Based Homework.
PRIMUS: Problems, Resources, and Issues in Mathematics Undergraduate Stud-
ies, 26(6), 557-569.
GamiFIN Conference 2019, Levi, Finland, April 8-10, 2019 57