=Paper= {{Paper |id=Vol-3918/paper018 |storemode=property |title=Enhancing personal financial management skills through a machine learning-powered business simulator |pdfUrl=https://ceur-ws.org/Vol-3918/paper018.pdf |volume=Vol-3918 |authors=Dmytro S. Antoniuk,Tetiana A. Vakaliuk,Vladyslav V. Didkivskyi,Oleksandr Yu. Vizghalov,Oksana V. Oliinyk,Valentyn M. Yanchuk |dblpUrl=https://dblp.org/rec/conf/aredu/AntoniukVDVOY24 }} ==Enhancing personal financial management skills through a machine learning-powered business simulator== https://ceur-ws.org/Vol-3918/paper018.pdf
                         Dmytro S. Antoniuk et al. CEUR Workshop Proceedings                                                                                                   198–205


                         Enhancing personal financial management skills through a
                         machine learning-powered business simulator
                         Dmytro S. Antoniuk1 , Tetiana A. Vakaliuk1,2,3,4 , Vladyslav V. Didkivskyi1 ,
                         Oleksandr Yu. Vizghalov1 , Oksana V. Oliinyk1 and Valentyn M. Yanchuk1
                         1
                           Zhytomyr Polytechnic State University, 103 Chudnivsyka Str., Zhytomyr, 10005, Ukraine
                         2
                           Institute for Digitalisation of Education of the NAES of Ukraine, 9 M. Berlynskoho Str., Kyiv, 04060, Ukraine
                         3
                           Kryvyi Rih State Pedagogical University, 54 Universytetskyi Ave., Kryvyi Rih, 50086, Ukraine
                         4
                           Academy of Cognitive and Natural Sciences, 54 Universytetskyi Ave., Kryvyi Rih, 50086, Ukraine


                                     Abstract
                                     Effective personal financial management is a critical life skill for all individuals, irrespective of their profession.
                                     A survey conducted among university students in Ukraine revealed a lack of sufficient financial literacy and
                                     highlighted the need to incorporate personal finance education into curricula. Business simulators present a
                                     promising solution to bridge this gap. This paper introduces a novel web-based business simulator equipped
                                     with machine learning capabilities to facilitate the development of personal financial management skills. The
                                     methodology for utilising the simulator, including its content, objectives, formats, methods, and tools, is elucidated
                                     in detail. The key features and sections of the simulator are described, along with the specific personal finance
                                     management skills it aims to cultivate. To enhance the simulator’s effectiveness, elements of machine learning,
                                     particularly reinforcement learning, have been incorporated. The simulator is designed to cater to a wide
                                     audience, from school-aged children to adults, and can be integrated into economics courses at both secondary
                                     and tertiary education levels in Ukraine. The paper concludes with a discussion on the future prospects of using
                                     such simulators to develop managerial and financial competencies among students from diverse specialities.

                                      Keywords
                                      personal financial management, business simulator, machine learning, reinforcement learning, financial literacy




                         1. Introduction
                         Personal financial management is a vital skill that everyone should possess, regardless of their profession
                         or background. It involves the effective management of one’s financial resources, including income,
                         expenses, savings, investments, and debts.
                            The importance of developing personal finance competency has been widely acknowledged in
                         international research. Lusardi [1] discussed the influence of financial literacy on the well-being of
                         people worldwide and the need to recognise it as a fundamental right and universal need. Lusardi et al.
                         [2] demonstrated that 30–40% of retirement wealth inequality in the USA is associated with the level of
                         financial literacy alone. Urban et al. [3] concluded that high school financial literacy courses have a
                         significant impact on lower default rates and better credit scores.
                            The use of business simulations in education has become increasingly common, with applications
                         ranging from practical training, such as flight or combat simulations, to economic, managerial, and
                         financial domains. Researchers have studied the pedagogical significance of this technology-enhanced
                         educational method. Hernández-Lara et al. [4] concluded that business simulations have a positive
                         impact on generic competencies, while Farashahi and Tajeddin [5] confirmed their effectiveness in a
                         comparative study. The evolution of technologies has enabled the development of immersive, attractive,


                          AREdu 2024: 7th International Workshop on Augmented Reality in Education, May 14, 2024, Kryvyi Rih, Ukraine
                          " dmitry_antonyuk@yahoo.com (D. S. Antoniuk); tetianavakaliuk@gmail.com (T. A. Vakaliuk);
                          v.didkivskyi@sana-commerce.com (V. V. Didkivskyi); aleksandrvizur@gmail.com (O. Yu. Vizghalov); oov76@ukr.net
                          (O. V. Oliinyk); v.yanchuk@gmail.com (V. M. Yanchuk)
                          ~ https://acnsci.org/vakaliuk/ (T. A. Vakaliuk)
                           0000-0001-7496-3553 (D. S. Antoniuk); 0000-0001-6825-4697 (T. A. Vakaliuk); 0000-0002-4615-7578 (V. V. Didkivskyi);
                          0000-0003-0985-4929 (O. Yu. Vizghalov); 0000-0003-2188-9219 (O. V. Oliinyk); 0000-0002-6715-4667 (V. M. Yanchuk)
                                     © 2025 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).


CEUR
                  ceur-ws.org
Workshop      ISSN 1613-0073
Proceedings

                                                                                                           198
Dmytro S. Antoniuk et al. CEUR Workshop Proceedings                                                    198–205


and highly functional business simulations for various use cases, from elementary schools to lifelong
learning establishments. Korgin [6] provided evidence of the effectiveness of simulation games for
improving basic arithmetical operations literacy in children, while Palan [7] studied the criteria and
approaches for selecting business simulation software for asset market experiments in higher education.
   The analysis provides evidence of the effectiveness of using business simulations in education and the
need for further development of business simulations for economic and financial literacy development,
assessment, and the study of their behavioural aspects.
   The purpose of this article is to describe the methodology for using a business simulator with machine
learning elements to develop personal finance management skills.


2. Results
An analysis of existing simulators [8, 9] revealed that most simulation software is designed for specific
areas of finance in countries with developed financial markets. Based on these findings, this work
presents an experiment in developing a more generalised simulator for countries with less developed
financial instrument markets.
   Consequently, the authors developed a web-based business simulator [10, 11, 12] to foster personal
finance management skills. The methodology for using this simulator, which incorporates machine
learning elements, is presented in the following sections.
   The proposed methodology encompasses the purpose and content of the application, as well as the
forms, methods, and tools employed. It is focused on the expected outcome: improved personal finance
management skills through the use of a business simulator with machine learning elements.
   The purpose of using the simulator is to develop personal finance management skills, while the
content involves enhancing the teaching process of normative disciplines through its integration.
   The methodology includes two key methods for utilising the simulator:

   1. Adaptive learning. The simulator creates a game-like process, known as the examination cycle, in
      which users encounter problems corresponding to their current competence level at each stage.
      As users progress through the simulation, they gain access to new personal finance management
      tools that could not be effectively used at previous competence levels. This approach requires
      users to iteratively master increasingly complex knowledge, skills, and abilities, and apply them
      in situations resembling real-life scenarios. Users can explore previously unfamiliar tools and
      situations or those of additional interest to them, considering their life cycle stage, field of activity,
      or current problems and interests.
   2. Situational modelling. The simulator is based on realistic simulations of common and specific
      situations in personal or family finance management. It begins by modelling the creation of a
      diversified currency and financial basket storage forms, then progresses to more complex tools,
      such as credit and deposit operations with varying time parameters, payment schedules, and
      provision forms. The simulation’s realism is ensured by the presence of probabilistic events
      with positive or negative impacts of different monetary values on the user’s personal finances.
      Non-financial investment transactions are introduced as the next step in familiarising users and
      developing their competence in personal finance management.

 The main forms of conducting training sessions using the simulator within the framework of this
methodology include:

    • Introductory classes for teachers and facilitators on the simulator’s functionality, modes, features,
      analytical capabilities, and means of scientific research on the effectiveness and adaptability of
      the user competence development process;
    • Autonomous and group independent work with the simulator, aimed at both independent in-depth
      or convenient pace learning through the training and game plot, and joint learning activities of
      user groups and facilitators, with or without competitive elements;



                                                     199
Dmytro S. Antoniuk et al. CEUR Workshop Proceedings                                                198–205


    • In-depth analysis of simulator situations can take place in face-to-face or remote formats with
      individual students or groups, focusing on additional elaboration of situations, behavioural and
      psychological aspects, or financial instruments that cause difficulties, misunderstanding, or attract
      additional user interest.

   The tools for developing personal finance management skills provided in the proposed methodology
include computers, smartphones, and tablets with Internet access, the business simulator with machine
learning elements, and teaching materials.
   The expected result of the proposed methodology is the formation of personal money management
skills at a high level and the acquisition of skills to successfully apply the business simulator with
machine learning elements to perform practical work.
   Within the framework of this methodology, different forms and methods of using the simulator are
offered, such as:

    • Organisation and development of the simulator to develop personal finance management skills;
    • Sessions using the simulator to simulate socio-economic situations corresponding to the lesson
      topic;
    • Organisation of thematic economic training using the simulator;
    • Visualisation of economic and behavioural concepts;
    • Using the simulator as a means of targeted in-depth problem-based learning;
    • Using the simulator as a means of organising assessment.

  The main features of the simulator, presented in different sections (figure 1), include:

   1. Current account management options.
   2. Savings management options.
   3. Deposit management options.
   4. Credit management options.
   5. Non-financial investment management options.
   6. Information on changes in current accounts that have occurred in the last week.
   7. Analytical information on the dynamics of changes in current account funds, savings, and
      investments.
   8. Information on current exchange rates.
   9. List of recent transactions made on current accounts.

  The simulator facilitates the formation of knowledge, skills, competencies, and personal attitudes
towards:

    • Using a diversified list of currencies.
    • Forming a widely-acknowledged standard of emergency savings and assessing readiness for
      longer-term investment.
    • Using basic saving and investment instruments available in a wide range of countries, such as
      deposits (deposit certificates), real estate, and business investments, and understanding their
      specific characteristics.
    • Debt management and forming a personal behavioural attitude towards using debt as a construc-
      tive investment leverage.

   To enhance the effectiveness of the simulator, machine learning elements, particularly reinforcement
learning, have been applied. Reinforcement learning (RL) is a type of machine learning in which an
agent directly examines environmental data, receives rewards, and sets policies for optimal action
(figure 2). The goal of RL is to find the optimal policy that maximises the expected amount of future
rewards [13].



                                                   200
Dmytro S. Antoniuk et al. CEUR Workshop Proceedings                                                                                                198–205




Figure 1: Business simulator.




Figure 2: The principle of operation of the model of training with reinforcement [13].


                                                                                   (︂                                                                     )︂
     𝑛𝑒𝑤
   𝑄       (𝑆𝑡 , 𝐴𝑡 ) ← (1 −      ⏟ 𝛼⏞         ) · 𝑄(𝑆𝑡 , 𝐴𝑡 ) +      ⏟ 𝛼⏞         · 𝑅𝑡+1 +           𝛾            ·        max 𝑄(𝑆𝑡+1 , 𝑎)
                                                   ⏟   ⏞                             ⏟ ⏞             ⏟ ⏞                      𝑎
                               learning rate      current value    learning rate        reward   discount factor
                                                                                                                            ⏟     ⏞
                                                                                                                       estimate of optimal future value
                                                                                        ⏟                               ⏞
                                                                                                 new value (temporal difference target)


Figure 3: Q-learning algorithm.




                                                                       201
Dmytro S. Antoniuk et al. CEUR Workshop Proceedings                                                 198–205


   One of the algorithms used in reinforcement learning is Q-learning, which aims to learn a strategy
that informs the agent about the best action to perform in a particular state 𝑆. The algorithm contains
elements such as the reward received (𝑟𝑡 ), the learning pace (𝛼), and the depreciation ratio (𝛾) (figure 3).
   The open-source library SharpRL [14] was chosen to provide the basic functionality for developing
a reinforcement learning environment based on the Q-learning algorithm. The program for defining
personal financial strategies is a console application that involves setting certain parameters, such as
the number of simulation passes in training mode, the number of simulations in policy adherence mode
after training, the duration of the simulation in weeks, and the user’s monthly income and expenses in
a specific currency.
   Experiments were conducted to determine the optimal ratio of initial parameters, and it was found
that the best results were obtained when the number of simulation passes in both training and policy
adherence modes was close to 1000. Increasing these figures did not significantly improve the results
(figure 4).




Figure 4: Results with different number of epochs of training in the mode of adherence to the trained model.


   To test the trained model, the results of the system were compared with the average results of real
users in the developed simulator over a 54-week period. It was found that the system consistently
outperformed the average user results (figures 5, 6, 7, 8).
   The graphs depicting the reinforcement learning model results exhibit jumps, particularly when
higher incomes and a large difference between income and expenses are involved. This is due to the
specific rules described to train the model, ensuring that the virtual agent system follows the best
path. For example, if an agent opens a 3-month deposit, the deposit will be closed automatically after
this period, significantly affecting the user’s reward for that week. However, the system learns and
“understands” where to invest or save, leading to sharp increases in performance, as evident in the
graphs. Such behaviour is not observed in the graphs representing real user results, indicating users’
lack of awareness of effective personal finance management strategies within the developed simulator.




                                                    202
Dmytro S. Antoniuk et al. CEUR Workshop Proceedings                                               198–205




Figure 5: Comparison of model and user results with parameters of UAH 10,000 income and UAH 6,000 costs.




Figure 6: Comparison of model and user results with parameters of UAH 15,000 income and UAH 9,000 costs.


3. Conclusions
Economic processes are a new topic for research into the possibilities of applying the full potential
of machine learning. Scientists worldwide are making initial attempts to reproduce such processes
programmatically to use artificial intelligence to find solutions and answer various economic questions.
   The proposed developed software package consists of two parts: a personal finance management
simulator and a system for determining effective financial strategies, which utilises reinforcement
learning opportunities.
   The simulator can be used in the future to teach elements of personal finance management to people
who are not sufficiently knowledgeable in this field. Moreover, the web application can be useful even
for school-aged children, complementing the educational process within economic courses not only in
higher education institutions but also in secondary education institutions in Ukraine.
   When constructing a methodology for using a business simulator with machine learning elements to
develop personal finance management skills, it is advisable to consider various types, scopes, methods
of placement, and purposes of using business simulators. The use of a business simulator with machine
learning elements is expedient and contributes to an increase in the efficiency of the educational process,



                                                   203
Dmytro S. Antoniuk et al. CEUR Workshop Proceedings                                                                   198–205




Figure 7: Comparison of the results of the model and users with the parameters of UAH 30,000 income and
UAH 15,000 costs.




Figure 8: Comparison of the results of the model and users with the parameters of UAH 100,000 income and
UAH 30,000 costs.


the formation of personal finance management skills, and the development of a steady cognitive interest
in students’ educational activities. The application of the author’s methodology will improve and
supplement the educational process in higher education by including a business simulator with machine
learning elements.
   Additionally, prospects for further study include the selection of different simulators of this type,
the possibility of using such simulators to develop managerial and financial competencies of students
in various specialities, as well as the development of an appropriate methodology and testing its
effectiveness. In the future, the authors plan to develop guidelines for teachers on using a business
simulator with machine learning elements to develop personal finance management skills in the
educational process of higher education.
Declaration on Generative AI: During the preparation of this work, the authors used Claude 3 Opus in order to: Improve
writing style, Abstract drafting. After using this service, the authors reviewed and edited the content as needed and takes full
responsibility for the publication’s content.




                                                              204
Dmytro S. Antoniuk et al. CEUR Workshop Proceedings                                                  198–205


References
 [1] A. Lusardi, Financial literacy and the need for financial education: evidence and implications,
     Swiss Journal of Economics and Statistics 155 (2019) 1. doi:10.1186/s41937-019-0027-5.
 [2] A. Lusardi, P.-C. Michaud, O. S. Mitchell, Optimal financial knowledge and wealth inequality,
     Journal of Political Economy 125 (2017) 431–477. doi:10.1086/690950.
 [3] C. Urban, M. Schmeiser, J. M. Collins, A. Brown, The effects of high school personal financial
     education policies on financial behavior, Economics of Education Review 78 (2020) 101786.
     doi:10.1016/j.econedurev.2018.03.006.
 [4] A. B. Hernández-Lara, E. Serradell-López, À. Fitó-Bertran, Students’ perception of the impact of
     competences on learning: An analysis with business simulations, Computers in Human Behavior
     101 (2019) 311–319. doi:10.1016/j.chb.2019.07.023.
 [5] M. Farashahi, M. Tajeddin, Effectiveness of teaching methods in business education: A comparison
     study on the learning outcomes of lectures, case studies and simulations, The International Journal
     of Management Education 16 (2018) 131–142. doi:10.1016/j.ijme.2018.01.003.
 [6] N. A. Korgin, Introduction to theory of control in organizations for kids via interactive games,
     IFAC-PapersOnLine 48 (2015) 289–294. doi:10.1016/j.ifacol.2015.11.250.
 [7] S. Palan, GIMS—Software for asset market experiments, Journal of Behavioral and Experimental
     Finance 5 (2015) 1–14. doi:10.1016/j.jbef.2015.02.001.
 [8] D. Antoniuk, T. Vakaliuk, V. Yanchuk, A. Yakobchuk, Review of software tools for planning
     personal finances, in: Collection of materials of the VII All-Ukrainian Scientific and Practical
     Conference of Young Scientists "Scientific Youth-2019", Comprint, 2019, pp. 105–107.
 [9] D. Antoniuk, T. Vakaliuk, V. Didkivskyi, O. Vizghalov, The need to develop a personal finance
     management simulator, Innovative pedagogy 24 (2020) 208–212. URL: http://www.innovpedagogy.
     od.ua/archives/2020/24/part_2/43.pdf.
[10] Personal finance, 2020. URL: https://financesimulator.azurewebsites.net.
[11] D. S. Antoniuk, T. A. Vakaliuk, V. V. Didkivskyi, O. Vizghalov, Development of a simulator to
     determine personal financial strategies using machine learning, in: A. E. Kiv, S. O. Semerikov, V. N.
     Soloviev, A. M. Striuk (Eds.), Proceedings of the 4th Workshop for Young Scientists in Computer
     Science & Software Engineering, volume 3077 of CS&SESW 2021, CEUR Workshop Proceedings,
     CEUR-WS.org, 2022, pp. 12–26. URL: https://ceur-ws.org/Vol-3077/paper02.pdf.
[12] D. S. Antoniuk, T. A. Vakaliuk, V. V. Didkivskyi, O. Vizghalov, O. V. Oliinyk, V. M. Yanchuk, Using
     a business simulator with elements of machine learning to develop personal finance management
     skills, in: V. A. Ermolayev, A. E. Kiv, S. O. Semerikov, V. N. Soloviev, A. M. Striuk (Eds.), Proceedings
     of the 9th Illia O. Teplytskyi Workshop on Computer Simulation in Education (CoSinE 2021)
     co-located with 17th International Conference on ICT in Education, Research, and Industrial
     Applications: Integration, Harmonization, and Knowledge Transfer, volume 3083 of CoSinE 2021,
     CEUR Workshop Proceedings, CEUR-WS.org, 2022, pp. 59–70. URL: https://ceur-ws.org/Vol-3083/
     paper131.pdf.
[13] R. S. Sutton, A. G. Barto, Reinforcement learning: an introduction, 2nd ed., The MIT Press, Cam-
     bridge, 2015. URL: https://web.stanford.edu/class/psych209/Readings/SuttonBartoIPRLBook2ndEd.
     pdf.
[14] A. Jansson, SharpRL: Reinforcement learning library for .NET, 2015. URL: https://github.com/
     svenslaggare/SharpRL.




                                                     205