A Conceptualisation of Process Mining Impacts Azumah Mamudu Queensland University of Technology, 2 George Street, Brisbane City, QLD 4000, Australia Abstract As the process mining domain continues to see growing interest among various industry sectors globally, it is expedient to study its impact in organisations. Currently, no models or frameworks exist specifically to assess the impact of process mining. Although generic IT/ IS impact models or frameworks could be adopted, they are unlikely to cater to the contextual nuances particular to the process mining envi- ronment. This study aims to provide a clear conceptualised understanding of process mining impact and its success factors and contextual elements. The extent to which these contextual factors contribute to Process Mining impact will also be ascertained. Applying a multi-phased qualitative analysis ap- proach, secondary data from published case studies and empirical data from real-life case studies will be analysed to derive an empirically validated process mining impact model. Current research progress includes a structured literature review on Success literature and building an a priori model from the analysis of secondary case studies. Keywords Process mining success, process mining impact model, process mining impact, impact models 1. Background and Research Problem Process mining is a field of techniques that extract insights from an organisation’s information systems using readily available event logs [1, 2]. It draws from computational intelligence, data mining and process science to enhance business processes. The key capabilities of process mining techniques are their ability to automatically discover process models, monitor performance indicators, identify bottlenecks and resource constraints in a business process and assess regulatory performance [1, 3]. Several process mining tools and techniques have been developed and applied in a variety of contexts with promising results [4]. It continues to experience a growing interest in finance, software development, insurance, shared services, and many other sectors [5, 6, 3] The process mining market is estimated to continue to grow. Results from the 2021 Global Process Mining Survey of 106 IT and business executives conducted by Deloitte1 indicated that 67% of the respondents have started implementing process mining. 87% of non-adopters are planning to conduct pilot runs. 83% of organisations using process mining on a global scale intend to expand their initiatives. In all, 84% of respondents believe process mining delivers value. In 2019, Gartner2 estimated that new product license and maintenance revenue for process mining was about $320 million. It was also estimated that by 2023, the global process Proceedings of the Demonstration & Resources Track, Best BPM Dissertation Award, and Doctoral Consortium at BPM 2021 co-located with the 19th International Conference on Business Process Management, BPM 2021, Rome, Italy, September 6-10, 2021 " azumah.mamudu@hdr.qut.edu.au (A. Mamudu)  0000-0003-0897-5112 (A. Mamudu) © 2021 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). CEUR Workshop Proceedings CEUR Workshop Proceedings (CEUR-WS.org) http://ceur-ws.org ISSN 1613-0073 1 https://www2.deloitte.com/de/de/pages/finance/articles/global-process-mining-survey-2021.html 2 https://www.gartner.com/doc/reprints?id=1-24ARMY34&ct=201002&st=sb analytics market size will grow from $185 million in 2018 to $1.42 billion at a Compound Annual Growth Rate (CAGR) of 50% 3 . Considering current market trends and the attention of the BPM research community towards the applicability of process mining in organisations [7], a unique opportunity is presented to thoroughly investigate the nature of impact in the process mining domain. This forms the crust of my research. Using qualitative analysis techniques, this research seeks to conceptualise the notion of impact in process mining through empirically-derived assessment models that elaborately capture its key dimensions and contextual elements. This study proposes a definition for process mining impact as a short- or long-term outcome or series of outcomes, perceived by relevant stakeholders which is directly or indirectly attributable to the implementation and use of a process mining tool in an organisation. 1.1. Research problem and questions As process mining continues to proliferate the business environment, the evidence to support its impact and contribution to organisations is mostly anecdotal. To the best of my knowledge, apart from reports and use cases from practitioners, tool vendors and consultants [8], no empirically designed models or frameworks exist for assessing the impact of process mining outcomes in organisations. It could be argued that existing generic impact models could be used to measure impact in process mining. However, such generic models or frameworks are less likely to properly capture the unique contextual nuances that pertain to the process mining environment. This could hinder a deep appreciation of the nature of impact that process mining provides and inhibit its potential to provide optimal value as a technology investment [9]. Based on this motivation, this research seeks to propose an extensive model that identifies and evaluates process mining impact and its influencing contextual factors. To achieve this, the following research questions are posed: 1. How can the impact of process mining be conceptualised (constituents and key dimen- sions)? 2. What are the different contextual elements that can influence process mining impact? 3. How might the impact of process mining differ based on the contextual elements identified in RQ 2? 1.2. Research contribution This study is expected to make the following theoretical contributions to research. • Provide a clear conceptualised understanding of process mining impact. • Provide a synthesis of existing literature on contextual elements of process mining impact to address RQ 3 (secondary contribution). • Deliver a deep understanding of the changing nature of PM impact based on contextual elements. • Propose a set of artefacts, actionable principles and procedural guidelines for measuring the interrelationships between process mining impact and contextual factors. 3 https://research.aimultiple.com/process-mining-stats/ 2. Related Work Current success research in process mining mainly explores critical success factors for adopting process mining. A key literature on process mining success is [10]. They propose a model from theoretical and empirical foundations which identifies success factors and measures for process mining. Another relevant study focuses on the success factors for process mining adoption in organisations [3]. They explore the enabling factors and challenges for the early stages of adopting process mining tools by organisations. Elements such as speed, efficiency and compliance are identified as key success factors in [11] for achieving automation and digital transformation in process mining although their main study focus is not success factors.Two other studies by [12] and [13] touch on the impact and value realisation of process mining, but they provide no clear direction to achieving these objectives. Success research in Business Process Management (BPM), the mother-domain of process mining has been substantial, both theoretically and empirically. For instance, some BPM success models, such as by [14], extend the DeLone and McLean IS success model to test systems quality and use of BPMS applications in operational activities. Other models [15] are unique to certain industry contexts such as banking. The works by [16] and [17] propose a holistic BPM framework with detailed sub-constructs for achieving BPM success. Other such as [18] consider the contribution of organisational roles and responsibilities to BPM success initiatives while [19] empirically test how organisational characteristics such as culture can influence success factors in BPM adoption. [20] investigate success factors for the individual stages of BPM adoption. Finally, BPM critical success factors have been systematically assessed for the Public Sector [21]. In the broader area of IS, success has been an active research area for many decades [22, 23, 24, 25]. However, it is understood differently among various organisational stakeholders [24, 25]. Different scopes and measures have been used in evaluating IS success which has further complicated the understanding of the concept [22, 23]. The initial effort to unify diverse views of success in IS research was conducted by DeLone and McLean in 1992. Currently the most cited and recognised success model in IS literature, the DeLone and McLean model of IS success is a taxonomy of six dimensions which presents a unified and integrated conceptualisation of the dependant variable [26, 27]. It identifies six dimensions of IS success [22]. The DeLone and McLean IS success model has been examined by other researchers such as [28], [29] and [30] who have either re-specified, extended or studied the inter-relatedness of its dimensions with other independent variables. Gable et al. [23] re-conceptualise IS success in a formative and multi-dimensional model that provides a benchmark for monitoring IS performance based on current and anticipated net benefits from an information system as perceived by relevant stakeholders. Their 2-part four-dimensional model measures individual and organisational impact to date on one half, and uses system quality and information quality to assess probable future impacts on the other half. 3. Relation of Work to BPM State of the Art in Research From a research perspective, the strides made in process mining (a sub-domain of Business Pro- cess Management), have naturally skewed towards the technical aspects such as the developing and designing of algorithms [6, 7]. The more managerial aspects that study process mining in practice still has significant research gaps. For instance, over the years, most case studies about the application of process mining have touched on some issues relating to process mining in the organisational context, process mining methodologies, process mining success factors and process mining adoption [5, 7]. Other pertinent managerial topics relating to governance, organisational culture and enterprise integration of process mining have received little to no attention hence a call for research contributions [7] to fill some of these existing gaps. 4. Research Methodology The study will employ a multi-phased qualitative study using secondary data from published case studies and empirical data from selected multiple real life case studies. Qualitative techniques will be used to inductively derive an a priori model which will be validated using primary data from three to five case studies. Table 1 below captures a detailed representation of the research design based on the respective research questions. Research Nature of Research Research SN Research input questions enquiry methods output How can the impact - Structured Literature of process mining be - Secondary case evidence; A clear conceptualised Detailed Review; RQ1 conceptualised - In-depth case studies understanding of process investigation - Qualitative analysis (constituents (empirical) mining impact of case study data and key dimensions)? A synthesis of existing What are the different Literature on success literature on contextual contextual elements that High level Structured Literature RQ 2 factors and elements of process can influence process investigation Review process mining adoption mining impact to mining impact? address RQ 3. - A deep understanding of the changing nature of PM impact How might the impact Process mining impact based on contextual elements. of process mining differ model with extended - Qualitative analysis Detailed - Ascertain the extent to which RQ 3 based on the contextual contextual elements of case study data; investigation contextual factors contribute to elements identified (moderating and - Expert interviews Process Mining impact. in RQ2? mediating factors) - Provide a rich understanding of outputs from RQ 1 and 2. Table 1 Research Design 4.1. Research progress The research is still in its early stages. A thorough literature search has been conducted using specific success and impact related keywords to collate success and impact literature from the process mining domain. Due to limited published literature, the search was expanded to BPM and IS domains. The literature analysis outcomes were used to draft a structured literature review. Exploratory studies have been conducted by qualitatively analysing secondary data from 12 real-life best practice process mining use cases by [8]. An initial version of a conceptual model for process mining impact has been derived. The next stage involves a confirmatory analysis of the model using empirical data from in-depth case studies. 4.2. Open points and issues • Feedback on the proposed research design and associated risks pertaining to the study area. References [1] W. M. P. van der Aalst, Process Mining Data Science in Action, 2nd ed., Springer Berlin Heidelberg, Berlin, Heidelberg, 2016. doi:10.1007/978-3-662-49851-4. [2] W. M. P. van der Aalst, A. Adriansyah, A. K. A. de Medeiros, F. Arcieri, T. Baier, T. Blickle, J. C. Bose, P. van den Brand, R. Brandtjen, J. Buijs, A. Burattin, J. Carmona, M. Castel- lanos, J. Claes, J. Cook, N. Costantini, F. Curbera, E. Damiani, M. de Leoni, P. Delias, B. F. van Dongen, M. Dumas, S. Dustdar, D. Fahland, D. R. Ferreira, W. Gaaloul, F. van Geffen, S. Goel, C. Günther, A. Guzzo, P. Harmon, A. ter Hofstede, J. Hoogland, J. E. Ingvaldsen, K. Kato, R. Kuhn, A. Kumar, M. La Rosa, F. Maggi, D. Malerba, R. S. Mans, A. Manuel, M. McCreesh, P. Mello, J. Mendling, M. Montali, H. R. Motahari-Nezhad, M. zur Muehlen, J. Munoz-Gama, L. Pontieri, J. Ribeiro, A. Rozinat, H. Seguel Pérez, R. Seguel Pérez, M. Sepúlveda, J. Sinur, P. Soffer, M. Song, A. Sperduti, G. Stilo, C. Stoel, K. Swenson, M. Talamo, W. Tan, C. Turner, J. Vanthienen, G. Varvaressos, E. Ver- beek, M. Verdonk, R. Vigo, J. Wang, B. Weber, M. Weidlich, T. Weijters, L. Wen, M. Westergaard, M. Wynn, Process mining manifesto, in: F. Daniel, K. Barkaoui, S. Dustdar (Eds.), International Conference on Business Process Management 2011, vol- ume 99 of Business Process Management Workshops, Springer Berlin Heidelberg, 2011, pp. 169–194. URL: https://link.springer.com/content/pdf/10.1007%2F978-3-642-28108-2_19.pdf. doi:10.1007/978-3-642-28108-2\_19. [3] R. Syed, S. J. Leemans, R. Eden, J. A. Buijs, Process mining adoption, in: International Conference on Business Process Management, Springer, 2020, pp. 229–245. doi:doi.org/ 10.1007/978-3-030-58638-6\_14. [4] W. M. P. van der Aalst, Challenges in business process mining, Applied Stochastic Models in Business and Industry (to appear) (2010). URL: http://citeseerx.ist.psu.edu/viewdoc/ download?doi=10.1.1.669.86&rep=rep1&type=pdf. [5] F. Emamjome, R. Andrews, A. ter Hofstede, A case study lens on process mining in practice, On the Move to Meaningful Internet Systems: Otm 2019 Conferences 11877 (2019) 127–145. URL: ://WOS:000577978000008. doi:10.1007/978-3-030-33246-4\_8. [6] T. Grisold, J. Mendling, M. Otto, J. vom Brocke, Adoption, use and management of process mining in practice, Business Process Management Journal 27 (2020) 369–387. URL: ://WOS:000595135100001. doi:10.1108/Bpmj-03-2020-0112. [7] J. vom Brocke, M. Jans, J. Mendling, H. A. Reijers, Call for papers, issue 5/2021, Busi- ness & Information Systems Engineering 62 (2020) 185–187. URL: https://doi.org/10.1007/ s12599-020-00630-7. doi:10.1007/s12599-020-00630-7. [8] L. Reinkemeyer, Process Mining in Action, Springer, Switzerland, 2020. doi:https://doi. org/10.1007/978-3-030-40172-6. [9] W. H. DeLone, E. R. McLean, The delone and mclean model of information systems success: a ten-year update, Journal of management information systems 19 (2003) 9–30. [10] R. Mans, H. Reijers, H. Berends, W. Bandara, R. Prince, Business process mining success, in: 21st European Conference on Information Systems, 2013. [11] J. Geyer-Klingeberg, J. Nakladal, F. Baldauf, F. Veit, Process mining and robotic process automation: A perfect match, in: 16th International Conference on Busi- ness Process Management, 2018, pp. 124–131. URL: https://www.researchgate. net/profile/Jerome_Geyer-Klingeberg/publication/326466901_Process_Mining_and_ Robotic_Process_Automation_A_Perfect_Match/links/5b4f787ea6fdcc8dae2b378c/ Process-Mining-and-Robotic-Process-Automation-A-Perfect-Match.pdf. [12] S. Decker, Data-driven business process improvement: An illustrative case study about the impacts and success factors of business process mining, Thesis, Jönköping In- ternational Business School, 2019. URL: https://www.diva-portal.org/smash/get/diva2: 1319791/FULLTEXT01.pdf. [13] J. Eggers, A. Hein, Turning big data into value: A literature review on business value realization from process mining, in: ECIS, 2020. [14] S. Poelmans, H. A. Reijers, J. Recker, Investigating the success of operational business process management systems, Information Technology and Management 14 (2013) 295– 314. URL: https://link.springer.com/content/pdf/10.1007/s10799-013-0167-8.pdf. doi:10. 1007/s10799-013-0167-8. [15] G. Thompson, L. F. Seymour, B. O’Donovan, Towards a BPM Success Model: An Analysis in South African Financial Services Organisations, Lecture Notes in Business Information Processing, Springer, 2009, pp. 1–13. URL: https://link.springer.com/content/pdf/10.1007% 2F978-3-642-01862-6_1.pdf. doi:10.1007/978-3-642-01862-6\_1. [16] A. Alibabaei, W. Bandara, M. Aghdasi, Means of achieving business process management success factors, in: 4th Mediterranean Conference on Information Systems, 2009. URL: https://eprints.qut.edu.au/30074/1/c30074.pdf. [17] A. Z. Dabaghkashani, B. N. Hajiheydari, C. M. Haghighinasab, A success model for business process management implementation, International Journal of Information and Electronics Engineering 2 (2010) 725–729. [18] Y. L. Antonucci, R. J. Goeke, Identification of appropriate responsibilities and positions for business process management success, Business Process Management Journal 17 (2011) 127–146. doi:10.1108/14637151111105616. [19] B. Hribar, J. Mendling, The correlation of organizational culture and success of bpm adoption, in: 22nd European Conference on Information Systems (ECIS) 2014, 2014. URL: https://aisel.aisnet.org/ecis2014/proceedings/track06/2/. [20] B. Buh, A. Kovačič, M. Indihar Štemberger, Critical success factors for different stages of business process management adoption – a case study, Economic Research-Ekonomska Istraživanja 28 (2015) 243–258. URL: https://doi.org/10.1080/1331677X.2015.1041776https: //www.tandfonline.com/doi/pdf/10.1080/1331677X.2015.1041776?needAccess=true. doi:10. 1080/1331677x.2015.1041776. [21] R. Syed, W. Bandara, E. French, G. Stewart, Getting it right! critical success factors of bpm in the public sector: A systematic literature review, Australasian Journal of Information Sys- tems 22 (2018). URL: https://journal.acs.org.au/index.php/ajis/article/view/1265/805https:// journal.acs.org.au/index.php/ajis/article/download/1265/805. doi:10.3127/ajis.v22i0. 1265. [22] W. H. DeLone, E. R. McLean, Information systems success: The quest for the dependent variable, Information systems research 3 (1992) 60–95. [23] G. G. Gable, D. Sedera, T. Chan, Re-conceptualizing information system success: The is-impact measurement model, Journal of the association for information systems 9 (2008) 18. URL: ://WOS:000259702000001. [24] T. D. Nguyen, T. M. Nguyen, T. H. Cao, Information systems success: A litera- ture review, in: Future Data and Security Engineering. FDSE 2015, volume vol 9446 of Future Data and Security Engineering, Springer International Publishing, 2015, pp. 242–256. URL: https://link.springer.com/content/pdf/10.1007%2F978-3-319-26135-5_18.pdf. doi:10.1007/978-3-319-26135-5\_18. [25] S. Petter, W. DeLone, E. R. McLean, Information systems success: The quest for the independent variables, Journal of Management Information Systems 29 (2014) 7–62. URL: https://www.tandfonline.com/doi/abs/10.2753/MIS0742-1222290401. doi:10.2753/ mis0742-1222290401. [26] S. Dörr, S. Walther, T. Eymann, Information systems success-a quantitative literature review and comparison, in: 11th International Conference on Wirtschaftsinformatik, Leipzich, 2013, pp. 1813–1827. URL: https://core.ac.uk/download/pdf/226102862.pdf#page=889. [27] M. Tate, D. Sedera, E. McLean, A. Burton-Jones, Information systems success research: The “20-year update?” panel report from pacis, 2011, Communications of the Association for Information Systems 34 (2014) 63. [28] P. B. Seddon, A respecification and extension of the delone and mclean model of is success, Information Systems Research 8 (1997) 240–253. URL: http://www.jstor.org/stable/ 23010940. [29] A. Rai, S. S. Lang, R. B. Welker, Assessing the validity of is success models: An empirical test and theoretical analysis, Information systems research 13 (2002) 50–69. URL: https: //pubsonline.informs.org/doi/abs/10.1287/isre.13.1.50.96. doi:10.1287/isre.13.1.50. 96. [30] R. Sabherwal, A. Jeyaraj, C. Chowa, Information system success: Individual and organiza- tional determinants, Management Science 52 (2006). URL: https://www.jstor.org/stable/ 20110659. doi:10.1287/mnsc.l060.0583.