‫ﯾﺎھﻮ‬ Cost Benefit Analysis in Product Configuration Systems Sara Shafiee1 and Alexander Felfernig and Lars Hvam and Poorang Piroozfar and Cipriano Forza Abstract.1Companies’ reports indicate a mixture of success and can be forecasted. Aiming to investigate these effects, the failure in Product Configuration Systems (PCS) projects. following propositions were developed: Moreover, the attention paid to PCS across different industries is Proposition 1. The higher the number of users in PCSs, the increasing. Therefore, more studies are needed to analyze risks, higher Return on Investment (ROI) and cost-benefits. costs, and benefits of PCS. This paper uses real case projects to Proposition 2. The higher the complexity in PCSs, the higher demonstrate the cost-benefit analysis of PCSs in real industrial setups. Hence, this article quantifies savings in terms of reduced ROI and cost-benefits. working hours, and the cost implications with reference to Firstly, we calculate the cost of three different projects during development, implementation, and maintenance. The study fills the their last four years. Secondly, we calculate the cost-benefits gap in previous research by addressing what the influence of other during the last four years. In this research, we focus on the saved factors on gained cost-benefits from PCSs are likely to be. This man-hours in calculating the ROI on multiple case projects in one study aims to explain why some PCS projects are more cost- case company, while investigating different factors influencing the effective than the others. While there are a number of factors ROI. Then, the data related to the number of users in the last year affecting the cost-benefit analysis in PCS, the focus of this study and the complexity of PCSs is retrieved. Finally, based on the remains mainly on the number of users and complexity of the knowledge in the literature and our research propositions, we project. The comparison in the case studies revealed that both demonstrate the results using graphs and discuss the findings. factors have a positive direct correlation with the gained cost- benefits from PCSs. 2 LITERATURE STUDY 1 INTRODUCTION In this section, the relevant literatures for calculating the PCS cost- benefits and PCS complexity are reviewed which will then be Product Configuration Systems (PCS) enable companies to develop utilized for calculating the ROI and PCS complexity in the cases of product alternatives to facilitate sales and production processes [1]. this study. This is achieved through incorporating information about product features, product structure, production processes, costs and prices [2]. PCSs support decision-making processes in the engineering 2.1 Cost benefit analysis for PCS and sales phases of a product, which can determine the most The results from the literature review shows that by utilizing PCS important decisions regarding product features and cost [3]. PCSs reduced man-hours and lead-time for generating the specifications affect the company’s ability to increase the accuracy of the cost is acknowledged in numerous previous research [5], [11]–[28]. calculations in the sales phase and consequently increases the Forza et al. [17] demonstrate a reduction in man-hour from 5-6 products’ profitability in sales and engineering process [2]. days to only 1 day through using PCS. Haug et al. [18] elaborate on PCSs can bring substantial benefits to companies such as, how man-hours in the configuration process can be reduced by up shorter lead time for generating quotations, fewer errors, increased to 78.4%. Moreover, Hvam et al.’s [25] study indicates that after ability to meet customers’ requirements regarding product utilization of PCS at the case company, the lead time required to functionality, use of fewer resources, optimized product designs, generate an offer was reduced by 94–99%. The reduction can be less routine work and improved on-time delivery [2], [4]–[6]. traced to automation of routine tasks and elimination of the Although advantages of PCSs are evident, there are still some iterative loops between domain experts, as PCS makes all product difficulties associated with high cost [2], [7] and considerable knowledge available [29]. chances of failure [8] in their implementation projects. Several researches have quantified the benefits of PCS in terms The aim of this paper is to evaluate the influence of different of reduced man-hours, lead-time and improved the quality of factors on the gained cost-benefits of PCS such as employees’ product specifications. However, none of the researchers have experiences and organizational culture [9][10]. More specifically, investigated the factors which are influencing the cost-benefit the objective of the paper is to evaluate the influence of the two analysis and why some of the PCS projects are more cost effective factors on the cost-benefits gained from different PCS projects: (1) than the others. In this research, we focus on the saved man-hours number of users and (2) complexity. This study also sets out to find which is a simple and quantified indicator to calculate the ROI to out why some PCSs are more beneficial than the other PCS fill a knowledge gap in the literature. projects and how the profitability of the PCS projects in the future Discussions concerning the unpredicted costs of PCS projects indicate that the rough estimates involved in cost analysis are 1 Mechanical Engineering Department, Technical University of Denmark, considered a challenge that needs more attention from academia Denmark, email: sashaf@dtu.dk [30]. The financial benefits of PCS projects should be clear from ‫ﯾﺎھﻮ‬ the beginning, and cost evaluation is important from the initiation differences for the selected factors (number of users and phase. Cost-benefit analysis is used to compare the expected costs complexity); the similar users (engineers); Almost the same rate for and benefits for different scenarios and the results from a variety of the using configurators (number of generated quotes); the same IT actions [31]. ROI, which is commonly used as a cost-benefit ratio, team and the involvement of similar tasks during development and is a performance measure used to evaluate the efficiency of a maintenance; similar setup of the knowledge; similar software and number of different investments [32], and has been used to integrations. determine the profitability of PCS projects [10]. The analysis has been performed during the last 4 years at the case company which allows us to benefit from the strength of using multiple case study method [35], [36]. Furthermore, case studies 2.2 Complexity analysis for PCS provide researchers with a deeper understanding of the relations To measure the complexity of PCS, Brown et al. [33] categorize among the variables and phenomena that are not fully examined or them into three major components; 1) execution complexity, 2) understood thus far [37], for instance, the factors with an impact on parameter complexity, and 3) memory complexity. Execution the cost-benefits from PCS projects. There are multiple data complexity covers the complexity involved in performing the sources such as archived documents and triangulated observations. configuration actions that make up the configuration procedure while the memory complexity refers to the number of parameters 4 CASE STUDIES that system manager must remember. In this paper, the parameter complexity is the most important category, as it measures the The company selected as the case study produces highly complexity involved in the knowledge that domain expert provides engineered products and technology. The market environment is during the creation of the configuration model [33]. Therefore, we highly competitive, and thus delivery time and costs are critical. assess the parameter complexity in terms of two major parameters The main motivation for implementing the PCS was to reduce the inside the PCS: attributes and constraints (Table 1). time required to respond to customer inquiries in order to increase the company’s overall competitiveness. Hence, in this study the Table 1. Complexity assessment in terms of parameters in PCS [34] focus is on lead-time reduction that leads to reduction in resources No. attributes No. constraints at the company and directly affects the cost implications. Low complexity 500 - 1300 200-800 Three selected projects from three different departments with Medium complexity 1300-2000 800-1200 different number of users and complexities were selected. All three High complexity >2000 >1200 projects are comparable as (1) they all are selected from one case company, (2) they are highly engineered-to-order and complex products, (3) they have been in use during the last 4 years to 3 RESEARCH METHOD support sales processes, (4) they have totally different cost-benefits The relevant literature was reviewed to clarify the present study’s results, and (5) they have are different in terms of complexity and position in relation to existing research. This allowed us not only to numbers of users. Table 2 demonstrates the data related to three ascertain whether this research has the potential to add to the selected sales (commercial) PCS projects. The number of users existing knowledge but also to identify which parts of the available refers to the sum of the personnel at the company who are using the knowledge are relevant to this study’s scope. system (e.g. in Case 1, 50 users constantly use the system). The Cost-benefit analysis has been performed in different research complexity in this research is relatively studied and different areas by calculating the saved man-hours, increased sales, complexities in different projects is compared. improved quality and reduction in errors and defects. To date, there is no research to investigate the factors influencing cost-benefits in Table 2. Number of users and complexity per project PCSs and to answer why some of the PCS projects are significantly Complexity of the configurator Number of users more cost effective. Case Studies (sum of attributes and per PCS In the current research, the benefit per quote (in man-hours) and constraints) Case 1 50 Medium/High = 3400 the total cost of the projects is provided by the company. The Case 2 13 Medium = 2100 amount of saved man-hours before and after using the configurator Case 3 10 Low = 600 and the gained benefits based on the saved man-hours are calculated. In this study, the total cost of each project is calculated Table 3 illustrates all the figures related to the gained benefits as the project cost, which includes the development, based on saved man-hours for each project during the last year. implementation and the yearly running cost (such as licenses and maintenance activities) for the last year. Table 3. Calculation of the total benefits in DKK based on the saved man- In this research, we use multiple case studies to evaluate two hours per year propositions in one ETO (Engineer To Order) company. The (just based on saved Benefit per quote in company is a chemical company producing catalysts and process hours (saved man- Number of quotes licenses) per year Total benefit per (development + maintenance + Case Studies configurator plants and the selected three projects are three catalysts types. The man-hours) Total Costs through per year hours) reason for choosing one case company is to provide the in-depth year ROI data analysis and observed a trend between the selected factors while all the other factors including organizational culture are fixed. The criteria for choosing the three project (three catalyst products) is the maximum similarities between these three PCS Case 1 240 10,3 987.840 527.000 90% projects to be able to keep other factors constant; the required Case 2 295 1 118.000 157.000 25% Case 3 270 0,6 65.000 110.000 -40% ‫ﯾﺎھﻮ‬ 5 DISCUSSIONS The case study results demonstrate how the number of the users and complexity of the configurators’ projects have an impact on saved man-hours and cost-benefits in PCS projects. Analyzing the correlation of the number of users to cost- benefits, clarify the fact that if the department is larger and the potential number of users are higher for one specific PCS, then the expected benefit regarding saved man-hours from that configurator is higher (Figure 1). The number of quotations generated for each of the cases the year before are almost the same (Table 3) but Case 1 saves more man-hours which could be because the time and number of the users for quotation process is higher compared to the other cases. Figure 3. The total cost benefits, number of users, complexity per PCS per year 6 CONCLUSION The aim of this study was to measure the influence of the number of users and the complexity of the PCS project on gained benefits based on the same man-hours. The empirical data is gathered from an ETO company based on the previous 4-year results and these results confirmed the propositions. In detail, the gained benefit, number of users, and the PCS complexity per year were measured. The number of users’ data was available from the case company and the complexity was calculated based on the number of Figure 1. The total cost benefits related to the number of users per PCS per attributes and the number of constraints in PCS. The PCS year complexity illustrate the relative complexity in the product. In order to be able to make the sales configurator for each of these Analyzing the complexity related to the cost-benefit calculation products, a specific number of input, outputs, and finally attributes, illustrates a trend in the benefits gained from PCS and their relative constraints, and rules are required in PCS. complexity ratio. Figure 2 demonstrates a trend between the The analysis led to the conclusion that there is a positive complexity of the PCS project and cost-benefits implications. correlation between the number of users in one PCS and the level The complexity is calculated based on the attributes and of direct savings. The higher number of the employees indicates constraints in each project and shows the size of the product as that PCS can save more man-hours in that specific department. The well. The results demonstrate that if the company develops a PCS more complex the PCS project, the more time is needed for for more complex product, the project cost will be higher (Table 3), developing the project which has been calculated as ROI. and the benefits will be higher conclusively. However, it seems complex projects save more man-hours. Complex PCS seem to compensate the development efforts and maintenance hours since in such cases, more stakeholders’ time is saved to deliver more complicated quotations. This research is in the first step in exploring the impact of other factors on the saved man-hours in PCS project. There are lists of factors which can influence the PCS projects cost-benefit analysis which can be explored in the future. These factors may be listed as employees’ experiences and users’ expertise, level of details included in the configurator, and organizational culture. This study considers two specific factors as outstanding ones based on the experience and verified two propositions. In this study, we provided one case company and three projects with in-depth data and we observed a trend between the selected factors. Therefore, it requires further research and additional cases to analyze different Figure 2. The total cost benefits related to the PCS complexity PCS per factors which may influence the gained benefits from PCS projects. year Further research is required to cover both the variety of companies except the ETOs as well as a wide range of case studies. Figure 3 demonstrates the total cost-benefits, number of users and complexity of each case project in one year. As discussed before, there is a direct positive correlation between cost-benefit analysis REFERENCES and both the number of users and the complexity of the project. [1] A. Felfernig, S. Reiterer, F. Reinfrank, G. Ninaus, and M. Jeran, ‫ﯾﺎھﻮ‬ “Conflict Detection and Diagnosis in Configuration,” in 2005, pp. 206–221. Knowledge-Based Configuration: From Research to Business [20] M. Heiskala, K. Paloheimo, and J. Tiihonen, “Mass Cases, A. Felfernig, L. Hotz, C. Bagley, and J. Tiihonen, Eds. customization with configurable products and configurators: a Morgan Kaufman, 2014, pp. 73–87. review of benefits and challenges,” in Mass customization [2] C. Forza and F. Salvador, Product information management for information systems in business, no. C, Finland: IGI Global, mass customization: connecting customer, front-office and back- 2007, pp. 75–106. office for fast and efficient customization. New York: Palgrave [21] J. Heatley, R. Agarwal, and M. Tanniru, “An evaluation of an Macmillan, 2007. innovative information technology - the case of carrier expert,” [3] L. Hvam, N. H. Mortensen, and J. Riis, Product customization. Journal of Strategic Information Systems, vol. 4, no. 3, pp. 255– Berlin Heidelberg: Springer, 2008. 277, 1995. [4] A. Felfernig, L. Hotz, C. Bagley, and J. Tiihonen, Knowledge- [22] L. Hvam, M. Malis, B. Hansen, and J. Riis, “Reengineering of the Based Configuration From Research to Business Cases. Newnes: quotation process: application of knowledge based systems,” Morgan Kaufman, 2014. Business Process Management Journal, vol. 10, no. 2, pp. 200– [5] C. Forza and F. Salvador, “Managing for variety in the order 213, 2004. acquisition and fulfilment process: The contribution of product [23] L. Hvam, “Mass customisation in the electronics industry : based configuration systems,” International Journal of Production on modular products and product configuration,” International Economics, vol. 76, no. 1, pp. 87–98, Mar. 2002. Journal of Mass Customisation, vol. 1, no. 4, pp. 410–426, 2006. [6] S. Shafiee, “Conceptual Modelling for Product Configuration [24] L. Hvam, “Mass customisation of process plants,” International Systems,” Technical University of Denmark, 2017. Journal of Mass Customisation, vol. 1, no. 4, pp. 445–462, 2006. [7] A. Haug, L. Hvam, and N. H. Mortensen, “Definition and [25] L. Hvam, A. Haug, N. H. Mortensen, and C. Thuesen, “Observed evaluation of product configurator development strategies,” benefits from product configuration systems,” International Computers in Industry, vol. 63, no. 5, pp. 471–481, Jun. 2012. Journal of Industrial Engineering: Theory, Applications and [8] S. Shafiee, K. Kristjansdottir, and L. Hvam, “Business cases for Practice, vol. 20, no. 5–6. 2013. product configuration systems,” in 7th international conference [26] T. D. Petersen, “Product Configuration in ETO Companies,” in on mass customization and personalization in Central Europe, Mass customization information systems in business, 2007, pp. 2016. 59–76. [9] L. L. Zhang, “Product configuration: a review of the state-of-the- [27] J. J. Sviokla, “An Examination of the Impact of Expert Systems art and future research,” International Journal of Production on the Firm: The Case of XCON,” MIS Quarterly, vol. 14, no. 2, Research, vol. 52, no. 21, pp. 6381–6398, Aug. 2014. p. 127, 1990. [10] K. Kristjansdottir, S. Shafiee, L. Hvam, M. Bonev, and A. [28] M. Yoshioka, M. Oosaki, and T. Tomiyama, “An Application of Myrodia, “Return on investment from the use of product Quality Function Deployment to Functional Modeling in a configuration systems – A case study,” Computers in Industry, Knowledge Intensive Design Environment,” in Knowledge vol. 100, no. July 2017, pp. 57–69, 2018. Intensive CAD Vol 1, no. January, Springer US, 1996, pp. 300– [11] M. Ariano and A. Dagnino, “An intelligent order entry and 314. dynamic bill of materials system for manufacturing customized [29] S. Shafiee, K. Kristjansdottir, L. Hvam, and C. Forza, “How to furniture,” Computers & Electrical Engineering, vol. 22, no. 1, scope configuration projects and manage the knowledge they pp. 45–60, Jan. 1996. require,” Journal of Knowledge Management, vol. 22, no. 5, pp. [12] M. Aldanondo, S. Rougé, and M. Véron, “Expert configurator for 982–1014, 2018. concurrent engineering: Cameleon software and model,” Journal [30] S. Shafiee, L. Hvam, and M. Bonev, “Scoping a product of Intelligent Manufacturing, vol. 11, no. 2, pp. 127–134, 2000. configuration project for engineer-to-order companies,” [13] L. Ardissono et al., “A Framework for the Development of International Journal of Industrial Engineering and Personalized, Distributed Web-Based Configuration Systems,” AI Management, vol. 5, no. 4, pp. 207–220, 2014. Magazine, vol. 24, no. 3, p. 93, 2003. [31] A. C. Haddix, S. M. Teutsch, and P. S. Corso, Prevention [14] V. E. Barker, D. E. O’Connor, J. Bachant, and E. Soloway, effectiveness: a guide to decision analysis and economic “Expert systems for configuration at Digital: XCON and evaluation. Oxford University Press, 2003. beyond,” Communications of the ACM, vol. 32, no. 3, pp. 298– [32] P. A. Lemoine, H. C. Woodard, and M. D. Richardson, “Return 318, Mar. 1989. on Investment,” in Handbook of Improving Performance in the [15] M. Gronalt, M. Posset, and T. Benna, “Standardized Workplace, Volume Two: Selecting and Implementing Configuration in the Domain of Hinterland Container Terminals,” Performance Interventions, 2010, pp. 302–308. Series on Business Informatics and Application Systems [33] A. B. Brown, A. Keller, and J. L. Hellerstein, “A Model of Innovative Processes and Products for Mass Customization, vol. Configuration Complexity and its Application to a Change 3, pp. 105–120, 2007. Management System Aaron,” IEEE Transactions on Network and [16] C. Forza and F. Salvador, “Product configuration and inter-firm Service Management, vol. 4, no. 1, pp. 13–27, Jun. 2007. coordination: An innovative solution from a small manufacturing [34] S. Shafiee, L. Hvam, A. Haug, M. Dam, and K. Kristjansdottir, enterprise,” Computers in Industry, vol. 49, no. 1, pp. 37–46, Sep. “The documentation of product configuration systems: A 2002. framework and an IT solution,” Advanced Engineering [17] C. Forza, A. Trentin, and F. Salvador, “Supporting product Informatics, vol. 32, pp. 163–175, 2017. configuration and form postponement by grouping components [35] A. H. Van de Ven, “Nothing is quite so practical as a good into kits: the case of MarelliMotori,” International journal of theory,” Academy of Management Review, vol. 14, no. 4, pp. mass customisation, vol. 1, no. 4, pp. 427–444, 2006. 486–489, 1989. [18] A. Haug, L. Hvam, and N. H. Mortensen, “The impact of product [36] D. M. McCutcheon and J. R. Meredith, “Conducting case study configurators on lead times in engineering-oriented companies,” research in operations management,” Journal of Operations Artificial Intelligence for Engineering Design, Analysis and Management, vol. 11, no. 3, pp. 239–256, Sep. 1993. Manufacturing, vol. 25, no. 2, pp. 197–206, Apr. 2011. [37] J. Meredith, “Building operations management theory through [19] M. Heiskala, J. Tiihonen, and K. Paloheimo, “Mass case and field research,” Journal of Operations Management, vol. customization of services: benefits and challenges of configurable 16, no. 4, pp. 441–454, 1998. services,” in Frontiers of e-Business Research (FeBR 2005),