=Paper= {{Paper |id=Vol-1856/p14 |storemode=property |title=Evaluation of business process management systems |pdfUrl=https://ceur-ws.org/Vol-1856/p14.pdf |volume=Vol-1856 |authors=Daina Ardzevičiūtė,Tomas Skersys,Ernestas Kvedaras }} ==Evaluation of business process management systems== https://ceur-ws.org/Vol-1856/p14.pdf
  Evaluation of business process management systems
        Daina Ardzevičiūtė                            doc. dr. Tomas Skersys                                Ernestas Kvedaras
Department of Information Systems               Department of Information Systems                            Kaunas, Lithuania
 Kaunas University of Technology                 Kaunas University of Technology                    e-mail:kvedarasernestas@gmail.com
         Kaunas, Lithuania                              Kaunas, Lithuania
e-mail: daina.ardzeviciute@ktu.edu                 e-mail: tomas.skersys@ktu.lt



    Abstract—Nowadays, more and more industrial organizations
are modeling their business processes and implementing business           II. THE FRAMEWORK FOR EVALUATING BUSINESS PROCESS
process management systems. Therefore, it is very important to                               MANAGEMENT SYSTEMS
choose a suitable business process management system. The main               Criteria identified during literary analysis were divided into
purpose of this paper is to propose and verify the framework for
                                                                         six groups:
evaluating business process management systems. This method
covers the most important aspects of a business process                     •     Business process modeling criteria – evaluate systems
management systems from the design to the monitoring of the                       ability to model clear and complete processes and to
business process. The main advantage of the proposed approach                     import and export them;
is that it is independent from any specific domain and execution
engine. The evaluation framework was tested by applying it to               •     Systems development criteria – evaluate business
four different business process management systems: “Bonita                       process execution capabilities and user interface
BPM”, “Camunda”, “jBPM“, “Activiti”.                                              design;

   Keywords—Business process; Business Process modeling;                    •     Installation and performance criteria – evaluate
Business Process Management System                                                versioning and aspects relevant to the processes
                                                                                  execution;
                      I. INTRODUCTION                                       •     Monitoring and control criteria – evaluate aspects
    Bas Steen suggested definition of business process: “A                        relevant to monitoring and controlling during the
business process is a chain of activities, performed by entities                  execution of processes;
that takes one or more kinds of inputs and creates an output                •     Processes and data analysis criteria – evaluate systems
that is of value for one or more entities” [1] is used in this                    capabilities for users to analyze business processes
paper. Business process modeling helps organizations to                           and other relevant data in the simplest possible way;
graphically define existing business processes (who, how, what
and why does), to identify business problematic areas, to define            •     Common criteria – evaluate systems information
potential risks and to improve the process while making                           accessible to its users and the use of the system.
decisions. It also provides a better and consistent understanding            The evaluation criteria and the systems has been selected
of business processes, improves communication between                    on the basis of what is most relevant to small and medium-
different interest groups, helps to identify, detect and manage          sized organizations. Evaluation conditions and weights were
organizational knowledge and provides a possibility to re-use            defined for each criterion. Weighting (1 to 3) reflects the
previously modeled and verified processes [2].                           importance in the whole range of the analysis. To simplify
    Business process management system is a system that                  criteria evaluation for the people doing this work, each of the
completely defines, manages and executes “workflows” [3]. It             criterion can be assessed in a four-point scale: 0 – the system
is hard to choose the right business process management                  does not meet the criterion; 1 – the system meets the criterion
system, because there are no defined criteria for doing that.            minimally; 2 – the system meets the criterion at an average; 3 –
Without them, choosing the system is subjective, since                   the system fully meets the criterion. Weights and criteria
organizations cannot devote a lot of resources to                        identification is quite subjective (using analyzed literature and
comprehensively analyze the systems. Therefore, in order to              “know-how” principle) in this work, since no way to adapt
analyze business process management system more efficiently,             formal methods was found.
evaluation criteria have to be defined.                                    Maximum score is calculated by multiplying weight by
   The remainder of this paper is structured as follows:                 maximum possible points (3).
Section II presents the proposed framework for evaluating
business process management systems; Section III presents the            A. Process modeling criteria
comparison between open source business process                             Part of the companies have already modeled (not
managements systems; Section IV concludes the paper.                     necessarily formally) the current (“as-is”) organization model,
                                                                         before the development and/or implementation of the processes

   Copyright © 2017 held by the authors




                                                                    69
management system. Modeled existing process forms the basis                             business process model. This means – the system must support
for process improvements, which are then added to the desired                           at least one business process execution language and,
(“to-be”) process [4]. It is therefore important to know whether                        translation between business process modeling and execution
it is possible to import already created models into the system.                        languages. All the systems being compared, must have this
                                                                                        functionality, since only the systems which execute business
    One of the most important criteria for this group is the                            processes are relevant in this paper.
modeling of processes, indicating that the system allows to
model processes using formal business process modeling                                      The following two criteria are related to users who interact
language [5]. Currently, there are different languages and                              with business processes. Generally, users use forms (web
standards for business process modeling, such as IDEF, Petri                            portals) to send data to business systems, and a tool is required
nets, WPDL, UML2, BPMN. Business modeling language                                      to specify user roles and rights to participate in the process [5],
comparison is not included in this research work tasks, but                             [8], [9].
other authors examine this topic ([6], [7]). After modeling
business process, it is relevant to know process statistics, e.g.,                          Business process integration with different systems is also
to identify how many message flows, roles there are, what the                           important in systems development (e.g., databases, customer
cost are, and to model data [8].                                                        relationship management systems) [5]. Integration is
                                                                                        particularly important if the organization uses different
    In addition to the modeled active structure (processes) and                         systems, because it would facilitate the organization's staff
passive structure (data), it is also important to define business                       work. Integration with other technologies and frameworks,
rules [8], [9]. Business rules can be modeled in three different                        which can ease and accelerate the development of the system,
ways [5]:                                                                               is also important. A valid aspect of the evaluation of this
                                                                                        functionality is supported programming languages [5].
    •     all the business rules are modeled into the business
          process, usually as decision points;                                              Systems design parameters and evaluation conditions given
                                                                                        in Table II.
    •     business rules are managed separately, and links to
          business rules are given in business process model;
                                                                                                     TABLE II.         SYSTEMS DEVELOPMENT CRITERIA
    •     business processes are not modeled in business
          process, but are created from business rules.                                 Systems              The evaluation conditions                            Weight
                                                                                        development
   To re-use process modeled in the system or to give it to                             criteria
someone, ability to export it in various formats is required [8].                       Process translation If the process of translation into executable           3
                                                                                        into executable     business process model is manual, 1 point is
   The simulation parameters and evaluation conditions are                              business process    given. If it is done automatically, but requires
given in Table I.                                                                       model               human interaction, 2 points are given. If the
                                                                                                            translation is fully automatic, 3 points are given.
                 TABLE I.       PROCESS MODELING CRITERIA                               Creation of user If only independent of the business process forms          3
                                                                                        interface (forms) can be created, 1 point is given. If forms can be
Process modeling The evaluation conditions                                Weight                          created based on processes diagram, 2 points are
criteria                                                                                                  given. If forms of designed processes and / or
                                                                                                          data models can be generated (not necessarily
Process import      If it is possible to import already created             1
                                                                                                          complete), an additional 1 point is given.
                    processes in XML format, 1 point is given. For
                    every other data import format an additional                        User management If there is a possibility to assign roles to the            2
                    point is given, but no more than 3 points in total                                  users, 1-3 points are given considering the
                    for this criterion.                                                                 possibilities (how roles are defined; is there a
                                                                                                        possibility to assign more than one user to the
Process modeling    If BPMN is supported, 3 points are given (since         3
                                                                                                        same role…) and flexibility.
                    it is a standard language). If system does not
                    support it, 1 point is given for each other                         Integration  with If there is a possibility to integrate the system         2
                    standard process modeling language, but no more                     other systems and being developed with other systems and
                    than 3 points in total for this criterion.                          technologies      technologies, 1-3 points are given considering
                                                                                                          the possibilities and flexibility.
Data modeling       If there is a data modeling possibility, 1-3 points     3
                    are given, considering the possibilities and
                    flexibility.
                                                                                        C. Installation and performance criteria
Business rules      If there is at least one way to model business          3              Business processes and other components version
                    rules, 3 points are given. If business rules cannot                 management is important to maintain the traceability of
                    be described fully, 1 or 2 points are given.                        processes [5], [8].
Model export        If the model can be exported into a picture, 1          1
                    point is given. For each other export option, 1
                                                                                           Some of the steps of the process cannot be completed
                    additional point is given, but no more than 3                       without user interaction, therefore, user information is required.
                    points in total for this criterion.                                 User information can be done in two ways [5]:
B. Systems development criteria                                                             •      active informing – user is informed on what he has to
                                                                                                   do, i.e. via email;
    One of the most important criteria in the field of this paper
is the translation of modeled business process into executable




                                                                                   70
       •     passive informing – user can view his activity log,                           modeled using business process modeling/execution language
             e.g., through the portal.                                                     that has a clear semantics) [5].
    User interface customization function allows user to change                                Data visualization tools (various diagrams (column, pie and
its parameters, like user interface color, time zone, language,                            histogram), graphs, scales) are critical when analyzing data [5].
etc. [9]                                                                                   Data visualization gives the ability to identify patterns and find
                                                                                           exceptions [11]. Therefore, to analyze data more easily and see
       Modeling criteria and evaluation conditions given in Table                          strengths and weaknesses, tool that visually represent chosen
III.                                                                                       data/statistics are required.

           TABLE III.       INSTALLATION AND PERFORMANCE CRITERIA
                                                                                              Process and data analysis criteria and evaluation conditions
                                                                                           given in Table V.
Installation and        The evaluation conditions                            Weight
performance
criteria                                                                                             TABLE V.         PROCESS AND DATA ANALYSIS CRITERIA
Versioning              If system has component versioning, 1-3 points         1           Process and data The evaluation conditions                               Weight
                        are given considering the possibilities (if                        analysis criteria
                        components that can be versioned are business
                                                                                           Process simulation If process simulation is possible, 3 points are         2
                        processes, data models, forms…) and flexibility.
                                                                                                              given. If an additional tool is required to do a
User information        If user can be informed via email, 1 point is          2                              simulation, 2 points are given. If process
                        given. If there is at least one other information                                     simulation is limited (for example, not all
                        method, 1 additional point is given. If use is                                        parameters, like business rules, are considered
                        being passively informed, 1 point is given. All                                       during simulation), 1 point is given.
                        points in this criterion can be summed.
                                                                                           Modeled process     If modeled business process verification is            1
User interface          For each variable user interface parameter, 1          1           check               possible, 1-3 points are given considering the
customization           point is given, but no more than 3 points in total                 (verification)      possibilities and flexibility.
                        for this criterion.
                                                                                           Visual        data If there are tools allowing to visually represent       2
                                                                                           mapping tools      data, 1-3 points are given considering the
D. Monitoring and control criteria                                                                            possibilities (can this be done with the system
    Real-time monitoring can be helpful in detecting process                                                  itself or additional tools are required) and
bottlenecks and identifying emerging risks and interfering in to                                              flexibility.
the process before occurrence of the damage [10]. Reacting to
the information visible during process monitoring, users may                               F. Common criteria
want to change business processes or stop them [5] [8]. This is                                Other aspects, besides business process management
usually done in business process execution time when                                       systems provided functionality, are also important. It is
unforeseen conditions or errors occur.                                                     important not only to choose the right system, but also to learn
                                                                                           to use it as quickly as possible and to get the required
       Monitoring and control criteria are given in Table IV.                              information: get needed help and access learning material. For
                                                                                           users to be able to help to improve the system and report found
             TABLE IV.          MONITORING AND CONTROL CRITERIA                            issues, it is important to have an easy and fast way to send
                                                                                           suggestions to the system creators. This functionality helps to
Monitoring and          The evaluation conditions                            Weight        create a connection between systems users and creators.
control criteria
Business process If there are tools that allow to monitor processes            2                 Common criteria and evaluation conditions given in Table
monitoring       in real time, 1-3 points are given considering the                        VI.
                 possibilities (if it can be done with the system
                 itself or an external tool is required) and
                 flexibility.                                                                                   TABLE VI.        COMMON CRITERIA
Business      process If processes being executed can be modified, 1-3         2           Common criteria The evaluation conditions                                Weight
control               points are given considering the possibilities and
                      flexibility.                                                         Multilingual        For each language in which help is provided, 1         1
                                                                                           assistance          point is given, but no more than 3 points in total
E. Process and data analysis criteria                                                                          for this criterion.
                                                                                           Training material   If training material is available, 1-3 points are      1
    To verify if business processes will be executed as                                                        given considering their abundance, detail and
expected, it is convenient to run a business process simulation.                                               availability.
For example, when new version of current process is modeled,                               Suggestions for     If user has the possibility to provide systems         1
it can be simulated before releasing into production to choose                             improvement         improvements suggestions, 1-3 points are given
between the versions [5].                                                                                      considering the possibilities and flexibility.
   Another important aspect of the analysis is modeled
business process verification. Verification is used to verify                                  The framework contains only recommendations for
modeled (being executed) business process validity against the                             assessing business process management systems. The
semantics of business process modeling language being used (it                             comparison criteria of business process management systems
can be done, if (executable) business process model was                                    are flexible; therefore, anyone can easily change the weights




                                                                                      71
 according to what is most important for a specific project or             TABLE VII.         COMPARISON OF BUSINESS PROCESS MANAGEMENT SYSTEMS
 product. Moreover, evaluation scale can also be changed: it can                                                      System name
 be narrowed (to two or three different grades) or expanded (for           Comparison criteria          “Bonita    “Camunda   “jBPM”   “Activiti”
 example, to introduce a ten-point rating scale). Furthermore,                                           BPM”         ”
 more criteria can be identified if required. The order of criteria
                                                                           Process modeling criteria
 evaluation is flexible. It is recommended to evaluate each
                                                                           Process import                 3           2         1          1
 system separately: to better evaluate specific system’s function,
 it is advised to fully evaluate the first system and only then            Process modeling               9           9         9          9
 proceed to the next one.                                                  Data modeling                  9           9         9          9
                                                                           Business rules                 9           9         9          6
III. COMPARISON OF BUSINESS PROCESS MANAGEMENT SYSTEMS                     Model export                   3           2         2          2

    Four open source candidates have been chosen according to              Process modeling score         33          31        30        27
                                                                           (available points - 33)
 projects currently being ran in university academic department:
 “Bonita BPM”, “Camunda”, “jBPM”, “Activiti”.                              System development criteria
                                                                           Process translation into       9           9         9          9
     “Bonita BPM” is an open source business process                       executable       business
 management and business process software collection, created              process model
 in 2001 [12]. “Bonita BPM” helps to connect all interested                Creation of user interface     9           9         9          6
 parties, processes and information systems into a single easily           (forms)
 manageable platform. In many sources ([13], [14], etc.) three             User management                6           6         6          6
 main aspects, which “Bonita BPM” combines, are                            Integration with other         6           6         6          6
 distinguished: process modeling and software creation, process            systems and technologies
 execution engine and end-user interface.                                  System development             30          30        30        27
                                                                           score (available points -
    “Camunda” is a lightweight, open-source platform for                   30)
 business process management [15]. This platform includes all
                                                                           Installation and performance criteria
 phases of the BPM cycle and allows a continuous update of
                                                                           Versioning                     3           3         3          3
 processes. “Camunda” supports core standards of OMG group
 for business processes management (BPM): BPMN 2.0,                        User information               6           6         4          6
 CMMM 1.0 and DMN 1.0.                                                     User interface                 3           3         0          1
                                                                           customization
     “jBPM” is a flexible business process management (BPM)                Installation and               12          12        7         10
 package, creating a bridge between business analytics and                 performance score
 system developers [16]. This package is unique in that it offers          (available points - 12)
 process management possibilities for both business participants           Monitoring and control criteria
 and system creators, which allows to create and maintain                  Business process               4           6         4          4
 dynamic processes that require a flexibility for complex real-            monitoring
 world simulations.                                                        Business process control       4           6         4          2
     “Activiti” is a lightweight workflow and business process             Monitoring and control         8           12        8          6
 management (BPM) platform for the actors, systems                         score (available points -
                                                                           12)
 developers and administrators [17]. “Activiti” supports all
 BPM aspects in the context of business creation. This includes            Process and data analysis criteria
 non-technical aspects, such as analysis, simulation and                   Process simulation             6           6         6          2
 optimization of business processes, as well as the technical              Modeled process check          3           3         3          3
 aspects of the development of business process support                    (verification)
 systems.                                                                  Visual data mapping            6           6         6          6
                                                                           tools
     Comparative analysis is summarized in Table VII. It                   Process and data               15          15        15        11
 contains evaluations of all four of the compared systems. Part            analysis score (available
 of the criteria have been tested during this analysis. However,           points - 15)
 due to the complexity of some criteria (e.g., integrations with           Common criteria
 other systems), some are evaluated only considering the                   Multilingual assistance        3           2         1          1
 analyzed literature.
                                                                           Training material              2           3         3          1
     To demonstrate how systems were evaluated, an example is              Suggestions for                3           3         2          1
 given: evaluation criterion “Process import” has pre-assigned             improvement
 weight of 1, maximum value is 3. “Bonita BPM” has a function              Common criteria score          8           8         6          3
 to import using XML, *.bpmn, *.ydx and other formats, so this             (available points - 9)
 system gets maximum points – 3.                                           Total score                   106         108        95        84




                                                                      72
    “Bonita BPM” system allows importing diagrams, which                      “Bonita BPM”, “Camunda”, “Activiti” documentations
have been exported from “Bonita BPM” “BPMN 2.0”,                          state that email send events can be configured while modeling
“Microsoft Visio 2010”, “ARIS BPM 7.x”, “XPDL 1.0” and                    business processes. No other active information possibilities
“jBPM 3.2” tools using either XML or other formats (i.e.:                 were identified during the analysis. Passive information about
*.bpmn, *.vdx) [18]. “Camunda”, “jBPM” and “Activiti”                     tasks to be done, etc. can be seen when logged in to any of the
systems can import a BPMN model from XML format [19],                     systems.
[20], [21]. All systems allow to create models in BPMN
language and all of them have data models, which allow users,                 “Bonita BPM” system allows to define toolbar size (normal
who model business processes and who not always have                      or small), choose grid options (e.g., whether to show a grid on
knowledge of how to use a database, to review, create and edit            new diagram) and to choose whether to suggest to change
these data models.                                                        diagram name when saving the first time (if this is enabled,
                                                                          every time a new diagram is saved, a window is displayed
    “Bonita BPM” system also allows to define business rules              where the name of the diagram can be changed). Moreover,
while defining decision points [18], “Camunda” system allows              “Bonita BPM” portal allows to apply a profile (e.g., create new
to define business rules using DMN standard [15], “jBPM” –                menu items) [18]. “Camunda” platform allows to define
business rules can be defined in few different ways (decision             process appearance (task color and icon can be changed) when
tables, specification of the rules [20]), therefore, these systems        creating a new process. The portal allows to create new filters
received a maximum available (3) points. “Activiti” system                and specify their name, description, color and priority [19].
allows to create a business rules task, which can execute one or          Information about user interface customization on the “jBPM”
more business rules [21], therefore, this system got a score of 2         platform was not found. “Activiti” allows to customize a
points.                                                                   palette, which is offered for users while modeling processes
                                                                          [21].
    The largest business process export possibilities have been
found on the “Bonita BPM” system, since process can be                        “Bonita BPM” allows to monitor during the execution of
exported not only to an image, BPMN 2.0, XLM, BOS format,                 processes and see information about them: their list, how many
but also elements to be exported (e.g., data models,                      errors occurred, how many cases execute without errors and
configurations, dependencies, organizations) can be chosen                how many of them are open. User can only monitor processes
[18]. Other three tools can export business process model to              they control [18]. To monitor processes modeled using
(BPMN) XML format. “jBPM” additionally allows to export to                “Camuda”, an additional system “Camuda “Cockpit” is
JSON format [20]. “Activiti” also allows to export business               required [15], which allows to do data filtering and searching,
process to PNG, PDF and other formats, while typing a slash               review historic data and do process control actions (cancel
and specifying a format at the end of URL address, for example            processes, edit variables, etc.). “jBPM” also allows a detailed
{url}/{format} [22].                                                      process monitoring – data filtering and searching, “look'n'feel”
                                                                          website tools [20]. In “Activiti” process owners and
    As mentioned earlier, all systems were required to have a             administrators can review a detailed information of processes
business process execution tool, therefore, all of them were              being executed [17].
evaluated with a maximum score. Compared systems have
form modeling tools, which allows to create required user                     “Bonita BPM” and “Camunda” systems provide a
interface forms using WYSIWYG principle. Moreover, they all               possibility to change processes in real-time. “jBPM” also
allow to manage user roles. “Bonita BPM”, “Camunda” and                   allows to do minor process changes (e.g., edit variables) [16].
“jBPM” at least part of the form can be generated.                        “Activiti” allows to stop processes being executed [21],
                                                                          however, no other control function of process being executed
    On “Bonita BPM” specification page [18] it is described               could be found and tested.
how to integrate other systems into “Bonita BPM” using
REST. On this specification, it is stated that REST integration               All, except “Activiti”, systems allow to run a process
allows to access all BPM objects (e.g., processes, users) and to          simulation and review its results. It helps to identify what needs
integrate with “Google” calendar. In “Camunda” user guide                 to be changed in the process to achieve the best results.
[19] integrations with “Spring” framework, “CDI”/”Java EE”                “Activiti” does not have that kind of functionality, however,
and other technologies is described. In the chapter 10 of                 the user guide describes how it can be done using an
“jBPM” documentation [20] integration with “REST” is                      experimental tool called “Activiti-Crystalball”. All systems
described, while also integrations with other technologies,               documentations (or user guides) state that the system can verify
frameworks are described in chapter 20. In “Bonita BPM” user              business processes modeled using BPMN notation. Also, each
guide [21] integration with other frameworks and technologies             system provides a possibility to visually review certain
is also described (i.e.: “Spring” integration is described in             information, which helps to analyze data and make decisions
chapter 5). To evaluate integration realistically and accurately,         about process modification.
an experience with the system is required.
                                                                              Information on the “Bonita BPM” website [12] can be
     All systems under comparison have business process                   found in three languages – English, French and Spanish.
versioning, which ensures that former version can be restored if          “Bonita BPM” website also provides various training and
needed. Since this criterion was evaluated only considering the           informational material: web-seminars being organized and
analyzed literature and versioning was described in all of them,          other events, BPM, process and video libraries. Furthermore,
all systems received maximum available score of 3.                        there are other websites dedicated to this tool community and
                                                                          documentation. “Camunda” website [15] provides information




                                                                     73
only in English, however some articles can be found in                                                 REFERENCES
German. Moreover, “Camunda” website offers a user guide,                [1]  B. Steen, "Generation of optimal business processesfrom business
examples, information about standards used in this system and                rules," 2009.
links to forums (consumers and developers). “jBPM” website              [2] M. Indulska, P. Green, J. C. Recker and M. Rosemann, "Business
[16] use only English language. It provides links to training                Process Modeling: Perceived Benefits," in 28th International Conference
videos, slide shares and documentation, forum. “Activiti”                    on Conceptual Modeling, Gramado, 2009 (unpublished).
website [17] provides links to user guide and forum and all the         [3] D. Hollingsworth, "The Workflow Reference Model," 29 11 1994.
information is only in English. Besides, all the systems offer a             [Online].                                                       Available:
                                                                             http://www.aiai.ed.ac.uk/project/wfmc/ARCHIVE/DOCS/refmodel/rmv
way to provide a feedback to the developers.                                 1-16.html#I11. [Accessed 20 02 2017].
  Figure 1 shows a radar diagram business process                       [4] M. Rouse, A. Stuart, "Business process modeling," TechTarget, vasaris
management systems compared.                                                 2012.                         [Online].                         Available:
                                                                             http://whatis.techtarget.com/definition/business-process-modeling.
                                                                             [Accessed 09 11 2015].
                                                                        [5] S. R. Koster, "An evaluation method for Business Process Management
                                                                             products," University of Twente, Enschedė, 2009.
                                                                        [6] B. List, B. Korherr, "An evaluation of conceptual business process
                                                                             modelling languages," in SAC '06 Proceedings of the 2006 ACM
                                                                             symposium on Applied computing, New York, 2006.
                                                                        [7] H. Mili, G. B. Jaoude, É. Lefebvre, G. Tremblay, A. Petrenko, "Business
                                                                             Process Modeling Languages: Sorting Through the Alphabet Soup,"
                                                                             ACM Computing Surveys (CSUR), vol. 43(1), pp. 7-26, 2010.
                                                                        [8] S.       D.     Jha,     17    June      2015.       [Online].   Available:
                                                                             https://www.linkedin.com/pulse/bpm-tool-evaluation-survey-review-
                                                                             global-community-sunil-dutt-jha. [Accessed 06 11 2015].
                                                                        [9] M. Scannapieco, "Business Process Management: Basics" [Online].
                                                                             Available:
                                                                             http://www1.unece.org/stat/platform/download/attachments/108103374/
                                                                             Day%201%20-%20Item%204%20%20-
                                                                             %20Business%20process%20modelling.pdf?version=1&modificationDa
                                                                             te=1420617654782&api=v2. [Accessed 11 11 2015].
                                                                        [10] Pegasystems          Inc.,       2015.         [Online].        Available:
                                                                             http://www.pega.com/business-process-monitoring. [Accessed 9 11
Fig. 1. Radar diagram of business process management systems                 2015].
                                                                        [11] N. Shamas, "Techcange," 19 May 2015. [Online]. Available:
    After doing a comparative analysis of business process                   https://www.techchange.org/2015/05/19/data-visualization-analysis-
                                                                             international-development/. [Accessed 14 11 2015].
management systems and considering an evaluation table
(Table VII) and a radar diagram (Fig. 1) it was identified that         [12] "Bonitasoft,"       Bonitasoft,       Inc.,       [Online].     Available:
                                                                             http://www.bonitasoft.com/. [Accessed 15 10 2015].
the best match for defined criteria is the “Camunda” system.
                                                                        [13] B. Markmann, "Has open source BPM arrived?," Counterpoint
                                                                             Consulting, Inc., 8 July 2013. [Online]. Available: http://c20g.com/has-
                         IV. CONSLUSION                                      open-source-bpm-arrived/. [Accessed 24 10 2015].
                                                                        [14] "Eclipse            marketplace,"            [Online].          Available:
    This paper presented a framework which allows to                         https://marketplace.eclipse.org/content/bonita-bpm. [Accessed 31 10
comprehensively evaluate selected business process                           2015].
management systems. The evaluation framework itself consists            [15] "Camunda," 2014. [Online]. Available: https://camunda.org/. [Accessed
of selected criteria and information on how to valuate these                 14 10 2015].
criteria. This evaluation framework is flexible, therefore,             [16] "jBPM," 2015. [Online]. Available: http://www.jbpm.org/. [Accessed 14
everyone can adapt it to their needs: choose the most important              10 2015].
criteria or add more, change the weights, evaluation scale or           [17] "Activi," [Online]. Available: http://activiti.org/index.html. [Accessed
change the order of criteria. For demonstration purposes, an                 30 10 2015].
example of implementation of the proposed framework on four             [18] "Bonita BPM documentation website," Bonitasoft, Inc., 2015. [Online].
business process management systems (“Bonita BPM”,                           Available: http://documentation.bonitasoft.com/. [Accessed 10 11 2015].
“Camunda”, “jBPM“, “Activiti”) has been presented. Finally,             [19] "docs.camunda.org,"                    [Online].                Available:
                                                                             https://docs.camunda.org/manual/7.3/guides/user-guide/. [Accessed 31
the comparison of these systems was made.                                    10 2015].
    This framework will be used in further research of                  [20] "jBPM Documentation," JBoss jBPM team, [Online]. Available:
university academic department and in author’s Final Degree                  http://docs.jboss.org/jbpm/v6.3/userguide/. [Accessed 03 11 2015].
Project where this framework will be used in creating                   [21] Alfresco, 05 11 2015. [Online]. Available: http://activiti.org/userguide.
                                                                             [Accessed 11 11 2015].
information system for specific domain.
                                                                        [22] "Activiti Modeler: export/print a diagram," Activiti, 26 07 2010.
                                                                             [Online]. Available: https://forums.activiti.org/content/activiti-modeler-
                                                                             exportprint-diagram.         [Accessed           06         01      2016].




                                                                   74