<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Extensions to the bupaR Ecosystem: An Overview</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Gert Janssenswillen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Felix Mannhardty</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mathijs Creemers</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Benoˆıt Depaire</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mieke Jans</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Leen Jooken</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Niels Martin z</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Greg Van Houdt</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>A. LogbuildR</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>UHasselt - Hasselt University Agoralaan</institution>
          ,
          <addr-line>3590 Diepenbeek</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <abstract>
        <p>-Over the past few year, bupaR - the open-source R-ecosystem for process analysis - has seen a considerable increase in functionalities and users. It has been one of the first successful tools for script-based process analytics, and can currently be seen as the state-of-the-art tool for process analysis in R and an important player in the open-source process mining tool landscape. With a user-base consisting largely of professional process analysts, the ecosystem has helped to increase the adoption of process mining in a broad range of fields. In this demonstration, we highlight recent extensions to the ecosystem that will further increase its usefulness for practitioners during their process mining projects. Index Terms-bupaR, R, process analytics, data quality, knowledge management.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        I. INTRODUCTION
bupaR is an ecosystem of R-packages geared towards the
analysis of process data in R [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].The ecosystem builds upon
three key principles: (1) connectivity, (2) reproducibility and
(3) extensibility. The latter indicates that the functionalities
provided by bupaR are continuously evolving. Since the
release of the core packages in 2017, both its usage and the
range of provided functionalities have been steadily
increasing. As shown in Table I, bupaR currently consists of 16
interconnected libraries for process analysis in the ecosystem,
each targeting a specific problem or use case.
      </p>
      <p>
        While bupaR in itself is not new, this paper outlines a
significant number of new functionalities that have recently
been added to the ecosystem. Hence, the current paper
extends earlier publications about the functionalities for business
process analysis in R [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>This paper is organised as follows. Section II lists recently
developed functionalities, Section III discusses the maturity
and usage of bupaR, while Section IV concludes the paper.
An accompanying tutorial and screencast can be found on
GitHub.1
1https://github.com/bupaverse/icpm-demo-tutorial</p>
      <p>Packages
bupaR*
collaborateR
daqapo*
edeaR*
eventdataR*
heuristicsmineR*
logbuildR
pm4py*
processanimateR*
processcheckR*
processmapR*
processmonitR*
propro
petrinetR*
understandBPMN*
xesreadR*</p>
      <p>
        Getting event data in the right format before starting your
analyses remains one of the important hurdles that process
analysts have to take. Notwithstanding bupaR’s functionality for
reading event logs from XES-files [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], practitioners typically
have to start from raw data, and make sure that it is correctly
converted into an event log.
      </p>
      <p>In order to guide this conversion, the package logbuildR
has been developed. It provides a graphical interface that leads
the user through different steps to build an event log. The
package provides the user with intelligent suggestions and
direct feedback in each step, which help the analyst to select
appropriate identifiers (case, activity, etc), make sure that each
row represents a unique event in the process (versus multiple
timestamps per row), convert timestamps to appropriate data
formats, and ensure life-cycle values adhere to the agreed-upon
makes this package well-suited for a teaching context in which
the computations are followed in a step-wise fashion. Also, it
is easy to compose new variants based on different heuristics.</p>
    </sec>
    <sec id="sec-2">
      <title>D. Propro</title>
      <p>
        The results of control-flow discovery algorithms are mainly
deterministic process models, which do not convey a notion
of probability or uncertainty. Using Bayesian inference and
Markov Chain Monte Carlo, propro [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] can build a statistical
model on top of a process model using event data, which
Fig. 1. Example of logbuildR interface: selecting appropriate identifiers. is able to generate probability distributions for choices in a
process’ control-flow. propro is based on a generic algorithm
to build a statistical model [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], which can then be used to
standard transactional life-cycle model [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. A screenshot of the test different kinds of hypotheses, such as non-deterministic
graphical interface is shown in Figure 1. The logbuildR dependencies between different choices in the model. This
package is available on GitHub.2 leads to valuable information about the process under
considB. DaQAPO eration, which go beyond the discovery of its static
controlflow. Hence, propro supports the enhancement of discovered
process models by exposing probabilistic dependencies, and
allows to compare the goodness-of-fit of different models with
respect to the event data, each of which provides important
advancements in the field of process mining. The propro
package is available on GitHub.4
      </p>
      <p>Following the preparation of the event log, one of the first
steps in process analysis is to assess the quality of the data.</p>
      <p>
        In order to support this step, daqapo was developed [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>Short for Data Quality Assessment for Process-oriented Data,
daqapo provides a variety of methods to detect data quality
issues in process-oriented data.</p>
      <p>As the reliability of process analysis techniques largely
depends on the quality of the event log, data quality is
an important aspect to consider. Insufficient data quality, or
an inadequate understanding of it, will inevitably lead to
low-quality results — Garbage in, garbage out — or even
misleading ones — Garbage in, gospel out.</p>
      <p>In order to stress the importance of data quality, daqapo
provides a large set of checks which enable users to identify a
range of data quality issues in a systematic way. These issues
include missing events, incorrect timestamps, and inaccurate
resource information. An overview of the available functions
is shown in Table II. The daqapo package is available
for installation on the Comprehensive R Archive Network
(CRAN).3</p>
    </sec>
    <sec id="sec-3">
      <title>C. HeuristicmineR</title>
      <p>
        The package heuristicsmineR brings extensible
support for variants of the Flexible Heuristics Miner [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] to bupaR.
Two major variants are implemented: the original Flexible
Heuristics Miner as described in [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and a variant that uses
time intervals derived from life-cycle transitions as described
in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Having discovered a Causal net, the dependencies
and gateway information can be visualised or transformed
into a Petri net for further processing, e.g., by computing
alignments with the pm4py package — which bridges the
bupaR-ecosystem to the PM4Py python library for process
mining. An underlying design principle of the package is to
separate the computation into several phases, each of which
provides an intermediate result that can be inspected and
visualised using the standard R print functionality. This
2https://github.com/bupaverse/logbuildR
3https://cran.r-project.org/package=daqapo
      </p>
    </sec>
    <sec id="sec-4">
      <title>E. ProcessanimateR</title>
      <p>Animation using moving tokens can be a powerful
visualisation tool to help understand the general process behavior.
The package procesanimateR implements an animation
library for bupaR that renders interactive process animations
using the web standard SVG.</p>
      <p>In procesanimateR, each case is represented by a
separate token that moves along the process map with speed
relative to the observed activity processing and waiting times.
The visual appearance of tokens can be customised using any
SVG shape and core properties, such as size and color, and can
be dynamically adjusted based on event attributes. In a recent
release, the package was extended with support to project
discovered process maps to an interactive geographical map
in which each process activity has a fixed position, as shown
in Figure 2. This enables new forms of animation and process
visualisation in which the position of activities and the length
of edges are assigned clear semantics. This contrasts to the
often random placement of activities and edges in traditional
process visualisation tools.</p>
    </sec>
    <sec id="sec-5">
      <title>F. CollaborateR</title>
      <p>
        Whereas most functionalities of bupaR have been
developed with no specific type of process in mind, this can not be
said about collaborateR [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. The origin of this package
lies in the area of software engineering. As its name implies,
it focuses on the collaboration between different process
participants. The underlying algorithm was published in recent
previous work [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <p>
        In the fast-changing and flexible software engineering
environments of today, knowledge management is critical. A clear
4https://github.com/bupaverse/propro
overview on how software developers collaborate can unearth
valuable patterns such as the general structure of collaboration,
crucial resources, and risks (e.g. losing certain knowledge
when a programmer decides to leave the company). Version
control system (VCS) logs, which keep track of which tasks
team members work on and when, contain data to provide
these insights. collaborateR provides an algorithm which
extracts and visualises a collaboration graph from VCS log
data. The algorithm is partly based on the principles that also
underlie the Fuzzy Miner [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Its structure consists of four
phases: (1) building the base graph, (2) calculating weights
for nodes and edges, and (3) simplifying the graph using
aggregation and abstraction. Each of these phases offers the
user flexibility to decide which parameters and metrics to
include. This makes it possible for the human expert to exploit
her existing knowledge about the project and team to guide
the algorithm in building the graph that best fits the specific
use case, and hence will provide the most accurate insights.
      </p>
      <p>An example of a collaboration graph is shown in Figure 3.
In this graph, pink nodes are individual programmers, while
blue nodes are clusters of programmers. When programmers
have worked on the same files of the project, i.e. the same
software code, an edge is drawn between them. The colouring
of the edges indicates whether programmers worked separately
(orange), together using pair programming (green), or a mix
of both (blue). The size of both nodes and edges indicates
the importance of the programmers and the strength of their
relationships. The package is available on GitHub.5</p>
      <sec id="sec-5-1">
        <title>III. MATURITY AND USAGE</title>
        <p>The packages of the bupaR collection that have been
published on the Comprehensive R Archive Network (13 at the
moment of writing, cf. Table I) gathered over 300k downloads
- more than half of which during the past year. The tools have
5https://github.com/bupaverse/collaborateR
been downloaded in 140 different countries. The core packages
bupaR, edeaR and processmapR respectively receive on
average about 7k, 5k and 4k downloads each month, and are
amongst the 10% most downloaded R packages.</p>
        <p>
          bupaR has been used in general process mining research
[
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]–[
          <xref ref-type="bibr" rid="ref17">17</xref>
          ], and has been applied in more specific areas such as
process simulation [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], transportation [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], healthcare [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ],
Learning Analytics [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]–[
          <xref ref-type="bibr" rid="ref24">24</xref>
          ], predictive process monitoring
[
          <xref ref-type="bibr" rid="ref25">25</xref>
          ], [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ], and others [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ], [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ]. As the majority of users are
practitioners, bupaR has a profound impact on the adoption
of process mining in various fields such as healthcare,
consulting, manufacturing, telecommunications, and governmental
agencies. In more popular media, various case studies are
available, for example, in the context of traditional business
processes, such as purchase-to-pay processes6, how to use it
with Power BI7, or how to use it for web analytics.8 The
new functionalities described in this paper further enhance the
usefulness of bupaR for both researchers and practitioners.
        </p>
      </sec>
      <sec id="sec-5-2">
        <title>IV. CONCLUSION AND FUTURE WORK</title>
        <p>Since the introduction of bupaR, the ecosystem has steadily
grown into broad toolbase, and has become widely used for
process analytics. The extensions described in this paper will
further enhance the use of bupaR, and its role in the adoption
of process mining by practitioners in various industries.</p>
        <p>Future work will focus on the extension of the new
functionalities described in this paper, as well as adding new
components to the eco-system. While logbuildR is now a graphical
interface, it will be extended in the future so that the user will
also receive the R-code that is needed to produce the event data
at the end. This code can be used for scripts or reports, thereby
making the log building step also reproducible. Furthermore,
the creation of collaboration graphs will be generalised so that
it can be used for other process data as well, beyond version
control systems. New functionalities in the area of process
discovery, process data visualisation and predictive process
monitoring are currently being developed.</p>
      </sec>
      <sec id="sec-5-3">
        <title>ACKNOWLEDGEMENTS</title>
        <p>The authors would like to warmly thank all users who are
actively contributing to the bupaR-framework by submitting
issues and pull requests on the GitHub repositories.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>G.</given-names>
            <surname>Janssenswillen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Depaire</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Swennen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Jans</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Vanhoof</surname>
          </string-name>
          , “
          <article-title>bupar: Enabling reproducible business process analysis</article-title>
          ,
          <source>” KnowledgeBased Systems</source>
          , vol.
          <volume>163</volume>
          , pp.
          <fpage>927</fpage>
          -
          <lpage>930</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>G.</given-names>
            <surname>Janssenswillen</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Depaire</surname>
          </string-name>
          , “
          <article-title>bupar: Business process analysis in r</article-title>
          .”
          <source>in International Conference on Business Process Management - Demonstration track</source>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3] --,
          <source>xesreadR: Read and Write XES Files</source>
          ,
          <year>2019</year>
          ,
          <source>R package version 0.2</source>
          .3. [Online]. Available: https://CRAN.Rproject.org/package=xesreadR
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>W. van der Aalst</surname>
          </string-name>
          ,
          <article-title>Process mining: discovery, conformance and enhancement of business processes</article-title>
          . Heidelberg: Springer,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>N.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <surname>G. Van Houdt</surname>
          </string-name>
          , and G. Janssenswillen, “
          <article-title>Towards more structured data quality assessment in the process mining field: the daqapo package</article-title>
          ,”
          <source>in Proceedings of the European R Users Meeting</source>
          <year>2020</year>
          ,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>N.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <surname>G. Van Houdt</surname>
          </string-name>
          ,
          <string-name>
            <surname>and G.</surname>
          </string-name>
          <article-title>Janssenswillen, daqapo: Data Quality Assessment for Process-Oriented Data</article-title>
          ,
          <year>2020</year>
          ,
          <source>R package version 0.3.0.</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>A. J. M. M. Weijters</surname>
            and
            <given-names>J. T. S.</given-names>
          </string-name>
          <string-name>
            <surname>Ribeiro</surname>
          </string-name>
          , “
          <article-title>Flexible heuristics miner (FHM),” in CIDM</article-title>
          . IEEE,
          <year>2011</year>
          , pp.
          <fpage>310</fpage>
          -
          <lpage>317</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A.</given-names>
            <surname>Burattin</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Sperduti</surname>
          </string-name>
          , “
          <article-title>Heuristics miner for time intervals</article-title>
          ,” in ESANN,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Janssenswillen, propro: Build Probabilistic Process Models Using MCMC, https</article-title>
          ://github.com/bupaverse/propro.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>G.</given-names>
            <surname>Janssenswillen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Depaire</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Christel</surname>
          </string-name>
          , “
          <article-title>Enhancing discovered process models using bayesian inference and mcmc</article-title>
          ,”
          <source>in Proceedings of the 2020 BPI Workshop</source>
          ,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>L.</given-names>
            <surname>Jooken</surname>
          </string-name>
          and G. Janssenswillen, collaborateR:
          <string-name>
            <given-names>Build</given-names>
            <surname>Collaboration Graph Using Version Control System Logs</surname>
          </string-name>
          ,
          <source>R package version 0.1.0.</source>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>L.</given-names>
            <surname>Jooken</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Creemers</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Jans</surname>
          </string-name>
          , “
          <article-title>Extracting a collaboration model from vcs logs based on process mining techniques</article-title>
          ,” in International Conference on Business Process Management. Springer,
          <year>2019</year>
          , pp.
          <fpage>212</fpage>
          -
          <lpage>223</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>C. W.</given-names>
            <surname>Gu</surname>
          </string-name>
          <article-title>¨nther and</article-title>
          <string-name>
            <surname>W. M. Van Der Aalst</surname>
          </string-name>
          , “
          <article-title>Fuzzy mining-adaptive process simplification based on multi-perspective metrics</article-title>
          ,” in International conference on business process management. Springer,
          <year>2007</year>
          , pp.
          <fpage>328</fpage>
          -
          <lpage>343</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>M.</given-names>
            <surname>Jans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Soffer</surname>
          </string-name>
          , and T. Jouck, “
          <article-title>Building a valuable event log for process mining: an experimental exploration of a guided process</article-title>
          ,
          <source>” Enterprise Information Systems</source>
          , vol.
          <volume>13</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>601</fpage>
          -
          <lpage>630</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>Burattin</surname>
          </string-name>
          , “
          <article-title>Integrated, ubiquitous and collaborative process mining with chat bots.” in BPM (PhD/Demos</article-title>
          ),
          <year>2019</year>
          , pp.
          <fpage>144</fpage>
          -
          <lpage>148</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>S.</given-names>
            <surname>Shershakov</surname>
          </string-name>
          , “
          <article-title>Enhancing efficiency of process mining algorithms with a tailored library: Design principles and performance assessment</article-title>
          .”
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>S.</given-names>
            <surname>Kuehnel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. T.-N.</given-names>
            <surname>Trang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Lindner</surname>
          </string-name>
          , “
          <article-title>Conceptualization, design, and implementation of econbpc-a software artifact for the economic analysis of business process compliance</article-title>
          ,” in International Conference on Conceptual Modeling. Springer,
          <year>2019</year>
          , pp.
          <fpage>378</fpage>
          -
          <lpage>386</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>M.</given-names>
            <surname>Mesabbah</surname>
          </string-name>
          and
          <string-name>
            <surname>S. McKeever</surname>
          </string-name>
          , “
          <article-title>Presenting a hybrid processing mining framework for automated simulation model generation,” in 2018 Winter Simulation Conference (WSC)</article-title>
          . IEEE,
          <year>2018</year>
          , pp.
          <fpage>1370</fpage>
          -
          <lpage>1381</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>F.</given-names>
            <surname>Mannhardt</surname>
          </string-name>
          and
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Landmark</surname>
          </string-name>
          , “
          <article-title>Mining railway traffic control logs,” Transportation research procedia</article-title>
          , vol.
          <volume>37</volume>
          , pp.
          <fpage>227</fpage>
          -
          <lpage>234</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>A. P.</given-names>
            <surname>Kurniati</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>McInerney</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Zucker</surname>
          </string-name>
          , G. Hall,
          <string-name>
            <given-names>D.</given-names>
            <surname>Hogg</surname>
          </string-name>
          , and
          <string-name>
            <given-names>O.</given-names>
            <surname>Johnson</surname>
          </string-name>
          , “
          <article-title>A multi-level approach for identifying process change in cancer pathways</article-title>
          ,” in International Conference on Business Process Management. Springer,
          <year>2019</year>
          , pp.
          <fpage>595</fpage>
          -
          <lpage>607</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>J. P.</given-names>
            <surname>Salazar-Fernandez</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Sepu´lveda, and</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Munoz-Gama</surname>
          </string-name>
          , “
          <article-title>Influence of student diversity on educational trajectories in engineering highfailure rate courses that lead to late dropout,” in 2019 IEEE Global Engineering Education Conference (EDUCON)</article-title>
          . IEEE,
          <year>2019</year>
          , pp.
          <fpage>607</fpage>
          -
          <lpage>616</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>D.</given-names>
            <surname>Etinger</surname>
          </string-name>
          , T. Orehovacˇki, and S. Babic´, “
          <article-title>Applying process mining techniques to learning management systems for educational process model discovery and analysis</article-title>
          ,
          <source>” in International Conference on Intelligent Human Systems Integration</source>
          . Springer,
          <year>2018</year>
          , pp.
          <fpage>420</fpage>
          -
          <lpage>425</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>J.</given-names>
            <surname>Saint</surname>
          </string-name>
          , D. Gasˇevic´, W. Matcha,
          <string-name>
            <given-names>N. A.</given-names>
            <surname>Uzir</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Pardo</surname>
          </string-name>
          , “
          <article-title>Combining analytic methods to unlock sequential and temporal patterns of selfregulated learning</article-title>
          ,
          <source>” in Proceedings of the Tenth International Conference on Learning Analytics &amp; Knowledge</source>
          ,
          <year>2020</year>
          , pp.
          <fpage>402</fpage>
          -
          <lpage>411</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>D. Gasˇevic´</surname>
            , W. Matcha, J. Jovanovic´,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Pardo</surname>
            ,
            <given-names>L.-A.</given-names>
          </string-name>
          <string-name>
            <surname>Lim</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Gentili</surname>
          </string-name>
          et al., “
          <article-title>Discovering time management strategies in learning processes using process mining techniques</article-title>
          ,
          <source>” in European Conference on Technology Enhanced Learning</source>
          . Springer,
          <year>2019</year>
          , pp.
          <fpage>555</fpage>
          -
          <lpage>569</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>M.</given-names>
            <surname>Tipirishetty</surname>
          </string-name>
          , “
          <article-title>Predictive process monitoring for lead-to-contract process optimization</article-title>
          ,”
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>B. A.</given-names>
            <surname>Tama</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Comuzzi</surname>
          </string-name>
          , “
          <article-title>An empirical comparison of classification techniques for next event prediction using business process event logs</article-title>
          ,
          <source>” Expert Systems with Applications</source>
          , vol.
          <volume>129</volume>
          , pp.
          <fpage>233</fpage>
          -
          <lpage>245</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>P.</given-names>
            <surname>Delias</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Kazanidis</surname>
          </string-name>
          , “
          <article-title>Exploiting higher-order dependencies for process analytics. the case for political events' analysis,”</article-title>
          <string-name>
            <surname>Kybernetes</surname>
          </string-name>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>W.</given-names>
            <surname>Ma</surname>
          </string-name>
          , “
          <article-title>Bias assessment and reduction in kernel smoothing</article-title>
          ,”
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>