<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>iPRODICT - Intelligent Process Prediction based on Big Data Analytics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nijat Mehdiyev</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andreas Emrich</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Björn Stahmer</string-name>
          <email>bjoern.stahmer@saarstahl.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peter Fettke</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peter Loos</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute for Information Systems (IWi) at German Research Center for Artificial Intelligence (DFKI) and Saarland University Saarbruecken</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Saarstahl AG</institution>
          ,
          <addr-line>Völklingen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The major purpose of the iPRODICT research project is to operationalize industrial internet of things driven predictive and prescriptive analytics by embedding it to the operational processes. Particularly, within an interdisciplinary team of researchers and industry experts, we investigate an integration of diverse technologies to enable real time sensor data driven decision making for process improvements and optimization in the process industry. The case study concentrates on adaptation and optimization of both manufacturing and business processes by analyzing the quality of the semi-finished steel products proactively based on the sensor data obtained from the continuous casting process and chemical properties of the steel. In the underlying paper, we discussed three business process management specific use cases in the sensor-driven process industry, namely (i) business process instance adaptation, (ii) business process instanceto-instance adaptation and optimization and (iii) business process instance-tomodel adaptation. Furthermore, we discuss the components of the proposed predictive enterprise solution and their dependencies briefly and provide an insight to the challenges and lessons learnt over the diverse stages of the case study.</p>
      </abstract>
      <kwd-group>
        <kwd>Predictive Analytics</kwd>
        <kwd>Process Adaptation and Optimization</kwd>
        <kwd>Process Industry</kwd>
        <kwd>Sensor-driven Business Process Management</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>1.1</p>
    </sec>
    <sec id="sec-2">
      <title>Introduction</title>
      <sec id="sec-2-1">
        <title>Operationalizing and Embedding Analytics to Business Processes</title>
        <p>
          Since the firms adopt similar products and identical technologies, high-performance
business processes are one of the last points of differentiation [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. The dynamic
capability of managing the business processes proactively requires the embedding of
insights gained from descriptive, predictive and prescriptive analysis to business
processes. The recent proliferation of industrial internet of things, coined also as Industry
4.0, creates enormous opportunities especially for manufacturing firms to advance their
analytical capabilities. Industry 4.0 enables the digitalization of horizontal and vertical
integration of value chains both within the corporation and across the whole supply
chain. A successful horizontal integration between diverse in-house functional areas
such as production management, quality management, inventory management and
maintenance management requires a robust vertical integration of the
operational/production processes (shop-floor) with the related business processes. In order to enable
such an integration the manufacturing firms need to have the capabilities/platforms to
collect, distribute, share and analyze the data from diverse levels of the automation
pyramid (both business and production levels) to make the strategic decisions in real
time. These capabilities should enable transparency, interoperability and
communication over the whole value chain.
        </p>
        <p>Within the frame of the iPRODICT research project, we explored the possibilities to
integrate novel technologies and approaches to develop a predictive enterprise software
for the process industry to manage/control the business and operational processes in
real time. For this purpose, we developed a prototype which is capable of supporting
both unilateral and bilateral integration of (i) Machine Learning, (ii) Complex Event
Processing, (iii) Business Process Management, (iii) Image Recognition, (iv)
Mathematical Optimization and (v) Data Visualization technologies and methods.
Furthermore, we explore the opportunities offered by industrial internet of things that enable
the digital transformation in both manufacturing and business processes.
1.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>A Case Study from Steel Industry</title>
        <p>The underlying case study conducts initial investigations and preliminary attempts for
proactive management, adaptation and optimization of business and operational
processes at one of the biggest German steelmaking company, Saarstahl AG. The core
focus of the research lies in the efficient exploitation of the real-time data obtained in
the diverse stages of the steel bar production for making strategically critical decisions.
The key challenge when handling such voluminous data with high velocity is assuring
reliability, timeliness and scalability. Furthermore, since we deal with semi-automation
of the business processes, the data visualization capabilities play also a central role for
supporting domain experts to make the relevant decisions.</p>
        <p>
          Particularly, the iPRODICT research project aims to integrate the shop floor data
obtained from the continuous casting process and the data describing the chemical
properties of the steel vertically with the business process data. The irregularities in the
chemical properties of the steel and abnormalities in the continuous casting parameters
such as tundish mass, air ingress, mold level fluctuations, oscillation frequency, mold
heat flux, mold water flow, casting speed and casting speed change influence the quality
of the (semi)finished steel bars. Such irregular parameter values may lead to steel
surface defects (surface decarburization, cracks and etc.) which are defined as a deviation
from the normative appearance, form, size, macrostructure [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]. Various additional
production processes such as steel pickling, surface grinding, etc. are required to be
performed contingent upon the grades of the steel surface defect in order to attain the
desired level of the product quality. This in turn requires agile capabilities to adapt the
business processes such as reallocating both human and machine resources, dynamic
optimization of the production and scheduling plans as well as matching the demand
and supply in real time. Currently the Saarstahl AG assesses the quality of semi-finished
products by performing multi-stage visual inspection which comes at a high expense.
The proposed predictive enterprise analytics solution aims to semi-automate the
inspection process by providing real-time situational awareness about the product quality
based on the industrial internet of things.
        </p>
        <p>The remainder of this paper is structured as follows: Section 2 provides an overview
of the related work in predictive analytics, business process management, complex
event processing and optimization domains. Section 3 introduces three BPM uses cases
in the sensor-driven process industry, namely business process instance adaptation,
process instance-to-instance adaptation and process instance-to-model adaptation. Section
4 provides a brief overview of the proposed system architecture. Finally, section 5
concludes the paper by discussing the lessons learnt.
2</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Related Work</title>
      <p>
        Predictive Analytics and Business Process Management. Recently, many attempts
have been made to apply machine learning algorithms in the business process
management domain. Scholars examined the applicability of diverse machine learning and
artificial intelligence approaches for (i) regression problems such as estimation of the
remaining process completion time [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and (ii) classification problems such as
next process event prediction, business process outcome prediction, violation of service
level agreements and etc. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. The application of deep learning
algorithms has also been gaining the popularity for both regression and classification
problems [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. A thorough analysis of these studies reveals that, they mainly use
process log data provided by Process Aware Information Systems. Control flow data
are especially preferred due to their easy accessibility and simplicity. The main
superiority of the proposed process prediction approaches within the iPRODICT research
project is the exploitation of big data obtained from the sensors which provide a
comprehensive overview of the process parameters. Industrial internet of things driven
business process management has been recently gaining great attention but the
applications/case studies are currently very limited. By providing the relevant use cases we
aim to address this gap.
      </p>
      <sec id="sec-3-1">
        <title>Complex Event Processing and Business Process Management. An integration of</title>
        <p>
          Complex Event Processing and Business Process Management is often coined in the
literature as Event Driven Business Process Management [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. An overview of
the recent literature reveals that the scholars mainly concentrate on the modelling
aspects of such an integration [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. There are also studies which examine the role of
Complex Event Processing as an active Business Activity Monitoring tool and provide a
proof of concept [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. However, integrating predictive analytics into the Complex
Event Processing in the Business Process Management domain in different formats
such as data driven event pattern detection from process data or streaming the
prediction results as primitive events to CEP, have not been addressed in detail. Within the
frame of the iPRODICT research project we made relevant contributions to address this
research gap.
        </p>
        <p>
          Mathematical Optimization and Business Process Management. An
implementation of mathematical optimization domain in the business process domains has also
been investigated by researchers [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ],[
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. A number of studies addressed single and
multi-objective business process optimization with both conventional and
meta-heuristic optimization approaches [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ]. However, an analysis of these papers suggests that
the optimization input parameters and constraint values were mainly provided by the
experts based on their domain knowledge or solely on assumptions. In the iPRODICT
research project we investigated data driven real time optimization by leveraging the
information obtained from the industrial internet of things.
        </p>
        <p>
          Complex Event Processing and Machine Learning. An integration of machine
learning approaches to CEP systems and their application in process monitoring have also
been recently investigated. [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ] proposed a Kalman Filter based approach for rule
parameter prediction in CEP systems. [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ] applied adaptive moving regression to predict
the IoT data and integrated it to CEP systems. [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ] investigated rule-based event
processing systems and languages. [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ] examined event pattern identification through
machine learning approaches. To our best knowledge, the iPRODICT research project is
one of the first in the domain of applying the machine learning algorithms on top of a
big data platform to infer complex event patterns for managing both business and
operational processes in real-time.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>BPM Use Cases in Sensor-driven Process Industry</title>
      <p>Traditionally known process mining scenarios do not apply to sensor-based scenarios
since the sensor data don’t constitute atomic logs of business events. Capabilities such
as data fusion and complex event processing have to be applied, in order to achieve
similar results for sensor data. The iPRODICT research project closes this gap by
providing a system approach to capturing business process events from sensor data.
3.1</p>
      <sec id="sec-4-1">
        <title>Use Case I: Process Instance Adaptation &amp; Process Step Recommendation</title>
        <p>Instance A.4711</p>
        <p>A
Rationale. The case of “process instance adaptation” denotes the run-time adaptation
of the given process instance. Usually, this is seen as a recommendation of the next
process step or activity based on the execution logs of the current process instance and
the execution log histories from prior process instances of the same process model. In
our scenario, we focus on situations where sensor data have a crucial impact on the
process outcome, i.e. the step chosen, while the log data give slim to no indication at
all about this process outcome.</p>
        <p>Use Case Description. The case at Saarstahl AG deals with the quality control of steel
slabs. Regardless of the final products, the slabs are later transformed into, the steel
production process is quite linear before that– with the exception of the chemical mix
that constitutes a batch for steel casting. According to an error model, the quality of the
steel slabs is being assessed and certain post-processing steps are triggered. This can be
done according to standard work plans for materials, individual customer requirements
or as a countermeasure for eventual errors.</p>
        <p>Methods. The two predictions for steel surface failures and post-processing steps can
be formulated as a time series classification problems. The error prediction is a
multilabel classification, which finds surface failures for a given steel slab. The prediction
of post-processing steps is the prediction of the next process step which relies on a
multi-class classification. Each class represents the possible activity types of the
postprocessing steps that are available. Input for both scenarios is the sensor data from the
steel casting plant and chemical properties of the steel for the given batches. The size
of the dataset delivered by Saarstahl was about 30 Terabytes which comprised the
information about process parameters obtained from about 450 sensors positioned in the
various stages of the continuous casting process, the chemical properties of the steel for
each individual charges, the pre-defined post-processing activities in the standard work
plans for the materials, the results of the quality inspection procedures for almost 9000
steel slabs, the occurred error types and the keys for matching the sensor data and the
chemical analysis data with the individual steel slabs. The results from the error
predictions are used as input for post-processing step predictions along with the standard work
plan and order information for the given steel brand or current order.</p>
        <sec id="sec-4-1-1">
          <title>Instance A.4711</title>
          <p>A
3.2</p>
        </sec>
      </sec>
      <sec id="sec-4-2">
        <title>Use Case II: Process Instance-to-Instance Adaptation &amp; Optimization</title>
        <p>B</p>
        <p>C
A
B
Adaptation of A.4711
causes delay of A.4712</p>
        <sec id="sec-4-2-1">
          <title>Instance A.4712</title>
          <p>C
Rationale. An “instance-to-instance” adaptation means the run-time adaptation or
coordination of several running process instances. In business processes, activities are
often being explicitly performed by either human or system resources such as machines
or computers. Moreover, goods and / or information are being transformed in the
business process. Especially for the latter, one important characteristic of process industry
comes into play: The synthetical and analytical production stages blur the traces
between product and order, i.e. the product is being heavily transformed in the process
and the final allocation to the constituting order is often being done at the very end of
the production process.</p>
          <p>Use Case Description. At Saarstahl AG, the orders constitute important information
for the selection of a steel brand for the next batches to cast. However, there is no direct
association of a given steel slab with its respective given order throughout the casting
process itself. Therefore, the allocation of slabs or the respective end products to the
orders is carried out at the end of the production process. Different criteria such as
timeliness, priority and storage availability have to be considered in order to make this
decision.</p>
          <p>Methods. Overall, the instances are being optimized regarding the given criteria in
terms of a multi-criteria optimization. Using an underlying cost function helps to
identify the best possible allocations. In the underlying study we examined the applicability
of meta-heuristic optimization approaches, particularly genetic algorithm based
optimization methods.
3.3</p>
        </sec>
      </sec>
      <sec id="sec-4-3">
        <title>Use Case III: Process Instance-to-Model Adaptation</title>
        <p>InIsntIsantnsacAtnaeznAAz..A447.741171111</p>
        <p>A A</p>
        <p>BBB
B2B2B2</p>
        <p>CC C</p>
        <p>Adaptation of several
instances of model A
causes a model change
to model A‘</p>
        <p>Model A'</p>
        <p>C
Rationale. Process discovery and model enhancement are core fields of process
mining. They are usually performed on process logs, where each log represents an atomic
denotation of a business event, i.e. an executed process activity. In sensor-based
scenarios, this is much harder to achieve, as time series of sensor data have to be
preprocessed, aggregated, segmented and condensed into such log information. For that
matter, process discovery in the internet of things must rely on different ground data to
derive process models from process instances.</p>
        <p>Use Case Description. At Saarstahl AG, almost 2000 steel types exist. Each one of
them has its own quality characteristics, recipes for its chemical mixture and associated
standard work plans. For example, a certain steel type may require mandatory
postprocessing steps in order to fulfill the formulated quality requirements. In our case, it
is interesting to analyze, whether the insights gathered from quality control (cf. use case
I) can be utilized to adapt the business process model according to those insights. By
that means, it should be analyzed, whether a formerly optional post-processing step
should be made obligatory or vice versa.</p>
        <p>Methods. In the initial stage of the iPRODICT research project, the global reference
process model was created by conducting interviews with the experts from Saarstahl
AG. The process modelling was carried out in Software AG’s ARIS by using the event
driven process chain approach. The obtained business process model incorporates the
sequence of different activities ranging from the order processing through the
production processes of the steel slabs. Subsequently, the variants of the process were
identified in terms of the individiual steel types. For this purpose the related work plans which
provide information about the pre-defined activities (either upon request from the
customers or the internal production requirements) and the quality inspection results as
described in use case I were used to induce the process models in the instance level.
Along with well-known algorithms from process discovery and model enhancement,
the sensor data were segmented towards the slabs and their steel types. We computed
different information retrieval metrics (particularly based on the a-priori probability
distributions) to measure difference aspects of model similarities and extracted the
data4</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>System Design</title>
      <p>driven implications and suggestions for enhancing the global reference model which
were derived initially based on expert knowledge.</p>
      <p>A system capable of performing the aforementioned use cases is depicted in Figure 4.</p>
      <p>The data acquisition encompasses sensor data, mobility data, video data assessing
the surface quality of steel slabs and data inventories from enterprise systems such as
ERP systems, order allocation systems, etc. In order to align the data and to perform
the necessary pre-processing, cleansing, aggregation and segmentation a component is
dedicated to this task of data preparation. For the different analyses carried out in
iPRODICT, the system must cater different mechanisms for real-time analysis: both
machine learning and complex event processing components. In the iPRODICT
research project we analyzed the applicability of different Machine Learning approaches
particularly for multi-class time series classification problem. For this purpose we
applied different approaches. Classification with state-of-the-art algorithms such as
decision trees, random forest, logistic regression, rule-induction techniques based on the
features extracted from time series sensor data using the feature templates provided by
domain experts was the initial approach. Since, the domain knowledge in the process
industry about the impact of individual process parameter values (measured by sensors)
to the product quality is restricted, which makes the supervised feature extraction
almost infeasible, we also investigated unsupervised approaches. To achieve the
satisfactory results, we applied deep learning techniques particularly stacked LSTM (Long
short-term memory) Autoencoders to extract the features from the time series data in
an unsupervised manner. The extracted features which can also model the non-linear
interdependencies among the individual sensor variables are then fed into a deep
feedforward neural networks to carry out the classification.</p>
      <p>Since the underlying data is quite imbalanced, i.e. certain error constellations either
occur quite scarcely or not at all, Machine Learning results have to be combined with
rule induction mechanisms to enhance existing expert rules to both allow insights from
the gathered data and to counteract rule inductions introduced through random data
correlations or sensor faults leveraging expert knowledge. The communication among
those components is being done via an asynchronous message bus. The dashboards
visualize the analytic results and provide action recommendations to the various
stakeholders in the end-to-end process at the steel casting plant, the quality control and the
production planning. In order to tackle the imbalanced nature of the data we also
examined various approaches such as over/undersampling and cost-sensitive learning
techniques to achieve more reliable results.
5</p>
    </sec>
    <sec id="sec-6">
      <title>Lessons Learnt</title>
      <p>
        Both practitioners and scholars suggest that the increasing availability of data facilitates
the systematic analysis based on data mining and artificial intelligence approaches to
beat the intuition based predictions [29]. Tremendous volume of data with high
velocity, the changing nature of both input and output data distributions over time,
uncertainty related to data and prediction environment and other factors was the main
motivator for developing a data-driven decision support solution within the frame of the
iPRODICT research project. However, the experiences gained during the different
stages of the iPRODICT research project suggest that it is also very important to
incorporate process knowledge obtained from the domain experts to machine learning
analysis for process adaptation, optimization and monitoring. The ability of processing
unstructured information makes the judgmental analytics crucial. Recent evidence from
literature suggests that human judgments and machine learning techniques must be
combined. Integration is effective when judgments are collected in a systematic manner
and then used as inputs to the quantitative models, rather than simply used as
adjustments to the output [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
      </p>
      <p>
        Furthermore, the gap between the theoretical development of the predictive analytics
approaches and their application in the industrial and business environments can also
be observed in the underlying case study. This phenomenon which is described by [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]
as “companies using quantitative forecasting methods does not appear to have changed
over time, despite enormous advances in the use of computer technology” can be
explained with the survey results conducted by [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ] where almost half of the respondents
from multi-national companies considers the “lack of understanding of how to use the
analytics to improve the business” as the main obstacle of adoption of analytics in their
organizations. During both requirements analysis and implementation phase of the
project, it has been repeatedly revealed that building machine learning based solution for
automating the decision making processes is not preferred by the production managers.
There is a need for transition phase which is necessary for building trust, during which
the solution acts as a decision support system with high explanatory capabilities and
easily understandable structure. After ensuring that the system provides robustness and
accuracy in the desired level, the integration of the analytics to the business process can
be automated.
      </p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgment</title>
      <p>This research was funded in part by the German Federal Ministry of Education and
Research under grant numbers 01IS14004A (project iPRODICT). The iPRODICT
research project consortium consists of Software AG, Saarstahl AG, Pattern Recognition
Company GmbH, Fraunhofer Institute for Intelligent Analysis and Information
Systems (IAIS), Blue Yonder GmbH and German Research Center for Artificial
Intelligence (DFKI).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Davenport</surname>
            ,
            <given-names>T.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Harris</surname>
            ,
            <given-names>J.G.</given-names>
          </string-name>
          :
          <article-title>Competing on analytics: The new science of winning</article-title>
          . Harvard Business School Press, Boston, MA, USA (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Popa</surname>
            ,
            <given-names>E.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kiss</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>Assessment of surface defects in the continuously cast steel</article-title>
          .
          <source>Acta Technica Corviniensis - Bulletin of Engineering</source>
          <volume>4</volume>
          (
          <issue>4</issue>
          ),
          <volume>109</volume>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>van der Aalst</surname>
            ,
            <given-names>W.M.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schonenberg</surname>
            ,
            <given-names>M.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Song</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Time prediction based on process mining</article-title>
          .
          <source>Information Systems</source>
          <volume>36</volume>
          (
          <issue>2</issue>
          ),
          <fpage>450</fpage>
          -
          <lpage>475</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Rogge-Solti</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weske</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>Prediction of remaining service execution time using stochastic petri nets with arbitrary firing delays</article-title>
          . In: Basu,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Pautasso</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Fu</surname>
          </string-name>
          ,
          <string-name>
            <surname>X. (eds.) ICSOC</surname>
          </string-name>
          <year>2013</year>
          .
          <article-title>LNCS</article-title>
          , vol.
          <volume>8274</volume>
          , pp.
          <fpage>389</fpage>
          -
          <lpage>403</lpage>
          . Springer, Heidelberg (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Polato</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sperduti</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burattin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>de Leoni</surname>
          </string-name>
          , M.:
          <article-title>Time and activity sequence prediction of business process instances</article-title>
          .
          <source>arXiv preprint arXiv:1602.07566</source>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Kang</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kang</surname>
          </string-name>
          , S.-H.:
          <article-title>Real-time business process monitoring method for prediction of abnormal termination using KNNI-based LOF prediction</article-title>
          .
          <source>Expert Systems with Applications</source>
          <volume>39</volume>
          (
          <issue>5</issue>
          ),
          <fpage>6061</fpage>
          -
          <lpage>6068</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Kang</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kang</surname>
            ,
            <given-names>S.-H.:</given-names>
          </string-name>
          <article-title>Periodic performance prediction for real-time business process monitoring</article-title>
          .
          <source>Industrial Management &amp; Data Systems 112(1)</source>
          ,
          <fpage>4</fpage>
          -
          <lpage>23</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Leontjeva</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Conforti</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Di</given-names>
            <surname>Francescomarino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Dumas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Maggi</surname>
          </string-name>
          ,
          <string-name>
            <surname>F.M.:</surname>
          </string-name>
          <article-title>Complex symbolic sequence encodings for predictive monitoring of business processes</article-title>
          . In: MotahariNezhad,
          <string-name>
            <given-names>H.R.</given-names>
            ,
            <surname>Recker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Weidlich</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. (eds.) BPM</surname>
          </string-name>
          <year>2015</year>
          .
          <article-title>LNCS</article-title>
          , vol.
          <volume>9253</volume>
          , pp.
          <fpage>297</fpage>
          -
          <lpage>313</lpage>
          . Springer, Switzerland (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Le</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nauck</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gabrys</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Martin</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Sequential Clustering for Event Sequences and Its Impact on Next Process Step Prediction</article-title>
          .
          <source>In: International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems</source>
          , pp.
          <fpage>168</fpage>
          -
          <lpage>178</lpage>
          . Springer, Cham (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Le</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gabrys</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nauck</surname>
            ,
            <given-names>D.:</given-names>
          </string-name>
          <article-title>A hybrid model for business process event and outcome prediction</article-title>
          .
          <source>Expert Systems</source>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Unuvar</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lakshmanan</surname>
            ,
            <given-names>G.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Doganata</surname>
            ,
            <given-names>Y.N.</given-names>
          </string-name>
          :
          <article-title>Leveraging path information to generate predictions for parallel business processes</article-title>
          .
          <source>Knowledge and Information Systems</source>
          <volume>47</volume>
          ,
          <fpage>433</fpage>
          -
          <lpage>461</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Evermann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rehse</surname>
            ,
            <given-names>J.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fettke</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Predicting process behaviour using deep learning</article-title>
          .
          <source>Decision Support Systems</source>
          <volume>100</volume>
          ,
          <fpage>129</fpage>
          -
          <lpage>140</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Tax</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Verenich</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>La</given-names>
            <surname>Rosa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Dumas</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          :
          <article-title>Predictive business process monitoring with LSTM neural networks</article-title>
          .
          <source>In: International Conference on Advanced Information Systems Engineering</source>
          , pp.
          <fpage>477</fpage>
          -
          <lpage>492</lpage>
          . Springer, Cham (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Krumeich</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weis</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Werth</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loos</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Event-driven business process management: where are we now? A comprehensive synthesis and analysis of literature</article-title>
          .
          <source>Business Process Management Journal</source>
          <volume>20</volume>
          ,
          <fpage>615</fpage>
          -
          <lpage>633</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>von</surname>
            <given-names>Ammon</given-names>
          </string-name>
          , R.:
          <article-title>Event-driven business process management</article-title>
          .
          <source>Encyclopedia of Database Systems</source>
          , pp.
          <fpage>1068</fpage>
          -
          <lpage>1071</lpage>
          . Springer US (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Krumeich</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mehdiyev</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Werth</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loos</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Towards an extended metamodel of eventdriven process chains to model complex event patterns</article-title>
          .
          <source>In: International Conference on Conceptual Modeling</source>
          , pp.
          <fpage>119</fpage>
          -
          <lpage>130</lpage>
          . Springer, Cham, (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Janiesch</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Matzner</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Müller</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Beyond process monitoring: a proof-of-concept of event-driven business activity management</article-title>
          .
          <source>Business Process Management Journal</source>
          <volume>18</volume>
          ,
          <fpage>625</fpage>
          -
          <lpage>643</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Vergidis</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tiwari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Majeed</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Business process analysis and optimization: Beyond reengineering</article-title>
          .
          <source>IEEE Transactions on Systems, Man, and Cybernetics</source>
          , Part C (
          <article-title>Applications</article-title>
          and Reviews)
          <volume>38</volume>
          ,
          <fpage>69</fpage>
          -
          <lpage>82</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Vergidis</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tiwari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Majeed</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Business process improvement using multi-objective optimisation</article-title>
          .
          <source>BT Technology Journal</source>
          <volume>24</volume>
          ,
          <fpage>229</fpage>
          -
          <lpage>235</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Tiwari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vergidis</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Majeed</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Evolutionary Multi-objective Optimization of Business Processes</article-title>
          .
          <source>In: IEEE Congress on Evolutionary Computation</source>
          , pp.
          <fpage>3091</fpage>
          -
          <lpage>3097</lpage>
          . IEEE (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Turchin</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gal</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wasserkrug</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Tuning complex event processing rules using the prediction-correction paradigm</article-title>
          .
          <source>In: Proceedings of the Third ACM International Conference on Distributed Event-Based Systems</source>
          , pp.
          <fpage>10</fpage>
          . ACM, (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Akbar</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carrez</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moessner</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zoha</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Predicting complex events for pro-active IoT applications</article-title>
          .
          <source>In: IEEE 2nd World Forum on Internet of Things (WF-IoT)</source>
          , pp.
          <fpage>327</fpage>
          -
          <lpage>332</lpage>
          . IEEE, (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Paschke</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kozlenkov</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Rule-Based Event Processing and Reaction Rules</article-title>
          . In: Governatori,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Hall</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Paschke</surname>
          </string-name>
          ,
          <string-name>
            <surname>A</surname>
          </string-name>
          . (eds.) Rule Interchange and Applications: International Symposium, RuleML
          <year>2009</year>
          ,
          <string-name>
            <given-names>Las</given-names>
            <surname>Vegas</surname>
          </string-name>
          , Nevada, USA pp.
          <fpage>53</fpage>
          -
          <lpage>66</lpage>
          . Springer Berlin Heidelberg (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Mehdiyev</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krumeich</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Enke</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Werth</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loos</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Determination of rule patterns in complex event processing using machine learning techniques</article-title>
          .
          <source>Procedia Computer Science</source>
          <volume>61</volume>
          ,
          <fpage>395</fpage>
          -
          <lpage>401</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Armstrong</surname>
            ,
            <given-names>J.S.:</given-names>
          </string-name>
          <article-title>The forecasting canon: nine generalizations to improve forecast accuracy</article-title>
          .
          <source>International Journal of Applied Forecasting</source>
          <volume>1</volume>
          ,
          <fpage>29</fpage>
          -
          <lpage>35</lpage>
          , (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Sanders</surname>
            ,
            <given-names>N.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Manrodt</surname>
            ,
            <given-names>K.B.</given-names>
          </string-name>
          :
          <article-title>The efficacy of using judgmental versus quantitative forecasting methods in practice</article-title>
          .
          <source>Omega</source>
          <volume>31</volume>
          ,
          <fpage>511</fpage>
          -
          <lpage>522</lpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>LaValle</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lesser</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shockley</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hopkins</surname>
            ,
            <given-names>M.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kruschwitz</surname>
          </string-name>
          , N.:
          <article-title>Big data, analytics and the path from insights to value</article-title>
          .
          <source>MIT Sloan Management Review</source>
          <volume>52</volume>
          ,
          <issue>21</issue>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>