<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Context-aware Miner for Medical Processes</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>L. Canensi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>G. Leonardi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>S. Montani</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>P. Terenziani</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>(1) Department of Computer Science, Universita di Torino</institution>
          ,
          <addr-line>Italy (2) DISIT</addr-line>
          ,
          <institution>Computer Science Institute, Universita del Piemonte Orientale</institution>
          ,
          <addr-line>Alessandria</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <fpage>192</fpage>
      <lpage>201</lpage>
      <abstract>
        <p>Medical process mining is gaining much attention in recent years, but the available mining algorithms can hardly cope with medical application peculiarities, that require to properly contextualize process patterns. Indeed, most approaches loose the connection between a mined pattern and the relevant portion of the input event log, and can have a limited precision, i.e., they can mine incorrect paths, never appearing in the input log traces. These issues can be very harmful in medical applications, where it is vital that mining results are reliable as much as possible, and properly reference the contextual information, in order to facilitate the work of physicians and hospital managers in guaranteeing the highest quality of service to patients. In this paper we propose a novel approach to medical process mining that operates in a context-aware fashion. We show on a set of critical examples how our algorithm is able to cope with the issues sketched above. The process model we mine can then be adopted to support e cient and exible trace retrieval, as described in [1]. Indeed, the model can be used as an indexing structure, well suited to quickly retrieve traces corresponding to the pattern being looked for. In the future, we plan to test the approach on a real-world medical dataset, taken from the stroke patient management domain.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Process mining describes a family of a-posteriori analysis techniques that exploit
the so-called event log, which records information about the sequences (traces
henceforth) of activities executed at a given organization. The most relevant and
widely used process mining technique is discovery; process discovery takes as an
input the event log and produces a process model, without using any a-priori
information.</p>
      <p>
        Despite the complexity of healthcare, medical process mining is a research
eld which is gaining attention in recent years (see, e.g., [2{4]), also as a means for
assessing the correct application of clinical guideline directives in practice. This
application domain indeed presents particular challenges and issues [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], mostly
related to the fact that di erent types of patients exhibit di erent characteristics,
that the patient's state dynamically evolves (and is in uenced by the medical
activities executed on her/him), and that di erent hospital settings may have
di erent resource constraints. All these peculiarities lead to the need to properly
contextualize medical processes and/or process patterns.
      </p>
      <p>
        The currently available process mining solutions, ranging from commercial
tools (o ered, e.g., by Fujitsu Ltd and Celonis), to the open-source framework
ProM [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] (developed at the Eindhoven University of Technology), which
represents the state of the art in process mining research, are not tailored to medical
applications, and do not take into account contextualization needs.
      </p>
      <p>
        Speci cally, despite some di erences, many current algorithms show
important similarities (see Section 2), and have common limitations: (1) they learn
\context-free" patterns of processes; (2) they can mine paths that do not
correspond to any input trace in the log (i.e., they can have a limited precision [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]);
(3) they do not explicitly relate the mined patterns to the log (in the sense that
there is no explicit correspondence between the mined patterns, and the traces
in the log \supporting" them).
      </p>
      <p>Such limitations are quite relevant in general, and very relevant in the
medical domain. Concerning limitation (1), it is well known that, e.g., the same (set
of) activities may produce di erent e ects on patients, depending on the
context (e.g., on the activities previously performed on the patients themselves).
The impact of limitation (2) is obvious and dramatic: the mined model is the
input for quality assessment procedures, such as veri cation of conformance with
respect to clinical guidelines, or performance measurement and bottleneck
detection. All these procedures will provide an unreliable output, if played on an
unreliable input (in the sense that the model may exhibit a path that never
appears in any input trace). However, surprisingly, limited precision is a common
limitation of many current miners (see Section 2.) Limitation (3) is less critical,
but still signi cant. Indeed, maintaining an explicit link between the mined
patterns and the input traces matching such patterns, can be important not only
to characterize contexts, but also to provide physicians with an evidence of the
learned output.</p>
      <p>
        In this paper, we propose an innovative approach that supports
contextaware process mining, and overcomes all the above limitations. Our mining
technique provides a process model in the form of a tree, called the \log-tree".
The log-tree perfectly adheres to the input traces (since all its paths correspond
to at least one trace in the log), and explicitly relates the mined patterns to
the log. Interestingly, in this way it can be exploited as an index, to e ciently
retrieve all the traces that contain the pattern of interest, along the lines of the
work in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], where we describe a trace retrieval approach for business process
management operational support1.
1 This paper is however focused on the mining technique, and on the description of
the log-tree structure. The interested reader can nd additional details about trace
retrieval in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
    </sec>
    <sec id="sec-2">
      <title>A critical analysis of current approaches</title>
      <p>
        As discussed in the Introduction, several di erent miners have been developed in
the literature. However, many existing miners, including alpha miner [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], fuzzy
miner [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], heuristic miner [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and the very recent inductive tree miner [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], show
interesting commonalities.
      </p>
      <p>In the following, for the sake of clarity and brevity, we will mainly refer to
one miner to illustrate the common characteristics of these literature approaches.
Speci cally, we will concentrate on heuristic miner. Indeed, heuristic miner can
abstract from exceptional behavior and noise and, therefore, is suitable for many
real-life logs, including medical ones.</p>
      <p>Most mining algorithms are based on a common assumption, which we call
uniqueness assumption: each event is unique in the output, so that each event
appears at most once in the output of the process miner2.</p>
      <p>As a second commonality, the mining methodology is typically based on two
steps (corresponding to steps 1 and 3 in Algorithm 1 below, which abstractly
characterizes the behavior of heuristic miner on a set T of traces): (i) a
destructuring step, in which immediate precedence between pairs of events is
detected in the input traces, and (ii) a re-structuring step, in which patterns
of events are reconstructed, by combining the immediate precedence relations
mined in the de-structuring step.</p>
      <p>
        ALGORITHM 1: HM pseudocode
1 function HM(T) ;
2 (1) for each pair of events A and B do
3 search T to detect immediate precedence A ! B and B ! A
4 end
5 (2) Look for cycles of length one (same event repeated) or two (pair of events
repeated);
6 (3) for each triplet of events A,B, and C, such that A ! B and A ! C do
7 use formulae [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] to discriminate whether B and C are in AND (both of them
must be executed after A, in any order) or in XOR (exactly one of them must be
executed after A), and construct the output
8 end
9 (4) Look for \long-distance dependencies" between events, and add them to the
output.
      </p>
      <p>For the sake of brevity, here we cannot comment in detail the algorithm, and
the formulae. We just focus on the main critical issues.</p>
      <p>
        C1 Given the uniqueness assumption, the de-structuring step (step 1 in
Algorithm 1) evaluates the immediate precedence relations between events A
2 Actually, ProM's region-based miner [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] is able to relax this assumption in some
cases; however, it does not maintain or exploit contextual information; moreover, its
precision can be very low, making this algorithm less suitable for our purposes.
and B looking at sequences \AB" and \BA" in the input traces, regardless
of their position in the traces, and, thus, regardless of the context.
C2 Given the fact that the de-structuring step ignores the context, and that the
re-structuring step (step 3 in Algorithm 1) does not take into account the
traces in the log, also the re-structuring step does not consider the context
at all.
      </p>
      <p>C3 The uniqueness assumption imposes severe constraints on the re-structuring
step.</p>
      <p>The following examples illustrate the critical impact of issues C1, C2 and C3.
The examples have been processed using heuristic miner, and provided as Petri
Nets, which are commonly assumed as an incontestable formalism to represent
(the semantics of) processes.</p>
      <p>To simplify the presentation, with no loss of generality, we suppose that each
trace is pre xed with a distinguished starting symbol (*) and post xed with
another distinguished ending symbol (#).</p>
      <p>(a) Example 1
(b) Example 2 part a
(c) Example 2 part b</p>
      <p>(d) Example 3</p>
      <sec id="sec-2-1">
        <title>Ex.1 Log content: 1000 equal traces: *ABCA# Although all the traces are equal, existing literature approaches cannot learn</title>
        <p>the (unique!) pattern. In this example, this is mainly due to the fact that the
uniqueness assumption causes problems in the re-structuring phase (critical
issue C3): the two occurrences of the event A in the traces must correspond to a
unique transition in the output Petri Net. Thus, a cycle (returning from C to
A) must be introduced in the output. Notably, the output Petri Net also admits
patterns like *A# or *ABCABCA#, which are not present in any of the input
traces (see Figure 1(a)).</p>
        <p>
          The pattern shown in this example represents one of the typical care processes
for patients su ering from acute diseases. For instance, consider the diagnostic
process of patients su ering from cerebral ischemia. After the symptom onset,
the patient arrives at the emergency ward of the hospital. According to the
latest medical guidelines for the treatment of stroke [
          <xref ref-type="bibr" rid="ref13 ref14">13, 14</xref>
          ], it is recommended
that the patient undergoes as soon as possible a computed tomography (CT),
for: (1) the di erential diagnosis between ischemic and hemorrhagic stroke and
other cerebrovascular diseases, and (2) the identi cation of possible early signs of
ischemic brain su ering. This action is indicated in Ex. 1 as action A = CT
Execution. Subsequently, the patient should be evaluated by a trained neurologist,
generating action B = Neurological Evaluation. Among the various additional
investigations, which may be required depending on the type of patient, the
guidelines suggest to always perform an electrocardiogram (ECG). In Ex. 1, this
is referred to as action C = ECG Execution. Before transferring the patient to
the Stroke Unit for further treatment, the guidelines recommend the repetition
of the CT (within 48 hours), in order to obtain a better diagnostic and
prognostic evaluation. The action A = CT Execution is therefore performed both as
the rst action of this process, and as the last one, thus generating the pattern
of actions of this example.
        </p>
        <p>In a similar manner, each of the following examples, presented only in an
abstract way due to lack of space, introduces situations which can be concretely
instantiated as real clinical processes, or parts of them.</p>
        <p>Ex.2 Log content: 1000 equal traces: *ABCBA#
This example highlights the limitations of \context-free" approaches. Consider,
in particular, critical issue C1 above: since the precedence relations are searched
without considering the context (and on the basis of the uniqueness assumption),
there is no way to decide whether A precedes B (100% of traces, considering the
rst part of the traces) or B precedes A (100% of traces, but considering the
last part of the traces), and analogously for the relation between B and C. As
a consequence, two separate Petri Nets are learned: the rst contains only the
pattern *A#, while the second contains a loop composed by C and B (see
Figure 1(b)). By using heuristic miner without the \all event connected option",
a di erent model is learned (see Figure 1(c)), where it is possible to replay the
input trace, but many other never observed behaviors can be generated as well.</p>
      </sec>
      <sec id="sec-2-2">
        <title>Ex.3 Log content: 500 traces *AD# and 500 traces *DB# Once again, the combination of a \context-free" analysis with the uniqueness as</title>
        <p>sumption causes undesired e ects. In this example, two di erent patterns should
be mined. However, during the de-structuring phase, no distinction is made
between D in the rst type of traces (i.e., D in the context of being preceded by *A)
and D in the second type of traces (i.e., D in the context of being preceded by
*). Thus, the re-structuring phase (see critical issue C2) generates a \merging"
between the two di erent patterns (due to the uniqueness of D), providing the
Petri Net in Figure 1(d) as output. Notably, besides the correct patterns *AD#
and *DB#, the output Petri Net also models the patterns *D# and ADB#,
which do not correspond to any trace in the input log.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Context-aware process mining</title>
      <p>In order to overcome the limitations illustrated in the previous section, we
propose an innovative approach to (medical) process mining, which is based on quite
a di erent philosophy: in our methodology, process mining heavily takes into
account contextual information, both in the data structure, and in the mining
algorithm. Our approach is based on three main ideas:
{ in the data structure, we remove the uniqueness assumption: the same
event may appear more than once in the output model, to represent the fact
that it may occur in di erent contexts;
{ in the data structure, and in the mining algorithm, we explicitly maintain
the context, i.e., the set of log traces that support a given path in the mined
model;
{ in the mining algorithm, we take advantage of the ordering of events in
the log traces (which represents, indeed, the context in which each single
event occurs) to directly mine the output model, without distinguishing
between a de-structuring and a re-structuring phase.</p>
      <p>In the following, we present our approach and its application to the previously
discussed critical examples.
3.1</p>
      <sec id="sec-3-1">
        <title>Data structure and algorithm</title>
        <p>Our mining algorithm takes in input a log (set of traces). The log is represented
by a matrix, in which each row is a trace. It outputs the mined process as a
tree, called a \log-tree", in which nodes represent events (i.e., activities), and
arcs represent a precedence relation between them. More precisely, in our model,
each node is represented as a pair &lt; P; T &gt;:
{ P denotes a (possibly unary) set of events; events in the same node are in
AN D relation, or, more properly, may occur in any order (with respect to
each other). Note that, in such a way, each path from the root node of the tree
to a given node N denotes a set of possible process patterns (called support
patterns of N henceforth), obtained by following the order represented by
the arcs in the path to visit the tree, and ordering in each possible way the
events in each node (for instance, the path fA; Bg ! fCg represents the
support patterns \ABC" and \BAC");
{ T represents the context, i.e., a set of references to all and only those traces
in the log which exactly match one of the patterns in P (called support traces
henceforth).</p>
        <p>Our mining algorithm (see Algorithm 2 below) builds the log-tree described as
above.</p>
        <p>ALGORITHM 2: Mining pseudocode
1 function Build-Tree(index,&lt; P; T &gt;) ;
2 nextP getNext(index+1, T) ;
3 if nextP not empty then
4 nextEvents XORvsAND (nextP, T) ;
5 for each node &lt; P ′; T ′ &gt; 2 nextEvents do
6 AppendSon(&lt; P ′; T ′ &gt;,&lt; P; T &gt;) ;
7 Build-Tree(index + jP ′j,&lt; P ′; T ′ &gt;) ;
8 end
9 end</p>
        <p>Build-Tree in Algorithm 2 takes in input a variable index, representing a
given position in the traces (i.e., a column in the input matrix), and a node.
Initially, it is called on the rst position, and on the root of the tree (which is
a \dummy" node, corresponding to the * event; thus, initially, index=0, P=*
and T is the set of all the traces). The function getNext simply inspects the
traces in T to nd all possible next events (in the context T ). On the basis
of the current context (support traces ) T, the function XORvsAND applies the
formulae described in appendix A to identify which events are in AND and which
are in XOR relation. The output of such a function is a set of nodes &lt; P ′; T ′ &gt;,
one for each maximal set of events to be AND-ed. Note that, for each one of
such sets P', the corresponding set T' of support traces is also computed, on the
basis of the current context T. Finally, each new node is appended in the output
tree (function AppendSon), and Build-Tree is recursively applied to each node
(with the parameter index properly set).</p>
        <p>A-posteriori, we create a dummy node #, and connect all the leaves to it; in
this way, the log-tree can also be seen as a basic process model.</p>
        <p>Notably, our mining algorithm explicitly manages the context, focusing at
each step on the proper support traces, and always taking into account the global
ordering of events in the traces to build the graph. As a consequence, di erently
from the heuristic miner algorithm shown in Algorithm 1, we do not need any
additional step to cope with long-distance dependencies (we have them \for
free"). Analogously, we \naturally" cope with cycles by simply unfolding them.
Thus, our algorithm already directly copes with cycles of any length (and no
additional ad-hoc procedure for cycles is needed, di erently from the heuristic
miner algorithm).
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Examples</title>
        <p>
          In Figure 2, we show the output of our miner, applied to the examples Ex.1-Ex.3
discussed in Section 2. Support traces are not reported in the gure, but are part
of the output itself. As it can be observed, the critical situations discussed in
Section 2 are all correctly managed by our approach. It is also worth noting that
our process graphs could be easily converted into Petri Nets.
Quite naturally, the log-tree is not only a model of the process at hand, but
also an index of the event log content, since, by means of the support traces,
it explicitly relates the mined patterns to the log. Indeed, as described in [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ],
we are exploiting the log-tree structure to speed up trace retrieval, in a tool for
operational support we are currently completing and testing.
4
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>In this paper, we have introduced a novel process mining algorithm, able to
overcome the limitations of many current approaches available in the literature.
Speci cally, our algorithm:
{ learns \context-aware" patterns of processes;
{ has a high precision, since it provides patterns that always correspond to
input traces in the log;
{ explicitly relates the mined patterns to the traces in the log \supporting"
them.
Our approach properly deals with critical situations that may occur in practical
application domains, as illustrated by the examples in Section 2. These
characteristics make the algorithm particularly well-suited for medical applications,
where it is vital that mining results are reliable as much as possible, in order
to facilitate the work of physicians and hospital managers in guaranteeing the
highest quality of service to patients.</p>
      <p>
        The mined process model can also be exploited to allow e cient trace
retrieval, as described in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Indeed, the model we mine maintains an explicit link
between mined patterns and the input traces supporting them, and can thus be
used as an indexing structure, well suited to quickly retrieve traces corresponding
to the pattern at hand.
      </p>
      <p>In the future, we plan to extensively test the overall approach on a real-world
medical dataset, taken from the stroke patient management domain.
In Algorithm 2, after nding the set of successors nextP of the considered set of
events P , we focus on the discovery of the relation between them. In order to do
this, we calculate the dependency frequency between every event pairs &lt; A; B &gt;
in nextP nextP :</p>
      <p>A ! B =
)
(1)
where jA &gt; Bj is the number of traces in which A is immediately followed by B,
and jA &gt; Xj is the number of traces in which A is immediately followed by some
event X, jY &gt; Bj is the number of traces in which B is immediately preceded
by some event Y. After evaluating the dependency frequency value A ! B and
B ! A, we can have the following possible situations:</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>A.</given-names>
            <surname>Bottrighi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Canensi</surname>
          </string-name>
          , G. Leonardi,
          <string-name>
            <given-names>S.</given-names>
            <surname>Montani</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Terenziani</surname>
          </string-name>
          .
          <article-title>Trace retrieval for business process operational support</article-title>
          .
          <source>Expert Syst. Appl.</source>
          ,
          <volume>55</volume>
          :
          <fpage>212</fpage>
          {
          <fpage>221</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>E.</given-names>
            <surname>Rojas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Munoz-Gama</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Sepulveda</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Capurro</surname>
          </string-name>
          .
          <article-title>Process mining in healthcare: A literature review</article-title>
          .
          <source>Journal of Biomedical Informatics</source>
          ,
          <volume>61</volume>
          :
          <fpage>224</fpage>
          {
          <fpage>236</fpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>R.</given-names>
            <surname>Mans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Schonenberg</surname>
          </string-name>
          , G. Leonardi,
          <string-name>
            <given-names>S.</given-names>
            <surname>Panzarasa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Cavallini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Quaglini</surname>
          </string-name>
          , and et al.
          <article-title>Process mining techniques: an application to stroke care</article-title>
          . In S. Andersen,
          <string-name>
            <given-names>G. O.</given-names>
            <surname>Klein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Schulz</surname>
          </string-name>
          , and J. Aarts, editors,
          <source>Proc. MIE</source>
          , volume
          <volume>136</volume>
          <source>of Studies in Health Technology and Informatics</source>
          , pages
          <volume>573</volume>
          {
          <fpage>578</fpage>
          . IOS Press, Amsterdam,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. L.
          <string-name>
            <surname>Perimal-Lewis</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Qin</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Thompson</surname>
            , and
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Hakendorf</surname>
          </string-name>
          .
          <article-title>Gaining insight from patient journey data using a process-oriented analysis approach</article-title>
          . In K. ButlerHenderson and K. Gray, editors,
          <source>Proc. Workshop on Health Informatics and Knowledge Management (HIKM)</source>
          , volume
          <volume>129</volume>
          <source>of Conferences in Research and Practice in Information Technology, page 5966. Australian Computer Society</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>R.</given-names>
            <surname>Mans</surname>
          </string-name>
          ,
          <string-name>
            <surname>W. van der Aalst</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Vanwersch</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Moleman</surname>
          </string-name>
          .
          <article-title>Process mining in healthcare: Data challenges when answering frequently posed questions</article-title>
          . In R. Lenz,
          <string-name>
            <given-names>S.</given-names>
            <surname>Miksch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Peleg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Reichert</surname>
          </string-name>
          ,
          <string-name>
            <surname>D.</surname>
          </string-name>
          <article-title>Rian~o, and A</article-title>
          . ten Teije, editors,
          <source>ProHealth/KR4HC</source>
          , volume
          <volume>7738</volume>
          of Lecture Notes in Computer Science, pages
          <volume>140</volume>
          {
          <fpage>153</fpage>
          . Springer, Berlin,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>B. van Dongen</given-names>
            ,
            <surname>A. Alves De Medeiros</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Verbeek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Weijters</surname>
          </string-name>
          , and
          <string-name>
            <surname>W. Van der Aalst.</surname>
          </string-name>
          <article-title>The proM framework: a new era in process mining tool support</article-title>
          . In G. Ciardo and P. Darondeau, editors,
          <source>Knowledge Mangement and its Integrative Elements</source>
          , pages
          <volume>444</volume>
          {
          <fpage>454</fpage>
          . Springer, Berlin,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>J.</given-names>
            <surname>Buijs</surname>
          </string-name>
          ,
          <string-name>
            <surname>B. van Dongen</surname>
          </string-name>
          , and W. van der Aalst.
          <article-title>On the role of tness, precision, generalization and simplicity in process discovery</article-title>
          .
          <source>In On the Move to Meaningful Internet Systems: OTM</source>
          <year>2012</year>
          , pages
          <fpage>305</fpage>
          {
          <fpage>322</fpage>
          . Springer,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>W.</given-names>
            <surname>Van der Aalst</surname>
          </string-name>
          and
          <string-name>
            <surname>B. van Dongen.</surname>
          </string-name>
          <article-title>Discovering work ow performance models from timed logs</article-title>
          . In Y. Han,
          <string-name>
            <surname>S</surname>
          </string-name>
          . Tai, and D. Wikarski, editors,
          <source>Proc. International Conference on Engineering and Deployment of Cooperative Information Systems (EDCIS</source>
          <year>2002</year>
          ), volume
          <volume>2480</volume>
          of Lecture Notes in Computer Science, pages
          <volume>45</volume>
          {
          <fpage>63</fpage>
          . Springer, Berlin,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Gunther and</article-title>
          W. van der Aalst.
          <article-title>Fuzzy mining - adaptive process simpli cation based on multi-perspective metrics</article-title>
          . In G. Alonso,
          <string-name>
            <given-names>P.</given-names>
            <surname>Dadam</surname>
          </string-name>
          , and M. Rosemann, editors,
          <source>Business Process Management, 5th International Conference, BPM</source>
          <year>2007</year>
          , Brisbane, Australia,
          <source>September 24-28</source>
          ,
          <year>2007</year>
          , Proceedings, volume
          <volume>4714</volume>
          of Lecture Notes in Computer Science, pages
          <volume>328</volume>
          {
          <fpage>343</fpage>
          . Springer,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>A.</given-names>
            <surname>Weijters</surname>
          </string-name>
          , W. Van der Aalst,
          <article-title>and</article-title>
          <string-name>
            <surname>A</surname>
          </string-name>
          . Alves de Medeiros.
          <article-title>Process Mining with the Heuristic Miner Algorithm</article-title>
          , WP 166. Eindhoven University of Technology, Eindhoven,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>S.</given-names>
            <surname>Leemans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Fahland</surname>
          </string-name>
          , and W. van der Aalst.
          <article-title>Discovering block-structured process models from event logs containing infrequent behaviour</article-title>
          . In N. Lohmann,
          <string-name>
            <given-names>M.</given-names>
            <surname>Song</surname>
          </string-name>
          , and P. Wohed, editors,
          <source>Business Process Management Workshops - BPM International Workshops</source>
          , Beijing, China,
          <year>August 26</year>
          ,
          <year>2013</year>
          ,
          <string-name>
            <given-names>Revised</given-names>
            <surname>Papers</surname>
          </string-name>
          , volume
          <volume>171</volume>
          <source>of Lecture Notes in Business Information Processing</source>
          , pages
          <volume>66</volume>
          {
          <fpage>78</fpage>
          . Springer,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>J. Carmona</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Cortadella</surname>
            , and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Kishinevsky</surname>
          </string-name>
          .
          <article-title>A Region-Based Algorithm for Discovering Petri Nets from Event Logs</article-title>
          .
          <source>In Business Process Management (BPM2008)</source>
          , pages
          <fpage>358</fpage>
          {
          <fpage>373</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. G.
          <string-name>
            <surname>Carlucci D. Inzitari</surname>
          </string-name>
          .
          <article-title>Italian stroke guidelines (spread): evidence and clinical practice</article-title>
          .
          <source>Neurological Sciences</source>
          ,
          <volume>27</volume>
          :S225{
          <fpage>S227</fpage>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14. http://www.iso
          <article-title>-spread.it. The ISO-SPREAD clinical guideline group web page</article-title>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>