=Paper=
{{Paper
|id=None
|storemode=property
|title=The Impact of Sequential and Circumstantial Changes on Process Models
|pdfUrl=https://ceur-ws.org/Vol-603/ER-POIS10_Paper5.pdf
|volume=Vol-603
|dblpUrl=https://dblp.org/rec/conf/caise/WeidlichZPFWRM10
}}
==The Impact of Sequential and Circumstantial Changes on Process Models==
The Impact of Sequential and Circumstantial
Changes on Process Models
Matthias Weidlich1 , Stefan Zugal2 , Jakob Pinggera2 , Dirk Fahland3 , Barbara
Weber2 , Hajo A. Reijers4 , and Jan Mendling3
1
Hasso-Plattner-Institute, University of Potsdam, Germany
matthias.weidlich@hpi.uni-potsdam.de
2
University of Innsbruck, Austria
stefan.zugal|jakob.pinggera|barbara.weber@uibk.ac.at
3
Humboldt-Universität zu Berlin, Germany
fahland@informatik.hu-berlin.de|jan.mendling@wiwi.hu-berlin.de
4
Eindhoven University of Technology, The Netherlands
h.a.reijers@tue.nl
Abstract. While process modeling has become important for document-
ing business operations and automating workflow execution, there are
serious issues with efficiently and effectively creating and modifying pro-
cess models. While prior research has mainly investigated process model
comprehension, there is hardly any work on maintainability of process
models. Cognitive research into software program comprehension has
demonstrated that imperative programs are strong in conveying sequen-
tial information while obfuscating circumstantial information. This paper
addresses the question whether these findings can be transferred to process
model maintenance. In particular, it investigates whether it is easier to
incorporate sequential change requirements in imperative process models
compared to circumstantial change requirements. To address this ques-
tion this paper presents results from a controlled experiment providing
evidence that the type of change (sequential versus circumstantial) has
an effect on the accuracy of process models. For performance indicators
modeling speed, correctness, and cognitive load no statistically significant
differences could be identified.
1 Introduction
The increasing use of business process models has sparked a discussion on
usability and quality issues. Large companies use business process modeling
as an instrument to document their operations, typically resulting in several
thousand process models which are partially created by staff members with limited
modeling expertise. Therefore, analyzing factors that influence the usability of
process models is a promising approach for securing success of process modeling
initiatives [2].
Prior research has mainly investigated process model comprehension as a
prerequisite for usability. Among others, modeling expertise and process model
B. Mutschler, J. Recker, R. Wieringa, J. Ralyté, and P. Plebani (Eds.):
CAiSE 2010 Workshop ER-POIS, Hammamet, Tunisia, pp. 43-54, 2010.
44 M. Weidlich et al.
complexity have been identified as factors of comprehension [15]. Yet, compre-
hension captures only a partial dimension of usability. Process models in current
process modeling initiatives are subject to frequent changes and a considerable
amount of staff members are involved in updating process models. For this reason,
investigating process model maintainability bears the potential to improve current
process modeling practice.
Up until now, there is hardly any work on maintainability of process models
beyond research into complexity metrics [3]. In this paper, we analyze to what
extent cognitive research into software program comprehension can be trans-
ferred to process model maintenance. We feel that insights from the domain
of software engineering are potentially valuable for process models given the
high degree of similarities between software programs and process models (see
[9, 21] for discussions of these similarities). Work on the cognitive dimensions
framework has established a relativist view on usability [6, 8, 7]. In particular,
it was demonstrated that imperative programs are strong in conveying sequen-
tial information while obfuscating circumstantial information. In this context,
sequential information explains how input conditions lead to a certain outcome,
and circumstantial information relates to the overall constraints that hold when
that outcome is produced. We challenge this hypothesis for imperative process
models in BPMN and test whether maintainability is influenced by the type
of change requirement. Accordingly, we conduct an experiment that checks if
sequential change requirements are easier to implement for a BPMN model than
circumstantial change requirements. The results of this experiment foster research
on maintainability factors of process models.
The remainder of the paper is structured as follows. Section 2 discusses
the background of our research, namely sequential and circumstantial change
requirements. Section 3 describes the setup for our experiment, which builds on
a realistic modeling task taken from the disaster management domain. Section 4
covers the execution and the experiment’s results. Finally, Section 5 discusses
related work, followed by a conclusion.
2 Background
The central subject to maintainability considerations is the notion of a process
change. A process change is the transformation of an initial process model S
to a new process model S 0 by applying a set of change operations. A change
operation modifies the initial process model by altering the set of activities
and their order relations [12]. Typical change primitives are add node, add edge,
delete node, or delete edge [23]. Figure 1 shows a BPMN process model from the
domain of earthquake response, which is a simplified version of a process run by
the “Task Force Earthquakes” of the German Research Center for Geosciences
(GFZ). The main purpose of the task force is to coordinate the allocation of an
interdisciplinary scientific-technical expert team after catastrophic earthquakes
worldwide [5].
The Impact of Sequential and Circumstantial Changes on Process Models 45
Get road maps
Sufficient transport capabilities
Present Seek for
Organize Rent vehicles to
equipment at vehicles of
transport of transport
customs in partner
cargo equipment
Germany else organisations
Organize
accommodation
with eletricity
Fly to
Present at else
destination
immigration
area
Present Transport
equipment at Demonstrate equipment to
customs in host devices storage
country location
Customs requires
demonstration of
devices
Fig. 1. BPMN Model for Transport of Equipment
According to considerations on cognitive software program analysis, not
all change requirements are equally difficult (cf., [6]). Here, we call a change
requirement sequential if an activity has to be added, deleted, or moved directly
before or behind another activity. For example, once arrived in the host country,
the taskforce has to demonstrate the devices to customs (cf., Fig. 1). In contrast
to the model of Fig. 1, customs might not clear the equipment which requires
additional activities. A concrete change might be to insert an activity “Negotiate
with customs” in the process after “Demonstrate devices.” Such a sequential
change requirement describes whether a pair of activities is in a specific structural
or behavioral order relation. In contrast, a circumstantial change requirement
involves adding or moving an activity such that a general behavioral constraint
is satisfied. Such a constraint might be given in terms of temporal operators
like ‘always’, ‘eventually’, ‘until’, and ‘next time’. As an example, consider a
change requirement to execute “Demonstrate devices” eventually in each case.
The region in the process model that needs to be changed cannot be deduced
from the change requirement directly. Consequently, sequential changes tend to
be rather local in the process model, whereas circumstantial changes tend to
affect the process model globally. Two realistic change requirements are given in
Appendix A.
How do these observations on process models relate to established theories?
Adapting a software program to evolving needs involves both sense-making tasks
(i.e., to determine which changes have to be made) and action tasks (i.e., to
apply the respective changes to the program) [8]. We can discuss the problem of
changing a process model in a similar vein. When process designers are faced with
a change requirement, they have to consider two things: 1) they need to determine
which change operations have to be used to modify the process model; and 2)
they have to apply the respective changes to the process model. Consequently,
the effort needed to perform a particular process model change is on the one
hand determined by the cognitive load to decide which changes have to be made
to the model, which is a comprehension and sense-making task. On the other
hand, the effort covers the number of edit operations required to conduct these
changes, which is an action task.
46 M. Weidlich et al.
In the cognitive dimensions framework, an important result – regarding sense
making of information artifacts – relates to the difference between the tasks
of looking for sequential and circumstantial information in a software program.
Transferring this result to process models reads as follows: circumstantial changes
are more difficult to perform on a flow chart diagram like BPMN [8]. Consequently,
we would expect that process designers show a better performance in applying
sequential change requirements. We challenge this hypothesis in an experimental
setup.
3 Research Setup
In this section we describe the design of an experiment that investigates the
influence of different change types on modeling performance.
Subjects: In our experiment, the subjects are 15 students in Software Engineering
of a graduate course on Business Process Management at the Hasso Plattner
Institute. Participation in the study was voluntary.
Objects: The object of our experiment is a process model along with two
descriptions of a change that have to be applied to the model. The process
model used in our experiment describes an actual process run by the “Task Force
Earthquakes” of the German Research Center for Geosciences (GFZ) [5]. In
particular, we used a model of the “Transport of Equipment” process similar to
the one shown in Fig. 1, which specifies how the transport of scientific equipment
from Germany to the disaster area is handled by the task force. The two change
descriptions require changes of this process if standard processing is not possible.
On the one hand, it might happen that the transport of the equipment is delayed
as customs might not clear the equipment immediately. On the other hand,
equipment transport capacity might not be available right away. For both cases,
the process of transporting the equipment has to be changed accordingly.
Purely Spectrum of Purely
Sequential Changes Circumstantial
Our Our
Sequential Circumstantial
Change Change
Fig. 2. Change Types
Factor and Factor Levels: The considered factor in our experiment is the
type of the change task with factor levels sequential and circumstantial. It is
important to note that the two change tasks used in the experiment are not
strictly sequential and circumstantial. However, when compared to each other,
one change is clearly more sequential, or circumstantial, respectively, than the
other (cf., Fig. 2). We also ensured that both changes require the same effort in
terms of graph-edit distance (i.e., the minimal number of atomic graph operations
needed to transform one graph into another, it can be leveraged to assess the
similarity of two process models [4]). For both changes, the graph edit distance
The Impact of Sequential and Circumstantial Changes on Process Models 47
between the original model and the changed model, i.e., the number of operations
needed to perform the change is around 40 atomic change operations.
Response Variables: As response variables we consider the modeling speed of
conducting the modification tasks, the accuracy of the change, the correctness
of the resulting model as well as the perceived cognitive load of conducting
the modification tasks. Modeling speed is measured as time (in seconds) needed
for conducting a change task. For assessing the accuracy we utilize a set of
12 key properties for each change type, which are derived directly from the
corresponding change description. For instance, “in the meantime” indicates
parallel execution, whereas explicit naming of activities in the text indicates
that respective activities should also be present in the process model. One point
is rewarded for each fulfilled property in the solution model (e.g., existence of
parallel execution). In addition, accuracy also includes penalty points for negative
key properties (e.g., superfluous activities). Consequently, students are able to
gather at most 12 points per change, allowing us to quantify their models in
terms of accuracy. Correctness, in turn, is assessed in terms of model syntax as
well as execution semantics. That is, whether syntactic requirements imposed by
the BPMN specification are met, and whether the model is free of behavioral
anomalies such as a deadlock or a lack of synchronization. To this end, we applied
the well-known soundness criterion [20]. For obvious reasons, soundness checking
is done solely for syntactically correct models. Finally, subjects are asked to
assess their cognitive load (i.e., the perceived difficulty of conducting a change
task) on a 7-point Likert scale.
Hypothesis Formulation: The goal of the experiments is to investigate whether
the type of change influences modeling speed, accuracy, correctness, and cognitive
load. Accordingly we postulate the following hypotheses:
– Null Hypothesis H0,1 : There is no significant difference in the speed of
modeling a process change with respect to the type of change.
– Null Hypothesis H0,2 : There is no significant difference in the accuracy of
the resulting models with respect to the type of change.
– Null Hypothesis H0,3 : There is no significant difference in the correctness
of the resulting models with respect to the type of change.
– Null Hypothesis H0,4 : There is no significant difference in the perceived
cognitive load with respect to the type of change.
Instrumentation: The participants conducted the modeling using the Cheetah
BPMN Modeler [17], which is a graphical process editor. The editor provides only
basic drawing functionality for creating, moving, and deleting nodes and edges
of a single BPMN diagram; the modeling constructs were limited to tasks, start
and end events, gateways (AND, XOR), and control flow edges. The reduced
functionality mimics a flexible “pen and paper” setting. To be able to trace
the actual modeling process, we extended the BPMN Modeler with a logging
function, which automatically records every modeling step and allows us to derive
performance characteristics (e.g., modeling time, number of syntactical errors,
number of events) for each model, and a function to replay a modeling log.
48 M. Weidlich et al.
Experimental Design: The experimental setup is based on literature providing
guidelines for designing experiments [24]. Following these guidelines a randomized
balanced single factor experiment is conducted with repeated measurements. The
experiment is called randomized because subjects are assigned to groups randomly.
We denote the experiment as balanced as each factor level is used by each subject,
i.e., each student works on a sequential and circumstantial change task. As only
a single factor is manipulated (i.e., the change type), the design is called single
factor. Due to the balanced nature of the experiment, each subject generates data
for both factor levels and thus provides repeated measurements. Figure 3 depicts
the design following the aforementioned criteria. The subjects are randomly
assigned to two groups of equal size, subsequently referred to as Group 1 and
Group 2. To provide a balanced experiment with repeated measurements, the
overall procedure is divided into two runs. In the first run Group 1 works on a
sequential change task, Group 2 on a circumstantial one. In the second run factor
levels are switched and to Group 1 the circumstantial factor level is applied, to
Group 2 the sequential factor level. Since no subject deals with an object more
than once, this design avoids learning effects.
Group 1 Sequential Group 1 Circumstantial
Factor Level 1: Factor Level 2:
Change Change
n/2 Participants Sequential n/2 Participants Circumstantial
Description Description
Group 2 Circumstantial Group 2 Sequential
Factor Level 2: Factor Level 1:
Change Change
n/2 Participants Circumstantial n/2 Participants Sequential
Description Description
First Run Second Run
Fig. 3. Employed Experimental Design
4 Performing the Experiment
By now, the setup of the experiment has been explained. Section 4.1 describes
the preparation and execution of the experiment. Then, the analysis and inter-
pretation of the gathered data are presented in Section 4.2. Finally, a discussion
of the results is provided in Section 4.3.
4.1 Experimental Preparation and Execution
Preparation: As part of the experimental preparation, we created the model for
the “Transport of Equipment” process and two different change task descriptions,
one rather sequential change task and one rather circumstantial change task. In
order to ensure that each description is understandable and can be modeled in the
available amount of time, we conducted a pre-test with 14 graduate students at
the University of Innsbruck. Based on their feedback, the change task descriptions
were refined in several iterations; the resulting tasks are shown in Appendix A.
Execution The experiment was conducted in January 2010 in Potsdam. A
session started with a familiarization phase, in which students had 10 minutes to
investigate the given model for the “Transport of Equipment” process. At the end
of the familiarization phase, students had to answer comprehension questions on
The Impact of Sequential and Circumstantial Changes on Process Models 49
the “Transport of Equipment” process before they were able to proceed with the
experiment. The familiarization phase was followed by a modeling tool tutorial
in which the basic functionalities of the BPMN Modeler were explained to our
subjects. The students were then randomly divided into two groups. As pointed
out in Section 3, the experiment was executed in two subsequent runs. After
completing the two change tasks, a questionnaire on cognitive load was presented
to the students.
Data Validation: Once the exploratory study was carried out, the logged data
was analyzed. Data provided by 15 students was used in our data analysis.
4.2 Data Analysis
In this section, we describe the analysis of gathered data and interpret the
obtained results.
Testing for Differences in Modeling Speed: To test for differences in terms
of modeling speed, a t-test for homogeneous variances was applied [13]. The
test was applicable to analyze time differences because the samples of both
factor levels follow normal distributions and the variances of the samples are
homogeneous. With an obtained p-value of 0.818 (> 0.05), hypothesis H0,1 cannot
be rejected at a confidence level of 95%. In other words, there is no statistically
significant difference with respect to the speed of answering between the two
factor levels. This outcome is re-enforced by the overlapping boxplots in Fig. 4.
Fig. 4. Speed of Executing the Modeling Task
Testing for Differences in Accuracy: Fig. 5 shows the boxplots displaying
the distribution of the accuracy values as obtained for the two factor levels,
i.e., the circumstantial and the sequential change task. For the circumstantial
task compared to the sequential task the median value is lower, as well as the
overall distribution is being situated at the lower side of the accuracy axis.
To test whether differences in terms of accuracy are statistically significant,
we deployed the t-test. The test is applicable again because both samples are
normally distributed and the variances of the samples are homogeneous. With an
obtained p-value of 0.042 (< 0.05) hypothesis H0,2 is rejected at a confidence level
of 95%. In other words, the lower accuracy values obtained for the circumstantial
task are statistically significant.
50 M. Weidlich et al.
Fig. 5. Accuracy of Process Models
Testing for Differences in Correctness: To test for differences in correctness
between the two factor levels, we inspected all models against the BPMN standard
and scored whether these models were syntactically correct or not. Since the
binomial data that was obtained in this way was not normally distributed, we
applied the non-parametric Mann-Whitney test [19]. This resulted in a p-value of
0.053 (> 0.05). As an alternative way to compare the correctness of the models,
we considered the soundness of the produced models, which is a well-established
correctness notion for process models [20]. We applied the same statistical test to
compare the two factor levels, which led to a p-value of 0.275 (> 0.05). Since both
p-values exceed the threshold of 0.05, either narrowly or widely, the hypothesis
H0,3 cannot be rejected at a confidence level of 95%: No statistically significant
differences with respect to correctness can be observed.
Testing for Differences in Cognitive Load: As stated before, we asked all
respondents to rate the cognitive load of the two modeling tasks after they had
been performed. We rated this complexity on a 7-point Likert scale, ranging
from ‘very low’ to ‘very high’. The values that were obtained in this way were in
conformance with the requirements for a standard t-test. The application of this
test resulted in a p-value of 0.735 (> 0.05). Consequently, hypothesis H0,4 cannot
be rejected at a confidence level of 95% or, phrased differently, no statically
significant difference can be established between the cognitive load between the
groups.
4.3 Discussion of Results
With respect to the four different performance indicators that were examined
for differences, only accuracy indicates a significantly better performance for the
group performing the sequential change task. In this case the obtained p-value
of 0.042 is slightly below the cut-off value of 0.05. For all other indicators, i.e.,
correctness, speed, and cognitive load, no significant differences could be detected.
These outcomes point at the type of change not being an overly strong factor
with respect to the maintainability of a process model. A significant difference is
expected from a theoretical point of view, as the respondents were asked to carry
out a change task on a process model that is captured with a technique that
The Impact of Sequential and Circumstantial Changes on Process Models 51
emphasizes a sequential view on the process. Therefore, we expected a change
task that is captured in the same, sequential style to be performed easier or
better than a circumstantial change task.
For the interpretation of these results we have to consider two major factors
that we tried to neutralize. First, there are characteristics of the process modeling
language that influence the ease of change. Arguably, BPMN process models
can be rather easily changed in comparison to Petri nets, which require the
alternation of places and transitions to be preserved. Accordingly, the size of
our models in the experiment could have been too small for the effect of change
type to materialize. Second, experiments like ours are strongly influenced by the
process modeling expertise of the participants [15]. It might have been the case
that our pre-test population was less proficient in process modeling, such that
the selected models again could have been too simple for the experimental group.
There are alternative explanations. We purposefully chose change tasks of
a different type, while ensuring that the graph-edit distance for solutions to
the sequential and circumstantial tasks are the same. This might also be a hint
that the graph-edit distance could be a much stronger factor for approximating
the difficulty of a change requirement1 . On the other hand, the number of
respondents that has been involved in this experiment (15) is rather low, which
makes statistical inferences hazardous due to the high impact of individual
observations. Given such a small sample size we are only able to detect strong
effects in the data. The impact of change type on accuracy seems to be such
a strong effect. Finally, the familiarization phase during which all respondents
could inspect the base model has been considerable. It could be argued that the
remaining sense-making task (e.g., the interpretation of the change task) is a
minor effort in the overall task. All these issues can only be settled satisfactorily by
replicating this experiment with a larger respondent base, a shorter familiarization
phase, and another set of change tasks.
5 Related Work
In this section we first discuss factors that influence the usability of process
models and which we strived to keep constant. Then, we relate works to our
experiment that investigate the impact of representational characteristics of a
model on comprehension and maintainability.
There are several factors influencing process model usability including domain
knowledge, tool support, and selection of tasks. Prior domain knowledge can
be an advantage for participants of an experiment. People may find it easier to
read a model about the domain they are familiar. It is known from software
engineering that domain knowledge affects the understanding of particular code
[11]. Its impact is neutralized in experiments by choosing a domain that is usually
only known by experts. Tool support plays a fundamental role in fostering process
1
Note that in practical settings the graph-edit distance of a change often cannot be
assessed beforehand, so this insight is mostly of a theoretical value.
52 M. Weidlich et al.
changes and hiding the complexity behind high-level change operations [18, 23].
We tried to neutralize the impact of tool support by offering only the most atomic
change operations. The selection of experimental tasks can also have an impact
on the validity of an experiment. It has been shown that understanding tasks can
vary in their degree of difficulty even if they relate to the same model [14]. We
tried to neutralize the impact of the tasks by choosing tasks of equal graph-edit
distance.
Our experiment can be related to various experiments that investigate how
characteristics of a particular problem representation influences problem-solving
performance. We have already referred to work on software program compre-
hension [6, 7, 8]. It showed that declarative programs are better at explicating
circumstantial information while imperative programs more handily show sequen-
tial information. This work is particularly interesting as it contributed to settling
a long debate on whether declarative or imperative computer programs should
be considered to be superior. Confirming results are reported among others in
[1, 10, 16] where the impact of a particular information representation is tested
as a factor of comprehension performance. This exactly matches the more general
argument of cognitive fit theory, which states that a problem representation
should match the problem solving task [22].
6 Summary and Conclusion
In this paper we investigated the relationship between the type of change re-
quirement and the performance of modifying a process model. We designed and
conducted an experiment in which graduate students received sequential and
circumstantial change requirements and changed a BPMN model accordingly.
The results show that there is partial support for the type of change being a
factor for process model maintainability. Our findings are of significant impor-
tance to future experiments on business process maintainability. Apparently, the
type of change requirement has an impact on the ease of changing the model.
Experiments that do not investigate this effect must neutralize its impact either
by using only one type of change requirement or by making a balanced selection
of change tasks from both types.
In future research we aim to replicate this experiment with more students in a
similar classroom setting. It will be interesting to check whether a larger sample
size will reveal effects that have been too weak to be detected with our small
sample. Furthermore, we plan to conduct experiments that vary the set of change
operations that are offered to the modeler. While we currently provided only basic
change operations in this experiment, it has to be investigated whether complex
changes can be easily made once high-level change operations are available. This
argument points also to the need for further research into change operations. We
consider it to be an important question how circumstantial change requirements
can be directly translated into corresponding change macros.
The Impact of Sequential and Circumstantial Changes on Process Models 53
Acknowledgement
This research is supported by the Technology Foundation STW, applied science
division of NWO, and the technology program of the Dutch Ministry of Economic
Affairs.
References
1. R. Agarwal, P. De, and A.P. Sinha. Comprehending object and process models: An
empirical study. IEEE TSE, 25(4):541–556, 1999.
2. W. Bandara, G. Gable, and M. Rosemann. Factors and measures of business process
modelling: model building through a multiple case study. EJIS, 14(4):347–360,
2005.
3. G. Canfora, F. Garcı́a, M. Piattini, F. Ruiz, and C.A. Visaggio. A family of
experiments to validate metrics for software process models. JSS, 77(2):113–129,
2005.
4. R. Dijkman, M. Dumas, and L. Garcı́a Bañuelos. Graph Matching Algorithms for
Business Process Model Similarity Search. In Proc. BPM ’09, pages 48–63, 2009.
5. D. Fahland and H. Woith. Towards process models for disaster response. In Proc.
BPM ’08, pages 254–265, 2008.
6. D.J. Gilmore and T.R.G. Green. Comprehension and recall of miniature programs.
IJMMS, 21(1):31–48, 1984.
7. T.R.G. Green. Conditional program statements and their comprehensibility to
professional programmers. Journal of Occupational Psychology, 50:93–109, 1977.
8. T.R.G. Green and M. Petre. Usability analysis of visual programmingenvironments:
A ‘cognitive dimensions’ framework. J. of Vis. Lang. and Computing, 7(2):131–174,
1996.
9. A.S. Guceglioglu and O. Demirors. Using Software Quality Characteristics to
Measure Business Process Quality. In Proc. BPM’05, pages 374–379, 2005.
10. J. Hahn and J. Kim. Why are some diagrams easier to work with? effects of
diagrammatic representation on the cognitive integration process of systems analysis
and design. ACMTCHI, 6, 1999.
11. A. Lakhotia. Understanding someone elses code: Analysis of experiences. JSS,
23(3):269–275, 1993.
12. C. Li, M. Reichert, and A. Wombacher. On measuring process model similarity
based on high-level change operations. In Proc. ER’08, pages 248–264, 2008.
13. L.A. Marascuilo and R.C. Serlin. Statistical Methods for the Social and Behavioral
Sciences. Freeman New York, NY, 1988.
14. J. Melcher, J. Mendling, H. A. Reijers, and D. Seese. On measuring the under-
standability of process models. In Proc. BPM ’09, 2009.
15. J. Mendling, H. A. Reijers, and J. Cardoso. What makes process models under-
standable? In Proc. BPM ’07, pages 48–63, 2007.
16. T.G. Moher, D.C. Mak, B. Blumenthal, and L.M. Leventhal. Comparing the
Comprehensibility of Textual and Graphical Programs: The Case of Petri Nets. In
Empirical Studies of Programmers: Fifth Workshop, pages 137–161, 1993.
17. J. Pinggera, S. Zugal, and B. Weber. Investigating the process of process modeling
with cheetah experimental platform. In Proc. ER-POIS 2010 (to appear), 2010.
18. M. Reichert and P. Dadam. ADEPTf lex – Supporting Dynamic Changes of
Workflows Without Losing Control. JIIS, 10(2):93–129, 1998.
54 M. Weidlich et al.
19. S. Siegel and N.J. Castellan. Nonparametric Statistics for the Social Sciences.
McGraw-Hill, 1988.
20. W.M.P van der Aalst. The Application of Petri Nets to Workflow Management.
The Journal of Circuits, Systems and Computers, 1998.
21. I. Vanderfeesten, H.A. Reijers, and W. M. P. van der Aalst. Evaluating workflow
process designs using cohesion and coupling metrics. Computers in Industry,
59(5):420–437, 2008.
22. I. Vessey. Cognitive Fit: A Theory-Based Analysis of the Graphs Versus Tables
Literature*. Decision Sciences, 22(2):219–240, 1991.
23. B. Weber, M. Reichert, and S. Rinderle-Ma. Change patterns and change sup-
port features - enhancing flexibility in process-aware information systems. DKE,
66(3):438–466, 2008.
24. C. Wohlin, R. Runeson, M. Halst, M.C. Ohlsson, B. Regnell, and A. Wesslen.
Experimentation in Software Engineering: an Introduction. Kluwer, 2000.
A. Change Descriptions Used in the Experiment
Sequential description. Customs of the host country may deny clearance of
equipment after presenting equipment at customs or after demonstration of
devices. If equipment is not cleared by customs of the host country, the task force
members try to convince customs officials to clear the equipment with incomplete
documents. In the meantime, task force members contact their partners to trigger
support from higher-ranked authorities of the host country. If the customs officials
finally clear the whole equipment by negotiation and support, the equipment is
transported to a storage location. In the other case, equipment is usually not
cleared because of incomplete documents for some parts of the equipment. Those
parts that have been cleared are transported to the storage location, whereas
the missing documents for the remaining parts are retrieved from the office
in Germany. Once these documents are available, the remaining parts of the
equipment are transported to the storage location as well.
Circumstantial description. Usually, equipment transport capacity is not available
immediately. Therefore, the process is adapted to ensure efficient handling of the
equipment. The task force team members travel in split groups to the destination.
A first group flies to the host country ahead of the equipment right away. After
having presented itself at the immigration it takes care of road maps, renting
of vehicles, and organizing accommodation. In the meantime, a second group
handles all equipment logistics in Germany and then flies to the disaster area
independently of the equipment. Eventually, the second group passes immigration
and contacts the other task force team members. In the meantime, the second
group also contacts local geologists, if there is a local institution with geologic
know-how. The equipment is cleared in the host country as soon as it arrives. The
whole equipment handling in the host country including customs is done by the
second group of task force members. The first and the second team synchronize
after their respective processes and transport the cleared equipment to the storage
location.