=Paper=
{{Paper
|id=None
|storemode=property
|title=Modelling Gradients using Petri Nets
|pdfUrl=https://ceur-ws.org/Vol-827/4_LauraBertens_article.pdf
|volume=Vol-827
|dblpUrl=https://dblp.org/rec/conf/acsd/BertensKKV10
}}
==Modelling Gradients using Petri Nets==
Modelling Gradients Using Petri Nets Laura M.F. Bertens1 , Jetty Kleijn2 , Maciej Koutny3 , and Fons J. Verbeek1 1 Imaging and Bioinformatics group, LIACS, Leiden University Leiden, 2300 RA The Netherlands lbertens@liacs.nl, fverbeek@liacs.nl 2 LIACS, Leiden University Leiden, 2300 RA The Netherlands kleijn@liacs.nl 3 School of Computing Science, Newcastle University Newcastle upon Tyne, United Kingdom maciej.koutny@ncl.ac.uk Abstract. Motivated by the graded posteriorization during the AP axis development in the frog Xenopus laevis, we propose an abstract Petri net model for the formation of a gradient of proteins in a chain of cells. Keywords: gradient formation, planar signalling, Petri net model 1 Introduction Petri nets have been shown to be very promising for molecular and cellular biology, in particular for metabolic, signalling and gene-regulatory networks (see e.g. [1, 2, 6, 9, 10, 14, 20, 30, 31]). In this paper we propose Petri nets as an abstract modelling tool for higher level developmental processes in the organism, e.g., on tissue and organ level, taking cells as central elements. Currently, we are working on a case study: the embryonic development of the anterior-posterior i.e., head-to-tail axis (AP axis) in the model organism Xenopus laevis, the African clawed frog. The development of this model embryo has been studied thoroughly and a huge amount of literature is available to draw from when building and validating the model, see references in [3, 15]. Moreover, this case study comprises several different subprocesses, found in many biological processes, that require modelling solutions. The aim of our project is to eventually model the entire process of AP axis development. Hence we envisage a final model consisting of several building blocks, most of which describing generic biological processes. Each of the subprocesses poses modelling challenges which, when solved, may lead to templates for similar developmental processes, incorporating multiple levels of both spatial and temporal information, also in other organisms. Petri nets are particularly useful in modelling such biological processes, due to their intuitive graphical component, which resembles biological diagrams, and their ability to model concurrency. Our case study appears to be very well suited to explore new ways in which Petri nets can be applied to developmental biology. Recent Advances in Petri Nets and Concurrency, S. Donatelli, J. Kleijn, R.J. Machado, J.M. Fernandes (eds.), CEUR Workshop Proceedings, ISSN 1613-0073, Jan/2012, pp. 39–53. 40 Petri Nets & Concurrency Bertens et al. 2 L.M.F.Bertens, J.Kleijn, M.Koutny and F.J.Verbeek In this paper we present a fundamental approach to modelling a particular subprocess: the formation of a morphogen gradient, which helps instigate the differentiation of the cells along the developing axis. This subprocess is a good starting point, since it is relatively simple conceptually, in comparison to the other subprocesses in the case study. In early development, gradients are cru- cial ([36]) and finding a modelling solution for the generic process of gradient formation will not only serve the modelling of this case study, but will also be useful for the modelling of other developmental processes. By staying very close to the biological sequence of events in gradient formation, rather than focusing on a concrete outcome, the model should be generally applicable and robust. Throughout this paper the emphasis will be on abstraction and modelling decisions, as opposed to implementation of specific biological data; we present a basic Petri net modelling gradient formation, which serves as a proof of con- cept for our approach. In the remainder of this paper we outline the biological background of gradient formation in general and in this particular case study. Subsequently we describe our modelling decisions and we present the model. In the last section the possibilities of the model and future work are discussed. 2 PT-nets with activator arcs For a general introduction to Petri nets we refer to [27]. In this paper, we use PT-nets with activator arcs ([17]), and a maximally concurrent execution rule [5]. Petri nets are defined by an underlying structure consisting of places and transitions. These basic elements are connected by directed, weighted arcs. In the Petri net model considered in this paper, there are moreover activator arcs connecting places to transitions. In modelling, places are usually the passive elements, representing local states, and transitions the active elements. Here, global states, referred to as markings, are defined as mappings assigning to each place a natural number (of tokens corresponding to available resources). A PTA-net, is a tuple N = (P, T, W, Act, m0 ) such that: – P and T are finite disjoint sets, of the places and transitions of N , resp. – W : (T × P ) ∪ (P × T ) → N is the weight function of N . – Act ⊆ P × T is the set of activator arcs of N . – m0 : P → N is the initial marking of N . In diagrams, places are drawn as circles, and transitions as boxes. Activator arcs are indicated by black-dot arrowheads. If W (x, y) ≥ 1, then (x, y) is an arc leading from x to y; it is annotated with its weight if this is greater than one. A marking m is represented by drawing in each place p exactly m(p) tokens as small black dots. We assume that each transition t has at least one input place (there is at least one place p such that W (p, t) ≥ 1). When a single transition t occurs (‘fires’) at a marking, it takes tokens from its input places and adds tokens to its output places (with the number of tokens consumed/produced given by the weights of the relevant arcs). Moreover, if there Modelling gradients using Petri nets Petri Nets & Concurrency – 41 Modelling Gradients Using Petri Nets 3 is an activator arc (p, t) ∈ Act, then transition t can only be executed at the given marking if p contains at least one token, without the implication of tokens in p being consumed or produced when t occurs. Thus, the difference with a self-loop, i.e., an arc from p to t and vice versa, is that the activator arc only tests for the presence of tokens in p. We define the executions of N in the more general terms of simultaneously occurring transitions. A step is a multiset of transitions U : T → N. Thus U (t) specifies how many times transition t occurs in U . (Note that if we exclude the empty multiset, single transitions can be considered as minimal steps.) Step U is enabled (to occur) at a marking m if m assigns enough tokens to each place for all occurrences of transitions in U and, moreover, all places tested through an activator arc by a transition in U , contain at least one token. Formally, step U is enabled at marking m of N if, for all p ∈ P : – m(p) ≥ t∈T U (t) · W (p, t) P – m(p) ≥ 1 whenever there is a transition t such that U (t) ≥ 1 and (p, t) ∈ Act. If U is enabled at m, it can be executed leading to the marking m′ obtained from m throught the accumulated effect of all transition occurrences in U : – m′ (p) = t∈T U (t) · (W (t, p) − W (p, t)) for all p ∈ P . P Finally, a step U is said to be max-enabled at m if it is enabled at m and there is no step U ′ that strictly contains U (meaning that U ′ 6= U and U (t) ≤ U ′ (t) for all transitions t) and which is also enabled at m. We denote this by m[U im′ . A (max-enabled) step sequence is then a sequence σ = U1 . . . Un of non-empty steps Ui such that m0 [U1 i m1 · · · mn−1 [Un i mn , for some markings m1 , . . . , mn of N . Then mn is said to be a reachable marking of N (under the maximally concurrent step semantics). To conclude this preliminary section, we elaborate a bit on the choice of this particular net model. First, it should be observed that it follows from the above definitions that the semantics allows auto-concurrency, the phenomenon that a transition may be executed concurrently with itself. This approach makes it possible to use transitions for a faithful modeling of natural events like the independent (non-sequential) occurrence in vast numbers of a biochemical reac- tion in a living cell. Note that the degree of auto-concurrency of a transition can easily be controlled by a dedicated place with a fixed, say k, number of tokens connected by a self-loop with that transition implying that never more than k copies of that transition can fire simultaneously. Activator arcs were introduced in [16] as a means of testing for the presence of at least one token in a place, and so they are similar to other kinds of net features designed for the same reason. We mentioned already self-loops by which the presence of a token in a place can be tested only by a single transition (which ‘takes and returns’ the token) and not simultaneously by an arbitrary number of transition occurrences in a step. Two other mechanisms which do allow such multiple testing are context arcs [25] and read (or test) arcs [34]. Both, however, display important differences when compared with activator arcs. A context arc 42 Petri Nets & Concurrency Bertens et al. 4 L.M.F.Bertens, J.Kleijn, M.Koutny and F.J.Verbeek testing for the presence of a token in place p by transition t indicates that after a step in which t participates has been executed, p must still contain a token which precludes the occurrence in the same step of transitions that have p as an output place. A read arc is also different, but less demanding in that there must exist a way to execute sequentially (i.e., one-by-one) all transition occurrences in the step, without violating the read arc specification. In both cases, one can easily see that activator arcs are most permissive since they only check for the presence of a token before the step is executed (this is often referred to as a priori testing). We feel that a priori testing is more appropriate for biological applications as the ‘lookahead’ implied by the other two kinds of test arcs is hard to imagine in reality. Finally, we rely in this paper on maximal concurrency in the steps that are executed which reflects the idea that execution of transitions is never delayed. This may also be viewed as a version of time-dependent Petri nets where all transitions have a firing duration of 1. However, the maximal concurrency we apply in this paper does not derive from Petri nets with time, but rather from Petri nets with localities [19] leading to a locally maximal semantics. This se- mantics is what we plan to use to model other aspects of the development as well. Here one may think of e.g., the locally synchronous occurrence (in pulses) of reactions in individual compartments of a cell. 3 Biological background and modelling decisions In biology, the term gradient is used to describe a gradual and directed change in concentration of a morphogen through a group of cells, e.g., a tissue. Morphogens are signalling molecules that cause cells in different places in the body to adopt different fates and thereby help establish embryonic axes. Morphogens are pro- duced in a localized source of a tissue, the source cell(s), and emanate from this region, forming a concentration gradient ([13, 32]). A morphogen gradient has an immediate effect on the differentiation of the cells along it; cells are able to ’read’ their position along the gradient and determine their developmental fate accord- ingly. They have a range of possible responses and the morphogen concentration dictates which response will be exhibited ([13, 32]). In establishing their devel- opmental fate, cells take into account the morphogen concentration. When the morphogen concentration over the entire gradient is increased (or decreased), the cells should accordingly change their response to that corresponding to a higher (or lower) level of morphogen. The mechanisms by which the morphogen travels through a cell layer have been the topic of some debate and are not yet fully understood. Three mech- anisms have been described, shown schematically in Figure 1: (A) diffusion through the extracellular matrix ([8, 11, 23]), either passively, like a drop of ink in water ([11]), or facilitated by receptors on the cell surface which guide the morphogens along ([8]), as shown in the figure; (B) sequential internalization of the morphogen molecules in vesicles in the cells, a process called endocytosis, and subsequent re-emission ([7, 8, 32]); (C) direct contact between the cells by Modelling gradients using Petri nets Petri Nets & Concurrency – 43 Modelling Gradients Using Petri Nets 5 A sequential ACTIVATION TRANSFORMATION concurrent B PLANAR SIGNALLING VERTICAL SIGNALLING C Fig. 1. Left: three possible mechanisms for gradient formation: diffusion (A), endocy- tosis and subsequent re-emission (B) and transport through cytonemes (C). Right: an overview of the process of AP axis formation in Xenopus laevis means of tentacle-like threads of cytoplasm, called cytonemes, connecting the cells ([13]). These mechanisms are not necessarily mutually exclusive and some studies conclude that a combination of mechanisms underlies the formation of a gradient. It is important to note that both diffusion and endocytosis take place between neighbouring cells, while cytonemes connect all cells directly to the source. This makes it very different from a modelling perspective, as will be discussed below. Unfortunately, knowledge of the exact concentrations and shapes of most gradients is limited. This is mainly due to the transient nature of morphogen gradients and the low concentrations at which they are effective, both of which make it difficult to visualize the morphogens ([11]). Many morphogens are rapidly degraded or prevented from binding to receptors by antagonistic proteins ([11]). Much of the information on gradients is therefore obtained indirectly, by observ- ing their effect, i.e., the responses of the cells along it ([11]). AP axis formation in Xenopus laevis: a case study. The AP axis for- mation in Xenopus laevis takes place during the early embryonic stage of gas- trulation and ensures the development of anterior structures near the head and posterior structures towards the tail. The process can be seen as divided into two steps, which take place sequentially ([26]), cf. Figure 1. The first step is activation; a group of cells in the outer cell layer of the embryo, the ectoderm, change their developmental identity and form a rectangular strip of tissue, called the neurectoderm ([3, 15]). It is this strip of cells in which the AP axis will ulti- mately be established, leading to gradual posteriorization of cells nearer to the tail-end of the embryo. 44 Petri Nets & Concurrency Bertens et al. 6 L.M.F.Bertens, J.Kleijn, M.Koutny and F.J.Verbeek During the second step, transformation, the axis is formed in the neurec- toderm by means of two mechanisms: vertical and planar signalling between neighbouring cells ([3, 15]). Here we focus on the second. Planar signalling occurs within the neurectoderm in a direction parallel to the future axis (and is there- fore called ‘planar’). Concentration gradients of several morphogens are formed in the neurectoderm along the future AP axis. Source cells on the posterior end of the neurectoderm produce the morphogens, which then get distributed throughout the tissue. Individual cells sense their position along these gradi- ents and take on a more or less posterior fate according to the concentration of these posteriorizing molecules ([12, 15]), thereby establishing the formation of an AP axis. In the planar signalling of our case study three types of signalling molecules play a role: retinoic acid (RA), fibroblast growth factors (Fgf) and Wnts ([22, 29, 35]). All of these are produced at the posterior end of the embryo and together these promote posterior cell fates, while inhibiting anterior fates. Although it is clear that all three types are important in axis formation, it is not yet fully understood how these proteins interact in establishing cell fate. A general and abstract modelling approach, focusing on the underlying common process of gradient formation, makes it possible to later add specific data on any of the morphogens in particular or on combinations of these. Modelling decisions. We have chosen cells as the elementary units in our model to be represented as places in a Petri net. Earlier studies ([4, 21, 24]) have successfully modelled cell-to-cell signalling, starting from a lower biological level, using places to represent genes and proteins. Although this allows a high level of detail, it also complicates the net and makes it difficult to identify single cells. In our approach the cellular level represents the intermediate level between the subcellular levels, on which the morphogen signalling between cells takes place, and the tissue/organ level, where whole cell layers may move. Tokens are used to represent a certain level of concentration (see [10]) within the overall gradient of the morphogen system, without differentiation between morphogens or their quantities. As mentioned before, in most cases no quan- titative data are available, since morphogen gradients are often transient and difficult to visualize ([13]). As in [21], our approach is therefore partially qualita- tive and partially quantitative. The significance of tokens in a place is not purely qualitative; not only the presence or absence but also the exact number of tokens determine the course of events. However, the numbers of tokens do not represent actual numbers of molecules, making the model semi-qualitative. Our Petri net model can, however, also be used to model specific morphogens, incorporating quantitative data, by assigning exact concentrations to the tokens and thereby making the model completely quantitative. For certain morphogens quantita- tive data exist, for instance for the gradient of Fgf8 in zebrafish, which can be seen to spread extracellularly through the processes of diffusion, endocytosis and degradation ([28]). Also, for some gradients found in biological processes, exper- imental data have enabled to deduce mathematical expressions, describing the Modelling gradients using Petri nets Petri Nets & Concurrency – 45 Modelling Gradients Using Petri Nets 7 quantitative morphogen concentrations ([33]). When modelling these gradients, these formulas can be incorporated in the parameters of our Petri net model. Neighbourhood communication. It is our aim to develop a faithful model for gradient formation. Rather than having the net simply distribute the proper pre-computed amount of tokens over the places representing the cells, the actual transport of morphogen between cells can be read off from the Petri net model during execution. Consequently, when building the model we have to specify explicitly which process of gradient formation is to be modelled. Here we choose to model morphogens moving between neighbouring cells, i.e., the Petri net will implement a mechanism similar to diffusion or endocytosis and subsequent re- emission, but not transport through cytonemes (since this does not take place between neighbouring cells). However, we foresee no problems in the abstract implementation of the latter process. The difference between diffusion and en- docytosis is apparent on a lower biological level and could be modeled by sub- nets. Furthermore, often the ratio of the concentrations between neighbouring cells is not known due to lack of quantitative data, and it may vary depending on the gradient considered. Therefore we have a parameter ρ in our model to represent this ratio and to determine the amount of tokens to be transported between places during the simulation of gradient formation. Since we do not distinguish the molecular mechanisms of diffusion, endocytosis and degradation of morphogens in this model, ρ represents the final ratio of morphogens between neighbouring cells and morphogen degradation is implicit. To model explicitly both the production of morphogens in the local source cells and the degradation in the target cells, subnets could be added. This should make the source and sink mechanisms of gradient formation transparent and allow the user to experiment with different configurations. Implementation. In the organism, gradient ratios arise passively as a conse- quence of physical laws. However, to accurately reflect the biological process of gradient formation underlying the spread of morphogens from cell to cell, our formal model has to compute the number of tokens passed on based on the ratio ρ. Hence the model includes explicit separate computational units for the nec- essary calculations. In particular, these parts of the net control the transport of tokens between places. In this way a close relation to the biological process can be maintained in one part of the net, with the underlying computations performed by a subnet in the background. At all times, the marking of the net will be consistent with biological observations of (the effect of) the gradient, i.e., the ratio is maintained and places corresponding to cells further away from the source will never have more tokens than places (cells) closer to it. Another important feature of the model is the use of concurrent steps rather than indi- vidually occurring transitions. Cells only react to their environment and have no knowledge of other cells than their immediate neighbours. Non-adjacent cells can be simultaneously involved in the transport of morphogens. This leads to an execution mode consisting of concurrent steps. Moreover, these steps are maxi- 46 Petri Nets & Concurrency Bertens et al. 8 L.M.F.Bertens, J.Kleijn, M.Koutny and F.J.Verbeek mal to reflect that also in the net model morphogens are moved to a next cell as soon as possible. 4 Gradients and Petri Nets Following the ideas outlined in the previous section, we will propose a formal model for the formation of a gradient. Our assumptions regarding the biological process of gradient formation are as follows. Given is a segment of k adjacent cells with the i-th cell immediate neighbour of the (i + 1)-th cell. Morphogens can be transported only between immediate neighbours. Morphogens move from cells with higher concentration to neighbours with lower concentration, as long as their concentration ratio does not exceed a given gradient ratio 0 < ρ < 1. We assume that ρ is a rational number, i.e., ρ = MN , where M > N ≥ 1. Initially, the first cell x1 contains a quantity (has concentration level) K of a morphogen. These assumptions lead to the following modelling problem. Given are k ≥ 1 places x1 , . . . , xk , representing a segment of k cells with place xi corresponding to the i-th cell. In the initial marking m0 , the first place x1 contains K tokens and there are no tokens in the other places. In the net modelling the mechanism of gradient formation, we need to shift tokens from x1 in the direction of the last place xk . Places and/or transitions may be added, but in such a way that for any reachable marking m the following hold. 1. The number of tokens in the xi ’s remains constant, i.e., m(x1 ) + · · · + m(xk ) = K token preservation 2. The tokens are distributed monotonically along the sequence of k places, i.e., m(x1 ) ≥ . . . ≥ m(xk ) monotonicity 3. The ratio of the numbers of tokens in two neighbouring places does not exceed ρ, i.e., for every 1 ≤ i < k with m(xi ) ≥ 1: m(xi+1 ) m(xi ) ≤ ρ ratio 4. Shifting continues until moving even one token would violate the above, i.e., if no tokens are shifted after marking m was reached, then for every 1 ≤ i < k with m(xi ) > 1: m(xi+1 )+1 m(xi )−1 > ρ termination Moreover, the relative position of a place within the sequence plays no role. In particular, the mechanism should be easily scalable and insen- sitive to the specific values of k and K. ⊓ ⊔ Modelling gradients using Petri nets Petri Nets & Concurrency – 47 Modelling Gradients Using Petri Nets 9 If we look at the above formulation of properties (2) and (3) — monotonicity and preservation of the gradient ratio — and recall that ρ = M N and M > N , it is easy to observe that these two properties are together equivalent to stating that, for every 1 ≤ i < k, N ·m(xi ) − M ·m(xi+1 ) ≥ 0. We will call a marking m df satisfying this inequality consistent and denote αi = N ·m(xi ) − M ·m(xi+1 ), for every 1 ≤ i < k. Note that the initial marking is consistent. Similarly, if we look at the above formulation of properties (2) and (4) — monotonicity and termination — it is easy to observe that together they are equivalent to the statement that, for every 1 ≤ i < k, N ·m(xi ) − M ·m(xi+1 ) < M + N . We will call a consistent marking m satisfying this inequality stable. Note that for a given ρ, k and K, there may be more than one stable marking. For example, if ρ = 12 , k = 5 and K = 111, then the following are two different stable markings: x1 x2 x3 x4 x5 x1 x2 x3 x4 x5 59 29 14 6 3 58 29 14 7 3 We are now ready to propose a generic solution for the above problem. For a given consistent j marking k m and each 1 ≤ i < k, move βi tokens from xi to xi+1 where βi ≤ M+N αi , and at least one βi must be non-zero if at least one of j k the values M+N αi is non-zero. We denote the resulting marking by mβ1 ...βk−1 . An intuitive reason for proposing such a mechanism for shifting tokens is that the number of tokens in xi that are ‘balanced’ by tokens in xi+1 is M N ·m(xi+1 ), because each token in xi+1 is equivalent to M N tokens in xi . Hence there are m(xi ) − MN ·m(x i+1 ) unbalanced tokens in xi . The ‘portion’ of each unbalanced token that could be safely transferred to xi+1 is M+N N . Hence in total we may j k j k safely transfer M+N N ·(m(xi ) − MN ·m(xi+1 )) tokens, which is precisely M+N αi tokens. Clearly, some of the numbers β1 , . . . , βk−1 can be zero, and by the con- dition above, all βi ’s are zeros if and only if the marking is stable: Proposition 1. β1 = · · · = βk−1 = 0 if and only if m is stable. Crucially, by the mechanism proposed consistent markings are always trans- formed into consistent markings. Proposition 2. If m is a consistent marking then mβ1 ...βk−1 is also consistent. j k According to the above, any number of tokens not exceeding M+N αi can be moved simultaneously from xi to xi+1 (for every i < k), and consistency will be preserved. Clearly, the new consistent marking is different from the previous one if and only if, for at least one i, we have βi ≥ 1. The idea now is to keep changing j thek marking on x1 , . . . , xk until a marking m has been reached such that M+Nαi = 0, for all 1 ≤ i < k, which is equivalent to αi < M + N , for all 1 ≤ i < k. In other words, this m is a stable marking. Since tokens cannot 48 Petri Nets & Concurrency Bertens et al. 10 L.M.F.Bertens, J.Kleijn, M.Koutny and F.J.Verbeek be shifted forever, this procedure will always terminate in a stable marking (formally, we can show this by considering a weighted distance to the end of the chain of the K tokens; it never increases and always decreases in a non-stable state). Looking now from the point of view of a Petri net implementation of the proposed mechanism, what we are after is a net Nshift comprising the places x1 , . . . , xk and such that if m is a marking of Nshift whose projection on these k places is consistent, then a step U can occur at m if j k – it moves at most M+N αi tokens from xi to xi+1 , for all 1 ≤ i < k; – at least one token is moved from xi to xi+1 for at least one 1 ≤ i < k, unless the projection of m onto x1 , . . . , xk is stable. In fact, in the proposed implementation, we will be preceding the ‘token-shifting’ with a ‘pre-processing’ stage which seems to be unavoidable unless one uses some kind of arcs with complex weights depending on the current net marking. Implementation. In the implementation of the proposed shifting mechanism, as many tokens as possible should be shifted from one neighbour to the j next. k That means that, at each stage we have, for every 1 ≤ i < k, βi = M+N αi . Moreover, tokens are shifted from a place without any assumptions whether new tokens will come to that place from its other neighbour. Thus we need to provide a Petri net structure capable of ‘calculating’ the value of expressions like N ·m(xi ) − M ·m(xi+1 ) . M +N Our proposed gradient forming mechanism distinguishes three phases: I, II and III. An auxiliary net N3phase , shown in Figure 2(b), is used to schedule the transitions implementing the calculations. It controls these transitions via the places wI and wII and activator arcs. For the full picture of the system one should combine the figures for all pairs (xi , xi+1 ) with a single copy of the net in Figure 2(b). Note that all places with identical label (in particular wI , wII , and wIII ) should be identified. That other parts of the encompassing net model do not interfere with the calculations carried out during phases I and II can be ensured by connecting the relevant transitions with the place wIII using activator arcs. For every 1 ≤ i < k, transition ti is intended to shift tokens from xi to xi+1 (phase III). To achieve this, we use two disjoint sets of new, auxiliary places, x′1 , . . . , x′k and x′′1 , . . . , x′′k . These places are initially empty. The idea is to fill x′i with N ·m(xi ) tokens and x′′i+1 with M ·m(xi+1 ) tokens (phase I). The latter are used for the removal of M ·m(xi+1 ) tokens from x′i (phase II). After this, there are αi tokens remaining in x′i . Finally, for each group of N + M tokens in x′i , one token is shifted from xi to xi+1 . The construction (for xi and xi+1 ) is shown in Figure 2(a). The overall mechanism operates in cycles of three consecutive, maximally concurrent steps such that for every 1 ≤ i < k: Modelling gradients using Petri nets Petri Nets & Concurrency – 49 Modelling Gradients Using Petri Nets 11 wII wI x′i x′′i+1 wI wII wIII e′i di e′′i+1 N M c′i M +N c′′i+1 wI wI wI ti xi xi+1 wIII (a) (b) Fig. 2. (a) The main part of the construction for the solution (note that e′′i+1 is introduced for later use when one might want to remove or add tokens to the xi ’s from ‘outside’; in the standard (consistent) situation it is never activated as after phase 2, place x′′i+1 is empty.); and (b) the subnet N3phase enforcing the three phases. I. Transition c′i , inserts (in m(xi ) auto-concurrent occurences) N ·m(xi ) tokens into x′i . In the same step, transition c′′i+1 , inserts (in m(xi ) auto-concurrent occurences) M ·m(xi+1 ) tokens into x′′i+1 . Simultaneously, transitions e′i and e′′i+1 empty x′i and x′′i+1 of any residual tokens left from the previous cycle. II. Next, transition di (in M ·m(xi+1 ) auto-concurrent occurences) empties x′′i+1 and leaves in x′i the difference αi = N ·m(xi ) − M ·m(xi+1 ). j k III. In the third step, the occurrences of transition ti transfer βi = M+N αi tokens from xi to xi+1 . Proposition 3. Each cycle results in transferring βi tokens from xi to xi+1 . Note that in this implementation with the control net N3phase , neighbour- ing pairs are either all involved in calculations (step 1 and 2 of the cycle) or tokens are transferred between neighbours (step 3). During the whole operation of the adjustment process (except for the transfer phase), the token counts in the places xi representing the cells are unchanged and they can be accessed for reading by other transitions (and thus influence neighbouring cells). In other words, calculations are orthogonal to the basic operation of the net (the gradient formation). As an example, let us consider the case when ρ = 12 , k = 4 and K = 100. Then executing the constructed net in a maximally concurrent manner leads to the following sequence of markings on the xi after each cycle and eventually to a stable marking: x1 100 67 67 60 60 57 57 56 56 55 54 x2 0 33 22 29 25 28 26 27 26 25 26 x3 0 0 11 8 12 10 12 12 13 12 12 x4 0 0 0 3 3 5 5 5 5 6 6 50 Petri Nets & Concurrency Bertens et al. 12 L.M.F.Bertens, J.Kleijn, M.Koutny and F.J.Verbeek The next example shows what happens if we start from a (non-initial) con- sistent marking (again ρ = 12 ): x1 200 167 156 ... x2 50 67 67 ... x3 0 16 22 ... x4 0 0 5 ... The construction works without any problems, if we start with a consistent marking. In case 0 > αi for some i, then transition ti is not executed, but the transitions ti−1 and ti+1 may still be executed and lead to an adjustment of the marking causing ti to become active in the next cycle. A further observation is that adding (or removing) tokens at some point, will trigger a re-adjustment process which tries to re-establish the correct ratios between the markings of adjacent places xi . This process is unpredictable, but to deal with that case we have included transition e′′i+1 which in the standard (consistent) situation is never activated since then, after phase 2, place x′′i+1 is empty. An important characteristics of the proposed solution is that it is purely local and does not assume anything about the number of tokens which may appear in the xi ’s nor the length of the chain. In other words, it is truly generic. What’s more it also works if M and N are different for different pairs of neighbouring places, i.e., if rather than a uniform gradient ratio ρ there is a ratio ρi for each pair of neighbours xi and xi+1 . Another feature of our solution is the maximal concurrency semantics in- tended to reflect the idea of morphogens (simultaneously) moving from cell to neighbouring cell whenever that is possible. The preliminary sequential seman- tics model we developed (but not reproduced here) is more complicated as it also needs inhibitor arcs which test for absence of tokens (to decide whether or not tokens should still be shifted). Moreover, one needs to decide that xi either receives or sends tokens at each stage. In a step model it can both receive and send. Also, with the maximal concurrency semantics, the number of states of the model is dramatically reduced. The auxiliary net N3phase is used to partly sequentialize the behaviour in order to separate the pre-processing phases from the actual shifting phase. This net could also have been made local to the subnet in Figure 2(a), with different copies of it assigned to different localities. This would have given the additional possibility of controlling the degree of synchronisation between different parts of the gradient model by using a locally maximal step semantics. Finally, we would like to point out that the activator arcs in our implementa- tion are used only to control the calculation and can actually be avoided in case there would be a limit on the number of tokens in each place xi at any time. (Then the activator arcs can be eliminated basically by having separate copies of N3phase for each 1 ≤ i < k, transfer around sufficiently many tokens in a bundle, and replace activator arcs by self-loops). This assumption corresponds to having (or knowing) some capacity bound on the concentration levels of morphogens in a cell and so may be biologically sound! Modelling gradients using Petri nets Petri Nets & Concurrency – 51 Modelling Gradients Using Petri Nets 13 5 Conclusion Starting from gradient formation in the AP axis development in the model or- ganism Xenopus laevis, we have presented a novel approach to using Petri nets in developmental biology by focusing on the cellular rather than subcellular levels and abstracting from concrete proteins and genes. This has led to a parame- terized Petri net model for the general process of gradient formation through diffusion and endocytosis. Assumptions regarding gradient formation have been formulated based on essential features of this process as reported in the literature. These assumptions underlie the precise requirements given that should be satisfied by an abstract Petri net model of gradient formation. A crucial point here is the consistency that is maintained during the execution of the model. Hence the realization of the gradient is faithfully reflected. Moreover the close relationship between biological process and evolution of the formal model makes it possible to apply existing Petri net techniques to analyse what happens during gradient formation. In particular cause-effect relations should be properly reflected in the process semantics of the modelling Petri net ([17, 18]). Another main contribution of this approach is its generic nature, leading to a model that is scalable and applicable to a plethora of specific gradients. Also scalability is a consequence of the faithful reflection of the biological process. Since the final token (morphogen) distribution is not directly computed from the initial amount of morphogen and the length of the chain of cells, but rather simulates the communication between neighbouring cells, the length plays no role in the occurrence of the steps. The model as presented here represents a one-morphogen system without relying on quantitative data, but exact values could be assigned to ratio and individual tokens. Moreover, it provides a basis for simulation of simultaneous gradient formation (different morphogens with different experimental initial markings) and for inhibiting/activating interactions between them. Simulation with actual biological data to validate the model should be a next step. In addition, we will focus our attention on the extension of this still rather basic model to more dimensions, e.g., rather than having just a single line of cells, we consider the spread of morphogens from a source throughout a tissue plane or volume. In [4, 21], Petri nets are used to model developmental processes in a way similar to our approach when it comes to the semi-qualitative use of tokens and the use of maximal concurrency. In these papers however, the focus is on subcellular levels. Petri net places are used to represent genes and gene products, where in our approach cells, as basic units in a tissue, are modelled by places. Having cells as basic units should prove to be a useful intermediate position convenient for ‘zooming in and out’ between subcellular and tissue level. It is our aim to model more subprocesses of the AP axis formation. For instance the different molecular processes underlying diffusion and endocytosis could be modeled in subnets, allowing the user to compare the different effects of these mechanisms. Also the degradation of morphogens could be modeled by a subnet, making the entire process more explicit. The choice of cells as main elements is 52 Petri Nets & Concurrency Bertens et al. 14 L.M.F.Bertens, J.Kleijn, M.Koutny and F.J.Verbeek expected to be particularly suitable not only in this ‘vertical’ linking processes, but also for the ‘horizontal’ connections between processes taking place on the same cellular level. Having molecules or genes as places would result in specific net models for certain processes, as would taking tissue structures, such as the neurectoderm. Cells however can play a role in different processes simultaneously. The next step in the modelling of the AP axis development in Xenopus laevis will focus on the vertical signalling (see Figure 1). This process occurs concurrently with the planar signalling of gradient formation and involves the same cells. This will challenge us to explore further the possibilities of Petri nets as a model for concurrent and independent processes in high level developmental biology. Acknowledgments We are grateful to all referees for their remarks and sugges- tions which helped us to improve the paper. We would like to express also our appreciation to A.Durston and H.Jansen for discussing Xenopus biology. References 1. R.Banks: Qualitatively Modelling Genetic Regulatory Networks: Petri Net Tech- niques and Tools. Ph.D. Thesis, Newcastle University, 2009 2. R.Banks, V.Khomenko, L.J.Steggles: A Case for Using Signal Transition Graphs for Analysing and Refining Genetic Networks. ENTCS 227, 2009, 3–19 3. N.Bardine: Hox in Frogs. PhD Thesis, University of Leiden, 2008 4. N.Bonzanni et. al: Executing Multicellular Differentiation: Quantitative Predictive Modelling of C.elegans Vulval Development. Bioinformatics 25, 2009 5. H.-D.Burkhard: On Priorities of Parallelism: Petri Nets under the Maximum Firing Strategy. LNCS 146, 1983, 86–97 6. C.Chaouiya: Petri Net Modelling of Biological Networks. Briefings in Bioinformat- ics 8, 2007, 210–219. 7. E.Entchev, M.Gonzalez-Gaitan: Morphogen Gradient Formation and Vesicular Trafficking. Traffic 3, 2002, 98–109 8. J.A.Fischer, S.H.Eun, B.T.Doolan: Endoytosis, Endosome Trafficking, and the Regulation of Drosophila Development. The Annual Review of Cell and Devel- opmental Biology 22, 2006, 181–206 9. D.Gilbert, M.Heiner: From Petri Nets to Differential Equations - an Integrative Approach for Biochemical Network Analysis. LNCS 4024, 2006, 181–200 10. D.Gilbert, M.Heiner, S.Lehrack: A Unifying Framework for Modelling and Analysing Biochemical Pathways Using Petri Nets. LNBI 4695, 2007, 200–216 11. J.B.Gurdon et. al: Activin Signalling and Response to a Morphogen Gradient. Nature 371, 1994, 487–492 12. J.B.Gurdon et. al: Single Cells Can Sense their Position in a Morphogen Gradient. Development 126, 1999, 5309–5317 13. J.B.Gurdon, P.Bourillot: Morphogen Gradient Interpretation. Nature 413, 2001, 797–803 14. M.Heiner, D.Gilbert, R.Donaldson: Petri Nets for Systems and Synthetic Biology. LNCS 5016, 2008, 215–264 15. H.J.Jansen: Anterior-posterior Axis Formation in Xenopus laevis. PhD Thesis, University of Leiden, 2009 Modelling gradients using Petri nets Petri Nets & Concurrency – 53 Modelling Gradients Using Petri Nets 15 16. R.Janicki, M.Koutny: Semantics of Inhibitor Nets. Information and Computation 12, 1995, 1–16 17. J.Kleijn and M.Koutny: Processes of Petri Nets with Range Testing. Fundamenta Informaticae 80, 2007, 199–219 18. J.Kleijn and M.Koutny: Processes of Membrane Systems with Promoters and In- hibitors. Theoretical Computer Science 404, 2008, 112–126 19. J.Kleijn, M.Koutny, G.Rozenberg: Towards a Petri Net Semantics for Membrane Systems. LNCS 3850, 2006, 292–309 20. I.Koch, B.H.Junker, M.Heiner: Application of Petri Net Theory for Modelling and Validation of the Sucrose Breakdown Pathway in the Potato Tuber. Bioinformatics 21, 2004, 1219–1226 21. E.Krepska et. al: Design Issues for Qualitative Modelling of Biological Cells with Petri Nets. LNBI 5054, 2008, 48–62 22. T.Kudoh, S.W.Wilson, I.B.Dawid: Distinct roles for Fgf, Wnt and Retinoic Acid in Posteriorizing the Neural Ectoderm. Development 129, 2002, 4335–4346 23. A.D.Lander, Q.Nie, F.Y.M.Wan: Do Morphogen Gradients Arise by Diffusion? Developmental cell 2, 2002, 785–796 24. H.Matsuno et. al: Boundary Formation by Notch Signaling in Drosophila Mul- ticellular Systems: Experimental Observations and Gene Network Modeling by Genomic Object Net. Pacific Symposium on Biocomputing 8, 2003, 152–163 25. U.Montanari, F.Rossi: Contextual Nets. Acta Informatica 32, 1995, 545–596 26. P.D.Nieuwkoop: Activation and Organisation of the Central Nervous System in Amphibians. III. Synthesis of a New Working Hypothesis. Journal of Experimental Zoology 120, 1952, 83–108 27. W.Reisig, G.Rozenberg (Eds.): Lectures on Petri Nets I and II. LNCS 1491 and 1492, 1998 28. S.Scholpp, M.Brand: Endocytosis Controls Spreading and Effective Signaling Range of Fgf8 Protein. Current Biology 14, 2004, 1834–1841 29. J.Shiotsuguet et. al: Multiple Points of Interaction between Retinoic Acid and Fgf Signaling During Embryonic Axis Formation. Development 131, 2004, 2653–2667 30. L.J.Steggles, R.Banks, O.Shaw et al.: Qualitatively Modelling and Analysing Ge- netic Regulatory Networks: a Petri Net Approach. Bioinformatics 23, 2006, 363–343 31. C.Talcott, D.L.Dill: Multiple Representations of Biological Processes. Transactions on Computational Systems Biology, 2006 32. A.A.Teleman, M.Strigini, S.M.Cohen: Shaping Morphogen Gradients. Cell 105, 2001, 559–562 33. C.J.Tomlin, J.D.Axelrod: Biology by Numbers: Mathematical Modelling in Devel- opmental Biology. Nature Reviews Genetics 8, 2007, 331–340 34. W.Vogler: Partial Order Semantics and Read Arcs. Theoretical Computer Science 286, 2002, 33–63 35. R.J.White et. al: Complex Regulation of cyp26a1 Creates a Robust Retinoic Acid Gradient in the Zebrafish Embryo. Plos biology 5, 2007, 2522–2533 36. L.Wolpert: Principles of Development. Oxford University Press, 2002