<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Building Executable Biological Pathway Models Automatically from BioPAX</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Timo Willemsen</string-name>
          <email>timo.willemsen@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Anton Feenstra</string-name>
          <email>k.a.feenstra@vu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Paul Groth</string-name>
          <email>p.t.groth@vu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, VU University Amsterdam</institution>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The amount of biological data exposed in semantic formats is steadily increasing. In particular, pathway information (a model of how molecules interact within a cell) from databases such as KEGG and WikiPathways are available in a standard RDF-based format BioPAX. However, these models are descriptive and not executable in nature. Being able to simulate or execute a pathway is one key mechanism for understanding the operation of a cell. The creation of executable models can take a significant amount of time and only relatively few such models currently exist. In this paper, we leverage the availability of semantically represented pathways, to bootstrap the creation of executable pathway models. We present an approach to automate the creation of executable models in the form of Petri-Nets from BioPAX represented pathways. This approach is encapsulated in an online tool, BioPax2PNML.</p>
      </abstract>
      <kwd-group>
        <kwd>biological pathways</kwd>
        <kwd>biological networks</kwd>
        <kwd>BioPax</kwd>
        <kwd>executable models</kwd>
        <kwd>Petri nets</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        A biological pathway, simply said, is a sequence of interactions among molecules
of a cell. There are many different types of pathways; gene regulation
pathways, signaling pathways and protein interaction pathways are among the most
commonly used ones. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
      </p>
      <p>
        Originally, pathways were hand-drawn and presented in papers. Pathways
are now made available in online databases in computer parsable formats (e.g.
BioPAX). For example, the WikiPathways has over 1700 available pathways1.
While these pathway descriptions are highly useful, they contain mostly static
information about interacting molecules and do not describe how pathways
actually work or give insight into the dynamics of these interactions [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        To address this lack of information, work has been undertaken to create
computational models of these pathways [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Two types of models can be
distinguished: executable and mathematical [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. The mathematical models give insight
into quantities and how they change over time, and are frequently created by
systems biologists. Executable models are valuable to biologists because they have
1 See http://WikiPathways.org/index.php/WikiPathways:Statistics for statistics
on WikiPathways
a large variety of uses [
        <xref ref-type="bibr" rid="ref4 ref5">4,5</xref>
        ]. They can be used to summarize available knowledge
of interactions and mechanisms in a system, and to investigate how components
cooperate to produce global system behaviour. Creating an executable model
is still a tedious manual process, mostly because they contain parameters that
need to be collected manually. On the other hand, mathematical models
typically require detailed knowledge of (kinetic and rate) parameters, which are
often not available and can be very hard to obtain from experiments. From our
experience, for executable models, the process of model construction and
parameter calibration usually takes several months [
        <xref ref-type="bibr" rid="ref3 ref6 ref7">3,6,7</xref>
        ], even for a modestly sized
network. This is currently one of the major bottlenecks in computational life
sciences research [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>This paper begins to address this bottleneck by leveraging the availability
of semantic representations of pathways and converting them to an executable
model. Concretely, the contributions of this paper are: i) to present a method to
automate validation of pathway data; ii) a mapping of the BioPAX format to an
executable model (Petri nets, represented in the Petri Net Markup Language;
PNML); and, iii) a method to automatically create these executable models. We
have developed a webservice that encapsulates the described method and can
be accessed at www.few.vu.nl/∼twn370/BioPax2PNML/. Additionally, all code
is available online at: https://github.com/TimoWillemsen/Biopax2PNML.</p>
      <p>The rest of this paper is organized as follows. We begin in Section 2 with
background information on biological pathways and common formats for both
descriptive (BioPAX) and executable (PNML) representations of them. We then
describe our approach for mapping between these two formats (Section 3). To
ensure that a BioPAX pathway has the appropriate information to be converted
to PNML, we present a validation approach in Section 4. This is followed, in
Section 5, by a description of the implementation of our method. Finally, we
conclude with some thoughts on future work in Section 6.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Biological Pathways</title>
      <p>
        There are different types of biological pathways, corresponding to different
levels of abstraction. For example, a pathway may describe interactions between
different cells, or between genes, or between proteins, or it may describe
biochemical reactions (or combinations thereof). Many databases exist that collect
this information in a variety of forms, and some are very specialized on
particular types of data. It is beyond the scope of this work to provide a comprehensive
overiew. Some of the most well-known are WikiPathways [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], focused on signal
transduction; the KEGG Pathway database [
        <xref ref-type="bibr" rid="ref10 ref11">10,11</xref>
        ], with a focus on metabolic
pathways; and Reactome [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] which has a broader scope.
      </p>
      <p>The examples provided in this paper will focus on signal transduction
pathways, as these tend to be well-studied and therefore well-defined. Such pathways
typically include protein-protein interactions, protein-gene interactions and
biochemical reactions.</p>
      <p>
        We have based our research on the pathways provided by the WikiPathways
database [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. This is a community-driven service where biological pathways are
extensively manually curated. The context of the pathways included in
WikiPathways can vary considerably, depending on their intended use. For example,
simply representing known interactions in a shareable way is considered useful,
but such pathways likely will not include details that are crucial for
computational analysis, even as simple as explicit notation of interactions among proteins
and genes. As a result of this, only certain pathways are suitable for
computational analysis.
      </p>
      <p>One such example is the C. elegans Programmed Cell Death pathway from
the WikiPathways Database, as shown in Fig. 1.</p>
      <p>For the purpose of this paper, we have taken a subset of this pathway, as
shown in Fig. 1. This pathway consists of 5 genes. When ced-3 is activated, it
will trigger the cell’s programmed death.</p>
      <p>We now discuss the computational representation of pathways used by
WikiPathways. After which, we briefly describe the use of Petri-nets to as a language
for executable models of pathways.
2.1</p>
      <sec id="sec-2-1">
        <title>BioPax</title>
        <p>
          In 2010 Demir et al [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] created the Web Ontology Language (OWL) based
standard for modeling pathways: BioPax. A key aspect of this standard is that it
allows for referring to external databases for information (e.g. linking to UniProt
protein descriptions.) This standard has been used in many different biological
databases; all the three mentioned above, Reactome, KEGG and WikiPathways
expose BioPax through an RDF interface [
          <xref ref-type="bibr" rid="ref11 ref12 ref9">9,11,12</xref>
          ].
        </p>
        <p>BioPax can be used to model different types of pathway components. An
example of how genes are modelled in BioPax, is shown below; the ced-3 and
ced-4 genes of the C. elegans Programmed Cell Death pathway, as shown in
Fig. 1.</p>
        <p>Two genes, ced-3 and ced-4, from the C. elegans Programmed Cell Death Pathway
from the WikiPathways Database ID:WP367
&lt; bp:Protein rdf:about =" eef1e " &gt;
&lt; bp:displayName &gt;ced -3 &lt;/ bp:displayName &gt;
&lt; bp:entityReference rdf:resource =" id3 " / &gt;
&lt;/ bp:Protein &gt;
&lt; bp:Protein rdf:about =" c0b3e " &gt;
&lt; bp:displayName &gt;ced -4 &lt;/ bp:displayName &gt;
&lt; bp:entityReference rdf:resource =" id4 " / &gt;
&lt;/ bp:Protein &gt;
An example of interactions in a pathway modelled in BioPax is shown below;
we see a reaction ‘id40’ that connects a right-hand-side element (eef1e; ced-3)
with a left-hand-side (c0b3e; ced-4) element.</p>
        <p>Gene interaction of the C. elegans Programmed Cell Death Pathway from the
WikiPathways Database ID:WP367
&lt; bp:BiochemicalReaction rdf:about =" id40 " &gt;
&lt; bp:right rdf:resource =" eef1e " / &gt;
&lt; bp:left rdf:resource =" c0b3e " / &gt;
&lt;/ bp:BiochemicalReaction &gt;
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Petri nets</title>
        <p>Petri nets are a formalism geared towards modelling and analysis of concurrent
systems. A Place-Transition (PT) Petri net is a quadruple (P, T, A, m), where
P is a set of places and T a set of transitions. A describes arcs which connect
places with transitions or vice versa. Each place holds zero or more tokens, which
represent flow of control through this place. The number of tokens in each place
all together are called a marking m of the network.</p>
        <p>
          Fig. 2 shows a graphical representation of such a Petri Net, again for our
small example part of the C. elegans Programmed Cell Death pathway. Squares
are transitions, representing interactions, and circles are places, representing
genes. Arcs are represented by arrows, and the marking is empty. Firing of a
transition depends on the availability of resources (tokens) in the input places,
and represents the execution of a reaction: consuming substrates and creating
products.[
          <xref ref-type="bibr" rid="ref14">14,15</xref>
          ]
        </p>
        <p>
          For computational purposes we have chosen to represent Petri nets in the
Petri Net Markup Language (PNML) format. This is a straightforward XML
standard that a number of systems support.[16] Fig. 2.2 shows the Petri net of
Fig. 2 in an XML representation. Petri nets are recognized as a powerful tool
to model biological pathways [
          <xref ref-type="bibr" rid="ref14">14,15</xref>
          ], as the formalism readily allows to capture
both the complexity and the highly concurrent nature of biological systems, while
optimally leveraging the large amounts of qualitative data available.[
          <xref ref-type="bibr" rid="ref3 ref6">15,3,6</xref>
          ]
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>BioPax to PNML mapping</title>
      <p>To transform static BioPax data into an executable Petri net, we have developed
a mapping between the two formats. BioPax is an RDF format, while PNML is
an XML format. It should be taken into account that the semantic linking is lost
when a BioPax pathway is converted to PNML Petri-net. For example, genes or
proteins have different identifiers in different databases. BioPax gives a way to
link multiple identifiers to a gene or protein, but PNML does not support this
feature.
3.1</p>
      <sec id="sec-3-1">
        <title>Genes or Proteins</title>
        <p>Each gene or protein is modelled as a place in the Petri net. Because the
creation of the Pathways in WikiPathways has been done manually, often they are
not consistent and may, for example, contain multiple instances of one gene or
protein. The mapping does not take into consideration the fact that duplicate
genes or proteins may represent the same entity and are modelled twice simply
for readability, or rather that they are modelled twice because they represent
a different entity of the same gene/protein (for example in a different location,
or in a different state). However we address this issue with the validation rules
introduced in Section 4.</p>
        <p>The first stage in mapping is shown in Algorithm 1, which transforms BioPax
proteins/genes to PNML.</p>
        <sec id="sec-3-1-1">
          <title>Algorithm 1 Genes/Proteins BioPax to PNML</title>
          <p>P = ∅
for all &lt;bp:Protein&gt; p in BioPax do
if p ∈/ P and p is other entity then
add p to P
end if
end for</p>
        </sec>
      </sec>
      <sec id="sec-3-2">
        <title>3.2 Interactions</title>
        <p>Interactions are also mapped to PNML. Each &lt;bp:BiochemicalInteraction&gt;
is mapped to a transition. Then for each &lt;bp:Left&gt; an arc is added pointing
into the transition and out from the corresponding place; for each &lt;bp:Right&gt;
an arc is created pointing out of the transition and into the corresponding place.
Algorithm 2 shows the straightforward way to do this.</p>
        <p>Once both algorithms 1 and 2 are executed a Petri net is created. Formally,
the Petri net can be described as P N = P, T, A, ∅ where P are the places, T
the transitions, A the arcs and markings m = ∅ since there are no tokens in
the system yet. In terms of modelling the biological system, the places represent
biological entities, like genes, proteins or complexes, the transitions represent
biochemical reactions and interactions, and the arcs represent the associations
between these two. Tokens represent the availability of the resources of the
corresponding place in the Petri net.</p>
        <sec id="sec-3-2-1">
          <title>Algorithm 2 Gene/protein interaction BioPax to PNML</title>
          <p>T = ∅
A = ∅
for all &lt;bp:BiochemicalInteraction&gt; t in BioPax do</p>
          <p>Add t to T
for all &lt;bp:Left&gt; left in BioPax do
left.in = t
left.out = left.resource</p>
          <p>Add left to A
end for
for all &lt;bp:Right&gt; right in BioPax do
right.in = right.resource
right.out = t</p>
          <p>Add right to A
end for
end for</p>
          <p>If we then execute both Algorithm 1 and Algorithm 2 on Fig. 1, a petri net
is generated. Part of the output is shown in Fig. 2.2
4</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>BioPax Validation</title>
      <p>The mapping described in Section 3 is based on several assumptions about the
contents of the input BioPax file. The basic assumptions are that genes,
proteins and complexes (bound combinations of proteins, possibly including a gene)
are entities, and that these entities can change state or identity only through
biochemical interactions.</p>
      <p>However, because of the manual nature of pathway construction, these
assumptions may not hold for a given pathway instance in the database. To make
sure the data is presented as it should be, we have developed a set of validation
rules and a validator available online.</p>
      <p>We have developed two types of validation rules; semantic and syntactic. The
syntactic validation consists of basic RDF-validation. This is necessarily because
from our preliminary survey, a large fraction of pathways are not modelled
correctly for translation.</p>
      <p>More interesting is the semantic validation. These rules ensure that the
information contained in the model is consistent and complete enough to create
an executable Petri net. Table 1 shows these validation rules.</p>
      <p>These rules ensure that the provided BioPax file contains everything needed.
We have categorized the validation rules by severity:
– Category error rules are minimal requirements for mapping.
– Category warning rules that mean the mapping can proceed but may lead
to an unconnected or incomplete Petri net.</p>
      <p>This framework is set up in a modular fashion, so that extension is easy.
We have implemented the methods described above as a webservice. The service
consists of 4 components: a validation rule database, a validator, a BioPax to
PNML converter and a pathway retriever, as is shown schematically in Fig. 4.
The webservice provides an interface to query different datasources. At the time
of writing only an interface to WikiPathways is provided, using the available
webservices [17]. However, support for other generic BioPax could be a future
extension.</p>
      <p>The retriever queries WikiPathways and downloads the pathway in the
BioPax format, so validation and conversion can be done.
The validation rule database is a set of SPARQL queries. Each query returns
a set of RDF triples that violate the rule (this set may be empty). This way
feedback can be given about where the rule violation takes place in the BioPax
File.</p>
      <p>The way the database is set up allows easy addition of rules. This modularity
makes it possible to improve on the current validation rules, but also allows
validation rule sets for different types of pathways (for example signalling pathways
vs. gene regulatory networks). Fig. 5 shows as an example the implementation
of rule 1 of Table 1.
PREFIX xsd: &lt; http: // www . w3 . org /2001/ XMLSchema # &gt;
PREFIX owl: &lt; http: // www . w3 . org /2002/07/ owl # &gt;
PREFIX rdf: &lt; http: // www . w3 . org /1999/02/22 - rdf - syntax - ns # &gt;
PREFIX bp: &lt; http: // www . biopax . org / release / biopax - level3 . owl # &gt;
SELECT ? reaction
WHERE {
? reaction rdf:type bp:BiochemicalReaction .</p>
      <p>OPTIONAL {</p>
      <p>? reaction bp:left ? left .
}
}</p>
      <p>FILTER (! BOUND (? left ))</p>
      <p>This query returns every bp:BiochemicalReaction that does not have a
bp:left child element associated to it.
5.3</p>
      <sec id="sec-4-1">
        <title>BioPax Validator</title>
        <p>The biopax validator is software that can analyze BioPax files according to the
validation rules provided by the rule database. It is essentially a graphical user
interface around the SPARQL queries. It annotates the place where errors or
warnings have occurred and provides an easy to use interface to solve them.
5.4</p>
      </sec>
      <sec id="sec-4-2">
        <title>BioPax to PNML Converter</title>
        <p>
          Once a BioPax file has been validated, the BioPax to PNML
converter can be used to generate an executable Petri net. This converter
works according to the mapping described in Section 3. This is
implemented as an online tool, named BioPax2PNML, and can be accessed on
www.few.vu.nl/∼twn370/BioPax2PNML/.
Although the proof of concept of the current work stops with the generation
of a valid Petri net model in the form of a PNML file, it is nevertheless
instructive to consider what subsequent steps should be. Execution of a Petri net
can be performed under different execution semantics, however the most
relevant for biological systems is commonly thought to be the so-called ‘bounded
asynchronous’ execution [
          <xref ref-type="bibr" rid="ref3">18,3,15</xref>
          ]. Under this semantics, as many transitions as
possible are executed simultaneously in each execution step. This represents the
inherent concurrency of biological systems, where molecules typically act
independently, certainly if they reside in different locations. This is also known as the
‘token game’, because execution of transitions has the effect of shifting tokens
around the Petri net. Fig. 7 shows an example network and the change in state
due to execution of enabled transitions.
        </p>
        <p>
          Execution leads to a trajectory of markings, that represent the progression
of states of the system in response to the intial marking, which corresponds to
a particular state or condition of the biological system. Typically, token levels
are collected from a few places of interest and compared to experimental data
of the corresponding biological molecule, or used to predict the behaviour of
that particular molecule under the conditions modeled. Examples of these for
signalling pathways can be found in [
          <xref ref-type="bibr" rid="ref6">15,6</xref>
          ], and for gene regulatory networks
in [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ].
6
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>Automatic Petri net creation of biological pathways is still a tedious process. The
manual labor involved makes it so that even a modestly sized model can take
several months to develop. In this paper we have provided a method to bootstrap
this process. By using a mapping between the commonly used BioPax format
and the PNML format, we have developed a way to automate the construction
of Petri net models. Because biological information online may be inconsistent
or incomplete, we have developed a set of validation rules to make sure that the
data is suitable for automatic conversion.</p>
      <p>To facilitate this, and as a proof of concept, an online tool BioPax2PNML
that executes this and provide an easy interface for Petri net modelers to
bootstrap the process of model creation.</p>
      <p>The approach outlined here is an initial start to making fully developed
executable models. In particular, deriving the weights on edges of the Petri nets is
a challenging task. In terms of future work, we believe that by leveraging the links
to other databases (e.g. Uniprot) we may be able to find additional information
to infer such edge weights. Moreover, we may be able to connect additional parts
of the resulting Petri-nets based on background knowledge about interactions
contained in other databases or even use knowledge of chemistry provided by
other data sources to create more precise models. A key foundation for work
going forward is that Linked Data and Semantic Web standards facilitate the
merging and acquisition of this information.
7
15. Nicola Bonzanni, K. Anton Feenstra, Wan Fokkink and Elzbieta Krepska. What
can Formal Methods bring to Systems Biology? In: Proc. FM’09, 5850 LNCS,
16–22. Springer, 2009.
16. Masao Nagasaki, Ayumu Saito, Atsushi Doi, Hiroshi Matsuno, and Satoru Miyano.</p>
      <p>Using Cell Illustrator and Pathway Databases. Springer, April 2009.
17. Kelder T, Pico AR, Hanspers K, van Iersel MP, Evelo C, et al. Mining Biological</p>
      <p>Pathways Using WikiPathways Web Services. PLoS ONE 4(7): e6447, 2009
18. Jasmin Fisher, Tom Henzinger, Maria Mateescu, and Nir Piterman. Bounded
asynchrony: A biologically-inspired notion of concurrency. In Proc. FMSB’08,
Cambridge, 5054 LNCS 17–32. Springer, June 2008.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Ganesh</surname>
            <given-names>A Viswanathan</given-names>
          </string-name>
          , Jeremy Seto, Sonali Patil, German Nudelman, Stuart C Sealfon.
          <source>Getting Started in Biological Pathway Construction and Analysis PLoS Comput Biol</source>
          <volume>4</volume>
          (
          <issue>2</issue>
          ): e16,
          <fpage>2008</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Pinney</surname>
            <given-names>JW</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Westhead</surname>
            <given-names>DR</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McConkey</surname>
            <given-names>GA</given-names>
          </string-name>
          .
          <article-title>Using Petri Net tools to study properties and dynamics of biological systems</article-title>
          .
          <source>J Am Med Inform Assoc</source>
          .
          <volume>12</volume>
          (
          <issue>2</issue>
          ):
          <fpage>181</fpage>
          -
          <lpage>99</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Nicola</given-names>
            <surname>Bonzanni</surname>
          </string-name>
          , Elzbieta Krepska,
          <string-name>
            <given-names>K.</given-names>
            <surname>Anton Feenstra</surname>
          </string-name>
          , Wan Fokkink, Thilo Kielmann, Henri Bal, and
          <string-name>
            <given-names>Jaap</given-names>
            <surname>Heringa</surname>
          </string-name>
          .
          <article-title>Executing multicellular differentiation: Quantitative predictive modelling of C. elegans vulval development</article-title>
          .
          <source>Bioinformatics 25</source>
          ,
          <fpage>2049</fpage>
          -
          <lpage>2056</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. Jasmin Fisher and Tom Henzinger.
          <article-title>Executable cell biology</article-title>
          .
          <source>Nature Biotechnology</source>
          <volume>25</volume>
          (
          <issue>11</issue>
          ):
          <fpage>1239</fpage>
          -
          <lpage>1249</lpage>
          ,
          <year>November 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Aviv</given-names>
            <surname>Regev</surname>
          </string-name>
          and
          <string-name>
            <given-names>Ehud</given-names>
            <surname>Shapiro</surname>
          </string-name>
          .
          <article-title>Cellular abstractions: Cells as computation</article-title>
          .
          <source>Nature</source>
          <volume>419</volume>
          :
          <fpage>343</fpage>
          ,
          <year>September 2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Bonzanni</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
          </string-name>
          , N.,
          <string-name>
            <surname>Oliver</surname>
            ,
            <given-names>S.G.</given-names>
          </string-name>
          and Fisher,
          <string-name>
            <surname>J.</surname>
          </string-name>
          <article-title>The role of proteasomemediated proteolysis in modulating activity of potentially harmful transcription factor activity in Saccharomyces cerevisiae</article-title>
          .
          <source>Bioinformatics</source>
          <volume>27</volume>
          :
          <fpage>i282</fpage>
          -
          <lpage>i287</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Nicola</given-names>
            <surname>Bonzanni</surname>
          </string-name>
          , Abhishek Garg,
          <string-name>
            <given-names>K.</given-names>
            <surname>Anton Feenstra</surname>
          </string-name>
          , Sarah Kinston, Diego Miranda-Saavedra, Judith Schutte, Jaap Heringa, Ioannis Xenarios,
          <article-title>Berthold Go¨ttgens. Hard-wired heterogeneity in blood stem cells revealed using a dynamic regulatory network model Bioinformatics in press (</article-title>
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Susanna-Assunta</surname>
            <given-names>Sansone</given-names>
          </string-name>
          , Philippe Rocca-Serra, Dawn Field,
          <string-name>
            <given-names>Eamonn</given-names>
            <surname>Maguire</surname>
          </string-name>
          , et al.
          <source>Toward interoperable bioscience data Nat Genet</source>
          <volume>44</volume>
          (
          <issue>2</issue>
          ):
          <fpage>121</fpage>
          -
          <lpage>126</lpage>
          ,
          <year>January 2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Thomas</given-names>
            <surname>Kelder</surname>
          </string-name>
          , Martijn P. van Iersel,
          <string-name>
            <surname>Kristina Hanspers</surname>
          </string-name>
          , Martina Kutmon,
          <string-name>
            <surname>Bruce R. Conklin</surname>
          </string-name>
          , Chris T. Evelo,
          <string-name>
            <surname>Alexander</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Pico</surname>
          </string-name>
          .
          <source>WikiPathways: building research communities on biological pathways Nucleic Acids Res</source>
          <volume>40</volume>
          (Database issue):
          <fpage>D1301</fpage>
          -
          <lpage>D1307</lpage>
          ,
          <year>January 2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Kanehisa</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goto</surname>
            <given-names>S. KEGG</given-names>
          </string-name>
          :
          <article-title>Kyoto Encyclopedia of Genes and Genomes</article-title>
          .
          <source>Nucleic Acids Res</source>
          <volume>7</volume>
          :
          <fpage>27</fpage>
          -
          <lpage>30</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Kanehisa</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goto</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hattori</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aoki-Kinoshita</surname>
            <given-names>KF</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Itoh</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kawashima</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Katayama</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Araki</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hirakawa</surname>
            <given-names>M.</given-names>
          </string-name>
          <article-title>From genomics to chemical genomics: new developments in KEGG</article-title>
          .
          <source>Nucleic Acids Res</source>
          <volume>7</volume>
          (Database issue):
          <fpage>D354</fpage>
          -
          <lpage>D357</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Robin</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Haw</surname>
            , David Croft,
            <given-names>Christina K.</given-names>
          </string-name>
          <string-name>
            <surname>Yung</surname>
          </string-name>
          , Nelson Ndegwa,
          <string-name>
            <surname>Peter D'Eustachio</surname>
            , Henning Hermjakob,
            <given-names>Lincoln D.</given-names>
          </string-name>
          <string-name>
            <surname>Stein. The Reactome BioMart In Database</surname>
          </string-name>
          , Oxford,
          <year>October 2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Emek</surname>
            <given-names>Demir</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Michael P.</given-names>
            <surname>Cary</surname>
          </string-name>
          , Suzanne Paley,
          <string-name>
            <given-names>Ken</given-names>
            <surname>Fukuda</surname>
          </string-name>
          , et al. BioPAX
          <article-title>- A community standard for pathway data sharing</article-title>
          <source>Nat Biotechnol</source>
          <volume>28</volume>
          :
          <fpage>935</fpage>
          -
          <lpage>942</lpage>
          ,
          <year>September 2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Elzbieta</surname>
            <given-names>Krepska</given-names>
          </string-name>
          , Nicola Bonzanni,
          <string-name>
            <given-names>K.</given-names>
            <surname>Anton Feenstra</surname>
          </string-name>
          , Wan Fokkink, Thilo Kielmann, Henri Bal, and
          <string-name>
            <given-names>Jaap</given-names>
            <surname>Heringa</surname>
          </string-name>
          .
          <article-title>Design issues for qualitative modelling of biological cells with Petri nets</article-title>
          .
          <source>In Proc. FMSB</source>
          '
          <volume>08</volume>
          ,
          <string-name>
            <surname>5054</surname>
            <given-names>LNCS</given-names>
          </string-name>
          ,
          <fpage>48</fpage>
          -
          <lpage>62</lpage>
          . Springer,
          <year>June 2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>