<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Novel Algorithm for Local Alignment of Protein Interaction Networks: MODULA</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Extended Abstract</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pietro H Guzzi</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pierangelo Veltri</string-name>
          <email>veltri@unicz.it</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Swarup Roy</string-name>
          <email>swarup@nehu.ac.in</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jugal K Kalita</string-name>
          <email>jkalita@uccs.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science University of Colorado</institution>
          ,
          <addr-line>Colorado Springs</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Information Technology, North-Eastern Hill University</institution>
          ,
          <country country="IN">India</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Dept Surgical Medical Sciences Unicz</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Biological networks are usually used to model interactions among biological macromolecules in a cells. For instance protein-protein interaction networks (PIN) are used to model and analyse the set of interactions among proteins. The comparison of networks may result in the identification of conserved patterns of interactions corresponding to biological relevant entities such as protein complexes and pathways. Several algorithms, known as network alignment algorithms, have been proposed to unravel relations between different species at the interactome level. Algorithms may be categorized in two main classes: merge and mine and mine and merge. Algorithms belonging to the first class initially merge input network into a single integrated and then mine such networks. Conversely algorithms belonging to the second class initially analyze separately two input networks then integrate such results. In this paper we present MODULA (Network Module based PPI Aligner), a novel approach for local network alignment that belong to the second class. The algorithm at first identifies compact modules from input networks. Modules of both networks are then matched using functional knowledge. Then it uses high scoring pairs of modules as seeds to build a bigger alignment. In order to asses MODULA we compared it to the state of the art local alignment algorithms over a rather extensive and updated dataset. 4</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Complex biological systems are often represented as networks and studied
computationally. In PPI networks [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ], also known as protein interaction networks
(PINs), the proteins are represented by nodes and interactions between them
are represented by edges. Studies suggest that molecular networks are conserved
through evolution [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ], and that highly connected proteins are more likely to
4 This work has been presented in IEEE BIBM 2015.
be essential for survival than proteins with lower connectivity. As a result, the
interactions between protein pairs as well as the overall composition of the
network are important for the overall functioning of an organism. Understanding
conserved substructures through comparative analysis of these networks can
provide basic insights into a variety of biochemical processes. The ultimate goal of
network alignment is to transfer knowledge of protein function from one species
to another. Since sequence similarity metrics such as BLAST bit scores are not
conclusive evidence of similar function, the purpose of aligning two PPI
networks is to supplement sequence similarity with topological information so as
to identify orthologs as accurately as possible. PIN alignment is relatively a
young research area and successes of PIN network alignment so far include
uncovering large shared sub-networks between species as diverse as S. cerevisiae
and H. sapiens, and reconstructing phylogenetic relationships between species
based solely on the amount of overlap discovered between their PPI networks [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
Comparing two biological networks is a particularly challenging problem, since
many interesting questions we might ask of these networks are computationally
intractable to answer . Most papers in the literature report promising results in
creating alignments that do indeed show large regions of biological or topological
similarity between the PPI networks of various species, but few do both well [
        <xref ref-type="bibr" rid="ref5 ref6">5,
6</xref>
        ].
      </p>
      <p>In this work, we try to align two or more PPI networks from different species.
That is, we want to find a mapping from the nodes of one network to the nodes of
another, in such a way as to maximize the topological and biological similarity
of the pairs of nodes which are aligned to one another. This allows for the
identification of orthologous proteins that are conserved during evolution as well
as similar modules or pathways in the networks themselves.</p>
      <p>We focus in particular on local network alignment. Existing approach for
local network alignment fall in two main classes: (i) mine and merge approach,
(ii) merge and mine approach. Algorithms of the first class at first analyze
single networks, then integrate results. Conversely algorithms of the second class
build an initial integrated network and then analyze such network [2, 7, ?]. We
propose MODULA, a novel local alignment method based on merge and mine
approach. MODULA performs alignment using compact PIN modules or
complexes extracted from two different species and explore best matching modules
from them. Below we present the background of the study and few related works.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Problem Formulation and Related Work</title>
      <p>
        Literature contains different formalizations of PIN alignment and we here follow
the formalization we developed in a previous work by Mina and Guzzi [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>Given two input graphs, Ga = {Va, Ea} and Gb = {Vb, Eb}, a correspondence
between two regions of Ga and Gb can be expressed as a set of node pairs
Si = {(xa, yb) | xa ∈ Va ∪ η, yb ∈ Vb ∪ η}
(1)
where η is a fictitious symbol that means the associated protein has no ortholog
in the other species.</p>
      <p>Let</p>
      <p>Sia = {xa | (xa, yb) ∈ Si}</p>
      <p>Sib = {yb | (xa, yb) ∈ Si}
be the sets of proteins belonging to Va and Vb, respectively, involved in Si. Let
Gia (Gib) be the subgraph induced by Sia (Sib) on Ga (Gb).</p>
      <p>The pairwise local network alignment problem consists of finding all
the correspondences Si (i.e. groups of nodes) in order to maximize a cost
function based on two criteria: (i) a similarity criterion that guarantees that matched
subgraphs are topologically similar; and (ii) a model criterion drives the
analysis toward the identification of specific topologies, and depends on the specific
module to be uncovered (i.e. protein complex, linear pathway).</p>
      <p>
        Literature contains many algorithms that have been proposed to detect
conserved modules in PINs [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. There exist different way to categorize such
algorithms, we here distinct them on two main classes on the basis of the overall
strategy: mine and merge, i.e. algorithms that first analyze each PIN separately,
and then project solutions reciprocally from a PIN to the others [
        <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
        ]; merge
and mine, i.e. algorithms that fist integrate PINs into a single graph and then
analyze such graph [
        <xref ref-type="bibr" rid="ref11 ref12 ref13 ref7">11–13, 7</xref>
        ].
      </p>
      <p>
        Mine and merge analysis are usually less expensive in terms of computational
resources, as evidenced by Erten et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. In general, merge and mine algorithms
are more complicated due to difficulties in formulating and accounting for
approximate matches, and the existence of multiple mappings between proteins in
different species [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Moreover, they are computationally expensive, since in
order to merge the input networks it is necessary to compare their topologies. The
main drawback of these approaches is that these algorithms are more sensible
to noise in input networks and to redundancy of information in input networks.
Conversely, merge and mine algorithms are less sensible to these problems but
they present in general a higher computational cost in the building of the initial
integrated graph (also referred to as alignment graph). The interested reader
may find a detailed discussion of these approaches in Mina and Guzzi[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>A common problem in both groups is the requirement of additional
information used to seed to build the alignment. Such seed are ortholog pairs and
the absence of such information would require the exploration of all the
possible combinations of protein pairs should be considered. Consequently many
algorithms require as input two networks and a list of protein pairs, (for
instance list of putative orthologs), to start the computation. List of pairs may be
obtained from existing databases of orthologs, or gathering sequence similarity
information using tools, using semantic similarity [14].
3</p>
    </sec>
    <sec id="sec-3">
      <title>A New Alignment Approach</title>
      <p>In this section we propose a new local alignment method MODULA that explore
a matching between two different biologically significant compact protein
interaction network modules from different species to find orthologous modules
conserved functional similarity during evolution. Interestingly, the same approach
may be extended for detecting conserved functional modules in multiple species.
Broadly, MODULA is a two step process as describe below.</p>
      <p>At first it identify compact network modules (or subgraphs) from input
networks Gi and Gj using any state-of-the-art protein complex finding method.
Then, every detected modules from Gi are compared and matched with each
modules in Gj using any existing global alignment method.Finally, The best
matching pairs are considered as aligned conserved modules.</p>
      <p>The overall idea of the method is shown in Fig. 1. More formally, the step
wise representation of MODULA is given in Algorithm 1.
3.1</p>
      <sec id="sec-3-1">
        <title>The Algorithm</title>
        <p>As an input other than two PINs from two different species, MODULA requires
an user defined threshold τ to satisfy a minimum similarity score for global
alignment between a pair of modules. To start with, MODULA needs compact
modules or complexes. It uses existing network modules finding methods to detect
biologically significant compact protein complexes (Ci and Cj ). In our work, we
use ClusterOne [15], an overlapping complex finding method from PINs. Recent
study revels that ClusterOne is an effective technique in detecting biologically
significant protein complexes [16]. For each module Mi ∈ Ci is compared with
each module Mj ∈ Cj using any suitable global alignment method. We use here
Magna++ for alignment [17]. MODULA considers only best match out of all
pair matches. If the best match score is above threshold τ , it will be considered
as best local alignment and added into the list L of all such alignments. The
process continues for rest of the pairs.</p>
        <p>Next, we assess the performance of our proposed method in light of several
real data.</p>
        <p>end
end
end</p>
        <p>Return(L) ;
Algorithm 1: MODULA: The PIN Alignment Algorithm</p>
        <p>Data: Gi (PIN-I); Gj (PIN-II); τ (Minimum Similarity Score)
Result: L (Aligned sub-networks )
Ci ← FindModules (Gi);
Cj ← FindModules (Gj);
f/o/rCeiaacnhdMCij ∈liCsit doof compact modules detected by PIN complex finding method
for each Mj ∈ Cj do
if Max ( Alignment (Mi, Mj )) &gt; τ then</p>
        <p>L= L S (Mi,Mj);
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Experimental Evaluation</title>
        <p>In order to assess performances of MODULA we compared it with respect to
state of the art algorithms showing a sensible improvement of performances.
In order to compare results, we expressed the performances of the algorithms in
terms of the ability to recover known protein complexes conserved in two aligned
species. Consequently, given a solution and a known complex, we measures this
ability in terms of their overlap by using two classical measures: precision (π)
and recall (ρ). Precision is defined as the fraction of proteins in the solution also
present in the complex, while recall is the ration of proteins in the complex that
are in common with the solution. Usually these measures are integrated into the
F1-score defined as the harmonic mean of precision and recall. Formally, these
measures are defined as follows:
π =</p>
        <p>T P
T P + F P
, ρ =</p>
        <p>
          T P
T P + F P
, F1 − score =
2πρ
π + ρ
where TP is the number of proteins found in a solution that are also in the
complex. Analogously, FP and FN are the number of false positives and false
negatives. The F1-score ranges in the interval [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ], with 1 corresponding to
perfect agreement. In our analysis, we match each known complex of a species
to all the solutions of a given alignment, and we select as best match the solution
with highest F1-score. For each species we selected a dataset of known complexes
as benchmark dataset. Within each dataset we identified many complexes with
similar biological functions and highly overlapping with each other. This might
lead to a biased evaluation since a solution might overlap with more than a known
complex, and therefore be counted more than once. Moreover, these overlapping
complexes are often quite small (3-4 proteins).
        </p>
        <p>
          Comparison has been made against Align-MCL algorithms since it has been
demonstrated AlignMCL outperformed other local alignment algorithms and
also showed a more stability when different PINs of the same organisms are
used. In order to compare MODULA with state-of-the-art methods, we use same
datasets as used in the [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] comprises of interaction networks of mouse, yeast,
human, worm and fly available in I2D database (release of 2011) [18]. The datasets
used here are presented in Table 1. However, for detail description of the dataset
one may refer [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ].
        </p>
        <p>Initially, we clustered these networks using ClusterOne algorithm. Then for
each alignment we built a comprehensive scoring matrix in which we compared
all the pairs of generated modules. Finally, we used such pairs of high scoring
modules to build a single aligned module. The resulting alignment is made by
considering all the modules.</p>
        <p>Table 2 summarizes results. Results shows that for this preliminary set of
experiments, MODULA is able to recover more known complexes with respect
to Align-MCL.
PPI networks are largely used to analyze biological mechanisms inside cells.
Recently, many different experiments have generated a lot of data causing the
growth of existing networks in terms of nodes and edges. Consequently, the need
for the development of novel tools and methodologies for data management and
analysis arose. In particular, one of the most exciting area is represented by the
comparative analysis of protein interaction networks.</p>
        <p>In this paper we proposed MODULA, a local network alignment algorithms
that improves existing state of the art. The quality of the algorithm has been
assessed. Results show that MODULA outperforms the other algorithms in
discovering conserved functional modules (protein complexes).</p>
        <p>A future work consists of comparing the solutions of different algorithms to
determine their agreement. Additional assessments will be performed comparing
the semantic similarity of the solutions.
14. P. Guzzi, M. Mina, C. Guerra, and M. Cannataro, “Semantic similarity
analysis of protein data: assessment with biological features and issues,” Briefings in
bioinformatics, vol. 13, no. 5, pp. 569–585, 2012.
15. T. Nepusz, H. Yu, and A. Paccanaro, “Detecting overlapping protein complexes in
protein-protein interaction networks,” Nature methods, vol. 9, no. 5, pp. 471–472,
2012.
16. P. Sharma, H. A. Ahmed, S. Roy, and D. K. Bhattacharyya, “Unsupervised
methods for finding protein complexes from ppi networks,” Network Modeling Analysis
in Health Informatics and Bioinformatics, vol. 4, no. 1, pp. 1–15, 2015.
17. V. Vijayan, V. Saraph, and T. Milenkovi´c, “Magna++: Maximizing accuracy in
global network alignment via both node and edge conservation,” Bioinformatics,
p. btv161, 2015.
18. K. R. Brown and I. Jurisica, “Unequal evolutionary conservation of human protein
interactions in interologous networks,” Genome biology, vol. 8, no. 5, p. R95, 2007.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>M.</given-names>
            <surname>Cannataro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. H.</given-names>
            <surname>Guzzi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Veltri</surname>
          </string-name>
          , “
          <article-title>Protein-to-protein interactions,” ACM Computing Surveys</article-title>
          , vol.
          <volume>43</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>36</lpage>
          , Nov.
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. --, “Impreco:
          <article-title>Distributed prediction of protein complexes,” Future Generation Computer Systems</article-title>
          , vol.
          <volume>26</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>434</fpage>
          -
          <lpage>440</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3. T. Milenkovi´c and N. Prˇzulj, “
          <article-title>Topological characteristics of molecular networks,” in Functional Coherence of Molecular Networks in Bioinformatics</article-title>
          . Springer,
          <year>2012</year>
          , pp.
          <fpage>15</fpage>
          -
          <lpage>48</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>P. H.</given-names>
            <surname>Guzzi</surname>
          </string-name>
          , M. T. Di Martino, G. Tradigo,
          <string-name>
            <given-names>P.</given-names>
            <surname>Veltri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Tassone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Tagliaferri</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Cannataro</surname>
          </string-name>
          , “
          <article-title>Automatic summarisation and annotation of microarray data,” Soft Computing</article-title>
          , vol.
          <volume>15</volume>
          , no.
          <issue>8</issue>
          , pp.
          <fpage>1505</fpage>
          -
          <lpage>1512</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>P. H.</given-names>
            <surname>Guzzi</surname>
          </string-name>
          and T. Milenkovi´c, “
          <article-title>Survey of local and global biological network alignment: the need to reconcile the two sides of the same coin</article-title>
          ,” Briefings in Bioinformatics, p.
          <fpage>bbw132</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>M. T. Di Martino</surname>
            ,
            <given-names>P. H.</given-names>
          </string-name>
          <string-name>
            <surname>Guzzi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Caracciolo</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Agnelli</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Neri</surname>
            ,
            <given-names>B. A.</given-names>
          </string-name>
          <string-name>
            <surname>Walker</surname>
            ,
            <given-names>G. J.</given-names>
          </string-name>
          <string-name>
            <surname>Morgan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Cannataro</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Tassone</surname>
            , and
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Tagliaferri</surname>
          </string-name>
          , “
          <article-title>Integrated analysis of micrornas, transcription factors and target genes expression discloses a specific molecular architecture of hyperdiploid multiple myeloma</article-title>
          ,
          <source>” Oncotarget</source>
          , vol.
          <volume>6</volume>
          , no.
          <issue>22</issue>
          , pp.
          <volume>19</volume>
          <fpage>132</fpage>
          -
          <lpage>47</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>M.</given-names>
            <surname>Mina</surname>
          </string-name>
          and
          <string-name>
            <given-names>P. H.</given-names>
            <surname>Guzzi</surname>
          </string-name>
          , “
          <article-title>Improving the robustness of local network alignment: Design and extensive assessmentof a markov clustering-based approach</article-title>
          ,
          <source>” IEEE/ACM Trans. Comput. Biology Bioinform.</source>
          , vol.
          <volume>11</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>561</fpage>
          -
          <lpage>572</lpage>
          ,
          <year>2014</year>
          . [Online]. Available: http://doi.ieeecomputersociety.
          <source>org/10</source>
          .1109/TCBB.
          <year>2014</year>
          .2318707
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>J.</given-names>
            <surname>Ji</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , C. Liu,
          <string-name>
            <given-names>X.</given-names>
            <surname>Quan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Liu</surname>
          </string-name>
          , “
          <article-title>Survey: Functional module detection from protein-protein interaction networks</article-title>
          ,
          <source>” IEEE Transactions on Knowledge and Data Engineering</source>
          , vol.
          <volume>99</volume>
          , no.
          <source>PrePrints</source>
          , p.
          <fpage>1</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>S.</given-names>
            <surname>Erten</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Bebek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Li</surname>
          </string-name>
          , and M. Koyutu¨rk, “
          <article-title>Phylogenetic analysis of modularity in protein interaction networks</article-title>
          .
          <source>” BMC bioinformatics</source>
          , vol.
          <volume>10</volume>
          , p.
          <fpage>333</fpage>
          ,
          <string-name>
            <surname>Jan</surname>
          </string-name>
          .
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>P.</given-names>
            <surname>Jancura</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Mavridou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Carrillo-de Santa Pau</surname>
          </string-name>
          , and E. Marchiori, “
          <article-title>A methodology for detecting the orthology signal in a PPI network at a functional complex level.” BMC bioinformatics</article-title>
          , vol.
          <volume>13</volume>
          <issue>Suppl 1</issue>
          , no.
          <source>Suppl</source>
          <volume>10</volume>
          , p.
          <fpage>S18</fpage>
          ,
          <string-name>
            <surname>Jan</surname>
          </string-name>
          .
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. G. Ciriello,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. H.</given-names>
            <surname>Guzzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Cannataro</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Guerra</surname>
          </string-name>
          , “
          <article-title>AlignNemo: A Local Network Alignment Method to Integrate Homology and Topology.” PloS one</article-title>
          , vol.
          <volume>7</volume>
          , no.
          <issue>6</issue>
          , p.
          <fpage>e38107</fpage>
          ,
          <string-name>
            <surname>Jan</surname>
          </string-name>
          .
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>J. Flannick</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Novak</surname>
            ,
            <given-names>C. B.</given-names>
          </string-name>
          <string-name>
            <surname>Do</surname>
            ,
            <given-names>B. S.</given-names>
          </string-name>
          <string-name>
            <surname>Srinivasan</surname>
            , and
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Batzoglou</surname>
          </string-name>
          , “
          <article-title>Automatic parameter learning for multiple local network alignment</article-title>
          .
          <source>” Journal of computational biology</source>
          , vol.
          <volume>16</volume>
          , no.
          <issue>8</issue>
          , pp.
          <fpage>1001</fpage>
          -
          <lpage>22</lpage>
          , Aug.
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>M.</given-names>
            <surname>Mina</surname>
          </string-name>
          and
          <string-name>
            <given-names>P. H.</given-names>
            <surname>Guzzi</surname>
          </string-name>
          , “Alignmcl:
          <article-title>Comparative analysis of protein interaction networks through markov clustering</article-title>
          ,” in 2012 IEEE International Conference on Bioinformatics and Biomedicine Workshops,
          <string-name>
            <surname>BIBMW</surname>
          </string-name>
          <year>2012</year>
          , Philadelphia, USA, October 4-
          <issue>7</issue>
          ,
          <year>2012</year>
          ,
          <year>2012</year>
          , pp.
          <fpage>174</fpage>
          -
          <lpage>181</lpage>
          . [Online]. Available: http://doi.ieeecomputersociety.
          <source>org/10</source>
          .1109/BIBMW.
          <year>2012</year>
          .6470300
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>