<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Signed Graph Analysis for the Interpretation of Voting Behavior</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nejat Arinik</string-name>
          <email>nejat.arinik@univ-avignon.fr</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rosa Figueiredo</string-name>
          <email>rosa.figueiredo@univ-avignon.fr</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Vincent Labatut</string-name>
          <email>vincent.labatut@univ-avignon.fr</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Signed Graph, European Parliament, Graph Partitioning, (Relaxed)</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Correlation Clustering</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Laboratoire Informatique d'Avignon</institution>
          ,
          <addr-line>LIA EA 4128, Avignon</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Laboratoire Informatique d'Avignon</institution>
          ,
          <addr-line>LIA EA 4128, Avignon</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Laboratoire Informatique d'Avignon</institution>
          ,
          <addr-line>LIA EA 4128, Avignon</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In a signed graph, each link is labeled with either a positive or a negative sign. This is particularly appropriate to model polarized systems. Such a graph can be characterized through the notion of structural balance, which relies on the partitioning of the graph into internally solidary but mutually hostile subgroups. In this work, we show that signed graphs can be used to model and understand voting behavior. We take advantage of data from the European Parliament to confront two variants of structural balance, and illustrate how their use can help better understanding the studied system.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Information systems → Clustering; • Theory of
computation → Network optimization; • Applied computing → Voting /
election technologies;</p>
    </sec>
    <sec id="sec-2">
      <title>INTRODUCTION</title>
      <p>
        Signed graphs were primarily introduced in Psychology, with the
objective of describing the relationships between people belonging
to distinct social groups [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]: each one of their links is labeled with
a sign + or −, indicating the nature of the relationship between the
considered adjacent nodes. A signed graph can be used to model any
system containing two types of antithetical relationships, such as
like/dislike, for/against, etc. Such a graph is considered structurally
balanced if it can be partitioned into two [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] or more [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] mutually
hostile subgroups each having internal solidarity. Here, the words
hostile and solidarity mean: connected by negative and positive links,
respectively.
      </p>
      <p>
        However, it is very rare for a real-world network1 to have a
perfectly balanced structure: the question is then to quantify how
imbalanced it is. Various measures have been defined for this
purpose, the simplest consisting in counting the numbers of misplaced
links, i.e. positive ones located inside the groups, and negative ones
located between them [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Such measures are expressed relatively
to a graph partition, so processing the graph balance amounts to
identifying the partition corresponding to the lowest imbalance
measure. In other words, calculating the graph balance can be
formulated as an optimization problem. This type of optimization
problem can be compared to that of community detection, which
consists in partitioning unsigned networks in order to detect groups
1We use the following words indistinctly in this article: graph and network, node and
vertex, link and edge.
of nodes more densely connected relatively to the rest of the
network [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The main diference is of course the presence of signs
attached to links, which represent additional information one has
to take into account. Doing so is a non-trivial task, which cannot be
conducted by simply performing minor adaptations of community
detection methods [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        In a previous article, we have studied the structural balance of
weighted signed graphs representing the voting activity of
Members of the European Parliament (MEPs) [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. We have compared
the results obtained with partitioning methods designed for
community detection on the one hand, and for structural balance on
the other hand. Our main result was that, in contradiction with
some conclusions presented in another study [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], taking negative
links into account leads to significantly diferent partitions, at least
for these data. This is consistent with other results appearing in the
literature and showing that the information conveyed by negative
links generally improves the resolution of the problems at hand,
e.g. graph partitioning [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] or link prediction [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>But our study sufers from several limitations. First, the extracted
graphs contain many links with a close to zero weight, which could
have been considered as noise: they largely increase the processing
time and apparently make it harder to interpret the results, without
significantly afecting the obtained partitions. Second, we focused
our discussion on objective aspects (the quality of the partitions in
terms of imbalance) and stayed quite superficial when interpreting
our results relatively to the studied system. Third, the raw data we
used as a base to extract the signed graphs were incomplete: they
did not cover the whole 7th term.</p>
      <p>
        In a more recent work also conducted in our research group [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ],
Levorato &amp; Frota applied the same methodology as in [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] and tried
to solve certain of these limitations. They focused on a diferent
dataset, representing the voting activity at the National Congress
of Brazil, and performed a thorough interpretation of the obtained
partitions. They also considered a variant of the structural balance,
which we will describe later. However, they used the extraction
approach from [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], leading to complete, and therefore noisy, signed
graphs. This may be the reason why certain of the partitions they
obtained are marginally informative and/or dificult to interpret.
Moreover, this dificulty is further increased by the current confused
political situation in Brazil2.
      </p>
      <p>
        In this paper, we present the work we conducted to overcome the
limitations of both studies [
        <xref ref-type="bibr" rid="ref16 ref17">16, 17</xref>
        ], with the following contributions.
First, we come back to the European Parliament (EP), through a
diferent, complete, data source. Second, we include a filtering step
to get rid of the noise present in the complete graphs. Third, we
focus our interpretation only on a small part of the available data,
2http://www.bbc.com/news/world-latin-america-35810578.
in order to deliver a deeper analysis and better show the interest of
structural balance to characterize and understand the considered
system.
      </p>
      <p>The rest of the article is organized as follows. In Section 2, we
describe the methods we used to extract the signed networks from
our raw data, as well as the partitioning algorithms we applied to
them. In Section 3, we study the efect of the additional filtering
step on these algorithms, and the quality of a heuristic proposed
to measure the imbalance. In Section 4, we present our results on
a few specific cases selected from our corpus, and discuss them.
We adopt the perspective of the end-user, and instead of simply
focusing on the objective performance of the considered
partitioning algorithms, we also comment on the quality of the identified
clusters relatively to the studied system. Finally, in Section 5 we
summarize our findings, comment the limitations of our work and
describe how they can be overcome, and how our methods can be
extended.
2</p>
    </sec>
    <sec id="sec-3">
      <title>METHODS</title>
      <p>In this section, we first describe how we extract the signed networks
from the raw data describing the votes (Subsection 2.1). We then
focus on the methods we use to partition the resulting networks
(Subsection 2.2).
2.1</p>
    </sec>
    <sec id="sec-4">
      <title>Network Extraction</title>
      <p>We first review the raw data we use in this article (Subsection 2.1.1),
before describing the method applied to extract the signed networks
(Subsection 2.1.2).</p>
      <p>
        2.1.1 IYP Dataset. Like in our previous work [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], our row data
describe the activity of the MEPs during the 7th term of the EP,
which covers the period 2009-14. They include the vote cast by
each MEP for each text considered at the EP. Each MEP is also
described through his name, country and political group, as well
as other personal fields not used in this article. The country
corresponds to one of the 28 member states (at this time) in which
the MEP was elected. The political group is a transnational
parliamentary coalition. The groups of the 7th term were, by order of
decreasing prevalence: EPP: right/center-right conservatives; S&amp;D:
center-left; ALDE: right/center-right neoliberals; G-EFL: left
environmentalists, progressists and regionalists; ECR: right euroskeptics
and anti-federalists; GUE-NGL: left/far-left, socialists and
communists; EFD: right/far-right euroskeptics; NI: MEPs not belonging to
any of the other groups (mainly far-right MEPs). Each text is itself
associated to one among 21 specific policy domains (see [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] for
the complete list).
      </p>
      <p>
        In theory, these data are publicly available on the oficial EP
website3, however, in practice, accessing them is dificult. Fortunately,
various institutions did all the work of compiling them, and provide
them under a convenient form. The dataset we used in [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] turned
out to be incomplete: most votes from the last year of the considered
term (2013-14) are missing, as well as all the amendment-related
votes. For this reason, for the present work we switched to another
source: the website It’s Your Parliament4 (IYP), which is
independently maintained by the Danish company Buhl &amp; Rasmussen, and
aims at both providing an easy access to these data and presenting
analyses of the MEPs voting patterns.
      </p>
      <p>In this dataset, one vote can be represented in 3 ways: For (the
MEP wants the text to be accepted), Against (he wants the text to
be rejected) and Abstention (he wants to express his neutrality).
It is also possible that the MEP did not vote at all, in which case he
is considered as Absent.</p>
      <p>2.1.2 Extraction Procedure. As mentioned before, the behavior
of each MEP is represented by a series of votes, corresponding to
all the documents reviewed by the EP during one term. We want
to extract signed networks summarizing these data. But before
explaining how, we need to formalize a certain number of concepts.
Let G = (V , E, w) be an undirected weighted graph, where V and E
are the sets of vertices and edges, respectively, and w : E → [0; 1]
is a function associating a positive weight to each edge. We note
n = |V | the number of vertices, and w(e) the weight of edge e ∈ E.
Consider a function s : E → {+, −} that assigns a sign to each edge
in E. An undirected weighted graph G together with a function s
is called a signed graph, denoted by G = (V , E, w, s). An edge e ∈ E
is called negative if s(e) = − and positive if s(e) = +. We note E−
and E+ the sets of negative and positive edges in a signed graph,
respectively.</p>
      <p>
        The extraction method we use is similar to the one we previously
proposed in [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], with the addition of an optional filtering step ,
which makes it four-stepped.
      </p>
      <p>
        The first step consists in selecting a subset of the raw data (or
possibly all of it). This selection can be made along 4 independent
dimensions: policy domain (e.g. only Foreign Afairs ), political group
(e.g. only S&amp;D), member country (e.g. only France), and time (e.g.
only the year 2010-11). It is also possible to just consider all the
available data over one or more dimensions, as we previously did
[
        <xref ref-type="bibr" rid="ref16 ref17">16, 17</xref>
        ]. Considering a large amount of data makes it dificult to
perform a qualitative analysis of the results, and to give them an
appropriate interpretation. For this reason, in this article we focus
on a few countries and domains, and consider each parliamentary
year separately, as explained in Section 4.
      </p>
      <p>
        The second step consists in comparing individually all MEPs in
terms of similarity of their voting behaviors, for the selected data.
For this purpose, we use a variant of the vote similarity measures
presented in [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. For a pair of MEPs u and v and a given text
t , this measure noted Simt (u, v) takes the value: +1 if the MEPs
agree (both votes are For or Against) ; −1 if they disagree (one
vote is For, the other is Against) ; and 0 if at least one MEP votes
Abstention. This measure is processed for each text and averaged
to get the overall similarity between two MEPs, resulting in a real
value noted Sim(u, v) and ranging from −1 (the considered MEPs
always disagree) to +1 (they always agree). The texts for which
at least one MEP is Absent are not included in this average. We
process the average vote similarity for every pair of active MEPs
(i.e. MEPs who voted at least once in the selected data).
      </p>
      <p>
        The third step, which was not enforced in [
        <xref ref-type="bibr" rid="ref16 ref17">16, 17</xref>
        ], consists in
filtering the similarity values in order to remove the ones too close to
zero, which are deemed non-significant. Instead of using arbitrary
thresholds, we propose an automatic method, consisting in
applying k-means separately to the negative similarity values, and to the
positive ones, with k = 2. This allows distinguishing the values that
are close to zero from the others. Indirectly, this amounts to
estimating the best thresholds θ − and θ + such that the similarity range
is split in 4 intervals: [−1; +1] = {[−1; θ −]; ]θ −; 0[; [0; θ +[; [θ +; +1]}.
The filtering is performed by setting all values in {]θ −; 0[; [0; θ +[}
(i.e. both central intervals) to zero.
      </p>
      <p>
        The fourth and final step allows to build the signed network
based on the remaining similarity values. It consists in creating a
vertex to represent each active MEP, and connecting by an edge all
pairs of MEPs whose similarity is non-zero. The sign and weight of
an edge e connecting two vertices u and v are defined as the absolute
value and sign of their similarity, respectively: w(e) = |Sim(u, v)|
and s(e) = sдn(Sim(u, v)). The filtering conducted at the third step
amounts to suppressing the weakest links, and the produced graph
is consequently not fully connected (unlike that from [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]). If these
links indeed correspond to noise, we expect their removal to both
lighten the computational load and ease the interpretation of the
results.
      </p>
      <p>As explained in Section 2.1.1, it is possible to play with the 4
dimensions present in our raw data (domain, group, country, and
time) and used during the selection step, to obtain a number of
diferent signed networks. There are 21 policy domains, and we also
consider all documents independently from their domain. The term
is 5-year long (2009-2014), and we consider each year separately as
well as the whole term. There are 28 countries and 8 political groups,
and in both cases we consider MEPs from specific countries/groups
separately, as well as all MEPs at once. In theory, this amounts to a
total of 4884 diferent modalities. In practice, some of them are not
usable (e.g. some groups are not represented in certain countries,
resulting in an empty data selection after the first step), so our
dataset contains 4150 instances of signed networks.
2.2</p>
    </sec>
    <sec id="sec-5">
      <title>Graph Partitioning</title>
      <p>We briefly describe the two partitioning methods, able of handling
signed graphs, which we selected to analyze our signed networks.</p>
      <p>Let us first formalize a few additional concepts. A graph partition
P = {C1, ..., Ck } (1 ≤ k ≤ n) is a k-partition of V , i.e. a division of
V into k non-overlapping and non-empty subsets Ci (1 ≤ i ≤ k)
called clusters. For σ ∈ {+, −}, the set of positive or negative edges
(depending on σ ) connecting two clusters Ci , Cj ∈ P (1 ≤ i, j ≤ k)
is Eσ [Ci : Cj ] = {(u, v) ∈ Eσ | u ∈ Ci , v ∈ Cj }, and its total weight
is given by Ω σ (Ci , Cj ) = Íe ∈Eσ [Ci :Cj ] w(e).</p>
      <p>
        One appropriate way of studying the structural balance of a
signed network G = (V , E, w, s) is by solving the Correlation
Clustering problem (CC). In its original version [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], and consistently
with the definition of structural balance given earlier in Section
1, it consists in finding a partition of the set of vertices V which
maximizes both the number of positive links located inside the
clusters, and that of negative links located between them. A relaxed
version called Relaxed Correlation Clustering problem (RCC) [
        <xref ref-type="bibr" rid="ref3 ref8">3, 8</xref>
        ]
consists in searching a partition of V into at most k clusters, while
allowing special patterns of relationships originally considered as
violations of the structural balance [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Both problems are formally
described next.
      </p>
      <p>The Imbalance I (P ) of a partition P is defined as the total weight
of positive edges located between clusters, and negative edges
located inside them, i.e.</p>
      <p>Õ Õ
Ω +(Ci , Cj ).</p>
      <p>(1)
I (P ) =</p>
      <p>Ω −(Ci , Ci ) +
1≤i ≤k
1≤i,j ≤k
Problem 2.1 (CC problem). For a signed graph G = (V , E, w, s),
the Correlation Clustering problem consists in finding a partition P
of V such that the imbalance I (P ) is minimized.</p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], the definition of a structurally balanced signed graph
was extended in order to include relevant processes (polarization,
mediation, diferential popularity and subgroup internal hostility)
that are counted in Eq. (1) as violations of the structural balance.
According to this new definition, a signed graph is considered
relaxed k-balanced if it can be l -partitioned, with l ≤ k, in such a
way that: 1) all the edges within a given cluster have the same sign
(not necessarily +) ; and 2) all the edges between two given clusters
have the same sign (not necessarily −).
      </p>
      <p>
        Using this new definition, the structural balance was generalized
to a version named Relaxed Structural Balance [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], resulting in a new
definition for the imbalance of a graph partition. For an l -partition
P = {C1, ..., Cl }, the Relaxed Imbalance RI (P ) is defined as
Õ
      </p>
      <p>min{Ω +(Ci , Ci ), Ω −(Ci , Ci )}
RI (P ) =
+
1≤i ≤l</p>
      <p>Õ
1≤i,j ≤l
min{Ω +(Ci , Cj ), Ω −(Ci , Cj )}.
(2)
(3)</p>
      <p>This generalized imbalance defines a new criteria to evaluate
balancing in a signed graph, and gives rise to the following graph
clustering problem.</p>
      <p>Problem 2.2 (RCC problem). Let G = (V , E, w, s) be a signed graph,
and k an integer value satisfying 1 ≤ k ≤ n. The Relaxed Correlation
Clustering problem consists in finding an l -partition P of V , with
l ≤ k, such that the relaxed imbalance RI (P ) is minimized.</p>
      <p>It is worth noticing that, for a given graph, the RCC solution is
necessarily equally or more balanced than the CC one.</p>
      <p>
        Both CC and RCC problems have been proved to be N P -hard [
        <xref ref-type="bibr" rid="ref11 ref2">2,
11</xref>
        ]. Integer programming-based methods can be used to solve both
problems to optimality [
        <xref ref-type="bibr" rid="ref1 ref11">1, 11</xref>
        ], and numerical experiments have
shown that the additional parameter k, in the RCC definition, turns
the graph clustering problem more dificult to solve numerically
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Both problems can be eficiently solved by the Iterated Local
Search (ILS) procedures described in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], namely ILS-CC and
ILSRCC. As a baseline, we also use the exact algorithm described in
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] to solve CC, which we call Ex-CC in the rest of the article.
      </p>
      <p>We apply both ILS procedures in order to identify structural
balanced partitions in each extracted signed network. The following
strategy was adopted to set the parameter k, which is an input of
the RCC problem. First, we apply ILS-CC and obtain an optimal
partition containing k ′ clusters. Second, we apply ILS-RCC to the
same network with parameter k ∈ {k ′, k ′ + 1, k ′ + 2}, producing 3
diferent network partitions. We consider and compare all obtained
partitions when interpreting our results relatively to the studied
system .</p>
      <p>
        In the experimental part, we compare partitions using the
Normalized Mutual Information (NMI), a measure widespread in the
ifelds of clustering [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] and community detection [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. It ranges
from 0 (the partitions are completely diferent) to 1 (they are exactly
similar). This measure takes into account the possible hierarchical
relations between the considered partitions. For instance, if one
cluster from the first partition corresponds to two distinct clusters
in the second partition, the penalty will be lower than if there is no
match at all [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
    </sec>
    <sec id="sec-6">
      <title>3 EXPERIMENTAL ASSESSMENT</title>
      <p>In this section, we first study the efect of the filtering step of our
extraction process on both the obtained networks and the
partitioning algorithms (Subsection 3.1). We then assess the quality of
the heuristic previously proposed to solve the CC problem
(Subsection 3.2). Note that the heuristic we use to solve RCC relies
on exactly the same operators, which is why we do not need to
explicitly evaluate it for this problem. For both points (filtering
and heuristic), we base our analysis on the 4150 signed network
instances constituting our whole dataset.</p>
      <p>For convenience, we will use the following notations: ExCC(G)
and I LSCC(G) are the imbalance values obtained through the
corresponding partitioning algorithms, expressed in total edge weight as
defined by equation 1. It is sometimes more convenient to discuss
an imbalance described in terms of percent of the total link weight
of the graph, in which case we add a % to our notation. Finally, the
ifltered version of a graph G is noted Gf .</p>
    </sec>
    <sec id="sec-7">
      <title>3.1 Efect of the Filtering Step</title>
      <p>
        As explained in Section 2.1, we added a filtering step to our
previously defined extraction process [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]: the goal of this subsection is
to assess its influence on both the resulting graphs (Subsection 3.1.1)
and the partitioning algorithms (Subsection 3.1.2).
      </p>
      <p>3.1.1 Efect on the Graphs. The plots from Figure 1 show the
numbers of positive (in green) and negative (in red) links for each
network in the dataset, without (left-hand plot) and with filtering
(right-hand plot). On the x axis, the networks are ordered by
decreasing number of links. The y axis uses a logarithmic scale for
readability matters. There obviously is a decrease in the numbers
of positive and negative links when filtering the graphs ( 43% of
the links are removed, in average). However it is worth noticing
that the general distribution does not change (if anything, it is
smoothed) and the proportions of positive and negative links are
also preserved. This is even truer when considering weights instead
of link counts (not plotted here), since the filtering removes the
weaker links (only 26% of the network weight, in average). This
point is important, because the considered partitioning methods
take weights into account.</p>
      <p>Another important point besides link distribution is graph
connectivity. We focus on the giant component of the unfiltered graphs
(which by definition are almost completely connected) and study
how they are afected by the filtering step. For the overwhelming
majority of the instances (66%), filtering does not make the graph
disconnected. For 23% (resp. 8%) of them, it splits them in 2 (resp. 3)
components. But in this case, the larger component represent 87%
(resp. 76%) of the original component, which means we still have
one giant component. Filtering splits the rest of the graphs into up
to 10 components, but this represents a very small proportion of
ilfrskubeonNm 101100100000100●● ●● ●●● ●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●U●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●n●●●●●●●●●●●●●●●●●●●●●●●●●f●●●●●i●●●●●●●●●●●l●●●●●●●●●t●●●●●●●●●●●●●●●e●●●●●●●●PN●●●●●●●●●●●●●●●●r●●●●●●●●●o●●●●●●e●e●●●●●●●●●●●●●●●●●●●●s●●●●gd●●●●●●●●●●●●●●i●●●●●●●●●a●●●t●Gi●●●●●●●●●●●●tv●●●●●●●●●●●●●●i●●●e●v●●●r●●●●●●●●●●●●a●●●e●●●●●●●●●●l●●p●●●●i●●●n●l●●●h●●●●i●●●●●●●n●k●●●●●●●●●s●●●●●ks●●●s lifrskubeonNm 101100100000100 ●● ●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●F●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●i●●●●●●●●●●●l●●●●●●●●●●t●●●●●●●●●●●●●e●●●●●●●●●●●●●●●●●●●●●●r●●●PN●●●●●●●●●●●e●●●●●●●●●●●●●●o●●e●●●●d●●●●●●●●●●●●s●●g●●●●●●●●●●●●●●●i●G●●●a●●●t●●●●●●●●●●i●●●●●t●v●●●r●●●●●i●●●●ae●v●●●●●●●●●●●pe●●●●●●●l●●●●●●●●hi●●●●●n●l●●●is●●●●●●nk●●●●●●●●ks●s
0 1000 2000 3000 4000 0 1000 2000 3000 4000
Graph instances, by decreasing order of total number of links Graph instances, by decreasing order of total number of links
Figure 1: Numbers of positive (green) and negative (red)
edges in all unfiltered (left) and filtered (right) networks.
the dataset (3%), constituted of very small graphs, and the giant
component is also preserved in these cases.</p>
      <p>3.1.2 Efect on the Partitioning Algorithms. According to our
experiments, the filtering step generally leads to a decrease in terms
of partitioning processing time. This efect is more pronounced for
graphs whose unfiltered partitioning requires more time, since
faster ones ofer little room for improvement. For Ex-CC, filtering
cuts the processing time by 5–10% in those graphs, whereas for
ILS-CC it is close to 90%. We now turn to the quality of the detected
clusters. We focus on Ex-CC and ignore ILS-CC, because only the
analysis of optimal solutions can allow us to assess the true efect
of filtering. We first consider the numbers of clusters that this
algorithm detects. For almost all instances, we observe an increase
in the number of clusters in the filtered graphs. But for a few of
them, there is a decrease: this is explained by the fact that removing
an edge can decrease cluster cohesion, if this edge is positive, but
also cluster separation, if it is negative. We have no ground truth
(group membership is not a reference, as shown in Section 4), so it is
dificult to objectively assess whether an increase in the number of
clusters is a good thing or not. However, we can use our knowledge
of the data: since they represent voting behaviors, we expect 1
cluster if there is a consensus, 2 if there is a clear For/Against
opposition, and a very few more if some MEPs swing in-between.
We observe that on the unfiltered networks Ex-CC detects a single
cluster for most networks (55% of them). It seems unlikely that a
consensus would emerge that often. After filtering, this proportion
drops to 38%, which seems more reasonable.
iitt(sconeu 000515000
) 2
m
xeE</p>
      <p>Ex-CC
ILS-CC
0030 0030
rcyueqenF 10002000 rcyenuqeF 00012000 5000
0 0.0 0N.2ormaliz0e.d4Mutua0lI.n6formati0o.n8 1.0 0 −0.15 −Im0.b1a0lance−D0.i0f5erence0.00 0.05 0 0 200 Graph4s0iz0e (nodes6)00 800
Figure 2: Distribution of the NMI (left) and of imbalance
difference (center) between partitions detected by Ex-CC with
vs. without filtering. On the right: execution time of Ex-CC
and ILS-CC as a function of the network size.</p>
      <p>But two partitions can contain the same number of clusters while
being very diferent (and oppositely: contain relatively diferent
numbers of clusters, but be hierarchically related). It is thus
necessary to assess how similar two solutions on an unfiltered graph
and its filtered counterpart are. For this purpose, we use the NMI
(cf. Subsection 2.2), which is showed in the left plot of Figure 2. The
NMI is close to 1 for most instances (≥ 0.8 for 61% of them),
meaning the identified partitions are not afected much by the filtering,
despite the previously observed variation in the number of clusters.</p>
      <p>We now turn to the quality of the partitions expressed in terms
of imbalance. The center plot in Figure 2 displays the distribution
of ExCC%(G) − ExCC%(Gf ), i.e. the diference of percent imbalance
between the partitions detected on an unfiltered graph vs. the
corresponding filtered graph. The values are distributed around 0,
meaning the quality in terms of imbalance does not change much
when filtering. Based on the previous observations, we can conclude
the filtering step only marginally afects the partitions detected by
Ex-CC.
3.2</p>
    </sec>
    <sec id="sec-8">
      <title>Evaluation of the Heuristic</title>
      <p>
        We now turn to the evaluation of ILS-CC, the heuristic method
proposed to solve the CC problem. We consider two aspects: the quality
of the identified partitions, in terms of imbalance, and the gain in
computational time. We use the parameter values recommended
by the authors of the algorithm [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. Based on the conclusion of
the previous subsection, we apply the algorithm to the filtered
networks only.
lliftttttrrrsccsyuoebeeeddeheagbuohNmm 51015 0**********G**r**a*p*h**i*n*s*t*a1*n*0c*e*0*s0*,*b*y**d*e*c**re*a2**s0*in0*g0**n*u*m**b**e**r*o*3f*0E*0*x*0-C**C**c*l*u*sIE*Lte*xS4*r−s*−0C*C0*C*0C rcyequenF 01002000030004000 0.0 0N.2ormaliz0e.d4Mutua0l.I6nformati0o.n8 1.0 rcyequenF 010020003000040000.00 0.02 Im0b.0a4lance0d.0if6erenc0e.08 0.10
Figure 3: Comparison of Ex-CC and ILS-CC: number of
clusters (left), distribution of NMI (center) and of Imbalance
difference (right).
      </p>
      <p>Figure 3 displays the obtained results. The left plot shows the
numbers of clusters detected by Ex-CC (in blue) and ILS-CC
(orange). The networks are ordered by decreasing number of Ex-CC
clusters. One can observe that the approximate approach gets very
close to Ex-CC. The center plot displays the NMI distribution, and
we see that in 83% of the cases, ILS-CC identifies a partition very
similar to the optimal one (N MI ≥ .8). The right plot is the
distribution of imbalance diference I LSCC%(Gf ) − ExCC%(Gf ), which
shows that the results output by ILS-CC are optimal or near-optimal
for almost all instances (98% of the cases). Qualitatively speaking,
the heuristic leads to excellent approximations on these data.</p>
      <p>We now turn to the computational gain of the heuristic. The
right plot in Figure 2 shows the evolution of the processing times
for both Ex-CC (orange) and ILS-CC (blue), expressed in seconds,
as a function of the number of nodes in the processed network. We
used a 24-core AMD Opteron 2.6 GHz CPU with 512 GB RAM. The
benchmark was generated randomly by sampling an increasing
number of nodes from the largest unfiltered network. The obtained
sizes range from 10 to 850 nodes, by 10-node steps. Since
consecutive graphs are independently drawn, we expect some fluctuations
in the obtained durations. Our first observation is that it becomes
very hard for Ex-CC to solve instances larger than 450 vertices
(vertical dashed line in the figure), as the necessary computing time
passes the 1 hour limit (shown with a horizontal dashed line). We
could not finish processing networks larger than 600 nodes, which
is why the line is interrupted. On the contrary, ILS-CC is very fast
even for the largest graphs: the time needed is of the order of a few
minutes (142.48 s at most). Note that the quality of the estimated
partitions are also very good, similar to what was described in the
previous subsection.</p>
    </sec>
    <sec id="sec-9">
      <title>4 INTERPRETATION OF SPECIFIC CASES</title>
      <p>The assessment conducted in the previous section was purely
quantitative, and based on the whole dataset. In order to explore the
usefulness of signed graph partitioning in a more qualitative way,
we now focus on a few specific cases of interest. We discuss the
results obtained while solving both CC and RCC on the networks
representing French and Italian MEPs, for 2 policy domains:
Agriculture &amp; Rural Development (AGRI) and Economic &amp; Monetary
Afairs (ECON). We chose those topics because of their potentially
polarizing nature: AGRI because the Common Agricultural Policy
(CAP) has historically been of utmost importance for France due
to the prevalence of the agricultural sector in its economy, but a
part of the population wants to leave the industrial model of
production; and ECON because the subprime mortgage crisis started
just before the considered term. We selected France (FR) because
of our knowledge of its politics, whereas Italy (IT) is interesting as
a reference, since it has roughly the same number of MEPs, and a
relatively close culture. Moreover, for each case, we focus on the
year for which the results are the most illustrative.</p>
      <p>In the rest of this section, we exhibit two types of graphs:
individual vs. cluster networks. In an individual network (Figures 4a,e
and 5a,e), vertices represent MEPs and edges represent filtered vote
similarity values. We use a circular layout, and gather MEPs by
political group. Each group is characterized by a color: GUE-NGL
(red), G-ELF (green), S&amp;D (pink), ALDE (orange), EPP (light blue),
ECR (dark blue), EFD (purple) and NI (brown). In a cluster network
(Figures 4b-d,f-g and 5b-d,f-g), each vertex represents a cluster, and
each positive (resp. negative) edge corresponds to the set of all
individual positive (resp. negative) edges between the MEPs
constituting these clusters. For each cluster, we indicate the groups of the
MEPs constituting it, and its proportions of internal positive and
negative links, relatively to the total network weight. The cluster
itself is represented by a pie chart also reflecting these proportions.
Similar proportions are provided also for each edge. Finally, in both
types of graphs, positive (resp. negative) edges are drawn in green
(resp. red).
4.1</p>
    </sec>
    <sec id="sec-10">
      <title>Agriculture &amp; Rural Development</title>
      <p>For AGRI, we focus on the year 2012-13. The top plots in Figure4
represent the network of the French MEPs, and 3 diferent partitions
estimated for this network. The first partition (b) is the optimal
solution to CC, which contains 3 clusters and has an imbalance of
14.18 (1.35% of the total weight). There are two large clusters of
similar size: the left one is largely dominated by the
environmentalists (G-EFL) and also contains the radical left (GUE-NGL) and
NI ; and the right cluster contains the center-left (S&amp;D), right and
center-right (EPP and ALDE) groups. Both clusters have a majority
–42.37(4.06%)</p>
      <p>EFD (1)
of positive internal and negative external links. The third cluster
(at the bottom) is a single node corresponding to Philippe de Villiers,
the only French member of the right-wing euroskeptic EFD group.
Unlike the three members of the other euroskeptic group (NI), he is
connected to the rest of the graph only by negative links. This
partition displays a clear left/right divide, with the exception of the three
NI members, who are put together with the left/environmentalists.
This divide can be explained when considering the texts voted
this year, among which many concern animal rights and related
matters (questions of great importance for these groups). The fact
one ALDE member was put with the Greens supports this, since it
corresponds to Corrine Lepage, former Minister of the Environment
in a right-wing French government. One could expect the S&amp;D to
vote similarly to the rest of the left on these topics. However, even
more texts voted during this year concern the CAP, on which the
center-left is more likely to side with the right. This also explains
the position of NI, which is more likely to opportunistically support
resolutions in favor of small family-owned farms (and therefore
vote like the radical left).</p>
      <p>The other partitions are solutions of the RCC problem, with
various k values. For k = 3 (we start from the optimal number of
clusters for CC, as explained in Section 2.2), represented in plot
(c), we get a lower imbalance than with CC (0.19), which is to be
expected. The partition difers from the first one in that it identifies
3 clusters of comparable sizes (no more singleton cluster). Both large
clusters from the previous partition loose a number of members,
which are gathered to form a new, intermediary group. It contains
some of the radical left (GUE-NGL), the center-left (S&amp;D),
centerright (ALDE) as well as the NI group. The two other clusters are
the environmentalists (G-EFL with Lepage) and the rest of the right
(EPP with de Villiers), respectively. This partition is interesting,
because it manages to identify a cluster of moderate MEPs, which
sometimes vote like the environmentalists, and sometimes like
the right. The cluster graph consequently takes the form of an
imbalanced (in terms of CC) triangle in which the environmentalists
and the right are in opposition, whereas the moderate are positively
connected to both. This type of structure could be identified only
thanks to the relaxed nature of RCC, which allows here to have
positive links between clusters.</p>
      <p>The k = 4 partition is quite similar to the CC partition, in the
sense S&amp;D and EPP are in the same cluster, and de Villiers is apart
again. But NI and GUE-NGL are now part of the EPP-dominated
cluster, and there is a fourth cluster formed by MEPs from almost
all political groups except EPP. Due to this heterogeneity, this last
cluster is very dificult to interpret. Yet, the partition reaches a
perfect zero imbalance, which means absolutely no link is misplaced.
This highlights the fact increasing k will decrease the imbalance,
but not necessarily make the partition more informative, from the
application point of view. This means that the problem, as it is
formulated, does not allow to completely automate the process of
identifying the best partition for the end-user.</p>
      <p>We now turn to the Italian MEPs, which are represented by
the bottom plots of Figure 4. first point to notice in the individual
network (e) is the complete absence of any G-EFL or GUE-NGL
MEPs, which seems to result in much fewer negative links, and
therefore less polarization. The CC solution, represented in plot (f),
contains 2 clusters, with an imbalance of 8.58. They are connected
as much positively as negatively, and the smaller is a singleton
corresponding to Gianni Vattimo. All of his links are negative, and
represent most of the negative links in the network. According to
his biography5, he has a very specific background and ideological
524.74 (44.51%)
0.00 (0.00%)
–
3
1
)%46.2( –99.25(8.42%)
81.
)
%57.7(
04.
19
position (nihilist philosopher, communist, speaks his mind) we
can confidently state he is an outlier. If we ignore him, we can
conclude that no polarization was detected by CC, probably due to
the absence of environmentalists.</p>
      <p>
        Cluster graph (g) represents the partition obtained for RCC and
k = 2. The imbalance is slightly improved, and the partition is quite
similar to that of CC, except Vattimo is joined by a few members of
other groups. Interestingly, the resulting cluster has only negative
internal links, whereas it is mostly positively connected to the other
cluster. This is called internal hostility by Doreian [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. In this case,
we suppose that this cluster gathers the most opposed MEPs from
the main groups, and that they are likely to be agents of polarization,
pulling their groups in opposite directions.
      </p>
      <p>The partition obtained for k = 3 (d) has an almost-zero
imbalance (0.49), and difers in two points with the previous one: 1) the
large cluster is split in two: S&amp;D vs. right-wing groups ; and 2)
Vattimo’s cluster changes slightly, and as a result becomes internally
positively connected. The cluster graph is quite similar in structure
to the one obtained for France with RCC k = 3, except this time
S&amp;D has positive connections with a right-wing cluster and a small
heterogeneous cluster, themselves in opposition (instead of right vs.
left/environmentalists). Overall, the RCC k = 3 partition seems to
be more informative than the RCC k = 2, but the very distinct
voting behavior of Vattimo might hide the simple fact that the Italian
MEPs are not polarized on agricultural questions.</p>
    </sec>
    <sec id="sec-11">
      <title>4.2 Economic &amp; Monetary Afairs</title>
      <p>The top plot in Figure 5 display the ECON results for the French
MEP during the year 2009-10. The individual network (a) contains
much more negative links for AGRI. As we will see, this is meanly
due to the fact that, this time, the two main antagonistic groups
have sensibly the same size. The CC solution (b) contains 3 clusters
for a relatively high imbalance (46.72). There are 2 large clusters:
one dominated by left-wing groups (GUE-NGL, G-EFL, S&amp;D) and
the other by right-wing ones (ALDE and EPP). Like for AGRI, we
have some exceptions: NI (far right) and Lepage (ALDE) are placed
in the left-wing cluster. For NI, we observe only a few positive
links with the left, but many negative ones with the right, which is
why they were put in the left-wing cluster. The third cluster is a
singleton: de Villiers, like for AGRI, because he is only negatively
connected to the other groups. The clusters constitute a purely
negative triangle: all clusters are in strong opposition while internally
positive. However, de Villiers is likely to be an outlier again, so this
rather reflects a strong bipartition. This partition is consistent with
the groups’ ideologies regarding economics, with a clear left/right
divide. It highlights the main diference with AGRI: this time, S&amp;D
is on the side of G-EFL/S&amp;D (positive links) against EPP/ALDE
(negative links), and does not constitute an intermediary cluster.</p>
      <p>The result obtained for RCC k = 3 (c) has a slightly improved
imbalance (36.64). The partition also exhibits a strong left/right
divide, but not as strong as with CC. The third cluster does not
contain de Villiers, and is instead a heterogeneous gathering of
MEPs from 3 distinct groups (EPP, S&amp;D and ALDE), which seem to
be outliers in their own groups. For instance, it contains Lepage,
which tends to vote like G-EFL when other ALDE MEPs votes like
EPP. The cluster graph shows an imbalanced triangle, in which the
outliers group is positively connected to both wings, whereas the
other two clusters are very strongly negatively connected.
Therefore, we consider this group has an intermediate position on the
political spectrum, as previously observed for AGRI (with a diferent
distribution, though).</p>
      <p>When considering k = 4 (d), the partition is the same except that
de Villiers is placed in his own cluster. This small change causes
the imbalance to drop to 2.5. However, it is worth noticing that
de Villiers was absent to many votes during this period (27 out
of 35), which explains the number and strength of his negative
links. Due to these absences, these links are not very meaningful.
So, in terms of interpretation, this partition is the same as the
previous one, as shown by the cluster graph. Again, as observed for
AGRI, a lower imbalance does not necessarily means the partition
is more informative: it is necessary to go back to the original data
to correctly interpret the results.</p>
      <p>We now turn to Italian MEPs, represented in the bottom plots of
Figure 5. The individual network (e) contains much fewer negative
links compared to the French network, and they are mostly attached
to a few MEPs (especially Magdi Cristiano Allam and Pino Arlacchi).
Like before, this is due to the fact these MEPs were absent to a
lot of voting sessions, and always vote Against: by comparison,
frequent voters tend to have their similarity scores smoothed when
averaging over time. The CC solution (f) splits the network in 2
clusters: one contains almost all far-right MEPs (EFD and NI), and
the other the rest of the network. We clearly have 2 antagonistic
clusters, however this is due, in part, to the possibly overestimated
negative links mentioned earlier. Overall, the network does not
seem to display as much polarization as the French one.</p>
      <p>The result obtained with RCC for k = 2 is exactly similar to
that of CC, and for this reason it is not shown. For k = 3 (g), the
imbalance is almost zero (0.49), and the partition is very diferent:
the large cluster is roughly split into a left-wing (S&amp;D) and a
rightwing (EPP and ALDE) clusters, whereas the third group is very
heterogeneous, and contains MEPs from all groups except NI. The
cluster graph takes the form of the triangle already observed before:
two opposed clusters (here: left vs. right) both positively connected
to the third one (here: the heterogeneous cluster), which holds
an intermediary position. With k = 4 (h), we get a very similar
partition, with an extra cluster gathering the same frequently absent
far-right MEPs. As mentioned before, this group is likely to be an
artifact due to the way absence is handled during the extraction
process. However, RCC must be credited for being able to identify
this cluster of interest while still distinguishing the three other
political trends present among the Italian MEPs.</p>
    </sec>
    <sec id="sec-12">
      <title>5 CONCLUSION</title>
      <p>In this article, we extract and analyze signed networks representing
the voting behavior of MEPs, using two graph partitioning methods
for the CC and RCC problems. We first propose a filtering step to
make the original networks sparser, which eases both their
processing and the interpretation of the results. We show empirically
that the efect of this step on the obtained partitions is negligible.
We also assess the quality of a heuristic allowing to speed up the
partitioning process, and show it is significantly faster than an exact
method, while identifying solutions of the same quality. Finally, we
focus on 4 networks of interest from our dataset, and validate the
relevance of the partitioning algorithms by performing a
qualitative evaluation of their results. We show that the two partitioning
approaches are complementary, and allow to identify various types
of clusters: some match the traditional ideological divides between
the political groups, whereas other highlights specific behaviors or
positions in the EP.</p>
      <p>However, we also identified some limitations, which we plan
to solve in our future work. First, some artifacts appear when
certain MEPs combine two specific behaviors: frequent absences and
systematic Against vote. The partitioning tools are able to detect
these cases, but they still obfuscate the results, so this issue has
to be solved before partitioning. Second, our interpretation was
limited to our short knowledge in the domain of European politics:
we need to collaborate with a specialist, in order to further assess
the quality of the partitioning methods.</p>
    </sec>
    <sec id="sec-13">
      <title>ACKNOWLEDGMENTS</title>
      <p>This research benefited from the support of the Agorantic FR 3621,
as well as the FMJH Program Gaspard Monge in optimization and
operation research (Project 2015-2842H), and from the support from
EDF to this program.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Ales</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Knippel</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>An extended edge-representative formulation for the K-partitioning problem</article-title>
          .
          <source>Electr</source>
          . Notes in Disc. Math.
          <volume>52</volume>
          (
          <year>2016</year>
          ),
          <fpage>333</fpage>
          -
          <lpage>342</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>N.</given-names>
            <surname>Bansal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Blum</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Chawla</surname>
          </string-name>
          .
          <year>2002</year>
          .
          <article-title>Correlation Clustering</article-title>
          .
          <source>In 43rd Annual IEEE Symposium on Foundations of Computer Science</source>
          .
          <volume>238</volume>
          -
          <fpage>247</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M.</given-names>
            <surname>Brusco</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Steinley</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>K-balance partitioning: An exact method with applications to generalized structural balance and other psychological contexts</article-title>
          .
          <source>Psychological Methods 15</source>
          ,
          <issue>2</issue>
          (
          <year>2010</year>
          ),
          <fpage>145</fpage>
          -
          <lpage>157</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>D.</given-names>
            <surname>Cartwright</surname>
          </string-name>
          and
          <string-name>
            <given-names>F.</given-names>
            <surname>Harary</surname>
          </string-name>
          .
          <year>1956</year>
          .
          <article-title>Structural balance: A generalization of Heider's theory</article-title>
          .
          <source>Psychological Review</source>
          <volume>63</volume>
          (
          <year>1956</year>
          ),
          <fpage>277</fpage>
          -
          <lpage>293</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>K.-Y. Chiang</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.-J. Hsieh</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Natarajan</surname>
            ,
            <given-names>I. S.</given-names>
          </string-name>
          <string-name>
            <surname>Dhillon</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Tewari</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Prediction and clustering in signed networks: a local to global perspective</article-title>
          .
          <source>Journal of Machine Learning Research</source>
          <volume>15</volume>
          ,
          <issue>1</issue>
          (
          <year>2014</year>
          ),
          <fpage>1177</fpage>
          -
          <lpage>1213</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>L.</given-names>
            <surname>Danon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>DÃŋaz-Guilera</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Duch</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Arenas</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Comparing Community Structure Identification</article-title>
          .
          <source>J. Stat. Mech</source>
          .
          <year>2005</year>
          ,
          <volume>9</volume>
          (
          <year>2005</year>
          ),
          <fpage>P09008</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Davis</surname>
          </string-name>
          .
          <year>1967</year>
          .
          <article-title>Clustering and structural balance in graphs</article-title>
          .
          <source>Human Relations</source>
          <volume>20</volume>
          ,
          <issue>2</issue>
          (
          <year>1967</year>
          ),
          <fpage>181</fpage>
          -
          <lpage>187</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>P.</given-names>
            <surname>Doreian</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Mrvar</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Partitioning signed social networks</article-title>
          .
          <source>Social Networks</source>
          <volume>31</volume>
          ,
          <issue>1</issue>
          (
          <year>2009</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>P.</given-names>
            <surname>Doreian</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Mrvar</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Structural Balance and Signed International Relations</article-title>
          .
          <source>Journal of Social Structure</source>
          <volume>16</volume>
          (
          <year>2015</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>49</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>P.</given-names>
            <surname>Esmailian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. E.</given-names>
            <surname>Abtahi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Jalili</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Mesoscopic analysis of online social networks: The role of negative ties</article-title>
          .
          <source>Physical Review E 90</source>
          ,
          <issue>4</issue>
          (
          <year>2014</year>
          ),
          <fpage>042817</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>R.</given-names>
            <surname>Figueiredo</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Moura</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Mixed integer programming formulations for clustering problems related to structural balance</article-title>
          .
          <source>Soc. Net</source>
          .
          <volume>35</volume>
          ,
          <issue>4</issue>
          (
          <year>2013</year>
          ),
          <fpage>639</fpage>
          -
          <lpage>651</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>S.</given-names>
            <surname>Fortunato</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Community detection in graphs</article-title>
          .
          <volume>486</volume>
          ,
          <issue>3</issue>
          -
          <fpage>5</fpage>
          (
          <year>2010</year>
          ),
          <fpage>75</fpage>
          -
          <lpage>174</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>F.</given-names>
            <surname>Heider</surname>
          </string-name>
          .
          <year>1946</year>
          .
          <article-title>Attitudes and cognitive organization</article-title>
          .
          <source>Journal of Psychology</source>
          <volume>21</volume>
          ,
          <issue>1</issue>
          (
          <year>1946</year>
          ),
          <fpage>107</fpage>
          -
          <lpage>112</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>J.</given-names>
            <surname>Kunegis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Preusse</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Schwagereit</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>What is the added value of negative links in online social networks?</article-title>
          .
          <source>In 22nd International Conference on World Wide Web</source>
          .
          <fpage>727</fpage>
          -
          <lpage>736</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>M.</given-names>
            <surname>Levorato</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Figueiredo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Frota</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.</given-names>
            <surname>Drummond</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Evaluating balancing on social networks through the eficient solution of correlation clustering problems</article-title>
          .
          <source>EURO Journal on Computational Optimization</source>
          in press (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>M.</given-names>
            <surname>Levorato</surname>
          </string-name>
          and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Frota</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Brazilian Congress structural balance analysis</article-title>
          .
          <source>Journal of Interdisciplinary Methodologies and Issues in Science 2</source>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>I. Mendonça</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Figueiredo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Labatut</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Michelon</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Relevance of Negative Links in Graph Partitioning: A Case Study Using Votes From the European Parliament</article-title>
          .
          <source>In 2nd European Network Intelligence Conference</source>
          .
          <volume>122</volume>
          -
          <fpage>129</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>A.</given-names>
            <surname>Strehl</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Ghosh</surname>
          </string-name>
          .
          <year>2002</year>
          .
          <article-title>Cluster ensembles: A knowledge reuse framework for combining multiple partitions</article-title>
          .
          <source>Journal of Machine Learning Research</source>
          <volume>3</volume>
          (
          <year>2002</year>
          ),
          <fpage>583</fpage>
          -
          <lpage>617</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>