<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Analyzing polarization in Twitter: The murder of Brazilian councilwoman and activist Marielle Franco</article-title>
      </title-group>
      <abstract>
        <p>Social media has allowed people to publicly express, at near zero cost, their opinions and emotions on a wide range of topics. This recent scenario allows the analysis of social media platforms to several purposes, such as predicting elections, exploiting influential users or understanding the polarization of public opinion on polemic topics. In this work, we analyze the Brazilian public perception related to the murder of a Rio councilwoman, Marielle Franco, member of a left-wing party and human-rights activist. We propose a polarity score to capture whether the tweet is positive or negative and then we analyze the score evolution over the time, after the murder. Finally, we evaluate our approach correlating the polarity score with human judgment over a randomly sampled set of tweets. Our preliminary results show how to measure polarity on public opinion using a weighted dictionary and how it changes over time.</p>
      </abstract>
      <kwd-group>
        <kwd>Social media</kwd>
        <kwd>Sentiment analysis</kwd>
        <kwd>Opinion Mining</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Over the last years, an increasing number of people actively use the Internet to exchange
information and convey emotions, allowing studies that examine how technology can
influence people’s feelings. Social media platforms have become an important source
of data to capture those emotions, opinions and sentiments on several topics and debates
– from the Mediterranean refugee’s crisis
        <xref ref-type="bibr" rid="ref4">(Coletto et al., 2016)</xref>
        to political leanings
        <xref ref-type="bibr" rid="ref1 ref5">(Conover et al., 2011)</xref>
        <xref ref-type="bibr" rid="ref3">(Tumasjan et al., 2010)</xref>
        .
      </p>
      <p>
        Twitter platform is especially powerful because of its very nature, which encourages
people to have public conversations and debates, sharing their thoughts with others,
creating solidary networks or politically engaged movements. However, such platforms
also encourage public demonstrations of negative emotions, often with hate speeches,
which discriminate against people’s race, religion, ethnicity, gender, political views
        <xref ref-type="bibr" rid="ref4">(Silva et al., 2016)</xref>
        .
      </p>
      <p>In this paper, we investigate the public perception, applying a polarity score
extracted from tweets, of the recent murder of Rio councilor and activist Marielle Franco,
on March 2018, in the city of Rio de Janeiro. Marielle was a black woman, bisexual,
feminist, human rights activist and was born in the Maré favela, a low-income
community in Rio de Janeiro. She was member of the left-wing party Socialism and Liberty
party (PSOL) and an outspoken critic of the endemic police violence in Rio’s favelas.
The crime shocked not only Brazil but the whole world and remains unsolved.</p>
      <p>We propose a simple yet effective method to classify tweets mentioning Marielle’s
case, based on a weighted dictionary of words and expressions that capture the
polarization – positive or negative, to better understand the impact of events related to the
crime on public opinion. Then we analyze how polarization changed in time, after the</p>
      <p>Description
Total tweets collected
Portuguese tweets
Distinct users
# Total
murder. Finally, we evaluate the experiment on correlating a random sample of
polarized tweets with human judgment.</p>
    </sec>
    <sec id="sec-2">
      <title>Related work</title>
      <p>Over the last years, the interest in Sentiment Analysis and Opinion Mining using social
media such as Twitter has been increasing rapidly.</p>
      <p>
        Some works surveys the techniques and approaches that addresses the new
challenges raised by sentiment-aware applications, as compared with more traditional
factbased analysis
        <xref ref-type="bibr" rid="ref6">(Pang et al., 2008)</xref>
        . Combined methods mix lexicon-based and
machinelearning based, in order to classify Twitter messages
        <xref ref-type="bibr" rid="ref5">(Kolchyna et al., 2015)</xref>
        .
POSspecific prior polarity features are also exploited on sentiment analysis on Twitter data
        <xref ref-type="bibr" rid="ref1 ref5">(Agarwal et al., 2011)</xref>
        . Twitter is also used to understand the political sentiment on
public opinion, for instance, on predicting the political alignment of Twitter users based
on the political communication in the run-up to the 2010 U.S midterm elections
(Conover el at., 2010). Other works exploit popular or influential users on Twitter,
investigating the positive-negative influence measured between popular users and their
audience
        <xref ref-type="bibr" rid="ref2">(Bae et al., 2012)</xref>
        or comparing measures of influence, such as indegree,
retweets, and mentions
        <xref ref-type="bibr" rid="ref3">(Cha et al., 2010)</xref>
        .
      </p>
      <p>The contributions of this work are the following: (i) the creation of a weighted
dictionary, in Portuguese, with positive and negative terms related to the topic, that can be
profitably reused in other contexts; (ii) an analyze of the Marielle’s murder impact on
public opinion and how events changed the polarity over the period of time analyzed.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Data collection</title>
      <p>We used the Twitter Standard Search API to gather tweets mentioning Marielle. We
manually choose, as search input, some general keywords related to the topic
‘#marielle’, ‘#mariellefranco’, and also some hashtags frequently used to express support as
‘#mariellevive’ (marielle lives), ‘#naofoiassalto’ (it was not a robbery),
‘#mariellepresente’, ‘#mariellefrancopresente’, ‘#todospormarielle’ (everyone for Marielle),
‘#justicapormarielle’ (justice for Marielle), ‘#pormarielleeanderson’ (for Marielle and
Anderson, her car driver which was also murdered). We did not find explicitly negative
hashtags related to the case. From the total tweets we collected, we filtered out only
tweets written in Portuguese, most present language in the initial dataset (545,116
tweets, 73% of the total), as shown in Table 1.</p>
      <p>Tweets were collected comprising a period of 50 days, from 14th March to 9th May,
with a 6 days gap (from 21th March to 24th March and from 24th April to 25th April)
due to infrastructure problems. Fig. 1 depicts the number of tweets collected along the
days. The day with more mentions to the topic was the 15th March, the day just after
the murder, with 74,418 tweets (the crime happened in the night of the 14th March).</p>
    </sec>
    <sec id="sec-4">
      <title>Polarizing tweets with a weighted dictionary</title>
      <p>We are interested in finding whether a tweet express a positive, negative or neutral
sentiment related to Marielle’s case. In order to classify the tweets into these three
classes, we take advantage of a dictionary with negative and positive terms, related to the
topic.</p>
      <p>The tweet polarity score p captures the tweet perception related to Marielle’s case
and rely on the tweet terms that match the dictionary terms as defined as following:
p = (ft. w!) for all t ∈  if t ∈ 
(1)
where
•
•
•
•
•
t is a term found in the tweet.</p>
      <p>T is the set of terms found in the tweet.</p>
      <p>D is the dictionary with positive and negative terms t and weights w.
f! is the frequency of each term t found in the tweet.
w! denotes the weight of t. If the term express negative feelings, w! is
negative, otherwise, w! is positive</p>
      <p>When p is zero, meaning that the tweet terms do not match any dictionary terms, the
tweet is considered as neutral.</p>
      <p>Initially, we manually created an initial dictionary (or seeds) with obvious terms, in
Portuguese, representing general insults, outrages, and hate speeches. We ranked the
tweets in ascendant order of polarity score p, in order to examine the tweets with more
negative polarity. We found additional terms insulting her as bisexual woman (with
misogynistic/homophobic language); swearing her party, offending her ideals as human
rights activist and even terms expressing a revenge feeling, implying that she deserved
to die.</p>
      <p>Later, we analyzed the most positive tweets, on ranking p in descendent order. We
found very positive words supporting the councilwoman, her party, and also claiming
the investigators for justice. Table 2 shows 6 out of the 102 terms of the dictionary, its
weights and its frequency in the dataset, i.e, the number of occurrences.</p>
      <p>The term semente means seed (used to refer to Marielle’s legacy, on inspiring other
black and poor women on political career). The depreciative term abortista means
abortionist (she was a pro-choice councilwoman). We considered the terms root (or
stems), to capture all its variations, since we do not distinguish their categories – such
as noun, adjective and verb. Table 3 shows some tweets, and their polarity scores. The
symbol &amp; refers to the logical AND (both terms have to be present and vtnc is a short
for ‘vai tomar no cu’, means fuck off.</p>
      <p>Tentaram calar #MartinLutherKing e
#MarielleFranco, não sabiam que ambos são sementes.
Estamos florescendo, mestres
polarity
score p
- 5
- 4
+ 2
+ 3</p>
      <p>terms and weights
canoniz &amp; vereadora -3
prote &amp; bandid -2
defen &amp; bandid -2
vtnc -1
canalha -1
dia &amp; triste +1
arrasad +1
semente +2
tentaram &amp; calar +1</p>
      <p>It is important to notice that we found several false negatives, classified as negative
but actually positive. For instance, the tweet (‘as pernas chegam a tremer quando
escuto um pessoal falando que Marielle defendia bandido’, translated: my legs shake
when I hear people saying that Marielle protected criminals) got initially -2 as polarity
score, because it contains the negative term defend &amp; bandid. However, the user was
actually criticizing someone else’ speech, that, in turn, would be classified as negative.
These sentences often include common expressions inferring that the opinion stated is
not of that user, but from someone else (for instance, ‘um pessoal falando que’). As a
turnaround to this challenge, we applied a simple heuristic: when we found these
common sentences, we inverted the tweet final polarization (-2 turned 2 in this example, so
the negative polarity turned positive).</p>
      <p>We then computed the total polarity score for each day analyzed in the period,
summing the polarity scores of all tweets of the 50 days analyzed, after Marielle’s murder.
Figure 2 shows (i) the total positive scores on the given days (blue bars), (ii) the total
negative scores on the given day (red bars), and (iii) the final polarity scores on each
day (black line). For most of the analyzed days, the positive p scores were
overwhelmingly superior to the total negative p scores, i.e., tweets were much more positive than
negative. However, there were few days when the negative scores overpassed the
positive ones.</p>
      <p>The five days following Marielle’s murder were marked by a majority of supportive
tweets, albeit that several fake news stating that Marielle was married with a traffic
dealer were being spread from the day after the murder, which very likely increased the
negative scores on that period, as can be seen in Figure 2. We identified also several
tweets mentioning the Brazilian ex-president Lula and his arrest (that happened on 7th
April 2018). A possible reason for that is both are left-wing politicians, therefore the
associations made in those tweets attacked Marielle’s reputation by associating her with
a politician that was on the verge of being arrested. One month after the murder (on 14th
April), a spike in the total positive p score reflected tweets demanding justice and
answers from investigators (see Figure 2). Other positive peaks reflect some tweets from
celebrities and politicians, supporting Marielle and claiming for justice, that got viral.</p>
      <p>
        We evaluate our polarity score precision with a simple experiment, inspired by
        <xref ref-type="bibr" rid="ref4">(SILVA et al., 2016)</xref>
        . We randomly sampled 100 tweets from the dataset classified as
negatives, then we manually verified if the tweet was really negative. We sampled only
negative tweets because they represent a small part of the entire classified dataset. We
observed that 90% of the sampled tweets were correctly classified as negative, while
10% were false negatives.
6
      </p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and future work</title>
      <p>In this work, we presented an ongoing work on analyzing the polarity on public
opinion related to the murder of Brazilian councilwoman and activist Marielle Franco
on classifying tweets using a dictionary with positive and negative terms. As next steps,
we aim to (i) enrich the dictionary to improve the precision on polarizing the tweets,
(ii) combine our approach with machine learning approaches, and (iii) identify in the
negative polarized tweets hate speeches categories, such as race, religion and gender.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>AGARWAL</surname>
          </string-name>
          ,
          <string-name>
            <surname>Apoorv</surname>
          </string-name>
          et al.
          <article-title>Sentiment analysis of twitter data</article-title>
          .
          <source>In: Proceedings of the workshop on languages in social media. Association for Computational Linguistics</source>
          ,
          <year>2011</year>
          . p.
          <fpage>30</fpage>
          -
          <lpage>38</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>BAE</surname>
          </string-name>
          ,
          <article-title>Younggue; LEE, Hongchul. Sentiment analysis of twitter audiences: Measuring the positive or negative influence of popular twitterers</article-title>
          .
          <source>Journal of the Association for Information Science and Technology</source>
          , v.
          <volume>63</volume>
          , n.
          <volume>12</volume>
          , p.
          <fpage>2521</fpage>
          -
          <lpage>2535</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>CHA</surname>
          </string-name>
          ,
          <string-name>
            <surname>Meeyoung</surname>
          </string-name>
          et al.
          <article-title>Measuring user influence in twitter: The million follower fallacy</article-title>
          . Icwsm, v.
          <volume>10</volume>
          , n.
          <fpage>10</fpage>
          -
          <lpage>17</lpage>
          , p.
          <fpage>30</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>COLETTO</surname>
          </string-name>
          ,
          <string-name>
            <surname>Mauro</surname>
          </string-name>
          et al.
          <article-title>Sentiment-enhanced multidimensional analysis of online social networks: Perception of the Mediterranean Refugees crisis</article-title>
          .
          <source>In: Advances in Social Networks Analysis and Mining (ASONAM)</source>
          ,
          <year>2016</year>
          IEEE/ACM International Conference on. IEEE,
          <year>2016</year>
          . p.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>CONOVER</surname>
          </string-name>
          ,
          <string-name>
            <surname>Michael D</surname>
          </string-name>
          . et al.
          <article-title>Predicting the political alignment of twitter users</article-title>
          .
          <source>In: Privacy, Security, Risk and Trust (PASSAT)</source>
          and
          <source>2011 IEEE Third International Conference on Social Computing (SocialCom)</source>
          ,
          <source>2011 IEEE Third International Conference on. IEEE</source>
          ,
          <year>2011</year>
          . p.
          <fpage>192</fpage>
          -
          <lpage>199</lpage>
          KOLCHYNA, Olga et al.
          <article-title>Twitter sentiment analysis: Lexicon method, machine learning method and their combination</article-title>
          .
          <source>arXiv preprint arXiv:1507.00955</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>PANG</surname>
          </string-name>
          ,
          <string-name>
            <surname>Bo</surname>
          </string-name>
          et al.
          <article-title>Opinion mining and sentiment analysis</article-title>
          .
          <source>Foundations and Trends in Information Retrieval</source>
          , v.
          <volume>2</volume>
          , n.
          <issue>1-2</issue>
          , p.
          <fpage>1</fpage>
          -
          <lpage>135</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          2016. p.
          <fpage>687</fpage>
          -
          <lpage>690</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>