<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>What does it mean to be a Wutburger? A rst exploration.</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Computational Linguistics Andreasstrasse 15</institution>
          ,
          <addr-line>8050 Zurich</addr-line>
          ,
          <country country="CH">Switzerland</country>
        </aff>
      </contrib-group>
      <fpage>32</fpage>
      <lpage>37</lpage>
      <abstract>
        <p>In this paper, we undertake an attempt to characterize the world view of what are called Wutburger in Germany, that is citizen who are enraged by the current political and social situation. In order to nd out what makes a Wutburger a Wutburger, we analyze Facebook posts on the basis of a lexical resource where nouns, adjectives and verbs are classi ed according to Plutchik's primary emotions. We also introduce new polar roles of verbs that help to identify the writer perspective. This way, we are able to identify targets and the Wutburger's stance towards them. As textual data, we utilize about 100,000 Facebook posts of a German right-wing party whose members are obvious exemplars of the notion of a Wutburger.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>In a number of western societies populism has (re)entered the scene and
especially rampages in the social media. Hate speech, shit storms etc. are extreme
forms of such undemocratic tendencies. In Germany, the notion of a Wutburger
has been coined, that is, citizen who are disappointed by the government and the
social situation and their (verbal) behavior seem to be driven by rage (German
Wut ). A new, right-wing party evolved, the AfD (Alternative fur Deutschland).
We have access to about 100,000 Facebook posts of the AfD including reader
comments that mostly stem from AfD proponents - who clearly form a
subset of German Wutburger. Our research question was: Can we nd out, how a
Wutburger perceives the world and what, after all, is the objective of his Wut.</p>
      <p>
        A rst step towards this goal is to measure the emotional ngerprint of the
texts produced by Wutburger and compare it to the ngerprint of a related text
genre. We use the Tubinger (German newspaper) Treebank (TuBa-D/Z) [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]
as a reference corpus. In order to compare the emotional load of the AfD texts
(303,563 sentences) and the TuBa-D/Z texts (95,595 sentences), we perform a
lexicon-based analysis. That is, we count the primary emotions by the use of
words that are indicative of these emotions. This is a straightforward approach,
but it should tell us reliably what the prevalent emotions in these texts are and
whether the AfD texts are more loaded than the newspaper reference texts.
      </p>
      <p>The emotional ngerprint does not tell us anything about the world view of
a Wutburger: who are his proponents and who are his opponents? We would like
to exploit the idea that the identi cation of these targets can be supported and
accomplished by a more ne-grained classi cation of lexical items. We not only
assign primary emotions to words (verbs, nouns and adjectives), we also identify
those words that have an implicit writer perspective and explicate which one it
is. For instance, the adjective ine able in a phrase like the ine able chancellor
expresses that the writer has a negative attitude towards the referent of the noun
and a sentence like Merkel jerks the German citizen around allows to infer that
the writer believes that the referent at subject position is an immoral actor, a
cheater one might say. Also, the direct object is perceived as a victim of the
cheater. Since the writer is against the cheater, he is in favor of the victim.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Lexical Resources</title>
      <p>
        Starting with the freely available lexicons described in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]1 and [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]2 we identi ed
those verbs, nouns and adjectives that have an emotional dimension (e.g. to
love, to hate, gratitude, joy, pleasant, happy ). We then classi ed each of the 168
verbs, 225 nouns and 300 adjectives according to Plutchik's [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] eight primary
emotions which are anger, fear, sadness, disgust, surprise, anticipation, trust,
and joy. This was done by two annotators, who achieved a Kappa value of
0.73. Furthermore, we annotated those verbs, nouns and adjectives that refer to
moral, e.g. to lie, donation. See Figure 1 for an overview (pos, neg are shortcuts
for positive, negative respectively). Kappa was = 0.66.
      </p>
      <p>verb
adj
noun
pos emotion neg emotion pos moral neg moral pos factual neg factual #
49 119 15 71 553 1170 1977
118 182 286 569 1010 1103 3268
91 134 104 436 663 1229 2657</p>
      <p>The columns for factual denote words that are positive or negative without
reference to either (a particular) emotion or moral. We could say that they are
positive or negative on a factual level. For instance to sicken, recover,
congratulate are examples of such verbs, whereas mistake, disease, transparency, security,
right, wrong are examples for such nouns and adjectives. This is a crucial
distinction: such words do not indicate a writer perspective, but the contribute to
polarity decisions, nevertheless.</p>
      <p>
        We took the 254 verbs classi ed as either belonging to the emotion or moral
dimension as a basis for further annotations. We identi ed 58 verbs with a very
strong writer perspective either on the actor or the experiencer role or on both
(to cheat, to jerk sb around ). We then coined for the six verb classes derived that
way special role labels. The set of agent roles is: prole, baiter, hater, torturer,
hypocrite, choleric. Experiencer roles are su erer and victim. To give an
example: the verb are up (aufbrausen) bears the emotion anger and the semantic
1 http://bics.sentimental.li/ les/8614/2462/8150/german.lex
2 https://pub.cl.uzh.ch/projects/opinion/lrec data.txt
role of the subject is that of choleric. Our hypothesis is that these roles better
capture the writer perspective, since they express how the writer conceptualizes
these referents. Note that we assign these roles to subcategorization frames, not
to verbs. We speci ed these verbs along the line proposed by [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. That is, we
modeled the various subcategorization frames of a verb and assigned it a polar
e ect (positive or negative) and for some of the verbs also a dedicated polar role
(su erer, torturer etc.). We thus were able to nd out who the AfD believes to
be a torturer, a baiter etc. and who su ers from the situation described.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Corpus Statistics and Lexical Coverage</title>
      <p>Our present endeavor is basically one that exploits an existing, but carefully
re ned and augmented lexical resource. Especially our new verb classes with a
new kind of polar roles are meant to make the writer perspective more nuanced.
We are at the very beginning of a sophisticated study. At the moment, however,
there is no gold standard and thus no machine learning involved.</p>
      <p>We found 9,012 verb types in the Facebook posts, which gave us altogether
419,034 verb tokens in 303,563 sentences (word tokens altogether: 5,249,613).
The 1052 verb types of our lexicon found in the data (61 verbs did not occur),
amounts to 83,658 verb tokens, which is - taking into account that one sentence
might have more than one model verb - about 25% coverage (a model verb in
each 4th sentence). Our verb resource seems to have a good coverage, thus. If
we just look at moral verbs, we get 11,153 hits, 64 of the 85 moral verb types do
occur in the posts. The 168 emotional verbs occur with a frequency of 17,102.</p>
      <p>In order to quantify the emotional load of the Facebook posts, we used the
Tubinger Treebank (TuBa-D/Z) as a reference corpus. The TuBa-D/Z comprises
95,595 sentences. The coverage of our verb resource is again quite good: we found
930 verb types with 22,679 verb tokens, which is a coverage of 23.79% (again
almost each 4th sentence bears a model verb).
4</p>
    </sec>
    <sec id="sec-4">
      <title>Emotional Fingerprint</title>
      <p>We use our emotion lexicon in order to diagnose the emotional load of the AfD
posts. In Fig. 2, we compare the AfD posts and the newspaper text wrt. to
the emotions present. We determined the frequency of words belonging to a
particular emotion and normalized by the total number of emotion words (found
in the posts) (left hand side), and by the number of sentences (right hand side),
respectively.</p>
      <p>As we can see from Fig. 2, fear is the most prominent emotion of a Wutburger
and not anger (a prestage of rage) while at the same time sadness is not a
prevalent emotion of a Wutburger. All other emotions are almost identically
distributed in both, AfD posts and newspaper text. Our expectation, namely
that the AfD posts would have a higher emotional load than news texts, was not
con rmed.
We also had a look at the moral dimension. The TuBa-D/Z refers to 7490
nouns and adjectives classi ed as positive (32%) or negative (60%) from a moral
perspective, i.e. 7.8% of the sentences refer to that dimension. In the AfD texts,
32167 tokens were found, which is about 10.6% (73% negative, 27% positive).
This clearly shows that (negative) moral argumentation is a central attitude of
a Wutburger. If we have a look at verbs the picture is similar: 1.6% of the news
texts contain a moralizing verb, whereas 2.3% of the AfD posts do so.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Target Identi cation and Stance Analysis</title>
      <p>A polar role is the label for the logical subject (agent) or object (theme, patient,
experiencer) that indicates the positive or negative role its ller plays. The
inventory of polar roles is not xed, yet. We have de ned a couple of ne-grained
polar roles that are meant to indicate a more nuanced writer perspective. These
roles are baiter, hater, choleric, hypocrite, prole, torturer and su erer, victim.
The de nition of these roles is straightforward: we just had to x the
corresponding verbs and determine which semantic role bears which polar role. Take
the polar role prole. There is a number of verbs in German (we have identi ed
18) that indicate that the writer implicitly classi es the agent of such a verb
as a prole (anlabern (to chat so up), anpobeln (to accost sb)). Thus, the agents
of such verbs are negative targets from the point of view of the writer. It turns
out that in the AfD texts journalists, do-gooder, politicians, asylum seekers, the
print media are, among others, conceptualized as proles.</p>
      <p>
        In order to derive these writer perspectives, we have parsed the AfD posts
with a dependency parser [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], normalized the parse trees (e.g. passive voice) and
extracted the ller of the polar roles. This way we found e.g. that (the targets)
Merkel, the German government, the police and the press are baiter, hater and
torturers etc. The AfD, the German citizen and women were victims and su erer.
Clearly, these lists are not perfect. There are (third person) pronouns in it and
also words denoting non-actors. The goal of this explorative study was to get a
proof of concept not a full- edged evaluation. Nevertheless, we have carried out
a small evaluation in order to nd out where the noise comes from. We randomly
took 50 sentences where the German chancellor Angela Merkel was the logical
subject of a morally negative verb (e.g. cheat, threaten, diss, violate ) and 50
where the AfD was the experiencer or patient of such a verb. Only 9 out of the
100 decisions were wrong due to 4 parsing errors and 5 modal constructions that
erroneously passed our modal lter.
      </p>
      <p>An interesting nding concerns the role of the AfD (i.e. Wutburger) itself.
If we look at those who are hated, we get: Arabs, strangers, Merkel, Muslims,
comrads but also Germany and the AfD. A closer inspections reveals that the
Wutburger do not disguise or veil their rage. They use verbs with AfD (or I or
we) as agents that indicate that they are haters.</p>
      <p>Our verb resource also allows for more sophisticated inferences. We have
coined the notion of a violator of morality for the following set of actors: the set
of actors of a verb that casts a negative e ect on its object which is - according
to the polarity lexicon - positive:</p>
      <p>X:(9Verb, Y: subj(Verb,X)^e ect(Verb,obj,neg)^obj(V erb; Y )^polarity(Y; pos))</p>
      <p>An example is Merkel destroys the security of Germany where security is
positive and destroy casts a negative e ect on the direct object (obj)</p>
      <p>If we, however, change polarity(Y,pos) to polarity(Y,neg) than we get a strong
proponent of the AfD: to disapprove something negative is positive.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Related Work</title>
      <p>
        One topic of this paper is lexicon-based, document-level emotion detection. For
an overview of similar approaches see e.g. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. We have speci ed the rst German
emotion lexicon, where words are associated with primary emotions and - if
applicable - writer perspectives.
      </p>
      <p>
        The role verbs play in sentiment analysis and stance detection has received
increased attention over the last years, cf. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The main di erence
to our German verb resource is that we not only specify the polar e ects (positive
or negative) a verb casts on its semantic roles, we also strive to assign
negrained role labels such as torturer etc. Again this is meant to allow for a ner
nuanced writer perspective, which not only helps to identify targets, but also
the stance taken towards those targets. Another distinctive feature is that we
combine bottom-up and top-down information in order to derive stance (see last
section).
7
      </p>
    </sec>
    <sec id="sec-7">
      <title>Conclusions</title>
      <p>We have introduced two new resources for German: a ne-grained verb resource
with polar roles that reveal the writer perspective, and an emotion lexicon where
words are classi ed as one of eight primary emotions. Also words related to moral
are speci ed. We used this in order to nd out whether Wutburger texts do have a
clear emotional ngerprint compared to news texts. We found that fear (and not
Wut, i.e. rage) is the prevalent emotion and that Wutburger signi cantly more
often argue on the basis of moral than a reference newspaper corpus. Another
insight is that Wutburger do not hide their rage (in their own sentences they often
occupy negative polar roles such as hater). More sophisticated search pattern on
the basis of top down and bottom up restrictions give rise to interesting inferences
(someone who disapproves something positive is a violator of morality). All this
is meant as a rst explorative study: is our lexicon large enough to be useful, is
our ne-grained verb resource broadly applicable. A fuller answer to the question
raised in the title must await a thorough empirical investigation.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Haji</given-names>
            <surname>Binali</surname>
          </string-name>
          ,
          <string-name>
            <surname>Chen Wu</surname>
            , and
            <given-names>Vidyasagar</given-names>
          </string-name>
          <string-name>
            <surname>Potdar</surname>
          </string-name>
          .
          <article-title>Computational approaches for emotion detection from text</article-title>
          .
          <source>In Proceedings of IEEE Intern. Conf. on Digital Ecosystems and Technologies</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Simon</given-names>
            <surname>Clematide</surname>
          </string-name>
          and
          <string-name>
            <given-names>Manfred</given-names>
            <surname>Klenner</surname>
          </string-name>
          .
          <article-title>Evaluation and extension of a polarity lexicon for German</article-title>
          .
          <source>In Proceedings of the First Workshop on Computational Approaches to Subjectivity and Sentiment Analysis (WASSA)</source>
          , pages
          <fpage>7</fpage>
          {
          <fpage>13</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Lingjia</given-names>
            <surname>Deng</surname>
          </string-name>
          and
          <string-name>
            <given-names>Janyce</given-names>
            <surname>Wiebe</surname>
          </string-name>
          .
          <article-title>Joint prediction for entity/event-level sentiment analysis using probabilistic soft logic models</article-title>
          .
          <source>In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP</source>
          <year>2015</year>
          , Lisbon, Portugal,
          <source>September 17-21</source>
          ,
          <year>2015</year>
          , pages
          <fpage>179</fpage>
          {
          <fpage>189</fpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Manfred</given-names>
            <surname>Klenner</surname>
          </string-name>
          and
          <string-name>
            <given-names>Michael</given-names>
            <surname>Amsler</surname>
          </string-name>
          .
          <article-title>Sentiframes: A resource for verb-centered German sentiment inference</article-title>
          .
          <source>In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC</source>
          <year>2016</year>
          ), Paris, France, may
          <year>2016</year>
          .
          <article-title>European Language Resources Association (ELRA).</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Manfred</given-names>
            <surname>Klenner</surname>
          </string-name>
          , Don Tuggener, and
          <string-name>
            <given-names>Simon</given-names>
            <surname>Clematide</surname>
          </string-name>
          .
          <article-title>Stance detection in Facebook posts of a German right-wing party</article-title>
          .
          <source>In LSDSem</source>
          <year>2017</year>
          /
          <article-title>LSD-Sem Linking Models of Lexical, Sentential and Discourse-level Semantics</article-title>
          ,
          <year>April 2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Alena</given-names>
            <surname>Neviarouskaya</surname>
          </string-name>
          , Helmut Prendinger, and
          <string-name>
            <given-names>Mitsuru</given-names>
            <surname>Ishizuka</surname>
          </string-name>
          .
          <article-title>Semantically distinct verb classes involved in sentiment analysis</article-title>
          .
          <source>In IADIS AC (1)</source>
          , pages
          <fpage>27</fpage>
          {
          <fpage>35</fpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Robert</given-names>
            <surname>Plutchik</surname>
          </string-name>
          .
          <article-title>A general psychoevolutionary theory of emotion</article-title>
          . Academic press, NewYork,
          <year>1980</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Hannah</given-names>
            <surname>Rashkin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Sameer</given-names>
            <surname>Singh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and Yejin</given-names>
            <surname>Choi</surname>
          </string-name>
          .
          <article-title>Connotation frames: A datadriven investigation</article-title>
          .
          <source>In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL)</source>
          , Berlin, Germany,
          <string-name>
            <surname>Angust</surname>
          </string-name>
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Kevin</given-names>
            <surname>Reschke</surname>
          </string-name>
          and
          <string-name>
            <given-names>Pranav</given-names>
            <surname>Anand</surname>
          </string-name>
          .
          <article-title>Extracting contextual evaluativity</article-title>
          .
          <source>In Proc. of the Ninth International Conf. on Computational Semantics</source>
          , pages
          <volume>370</volume>
          {
          <fpage>374</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Rico</surname>
            <given-names>Sennrich</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Martin</given-names>
            <surname>Volk</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Gerold</given-names>
            <surname>Schneider</surname>
          </string-name>
          .
          <article-title>Exploiting synergies between open resources for German dependency parsing, POS-tagging, and morphological analysis</article-title>
          .
          <source>In Recent Advances in Natural Language Processing (RANLP</source>
          <year>2013</year>
          ), pages
          <fpage>601</fpage>
          {
          <fpage>609</fpage>
          ,
          <year>September 2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Heike</surname>
            <given-names>Telljohann</given-names>
          </string-name>
          , Erhard W. Hinrichs, Sandra Kubler, Heike Zinsmeister, and
          <string-name>
            <given-names>Kathrin</given-names>
            <surname>Beck</surname>
          </string-name>
          .
          <article-title>Stylebook for the Tubingen treebank of written German</article-title>
          .
          <source>Technical report</source>
          , Universitat Tubingen,
          <source>Seminar fur Sprachwissenschaft</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>