<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Analyses of Character Emotions in Dramatic Works by Using EmoLex Unigrams</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mehmet Can Yavuz</string-name>
          <email>mehmetyavuz@sabanciuniv.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Faculty of Engineering and Natural Science, Sabancı University</institution>
          ,
          <addr-line>Tuzla</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>In theatrical pieces, written language is the primary medium for establishing antagonisms. As one of the most important figures of renaissance, Shakespeare wrote characters which express themselves clearly. Thus, the emotional landscape of the plays can be revealed from the texts. It is important to analyze such landscapes for further demonstrating these structures. We use word-emotion association lexicon with eight basic emotions (anger, fear, anticipation, trust, surprise, sadness, joy, and disgust) and two sentiments (negative and positive). By using this lexicon, the emotional state of each character is represented in 10 dimensional space and mapped onto a plane. This principle axes planes position each character relatively. Additionally, tempora-emotional evaluation of each play is graphed. We conclude that the protagonist and the antagonist have different emotional states from the rest and these two emotionally oppose each other. Temporal-Emotional timeline of the plays are meaningful to have a better insight into the tragedies.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>Shakespeare’s plays are one of the most important
works of early modernity with their dramaturgy,
strong and in-depth characters and poems, that are
all still contemporary. Antagonistically most
powerful works of Shakespeare, who wrote in three
genres, are tragedies. Tragedies have strong
antagonisms and written language is the primary</p>
      <p>Copyright c 2020 for this paper by its authors. Use
permitted under Creative Commons License Attribution 4.0
International (CC BY 4.0).
medium for establishing antagonisms. Therefore,
the characters in these plays express themselves
through dialogues or monologues clearly. By
using the emotional association of each word, from
this perspective, it is possible to reveal the
emotional landscape of the plays. Emotionally
positioning the characters relative to each other is
important for further understanding of the structure
of the plays. It is also important to extract overall
emotional variations throughout the play to have
an insight about the tragedies. In this study, it
is aimed to answer these two questions by using
word-emotion association lexicon with eight
basic emotions (anger, fear, anticipation, trust,
surprise, sadness, joy, and disgust) and two
sentiments (negative and positive).</p>
      <p>
        These tasks are not only important for
artificial literature
        <xref ref-type="bibr" rid="ref14 ref35 ref38">(Lebrun, 2017; Yavuz, 2020)</xref>
        , but
also for the purpose of increasing artistic
creativity through computerized analysis. The
algorithmic study of literary works has given rise
to objective criticism in literary theory,
        <xref ref-type="bibr" rid="ref17">(Moretti,
2013)</xref>
        . Accordingly, the discovery of new or
previously theoretically laid out features of
literary texts through mathematical experiments or
statistics brought along conjunctions on literature,
        <xref ref-type="bibr" rid="ref18 ref35 ref38">(Moretti, 2000; Yavuz, 2020)</xref>
        . Art and criticism
develop in parallel today as of yesterday.
Computational linguistics enriched with fields such as
advanced chatbots, conversational AI, or text style
transfers, the fields give clues that artificial
literature will also develop rapidly in the upcoming
period. Whether it is a computer-assisted
writing process or fully automated writing machines,
these generative models need evaluation metrics.
For this purpose, objective metrics should be
developed for outstanding literary pieces such as
Shakespeare, and for what makes these plays so
great, if possible. . . Aim of this paper is in
accordance with the previous works,
        <xref ref-type="bibr" rid="ref34 ref35 ref38">(Yavuz, 2019;
Yavuz, 2020)</xref>
        , we would like to discuss objective
and quantifiable reasons behind the literariness of
a drama.
      </p>
      <p>In order to convey such analyses, each
character in any play represented in 10 dimensional
emotional space and mapped onto a plane. The
emotional timeline of the plays are also revealed. We
would like to overview the word-emotion
association lexicon and dimension reduction algorithm.
Then, the last section is left to discussions on the
emotional states of the characters and temporal
analyses of the emotions.
1.1</p>
      <sec id="sec-1-1">
        <title>Related Works</title>
        <p>
          Distant reading is a established
approach/methodology in digital humanities
(DH) and mostly deals with the quantitative
analyses of literary and cultural studies
          <xref ref-type="bibr" rid="ref2 ref3">(Clement,
2008;Crane, 2006)</xref>
          . Inside DH, ”Drametrics” is
a sub-research field, specialized on quantitative
analysis of the literary genre of drama
          <xref ref-type="bibr" rid="ref24">(Romanska,
2015)</xref>
          . Digital Shakespeare research and projects
have gotten attention since the 2000s
          <xref ref-type="bibr" rid="ref19 ref9">(Hirsch,
2014; Mueller, 2008)</xref>
          . The dramatic structures
in the form of antagonisms are revealed by topic
modeling algorithms,
          <xref ref-type="bibr" rid="ref34">(Yavuz, 2019)</xref>
          . Exceptional
characters, such as Deus-ex-Machina, is also
detected in semantic space,
          <xref ref-type="bibr" rid="ref35 ref38">(Yavuz, 2020)</xref>
          . The
graphs are also used to extract secondary
antagonisms,
          <xref ref-type="bibr" rid="ref35 ref38">(Yavuz,2020)</xref>
          . Machine learning based text
analyses are also carried out for genre
classifications
          <xref ref-type="bibr" rid="ref1 ref10 ref30 ref32 ref34 ref39">(Yavuz, 2019; Ardanuy, 2014; Hope, 2010;
Scho¨ch, 2016; Underwood, 2013; Yu, 2008)</xref>
          . In
literature, structural elements such as dramatis
persone are also analyzed and applications are
developed for further analyses
          <xref ref-type="bibr" rid="ref11 ref25 ref31 ref33 ref5">(Dennerlein, 2015;
Krautter, 2018; Schmidt, 2019, Trilcke, 2015;
Wilhelm, 2013)</xref>
          . In addition to dramatic structure
works, there is literature that apply sentiment
analyses for dramatic works,
          <xref ref-type="bibr" rid="ref11 ref20 ref26 ref26 ref26 ref27 ref27 ref27 ref28 ref28 ref28 ref29 ref29 ref29">(Nalisnick, 2013;
Schmidt, 2018; Schmidt, 2018a; Schmidt, 2018b)</xref>
          .
2
        </p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Methodology</title>
      <p>Our approach is lexicon based. Lines uttered by
each character treated as a document and
represented with a tf-idf. Emotional weights are
multiplied with the vectors and the summed up to have
the final 10 dimensional emotion space and then
reduced to a plane by linear dimension reduction.
Overall emotional state of any character, thus, is
represented in relative point to each other. Lexicon
is also used to extract temporal emotional
variations along the texts.
2.1</p>
      <sec id="sec-2-1">
        <title>EmoLex Unigrams</title>
        <p>
          Psychologists proposed many theories for
classifying human emotions,
          <xref ref-type="bibr" rid="ref4">(Dalgleish, 2000)</xref>
          . Some
emotions are considered basic, while others are
considered as complex. The distinction can be
between emotions that we can sense and
perceive (instinctual), and emotions that can arrive
after some thinking and reasoning (cognitive),
          <xref ref-type="bibr" rid="ref41">(Zajonc,1984)</xref>
          . There are also oppositions,
          <xref ref-type="bibr" rid="ref12">(Lazarus,
1984)</xref>
          . According to
          <xref ref-type="bibr" rid="ref21">Plutchik, (Plutchick, 1985</xref>
          ),
the discussion may not be resolvable because there
is no empirical basis. There is a high correlation
between basic and instinctive emotions, similarly
between complex and cognitive emotions. Many
of the basic emotions are also instinctual.
        </p>
        <p>
          There are theoretical studies on what the
basic emotions are. Ekman argues about about
the existence of 6 basic emotions: joy, sadness,
anger, fear, disgust, and surprise,
          <xref ref-type="bibr" rid="ref6">(Ekman, 1992)</xref>
          .
Plutchik includes two new emotions: trust and
anticipation, (Plutchick, 1994). Plutchik displayed
the emotions on a wheel. The distance from the
center in the circle indicates intensity. Plutchik
also state the basic emotions as opposing pairs:
joy–sadness, anger–fear, trust–disgust, and
anticipation–surprise. The opposing places and
neighborhoods on the circle are formed accordingly.
        </p>
        <p>
          Emolex is the dictionary of English words
and their associations with eight basic emotions
(anger, fear, anticipation, trust, surprise, sadness,
joy, and disgust) and two sentiments (negative and
positive),
          <xref ref-type="bibr" rid="ref16">(Mohammad, 2013)</xref>
          . Thus,
representing each word in 10 dimensional emotion space
is effective as well as theoretically relevant. The
dataset is unigram. Each single word represented
in 10 dimensional feature space: 8 basic emotions
and 2 sentiment labeling. Each emotion can be
either 0 or 1. No intensity information is given.
The words are crowd-sourced and manually
labeled with Mechanical Turk. There are 14182
unigrams in the dictionary.
Linear dimension reduction methods are for
getting a n-dimensional plane over the hyperspace.
For instance, if you have data cloud in 10
dimension, by mapping onto a plane, one can visualize
such points. SVD is one of the relevant methods,
it breaks any A matrix into three,
        </p>
        <p>A = U SV 0 which</p>
        <p>U U 0 = I and V V 0 = I
S is a diagonal matrix that consists of r singular
values. r is the rank of A. Truncated SVD is a
reduced rank approximation. Only the most relevant
dimensions are selected, these are the largest
singular values. The dimensions of truncated SVD
are [uxk] [kxk] [kxv] Therefore A matrix is
approximated by k dimensions, this is the
dimension reduction. A descriptive subset of the data is
called T, which is a dense summary of the matrix
A,
(1)
(2)
(3)</p>
        <p>T = U Sk
Sk denotes k largest singular values, which is the
number of reduced features. Each feature is
represented with a percentage of variance. Higher
variance means more information gain.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Discussion</title>
      <p>There are two analyzes we would like to discuss.
The first is about whether we can get ideas about
the plays based on the emotional state of the
characters. For this purpose, each character is treated
as a text and represented with Tf-Idf features.
The weights of each word for a specific character
multiplied with its 10-dimensional emotion
vector. Right afterwards, SVD lets you extract
principle axes and mapped onto the plane. This is
the first analysis to be discussed. Secondly, the
temporal dimensions of the plays are considered.
The opposing emotional pairs (given by Plutchik)
were represented as a time series as positive /
negative. The states are represented as a cumulative
temporal sum and the emotional landscape of the
tragedies are revealed.</p>
      <p>The weights of Tf-Idf features help to position
character emotions. Each word contributes to the
resulting emotion with their weights. Weights of
more frequent terms affect the resulting emotional
state more, while less frequent terms affect less.
The 10-dimensional emotional space mapped onto
an abstraction plane by linear dimension
reduction. The dimensions of these planes correspond
to abstract emotions or a mixture of the other 10
dimensions with certain proportions. The
important thing in these graphics is the position of the
characters relative to each other. The emotional
positioning of Hamlet in the upper left, Othello in
the upper right, Romeo and Juliet in the lower left,
and Macbeth in the lower right.</p>
      <p>In these graphics, the basic characteristics of the
plays can be observed. The main characters or
pairs of characters are emotionally different from
the rest. The protagonist and the antagonist
always have emotional contrast. For example, the
Hamlet play is basically determined by the
tension between the two people, Hamlet and King
Claudius. Although Hamlet is emotionally very
different from other characters, King Claudius is
emotionally close to the main character cluster. In
all tragedies, there is a cluster of emotionally
indifferent characters, we can call the main cluster.
Characters like Lord Polonius and Laertes are also
located around King Claudius with the main
cluster. The Ghost character, like Hamlet, is different
from all other characters and is in an opposite
position to Hamlet. These observations follow the
readings of the play. In Othello, Iago sets traps to
harm Desdemona. Desdemona is also compatible
with the main cluster. But Iago and Othello are
positioned far apart and apart from the main
cluster. In the Macbeth play, the two enemies,
Macduff and Malcolm, are opposite and separately
positioned. Lady Macbeth is emotionally compatible
with the main cluster. In an interesting
observation on Romeo and Juliet, the positioning of the
clusters is placed in symmetry in accordance with
Renaissance thought. It is known that the play
is written symmetrically. There are three family
positions in symmetry: Ruling house of Verona,
House of Capulet, House of Montague.</p>
      <p>The graphs show that the emotional positioning
of tragedies is compatible with the readings of the
play. What we mean is the protagonists and
antagonists are clearly observable. Distances or
orientations, or rather relative positions, are significant.
The main characters that experience basic tensions
could be demonstrated. In the play of Romeo and
Juliet, the affinities are observed and there is
symmetrical positioning of the families.
3.2</p>
      <sec id="sec-3-1">
        <title>Temporal-Emotional Evaluation of the</title>
      </sec>
      <sec id="sec-3-2">
        <title>Tragedies</title>
        <p>Temporal-emotional evaluation of the tragedies
are drawn. We can assume that each play is a
temporal series, and we summed up the emotional
state in each timestep, the cumulative emotional
curves are calculated. Therefore, the emotional
directions are determined. Emotions are positioned
in contrast as (Negative-Positive), (Fear-Anger),
(Anticipation-Surprise), (Sadness-Joy),
(DisgustTrust). For each timestep, or the word, the
contribution is the expected emotion,</p>
        <p>E[e] = e p(e)
(4)
which p(e) is the occurrence probability of the
emotion in the lexicon and e is the Bernoulli
random variable, either 0 or 1, either has the emotion
or not. The cumulative sum of a emotional
contrast pair,</p>
        <p>T
C(fe1; e2g; T ) = X
t=0</p>
        <p>E[e2; t]</p>
        <p>E[e1; t]
(5)
which fe1; e2g are the random variables for
emotional contrast pairs. The cumulative total for
each pair is specified for 5 curves.
Cumulative sums of (Negative-Positive), (Sadness-Joy),
(Disgust-Trust) pairs for all four plays constantly
increases. (Fear-Anger), (Anticipation-Surprise)
are more neutral. All in all emotionally, the
temporal word distributions for tragedies are similar.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>The traces of the tensions between characters are
observable from the emotional aspect. As we
show, the emotional positions of the protagonist,
the antagonist and the main cluster gives much
insight about the greatness such pieces. Any
great tragedy needs emotional contrast between
the main characters and there is always the main
cluster. The temporal-emotional characteristics of
the plays are also important and very much
similar to each other. There are constantly increasing
emotions as well as neutrals. Each play grows
towards positive, joyful and trusty emotional state.
This might be the reason behind a followable play.
Positive feelings should accumulate.</p>
      <p>Either it is computer-assisted or fully automated
writing machine, artificial literature needs
emotional aspect. The emotional aspect of literary
works should be conditional of such generative
models. The common acceptance on this early
modern author is his greatness as a tragedy writer.
The theatrical pieces by Shakespeare are in dialog
form, each character express themselves clearly.
Therefore, it is shown that any dramatic
antagonism is also emotional. Any artificial dramatic
work should have a similar emotional resonance
with such tragedies. With this analyses, we try to
further develop evaluation metrics for artificial
literature. A baseline metric to emotionally evaluate
such theatrical forms.</p>
      <p>
        On the way to Artificial Literature (ALit), there
needs more criteria and more complex tools to
analyze literariness of such pieces
        <xref ref-type="bibr" rid="ref15">(literariness,
2020)</xref>
        . As we shown so far, emotion aspect of the
plays are very crucial at establishing antagonisms.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Ardanuy</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sporleder</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2014</year>
          , April).
          <article-title>Structure-based clustering of novels</article-title>
          .
          <source>In Proceedings of the 3rd Workshop on Computational Linguistics for Literature (CLFL)</source>
          (pp.
          <fpage>31</fpage>
          -
          <lpage>39</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Clement</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Steger</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Unsworth</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Uszkalo</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>How not to read a million books</article-title>
          . Available online at http://people.brandeis.edu/ unsworth/hownot2read.html
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Crane</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>What do you do with a million books? D-Lib Magazine</article-title>
          . Available online at http://www.dlib.org/dlib/march06/crane/03crane.html
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Dalgleish</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Power</surname>
          </string-name>
          , M. (Eds.). (
          <year>2000</year>
          ).
          <article-title>Handbook of cognition and emotion</article-title>
          . John Wiley Sons.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Dennerlein</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Measuring the average population densities of plays. A case study of Andreas Gryphius, Christian Weise and Gotthold Ephraim Lessing</article-title>
          . Semicerchio. Rivista di poesia comparata LIII:
          <fpage>80</fpage>
          -
          <lpage>88</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Ekman</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>1992</year>
          ).
          <article-title>An argument for basic emotions</article-title>
          .
          <source>Cognition emotion</source>
          ,
          <volume>6</volume>
          (
          <issue>3-4</issue>
          ),
          <fpage>169</fpage>
          -
          <lpage>200</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Golub</surname>
            ,
            <given-names>G. H.</given-names>
          </string-name>
          ; Reinsch,
          <string-name>
            <surname>C.</surname>
          </string-name>
          (
          <year>1970</year>
          ).
          <article-title>”Singular value decomposition and least squares solutions”</article-title>
          .
          <source>Numerische Mathematik</source>
          .
          <volume>14</volume>
          (
          <issue>5</issue>
          ):
          <fpage>403</fpage>
          -
          <lpage>420</lpage>
          . doi:
          <volume>10</volume>
          .1007/BF02163027. MR 1553974.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Gao</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Galley</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2018</year>
          , June).
          <article-title>Neural approaches to conversational AI</article-title>
          .
          <source>In The 41st International ACM SIGIR Conference on Research Development in Information Retrieval</source>
          (pp.
          <fpage>1371</fpage>
          -
          <lpage>1374</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Hirsch</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Craig</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>”Mingled Yarn”: The State of Computing in Shakespeare 2.0</article-title>
          . In T. Bishop, &amp; A.
          <string-name>
            <surname>Huang</surname>
          </string-name>
          (Eds.),
          <source>The Shakespearean International Yearbook</source>
          (Vol.
          <volume>14</volume>
          :
          <string-name>
            <surname>Special</surname>
            <given-names>Section</given-names>
          </string-name>
          , Digital Shakespeares, pp.
          <fpage>3</fpage>
          -
          <lpage>35</lpage>
          ). United Kingdom: Ashgate Publishing Limited.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Hope</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Witmore</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>The Hundredth Psalm to the Tune of ”Green Sleeves”: Digital Approaches to Shakespeare's Language of Genre</article-title>
          .
          <source>Shakespeare Quarterly</source>
          ,
          <volume>61</volume>
          (
          <issue>3</issue>
          ),
          <fpage>357</fpage>
          -
          <lpage>390</lpage>
          . Retrieved from http://www.jstor.org/stable/40985589
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Krautter</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Quantitative microanalysis? Different methods of digital drama analysis in comparison</article-title>
          .
          <source>Book of Abstracts</source>
          ,
          <string-name>
            <surname>DH</surname>
          </string-name>
          <year>2018</year>
          .
          <article-title>Mexico-City, Mexico</article-title>
          , pp.
          <fpage>225</fpage>
          -
          <lpage>228</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Lazarus</surname>
            ,
            <given-names>R. S.</given-names>
          </string-name>
          (
          <year>1984</year>
          ).
          <article-title>On the primacy of cognition</article-title>
          .
          <source>American Psychologist</source>
          ,
          <volume>39</volume>
          (
          <issue>2</issue>
          ),
          <fpage>124</fpage>
          -
          <lpage>129</lpage>
          . https://doi.org/10.1037/
          <fpage>0003</fpage>
          -
          <lpage>066X</lpage>
          .
          <year>39</year>
          .2.
          <fpage>124</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Le</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mikolov</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2014</year>
          , January).
          <article-title>Distributed representations of sentences and documents</article-title>
          .
          <source>In International conference on machine learning</source>
          (pp.
          <fpage>1188</fpage>
          -
          <lpage>1196</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Lebrun</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2017</year>
          , May).
          <source>Who Is the Artificial Author?</source>
          .
          <source>In Canadian Conference on Artificial Intelligence</source>
          (pp.
          <fpage>411</fpage>
          -
          <lpage>415</lpage>
          ). Springer, Cham.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <source>literariness. Oxford Reference. Retrieved 8 Jun</source>
          .
          <year>2020</year>
          , from https://www.oxfordreference.com/view/10.1093/oi/ authority.20110803100108912.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Mohammad</surname>
            ,
            <given-names>S. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Turney</surname>
            ,
            <given-names>P. D.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Crowdsourcing a word-emotion association lexicon</article-title>
          .
          <source>Computational Intelligence</source>
          ,
          <volume>29</volume>
          (
          <issue>3</issue>
          ),
          <fpage>436</fpage>
          -
          <lpage>465</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Moretti</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Distant reading</article-title>
          . Verso Books.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Moretti</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <source>Conjectures on world literature. New left review</source>
          ,
          <fpage>54</fpage>
          -
          <lpage>68</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Mueller</surname>
            ,
            <given-names>Martin.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Digital Shakespeare, or towards a literary informatics</article-title>
          .
          <source>Shakespeare</source>
          .
          <volume>4</volume>
          .
          <fpage>284</fpage>
          -
          <lpage>301</lpage>
          .
          <fpage>10</fpage>
          .1080/17450910802295179.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Nalisnick</surname>
            ,
            <given-names>E. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baird</surname>
            ,
            <given-names>H. S.</given-names>
          </string-name>
          (
          <year>2013</year>
          ,
          <article-title>August)</article-title>
          .
          <article-title>Character-to-character sentiment analysis in Shakespeare's plays. In extitProceedings of the 51st Annual Meeting of the Association for Computational Linguistics</article-title>
          (Volume
          <volume>2</volume>
          :
          <string-name>
            <surname>Short</surname>
            <given-names>Papers</given-names>
          </string-name>
          ) (pp.
          <fpage>479</fpage>
          -
          <lpage>483</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Plutchik</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1985</year>
          )
          <article-title>On emotion: The chicken-andegg problem revisited</article-title>
          .
          <source>Motiv Emot</source>
          <volume>9</volume>
          ,
          <fpage>197</fpage>
          -
          <lpage>200</lpage>
          . https://doi.org/10.1007/BF00991576
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Plutchik</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>1994</year>
          )
          <article-title>The psychology and biology of emotion</article-title>
          . HarperCollins College Publishers.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Ramsay</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2011</year>
          ). Reading Machines:
          <article-title>Toward an Algorithmic Criticism</article-title>
          . University of Illinois Press.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Romanska</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Drametrics: what dramaturgs should learn from mathematicians</article-title>
          . In Romanska, M. (ed.), The Routledge Companion to Dramaturgy. Routledge, pp.
          <fpage>472</fpage>
          -
          <lpage>481</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burghardt</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dennerlein</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Wolff</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Katharsis - A Tool for Computational Drametrics</article-title>
          . In Book of Abstracts,
          <string-name>
            <surname>DH</surname>
          </string-name>
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burghardt</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2018</year>
          ,
          <article-title>August)</article-title>
          .
          <article-title>An evaluation of lexicon-based sentiment analysis techniques for the plays of gotthold ephraim lessing</article-title>
          .
          <source>In Proceedings of the Second Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage</source>
          ,
          <source>Social Sciences, Humanities and Literature</source>
          (pp.
          <fpage>139</fpage>
          -
          <lpage>149</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Burghardt</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2018b</year>
          ).
          <article-title>Toward a Tool for Sentiment Analysis for German Historic Plays</article-title>
          . In Piotrowski, M. (ed.), COMHUM 2018:
          <article-title>Book of Abstracts for the Workshop on Computational Methods in the Humanities 2018</article-title>
          .
          <article-title>Lausanne, Switzerland: Laboratoire laussannois d'informatique et statistique textuelle</article-title>
          . pp.
          <fpage>46</fpage>
          -
          <lpage>48</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burghardt</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Dennerlein</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2018a</year>
          ).
          <source>Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior</source>
          . Sandra Ku¨bler, Heike Zinsmeister (eds.),
          <source>extitProceedings of the Workshop on Annotation in Digital Humanities (annDH</source>
          <year>2018</year>
          ) Sofia, Bulgaria. pp.
          <fpage>47</fpage>
          -
          <lpage>52</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burghardt</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Dennerlein</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2018b</year>
          ).
          <article-title>Kann man denn auch nicht lachend sehr ernsthaft sein?“ - Zum Einsatz von Sentiment Analyse-Verfahren fu¨r die quantitative Untersuchung von Lessings Dramen</article-title>
          . In Book of Abstracts,
          <source>DHd</source>
          <year>2018</year>
          , Cologne, Germany.
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          <article-title>Scho¨ch,</article-title>
          <string-name>
            <surname>Christof.</surname>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Topic Modeling Genre: An Exploration of French Classical and Enlightenment Drama. Digital Humanities Quarterly</article-title>
          . http://doi.org/10.5281/zenodo.166356
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          <string-name>
            <surname>Trilcke</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fischer</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Kampkaspar</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Digital Network Analysis of Dramatic Texts</article-title>
          . Book of Abstracts,
          <string-name>
            <surname>DH</surname>
          </string-name>
          <year>2015</year>
          . Sidney, Australia
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          <string-name>
            <surname>Underwood</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Black</surname>
            ,
            <given-names>M.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auvil</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Capitanu</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Mapping mutable genres in structurally complex volumes</article-title>
          .
          <source>2013 IEEE International Conference on Big Data</source>
          ,
          <fpage>95</fpage>
          -
          <lpage>103</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          <string-name>
            <surname>Wilhelm</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burghardt</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Wolff</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2013</year>
          ). “To See or Not to See”
          <article-title>- An Interactive Tool for the Visualization and Analysis of Shakespeare Plays</article-title>
          . In R. Franken-Wendelstorf,
          <string-name>
            <given-names>E.</given-names>
            <surname>Lindinger</surname>
          </string-name>
          , and J.
          <string-name>
            <surname>Sieck</surname>
          </string-name>
          (Eds.),
          <source>Kultur und Informatik: Visual Worlds &amp; Interactive Spaces. Glu¨ckstadt: Verlag Werner Hu¨lsbusch</source>
          , pp.
          <fpage>175</fpage>
          -
          <lpage>185</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          <string-name>
            <surname>Yavuz</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          :
          <article-title>(2019, November) Analyses of Literary Texts by Using Statistical Inference Methods</article-title>
          .
          <source>In: Proceedings of the Sixth Italian Conference on Computational Linguistics</source>
          , CLiC-it'19.
          <string-name>
            <surname>Bari</surname>
          </string-name>
          , Italy., CEUR-WS.org, online http://ceur-ws.org/Vol2481/paper75.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          <string-name>
            <surname>Yavuz</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          :
          <article-title>(2020, March) Analyses of Characters in Dramatic Works by Using Document Embeddings</article-title>
          .
          <source>In: Proceedings of the Workshop on Digital Humanities and Natural Language Processing (DHandNLP</source>
          <year>2020</year>
          )
          <article-title>co-located with International Conference on</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          <string-name>
            <surname>POR</surname>
          </string-name>
          <year>2020</year>
          ), E´ vora, Portugal., CEUR-WS.org, on-
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          line http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2481</volume>
          /paper75.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          <string-name>
            <surname>Yavuz</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          (
          <year>2020</year>
          , November) ”
          <article-title>Analyses of Character Networks in Dramatic Works by Using Graphs”</article-title>
          <source>The 7th International Conference on Behavioural and Social Computing)</source>
          ,
          <source>Bournemouth UK.</source>
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>An evaluation of text classification methods for literary study</article-title>
          .
          <source>Literary and Linguistic Computing</source>
          <volume>23</volume>
          (
          <issue>3</issue>
          ):
          <fpage>327</fpage>
          -
          <lpage>343</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          <string-name>
            <surname>Xanthos</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pante</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rochat</surname>
            ,
            <given-names>Y</given-names>
          </string-name>
          and Grandjean,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Visualising the dynamics of character networks</article-title>
          .
          <source>Book of Abstracts</source>
          ,
          <string-name>
            <surname>DH</surname>
          </string-name>
          <year>2016</year>
          . Krako´w, Poland, pp.
          <fpage>417</fpage>
          -
          <lpage>419</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          <string-name>
            <surname>Zajonc</surname>
            ,
            <given-names>R. B.</given-names>
          </string-name>
          (
          <year>1984</year>
          ).
          <article-title>On the primacy of affect</article-title>
          .
          <source>American Psychologist</source>
          ,
          <volume>39</volume>
          (
          <issue>2</issue>
          ), (
          <year>1984</year>
          ).
          <fpage>117</fpage>
          -
          <lpage>123</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>