<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Peculiarity-based Exploration of Syntactical Patterns: a Computational Study of Stylistics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mohamed-Amine Boukhaled</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Francesca Frontini</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jean-Gabriel Ganascia</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>LIP6 (Laboratoire d'Informatique de Paris 6), Université Pierre et Marie Curie and CNRS (UMR7606), ACASA Team</institution>
          ,
          <addr-line>4, place Jussieu, 75252-PARIS Cedex 05</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
      </contrib-group>
      <fpage>31</fpage>
      <lpage>39</lpage>
      <abstract>
        <p>In this contribution, we present a computational stylistic study and comparison of classic French literary texts based on a datadriven approach where discovering interesting linguistic patterns is done without any prior knowledge. We propose an objective measure capable of capturing and extracting meaningful stylistic syntactic patterns from a given author's work. Our hypothesis is based on the fact that the most relevant syntactic patterns should significantly reflect the author's stylistic choice and thus they should exhibit some kind of peculiar overrepresentation behavior controlled by the author's purpose with respect to a linguistic norm. The analyzed results show the effectiveness in extracting interesting syntactic patterns from novels, and seem particularly promising for the analysis of such particular texts.</p>
      </abstract>
      <kwd-group>
        <kwd>Computational Stylistics</kwd>
        <kwd>Interestingness Measure</kwd>
        <kwd>Sequential Pattern Mining</kwd>
        <kwd>Syntactic Style</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Computational stylistics is a subdomain of computational linguistics located
at the intersection of several research areas such as natural language
processing, literary analysis and data mining. The goal of computational stylistics
is to extract style patterns characterizing a particular type of texts using
computational and automatic methods
        <xref ref-type="bibr" rid="ref4">(Craig 2004)</xref>
        . When investigating the
writing style of a particular author, the task will automatically explore
linguistic forms of his style, which is not only distinguishing features, but also
the deliberate overuse of certain structures by the author compared to a
linguistic norm
        <xref ref-type="bibr" rid="ref5">(Mahlberg 2012)</xref>
        . However, the notion of style in the context of
computational stylistics appears to be wide enough, and is manifested on
several linguistic levels: lexicon, syntax, semantics and pragmatics. Each level has
its own markers of styles and its own linguistic units that characterize it.
Many works have been done in the literature to analyze the stylistic traits on
these different linguistic levels
        <xref ref-type="bibr" rid="ref1 ref10 ref11 ref2 ref8">( Biber 2006, Biber &amp; Conrad 2009, Ramsay
2011, Frontini et al. 2014; see Siemens &amp; Schreibman, 2013 for a discussion
and overview )</xref>
        . In this contribution, syntactic style will be targeted.
In their study
        <xref ref-type="bibr" rid="ref7">Quiniou et al. (2012)</xref>
        have shown the interest of using
sequential data mining methods for the stylistic analysis of large texts. They have
shown that relevant and understandable patterns that are characteristic of a
specific type of text can be extracted using sequential data mining techniques
such as sequential pattern mining.
      </p>
      <p>However, the process of extracting textual patterns is known by its property
of producing a large amount of patterns, even from a relatively small sample
of text. Thus, a measure of interest is to be applied to identify the most
important and relevant patterns for the characterization of the text’s style in
question.</p>
      <p>In this paper, we present a computational stylistic study of classic texts of
French literature based on a data-driven approach where the discovery of
interesting linguistic forms is done without any prior knowledge. Specifically,
the proposed method is based on the assessment of the peculiar
overrepresentation of syntactic patterns extracted using sequential data mining
technique from texts with respect to a norm corpus. This method is intended
to quantitatively support a textual analysis by focusing on the verification of
the degree of importance of each syntactic pattern (syntagmatic segments
with potential gaps), and by extracting the syntactic patterns that
characterize the syntactical style of a work by a particular author.
2</p>
      <p>Approach for extracting relevant syntactic patterns
Our method consists of two steps. First, a sequential pattern mining
algorithm is applied to the texts in order to extract recurrent syntactic patterns.
Second, a peculiarity-based interestingness measure that evaluates of the
overrepresentation (in terms of frequency of occurrence with respect to a norm
corpus) is applied to the set of extracted syntactic patterns. Thus, each
syntactic pattern will be assigned an interestingness value indicating its
importance and its relevance for the characterization of text’s syntactic style. In
what follows, we present in section 2.1 the corpus used in our experience, and
its dividing protocol into two parts: text to analyze and text used as norm.
Then, section 2.2 introduces some elements necessary to understand the
process of extracting sequential syntactic patterns. Finally, the formulation and
the statistical details of the proposed interestingness measure are presented in
Section 2.3.</p>
    </sec>
    <sec id="sec-2">
      <title>Analyzed Corpus</title>
      <p>In our study, we used four novels, belonging to the same genre and the same
literary time span, written by four famous classic French authors: Balzac’s
“Eugenie Grandet”, Flaubert's “Madame Bovary”, Hugo’s “Notre Dame de
Paris” and Zola’s “Le ventre de Paris”. This choice is motivated by our
particular interest in studying the style of the classical French literature of the 19th
century. At the time of the analysis of the syntactic patterns, each text
written by one of the four authors is contrasted with texts written by the three
other authors. That is to say that these three texts will be considered as norm
corpus from which we will evaluate the hypothesis of the overrepresentation of
syntactic patterns in the fourth remaining text, as explained later in this
section.
2.2</p>
    </sec>
    <sec id="sec-3">
      <title>Extraction of syntactic patterns</title>
      <p>
        In our study we consider a syntagmatic approach. The text is first segmented
into a set of sentences, each sentence is then represented by a sequence of
syntactic labels (POS-tag)1 corresponding to the words of the sentence using
Treetagger
        <xref ref-type="bibr" rid="ref9">(Schmid 1994)</xref>
        . This produces at the end a set of syntactic
sequences for each text. For exemple, the sentence “Le silence profond régnait
nuit et jour dans la maison.” Will be represented by the sequence:
&lt; "#$ , '() , *"+ , ,#- , '() , .(' , '() , /-/ , "#$ 0,#''($)&gt;,
Then, sequential patterns of a certain length with their supports (a number
indicating how many sentences contain the pattern) are extracted from this
syntactic sequential database using a sequential pattern extraction algorithm
        <xref ref-type="bibr" rid="ref11">(Viger et al. 2014)</xref>
        . Syntactic pattern consists of a sequential syntagmatic
segment (with possible gaps) present in the syntactic sequences. It can be
considered as a kind of generalization of the notion of n-gram widely used in
the field of automatic language processing. Examples of syntactic patterns
present in the sequence of the example above:
• &lt; "#$ &gt;&lt; '() &gt;&lt; *"+ &gt;
• &lt; '() &gt;&lt; *"+ &gt;&lt; ,#- &gt;&lt; '() &gt;
• &lt; .(' &gt;&lt; '() &gt; &lt;∗ 2 &gt; &lt; "#$ &gt;&lt; '() &gt;
      </p>
      <p>To avoid the effect of statistical fluctuations on the analysis of patterns
with low supports, we considered a support’s threshold of 1%. That is to say
that we focus only on patterns that are present in at least 1% of the sentences
of the analyzed text. However, as sequential pattern mining is known to
produce a large quantity of patterns even from relatively small samples of texts,
1 Frech treetagger tagset:</p>
      <p>http://www.cis.unimuenchen.de/~schmid/tools/TreeTagger/data/french-tagset.html
2 &lt;*&gt; denotes a gap that can be filled with any POS tag
an interestingness measure should be applied on these patterns in order to
identify the most important ones. This interestingness measure is explained in
the next section.
2.3</p>
      <p>Evaluation of the relevance of syntactic patterns
Our hypothesis to evaluate the relevance of a syntactic pattern is based on the
fact that the most relevant ones should significantly reflect the stylistic choice
of the author and should thus be characterized by a significant peculiar
quantitative behavior, this peculiar behavior translate into a support’s
overrepresentation in his texts.</p>
      <p>However, to capture this overrepresentation one cannot refer only to the
absolute frequency of occurrence (support) Indeed, more frequent use of a
syntactic pattern by an author (which translates into a relatively high support) does
not necessarily indicate a stylistic choice since it can be very well a property
imposed by the grammar of the language or by syntactic features that are
characteristic of text’s genre.</p>
      <p>Thus, to assess the over-representation of a pattern, we use an empirical
approach based on the comparison of the support of a syntactic pattern in a text
to that found in a norm corpus. A ratio 4 between these two quantities is
calculated as follow:
4 =
frequency of a pattern in the norm corpus</p>
      <p>
        frequency pattern in the text
In our experiments we found empirically that the distribution of the ratio 4
exhibits a Gaussian behavior. Indeed, the values of the 4 ratio are normally
distributed around a central value (see Fig. 1). This is due to the fact that the
frequency of occurrence of a syntactic pattern in a text is highly correlated
with the frequency of occurrence in the norm corpus with a few exceptional
special cases or outliers (see Fig. 2). These outliers represent the patterns of
special interest for our study because they represent a certain linguistic
deviation that is specific to the author's style compared to what one would expect
to see in the norm corpus.
The configuration described above allows us to use an outlier detection
method based on Gaussian distribution and '-score to identify such special
patterns
        <xref ref-type="bibr" rid="ref3">(Chandola et al. 2009)</xref>
        . The over-representation of a pattern in this case
will result in a greater negative aberrant behavior compared to other patterns.
The most over-represented patterns will be those associated with lowest values
of standard z-score '. The z-score values are calculated as follows:
4( ) 4*
'( = 0
Where 4( and '( are respectively the ratio 4 and the z-score corresponding to
the +-th syntactic pattern. 4, and 0 are respectively the mean and standard
deviation of the ratio 4 .
3
      </p>
      <p>Results and Discussion</p>
      <p>
        In this section, we present some examples of relevant syntactic patterns
extracted from our corpus. Using the proposed method, the extracted patterns
seem to have a strong relevance to characterize the style of the authors of our
corpus but also to the novels’ content and the literary genre in which it
operates. In the Flaubert's Madame Bovary, several extracted patterns well
represent the rhythmic rather than functional role of punctuation that is peculiar
to the style of Flaubert
        <xref ref-type="bibr" rid="ref6">(Mangiapane 2012)</xref>
        . For example pattern (1) captures
instances of a comma preceding the conjunction, followed by a parenthetical
clause.
      </p>
      <p>Pattern (1) &lt;PUN&gt; &lt; KON&gt;&lt; PUN&gt; &lt;PRP&gt;, with support= 113,
sample instances of the pattern in the text:
• , et , à
• , mais , avant
• ; et , à
In le Ventre de Paris of Zola, and in the same direction, the syntactic
patterns extracted as relevant clearly represent the use of nested clauses to
describe situations or attitudes in the novel such as in the pattern (2), or to
describe public places and objects in displays in long lists as in the pattern
(3):</p>
      <p>Pattern (2) : &lt;PUN&gt; &lt;PRP&gt; &lt;PRP&gt; &lt;NOM&gt;, support= 104, sample
instances of the pattern in the text (bold text):
« Florent se heurtait à mille obstacles , à des porteurs qui se chargeaient , à
des marchandes qui discutaient de leurs voix rudes ; il glissait sur le lit épais d'
épluchures et de trognons qui couvrait la chaussée , il étouffait dans l' odeur puissante
des feuilles écrasées .»</p>
      <p>Pattern (3): &lt;NOM&gt; &lt;PUN&gt; &lt;PRP&gt; &lt;NOM&gt; &lt;ADJ&gt;, support= 68,
sample instances of the pattern in the text (bold text):
• angles , à fenêtres étroites
• très-jolies , des légendes miraculeuses
• écrevisses , des nappes mouvantes</p>
      <p>In Eugénie Grandet of Balzac, other different communicative functions are
performed by the syntactic patterns and their textual instances, for example:</p>
      <p>Pattern (4): &lt;PUN&gt; &lt;VER&gt; &lt;NAM&gt; &lt;PRP&gt;, support= 49, which is
used as post-introducer of direct speech. This rather formulaic way of
specifying (in a parenthetical form) the utterer of a reported speech is common to
all, but seems to be strongly preferred by Balzac, while the other authors have
shown a more varied style in introducing dialogues. Sample instances of the
pattern in the novel:
• , dit Grandet en
• , reprit Charles en
• , dit Cruchot en</p>
      <p>Pattern (5): &lt;NUM&gt; &lt;NUM&gt; &lt;NOM&gt;, support= 54, is a pattern used to
refer to money, which is typical for the novel scenario where money plays a
very important role. Sample instances of the pattern in the novel:
• vingt mille francs
• deux mille louis
• sept mille livres</p>
      <p>Pattern (6) : &lt;ADV&gt; &lt;VER&gt; &lt;PRO&gt; &lt;ADV&gt;, support= 59, is used to
express negative questions :
• n' avait -il pas
• ne disait -on pas
• ne serait -il pas</p>
      <p>Pattern (7) : &lt;PUN&gt; &lt;NOM&gt; &lt;PUN&gt; &lt;VER&gt;, support= 44,
represent the punctuation extensively used to mimic spoken intonation and even to
reproduce performance phenomena such as stutter. :
• , messieurs , cria
• , madame , répondit
• , mademoiselle , disait</p>
      <p>The few analyzed examples indicate that the presented technique is
effective in extracting interesting syntactic patterns from a single text, and this
seems particularly promising for the analyses of such classic literary texts.
On the other hand, this technique, as well as other similar ones, prompts the
question of what is really captured by significant patterns. Some structures
may be significant because they are typical of an author’s style, its fingerprint
- as we may say borrowing a metaphor often used in attribution studies, or
they may be dictated by functional needs, due to the particular topic of the
novel, or to the conventions of the chosen genre. This is particularly true for
syntactic analysis, where the functional constraints on the authorial freedom
are more evident. Much further works have to be carried out concerning this
issue.
4</p>
      <p>conclusion
In this paper, we have presented an objective interestingness measure to
extract meaningful stylistic syntactic patterns from a given author’s work. Our
hypothesis is based on the fact that the most relevant syntactic patterns
should significantly reflect the author’s stylistic choice and thus they should
exhibit some kind of peculiar overrepresentation behavior controlled by the
author’s purpose. To evaluate the effectiveness of the proposed method, we
conducted an experiment on a classic French Corpus. The analyzed results
show the effectiveness in extracting interesting syntactic patterns from this
type of text.</p>
      <p>Based on the current study, we have identified several future research
directions such as exploring other statistical measures to assess the interestingness
of a given syntactic pattern, and expanding the analysis to include
morphosyntactic patterns (form and lemma words). Finally, we intend to experiment
with other languages and text sizes using standard corpora employed in the
field of computational stylistics at large.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Biber</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <year>2006</year>
          . University language:
          <article-title>A corpus-based study of spoken and written registers</article-title>
          , John Benjamins Publishing.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Biber</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Conrad</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <year>2009</year>
          . Register, genre, and style, Cambridge University Press.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Chandola</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Banerjee</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Kumar</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <year>2009</year>
          .
          <article-title>Anomaly detection: A survey</article-title>
          .
          <source>ACM Computing Surveys (CSUR)</source>
          ,
          <volume>41</volume>
          (
          <issue>3</issue>
          ), p.
          <fpage>15</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Craig</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <year>2004</year>
          .
          <article-title>Stylistic analysis and authorship studies. A companion to digital humanities, 3</article-title>
          , pp.
          <fpage>233</fpage>
          -
          <lpage>334</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Mahlberg</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <year>2012</year>
          .
          <article-title>Corpus stylistics and Dickens's fiction</article-title>
          , Routledge.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Mangiapane</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <year>2012</year>
          .
          <article-title>Ponctuation et mise en page dans Madame Bovary: les interventions de Flaubert sur le manuscrit du copiste</article-title>
          .
          <source>Flaubert. Revue critique et génétique</source>
          , (
          <volume>8</volume>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Quiniou</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          et al.,
          <year>2012</year>
          .
          <article-title>What about sequential data mining techniques to identify linguistic patterns for stylistics?</article-title>
          <source>In Computational Linguistics and Intelligent Text Processing</source>
          . Springer, pp.
          <fpage>166</fpage>
          -
          <lpage>177</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Ramsay</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <year>2011</year>
          . Reading machines:
          <article-title>Toward an algorithmic criticism</article-title>
          , University of Illinois Press.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Schmid</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <year>1994</year>
          .
          <article-title>Probabilistic part-of-speech tagging using decision trees</article-title>
          .
          <source>In Proceedings of the international conference on new methods in language processing</source>
          . pp.
          <fpage>44</fpage>
          -
          <lpage>49</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Siemens</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Schreibman</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <year>2013</year>
          .
          <article-title>A companion to digital literary studies</article-title>
          , John Wiley &amp; Sons.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Viger</surname>
            ,
            <given-names>P.F.</given-names>
          </string-name>
          et al.,
          <year>2014</year>
          .
          <article-title>SPMF: A Java Open-Source Pattern Mining Library</article-title>
          .
          <source>Journal of Machine Learning Research</source>
          ,
          <volume>15</volume>
          , pp.
          <fpage>3389</fpage>
          -
          <lpage>3393</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>