<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Dealing with Italian Adjectives in Noun Phrase: a study oriented to Natural Language Generation</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Alessandro Mazzei Dipartimento di Informatica Universita` di Torino</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Universita` di Torino Universita` di Torino</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p />
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>English. This paper describes a
theoretical and empirical investigation about the
position of adjectives in the Italian
language. The long term goal which oriented
the study is the formalization of this
information into a natural language generation
system. Providing that adjectives mainly
occur within noun phrases, we focused on
them and we collected data from corpora
representing very different text genres, i.e.
social media and standard ones, in order
to compare the theoretical predictions with
the real use of the adjective in Italian. The
results obtained by confirm the previsions
of the modern linguistic theories but also
show the different behaviour of adjectives
in the distinct analysed genres.</p>
      <p>Italiano. Questo lavoro presenta
un’analisi teorica ed empirica sulla
posizione degli aggettivi nella lingua
Italiana. L’orientamento del lavoro e` dato
dalla necessita` di formalizzare questa
informazione nell’ambito di un sistema di
generazione automatica della linguaggio.
Poiche´ gli aggettivi si presentano
principalmente nei sintagmi nominali, ci si e`
concentrati su questi, raccogliendo dati
da corpora che rappresentano generi di
testo diversi, ovvero social media e
standard, al fine di confrontare le previsioni
teoriche con l’uso reale dell’aggettivo in
Italiano. I risultati ottenuti confermano
le previsioni delle moderne teorie
linguistiche ma mostrano anche il diverso
comportamento degli aggettivi nei diversi
generi analizzati.</p>
      <p>
        Corpus linguistics is a methodological approach
based on the extraction from a set of texts of data
useful for the study of language. Even if in
principle any collection of texts can be called corpus,
the term assumes a more precise connotation in
the context of modern linguistics, where a corpus
is featured by sampling, representativeness, finite
size, machine-readable form and a standard
reference
        <xref ref-type="bibr" rid="ref10 ref13">(McEnery and Wilson, 2001)</xref>
        .
      </p>
      <p>In this work we have applied a corpus-based
approach and we considered two different corpora
which represent two different text genres: one
concerning social media language (PoSTWITA
corpus) and one concerning balanced standard
Italian (UD-it corpus). Indeed, while social
media texts have recently gained great attention from
the NLP community since they have many
peculiar properties, standard texts can give a more
accurate view on the status of some linguistic notions
in “traditional” written text.</p>
      <p>
        These above mentioned corpora allowed us an
in depth investigation about the position of the
adjective in the nominal phrase. Indeed, even if this
grammatical category is described in several
traditional Italian grammars
        <xref ref-type="bibr" rid="ref11 ref13 ref14">(Renzi et al., 2001;
Serianni, 2006; Patota, 2006)</xref>
        , its theoretical status is
not currently enough formalized to be used within
the computational context. A more useful
perspective on the behaviour of the adjective is proposed
in a recent theoretical study which is focussed on
the position of the adjective in Romance languages
        <xref ref-type="bibr" rid="ref7">(Giusti, 2016)</xref>
        .
      </p>
      <p>
        This work aims at achieving two major goals.
The first is to empirically confirm with the
analysis of corpora the theoretical predictions given
in
        <xref ref-type="bibr" rid="ref7">(Giusti, 2016)</xref>
        . The second goal is instead to
provide a representation and classification of
Italian adjective category that can be spent within the
SimpleNLG-IT
        <xref ref-type="bibr" rid="ref8 ref9">(Mazzei et al., 2016)</xref>
        , a surface
realizer for Italian language.
      </p>
      <p>The paper is organized as follows: in Section 2
we review the linguistic literature concerning the
position of the adjective within the Italian noun
phrase. In Section 3, we explain the details of
our corpus linguistic investigation. In Section 4,
we describe the use of the empirical data in the
SimpleNLG-IT realizer. Finally, the Section 5
closes the paper with conclusions and some
pointers to future work.
2</p>
    </sec>
    <sec id="sec-2">
      <title>The Theoretical Status of the Adjective in the Nominal Phrase</title>
      <p>
        We take into account the adjective in its primary
use
        <xref ref-type="bibr" rid="ref2">(Bhat, 1994)</xref>
        , that is as modifier of a noun.
In Italian, within the nominal phrase, the
adjective can be positioned before or after the noun to
which it refers. In accordance with the traditional
grammar, e.g.
        <xref ref-type="bibr" rid="ref14">(Serianni, 2006)</xref>
        , these alternative
positions are described as unmarked, when the
adjective follows the noun, and marked, when it
precedes the noun.
      </p>
      <p>
        These different behaviour of the adjective also
carry different semantic values: nominal phrases
where the adjective precedes the noun indicate
more subjectivity or more stylistic refinement if
compared to the more neutral and objective
expressions where the adjective follows the noun,
as in the following examples (extracted from
        <xref ref-type="bibr" rid="ref14">(Serianni, 2006)</xref>
        ): gli occhi neri (the eyes black)
and gli alberi alti (the trees high) vs. i neri
occhi (the black eyes) and gli alti alberi (the high
trees)1. In the left side of the versus, the adjectives
neri (black) and alti (high) objectively qualify the
nouns that they follow, and the information they
carry is indeed verifiable by a true/false criterion;
in the other side instead the same adjectives
qualify the nouns but they also emphasize a desire for
stylistic elaboration by those who write or speak
        <xref ref-type="bibr" rid="ref14">(Serianni, 2006)</xref>
        .
      </p>
      <p>
        Moreover, a descriptive function is usually
attributed in literature to pre-nominal adjectives,
while a restrictive function is attributed to
postnominal ones, e.g. in
        <xref ref-type="bibr" rid="ref14">(Serianni, 2006)</xref>
        . This can
be clearly exemplified by the difference between
the following sentences: le vecchie tubature hanno
ceduto (the old pipes has collapsed) and le
tubature vecchie hanno ceduto (the pipes old has
collapsed). In the first sentence, the pre-nominal
ad1The English glosses for the examples are literal and can
not correspond to the correct English expressions.
jective vecchie (old) has a descriptive function: it
describes a quality of the related noun, i.e.
tubature (pipes). Instead in the second sentence, the
same adjective, in post-nominal position, has
restrictive function with respect to the meaning of
the related noun: it adds to the noun a
distinctive qualification which identifies it as the only
one with a certain quality (the old pipes, not the
new ones)
        <xref ref-type="bibr" rid="ref14">(Serianni, 2006)</xref>
        . However the value of
the adjective in the post-nominal position, being
unmarked, may be ambiguous between these two
functions, whereas an adjective in pre-nominal
position can only have appositive (that is descriptive)
function
        <xref ref-type="bibr" rid="ref6">(Giusti, 2010)</xref>
        .
2.1
      </p>
      <sec id="sec-2-1">
        <title>A hierarchy of the Descriptive Adjectives</title>
        <p>
          In
          <xref ref-type="bibr" rid="ref6">(Giusti, 2010)</xref>
          a further distinction among the
descriptive adjectives in sub-categories is
provided. It is based on a cross-linguistically
defined hierarchy where the rank that the adjective
assumes is strictly related to the position that it can
assume with respect to the noun. The categories
are the following:
evaluative, e.g. bello (beautiful)
dimension, e.g. alto (high)
age, e.g. vecchio (old)
physical property, e.g. duro (hard)
colour, e.g. rosso (red)
relational, e.g. nazionale (national)
        </p>
        <p>
          The adjectives collocated in the lower part of the
hierarchy are more prone to assume post-nominal
positions, where those in the higher part more
frequently assume the pre-nominal ones. For
instance, the relational adjectives, that are at the
lower level of the hierarchy, are predominantly
post-nominal. The others can be freely positioned
before or after the noun, but those occupying lower
positions within the hierarchy have a stronger
tendency for post-nominal positions, while those in
higher part of the hierarchy are more freely placed
before or after noun
          <xref ref-type="bibr" rid="ref7">(Giusti, 2016)</xref>
          . For more
details about the classification of the adjectives and
how we applied it to those we extracted from
corpora, see the following section.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Extracting Adjectives from Corpora</title>
      <p>In order to validate the assumptions made in
literature, and described in section 2 about the
behaviour of the adjective, we selected corpora
where Italian is annotated for what concerns
morphology and syntax and representing also
different text genres. We applied scripts in Python and
SQL queries for detecting the presence of
adjectives and noun phrases in both the reference
corpora, but their classification is manually done, for
carefully dealing with cases where ambiguity
occurs.</p>
      <p>We found a substantial help for finding a
decisionmaking criterion for the classification of adjectives
in the examples proposed in the Treccani online
vocabulary. For instance, we tagged as evaluative
the adjective pericoloso (dangerous), which is
derived from the noun pericolo (danger), according
to the vocabulary example un viaggio pericoloso
(a dangerous journey). We tagged instead as
relational the adjective solare (solar), like in the
example luce solare (solar light), considering that the
adjective is derived from the noun sole (sun),
indicating an entity rather than a quality.</p>
      <p>A particular attention must be paid to
homonymous adjectives, like e.g. reale that may mean
’royal’ or ’real’. In this case, two different entries
in the vocabulary must be introduced, one for each
meaning of the adjective: the first tagged as
relational, for the meaning derived from the noun re
(king), and the second tagged as evaluative, for
indicating the meaning ’actually existing’.</p>
      <p>In the rest of this section the resources we used
in our investigation are described also showing the
differences that make them especially interesting
for validating our results in two different contexts
and text domains.</p>
      <p>
        The data sets we used are respectively extracted
from two different corpora: PoSTWITA
        <xref ref-type="bibr" rid="ref3 ref8">(Bosco
et al., 2016)</xref>
        and UD-it2, both tagged in
accordance with the Universal Dependencies annotation
scheme 3. While the PoSTWITA corpus is only
morphologically tagged and it is taken from the
social network Twitter, the other resource is a
treebank which includes other variety of more
standard texts.
3.1
      </p>
      <sec id="sec-3-1">
        <title>PoSTWITA</title>
        <p>PoSTWITA characterised by short texts (140
characters maximum) and a typical social media
Italian jargon that is featured by a frequent use
of creative expressions and incorrect words like in
the following example:
ho un disparato bisogno di soffocati di coccole.
&lt;3 ti amo piccola mia. ([I] have a desperate need
2http://universaldependencies.org/it/
overview/introduction.html
3www.universaldependencies.org
to suffocate you with pampering. &lt;3 [I] love you
my baby.)
where two incorrect words occur: disparato
instead of disperato and soffocati instead of
soffocarti.</p>
        <p>
          Also distinctive graphic practices due to the
particular medium are symbols are very frequent
in Twitter posts, like e.g. acronyms and
abbreviations and elements without a clearly
defined syntactic function like hashtags, mentions
and emoticons
          <xref ref-type="bibr" rid="ref5">(Chiusaroli, 2016)</xref>
          , whose
presence is mainly motivated by communicative
goals of the authors, like the following example
shows: “@pari biosteria Alessandro #Bergonzoni
Contro lo #stigma nei confronti della malattia
mentale #passaparola http://t.co/daHsNTcBmh”
(@pari biosteria Alessandro #Bergonzoni Against
the #stigma towards the disease mental
#passaparola http://t.co/daHsNTcBmh)
where some hashtag is exploited as common noun
(#stigma), other as proper noun (#Bergonzoni)
or with a proper communicative function
#passaparola).
        </p>
        <p>Each word of PoSTWITA is associated with a tag
showing its grammatical category selected within
the inventory of tags proposed for the part of
speech tagging within the Universal Dependency
project; only a few tags extends this inventory for
better describe typical social media elements, like
EMO for emoticons or URL for web addresses.
Within our corpora we focused only on the words
tagged as ADJ (adjectives), NOUN (common
nouns) and PROPN (proper nouns), that is those
involved in the noun phrase structures.
Nevertheless, it must be observed that since PoSTWITA
corpus is only tagged morphologically, a proper
notion of noun phrase is not marked in it. In
order to detect adjectives that are syntactically linked
to nouns within noun phrases, we considered the
adjectives that were immediately before or after
nouns or proper nouns. According to this strategy,
the number of adjectives occurring in prenominal
position is 1,519, while the number of those in
postnominal position is 1,740.
3.2</p>
        <p>
          UD-it
UD-it corpus is tagged both morphologically and
syntactically. It is derived from the conversion
of different resources developed by Turin and
Pisa University’s Computer Science Departments
and Pisa CNR’s Computational Linguistics
Institute. This corpus is composed by legal texts
(Italian Constitution and part of the Civil Code),
Wikipedia and newspaper articles. We can
therefore say that, unlike PoSTWITA corpus, UD-it
corpus is representative of the so-called Standard
Italian, that is encoded, over regional, elaborate,
belonging to the upper classes, invariant and
written
          <xref ref-type="bibr" rid="ref1">(Berruto, 2010)</xref>
          , like the following example
shows: “La prima attivita` ha lo scopo di creare
e sviluppare una rete di ricognizione globale con
l’intento di monitorare il rispetto dei trattati
internazionali contro la proliferazione di armi di
distruzione di massa e la definizione dei confini
territoriali.” (The first activity has the objective of
creating and developing a network of global
reconnoiting with the goal of monitoring the respect of
international treatises against the diffusion of the
weapons of mass destruction and the definition of
territorial borders.)
Providing that UD-it corpus is fully annotated
according to the dependency grammar framework
of the Universal Dependencies, a notion of noun
phrase can be derived from its structures, even if it
is not properly annotated, as usual in dependency
formats. We considered in this corpus all the
adjectives that are related with a noun or a proper
noun with the dependency relation amod, that is
the dependency featuring the adjectival modifiers.
Taking into account this relation, we collected
4,469 adjectives occurring in pre-nominal position
and 9,362 in the post-nominal one.
        </p>
        <p>It must be observed that the availability of the
syntactic annotation of the UD-it corpus has allowed
more reliable results with respect to that obtained
from PoSTWITA. Indeed we can not be sure that
an adjective is related to a specific noun just
because it is near that noun, providing that an
adjective can refer to a noun even if distant from it, as
the following example shows, where an adverbial
modifier is collocated between the noun and the
adjective that modifies it:
adottare principi il piu` possibile semplici
VERB NOUN DET ADV ADJ ADJ
(adopting principles the most possible simple)
amod
3.3</p>
      </sec>
      <sec id="sec-3-2">
        <title>Discussion of Results</title>
        <p>The pie charts (Fig. 1) show the data extraction
results. The largest percentage of the post-nominal
adjectives provides some hints about the
markedness of the pre-nominal position for both
PoSTWITA and UD-it.</p>
        <p>For what concerns the distribution in pre- and
post-nominal position of the categories of
adjectives described in sec. 2.1, it is represented in the
histograms as detected in Figure 3 (PoSTWITA)
and Figure 2 (UD-it). We collected these data by
applying to our datasets scripts in Python and SQL
queries running on a database version of the
resources.</p>
        <p>The diagrams show how the adjectives in the
lower portion of the hierarchy (relational, colour
and physical property) are predominantly in
post-nominal position within the noun phrase,
whereas the adjectives in the higher portion of the
hierarchy (age and dimension) are in majority in
the pre-nominal one. Evaluative adjectives are the
most equally distributed. These results confirm
the theoretical tenets presented in the previous
part of the paper and collocate the behaviour of
the adjective within a context that can be used
for modelling in a computational perspective this
grammatical category.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Ordering adjectives in SimpleNLG-IT</title>
      <p>
        The formalization of linguistic properties is a
fundamental process both for NL processing as well
as for NL generation systems. In particular, a
widespread architecture for NLG assumes a
specific module for the linguistic realization, that is
essentially an algorithmic implementation of a
formal grammar
        <xref ref-type="bibr" rid="ref12">(Reiter and Dale, 2000)</xref>
        . Recently,
as can be read in
        <xref ref-type="bibr" rid="ref8 ref9">(Mazzei et al., 2016)</xref>
        , a common
set of API for the linguistic realization has been
adapted also for Italian language. A key
component of SimpleNLG-IT is the reference lexicon,
i.e. the computational dictionary specifying the
computational properties of the words that the
realizer can generate
        <xref ref-type="bibr" rid="ref8 ref9">(Mazzei et al., 2016)</xref>
        . The
default position for adjective which is assumed in
SimpleNLG-IT is the post-nominal one, with the
only exception of ordinals adjectives.
      </p>
      <p>
        Nevertheless, providing that a more correct
modelling of the behaviour of words has a
positive impact on the human-machine interaction,
in SimpleNLG-IT we devised a new version of
the lexicon by following the procedure described
in
        <xref ref-type="bibr" rid="ref8 ref9">(Mazzei, 2016)</xref>
        . We started from the newly
released Vocabolario di base della lingua
italiana4 (NVdB)
        <xref ref-type="bibr" rid="ref4">(Chiari and De Mauro, 2014)</xref>
        which
represent the basic lexicon typical of a
standard Italian speaker. Moreover, according to
        <xref ref-type="bibr" rid="ref7">(Giusti, 2016)</xref>
        , we classified the adjectives as:
relational, colour, physical property, age, dimension,
evalutativepre and evalutativepost. Indeed,
following the data reported in the Figure 2, we
formalized that adjective belonging to the relation,
colour, physical property sets are generated in
prenominal position. In contrast, adjectives
belonging to age and dimension classes are generated in
post-nominal position. Since evaluative adjectives
do not show a clear default position, we further
split the set in two different subsets that are
generated in pre-/pos-tnominal position respectively.
Note that not all the adjectives used for UD-it
analysis belong to NVdB, e.g. maggiore (greater) or
agrario (agrarian). Table 1 reports the occurrences
of the adjectives in NVdB/UD-it respectively.
      </p>
      <p>All the resource developed are made available
on a free access repository5.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and future work</title>
      <p>The paper presents a study about the behaviour
of the adjective within the noun phrase.
Providing that the qualitative description given by
tradi4https://dizionario.internazionale.it/
nuovovocabolariodibase</p>
      <p>5https://github.com/alexmazzei/
SimpleNLG-IT
Category
dimension
age
physical property
colour
relational
evalutativepre
evalutativepost</p>
      <p>NVdB/UD-it
15/16
7/7
4/4
10/11
111/121
33/35
61/68
tional grammars does not allow the definition of a
formal model, we considered a recent study that
classifies the descriptive adjectives. The long term
goal which oriented this study is to contribute to
the development of a natural language generation
system for Italian featured by a more careful
modelling of the behaviour of words within sentence
structures.</p>
      <p>Assuming a corpus-based perspective we tested on
two corpora for Italian the tenets of this study. The
results confirm and validate the theory thus
opening the window for a definition of a formal model
that can be exploited in our computational
framework.</p>
      <p>Future work is planned to extend the validation
of our model on larger datasets, where a wider
variety of adjectives is used and also more complex
noun phrase structures are taken into account with
respect to the simple &lt;adjective - noun&gt;or &lt;noun
- adjective&gt;associations here considered. In
particular, providing that more than one adjective can
occurs within a noun phrase and can be
syntactically linked to a single noun, we intend to
investigate on the preference order also in these cases.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>G.</given-names>
            <surname>Berruto</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Italiano standard</article-title>
          . www.treccani.it.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>D.N.S.</given-names>
            <surname>Bhat</surname>
          </string-name>
          .
          <year>1994</year>
          .
          <article-title>The adjectival category. Criteria for differentiation and identification</article-title>
          . John Benjamins Publishing Company.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <given-names>Cristina</given-names>
            <surname>Bosco</surname>
          </string-name>
          , Fabio Tamburini, Andrea Bolioli, and
          <string-name>
            <given-names>Alessandro</given-names>
            <surname>Mazzei</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Overview of the EVALITA 2016 Part Of Speech on Twitter for ITAlian task</article-title>
          .
          <source>In Proceedings of the Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian.</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>Isabella</given-names>
            <surname>Chiari and Tullio De Mauro</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>The New Basic Vocabulary of Italian as a linguistic resource</article-title>
          . In Roberto Basili, Alessandro Lenci, and Bernardo Magnini, editors,
          <source>1th Italian Conference on Computational Linguistics (CLiC-it)</source>
          , volume
          <volume>1</volume>
          , pages
          <fpage>93</fpage>
          -
          <lpage>97</lpage>
          . Pisa University Press, December.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <given-names>F.</given-names>
            <surname>Chiusaroli</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Scritture brevi e tendenze della scrittura nella comunicazione di Twitter. In Linguaggio e apprendimento linguistico. Metodi e strumenti tecnologici</article-title>
          .
          <source>Officinaventuno.</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <given-names>G.</given-names>
            <surname>Giusti</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Il sintagma aggettivale</article-title>
          .
          <source>In Giampaolo Salvi and Lorenzo Renzi</source>
          , editors,
          <source>Grammatica dell'italiano antico. Il Mulino.</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <given-names>G.</given-names>
            <surname>Giusti</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>The structure of the nominal group</article-title>
          .
          <source>In The Oxford guide to the Romance Languages</source>
          . Oxford University Press.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>Alessandro</given-names>
            <surname>Mazzei</surname>
          </string-name>
          , Cristina Battaglino, and
          <string-name>
            <given-names>Cristina</given-names>
            <surname>Bosco</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>SimpleNLG-IT: adapting SimpleNLG to Italian</article-title>
          .
          <source>In Proceedings of the 9th International Natural Language Generation conference</source>
          , pages
          <fpage>184</fpage>
          -
          <lpage>192</lpage>
          , Edinburgh, UK, September 5-8. Association for Computational Linguistics.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <given-names>Alessandro</given-names>
            <surname>Mazzei</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Building a computational lexicon by using SQL</article-title>
          . In Pierpaolo Basile, Anna Corazza, Francesco Cutugno, Simonetta Montemagni, Malvina Nissim, Viviana Patti, Giovanni Semeraro, and Rachele Sprugnoli, editors,
          <source>Proceedings of Third Italian Conference on Computational Linguistics</source>
          (CLiC-it
          <year>2016</year>
          ) &amp;
          <article-title>Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian</article-title>
          .
          <source>Final Workshop (EVALITA</source>
          <year>2016</year>
          ), Napoli, Italy, December 5-
          <issue>7</issue>
          ,
          <year>2016</year>
          ., volume
          <volume>1749</volume>
          , pages
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          . CEUR-WS.org.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <given-names>T.</given-names>
            <surname>McEnery</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Wilson</surname>
          </string-name>
          .
          <year>2001</year>
          .
          <article-title>Corpus linguistics. An introduction</article-title>
          . Edimburgh University Press.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <given-names>G.</given-names>
            <surname>Patota</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Grammatica di riferimento dell'italiano contemporaneo</article-title>
          .
          <source>Garzanti Linguistica.</source>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <given-names>Ehud</given-names>
            <surname>Reiter</surname>
          </string-name>
          and
          <string-name>
            <given-names>Robert</given-names>
            <surname>Dale</surname>
          </string-name>
          .
          <year>2000</year>
          .
          <article-title>Building Natural Language Generation Systems</article-title>
          . Cambridge University Press, New York, NY, USA.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <given-names>L.</given-names>
            <surname>Renzi</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Salvi, and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Cardinaletti</surname>
          </string-name>
          .
          <year>2001</year>
          .
          <article-title>Grande grammatica italiana di consultazione</article-title>
          . Il Mulino.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <given-names>L.</given-names>
            <surname>Serianni</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Grammatica italiana. Italiano comune e lingua letteraria</article-title>
          .
          <source>Utet universita`.</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>