<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Spammare senza pietà - Corpus based analysis of English, un- acclimatised verb loans in Italian and creation of a reference lexicon</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Anna Fantini</string-name>
          <email>anna.fantini01@universitadipavia.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Università degli studi di Pavia</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2004</year>
      </pub-date>
      <fpage>2</fpage>
      <lpage>7</lpage>
      <abstract>
        <p>English. We describe the lexical resource created to investigate the semantic changes of 90 English, un-acclimatised verb loans in Italian. Final results and interesting observations concerning the annotation task are discussed. Italiano. Descriviamo la risorsa lessicale creata per indagare in italiano il cambiamento semantico di 90 prestiti verbali inglesi non acclimatati. Illustriamo i risultati finali e le interessanti osservazioni emerse dall'esperimento di annotazione.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>The case of language borrowing was investigated
in depth by Gusmani (1983), who argues that a
linguistic loan is an interference phenomenon,
connected with contact and mutual influence of
different languages. According to his study, the
motivations behind the origin of a loan lie in the
individual act of a speaker or of a group of
speakers. The need to resort to a foreign
alternative derives from the prestige held by the latter
against an equivalent word in the mother tongue
of the speaker (or from the absence all together
of an alternative, as in our work: “Se mi vede,
Miki mi banna (&lt;to ban)” vs. *“Se mi vede Miki
mi bandisce”).</p>
      <p>Facts show that language borrowing is
particularly common among specialized languages, more
so if they are linked to technical contexts.
This is extremely visible within the computer
context. The main focus of this paper is the
informal variety of Italian as used by communities
of online video-gamers, computer experts and
amateurs, forum users, etc.; a specialized
language linked to technical context populated with
partially integrated and un-acclimatised English
verb loans.</p>
      <p>These kinds of (mostly) lexical influences are so
recent that their structure is hardly stable, and the
process of integration – graphical,
morphological, phonetic, and lexical – in the language is still
in progress. For instance, they tend to retain the
phonetic property of the original word, especially
of the lexical root (to spawn &gt; spawnare
/spo’nare/).</p>
      <p>The new word serves as an alternative – usually
a hyponym – of an already existing term1. As for
the concept of loan acclimatisation, the literature
states that it involves the role of the new term in
the target language. Therefore, Gusmani speaks
of acclimatisation only with regard to the lexicon
and its connection with speakers’ usage: the
more they familiarise with the loan, the more the
latter gets acclimatised. It follows that – for very
recent, scarcely integrated loans – the majority of
speakers, as well as linguistic authorities, do not
perceive the influence of English as an
enrichment of the lexical heritage but mostly as a
nuisance. If it is true that a number of reports
describe the interference of English over Italian as
an impoverishment, some attempts have also
been made to study the less acclimatized loans
themselves. It is thus of interest to examine why
this kind of loan infiltrates the Italian language,
how the speakers cope with the new word and
what is the semantics of the loan in the target
language. The aim of the present paper is to give
a detailed account of how the meaning of a verb
loan changes (and if it changes) in the target
language and to offer a reliable source of lexical
information in the form of an electronic lexicon
built for the occasion. Section 2 details the
method used to collect suitable data; section 3
illustrates the structure and functions of the lexicon;
section 4 provides the results of our analysis as
well as the annotation task performed with our
data; section 5 discusses our findings and section
6 finally provides a conclusion.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Methods</title>
      <p>
        In order to investigate the semantics of English
un-acclimatized verb loans, we examined their
occurrence in a monitor web-corpus created for
1 E.g. googlare &lt; to google as hyponym of cercare.
this purpose, following the guidelines and
instructions of previous Corpus Linguistics works
        <xref ref-type="bibr" rid="ref22 ref22 ref3">(Baroni and Kilgarriff, 2001; Lenci et al., 2012;
McEnery, Xiao, Tono, 2006; Pomikálek, 2011;
Pustejovsky and Stubbs, 2012)</xref>
        . The corpus
contains 6 transcriptions from a total of 194,07
minutes of audio material, collected with
consensual but unaware recordings and then transcribed
using the software Elan 4.9.6
        <xref ref-type="bibr" rid="ref23">(Wittenburg et al.,
2006)</xref>
        , plus 129 texts obtained through the
Sketch Engine web-crawler, suitably set. We
extracted a sum of 90 different verb lemmas (542
different word forms), for a total of 1327
occurrences. The annotation involves a POS level –
limited to the sentence containing the loan – a
loan-type level – describing three degrees of
language integration2 – a semantic type level3 and a
thematic role level 4 . The last two levels have
been annotated using the tags proposed in Jezek
and Nissim (2014) and Jezek and Vieu (2013)
respectively.
      </p>
      <p>Every text has been annotated using the Mae
software (Stubbs 2011). An annotation task was
conducted using a sample of the corpus (see
section 4.2), its agreement result being only partially
positive but interesting nonetheless from a
linguistic point of view.</p>
      <p>
        The next part of our research involved the
analysis of the semantic patterns for each lemma5, thus
compiling one or more data-driven senses for
every verb. The senses obtained were classified
according to Verb Net’s semantic class
hierarchy. The assumptions underlying this
investigation are grounded on Corpus Pattern
Analysis (CPA) and Computational
Lexicography
        <xref ref-type="bibr" rid="ref10 ref15 ref9">(Hanks 2008; Hanks 2012; Jezek 2011)</xref>
        .
Verb patterns have – in general – the following
structure, where:
(1) Spammare 2b
Agent[PERSON] V_spammare
(Theme[ARTEFACT | ABSTRACT]).
      </p>
      <p>We have chosen all uppercase for the semantic
type, and first letter uppercase for the thematic
role, extended to every argument of the verb.
Round brackets contain the possible optional
arguments of the verb.
2 Totally integrated, e.g. spammare; partially integrated
(grafic), e.g. trackare; partially integrated (phonetics), e.g.
spawnare /sp'nare/.
3 E.g. Person, Artefact, Location, Abstract, etc.
4 E.g. Agent, Patient, Goal, Source, Duration, ect.
5 From Hanks, Pustejovsky 2005, a pattern is intended here
as an argument structure with specifications of both the
thematic roles and the semantic types of each argument
positions.
After extracting the semantic patterns for each
lemma from the corpus, we stored the
information in an electronic lexicon, built using the
software Personal Lexicon 2.7.1, a language
learning resource developed by Alexander Smith
between 2007 and 2015. The software comes
both in free and registered versions, the current
lexicon has been compiled – and it will be
consultable – using the free version.6
The lexicon is designed to give a precise
account of every semantic feature and every
meaning variation of the verb loans. As the reader will
see observing Figure 1, each entry is
characterized by the following elements (some of them
pre-named in the software):
“Figure 1. The spammare 2b lexical entry”
 The entry citation form, with the number
of the sense or of the sub-sense7;
 The Pronunciation of the citation form;
 The Class (pre-named) as in the loan type
which it belongs to (whether it is fully
integrated or only partially integrated);
 The Root element, as in the lexical English
root it comes from;
 The Theme (pre-named), as in the Verb</p>
      <p>Net class it was reduced to;
 The Definition box, containing the lexical
definition and the verb pattern;
 The Related entries in the lexicon, all
accessible through hyperlink;
 The Personal Examples, used to extract the
pattern.</p>
      <p>In figure 2 we show the Conjugations tab
(prenamed) that includes all the syntactic
complements of the verb and their semantic properties
(thematic roles and semantic types).
6 The resource is not yet available for public consultation..
7 Sub-senses corresponding to GRADIT’s accezioni, the
progressively numbered paragraphs a sense is pos-sibly
divided into.</p>
      <p>“Figure 2. Lexicon conjugation tab”
We listed the grammatical subject, the direct
object, the indirect object and up to ten different
indirect complements. Notice that the semantic
type slot may specify more than one element, in
which case we used the | separator.</p>
      <p>In figure 3 we illustrate the Themes section of
the lexicon, with a partial list of Verb Net classes
and sub-classes used in the resource.
“Figure 3. Lexicon Theme section”
Clicking on each one produces the list of entries
belonging to that particular class; this list appears
in the third section of the lexicon, the Lexical
Items column storing all the entries ordered
alphabetically.
4</p>
    </sec>
    <sec id="sec-3">
      <title>The Results</title>
      <p>In this section we report the results of both the
semantic analysis of the loans and the annotation
task.
4.1</p>
    </sec>
    <sec id="sec-4">
      <title>Quantitative considerations</title>
      <p>The lexicon contains 157 senses for a total of
90 verbs. As shown in Table 1, the 157 senses
have been classified into 3 groups according to
three main criteria about the degree of semantic
conservativeness of the loan:</p>
      <p>1 The meaning remains the same as the
original verb.</p>
      <p>2 The meaning remains linked to the original
one, but it diversifies to some degree.</p>
      <p>3 The meaning changes to the point that it
becomes a new meaning altogether</p>
    </sec>
    <sec id="sec-5">
      <title>Group # Type Numbers</title>
      <p>Group 1 Same sense 88</p>
      <sec id="sec-5-1">
        <title>New verb form 11</title>
      </sec>
      <sec id="sec-5-2">
        <title>Group 2</title>
      </sec>
      <sec id="sec-5-3">
        <title>Diversified sense</title>
      </sec>
      <sec id="sec-5-4">
        <title>Group 3</title>
      </sec>
      <sec id="sec-5-5">
        <title>New sense 25 26</title>
      </sec>
      <sec id="sec-5-6">
        <title>New v. and new sense 7</title>
      </sec>
      <sec id="sec-5-7">
        <title>Senses 157</title>
        <p>“Table 1. Senses sorted according to their
semantic behaviour”</p>
        <p>Group 1 coincides with 63% of the total (99
senses out of 157), 11 senses have also new verb
forms (bishottare, autospottare), 78 senses occur
in 1 to 10 examples – they often have new verb
forms (riloggare) or a very specific meaning
(rippare)8. In this group there is the highest
percentage (41%) of monosemic verbs.</p>
        <p>Group 2 coincides with 15% of the total (25
senses out of 157), 19 senses occur only in 1 to
10 examples – they do not have a very specific
meaning, but may be considered as hyponyms of
Italian verbs (farmare2 of sfruttare) 9 . In this
group there is the lowest percentage (16%) of
monosemic verbs – their distribution proved not
to be directly proportional to the senses’
quantity.</p>
        <p>Group 3 coincides with 25% of the total (33
senses out of 157), 24 senses occur only in 1 to
10 examples yet we also have the senses
occurring in the highest number of examples
(droppare 1 10 and 2 11 with 189 examples). In this
group 27% of the verbs are monosemic.
4.2</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>The inter annotator agreement</title>
      <p>
        The semantic annotation task was conducted
following the methodology of Pustejovksy and
Stubbs (2012); only a sample of 440 random
occurrences was annotated by 9 groups of
anannotators, each constituted by 3 people. They
were given guidelines explaining the method and
the tagsets, and they were asked to separately
annotate the semantic type and the thematic role
of each verbal argument. We used Fleiss’k
algorithm to calculate the agreement12
        <xref ref-type="bibr" rid="ref1">(Artstein and
Poesio, 2008)</xref>
        , the values being interpreted
according to Landis and Koch (1977). We already
said that the results have been only partially
positive, in particular – as for the thematic role –
on8 E.g. “Non potendo accedere al CD-Rom non posso
rippare niente” .
9 E.g. “Ok, farmerò i campi di battaglia eterni”.
10 E.g. “Non molto tempo fa ho droppato i bracciali”.
11 E.g. “Non è difficile droppare un computer privato”.
12 We choose Geertzen, J. (2012) online resource for
agreement evaluation .
ly one group reached the 0.6 threshold
considered acceptable with semantic annotation, the
others showing moderate agreement and fair
agreement (one group only). For the semantic
type annotation, three groups reached the 0.6
value, four groups showed moderate agreement
and two groups showed fair agreement.
Nonetheless, we could make interesting linguistic
considerations.
5
      </p>
    </sec>
    <sec id="sec-7">
      <title>Discussion: the semantic behaviour of the loans</title>
      <p>Let us consider the case of spammare13: all its
three main senses are distributed among the three
groups mentioned in Table 1, the semantic
behaviour shows not only a certain degree of
conservativeness, but also a great degree of
diversification (just 18 occurrence out of 76 keep the
original meaning) and thus of acclimatisation.
Italian speakers apply a saving strategy: the
monosemous loans are also the most
conservative, while diversification often results in
polysemous verbs – it seems that, once a
semantic change starts, the speaker continues to use the
loan until it reaches a definitive meaning,
eventually becoming acclimatized. The cognitive
effort behind this process is very high, but it also
implies a certain linguistic confidence. Of course
it is less arduous to produce a loan whose sense
is strictly linked to the original verb's one, thus
generating many monosemous loans.
Nevertheless we wonder whether – aside from being
economically convenient – is it also strategically and
linguistically sensible to produce just
monosemous loans instead of using semantically
diversified ones. Is it sensible to keep numerous and
specific loans, when there can be fewer and
polysemous ones? Further investigations of English
un-acclimatised verb loans may answer part of
these questions.
5.1</p>
    </sec>
    <sec id="sec-8">
      <title>Interesting observations about the annotation task</title>
      <p>We feel that the only partially satisfying results
may depend on the tricky lexical meaning of
each loan. It is clearly easier to annotate the
argument structure of a well-known verb like
potenziare, rather than the one of the loan
overcloccare 14 (potenziare and overcloccare being
almost synonyms). The thematic role level is the
most problematic, obtaining substantial
agreement only in one case; the semantic type level on
the other end is perceived as a less abstract, more
transparent concept and the annotation is slightly
better, with three groups over 0.6. What is really
interesting is that the group which performed
best with thematic roles is also the one which did
worst with semantic types. Moreover, the groups
which performed best with semantic types
showed only fair to moderate agreement in
thematic roles. We observe a – general and group
wise – performance improvement with the
semantic type level.</p>
      <p>This is because assigning a thematic role requires
a deeper reflection and some of the roles may be
ambiguous (for example, Beneficiary and Goal).
The creation and combination of more specific
sub-types and sub-roles – targeted to this kind of
verbs – could help resolve the ambiguity
hindering agreement (for example, Person split into
Authority and Subordinate)15.</p>
      <p>Furthermore the un-acclimatisation of the
loans leads to somewhat different uses and
different meanings among the speakers. This
happens either between different communities, either
between different speakers of the same
community. Other significant observations emerged on
the frequency of roles and types and on their
cooccurrence: the most used roles are Agent (often
erroneously) and Patient (often in the place of a
more neutral Theme). The types most used are
Person, Artefact and Abstract. The Agent-Person
combination is the most frequent, even if the role
is often wrongly assigned. Great uncertainty
emerged in assigning the correct type to
arguments whose referents are intangible informatics
entities, e.g. nicknames, server, updates, etc. or
characters of a game, e.g. boss, Pokémon, etc.</p>
      <p>Last but not least, it was possible to already
identify primitive verb classes, depending on the
roles and the types assigned to verb arguments,
i.e. verbs of change of state with a Patient role
and possibly a Beneficiary role, or verbs of
creation with a Result role and occasionally an Agent
role.
13 E.g. 1 “Magari capiterà di spammare un oggetto”
2 “Iniziano a spammare pubblicità a tutti gli iscritti.”
3 “Questa è un'abilità controversa [...] ma non va
spammata” .
14 E.g. “Prima di lanciare il tutto ho overcloccato la scheda
video”.
15 From section 1 “Se mi vede Miki mi banna” (bannare 1a)
Miki annotated as Agent-Authority and the personal
pronoun as Beneficiary-Subordinate.</p>
    </sec>
    <sec id="sec-9">
      <title>Conclusions</title>
      <p>The peculiarities of each group of annotators
lead to a thought-provoking analysis of the
tagsets and the semantic notions themselves. The
analysis of the semantic behaviour of the loans
unveils deeper questions on the speaker’s
strategy: if it is easier to reuse a loan whose meaning
already exists, why are there also loans with new
or diversified meaning? Furthermore it came to
our attention that yes, many loans are linked to
the informatics/technical context (rippare,
sloggare, etc.) but others can be considered as
hyponyms of already existing Italian verbs, whose
meaning is rather general (cheattare for barare,
whinare for lamentarsi, etc.). It is possible to
already discern synonymic and antonymic
relations between the loans themselves: craftare,
farmare 2, spawnare 1 or sbuggare-buggare.
Finally, the most productive verb classes in our
corpus are the verbs of change of state, the
creation verbs and the verbs of killing.</p>
      <p>Anthony McEnery, Richard Xiao and Yukio Tono.
2006. Corpus based language studies. An advanced
resource book. Routledge, Taylor &amp; Francis Group.</p>
      <p>Oxon. Routledge Applied Linguistics.
James Pustejovsky and Amber Stubbs. 2012. Natural
language annotation for machine learning.</p>
      <p>O’Reilly.</p>
      <p>Renata Savy. 2006. Specifiche per la trascrizione
ortografica annotata dei testi raccolti. In Progetto
CLIPS. Corpora e Lessici dell’Italiano Parlato e
Scritto.</p>
      <p>Amber Stubbs. 2011. MAE and MAI: Lightweight</p>
      <p>Annotation and Adjudication Tools.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>Ron</given-names>
            <surname>Artstein</surname>
          </string-name>
          and
          <string-name>
            <given-names>Massimo</given-names>
            <surname>Poesio</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Inter-coder agreement for computational linguistics</article-title>
          .
          <source>Computational Linguistics</source>
          ,
          <volume>34</volume>
          (
          <issue>4</issue>
          ),
          <fpage>555</fpage>
          -
          <lpage>596</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>Joe</given-names>
            <surname>Barcroft</surname>
          </string-name>
          , Gretchen Sunderman and
          <string-name>
            <given-names>Norbert</given-names>
            <surname>Schmitt</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Lexis</article-title>
          . In J. Simpson, ed.
          <source>The Routledge Handbook of Applied Linguistics</source>
          . Routledge Taylor &amp; Francis Group. Oxon., pp.
          <fpage>597</fpage>
          -
          <lpage>610</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <given-names>Marco</given-names>
            <surname>Baroni</surname>
          </string-name>
          and
          <string-name>
            <given-names>Adam</given-names>
            <surname>Kilgarriff</surname>
          </string-name>
          .
          <year>2001</year>
          .
          <article-title>Large linguistically processed web corpora for multiple language</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>Raffaella</given-names>
            <surname>Bombi</surname>
          </string-name>
          .
          <year>2003</year>
          .
          <article-title>Anglicismi come banco di prova dell'interferenza linguistica. Italiano e inglese a confronto, Firenze</article-title>
          , Franco Cesati Editore.
          <fpage>101</fpage>
          -
          <lpage>125</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <given-names>Raffaella</given-names>
            <surname>Bombi</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>La linguistica del contatto: tipologie di anglicismi nell'italiano contemporaneo e riflessi metalinguistici</article-title>
          . (Vol.
          <volume>11</volume>
          ). Il calamo.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <given-names>Thierry</given-names>
            <surname>Fontenelle</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>Lexicography</article-title>
          . In J. Simpson, ed The Routledge Handbook of Applied Linguistics. Routledge, Taylor &amp; Francis Group. Oxon. pp.
          <fpage>53</fpage>
          -
          <lpage>66</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <given-names>Jeoren</given-names>
            <surname>Geertzen</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Inter-Rater Agreement with multiple raters and variables</article-title>
          .
          <source>Retrieved November 27</source>
          ,
          <year>2015</year>
          , from https://nlp-ml.io/jg/software/ira/
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>Roberto</given-names>
            <surname>Gusmani</surname>
          </string-name>
          .
          <year>1983</year>
          .
          <article-title>Saggi sull'interferenza linguistica (vol.1 e vol</article-title>
          .
          <volume>2</volume>
          ). Le lettere.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <given-names>Patrick</given-names>
            <surname>Hanks</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>How people use words to make meanings: Semantic types meet valencies</article-title>
          . In A. Boulton &amp; J. Thomas, eds. Input,
          <article-title>Process and Product: Developments in Teaching and Language Corpora</article-title>
          . Masaryk University Press.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <given-names>Patrick</given-names>
            <surname>Hanks</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Lexical Patterns: from Hornby to Hunston and beyond</article-title>
          . In E. Bernal &amp; J. DeCesaris, eds.
          <source>Proceedings of Euralex</source>
          <year>2008</year>
          . Barcellona, Universitat Pompeu Fabra.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <given-names>Patrick</given-names>
            <surname>Hanks</surname>
          </string-name>
          and
          <string-name>
            <given-names>Elisabetta</given-names>
            <surname>Jezek</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>What lexical sets tell us about conceptual categories</article-title>
          . In Lexis:
          <article-title>E-journal in English lexicology, 4: Corpus Linguistics and the Lexicon</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <given-names>Patrick</given-names>
            <surname>Hanks</surname>
          </string-name>
          and
          <string-name>
            <given-names>James</given-names>
            <surname>Pustejovsky</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>A Pattern Dictionary for Natural Language Processing</article-title>
          . Revue française de linguistique appliquée,
          <volume>10</volume>
          (
          <issue>2</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <given-names>Martin</given-names>
            <surname>Haspelmath</surname>
          </string-name>
          .
          <year>2009</year>
          .
          <article-title>Lexical borrowing: concepts and issues. Loanwords in the world's languages: a comparative handbook</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <given-names>Martin</given-names>
            <surname>Haspelmath</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Loanword typology: steps toward a systematic cross-linguistic study of lexical borrowability. Aspects of language contact: new theoretical, methodological and empirical findings with special focus on Romancisation processes</article-title>
          . Mouton de Greuyter.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <given-names>Elisabetta</given-names>
            <surname>Jezek</surname>
          </string-name>
          .
          <year>2011</year>
          . Lessico.
          <article-title>Classi di parole, strutture, combinazioni</article-title>
          . Il Mulino, Bologna.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <given-names>Elisabetta</given-names>
            <surname>Jezek</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>Struttura argomentale dei verbi</article-title>
          . In L. Renzi - G.
          <article-title>Salvi (a cura di) Grammatica dell'Italiano Antico</article-title>
          . Bologna: Il Mulino,
          <fpage>77</fpage>
          -
          <lpage>122</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <given-names>Elisabetta</given-names>
            <surname>Jezek</surname>
          </string-name>
          and
          <string-name>
            <given-names>Malvina</given-names>
            <surname>Nissim</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Linee guida per l'annotazione degli argomenti del verbo</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Tullio De Mauro.</surname>
          </string-name>
          1999-
          <fpage>2007</fpage>
          .
          <article-title>GRADIT - Grande Dizionario Italiano Dell'uso. 6 vols</article-title>
          . Torino: UTET.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <given-names>Elisabetta</given-names>
            <surname>Jezek</surname>
          </string-name>
          and
          <string-name>
            <given-names>Laure</given-names>
            <surname>Vieu</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Lista di ruoli semantici per Senso Comune</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <given-names>Joseph L.</given-names>
            <surname>Fleiss</surname>
          </string-name>
          .
          <year>1971</year>
          .
          <article-title>Measuring nominal scale agreement among many raters</article-title>
          .
          <source>Psychological Bulletin</source>
          ,
          <volume>76</volume>
          :
          <fpage>378</fpage>
          -
          <lpage>382</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <given-names>Adam</given-names>
            <surname>Kilgarrif</surname>
          </string-name>
          .
          <year>2001</year>
          .
          <article-title>Web as corpus</article-title>
          .
          <source>Proceedings of corpus linguistics 2001. Corpus Linguistics</source>
          . Reading in a Widening Discipline.
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <given-names>Alessandro</given-names>
            <surname>Lenci</surname>
          </string-name>
          , Simonetta Montemagni and
          <string-name>
            <given-names>Vito</given-names>
            <surname>Pirrelli</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Testo e computer. Elementi di linguistica computazionale</article-title>
          .
          <source>Carocci editore.</source>
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <given-names>Peter</given-names>
            <surname>Wittenburg</surname>
          </string-name>
          , Hennie Brugman,
          <string-name>
            <surname>Albert Russel</surname>
          </string-name>
          , Alex Klassmann and
          <string-name>
            <given-names>Han</given-names>
            <surname>Sloetjes</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>ELAN: a Professional Framework for Multimodality Research</article-title>
          .
          <source>In: Proceedings of LREC 2006, Fifth International Conference on Language Resources and Evaluation.</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>