<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Entrenchment Determinants Are Relevant throughout Spoken Language Production: A Study of Speech Errors</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Svetlana Gorokhova (s.gorokhova@spbu.ru)</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Philology, Saint Petersburg State University</institution>
          ,
          <addr-line>11 Universitetskaya nab. Saint Petersburg, 199034</addr-line>
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>488</fpage>
      <lpage>493</lpage>
      <abstract>
        <p>Spontaneously produced Russian speech errors were analyzed for factors that may be expected to determine cognitive entrenchment. The results suggest that entrenchment determinants are relevant throughout the process of spoken language production, including phonological encoding, lemma retrieval, selection of inflected word forms, and grammatical agreement computation, and that the degree of entrenchment of linguistic units is predictive of speech errors.</p>
      </abstract>
      <kwd-group>
        <kwd>entrenchment</kwd>
        <kwd>word frequency</kwd>
        <kwd>age of acquisition</kwd>
        <kwd>word length</kwd>
        <kwd>associative relatedness</kwd>
        <kwd>cooccurrence strength</kwd>
        <kwd>phonological substitutions</kwd>
        <kwd>semantic substitutions</kwd>
        <kwd>inflected word forms</kwd>
        <kwd>grammatical agreement</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Spreading-activation theories of production posit that whole
networks of units are activated during language production,
and the selected item is the one that receives the highest
proportion of activation
        <xref ref-type="bibr" rid="ref24 ref32 ref9">(Dell, 1986; McNamara, 1992;
Stemberger, 1985)</xref>
        . The degree to which a unit is entrenched
in long-term memory may be assumed to affect the amount
of activation that it receives, and consequently strongly
entrenched units have a better chance of being selected
        <xref ref-type="bibr" rid="ref30">(Schmid, 2007)</xref>
        .
      </p>
      <p>
        Usage-based cognitive-linguistic theories claim that the
frequency of use of a linguistic unit correlates with its
degree of cognitive entrenchment
        <xref ref-type="bibr" rid="ref11 ref18 ref23 ref29 ref30">(Evans &amp; Green, 2006;
Hudson, 2007; Langacker, 1987; Rosch et al., 1976;
Schmid, 2007)</xref>
        and that frequency is thus a major
entrenchment predictor. Importantly, entrenchment of
linguistic units is arguably determined not only by the
frequency of their activation by individual speakers but also
by the frequency of their occurrence in a speech community
as a whole.
      </p>
      <p>
        It has been suggested that apart from frequency,
entrenchment is likely to be determined by the age of
acquisition (AoA) of a linguistic unit
        <xref ref-type="bibr" rid="ref13 ref14 ref26 ref27">(Gerhand and Barry,
1999; Ghyselinck, Lewis, &amp; Brysbaert, 2004; Morrison and
Ellis, 1995, 2000)</xref>
        and the length of a linguistic string
        <xref ref-type="bibr" rid="ref2">(Blumenthal-Drame, 2012)</xref>
        .
      </p>
      <p>
        Although frequency and AoA are important explanatory
mechanisms used by cognitive linguistic and
psycholinguistic theories, the available experimental data on
the role and the locus of the frequency and AoA effects in
lexical retrieval are controversial. While many authors argue
that the frequency effect is located at the stage of accessing
phonological forms
        <xref ref-type="bibr" rid="ref19 ref20">(Jescheniak and Levelt, 1994; Jurafsky,
2003 etc.)</xref>
        rather than the semantic lemma level, there is
some evidence to suggest that lexical selection (lemma
retrieval) is also affected by word frequency
        <xref ref-type="bibr" rid="ref16 ref21">(Gorokhova,
2013; Kittredge et al., 2008; Navarrete et al., 2006)</xref>
        .
Furthermore, recent studies provide evidence for the
availability of probabilistic information about individual
inflectional variants of a word in lexical memory
        <xref ref-type="bibr" rid="ref1 ref12 ref15 ref18 ref31">(see
Baayen et al., 2003; Fleischhauer &amp; Clahsen, 2012;
Gorokhova, 2011; Smolka, Zwitserlood, &amp; Rösler, 2007)</xref>
        .
      </p>
      <p>
        Similarly, a number of experimental studies propose that
AoA is only relevant at the stage of phonological retrieval
        <xref ref-type="bibr" rid="ref21">(Barry et al., 2001; Kittredge et al., 2008)</xref>
        although other
authors argue that both frequency and AoA are fundamental
for lexical retrieval
        <xref ref-type="bibr" rid="ref25 ref5">(Catling et al., 2010; Meschyan &amp;
Hernandez, 2002)</xref>
        , including its earlier stages
        <xref ref-type="bibr" rid="ref3">(Brysbaert,
Van Wijnendaele, &amp; De Deyne, 2000)</xref>
        .
      </p>
    </sec>
    <sec id="sec-2">
      <title>Data</title>
      <p>To explore the effect of entrenchment predictors on
spoken language production, spontaneously produced
Russian speech errors (slips of the tongue) of phonological,
semantic, and syntactic types were analyzed for factors that
may be regarded as determinants of entrenchment —
frequency, age of acquisition (AoA), target-error
cooccurrence strength, word association norms, and word
length. The analyses used the data from the Russian
National Corpus, Russian Word Association Thesaurus, and
experimentally obtained AoA ratings for target and error
words. The study involved 657 context-free sound-based
noun substitution errors, 1378 context-free meaning-based
noun substitution errors, 242 context-free errors that
resulted in the selection of a wrong inflectional variant of
the target word, and 274 agreement errors in modifier-head
constructions. The errors were collected by tape recording
and digitally recording everyday conversations, telephone
conversations, and live TV and radio programs. In case the
speaker themselves did not catch the error and did not
correct it, where possible, they were questioned as to what
they had intended to say. If this was not possible (e.g. in the
case of an error produced by a participant of a talk show),
the error was only included in the corpus after being attested
by two professional linguists.</p>
    </sec>
    <sec id="sec-3">
      <title>Results and Discussion</title>
    </sec>
    <sec id="sec-4">
      <title>Sound-based substitution errors</title>
      <p>Phonological substitution errors were analyzed for word
frequency and word length. Not surprisingly, the results of
the length comparison did not reveal any target vs. error
word length difference as target and errors words in
phonological substitution errors are known to frequently
have similar beginning segments and equal lengths.</p>
      <p>Examples
1. Da, kstati, mne pyatno [pitnO] otčistili</p>
      <p>→ ... pis'mo [pis′mO]...</p>
      <p>By the way, I've had the spot cleaned → ... letter ...
2. Nas vstretili s bol′šim vnimanijem [vnimAnijəm]
→…vlijanijem [vlijAnijəm]
They met us with great care → …influence</p>
      <p>At the same time, the results of the frequency analysis
show that lower-frequency nouns tend to be replaced by
phonologically related higher-frequency nouns
(t(656)=3.41, p&lt;0.001) (fig. 1).</p>
    </sec>
    <sec id="sec-5">
      <title>Meaning-based substitution errors</title>
      <p>Semantic substitution errors were analyzed for word
frequency, word length, age of acquisition (AoA),
targeterror cooccurrence strength, and word association norms.</p>
      <p>Based on the types of conceptual-semantic relationships
between the target and its substitute, the target-error pairs of
nouns were classified as either “cohyponyms” (e. g. saucer
→ plate) or “antonyms” (e. g. descendants → ancestors) or
“associatively related” (e. g. carpets → floors) by 20
undergraduate students of linguistics from St Petersburg
State University and by 4 professional linguists. The
resulting error corpus under study comprised 724
cohyponym, 187 antonym, and 467 “associatively related”
target-error pairs.</p>
      <p>Examples
1. Cohyponyms
Ja tebe bljudce, meždu pročim, xoču dostat′ → … tarelku
Incidentally, I want to get you a saucer → … a plate
2. Antonyms</p>
      <p>A potom, predstavljaete, naši potomki obnaružat etu
knigu → ... predki ...</p>
      <p>And then, can you imagine, our descendants will discover
this book → ... ancestors ...</p>
      <p>3. "Associatively related"
Koška vse vremja deret kovry → …poly</p>
      <p>The cat keeps tearing the carpets → … floors
Word frequency The results indicate that error word
frequencies tend to exceed target word frequencies in
cohyponym (t(723)=2.49, p&lt;0.01) and “associatively
related” (t(466)=3.91, p&lt;0.0001) semantic substitutions but
not in antonym substitutions (figs. 2, 3, and 4).</p>
      <p>Besides, there is a very significant positive correlation
between target and error frequency values in cohyponym
(r=0.74, p&lt;0.0001) and “associatively related” (r=0.60,
p&lt;0.0001) error types (figs. 5 and 6).</p>
      <p>Figure 5: Correlation of target and error word frequencies:
Cohyponym substitution errors.</p>
      <p>Age of acquisition AoA ratings for target and error words
were obtained using the experimental procedure described
in Kuperman, Stadthagen-Gonzales, &amp; Brysbaert, 2012. The
target and error words were distributed over lists of 250
words each. For every word, participants were asked to
enter the age (in years) at which they thought they had
learned the word, i.e. the age at which they would have
understood the word even if they did not use it actively at
the time.</p>
      <p>The lists were initially presented to 20 participants each.
If a word got less than 18 valid observations after this phase
because of some values missing in the completed lists, it
was included in a new, comparable list at the end of the data
collection and presented to new participants until the
required number of observations was reached. The ratings
were collected from 256 respondents, who were all native
speakers of Russian with college education aged between 21
and 76.</p>
      <p>The results suggest that error words tend to be acquired
earlier than target words in cohyponym (t(717)=2.94,
p&lt;0.01) and “associatively related” (t(446)=2.79, p&lt;0.01)
but not in antonym substitutions (figs. 7, 8, and 9).
Word length Word length measured in syllables, while not
affecting cohyponym and antonym errors, may still be
predictive of the outcome of “associatively related”
semantic substitutions, in which target words were found to
be significantly longer than error words (t(466)=2.49,
p&lt;0.01) (fig. 10).</p>
      <p>Target-error associative relatedness Target-error pairs
were analyzed in terms of word association norms from the
Russian Word Association Thesaurus. For the purpose of
this study, a target word was taken to be a stimulus word,
and the substitute word, to be its associative response.</p>
      <p>The results indicate that both antonym and cohyponym
errors tend to have much higher measures of target-error
associative relatedness compared to “associatively related”
errors while antonym target-error pairs are more closely
related than cohyponyms (F(2, 1336)=17.71, p&lt;0.0001)
(fig. 11).</p>
      <p>Target-error cooccurrence strength The Russian National
Corpus was used to estimate the mutual informativeness, or
co-occurrence strength, of the target and its substitute. Since
Mutual Information (MI) score is known to overestimate
low-frequency words, T-score was used in addition to MI
because it highlights the word pairs whose co-occurrence
frequency is high enough to be reliable. MI and T-scores
were computed for each target-error pair with a context
window of + 10 (the average length of a Russian language
sentence).</p>
      <p>
        Both antonym and cohyponym errors appear to have
much higher measures of target-error cooccurrence strength
compared to “associatively related” errors (F(2, 1372)=9.85,
p&lt;0.0001) (fig. 12).
The findings are in line with the view that lexical retrieval
is affected by word frequency
        <xref ref-type="bibr" rid="ref3">(Brysbaert et al., 2000;
Navarrete et al., 2006)</xref>
        and AoA
        <xref ref-type="bibr" rid="ref25 ref5">(Catling et al., 2010;
Meschyan &amp; Hernandez, 2002)</xref>
        and provide support for the
hypothesis that various determinants of entrenchment may
play a role throughout the process of lexical selection
including its earlier stages such as the stage of lemma
retrieval.
      </p>
    </sec>
    <sec id="sec-6">
      <title>Substitutions of inflected word forms</title>
      <p>The analyses, based on the frequency data from the
spoken part of the Russian National Corpus, involved
context-free substitutions of inflected word forms that
resulted in the selection of a wrong inflectional variant of a
noun, pronoun, verb, or adjective.</p>
      <p>Examples
1. Case (DAT → GEN)
Ty otvezi ix v Moskvu k RODSTVENNIK-AM
you take them to Moscow to relative-PL.DAT
→ … k RODSTVENNIK-OV</p>
      <p>to relative-PL.GEN
Why don't you take them to your relatives in Moscow.
2. Person (2d → 3d)
Poslezavtra BUD-EŠ ′ otdoxnuvšij
day after tomorrow be-2SG.FUT well-rested
→… BUD-ET …</p>
      <p>be-3SG.FUT
You’ll feel well-rested tomorrow.
3. Tense (FUT → PST)
Ja vynuždena BUDU vyslušat′ plamennuju tiradu
I have to be:3SG.FUT listen to fiery tirade
→ … BYLA …</p>
      <p>be:3SG.PST
I’ll have to listen to a fiery tirade.</p>
      <p>The results indicate, firstly, that token frequency is
relevant to the selection of inflected word forms. A
comparison between the frequencies of the target and error
inflected word forms in the corpus reveals that the general
tendency is for a higher-frequency inflectional variant of a
word to substitute for a lower-frequency variant
(t(241)=3.78, p&lt;0.001) (fig. 13).</p>
      <p>
        Thus, Russian speech error data corroborate the claim that
the production of inflected forms may be influenced by
word form frequency
        <xref ref-type="bibr" rid="ref1 ref12 ref6">(Baayen et al., 2003; Clahsen, Hadler,
&amp; Weyerts, 2004; Fleischhauer &amp; Clahsen, 2012)</xref>
        .
      </p>
      <p>Furthermore, it appears that the selection of inflected
forms is sensitive to type frequency. A comparison
between the relative frequencies of the target and error
inflectional variants within the word’s declension paradigm
suggests that the case forms of nouns and personal pronouns
that occur most frequently in spoken Russian (nominative,
genitive, and accusative) tend to substitute for the less
frequent oblique case forms such as the dative whereas the
higher-frequency nominative and accusative forms tend to
replace the genitive (t(86)=4.03, p&lt;0.001) (fig. 14).
frequency difference; so it seems plausible to conclude that
it is the higher frequencies of error modifier-head
constructions that account for the result.</p>
      <p>
        The results are evident in favor of usage-based models of
mental grammar suggesting that the degree of entrenchment,
regarded as a mental correlate of usage frequency, may
influence the selection of a word's inflectional variants.
Furthermore, the data provide support for the claim that the
frequency of use of grammatical constructions at different
levels of schematicity is an important determinant of
linguistic structure and language use
        <xref ref-type="bibr" rid="ref10 ref4 ref7 ref8">(see Bybee, 2006;
Croft &amp; Cruse, 2004; Diessel, 2007)</xref>
        .
      </p>
      <p>Errors of agreement in modifier-head constructions</p>
      <p>The analysis involved “reversed agreement” errors in
modifier-head [Adj/Part/Pron/Num+N] constructions, when
a speaker selects an irrelevant noun case form based on the
case-ambiguous pre-modifier adjective form instead of
computing the adjective case form based on the head noun
form.</p>
      <p>
        Examples
1. PL.LOC → PL.GEN
na et-IX forum-AX
at this-PL.GEN/LOC forum-PL.LOC
→
na et-IX forum-OV
at this-PL.GEN /LOC forum-PL.GEN
(I visited different Internet forums and) at these forums…
2. SG.F.GEN → SG.F.DAT
mil-OJ ženščin-Y
nice-SG.F.GEN/DAT/INS/LOC woman-SG.F.GEN
→
mil-OJ ženščin-E
nice-SG.F.GEN/DAT/INS/LOC woman-SG.F.DAT
(I visited a presentation made by a) nice woman…
The errors were analyzed using frequency data from the
disambiguated part of the Russian National Corpus. The
comparison reveals the tendency for speakers to substitute
more frequent constructions for less frequent constructions
(t(236)=3.49, p&lt;0.001) (fig. 15). To ascertain that the result
was not due to higher frequencies of error head nouns, a
statistical test was run to compare target and error head
noun frequencies, which did not produce a significant
Evidence from agreement errors in modifier-head
constructions indicates that the production mechanism
makes use of distributional patterns of relevant
constructions stored in long-term memory. This finding is in
line with some recent studies that suggest that number
agreement may be computed based on the speaker’s
linguistic experience
        <xref ref-type="bibr" rid="ref17 ref33">(Haskell, Thornton, &amp; MacDonald,
2010; Thornton &amp; MacDonald, 2003)</xref>
        . The error
construction seems to be a well-entrenched recurrent
pattern, which a speaker, based on their linguistic
experience, tends to use as a default schema instead of using
more generalized constructional schemas.
      </p>
    </sec>
    <sec id="sec-7">
      <title>Conclusion</title>
      <p>Speech error data provide supportive evidence for the
claim that properties of linguistic units regarded as
entrenchment determinants are important throughout the
process of spoken language production. Furthermore, the
results suggest that the degree of entrenchment of words and
lexico-grammatical structures may be a factor involved in
the occurrence of speech errors. At the same time, more
research is needed to investigate the effects of other
variables such as imageability on the word’s susceptibility
to errors in normal speech.</p>
      <p>This work was supported by RBRF grant No. 13-06-00353.</p>
    </sec>
    <sec id="sec-8">
      <title>Acknowledgments References</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Baayen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McQueen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dijkstra</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Schreuder</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Frequency effects in regular inflectional morphology: Revisiting Dutch plurals</article-title>
          . In: H.
          <string-name>
            <surname>Baayen</surname>
          </string-name>
          &amp; R. Schreuder (Eds.),
          <source>Morphological Structure in Language Processing</source>
          , Berlin: Mouton de Gruyter.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Blumenthal-Dramé</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Entrenchment in UsageBased Theories: What corpus data do and do not reveal about the mind</article-title>
          . Berlin: Walter de Gruyter.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Brysbaert</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Van Wijnendaele</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>De Deyne</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Age-of-acquisition effects in semantic processing tasks</article-title>
          .
          <source>Acta Psychologica</source>
          ,
          <volume>104</volume>
          ,
          <fpage>215</fpage>
          -
          <lpage>226</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Bybee</surname>
            ,
            <given-names>J.L.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Frequency of use and the organization of language</article-title>
          . Oxford: Oxford University Press.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Catling</surname>
            ,
            <given-names>J.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dent</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnston</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Balding</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Age of acquisition, word frequency, and pictureword interference</article-title>
          .
          <source>Quarterly Journal of Experimental Psychology</source>
          ,
          <volume>63</volume>
          (
          <issue>7</issue>
          ),
          <fpage>1304</fpage>
          -
          <lpage>1317</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Clahsen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hadler</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Weyerts</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Speeded production of inflected words in children and adults</article-title>
          .
          <source>Journal of Child Language</source>
          ,
          <volume>31</volume>
          ,
          <fpage>683</fpage>
          -
          <lpage>712</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Croft</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Cruse</surname>
            ,
            <given-names>D.A.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <source>Cognitive Linguistics</source>
          . Cambridge: Cambridge University Press
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Croft</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Cruse</surname>
            ,
            <given-names>D.A.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <source>Cognitive Linguistics</source>
          . Cambridge: Cambridge University Press.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Dell</surname>
            ,
            <given-names>G. S.</given-names>
          </string-name>
          (
          <year>1986</year>
          ).
          <article-title>A spreading-activation theory of retrieval in sentence production</article-title>
          .
          <source>Psychological Review</source>
          ,
          <volume>93</volume>
          (
          <issue>3</issue>
          ),
          <fpage>283</fpage>
          -
          <lpage>321</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Diessel</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Frequency effects in language acquisition, language use, and diachronic change</article-title>
          . New Ideas in Psychology,
          <volume>25</volume>
          ,
          <fpage>108</fpage>
          -
          <lpage>127</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Evans</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Green</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Cognitive Linguistics: An Introduction</article-title>
          . Edinburg: Edinburgh University Press.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Fleischhauer</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Clahsen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Generating inflected word forms in real time: Evaluating the role of age, frequency, and working memory</article-title>
          . In A.
          <string-name>
            <surname>Biller</surname>
            ,
            <given-names>E. Chung,</given-names>
          </string-name>
          &amp; A.
          <string-name>
            <surname>Kimball</surname>
          </string-name>
          (Eds.),
          <source>Proceedings of the 36th annual Boston University Conference on Language Development</source>
          . Vol.
          <volume>1</volume>
          . Somerville, MA: Cascadilla Press.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Gerhand</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Barry</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>1999</year>
          ).
          <article-title>Age of acquisition, frequency and the role of phonology in the lexical decision task</article-title>
          .
          <source>Memory and Cognition</source>
          ,
          <volume>27</volume>
          ,
          <fpage>592</fpage>
          -
          <lpage>602</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Ghyselinck</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewis</surname>
            ,
            <given-names>M. B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Brysbaert</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Age of acquisition and the cumulative-frequency hypothesis: A review of the literature and a new multi-task investigation</article-title>
          .
          <source>Acta Psychologica</source>
          ,
          <volume>115</volume>
          ,
          <fpage>43</fpage>
          -
          <lpage>67</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Gorokhova</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>The role of frequency effects in the selection of inflected word forms: A corpus study of Russian speech errors</article-title>
          . In M. Konopka,
          <string-name>
            <given-names>J.</given-names>
            <surname>Kubczak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Mair</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Šticha</surname>
          </string-name>
          , &amp; U. H. Wassner (Eds.),
          <source>Grammar and Corpora</source>
          <year>2009</year>
          :
          <article-title>Corpus Linguistics and Interdisciplinary Perspectives on Language</article-title>
          , Vol.
          <volume>1</volume>
          . Tübingen: Gunter Narr Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Gorokhova</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Some factors that determine the outcome of lexical competition in language production: A corpus-based analysis of Russian speech errors</article-title>
          .
          <source>In A. Stefanowitsch &amp; J. Goschler (Eds.)</source>
          ,
          <source>Yearbook of the German Cognitive Linguistics Association</source>
          ,
          <year>2013</year>
          . Vol.
          <volume>1</volume>
          . Berlin/Boston: Mouton de Gruyter.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Haskell</surname>
            ,
            <given-names>T.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thornton</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>MacDonald</surname>
            ,
            <given-names>M.C.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Experience and grammatical agreement: Statistical learning shapes number agreement production</article-title>
          .
          <source>Cognition</source>
          <volume>114</volume>
          :
          <fpage>151</fpage>
          -
          <lpage>164</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Hudson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Word grammar</article-title>
          . In D. Geeraerts &amp; H.
          <string-name>
            <surname>Cuyckens</surname>
          </string-name>
          (Eds.),
          <source>The Oxford Handbook of Cognitive Linguistics</source>
          . New York: Oxford University Press.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Jescheniak</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Levelt</surname>
            ,
            <given-names>W. J. M.</given-names>
          </string-name>
          (
          <year>1994</year>
          ).
          <article-title>Word frequency effects in speech production: Retrieval of syntactic information and of phonological form</article-title>
          .
          <source>Journal of Experimental psychology: Learning, Memory, and Cognition</source>
          ,
          <volume>20</volume>
          (
          <issue>4</issue>
          ),
          <fpage>824</fpage>
          -
          <lpage>843</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Jurafsky</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Probabilistic modeling in psycholinguistics: Linguistic comprehension and production</article-title>
          . In R. Bod,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hay</surname>
          </string-name>
          , &amp; S. Jannedy (Eds.),
          <string-name>
            <given-names>Probabilistic</given-names>
            <surname>Linguistics</surname>
          </string-name>
          . Cambridge, MA: MIT Press.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Kittredge</surname>
            ,
            <given-names>A.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dell</surname>
            ,
            <given-names>G. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Verkuilen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Schwartz</surname>
            ,
            <given-names>M. F.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Where is the effect of frequency in word production? Insights from aphasic picture-naming errors</article-title>
          .
          <source>Cognitive Neuropsychology</source>
          ,
          <volume>25</volume>
          ,
          <fpage>463</fpage>
          -
          <lpage>492</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Kuperman</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stadthagen-Gonzales</surname>
            ,
            <given-names>H</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Brysbaert</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Age-of-acquisition ratings for 30,000 English words</article-title>
          .
          <source>Behavior Research Methods</source>
          ,
          <volume>44</volume>
          ,
          <fpage>978</fpage>
          -
          <lpage>990</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Langacker R. W.</surname>
          </string-name>
          (
          <year>1987</year>
          ).
          <article-title>Foundations of cognitive grammar</article-title>
          . Vol.
          <volume>1</volume>
          ,
          <string-name>
            <given-names>Theoretical</given-names>
            <surname>Prerequisites</surname>
          </string-name>
          . Stanford, CA: Stanford University Press.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>McNamara</surname>
            ,
            <given-names>T. P.</given-names>
          </string-name>
          (
          <year>1992</year>
          ).
          <article-title>Theories of priming: I. Associative distance and lag</article-title>
          .
          <source>Journal of Experimental Psychology: Learning</source>
          , Memory, &amp; Cognition,
          <volume>18</volume>
          ,
          <fpage>1173</fpage>
          -
          <lpage>1190</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Meschyan</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hernandez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2002</year>
          ).
          <article-title>Age of acquisition and word frequency: Determinants of object-naming speed and accuracy</article-title>
          .
          <source>Memory &amp; Cognition</source>
          ,
          <volume>30</volume>
          (
          <issue>2</issue>
          ),
          <fpage>262</fpage>
          -
          <lpage>269</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <string-name>
            <surname>Morrison</surname>
            ,
            <given-names>C. M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ellis</surname>
            ,
            <given-names>A. W.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>The roles of word frequency and age of acquisition in word naming and lexical decision</article-title>
          .
          <source>Journal of Experimental Psychology: Learning, Memory and Cognition</source>
          ,
          <volume>21</volume>
          ,
          <fpage>116</fpage>
          -
          <lpage>133</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>Morrison</surname>
            ,
            <given-names>C. M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ellis</surname>
            ,
            <given-names>A. W.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Real age of acquisition effects in word naming and lexical decision</article-title>
          .
          <source>British Journal of Psychology</source>
          ,
          <volume>91</volume>
          ,
          <fpage>167</fpage>
          -
          <lpage>180</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <string-name>
            <surname>Navarette</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Basagni</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alario</surname>
            ,
            <given-names>F.-X.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Costa</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Does word frequency affect lexical selection in speech production?</article-title>
          <source>The Quarterly Journal of Experimental Psychology</source>
          ,
          <volume>59</volume>
          ,
          <fpage>1681</fpage>
          -
          <lpage>1690</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <string-name>
            <surname>Rosch</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mervis</surname>
            ,
            <given-names>C. B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gray</surname>
            ,
            <given-names>W. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnson</surname>
            ,
            <given-names>D. M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Boyes-Braem</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>1976</year>
          ).
          <article-title>Basic objects in natural categories</article-title>
          .
          <source>Cognitive Psychology</source>
          ,
          <volume>8</volume>
          ,
          <fpage>382</fpage>
          -
          <lpage>439</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          <string-name>
            <surname>Schmid</surname>
            ,
            <given-names>H.-J.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Entrenchment, salience, and basic levels</article-title>
          . In D. Geeraerts &amp; H.
          <string-name>
            <surname>Cuyckens</surname>
          </string-name>
          (Eds.),
          <source>The Oxford Handbook of Cognitive Linguistics</source>
          . New York: Oxford University Press.
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          <string-name>
            <surname>Smolka</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zwitserlood</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Rösler</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Stem access in regular and irregular inflection: Evidence from German participles</article-title>
          .
          <source>Journal of Memory and Language</source>
          ,
          <volume>57</volume>
          ,
          <fpage>325</fpage>
          -
          <lpage>347</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          <string-name>
            <surname>Stemberger</surname>
            ,
            <given-names>J. P.</given-names>
          </string-name>
          (
          <year>1985</year>
          ).
          <article-title>An interactive activation model of language production</article-title>
          . In A. Ellis (Ed.),
          <article-title>Progress in the psychology of language</article-title>
          . Vol.
          <volume>1</volume>
          . London: Erlbaum.
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          <string-name>
            <surname>Thornton</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>MacDonald</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Plausibility and grammatical agreement</article-title>
          .
          <source>Journal of Memory and Language</source>
          ,
          <volume>48</volume>
          ,
          <fpage>740</fpage>
          -
          <lpage>759</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>