<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Inner Speech for a Self-Conscious Robot</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>A. Pipiton</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>A. Ch</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>C.N.R., Institute for High-Performance Computing and Networking (ICAR)</institution>
          ,
          <addr-line>Palermo</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Dept. of Industrial and Digital Innovation (DIID), University of Palermo</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The experience self-conscious thinking in the verbose form of inner speech is a common one. Such a covert dialogue accompanies the introspection of mental life and ful lls important roles in our cognition, such as self-regulation, self-restructuring, and re-focusing on attentional resources. Although the functional underpinning and the phenomenology of inner speech are largely investigated in psychological and philosophical elds, robotic research generally does not address such a form of self-conscious behavior. Existing models of inner speech inspire computational tools to provide the robot with a form of self-consciousness. Here, the most widespread psychological models of inner speech are reviewed, and a robot architecture implementing such a capability is outlined.</p>
      </abstract>
      <kwd-group>
        <kwd>Inner Speech Cognitive Architecture Robot Self-Consciousness Robot Thought</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Inner speech plays a central role in daily life. A person thinks over her mental
states, perspectives, emotions and external events by generating thoughts in
the form of linguistics sentences. Talking to herself enables the person to pay
attention to internal and external resources, to control and regulate her behavior,
to retrieve memorized facts, to learn and store new information and, in general,
to simplify otherwise demanding cognitive processes [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>Moreover, inner speech allows restructuring the perception of the external
world and the perception of self by enabling high-level cognition, including
selfcontrol, self-attention, and self-regulation.</p>
      <p>
        Even if second-order thoughts may not need language but, for example,
images or sensations, Bermudez [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], Jackendo [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], among others, argue that
genuine conscious thoughts need language. In the light of the above considerations,
inner speech is an essential ingredient in the design of a self-conscious robot.
      </p>
      <p>We model such a necessary capability within a cognitive architecture for
robot self-consciousness by considering the underlying cognitive processes and
components of inner speech.</p>
      <p>It should be remarked that in the present paper such processes are taken
into account independently from the origin of the linguistics abilities which are
supposed acquired by the robot.</p>
      <p>In Section 2 we show a brief overview of the cognitive models underlying
the proposed robot architecture, which is detailed in Section 3. Conclusions and
future works about the proposed robot architecture are discussed in Section 4.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Models of inner speech</title>
      <p>Inner speech cannot be directly observed, thus reducing the scope for
empirical studies. However, theoretical perspectives were developed during the last
decades, and some of them are recognized in di erent research communities.</p>
      <p>
        Vygotsky [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] conceives inner speech as the outcome of a developmental
process during which the linguistics interactions, such as between a child and a
caregiver, are internalized. The linguistically mediated explanation for solving a
task thus becomes an internalized conversation with the self, when the learner
is engaged in the same o similar cognitive tasks.
      </p>
      <p>
        Morin [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ][
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] claims that inner speech is intrinsically linked to self-awareness.
Self-focusing on an internal resource triggers the inner speech, and then it
generates self-awareness about such a resource. Typical sources for the self-focus
process are social interactions or mirror re ections by physical objects.
      </p>
      <p>
        Baddeley [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] discussed the roles of rehearsal and working memory, where
the di erent modules in the working memory are responsible for inner speech
rehearsal. In particular, the central executive oversees the process; the
phonological loop deals with spoken and written data, and the visuospatial sketchpad
deals with information in a visual or spatial form. The phonological loop is
composed of the phonological store for speech perception, which keeps information
in a speech-based form for a very short time (1-2 seconds), and of the
articulatory control process for speech production, that rehearses and stores verbal
information from the phonological store.
      </p>
      <p>
        Inner speech is usually conceived as the back-propagation of produced
sentences to an inner ear: thus, a person rehears the internal voice she delivers.
Steels [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] argued that the language re-entrance allows re ning the syntax
emerging during linguistic interactions within a population of agents. The syntax thus
becomes more complex and complete by parsing previously produced utterances
by the same agent.
      </p>
      <p>
        In the same line, Clowes [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] discussed an arti cial agent implemented by a
recurrent neural network whose output nodes are words interpreted as possible
actions (for example `up,' `left,' `right,' `grab'). When such words are re-entrant
by back-propagating the output to the input nodes, then the agent achieved the
task in far fewer generations than in the control condition where words are not
re-entrant.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>The cognitive architecture for inner speech</title>
      <p>
        al.[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Here, the structure and processing of the Standard Model are decomposed
with the aims to integrate the components and the processes de ned by the inner
speech theories previously discussed.
The perception of the proposed architecture includes the proprioception module
related to the self-perception of the emotions (Emo), the belief, desires and
intentions (BDI) and the robot body (Body), and the exteroception module
related to the perception of the outside environment.
      </p>
      <p>
        The proprioception module, according to Morin [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], is also stimulated by the
social milieu which, in the considered perspective, includes the social interactions
of the robot with the others entities in the environment, as physical objects like
the mirrors and the cameras and others robots or humans, by means face-to-face
interaction that foster self-world di erentiation.
      </p>
      <p>The motor module is decomposed in three sub-components: the Action
module, the Covert Articulation module (CA) and the Self Action module (SA). In
particular:
{ The Action module represents the actions the agent performs on the outside
world producing modi cations to the external environment (not including
the self) and the working memory.
{ The Covert Articulation (CA) module rehearses information from the
Phonological Store (PS), i.e., the perceptual bu er for speech-based data considered
as a sub-component of the short-term memory (see below). Such a module
acts as the inner voice heard by the phonological store by rounding
information in a loop. In this way, the inner speech links the covert articulation to
the phonological store in a round loop.
{ The Self Action (SA) module represents the actions that the agent performs
on itself, i.e., self-regulation, self-focusing, and self-analysis.
3.2</p>
      <sec id="sec-3-1">
        <title>The Memory System</title>
        <p>The memory structure, inspired by the Standard Model of the Mind is divided
into three types of memories: the short-term memory (STM), the procedural
and the declarative long-term memory (LTM), and the working memory system
(WMS).</p>
        <p>The short-term memory holds sensory information on the environment in
which the robot is plunged that were previously coded and integrated with
information coming by perception. As previously mentioned, the short-term memory
includes the phonological store.</p>
        <p>Information ow from perception to STM allows storing the aforementioned
coded signals. In particular, information from perception to the phonological
store is related to conscious thoughts from exteroception, and to self-conscious
thoughts from proprioception.</p>
        <p>The information ow from the working memory system to perception
provides expectations or possible hypotheses that are employed for in uencing the
attention process. In particular, the ow from the phonological store to
proprioception enables the self-focus modality.</p>
        <p>The long-term memory holds learned behaviors, semantic knowledge, and
experience. In the considered case, the declarative LTM contains the linguistics
information in terms of lexicon and grammatical structures, i.e., the LanguageLTM
memory. The declarative linguistics information is assumed acquired, as
speci ed above, and represent the grammar of the robot. Moreover, the Episodic
Long-Term Memory (EBLTM) is the declarative long-term memory component
which communicates to the Episodic Bu er (EB) within the working memory
system, that acts as a `backup' store of long-term memory data.</p>
        <p>The procedural LTM contains the composition rules according to which the
linguistic structures are arranged for producing sentences at di erent levels of
completeness and complexity. A procedure does not concern the grammatical
plausibility of the structures only. Other rules concerning the regulation, the
focusing and the restructuring of resources within the whole environment
(including the self) are to be considered.</p>
        <p>Finally, the working memory system holds task-speci c information `chunks'
and streamlines them to the cognitive processes during the task execution, step
by step according to the cognitive cycle of the Standard Model of the Mind. The
working memory system deals with cognitive tasks such as mental arithmetic
and problem-solving. The Central Executive (CE) sub-component manages and
controls the linguistic information of the rehearsal loop by the integrating (i.e.,
combining) data from the phonological loop and also drawing on data held in
the long-term memory.</p>
      </sec>
      <sec id="sec-3-2">
        <title>The Cognitive Cycle</title>
        <p>In brief, a cognitive cycle starts with the perception that converts external
signals in linguistics data and holds them into the phonological store. The central
executive manages the inner thinking process by enabling the working memory
system to selectively attend to some stimuli or ignore others, according to the
rules stored within the LTMs, and by orchestrating the phonological loop as a
slave system.</p>
        <p>At this stage, a conscious thought emerges as a result of a single round
between the phonological store and the covert articulation triggered by the
phonological loop, once the central executive has retrieved the data for the process.
The phonological loop enables the covert articulation which acts as a motor for
the internal production, and whose output stream is heard to the
phonological store. The output stream also a ects the self which is then regulated and
restructured.</p>
        <p>Once the conscious thought is elicited by inner speech, the perception of the
new context could take place, repeating the cognitive cycle.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>In this paper, a cognitive architecture for inner speech cognition is presented. It
is based on the Standard Model of Mind which was decomposed for including
some typical components of the inner speech's models for human beings.</p>
      <p>The working memory system of the architecture includes the phonological
loop considered by Baddeley as the main component for storing spoken and
written information and for implementing the cognitive rehearsal process.</p>
      <p>The covert dialogue is modeled as a loop in which the phonological store hears
the inner voice produced by the covert articulator process. The central executive
is the master system which drives the whole system.</p>
      <p>By retrieving linguistic information from the long-term memory, the
central executive contributes to creating the linguistic thought whose surface form
emerges by the phonological loop.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>This material is based upon work supported by the Air Force O ce of Scienti c
Research under award number FA9550-17-1-0232.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Alderson-Day</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fernyhough</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          : Inner Speech: Development,
          <string-name>
            <given-names>Cognitive</given-names>
            <surname>Functions</surname>
          </string-name>
          , Phenomenology, and
          <string-name>
            <surname>Neurobiology</surname>
          </string-name>
          .
          <source>Psychological Bulletin</source>
          <volume>141</volume>
          (
          <issue>5</issue>
          ),
          <volume>931</volume>
          {
          <fpage>965</fpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Baddeley</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <source>Working Memory. Science</source>
          <volume>255</volume>
          (
          <issue>5044</issue>
          ),
          <volume>556</volume>
          {
          <fpage>559</fpage>
          (
          <year>1992</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bermudez</surname>
            ,
            <given-names>J.L.</given-names>
          </string-name>
          :
          <article-title>The Paradox of Self-Consciousness</article-title>
          . MIT Press, Cambridge, MA (
          <year>1998</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Clowes</surname>
          </string-name>
          , R.:
          <article-title>A Self-Regulation Model of Inner Speech and its Role in the Organisation of Human Conscious Experience</article-title>
          .
          <source>Journal of Consciousness Studies</source>
          <volume>14</volume>
          (
          <issue>7</issue>
          ),
          <volume>59</volume>
          {
          <fpage>71</fpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Jackendo</surname>
          </string-name>
          , R.:
          <source>How Language Helps Us Think. Pragmatics &amp; Cognition</source>
          <volume>4</volume>
          (
          <issue>1</issue>
          ),
          <volume>1</volume>
          {
          <fpage>34</fpage>
          (
          <year>1996</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Laird</surname>
            ,
            <given-names>J.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lebiere</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosenbloom</surname>
            ,
            <given-names>P.S.:</given-names>
          </string-name>
          <article-title>A Standard Model of the Mind: Toward a Common Computational Framework across Arti cial Intelligence, Cognitive Science, Neuroscience, and Robotics</article-title>
          .
          <source>AI Magazine Winter</source>
          <year>2017</year>
          ,
          <volume>13</volume>
          {
          <fpage>26</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Morin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>A Neurocognitive and Socioecological Model of Self-Awareness</article-title>
          . Genetic, Social, and
          <source>General Psychology Monographs</source>
          <volume>130</volume>
          (
          <issue>3</issue>
          ),
          <volume>197</volume>
          {
          <fpage>222</fpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Morin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Possible Links Between Self-Awareness and Inner Speech</article-title>
          .
          <source>Journal of Consciousness Studies</source>
          <volume>12</volume>
          (
          <issue>4-5</issue>
          ),
          <volume>115</volume>
          {
          <fpage>134</fpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Steels</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Language Re-Entrance and the 'Inner Voice</article-title>
          .
          <source>' Journal of Consciousness Studies</source>
          <volume>10</volume>
          (
          <issue>4-5</issue>
          ),
          <volume>173</volume>
          {
          <fpage>185</fpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Vygotsky</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Thought and Language. Revised and expanded edition</article-title>
          . MIT Press, Cambridge, MA (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>