<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The Role of the Sensorimotor Loop for Cognition</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Bulcs u´ Sa´ndor</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Laura Martin</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Claudius Gros</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute for Theoretical Physics Goethe University Frankfurt</institution>
          <addr-line>Frankfurt a.M.</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2016</year>
      </pub-date>
      <fpage>40</fpage>
      <lpage>41</lpage>
      <abstract>
        <p>-Locomotion is most of the time considered to be the result of top-down control commands produced by the nervous system in response to inputs received via sensory organs from the environment. Locomotion may arise alternatively when attracting states are stabilized in the combined dynamical space made up by the brain, the body and the environment. Cognition is embodied in this case within the sensorimotor loop, viz self-organized. Using a physics simulation environment we show that self-organized locomotion may result in complex phase spaces which include limit cycle corresponding to regular movements and both strong and partially predictable chaos describing explorative behavior.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>I. INTRODUCTION</title>
      <p>
        We used the LPZRobots physics simulation environment [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
to investigate the occurrence of self-organized embodiment in
robots for which sensation is confined to propio-sensation. The
‘brain’ of the robot, consisting of a single controlling neuron
per actuator, receives sensory information only regarding the
actual position x(a) of the actuators i = 1; 2; 3, which are in
i
turn translated via
x(t) = R [2y(xi)
i
1] ;
to a target position x(t) for the i-th actuator (compare Fig. 1).
      </p>
      <p>i
R denotes here the (rescaled) radius of the spherical robot and
y(xi) = 1=(1 + exp( xi)) the firing rate of the controlling
neuron. The membrane potential xi is determined via
x_ i =
xi +
w0
2R
x(a) + R
i
z0 X uj 'j y(xj )
j6=i
(1)
(2)</p>
      <p>STSP does not induce any long-lasting traces (modifications
of the synaptic strength), being hence a fully transient form
of plasticity which tends to destablize fixpoint attractors.</p>
    </sec>
    <sec id="sec-2">
      <title>II. AUTONOMOUS MODE SWITCHING</title>
      <p>
        The here considered robot moves only, as an entity
comprised of body and controlling neurons, when embedded
within the environment. Locomotion corresponds then to
selfstabilizing attractors in the combined phase space of the
controlling neural network, of the body and of the environmental
degrees of freedom it couples to [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>Our robot may engage in a rich palette of regular motion
patterns, as illustrated in Fig. 2, which are stable either for
distinct sets of internal parameters, such as the bare synaptic
weights w0 and z0, or simultaneously. Autonomous mode
switching corresponding to a rollover from one to another
basin of attraction occurs regularly in the latter case upon
collision with either an external object, or with another robot. We
note, importantly, that limit-cycles corresponding to regular
motion, as shown in Fig. 2, are continuously degenerate with
respect to the direction and/or to the center of propagation.</p>
    </sec>
    <sec id="sec-3">
      <title>III. EXPLORATIVE CHAOS</title>
      <p>
        Explorative behavior arises when the synaptic weights w0
and z0 are set such that chaotic attractors are formed within the
by the relaxation constant , by the coupling w0 &gt; 0 to
the proprio-sensory reading of xi(a), and with ( z0) &lt; 0 by
the inhibition it receives from the other two neurons. The
interneural inhibition is dynamically modulated
presynaptically by a mechanism known as short-term synaptic plasticity
(STSP) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], which we model as [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]:
u_
'_
=
=
      </p>
      <p>U(y) u
(uT;uy) '</p>
      <p>T'</p>
      <p>U (y)
(u; y)
=
= 1
1 + (Umax</p>
      <p>1)y
Uumyax :
Both the effective Ca2+ concentration u and the fraction of
available vesicles ' of neurotransmitters relax to unity in the
absence of a presynaptic input y, which, when present, tends
to increase/decrease u ! Umax and ' ! 0 respectively.</p>
      <p>
        We note that STSP is well known to change synaptic
efficiencies transiently by up-to fifty percent on time scales of
a few hundred milliseconds, as defined by Tu and T'. These
are also the time scales which are relevant for locomotion.
Fig. 1. The simulated robot contains three weights (red, green and blue)
moving along perpendicular rods within a movable sphere. The position of
the three weights is controlled respectively by a single neuron (see Eqs. (1)
and (2)). The small balls at the end of the respective rods are guides to the
eye. [video]
sensorimotor loop. We note that noise is absent for the
simulations shown in Fig. 3, with the seemingly random wandering
of the robot resulting exclusively from the chaotic nature of
the underlying attractor. Two types of chaotic attractors may
be stabilized in addition, denoted respectively as strong and
as partially predictable chaos [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>IV. PLAYFUL LOCOMOTION</title>
      <p>
        Morphological computation [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] may occur when
the body plays a central role in cognition. For a test of this
concept we have situated the sphere robot in a structured
environment, as shown in Fig. 4, containing movable blocks.
One observes that our three-neuron robot starts to engage in
a seemingly ‘playful’ manner with its environment, pushing
blocks around by bumping into individual objects repeatedly.
This occurs, from a dynamical systems point of view, when the
robot switches upon collisions back and forth between stable
chaotic motion and another weakly unstable, or alternatively
as in Fig. 3, stable coexisting limit-cycle attractor describing
regular locomotion.
      </p>
    </sec>
    <sec id="sec-5">
      <title>V. CONCLUSION</title>
      <p>The sphere robot does neither perform any form of
knowledge acquisition with its brain consisting of only three
neurons, nor does its ‘cognitive system’ dispose of higher-level
internal drives or motivations. The explorative behavior
observed in Figs. 3 and 4 can be explained on the contrary fully
in terms of dynamical systems theory. Taking a philosophical
perspective our simulated robots hence demonstrate that it is in
general impossible for an external observer to deduce reliably
the internal settings and motivations of an acting cognitive
system.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>R.</given-names>
            <surname>Der</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Martius</surname>
          </string-name>
          ,
          <source>The Playful Machine: Theoretical Foundation and Practical Realization of Self-Organizing Robots. Springer Science &amp; Business Media</source>
          ,
          <year>2012</year>
          , vol.
          <volume>15</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M. V.</given-names>
            <surname>Tsodyks</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Markram</surname>
          </string-name>
          , “
          <article-title>The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability</article-title>
          ,
          <source>” Proceedings of the National Academy of Sciences</source>
          , vol.
          <volume>94</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>719</fpage>
          -
          <lpage>723</lpage>
          ,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>L.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Sa</surname>
          </string-name>
          ´ndor, and C. Gros, “
          <article-title>Closed-loop robots driven by shortterm synaptic plasticity: Emergent explorative vs. limit-cycle locomotion,” Frontiers in Neurorobotics</article-title>
          , vol.
          <volume>10</volume>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>B.</given-names>
            <surname>Sa</surname>
          </string-name>
          ´ndor, T. Jahn,
          <string-name>
            <given-names>L.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and C.</given-names>
            <surname>Gros</surname>
          </string-name>
          , “
          <article-title>The sensorimotor loop as a dynamical system: How regular motion primitives may emerge from self-organized limit cycles</article-title>
          ,
          <source>” Frontiers in Robotics and AI</source>
          , vol.
          <volume>2</volume>
          , p.
          <fpage>31</fpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>H.</given-names>
            <surname>Wernecke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Sa</surname>
          </string-name>
          ´ndor, and C. Gros, “
          <article-title>How to test for partially predictable chaos</article-title>
          ,
          <source>” arXiv preprint arXiv:1605.05616</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>V. C.</surname>
          </string-name>
          <article-title>Mu¨ller and M. Hoffmann, “What is morphological computation? on how the body contributes to cognition and control</article-title>
          ,” Artificial Life, to be published.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>R.</given-names>
            <surname>Pfeifer</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Bongard</surname>
          </string-name>
          ,
          <article-title>How the body shapes the way we think: a new view of intelligence</article-title>
          . MIT press,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>R.</given-names>
            <surname>Der</surname>
          </string-name>
          and
          <string-name>
            <surname>G</surname>
          </string-name>
          . Martius, “
          <article-title>Self-organized behavior generation for musculoskeletal robots,” Frontiers in Neurorobotics</article-title>
          , vol.
          <volume>11</volume>
          , p.
          <fpage>8</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>