<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Homeostatically Motivated Intelligence for Feeling Machines</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Kingson Man</string-name>
          <email>kman@usc.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Antonio Damasio</string-name>
          <email>damasio@usc.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Southern California</institution>
          ,
          <addr-line>Los Angeles CA 90089</addr-line>
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We present a position paper of work-in-progress on homeostatically motivated artificial intelligence.</p>
      </abstract>
      <kwd-group>
        <kwd>Homeostasis</kwd>
        <kwd>Feeling</kwd>
        <kwd>Consciousness</kwd>
        <kwd>Soft Robots</kwd>
        <kwd>Multisensory Integration</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>We propose the design and construction of a new class of machines organized
according to the principles of life regulation. These machines have physical constructions—
bodies—that must be maintained by homeostasis within a narrow range of viability
states and thus share some essential traits with all living systems. The fundamental
innovation of these machines is the introduction of risk to self. Rather than up-armoring
or adding raw processing power to achieve resilience, we begin the design of these
robots by, paradoxically, introducing vulnerability. Drawing on recent developments in
soft robotics and algorithms for multisensory abstraction, we outline a way forward to
more biologically authentic implementations of feeling in machines.</p>
      <p>
        The main motivation for this project is a set of theoretical contributions to the
understanding of biological systems endowed with feeling. Damasio has provided a
rationale for the emergence of feelings as a means to optimize survival, a process that is
closely associated with the biological basis of selfhood
        <xref ref-type="bibr" rid="ref4">(Damasio 2018)</xref>
        . Feelings are
intrinsically about something: the state of life in the organism, the likelihood of
persistence with well-being or, instead, failure, disease, and death. Ultimately, feelings help
achieve homeostasis, i.e., survival with an energy surplus capable of ensuring a future.
Organisms do not take a neutral or value-free stance towards information processing.
What they do, and think, matters to them.
      </p>
      <p>Machines that implement a process resembling homeostasis might acquire a new
source of motivation and evaluation of behavior, akin to that of feelings in living
organisms. The world affords risks and opportunities, not in relation to an arbitrary
reward or loss function, but in relation to the continued existence of the robot itself.
Rewards aren’t rewarding and losses don’t hurt unless they are rooted in the ground of life
and death. True agency arises when the machine picks a side in this dichotomy, when
it acts with a preference for existence over dissolution. A robot engineered to participate
in its own homeostasis might finally become its own locus of concern. This elementary</p>
    </sec>
    <sec id="sec-2">
      <title>Background</title>
      <p>concern infuses meaning into information processing. A robot operating on intrinsically
meaningful representations might seek broadly intelligent solutions to the human
relevant tasks set before it, natural and social.</p>
      <p>Our approach diverges from traditional conceptions of intelligence that emphasize
outward-directed perception and abstract problem solving. We regard high-level cognition
as an outgrowth of resources that originated to solve the ancient biological problem of
homeostasis. A physical body is subject to perennial risk and decay. But to a
disembodied algorithm—or to a robot whose physical persistence is guaranteed—nothing can
happen that carries any consequences. Sense-data become meaningful when the data
are connected to the maintenance and integrity of the sensing agent and to its
homeostasis. Sensory processing that is not attached to a vulnerable body “makes no sense”.</p>
      <p>
        The presence of a body serving as an aid or scaffold to problem-solving does not
suffice to generate meaning – otherwise all physical robots would be trivially eligible.
Preliminary steps have been taken to add “emotional circuits” to influence robotic goal
selection
        <xref ref-type="bibr" rid="ref12">(Parisi &amp; Petrosino 2010)</xref>
        . Others have constructed robots capable of
emotional expressions (typically through facial movements) to facilitate human-robot
interaction (Brezeal 2003). But these motivation schedules and emotional performances
have not been rooted in the machine’s own “life-state” and “well-being”. The emotions
and “values” underlying them were not relevant to the continuance of the system itself.
Such systems ultimately lack a viability constraint. All robots of this class appear to be
biologically indifferent
        <xref ref-type="bibr" rid="ref14">(see Jonas 1966)</xref>
        , and, in reality, affect-less.
      </p>
      <p>
        Di Paolo (2003) has criticized the program of embodied robotics as still missing an
organism-level logic. Previous work has produced agents that can regulate their own
susceptibility to environmental cues based on abstract internal variables
        <xref ref-type="bibr" rid="ref11 ref7">(Parisi 2004;
Doya &amp; Uchibe 2005)</xref>
        . In simulation experiments making explicit reference to
homeostasis, phototactic robots used neural plasticity to restore adaptive behavior following
visual inversion
        <xref ref-type="bibr" rid="ref5">(Di Paolo 2000)</xref>
        .
      </p>
      <p>
        We advocate a transition from embodied artificial intelligence to homeostatically
motivated artificial intelligence. Intelligence has been defined as “an agent’s ability to
achieve goals in a wide range of environments.”
        <xref ref-type="bibr" rid="ref8">(Legg &amp; Hutter 2007)</xref>
        This
immediately prompts the follow-up question: “Whose goals?” An agent that myopically
follows orders, to the extent that it endangers itself and its ability to follow future orders,
is no great intellect.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Soft Power</title>
      <p>The past decade has witnessed the birth of the sub-discipline of soft robotics. This was
enabled by new discoveries in the design and construction of soft “tissues” embedded
with electronics, sensors, and actuators. These artificial tissues are flexible, stretchable,
compressible, and bounce back resiliently. In short, they are naturally compliant with
their environments. Soft materials potentially provide a richer source of information on
body and environment than do traditional rigid materials.</p>
      <p>Living organisms are composed of tissues that participate in their own
self-maintenance. Living tissues sense and signal the state of their life process. In contrast, consider
the “life” of a piece of sheet metal bent into a boxy robot. In general, metal is so durable
in comparison to its niche – our human environment – that its security and viability are
afterthoughts. Metals and hard plastics are ubiquitous in robotics with the consequence
that, in most cases, material integrity can be safely ignored. But durability comes at a
cost. An invulnerable material has not much to say about its well-being. If we imagine
strain gauges embedded throughout a hard surface, they would spend most of their time
reporting “no change”, until a catastrophic failure occurs and all the sensors cry out for
the first and last time.</p>
      <p>
        Soft robots, on the other hand, more readily enter into a graceful and sensitive
coupling with the environment
        <xref ref-type="bibr" rid="ref13 ref15 ref16">(see reviews by Rogers et al 2010; Pfeifer et al 2014; Rus
&amp; Tolley 2015)</xref>
        . Under stress, they deform without breaking, then enter a gradual
decline instead of sudden failure. The same strain gauges embedded in the volume of a
soft material can localize forces and signal graded disruptions in body surface
continuity, such as caused by punctures and tears. Soft materials have continuously varying
morphology, admitting of more points of contact, control, and force dispersion. They
densely sample the environment across multiple sensing modalities, returning rich
information about evolving interaction. In short, soft matter is more likely to create the
kind of relationship that admits of feeling.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>Computing Crossmodal Associations</title>
      <p>
        The effort to build a robot with a homeostatic self representation would present a
complex exercise in machine learning. It could draw upon a neuroarchitectural framework
originally proposed in 1989
        <xref ref-type="bibr" rid="ref2 ref3">(Damasio 1989 a,b)</xref>
        . According to this framework, sensory
inputs coalesce into abstract concepts by being progressively re-mapped in a neural
hierarchical fashion, with each higher level registering more complex features. Nodes
in each level can also reinstantiate their lower-level constituent features by top-down
projections. This convergence-divergence architecture can form representations that
bridge across the sensory modalities
        <xref ref-type="bibr" rid="ref10 ref9">(Meyer &amp; Damasio 2009; Man et al 2013)</xref>
        .
      </p>
      <p>
        Crucially, crossmodal processing can accommodate the interoceptive modalities. A
proposal has been made that the feeling of existence itself, or of conscious presence,
may be due to predictive coding of internal sensations
        <xref ref-type="bibr" rid="ref17">(Seth et al 2012)</xref>
        . In theory,
external objects can be bound together with internal homeostatic parameters. In practice,
however, this invariant mapping is still elusive in the literatures on human brains and
machine brains.
      </p>
      <p>There is an intriguing correspondence between the biological architecture of sensory
convergence and some variants of deep neural networks. We suggest that artificial
neural networks are poised to tackle the next great challenge of building correspondences
between inner space and outer space, between internal homeostatic data and external
sense data.</p>
      <p>A machine in charge of its own self-regulation, and constructed of soft and sensitive
tissues, will have a wealth of internal data upon which to draw to inform its plans and
perceptions. The homeostatic robot will process information with the aid of something
akin to feeling. How does the color, taste, and texture, say, of an apple, systematically
associate with changes to the ongoing management of life? All of which is to say that
the question “How does this make you feel?” might soon be asked of machines.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Breazeal</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <year>2003</year>
          .
          <article-title>Emotion and sociable humanoid robots</article-title>
          .
          <source>International Journal of HumanComputer Studies</source>
          <volume>59</volume>
          (
          <issue>1-2</issue>
          ):
          <fpage>119</fpage>
          -
          <lpage>155</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Damasio</surname>
            ,
            <given-names>A.R.</given-names>
          </string-name>
          <year>1989</year>
          .
          <article-title>The brain binds entities and events by multiregional activation from convergence zones</article-title>
          .
          <source>Neural computation</source>
          <volume>1</volume>
          (
          <issue>1</issue>
          ):
          <fpage>123</fpage>
          -
          <lpage>132</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Damasio</surname>
            ,
            <given-names>A.R.</given-names>
          </string-name>
          <year>1989</year>
          .
          <article-title>Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition</article-title>
          .
          <source>Cognition</source>
          <volume>33</volume>
          (
          <issue>1-2</issue>
          ):
          <fpage>25</fpage>
          -
          <lpage>62</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Damasio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <year>2018</year>
          .
          <article-title>The Strange Order of Things: Life, feeling, and the making of cultures</article-title>
          . Pantheon.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Di</given-names>
            <surname>Paolo</surname>
          </string-name>
          ,
          <string-name>
            <surname>E. A.</surname>
          </string-name>
          <year>2000</year>
          .
          <article-title>Homeostatic adaptation to inversion of the visual field and other sensorimotor disruptions</article-title>
          . In Meyer, J.-A.,
          <string-name>
            <surname>Berthoz</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Floreano</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roitblat</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp; Wilson, S. (Eds.),
          <source>From Animals to Animats 6: Proceedings of the Sixth International Conference on the Simulation of Adaptive Behavior</source>
          . Cambridge MA: MIT Press.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Di</given-names>
            <surname>Paolo</surname>
          </string-name>
          ,
          <string-name>
            <surname>E.</surname>
          </string-name>
          ,
          <year>2003</year>
          .
          <article-title>Organismically-Inspired Robotics: Homeostatic Adaptation and Teleology Beyond the Closed Sensorimotor Loop</article-title>
          .
          <article-title>Dynamical systems approach to embodiment and sociality</article-title>
          ,
          <volume>19</volume>
          -
          <fpage>42</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Doya</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Uchibe</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <year>2005</year>
          .
          <article-title>The Cyber Rodent Project: Exploration of Adaptive Mechanisms for Self-Preservation and</article-title>
          <string-name>
            <surname>Self-Reproduction</surname>
          </string-name>
          .
          <source>Adaptive Behavior</source>
          <volume>13</volume>
          (
          <issue>2</issue>
          ):
          <fpage>149</fpage>
          -
          <lpage>160</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Legg</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Hutter</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <year>2007</year>
          .
          <article-title>Universal intelligence: A definition of machine intelligence</article-title>
          .
          <source>Minds and Machines</source>
          <volume>17</volume>
          (
          <issue>4</issue>
          ):
          <fpage>391</fpage>
          -
          <lpage>444</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Man</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Kaplan</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ; Damasio,
          <string-name>
            <given-names>H.</given-names>
            ;
            <surname>Damasio</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          <year>2013</year>
          .
          <article-title>Neural convergence and divergence in the mammalian cerebral cortex: from experimental neuroanatomy to functional neuroimaging</article-title>
          .
          <source>Journal of Comparative Neurology</source>
          <volume>521</volume>
          (
          <issue>18</issue>
          ):
          <fpage>4097</fpage>
          -
          <lpage>4111</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. Meyer,
          <string-name>
            <given-names>K.</given-names>
            &amp;
            <surname>Damasio</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          <year>2009</year>
          .
          <article-title>Convergence and divergence in a neural architecture for recognition and memory</article-title>
          .
          <source>Trends in neurosciences 32</source>
          <volume>(7)</volume>
          :
          <fpage>376</fpage>
          -
          <lpage>82</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Parisi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <year>2004</year>
          .
          <article-title>Internal robotics</article-title>
          .
          <source>Connection science 16</source>
          (
          <issue>4</issue>
          ):
          <fpage>325</fpage>
          -
          <lpage>338</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Parisi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ; Petrosino,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <year>2010</year>
          .
          <article-title>Robots that have emotions</article-title>
          .
          <source>Adaptive Behavior</source>
          <volume>18</volume>
          (
          <issue>6</issue>
          ):
          <fpage>453</fpage>
          -
          <lpage>469</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Pfeifer</surname>
          </string-name>
          , R.;
          <string-name>
            <surname>Iida</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Lungarella</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <year>2014</year>
          .
          <article-title>Cognition from the bottom up: On biological inspiration, body morphology, and soft materials</article-title>
          .
          <source>Trends in Cognitive Sciences</source>
          ,
          <volume>18</volume>
          (
          <issue>8</issue>
          ):
          <fpage>404</fpage>
          -
          <lpage>413</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Jonas</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          <year>1966</year>
          .
          <article-title>The Phenomenon of Life</article-title>
          . Northwestern University Press.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Rogers</surname>
            ,
            <given-names>J.A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Someya</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Huang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <year>2010</year>
          .
          <article-title>Materials and Mechanics for Stretchable Electronics</article-title>
          .
          <source>Science</source>
          <volume>327</volume>
          (
          <issue>5973</issue>
          ):
          <fpage>1603</fpage>
          -
          <lpage>1607</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Rus</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Tolley</surname>
            ,
            <given-names>M.T.</given-names>
          </string-name>
          <year>2015</year>
          .
          <article-title>Design, fabrication and control of soft robots</article-title>
          .
          <source>Nature</source>
          <volume>521</volume>
          (
          <issue>7553</issue>
          ):
          <fpage>467</fpage>
          -
          <lpage>475</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Seth</surname>
            ,
            <given-names>A.K.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Suzuki</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ; and Critchley,
          <string-name>
            <surname>H.D.</surname>
          </string-name>
          <year>2012</year>
          .
          <article-title>An interoceptive predictive coding model of conscious presence</article-title>
          .
          <source>Frontiers in Psychology</source>
          <volume>2</volume>
          :
          <fpage>395</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>