<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Dissociating Intelligence from Consciousness in Artificial Systems - Implications of Integrated Information Theory</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Graham Findlay</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>William Marshall</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Larissa Albantakis</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>William Mayner</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Chris- tof Koch</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Giulio Tononi</string-name>
          <email>gtononi@wisc.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Allen Institute for Brain Science</institution>
          ,
          <addr-line>Seattle WA</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Wisconsin-Madison</institution>
          ,
          <addr-line>Madison WI</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Recent years have seen dramatic advancements in artificial intelligence (AI). How we interact with AI will depend on whether we think they are conscious entities with the ability to experience, for example, pain and pleasure. We address this question within the framework of integrated information theory (IIT), a general, quantitative theory of consciousness that allows extrapolations to non-biological systems. We demonstrate (manuscript submitted elsewhere) an important implication of IIT: that computer systems with traditional hardware architectures would not share our experiences, even if they were to replicate our cognitive functions or simulate our brains in ultra-fine detail.</p>
      </abstract>
      <kwd-group>
        <kwd>Consciousness</kwd>
        <kwd>Integrated Information Theory</kwd>
        <kwd>Artificial Intelligence</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>If a computer were functionally equivalent to a human, having the same cognitive
abilities, would it necessarily experience sights, sounds, and thoughts, as we do when we
are conscious?</p>
      <p>
        Integrated Information Theory (IIT) [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ] offers a principled explanation for how
consciousness relates to physical substrates, aims at providing a mathematical
framework to determine whether and how a system is conscious [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ], makes testable
predictions, and is supported by scientific evidence about our own consciousness [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>We applied IIT to a simple target system, constituted of a few discrete dynamical
logic gates, which minimally satisfies the properties required by IIT to support
consciousness, and to a more complicated ‘computer’ system, constituted of dozens of
logic gates, which is programmed to be functionally equivalent to the target system
(Fig. 1). Using the quantitative framework of IIT, we show that even though the
computer replicates the input-output functions of the target system exactly and indefinitely,
it fails to replicate its purported experience. Our results demonstrate that, according to
IIT, functional equivalence (“doing the same thing”) does not imply phenomenal
equivalence (“having the same experience”).</p>
      <p>As an extreme illustration of the dissociation between function and phenomenology,
we also analyze a Turing-complete computer (not shown) that is negligibly conscious
according to IIT, regardless of its programmed function. If computable functions exist
for simulating human brains, then they could therefore be implemented by this
computer while its experience remained negligible. We conclude that computer systems
with traditional architectures, even if they were to replicate our cognitive functions or
simulate the neuronal interactions occurring within our brain, would not replicate our
experiences.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Tononi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boly</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Massimini</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koch</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Integrated information theory: from consciousness to its physical substrate</article-title>
          .
          <source>Nature Reviews Neuroscience</source>
          ,
          <volume>17</volume>
          (
          <issue>7</issue>
          ),
          <fpage>450</fpage>
          -
          <lpage>461</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Oizumi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Albantakis</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tononi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3.0</article-title>
          .
          <source>PLoS Computational Biology</source>
          ,
          <volume>10</volume>
          (
          <issue>5</issue>
          ),
          <year>e1003588</year>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Mayner</surname>
            ,
            <given-names>W. G. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marshall</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Albantakis</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Findlay</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marchman</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tononi</surname>
          </string-name>
          , G.:
          <article-title>PyPhi: A toolbox for integrated information theory</article-title>
          .
          <source>PLOS Computational Biology</source>
          ,
          <volume>14</volume>
          (
          <issue>7</issue>
          ),
          <year>e1006343</year>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>