<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Ethical boundaries for android companion robots: a human perspective</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>y Fri</string-name>
          <email>cindzfriedman@gmail.com</email>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Philosophy, University of Pretoria</institution>
          ,
          <addr-line>Pretoria</addr-line>
          ,
          <country country="ZA">South Africa</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Literature on machine ethics tends to position itself on a spectrum where at one end sits notions about whether machines can be moral patients and, at the other end, sits notions of whether machines can be moral agents. While majority of the literature concerns itself with the latter - for example see [1], [2], [3] - my paper fits into the debate by focusing on the capacity for android companion robots to be moral patients in relation to their capacity to be phenomenally conscious in the sense of feeling what it is like [4] to be a moral patient and be morally wronged. It questions whether these robots should be treated morally well by human interactors and ultimately, whether there should be ethical boundaries established for their utilisation in the form of granting robots negative rights. As such, it grapples with both the descriptive and normative aspects of the topic, which seems to often be amiss in current machine ethics literature - an issue that Gunkel [5] has raised. I start my argument in favour of reflecting on the moral treatment of robots from a human perspective, by considering Turner's statement that “protection in law often follows shortly after society has recognised a moral case for protecting something” [6, p. 170] and critically analyse the concepts of there being a moral case to consider, as well as the need for protection, to formulate my argument for why we should establish ethical boundaries, but that we must, first and foremost, consider establishing ethical boundaries from a human perspective. Even though social robots of the kind we are considering here may not actually be conscious, human interactors may anthropomorphise them since they are, as Darling [7] and Scheutz [8] note, designed to elicit the tendency to anthropomorphise in human interactors. This creates the possibility for the formulation of 'real bonds' with these robots, despite robots not having the capacity to genuinely reciprocate human emotion - at least not currently, nor in the near future. The possibility for the formulation of 'real bonds', however, raises the question of whether treating them immorally may lower the moral standards of human interactors [9], [10]. Taking on a human perspective is thus a relational account in terms of the moral consideration of robots [11], [7], [12] since what matters is not whether robots are actually phenomenally conscious and can actually be moral patients who can feel what it is like to be morally wronged, but whether we view them as possessing the property of phenomenal consciousness due to the way in which we relate to them. Given this, and going back to Turner [6], if we take on a human perspective, there is a moral case for protecting something - this something being the human interactors - and the protection is from themselves. Thus, I argue that we must establish ethical boundaries but that the establishment of ethical boundaries must</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>firstly be considered from a human perspective so as to protect human interactors
from their own potential immoral behaviour.</p>
      <p>
        On the other hand, I suggest that in arguing for ethical boundaries from a ‘robot
perspective’, one implies that there is a moral case to consider for the sake of robots,
and that robots need protection from being treated immorally by human interactors –
that they warrant moral consideration because they can be moral patients and can feel
what it is like to be morally wronged. This is problematic. Firstly, if robots are not
actually conscious and cannot then feel what it is like to be morally wronged, from
what are we protecting them? Secondly, even if they were, or could one day be
conscious, we must still approach the topic at hand from a human perspective first and
foremost, because even if we cannot disprove the possibility of robot consciousness,
or even if robots can mimic consciousness, our misdeeds towards them may still
negatively impact our moral standards. Therefore, taking on such a ‘robot perspective’
would mean taking on a property account towards the moral consideration of robots
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] which pertains to basing moral consideration on whether robots possess
particular properties, such as phenomenal consciousness in this instance. This account,
however, is highly problematic because, firstly, which property do we take into
consideration (consciousness, personhood, sentience)? And, secondly, it is difficult to prove
that humans possess such properties, raising the question of how we could even begin
to prove such properties in robots?
      </p>
      <p>
        I then consider granting rights to robots. Given the overlap between morality and
legality [13, p. 169] I suggest granting negative rights to robots so as to inhibit the
maltreatment of robots by human interactors, thereby preventing negative impact
upon the moral fibre and quality of human societies. In literature on robot rights, few
authors clarify which kind of rights should, or should not, be granted to robots –
something with which Tavani [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] takes issue. Although homing in on the concept of
negative rights remains a broad account of the kind of rights that should be granted, it
is, nonetheless, a distinction I have not yet come across. I draw the distinction
between positive and negative rights from Berlin’s [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] account on positive and
negative liberty. Negative rights are rights that protect us from something. Positive rights,
however, are rights we have to something. Negative rights, therefore, oblige inaction,
since they protect people from being subjected to an immoral action. In this regard, if
we considered granting robots negative rights, this would not be granting them for the
sake of the robot but rather granting them so as to inhibit maltreatment, thereby
possibly lessening negative impacts upon their human interactors. This provides a new
perspective regarding the debate surrounding robot rights.
      </p>
      <p>I thus conclude that regardless of the case for treating robots well from their own
perspective, the case from the human perspective is enough to argue that robots
should be treated morally well. Taking on this humanistic perspective will guide the
way as to how we should go about formulating much needed ethical boundaries for
our interaction with social robots, as well as what these ethical boundaries should
ultimately be.</p>
      <p>Keywords: android, companion robot, social robot, robot rights, robot ethics, moral
patiency, HRI.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Anderson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anderson</surname>
            ,
            <given-names>S. L.: Machine</given-names>
          </string-name>
          <string-name>
            <surname>Ethics</surname>
          </string-name>
          . Cambridge University Press, Cambridge (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Bostrom</surname>
          </string-name>
          , N.: Superintelligence: Paths, dangers, strategies. Oxford University Press, New York (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Wallach</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Allen</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          : Moral Machines:
          <article-title>Teaching robots right from wrong</article-title>
          . Oxford University Press, Oxford (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Nagel</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>What is it like to be a bat?</article-title>
          .
          <source>Philosophical Review</source>
          <volume>83</volume>
          (
          <issue>October</issue>
          ),
          <fpage>435</fpage>
          -
          <lpage>450</lpage>
          (
          <year>1974</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Gunkel</surname>
            ,
            <given-names>D. J.:</given-names>
          </string-name>
          <article-title>The other question: can and should robots have right?</article-title>
          .
          <source>Ethics and Information Technology</source>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Turner</surname>
          </string-name>
          , J.:
          <article-title>Why Robot Rights?</article-title>
          .
          <source>In: Robot Rules: Regulating Artificial Intelligence</source>
          , pp.
          <fpage>145</fpage>
          -
          <lpage>171</lpage>
          . Palgrave Macmillan,
          <string-name>
            <surname>Cham</surname>
          </string-name>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Darling</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Extending legal protection to social robots: the effects of anthropomorphism, empathy, and violent behavior towards robotic objects</article-title>
          . In: Kerr,
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Froomkin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Calo</surname>
          </string-name>
          , R. M. (eds.) Robot Law. Edward Elgar,
          <string-name>
            <surname>Cheltenham</surname>
          </string-name>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Scheutz</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>The Inherent Dangers of Unidirectional Emotional Bonds</article-title>
          . In: Lin,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Abney</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            ,
            <surname>Bekey</surname>
          </string-name>
          ,
          <string-name>
            <surname>G. A</surname>
          </string-name>
          . (eds.)
          <source>Robot Ethics: The Ethical and Social Implications of Robotics</source>
          , pp.
          <fpage>205</fpage>
          -
          <lpage>221</lpage>
          . MIT Press, Cambridge (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Levy</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>The Ethical Treatment of Artificially Conscious Robots</article-title>
          .
          <source>International Journal of Social Robotics</source>
          <volume>1</volume>
          (
          <issue>3</issue>
          ),
          <fpage>209</fpage>
          -
          <lpage>216</lpage>
          (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Ramey</surname>
          </string-name>
          , C. H.:
          <article-title>'For the sake of others': The 'personal' ethics of human-android interaction</article-title>
          . pp.
          <fpage>137</fpage>
          -
          <lpage>148</lpage>
          . Cognitive Science Society, Stresa (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Coeckelbergh</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Robot rights? Towards a social-relational justification of moral consideration</article-title>
          .
          <source>Ethics and Information Technology</source>
          <volume>12</volume>
          (
          <issue>3</issue>
          ),
          <fpage>209</fpage>
          -
          <lpage>221</lpage>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Tavani</surname>
          </string-name>
          , H. T.:
          <article-title>Can Social Robots Qualify for Moral Consideration? Reframing the Question about Robot Rights</article-title>
          .
          <source>Information</source>
          <volume>9</volume>
          (
          <issue>73</issue>
          ), (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Asaro</surname>
            ,
            <given-names>P. M.:</given-names>
          </string-name>
          <article-title>A Body to Kick, but Still No Soul to Damn: Legal Perspectives</article-title>
          . In: Lin,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Abney</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            , &amp;
            <surname>Bekey</surname>
          </string-name>
          ,
          <string-name>
            <surname>G. A.</surname>
          </string-name>
          , (eds.)
          <source>Robot Ethics: The Ethical and Social Implications of Robotics</source>
          , pp.
          <fpage>169</fpage>
          -
          <lpage>186</lpage>
          . MIT Press, Cambridge (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14. Berlin, I.:
          <article-title>Two Concepts of Liberty</article-title>
          . In: Four Essays on Liberty, pp.
          <fpage>118</fpage>
          -
          <lpage>172</lpage>
          . Oxford: Oxford University Press, Oxford (
          <year>1969</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>