<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Participation in Smart Systems</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sabine Thürmel</string-name>
          <email>sabine@thuermel.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Munich Center of Technology in Society, Technische Universität München (TUM)</institution>
          ,
          <addr-line>Munich</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Both humans and nonhumans can commit to participate in distributed problem solving in smart systems. Therefore the state of the art in collaborative coordination in agent-based smart systems, commitment to joint action, and the potential dysfunctional cooperative behaviour in such social computing systems is described.</p>
      </abstract>
      <kwd-group>
        <kwd>participation</kwd>
        <kwd>social computing</kwd>
        <kwd>multiagent systems</kwd>
        <kwd>smart systems</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Software agents are no longer mere tools, but have become interactions partners. The
degrees of freedom built into computational artefacts can materialize in individual
acts, mandated actions or collaborative interaction. New capabilities may emerge over
time on the individual level. Self-organisation and coalition forming on the group
level can occur. New cultural practices and novel institutional policies may emerge.
Due to these developments we may speak of a participatory turn when assessing the
current division of labour between humans and nonhumans.</p>
      <p>Participation of human (and nonhuman) actors in computer-based environments
requires the communicative involvement within a computer-mediated and
(frequently) open organisational structure where a predefined goal is pursued.</p>
      <p>
        Purely human online participation is explored in a wide variety of research projects
e.g. at the Alexander von Humboldt Institute for Internet and Society [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The study of
the motivation for the participation in e-petitions [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] is one concrete example of such
investigations [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Participation of nonhumans (and humans) can be found in multiagent systems
(MAS). MAS focus on the simulation of complex interactions and relationships of
individual human and/or nonhuman agents. They represent a variant of social
computing systems. Examples range from swarm intelligence systems to the simulation of
sophisticated organisational structures. Social computing systems and especially MAS
may be deployed in experimental environments as well as outside the laboratory. In
testbed environments they are composed exclusively of software agents. From a
computer scientist’s perspective they are best suited to offer heuristics for NP-complete
problems in planning, optimization and all kinds of knowledge acquisition in open
environments where knowledge is local and distributed. They represent a variant of
crowd-based socio-cognitive systems (CBSC). As Pablo Noriega rightly remarked
after the workshop CBSC may also enable interactions to accomplish activities that
need not (may not) be conceived as problems and even when you design one such
system to solve one particular problem there needs not be an epistemic challenge.
While this is also true for MAS, it must be noted that they are currently mainly used
in computational sciences projects - may it be in computational science and
engineering, computational sociology or even in legal engineering: “Crowd simulation”
systems are useful if evacuation plans have to be developed. Demonstrators for the
coordination of emergency response services in disaster management systems, based on
electronic market mechanisms, have been built [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. The Agile project (Advanced
Governance of Information services through Legal Engineering) even searched for a
Ph.D candidate to develop new policies in tax evasion scenarios based on ABMs [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
The novel technical options of “social computing“ do not only offer to explain social
behaviour but they may also suggest ways how to change it.
      </p>
      <p>
        Moreover, MAS provide a basis to cyberphysical systems. Whereas “classical
computer systems separate physical and virtual worlds, cyberphysical systems (CPS)
observe their physical environment by sensors, process their information and influence
their environment with actuators according to communication devices” [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
Agentbased cyberphysical systems may be found in smart energy grids [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] or distributed
health monitoring systems [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. These systems are first simulated and then deployed to
control processes in the material word. In the latter case humans may be integrated for
clarifying and/or deciding non-formalized conflicts in an ad-hoc manner.
Automatic collaborative routines or new practises for ad-hoc coordination and
collaboration are established. Novel purely virtual or hybrid contexts realizing collective
and distributed agency materialize. Therefore it becomes vital to understand collective
coordination in such smart systems.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Collective Coordination in Current Smart Systems</title>
      <p>
        The individual elements of smart systems may be defined as “miniaturized devices
that incorporate functions of sensing, actuation and control. They are capable of
describing and analyzing a situation, and taking decisions based on the available data in
a predictive or adaptive manner, thereby performing smart actions. In most cases, the
“smartness” of the system can be attributed to autonomous operations based on closed
loop control, energy efficiency, and networking capabilities” [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Examples include
the internet of things and the above mentioned cyberphysical systems.
      </p>
      <p>These systems form part of the intelligent infrastructure of today’s world. Smart
systems have a huge impact on our socio-cognitive environment since „machines
don’t just replace what we do, they change the nature of what we do: by extending our
capabilities, they set new expectations for what’s possible and create new
performance standards and needs. …Our tools change us” [10, p.5]. Moreover it can be
stated that in systems where humans and nonhumans collaborate “we’ll outsource
some decisions to machines completely, while also assimilating computational
rationality into our own decision processes” [10, p.2]. To put it more precisely: “the
delegation of control functions to autonomous machines limits the options for human actions
and decisions thus increasingly forcing humans into adaptive behaviour” [11, p.28].
Even such adaptive behaviour is a nontrivial task since these systems may be able to
adapt to changes in the environment themselves. One option for potentially successful
interaction and coordination of humans and nonhumans is offered by the above
mentioned multiagent systems.</p>
      <p>
        Current agent-based software systems range from swarm intelligence systems, based
on a bionic metaphor for distributed problem solving, to sophisticated e-negociation
systems [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The software agents demonstrate instrumental rationality, distributed
control and division of labour. The commitment of the software agents to pursue a
goal is “hard-wired” in most current applications.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Commitments in Joint Action</title>
      <p>
        Higher degrees of freedom are provided if the commitment to a specific task or even
to distributed problem solving is not fixed during execution but may change. In the
human case “commitments and predictability in joint action” are a research field in its
own right (u. a. [
        <xref ref-type="bibr" rid="ref13 ref14 ref15 ref16">13,14,15,16</xref>
        ]). Commitments to joint action may not be taken for
granted even in systems characterized by division of labour, distributed control and
instrumental rationality. Pacherie distinguishes two variants: “interdependent
individual commitments powered by practical rationality” and “joint commitments powered
by social normativity: obligations &amp; entitlements” [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Humans may display both
whereas current technical agents may exhibit the former but not necessarily the latter.
It is currently an open question whether synthetic social norms should count as
obligations and provide a basis for entitlements outside virtual environments.
      </p>
      <p>
        However, the fact that current technical agents “lack humans’ consciousness,
intentionality and free will” (Moor 2006, p. 20) does not mean that they do not possess a
degree of “social autonomy in a collaborative relationship”. This form of
goalautonomy was defined by Falcone and Castelfranchi as having to two components:
“a) meta level autonomy that denotes how much the agent is able and in condition of
negotiating about the delegation or of changing it; b) a realization autonomy that
means that the agent has some discretion in finding a solution to an assigned problem,
or a plan for an assigned goal” [17, p. 407]. Even certain current software agents may
possess this kind of social autonomy thus displaying a certain proto-social behaviour.
Such software agents need not necessarily be based in a Belief-Desire-Intention
(BDI)-model [17, p. 416]. However, if one intends to base a computational model of
trust on BDI-agents, an elaborate approach is to be found in [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. As an aside, it
should be mentioned, that one cannot only model trust, but also implement
“mischievous” software agents, agents who aim at spreading false information, if suits them.
Incidentally, in the biological world this is an exclusively human behaviour [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ].
      </p>
      <p>This paper cannot expand on the similarities and differences of current human and
technical agents. It must suffice to state that human capabilities and those of technical
agents may differ widely. Their acts are based on different cognitive systems,
different degrees of freedom and only partially overlapping spheres of experience.</p>
    </sec>
    <sec id="sec-4">
      <title>Dysfunctional Cooperative Behaviour</title>
      <p>
        Even criminal behaviour, deliberate misinterpretations of norms or negligence can be
studied in MAS if it is based on bounded rationality. Investigations into machine
ethics and the treatment of artificial agents as legal subjects are very instructive when
searching for commonalities and fundamental differences in unethical or illegal
behaviour between humans and nonhumans. Books as “the law of robots” [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] and “a
legal theory for autonomous artificial agents” [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] demonstrate this.
      </p>
      <p>Chopra and White are convinced that “in principle artificial agents should be able to
qualify for independent legal personality, since this is the closest legal analogue to the
philosophical conception of a person” [21, p. 182]. In their view “artificial agents are
more likely to be law-abiding than humans because of their superior capacity to
recognize and remember legal rules” [21, p. 166]. If they do not abide by the laws “a
realistic threat of punishment can be palpably weighed in the most mechanical of
cost-benefit calculations” [21, p. 168].</p>
      <p>
        Pagallo perceives the legal personhood of robots and their constitutional rights as an
option only being relevant in the long term [20, pp. 147]. However he discusses at
length both human greediness using robots as criminal accomplices and artificial
greediness. He states that “in certain fields of social interaction, “intelligence”
emerges from the rule of the game rather than individual choices” [20, p.96]. Thus such
social and asocial intelligence might be acquired by (rational) nonhuman agents, too.
Moreover investigations into the potential ethical status of software agents have been
undertaken (e.g. [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]) and propositions to teach “moral machines” to distinguish right
from wrong have been developed (e.g. [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]).
      </p>
      <p>
        In order to clarify the state of the art in software agents’ ethics Moor’s distinctions
between ethical-impact agents, implicit ethical agents, explicit ethical agents and full
ethical agents may be used [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. In social computing the three classes of lesser ethical
agents may be found: software agents used as mere tools may have an ethical impact;
electronic auctioning systems may judged implicit ethical agents, if “its internal
functions implicitly promote ethical behaviour—or at least avoid unethical behaviour”
[22, p. 19]; disaster management systems based on MAS systems [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] may be
exemplary explicit ethical agents if they “represent ethics explicitly, and then operate
effectively on the basis of this knowledge” [22, p. 20]. It is open to discussion whether any
software agent will ever be a full ethical agent which “can make explicit ethical
judgments generally is competent to reasonably justify them” [22, p. 20]. But the first
variants of ethical (machine) behaviour, i.e. proto-ethical systems, are already in
place.
      </p>
      <p>Analogous to this classification of ethical behaviour displayed by software agents a
wide variety of amoral agents could be implemented. They could range from of
unethical impact agents, implicit unethical agents to explicit unethical agents e.g. based
on virtue ethics. They could be modelled for use in online games. Such games could
provide sheer entertainment, edutainment or form part of the currently so popular
serious games. The latter “have an explicit and carefully thought-out educational
purpose and are not intended to be played primarily for amusement” [24, p.5].
Agent-based models allow to model a wide variety of social and asocial behaviour.
Yet when transferring the insights gained in the laboratory to real world scenarios,
one must proceed with great care. Humans, even if they do not always “follow the
rules of the game” are able to perceive others not only as social tools but as valuable
peers and act accordingly.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <article-title>Alexander von Humboldt Institute for Internet and Society</article-title>
          , http://www.hiig.de/en/,
          <source>accessed November 24th</source>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <article-title>E-petitionen for the Bundestag https</article-title>
          ://epetitionen.bundestag.de/ (
          <year>2013</year>
          ),
          <source>accessed November 24th</source>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <article-title>Alexander von Humboldt Institute for Internet and Society: Motiviation for partizipation in e-petions</article-title>
          . http://www.hiig.de/en/project/motivation
          <article-title>-for-participation-</article-title>
          <string-name>
            <surname>epetitions</surname>
            <given-names>/</given-names>
          </string-name>
          , (
          <year>2013</year>
          ),
          <source>accessed November 24th</source>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Jennings</surname>
          </string-name>
          , N.:
          <source>ALADDIN End of Project Report, www.aladdinproject.org</source>
          , (
          <year>2010</year>
          ),
          <source>accessed October 24th</source>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <article-title>Leibnizcenter for Law: Multi-agent PhD position available</article-title>
          . www.leibnitz.org/wpcontent/uploads/2011/02/wervering.pdf, (
          <year>2011</year>
          ),
          <source>accessed January 24th</source>
          ,
          <year>2012</year>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Mainzer</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <source>Information and Computation of Complex Dynamical Systems. Workshop “Philosophy of the Information and Computing Sciences”</source>
          , Lorenz Center, http://www.lorentzcenter.nl/lc/web/2010/374/presentations/Mainzer.pdf, (
          <year>2010</year>
          ),
          <source>accessed November 24th</source>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Wedde</surname>
            <given-names>H.</given-names>
          </string-name>
          , Lehnhoff,. S., Rehtanz Chr.,
          <string-name>
            <surname>Krause</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Bottom-Up Self-Organization of Unpredictable Demand and Supply under Decentralized Power Management</article-title>
          .
          <source>In: Proceedings of the 2nd IEEE International Conference on Self-Adaptation and Self-Organization (SASO'08)</source>
          , pp.
          <fpage>10</fpage>
          -
          <lpage>20</lpage>
          , IEEE Press, Venice (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Nealon</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moreno</surname>
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Agent-Based Health Care Systems</article-title>
          . In Nealon J.,
          <string-name>
            <surname>Moreno</surname>
            <given-names>A</given-names>
          </string-name>
          . (eds.)
          <article-title>Applications of Software Agent Technology in the Health Care Domain</article-title>
          ,
          <source>Whitestein Series in Software Agent Technologies</source>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>18</lpage>
          , Birkhäuser Verlag, Basel (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9. Wikipedia:
          <article-title>Smart Systems</article-title>
          . http://en.wikipedia.org/wiki/Smart_system, (
          <year>2013</year>
          ),
          <source>accessed November 24th</source>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Gorbis</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Human plus machine</article-title>
          . http://www.iftf.org/node/3960, (
          <year>2011</year>
          ),
          <source>accessed November 24th</source>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Weyer</surname>
          </string-name>
          , J. :
          <article-title>Die Kooperation menschlicher Akteure und nicht-menschlicher Agenten</article-title>
          .
          <source>Ansatzpunkte einer Soziologie hybrider Systeme</source>
          , Arbeitspapier Nr.
          <volume>16</volume>
          ,
          <string-name>
            <surname>Soziologische</surname>
            <given-names>Arbeitspapiere der Universität Dortmund</given-names>
          </string-name>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Woolridge</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>An Introduction to MultiAgent Systems</article-title>
          , 2nd ed., John Wiley &amp; Sons: New York (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Bratman</surname>
            ,
            <given-names>M. E.</given-names>
          </string-name>
          :
          <article-title>Shared agency</article-title>
          . In Mantzavinos, C. (ed.)
          <article-title>Philosophy of the social sciences: Philosophical theory and scientific practice</article-title>
          , pp.
          <fpage>41</fpage>
          -
          <lpage>59</lpage>
          , Cambridge University Press, Cambridge (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Gilbert</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Walking together: A paradigmatic social phenomenon</article-title>
          .
          <source>Midwest Studies in Philosophy</source>
          , vol.
          <volume>15</volume>
          (
          <issue>1</issue>
          ), pp.
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Pacherie</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>The Phenomenology of Joint Action: Self-Agency vs</article-title>
          . Joint-Agency. In Seemann A. (ed.) Joint Attention: New Developments, pp.
          <fpage>343</fpage>
          -
          <lpage>389</lpage>
          . MIT Press, Cambridge (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Pacherie</surname>
          </string-name>
          , E.:
          <article-title>Commitments and predictability in joint action</article-title>
          .
          <source>Presentation at the ENSO III Conference</source>
          , Helsinki, unpublished manuscript, (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Falcone</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Castelfranchi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The human in the Loop of a Delegated Agent: The Theory of Adjustable Social Autonomy</article-title>
          ,
          <source>IEEE Transaction on Systems, Man, and Cybernetics - Part A: Systems and Humans</source>
          , Vol.
          <volume>31</volume>
          , No 5, pp.
          <fpage>406</fpage>
          -
          <lpage>418</lpage>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Castelfranchi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Falcone</surname>
          </string-name>
          , R.:
          <source>Trust Theory: A Socio-Cognitive and Computational Model</source>
          , Wiley Series in Agent Technology, John Wiley and Sons: Chichester: UK (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Buttelmann</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carpenter</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tomasello</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Eighteen-month-old infants show false belief understanding in an active helping paradigm</article-title>
          ,
          <source>Cognition</source>
          , Volume
          <volume>112</volume>
          , Issue 2, pp.
          <fpage>337</fpage>
          -
          <lpage>342</lpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Pagallo</surname>
            <given-names>U.</given-names>
          </string-name>
          : The Law of Robots: Crimes, Contracts, and Torts, Springer, Dordrecht (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Chopra</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>White</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>A Legal Theory for Autonomous Artificial Agents</article-title>
          . Ann Arbor, The University of Michigan Press (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Moor</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <article-title>The Nature, Importance, and Difficulty of Machine Ethics</article-title>
          .
          <source>IEEE INTELLIGENT SYSTEMS</source>
          , pp.
          <fpage>18</fpage>
          -
          <lpage>21</lpage>
          , IEEE Press, New York (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Wallach</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Allen</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <article-title>Moral Machines: Teaching Robots Right from Wrong</article-title>
          , University of Oxford Press: New York (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Abt</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          : Serious Games. Viking Press, New York (
          <year>1970</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>