<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Ethical Challenges in Modeling and Simulation of Nudging in Care</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Stephanie C. Rodermund</string-name>
          <email>rodermund@uni-trier.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fabian Lorig</string-name>
          <email>lorigf@uni-trier.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ingo J. Timm</string-name>
          <email>itimm@uni-trier.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Business Informatics 1, Trier University</institution>
          ,
          <addr-line>54296 Trier</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <fpage>35</fpage>
      <lpage>41</lpage>
      <abstract>
        <p>Due to the demographic change, there is a disproportionately increasing demand for professional care services in contrast to available caregivers. Consequently, innovative technologies, e.g., Internet-of-Things devices or robotics enabling a change of behavior, must be developed to strengthen patients' independency for improving patients' quality of life and for exonerating the caregivers. Therefore, nudging can be used to initiate beneficial behavior change. To evaluate the effectiveness of different nudging methods, modeling and simulation can be used. In this paper, we discuss ethical implications of such simulations with respect to the conflict of interest between the individuals' autonomy, self-determined life, and duty of care. Thereby, challenges that developers have to face are identified and discussed.</p>
      </abstract>
      <kwd-group>
        <kwd>Methods of Behavior Change</kwd>
        <kwd>Nudging</kwd>
        <kwd>Agent-based Simulation</kwd>
        <kwd>Ethical Implications</kwd>
        <kwd>Health Care</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        As a result of the demographic change, the population is ageing and the number of
people in need of care increases. Experts predict no reversal of this trend [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1, 2, 3</xref>
        ]. This
results in an ascending demand of professional care services, whereas this demand
cannot be met by the number of available caregivers [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Hence, the independence of
people in need of care must be preserved for as long as possible. Thereby, a longer care
at home can be enabled because care-dependents are able to execute simple tasks, which
otherwise would afford professional assistance. One approach to achieve a higher
degree of independence is to encourage beneficial behavior, e.g., through using
innovative technologies like Internet-of-Things devices. The concept of nudging
summarizes methods, that are meant to influence behavior without forcing it by taking
away options or setting high financial incentives [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Before using a method, its
effectiveness in encouraging the intended behavior should be ensured to prevent
negative consequences. To evaluate the effectiveness of different nudging methods,
modeling and simulation can be used [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. This paper discusses ethical implications
that infer from such a simulation approach with respect to the conflicts of interest
between the individuals’ autonomy, self-determinism, and duty of care.
      </p>
      <p>This work is structured as follows: Section 2 gives an introduction in the concept of
nudging, as well as modeling of nudging in care. In Section 3, a discussion on the ethical
implications of nudging in care and of a respective simulation model is presented.
Finally, in Section 4 we conclude and discuss potential future work.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Modeling and Simulation of Nudging</title>
      <p>
        The concept of nudging, as defined by Thaler and Sunstein, describes methods of
manipulating human behaviors without decreasing the choice set or making use of
prohibitions [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Nudging covers methods that change a given decision architecture to
generate behavior that is beneficial for the decision-maker or general public. Methods
of nudging include, e.g., provision of defaults and feedback, or structuring complex
decisions. The approach stems from behavioral economics and is mainly used as
political instrument, e.g., to increase sustainability and energy efficiency [
        <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
        ], to
increase work efficiency of employees [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ] or as a political instrument in healthcare
[
        <xref ref-type="bibr" rid="ref12 ref13 ref14">12, 13, 14</xref>
        ]. Furthermore, nudging is already used in nursing and assisted living to
improve the patients’ independence, e.g., to increase urine consistency [
        <xref ref-type="bibr" rid="ref15 ref16 ref17">15, 16, 17</xref>
        ].
      </p>
      <p>
        Modeling and simulation have established for analyzing and evaluating behaviors
[
        <xref ref-type="bibr" rid="ref18 ref19">18, 19</xref>
        ]. To measure the effect of nudging methods on care-dependents’ behavior via
simulation, nudges have to be formalized, which means altering the patients’
environmental conditions. Furthermore, the cognitive decision-making of the
caredependents has to be modeled to represent the processes that cause acceptance and
rejection of nudging methods, and the respective behavior of the care-dependents. To
model care-dependents, Agent-based Modeling (ABM) seems to be well-suited, as it
has established in modeling of cognitive decision-making and behaviors of human
beings [
        <xref ref-type="bibr" rid="ref20 ref21 ref22 ref23 ref24">20, 21, 22, 23, 24</xref>
        ]. For generating model behavior, empirical studies must be
carried out which collect both general data on the patients (e.g. degree of independence)
and on the behavior investigated before and after the addition of specific nudging
methods. An example that can lead to an improvement in independence is to encourage
care-dependents to drink enough. Dehydration can lead to health issues and states of
confusion that decrease the self-sufficiency capacity especially of the elderly [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
Drinking could be nudged, e.g., by providing feedback on the patients’ behavior or by
reminding them to drink by using IoT devices [
        <xref ref-type="bibr" rid="ref26 ref27">26, 27</xref>
        ] or motion detectors that are
placed near water sources and provide visual stimuli (light). This scenario serves as an
application example for modeling and simulation.
      </p>
      <p>In the following, we discuss ethical implications that must be addressed while
modeling and simulation in order to contribute to improving the quality of the
caredependents’ lives.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Ethics of Simulating Nudging in Care</title>
      <p>First, we consider the ethical implications of nudging in care and then discuss moral
challenges of simulation in this domain.
3.1</p>
      <sec id="sec-3-1">
        <title>Ethics of Nudging in Care</title>
        <p>
          The ethics of nudging offer a broad area for discussion, where the concept is mainly
criticized. The major points of criticism focus on endangering the decision-makers'
autonomy and their growing habituation to manipulation. Furthermore, the
consequences of manipulation are not necessarily suitable for each individual,
dependent on the given context, as well as determined by the intention of the decision
architect [
          <xref ref-type="bibr" rid="ref28 ref29">28, 29</xref>
          ]. Assistive Technologies (AT) also target maintaining the independence
of those in need of care. Ultimately, the ethical considerations here focus on four
wellestablished principles formulated by Beauchamp and Childress [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ]. These principles
(autonomy, beneficence, non-maleficence, justice) derive and are underpinned from
multiple sources as common morality, health ethics, the Declaration of Helsinki as well
as basic laws (e.g., need for consent before medical procedure execution or Art. 1 of
the Charter of fundamental rights of the European Union) [
          <xref ref-type="bibr" rid="ref21 ref30 ref32 ref33">30, 21, 32, 33</xref>
          ].
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Moral Challenges in Modeling and Simulation of Nudging in Care</title>
        <p>
          A simulation model is needed to formalize different nudges and their impacts on
caredependents’ behaviors. As mentioned earlier, simulation models of nudging and
behavior change already exist [
          <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
          ]. Nevertheless, transferring this to the care domain
confronts us as developers with new challenges. Since empirical studies are required
for model creation, and the results of a simulation are meant to be transferred to reality
where care-dependents are affected, ethical challenges of modeling and simulation in
this context have to be discussed.
        </p>
        <p>
          Several codes and guidelines have built that shall “inspire and guide the ethical
conduct of all computing professionals” [
          <xref ref-type="bibr" rid="ref34">34</xref>
          ]. These guidelines and principles address
ethical questions that developers have to face and demand the developer to supply a
positive contribution for society and its environment [
          <xref ref-type="bibr" rid="ref34 ref35 ref36">34, 35, 36</xref>
          ]. Therefore, the
benefits for the patients (increase of independency and quality of life) must be carefully
weighed against the costs (loss of autonomy through manipulation of decision)
throughout the whole process of model creation and application.
        </p>
        <p>
          We start our ethical considerations at the collection and analysis of patient data by
means of an empirical study. Ethical codes, e.g., the ACM Code of Ethics or the ethical
guidelines of the GI, point out that the right for autonomy and privacy as well as the
protection of the human dignity has to be respected [
          <xref ref-type="bibr" rid="ref34 ref35 ref36">34, 35, 36</xref>
          ]. This includes the
sensibility of collected personal data. Therefore, a re-identification of anonymized
patient data has to be ruled out. As a possible technique, we suggest the introduction of
control groups for which no data is collected during the study. Additionally, the
collected data should be abstracted, e.g., by using probability distributions [
          <xref ref-type="bibr" rid="ref37">37</xref>
          ].
Nevertheless, patients may experience unpleasant consequences, such as realizing their
own weaknesses or exposing them to relatives during the experiment. Therefore, the
developer has to thoroughly weigh which data and causal relationships of variables are
really necessary for model generation and validation and can be published, with respect
to possible consequences for the individual care-dependent.
        </p>
        <p>
          Second, the principles declare that the developer is responsible for negative
consequences resulting from using the model. This also includes injury of patients and
misuse of personal data. For example, the model could be used to test nudging methods
that advantage an interest group but disadvantage patients with negative consequences.
Thus, a careful consideration of possible effects for all concerned and the use of
approved scientific methods for model creation are recommended [
          <xref ref-type="bibr" rid="ref34 ref35">34, 35</xref>
          ]. Because
those nudging methods that prove to have the most influence on care-dependents’
behavior are meant to be applied to reality, the outcomes of the simulation have to be
reliable. Therefore, the evaluation of nudging methods should be based on defined
indicators that allow for evaluation as well as comparison of methods. In order to ensure
that care-dependents’ interests are followed the indicators should be defined
objectively. Additionally, an inadvertent misuse of the model can be prevented by a
detailed documentation of the model’s purpose, application or possible consequences.
4
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>
        In this paper, we discussed ethical implications, that might be faced during modeling
and simulation of nudging in care. A lot of attempts aim at phrasing rules in the field
of ATs as well as robotics and members of the EU Parliament made a corresponding
demand to the EU Commission in 2017 [
        <xref ref-type="bibr" rid="ref38">38</xref>
        ]. Although guidelines exist in the area of
modeling and simulation, there are only few limitations that developers have to face.
Additionally, ethical challenges that arise in modeling and simulation depend strongly
on the respective application area. Therefore, it is up to the developers to assume social
responsibility for their models and to respect formulated ethical principles.
Nevertheless, further discussion has to be started, to guarantee a thorough assessment
and to reinforce awareness of this issue.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Hackmann</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Arbeitsmarkt Pflege: Bestimmung der künftigen Altenpflegekräfte unter Berücksichtigung der Berufsverweildauer</article-title>
          .
          <source>Sozialer Fortschritt</source>
          <volume>59</volume>
          ,
          <fpage>235</fpage>
          -
          <lpage>244</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Statistisches</given-names>
            <surname>Bundesamt</surname>
          </string-name>
          :
          <article-title>Pflege im Rahmen der Pflegeversicherung Deutschlandergebnisse (Pflegestatistik) (</article-title>
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Statistisches</given-names>
            <surname>Bundesamt</surname>
          </string-name>
          .
          <article-title>Pflege im Rahmen der Pflegeversicherung Deutschlandergebnisse (Pflegestatistik) (</article-title>
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Rothgang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Müller</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Unger</surname>
          </string-name>
          , R.:
          <source>Themenreport " Pflege</source>
          <year>2030</year>
          "
          <article-title>: was ist zu erwarten-was ist zu tun?</article-title>
          .
          <source>Bertelsmann Stiftung</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Thaler</surname>
            ,
            <given-names>R. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sunstein</surname>
            <given-names>C. R.</given-names>
          </string-name>
          : Nudge:
          <article-title>Improving decisions about health, wealth, and happiness (</article-title>
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Thomas</surname>
            ,
            <given-names>D. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jona</surname>
          </string-name>
          , L.:
          <article-title>'Good Nudge Lullaby': Choice Architecture and Default Bias Reinforcement</article-title>
          .
          <source>The Economic Journal</source>
          ,
          <volume>128</volume>
          (
          <issue>610</issue>
          ),
          <fpage>1180</fpage>
          -
          <lpage>1206</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Moglia</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Podkalicka</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGregor</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>An Agent-Based Model of Residential Energy Efficiency Adoption</article-title>
          .
          <source>Journal of Artificial Societies &amp; Social Simulation</source>
          ,
          <volume>21</volume>
          (
          <issue>3</issue>
          ) (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Ölander</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thøgersen</surname>
          </string-name>
          , J.:
          <article-title>Informing versus nudging in environmental policy</article-title>
          .
          <source>Journal of Consumer Policy</source>
          .
          <volume>37</volume>
          (
          <issue>3</issue>
          ),
          <fpage>341</fpage>
          -
          <lpage>356</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Demarque</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Charalambides</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hilton</surname>
            ,
            <given-names>D. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Waroquier</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Nudging sustainable consumption: The use of descriptive norms to promote a minority behavior in a realistic online shopping environment</article-title>
          .
          <source>Journal of Environmental Psychology</source>
          .
          <volume>43</volume>
          ,
          <fpage>166</fpage>
          -
          <lpage>174</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Ebert</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Freibichler</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>Nudge management: applying behavioural science to increase knowledge worker productivity</article-title>
          .
          <source>Journal of Organization Design</source>
          .
          <volume>6</volume>
          (
          <issue>1</issue>
          ),
          <volume>4</volume>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Stieglitz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Potthoff</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kißmer</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <article-title>Digital Nudging am Arbeitsplatz: Ein Ansatz zur Steigerung der Technologieakzeptanz</article-title>
          .
          <source>HMD Praxis der Wirtschaftsinformatik</source>
          .
          <volume>54</volume>
          (
          <issue>6</issue>
          ),
          <fpage>965</fpage>
          -
          <lpage>976</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Galizzi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>M.: Label, nudge or tax? A review of health policies for risky behaviours</article-title>
          .
          <source>Journal of public health research.</source>
          <volume>1</volume>
          (
          <issue>1</issue>
          ),
          <volume>14</volume>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Downs</surname>
            ,
            <given-names>J. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loewenstein</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wisdom</surname>
          </string-name>
          , J.:
          <article-title>Strategies for promoting healthier food choices</article-title>
          .
          <source>American Economic Review</source>
          .
          <volume>99</volume>
          (
          <issue>2</issue>
          ),
          <fpage>159</fpage>
          -
          <lpage>64</lpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Campbell-Arvai</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arvai</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kalof</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Motivating sustainable food choices: The role of nudges, value orientation, and information provision</article-title>
          .
          <source>Environment and Behavior</source>
          .
          <volume>46</volume>
          (
          <issue>4</issue>
          ),
          <fpage>453</fpage>
          -
          <lpage>475</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Orpwood</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Adlam</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Evans</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chadd</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Self</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Evaluation of an assisted-living smart home for someone with dementia</article-title>
          .
          <source>Journal of Assistive Technologies</source>
          .
          <volume>2</volume>
          (
          <issue>2</issue>
          ),
          <fpage>13</fpage>
          -
          <lpage>21</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Namazi</surname>
            ,
            <given-names>K. H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Johnson</surname>
            ,
            <given-names>B. D.</given-names>
          </string-name>
          :
          <article-title>Physical environmental cues to reduce the problems of incontinence in Alzheimer's disease units</article-title>
          .
          <source>American Journal of Alzheimer's Care and Related Disorders &amp; Research</source>
          .
          <volume>6</volume>
          (
          <issue>6</issue>
          ),
          <fpage>22</fpage>
          -
          <lpage>28</lpage>
          (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Mollenkopf</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schakib-Ekbatan</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oswald</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Langer</surname>
          </string-name>
          , N. für
          <string-name>
            <surname>Alternsforschung</surname>
            ,
            <given-names>D. Z.</given-names>
          </string-name>
          :
          <article-title>Technische Unterstützung zur Erhaltung von Lebensqualität im Wohnbereich bei Demenz</article-title>
          .
          <source>Ergebnisse einer Literatur-Recherche. Forschungsberichte aus dem DZFA</source>
          .
          <volume>16</volume>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Hattori</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nakajima</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ishida</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Learning from humans: Agent modeling with individual human behaviors</article-title>
          .
          <source>IEEE Transactions on Systems</source>
          , Man, and
          <string-name>
            <surname>Cybernetics-Part</surname>
            <given-names>A</given-names>
          </string-name>
          : Systems and Humans,
          <volume>41</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Rodermund</surname>
            ,
            <given-names>S.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lorig</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Berndt</surname>
            ,
            <given-names>J.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Timm</surname>
            ,
            <given-names>I.J.:</given-names>
          </string-name>
          <article-title>An Agent Architecture for Simulating Communication Dynamics in Social Media</article-title>
          .
          <source>Multiagent System Technologies, 15th German Conference (MATES)</source>
          ,
          <fpage>19</fpage>
          -
          <lpage>37</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Bonabeau</surname>
          </string-name>
          , E.:
          <article-title>Agent-based modeling: Methods and techniques for simulating human systems</article-title>
          .
          <source>Proceedings of the National Academy of Sciences. 99(suppl 3)</source>
          ,
          <fpage>7280</fpage>
          -
          <lpage>7287</lpage>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Urban</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>PECS-agent-based modelling of human behaviour</article-title>
          .
          <source>In Emotional and Intelligent-The Tangled Knot of Social Cognition, AAAI Fall Symposium Series</source>
          , North Falmouth (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Jager</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>The need for and development of behaviourally realistic agents</article-title>
          .
          <source>In International Workshop on Multi-Agent Systems and Agent-Based Simulation</source>
          .
          <fpage>36</fpage>
          -
          <lpage>49</lpage>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Berndt</surname>
            ,
            <given-names>J.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rodermund</surname>
            ,
            <given-names>S.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Timm</surname>
            ,
            <given-names>I.J.</given-names>
          </string-name>
          :
          <source>Social Contagion of Fertility: An Agent-Based Simulation Study. Accepted for: 2018 Winter Simulation Conference (WSC</source>
          <year>2018</year>
          )
          <article-title>(</article-title>
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Reuter</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Berndt</surname>
            ,
            <given-names>J.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Timm</surname>
            ,
            <given-names>I.J.: Simulating</given-names>
          </string-name>
          <string-name>
            <surname>Psychological</surname>
          </string-name>
          <article-title>Experiments: An Agent-Based Modeling Approach</article-title>
          . In: Folds,
          <string-name>
            <given-names>D.J.</given-names>
            ;
            <surname>Berndt</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.O</surname>
          </string-name>
          . (Eds.):
          <source>Fourth International Conference on Human and Social Analytics (HUSO</source>
          <year>2018</year>
          ).
          <fpage>5</fpage>
          -
          <lpage>10</lpage>
          . IARIA: Wilmington,
          <string-name>
            <surname>DE</surname>
          </string-name>
          , USA (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Gross</surname>
            ,
            <given-names>C. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lindquist</surname>
            ,
            <given-names>R. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Woolley</surname>
            ,
            <given-names>A. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Granieri</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Allard</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Webster</surname>
            ,
            <given-names>B.:</given-names>
          </string-name>
          <article-title>Clinical indicators of dehydration severity in elderly patients</article-title>
          .
          <source>The Journal of emergency medicine</source>
          .
          <volume>10</volume>
          (
          <issue>3</issue>
          ),
          <fpage>267</fpage>
          -
          <lpage>274</lpage>
          (
          <year>1992</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Fortmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cobus</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heuten</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boll</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>WaterJewel: design and evaluation of a bracelet to promote a better drinking behaviour</article-title>
          .
          <source>Proceedings of the 13th international conference on mobile and ubiquitous multimedia</source>
          ,
          <fpage>58</fpage>
          -
          <lpage>67</lpage>
          ACM (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Fortmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Root</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boll</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heuten</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>Tangible apps bracelet: Designing modular wrist-worn digital jewellery for multiple purposes</article-title>
          .
          <source>In Proceedings of the 2016 ACM Conference on Designing Interactive Systems</source>
          ,
          <volume>841</volume>
          -
          <fpage>852</fpage>
          ACM (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Selinger</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Whyte</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Is there a right way to nudge? The practice and ethics of choice architecture</article-title>
          .
          <source>Sociology Compass</source>
          .
          <volume>5</volume>
          (
          <issue>10</issue>
          ),
          <fpage>923</fpage>
          -
          <lpage>935</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>N. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goldstein</surname>
            ,
            <given-names>D. G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnson</surname>
          </string-name>
          , E. J.:
          <article-title>Choice without awareness: Ethical and policy implications of defaults</article-title>
          .
          <source>Journal of Public Policy &amp; Marketing</source>
          .
          <volume>32</volume>
          (
          <issue>2</issue>
          ),
          <fpage>159</fpage>
          -
          <lpage>172</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Beauchamp</surname>
          </string-name>
          , Tom L.:
          <article-title>The 'four principles' approach to health care ethics</article-title>
          .
          <source>Principles of health care ethics</source>
          .
          <volume>29</volume>
          <fpage>3</fpage>
          -
          <lpage>10</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Kehl</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Robotik und assistive Neurotechnologien in der Pflege-</article-title>
          gesellschaftliche
          <string-name>
            <surname>Herausforderungen</surname>
          </string-name>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>European</surname>
          </string-name>
          <article-title>Parliament: Charter of fundamental rights of the European Union</article-title>
          .
          <article-title>Office for Official Publications of the European Communities (</article-title>
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Deklaration</surname>
          </string-name>
          von Helsinki:
          <article-title>Ethische Grundsätze für die medizinische Forschung von Menschen</article-title>
          . http://www.bundesaerztekammer.de/fileadmin/user_upload/Deklaration_von_Helsinki_20 13_DE.pdf (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <article-title>ACM 2018 Task Force: ACM Code of Ethics and Professional Conduct</article-title>
          . https://www.acm.org/code-of-ethics (
          <year>2018</year>
          ) (Accessed:
          <fpage>28</fpage>
          .
          <fpage>11</fpage>
          .
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Gesellschaft</surname>
          </string-name>
          für Informatik:
          <article-title>Die ethischen Leitlinien der Gesellschaft für Informatik e</article-title>
          .V. https://gi.de/fileadmin/GI/Allgemein/PDF/GI_Ethische_Leitlinien_
          <year>2018</year>
          .pdf (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Oren</surname>
            ,
            <given-names>T. I.</given-names>
          </string-name>
          :
          <article-title>Ethics in modeling and simulation (simethics)</article-title>
          .
          <source>Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC)</source>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Bier</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krempel</surname>
          </string-name>
          , E.:
          <article-title>Common privacy patterns in video surveillance and smart energy</article-title>
          .
          <source>ICCCT-2012</source>
          ,
          <fpage>610</fpage>
          -
          <lpage>615</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38.
          <string-name>
            <surname>Europäisches</surname>
          </string-name>
          <article-title>Parlament: Zivilrechtliche Regelungen im Bereich Robotik - Entschließung des Europäischen Parlaments (P8_TA(</article-title>
          <year>2017</year>
          )
          <article-title>00 51) vom 16</article-title>
          .
          <article-title>Februar 2017 mit Empfehlungen an die Kommission zu zivilrechtlichen Regelungen im Bereich Robotik (</article-title>
          <year>2015</year>
          /2103(INL)). http://www.europarl.europa.eu/sides/getDoc.do?pubRef=-
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>