=Paper= {{Paper |id=Vol-1315/paper1 |storemode=property |title=An Interdisciplinary Approach for a Holistic and Embodied Emotion Model in Humanoid Agents |pdfUrl=https://ceur-ws.org/Vol-1315/paper1.pdf |volume=Vol-1315 |dblpUrl=https://dblp.org/rec/conf/aic/SchaatHDD14 }} ==An Interdisciplinary Approach for a Holistic and Embodied Emotion Model in Humanoid Agents== https://ceur-ws.org/Vol-1315/paper1.pdf
        An Interdisciplinary Approach for a Holistic and
        Embodied Emotion Model in Humanoid Agents

        Samer Schaat1, Matthias Huber2, Klaus Doblhammer1, Dietmar Dietrich1
    1
    Institute for Computer Technology, Vienna University of Technology, A – 1040 Vienna
             {schaat, doblhammer, dietrich}@ict.tuwien.ac.at
                2
                 Department of Education, University of Vienna, A – 1010 Vienna
                            matthias.huber@univie.ac.at



        Abstract. Computational models of the human decision making process have
        already enabled several insights and applications. Nevertheless, such models
        have only recently begun to consider that simply modelling rational decision
        making was insufficient to represent human behavior. Recent efforts have start-
        ed to consider this factor by utilizing computational models of emotions. One of
        the most significant challenges to be faced here is the interdisciplinary coopera-
        tion required in order to develop a holistic and integrated model, which reflects
        aspects of embodiment and is integrated in a holistic cognitive architecture. In
        this paper we will analyse how models from relevant disciplines can support us
        in outlining an overview model which considers the mentioned criteria.

        Keywords: Emotions · Humanoid Agents · Evaluation Models · Decision Mak-
        ing · Simulation · Artificial General Intelligence · Neuroscience · Neuropsy-
        choanalysis.


1       Introduction

If one considers humans as being the archetypes of intelligent information processing,
the fundamental mechanisms of human decision making must be considered. This is
especially relevant for a holistic model of decision making. Over the last years the
focus in this area was on rational decision making, with little consideration for the
fact that this is actually based upon unconscious processes. In particular the consider-
ation of affective processes is needed in a computational representation of human
capabilities that are used to cope with every-day problems, such as “intuition”, “gut
feeling” etc. A further tendency in humanoid agents is the reduction of decision mak-
ing to a set of universal rules. Even when the abstract principles of decision making
are generally valid, the definite rules followed by humans cannot be generalized, and
therefore must be generated according to a subjective approach, based on memory
and also in an agent specific manner. Besides, conventional decision making models
are mostly abstracted from the body. Following an embodied approach, human cogni-
tion and particularly decision making is however based upon the interaction of the
brain with the rest of the body.




                                        Page 16 of 171
   These topics can only be tackled with an interdisciplinary approach, where com-
puter science is not used as a tool, but its methodologies are applied on the content of
other disciplines. Such approach not only enables to develop computer models for
technical applications, but also serves precision, concretization and sharpening of
concepts from different disciplines. In order to develop a deterministic model of an
agent decision making process according to human-based principles, we will leverage
insights from different disciplines, considering embodiment, subjective approaches
and unconscious processes. In particular we consider neuroscience, psychoanalysis,
neuropsychoanalysis, and current computation models of emotions. Although the
unconscious is a key concept in psychoanalysis, as far as we know, it is not analyzed
yet for computational models of affective processes, and neuroscientific theories are
not reflected in a holistic and embodied computational model of human decision mak-
ing yet. In order to further construct a model transformation upon this and to integrate
neuroscientific and (neuro)psychoanalytic models into a technical model, it is neces-
sary that they are described consistently and holistically. Even though this paper shall
focus on a model of the basic mechanisms of decision making, the holistic perspective
may not be neglected. This represents the integration of cognition and emotion, which
are thereby not modelled separately. Upon highlighting how each discipline (by an
expert of neuroscientific emotion theories, a psychoanalyst and a computer scientist)
perceives the fundamental mechanisms of subjective decision making in terms of the
criteria described, we shall sketch an evaluation model for subjective decision making
in humanoid agents which integrates the insights of the various disciplines.


2      Emotions in Neuroscience

Currently several epistemologically divergent neuroscientific research movements are
endeavoring to describe human emotionality in a holistic context. In particular the
work of Jaak Panksepp is of note, specifically his theory of mutually linked (neuronal
interacting) basic emotion systems (seeking, fear, panic, rage) [1]. Also of note is the
work of Gerald M. Edelman and his theory of Neuronal Darwinism in which emo-
tions, in the context of values and value systems, are introduced in a holistic theory of
consciousness [2], a precursor to a modern integrative comprehension of emotions.
The research of Joseph LeDoux concerning the “Amygdala Fear System” [3] and also
the work of James McGough on the significance of emotions in learning and memory
[4] are also worthy of mention. The Portuguese Antonio Rosa Damasio is recognized
as one of the most significant and influential contemporary neuroscientists. His “The-
ory of Emotion” is highly regarded far beyond neurobiology circles, as his compre-
hension of emotions and feelings possesses great explanatory potential, confirmed
through diverse studies [5], [6], and a plethora of neurophysiological data [7], [3], [8]:
On the one hand Damasio is able to justify the holistic claim as his comprehensive
body of work includes, along with the Theory of Emotion, a “Theory of Self”, a
“Theory of Consciousness”, a “Theory of Mind” along with a theory governing the
automatic regulation of life. On the other hand, Damasio also took on the challenge of
creating a model for the dualistic juxtaposition of body and mind, based on the inevi-




                                    Page 17 of 171
table interdependence of reason and feelings, thereby transporting an anthropological
comprehension which satisfies both the psychoanalytical developmental theories and
phenomenological traditions.
    The starting point of Antonio Damasio’s deliberations is the organism, as a holis-
tic, open system, that progressively interacts with the environment and is organized
according to the operating principle of homeostasis (automatic life regulation),
whereby emotions form the ultimate level of these regulative (permanently active)
mechanisms. This also clarifies why emotion and feeling take on a biological (and
also evolutionary) function as necessary survival regulators for the protection of an
organism. Damasio differentiates in this context between three processing stages: (1)
an emotional status, which can be unconsciously triggered and executed, (2) a feeling
state, which can be unconsciously represented along with (3) a consciously generated
feeling state, in which the organism knows that it possesses emotions but also feelings
[6, p. 51]. Furthermore three types of emotions are differentiated: (a) the primary
emotions (fear, anger, sorrow, happiness, disgust, surprise) which are congenital (pre-
organized in terms of classical “Jamesist” feelings) and can be thought of as being
genetically determined, universal and culturally dependent basic emotions. (b) The
secondary or social emotions which in contrast develop over the course of ontogeny
and emerge as soon as systematic connections of objects and/or situations with prima-
ry emotions are formed. Social or secondary emotions (e.g. compassion, embarrass-
ment, shame, guilt, pride, jealously, awe, envy etc.) are thereby acquired and respec-
tively triggered through mental registration with respect to the cognitive processing of
situations and/or objects. (c) Background emotions are seen by Damasio as being the
consequence of certain combinations of simple regulative (homeostatic) reactions
(e.g. desire) [9, p. 56]. They are ever-present but are seldom consciously perceived
and may be interpreted as being an expression of well-being or discomfort. Emotions
thereby fulfill a double biological function: as already mentioned they must continu-
ously regulate the inner status of the organism. Above and beyond that they must also
trigger a specific reaction to a particular stimulus or situation. Two mechanisms are
available for this: emotions are formed either when our sensory organs process certain
objects and/or situations (the body-loop) or when the organism retrieves certain ob-
jects and/or situations from memory and represents them as imaginary images in the
thought process (the as-if-loop). It has already been stated that emotions and feelings
are temporally and structurally predetermined: the key content of a feeling is the illus-
tration of a particular bodily state. A feeling is thereby a projection of the body under
certain conditions and the feeling of an emotion is the projection of the body while
under the influence of a particular emotional process. Additionally, along with the
bodily-related projections, in certain situations specific projections of the thought
process are also relevant. Therefore a (conscious) feeling consists of the perception of
a certain bodily state along with the perception of a certain associated mental state
(the cognition of the emotion). As before, Damasio also differentiates here between
three types of feelings: (a) feelings of basic universal emotions (in terms of the prima-
ry emotions), (b) feelings of differentiated universal emotions (as a connection of
cognitive states with emotional bodily states; depending on experience, in terms of the




                                    Page 18 of 171
social emotions), along with (c) background sensations (in terms of background emo-
tions, although not formed by emotions in the strictest sense) [5, p. 208].
   In the context of this “Theory of Emotion”, an elementary principle is clearly evi-
dent in Damasio’s work: emotion, feelings and consciousness are continually depend-
ent on the representations of the organism and their common entity is and remains the
body. Human thoughts and actions are therefore dependent on the emotional constitu-
tion and respectively to certain changes in bodily state. The purpose of thought and
the prerequisite for action is however always a decision, whereby the essence of a
decision lies in choosing a certain response (e.g. a course of action) [5, p. 227].
   If one considers the decision making process on the basis of an undesirable devel-
opment, one thereby creates an undesirable/negative outcome, that is connected to the
associated response and is consciously perceived, even when short-lived, as an un-
comfortable/negative feeling. As a feeling (from emotion) affects the body, Damasio
choose the term somatic (soma = body), and as the feeling identifies, or marks a pro-
jection, he also chose the term marker. A somatic marker is thereby understood as
being the perception of an automatic reaction of the body to a certain projected image
(a situation or an event) respectively, as a bodily signal marking a particular scenario
as being either good or bad. [5, p. 238]. Accordingly a positive somatic marker func-
tions as a start signal and a negative somatic marker functions as an inhibitor. Somatic
markers are formed throughout the course of upbringing and socialization through
connecting certain classes of stimuli with certain classes of somatic statuses. There-
fore they touch on the process of the secondary emotions. The adaptive function of
the somatic marker (as an assistant with anticipatory skills) orientates itself towards
congenital, regulatory dispositions (internal preference system) which ensure the sur-
vival of the organism and take care of avoiding pain and seeking or increasing desire.
   Looking back at the functional mechanisms of emotion, one can differentiate four
forms of the decision making process: (A) in the context of the body-loop, the body is
actually (from the prefrontal cortex and the amygdala) prompted to take on a certain
state profile, the result of which (via the somatosensory cortex) is considered with
attention and perceived. (B) In the context of the as-if-loop the somatosensory cortex
functions (as instructed by the prefrontal cortex and the amygdala) as if the signals
were received from the body. Therefore the body is taken out of the loop, nevertheless
the as-if activity patterns influence the decision making process, as it suggests that
real bodily states are symbolically processed. (C) Additionally somatic markers (e.g.
feelings) can represent very concrete components or triggers for decisions, regardless
of whether they follow a real or representative route. (D) Very often decisions are
made, where it appears that no feeling at all was involved. Therefore it is not – and
that is key here – that it doesn’t come to an evocation of a bodily state or that of a
representative surrogate, but rather just that of the bodily state with which the signal
function is activated, it is simply just not considered and therefore not consciously
perceived [10, p. 84]. By this means somatic markers operate permanently outside of
consciousness and persistently influence conscious thought and decisions. Therefore
one differentiates between somatic markers with respect to the influence of emotion
and feeling on the decision making processes based on their neural route, (A) the real




                                    Page 19 of 171
body-loop versus (B) the representative as-if-loop and on the basis of their influence,
(C) manifest versus (D) covert.


3         Evaluation Models in Psychoanalysis

There are multiple aspects to the description of decision making in the “psychic appa-
ratus” in classical psychoanalytic theory [11, 14]: On the one hand the body delivers
via homeostatic differences drive tensions, so-called “quota of affects” represented in
the psyche, which can consequently cathect1 psychic contents. This allocation of the
“quota of affects” to psychic contents already activates content in the unconscious
whereby these become accessible for mental processing. The level of cathexis is a
measure of the grade of the activation, representing an evaluation, which ultimately is
a key factor in determining, if content shall be processed and ultimately become con-
sciously perceivable and actionable. The psychic contents on the other hand, come
from memory traces which are associated via perceptional data and drive representa-
tives and by this means serve as a basis for cathexis. A cathected association complex
is called thing presentation. This is, during the transition from (unconscious) primary
process to secondary process – upon going through a conflict regulating defense –
linked with a so-called word presentation, which means, that from now on a psychic
content can be treated within general (formal, verbal) logic. This was not yet possible
in the primary process, as this is governed by a pre-logical order of associations. Ca-
thexes, which in the course of the mental processing of the primary process have been
displaced many times, remain intact throughout these transitions. In the secondary
process, the topical description of which encompasses the psychoanalytical precon-
scious and conscious areas, are now fixed to the “quota of affects” of certain contents
and contribute, along with the logical links via word presentations to the evaluation of
the association complexes.
   The overall evaluation of action chains generated in this manner is regulated on the
one hand – in the primary process – by the so called “pleasure principle” and in the
secondary process by the “principle of reality”. The “pleasure principle” states that
the overall goal of all mental activity is to avoid unpleasure and to aim for pleasure
(as in [12, p.321]), the “principle of reality” is a variation upon this, namely the mo-
ments in which the outside world becomes included into these activity designs (as in:
[12, p.378]). Pleasure is created if psychic energy is discharged, unpleasure is equiva-
lent to the “quotas of affect” present within the apparatus. Both of these principles are
ultimately relevant for decision making and choosing a course of action, so much so,
that in total a maximum of expected pleasure less the necessary unpleasure in order to
achieve it is always sought. Primary and secondary process oriented thinking and
evaluation mechanisms complement each other towards taking action. Thinking is
essentially an experimental kind of acting. [13, p.220]. If action is undertaken, the
“quota of affects” is discharged and alongside the physical impulses, consciously
perceptible affects and impulses of feelings in particular shades are formed. Uncon-
1
    In psychoanalysis this also known as the economic aspect of psychological operation.
      Cathexis ( a psychoanalytic term) is the allocation of quota of affects to psychic contents.




                                         Page 20 of 171
scious affects, feelings and sensations are of no relevance in psychoanalytic theory,
they are, - in contrast to psychic contents –virtual qualities, which with respect to the
occupation conditions of the “quota of affects” can be constructed retrospectively [14,
p.176].


4      Emotions in Neuropsychoanalysis

Neuropsychoanalysis seeks to forge a connection between psychoanalytical models
and related neuroscientific findings [7, 15]. It seeks to assume a neuroscientific per-
spective of every mental function and thereby wishes to reassess Freud’s description
of the functional organization [15, p. 830]. The results of these comparisons may
remain patchy in accordance with the method applied and usually only the most sig-
nificant theses and statements of these disciplines are studied.
   Considering evaluation models for decision making, neuropsychoanalysis holds
that the conscious decisions for actions, in reality follow their unconscious initiation
[cf. 15, p. 384]. Feelings of pleasure and unpleasure with respect to an object or a
situation represent the most elementary evaluation of a consciousness, according to
Solms, Panksepp and Damasio [15, p. 836]. Likewise the basic units of these evalua-
tions, of the driving forces, can be illustrated neurologically and yield that: An amaz-
ingly large consensus emerges between Panksepp’s SEEKING-System and Freud’s
Libido-System and the highest priority of a regulating function of consciousness is to
generate feelings of pleasure and unpleasure, which in turn are then associated with
the objects which are best suited to their generation [cf. 15, p. 848].


5      Emotions in Agent-based Systems

In recent years several computational models of emotions have been developed and
integrated in the decision making process of artificial agents. These models differ in
various aspects. Generally they differ in the components which are considered as
being intrinsic to emotions (e.g. bodily processes, behavioral tendencies), in their
relationship to cognitive processes and in their representation [16]. The most im-
portant difference lies in the supporting theory, which in most cases originates from
psychology. This in turn influences the distinction if emotions are generated dynami-
cally (emergent emotions) or are designed explicitly (discrete emotions). These as-
pects of distinction are mirrored in the division of “appraisal, dimensional and ana-
tomical” computational models of emotion [16], whereby the former is the most
widespread due to its aptness in linking emotion with cognitive processes.
   In appraisal models (e.g. OCC Modell [17]), emotions are formed through the
evaluation of external events regarding the agent’s beliefs, desires and intentions,
whereby coping strategies (e.g. planning, delaying) are triggered. A computational
model of this, which offers the chance to adjust the appraisal process, is FAtiMA
Modular [18]. The agent architecture consists of an extensible core architecture which
offers the framework for various implementations of appraisal models, enabling easier
comparison. The appraisal process is split into the appraisal derivation and the affect




                                    Page 21 of 171
derivation. The former evaluates the relevance of an event and creates appraisal vari-
ables (e.g. unexpectedness, appealingness and desirability). The latter builds upon
these variables by creating the associated emotions, determined by a specific appraisal
theory. According to a set of rules, emotions then influence the choice of action in
either a reactive or deliberate form.
   In dimensional models, emotions are located in a dimensional space instead of be-
ing formulated as discrete entities. A typical model is the PAD model [19], with the
dimensions pleasure, arousal and dominance. Some computational models such as
ALMA [20] and WASABI [21] utilize both, appraisal models to model appraisal pro-
cesses, and dimensional models to model mood processes. Other models such as Mi-
croPsi [22, p.143-155] describe emotions implicitly as regions of a multi-dimensional
space, defined by the parameters which determine the behavior of the agent. These
are: arousal, resolution level, dominance of the leading motive, the level of back-
ground checks (the rate of the securing behavior), the level of goal-directed behavior,
and valence. Thus, explicit emotions do not exist for agents but rather emotions are
first attributed to an agent upon (self) perception.
   In conclusion, it can be stated that none of the models mentioned offers an embod-
ied model that holistically considers the various aspects of emotion, or is integrated in
a holistic cognitive architecture.


6      A Holistic and Embodied Emotion Model for Evaluation in
       Decision Making

Building on the findings of the various disciplines, we sketch a holistic and embodied
model. As shown above, the models of Damasio and psychoanalysis fulfill the initial-
ly mentioned criteria especially well. Insights from both theories confirm and com-
plement each other. For a technical model of the basic mechanisms of decision mak-
ing, the psychoanalytic findings mentioned above are particularly well suited as an
abstract framework (which is required for a holistic and coherent model), and Dama-
sio’s model is especially well suited for its concretization due to its consistent and
holistic character in considering the interaction between body and mind.
    The role of computer science here is to integrate the various models from other
disciplines in a consistent and coherent model of decision making, which is determin-
istic and can therefore be validated by means of simulation. Thus, computer science
enables a model building methodology and evaluation tool, by the means of agent
based simulation. The basic principle of this approach has been illustrated in a previ-
ous article [23], where a functional view of emotions in the decision making unit of
an agent was integrated. However, a holistic view considering the theories of Dama-
sios was neglected. Nevertheless, the fundamental principle remains intact, i.e. affec-
tive evaluation processes are the foundation of evaluating data (psychic contents,
thereby also actions and plans). These are those processes which use “quotas of af-
fects” or derived evaluation variables to determine the relevance of data, based on
memories, for decision making in a given situation (see Fig. 1). Thus, the evaluation
of data is an incremental process on multiple levels – considering various evaluation




                                    Page 22 of 171
principles (pleasure and reality principles) and evaluation influences (bodily influ-
ences and through perception activated memories and fantasies).
   Emotions are an additional level of this incremental and hierarchical multi-level
evaluation model. They represent (1) “quotas of affects” from the drives, (2) emotions
activated through perception and fantasy (memories associated with emotions), (3) the
current pleasure. Hence emotions form a holistic representation of the psychobiologi-
cal status of the agent (having information concerning the body and mental status)
and can therefore consider the overall status of the agent in the evaluation. The final
evaluation step is carried out by feelings, whereby depending on the intensity of the
emotion, it is transformed into a preconscious feeling and subsequently a consciously
“felt feeling” (in the sense of Damasios). The latter can be described as an inner per-
ception, upon which the agent can reflect. As with the other valuation variables, feel-
ings evaluate goals and plans by activating memories.




 Fig. 1. Evaluation is an incremental process that considers multiple influences and principles.

   By considering perception and fantasy, evaluation through feelings not only occurs
in the terms of gaining pleasure, but also in terms of avoiding unpleasure, that is to
say not just to support the fulfilment of drives but also to evaluate external events in
terms of their potential to increase unpleasure. Evaluation generally serves to priori-
tize and select actions, mediating between the environment and the internal state (e.g.
to fulfil desires in the environment and to adapt desires to external conditions).
   The representation of the biological aspect of the psychobiological status is
achieved through drives and body perception (proprioceptive and external percep-
tion). Whereby it must be emphasized that memory-based psychic representation
(representation of drives and body representation) is used for emotion generation (and
not the body signals as such). The psychic aspect of the psychobiological status is
represented by the memories activated by environment perception and fantasies. In
the sense of Damasio, one can conceptually speak of background emotions (red influ-
ences in Fig. 2), which can be considered as moods, and emotions triggered from the
outside world.
   The key concretization, when integrating Damasio’s model, concerns the consider-
ation of the embodiment by means of a mental representation of it. In this regard we
follow the approach of considering the psyche as an information theoretical level of




                                       Page 23 of 171
the physical world. This is reflected in the differentiation between the neural, neuro-
symbolic and physical levels (see Fig. 2), and also in the application of a memory
based physical representation (see Fig. 2).




                     Fig. 2. A holistic and embodied emotion model.


7      Conclusion

Interdisciplinary cooperation enabled us to outline a holistic model of emotion for
humanoid agents. Due to the consideration of bodily influences and the evaluation of
perceived events, the model outlined can be considered as being a combination of
both appraisal and dimensional models, whereby neuroscientific inputs and embodi-
ment are considered in developing a holistic model. Psychoanalysis and Damasio’s
neuroscientific model fulfill the initially mentioned criteria particularly well. Where-
by psychoanalysis offers us an abstract holistic framework which can be concretized
by means of Damasio’s model. Both models also complement each other, as Damasio
considers the interdependence of body and mind more concretely and is more con-
sistent. Neuropsychoanalysis supports our approach of combining psychoanalysis
with neuroscientific models, by revealing supporting evidence. Computer science
enables the combination of the various models in one consistent and holistic model
and offers an evaluation tool by means of simulation. Having outlined such a simula-
tion model, the next steps lie in extending an existing implementation of a holistic
functional model of the human mind [23], to integrate these new findings in a holistic
model of human information processing. We expect that the integration of the various
models in an overall evaluation model will yield new discoveries and opportunities in
simulations.




                                    Page 24 of 171
References
 1. Panksepp, J.: Affective Neuroscience. The Foundations of Human and Animal Emotions.
    Oxford University Press, New York (1998)
 2. Edelman, G. M., Tononi, G.: Neuronaler Darwinismus. Eine selektionistische Betrach-
    tungsweise des Gehirns. In: Meier, H., Ploog, D. (eds.): Der Mensch und sein Gehirn. Die
    Folgen der Evolution, 187-233, Piper Verlag, München (1997)
 3. Ledoux, J.: The Emotional Brain. The Mysterious Underpinnings of Emotional Life. Si-
    mon and Schuster, New York (1996)
 4. Cahill, L., Mcgough, J. L.: Mechanisms of emotional arousal and lasting declarative
    memory. In: Trends in Neurosciences 21, 284-299 (1998)
 5. Damasio, A. R.: Descartes’ Irrtum. Fühlen, Denken und das menschliche Gehirn.
    [Descartes' Error. Emotion, Reason, and the Human Brain Putnam. Penguin edition,
    London (2005)] Deutscher Taschenbuch Verlag, München (2001)
 6. Damasio, A. R.: Ich fühle, also bin ich. Die Entschlüsselung des Bewusstseins. [The Fee-
    ling of What Happens. Body and Emotion in the Making of Consciousness. Harcourt, New
    York (1999)] List Verlag, Berlin (2007)
 7. Solms, M., Turnbull, O.: The Brain and the Inner World. An Introduction to the Neurosci-
    ence of the Subjective Experience. Other Press, New York (2002)
 8. Kandel, E. R.: In Search of Memory. The Emergence of a New Science of Mind. Norton,
    New York (2006)
 9. Damasio, A. R.: Der Spinoza-Effekt. Wie Gefühle unser Leben bestimmen. [Looking for
    Spinoza. Joy, Sorrow, and the Feeling Brain. Harcourt, New York (2003)] List Verlag,
    Berlin (2007)
10. Huber, M.: Die Bedeutung von Emotion für Entscheidung und Bewusstsein. Die neurowis-
    senschaftliche Herausforderung der Pädagogik am Beispiel von Damasios Theorie der
    Emotion. Verlag Königshausen & Neumann, Würzburg (2013)
11. Freud, S.: The Interpretation of Dreams. The Standard Edition of the Complete Psycholog-
    ical Works of Sigmund Freud, Volume IV. Hogarth Press, London (1900)
12. Laplanche, J., Pontalis, J.B.: The Language of Psycho-Analysis.London: The Hogarth
    Press and the Institute of Psycho-Analysis, London (1973)
13. Freud, S.: Formulations on the Two Principles of Mental Functioning. The Standard Edi-
    tion of the Complete Psychological Works of Sigmund Freud, Volume XII, Hogarth Press,
    London, 213-226 (1911)
14. Freud, S.: The Unconscious. The Standard Edition of the Complete Psychological Works
    of Sigmund Freud, Volume XIV. Hogarth Press, London, 159-215 (1915)
15. Solms, M.: Sigmund Freud heute. Eine neurowissenschaftliche Perspektive auf die Psy-
    choanalyse. Psyche. 60, pp. 829-859 (2006)
16. Marsella, S. C., Gratch, J., Petta, P.: Computational models of emotion, In: K.R. Scherer,
    T. Bänziger, and E. Roesch, (eds.), Blueprint for Affective Computing. Oxford University
    Press, New York (2010)
17. Ortony, A., Clore, G. L., Collins, A.: The Cognitive Structure of Emotions. Cambridge
    University Press, New York (1990)
18. Dias, J., Mascarenhas, S., Paiva, A.: FAtiMA Modular: Towards an Agent Architecture
    with a Generic Appraisal Framework. In: Proceedings of the International Workshop on
    Standards for Emotion Modeling (2011)
19. Mehrabian, A., Russell, J.A.: An approach to environmental psychology. MIT Press, MA
    (1974)




                                      Page 25 of 171
20. Gebhard, P.: ALMA: A layered model of affect. In: Proceedings of the fourth international
    joint conference on Autonomous agents and multiagent systems. pp. 29-36 (2005)
21. Becker-Asano, C., Wachsmuth, I.: Affective computing with primary and secondary emo-
    tions in a virtual human. Auton Agent Multi-Agent Syst. 20, pp. 32-40 (2010)
22. Bach, J.: Principles of Synthetic Intelligence, Psi: An Architecture of Motivated Cognition.
    Oxford University Press, New York (2009)
23. Schaat, S., Doblhammer, K., Wendt, A., Gelbard, F., Herret, L., Bruckner, D.: A Psycho-
    analytically-Inspired Motivational and Emotional System for Autonomous Agents. In:
    Proceedings of the 39th Annual Conference of the IEEE Industrial Electronics Society, pp.
    6648 - 6653 (2013)




                                       Page 26 of 171