<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Learning to Cope with Critical Situations - An Agent based Approach</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>R´egis Newo</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Klaus-Dieter Althoff</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Hildesheim, Institute of Computer Sciences, Laboratory of Intelligent Information Systems</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>How does someone react when he faces a critical situation in his life? In this paper we present an initial initial implementation architecture based on a simulation model described in [10] In our model we mainly consider the interactions between a person concerned and factors like his environment and his own abilities. Using the empolis information access suite, we currently implement our model by means of a multiagent system approach, realized by distributed knowledge-based systems with a specific focus on case-based reasoning technology.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>In our everyday life, we consistently face situations which pose more or less
immense challenges. Examples can be the breakup with a partner, the loss of a
job, an illness or even the death of a relative. As different as those challenges
can be, the reactions of the persons who are facing the same kind of challenges
can be very different as well. The problem consists in finding out, how someone
reacts when he/she faces up a given challenge. The problem being a
psychological one, there have been many research groups in psychology working in that
direction, beginning in the early 1980s. They developed psychological models
and paradigms in order to represent and analyse people’s behaviours as well as
theories, sotware-based models, and simulation approaches.</p>
      <p>In this paper, we present an agent-based approach for the representation and
simulation of human behaviours in critical situations. For this purpose we
developed - in cooperation with Werner Greve (Institute of Psychology,
University of Hildesheim1) - the SIMOCOSTS (SImulation MOdel for COping
STrategy Selection) model. In the SIMOCOSTS project we are actually aiming at
a threefold goal, namely (1) developing a research software tool for supporting
psychologists, who are working on cognitive modelling and learning as roughly
described above, in their research work, (2) realizing what we call ”collaborative
multi-expert-systems” (CoMES; see below), and (3) instantiating the SEASALT
software architecture we developed in our research lab as a first step towards
realizing CoMES. In this paper, we elaborate on how we currently intend to
implement our simulation while focussing on the representation of the needed
1 http://www.uni-hildesheim.de/psychologie/mitglieder/werner greve.htm
knowledge.</p>
      <p>In the next section, we will shortly introduce CoMES and SEASALT and
discuss related work. We describe the SIMOCOSTS model, its functionality, the
developed knowledge representation and processing in Section 3, and the status
of its implementation in Section 4. Finally in Section 5 we give a short outlook
on relevant future work.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Background and related work</title>
      <p>
        In this section we shortly explain the underlying CoMES approach and its first
instantiation via the SEASALT architecture. Related work from the areas of
cognitive architectures, coping processes, and other related psychological areas
can be found in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
2.1
      </p>
      <sec id="sec-2-1">
        <title>Collaborative Multi-Expert-Systems</title>
        <p>
          Collaborative Multi-Expert-Systems (CoMES, see also [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]) denote a new research
approach that is both, a continuation of the well-known expert system approach
and a research direction based on the ideas of case factory and knowledge-line [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ].
In the Knowledge-line concept we systematically apply the software product-line
approach [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ] from software engineering to the knowledge of knowledge-based
systems. This enables the necessary ”knowledge level modularization” for
building potential variants in the sense of software product-lines. The modularization
can be achieved by making use of multi-agent systems [
          <xref ref-type="bibr" rid="ref12 ref6">6, 12</xref>
          ] as a basic approach
for knowledge-based systems. An intelligent agent - as a first approximation - is
implemented as a case-based reasoning (CBR) system [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ], which, besides
casespecific knowledge, can also include other kinds of knowledge. Each CBR agent
is embedded in a case factory [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] that is responsible for all necessary knowledge
processes like knowledge inflow, knowledge outflow as well as knowledge analysis.
While many early (and also some current) expert systems had the problem of
acquiring and maintaining their knowledge, the underlying idea in CoMES is to
”develop CoMES where knowledge is produced”. Another idea is to keep the
resulting learning scenarios/tasks as simple as possible, thus having more agents
and having each one learning in a rather simple way.
2.2
        </p>
        <p>
          Sharing experience using an agent based system architecture
layout
A first step towards realizing the CoMES approach is the SEASALT (Sharing
Experience using an Agent based System Architecture LayouT) architecture.
The architecture can be vertically split in two parts as can be seen in Figure
1. On the left hand side the knowledge provision and on the right hand side
the knowledge acquisition. For the current stage of the SIMOCOSTS project
we focus on the knowledge provision part only (a more detailed description of
SEASALT is given in [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]). If a user enters a question using the Interface, it passes
the question on to the Coordination Agent. The Coordination Agent analyzes
the question, looks up the matching Topic Agent(s) and sends its requests to
them. A response based on the existing case base is created by each Topic Agent
and passed back to the Coordination Agent. Finally, the response of the Topic
Agents is used by the Coordination Agent to compile an answer.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>A Simulation Model for Coping Strategies</title>
      <p>
        SIMOCOSTS (SImulation MOdel for COping STrategy Selection) is the
underlying model for our simulation. The model is based on the psychological theories
developed by Brandst¨adter and Greve [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. One main difference between our
simulation approach and other ones consists in the fact that all the other view the
respective persons as agents. But we intend to represent a person with many
agents while following the holonian concept [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] in order to have a detailled and
agent-based representation of each individual. A detailled picture and
description of the model can be found in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
      </p>
    </sec>
    <sec id="sec-4">
      <title>An Implementation Architecture for the Simulation of</title>
    </sec>
    <sec id="sec-5">
      <title>Coping Strategies</title>
      <p>
        We developed the model mentioned in the previous Section with a main focus
on the processes needed for the simulation. The main drawback of that model
is that it is not suitable for an (initial) implementation. We thus present in
this Section the implementation architecture of our simulation tool. We want to
start with a rather simple architecture which will be later expanded, because of
the complexity of the task. The main idea of our architecture is based on the
fact that each person has some goals that he wants to achieve (see [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]). In our
scenario, a critical situation occurs when there exist some facts that prevent the
person from reaching those goals.
      </p>
      <p>
        As we know, human acts (especially while loosing problems) is mostly based
on past experiences. For our purpose, the achievement of goals as well as the
general knowledge that will be used for the achievement of the goals will be based
on past experiences. That is why we will make use of the case-base reasoning
technology in our implementation. Furthermore, we will implement the goals by
using the so called practical reasoning agents paradigm [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], which is based on
the Belief-Desire-Intention (BDI) principle.
      </p>
      <p>Our architecture (see Figure 2) consists of the three main following parts.
Knowledge Base The knowledge base consists of all the general knowledge,
that can be helpful while loosing the problem. That knowledge include skills,
material and/or social environment, etc. We plan to use many differents case
bases for the different case bases for the distinct parts of the general knowledge
needed (e.g. skills).</p>
      <p>The Strategies In our architecture, the strategies represent the actions (in
analogy to BDI agents) that can be used for the computation of the plan in
the means-ends reasoning stage. These actions mostly have an impact on the
knowledge base defined earlier (e.g. the acquisition of a new skill) as well as on
the internal goals (i.e. adaptation of the goals). We plan to implement those
strategies as rules in a case-base reasoning system.</p>
      <p>The (internals) Goals The initial goals of the person are the initial beliefs of
the agents which are used for the computation of the intentions when a critical
situation occurs. Each agent is responsible for analyzing if its goals are still
reachable (i.e. there is no critical situation). , we will implement the goals as
cases in a case-base reasoning system.</p>
      <p>
        When a situation is judged as critical, each affected goal try to find out how
it can be achieved. The achievement is done by using the strategies, which are
based on the general knowledge of the person. Actually we started to build,
using CBR, a knowledge base needed for a specific example (i.e. breakup of a
partner). This has to be very sound in order to have a plausible simulation. We
plan to use the Information Access Suite of empolis [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] GmBH for the realization
of our architecture, because it is a powerful tool which gives us the possibility
to handle case bases as well as rules.
4.1
      </p>
      <sec id="sec-5-1">
        <title>Classification of the Architecture</title>
        <p>Our Architecture follows the principle of the CoMES approach introduced in
Section 2.1 and leans on the SEASALT architecture which we presented in
Section 2.2. We have a knowledge line in our implementation architecture which
contains the three parts presented above. In fact, the knowledge line in our
architecture can be seen as all the informations needed to represent a person. We
thereby achieve the reusability which is important while developing a knowledge
line in terms of CoMES.</p>
        <p>As for the similarities with the SEASALT architecture, we will also have a
community which will consist of experts in the area of psychology. The goals can be
seen as the topic agents in SEASALT and we also a knowledge engineer whose
task will be the acquisition of the information needed for a person. We also have
a distributed architecture because it is based on the CoMES approach.
5</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Outlook and Conclusion</title>
      <p>In this paper, we presented an architecture for the implementation of the
simulation of coping processes. After the introduction of the CoMES approach and
the SEASALT architecture, we presented our an implementation architecture
based on the SIMOCOSTS model. Our implementation will be based on two
main technologies, namely case base reasoning and multi-agent systems, while
following the CoMES approach.</p>
      <p>Further work include an accurate specification of the knowledge base an its
implementation as well as the implementation of strategies and goals for given
examples.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Klaus-Dieter Althoff</surname>
          </string-name>
          .
          <article-title>Case-based reasoning</article-title>
          . In S.K. Chang, editor,
          <source>Handbook on Software Engineering and Knowledge Engineering</source>
          . Vol.
          <volume>1</volume>
          ,
          <string-name>
            <surname>World</surname>
            <given-names>Scientific</given-names>
          </string-name>
          , pages
          <fpage>549</fpage>
          -
          <lpage>587</lpage>
          .
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Klaus-Dieter</surname>
            <given-names>Althoff</given-names>
          </string-name>
          , Kerstin Bach,
          <string-name>
            <surname>Jan-Oliver</surname>
            <given-names>Deutsch</given-names>
          </string-name>
          , Alexandre Hanft, Jens M¨anz, Thomas Mu¨ller, R´egis Newo, Meike Reichle,
          <string-name>
            <given-names>Martin</given-names>
            <surname>Schaaf</surname>
          </string-name>
          , and
          <string-name>
            <surname>Karl-Heinz Weis</surname>
          </string-name>
          .
          <article-title>Collaborative Multi-Expert-Systems - Realizing Knowlegde-Product-Lines with Case Factories and Distributed Learning Systems</article-title>
          . In J. Baumeister and D. Seipel, editors,
          <source>Accepted for Proc. 3rd Workshop on Knowledge Engineering and Software Engineering (KESE</source>
          <year>2007</year>
          ), Osnabru¨ck, Germany, Berlin, Heidelberg, Paris,
          <year>2007</year>
          . Springer Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Klaus-Dieter</surname>
            <given-names>Althoff</given-names>
          </string-name>
          , Alexandre Hanft, and
          <string-name>
            <given-names>Martin</given-names>
            <surname>Schaaf</surname>
          </string-name>
          .
          <article-title>Case factory - maintaining experience to learn</article-title>
          . In Mehmet H. G¨oker, Thomas Roth-Berghofer, and H. Altay Gu¨venir, editors,
          <source>Proc. 8th European Conference on Case-Based Reasoning (ECCBR'06)</source>
          , O¨lu¨deniz/Fethiye, Turkey, volume
          <volume>4106</volume>
          of Lecture Notes in Computer Science, pages
          <fpage>429</fpage>
          -
          <lpage>442</lpage>
          , Berlin, Heidelberg, Paris,
          <year>2006</year>
          . Springer Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Kerstin</given-names>
            <surname>Bach</surname>
          </string-name>
          , Meike Reichle, and
          <string-name>
            <surname>Klaus-Dieter Althoff</surname>
          </string-name>
          .
          <article-title>A Domain Independant System Architecture for Sharing Experience</article-title>
          . In Alexander Hinneburg, editor,
          <source>Proceedings of the LWA</source>
          <year>2007</year>
          : Lernen - Wissen - Adaptivita¨t, pages
          <fpage>296</fpage>
          -
          <lpage>303</lpage>
          ,
          <year>September 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>J.</given-names>
            <surname>Brandtsta</surname>
          </string-name>
          <article-title>¨dter and</article-title>
          <string-name>
            <given-names>W.</given-names>
            <surname>Greve</surname>
          </string-name>
          .
          <article-title>The aging self: Stabilizing and protective processes</article-title>
          .
          <source>Developmental Review</source>
          ,
          <volume>14</volume>
          :
          <fpage>52</fpage>
          -
          <lpage>80</lpage>
          ,
          <year>1994</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Hans-Dieter Burkhard</surname>
          </string-name>
          .
          <article-title>Software-agenten</article-title>
          . In Gu¨nther G¨orz,
          <string-name>
            <surname>Claus-Rainer Rollinger</surname>
          </string-name>
          , and Josef Schneeberger, editors,
          <source>Handbuch der Ku¨nstlichen Intelligenz</source>
          ,
          <volume>4</volume>
          . Auflage, pages
          <fpage>943</fpage>
          -
          <lpage>1020</lpage>
          . Oldenbourg,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. empolis GmbH.
          <article-title>Technisches white paper e:information access suite</article-title>
          .
          <source>Technical report</source>
          , empolis GmbH,
          <year>September 2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8. S. Glu¨ckselig.
          <source>Holonische Multiagentensimulation. Master's thesis</source>
          , Universita¨t Wu¨rzburg,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9. Thomas Mu¨ller. Simulation kognitiver Prozesse mit Multiagentensystemen.
          <source>Master's thesis</source>
          , Universit¨at Hildesheim,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. R´egis Newo, Thomas Mu¨ller,
          <string-name>
            <surname>Klaus-Dieter Althoff</surname>
            , and
            <given-names>Werner</given-names>
          </string-name>
          <string-name>
            <surname>Greve</surname>
          </string-name>
          .
          <article-title>Learning to Cope with Critical Situations - A Simulation Model of Cognitive Processes using Multiagent Systems</article-title>
          . In Alexander Hinneburg, editor,
          <source>Proceedings of the LWA</source>
          <year>2007</year>
          : Lernen - Wissen - Adaptivit¨at, pages
          <fpage>159</fpage>
          -
          <lpage>164</lpage>
          ,
          <year>September 2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. Frank van der Linden, Klaus Schmid, and
          <string-name>
            <given-names>Eelco</given-names>
            <surname>Rommes</surname>
          </string-name>
          .
          <source>Software Product Lines in Action - The Best Industrial Practice in Product Line Engineering</source>
          . Springer, Berlin, Heidelberg, Paris,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12. Gerhard Weiß, editor.
          <source>Multiagent Systems. A Modern Approach to Distributed Artificial Intelligence</source>
          . The MIT Press,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>Michael</given-names>
            <surname>Wooldridge</surname>
          </string-name>
          .
          <article-title>An Introduction to MultiAgent Systems</article-title>
          . John Wiley &amp; Sons,
          <year>June 2002</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>