<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Community Dynamics in case of Critical Hydrogeological Phenomena: Some Simulated Scenarios</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Rino Falcone</string-name>
          <email>rino.falcone@istc.cnr.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alessandro Sapienza</string-name>
          <email>alessandro.sapienza@istc.cnr.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Cognitive Science and Technology - National Research Council of Italy(ISTC-CNR)</institution>
          ,
          <addr-line>00185 Rome</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The problem of critical floods has raised a lot of interest in the last few years, due to the significant losses they can cause, both in economic terms and especially in terms of injuries and human lives. In this work we provide some useful insights about critical weather phenomena, focusing on the strict relationship between citizens and the authority. We realized a simulative agent-based platform in which the citizens (modeled through cognitive agents) need to identify -on the basis of their information sources and of the trustworthiness attributed to them- the risks to which they are exposed and act accordingly. The main results of this work are: 1) the identification of the most significant indexes to evaluate the citizens' performance; 2) a detailed analysis of some possible strategies for the citizens and for the authority; 3) the identification of what we call ”dissonance between evaluation and action”, i.e. the fact that in a risky situation I could trust my sources and what they report, but still acting differently from what they suggest.</p>
      </abstract>
      <kwd-group>
        <kwd>trust</kwd>
        <kwd>social simulation</kwd>
        <kwd>multi-agent systems</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Every year the whole world is subjected to enormous inconvenience due to critical
weather phenomena and in particular floods. The most important issue is the serious
loss in terms of lives. This is the primary reason why governments should seriously
care about floods (their prevention, but also their management and monitoring).
Moreover, hydrogeological disasters often produce a huge economic loss [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Cun˜ ado &amp;
Ferreira [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] report that floods represented 40% of all natural disasters between
19852009. Guha-Sapir et al. [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] state that in 2013 hydrogeological disasters took the largest
share in natural disaster occurrence (48.2%) and that the most expensive
hydrogeological disaster ever registered happened in Thailand in 2011, causing US$ 41.4 billion
of damages. The point is that the whole damage is not so easy to estimate. The direct
damages, produced to buildings, infrastructures, houses, streets and farming, are easier
to detect. Actually, these natural disasters can also cause a series of secondary and
indirect damages, much more difficult to quantify. Let’s just think to psychological traumas
[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], or other kind of disease [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] that a critical event can provoke, maybe due to the
risk of dying, to the loss of material goods or even loved ones.
      </p>
      <p>
        Grothmann &amp; Reusswig [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] report that ”self-protective behavior by residents of
floodprone urban areas can reduce monetary flood damage by 80%, and reduce the need for
public risk management”. Then, while floods represent a very serious threat both to the
authorities and the population, the adoption of self-protective behavior by citizens can
substantially reduce the problem of direct and indirect damages.
      </p>
      <p>The local authorities are crucial in this situation. Their role is not just helping people
after a disaster, but they should instead stimulate preventive behaviors, which can in
turn minimize the future risks. The damage a population suffers strictly depends on the
strong relationship with authority. Both the citizens and the authority have their own
goals. In particular, each citizen wants to protect its own interests, while the authority
has to protect and safeguard the collective interest. In general their interests should
converge, but this is not always true; it is essential to study their behavior in order to
understand how they relate to each other and what is the outcome of their interaction.
In this work we propose a multi-agent system approach, in which the citizens and the
authority are modeled through cognitive agents. We intend to provide a useful tool to
analyze the problem both from the authority’s and from the citizens’ point of view.
2</p>
    </sec>
    <sec id="sec-2">
      <title>State of the art</title>
      <p>
        Identifying and measuring risks and vulnerabilities before a disaster occurs is essential
to reduce the impact of the disaster itself. The current literature proposes a lot of
studies on natural risks, even if just a few of them focuses on the human behavior [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ][
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].
Moreover, the risk attitude is domain specific [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ], so it is not possible to take into
account results concerning different natural phenomena, applying them to floods.
The classical approach to the problem is that of survey [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ][
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. After defining a
psychological model for the population, this method aims to exploit surveys to identify the
correlations among the psychological variables introduced in the model.
In [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] the authors state that the monetary damage can be reduce by the 80% just thanks
to the citizens’ adaptation measures. They propose a socio-psychological model
explaining why some people adopt precautionary measures while others do not, showing
the correlations between the model parameters and the citizens’ actions.
Another way to deal with this topic is to take into account the historical evolution of the
phenomena happened in a given geographical area: the way they happened, their
intensity, frequency etc. For instance [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] analyzed all the historical natural events occurred
in a mountain area in the Central Italian Alps, producing a georeferenced database. The
authors show how making use of this historical information is fundamental to identify
hypothetical critical scenarios and to evaluate the territorial threats and then to handle
future emergencies.
      </p>
      <p>
        The simulative approach is normally used to estimate the damage that an event can
cause [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ][
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. For instance, in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] the authors propose a model simulating critical
scenarios and evaluating the expected economic loss.
      </p>
      <p>
        Alternatively, social simulations can be used to model citizens’ decision in the case
of critical weather phenomena. In [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], the authors create a computerized simulation
model for capturing human behavior during flood emergency evacuation. The idea is
that of producing a useful tool for assisting the decisions of emergency managers. Their
complex model, which can be summarized in the four phases of concern, danger
recognition, acceptance and evacuation decision, is very focused on the citizen, but
underestimates the relationship with the sources reporting the information to it.
Another critical point is the performance evaluation. Usually, the platforms
simulating human response consider the number of citizens successfully evacuated or alive
after the event. This is truly the most important dimension: we want our citizens to be
safe. But this dimension becomes important in a short time window. In a longer
period view, it is necessary to consider other indexes. In our work, we want to provide
a novel approach to deal with this topic, exploiting trust and multi-agent systems. We
investigate the citizens decision to take precautionary actions or not, thus we consider a
medium/long term window. In our approach we use social simulations and a multi-agent
system to study the problem, modeling both the citizens and their sources as cognitive
agents and also focusing on their interaction, mediated by trust. This way to analyze
the problem allows showing some interesting outcomes, as we have the possibility to
put into the same world a huge number of agents interacting with each other and we
can infer what social phenomena emerge. Moreover, this approach allows us to study
the role and the influence of the individual actions on the general context, changing the
parameters referred to the individuals and observing the results on the society.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>The framework</title>
      <p>
        The simulations were realized using NetLogo [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ], an agent-based framework, while
the trust model was implemented in Java and imported as a plug-in into NetLogo.
Given a population distributed over a wide area, some weather phenomena happen over
time in the world with a variable level of criticality. Our classification of the events
is based on [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], except that, as we are not interested in the difference between low
and no damages events, we considered them to be the same event. Consequently, we
implemented in the framework three possible events: event 1 (light or no event), event
2 (medium event) and event 3 (critical event). Moreover [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] provides the frequency
with which these events occur: 77,91 light event; 17,44% medium event; 4,65% critical
event. Each of these events can cause damage to citizens’ personal capital and to the
authority’s social capital. The events happen in a time window covering a long period
(months); we are not analyzing short-term situations.
      </p>
      <p>The population is modeled through cognitive agents (citizens), randomly distributed
and having the necessity to identify the future weather event on the basis of their
information sources and of the trustworthiness they attribute to these different sources:
1. Citizens’ personal judgment, based on the direct observation and evaluation of the
phenomena.
2. The authority, which distributes into the world weather forecast, trying to prepare
citizens to what is going to happen.
3. Observation of the others’ behavior (other agents in the radius of 3 NetLogo patches):
agents are in some way influenced by community logics, tending to partially or
totally emulate their neighbors’ behavior. According to this source, the probability of
each event is directly proportional to the number of neighbors making the related
decision.</p>
      <p>
        They possess an initial capital to administer, making the correct investments; thus
they need to understand which is the most convenient choice for them, according to the
costs and damages related to each decision. Here we focus on direct damages, we are
not considering indirect damages, due to the difficulties to compute them. Other works
tried to model them as a percentage of direct damages [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]; we believe it is a much
more complex issue.
      </p>
      <p>The authority informs promptly the citizens about the weather phenomena. Notice
that, being just forecasts, it is not certain that what it reports is really going to happen.
The probability that a forecast is correct is linked to the standard deviation of the source.
Furthermore, the citizens can evaluate the situation on their own and can also exploit
the evaluations produced by their neighbors (seeing the effect of their decisions). The
social source is the result of the agents’ decisions aggregation in the neighborhood:
if a neighbor has not decided, it is not considered. Then they estimate the probability
that each event occurs, considering all the information they can access and aggregating
each single contribute according to the corresponding trust value. When the event ends,
the citizens adjust the trust values of their sources, on the basis of the corresponding
performances. We repeat this phase 100 times, enough to properly evaluate the sources.
After that, each citizen possesses a final capital and it has avoided a given amount
of damage; the same applies to the authority. The best strategy will maximize these
two dimensions, but it is not sure that the strategy maximizing the performance of the
citizens maximizes also the authority’s performance.
3.1</p>
      <sec id="sec-3-1">
        <title>Managing information through trust</title>
        <p>
          According to [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ], trusting an information source s means to use a cognitive model based
on the dimensions of competence and reliability/motivation of the source, which in
turn may arise for different reasons: direct experience with the source on that specific
kind of information content; recommendations of other individuals about s or
reputation (the shared general opinion of others about s) on that specific information content
[
          <xref ref-type="bibr" rid="ref6">6</xref>
          ][
          <xref ref-type="bibr" rid="ref16">16</xref>
          ][
          <xref ref-type="bibr" rid="ref17">17</xref>
          ][
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]; the categorization of s (it is assumed that a source can be categorized
and that its category is known), exploiting inference and reasoning (analogy,
inheritance, etc.)[
          <xref ref-type="bibr" rid="ref4">4</xref>
          ][
          <xref ref-type="bibr" rid="ref8">8</xref>
          ][
          <xref ref-type="bibr" rid="ref9">9</xref>
          ].
        </p>
        <p>
          The trust model used in this work exploit the trust definition defined in [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] and
mainly relies on direct experience to produce evaluations. Actually, we also use the
categorization analysis for distinguishing the sources on the basis of their different nature.
        </p>
        <p>This model is composed by a set of citizens C, sources S, and information I. Each
citizen ck evaluates the performance of its information sources, in order to understand
how trustworthy they are, concerning a specific kind of informative task. They will use
the function trustOnS : S x I ! T ,where T is a real value defined in the range [0; 1],
producing a different evaluation for each source according to their direct experience.</p>
        <p>Initially, there is no evidence about the sources’ performance, and then these
values are set to 0.5 (a situation of uncertainty between trust and distrust). Each source
s possesses the information i, represented with a probability density function (PDF),
divided into 3 segments (seg1, seg2 and seg3), as there are the 3 possible outcomes
(light, medium and critical event). The citizens can access the PDF through the
function getInf o : S x T ! I. Here the trust value is fundamental. In fact, the information
obtained with getInfo is not exactly the one reported by the source, but it is properly
manipulated according to trust: the citizens will use it as a weight to smooth the PDF.
The idea is that we trust on what the source says proportionally to how much we trust
the source itself. The individual segments of the PDF are smoothed as in Equation 1.
The Equation 2 has the purpose of normalizing the PDF (in order to be a PDF, its area
needs to be equal to 1). Once estimated the PDF for each information source, they are
aggregated through aggr : I x I ! I. Each agent initially possesses a global
distribution (global evidence or ge) with no evidence/information. Then it will add the
information coming from each source. Here (equation 3) we use the classical Bayesian
logic, recursively on each source:
newSeg1j = (1 + (segj
newSeg2j =
newSeg1j
PN
j=1 newSeg1j
1) trustOnS(s; i))</p>
        <p>N
newGe = aggr(ge; i) =
ge i
N F</p>
        <p>Here N is the number of segments and it is equal to 3; the index j goes from 1 to N .
The output newSeg1j of Equation 1 is the new value of the segment, but it still needs
to be normalized. This is done in Equation 2, which in fact takes as input newSeg2j
to produce newSeg2j . N F is a normalization factor that, as for i, ensures ge is still
a probability density function. In other words newGe, that is the global evidence that
an agent has, is computed as the product of the old ge and the new contribute reported
by the source. The probability that each event will happen is obtained by integrating
information i in the segment representing the specific event. The citizens will reason
about these probabilities to make their decisions.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Updating trust</title>
        <p>
          Our citizens need to adapt to their world, which in this framework means to produce a
trust evaluation [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ][
          <xref ref-type="bibr" rid="ref22">22</xref>
          ] of their information sources, understanding how reliable they
are. As mentioned above, at the beginning they possess a neutral trust value (the
initial trust is 0.5), which is the starting point for feedback on trust. The new trust value
(newTs: trust on the source s) is computed as the weighted mean of the old evaluation
ts and the new performance newP erf ormances:
(1)
(2)
(3)
(4)
(5)
(6)
newTs =
        </p>
        <p>ts +
= jAvoidedDamage
= jIncurredDamage
newP erf ormances
+
IncurredCostj
IncurredCostj</p>
        <p>In Equation 4 newP erf ormances is obtained comparing what the source said with
what actually happened. We take into account just a portion of the reported PDF, i.e.
the estimated probability of the actually occurred event.</p>
        <p>Here and are respectively the weights of the old trust value and the newly-realized
experience. In particular has a fixed value equal to 10; on the contrary, changes in
the range [0; 10] on the basis of the risk to which the agent is subjected, computed as
the effective damage and the cost of my decision. In particular, if the source suggests
to invest (critical and medium events) the agent will consider the damage it avoided
thanks to the source as in Equation 5 (or that it would have avoided if it had listened to
it), while for light events’ forecasts it will consider the incurred damage, as in Equation
6. In both cases the agent will take into account the decision-making cost.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Citizens’ description</title>
        <p>One of the parameters characterizing the citizens is the trust they have in their
information sources. This is a dynamic value, changing because of direct experience (see
Section 3.2). Each citizen is also characterized by its ability to see and to read the
phenomena. For representing these abilities, we associated with the citizens’ evaluations
a value of standard deviation related to the meteorological events. In the simulations
we used the value 0.7, producing a correctness of 45% for agents’ personal evaluations.
This value seems to us to represent more realistically the citizen’s ability to make
predictions on his own.</p>
        <p>Further, citizens possess an initial monetary capital; they want to save it, but it could
decrease in time. Each citizen decides if to invest its capital to make security
modifications to its own property, reducing or even deleting the possible damage in case of an
event. If it does not, it exposes itself to the risk of a possible high damage.
3.4</p>
      </sec>
      <sec id="sec-3-4">
        <title>The authority</title>
        <p>The authority wants to inform citizens about what is going to happen and to stimulate
them to invest in order to reduce possible damages. We suppose that it is able to
inform all the citizens with a high level of correctness. Its forecasts are produced using a
standard deviation of 0.5, meaning that it will have a correctness of 70%. As a choice,
we made that the information coming from the authority has a greater correctness than
that coming from personal evaluation. This is reasonable, as the authority possesses the
tools to make a good prediction, while usually the individual citizens do not.
Even the authority has a capital, which can be used to stimulate citizens to take
preventive measures for the incoming events. In particular, there are three possible strategies.
A punitive authority fines citizens if it asks them to take measures and they do not do
it. However, it will not discover all the guilty citizens, but just a percentage of them.
The fine value is equal to the maximal investment and the fine probability is 20%. The
fines increase the capital of the authority. An encouraging authority monetarily helps
citizens to take measures; if the citizens make an investment, they will receive an
incentive equal to the 50% of the investment. A punitive and encouraging authority fines
citizens if they do not take measures and it helps them if they make the investment.</p>
        <p>In addition to this, the authority suffers damage due to the wrong choices of citizens.
In fact when the population is affected by a medium or critical event there will be the
necessity to help it: the cost of hospitalization for the wounded, the cost of restructuring
infrastructures and the cost of helping population, etc. The authority will have to act
and that will consequently corrode its capital. In practice, it needs to understand if it is
better to invest in the preventive phase or in the intervention phase, after the event.</p>
      </sec>
      <sec id="sec-3-5">
        <title>How citizens decide</title>
        <p>The citizens need to identify the most convenient decision in every situation,
considering the information they have on the specific context in which they act. They can
make the maximal investment: in this case the damage is reduced to zero for light and
medium events and it is minimal for critical events. This is the most conservative
choice. They can make the medium investment: even in this case there are no damages
for light and medium events, but there is an important damage for critical events. At
last, they can decide not to invest: this decision allows saving money, but it exposes the
citizens to high damages in case of medium events and very high damages in case of
critical events.</p>
        <p>From the global evidence ge described in Section 3.1, the citizens subjectively
estimate the probability with which each event will occur: P(e1), P(e2) and P(e3). Their
final decision depends on 1) the probability that each specific event occurs (based on
the information coming from their information sources), 2) the fixed costs related to
each decision, 3) the possible damage depending on the event that is going to happen.
The computation of these costs is made using the formulas 7, 8 and 9.</p>
        <p>P CM I = M I +
P CmI =</p>
        <p>M I
2
+</p>
        <p>M axD
2</p>
        <p>P (e3)
M axD
4</p>
        <p>P (e3)</p>
        <p>Inc
Inc
2
+</p>
        <p>F
2</p>
        <p>P (F )
(7)
(8)</p>
        <p>M axD
P CN oI = M axD P (e3) + P (e2) + F P (F ) (9)
2</p>
        <p>Here P CM I, P CmI and P CN oI are respectively the probabilistic costs for the
maximal, medium and no investment, M I = 1 is the maximal investment, M axD =
10 is the maximal damage, Inc = 0:5 is the maximal incentive, F = 1 is the fine
amount, P (F ) = 0:2 is the fine probability.</p>
        <p>In the Equations 7, 8 and 9 incentives and fines are considered (or not considered)
according to the authority’s profile. These formulas take as input the actual cost an agent
has to pay taking a given choice and the potential damage that it could suffer, providing
just a probabilistic estimation. What it will pay depends on its decision and on the event
that will actually happen.</p>
        <p>We define this kind of agents ESC (exploiting sources and costs). This is the most
possible rational agent in this context, as it takes into account all the information it has.
However, not all the citizens decide to use the same logic: someone could just focus on
a part of these data. To model that, we introduced in the simulation five agent’s type.
Random agents do not consider any information about the event, and then their decision
is absolutely random. This is the most basic kind of agent.</p>
        <p>A Priori agents (AP agents) consider the a priori probabilities of the events, which
characterize the world, but do not refer to the specific situation. It acts considering the most
probable event; therefore it will always make the same choice.</p>
        <p>A Priori and Costs agents (APC agents) are able to evaluate both the a priori
probabilities and the costs and damages corresponding to each decision. Although they
produce a better evaluation than AP and random agents, their decisions are still
contextindependent, then they will always take the same choice.
Exploiting Sources agents (ES agents) estimate the events’ probability using the
available information sources. Then they will decide according to the most probable event,
just following the sources and their trustworthiness.</p>
        <p>Exploiting Source and Costs agents (ESC agents) are the most complete agents,
exploiting all the available information.</p>
        <p>It is worth noting that while the fourth kind of agent acts maximizing the probability
to guess the event, the fifth type has the aim of minimizing the possible losses. These
two different goals lead to different choices and performances.
3.6</p>
      </sec>
      <sec id="sec-3-6">
        <title>Output’s parameters</title>
        <p>In order to evaluate the agents’ performance in each scenario, it is necessary to identify
the most representative dimensions. The most intuitive is the final capital. It provides
a representation of how good is the citizen in saving money. This would be enough if
the citizens’ capital were not influenced by the authority. Given that, we need also to
take into consideration the citizen’s ability to avoid damages. This dimension is crucial,
since we do not just want them to save money, but to be safe. The final capital and the
avoided damage need to be considered together as they provide a partial view of the
performance if taken individually: an agent performs properly if it saves enough capital
and it avoids a high percentage of damage. These dimensions are available both for the
citizens and the authority. Another dimension is the percentage of successes the citizens
have in facing a given type of event with the adequate investment. Finally, we consider
the percentage of times the citizens follow what a specific source reports. In particular,
we will use it for the authority.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>The simulation</title>
      <p>In this scenario, we identify the performance of each agent’s profile, starting from the
simplest to the most sophisticated one. Experimental setting: number of citizens = 200;
citizens’ initial capital = 100 units; authority reliability = 0.5, which implies a
correctness of 70%; authority’s profile = punitive, encouraging, punitive and encouraging;
authority’s initial capital = 20000 units; maximal investment = 1 unit; medium
investment = 0.5 units; maximal damage = 10 units; medium damage = 5 units; fine amount
= 1 unit; fine probability = 20%.
event, which in this case is the light event: they will never make an investment, always
suffering all the damages. Their performance is even worse than the random agent’s
one. Their capital assumes a very negative value, while their avoided damage is always
equal to zero, as they do not make investments.</p>
      <p>APC agents start making considerations about the costs and damages linked to their
decisions. Their performance seems to be good enough. Even if they do not use their
information sources, they know that each decision is associated with a cost, but also a
risk, a possible damage. Thanks to this knowledge, they get a good performance.</p>
      <p>Differently from APC, ES agents exploit just the information of their sources, but
they ignore costs and damages. Their strategy aims to maximize the probability to guess
the event. Thanks to that they obtain a high performance, both in terms of final capital
and avoided damage.</p>
      <p>At last, the ESC agents use all the available information, with the strategy of
minimizing the risk: they want to suffer as less damage as possible. ES’s and ESC’s
performances are very similar. The firsts have a higher final capital, while the seconds get a
higher avoided damage. As we can see from Table 2, the performance of ES and ESC
agents are very similar, but the ESC perform slightly better. Consider that, if at least
one source was 100% reliable, the performance of ES agents would be the best:
having always reliable information would allow them not to take risks. For instance, table
3 shows what happens when the authority has a 90% correctness. In this case the ES
agents’ performance exceeds that of the ESC.</p>
      <p>All this depends on the level of risk. Even if the sources are very reliable, in case
of conspicuous damage it is still necessary to carry out probabilistic reasoning. Table 5
shows what happens when the authority has a 90% correctness, as in Table 3, but the
damage is fivefold. Here the ESC performance returns to be the best. Resuming, when
the source does not have a high level of accuracy or when there is a very precise sources
but also a very high potential damage, reasoning further taking risks into account - as
ESC agents - maximizes performance. In any case, using reliable sources leads to an
improvement in terms of performance: the better the sources, the better the result. Given
the agents’ adaptability to the sources, it is sufficient that one of them is very reliable to
allow the citizens to perform well.</p>
      <p>Moreover, it is necessary to clarify that this analysis takes into account just direct
damages, excluding those indirect or secondary. These last would further penalize ES’s
performance, as they are more exposed to critical events. A peculiarity of these agents
concerns how they use their information sources. We expect them to follow the
indications of the sources they consider most reliable, as the other agents do, but ESC agents
reason differently: even if they trust a lot a source (here in particular we are interested
in the institutional source), they could not follow its indications. Although this
phenomenon could seem strange, it results natural if we think about the aim moving them
and to their way to think. While ES agents want to maximize the probability to guess an
event, and this lead them to use the most reliable sources, ESC agents want to minimize
the risk, in order to reduce the possible damages. Thus, even if they trust a lot a source,
they could take (and they actually take) different decisions from what the source said.
In general it happens precisely because it allows to reduce the potential risks.</p>
      <p>ES agents (Table 5) follow the authority instructions the 99% of the cases. This is
because authority is the best source they have, communicating the most accurate
information. ESC agents follow its indication just the 58% of the times if the authority is
punitive and the 42% if it is encouraging or punitive&amp;encouraging. This phenomenon
is completely independent of trust values, which derive from the authority’s estimated
reliability. Its average value is about 70% and it is correctly identified in both cases.
However, with the same level of trust, ES agents completely rely on the authority, as it
allows them to maximize the results of their strategy, while the ESC agents go beyond
what the source reports. Although ESC agents believe the authority reports correct
information, they also take into account the possible risks linked to a wrong decision. In
other words ”I trust what you said, but I will not do that”. This is why they act
differently. We call this phenomenon ”dissonance between evaluation and action”.
Concerning the authority, regardless of the chosen strategy, it has a heavy effect on ES
agents, which completely follow its indications. For ESC agents it is a very different
story. They follow the punitive authority the 58% of times and the 42% of times when
it is encouraging or punitive&amp;encouraging. These lower values have not to be
interpreted as a bad result; what happens here is that, thanks to the available incentives, they
can afford to avoid much more risk: they make an investment even if it is not strictly
necessary. This allows them to increase the avoided critical event’s percentage of 10%
(the difference for the medium events is very low, as they already avoid the majority of
them). On the contrary, the fines are almost unused, they do not have any effect on these
agents since, for their very nature, they already tend to protect themselves. Moreover,
Figure 1 shows how a punitive strategy preserves the authority’s capital, but an
encouraging one allows the citizens to block more critical events. We can then conclude that,
to the purpose of maximizing citizens’ safety, the best authority’s profile is the
encouraging one. Moreover, there are no substantial differences between the encouraging and
the punitive&amp;encouraging, because of the little weight the fines have in this context.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusions</title>
      <p>The simulative platform we presented wants to study the social behavior of a population
in presence of hydrogeological phenomena of various criticality. In these situations, as
we saw, the interests of the citizens and the authority do not necessarily correspond, as
they pursuit partially different tasks. Thus we analyzed the best strategies on the various
contexts.
Concerning citizens, we explored different profiles on the basis of the different quantity
of information they take into account. Although the best performance is ensured by the
use of all the available information, sometimes in a risky context it is not so easy to
consider the complete knowledge. In this regard, we showed that taking into account the
information sources already allows to get good performances, even ignoring the costs
and the potential damages. This in itself is already useful information for authority. A
higher level strategy would be in fact working not just on the information, but stressing
the use of a specific information rather than another. For instance, if the population is
not prone to a full rational choice (not necessarily its members are able to take in
consideration all the useful parameters), it is better to stimulate it to take into account the
information sources and not the information about costs and damages (see Table 2).
Concerning the ESC agents, we identified what we called ”dissonance between
evaluation and action”: they can trust a lot their information sources and believe them to be
reliable, but in the end they take a different decision, as they reason at a different level
of abstraction and they take into account the possible risks linked to a wrong decision.
Since the forecasts are just probabilistic suggestions, it is necessary to take into account
even the less probable events, which can have in fact a very high impact in case they
happen.</p>
      <p>As regards the authority, we analyzed three possible strategies. We showed how in
general an encouraging authority has a greater impact than a punitive one. However, if the
citizens’ choices are strongly linked together link in the second experiment, the use of
fines still has a positive effect, since it pushes them not to rely too much on their
neighbors. In this case the authority has the best performance with a punitive&amp;encouraging
strategy.</p>
      <p>These important results are useful considerations and a good point to start for the
authorities as, besides identifying the best strategies in each situation, they allow to understand
the effects and the links that emerge within the population.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Adam</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Gaudou</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Modelling human behaviours in disasters from interviews: application to Melbourne bushfires</article-title>
          .
          <source>Journal of Artificial Societies and Social Simulation (JASSS)</source>
          ,
          <volume>20</volume>
          (
          <issue>3</issue>
          ),12. doi:
          <volume>10</volume>
          .18564/jasss.3395
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Blahut</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poretti</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Amicis</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sterlacchini</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Database of geo-hydrological disasters for civil protection purposes</article-title>
          .
          <source>Natural hazards</source>
          ,
          <volume>60</volume>
          (
          <issue>3</issue>
          ),
          <fpage>1065</fpage>
          -
          <lpage>1083</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bronfman</surname>
            ,
            <given-names>N. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cisternas</surname>
            ,
            <given-names>P. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lopez-Vazquez</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Cifuentes</surname>
            ,
            <given-names>L. A.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Trust and risk perception of natural hazards: implications for risk preparedness in Chile</article-title>
          .
          <source>Natural Hazards</source>
          ,
          <volume>81</volume>
          (
          <issue>1</issue>
          ),
          <fpage>307</fpage>
          -
          <lpage>327</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Burnett</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Norman</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sycara</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>Stereotypical trust and bias in dynamic multiagent systems</article-title>
          .
          <source>ACM Transactions on Intelligent Systems and Technology (TIST)</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ):
          <fpage>26</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Castelfranchi</surname>
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Falcone</surname>
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Trust Theory: A Socio-Cognitive and Computational Model</article-title>
          . Hoboken, NJ: John Wiley and Sons.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Conte</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Paolucci</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2002</year>
          ).
          <article-title>Reputation in artificial societies: Social beliefs for social order</article-title>
          . Boston, MA: Kluwer Academic Publishers.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. Cun˜ado, J., &amp;
          <string-name>
            <surname>Ferreira</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2011</year>
          , May).
          <article-title>The macroeconomic impacts of natural disasters: new evidence from floods</article-title>
          .
          <source>In Agricultural and Applied Economics Association's 2011 AAEA &amp; NAREA Joint Annual Meeting. Pittsburg</source>
          , PA.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Falcone</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Castelfranchi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Generalizing trust: Inferencing trustworthiness from categories</article-title>
          .
          <source>In Proceedings of the International Workshop on Trust in Agent Societies</source>
          . Springer, Berlin, Heidelberg.
          <volume>5396</volume>
          ,
          <fpage>65</fpage>
          -
          <lpage>60</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Falcone</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Piunti</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Venanzi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Castelfranchi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>From manifesta to krypta: The relevance of categories for trusting others</article-title>
          .
          <source>ACM Transactions on Intelligent Systems and Technology (TIST)</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ),
          <fpage>27</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Grothmann</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Reusswig</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>People at risk of flooding: why some residents take precautionary action while others do not</article-title>
          .
          <source>Natural hazards</source>
          ,
          <volume>38</volume>
          (
          <issue>1</issue>
          ),
          <fpage>101</fpage>
          -
          <lpage>120</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Guha-Sapir</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vos</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Below</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ponserre</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Annual disaster statistical review 2011: the numbers and trends</article-title>
          .
          <source>Centre for Research on the Epidemiology of Disasters (CRED).</source>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Hajat</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ebi</surname>
            ,
            <given-names>K. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kovats</surname>
            ,
            <given-names>R. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Menne</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Edwards</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Haines</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>The human health consequences of flooding in Europe: a review</article-title>
          .
          <source>Extreme weather events and public health responses</source>
          ,
          <volume>4</volume>
          ,
          <fpage>185</fpage>
          -
          <lpage>196</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Luino</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chiarle</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nigrelli</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agangi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Biddoccu</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cirio</surname>
            ,
            <given-names>C. G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Giulietto</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>A model for estimating flood damage in Italy: preliminary results</article-title>
          .
          <source>WIT Transactions on Ecology and the Environment</source>
          ,
          <volume>98</volume>
          .
          <fpage>65</fpage>
          -
          <lpage>74</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Mason</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andrews</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Upton</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>The psychological impact of exposure to floods</article-title>
          . Psychology, health &amp; medicine,
          <volume>15</volume>
          (
          <issue>1</issue>
          ),
          <fpage>61</fpage>
          -
          <lpage>73</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Miceli</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sotgiu</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Settanni</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Disaster preparedness and perception of flood risk: A study in an alpine valley in Italy</article-title>
          .
          <source>Journal of environmental psychology</source>
          ,
          <volume>28</volume>
          (
          <issue>2</issue>
          ),
          <fpage>164</fpage>
          -
          <lpage>173</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Sabater-Mir</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <year>2003</year>
          .
          <article-title>Trust and reputation for agent societies</article-title>
          .
          <source>Ph.D. thesis</source>
          , Universitat Autonoma de Barcelona
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Sabater</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sierra</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , (
          <year>2001</year>
          ).
          <article-title>Regret: A reputation model for gregarious societies</article-title>
          .
          <source>In Fourth workshop on deception fraud and trust in agent societies</source>
          ,
          <volume>70</volume>
          ,
          <fpage>61</fpage>
          -
          <lpage>69</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Scawthorn</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blais</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seligson</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tate</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mifflin</surname>
          </string-name>
          , E.,
          <string-name>
            <surname>Thomas</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>James</surname>
            <given-names>Murphy</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            , &amp;
            <surname>Jones</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>HAZUS-MH flood loss estimation methodology. I: Overview and flood hazard characterization</article-title>
          .
          <source>Natural Hazards Review</source>
          ,
          <volume>7</volume>
          (
          <issue>2</issue>
          ),
          <fpage>60</fpage>
          -
          <lpage>71</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Steele</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dillon</surname>
            ,
            <given-names>T. S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Chang</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Fuzzy trust evaluation and credibility development in multi-agent systems</article-title>
          .
          <source>Applied Soft Computing</source>
          ,
          <volume>7</volume>
          (
          <issue>2</issue>
          ),
          <fpage>492</fpage>
          -
          <lpage>505</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Simonovic</surname>
            ,
            <given-names>S. P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ahmad</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Computer-based model for flood evacuation emergency planning</article-title>
          .
          <source>Natural Hazards</source>
          ,
          <volume>34</volume>
          (
          <issue>1</issue>
          ),
          <fpage>25</fpage>
          -
          <lpage>51</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Song</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sekimoto</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horanont</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ueyama</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Shibasaki</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2013</year>
          ,
          <article-title>August)</article-title>
          .
          <article-title>Modeling and probabilistic reasoning of population evacuation during large-scale disaster</article-title>
          .
          <source>In Proceedings of the 19th ACM SIGKDD</source>
          (pp.
          <fpage>1231</fpage>
          -
          <lpage>1239</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Theodorakopoulos</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Baras</surname>
            ,
            <given-names>J. S.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>On trust models and trust evaluation metrics for ad hoc networks</article-title>
          .
          <source>IEEE Journal on selected areas in Communications</source>
          ,
          <volume>24</volume>
          (
          <issue>2</issue>
          ),
          <fpage>318</fpage>
          -
          <lpage>328</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Vojinovic</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ediriweera</surname>
            ,
            <given-names>J. D. W.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Fikri</surname>
            ,
            <given-names>A. K.</given-names>
          </string-name>
          (
          <year>2008</year>
          ,
          <article-title>August)</article-title>
          .
          <article-title>An approach to the modelbased spatial assessment of damages caused by urban floods</article-title>
          .
          <source>In 11th International Conference on Urban Drainage</source>
          (Vol.
          <volume>31</volume>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Weber</surname>
            ,
            <given-names>E. U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blais</surname>
            ,
            <given-names>A. R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Betz</surname>
            ,
            <given-names>N. E.</given-names>
          </string-name>
          (
          <year>2002</year>
          ).
          <article-title>A domain-specific risk-attitude scale: Measuring risk perceptions and risk behaviors</article-title>
          .
          <source>Journal of behavioral decision making</source>
          ,
          <volume>15</volume>
          (
          <issue>4</issue>
          ),
          <fpage>263</fpage>
          -
          <lpage>290</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Wilensky</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          (
          <year>1999</year>
          ). NetLogo. http://ccl.northwestern.edu/netlogo/.
          <article-title>Center for Connected Learning</article-title>
          and
          <string-name>
            <surname>Computer-Based</surname>
            <given-names>Modeling</given-names>
          </string-name>
          , Northwestern University, Evanston, IL.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Yolum</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Singh</surname>
            ,
            <given-names>M. P.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Emergent properties of referral systems</article-title>
          .
          <source>In Proceedings of the second international joint conference on Autonomous agents and multiagent systems</source>
          ,
          <volume>592</volume>
          -
          <fpage>599</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>