<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Introduction</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Arnaud Doniec</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stéphane Espié</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>René Mandiau</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sylvain Piechowiak</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>LAMIH, University of Valenciennes</institution>
          ,
          <addr-line>Le Mont-Houy, 59313 Valenciennes Cedex, France INRETS, 2 avenue du Général Malleret-Joinville, 94114 Arcueil Cedex</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
      </contrib-group>
      <fpage>2</fpage>
      <lpage>12</lpage>
      <abstract>
        <p>The use of a multi-agent approach in the design of a traffic simulation tool is innovative since most of actual tools are still based on mathematical approach. In this paper we present a multi-agent approach to simulate in a realistic way the traffic phenomenon at junction. We use a multi-agent coordination approach which is improved by an anticipation algorithm based on constraints processing. The resulting tool is validated by comparison between simulated flow and real flow measured at a real junction.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>the different moves (inside the intersection) have to be limited in order to reduce the number of
conflicts
Moreover each tool uses its own internal rules to limit the occupancy of the inner space of the intersection.
In AIMSUN [1] for example, users can configure a specific parameter called "yellow box" and thus define a
minimal speed that the vehicles inside the crossroad have to practice so that other vehicles can enter.</p>
      <p>Such tools are sometimes sufficient for superficial traffic studies, but are not acceptable when the
question is to mimic actual behavior. Indeed, no more than two vehicles are present inside the intersection at the
same time which is not realistic at all. Moreover these tools allow neither a good accuracy of traffic flow
(and jam...) for high density traffic, nor the simulation of a surrounding traffic for a driving simulator.</p>
      <p>
        In opposition to this "mathematical approach", the "behavioral approach" produces an emerging traffic
by managing interactions between various actors of the road situations (car drivers, pedestrians, road
operator, ...). The resulting traffic is therefore the sum of all actors’ individual actions. ARCHISIM is a behavioral
traffic simulation tool developed by INRETS [
        <xref ref-type="bibr" rid="ref7">9</xref>
        ].
      </p>
      <p>The computing model of ARCHISIM follows a multi-agent architecture. Each simulated driver is an
autonomous software agent which evolves in a virtual environment and interacts with the other agents of the
simulation performing its goals according to its skills and the current situation.</p>
      <p>At each simulation step, an agent receives a set of information describing the surrounding situation in the
environment. Thanks to these informations, each agent takes its own decision which results in a longitudinal
and lateral acceleration for the next time step.</p>
      <p>The novelty of ARCHISIM lies in the ability for a driving simulator to take part in the traffic
simulation. In other words, ARCHISIM is able to generate a surrounding realistic traffic for a human driver in a
simulator. The agents interact with the driving simulator like with any other vehicles of the simulation.</p>
      <p>
        The traffic model of ARCHISIM has been validated for highway situation [
        <xref ref-type="bibr" rid="ref6">8</xref>
        ], [
        <xref ref-type="bibr" rid="ref2">4</xref>
        ]. Then, efforts have
been undertaken to extend the traffic model of ARCHISIM into intersections management. A specific
coordination mechanism has been proposed in [
        <xref ref-type="bibr" rid="ref1">3</xref>
        ] and we improve this mechanism by adding an anticipation
mechanism. We describe this work in the next sections.
3
3.1
      </p>
    </sec>
    <sec id="sec-2">
      <title>Multi-agent coordination applied to traffic simulation</title>
      <sec id="sec-2-1">
        <title>An overview of coordination in MAS</title>
        <p>When crossing an intersection a real driver has to solve its conflicts with other vehicles. In our
simulation context, this driving task can be expressed as a multi-agent coordination issue: all agents reaching a
crossroad have to coordinate their actions in order to avoid accidents and deadlocks.</p>
        <p>
          Coordination concerns all local processes that allow to achieve a global state of the system. Many
definitions exist in literature, each of them highlights a particular point of view. For Jennings, coordination
is the process which allows an agent to reason about its own actions and the actions of other agents in order
to ensure that the global system correctly behaves [
          <xref ref-type="bibr" rid="ref9">11</xref>
          ]. In this manner, coordination can be used to satisfy
and guarantee some criteria of consistency without any global process. Malone defines coordination as all
extra activities which are required to have interactions between agents [
          <xref ref-type="bibr" rid="ref15">17</xref>
          ].
        </p>
        <p>
          Originally, first works on multi-agent coordination have investigated the coordination from a cooperative
viewpoint. They made the assumption that all agents were motivated to achieve a common goal. We can
quote for instance Lesser and Corkill’s works whose model was based on exchanged messages describing
aims, priorities and preference of the agents [
          <xref ref-type="bibr" rid="ref12">14</xref>
          ]. The coordination has also been expressed as a planning
problem [
          <xref ref-type="bibr" rid="ref8">10</xref>
          ]. Each agent can formalize in a plan its actions and interactions in the future. In this context,
the coordination enables the laying down of a multi-agent plan describing the global behavior of the system,
relying on all individual plans. The coordination mechanism has therefore to identify and find: the possible
link between actions, the sequential and parallel executions of actions, the potential conflicts which can
occur. Coordination can be also assimilated to search process performed in the distributed problems solving
([
          <xref ref-type="bibr" rid="ref18">20</xref>
          ], [
          <xref ref-type="bibr" rid="ref5">7</xref>
          ]). In this specific context, coordination refers to internal reasoning of agents, mechanisms of partial
solutions exchanges, etc.
        </p>
        <p>
          More recently, this background of cooperative agents has been discussed and coordination has been
considered from a competitive way. The idea is that each agent has individual motivation, acts to achieve
its own goal and interacts with other agents to ensure some global properties of the system. In [
          <xref ref-type="bibr" rid="ref17">19</xref>
          ], for
example, Shoham et al. obtain coordination between agents having antagonist aims by introducing social
laws. Their application deals with robots which have to move in an unknown environment. Since their
motivations are individual and their behavior not necessarily cooperative, conflicts can appear. To avoid
such a situation, the authors introduce rules which allow to restrict possible actions for agents in conflict.
        </p>
        <p>Crossing an intersection is a driving task which differs from one country to another. In the south of
Europe, this task is mostly competitive especially for latin drivers. In the northern countries, the crossing is
less competitive and more cooperative. The coordination mechanism has to be flexible in order to reproduce
the large variety of drivers’ behavior.
3.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Multi-agent coordination in the ARCHISIM tool</title>
        <p>The coordination mechanism used in ARCHISIM is based on the modeling of conflicts inside the
intersection. This modeling applies a breaking down of the complex interactions between agents in elementary
situations involving two agents.</p>
        <p>An actual driver perceives a complex crossroad as a succession of elementary intersections of type T
or X. A roundabout for example is a succession of T intersections. The interactions between drivers in an
elementary intersection are regulated by priority relations defined in the Highway Code. Such a priority
relation can be expressed by the predicate . In a X intersection, four interactions are possible and can
be illustrated by the following conjunction:
1.
2.
3.</p>
        <p>over
: no conflict exists between the agents</p>
        <p>and
:</p>
        <p>comes from a minor road or has a sign and consequently has no priority
: this situation is the dual of the previous situation
:
and</p>
        <p>both have the priority, the figure 1 is an illustration of such a situation</p>
        <p>
          The coordination mechanism has the following dynamics. An agent near an intersection searches all
vehicles with which it is conflict. For each of them, the agent assesses the priority relation it has. Each
priority relation is used as a local rule which indicates to the agent if it has to accelerate or slow down.
When multiple priority relations are involved in its current situation, the agent chooses the behavior which
induces the lower speed. The figure 2 is a synthesis of the coordination mechanism. For a more complete
description of this coordination mechanism, the reader can refer to [
          <xref ref-type="bibr" rid="ref1">3</xref>
          ].
3.3
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>Priority evaluation</title>
        <p>In order to obtain a valid overall traffic flow, the behavior of agents inside the intersection has to be as
realistic as possible. The individual practices differ from one country to another. For example the Highway
Code is barely respected by latin drivers and some psychology studies show that in other countries drivers
tend to develop their own informal rules [2].</p>
        <p>To take these features of the driving task into account, the agents have the possibility to alter the rules
of the Highway Code with more informal rules during the second step of the coordination algorithm. For
example, the following priorities can be considered by an agent:
priority relating to speed: a driver arriving at an intersection and having priority (from the Highway
Code point of view) tends to lose his priority if he perceives a vehicle approaching with a high speed
priority relating to impatience: a driver stopped for a long time tends to consider he has priority on
the other vehicles</p>
        <p>The introduction of such abilities improves the local behavior of agents and consequently, by emergence,
improves the global traffic obtained. In specific conditions such practices can lead to deadlocks inside the
intersection. Indeed, the non-respect of several rules promotes the occupancy of the inner center of the
crossroad but increases the risk of having a deadlock (figure 3).</p>
        <p>We claim that if agents have opportunistic behavior they also need anticipation abilities in order to avoid
undesired situations like deadlocks.
4
4.1</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Anticipation mechanism</title>
      <sec id="sec-3-1">
        <title>Anticipation in artificial intelligence</title>
        <p>
          Anticipation is a general concept and many definitions exist. Rosen’s one is usually the most used in
literature: An anticipatory system is a system containing a predictive model of itself and / or of its environment
that allows it to change current state at an instant in accord with the model predictions pertaining to a later
instant [
          <xref ref-type="bibr" rid="ref16">18</xref>
          ].
        </p>
        <p>
          In the field of multi-agent system, anticipation is used to construct adaptive and complex behavior like
in video game for instance [
          <xref ref-type="bibr" rid="ref11">13</xref>
          ]. In [
          <xref ref-type="bibr" rid="ref3">5</xref>
          ], the author proposes a multi-agent architecture for a special kind
of anticipation: preventive anticipation which consists of using prediction of the future in order to prevent
some undesired situations. The set of possible states of the system is divided in two parts: the desired and
procedure anticipate(in: ActionsList ,
        </p>
        <p>UndesiredStatesList
out: ActionsList</p>
        <p>)
begin
propagation(
for each
)</p>
        <p>,
undesiredStateSearch(
then
,$
)
undesired states. In this context, anticipation is viewed as a process trying to keep the system in a desired
state.</p>
      </sec>
      <sec id="sec-3-2">
        <title>A framework for preventive anticipation based on constraints processing</title>
        <p>- A mental representation of an agent is a triplet in which:</p>
        <p>
          We introduce a formal framework for preventive anticipation by using constraint processing techniques [
          <xref ref-type="bibr" rid="ref10">12</xref>
          ].
Our approach is based on the creation by each agent of a mental representation of environment and more
especially of the different relations and interactions which exist between the agents of the environment [
          <xref ref-type="bibr" rid="ref4">6</xref>
          ].
’ The aim of the anticipation algorithm is to scan a list of actions and to eliminate the actions which
The nature of the domain can diversify from an application to another. A domain can be for example spatial
or temporal.
        </p>
        <p>
          Based on this representation, each agent tries to predict the future state of the system, in other words it
tries to determine how the actions of the agent will make the system evolve. In our framework of anticipation,
we consider that each action has direct and indirect effects. A direct effect of an action is modeled by adding
or deleting a relation in the set . Indirect effects are computed by using propagation techniques over direct
effects.
induce an undesired state. Undesired states are expressed as a domain list which is a parameter of the
algorithm. The first step of the procedure anticipate starts by making a first propagation over . This is
performed by an external propagation function. Classic algorithm like AC-3 [
          <xref ref-type="bibr" rid="ref14">16</xref>
          ] can be used and adapted
in accordance with the application. Then for each action of the list , direct effects are evaluated. This is
also performed by an external function which can not be expressed in a generic manner since it depends on
the application. In our traffic simulation example, this external function determines the direct effects with
cinematic calculus on current position and speed of vehicles. Direct effects of an action are used to update
the representation . Based on this update, undesired states are searched. If an undesired state is found, the
current action is removed from the list .
        </p>
        <p>The function undesiredStateSearch scans the list and verifies that the undesired state it holds are not
present in the mental representation .</p>
        <p>end
end
defining the domain of each agent in
- function undesiredStateSearch(in: ,
$ UndesiredStatesList )
begin
for each
if</p>
        <p>do
domainSearch( ,
then
)
’.</p>
        <p>return(true)
end
end
A in its mental representation , this means that has inferred that will be blocked
Here we present the use of our formal framework to avoid deadlocks when simulating traffic at junction in
the ARCHISIM tool. To explain our model, we consider an agent located at the entrance of a crossroad
(figure 6).</p>
        <p>The set can be built with the agents present inside the intersection and perceived by . The domain
associated to each agent of is temporal and expresses the next time step. For example, if an agent has
during the interval to .</p>
        <p>The set is composed with blocking relation. Three types are considered:
5.1</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Implementation and validation</title>
      <sec id="sec-4-1">
        <title>Use of anticipation to avoid deadlocks</title>
        <p>The application of the anticipation algorithm gives the following reasoning:
$ &amp; Finally, has no other option and has to stop. The anticipation algorithm applied by does not change
its actions list. With the notion of impatience, it considers it has priority after a sufficient time and decides
to accelerate.
The evaluation of our multi-agent model has been led in two parts. The first one results in tests and visual
analysis of individual behaviors.
As the analysis of the individual behaviors is completely subjective, we use different scenarii allowing to
place the agents in situations of traffic suitable for the appearance of deadlocks.</p>
        <p>signalized intersection with different traffic densities
unsignalized intersection with different traffic densities
sequences of double left-turn (with and without long vehicle)</p>
        <p>The figure 7 shows how our anticipation algorithm reduces the number of deadlocks during the
simulation of a non-signalized intersection. For a one hour simulation with non-anticipatory agents, the number of
deadlocks varies from 0 to 35 according to the flow. When the agents have anticipation abilities, the number
of deadlocks remains almost constant and close to zero for simulated flows going up to 800 vehicles/hour
per axis.</p>
        <p>To be more accurate in our evaluation, we have tried to simulate the traffic of a real crossroad and
compare the traffic data obtained by simulation with real measures.
6.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Simulation of a real junction</title>
        <p>The intersection used for this evaluation is located in the city of Reggio (Calabria) in Italy. This intersection
makes the junction between a main road going from north to south and a secondary street (from east to
west). It is signalized by two stop signs installed on the secondary trunk road. Each arm of the junction has
two lanes and the inner center is large enough to allow storage of vehicles.</p>
        <p>The traffic data was measured manually by the University of Reggio Calabria within the intersection
between 12:30 AM and 1:30 PM on a normal weekday. For each arm of the intersection, the entry flow is
expressed in a number of vehicles per hour and perrcentage of turning movement (right or left turn, straight
ahead).</p>
        <p>From this data, we have generated a traffic demand which has been used in ARCHISIM to generate
simulated vehicles two hundred meters before the intersection. Virtual sensor has been used to measure the
flow of vehicles.</p>
        <p>
          Simulations were carried out according to two experimental conditions. In the first experiment, only the
coordination mechanism [
          <xref ref-type="bibr" rid="ref1">3</xref>
          ] (reference behaviour) is used, whereas the anticipation algorithm (anticipatory
behaviour) is added in the second one.
        </p>
        <p>The figures 8 to 11 draw the comparison between the simulated flows obtained with or without
anticipation and the real flow measured. For all graphs, the time is expressed as five minutes’ period. The figures 8
and 9 relate to the principal axis. The figures 10 and 11 describe the flows of the secondary axis.
30
Time (min)
30
Time (min)
30
Time (min)</p>
        <p>In all cases the best results are obtained by using anticipatory agents. To qualify more precisely these</p>
        <p>30
Time (min)
40
50
60</p>
        <p>The values obtained are, for three out of the four axis, lower than 0,1 what corresponds to an error lower
than 10% (table 1). In the literature, a good simulation of traffic often offers an error rate lower than 15%.
The results of the curve of the figure 11 are not very representative since the simulated flows are weak and
not very significant.</p>
        <p>North/South
South/North
East/West
West/East
reference behaviour
0,06
0,03
0,15
0,32</p>
        <sec id="sec-4-2-1">
          <title>RMSE</title>
          <p>anticipatory behaviour
0,04
0,03
0,06
0,30</p>
        </sec>
        <sec id="sec-4-2-2">
          <title>Flow (vh/h)</title>
          <p>Min Max
600 900
680 980
300 600
0 60
In this article, we have presented the use of a multi-agent approach in the design of traffic simulation tool.
In particular, we have introduced an original framework for anticipation in a multi-agent system based on
constraint processing techniques.</p>
          <p>This framework has been instantiated and used to avoid deadlocks when simulating traffic at junction.
The resulting simulation tools have been evaluated by comparison with a real intersection. These
experimental results confirm the relevance of the use of multi-agent techniques to develop a traffic simulation
tool.</p>
          <p>Researches are actually made to improve the realism of simulation at junctions. In particular, the
multiagent model will be extended to manage lateral acceleration and give more realistic behavior to simulated
drivers.</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>References</title>
      <p>[1] Aimsun. AIMSUN 5.0 Microsimulator User’s Manual. TSS-Transport Simulation Systems, 2005.
[2] Gunilla M. Björklund and Lars Åberg. Driver behaviour in intersections: Formal and informal traffic
rules. Transportation Research Part F, 8:239–253, 2005.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Alexis</given-names>
            <surname>Champion</surname>
          </string-name>
          , Stéphane Espié, René Mandiau, and
          <string-name>
            <given-names>Christophe</given-names>
            <surname>Kolski</surname>
          </string-name>
          .
          <article-title>A game-based, multi-agent coordination mechanism - application to road traffic and driving simulations</article-title>
          .
          <source>In Summer Computer Simulation Conference</source>
          , pages
          <fpage>644</fpage>
          -
          <lpage>649</lpage>
          , Montréal, Québec, Canada, july
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Alexis</given-names>
            <surname>Champion</surname>
          </string-name>
          ,
          <string-name>
            <surname>Ming-Yu</surname>
            <given-names>Zhang</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jean-Michel Auberlet</surname>
            , and
            <given-names>Stéphane</given-names>
          </string-name>
          <string-name>
            <surname>Espié</surname>
          </string-name>
          .
          <article-title>Behavioural simulation: towards high-density network traffic studies</article-title>
          .
          <source>In Proceedings of the Third International Conference on Traffic and Transportation Studies (ICTTS</source>
          <year>2002</year>
          ), pages
          <fpage>988</fpage>
          -
          <lpage>995</lpage>
          , july
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Paul</given-names>
            <surname>Davidsson</surname>
          </string-name>
          .
          <article-title>Anticipatory Behavior in Adaptive Learning Systems, chapter : A Framework for Preventive State Anticipation</article-title>
          . Springer,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Arnaud</given-names>
            <surname>Doniec</surname>
          </string-name>
          , René Mandiau, Stéphane Espié, and
          <string-name>
            <given-names>Sylvain</given-names>
            <surname>Piechowiak</surname>
          </string-name>
          .
          <article-title>Dealing with multi-agent coordination by anticipation: Application to the traffic simulation at junctions</article-title>
          .
          <source>In Proceedings of the Third European Workshop on Multi-Agent Systems (EUMAS'05)</source>
          , Brussels, Belgium, december
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Arnaud</given-names>
            <surname>Doniec</surname>
          </string-name>
          , Sylvain Piechowiak, and
          <string-name>
            <given-names>René</given-names>
            <surname>Mandiau</surname>
          </string-name>
          .
          <article-title>A DisCSP solving algorithm based on sessions</article-title>
          .
          <source>In Recent Adavances in Artificial Intelligence: Proceedings of the 18th International Florida Artificial Intelligence Research Society Conference (FLAIRS'05)</source>
          , pages
          <fpage>666</fpage>
          -
          <lpage>670</lpage>
          , Clearwater, USA, may
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Sameh</given-names>
            <surname>El</surname>
          </string-name>
          <string-name>
            <surname>Hadouaj</surname>
          </string-name>
          , Alexis Drogoul, and
          <string-name>
            <given-names>Stéphane</given-names>
            <surname>Espié</surname>
          </string-name>
          .
          <article-title>How to combine reactivity and anticipation: the case of confli cts resolution in a simulated road traffic</article-title>
          .
          <source>In Multi-Agent-Based Simulation</source>
          , Second International Workshop, pages
          <fpage>82</fpage>
          -
          <lpage>96</lpage>
          , Boston, USA, july
          <year>2000</year>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Stéphane</given-names>
            <surname>Espié</surname>
          </string-name>
          .
          <article-title>Archisim, multi-actor parallel architecture for traffic simulation</article-title>
          .
          <source>In Proceedings of the Second World Congress on Intelligent Transport Systems</source>
          , volume IV, Yokohama, Japan, november
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Mickael</surname>
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Georgeff</surname>
          </string-name>
          .
          <article-title>Communication and interaction in multi-agent planning</article-title>
          .
          <source>In Proceedings of the 3th National Conference on Artificial Intelligence (AAAI'83)</source>
          , pages
          <fpage>125</fpage>
          -
          <lpage>129</lpage>
          , Washington, USA, august
          <year>1983</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Nicholas</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Jennings</surname>
          </string-name>
          .
          <article-title>Coordination techniques for distributed artificial intelligence</article-title>
          .
          <source>In Foundations of Distributed Artificial Intelligence</source>
          , pages
          <fpage>187</fpage>
          -
          <lpage>210</lpage>
          . Wiley,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>Vipin</given-names>
            <surname>Kumar</surname>
          </string-name>
          .
          <article-title>Algorithms for constraint-satisfaction problems: A survey</article-title>
          .
          <source>Ai Magazine</source>
          ,
          <volume>13</volume>
          (
          <issue>1</issue>
          ):
          <fpage>32</fpage>
          -
          <lpage>44</lpage>
          ,
          <year>1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [13]
          <string-name>
            <surname>John</surname>
            <given-names>E. Laird.</given-names>
          </string-name>
          <article-title>It knows what you're going to do: Adding anticipation to a quakebot</article-title>
          .
          <source>In Proceedings of Autonomous Agent'01</source>
          , pages
          <fpage>385</fpage>
          -
          <lpage>392</lpage>
          , Montreal, Canada,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Victor</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Lesser</surname>
            and
            <given-names>Daniel D.</given-names>
          </string-name>
          <string-name>
            <surname>Corkill</surname>
          </string-name>
          .
          <article-title>Functionally accurate, cooperative distributed systems</article-title>
          .
          <source>In IEEE Transactions on Systems, Man and Cybernetics</source>
          , pages
          <fpage>81</fpage>
          -
          <lpage>96</lpage>
          ,
          <year>1981</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>Edward</given-names>
            <surname>Lieberman and Ajay</surname>
          </string-name>
          <string-name>
            <given-names>K.</given-names>
            <surname>Rathi</surname>
          </string-name>
          .
          <article-title>Traffic flow theory, expansion of the Transportation Research Board (TRB) Special Report 165</article-title>
          , chapter 10 - Traffic simulation, pages
          <fpage>10</fpage>
          -
          <lpage>1</lpage>
          10-
          <fpage>25</fpage>
          . Oak Ridge National Laboratory,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Alan</surname>
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Mackworth</surname>
          </string-name>
          .
          <article-title>Consistency in networks of relations</article-title>
          .
          <source>Artificial Intelligence</source>
          ,
          <volume>8</volume>
          :
          <fpage>99</fpage>
          -
          <lpage>118</lpage>
          ,
          <year>1977</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Thomas</surname>
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Malone</surname>
          </string-name>
          .
          <article-title>Modeling coordination in organizations and markets</article-title>
          .
          <source>Management Sciences</source>
          ,
          <volume>33</volume>
          (
          <issue>10</issue>
          ):
          <fpage>1317</fpage>
          -
          <lpage>1332</lpage>
          ,
          <year>1987</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>Robert</given-names>
            <surname>Rosen. Anticipatory</surname>
          </string-name>
          Systems - Philosophical, Mathematical and
          <string-name>
            <given-names>Methodological</given-names>
            <surname>Foundations</surname>
          </string-name>
          . Pergamon Press,
          <year>1985</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>Yoav</given-names>
            <surname>Shoham</surname>
          </string-name>
          and
          <string-name>
            <given-names>Moshe</given-names>
            <surname>Tennenholtz</surname>
          </string-name>
          .
          <article-title>On social laws for artificial agent societies: Off-line design</article-title>
          .
          <source>Journal of Artificial Intelligence</source>
          ,
          <fpage>1</fpage>
          -
          <lpage>2</lpage>
          (
          <issue>73</issue>
          ):
          <fpage>231</fpage>
          -
          <lpage>252</lpage>
          ,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>Makoto</given-names>
            <surname>Yokoo</surname>
          </string-name>
          .
          <article-title>Distributed Constraint Satisfaction: Foundations of Cooperation in Multi-agent Systems</article-title>
          . Springer Verlag,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>