<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Decision Making Methods in Agent Based Modeling</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Galina Ilieva</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>The University of Plovdiv „Paisii Hilendarsky“</institution>
          ,
          <addr-line>Tsar Assen str. 24, 4000 Plovdiv</addr-line>
          ,
          <country country="BG">Bulgaria</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2011</year>
      </pub-date>
      <fpage>8</fpage>
      <lpage>17</lpage>
      <abstract>
        <p>The aim of the work is to investigate how agents can become more intelligent using contemporary methods for decision making in electronic commerce auctions. The idea is to implement fuzzy logic for agents' evaluations of market conditions and sort their preferences using difference combinations of fuzzy input data to make rational choice which is the best behavior under given market conditions. The task is to prove that a family of decision making algorithms, created in the Bulgarian Academy of Sciences, can be embedded in existing prototype of multi-agent simulator for online auctions for change of agents' bidding strategy.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>The behavior of agents in an auction is based on their bidding strategies. A strategy is
a methodology which the agent implements to achieve its goals while following the
auction rules. Strategies are private and are chosen by auction participants (agents’
owners). Various protocols for bidding are used in practice, so there is no universal
strategy for successful negotiation. A given strategy can be effective under one
protocol and ineffective under another. Creation of an optimal strategy for continuous
double auction (CDA) is a complex task that still challenges electronic commerce
researchers. The aim is creating strategies that would pick the “right” deal sides, so
that the CDA efficiency would be maximized and there would be quick deal price
convergence toward the equilibrium price. The goal of this work is to investigate two
alternative algorithm families for multi-criteria analysis with fuzzy logic for bidding
strategy selection in CDA. The described methods for decision making can be used in
electronic auctions not only for preliminary selection of the most suitable strategy
from a given set of agent strategies, but also for changing the used strategy during
auction.
For detailed investigation of intelligent agents’ behavior as participants in electronic
commerce, various auction models have been simulated. The suggested methods for
bidding strategies evaluation are based on two different approaches. The first one of
them is essentially a comparison between strategies’ efficiency in a static agent
population (the strategies are selected in advance and cannot be changed once an
auction has begun). The second approach investigates agent populations in which
change of the used strategy after the beginning of an auction is allowed using
dynamics replicator.</p>
      <p>
        Anthony and Jennings, who follow the first approach, generate biddings that depend
on the following parameters: time left until the end of the auction; number of open
auctions; agent’s intention towards deal and agent’s attitude towards risk. The
combination of these four indices through relative weighting coefficients, defined by
the user, gives a bidding strategy. Later, the two authors suggest a genetic algorithm
for search of an effective strategy from the solution set defined by the specific market
conditions [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. As followers of the second approach, Walsh et al. use an evolutionary
variant of game theory and investigate experimentally an agent’s preference towards
three bidding strategies. The main disadvantage of their work is that the time
complexity of the suggested algorithms for strategy comparison depends
exponentially on the number of investigated strategies [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Muchnick and Solomon
create the NatLab platform using the principle of Markov’s nets. In order to make a
smooth transition from computer simulation to experimental economics, they generate
eight different bidding strategies using avatars. In order for the emulation to be more
realistic, the system makes adaptive actualization of the avatars [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Posada and Lopez
suggest a portfolio comprised of three alternative bidding strategies. For strategy
selection, they propose two heuristics –imitation and take-the-best. Imitation heuristic
uses social learning taking into account the past collective experience. The other
heuristic, take-the-best, uses individual rational learning taking into account previous
experiences of the agent [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Goyal et al. use the term “attitude” analogically to the
typical to agent technology terms “intention” and “commitment”. Each agent has a
definite attitude toward the bidding process. This helps it to adapt to the market
dynamics more quickly. In order for a proper bidding to be chosen, a set of individual
bids is generated in advance. The agents’ attitudes towards the set of criteria and bids
take part in the multi-criteria procedure for bidding selection [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        In the current work, the applicability of two algorithms with fuzzy logic with a
common purpose of solving the task of multi-criteria ordering of bidding strategies in
an auction is investigated - algorithm with Fuzzy Techniques and Negotiable
Attitudes (FTNA) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and Algorithm for aggregation of fuzzy Relations between
Alternatives and a fuzzy relation between the weights of the CRriteria
(ARAKRI1)[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ],[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
3 Application of algorithms for multi criteria ranking with fuzzy
relations for bidding strategy selection
In this section, the methodology of software modeling and comparative analysis, both
quantitative and qualitative, will be used. We will determine whether the mentioned
algorithms for multi-criteria analysis can be embedded in existing prototype of
software system for agent-based modeling MASECA [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] as a software procedure,
accessible to the bidding agents. After completing the software implementation of
algorithms, we start series of experiments to research the influence of the new
decision making capability.
      </p>
      <p>The input data for decision making procedure are:
n - a number of alternatives;
m - a number of criteria;
l – a number of bidding agents.</p>
      <p>During the experiment, we use the next parameter values:
Five strategies as alternatives for agents’ bidding in CDA:
A1 – snipping strategy (Snipping),
A2 – strategy with fixed markup (L),
A3 - zero intelligence with budget constraints (ZIC),
A4 - zero intelligence plus (ZIP) and
A5 – risk based strategy (RB).</p>
      <p>These strategies are the most cited in literature sources.</p>
      <p>For example, we can use the next three criteria for strategies’ evaluation:
C1 – time complexity,
C2 – price prediction,
C3 – risk attitude.</p>
      <p>All criteria are maximizing. Five bidding agents participate in the experiments.
3.1</p>
      <p>
        Algorithm with Fuzzy Techniques and Negotiable Attitudes (FTNA)
Step 1: The decision maker (DM) determines the relative weighting coefficients of
the criteria for each strategy by using the method of analytical hierarchic process. The
values of the weights depend on the degree of importance of the given criterion. The
fuzzy relations (matrices for comparison) of the criteria are completed according to
the degree of importance of the paired criteria. Evaluations vary in the range from 1 to
9: 1-insignificantly important; 3-more important; 5-equally important; 7-substantially
more important; 9-absolutely more important, and ranks 2,4,6,8 represent values that
are between the given ones. The weight of each criterion is given by the formula of
geometric mean of the corresponding row of the comparison matrix. If we let w to be
the set of weights and w={w1,w2,..,wm}, then here we will also have wi∈[
        <xref ref-type="bibr" rid="ref1">0,1</xref>
        ] for
m
∑ wi = 1
i=1,2,..,m and i=1 (Figure 1).
      </p>
      <p>To fulfill the matrices we use experts’ knowledge of evaluation of bidding strategies
features.</p>
      <p>Step 2: The agent’s attitude towards the bidding strategies and the criteria for their
evaluation are determined. Here “attitude” represents the preference of agent k to
choose a strategy i with criterion j. The evaluations of the attitudes aijk (i=1,2,..,n,
j=1,2,..,m, k=1,2,..,l) are presented through linguistic terms such as “very low”, “low”,
“average”, “high”, and “very high”. The fuzzy agent relations towards strategies and
Ак = (a ) k
criteria are completed in the attitude matrices ij nxm (Figure 2). To fulfill the
matrices we use historical data from auction deals until the present moment.</p>
      <p>Step 3: Each attitude matrix is aggregated into attitude vector Ai (1=1,2,..,n) as
follows:
Aik = w1k aik1 + w2k aik2 + ... + w a
k k
n in (Figure 3).</p>
      <p>Step 4: We assume that all the agents are equally important and calculate the
normalized vector of the fuzzy solution r. The normalized weight of the agents Dk
(k=1,2,...,l) is denoted with (ν 1, ν 2 ,...,ν l):</p>
      <p> a11 a12 .. an1 
(r1, r2 ,..,rn ) = (υ1,υ 2 ,..,υl )a.1.2 a..22 .... a..n2 
 a1l a2l .. anl </p>
      <p>
        Step 5: The elements of the normalized vector of the fuzzy solution ri are positive
triangular fuzzy numbers and belong to the interval [
        <xref ref-type="bibr" rid="ref1">0,1</xref>
        ]. Then we calculate the
distance between the fuzzy solutions ri and the perfect ones, a positive and a negative
solution. Let r+ be the fuzzy positive perfect solution, r- - the fuzzy negative perfect
solution and r+=(1,1,1) and r-=(0,0,0). The distances d i+ between ri and r+ and d
ibetween ri and r- are calculated:
di+ = d (ri , r + ) and di- = d (ri , r - ) , where d is the distance between two fuzzy numbers.
To calculate d the vertex method is used (Figure 5).
      </p>
      <p>Step 6: To determine the rank of each strategy the coefficient of closeness is
calculated with the formula:
CCi= 12 (di++ (1 - di- ) for i=1,2,...,n.</p>
      <p>The strategy with the largest coefficient of closeness is the most appropriate one for
bidding at that moment (Figure 6, left – before, right – after sort).
3.2 Algorithm with Fuzzy Numbers as Alternatives Evaluations and Real
Numbers as Weighted Coefficients (ARAKRI1)
Step 1: The evaluations of the alternatives (strategies) by the criteria are fuzzy
triangular numbers (Figure 7).</p>
      <p>
        According to [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], the G-index of the fuzzy number A~ = (a1, a2 , a3 , a4 ), a2 = a3 is
computed using the following ranking function:
      </p>
      <p>
        ~ ~ ~
F ( A)= kF1 ( A+) (1 - k)F2 ( A), k ∈[
        <xref ref-type="bibr" rid="ref1">0,1</xref>
        ] , where:
F1 ( A~) = a1 + S A~ sin[R, g (x)] = a1 + (a 4- a1 +) (a3 - a2 ) ×
      </p>
      <p>2
F2 ( A~) = a4 + S A~ sin[R, f (x)=] a4 - (a 4- a1 +)2 (a3 - a2 ) ×
1
1</p>
      <p>1
[(a4 - a3 )2 + 1] 2 and</p>
      <p>1
[(a2 - a1 )2 + 1] 2 (Figure 8).</p>
      <p>Step 2: As the criteria evaluation can be expressed in different measurement units, for
their unification is used the following transforming function:
1

μ k (ai , a j ) = 0.5 +
</p>
      <p>xik - x jk
2(maix{xik } - miin{xik })
ако i = j
ако i ≠ j
where xik , x jk , i, j = 1,2,..., n, k = 1,2,..., m are the
evaluations
of
the
alternatives
ai
and a j , i, j = 1,2,..., n according to the criterion ck , k = 1,2,..., m . The obtained fuzzy
relations are Rk , k = 1,2,..., m . If a certain criterion, ck, is minimizing, in order for the
alternatives to be sorted in a descending order, the complement to the relation
Rk ' =1 - Rk is calculated, in other words, for this relation new membership function is
calculated using the formula μk '(ai , a j ) = 1 - μk (ai , a j ) (Figure 9).</p>
      <p>
        Step 3: All relations R1, R2 ,..., Rm are combined so that an aggregated relation R with
the following matrix can be obtained with the membership function
μ (ai , a j ) = Agg{μ 1 (ai , a j ), μ 2 (ai , a j ),..., μ m (ai , a j )}
Each element from matrix R is calculated by the aggregation operators’ formula with
weighting coefficients. The following operators are used: WMean, WGeom,
WMaxMin and WMinMax with weighting coefficients-real numbers. If w is the set of
average criteria weights from the FTNA algorithm and w={w1,w2,...,wm}, then
wk∈[
        <xref ref-type="bibr" rid="ref1">0,1</xref>
        ] for k=1,2,…,m and ∑m wi = 1.
      </p>
      <p>k=1
The calculations with the operators WMean, WGeom, WМaxMin and WМinMax for
degree of membership to each of the aggregated relations R of the pair на двойката
(ai , a j ) are as follows:</p>
      <p>m
μ (ai , a j ) = WMean {μ1(ai , a j ),μ 2 (ai, a j ),...,μ m (ai , a j )} = ∑k=1 wkμ k (ai , a j )</p>
      <p>m
μ (ai ,a j ) = WGeom{μ1(ai , aj ),μ 2(ai , a j ),...,μ m (ai ,a j )} = ∏[μ k (ai , aj )]wk</p>
      <p>
        k=1
μ (ai , a j ) = WMaxMin {μ1(ai , a j ),μ 2 (ai , a j ),..., μ m (ai , a j )} = mkax{min( μ k (ai , a j ), wk )}
μ (ai , a j ) = WMinMax {μ1(ai , a j ),μ 2 (ai , a j ),..., μ m (ai , a j )} = mkin{max(μ k (ai , a j ), wk )}
For the last two operators, WMaxMin and WMinMax the weights of the criteria are
recalculated so that they belong to the interval [
        <xref ref-type="bibr" rid="ref1">0,1</xref>
        ] and the largest of them to be
equal to 1 by the formula:
wk '= m wk
max{wk}
      </p>
      <p>k=1
Four obtained aggregated matrices are shown in Figure 10.</p>
      <p>Step 4: The four matrices from Figure 10 are from type R. Each of these matrices is
recalculated so that matrices R' are obtained in the following way: if
μ (ai , a j ) ≥ μ (a j , ai ) , then μ '(ai , a j ) = μ (ai , a j ) and μ '(a j , ai ) = 0 . Every asymmetric fuzzy
rearrangement R' of R is fuzzy partial order. R' can be rearranged into a triangular
matrix. After the triangular matrix R' is rearranged, a relation is obtained which
represents a fuzzy linear arrangement. A non-fuzzy order of the alternatives is the
same as their order in the title raw of the obtained table and is the solution to the
problem of multi criteria arrangement (Figure 11).
4 Results Comparison from the Multi Criteria Analysis with the
FTNA and ARAKRI1 algorithms</p>
    </sec>
    <sec id="sec-2">
      <title>5 Significance of the obtained results</title>
      <p>The proposed method for bidding strategies selection is appropriate for the
development and modeling of economic objects. The work can serve as a basis for the
practical orientation of teaching in the following fields: Electronic Commerce,
Electronic Business etc. As a result, this would sharpen the motivation and interest of
students in those fields and would provide them with practical instruments. On the
other hand, realization of these types of methods with fuzzy logic broadens the
practical applicability of related mathematical tasks and will supply additional
information for future theoretical research.</p>
      <p>Acknowledgments. The work reported in this paper is partially supported by the
projects No. RS11-FESS-0xx/30.05.2011 „Intelligent methods for business
information processing”.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Anthony</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>N.R.</given-names>
            <surname>Jennings</surname>
          </string-name>
          ,
          <article-title>Evolving bidding strategies for multiple auctions</article-title>
          ,
          <source>In Proc. of 15th European Conference on Artificial Intelligence, Netherlands</source>
          ,
          <year>2002</year>
          , pp.
          <fpage>182</fpage>
          -
          <lpage>187</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Goyal</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Jie</given-names>
            <surname>Lu</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Zhang, Decision Making in Multi-Issue e-Market Auction Using Fuzzy Techniques and Negotiable Attitudes</article-title>
          ,
          <source>Journal of Theoretical and Applied Electronic Commerce Research</source>
          <volume>3</volume>
          (
          <issue>2</issue>
          ):
          <fpage>97</fpage>
          -
          <lpage>110</lpage>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Illieva</surname>
            <given-names>G.</given-names>
          </string-name>
          ,
          <article-title>An е-Market System Supporting Simultaneous Auctions with Intelligent Agents</article-title>
          . - In
          <source>: Proc. of the young researchers session of the John Atanasoff International Symposium on Modern Computing</source>
          , ISBN:
          <volume>10</volume>
          :
          <fpage>954</fpage>
          -
          <lpage>91743</lpage>
          -5-2, ISBN:
          <volume>13</volume>
          :
          <fpage>978</fpage>
          -
          <lpage>954</lpage>
          -91743-5-9, Sofia, pp.
          <fpage>41</fpage>
          -
          <lpage>47</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Muchnick</surname>
            , L.,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Solomon</surname>
          </string-name>
          ,
          <article-title>Markov Nets and the NatLab platform; Application to Continuous Double Auction in Salzano and Colander (eds</article-title>
          .),
          <source>Complexity Hints for Economic Policy</source>
          , Springer,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Peneva</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>I. Popchev.</surname>
          </string-name>
          <article-title>Models for decision making by fuzzy relations and fuzzy numbers for criteria evaluations</article-title>
          .
          <source>- Compt. Rend. Acad. Bulg. Sci.</source>
          , Vol.
          <volume>62</volume>
          ,
          <year>2009</year>
          , No.
          <volume>10</volume>
          ,
          <fpage>1217</fpage>
          -
          <lpage>1222</lpage>
          , ISSN:
          <fpage>1310</fpage>
          -
          <lpage>1331</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Peneva</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>I. Popchev</surname>
          </string-name>
          ,
          <article-title>Fuzzy multi-criteria decision making algorithms</article-title>
          .
          <source>- Compt. Rend. Acad. Bulg. Sci.</source>
          , Vol.
          <volume>63</volume>
          ,
          <year>2010</year>
          , No.
          <volume>7</volume>
          ,
          <fpage>979</fpage>
          -
          <lpage>992</lpage>
          , ISSN:
          <fpage>1310</fpage>
          -
          <lpage>1331</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Posada</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Adolfo</surname>
          </string-name>
          ,
          <article-title>How to Choose the Bidding Strategy in Continuous Double Auctions: Imitation Versus Take-The-Best Heuristics</article-title>
          ,
          <source>Journal of Artificial Societies and Social Simulation</source>
          , Vol.
          <volume>11</volume>
          , No.
          <volume>1</volume>
          .,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Walsh</surname>
            ,
            <given-names>W.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>R. Das</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Tesauro</surname>
            ,
            <given-names>J.O.</given-names>
          </string-name>
          <string-name>
            <surname>Kephart</surname>
          </string-name>
          ,
          <article-title>Analyzing complex strategic interactions in multi-agent games</article-title>
          ,
          <source>In Proc. of AAAI Workshop on Game-Theoretic and Decision-Theoretic Agents</source>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>