=Paper= {{Paper |id=Vol-1975/paper20 |storemode=property |title=Formation of Coalition Structures as a Non-Cooperative Game |pdfUrl=https://ceur-ws.org/Vol-1975/paper20.pdf |volume=Vol-1975 |authors=Dmitry Levando |dblpUrl=https://dblp.org/rec/conf/aist/Levando17 }} ==Formation of Coalition Structures as a Non-Cooperative Game== https://ceur-ws.org/Vol-1975/paper20.pdf
           Formation of Coalition Structures as a
                 Non-Cooperative Game

                                      Dmitry Levando

       National Research University Higher School of Economics, Moscow, Russia
                                   dlevando@hse.ru


        Abstract. The paper proposes a list of requirements for a game able to
        describe individually motivated social interactions: be non-cooperative,
        able to construct multiple coalitions in an equilibrium and incorporate
        intra and inter coalition externalities. For this purpose the paper presents
        a family of non-cooperative games for coalition structure construction
        with an equilibrium existence theorem for a game in the family. Few
        examples illustrate the approach. One of the results is that efficiency is
        not equivalent to cooperation as an allocation in one coalition. Further
        papers will demonstrate other applications of the approach.

        Keywords: Non-cooperative games, Nash equilibrium, cooperative games


1     Introduction
There is a conventional dichotomy in existing game theories: the cooperative
game theory (CGT) versus the non-cooperative game theory (NGT). CGT deals
with coalitions as elementary items, NGT deals with strategic individual behav-
ior. Comparison of the game theories is in Table 1. The enlisted properties are
important for studying non-cooperative fundamentals of individually motivated
social behavior.

                          Table 1. Comparison of game theories

                                           CGT                          NGT
         type of a mapping        a finite set to a point        a vector to a vector
          individual action                  no                        always
       individual motivation                 no                        always
         explicit allocation
                                            yes                           no
     of players over coalitions
    inter-coalition externalities       sometimes                       vague
                                                                     always, but
    intra-coalition externalities           no
                                                            with vague coalition definition




    Cooperative game theories are based on the notion that a coalition, a sub-
set of all players, moves as a whole unit only. This approach seems somewhat
simplified. Usually economic agents are self-interested, and do not necessarily
make the same move even being together. From another side non-cooperative
approach is based on a notion that every player is able to make individual deci-
sions, but there is a low interest to partitioning players into coalitions or coalition
structures.1
    Studying formation of only one coalition from a non-cooperative game, was
introduced by Nash, [6], and is known now as Nash Program, Serrano, [8].
Practice of social analysis and social design requires studying non-cooperative
and simultaneous formation of multiple coalitions, or coalition structures. This
makes Nash program be too restrictive. Importance of studying externalities be-
tween coalitions, a case impossible within the Nash Program, was mentioned by
Maskin, [4].
    The main complication for a non-cooperative coalition structure formation
stems from the necessity to describe complex inter and intra coalition interac-
tions while forming multiple coalition structures.
    Cooperative game theory equilibrium concepts (also the strong Nash equilib-
rium) evade such issues. Consider an example with 10 members in a committee,
which make the grand coalition. Let there are 5, who do not agree and devi-
ate from some joint agreement. Do they have the same reason and deviate as
one group, five different reasons and deviate independently in five groups, two
reasons and deviate in some groups of two and three, etc? And every deviator
may have more than one deviating strategy inside a deviating group. Deviating
groups may have internal conflicts, there could be conflicts between those who
stay and those who deviate, or between deviators from different groups. These
questions are different from those addressed by Aumann [1] in the strong Nash
equilibrium and by Bernheim et all [2] in the coalition proof equilibrium.
    The central idea of the presented model is to incorporate possible cases of
deviation into individual strategy sets of players. This is done by parametrizing
possible coalition structures by maximum coalition size. A constructed game
satisfies properties in Table 1, and has an equilibrium in mixed strategies. As
a result it is possible to study deviations of more than one player. The game
differs from those existing in CGT and NGT. Varying a maximum coalition size
we construct a family of games.
    Section 2 contains an example of a game, Section 3 presents a mechanism to
construct such games. The last Section 4 shows an example with preferences over
coalition structures for an equilibrium refinement. The proof is in Appendix.


2    Example
There are 2 players, i = 1, 2. They can make choices over a desirable coalition
structure, indexed as a = {{1}, {2}}, if a player chooses to be alone, and indexed
t = {1, 2}, if a player chooses to be together.2 A player has two strategies N C
1
  The terms a coalition structure and a partition of players are considered as synon-
  imes.
2
  An example with preferences over coalition structures in in Section 4.
and C for every coalition structure.3 A set of strategies of i is Si (K = 2) =
{N Cia , Cia , N Cit , Cit }, i = 1, 2. Table 2 presents strategies and outcomes of
the game. A cell contains a payoff profile and a final coalition structure. Every
strategy profile is mapped to the pair: a payoff profile and a coalition structure.
In the equilibrium a player uses mixed strategies Cia , Cit with equal probabilities.
There are 4 equilibria outcomes with payoff profiles (−2; −2), all being inefficient.
    The example uses a unanimous rule for coalition formation, the grand coali-
tion {1, 2} can be formed only if both choose it. Otherwise a player obtains
the singleton coalition. From twelve possible strategy profile only four result in
the grand coalition. Table 2 presents a game with two types of externalities,
inter-coalition {{1}, {2}} and intra-coalition in {1, 2}. So the example satisfies
all desirable properties from Table 1.


Table 2. Payoff for the unanimous coalition structure formation rule: the same effi-
cient payoffs (0;0) in different partitions. What is a cooperation then?
                N C2,a       C2,a                       N C2,t      C2,t
                (0;0)       (-5;3)                      (0;0)      (-5;3)
    N C1,a
             {{1},{ 2} } {{1}, {2}}                  {{1},{ 2} } {{1}, {2}}
                (3;-5)   (−2; −2)⋆,⋆⋆                   (3;-5)   (−2; −2)⋆⋆
    N1,a
              {{1}, {2}}  {{1}, {2}}                  {{1}, {2}} {{1}, {2}}
                  (0;0)             (-5;3)                (0;0)           (−5; 3)
    N C1,t
              {{1},{ 2} }         {{1}, {2}}             {1, 2 }           {1, 2}
                 (3;-5)           (−2; −2)⋆⋆             (3; −5)        (−2; −2)⋆⋆
     C1,t
               {{1}, {2}}         {{1}, {2}}              {1, 2}           {1, 2}



    For the coalition structure {{1}, {2}} with a maximum coalition size K = 1
every player has two equilibrium strategies. A respective equilibrium is marked
with an upper star, ∗ and it is inefficient.
    For the coalition structure {1, 2} a player has two more equilibrium strate-
gies. Final equilibria are marked with two upper stars, ∗∗ . The equilibria belong
to different coalition structures, what make this game be a stochastic game,
Shapley, [9]. Stochastic property appears here not from outside shock, but from
strategic actions of the players.
    The presented example let players think that they can deviate either alone
or together. If both can deviate, then i has and anticipate another has also the
following strategies: a move within the same or a different coalition structure
with strategies N C or C for each case. Every such possibility is in individual
strategy set Si .
3
    For simplicity of the motivating example players do not have preferences over coali-
    tion structures, used in example with introvert and extravert players further.
3    A game
A game is parametrized by a number K, K = 1, . . . , N , a size of maximum coali-
tion size in any feasible coalition structure. The parameter K has two meanings:
no more than K agents are required to make this largest coalition, and at the
same this coalition needs no more than the same K agents to dissolve. Every
player has a set of strategies for every feasible coalition structure. A strategy pro-
file of all players is mapped into a coalition structure (an allocation of players
into coalitions) and a payoff profile for all players. Payoffs are defined separately
for every feasible coalition structure.
Definition 1 (a simultaneous coalition structure formation game). A
non-cooperative game for coalition structure formation with maximum coalition
size K is
                     ⟨                                        ⟩
             Γ (K) = N, {K, P(K), R(K)} , (Si (K), Ui (K))i∈N ,

where {K, P(K), R(K)} - coalition structure formation mechanism, K is maxi-
mum coalition size, P(K) is a family of allowed coalition structures, R(K) is a
family of coalition structure partition rules, (Si (K), Ui (K))i∈N are properties of
players (individual strategies and payoffs), such that:
                      R(K) {                                              }
         ×i∈N Si (K) →        P(K), (Ui (K) = {Ui (P ) : P ∈ P(K)})i∈N

    Every individual strategy set Si (K) is a topological space, and every family
of utility functions Ui (K) is integrable and bounded over ×i∈N Si (K).
    .
Definition 2 (an equilibrium in a game  ( Γ (K)).
                                               ) For a non-cooperative game
                                  ∗        ∗
Γ (K) a mixed strategies profile σ (K) = σi (K)      is an equilibrium if for
                                                       i∈N
every subset n(k) from N , with a size 1 ≤ k ≤ K, and for every player i ∈ n(k) a
deviation from an equilibrium, ∀σi (K) ̸= σi∗ (K), does not generate an individual
gain:
                Γ (K) ( ∗       ∗
                                      )        Γ (K) (          ∗
                                                                      )
             EUi       σi (K), σ−i (K) ≥ EUi           σi (K), σ−i (K) .
Definition of an equilibrium makes a claim only about strategy profiles, but not
about resulting coalition structures.
Theorem 1 (existence). An equilibrium for a game Γ (K) exists for any K =
1, . . . , N .
    In short, a proof follows from standard properties of finite number of bounded
integral operators with a final application of a fixed point theorem. If every Si (K)
is a topological space, then we can always define a dual space of probability mea-
sure ∆i (Si ) on it, ∆i (Si ) is a set of mixed strategies, with a weak convergence.
                                                           Γ (K)
Then for every i ∈ N expected utility operator EUi               is bounded, continu-
ous and compact. Finally a fixed point theorem is applied. Complete proof is in
Appendix.
   An increment in K generates a family of nested games with nested compo-
nents: P(K̄) ⊂ P(K̄ + 1), Si (K̄) ⊂ Si (K̄ + 1), Ui (K̄) ⊂ Ui (K̄ + 1), for ∀i ∈ N
and every K̄ = 1, . . . , N − 1.
Definition 3 (family of nested games).
  A family of games G = {Γ (K) : K = 1, . . . , N } is nested if :

                  Γ (K = 1) ⊂ . . . ⊂ Γ (K) ⊂ . . . ⊂ Γ (K = N ),

i.e. for any two games Γ (K̄) and Γ (K̄ + 1) there is P(K̄) ⊂ P(K̄ + 1), R(K̄) ⊂
R(K̄ + 1), Si (K̄) ⊂ Si (K̄ + 1), Ui (K̄) ⊂ Ui (K̄ + 1), for every i ∈ N and every
K̄ = 1, . . . , N − 1.
Clearly, every game in a family has an equilibrium in mixed strategies


3.1   Why not to use a ”threat”, Nash (1953)

In the paper on cooperative behavior Nash (1953) offered to used a “threat ”as
a basic concept for coalition formation analysis. Further development of this
concept was transformed into a “blocking coalition ”(Aumann, 1960).
    The reason not to take them for non-cooperative coalition structure formation
is the following. Consider a strategy profile from only part of players. Let this
profile be a threat to someone, beyond this subset. The threatening players may
produce externalities for each other (and negative externalities not excluding!).
How credible could be such threat? From an other side, there may be some other
player beyond the subset of players who may obtain a bonanza from this threat.
But this beneficiary may not join the group due to some intra-group negative
externalities for members or from members of this group. Resulting internal
complexity and recursive nature of the example was the reason not to use a
threat and blocking coalition concepts to establish non-cooperative formation of
coalition structures.


4     Equilibrium refinement in the example

Non-cooperative game theory extensively studied refinement of the Nash equi-
librium. We can demonstrate equilibrium refinement for the game above with an
introduction of individual preferences over coalition structures. Let player i = 1
be an “extrovert” and always prefers to be together, in {1, 2}, but player i = 2
is an “introvert” and always prefers to be alone {{1}, {2}}. Player i = 1 has an
additional gain from being together (in comparison to Table 2) ϵ, 0 < ϵ, from
being together with another. From another side player i = 2 has an additional
gain from being alone, δ, 0 < δ.
    Payoffs of the Table 3 are adjusted according to these assumptions and
present the payoff matrix for the new game. Using the rule of unanimous agree-
ment for coalition formation the grand coalition, {1, 2}, can never be formed,
what leaves only one equilibrium payoffs (−2; −2) for the game in {{1}, {2}}.
Players differ in number of equilibrium strategies. Player i = 2 has one equilib-
rium strategy C2,a . Player i = 1 has two pure equilibrium strategies, C1,a and
C1,t and mixes them with equal weights. Equilibrium for K = 1 is labeled with
one star, ⋆ , for K = 2 with two starts, ⋆⋆

Table 3. Payoff for a game when player 1 is ”extrovert” and player 2 is ”introvert”.

                    N C2,a          C2,a          N C2,t       C2,t
                   (0; 0 + δ)   (−5; 3 + δ)     (0; 0 + δ) (−5; 3 + δ)
           N C1,a
                  {{1}, {2}}    {{1}, {2}}     {{1}, {2}} {{1}, {2}}
                  (3; −5 + δ) (−2; −2 + δ)⋆,⋆⋆ (3; −5 + δ) (−2; −2 + δ)
            C1,a
                  {{1}, {2}}    {{1}, {2}}     {{1}, {2}} {{1}, {2}}
                     (0; 0 + δ)     (−5; 3 + δ)     (0 + ϵ; 0)  (−5 + ϵ; )
           N C1,t
                    {{1}, {2}}      {{1}, {2}}        {1, 2}      {1, 2}
                    (3; −5 + δ)   (−2; −2 + δ)⋆⋆   (3 + ϵ; −5) (−2 + ϵ; −2)
            C1,t
                    {{1}, {2}}      {{1}, {2}}        {1, 2}      {1, 2}




     If both players are extroverters with a premium ϵ > 0 for being together in
{1, 2}, then a change in a game from K = 1 to K = 2 changes the equilibrium
strategy profile, and a resulting equilibrium coalition structure as well. Table 4
contains payoffs for this game. The additional payoff makes players form only
the grand coalition {1, 2} with a unique equilibrium, but a resulting payoff is
still inefficient.

Table 4. Payoff for two extrovert players who prefer to be together. Uniqueness of an
equilibrium is fixed.

                  L2,a       H2,a              L2,t             H2,t
                 (0;0)      (-5;3)            (0;0)            (-5;3)
          L1,a
               {{1}, {2}} {{1}, {2}}        {{1}, {2}}       {{1}, {2}}
                 (3;-5)   (−2; −2)⋆           (3;-5)          (−2; −2)
          H1,a
               {{1}, {2}} {{1}, {2}}        {{1}, {2}}       {{1}, {2}}
                 (0;0)      (-5;3)    (0 + ϵ; 0 + ϵ)   (−5 + ϵ; 3 + ϵ)
           L1,t
               {{1}, {2}} {{1}, {2}}      {1, 2}           {1, 2}
                 (3;-5)     (-2;-2)  (3 + ϵ; −5 + ϵ) (−2 + ϵ; −2 + ϵ)⋆⋆
          H1,t
               {{1}, {2}} {{1}, {2}}      {1, 2}           {1, 2}




5   Conclusion
The paper suggest a new family of simultaneous non-cooperative games which
satisfy the following criteria: be non-cooperative, be able to form multiple-
coalition structures and to contain two types of externalities, intra and inter
- coalition. Further application of the proposed mechanism to follow in the next
papers. Earlier version of the paper with more applications was published at
SSRN.

Acknowledgments. Special thanks for the support to Fuad Aleskerov, Lev Gel-
man, Dimitrios Tsomocos, Marc Kelbert, Nadezhda Likhacheva, Olga Pushkarev,
Shlomo Weber and some others. Earlier version of the paper was published at
SSRN and at arXiv.


References
      1. Aumann, R.Y., Acceptable points in games of perfect information. Pacific
         Journal of Mathematics, 10(2), 381-417 (1960)
      2. Bernheim, B.D., Peleg, B. and Whinston, M.D., Coalition-proof nash equi-
         libria i. concepts. Journal of Economic Theory, 42(1), 1-12 (1987)
      3. Lyusternik, L.A. and Sobolev, V.I., A short course in functional analysis.
         Vysshaya Shkola, Moscow (1982)
      4. Maskin, E., Commentary: Nash equilibrium and mechanism design. Games
         and Economic Behavior, 71(1), 9-11 (2011)
      5. Nash, J., Non-cooperative games. Annals of mathematics, 286-295 (1951)
      6. Nash, J., Two-person cooperative games. Econometrica: Journal of the
         Econometric Society, 128-140 (1953)
      7. Schilling, R.L., Measures, integrals and martingales. Cambridge University
         Press, 2017.
      8. Serrano, R., Fifty years of the Nash program, 1953-2003, (2004).
      9. Shapley, L.S., Stochastic games. Proceedings of the national academy of sci-
         ences, 39(10), 1095-1100 (1953)


Appendix. Proofs
Theorem 1. Let K be a maximum size of a coalition. For fixed K a game Γ (K)
has the Nash equilibrium in mixed strategies.
   The parameter K is omitted everywhere below for simplicity, besides ex-
pected utility.

Step 1 Preliminary step.

Let Si be a topological space for every i ∈ N . Let B(Si ) be σ-algebra on Si , and
the pair (Si , B(Si )) be a measurable set. Let a non-negative measure ∆i on Si
be a mapping ∆i : B(Si ) → [0, 1], and (Si , B(Si ), ∆i (Si )) be a measure space of
mixed strategies with ∆i (Si ) = 1. By theorem 5 from [7] the space ∆i can be
uniquely assigned. The space (Si , B(Si ), ∆i ) has weak convergence, what we do
not prove here.

Lemma 1. The space (Si , B(Si ), ∆i (Si )) is complete.
                                                                 {     }∞
                                                                   (k)
Proof. Let σi , be a mixed strategy, σi ∈ ∆i , and                σi              be a sequence
                                                                            k=1
of mixed strategies of i. All the sequences in (Si , B(Si ), ∆i ) are bounded. By
Bolzano-Weirstrass theorem every bounded
                                       { sequence
                                              }∞      has a least one limit point.
     (0)                                  (k)
Let σi be a limit point of a sequence σi           , and
                                                       k=1
                        ∫                         ∫
                               (0)
                              σi (si )dsi = lim        σ (k) (si )i dsi .
                         Si                k→∞    Si

Existence of a limit point in the weak convergence sense follows from the weak
compactness property of the set ∆i , by Prohorov’s theorem, [7]. From this im-
mediately follows completeness of the set of mixed strategies ∆i .

   A set of probability measures ∆−i := (∆j )j̸=i of all other players besides i is
bounded. Let σ−i be a mixed strategy of all other players, σ−i ∈ ∆−i .

Step 2 Expected utility of one player.

√∫Let Ui : ×i∈N Si → R+ be a payoff function of i, continuous on Si × S−i and
                        2
  Si ×S
        (Ui (si , s−i )) dsi ds−i < ∞.
        i
    We will use the word operator to emphasize, that player i controls only own
strategies, variables indexed with i, but does not control variables indexed with
−i controlled by other players. Expected utility operator of i in a game Γ (K) is
a Lebegue integral
                                           ∫
    K                  Γ (K)
EUi (σi , σ−i ) := EUi       (σi , σ−i ) =     Ui (si , s−i ) σi (si )σ−i (s−i )d(si )d(s−i ).
                                            Si ×S−i

    Probability measures for all players and each partition-contingent payoffs
Ui (si , s−i ) were defined above, so expected utility EUiK (σi , σ−i ) is well defined.

Theorem { 2. Expected
               }∞     utility operator EUiK (σi , σ−i ) maps
                                                         { a weakly
                                                               (     converging
                                                                        )}∞
           (k)                                               K   (k)
sequence σi       into a bounded converging sequence EUi σi , σ−i             .
                  k=1                                                                      k=1

                  ∫               ∫                      {     }∞
                       (k)             (0)                 (k)
Proof. Let limk→∞ Si σi (si )dsi = Si σi (si )dsi , where σi        is a bounded
                                                                k=1
weakly converging sequence from ∆i . Then

          (            )          ∫
             (k)                                           (k)
  lim EUiK σi , σ−i = lim                  Ui (si , s−i ) σi (si )σ−i (s−i )d(si )d(s−i )
 k→∞                        k→∞ S ×S
                                        −i
    ∫                               i
                                                                   (          )
                          (k)                                         (0)
 =        Ui (si , s−i ) σi (si )σ−i (s−i )d(si )d(s−i ) = EUiK σi , σ−i ,
      Si ×S−i


   Expected utility EUiK (σi , σ−i ) inherits compactness and weak convergence
over ∆i (Si ).
                                {    (         )}∞
                                       (k)
Lemma 2. The sequence            EUiK σi , σ−i                        is continuous on ∆i , ∀σ−i ∈
                                                                k=1
∆−i .

Proof.
           (   (        )            (          ))
                 (k)                    (0 )
     lim   EUiK σi , σ−i − EUiK σi i , σ−i
    ki →∞
              (∫                                                            )
                                    (                   )
                                       (k)       (0i )
        = lim         Ui (si , s−i ) σi (si ) − σi (si ) σ−i (s−i )dsi ds−i
           k→∞       Si ×S−i
    ∫                                        (∫                                                              )
                                                            (                       )
                                                                 (k)        (0 )
≤              Ui (si , s−i )dsi ds−i lim                       σi (si ) − σi i (si )   σ−i (s−i )dsi ds−i       =0
     Si ×S−i                        ki →∞         Si ×S−i
                                                                                                                  (1)

   Let Fi (σ−i ) = arg maxσi ∈∆i EUiK (σi , σ−i ), Fi : ∆i → ∆−i . Operator Fi is a
best response operator, it is bounded, compact and continuous.
   Best response correspondence Fi determines the best mixed strategies of i
to maximize expected utility given mixed strategy profile from other players.
Expected utility operator EUiK (σi , σ−i ) maps a convex, closed, compact set ∆i ,
Fi ⊂ ∆i , to a convex, closed, compact set.

Theorem 3. Let ∆i be a set of probability measures of i ∈ N , and Xi =
EUiK (∆i , ∆−i ) be a bounded and compact set of i′ s expected utility values. Then
the set Fi (X−i ) = arg maxσi ∈∆i (Si ) EUiK (σi , σ−i ) is also compact.
                                                 {       }∞
                                                    (k )
Proof. The set X−i is a compact set. Let σi i                     be a sequence from ∆i .
                                                          ki =1        (      )
                    (k)                                       (k)         (k)        (k)
For every point σi we take one of the pre-images X−i , Fi X−i = σi . The
                                                   {       }∞
                                                       (k)
set Xi is compact, then from the sequence X−i                      ∈ X−i we can extract
                             {          }∞                   k=1
                                 (k(r))                                         (0 )
a converging sub-sequence X−i                    , which converges to X−ii ∈ X−i .
                                         k(r)=1                               (          )
                                            (0 )                (k(r))            (k(r))
By continuity of Fi (X−i ) on Xi at X−ii there is σi                    = Fi X−i           →
   (       )
      (0 )       (0 )
Fi X−ii = σi i ∈ ∆i .

 Step 3 Fixed point argument for the game
   To apply fixed point theorem we construct a system of N equations and
   demonstrate existence( of a fixed point
                                       ) for the whole system. Let a vector
   operator EU K (σ) = EUiK (σi , σ−i ) i∈N be a list of expected utility oper-
   ators of all players. By the Tykhonov theorem the set of expected payoff
   values EU K (∆), s.t. ∆ = ∆i × ∆−i , is compact, ∆−i = ×j̸=i ∆i . Thus
   the set EU K (∆) is also bounded and continuous over the set of probability
   measures, as every component of EUiK (∆i , ∆−i ) has this property. Let k be
   a number of a probability
                         {{ measure
                               }    } (mixed strategy) of i in a sequence of
                                            ∞
                                    (k)
     probability measures         σi                    in the sense of the weak convergence,
                                            k=1   i∈N
      (k) weak         (0)
s.t. σi −−−→ σi . We want to construct a finite collection of converging
expected utility operators.
For every i exists an argmax operator:

                                          Fi (σ−i ) : ∆−i 7→ ∆i ,

i.e. the best response operator, that allows to choose the best mixed strategy
from ∆i in response to σ−i from ∆−i , such that

                             Fi (σ−i ) = arg max EUiK (σi , σ−i ) ,
                                                    σi ∈∆i

where ∆i is a bounded, closed, convex set with weak convergence. Let
                                         {                                 }∞
                     {     }
                       (k)                                        (k)
                      Fi     =               arg max       EUiK (σi , σ−i )
                                                (k)
                                               σi     ∈∆
                                                                              k=1

be a sequence of vectors of operators.
Let
  (                     )∞
      (k)         (k)
    F1 , . . . , F N               =
                             k=1
   (                                                                                 )∞
                            (k)                                             (k)
      arg max        EU1K (σ1 , σ−1 ), . . . , arg            max       K
                                                                      EUN (σN , σ−N )         (2)
            (k)                                               (k)
            σ1 ∈∆1                                           σN ∈∆N
                                                                                        k=1

be a sequence of best response( operators.
                                     )
                                 (k)
Every vector operator F (k) = Fi          is a finite vector, and by Tykhonov
                                                       i∈N
theorem it is also a compact and closed set. Every mapping F (k) transforms
a convex, closed, compact set ∆ = (∆i )i∈N into itself.

Lemma 3 (Schauder). Any operator F compact on (∆i )i∈N has a uniform
limit(on ∆ = (∆i )i∈N
                    ) as a sequence of continuous finite dimensional opera-
                              ∞
        (k)            (k)
tors F1 , . . . , FN                   , and maps (∆i (Si ), ∆−i (S−i )) → (∆i (Si ), ∆−i (S−i )).
                              k=1

The proof follows Sobolev and Ljusternik, (1976).

Proof. Operator F is a compact operator, hence F (∆) is a compact set.
Let there is a sequence of positive numbers {ϵ1 , ϵ2 , ϵk , . . .}, which converges
to zero. Let y ∈ F (∆) be an element of ∆. For every small positive ϵk
                         (k)       (k)            (k)          (k)
we construct L(k) = {y1 , . . . , yN }, y (k) = (y1 , . . . , yN ) ∈ F (∆), where
                       (k)      (k)
for every i there( is y)
                       i   ∈ {σi }i∈N . All L(k) are continuous on a mixed
                         (k)
strategy profile σi                       in a sense of the weak convergence, and denote
                                   ∫
                                   i∈N
                                                (k)
∥y − y (k) ∥ = maxi∈N               Si ×S−i
                                              |yi (si ) − yi (si )|y−i (s−i )dsi ds−i . Define on
F (∆) an operator J (k) such that for any y ∈ F (∆) there is
                                                     ∑N    (k)   (k)
                                       (k)            i=1 θi (y)yi
                                   J         (y) =   ∑N      (k)
                                                                     ,
                                                        i=1 θi (y)
where
                                   {
                                               (k)        (k)
                         (k)        ϵk − ∥y − yi ∥, ∥y − yi ∥ < ϵk
                        θi (y) =                          (k)      .
                                    0,              ∥y − yi ∥ > ϵk
                                                                         (k)         (k)
Operator J (k) (y) is well defined for every y ∈ F (∆) as θi ≥ 0 and θi > 0
at least for one j. Operator J (k) (y) is continuous on F (∆). This follows from
          (k)                              ∑N (k)
that all θi (y) are continuous over y, i=1 θi (y) is continuous over y. For
                           ∑N (k)
every y ∈ F (∆) there is i=1 θi (y) > 0, from where follows continuity of
      (k)
 θ          (y)
∑Ni     (k)         . Then
  1    θi     (y)
                                   ∑N        (k)   (k)          ∑N      (k)        (k)
                                        i=1 θi (y)yi               i=1 θi (y)(y − yi )
  ∥y − J (k) (y)∥ = y −                 ∑N (k)              =        ∑N (k)              ≤
                                          i=1 θi (y)                    i=1 θi (y)
                         ∑N
                          (k)         (k)      ∑N (k)
                     i=1 θi (y)∥y − yi ∥        i=1 θi (y)
               ≤        ∑N (k)            ≤ ϵk ∑N    (k)
                                                           = ϵk .
                           i=1 θi (y)           i=1 θi (y)
                   (k)                                       (k)
If there is ∥y − yi ∥ ≥ ϵk then a corresponding coefficient θi (y) = 0.
Let
{ (k)F} σ = J (F σ), then for any σ ∈ ∆ there is a sequence of operators
       (k)      (k)
        ∞
  F     k=1
             such that

                             ∥F σ − F (k) σ∥ = ∥F σ − F (k) (F σ)∥ ≤ ϵ,
for any σ ∈ ∆.
For every y (k) there is y (k) ∈ F (∆), so the values of the constructed operators
belong to a convex closure of F (∆).
                                             {     }∞
Lemma 4. Let a sequence of operators F (k) k=1 be continuous on ∆ and it
uniformly converges to an operator F on ∆. Let L(k) = F (k) (∆), k = 1, 2, . . ..
Then the set L = ∪∞   k=1 L
                             (k)
                                 is compact.
The proof follows Sobolev and Ljusternik, (1976).
Proof. According to the Lemma { (k) }above   an operator F (0) is compact, as there
                                       ∞
is a sequence of operators, F          k=1
                                           , which converges to F (0) . Then for any
ϵk > 0 and when k̄ ≥ k, for every σ ∈ L(k) there is y (0) ∈ L(0) such that
∥y − y (0) ∥ < ϵk . This is possible as y is an element from L(k) and σ is one of
pre-images of y under the mapping F (k) . So we can take y (0) = F (0) σ.
Now we construct the set ∪k̄k=1 L(k) . This set is compact. We need to show
that it is an ϵ-net for L. Let y ∈ K. If y ∈ ∪k̄k=1 L(k) , then the result of the
Lemma is trivial. If y ∈ L(k) for k̄ > k, then there is y (0) ∈ L(0) , such that
∥y − y (0) ∥ < ϵk . Thus ∪∞ k=k̄+1
                                   L(k) is compact for ϵk from set L, and thus L
is compact.
Theorem 4 (Schauder fixed point theorem). If a compact operator F
maps a bounded closed convex set ∆ into itself, then the mapping has a fixed
point, σ ∈ ∆, F σ = σ.

The proof follows Sobolev and Ljusternik, [3].

Proof. Take a sequence of positive {ϵ(k) }∞          k=1 , converging to zero, and as
above construct a sequence of continuous finite-dimension operators {F (k) }∞          k=1 ,
which uniformly converges on ∆ to F .
The infinite set of all probability distributions ∆ is convex, {F (k) }∞           k=1 =
{σ (k) }∞k=1 ⊂   ∆   for  every  σ  ∈   ∆. Let X  (k)
                                                      be   a finite dimension  subspace
with the set F (k) (∆), F (k) (∆) ⊂ X (k) . Take the operator F (k) on the subset
∆(k) = ∆ ∩ F (k) from X (k) . The set ∆(k) is also a closed convex set. As
F (k) (∆) ⊂ ∆ and F (k) (∆) ⊂ ∆(k) , then F (k) (∆) ⊂ ∆(k) , and therefore
F (k) (∆(k) ) ⊂ ∆.
Thus the operator F (k) in ∆(k) , ∆(k) ⊂ ∆, maps a closed convex set ∆(k) .
By the Bauer fixed-point theorem there is a fixed point of this mapping, i.e.
F (k) σ (k) = σ (k) . From another side ∆(k) ⊂ ∆, thus σ (k) is a fixed point also
for the
{ (k)
                         (k)
       }∞mapping F (∆). As the point              σ (k) ∈ F (k) (∆), and the sequence
                                        ˜ = ∪  ∞
  σ           belongs to the set ∆                 F (k) (∆) ⊂ ∆. Thus the set ∆     ˜ is
         k=1                                { k=1 }
                                               (k) ∞
compact. Then from the sequence σ                         we can extract a converging
                 {       }∞                         k=1
subsequence σ (kr ) kr =1 and a limit of this subsequence is in ∆, as ∆ is
closed.                                             ∫         (                   )
                                                                  (k ) (k )   (0)    (0)
We can define ∥F (kr ) σ (kr ) , σ (0) ∥ = maxi∈N Si ×S−i Fi r σ−ir − σi            σ−i dsi ds−i ,
  (k ) (k )         (k )
Fi r σ−ir = σi r . We need to demonstrate that σ (0) is a fixed point. This
follows from

∥F σ (0) , σ (0) ∥ ≤ ∥F σ (0) , F σ (kr ) ∥ + ∥F σ (kr ) , F (kr ) σ (kr ) ∥ + ∥F (k) σ (kr ) , σ (0) ∥ =

              = ∥F σ (0) , F σ (kr ) ∥ + ∥F σ (kr ) , F (k) σ (kr ) ∥ + ∥σ (kr ) , σ (0) ∥.
For any fixed ϵk > 0 we choose k ′ be big enough that for any k̄ > k ′ there is
∥σ (k̄) , σ (0) ∥ < ϵk̄ /3 and ∥F σ (0) , F σ k̄ ∥ < ϵk̄ /3.
Then we choose k ′′ be big                                   ′′
                                     } that for k̄ ≥ k there is ∥F σ, F σ ) < ϵk̄ /3
                               { enough
                                                                         (k̄)
                                           ∞
is uniform on ∆ for all           σ (k̃)           . Then for some k̄ ≥ max{k ′ , k ′′ } there is
                                           k̃=k̄
∥F σ (0) , σ (0) ∥ < ϵk̄ /3. As ϵk̄ > 0, then this is possible only if F ϵ(0) = ϵ(0) .
Then ϵ(0) is a fixed point.

The proof does not depend on K, thus every game in the family G has an
equilibrium in mixed strategies.