<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Information in Hierarchical systems</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Federal Research Center “Informatics and Control” of the Russian Academy of Sciences</institution>
          ,
          <addr-line>Vavilova 44-2, 119333, Moscow</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>The paper discusses the decentralization of the organizational system control in the presence of external uncertainty factors. The quantity of information that he or she can timely receive is assumed to be limited.</p>
      </abstract>
      <kwd-group>
        <kwd>Decision making under uncertainty</kwd>
        <kwd>Decentralization of control</kwd>
        <kwd>Information theory of hierarchical systems</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Experience shows that, in practice, the control of rather complex organizational
systems is based on the hierarchical principle. Hence, it can be concluded that
decentralized control is more efficient. However, it is rather difficult to explain the reason for
the effectiveness of such decentralization. Such explanation was proposed in the early
70s of the last century by Yu.B. Germeyer and N.N. Moiseev [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. It consists in the
following.
      </p>
      <p>Virtually always, the result of control depends not only on the controls selected by
the operating party, but also on external factors that are beyond the decision maker’s
control. Control will be effective if the decision maker correctly takes into account all
information about the external environment. But this is often impossible due to the
large quantity of such information. If the decision maker delegates some of his or her
decision-making powers to some agents, by joint efforts, they will be able to process
large amounts of information in a timely manner, thereby making the control more
efficient. However, there is another problem. Having the right to choose controls,
agents will have their own interests and choose control pursuing their own goals. This
may reduce the overall system control efficiency. However, if the interests of all
agents are well coordinated, it is still possible to benefit from the decentralization.</p>
      <p>Currently, the ability to handle large amounts of information is rapidly increasing;
however, there is no obvious tendency to centralize the control of complex systems.
This is probably due to the simultaneous processes of complicating the ties both
between the individual elements within a controlled system and the system’s ties with
the external environment. Therefore, the quantity of information necessary for
effective control is also increasing. In addition, we need to somehow separate the essential
information from the non-essential one; moreover, the separation method also
depends on the quantity of information that can be processed in a timely manner.</p>
      <p>At the verbal level, the above idea set forth by Yu.B. Germeyer and N.N. Moiseev
has been discussed rather widely. However, for a long time, it was not possible to
build formal mathematical models that allow for describing this effect. There are
objective reasons for this.</p>
      <p>Obligatory such a model should include:
– the description of several agents (including the operating party);
– the description of each agent’s capabilities and goals;
– the existence of external uncertainty;
– the description of each agent’s attitude towards uncertainty arising both from
insufficient information about the external environment and from unknown choices of
partners’ controls;</p>
      <p>– a sufficiently detailed description of the agents’ awareness, allowing, among
other things, to estimate the quantity of information processed.</p>
      <p>Thus, the desired model shall be very complex.</p>
      <p>
        It is worthwhile to dwell on the last item in this list. The very concept of
“information” is very complex and ambiguous. In some models of control decentralization,
we can be limited only by the description of the quantity of information; however, it
is not easy to do. There are several approaches to determining the quantity of
information [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. This very fact suggests that, in some cases, each of them is not suitable for
modeling reality; therefore, the choice of the desired method is a non-trivial task. In
addition, each of the existing models of the quantity of information is quite complex;
hence, when incorporated it into the general decentralization model, we get a very
difficult object to study.
      </p>
      <p>
        Probably, a model combining game-theoretic constructions with a quantitative
description of information exchanges was proposed for the first time in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. It uses the
approach to determining the quantity of information that A.N. Kolmogorov referred to
as the combinatorial one. The same approach is used below.
      </p>
      <p>This paper accepts the following structural assumptions ensuring the presence of a
“radial structure” in the control system under consideration:</p>
      <p>– it is believed that the set of controls can be presented as a Cartesian product of
several simpler sets;</p>
      <p>– it is assumed that, in the decentralized version, control is carried out without
feedback, i.e. the top-level element has no information about controls chosen by other
elements;</p>
      <p>– with decentralized control, it is believed that the lower-level elements have
complete and, therefore, identical information about external uncertainty factor.</p>
      <p>The rejection of any of these assumptions leads to the fact that the lower-level
elements can and shall interact with each other. As a result, a number of interesting and
important problem statements have been created; but this is a subject for a separate
research.</p>
    </sec>
    <sec id="sec-2">
      <title>Control System</title>
      <p>Let us consider the following controlled system model. The decision maker may
choose any control w at his or her discretion from the set W . In addition to this
choice, the control result is influenced by some uncertainty factor  from the set A ,
the value of which is behold the control of the operating party (the decision maker).
The control efficiency is estimated by value g(w, ) of the function g :W  A → .
Let us assume that the goal of control is to maximize this value.</p>
      <p>Let us make another assumption reflecting the concept of “technological
structuredness” of the controlled system under consideration. Let us assume that the set W
can be presented as a Cartesian product W = U V 1 V 2 ...V n . Then, every
element wW can be recorded as w = (u, v1, v2 ,..., vn ) , where u U , vi V i ,
i = 1, 2,..., n . We will use this form of recording where it is convenient, without
special reservations. In addition, we assume that, on the set A , the probabilistic measure
is given, which is known to the operating party.</p>
      <p>We make the following standard assumptions. Let us assume that, on the sets
u U , vi V i , i = 1, 2,..., n and A , topologies are given in which these sets are
compact. Let us consider the function g as continuous in the Cartesian product topology
U V 1 V 2 ...V n  A . Let us consider the measure  as a Borel one.</p>
      <p>We assume that the operating party has the opportunity to obtain information about
the realized uncertainty factor value, but the quantity of information that such party is
able to obtain and timely process is limited. Namely, let us assume that the operating
party can use l bits of information, and there are no other restrictions on the use of
such information.</p>
      <p>The above can be formalized as follows. Let introduce a notation. Hereinafter,
(X ,Y) will denote the family of all functions maping the set X into the set Y .</p>
      <p>The assumption made means that all information about the uncertainty factor, that
is available to the operating party, can be encoded with words s = (s1, s2,..., sl ) from
zeros and ones of the l length. Let us denote the set 0,1l (the Cartesian degree of
the set 0,1 ) with the letter S . Since the operating party has no restrictions on
access to information about the uncertainty factor, the choice of “encoding method”
P : A → S would be its prerogative. In addition, depending on the information
obtained s  S , the operating party has the right to choose any control wW . That
means, in fact, it can choose the function w* : S →W . If the operating party fixes the
encoding method P (A, S) and the control choice rule w* (S,W) , and the
value of the indefinite factor   A is realized, the operating party will receive the
message P ( ) , choose the control w* ( P ( )) , and its gain will be g ( w* ( P ( )) , ) .</p>
      <p>We will consider two control schemes of the described system. In the first of them,
the control w is selected centrally. In the second one, the decision maker delegates the
right to choose controls vi to n agents: the agent number i gets the right to choose
the control vi V i (i = 1, 2,..., n). The operating party (the Center) reserves the choice
of control u U . We believe that, at the time of decision making, agents know
exactly the realized value of the uncertainty factor .</p>
      <p>The i agent’s right to influence the situation inevitably entails the appearance of
his or her own goals. The process of forming such goals is complex and insufficiently
studied. In this model, such goals are considered as exogenous. We assume that the
purpose of the agent i is described by the desire to maximize the value of the function
hi (u, vi , ) . It is significant that this function depends on his or her own control, the
Center’s control, and the uncertainty factor; but it does not depend on choices of other
agents. We will assume that the functions hi are known to the Center. The functions hi
are considered to be continuous.</p>
      <p>Let us consider two systems of models differing from each other by the attitude of
the operating party towards uncertainty.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Interval Uncertainty</title>
      <p>First, let us consider the case where the operating party is careful in relation to
uncertainty.</p>
      <p>In the case of centralized control, its maximum guaranteed result will be
R0 (l ) =</p>
      <p>sup inf g(w* (P( )), ) .</p>
      <p>(w*,P)(S,W )( A,S) A
For comparison, in the absence of restrictions on the quantity of information obtained,
the maximum guaranteed result is</p>
      <sec id="sec-3-1">
        <title>Theorem 1. The following equalities are true:</title>
        <p>R0 () =</p>
        <p>sup inf g(w# ( ), ).</p>
        <p>(w# ,P)( A,W ) A
R0 (l ) =</p>
        <p>max min max g(ws , ),
(w0 ,w1...,wm−1)Wm A s=0,1,...,m−1
R0 () = min max g(w, ).</p>
        <p>A wW
In the case of decentralized control, under the assumptions made, the Center can
assume that agent i will choose its control from the set</p>
        <p>BRi (u*, P, ) = vi V i : hi (u* ( P ( )), vi , ) = max hi (u* ( P ( )), vi , )
viVi
therefore, the maximum guaranteed result of the Center will be</p>
        <p>sup min min ... min
(u*,P)(S,U )(A,S ) A v1BR1(u*,P, ) vnBRn (u*,P, )
g(u* ( P ( )), v1,..., vn , ).
In the model without restrictions on the quantity of information obtained, similar
result is equal to</p>
        <p>R1() = sup min min ... min
u#(A,U ) A v1BR1(u# , ) vnBRn (u# , )</p>
        <p>g(u# ( ), v1,..., vn , ),
BRi (u# , ) = vi V i : hi (u# ( ), vi , ) = max hi (u# ( ), vi , ).</p>
        <p>viVi
Theorem 2. We have the following equalities:</p>
        <p>R1 =</p>
        <p>sup min max min min ... min
(u0 ,u1,...,um−1)U m A s=0,1,...,m−1 v1E1 (us , ) v2E2 (us , ) vnEn (us , )
g(us , v1, v2 ,..., vn , ) ,
R1 () = min max min min ... min
A uU v1E1 (u, ) v2E2 (u, ) vnEn (u, )
g(u, v1, v2 ,..., vn ) ,
where
where</p>
        <p>Ei (us , ) = vi V i : hi (us , vi , ) = max hi (us , i , ) .</p>
        <p>iVi
For comparison of the two control methods, let us note that the values R0 (l) and
R1(l) do not decrease with increasing l . Of course, for any l , the following
inequalities are true: R0 (l )  R0 () and R1 (l )  R1 () . Besides, R0 ()  R1 () , and in
general, the inequality is strict. True is the</p>
        <p>Lemma 1. The following equality holds lli→m R0 (l) = R0 () .</p>
        <p>This simple and seemingly purely technical result is the key to proving the
following substantive statement.</p>
        <p>Theorem 3. All controlled systems can be divided into two classes. For games of
the first class, regardless of l , the following inequality is true: R0 (l)  R1(l) . For
games of the second class, there is such natural L that for all l  L , there is true the
inequality R1(l)  R0 (l) . Both classes are not empty.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Stochastic Uncertainty</title>
      <p>Now, let us assume that the operating party is risk neutral, that is, it focuses on the
mathematical expectation of its gain.</p>
      <p>With centralized control method, the maximum expected result of the operating
party is, by definition, equal to</p>
      <p>R2 (l ) =</p>
      <p>sup  g ( w* ( P ( )), )(d ) .</p>
      <p>(w*,P)(S,W )(A,S) A
A similar result in the model without restrictions on the quantity of information
obtained is given by the condition</p>
      <sec id="sec-4-1">
        <title>Theorem 4. The following equalities are true:</title>
        <p>R2 () =</p>
        <p>max  g(w# ( ), )(d ).</p>
        <p>w#(A,W ) A
With decentralized control method, the maximum expected result of the Center is
determined by the condition</p>
        <p>R3 (l ) =
(u*,P)(S,U )(A,S) A v1BR1(u*,P, ) vnBRn (u*,P, )
sup min ... min
g (u* ( P ( )), v1,..., vn , )(d ) .</p>
        <p>In the model without restrictions on the quantity of information obtained, this result is
equal to</p>
        <p>R3 () = sup min ... min
u#(A,U ) A v1Br1(u# , ) vnBrn (u# , )
g (u# ( ), v1,..., vn , )(d ) .</p>
      </sec>
      <sec id="sec-4-2">
        <title>Theorem 5. We have the following equalities:</title>
        <p>R3 (l) =
(u0 ,u1,m...,uamx−1)Um A s=m01,.a..,xm−1v1mE1(iuns , )...vnmEni(nus , )</p>
        <p>g(us , v1,..., vn, )(d ),
R3 () =  max min ... min</p>
        <p>A uU v1E1(u, ) vnEn (u, )
g (u, v1,..., vn , )(d ).</p>
        <p>It is easy to establish that, for any l, the following inequalities are true:
R2 (l )  R2 () , R2 (l )  R2 (l +1) , R3 (l )  R3 () , R3 (l )  R3 (l +1) and
R2 ()  R3 () .</p>
        <p>n
Let assume that g(u, v1, v2 ,..., vn , ) =  hi (u, vi , ) . Then, one can demonstrate
i=1
that R1(l)  R0(l), and in non-trivial cases, the inequality is strict. Similarly, if
n
g(u, v1, v2 ,..., vn , ) = − hi (u, vi , ) , then R1 (l )  R0 (l ) and, in a typical case, the
i=1
inequality is strict.</p>
        <p>The first hypothesis from the previous paragraph can be interpreted as a “very
good” coordination of interests of agents and the system as a whole. The second
assumption is interpreted as a “very bad” coordination of interests of the Center and
agents.</p>
      </sec>
      <sec id="sec-4-3">
        <title>The analogue of Lemma 1 is as follows.</title>
        <p>Lemma 2. We have the equality lli→m R2 (l ) = R2 () .
any   0 , at large enough l , we have the inequality R2 (l )  R3 (l) − and, in a
typical case, with large enough l , the inequality R2 (l )  R3 (l) is also true.
5
Qualitative conclusions, that can be made based on the study of both systems models,
can be formulated as follows.</p>
        <p>In non-trivial cases, the picture is as follows. If the interests of agents are “poorly
coordinated” with those of the Center, a centralized control is always more profitable.
On the contrary, if the interests of the Centers and agents are “well coordinated”, then,
with large values of l , centralization of control is more profitable, and with small
values of l , a decentralized control is preferable.</p>
        <p>In general, these conclusions are consistent with substantive ideas. In our opinion,
this suggests that models built reflect correctly the essence of the objects modeled.</p>
        <p>Let us note, by the way, that the results of theorems 1,2,4, and 5 allow, at least in
principle, to separate the “essential” information from the “non-essential” one. Surely,
we are still far from getting any quantitative results, but the qualitative picture
becomes clearer.</p>
        <p>It is important to note that all results have been obtained with minimal “geometric”
constraints on the structure of the studied models.</p>
        <p>The second of the considered model systems allows for using not the maximum,
but the “average” number of bits in the relevant message to estimate the quantity of
information, that is, for using the Shannon entropy. But the corresponding model has
not yet been studied.</p>
        <p>The above gives reason to hope that the suggested approach can serve as a basis for
building models that allow to study issues of the optimal decentralization of the
control basis for building models of complex organizational systems on a quantitative or
qualitative level.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Germeyer</given-names>
            <surname>Yu</surname>
          </string-name>
          .
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Moiseev</surname>
          </string-name>
          <string-name>
            <surname>N.N.</surname>
          </string-name>
          :
          <article-title>On some problems of the hierarchical system theory</article-title>
          .
          <source>In: Problemy prikladnoy matematiki i mekhaniki. Nauka</source>
          , Moskva, pp.
          <fpage>30</fpage>
          -
          <lpage>43</lpage>
          (
          <year>1971</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Kolmogorov</surname>
            <given-names>A.N.</given-names>
          </string-name>
          :
          <article-title>Three approaches to the definition of the concept 'quantity of information'</article-title>
          .
          <source>In: Problemy Peredachi Informatsii</source>
          ,
          <volume>1</volume>
          (
          <issue>1</issue>
          ),
          <fpage>3</fpage>
          -
          <lpage>11</lpage>
          (
          <year>1965</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Gorelov</surname>
            <given-names>M.A.</given-names>
          </string-name>
          :
          <article-title>Maximal guaranteed result for limited volume of transmitted information</article-title>
          .
          <source>Automation and Remote Control</source>
          .
          <volume>72</volume>
          (
          <issue>3</issue>
          ),
          <fpage>580</fpage>
          -
          <lpage>599</lpage>
          (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>