<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>On Applying the Structured Model “State-Probability of Action” to Multi-Criteria Decision Making and Contradictory Reasoning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Oleksiy Oletsky</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ivan Peleshchak</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Lviv Polytechnic National University</institution>
          ,
          <addr-line>Lviv, 79013</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>National University of Kyiv-Mohyla Academy</institution>
          ,
          <addr-line>Skovorody St.,2, Kyiv, 04070</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>An approach to applying the structured model “state-probability of action” for decision making and reasoning under contradictory information got its further development. It was formulated in terms of nodes, each of which should be associated with a rectangular stochastic matrix “state-probability of action”, and decision making, reasoning etc. is carried out mainly by operating with matrices and vectors. A way to constructing matrices “state-probability of action” on the base of fuzzy sets and their membership functions has been suggested. A problem of equilibrium between two alternatives was explored for such a network. Some examples are provided, one of them represents the prospect of how the structured model “stateprobability of action” can be combined with some elements of the Analytic Hierarchy Process for tackling the problem of multi-criteria decision making.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Multi-criteria decision making</kwd>
        <kwd>model “state-probability of action”</kwd>
        <kwd>fuzzy sets</kwd>
        <kwd>equilibrium of alternatives</kwd>
        <kwd>contradictory reasoning</kwd>
        <kwd>Analytic Hierarchy Process</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>uncertain logical reasoning, especially if this reasoning is carried out on the base of contradictory
evidence. This is the problem this paper is devoted to.
2. Methodology, model, and techniques: “state-probability of choice” nodes
and connections between them
Formally, for each node Q we have to specify a system of states 
= { ( ),  ( ), … }. Let  ( ) be a
random variable that means which state from 
an agent is located in at the moment. We have to
consider a vector of probabilities
where  ̅( ) is a probability that an agent is being in the state  ( ):
 ̅( ) = ( ̅( )</p>
      <p>,  ̅( ), … )
 ̅( ) =  ( ( ) = 
( )
)</p>
      <p>Instead of specifying  ̅( ) explicitly, we might consider a random walk across Q and transitional
probabilities in the corresponding Markov chain as it has been done in [1].</p>
      <p>Let A and B be connected nodes, and B is a successor of A. We consider the relation  →  as an
uncertain one, which means that the state</p>
      <p>the agent is located in depends on their state from  . We
specify the following probabilities:

( → ) =   ( ) = 
( )  ( ) = 
( )</p>
    </sec>
    <sec id="sec-2">
      <title>We can introduce the (</title>
      <p>× 
( → ) are described above.</p>
      <p>The matrix  ( → ) belongs to the class of so-called rectangular stochastic matrices [1, 3, 4], which
is a generalization of
well-known square stochastic
matrices. A rectangular
matrix 
=
,  = 1,  ,  = 1,  is said to be rectangular stochastic if it satisfices the following requirements:
)-matrix  ( → ) = ( ( → )), where 
=  ( ) , 
=  ( ) ,
∀
∀ ,</p>
      <p>= 1,
0 ≤ 
≤ 1
which means that the sum of elements in each row equals 1, but the matrix may be not a square one.</p>
      <p>As it was stated in [3], within such a notation in terms of vectors and matrices the following relation
takes place:</p>
      <p>̅( ) =  ̅( ) ∙  ( → )</p>
      <p>Terminal nodes, which have no successors, have another meaning. They are related just to the action
of decision making. Let there be n alternatives. We can introduce the “state-probability of action” model
as follows: let its states numbering m represent possible distribution of probabilities of choice, and each
element ℎ ,  = 1,  ,  = 1,  of the matrix</p>
      <p>= (ℎ ) is the probability that an agent will choose the
jth alternative if they are being in the i-th state.</p>
      <p>=  ̅( ) ∙</p>
      <sec id="sec-2-1">
        <title>3. Equilibrium of alternatives</title>
        <p>We will consider the most important particular case when there are two alternatives (n=2). For this
case it is especially important to consider the situation of equilibrium of alternatives. This means that
no alternative has advantage over the other, and</p>
        <p>Equilibrium of alternatives is of great importance for collective decision making by majority of votes
[1, 2]. It can be shown that if a number of agents is large enough, a situation of equilibrium is the only
situation when the alternatives are on a par with each other and are chosen in turn. Otherwise, one
alternative holds the steady advantage over the other, and it is permanently winning. But there can be
different situations of equilibrium. So, if an agent of influence wants to boost up an alternative which
is currently losing, they can try to reach one of equilibrium situations and then walk away from it in the
desired direction. In [1] some sufficient conditions of equilibrium situations were found, which
significantly rely on the principles of symmetry. This will be illustrated below.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>To make the further considerations clearer, let’s regard a basic illustrative example.</title>
    </sec>
    <sec id="sec-4">
      <title>Example 1 Let the terminal matrix H be as follows [1]:</title>
      <p>This means that the alternatives should be chosen with the equal probabilities, and equilibrium of
alternatives holds.</p>
      <p>Let’s assume that an agent of influence succeeds in changing the vector  ̅( ) – for example, it
changes as follows:
0.1,
0.1,
0.,
0.,
0.1,
0.3)</p>
      <p>Then  = (0.51, 0.49). Equilibrium of alternatives has been broken, and the first alternative will
now win permanently.</p>
      <p>The problem is that the matrix H is postulated in a very arbitrary way. There is no sound reason for
its elements to be chosen as they are, and they could have very different values. In addition to this, the
states represented by H hardly can be clearly interpreted. Now we are going to discuss how this problem
might be tackled.</p>
      <sec id="sec-4-1">
        <title>4. Getting matrices for terminal nodes</title>
        <p>One approach to making the model “state-probability of choice” more structured and intelligible
was suggested in [3]. Firstly, it comprises distinguishing groups of states having more or less clear
interpretation. For instance, such groups can be as follows:



proponents of a decision
those who hesitate
opponents of a decision</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>A number of groups can be larger.</title>
      <p>In terms of concepts introduced in Section 2, this is a separate node associated with a model
“stateprobability of action” with its own system of states L connected to the terminal one. So, we should
somehow determine a transition matrix  ( → ) from L to H. Then we can get the more ingenious
aggregated matrix  ∗ =  ( → ) ∙  . Given a vector  ̅( ), which specifies probabilities that an agent is
being in each state of L, the vector of choice probabilities p takes a view</p>
      <p>=  ̅( ) ∙  ( → ) ∙  =  ̅( ) ∙  ∗</p>
      <p>Again, a question of equilibrium arises, and now it is connected with so-called centrosymmetric
matrices [5, 6]. A (
×  ) – matrix A is said to be centrosymmetric, if

= 
,</p>
      <p>∀ = 1,  ;  = 1,</p>
      <p>It is known that if both matrices  ( → ) and H are centrosymmetric, then their product  ∗ is
centrosymmetric as well. Then, if  ̅( ) is a symmetric vector and  ∗ is a centrosymmetric matrix, the
vector p shall be symmetric, that is  = (0.5, 0.5), and therefore equilibrium of alternatives holds.</p>
      <p>In [3] the matrix  ( → ) was just specified explicitly. But it seems reasonable to elaborate more
flexible approaches to getting this matrix.</p>
      <sec id="sec-5-1">
        <title>5. A fuzzy approach to getting transitional matrix</title>
        <p>For specifying the transitional matrix  ( → ), we suggest an approach based on fuzzy sets. To
formulate the idea more or less formally, let’s consider a family of fuzzy sets  ( ,  ) with the
membership functions  ( , )( ), which indicates the grade of relation of the state x represented by H
to the certain state l from L. For instance, the state corresponding to the distribution (0.6, 0.4) relates in
large measure to the state corresponding to hesitating agents but not to proponents or opponents of the
decision.</p>
        <p>So, we can get a matrix  = ( ), where 
= 
( ),
( ( )). The matrix  ( → ) can be obtained
from this matrix by means of the well-known exponential transformation

( → ) =</p>
        <p>∑ 
where  &gt; 0 is a certain parameter.</p>
        <p>This looks similar to what we did in [2], but in that paper we did not take into consideration neither
related systems of states nor fuzzy sets.</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Let’s illustrate this by the following example.</title>
      <p>Let’s take the terminal matrix H corresponding to a certain decision the same as in (1), and there are
three groups of states on the level L: proponents of the decision, hesitating agents and opponents of the
decision. We can take U as follows:
 =
is centrosymmetric. Equilibrium of alternatives will hold for any symmetric vector  ̅( ).</p>
      <p>Like [2], the parameter  can be interpreted as a parameter which indicates the degree of agents’
decisiveness, and an influencer can try to manipulate this parameter. The resulting matrix
 ∗( ) appears not to be very good due to the low value of  . If we take the increased value, for
instance  = 5, which means that the agents become more decisive, we will get
 ∗(
) ≈</p>
      <sec id="sec-6-1">
        <title>6. The model “state-probability of action” and reasoning</title>
        <p>Now we a going to show how the structured model “state-probability of action” can be applied for
uncertain and contradictory reasoning. Reasoning is typically carried out on the base of the knowledge
by applying certain rules of inference to the known facts. But if we regard an agent’s knowledge as a
logical system, it may be contradictory (especially if the agent is a human being). Therefore, for a
statement A an agent may infer both A and its negation  ̅. In such a situation, we consider a probabilistic
approach, which means that an agent can accept A with a certain probability, and this probability can
be calculated with the help of the model “state-probability of action”. In this paper we are going to
develop an approach preliminary outlined in [7], re-formulate it in terms of systems of states and to
provide some more ingenious examples.</p>
        <p>Let an agent consider a decision L and therefore two related alternatives – to accept L or to reject L.
Within the model “state-probability of action” we have to introduce systems of states corresponding to
the rules of inference. For a single inference rule  ⟹  we consider two systems of states:  ( ) and
 ( ). So, we have to specify the vector  ̅( ) and the matrix  ( ⟹ ), then  ̅( ) can be obtained by the</p>
        <p>Multipliers in the equation (1) can be grouped in different ways. It can be rewritten in the following
form:
where</p>
        <p>=  ( ⟹ ) ∙  ∗.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Surely, a chain of logical inference may be longer.</title>
      <p>If both  ( ⟹ ) and  ∗ are centrosymmetric rectangular stochastic matrices, then their product R
shall be a centrosymmetric rectangular stochastic matrix as well. Provided that  ̅( ) is a symmetric
vector and R is a centrosymmetric matrix, equilibrium of alternatives holds.</p>
    </sec>
    <sec id="sec-8">
      <title>Another equivalent form of (1) can be constructed as follows:</title>
      <p>formula (). If the rule is a terminal one, that is the rule is 
⟹  , then we should specify the vector
 ̅( ) , the matrix  ( ⟹ ) and in addition to this the matrix  ∗ described above.</p>
    </sec>
    <sec id="sec-9">
      <title>Finally, for the rule  ⟹  the vector of probabilities equals</title>
    </sec>
    <sec id="sec-10">
      <title>We will use this form below. It is possible that the decision L can be affected by different factors, and this typically can lead to contradictions. To make a closer look, let’s consider the following set of rules:</title>
      <p>(2)
(3)</p>
    </sec>
    <sec id="sec-11">
      <title>By applying the equation (2) we can get q different vectors:</title>
      <p>̅( )( ) =  ̅( ) ∙  (
⟹ ),  = 1,</p>
      <p>The vector  ̅( ) can be obtained by combining all  ̅( )( ). In particular, we can get their convex
combination:
 ̅( ) = ∑</p>
      <p>̅( )( ),
0≤</p>
      <p>≤ 1,</p>
      <p>= 1</p>
      <p>We assume that the matrix  ∗ is centrosymmetric. It can be shown that if all vectors  ̅( )( ) are
symmetric, their convex combination is symmetric and therefore equilibrium of alternatives holds for
any values of  . Otherwise, for ensuring equilibrium the proper values of 
should be specially
picked.</p>
    </sec>
    <sec id="sec-12">
      <title>Let’s regard some examples.</title>
      <sec id="sec-12-1">
        <title>7. Examples of combining evidence</title>
      </sec>
    </sec>
    <sec id="sec-13">
      <title>Example 3</title>
      <p>Firstly, we are going to illustrate one popular rule of what may be called paranormal logic, namely
the rule “If A implies B and B is desirable, then A is true”. Surely, this rule is incorrect from the logical
point of view, but people are often driven by it in their practice.</p>
    </sec>
    <sec id="sec-14">
      <title>So, we have the rule  ⟹  , B is here the terminal node. As it was explained before,</title>
      <p>As for A, one evidence is the uncertain information whether it is true or false. It appears to be more
flexible if we pick out a separate rule  ⟹  , where K denotes the statement “There is the evidence
that A is true”. Based on this rule, we can get the vector</p>
    </sec>
    <sec id="sec-15">
      <title>Another rule is</title>
      <p>⟹  , where W denotes the statement “B is desirable”. So,
and the vector  ̅( ) should be obtained by combining  ̅( )( ) and  ̅( )( ).</p>
      <p>For all rules we are taking systems of states like to that we used for getting aggregated matrix
 ∗ (proponents, opponents and hesitating agents).</p>
    </sec>
    <sec id="sec-16">
      <title>Let’s postulate the specific values.</title>
      <p>The matrix  ∗ will be taken from the example 2 with  = 5:
 ̅( )( ) =  ̅( ) ∙  ( ⟹ )
 ̅( )( ) =  ̅( ) ∙  ( ⟹ )
 ∗ =</p>
      <sec id="sec-16-1">
        <title>For the reason of simplicity, we are taking the same matrices  ( ⟹ ) and  ( ⟹ ):</title>
        <p>But vectors  ̅( ) and  ̅( ) are very different. Assuming that there is no reliable information about</p>
      </sec>
    </sec>
    <sec id="sec-17">
      <title>A, we may take</title>
      <p>But if a majority of agents wants B to be accepted, we may take
 ̅( ) = (0.1,
0.2,</p>
      <p>0.7)
 ̅( ) = (0.7,
0.2,
0.1)
Then
 ̅( )( ) =  ̅( ) ∙  ( ⟹ ) = (0.11,
0.24,
and equilibrium of alternatives will hold.</p>
      <p>Another example illustrates how the structured model “state-probability of action” can be combined
with some elements of the Analytic Hierarchy Process (AHP) [8-12], which is a very famous method
of hierarchical multi-factor decision making.</p>
    </sec>
    <sec id="sec-18">
      <title>Example 4</title>
      <p>Assume there are two alternatives and agents are to choose one of them. Similar to AHP, we consider
decision making affected by multiple criteria. But instead of constructing pairwise comparison matrices
for each criterion, we are trying to introduce states reflecting degrees of advantage of one alternative
over the other. We stipulate the rule  ⟹  with the following meaning: “if an alternative L is better
with respect to any criterion, then L should be chosen”. We introduce the states for A as follows:
 L is significantly better than a competing alternative;
 L is better in some measure;
 both alternatives are equivalent;
 L is worse in some measure;
 L is significantly worse.</p>
      <p>Certainly, systems of states may be quite different. For instance, states may correspond to the
standard grades of Saaty scale, or we may use any other scale of preferences. Some reviews of different
scales for pairwise comparisons can be found in [13, 14].</p>
      <p>For the rule  ⟹  we will specify the following matrix:
 ̅( )( ) = (0.9, 0.1, 0, 0, 0. )
 ̅( )( ) = (0.6, 0.2, 0.1, 0.1, 0)
 ̅( )( ) = (0, 0.1, 0.1, 0.2, 0.6)
For each k-th criterion we will specify its particular vector  ̅( )( ). Let there be 4 criteria, and
 = ⎜⎜1
1
1
2
⎛
⎜3</p>
      <p>1
⎝4
 = ⎜
⎛
⎜4
1
4
1
⎝
4
3⎞</p>
      <p>⎟
2⎟</p>
      <p>⎟
1</p>
      <p>⎠
1</p>
      <p>⎞
4</p>
      <p>⎟
4⎟
1</p>
      <p>⎠
2
1
1
2
1
3
1
4
1
1
1
4
3
2
1
1
2
1
4
1
1
1
4</p>
    </sec>
    <sec id="sec-19">
      <title>Then its Perronian vector approximately equals</title>
      <p>With respect to this combined vector, final probabilities of alternatives are

combining criteria by using the formula (), we have to specify the coefficients 
. For instance, we can
take the Perronian vector (that is the normalized main eigenvector) of a pairwise comparison matrix
across criteria, which is absolutely typical for the AHP.</p>
    </sec>
    <sec id="sec-20">
      <title>Let the comparison matrix be</title>
      <p>and the chosen alternative shall be L.</p>
      <p>Equilibrium of alternatives will hold if the Perronian vector of C is symmetric. This can take place
if C is centrosymmetric, for example if it is as follows:</p>
      <p>In this paper we don’t consider possible consistency or inconsistency of centrosymmetric pairwise
comparisons, this issue needs to be specially studied.</p>
      <p>If a pairwise comparison matrix is considered as a parameter of a behavioral model, an influencer
can try to affect these comparisons – maybe by influencing experts to change their opinions and thereby
to modify their comparisons.</p>
      <sec id="sec-20-1">
        <title>8. Results, conclusions and discussion</title>
        <p>In this paper, the structured model “state-probability of action” has got a further development, which
opens a prospect of constructing a model of decision making under the uncertain and/or contradictory
information on the base of a network of connected nodes, each of which implements the model
“stateprobability of action”. At a closer look, each node should be associated with a rectangular stochastic
matrix “state-probability of action”, and decision making, reasoning etc. is carried out mainly by
operating with matrices and vectors. For given or assumed statements, vectors of initial probabilities
that an agent is being in the certain state related to these statements are to be provided. Such vectors
might be specified explicitly, but they can be also obtained from a Markov chain with the given
transitional probabilities, those are the probabilities of transitions across the states.</p>
        <p>Such a model comprises operating with chains of reasoning and combining contradictory evidence.
In some measure it is similar to those like probabilistic Bayesian networks, belief networks, knowledge
graphs etc. [15-18]. But the suggested model places more articulate emphasis on behavioral aspects of
decision making and on considering possible contradictions in available evidence.</p>
        <p>An approach to constructing matrices “state-probability of action” on the base of fuzzy sets and their
membership functions has been suggested. It appears that such a fuzzy approach might be considerably
entrenched by using fuzzy numbers of different kinds (triangle, trapezoid etc.).</p>
        <p>The model “state-probability of action” was designed to be parametrized. If such a model describes
a real situation of decision making and an agent of influence is aware of this model, then they can try
to manipulate the parameters with the aim of making other agents accept decisions desirable for
influencers. They can do it by sharing information with other agents; models aimed at describing
dissemination of information across communities are rapidly developing now [19-22].</p>
        <p>Some parameters for nodes implementing the structured model “state-probability of action” have
been suggested and discussed in [2] and, following that, in this paper. The main of them are as follows
(including but not limited to):
 decisiveness of agents
 pairwise comparisons between different criteria the final decision depends on if the suggested
approach is being combined with the Analytic Hierarchy Process
 weighting coefficients in formula (3), which are proposed to be used for combining evidence;
meaningfully these coefficients may reflect how those pieces of evidence are important and/or
reliable and how we do trust them
 fuzzy membership functions and types of fuzzy numbers which can be applied for forming
matrices “state-probability of action”, especially for terminal nodes
 transitional probabilities across states.</p>
      </sec>
    </sec>
    <sec id="sec-21">
      <title>This list of parameters of the model surely can be extended.</title>
      <p>Two examples, which illustrate possible ways of applying the structured model “state-probability of
action” to contradictory decision making and reasoning, have been provided. One of them illustrates a
very proliferated, despite its actual incorrectness, rule of reasoning “If A implies B and B is desirable,
then A is true”, which relates to what can be characterized as a paranormal logic and may be closely
bound with a conflict between knowledge and wishes of an agent, especially of a human being. The
other example illustrates the prospect of how the structured model “state-probability of action” can be
combined with some elements of the Analytic Hierarchy Process for tackling the problem of
multicriteria decision making. This appears especially important if decisions are made algorithmically on the
base of certain parametrized procedures.</p>
      <p>For both examples, the problem of equilibrium between alternatives, which can be found within the
model by combining contradictory pieces of evidence, has been explored. Those situations of
equilibrium can be found on the base of symmetric vectors and centrosymmetric matrices, it appears
interesting to search for non-symmetric ones. If the model is combined with the AHP, it appears
important to investigate how consistent or inconsistent pairwise comparison matrices may be.</p>
      <p>As an overall final remark, the suggested model “state-probability of action” insofar as it is a
probabilistic model admitting clear fuzzy generalization, and it is a model placing special emphasis on
behavioral aspects of decision making, can find various applications as for modeling individual and
collective decisions in socio-economic systems (political activity, information wars, fluctuations of
ratings gained by political parties, voting on elections etc.) so in multi-agent systems of algorithmic
decision making, especially if decisive rules applied in those systems are weakly formalized, unclear
and volatile.</p>
      <sec id="sec-21-1">
        <title>9. References</title>
        <p>[1] O. Oletsky, E. Ivohin, Formalizing the Procedure for the Formation of a Dynamic Equilibrium of
Alternatives in a Multi-Agent Environment in Decision-Making by Majority of Votes, Cybern Syst
Anal. 57-1 (2021) 47-56. doi: https://doi.org/10.1007/s10559-021-00328-y.
[2] O.Oletsky, Exploring Dynamic Equilibrium Of Alternatives On The Base Of Rectangular
Stochastic Matrices, in: CEUR Workshop Proceedings 2917, CEUR-WS.org 2021.
http://ceurws.org/Vol-2917/, pp. 151-160
[3] E.Ivokhin, O.Oletsky, Restructuring of the Model “State–Probability of Choice” Based on
Products of Stochastic Rectangular Matrices, Cybern. Syst. Anal. 58-2 (2022) 242-250.
https://doi.org/10.1007/s10559-022-00456-z
[4] R.Beneduci, Stochastic matrices and a property of the infinite sequences of linear functionals,</p>
      </sec>
    </sec>
    <sec id="sec-22">
      <title>Linear Algebra and its Applications 433 (2010) 1224–1239</title>
      <p>[5] J.R.Weaver, Centrosymmetric (cross-symmetric) matrices, their basic properties, eigenvalues and
eigenvectors, Amer. Math. Monthly 92 (1985) 711–717.
[6] A. Melman, Symmetric centrosymmetric matrix-vector multiplication, Linear Algebra Appl. 320
(2000) 193–198.
[7] O.Oletsky, A Model of Information Influences on the Base of Rectangular Stochastic Matrices in
Chains of Reasoning with Possible Contradictions, in: CEUR Workshop Proceedings 3179 (IT&amp;I
Workshops 2021), pp. 354-361.
[8] T.L. Saaty, The Analytic Hierarchy Process, McGraw-Hill, New York, 1980.
[9] M. Brunelli, Introduction to the Analytic Hierarchy Process, Springer, Cham, 2015.
[10] O.S. Vaidya, S. Kumar, Analytic hierarchy process: An overview of applications, European</p>
    </sec>
    <sec id="sec-23">
      <title>Journal of Operational Research 169(1) (2006) 1-29</title>
      <p>[11] A. Ishizaka, A. Labib, Review of the main developments in the analytic hierarchy process, Expert</p>
      <p>Syst. Appl. 38 (2011) 14336–14345.
[12] W. Ho. Integrated analytic hierarchy process and its applications. A literature review, European</p>
      <sec id="sec-23-1">
        <title>Journal of Operational Research 186(1) (2008) 211-228.</title>
        <p>[13] E. Choo, W. Wedley, A Common Framework for Deriving Preference Values from Pairwise</p>
      </sec>
    </sec>
    <sec id="sec-24">
      <title>Comparison Matrices, Comput. Oper. Res. 31(6) (2004) 893-908.</title>
      <p>[14] V. Tsyganok, S. Kadenko, O. Andriichuk, Usage of Scales with Different Number of Grades for
Pair Comparisons in Decision Support Systems, International Journal of the Analytic Hierarchy
Process 8(1) (2016) 112-130. doi: 10.13033/ijahp.v8i1.259.
[15] A.Darwiche, Modeling and Reasoning with Bayesian Networks, Cambridge University Press,
2009.
[16] P. Jackson, Introduction to expert systems, Addison Wesley, 1999.
[17] L. Bellomarini, D. Fakhoury, G. Gottlob, E. Sallinger, Knowledge graphs and enterprise AI: the
promise of an enabling technology, in: ICDE, IEEE, 2019, pp. 26–37
[18] P. Atzeni, L. Bellomarini, M. Iezzi, E. Sallinger, A.Vlad, Weaving enterprise knowledge graphs:</p>
    </sec>
    <sec id="sec-25">
      <title>The case of company ownership graphs, in: EDBT, OpenProceedings.org (2020), pp. 555–566.</title>
      <p>[19] S. Vosoughi, D. Roy, S.Aral, The spread of true and false news online, Science 359 (03 2018)
1146–1151
[20] A. Aref, T. Tran, An integrated trust establishment model for the internet of agents, Knowledge
and Information Systems, 62 (2020) 79–105
[21] K. K. Fullam, T. B. Klos, G. Muller, J. Sabater, A. Schlosser, Z. Topol, K. S. Barber, J. S.</p>
      <p>Rosenschein, L. Vercouter, M. Voss, A specification of the agent reputation and trust (art) testbed:
Experimentation and competition for trust in agent societies, in: Proc. 4th Int. Joint Conf. Auto.</p>
    </sec>
    <sec id="sec-26">
      <title>Agents Multiagent Syst. (2005), pp. 512-518</title>
      <p>[22] H. Yu, Z. Shen, C. Leung, C. Miao, V. Lesser, A survey of multi-agent trust management systems,
IEEE Access, 1 (2013) 35–50</p>
    </sec>
  </body>
  <back>
    <ref-list />
  </back>
</article>