<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Influence Networks based Methodology for Consensus Reaching in Group-Decision-Making Problems</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jorge Ivan Romero-Gelvez</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Felix Antonio Cortes-Aldana</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Monica Garcia-Melon</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jorge Aurelio Herrera Cuartas</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Olmer Garcia Bedoya</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Universidad Nacional de Colombia</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Universidad de Bogota ́ Jorge Tadeo Lozano</institution>
          ,
          <addr-line>Bogota ́</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Universitat Politecnica de Valencia</institution>
        </aff>
      </contrib-group>
      <fpage>280</fpage>
      <lpage>294</lpage>
      <abstract>
        <p>The purpose of this work is to show a way to improve agreement in group decision problems. This work focuses his effort on the issue refers to assign different importance to every decision-maker. We propose as a novelty a methodology to assign different levels of importance to every decision-maker according to their perceived importance in the group. First, judgments are collected by an html form and use a proposed method based on SNA and DEMATEL to assign weights to decision-makers according to their reputation in the decision-group. Next, we solve the problem using AHP in order to rank the alternatives.</p>
      </abstract>
      <kwd-group>
        <kwd>Influence</kwd>
        <kwd>SNA</kwd>
        <kwd>Consensus</kwd>
        <kwd>Group-Decision-Making</kwd>
        <kwd>MCDA</kwd>
        <kwd>DEMATEL</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Group decision-making problems present several issues to reach a consensus
between decision-makers. According to [
        <xref ref-type="bibr" rid="ref3 ref4">3,4</xref>
        ] there are challenges and open questions
according to represent a different level of importance to decision-makers. We
propose that importance can be represented as weight over every decision-maker
in order to influence a change over decision-makers initial judgments to reach
a consensus agreement level over the main decision-making problem. There are
many methods for weighting criteria, [
        <xref ref-type="bibr" rid="ref1 ref17 ref25 ref28 ref29">1,17,29,28,25</xref>
        ] Modeling a decision maker’s
preferences as tangible valuations of their value judgments or even quantitative
information represents the core of the multi-criteria decision analysis.
Determining correct valuations for the criteria and alternatives becomes a problem of
vital importance in decision making. Determining this importance has been
approached from multiple perspectives, among some of the best-known approaches,
we can highlight the method of entropy, SWARA, SAW, AHP and ANP, among
others. Even dematel presents a proposal to generate weights from the sets of
importance and influence.
      </p>
      <p>
        Literature review and basic background
Groups have the potential to produce decisions that are better than individual
ones. However, research and history show that groups can make worse decisions
than individuals. even in the presence of diversity, strong leadership and
unlimited time. The influence analysis has been developed from the social sciences,
being psychology one of the branches that has presented more interest due to
an extended use in the dynamics of group decision problems. Its historical
evolution is shown below, emphasizing in the end the trend in applications related
to multi-criteria analysis. According to [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] in 1950, many psychologists followed
a research program on communication and social influence that focused on the
foundations of power and influence in groups. Later, in 1970, interest in the field
of group dynamics start to increase. While the increasing use of formal models
tilts the field towards a concern with theoretical issues, the field is still far from
having an adequate balance between theory, method and data. In the 1990s,
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] the most active lines of research in small groups were no longer in social
psychology but in organizational psychology. However, even in organizational
psychology, there has been a decline in work in human relationships and
traditions of group dynamics exemplified by [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. During the 1990s, more work was
done in intergroup relationships, based on social cognition approaches, than in
intergroup relationships, in which the structural characteristics of groups are
recognized and treated. At the same time, intergroup relationship research moves
to other fields of application. The social influence network theory presents a
formalization of the social process of attitude changes that develop in a network
of interpersonal influence [
        <xref ref-type="bibr" rid="ref10 ref11 ref9">10,9,11</xref>
        ]. [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] suggests, that the emergence of
interpersonal influence is among the basic postulates of social psychological theory:
People’s attitudes are usually formed in interpersonal settings in which
influential positions on issues disagree and may change. The social influence network
(SIN) has been continuously developed since the 1950s by [
        <xref ref-type="bibr" rid="ref10 ref13 ref14 ref6">14,13,6,10</xref>
        ]. It is one
of the important fields directly related to group decision making and SNA. In
this co-related direction, recent studies on CGDM have been introduced with
the incorporation of the theory of social influence, derived from social networks.
Brunelli et al. He addressed the evaluation of consensus considering the strengths
of the influence of experts in a social network through a measure of centrality
of their own vector with a blurred adjacency relationship approach. In [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], a
leadership-based consensus procedure was developed, where opinion managers
can give advice and influence the formation of a social network’s judgment to
achieve consensus.
3
      </p>
      <p>
        Methodology
For solve large group decision problems we propose a hybrid methodology based
on [
        <xref ref-type="bibr" rid="ref12 ref22 ref23 ref24">24,12,23,22</xref>
        ] using Social network analysis/DEMATEL for assign weights to
DM and analytic hierarchy process (AHP) for solve the decision-making problem.
As novelty we include a weighting rule (eq. 15)
      </p>
      <p>The methodology can be seen in the fig. 1. First, we generate the visualization
an analysis of data obtained by all decision-makers (DM). We collect all data
by a html questionnaire shared with several D-M, in order to obtain the
valuejudgments of them. For data visualization and analysis of all decision makers we
use JULIA programming language with the packages Taro, DataFrames and
ExcelReaders. Second, we assign weights to all decision-makers as the arithmetic
mean of SNA and proposed DEMATEL. Finally, we assign weights to all
decisionmakers and solve the problem with an MCDA technique, in this case, we propose
to use AHP by an own developed package in Julia 4. The use of SNA, DEMATEL
and AHP is explained as follows.
3.1</p>
    </sec>
    <sec id="sec-2">
      <title>Social Network Analysis</title>
      <p>
        According to [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] social network analysis is a collection of techniques under a
methodology that allows us to create social structures by using graph theory
and network analysis. Social structures can represent several kinds of different
relationships between actors and assign weight to those relationships. It can
represent the spread of disease or virus, interpersonal relationships, trust, influence,
among many others. According to [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] SNA practice, it implies following an
analysis structure that suggests the following steps (adapted for our context in
decision making by the authors):
– Identification: In this paragraph we notice the advice from [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and define
relational states as ”relational cognition” in perceptual aspects. (Influence
among them)
– Analysis: Measure the level of proximity for every decision-maker in the
influence network, to assign them different levels of importance.
– interpretation of information: Assign weights for every decision-maker to
use their influence in a dynamic group decision-making problem and improve
consensus in their judgments.
4 https://github.com/jorgeiv500/AnalyticHierarchyProcess
      </p>
      <p>
        There are many proximity measures, in this work we use the measure [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ].
The proximity can be compute as follows:
      </p>
      <p>Cc0 (ni) =</p>
      <p>g − 1
Pg</p>
      <p>j=1 d(ni, nj )
Where: d(ni, nj ) is the distance between the actor ni and the actor nj , g is
the sum of actors present in the network. The proximity measure proposed by
Sabidussi can be seen as the average inverse distance between the actor
(interested party in our problem) and all other actors. Proximity is the inverse measure
of centrality because large values indicate that a node has high peripheral value,
and small values indicate greater centrality in a node. A higher proximity index
indicates less importance for each actor.</p>
      <p>Decision-makers weight calculation The importance index is represented as
the weight Wj of each DM when an opposite measure I is normalized as follows:
Being I the importance of each DM ni represented as the influence over all the
DM and Wi is the weight for each DM.</p>
      <p>I =</p>
      <p>1</p>
      <p>Cc0 (ni)
Wi =</p>
      <p>Ii
P I
j i
3.2</p>
    </sec>
    <sec id="sec-3">
      <title>Decision-Making Trial and Evaluation Laboratory (DEMATEL)</title>
      <p>
        Decision Making Trial and Evaluation Laboratory, was developed by [
        <xref ref-type="bibr" rid="ref7 ref8">7,8</xref>
        ] based
on structural modeling for solving complicated and intertwined problems.
According to [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], this method has his core on graph theory which can divide
multiple criteria into a cause-and-effect group and the causal relationships in
a network. This technique has extended use, so it can calculate the relations
between criteria for Analytic-network-problems and other MCDM methods. In
this method each node represents an evaluation item (like criteria, people,
alternatives, among others), and arcs represent the strength of their relations. First,
using a four values scale where every influencing factor is denoted by:
– No influence −→ 0
– Low influence −→ 1
– Medium influence −→ 2
– High influence −→ 3
– Very high influence −→ 4
      </p>
      <p>We invite experts denoted as Hi to obtain the direct influence matrices BH .
Every decision-maker give their judgments over the evaluation items with the
scale presented before.
(1)
(2)
(3)</p>
      <p> 0 b12 b1n 
BH =  b21 0 b2n </p>
      <p>k k
xn1 xn2 0</p>
      <p>Where bi,j represents the direct influenced matrix determined by the H − th
expert.</p>
      <p>Next, we compute the average matrix as the arithmetic mean of all BH
matrices.</p>
      <p>The total effect including direct and indirect effects received by the jht factor,
id denoted by cj could be calculated as follows:
cj =</p>
      <p>Later, we compute the total relation matrix T . The powers of R represent the
indirect effects between any factors. A continuous decrease of the indirect effects
of factors along with the powers of matrix R, such as R2, R3, R4, ...., Rn like a
Markov chain matrix, guarantees convergent solutions to the matrix inversion.
Then, the total relation matrix X is given as follows:</p>
      <p>T = R + R2 + R3 + . . . = R(I − R)−1
Where I is n × n unit matrix.</p>
      <p>The total effect that directly and indirectly exerted by the ith factor, is
denoted by ri , could be calculated as follows:
ri =
n
X tij
j=1</p>
    </sec>
    <sec id="sec-4">
      <title>Decision-makers weigths calculation According with [1,5] DEMATEL can</title>
      <p>be used in order to compute the weights of criteria in MCDM problems as follows.
where ti+ represents the importance factor of every evaluated item.
ri + ci = ti+ =
n n
X ti,j + X tj,i
j=1 j=1
ri − ci = ti− =
n
X ti,j −
j=1
n
X tj,i
j=1
wi = ((t+)2 + (t−)2)1/2</p>
      <p>Wi =</p>
      <p>wi
Pn
i=1 wi
where ti− represents the influence factor of every evaluated item.
where wi represents euclidean distance of every evaluated factor, and consider
the importance ti+and influence ti− of all nodes.
(11)
(12)
(13)
(14)
(15)
Finally, we normalize matrix wi and obtain the weights for all item under
evaluation.</p>
      <p>Proposed method for weighting based on DEMATEL influence ti−
Given that we want to see the influence of every DM into all other participants,
we propose: from eq 12 obtain influence values of every decision-maker, similar to
centrality values we obtain the capacity of change judgments over other
decisionmakers. Later, we show their similarities with a numeric example in the last
section of this paper. We propose only use the influence ti−, as positive values by
adding the double of the absolute value from a minimum of all negative values
in set ti−.</p>
      <p>W (ti) =
 wi
 Pn
i=1 wi
t−
i=1 ti− if ti− ∈ {R ≥ 0}
 Pni
if any ti−∃{R&lt;0}
where W (ti) is the final weigth for every decision-maker, ti− is the influence
vector and ωi = ti− + 2| minin=1 ti−| are positive values from ti−.
3.3</p>
    </sec>
    <sec id="sec-5">
      <title>Analytic hierarchy process</title>
      <p>
        For solving the DM problem, we propose the use of AHP, as an accepted and
used often in problems that include subjective judgments of people. According
to Saaty [
        <xref ref-type="bibr" rid="ref25 ref26">26,25</xref>
        ] the AHP is a useful tool to structure complex problems that
influence multiple criteria and at the same time classify a set of alternatives in
order of importance. Initially a hierarchical structure is made where the main
decision problem is identified, then the criteria and sub-criteria that are taken
into account for the decision are identified.The last level corresponds to the set
of alternatives that will be evaluated concerning each of the criteria and
subcriteria. This evaluation is carried out through a series of binary comparisons in
a matrix n x n, where n is the number of elements to be compared. In order to
make the comparison, a scale is required. He proposed a scale between 1 and 9
where each intermediate value has an interpretation for the decision-maker (see
Table.1).
      </p>
      <p>Values 2, 4, 6 and 8 are intermediate values that can be used in some cases.
The next step is to find the relative priorities of the criteria and / or the
alternatives. This step is based on the eigenvector theory. For example if a comparison
matrix is A, then:</p>
      <p>Where w corresponds to the column vector of the relative weights obtained
by making the average of each line of the normalized comparison matrix.</p>
      <p>The value of λmax is obtained by adding the column vector corresponding to
the multiplication of the original comparison matrix with the column vector of
relative weights.</p>
      <p>Aw = λmaxw
λ max =
n
X Aw
i
Because comparisons are made subjectively, a consistency index is required to
measure the consistency of the person making the ratings. The consistency index
and the consistency ratio CR are calculated as follows:</p>
      <p>CI = λmax − n
n − 1</p>
      <p>CR =</p>
      <p>CI
RI</p>
      <p>Where the RI inconsistency ratio is a comparison constant that depends on
the size of the paired comparison matrix for sizes of n = 9 (our criteria x criteria
matrix) RI = 1.45
(16)
(17)
(18)</p>
      <p>Solution method
– Decision-Making Problem Formulation: We use a HTML survey 5 form
in order to collect judgments for 6 Decision Makers.
– Data Management and implementation SNA-DEMATEL: The
implementation of SNA was made with Gephi and calculating in Julia Language
the Sabidussi proximity measure.
– Decision-Making Problem solution: For solve the DM problem, we first
compare and assign a weight to every DM in order to give them different
levels of importance. Next, we solve the problem using AHP and arithmetic
mean aggregation of their judgments.</p>
      <p>– IDE: IPython/IJulia/Jupyter-notebooks.
4.1</p>
    </sec>
    <sec id="sec-6">
      <title>Case Study in environmental decisions</title>
    </sec>
    <sec id="sec-7">
      <title>Decision-Making Problem Formulation: The primary purpose of this appli</title>
      <p>
        cation is to compare DEMATEL with SNA to assign weights to decision-makers.
To solve the DM-Importance issue, we analize the problem presented in [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. This
problem includes new six decision-makers as stakeholders in a group
decisionmaking problem. The main problem is to prioritize environmental issues in a
natural park. The criteria describe as follows.
      </p>
      <p>Criteria The set of criteria is given in order to prioritize the problems given as
conservation objectives for the Cocuy National Natural Park.</p>
      <p>– Keep the eco-systemic connectivity of forest areas and wilderness.
– Preserve habitats and populations of endemic species.
– Keep the water supply that feeds the river basins.
– Protect the Uwa territory that overlaps with the Park.</p>
      <p>– Protect outstanding scenic values.</p>
      <p>Alternatives After discussing with the panel of decision-makers, it was agreed
to use 6 problems present in the National natural park.</p>
      <p>– Socio-Political fragmentation and loss of traditional knowledge of Uwa
community.
– Logging, burning and clearing of vegetation to maintain pastures and crops
between the Andean forests in the eastern sector.
– Infrastructure without environmental impact studies and mitigation
measures (deposits, canals, bridges, roads)
– Extensive grazing in the park.
– Clogging and rapid drying of peatlands, lakes and springs
– Tourism poorly managed in the park.</p>
      <sec id="sec-7-1">
        <title>5 https://www.1ka.si/</title>
        <p>
          Data Management and implementation SNA-DEMATEL: In order to
implement SNA and DEMATEL we make a square matrix for every DM
collecting the perceived importance of each other DM. Next, according with [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]
we calculate the influence index for every DM, by asking the decision makers
the following question: “Q1.Which stakeholder do you think may agree with your
opinion regarding the ranking of the goals of Cocuy National Park?”. Each DM
gives his/her opinion (their own beliefs) in order to build the square matrix
following the scale:
– No agreement with your opinion = 0
– Low level of agreement with your opinion = 1
– Medium level of agreement with your opinion = 2
– High level of agreement with your opinion = 3
– Very high level of agreement with your opinion = 4
        </p>
        <p>The judgments for every decision maker (also called matrix A See eq.5) can
be observed in Table 2 their aggregation and normalization (also called matrix
D See eq.6) can be observed in Table 3.
A = 11..0607 23..0107 01..0803 10..5000 11..8637 11..0803 D = 00..0183 00..1254 00..0104 00..1010 00..1143 00..0184</p>
        <p>From Table 3 we apply DEMATEL and Social Network Analysis in sub
section Decision-making problem solution as follows.</p>
        <p>Influence Networks based Methodology for Consensus Reaching 289
Fig.2: Influence
Network in Gephi®</p>
        <p>Ci = 11..5403 Ii = 00..6770 Wi = 00..1101 (19)</p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>Decision-Making Problem solution: For SNA analysis we take the D ma</title>
      <p>
        trix and represent the strength of all influence-relations in a graph (with gephi
software) as we can see in Fig 2. Their importance is calculated by Sabidussi
centrality/proximity measure [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. Once we have the Sabidussi centrality Ci we
apply the eq.2 and 3 in order to calculate the weight (importance) for every
decision maker (see eq. 19 ). Next, we aplly DEMATEL also starting from matrix
D, next using eq 6 we obtain the direct relations matrix, then we also get the
total relation matrix T from eq 8 (see Table 4)
0.44 0.73 0.72 0.74 0.73 0.85
0.53 0.55 0.69 0.74 0.71 0.72
T = 00..3447 00..4698 00..3559 00..4469 00..4578 00..4653
In order to identify the relevant relations between decision-makers we give a
threshold value β = 0.6 (0.1 over the arithmetic mean of every bij given in the
matrix T ). In Table 4 we can see all important relations between decision-makers
(in green) and represent them in DEMATEL (see Fig. 3) relations graph. The
final ranking for DEMATEL importance and influence can be observer in Table
5b as follows:
      </p>
      <p>Finally, we solve the problem using AHP though superdecisions-software 6.
Table 5a shows the weight compatibility between the proposed SNA and
DEMATEL approach. Weights obtained using the proposed DEMATEL approach have
been compared with those obtained with Social network analysis by
heighteningsabidussi proximity measure (see Fig. 4 as follows).</p>
      <p>Comparing them, there are very similar and present compatibility in their
order of preference, obtaining the same selection results when apply AHP method
as can see in Figs 5 and 6.</p>
      <sec id="sec-8-1">
        <title>6 https://www.superdecisions.com</title>
        <p>Fig. 4: Decision-makers final weigths
(a) AHP model results using SNA</p>
        <p>(b) AHP model results using DEMATEL</p>
        <p>Fig. 6: AHP model results with proposed models using Superdecisions
Now, we replace weights with arithmetic mean of two proposed approaches
and obtain as result: Awi = {0.360.200.090.130.140.08} and alternatives solution</p>
        <p>Fig. 7: Final Ranking with Superdecisions
ranking for the problem: Si = {0.140.180.110.320.140.12} . As can see in Fig. 7
Problem 5 is the most important problem in this numerical example, and there
is an agreement of every decision-makers over the solution, reaching consensus
over the final rank.
5</p>
        <p>Conclusions
– Sabidussi proximity measure give ssimilar results to Normalized DEMATEL
proposed weighting method, both proposals are normalized and proportional.
– It is possible to influence change over judgments in a decision-makers group
by an iterative and dynamic way, showing the values of the actor that have
major influence over all.
– People tend to agree with judgments from the most influential actor, given
their importance perception over some participants in the decision-making
group.
– Group decision making presents several issues according to every different
context in decision-making formulation. However, one of the open challenges
can be solved by our proposal in a very effective way, giving to every
decisionmaker a perceived-influence by other members of the decision group.
– In addition, to compute weights for every decision-maker, social network
analysis and DEMATEL give the analyst in the group decision problem
the capacity of increasing their knowledge about hidden relationships over
participants and give an easy way to reach agreements faster than other
panel-based-methods.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. Baykasog˘Lu,
          <string-name>
            <surname>A.</surname>
          </string-name>
          , Kaplanog˘Lu,
          <string-name>
            <given-names>V.</given-names>
            , Durmu¸sOg˘
            <surname>Lu</surname>
          </string-name>
          ,
          <string-name>
            <surname>Z.D.</surname>
          </string-name>
          ,
          <string-name>
            <surname>S</surname>
          </string-name>
          ¸Ahin,
          <string-name>
            <surname>C.</surname>
          </string-name>
          :
          <article-title>Integrating fuzzy dematel and fuzzy hierarchical topsis methods for truck selection</article-title>
          .
          <source>Expert Systems with Applications</source>
          <volume>40</volume>
          (
          <issue>3</issue>
          ),
          <fpage>899</fpage>
          -
          <lpage>907</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Borgatti</surname>
            ,
            <given-names>S.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Everett</surname>
            ,
            <given-names>M.G.</given-names>
          </string-name>
          , Johnson, J.C.:
          <article-title>Analyzing social networks</article-title>
          .
          <source>Sage</source>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Cabrerizo</surname>
            ,
            <given-names>F.J.</given-names>
          </string-name>
          , P´erez,
          <string-name>
            <given-names>I.J.</given-names>
            ,
            <surname>Herrera-Viedma</surname>
          </string-name>
          ,
          <string-name>
            <surname>E.</surname>
          </string-name>
          :
          <article-title>Managing the consensus in group decision making in an unbalanced fuzzy linguistic context with incomplete information</article-title>
          .
          <source>Knowledge-Based Systems 23(2)</source>
          ,
          <fpage>169</fpage>
          -
          <lpage>181</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Cabrerizo</surname>
            ,
            <given-names>F.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chiclana</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Urena</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herrera-Viedma</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>Challenges and open questions in soft consensus models</article-title>
          .
          <source>In: 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS)</source>
          . pp.
          <fpage>944</fpage>
          -
          <lpage>949</lpage>
          . IEEE (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Dalalah</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hayajneh</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Batieha</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>A fuzzy multi-criteria decision making model for supplier selection</article-title>
          .
          <source>Expert systems with applications 38(7)</source>
          ,
          <fpage>8384</fpage>
          -
          <lpage>8391</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>DeGroot</surname>
          </string-name>
          , M.H.:
          <article-title>Reaching a consensus</article-title>
          .
          <source>Journal of the American Statistical Association</source>
          <volume>69</volume>
          (
          <issue>345</issue>
          ),
          <fpage>118</fpage>
          -
          <lpage>121</lpage>
          (
          <year>1974</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Fontela</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gabus</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          : Dematel, innovative methods (
          <year>1974</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Fontela</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gabus</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>The dematel observer (</article-title>
          <year>1976</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Friedkin</surname>
            ,
            <given-names>N.E.</given-names>
          </string-name>
          :
          <article-title>A structural theory of social influence</article-title>
          , vol.
          <volume>13</volume>
          . Cambridge University Press (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Friedkin</surname>
            ,
            <given-names>N.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnsen</surname>
            ,
            <given-names>E.C.</given-names>
          </string-name>
          :
          <article-title>Social influence and opinions</article-title>
          .
          <source>Journal of Mathematical Sociology</source>
          <volume>15</volume>
          (
          <issue>3-4</issue>
          ),
          <fpage>193</fpage>
          -
          <lpage>206</lpage>
          (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Friedkin</surname>
            ,
            <given-names>N.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnsen</surname>
            ,
            <given-names>E.C.</given-names>
          </string-name>
          :
          <article-title>Social influence network theory: A sociological examination of small group dynamics</article-title>
          , vol.
          <volume>33</volume>
          . Cambridge University Press (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Gelvez</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aldana</surname>
            ,
            <given-names>F.C.</given-names>
          </string-name>
          , Sepu´lveda, G.:
          <article-title>Mining method selection methodology by multiple criteria decision analysis-case study in colombian coal mining</article-title>
          .
          <source>In: International Symposium of the Analytic Hierarchy Process</source>
          , Washington DC, USA (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Harary</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>A criterion for unanimity in french's theory of social power</article-title>
          . (
          <year>1959</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Johnsen</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>Studies in multiobjective decision models</article-title>
          .
          <source>Studentlitteratur Lund</source>
          (
          <year>1968</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kamis</surname>
            ,
            <given-names>N.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chiclana</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Levesley</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>An influence-driven feedback system for preference similarity network clustering based consensus group decision making model</article-title>
          .
          <source>Information Fusion</source>
          <volume>52</volume>
          ,
          <fpage>257</fpage>
          -
          <lpage>267</lpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Katz</surname>
            ,
            <given-names>L.:</given-names>
          </string-name>
          <article-title>A new status index derived from sociometric analysis</article-title>
          .
          <source>Psychometrika</source>
          <volume>18</volume>
          (
          <issue>1</issue>
          ),
          <fpage>39</fpage>
          -
          <lpage>43</lpage>
          (
          <year>1953</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Kerˇsuliene</surname>
          </string-name>
          , V.,
          <string-name>
            <surname>Zavadskas</surname>
            ,
            <given-names>E.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Turskis</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          :
          <article-title>Selection of rational dispute resolution method by applying new step-wise weight assessment ratio analysis (swara)</article-title>
          .
          <source>Journal of business economics and management</source>
          <volume>11</volume>
          (
          <issue>2</issue>
          ),
          <fpage>243</fpage>
          -
          <lpage>258</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Khan</surname>
            ,
            <given-names>G.F.</given-names>
          </string-name>
          :
          <article-title>Seven Layers of Social Media Analytics: Mining Business Insights from Social Media Text</article-title>
          , Actions, Networks, Hyperlinks, Apps,
          <string-name>
            <given-names>Search</given-names>
            <surname>Engines</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Location</given-names>
            <surname>Data</surname>
          </string-name>
          .
          <source>Gohar Feroz Khan</source>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Levine</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moreland</surname>
            ,
            <given-names>R.L.</given-names>
          </string-name>
          : Progress in small group research.
          <source>Annual review of psychology 41(1)</source>
          ,
          <fpage>585</fpage>
          -
          <lpage>634</lpage>
          (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>C.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wu</surname>
            ,
            <given-names>W.W.:</given-names>
          </string-name>
          <article-title>A causal analytical method for group decision-making under fuzzy environment</article-title>
          .
          <source>Expert Systems with Applications</source>
          <volume>34</volume>
          (
          <issue>1</issue>
          ),
          <fpage>205</fpage>
          -
          <lpage>213</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Newcomb</surname>
            ,
            <given-names>T.M.:</given-names>
          </string-name>
          <article-title>Social psychological theory: integrating individual and social approaches</article-title>
          . (
          <year>1951</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <given-names>Romero</given-names>
            <surname>Gelvez</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.I.</surname>
          </string-name>
          : Selecci´on de m´
          <article-title>etodos extractivos y su impacto en la productividad minera</article-title>
          . estudio de caso en la miner´ıa de carbo´
          <source>n colombiana (Diciembre</source>
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Romero-Gelvez</surname>
            ,
            <given-names>J.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cortes-Aldana</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Franco-Sepulveda</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>Compromise solutions in mining method selection - case study in colombian coal mining</article-title>
          .
          <source>DYNA 82</source>
          ,
          <fpage>127</fpage>
          -
          <lpage>136</lpage>
          (06
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Romero-Gelvez</surname>
            ,
            <given-names>J.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Garcia-Melon</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Influence analysis in consensus search-a multi criteria group decision making approach in environmental management</article-title>
          .
          <source>International Journal of Information Technology &amp; Decision Making</source>
          <volume>15</volume>
          (
          <issue>04</issue>
          ),
          <fpage>791</fpage>
          -
          <lpage>813</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Saaty</surname>
            ,
            <given-names>T.L.</given-names>
          </string-name>
          :
          <article-title>What is the analytic hierarchy process? In: Mathematical models for decision support</article-title>
          , pp.
          <fpage>109</fpage>
          -
          <lpage>121</lpage>
          . Springer (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Saaty</surname>
            ,
            <given-names>T.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peniwati</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Group decision making: drawing out and reconciling differences</article-title>
          .
          <source>RWS publications</source>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Sabidussi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>The centrality index of a graph</article-title>
          .
          <source>Psychometrika</source>
          <volume>31</volume>
          (
          <issue>4</issue>
          ),
          <fpage>581</fpage>
          -
          <lpage>603</lpage>
          (
          <year>1966</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Shannon</surname>
            ,
            <given-names>C.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weaver</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>The mathematical theory of communication (urbana, il (</article-title>
          <year>1949</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Simos</surname>
          </string-name>
          , J.:
          <article-title>Evaluer l'impact sur l'environnement: Une approche originale par l'analyse multicrit`ere et la n´egociation</article-title>
          . In:
          <article-title>Evaluer l'impact sur l'environnement: une approche originale par l'analyse multicrit`ere et la n´egociation. Presses polytechniques et universitaires romandes (</article-title>
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>