<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Network-centric Approach to Destructive Manipulative Influence Evaluation in Social Media</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute of Personnel Training of the State Employment Service of Ukraine</institution>
          ,
          <addr-line>Kyiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>National Aviation University</institution>
          ,
          <addr-line>Kyiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>State Higher Vocational School in Nowy Sacz</institution>
          ,
          <addr-line>Nowy Sacz</addr-line>
          ,
          <country country="PL">Poland</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Yessenov University</institution>
          ,
          <addr-line>Aktau</addr-line>
          ,
          <country country="KZ">Kazakhstan</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0003</lpage>
      <abstract>
        <p>The mass media phenomena investigation are equipping a mankind with a broader and deeper understanding of society and culture due to the fact that the texts produced by the mass media are the most socially significant messages and have a priority in the society over all other types of texts. Moreover, in recent years, the concepts of mass consciousness influence and mass behavior influence had become increasingly popular. Frequently, mass media is the subject or instrument of such manipulation. Today Internet is digital media technology including web-sites, e-mail, Internet-radio and TV, as well as social networks and other services (so called social media). Destructive manipulative influence evaluation in social media is actual and important scientific task whichever quantitative its assessment. In this paper advanced approach to destructive manipulative influence evaluation in social media was proposed. This approach allows calculating the quantitative parameters that characterize the level of destructive manipulative influences on public opinion using channels of social media. Using this approach specialized software tools can be developed for manipulative influence automatized detection and quantitative evaluation.</p>
      </abstract>
      <kwd-group>
        <kwd>Social Media</kwd>
        <kwd>Destructive Manipulative Influence</kwd>
        <kwd>Quantitative Evaluation</kwd>
        <kwd>Public Opinion</kwd>
        <kwd>Information Psychological Security</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Currently, the mass media has become the main tool for information dissemination
that affect individual consciousness and subconscious and, as a consequence, the
public consciousness. Public consciousness should be considered as a social phenomenon
whose main function is to influence the audience through semantic and evaluative
information transmitted by mass media channels. Moreover, public consciousness is a
mechanism for actualizing information through various means of communication.
Therefore, mass media influence does not always have a negative effect, since in the
globalized world it is difficult to imagine human life without newspapers, social
networks and other mass media. However, on the other hand, some individuals, for
gaining their own advantages, use mass media as an instrument of influence on society.
2</p>
      <p>Analysis of Modern Researches Devoted to Manipulative
Influence Evaluation in Social Media
The research in mass media manipulative influence field was engaged by large
number of Ukrainian as well as foreign scientists.</p>
      <p>In research papers of A. Peleschyshyn [1,2] the description of informational
environment of the virtual community in social networks was described; a model of internal
informational environment and the discussion model of the virtual community were
developed and detailed; on the basis of a formal model of the informational
environment of the virtual community, taking into account the quality of information content,
the indicator of information threats is determined. These models allow organizing the
detection and counteraction of the information threats and providing the
informationpsychological security of a person in a social network. However, a significant
disadvantage of these models is the impossibility of quantity evaluation.</p>
      <p>A human activity model and human joint activities model in the information space
was proposed by A. Shiyan [3]. On the basis of proposed models, a human protection
method from negative informational and psychological influence on the basis of the
peculiarities of its activity was presented. However, directly, the formal protection
model against manipulative influence was not highlighted, as a consequence, is not
possible to evaluate mathematically the effect.</p>
      <p>In research study of D. Gubanov [4] an overview of the influence models in social
networks was presented, the main classes of models in social networks were
considered and the correspondence between classes of models and parameters of the
modeling object was established. An analysis of these models allows to study the
relationships between objects in a social group and the dependence of information influence
on persons and public opinion.</p>
      <p>The formalized model for detecting PR-influence through Internet publications was
developed by O. Khatyan in paper [5]. According to this work, PR-influence is the
mass media manipulative influence. However, this model allows to identify the
impact, but do not assess it. Therefore, the developed model can be used as an initial
stage for the development of a further evaluation model. Proceeding from the above, a
detailed analysis of manipulative influences models was conducted.</p>
      <p>Given results of the analysis show that existed models and methods have certain
limitations as to practical application for solving various kind of tasks of information and
psychological security (also it can be combined with information-technical
influence [6]). It is found that the evaluation method of media manipulative influence is
only then effective and adequate in case it meets all the specified criteria like taking
into account methods of manipulative influence or formal its description.
The main task of this paper is to develop an evaluation method of destructive
manipulative influence, which will allow calculating the quantitative parameters of their
influence on public opinion in social media.</p>
      <p>Theoretical Background of Proposed Approach to</p>
      <p>Manipulative Influence Evaluation
After the definition of existed approach new approach based on network-centric
concept [7,8] was developed. The proposed evaluation approach of mass media
manipulative influence on public opinion is realized in following 8 stages:
1. Evaluation the financial costs;
2. Ranking of reasons by the degree of their danger;
3. Determination the objectives of the manipulation campaign (hereinafter – KMp);
4. Determination of the KMp tasks;
5. Determination of strategies for the KMp implementation;
6. Selection the mass media for manipulation;
7. Selection the manipulation method;
8. Estimation of manipulative influence.</p>
      <p>These stages will be detail described after defining input and output data. The
practical realization of this approach could allow evaluating the level of media
manipulative influence on public opinion.</p>
      <p>Input data: the set of reasons for conducting KMp; the set of dislocation places; the
set of goals for KMp; the set of focus groups; set of criteria for estimating parameters;
the set of strategies for KMp; the set of mass media; the set of manipulation methods
and the set of «weight by criteria».</p>
      <p>
        Output data: list of selected causes, goals, criteria, tasks, strategies, methods, mass
media; values of magnitude and effectiveness of manipulative influence.
Evaluation the effectiveness of manipulative actions is the preparatory stage for
conducting the campaign. This stage is only necessary for the customer – to evaluate the
financial efficiency of KMp. At this stage, from the whole mass media database it is
necessary to select those mass media which, in the opinion of the expert, are suitable
for the implementation of manipulative influence. First of all, it is necessary to
determine the economic effect of advertising in selected mass media in accordance to (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ):
E 
Т D  H
100
      </p>
      <p>
        T  U P  U D  ,
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
where E is the economic effect of advertising; ТD is additional trade turnover under
the advertising influence; НТ is trade margin on goods (measured in % to the
realization price); UР are advertising costs; UD are additional expenses on the growth of
goods turnover.
      </p>
      <p>The next formula ZP  ZP  ZO . gives an opportunity to evaluate the effectiveness of</p>
      <p>ZO ZO
advertising in relation to the profits of the company, obtained from advertising ( ZP )
to profit before advertising ( ZO ).
3.1</p>
      <p>Stage 1 – Evaluation the financial costs on KMp
Step 1 – Choosing the reasons for conducting KMp.</p>
      <p>At the first step of Stage 1 it is necessary to input a set of reason ( I ):
P
i1
I  {</p>
      <p>Ii}  {I1, I2,..., I p}, Ii  I, i  1, P
,
and experts choose those reasons (using voting method), which, in their opinion,
require a KMp. After that experts go to step 2.</p>
      <p>Step 2 – Ranking of reasons by the degree of their danger.</p>
      <p>
        That is, for each possible i reason (for the period of preparation and implementation
of the KMp) in r regions, it is necessary to evaluate the financial cost ( ui ) for a
manipulative attack using formula (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ):
      </p>
      <p>R
ui  
r1 j1 t1</p>
      <p>J T
 rj (t)  cir , r  1, R; j  1, J ; t  1,T
,
where  rj (t) is the amount of mass media of j type (social networks, newspaper, TV
etc.), for the period t in region r , cir is the cost of one mass media of j type in
region r .</p>
      <p>Step 3 – Definition of financial constraints.</p>
      <p>At this step, it is necessary to determine financial constraints of conducting KMp
using following expression:</p>
      <p>
        R T
ui   d rj (t), i  1, I ,
r t1
(
        <xref ref-type="bibr" rid="ref2">2</xref>
        )
(
        <xref ref-type="bibr" rid="ref3">3</xref>
        )
where d rj (t) is the amount of possible financing of the KMp during t period in r
region. As a result of Stage 1, will be received a financial statement about expenses
on the KMp. Based on the report, it is possible to analyzed if KMp should be carry
out from a financial point of view.
3.2
      </p>
      <p>Stage 2 – Ranking of reasons by the degree of their danger
During the ranking of reasons by the degree of their danger, each expert are
conducting pairwise comparison of reasons by the degree of their danger for KMp (step 1)
where i is the expert number, j is the reason number, r is the region number:
 1, if   Ii  equal to Ii1;
hirj  2, if   Ii  more dangerous than  Ii1;</p>
      <p> 0, if   Ii   less dangerous than  Ii1;
Hr  hij (i1,a)  h21,
( jb) ...</p>
      <p>
        h11, h12, h1b
h22, h2b ,
... ...
ha1, ha2, hab
(
        <xref ref-type="bibr" rid="ref4">4</xref>
        )
(
        <xref ref-type="bibr" rid="ref5">5</xref>
        )
Furthermore, the system agrees the expert score with one of the well-known
harmonization computer algorithms. As a result of the Stage 2 implementation, will be
obtained a matrix of reasons, according which it is expedient (or inexpedient) to conduct
KMp.
3.3
      </p>
      <p>Stage 3 – Determination the objectives of the KMp
At this stage, a set of objectives ( С ) must be created by experts:</p>
      <p>C  {</p>
      <p>Ci}  {C1,C2,...,Cc}, Ci  C, i  1,c
The set of objectives is a possible consequence of the reasons for conducting the KMp
(step 1). Moreover, in step 2 by experts are creating the set of focus group ( G ) who
are the target of influence:</p>
      <p>G  {</p>
      <p>Gi}  {G1,G2,...,Gg}, Gi  G, i  1, g
r
c
i1
g
i1
.
,
and criteria ( Kr ): Kr  {</p>
      <p>Kri}  {Kr1, Kr2,..., Krr}, Kri  Kr, i  1, r , that are the
parami1
eters by which the objectives and tasks of the KMp will be selected.</p>
      <p>As a result of the Stage 3 implementation, will be formed objectives, the focus groups
who are the objects of influence are identified and the criteria (for choosing objectives
and tasks) are selected.</p>
      <p>y
L  {</p>
      <p>Li}  {L1, L2,..., Lm}, Li  L, i  1, m.
3.4</p>
      <p>
        Stage 4 – Determination of the KMp tasks
At the step 1, experts form a set of tasks ( A ), which are connected to the objectives
of the KMP (the objectives were identified in step 3), for assessing the KMP's tasks
by using (
        <xref ref-type="bibr" rid="ref6">6</xref>
        ):
      </p>
      <p>A  {</p>
      <p>
        Ai}  {A1, A2,..., Ay}, Ai  A, i  1, y.
(
        <xref ref-type="bibr" rid="ref6">6</xref>
        )
(
        <xref ref-type="bibr" rid="ref7">7</xref>
        )
(
        <xref ref-type="bibr" rid="ref8">8</xref>
        )
At the step 2, the proportion of agreed positive scores xvAi to the criteria of each v
task of each agent Ai according to all the criteria is calculated by (
        <xref ref-type="bibr" rid="ref7">7</xref>
        ):
xvAi 
  AviKri , i  1,v.
 aAiKri
      </p>
      <p>v
As a result of Stage 4, the tasks to be achieved during KMp are formed.
3.5</p>
      <p>
        Stage 5 – Determination of strategies for the KMp implementation
The objectives of manipulating different groups are made at different times ti and
with different benefits. In accordance with the formulated objectives and tasks their
strategies ( L ) Ci  Li, Ai  Li are selected and implemented. At the step 1, from the
set of strategies experts select the strategy that require of the KMp conducting:
At the step 2, the list of strategies is ranking by following expression (
        <xref ref-type="bibr" rid="ref8">8</xref>
        ):
3, if  al  ap ,


flp  2,  if  al  ap ,

1, if al  ap.
      </p>
      <p>As a result of Stage 5, it is formed a number of strategies (possibly more than 1) on
which KMp will be realized.
3.6</p>
      <p>Stage 6 – Selection the mass media for manipulation
At the stage 6, it is necessary to choose mass media ( Z ) which will be used during
manipulative influences [9-11].</p>
      <p>Then, it is necessary to conduct an analytical study of mass media with further
evaluation of the information influence effectiveness. At the step 1, a set of mass media is
formed as follow:
.</p>
      <p>
        Step 2 – evaluation the effectiveness of manipulative actions can be presented using
following formula (
        <xref ref-type="bibr" rid="ref9">9</xref>
        ):
where indzg is the influence of z mass media on  -th focus group or its segment.
The ratio of advantages in  -th focus group for each studied above j criteria of
p j (k, h) for pair of mass media alternatives Ak , Ah can be presented as
where dzp is publication price (unit of standard area, standard broadcast time etc.) in
z mass media on р page (in р broadcast time etc.).
      </p>
      <p>
        After that, an important action is the calculation of «cost per thousand» readers:
According to the different price in different cities (regions), the «cost per thousand»
quantity will difference. So, ind index can be presented as indZGR and matrix IND
converted into cube, but in our example (
        <xref ref-type="bibr" rid="ref11">11</xref>
        ) it is necessary to leave just two indices
Z and G :
      </p>
      <p>R
cZiiGi </p>
      <p>R
aZiiGi
bZRii ,
where aRi</p>
      <p>ZiGi is a score of z mass media in  -th focus group in r region, z  1, Z ,
g  1,G, r  1, R, bZRi is a score of z mass media of population in r -region, cZiiGi is a
R
i
compliance index of z mass media in  -th focus group in r region.</p>
      <p>
        Thereafter, the mass media price matrix (
        <xref ref-type="bibr" rid="ref10">10</xref>
        ) is created and stored in database of
manipulation system:
      </p>
      <p>Dzp  
d1Z
dZ1



d1P
 ,
dP1
eZiGi pRi </p>
      <p>dZi p
bZiRi  cZiGiRi</p>
      <p>.</p>
      <p>INDZP 
ind1Z</p>
      <p>
indZ1
 ind1P
</p>
      <p> ,
 indP1</p>
      <p>
        (
        <xref ref-type="bibr" rid="ref9">9</xref>
        )
(
        <xref ref-type="bibr" rid="ref10">10</xref>
        )
(
        <xref ref-type="bibr" rid="ref11">11</xref>
        )
 rkgj  rhgj , if  rkgj  rhgj  ,
p gj k, h   m j

 0  if not.
      </p>
      <p>The ratio of the dominance Ak alternative over Ah in  -th focus group can be
presented by membership function (14) which characterizes the dominance intensity of
k over h mass media:
where m j is the rating scale according to the j criteria, rkgj , rhgj are the value of the
Ak , Ah options according to the j criteria in  -th focus group.</p>
      <p>
        The ratio of advantages over a pair of alternatives ( Ak , Ah ) taking into account all
considered criteria (
        <xref ref-type="bibr" rid="ref12">12</xref>
        ) can be defined by following expression (
        <xref ref-type="bibr" rid="ref13">13</xref>
        ):
      </p>
      <p>J J  rkgj  rhgj , if  rkgj  rhgj ;
pg k, h  p gj k, h    m j</p>
      <p>j1 j1  0  if not.</p>
      <p> pg k, h  pg h, k , if pg k, h  p g h, k ;
 Dg k, h  </p>
      <p> 0  if not.</p>
      <p>
        The best alternative using (
        <xref ref-type="bibr" rid="ref12">12</xref>
        ) – (14) corresponds to the following expression:
  
 *  Ak*   max Dk1,,m *  Ak   1 min max  p k, hkll11,,.k.,m,l  p h, k .
As a result of Stage 6, the mass media which according to the criteria has the highest
rating will be chosen. Moreover, isn’t necessarily it will be one mass media for all
disposition places. It is also possible to choose different mass media for different
disposition places.
3.7
      </p>
      <p>Stage 7 – Selection the manipulation method
In database the manipulative influence methods ( M ) are stored (for example [12]).
These methods (15) can be presented as following complex set:</p>
      <p>M  {
x
i1</p>
      <p>x e
Mi}  { {
i1 j1</p>
      <p>
        Mij}}  {{M11, M12,..., M1e},{M21, M22,.., M2e},
,...,{Mx1, Mx2,..., Mxex }}, (i 1, x, j 1,e) .
(
        <xref ref-type="bibr" rid="ref13">13</xref>
        )
(14)
(15)
In database all methods are separated by certain characteristics and used by different
mass media. Furthermore, each agent chooses the most effective method from the
database that, in agent’s opinion can use by mass media. After that, the list of criteria
(16) for which the methods selecting are conducting will be formed.
      </p>
      <p>M ij  k11i, j  k2 2i, j   k3 3i, j , i  1, I ,  j  1, J ,
(16)
where k1 «the value» of l criteria ( l 1, 2, 3 ),  iij is criterion value of j operative
manipulative influences method according to i strategy for l criteria.
As a result of Stage 7, manipulative influence methods which will be implemented by
the mass media chosen in step 6 will be chosen.
3.8</p>
      <p>Stage 8 – Estimation of manipulative influence
If the initial evaluation of  -th focus group is presented as bg , then the task of
manipulation is to change the group's opinion to</p>
      <p>bg  qg , qg Qg , g  N, 
where qg is the change of initial opinion, thus qg is the controlling influence.
As a result of the sequence of operational manipulative influences, the final opinion in
some focus groups is formed:</p>
      <p>Bq  T (b  q),
where qg is the initial opinion of focus group, q  qg .
gN
The target function of public opinion modification can be represented as follow:
Ф  Bq, q  max H  (Bq )  C  q,
(17)
where H () are received benefits (profit, votes in elections, change in certain officials
or government etc.) by an organization in whose interests the manipulative influence
is conducted, which depends on the change of public opinion, C() are costs for
manipulative actions.</p>
      <p>Using (17) the task of management is to choose an acceptable management method
that maximizes efficiency Ф  Bq , q  max . The value of operational influence can be
determined by following expression:</p>
      <p>Di   f  ik  xik  xik 1,
where f  ik   is a function (table or algorithm), that reflects the difference in scores
xik  xik1  in the amount of operational influence, for example, the volume and
number of compromising newspaper articles or news releases on the TV channel.
If xik  xik1 , then Di  f  ik  xik 1  xik . The effectiveness l of influence El in
period  k is determined in different ways (18), in particular, by the following formula:
El  k   
 xlk 1  xlk
 wxllkk  wxlklk11 , if (wlk  wlk 1)  ( xlk  xlk 1)
 wlk 1  wlk , if (wlk 1  wlk )  (xlk 1  xlk )
,
(18)
where wlk is influence assessment in the period  k , xlk are the magnitudes (levels) of
the produced influence of l type in the period  k , l  1, L is influence type.
4</p>
      <p>Experimental Study and Discussion
The specialized experimental technique was developed for mentioned network-centric
approach and also implemented for quantitative assessment based on real examples in
social media sphere. In practice the task of destructive manipulative influence causes
changing opinions, views and behavior of focus groups. If primary assessment of  -th
focus group is   , then task of destructive manipulative influence is changing to

 +   ,   ∈   ,  ∈  , where   is changing of opinion and   is controlling
influence. As result of the sequence of manipulative influences the finishing opinion of
focus group is forming. Next by using expressions (17) – (18) the effectiveness of
influences can be calculated for all Internet mass media (see last stage of proposed
approach). Considering the network-centric concept involves data analyzing and
gathering from different regions for obtaining results on manipulative influences, it is
proposed to calculate the influence of the mass media and its efficiency as an average
of 3 Ukrainian regions for 4 Internet newspapers (named „Facty“, „Segodnya“,
„Komsomolska Pravda“ and „Dzerkalo tyzhnia“) and 3 manipulation methods
selected by experts in accordance to 7 Stage of proposed approach.</p>
      <p>The influence of selected mass media presented in Tabs. 1, 3, 5, 7; the effectiveness
of influence showed in Tabs. 2, 4, 6, 8 in accordance to (18). The value of operational
influence will be determined by the number of articles (using competent expert
estimation in this sphere).
These tables present the influence of different Internet mass media and the value of
manipulative influence on public opinion.</p>
      <p>In Fig. 1 graphically depicts the ratio of the value of operational influence, that is the
number of articles, to the value of the effectiveness of manipulative influence.
In accordance to Fig.1 can be declared that the biggest value of destructive
manipulative influence (with smallest operational influence) shows Internet mass media
“Facty” – when the number of articles is 2, the effectiveness of manipulative
influence is equal to 28%. For comparison another Internet mass media “Segodnya” shows
the effectiveness of manipulative influence equal to 14% with the number of articles
equal to 2. Experimental study has confirmed and demonstrated the developed
network-centric approach ability in practical cases for effective destructive manipulative
influence evaluation in social media.
5</p>
      <p>Conclusions
In this paper the network-centric approach to destructive manipulative influence
evaluation in social media was developed. This approach by means of evaluating financial
expenditures, defining goals, objectives and strategies for manipulating, selecting
Internet mass media and classified methods of manipulation, based on the generated
databases of causes, goals of the criteria, focus groups and mass media, allows
calculating the quantitative parameters that characterize the level of destructive
manipulative media influences on public opinion. Experimental study confirmed this approach
ability for quantity manipulative influence evaluation which realized by modern mass
media and using manipulation influence methods on personal or public opinion.
Given results will be useful in information security for evaluation harmful mass media
influence on public opinion or on consciousness individuals. In the next research, it is
going to conduct an experimental study of the developed method for its verification,
correctness confirmation, as well as the establishment of the practical application
possibility for raising the information and psychological security level of citizens,
society and the state in cyberspace (for example it will be very actual and important in
critical information infrastructure of the state [13]). Also using this approach
specialized software tools can be developed for manipulative influence automatized
detection and quantitative evaluation.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Peleschyshyn</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holub</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Holub</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>The preliminary stage of the algorithm for detecting information and psychological manipulation in online communities</article-title>
          .
          <source>In 2018 IEEE Proceedings of 13th International Scientific and Technical Conference on Computer Sciences and Information Technologies</source>
          , pp.
          <fpage>24</fpage>
          -
          <lpage>32</lpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Fedushko</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Syerov</surname>
            ,
            <given-names>Yu.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Korzh</surname>
          </string-name>
          , R.:
          <article-title>Validation of the user accounts personal data of online academic community</article-title>
          . In: 13th International Conference “Modern Problems of Radio Engineering, Telecommunications and Computer Science”,
          <source>TCSET</source>
          <year>2016</year>
          , pp.
          <fpage>863</fpage>
          -
          <lpage>866</lpage>
          . Lviv-Slavske (
          <year>2016</year>
          ). DOI:
          <volume>10</volume>
          .1109/TCSET.
          <year>2016</year>
          .
          <volume>7452207</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Shiyan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Method of protecting a person from negative informational and psychological influence on the basis of activity typology</article-title>
          . Information security, №
          <volume>3</volume>
          (
          <issue>15</issue>
          ), pp.
          <fpage>92</fpage>
          -
          <lpage>99</lpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Gubanov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Novikov</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chkhartishvili</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Models of influence in social networks</article-title>
          .
          <source>Large-Scale Systems Control</source>
          , vol.
          <volume>27</volume>
          , pp.
          <fpage>205</fpage>
          -
          <lpage>281</lpage>
          (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Ryabyy</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hatyan</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bagatskуy</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The model of PR-impact detection by means of Internet mass-media</article-title>
          .
          <source>Ukrainian Scientific Journal of Information Security</source>
          , vol.
          <volume>21</volume>
          , issue 2, pp.
          <fpage>131</fpage>
          -
          <lpage>139</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Danik</given-names>
            <surname>Yu</surname>
          </string-name>
          .,
          <string-name>
            <surname>Hryschuk</surname>
            <given-names>R.</given-names>
          </string-name>
          , Gnatyuk S.:
          <article-title>Synergistic effects of information and cybernetic interaction in civil aviation</article-title>
          ,
          <source>Aviation</source>
          , vol.
          <volume>20</volume>
          , №3, рр.
          <fpage>137</fpage>
          -
          <lpage>144</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Tikhomirov</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kinash</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gnatyuk</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Trufanov</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          et al: Network Society: Aggregate Topological Models, Communications in Computer and Information Science. Verlag: Springer International Publ, vol.
          <volume>487</volume>
          , рр.
          <fpage>415</fpage>
          -
          <lpage>421</lpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Trahtengerts</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pashchenko</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Principles of Implementation and Estimation of Influence Factors in Network Centric Systems</article-title>
          .
          <source>In Proceedings of 2017 IEEE 11th International Conference on Application of Information and Communication Technologies</source>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Trach</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peleshchyshyn</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Development of directions tasks indicators of virtual community life cycle organization</article-title>
          .
          <source>In Proceedings of 2017 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies</source>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Fedushko</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Development of a software for computer-linguistic verification of sociodemographic profile of web-community member</article-title>
          .
          <source>Webology</source>
          <volume>11</volume>
          (
          <issue>2</issue>
          ), article
          <volume>126</volume>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Syerov</surname>
          </string-name>
          , Yu.,
          <string-name>
            <surname>Fedushko</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loboda</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          :
          <article-title>Determination of Development Scenarios of the Educational Web Forum</article-title>
          .
          <source>Proceedings of the XIth International Scientific and Technical Conference (CSIT</source>
          <year>2016</year>
          ). pp.
          <fpage>73</fpage>
          -
          <lpage>76</lpage>
          .
          <string-name>
            <surname>Lviv</surname>
          </string-name>
          (
          <year>2016</year>
          ). DOI:
          <volume>10</volume>
          .1109/STC-CSIT.
          <year>2016</year>
          .7589872
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Polishchuk</surname>
          </string-name>
          , Yu.,
          <string-name>
            <surname>Zhmurko</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Information-psychological security of society in the context of information warfare: monograph</article-title>
          . Akademia
          <string-name>
            <surname>Techniczno-Humanistyczna</surname>
          </string-name>
          , Bielsko-Biała, Poland. pp.
          <fpage>132</fpage>
          -
          <lpage>161</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Gnatyuk</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sydorenko</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aleksander</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Unified data model for defining state critical information infrastructure in civil aviation</article-title>
          ,
          <source>In Proceedings of the 2018 IEEE 9th International Conference on Dependable Systems, Services and Technologies</source>
          , Kyiv, Ukraine, May
          <volume>24</volume>
          -
          <issue>27</issue>
          , pp.
          <fpage>37</fpage>
          -
          <lpage>42</lpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>