<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>method determining integral risk indicators of regional socio-economic development</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Oleg I. Pursky</string-name>
          <email>Pursky_O@ukr.net</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tetiana V. Dubovyk</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Iryna O. Buchatska</string-name>
          <email>i.buchatska@knute.edu.ua</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Iryna S. Lutsenko</string-name>
          <email>lutsenkois0802@gmail.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hanna B. Danylchuk</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Kyiv National University of Trade and Economics</institution>
          ,
          <addr-line>19 Kioto Str., Kyiv, 02156</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”</institution>
          ,
          <addr-line>37 Peremohy Ave., Kyiv, 03056</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>The Bohdan Khmelnytsky National University of Cherkasy</institution>
          ,
          <addr-line>81 Shevchenko Blvd., Cherkasy, 18031</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2021</year>
      </pub-date>
      <fpage>26</fpage>
      <lpage>28</lpage>
      <abstract>
        <p>In this study, we present the computational method for risk assessment of the socio-economic development of regions. An attempt has been made to develop a method for the determination of integral risk indicators of socio-economic development based on the joint use of the methods of factor analysis and expert evaluation. This approach has increased the reliability of the calculations and made it possible to analyze the influence of socio-economic indicators on the risk level of socio-economic development. The integral risk indicator shows the efect of the inconsistency in the level of factor provision on the socio-economic development of the  -th region (district) in comparison with the general situation in the country (regions). The closer the value of integral risk indicator is to 1, the higher the level of risk in this region. Using Kyiv region districts as an example, the process of risk assessment for regional socio-economic development has been considered. The results obtained in this investigation demonstrate that the presented computational method solves the problem of formalization of risk assessment for the socio-economic development of regions.</p>
      </abstract>
      <kwd-group>
        <kwd>computational method</kwd>
        <kwd>risk assessment</kwd>
        <kwd>socio-economic development of regions</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The market today is functioning in a turbulent environment facing continuous change because
of hyper-competition, changing demands of customers, regulatory changes, and technological
advancement [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Modern world economic conditions, economic globalization, acceleration of
market development processes, information technologies, socio-political factors require public
LGOBE
(T. V. Dubovyk); https://knute.edu.ua/blog/read/?pid=43144&amp;uk (I. O. Buchatska);
https://kafedra.management.fmm.kpi.ua/test/?p=1260 (I. S. Lutsenko);
https://scholar.google.com.ua/citations?user=bfPE5scAAAAJ (H. B. Danylchuk)
© 2021 Copyright for this paper by its authors.
      </p>
      <p>CEUR
Workshop
Proceedings
htp:/ceur-ws.org
IS N1613-073</p>
      <p>
        CEUR Workshop Proceedings (CEUR-WS.org)
administration new approaches to the formation of socio-economic strategies, development
of adequate methodological solutions, and tools in the field of governance, especially it
concerns socio-economic development management of regions [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ]. Using modern information
technologies and new electronic communication channels significantly reduce costs related to
organization and support social activity and business, and the new possibilities allow re-designing
socio-economic development strategy at any moment [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In connection with the globalization
and the processes of post-industrial economy development, the efect of unpredictability appears
in the change of socio-economic systems state due to the increasing influence of economic
crises, suddenly emerging threats and risks [
        <xref ref-type="bibr" rid="ref5 ref6 ref7 ref8 ref9">5, 6, 7, 8, 9</xref>
        ]. One of the urgent problems in the risk
analysis of socio-economic systems is the construction of adequate methods. This is due to the
multidimensionality of socio-economic systems, the stochasticity of their behavior, as well as
the complex interaction between the elements of the systems [
        <xref ref-type="bibr" rid="ref6 ref8">6, 8</xref>
        ].
      </p>
      <p>
        In socio-economic studies, to improve the reliability of the procedure for assess-ment of
socio-economic development using mechanism for determining the integral indicators based
on factor analysis, taking into account consider the knowledge and experience of experts
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Accordingly, the aim of this study is to develop a reliable computational method for risk
assessment of regional socio-economic development on the basis of the joint use of the methods
of factor analysis and expert evaluation [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. This article poses and solves the problem of
formalization of risk assessment for regional socio-economic development with the Kyiv region
districts as an example.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Computational method of risk assessment</title>
      <p>
        This section presents a method for determining the integral risk indicator of regional
socioeconomic development. The method is based on a model for determination of the socio-economic
development integral indicator which is described in detail in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. In this model, methods of
factor analysis and expert evaluations are used to determine integral indicators. To reducing
the dimension of the feature space (socio-economic indicators), one of the methods of factor
analysis is used [
        <xref ref-type="bibr" rid="ref12 ref13 ref14">12, 13, 14</xref>
        ], the principal component analysis (PCA) [
        <xref ref-type="bibr" rid="ref15 ref16">15, 16</xref>
        ]. Based on the
reduced set of independent factors, a single integrated indicator is obtained, which combine all
these factors in the best way [
        <xref ref-type="bibr" rid="ref16">16, 17</xref>
        ]. The main disadvantage of factor analysis methods is the
reliability of the conclusions, in particular, in this model of determining the integral indicators
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], the weight of the factor is determined by the dispersion of initial indicators, which is not
always reliable in socio-economic studies, since in this case the importance of indicators for the
socio-economic system is not taken into account [
        <xref ref-type="bibr" rid="ref10">10, 17, 18</xref>
        ]. Therefore, within the framework
of this model, in order to increase the reliability of the algorithm for determining the integral
indicators based on factor analysis, expert evaluation procedures have been introduced in the
mechanism of determining the weight of the factors [
        <xref ref-type="bibr" rid="ref10">10, 19, 20</xref>
        ]. In this case, the generalized
weight of factors that takes into account both the weight of the factor, determined on the basis
of expert evaluations, and the weight of the factor determined statistically, can be obtained as
the weighted average of these two evaluations [
        <xref ref-type="bibr" rid="ref10">10, 21</xref>
        ]:
of the factor, respectively. Thus, the complex indicator of socio-economic development for  -th
region is calculated as the sum of factors with the corresponding weighted average weight
∑  are expert and statistical (factor analysis) weighted coeficients
where  is a number of factors;   is the value of the  -th factor for the  -th object (region).
Taking into account the proposed complex indicators of socio-economic development (2), the
value of the integral risk indicator  in the region can be calculated using the following formula
,
where   is the integral risk assessment for socio-economic development of  -th region;  
the numerical value of the complex indicator  in average in study regions;  is the number of
factors. In this formula (3), the risk assessment is calculated taking into account the average
value of the complex indicator
      </p>
      <p>for all regions and the number of factors. In this case, the risk
  varies in the range from 0 to 1. The integral indicator   shows the efect of the inconsistency
in the level of factor provision on the socio-economic development of the  -th region (district)
in comparison with the general situation in the country (regions). The closer the value of   is
to 1, the higher the level of risk in this region.
1 stage. The entering of values of indicators of socio-economic development and expert
evaluations in the form of the matrix of indicators and the matrix of expert evaluations of
indicators, followed by its normalization to a single scale of measurements.
2 stage. The calculation of the pairwise correlations matrix and determination of its eigenvalues
and eigenvectors.
3 stage. Obtaining a matrix of factors by multiplying the normalized matrix of indicators and the
matrix of eigenvectors, and normalization of factors and calculation of their variance.
4 stage. Determining the number of  factors included in the integral risk indicator (figure 1)
on the basis of eigenvalues of the matrix of pairwise correlations of indicators and
the given boundary value  dispersion of normalized indicators or in other words – a
sampling of the minimum number of factors with maximal eigenvalues   is made, the
sum values of which are not less than</p>
      <p>
        [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
development.
5 stage. Determining the relative contribution %(  ) of each of the  factors in the description
of the total dispersion of all  indicators as the ratio of the eigenvalue   of the factor  
to the total dispersion of the features, which is also equal to  :

∑   ≥ , %(
=1
 ) =   /∑   =   /
(4)
6 stage. The determination of the experts competence and calculation of Kendall’s coeficient
of concordance for evaluation of the consistency of their conclusions.
7 stage. The determination of weighting coeficients of factors (1) included in the integrated
indicators (2).
8 stage. The calculation of integral risk indicators of regional socio-economic development (3)
and the visualization of the results of data processing.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Risk assessment for regional socio-economic development of the Kyiv region districts</title>
      <p>In this section, we consider the process of risk assessment for regional socio-economic
development in accordance with the developed computation method for integral risk indicators
(figure 1) on the example of the Kyiv region districts. Listed in a single scale of measurements
and normalized values of socio-economic indicators of districts are presented in table 1.
According to the National State Statistics Service of Ukraine [24], one of the main indicators
that characterize the level regional socio-economic development are (table 1):
(P1) Number of cars per 1000 people;
(P2) Services rendered per unit of population, UAH;
(P3) Natural increase (reduction) of the population;
(P4) Registered unemployment rate;
(P5) Average monthly salary, UAH;
(P6) Provision of housing by the population,  2 per person;
(P7) The ratio of  2 of built housing to the population;
(P8) Preschool establishments per unit of population;
(P9) General educational institutions per unit of population;
(P10) Number of crimes per 1000 people;
(P11) Emissions of pollutants.</p>
      <p>It should be noted that the list of indicators, depending on the goals and objectives of the
risk assessing, may change, thereby changing its emphasis. Thus, for the Kyiv region we
have a matrix of initial socio-economic indicators in the size of 25 × 11 (25 districts of the Kyiv
region: Baryshivsky (D1), Bilotserkivsky (D2), Boguslavsky (D3), Boryspilsky (D4), Borodyansky
(D5), Brovarsky (D6), Vasylkivsky (D7), Vyshgorod (D8), Volodarsky (D9), Zgurivsky (D10),
Ivankivsky (D11), Kagarlytsky (D12), Kyiv-Sviatoshynsky (13), Makarivsky (D14), Myronivsky
(D15), Obukhovsky (D16), Perejaslav-Khmelnytsky (D17), Polissya (D18), Rokytnyansky (D19),
Skvyrsky (D20), Stavyshchensky (D21), Tarashchansky (D22), Tetiivsky (D23), Fastivsky (D24),
Yahotynsky (D25)).</p>
      <p>On the basis of the normalized matrix of socio-economic indicators (table 1), the pairwise
correlations matrix of indicators is dimensioned 11 × 11. For the pairwise correlations matrix of
indicators, we determine eigenvalues  (table 2) and eigenvectors X. The matrix of factors 
is obtained by multiplying the normalized matrix of socio-economic indicators (table 1) into
the matrix of the eigenvectors of the pairwise correlations matrix. The obtained factors are
normalized. The normalized factor matrix is used to calculate the matrix of correlations between
factors and indicators of socio-economic development that is required for the interpretation of
factors.
the given threshold  of the dispersion for normalized socioeconomic indicators (table 1), the
formula (4) determines the number of  factors in the integral risk indicator. In this case,
the number of main components (factors) must be used, which exhaust at least 60-70% of the
variance of the initial random variables. For example, at a given threshold of 0,6 from table 2 it
is necessary to select  factors with maximal eigenvalues, the sum of values of which is not
less than 0, 6 × 11 = 6,6. The sum of the first three eigenvalues  is 7,49 that is the integral index
consists of the first three factors (  = 3) that explain approximately 68% (see formula 4) of the
variance of the initial data (table 2). The calculate matrix of correlations between the normalized
socio-economic indicators and the factors shows, which indicators are included in the given
three factors (with the value of the variance of the indicators should not be less than the given
limit value of 0,6). Table 3 shows the structure of factors: the coeficient of correlation between
the indicators and factors in which they are included, statistical and expert weights coeficients
and weighted average weight coeficient of factors. The first factor included the first four
indicators: 1) the number of cars per 1000 people; 2) services rendered per unit of population;
3) natural increase (reduction) of the population; 4) the level of registered unemployment. The
second factor included the eleventh indicator – emissions of pollutants. The third factor entered
the seventh indicator – the ratio  2 of the built housing to the population.</p>
      <p>
        By multiplying the obtained factors by the corresponding weighted average weight coeficients
of factors, by formula (2) we obtain the values of integral risk indicators according to formula (3)
that allow ranking the regions in terms of their risk assessment of socio-economic development
(figure 2). In table 4 calculations results of integral risk indicators   of social and economic
development of Kyiv region districts are presented. It is also worth noting that for a better
understanding of the calculation procedures should be carefully study the model that presented
in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusions</title>
      <p>The obtained results demonstrate that the presented computational method solves the problem of
formalization of risk assessment for the socio-economic development and can be used to analyze
and predict the socio-economic situation in the region. In the framework of the presented
method by changing the values of socio-economic indicators, it is possible to analyze and model
the socio-economic situation in the region, which undoubtedly provides management with
valuable information on possible risks and directions of efective strategies for socio-economic
development. The management receives not only an adequate assessment of the risk level of
socio-economic development of the region, but also the opportunity to determine the immediate
causes and consequences that shape the current and future socio-economic situation in the
region. The results of modeling the process of assessing the level of socio-economic development
of Kyiv region showed that the main advantages of the method of determining the integrated
risk indicators are the possibility of studying correlations between socio-economic indicators,
between indicators and factors, interpretation of factors, determining negative and positive
characteristics of socio-economic situations in context of research objects. The proposed method
for risk assessment makes it possible to implement a unified approach to data analysis and to
ensure the eficiency of constructing integral risk indicators.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>This study was supported by the Ministry of Education and Science of Ukraine, Project
No. 0112U000635, “Development and implementation of the modern information systems
and technologies in the socio-economic activities”.
[17] G. Di Franco, A. Marradi, Factor analysis and principal component analysis, FrancoAngeli,
2013.
[18] W. H. Finch, Exploratory factor analysis, SAGE Publications, 2019.
[19] S. Farhady, Expert Evaluation Game Factors, LAP Lambert Academic Publishing, 2013.
[20] J. J. Phillips, P. P. Phillips, Handbook of training evaluation and measurement methods,</p>
      <p>Routledge, 2016.
[21] L. Ustinovieius, Determining integrated weights of attributes, Journal of Civil Engineering
and Management 7 (2001) 321–326. doi:10.3846/13921525.2001.10531743.
[22] M. Rausand, S. Haugen, Risk Assessment: Theory, Methods, and Applications (Statistics in</p>
      <p>Practice), Wiley, 2020.
[23] A. A. Kuklin, M. S. Pecherkina, A. N. Tyrsin, A. A. Surina, Methodological tools for the
detection of risks to the welfare of the individuals and the territory of residence, Economy
of Region 13 (2017) 1030–1043. doi:10.17059/2017- 4- 5.
[24] Statistical yearbook of Ukraine for 2017, 2017.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Raman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bharadwaj</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Mukherjee</surname>
          </string-name>
          ,
          <article-title>Developing SOA-enabled service agility capabilities: case studies in services industry</article-title>
          ,
          <source>International Journal Business Information Systems</source>
          <volume>27</volume>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>S.</given-names>
            <surname>Belew</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Elad</surname>
          </string-name>
          ,
          <article-title>Starting an Online Business All-in-One for Dummies</article-title>
          , 3rd ed.,
          <string-name>
            <surname>For</surname>
            <given-names>Dummies</given-names>
          </string-name>
          , New Jersey,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>O.</given-names>
            <surname>Pursky</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Dubovyk</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Moroz</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Buchatska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Savchuk</surname>
          </string-name>
          ,
          <article-title>The price competition simulation at the blended trading market</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          <volume>2422</volume>
          (
          <year>2019</year>
          )
          <fpage>15</fpage>
          -
          <lpage>26</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>O. I.</given-names>
            <surname>Pursky</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. V.</given-names>
            <surname>Grynyuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. A.</given-names>
            <surname>Shestopal</surname>
          </string-name>
          ,
          <article-title>Planning of advertising costs and vendor number at e-trade market, Aktual'ni Problemy Ekonomiky = Actual Problems in Economics (</article-title>
          <year>2016</year>
          )
          <fpage>407</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>D.</given-names>
            <surname>Chernov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Sornette</surname>
          </string-name>
          ,
          <article-title>Critical risks of diferent economic sectors</article-title>
          , Springer,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>K.</given-names>
            <surname>Pitilakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Franchin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Khazai</surname>
          </string-name>
          , H. Wenzel, SYNER-G:
          <article-title>systemic seismic vulnerability and risk assessment of complex urban, utility, lifeline systems and critical facilities: methodology and applications</article-title>
          , volume
          <volume>31</volume>
          , Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M.</given-names>
            <surname>Machina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. K.</given-names>
            <surname>Viscusi</surname>
          </string-name>
          ,
          <article-title>Handbook of the Economics of Risk and Uncertainty</article-title>
          , North Holland, Amsterdam,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>S.</given-names>
            <surname>Ashmarina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Vochozka</surname>
          </string-name>
          ,
          <source>Sustainable Growth and Development of Economic Systems</source>
          , Springer,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>H.</given-names>
            <surname>Danylchuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Kibalnyk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Serdiuk</surname>
          </string-name>
          ,
          <article-title>Critical phenomena study in economic systems using a damped oscillations model</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          <volume>2224</volume>
          (
          <year>2019</year>
          )
          <fpage>211</fpage>
          -
          <lpage>225</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>O.</given-names>
            <surname>Pursky</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Dubovyk</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Gamova</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Buchatska</surname>
          </string-name>
          ,
          <article-title>Computation algorithm for integral indicator of socio-economic development</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          <volume>2393</volume>
          (
          <year>2019</year>
          )
          <fpage>919</fpage>
          -
          <lpage>934</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>O.</given-names>
            <surname>Pursky</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Dubovyk</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Buchatska</surname>
          </string-name>
          , I. Lutsenko,
          <string-name>
            <given-names>H.</given-names>
            <surname>Danylchuk</surname>
          </string-name>
          ,
          <article-title>Computational method for risk assessment of regional socio-economic development</article-title>
          ,
          <source>SHS Web of Conferences</source>
          <volume>107</volume>
          (
          <year>2021</year>
          )
          <article-title>10001</article-title>
          . doi:
          <volume>10</volume>
          .1051/shsconf/202110710001.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>K.</given-names>
            <surname>Adachi</surname>
          </string-name>
          ,
          <article-title>Matrix-based introduction to multivariate data analysis</article-title>
          , Springer,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>K. A.</given-names>
            <surname>Pituch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. P.</given-names>
            <surname>Stevens</surname>
          </string-name>
          ,
          <article-title>Applied multivariate statistics for the social sciences: Analyses with SAS</article-title>
          and
          <string-name>
            <surname>IBM's</surname>
            <given-names>SPSS</given-names>
          </string-name>
          , Routledge,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>K.</given-names>
            <surname>Vehkalahti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. S.</given-names>
            <surname>Everitt</surname>
          </string-name>
          ,
          <article-title>Multivariate analysis for the behavioral sciences</article-title>
          , CRC Press,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>V.</given-names>
            <surname>Gray</surname>
          </string-name>
          ,
          <source>Principal Component Analysis: Methods, Applications and Technology, Nova Science Pub</source>
          . Inc.,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>S.</given-names>
            <surname>Okafor</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Okafor</surname>
          </string-name>
          ,
          <source>Factor Analysis in Economics: Theory and Applications</source>
          , LAP Lambert Academic Publishing,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>