<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Organizational resilience. Cost optimization approaches</article-title>
      </title-group>
      <fpage>2</fpage>
      <lpage>7</lpage>
      <abstract>
        <p>The article considers the possibility of applying the theoretical concept of resilience to the optimization of activities to improve the resilience of organizations. For this purpose, various approaches to the concept of resilience and its practical implementation are analyzed. The generalizing point for these approaches is the understanding of resilience as the degree of readiness to respond adequately to unforeseen events and circumstances. Thus for organizations, resilience is cognate to risk management. In order to optimize costs, the analysis of the relation between these types of activities was carried out. Based on the definition of resilience as a component of risk management, a multi-level approach to optimizing the cost of improving the resilience of organizations is proposed. In this approach, the most effective measures to improve resilience are selected end-to-end, while increasing the scope of the task consistently: from the level of specific activities to the analysis of interactions between organizations. This reduces the impact of uncertainty on risk-based decisions by maximizing consideration of factors and boundary conditions.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Recent examples of natural, man-made, and
humanitarian disasters have revealed a lack of readiness of
companies to deal with unforeseen threats of a serious scale.
"Black swans", that is, catastrophic events difficult to
predict, from a rare phenomenon passed into the category
of quite probable. In such circumstances, traditional risk
management methods focused on a thorough threat analysis
and based on the extrapolation of retrospective assessments
and expert assessments representing a generation of a more
stable period will no longer work. This does not allow
companies to develop adequate responses to sudden shocks,
which often leads to significant losses.</p>
      <p>To solve this problem, organizations must develop the
ability to withstand an emergency and recover from a
failure. This is the goal of the concept of resilience, which
has recently become one of the most frequently used in
various disciplines when considering sustainable
development issues.</p>
      <p>The main purpose of the work is to study the
possibility of applying the theoretical concept of resilience
to optimize the activities aimed to improve the resilience
of organizations. The first section provides the basic
concept of organizational resilience. In the second section,
resilience is considered in the context of risk management
activities. In the third paragraph, a multi-level approach to
optimizing the cost of improving the viability of
organizations is proposed.</p>
    </sec>
    <sec id="sec-2">
      <title>Organizational resilience</title>
      <p>
        The term resilience or stress resistance in Russian
translation was used by scientists, starting with Seneca and
Cicero, then Bacon and others in the middle ages,
gradually becoming more universal and relevant over time
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In the modern context, the use of the term in relation
to ecosystems was initiated by the work of Halling [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],
who defined resilience as the ability of an ecosystem to
independently maintain and restore the level of basic
relationships in it by absorbing shocks and fluctuations in
the parameters of external or internal influence. In the last
decade, the concept of resilience has played an
increasingly important role in the development of political
solutions, in addressing environmental, technical and
social issues. Despite the wide cross-disciplinary scope of
use, to date it has not developed a common understanding
of the term [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. However, by now it is possible to
distinguish the main approaches that can be used as a basis
for working on the resilience of organizations.
      </p>
      <p>
        The Latin word “resilio", passed into English as
“resilience” in the sense of “bounce back, go back”. It is
in this sense that resilience is understood in the first
approach – the ability of the system to return to its original
position after being out of balance. At the same time,
resilient species overcome adverse external influences at
the expense of internal resources [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. This static approach
to resilience is used in ISO 22313 [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        The second approach understands resilience as the
ability of a system to adapt to stressful events without
necessarily returning to its original state. The main
disadvantage of such adaptability in socio-ecological
systems, as noted by A. Hornborg [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], is the fact that
poststress equilibrium is likely to assume the oppression of the
natural system, since the significance of social systems for
decision-makers is higher.
      </p>
      <p>
        D. Chandler [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] proposed the third, so-called dynamic
approach. It defines resilience as "an emerging and
adaptive process of subject-object relationships". Chandler
explains "the subject does not survive solely because of its
internal resources, but survives and thrives because of its
ability to adapt or interact dynamically with the
socioecological environment."
      </p>
      <p>
        The definition of resilience, which summarizes all
these approaches, is used in the UN Strategy for disaster
risk reduction [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]: “The ability of a system, community or
society exposed to hazards to resist, absorb, accommodate
to and recover from the effects of a hazard in a timely and
efficient manner, including through the preservation and
restoration of its essential basic structures and functions”.
      </p>
      <p>
        One of the important areas of research on resilience is
organizational resilience. Here, as in the mainstream of
research, there is a high degree of activity of researchers
with many different approaches to the subject. M.
Linnenluetske [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] traces the development of the concept of
"organizational resilience" from the ability to resist
external influences in the 1980s, the understanding of
resilience as reliability in the 1990s, to strategies for
working with staff, the adaptability of business models and
the stability of supply chains in the 2010s.
      </p>
      <p>
        L. Hiao, and H. Cao [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] note that the fundamental
difference between organizational resilience and
adaptability, flexibility, reliability, etc. is that the
resilience of the organization is understood not only as the
ability of the organization to respond, but also to develop
in a state of uncertainty, interruptions and emergencies. In
addition, the same researchers suggest a multi-level
approach to considering the sustainability of the
organization from the individual level (personnel), to the
level of divisions and the entire organization, and also note
the importance of transit relations between these levels.
      </p>
      <p>
        A large number of studies have been devoted to the
development of indicators for determining the level of
resilience of companies [
        <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
        ]. M. Bruno et al. [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] define
four aspects of resilience that are of interest for seismic
events: technical, organizational, social and economic.
The following characteristics are proposed for assessing
the seismic stability of systems: robustness, redundancy
and diversification, entrepreneurship, and efficiency.
These characteristics are quite universal relative to the
application area.
      </p>
      <p>
        J. Park et al. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] consider resilience as a cyclical or, as
they write, recursive process, in which it is important to
pass the following main stages of information processing
and development of adaptation measures: sensing,
anticipation, adaptation, learning.
      </p>
      <p>
        I. Linkov et al. [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] identify and apply [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] four jointly
exhaustive components of any complex system: physical,
informational, cognitive, and social.
      </p>
      <p>
        As a result of their combination with the process of
resilience, the authors obtained [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] the so-called
resilience matrix, which takes into account the quality of
each of the selected vital components of the system for
each of the processes of ensuring resilience (Table 1) [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
Prepare
      </p>
      <p>The use of the matrix does not imply the use of certain
quantitative estimates, but allows you to get a
comprehensive view of the system's readiness for shocks
and to identify weaknesses that require priority study.</p>
      <p>
        The work [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] proposes a methodology for quantifying
the system's resilience based on the concept of critical
functionality, which is the minimum necessary set of
functions during a crisis.
      </p>
      <p>
        Companies that are active users of natural resources
can use approaches to assess so-called "sustainable
resilience" [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>Thus, at the moment, there are a number of approaches
to assessing the current level of resilience of an
organization, from which you can choose the most
appropriate to the context of the organization's activities
and the required accuracy of analysis. Based on the results
obtained from such assessment, it is possible to plan
further steps to improve the level of preparedness of
organizations to respond to unexpected stressors.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Resilience and risk management</title>
      <p>When implementing the concept of resilience in
companies, it is necessary to understand that this activity
does not replace the need for existing risk management
practices. Resilience can be either an independent line of
work or a complementary function in relation to risk
management. To successfully combine these practices, it
is necessary to clearly understand the difference between
their main goals and methods.</p>
      <p>The main difference between the two approaches is
that risk management is aimed at identifying and
neutralizing risks that can cause unacceptable deviations
of the company's indicators from the planned ones. At the
same time, resilience is designed to respond to unknown
threats, and in the process of responding, the original
targets can be changed in accordance with changed
circumstances.</p>
      <p>
        The risk management process, as presented in the most
popular ISO 31000(2018) [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] standard, is represented by
a cycle of the following stages: scope and criteria - risk
assessment - risk treatment - monitoring and control –
documentation. As risk management has moved into the
management area from the technical one, which was used
for the risk analysis of dangerous objects, it has adopted
the characteristics of probabilistic safety analysis of
technical objects. This approach is used most extensively
in the nuclear power industry, due to the severity of the
consequences. It allows to assess the possible size of
nuclear damage, taking into account the probabilities, and
to organize the safety management of a nuclear facility by
developing recommendations for improving safety
(reducing risk) based on the results of risk assessments.
Conducting such an analysis allows, on the one hand, to
ensure a given level of security of nuclear facilities, and on
the other hand, to optimize the size of investments in
security. A characteristic feature of risk management
approaches from the point of view of the nuclear industry
practice is that even such a deep approach to the study of
the safety issue could not completely exclude major
nuclear accidents. So, since the publication of the WASH
-1400 report [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], released in 1975 shortly before the
accident at the Three Mile Island nuclear power plant,
none of the major accidents (Three Mile Island,
Chernobyl, Fukushima) has exactly followed a
prepredicted scenario. The largest accidents were caused by a
combination of unforeseen events.
      </p>
      <p>
        Given the fact that risk management based on the
identification and analysis of risks cannot completely
exclude the occurrence of unforeseen events, and their
frequency has been objectively increasing in recent years,
the resilience approach, which consists in organizing the
company's actions in the event of unforeseen events, is the
missing link in the risk management activity. J. Park et al.
[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] cite the article by Marais et al.: “It is not necessary to
predict all potential causes of a ship sinking in order to
provide life boats and other emergency measures“. In the
same paper, the authors [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] provide a comparative table
of risk management and resilience approaches. In addition
to the differences in goals already mentioned above, there
are differences in design strategies, analysis models, and
attitudes to sustainable development. There is a significant
difference in the mechanism for coordinating response
measures: while risk management methods provide for
centralized execution of emergency response plans,
resilience methods provide more "bottom-up" initiative
depending on the specific situation.
      </p>
      <p>
        To explain the differences between the scope of
classical risk management and resilience, we provide a
graphical explanation in Fig.1. At time T1, classical risk
management methods can be used to extrapolate current
knowledge of possible risk (direct V1 = f1(T1)). However,
due to the inertia of human thinking and the methods used,
there has recently been a gap between the rate of increase
of vulnerability V=f(T) from the area of assessed risks (the
area under the line V1 = f1(T1), highlighted in Fig.1.).
Therefore, at time T2, there remains a risk area that is not
covered by risk management activities. It is precisely to
close this gap that the company's resilience is being
developed. And the higher the growth dynamics of risk
exposure is, the higher the significance of activities for the
development of resilience.
Working to improve the resilience of companies shifts
the focus of risk management to strategic risks and
strategic assets. This is due to the fact that in the process
of responding to a stressful event, resilience does not
exclude modifications of the main process, the loss of
individual components of the system, and other changes.
In the work [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], this approach is called "hard resilience",
in contrast to "soft resilience", which assumes full
restoration of the system's functionality after a failure.
      </p>
      <p>Thus, the concept of resilience can be considered as an
element of risk management activities with due
consideration of the identified differences and the
development of boundary conditions. With high dynamics
of changes in the quality and level of risks, such activities
can significantly compensate for the inertia of traditional
risk management approaches.</p>
    </sec>
    <sec id="sec-4">
      <title>Optimizing the cost of resilience</title>
      <p>
        As with any other investment decision, companies
need a tool to analyze possible alternatives and choose the
best solution to improve their resilience. However,
investments in risk management measures and resilience
have a number of significant differences from commercial
investment projects. The main difference is that the
assessment of the effect of such activities is based on
probabilistic estimates of events that are not fully
understood. This can cause difficulties in making a priori
decisions. For any organization, making a wrong decision
about the level of resilience in an uncertain environment
can lead to the following adverse consequences [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]:
• "insufficient countermeasures can lead to incidents
with significant losses;
• over-investment in security can reduce the
organization's performance."
      </p>
      <p>To reduce uncertainty and maximize consideration of
all factors associated with increased resilience, we perform
a cost-effectiveness analysis at four levels (fig. 2).
This approach will allow to identify the most effective
measures at each level, from which the most relevant for
the organization could be selected.</p>
      <p>
        At the first level of analysis, we will highlight the
measures that are most effective in reducing losses after
incidents. As known, it is better to prevent a fire than to
extinguish it. And the effective cost of resilience has a rule
of leverage – relatively small costs at the preparatory stage
give a huge effect in the case of risk realization. For
example, an analysis of many projects aimed at reducing
the risk of natural disasters has shown that the vast
majority of them were profitable in terms of a posteriori
cost-benefit analysis [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].
      </p>
      <p>In the general case, the cost effectiveness of the
resilience Еres could be determined by the ratio of areas
ΔSloss/Sres (Fig. 3).
where ΔSloss - reduction in incident response costs; Sres –
costs for improving resilience.
At the second level, we will consider the impact of
costs of resilience as part of the risk management
activities. To do this, we use the total cost of risk (TCR)
indicator, which takes into account the entire amount of
possible costs associated with risks. This indicator is often
used to optimize risk management and insurance
measures. The total cost of the TCR risk is determined by
the sum of the following components:</p>
      <p>TCR = Cret + Cins + Crm → min
where Cret - capital reserve for self coverage of expected
and unforeseen losses; Cins –insurance premium; Crm -
noninsurance costs.</p>
      <p>Non-insurance costs will consist of two components:
risk reduction costs (Crisk) and resilience costs (Cres): Crm=
Crisk+ Cres, then</p>
      <p>TCR = Cret + Cins + (Crisk + Cres ) .</p>
      <p>
        To minimize the total cost of risk, we select such types
of investments in resilience Cres that will minimize the
amount of the contingency reserve for Cret, which will also
have a positive impact on the size insurance premium Cins,
and can also theoretically reduce the estimate of the
expected loss. Taking into account the identified
correlations between the total cost of risk and resilience,
as well as working to strengthen the positive relationships
between TCR components, can lead to a very noticeable
synergistic effect. One of the successful examples of such
joint activities is the extinguishing of the fire in the
NotreDame Cathedral on April 15, 2019. Thanks to emergency
response plans developed jointly with insurance
companies and coordinated with firefighters, it was
possible to save most of the relics and art objects stored in
the Cathedral [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ].
      </p>
      <p>
        At the same level, the entire risk management process
is coordinated to determine the resilience project's scope
in terms of boundary values. In this sense, it is useful to
use experience from high-risk industries that have
accumulated some experience of planning activities in
conditions of uncertainty. Thus, the International
Commission on Radiation Protection (ICRP) introduces
the following principles of radiation protection [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]:
• the principle of justification;
• the principle of optimizing protection;
• the principle of using dose limits.
      </p>
      <p>In this approach, the ALARA (as low as reasonably
achievable) principle of protection optimization is applied
exclusively in the area of compliance with the required
levels of collective and individual risk (dose limits), and
only for activities whose estimated benefit significantly
exceeds the possible harm (justification principle). If the
organization has and is fulfilling certain security
requirements (for example, industrial or information
security), then it is necessary to use the amount of work
that has already been done, thereby minimizing the cost of
increasing the level of resilience.</p>
      <p>
        In addition to the limits of the optimization area, other
possible strategies must be considered [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] since
minimizing the total cost of risk is not always the best
option. While minimizing the total cost of risk, today's real
costs are added to the hypothetical losses of tomorrow. At
the same time, the optimal solution has a strong
dependence on the quality of risk assessments. The cost
criterion may not always be dominant when making
decisions. For example, for enterprises with critical
infrastructure, the main criterion may be the duration of
the predicted business interruption. Taking into account all
possible restrictions and alternatives will allow you to
make the most informed decision about the possibilities of
reducing the risk.
      </p>
      <p>
        At the third level, we will consider applying the
costbenefit analysis to the entire organization. At the same
time, both the scope of the problem and the number of
stakeholders increase significantly. Therefore, before
performing such an analysis, it is recommended to
determine [
        <xref ref-type="bibr" rid="ref25 ref26">25, 26</xref>
        ]: the goals of the analysis, the time
interval, the discount rate, the stakeholders, and the
required amount of information.
      </p>
      <p>Careful analysis of the source data for the calculation
is important for two reasons. On the one hand, the
calculation of financial indicators, such as the benefit/cost
ratio or NPV (Net Present Value), is one of the reference
points for making a decision. On the other hand, financial
estimates cannot be the only decision-making tool due to
the inaccuracy of the initial data. Therefore, all structured
information about existing alternatives, assumptions, and
limitations is essential for making a decision.</p>
      <p>For example, when evaluating the key parameter of the
analysis - the discount rate, you need to find a balance
between the desire to get returns as quickly as possible
(high rate) and take into account as many potential
stressors as possible, sometimes with a long horizon of
manifestation (low rate).</p>
      <p>For public companies, it is important to take into
account the views of shareholders. As the practice of large
losses shows, the success of the company in the process of
responding to an incident affects the share price. In the
case of unsuccessful measures, the yield of shares falls,
and, conversely, shows an excess of the estimated yield in
case of successful countermeasures.</p>
      <p>The fourth level of analysis involves considering the
possibilities of interaction between different organizations
in the event of incidents. Such an association is possible
on a territorial or professional basis. This can be a unified
response system, the creation of a mutual insurance
company, and so on. The development of joint pre-agreed
responses by various organizations can significantly
improve the effectiveness of investments in their
resilience.</p>
      <p>This multi-level approach to optimizing the
organizational resilience costs will help to determine the
required level of coverage and identify solutions that best
meet the organization's needs at the lowest cost.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions</title>
      <p>The analysis of theoretical approaches to the concept
of resilience allowed us to determine the place of activities
to improve the organizational resilience as a component of
risk management. This positioning of resilience allows to
combine this activity with existing risk management
processes in the organization.</p>
      <p>The proposed multi-level approach to optimizing the
cost of resilience reduces the level of uncertainty in
making decisions based on risk assessments by taking into
account factors and limitations as much as possible.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>The study was supported by the RFBR, grant №
19-0700455</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Alexander</surname>
            <given-names>D.E.</given-names>
          </string-name>
          <article-title>Resilience and disaster risk reduction: an etymological journey</article-title>
          .
          <source>Nat. Hazards Earth Syst. Sci</source>
          .
          <year>2013</year>
          г.,
          <source>Т</source>
          .
          <volume>13</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Holling</surname>
            <given-names>C.S. Resilience</given-names>
          </string-name>
          <article-title>and stability of ecological systems</article-title>
          .
          <source>Ann.Rev. Ecol. Syst</source>
          .
          <year>1973</year>
          г.,
          <source>Т. 4.</source>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Chandler</surname>
            <given-names>D.</given-names>
          </string-name>
          <article-title>Resilience: The governance of complexity</article-title>
          . N.Y: Routledge.,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <source>[4] ISO 22313:2020 Security and resilience - Business continuity management systems - Guidance on the use of ISO 22301.</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Hornborg</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <article-title>Zero-sum world: challenges in conceptualizing environmental load displacement and ecologically unequal exchange in the world-</article-title>
          <source>System. Int. J. Comp. Sociol</source>
          .
          <year>2009</year>
          г.,
          <volume>50</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>UNISDR.</surname>
          </string-name>
          <article-title>Terminology on Disaster Risk Reduction</article-title>
          . United Nations.
          <article-title>United Nations International Strategy for Disaster Risk Reduction</article-title>
          . Geneva.: б.н.,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Linnenluecke</surname>
            <given-names>M.K.</given-names>
          </string-name>
          <article-title>Resilience in business and management research: A review of influential publications and a research agenda</article-title>
          .
          <source>International Journal of Management Reviews</source>
          .
          <year>2017</year>
          г.,
          <source>Т. 19.1.</source>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>XIAO L.</given-names>
            ,
            <surname>CAO H. Organizational</surname>
          </string-name>
          <article-title>Resilience: The Theoretical Model and Research Implication</article-title>
          .
          <source>ITM Web of Conferences</source>
          .
          <year>2017</year>
          г.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Rose</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krausmann</surname>
            <given-names>E.</given-names>
          </string-name>
          <article-title>An economic framework for the development of a resilience index for business recovery</article-title>
          .
          <source>International Journal of Disaster Risk Reduction. Elsevier.</source>
          ,
          <year>2013</year>
          г.,
          <source>Т. 5.</source>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Lengnick-Hall</surname>
            <given-names>C. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beck</surname>
            <given-names>T. E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lengnick-Hall</surname>
          </string-name>
          .
          <article-title>Developing a capacity for organizational resilience through strategic human resource management</article-title>
          .
          <source>Human Resource Management Review</source>
          .
          <year>2011</year>
          г.,
          <source>Т</source>
          .
          <volume>21</volume>
          , 3.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Bruneau</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chang</surname>
            <given-names>S.E.</given-names>
          </string-name>
          et. al.
          <article-title>A Framework to Quantitatively Assess and Enhance the Seismic Resilience of Communities</article-title>
          . Earthquake Spectra. Earthquake Engineering Research Institute.,
          <year>2003</year>
          г.,
          <source>Т</source>
          .
          <volume>19</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Park</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seager</surname>
            <given-names>T.</given-names>
          </string-name>
          , et. al.
          <article-title>Integrating Risk and Resilience Approaches to Catastrophe Management in Engineering Systems</article-title>
          .
          <source>Risk Analysis</source>
          .
          <year>2013</year>
          г.,
          <source>Т</source>
          .
          <volume>33</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Linkov</surname>
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Trump</surname>
            <given-names>B.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hynes</surname>
            <given-names>W.</given-names>
          </string-name>
          <article-title>Resilience-based Strategies and Policies to Address Systemic Risks</article-title>
          . SG/NAEC.
          <article-title>Organisation for Economic Co-operation and Development</article-title>
          .,
          <year>2019</year>
          г.,
          <source>Т. 5.</source>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Eisenberg</surname>
            <given-names>D.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Linkov</surname>
            <given-names>I.</given-names>
          </string-name>
          , Park J.,
          <string-name>
            <surname>Bates</surname>
            <given-names>M.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>FoxLent</surname>
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seager</surname>
            <given-names>T.P.</given-names>
          </string-name>
          <string-name>
            <surname>Resilience</surname>
          </string-name>
          <article-title>Metrics: Lessons from Military Doctrines. Solutions for a sustainable and desirable future</article-title>
          .
          <year>2014</year>
          г.,
          <source>Т. 5</source>
          ,
          <issue>5</issue>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Ganin</surname>
            <given-names>A.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Massaro</surname>
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gutfraind</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Steen</surname>
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Keisler</surname>
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kott</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mangoubi</surname>
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Linkov</surname>
            <given-names>I.</given-names>
          </string-name>
          <article-title>Operational resilience: concepts, design and analysis</article-title>
          .
          <source>Scientific reports</source>
          .
          <year>2016</year>
          г.,
          <source>PMC4726063.</source>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Gillespie-Marthaler</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nelson</surname>
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baroud</surname>
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abkowitz</surname>
            <given-names>M. Selecting</given-names>
          </string-name>
          <article-title>Indicators for Assessing Community Sustainable Resilience</article-title>
          .
          <source>Risk Analysis</source>
          .
          <year>2019</year>
          г.,
          <source>Т</source>
          .
          <volume>39</volume>
          ,
          <fpage>11</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <source>[17] ISO</source>
          <volume>31000</volume>
          :
          <string-name>
            <surname>2018 (E).</surname>
          </string-name>
          <article-title>Second edition</article-title>
          . Risk management - Guidelines.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18] NUREG-
          <volume>75</volume>
          /014. WASH-1400
          <source>The Reactor Safety Study</source>
          .
          <article-title>The Introduction of Risk Assessment to the Regulation of Nuclear Reactors</article-title>
          . Manuscript Completed:
          <article-title>August 2016 Date Published: August 2016</article-title>
          . Prepared by:
          <source>Reynold Bartel</source>
          .
          <volume>60</volume>
          p.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Proag</surname>
            <given-names>V.</given-names>
          </string-name>
          <article-title>The concept of vulnerability and resilience</article-title>
          .
          <source>ScienceDirect</source>
          . Elsevier.,
          <year>2014</year>
          г.,
          <source>Т</source>
          .
          <volume>18</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Białas</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <article-title>Cost-benefits aspects in risk-management</article-title>
          .
          <source>Polish Journal of Management Studies</source>
          .
          <year>2016</year>
          , Т.
          <volume>13</volume>
          , 1.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Hugenbusch</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Neumann</surname>
            <given-names>T</given-names>
          </string-name>
          .
          <article-title>Cost-Benefit analysis of disaster risk reduction</article-title>
          .
          <source>Executive Summary</source>
          . б.м. : Aktion Deutschland Hilft e.V.,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22] https://www.insurancebusinessmag.com/uk/news/bre aking-news/
          <article-title>revealed-civil-liability-insurer-of-twonotredame-</article-title>
          <string-name>
            <surname>de-</surname>
          </string-name>
          paris-contractors-
          <volume>165074</volume>
          .aspx
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>ICRP</surname>
          </string-name>
          ,
          <year>2007</year>
          .
          <article-title>The 2007 Recommendations of the International Commission on Radiological Protection</article-title>
          .
          <source>ICRP Publication 103. Ann. ICRP</source>
          <volume>37</volume>
          [
          <fpage>2</fpage>
          -
          <lpage>4</lpage>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>Sachenko</surname>
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Amelina</surname>
            <given-names>M.</given-names>
          </string-name>
          <article-title>Corporate insured strategies</article-title>
          . Moscow: Ankil,
          <year>2015</year>
          , 179 p.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Proag</surname>
            <given-names>S.-L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Proag</surname>
            <given-names>V.</given-names>
          </string-name>
          <article-title>The cost benefit analysis of providing resilience</article-title>
          .
          <source>Procedia Economics and Finance</source>
          .
          <year>2014</year>
          г.,
          <source>Т</source>
          .
          <volume>18</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Mechler</surname>
            <given-names>R.</given-names>
          </string-name>
          <year>and</year>
          . The Risk to Resilience Study Team.
          <article-title>The Cost-Benefit Analysis Methodology, From Risk to Resilience Working Paper No. 1</article-title>
          .
          <string-name>
            <surname>Kathmandu</surname>
            , Nepal: eds. Moench,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Caspari</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>A. Pokhrel</surname>
            ,
            <given-names>ISET</given-names>
          </string-name>
          ,
          <article-title>ISET-Nepal and ProVention</article-title>
          .,
          <year>2008</year>
          . Sachenko Larisa A.,
          <source>PhD.</source>
          ,
          <article-title>CEO Risk-profile LLC. E-mail sachenko@risk-profile</article-title>
          .ru
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>