<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Integrating digital twins in the electric power ecosystem, Computers &amp; Security</journal-title>
      </journal-title-group>
      <issn pub-type="ppub">1613-0073</issn>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.1016/j.cose.2021.102507</article-id>
      <title-group>
        <article-title>and governance: Implementation of Cyber Resilience KPIs for Decentralized Energy Asset</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ali AGHAZADEH ARDEBILI</string-name>
          <email>ali.a.ardebili@unisalento.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Cristian MARTELLA</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Angelo MARTELLA</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alessandro LAZARI</string-name>
          <email>alessandro.lazari@unisalento.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Antonella LONGO</string-name>
          <email>antonella.longo@unisalento.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Antonio FICARELLA</string-name>
          <email>antonio.ficarella@unisalento.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dept. of Engineering for innovation, University of Salento</institution>
          ,
          <addr-line>Lecce</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Dept. of Research and Development, HSPI Consulenti di Direzione</institution>
          ,
          <addr-line>Rome</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <volume>112</volume>
      <issue>2022</issue>
      <fpage>8</fpage>
      <lpage>12</lpage>
      <abstract>
        <p>In the wake of terrorist attacks in Europe, the European Union has increasingly prioritized collaborative eforts to bolster the protection, resilience, and cybersecurity of critical infrastructures and essential services. Nevertheless, a significant gap persists in accurately quantifying the resilience of these systems, particularly regarding the integration of Artificial Intelligence, which remains underdeveloped. This article endeavors to bridge this gap by developing a robust data-driven framework for Resilience Key Performance Indicators. This study focuses on identifying efective data-driven methodologies to assess the response of cyber-physical critical infrastructures to cyber attacks. A case study is also deployed to replicate cyber attack scenarios on cyber-physical assets and provide a meticulous evaluation of the resilience performance of an energy cyber-physical framework, comprising a Smart PV Station, Data Infrastructure, and Digital Twin for essential services. Notably, the anomaly detection algorithm successfully identifies anomalous behavior induced by simulated cyber attacks, thereby averting the system from reacting to falsely imposed conditions. Furthermore, the assessment inspects the functionality and features of the framework, thus enriching our comprehension and quantification of cyber-physical infrastructure resilience through Resilience Key Performance Indicators.</p>
      </abstract>
      <kwd-group>
        <kwd>Resilience</kwd>
        <kwd>detection</kwd>
        <kwd>Early warning</kwd>
        <kwd>Incident response</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>CEUR
ceur-ws.org</p>
    </sec>
    <sec id="sec-2">
      <title>1. Introduction</title>
      <p>of the European Union have shown an increasing political will in establishing a joint framework
aimed at enhancing the protection, resilience and cybersecurity of critical infrastructures, entities
and operators of essential services. It can be afirmed, in fact, that despite the initial dificulties in
(A. MARTELLA)</p>
      <p>© 2022 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
overcoming the metabolization of key principles and the fulfilment of minimum harmonization
thresholds, the EU and its Member States have adopted overtime a very comprehensive, efective
and up-to-date framework that nowadays stands as reference also for neighboring countries
and allied of the EU.</p>
      <p>In the era of rapid technological advancement, the integration of cutting-edge technologies
like Digital Twins (DTs), big data analysis, and the Internet of Things (IoT) with Critical
Infrastructures (CIs) has transformed the critical entities into smart cyber-physical complex
systems. However, traditional risk assessment methods are proving ineficient for the evaluation
of future AI-integrated CIs. There exists a significant gap in the quantification of resilience for
these complex systems due to the lack of standardization, particularly concerning AI integration,
which is not yet industrialized in CIs operations and control systems. As we move closer to an era
where data-driven cyber resilience indicators are imperative, this article aims to fill this gap by
developing a robust Resilience Key Performance Indicator (R-KPI) implementation framework.
This involves employing highly cited methods to quantify resilience of a smart PV panel which
is developed in Data Lab, University of Salento (see Section 4.1), draw multiple resilience curves
and associated R-KPIs, comparing the results to discern the most comprehensive understanding
of system behavior under varied disturbances. The disturbance in current study is a cyber
attack scenario which is detailed in Section 4.3. The central question addressed in this study
is the best data-driven practice for presenting the behavior of Cyber-Physical (CP) CIs in
response to a cyber attack, utilizing a case study methodology involving the repetition of a
cyber attack scenario on CP assets. The article’s main contribution lies in providing a framework
to employ approved R-KPIs for evaluating the cyber resilience of smart infrastructures, opening
research lines for data-driven anomaly detection and early warning systems. Furthermore,
the article bridges existing gaps by ofering a universal framework for employing R-KPIs in
smart infrastructures, enhancing the understanding of cyber resilience and enabling improved
resilience quantification for AI-integrated CIs.</p>
      <p>The remainder of the article is structured as follows: Methodology, Case Study, Results and
Discussion, Conclusion and Future Work. Next Section 2 will delve into the state of the art of
resilience quantification in CP CIs.</p>
    </sec>
    <sec id="sec-3">
      <title>2. Background Review</title>
      <p>
        Resilience engineering is pivotal for safeguarding the uninterrupted operation of CIs, ensuring
the delivery of vital services [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. The trend of digitalization is molding an ecosystem that
seamlessly integrates the physical and digital realms, imbuing systems with inherent intelligence
through the utilization of cutting-edge technologies [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The resilience of smart CIs, particularly
CP power systems, is a key concern [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Inter-dependencies between cyber, physical, and social
elements in water, transportation, and cyber infrastructures must be considered to enhance
resilience [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. A multi-disciplinary approach is crucial for addressing the challenges faced by
future cities in developing secure and resilient Cyber-Physical Systems (CPSs) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. However,
quantifying resilience remains a crucial challenge, marked by an absence of an eficiently
addressed standard approach in the existing literature in knowledge and practice [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ].
      </p>
      <p>
        Existing technologies do not address the disparate time and spatial scales across the many
system domains [
        <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
        ]. New methods for managing system resilience, including computing,
sensing, machine learning, artificial intelligence, and advanced analytics, are needed to ensure
CPSs can withstand adverse events. The Society of Risk Analysis Workshop in December 2021,
attended by over fity scientists and engineers, aimed to identify key technologies and techniques
for designing resilience in infrastructures. Four promising themes for research include resilient
topologies of sensors and hardware [
        <xref ref-type="bibr" rid="ref11 ref12 ref13">11, 12, 13</xref>
        ], state-of-the-art modeling and the DT [
        <xref ref-type="bibr" rid="ref14 ref15 ref16">14, 15, 16</xref>
        ],
machine learning and AI [
        <xref ref-type="bibr" rid="ref17 ref18 ref19">17, 18, 19</xref>
        ], and energy networks and the System of Systems [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
Cyber-attacks and system complexity pose challenges to risk assessment and management.
Resilience, utilizing flexible response, distributed decision making, modularity, and redundancy,
helps absorb and recover from adverse events when technical objectives, schedule, or cost
are insuficient. Resilience is crucial for CPSs, as it allows for quick and efective recovery
from threats. While mitigating risks is important, adverse events will still occur, and a system
hardened to avoid risks is not inherently robust enough to recover. International standardization
bodies and agencies have developed several cybersecurity standards, including ISO 27000 [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ],
NIST SP 800-82 [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], NIST SP 800-53 [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ], and NIST SP 800-72 [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. The Department of Homeland
Security has also published standards for Common Cybersecurity Vulnerabilities in Industrial
Control Systems (ICSs). Some standards have been published to address specific CPSs for smart
grids IEC 62351 [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ], and specific CPS functions like interoperability and communication. These
standards provide best practices for cybersecurity or technical guidelines for its implementation
in specific sectors.
      </p>
      <p>As anticipated in the introduction, the EU has adopted overtime a series of directives and
regulations that contributed to the establishment of a very comprehensive and advanced
framework aimed at enhancing the cyber/physical security and resilience of critical entities and
essential services. With the launch of the European Programme for Critical Infrastructure
Protection (EPCIP) in 2006, the EU has created the condition for the establishment of an EU-wide
forum in which risk assessment methodologies, mitigation activities, incident response, crisis
management and cooperation mechanism could be discussed, analysed and improved. The
so-called NIS 2 and CER directives, promulgated on the 16th of December 2022, and currently
being adopted by the Member States, are the last mile of a 20 years journey that has now a
strong focus on resilience. Past legislation, in fact, initially focused on the protection from
all-hazards and included initial activities aimed at introducing prevention, preparedness and
response. In the current context, given the obligations respectively introduced by the NIS and
CER directives, embracing resilience at strategic and tactical levels is of utmost importance.
This is also confirmed by the 2016 NATO’s baseline requirements for resilience that include the
following priorities: 1) assured continuity of government and critical government services; 2)
resilient energy supplies; 3) ability to deal efectively with uncontrolled movement of people;
4) resilient food and water resources; 5) ability to deal with mass casualties; 6) resilient civil
communications systems; 7) resilient civil transportation systems.</p>
      <p>With ”resilient energy supplies” ranking second in the order of highest priorities, it goes per
se that research has to dig deep in this lifeline sector, to ensure that all measures are taken to
prevent, absorb and recover from attacks aimed at disrupting the continuity of vital systems
in the ”energy supply chain”. Since it is time consuming and expensive to commit the human
resources in continuously monitoring infrastructures and the systems and networks they rely
upon, it is fundamental to study and introduce tools and mechanisms that can be automatically
triggered to prevent or mitigate a potential attack or anomaly. Such mechanisms should be
characterised by a high degree of learning up to the point in which they can deal with the
anomaly or attack in a completely autonomous way.</p>
      <p>In the Italian context, the importance of the energy sector is further reafirmed by the
”Perimetro Nazionale di Sicurezza Cibernetica” which is an additional measure that has ”national
security” as final goal and introduces further obligations for the operators of essential services,
including some safeguard mechanism on the procurement of digital devices, equipment and
tools.</p>
      <p>
        One promising approach provides to implement resilience by design throughout the lifecycle
of systems development. Currently, resilience eforts are primarily focused on single-domain
networks like energy, water, and freight [
        <xref ref-type="bibr" rid="ref20 ref26 ref27 ref28 ref29">20, 26, 27, 28, 29</xref>
        ]. However, initiatives have been
developed to assess multi-domain resilience using qualitative expert judgment. The Argonne
National Lab developed an infrastructure survey tool to collect information on protection and
resilience from 16 CI domains [30]. DTs of individual buildings can integrate data from all
domains, allowing for examination of correlations and causal relationships. Data must be
gathered from individual domains, a data warehouse constructed, and key resilience indicators
developed. System operators must identify correlations and causal relationships using ML and
causal inference techniques. Addressing this challenge requires a focus on R-KPIs in metric
development[31].
      </p>
      <p>The smart grid, as a complex CPS, faces significant security challenges, and a comprehensive
understanding of attack threats and defense strategies is essential [32]. A full group of physical
impact scenarios on an infrastructure can be calculated [33]. A resilience metric is desirable
for smart grids [34]. The detection of security threats in CPSs is becoming increasingly
critical due to the increasing interconnection of CIs with public networks. Further research is
needed to advance academic research and develop preventative solutions for safe and secure
implementation of these systems. Typical cyber-attacks targeted to CPSs include Input Fuzzing,
Man-in-the-Middle, distributed Denial of Service, False Data Injection, and more [35]. Resilience
can be ensured by implementing a process for anomaly detection or early warning. Anomaly
detection, also known as outlier detection, is a real-time monitoring process that aims to identify
patterns in a data set that do not align with normal behavior, typically referring to infrequent
events [36]. Tightly linked to anomaly detection is the concept of early warning system. Even
such a system implements a real-time monitoring process that is capable of detecting adverse
trends and making reliable predictions. An early warning process collects, analyzes,
interprets, and communicates data, enabling early decision-making to protect public health and
the environment [37]. So, anomaly detection can be considered as part of the early warning
process. Both thread/anomaly detection and early warning are commonly used in various fields,
including cyber-attack threats. While threat detection and prevention in enterprise networks is
mature, CPS currently lacks equivalent capabilities [35]. For the aim of this paper, we implement
a specific cyber-attack scenario in which we simulate the anomaly detection to increase the
system resilience. As future work, we aim to develop an early warning system based on a
comprehensive anomaly detection algorithm for the resilience enhancement of CIs.</p>
      <p>In [38], a CPS resilience assessment framework is proposed, which consists of three phases
called (1) System Description (SD), (2) Disruption Scenario (DS), and (3) Resilience Strategy (RS),
each corresponding to the typical steps of the resilience cycle. Both the hazard and the resilience
strategy contribute to determining the damage to the system. The damage scenario and the
CPS model are used to assess resilience, but not all three phases are necessary. In the SD phase,
data and knowledge about the system structure and processes are gathered to build the model
for the CPS. A Measure of Performance (MoP) is defined according to the resilience objectives
of the CPS, which is computed over time to represent the evolution of the CPS’s structure and
processes. In the DS phase, data and knowledge about possible hazards that may disrupt the
CPS and the resulting damages are gathered or created. Deductive methods estimate the damage
caused by a known hazard, while deductive methods identify hazards that may cause a given
damage. Finally, RS provides to gather data and knowledge about available resilience strategies,
either reactive or proactive, which aim to mitigate or prevent damages, with reactive strategies
restoring system performance and minimizing losses after damage has occurred. Resilience
can be assessed based on the analysis of system attributes and performance during normal
operating conditions. Critical components and processes can be identified, and resilience can
be preemptively assessed. A disruption scenario can be added for an accurate assessment of
system behavior during disrupted conditions. The resulting damage can be mitigated with the
implementation of resilience strategies. However, in some real-world scenarios, systems may
not be restored by the aid of resilience strategies and may collapse or recover as the disruption
elapses. The CPS model and the damage scenario created through these phases are used for the
resilience assessment, with defined resilience metrics provided as input and a resilience report
with quantified metrics obtained as output. In [ 38], for each phase of the proposed framework
a list of the most common disruption scenarios and the corresponding resilience strategies is
provided.</p>
      <p>
        The first step for resilience evaluation is resilience quantification, which employs a
scenariobased approach, with methods tailored to the nature of the studied risk [39, 40, 41]. While much
literature concentrates on analytical frameworks for disaster resilience [42, 43, 44, 45], the surge
in studies evaluating the resilience of CIs under CP attacks is evident [
        <xref ref-type="bibr" rid="ref5">46, 47, 48, 5</xref>
        ]. In this
article, we explore the resilience of a smart PV power station under a cyber attack scenario.
      </p>
      <p>Various metrics have been proposed for Engineering Resilience Quantification, yet in the
CI domain, prioritizing service continuity and maintaining a minimum service level is crucial
for societal well-being during risks, including extreme events and CP attacks [49, 50, 51, 52].
Therefore, this article focuses on indicators linked to system recovery time [51, 53, 54] and
functionality loss.</p>
    </sec>
    <sec id="sec-4">
      <title>3. Methodology</title>
      <p>The primary aim of resilience-enhancing metrics is to elevate the three core capacities of
resilience, namely absorption, adaptation, and restoration. To evaluate the behaviour of the
system after a disturbance, three Resilience KPIs are selected. The recovery time (Figure 1) is
the most important indicator of the resilience of CI. Particularly in sectors like energy, due
to its direct impact on the overall operational resilience recovery time is the most important
Resilience KPI. Recovery time is the period during which a system experiences a decline in
functionality or performance, measured from the occurrence of the disturbance until the system
returns to a state of stable performance. As Figure 1 shows, the new performance level after
stabilization can be a) Lower than the prior disturbance level of performance, b) Equal to the
former level, or c) Higher than the prior disturbance.</p>
      <p>The determination of the minimum performance level (Figure 2) in CI is contingent upon the
inherent design features of the system and the severity of the encountered disturbance.
Monitoring this minimum performance level holds crucial significance as it ensures the preservation
of essential services vital for the system’s proper functioning. The minimum performance level
is intricately defined by the indispensable thresholds associated with the societal needs for that
particular service.</p>
      <p>Resilience curves are applied across the CI literature shows two kind of curve: typical
representation with a semi-linear degradation and semi-linear recovery phase, or non-idealized
system behavior(Figure 3). The research employs a resilience assessment framework adapted
from [51], which is an Integral-based metric that incorporate both time and performance. This
framework evaluates the impact of disturbances on infrastructure by estimating the degradation
in service quality (() ). The process involves assessing the degradation from the disturbance
( 0) until full recovery ( 1), representing the recovery phase.</p>
      <p>Regarding Loss of Functionality (LF ), it quantifies service quality degradation during the
recovery period, irrespective of the system’s behavior. The calculation is expressed as:
 1
 0
 = ∫ [100 − ()]</p>
      <p>For better demonstrate the usefulness of the three aforementioned Resilience KPIs as means
to evaluate the behaviour of the system in a realistic cyber-attack scenario, a case study is
proposed in the following section. This case study is intended to use these KPIs for the eficacy
assessment of the anomaly detection algorithm in bolstering the system’s resilience.</p>
    </sec>
    <sec id="sec-5">
      <title>4. Case Study</title>
      <p>The case study aims to assess the proposed energy CP framework, which includes three main
building blocks: Physical Asset, Data Infrastructure, and DT. The Physical Asset is constituted
by a Smart PV Station (SPVS), that is portable power-generating infrastructure featuring a
PV panel with sensors and actuators for orientation. The Data Infrastructure focuses on data
streaming and persistence, deployed using a fog node on a Raspberry PI 4B. The DT is a
virtual world interactive model of the SPVS, containing four fundamental services: Dynamic
Environment, Operation, Ideal State, and Demand. These services are deployed on a workstation,
representing the cloud backend of the framework, but with limited processing and storage
capabilities. The case study serves as an experiment to evaluate the framework’s functionality
and features.For the sake of clarity, the case study corresponds to a simplified scenario, eliciting
additional complex, interconnected and dependent events and factors that come into play and
significantly impact in a real-world context. Finally, a more comprehensive and exhaustive
evaluation test is planned to be accomplished for assessing the proposed R-KPIs also on larger
scale implementations, such as smart grids and smart cities scenarios.</p>
      <sec id="sec-5-1">
        <title>4.1. Physical Asset</title>
        <p>The models discussed in this case study are applied in the PV power generation system called
SPVS. Such a system is part of the real testbed implemented in [55, 56] and which is detailed in
the present section. The list of components that are presented in Table 1 was used for assembling
the CP infrastructure (Figure 4b) and for evaluating our experimental setup. The logical model
of the SPVS is shown in Figure 4a, where the physical components and the connections between
them are represented. In particular, it includes two types of physical connections: power
delivery and data delivery. The former is used to highlight the electric circuit to power the
SPVS components, whilst the latter maps the data streams between the components.</p>
        <p>A 20W monocrystalline solar module, is chosen for the implementation of the portable SPVS
testbed. The module uses high-eficiency monocrystalline solar cells, costing over 18%, and is
suitable for 12V systems.</p>
        <p>The SPVS uses sensors and actuators to monitor and interact with its environment. It assesses
air quality and collects data on the PV panel’s live power production, battery power, and system
operations. The station can track specific orientations using onboard actuators, including servo
motors that control the panel’s pitch and yaw angles (as shown in Figure 4c).</p>
        <p>The SPVS physical asset’s brain uses ESP32 microcontroller units due to their good
performance, low cost, and compact size. The boards also features an antenna module for wireless
communication on the 2.4GHz band.</p>
        <p>The device is powered by the energy generated by the PV panel and stored in a battery. To
this end, a Maximum Power Point Tracker (MPPT) monitors the PV panel’s output to regulate
voltage and current to keep the system at maximum power at all times. However, the MPPT’s
(a) The logical model of the smart PV system.
output is too high to power the logical components, which require 5 volts. Thus, separate
power sources are used for low power (sensors and control devices) and high power (servo
motors). In particular, two step-down voltage converters are installed between the battery and
downstream modules, ensuring constant 5 volts output and avoiding power decreases during
power-intensive operations.</p>
      </sec>
      <sec id="sec-5-2">
        <title>4.2. System Architecture and Software Components</title>
        <p>The Data Streaming service facilitates interaction between the SPVS and its DT virtual services
using MQTT protocol. A MQTT message broker is instantiated to process message queues
between publishers and subscribers. Client services must include MQTT client implementations
to secure and publish sensor data payloads, ensuring timely data reception. Inbound messages
are deserialized to transform payloads into JSON objects ready for data processing. The service
manages the communication between the physical SPVS and its DT services, and forwards data
messages to the Data Persistence service.</p>
        <p>The Data Persistence service consists of two microservices that maintain historical data
records between the SPVS and Energy DT’s services, including sensor readings and action
commands. MongoDB was chosen for the case study due to its document-based structure, which
allows high-performance IoT data querying and fast insert queries [57]. MongoDB outperforms
relational DBMSs like MySQL in terms of resource utilization and latency [58, 59]. It supports
eficient local data storage on edge devices, reducing the need for data transmission to remote
servers or cloud infrastructures. In this case study, a Python script implements the interface
microservice for the DBMS. In particular, the script acts as a middleman, providing subscriptions
for MQTT topics and preparing data for storage through MongoDB microservice interaction.</p>
        <p>The Anomaly Detection Service (ADS) is responsible for detecting anomalous behaviours
of the SPVS to enhance system eficiency and ensure service continuity. It predicts optimal
production parameters for real-time variables like temperature, solar irradiation, and energy
consumption using mathematical models [60] or machine learning models. The ADS compares
estimated current, voltage, and power values to the provided measured set of related parameters,
and if the diference exceeds predetermined tolerance levels, an anomaly is recognized. For
developing the present case study, the aforementioned ADS was adopted to identify induced
electrical production anomalies and then to mitigate the corresponding efects, as detailed in
Section 5.</p>
      </sec>
      <sec id="sec-5-3">
        <title>4.3. Attack Scenario</title>
        <p>For the purpose of this research, the assumption is that in the current geopolitical scenario,
there could be a number of state and non-state actors willing to create minor disturbances or
severe disruptions to energy infrastructures as part of a single or more complex and coordinated
attack aiming at making interconnected infrastructures and their supply chains cripple. For this
reason, the attack scenarios considered for this research and the tests that have been performed
on the PV system, is that the attacker would use a ”man-in-the-middle” technique. Such a
technique is used to interfere with the correct functioning of the generation infrastructure
by modifying (tampering with) the part of the setup that allows the synchronization of the
clock which controls the correct orientation of the PV, by tracking the most eficient irradiation
position throughout the daily lifecycle. Furthermore, in this context, it is assumed that if an
attacker would intervene on the synchronization of the system’s clock by providing a wrong
value, the system would work outside of the established and more performing ranges, up to the
point in which the system would position the PV in ”sleep mode” in all of the cases in which
the wrong value falls before dawn or after dusk. In these cases, the energy production can be
significantly reduced with all the corresponding consequences on the missing generation and
its inevitable impacts on the expected demand from both the transmission and distribution
infrastructures.</p>
      </sec>
      <sec id="sec-5-4">
        <title>4.4. Test Condition</title>
        <p>January 24, 2023 was the date selected for the tests1 because during that day the weather
remained mostly clear with occasional partial cloud cover. Overall, the weather conditions
were relatively stable(see Figure 5), with no significant variations in temperature (see Figure 6)
or visibility. The day featured mostly clear skies, transitioning to partly cloudy in the early
afternoon(see Figure 7), and the wind speed remained moderate throughout the observed period.
These conditions were favorable for conducting tests and collecting data as part of the system
implementation. More specifically, the detailed environmental data related to the weather
conditions of the selected day have been collected from Weather Spark2. In the present scenario,
stable conditions were chosen to reduce the complexity and minimize the sources of disturbance
attributable to third-party factors. The goal of this work is to provide a first evaluation of the
proposed R-KPIs in a simplistic scenario, highlighting the contribution of rogue alterations of
the physical asset parameters. The efects of further external disturbance factors and the way
they can impact on the system behaviour and on the proposed R-KPIs is out of the scope of this
paper and can be better analyzed in future works.</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>5. Results and Discussion</title>
      <p>The collected data on the day of the test is depicted in Figure 8. The simulation of a CP attack
initiates at 10:10 in the morning. Disturbances caused by the CP attacks are illustrated in
1The portable smart PV power station testbed is situated within the Ecotekne complex, located in Lecce, Italy. The
geographical coordinates are 40°19’59.2”N latitude and 18°06’51.3”E longitude.
2https://weatherspark.com/</p>
      <p>Despite the system being forced into the rest position, the DT’s ideal state service attempts
to adjust the orientation of the PV panel to follow the sun’s trajectory based on time and
position. However, the continuous disruption from the CP attack disturbs the system’s normal
functioning. Around 12 o’clock, the anomaly detection algorithm identifies the anomalous
behavior caused by the cyber attack, preventing the system from responding to false imposed
conditions.</p>
      <p>The second attack simulation occurs at 12:05, and with the anomaly detection trained from
the previous behavior and attack features, the system identifies the attack quickly, resulting
in minimal functionality loss. After the second attack, the system rapidly returns to the
ideal position. In the last attack at 12:35, the functionality loss is negligible, showcasing an
improvement in resilience and service continuity. Metrics such as functionality loss, minimum
performance level, and recovery time demonstrate improvement in response to this attack
scenario.</p>
      <p>Figure 10 illustrates the R-KPIs for the system during the mentioned attack scenario, as
introduced in Sections 3 and 4.3, respectively. The R-KPI values presented in Table 23 are
derived from the scenario outlined in Figure 10. These findings highlight the eficacy of the
anomaly detection algorithm in bolstering the system’s resilience.</p>
      <p>Initial Attack Analysis An examination of the Key Performance Indicators (KPIs) reveals a
significant loss of functionality during the first attack. This aligns with the high impact rating
3calculated by https://www.sketchandcalc.com/
assigned within the risk assessment matrix. The scenario poses a greater threat compared to
natural disasters, based on a quantity of relevant literature on intentional disruptions versus natural
events in literature. Consequently, employing an anomaly detection system is recommended
to efectively identify and respond to such attacks. Post-Attack Performance and Recovery:
The system’s performance exhibits a precipitous decline following the initial attack, reaching a
critically low point of 1.36. A comprehensive investigation into this minimum performance
level is crucial in the critical infrastructures of the society with real users of the service. This
analysis should determine the energy infrastructure’s capacity to meet the essential service
needs of users during an attack. Furthermore, assessing the recovery time is equally critical in
real-world critical infrastructure scenarios. This evaluation entails determining the timeframe
for which energy users reliant on this source can sustain operations with the minimum energy
level to deliver essential services.</p>
      <p>Impact of Anomaly Detection The implementation of an anomaly detection system
demonstrably improves performance across all Key Performance Indicators (KPIs) during the second
and third attacks. This significant improvement suggests a sharp reduction in risk impact when
employing such an algorithm. While the attack probability might remain constant, the risk
scenario’s position within the risk-probability matrix shifts towards a zone characterized by low
impact and high probability. Consequently, these risks can be classified as moderate, implying
the system’s ability to absorb and recover from such disturbances. Nevertheless, further eforts
to mitigate the likelihood of occurrence are needed. A comprehensive study is recommended in
such a scenario to identify potential modifications within the cyber-physical infrastructures
that could enhance overall security and diminish the probability of this specific attack scenario.</p>
    </sec>
    <sec id="sec-7">
      <title>6. Conclusion and Future Work</title>
      <p>This research has allowed the team to fine tune the understanding of the dynamics behind a
possible attack to a PV generation infrastructure. Thanks to the use of a testbed, the research
has provided vary solid premises and insights that will allow the extension to real cases and full
scale infrastructures. Even tough further analyses are required, the team is motivated to look
for partners in the domain of electricity distribution, transmission and generation to allow the
execution of a full scale test in a more complex data management infrastructure such as a data
space, fostering the cabling of early warning and response policies in DTs of smart grids and CIs.
In this regard, the long term goal is to understand the self-healing capabilities of systems and
networks enabling the continuous and undisturbed delivery of essential services, leveraging
novel data-driven approaches to digital services that use real-time field data.</p>
      <p>The case study presented is validated using a small scale portable testbed that includes a
single PV panel, as discussed in section 4.1. Although the current setup provided valuable
insights as discussed in this paper, it is limited and poses significant challenges with respect to
large scale scenarios. Future studies will also address the scalability of the proposed approach
to full-scale infrastructures, also involving key role players in the power distribution sector.
[30] D. T. Ton, W. P. Wang, A more resilient grid: The us department of energy joins with
stakeholders in an r&amp;d plan, IEEE Power and Energy Magazine 13 (2015) 26–34.
[31] N. Yodo, P. Wang, Engineering resilience quantification and system design implications:</p>
      <p>A literature survey, Journal of Mechanical Design 138 (2016). doi:10.1115/1.4034223.
[32] H. He, J. Yan, Cyber‐physical attacks and defences in the smart grid: a survey, IET
Cyber-Physical Systems: Theory &amp; Applications 1 (2016) 13–27. doi:10.1049/iet-cps.
2016.0019.
[33] S. A. Timashev, Cyber reliability, resilience, and safety of physical infrastructures, IOP
Conference Series: Materials Science and Engineering 481 (2019) 012009. doi:10.1088/
1757-899x/481/1/012009.
[34] L. Das, S. Munikoti, B. Natarajan, B. Srinivasan, Measuring smart grid resilience: Methods,
challenges and opportunities, Renewable and Sustainable Energy Reviews 130 (2020)
109918. doi:10.1016/j.rser.2020.109918.
[35] N. Jefrey, Q. Tan, J. R. Villar, A review of anomaly detection strategies to detect threats to
cyber-physical systems, Electronics 12 (2023) 3283.
[36] V. Chandola, A. Banerjee, V. Kumar, Anomaly detection: A survey, ACM computing
surveys (CSUR) 41 (2009) 1–58.
[37] J. E. Quansah, B. Engel, G. L. Rochon, Early warning systems: a review, Journal of</p>
      <p>Terrestrial Observation 2 (2010) 5.
[38] B. Cassottana, M. M. Roomi, D. Mashima, G. Sansavini, Resilience analysis of cyber-physical
systems: A review of models and methods, Risk Analysis (2023).
[39] A. Shafieezadeh, L. Ivey Burden, Scenario-based resilience assessment framework for
critical infrastructure systems: Case study for seismic resilience of seaports, Reliability
Engineering &amp; System Safety 132 (2014) 207–219. doi:10.1016/j.ress.2014.07.021.
[40] T. Davies, S. Beaven, D. Conradson, A. Densmore, J. Gaillard, D. Johnston, D. Milledge,
K. Oven, D. Petley, J. Rigg, T. Robinson, N. Rosser, T. Wilson, Towards disaster resilience:
A scenario-based approach to co-producing and integrating hazard and risk knowledge,
International Journal of Disaster Risk Reduction 13 (2015) 242–247. doi:10.1016/j.ijdrr.
2015.05.009.
[41] A. Al-Mutairi, S. AlKheder, S. Alzwayid, D. Talib, M. B. Heji, J. H. Lambert, Scenario-based
preferences modeling to investigate port initiatives resilience, Technological Forecasting
and Social Change 176 (2022) 121498. doi:10.1016/j.techfore.2022.121498.
[42] G. P. Cimellaro, A. M. Reinhorn, M. Bruneau, Framework for analytical quantification of
disaster resilience, Engineering Structures 32 (2010) 3639–3649. doi:10.1016/j.engstruct.
2010.08.008.
[43] S. L. Cutter, C. G. Burton, C. T. Emrich, Disaster resilience indicators for benchmarking
baseline conditions, Journal of Homeland Security and Emergency Management 7 (2010).
doi:10.2202/1547-7355.1732.
[44] J. C. Matthews, Disaster resilience of critical water infrastructure systems, Journal of</p>
      <p>Structural Engineering 142 (2016). doi:10.1061/(asce)st.1943-541x.0001341.
[45] A. Fekete, Critical infrastructure cascading efects. disaster resilience assessment for floods
afecting city of cologne and rhein‐erft‐kreis, Journal of Flood Risk Management 13 (2020).
doi:10.1111/jfr3.12600.
[46] A. Salvi, P. Spagnoletti, N. S. Noori, Cyber-resilience of critical cyber infrastructures:</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A. I. H. A.</given-names>
            <surname>Ramadan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Ardebili</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Longo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ficarella</surname>
          </string-name>
          ,
          <article-title>Advancing resilience in green energy systems: Comprehensive review of ai-based data-driven solutions for security and safety</article-title>
          ,
          <source>in: 2023 IEEE International Conference on Big Data (BigData)</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>4002</fpage>
          -
          <lpage>4010</lpage>
          . doi:
          <volume>10</volume>
          .1109/BigData59044.
          <year>2023</year>
          .
          <volume>10386721</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Lim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Ninan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Nooteboom</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Hertogh</surname>
          </string-name>
          ,
          <article-title>Organizing resilient infrastructure initiatives: A study on conceptualization, motivation, and operation of ten initiatives in the netherlands</article-title>
          ,
          <source>Resilient Cities and Structures</source>
          <volume>2</volume>
          (
          <year>2023</year>
          )
          <fpage>120</fpage>
          -
          <lpage>128</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.rcns.
          <year>2023</year>
          .
          <volume>10</volume>
          .001.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>E.</given-names>
            <surname>Evangelopoulos</surname>
          </string-name>
          , Smart counties: technologies, considerations, characteristics, challenges, policies, and theoretical concerns,
          <source>Elsevier</source>
          ,
          <year>2022</year>
          , p.
          <fpage>49</fpage>
          -
          <lpage>78</lpage>
          . doi:
          <volume>10</volume>
          .1016/ b978-0
          <source>-12-819130-9</source>
          .
          <fpage>00039</fpage>
          -
          <lpage>5</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S.</given-names>
            <surname>Paul</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ding</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Utkarsh</surname>
          </string-name>
          , W. Liu,
          <string-name>
            <surname>M. J. O'Malley</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Barnett</surname>
          </string-name>
          ,
          <article-title>On vulnerability and resilience of cyber-physical power systems: A review</article-title>
          ,
          <source>IEEE Systems Journal</source>
          <volume>16</volume>
          (
          <year>2022</year>
          )
          <fpage>2367</fpage>
          -
          <lpage>2378</lpage>
          . doi:
          <volume>10</volume>
          .1109/jsyst.
          <year>2021</year>
          .
          <volume>3123904</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Mohebbi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , E. Christian Wells,
          <string-name>
            <given-names>T.</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Nguyen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Abdel-Mottaleb</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Uddin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Lu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Wakhungu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Wu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Tuladhar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Ou</surname>
          </string-name>
          ,
          <article-title>Cyber-physicalsocial interdependencies and organizational resilience: A review of water, transportation, and cyber infrastructure systems and processes</article-title>
          ,
          <source>Sustainable Cities and Society</source>
          <volume>62</volume>
          (
          <year>2020</year>
          )
          <article-title>102327</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.scs.
          <year>2020</year>
          .
          <volume>102327</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>H.</given-names>
            <surname>Boyes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Isbell</surname>
          </string-name>
          , T. Watson,
          <source>Critical Infrastructure in the Future City</source>
          , Springer International Publishing,
          <year>2016</year>
          , p.
          <fpage>13</fpage>
          -
          <lpage>23</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>319</fpage>
          -31664-
          <issue>2</issue>
          _
          <fpage>2</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.</given-names>
            <surname>Ingrisch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Bahn</surname>
          </string-name>
          ,
          <article-title>Towards a comparable quantification of resilience</article-title>
          ,
          <source>Trends in Ecology &amp; Evolution</source>
          <volume>33</volume>
          (
          <year>2018</year>
          )
          <fpage>251</fpage>
          -
          <lpage>259</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.tree.
          <year>2018</year>
          .
          <volume>01</volume>
          .013.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>P.</given-names>
            <surname>Tamvakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Xenidis</surname>
          </string-name>
          ,
          <article-title>Comparative evaluation of resilience quantification methods for infrastructure systems</article-title>
          ,
          <source>Procedia - Social and Behavioral Sciences</source>
          <volume>74</volume>
          (
          <year>2013</year>
          )
          <fpage>339</fpage>
          -
          <lpage>348</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.sbspro.
          <year>2013</year>
          .
          <volume>03</volume>
          .030.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A. S.</given-names>
            <surname>Jin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Hogewood</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Fries</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. H.</given-names>
            <surname>Lambert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Fiondella</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Strelzof</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Boone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Fleckner</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Linkov</surname>
          </string-name>
          ,
          <article-title>Resilience of cyber-physical systems: Role of ai, digital twins, and edge computing</article-title>
          ,
          <source>IEEE Engineering Management Review</source>
          <volume>50</volume>
          (
          <year>2022</year>
          )
          <fpage>195</fpage>
          -
          <lpage>203</lpage>
          . doi:
          <volume>10</volume>
          .1109/emr.
          <year>2022</year>
          .
          <volume>3172649</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>B.</given-names>
            <surname>Cassottana</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. M. Roomi</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Mashima</surname>
          </string-name>
          , G. Sansavini,
          <article-title>Resilience analysis of cyber‐physical systems: A review of models and methods</article-title>
          ,
          <source>Risk Analysis</source>
          <volume>43</volume>
          (
          <year>2023</year>
          )
          <fpage>2359</fpage>
          -
          <lpage>2379</lpage>
          . doi:
          <volume>10</volume>
          . 1111/risa.14089.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D. E.</given-names>
            <surname>Culler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Mulder</surname>
          </string-name>
          ,
          <article-title>Smart sensors to network the world</article-title>
          ,
          <source>Scientific American</source>
          <volume>290</volume>
          (
          <year>2004</year>
          )
          <fpage>84</fpage>
          -
          <lpage>91</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>S. N.</given-names>
            <surname>Vecherin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. K.</given-names>
            <surname>Wilson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. L.</given-names>
            <surname>Pettit</surname>
          </string-name>
          ,
          <article-title>Optimal sensor placement with signal propagation efects and inhomogeneous coverage preferences</article-title>
          ,
          <source>International Journal of Sensor Networks</source>
          <volume>9</volume>
          (
          <year>2011</year>
          )
          <fpage>107</fpage>
          -
          <lpage>120</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>S.</given-names>
            <surname>Slijepcevic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Potkonjak</surname>
          </string-name>
          ,
          <article-title>Power eficient organization of wireless sensor networks</article-title>
          ,
          <source>in: ICC</source>
          <year>2001</year>
          . IEEE international conference on communications.
          <source>Conference record (Cat. No. 01CH37240)</source>
          , volume
          <volume>2</volume>
          , IEEE,
          <year>2001</year>
          , pp.
          <fpage>472</fpage>
          -
          <lpage>476</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>M. O.</given-names>
            <surname>Ahmad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Ahad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Alam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Siddiqui</surname>
          </string-name>
          , G. Casalino,
          <article-title>Cyber-physical systems and smart cities in india: Opportunities, issues, and challenges</article-title>
          ,
          <source>Sensors</source>
          <volume>21</volume>
          (
          <year>2021</year>
          )
          <fpage>7714</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>El</surname>
          </string-name>
          <string-name>
            <surname>Saddik</surname>
          </string-name>
          ,
          <article-title>Digital twins: The convergence of multimedia technologies</article-title>
          ,
          <source>IEEE multimedia 25</source>
          (
          <year>2018</year>
          )
          <fpage>87</fpage>
          -
          <lpage>92</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>F.</given-names>
            <surname>Tao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , A. Liu,
          <string-name>
            <given-names>A. Y.</given-names>
            <surname>Nee</surname>
          </string-name>
          ,
          <article-title>Digital twin in industry: State-of-the-art</article-title>
          ,
          <source>IEEE Transactions on industrial informatics 15</source>
          (
          <year>2018</year>
          )
          <fpage>2405</fpage>
          -
          <lpage>2415</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>T.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Liang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Jia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Arif</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Xie</surname>
          </string-name>
          ,
          <article-title>Coupling resource management based on fog computing in smart city systems</article-title>
          ,
          <source>Journal of Network and Computer Applications</source>
          <volume>135</volume>
          (
          <year>2019</year>
          )
          <fpage>11</fpage>
          -
          <lpage>19</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>T.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Liang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Yang</surname>
          </string-name>
          , G. Xu,
          <string-name>
            <given-names>H.</given-names>
            <surname>Peng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Jia</surname>
          </string-name>
          ,
          <article-title>An intelligent edge-computingbased method to counter coupling problems in cyber-physical systems</article-title>
          ,
          <source>IEEE Network 34</source>
          (
          <year>2020</year>
          )
          <fpage>16</fpage>
          -
          <lpage>22</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>D.</given-names>
            <surname>Martínez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Brewer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Strelzof</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Wilson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Wade</surname>
          </string-name>
          ,
          <article-title>Rotorcraft virtual sensors via deep regression</article-title>
          ,
          <source>Journal of Parallel and Distributed Computing</source>
          <volume>135</volume>
          (
          <year>2020</year>
          )
          <fpage>114</fpage>
          -
          <lpage>126</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>P. E.</given-names>
            <surname>Roege</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z. A.</given-names>
            <surname>Collier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Mancillas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>McDonagh</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Linkov</surname>
          </string-name>
          ,
          <article-title>Metrics for energy resilience</article-title>
          ,
          <source>Energy Policy</source>
          <volume>72</volume>
          (
          <year>2014</year>
          )
          <fpage>249</fpage>
          -
          <lpage>256</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>J.</given-names>
            <surname>Brenner</surname>
          </string-name>
          ,
          <article-title>Iso 27001 risk management and compliance</article-title>
          ,
          <source>Risk management 54</source>
          (
          <year>2007</year>
          )
          <fpage>24</fpage>
          -
          <lpage>29</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>K.</given-names>
            <surname>Stoufer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Falco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Scarfone</surname>
          </string-name>
          , et al.,
          <article-title>Guide to industrial control systems (ics) security</article-title>
          , NIST special publication
          <volume>800</volume>
          (
          <year>2011</year>
          )
          <fpage>16</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>J. T.</given-names>
            <surname>Force</surname>
          </string-name>
          ,
          <article-title>Security and privacy controls for information systems and organizations</article-title>
          ,
          <source>Technical Report, National Institute of Standards and Technology</source>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>C. I. Cybersecurity</surname>
          </string-name>
          ,
          <article-title>Framework for improving critical infrastructure cybersecurity</article-title>
          , URL: https://nvlpubs.nist.gov/nistpubs/CSWP/NIST.CSWP
          <volume>4162018</volume>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>F.</given-names>
            <surname>Cleveland</surname>
          </string-name>
          , Iec tc57 wg15:
          <article-title>Iec 62351 security standards for the power system information infrastructure</article-title>
          , White
          <string-name>
            <surname>Paper</surname>
          </string-name>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>A.</given-names>
            <surname>Al-Mutairi</surname>
          </string-name>
          , S. AlKheder, S. Alzwayid,
          <string-name>
            <given-names>D.</given-names>
            <surname>Talib</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. B.</given-names>
            <surname>Heji</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. H.</given-names>
            <surname>Lambert</surname>
          </string-name>
          ,
          <article-title>Scenario-based preferences modeling to investigate port initiatives resilience</article-title>
          ,
          <source>Technological Forecasting and Social Change</source>
          <volume>176</volume>
          (
          <year>2022</year>
          )
          <fpage>121498</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>A.</given-names>
            <surname>Hasandka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Rivera</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. Van Natta</surname>
          </string-name>
          ,
          <article-title>NREL's Cyber-Energy Emulation Platform for Research and System Visualization</article-title>
          ,
          <source>Technical Report, National Renewable Energy Lab</source>
          .
          <article-title>(NREL), Golden</article-title>
          ,
          <source>CO (United States)</source>
          ,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>T. M. Aljohani</surname>
            ,
            <given-names>M. J.</given-names>
          </string-name>
          <string-name>
            <surname>Beshir</surname>
          </string-name>
          ,
          <article-title>Matlab code to assess the reliability of the smart power distribution system using monte carlo simulation</article-title>
          ,
          <source>Journal of Power and Energy Engineering</source>
          <volume>5</volume>
          (
          <year>2017</year>
          )
          <fpage>30</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>S.</given-names>
            <surname>Chanda</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. K.</given-names>
            <surname>Srivastava</surname>
          </string-name>
          ,
          <article-title>Defining and enabling resiliency of electric distribution systems with multiple microgrids</article-title>
          ,
          <source>IEEE Transactions on Smart Grid</source>
          <volume>7</volume>
          (
          <year>2016</year>
          )
          <fpage>2859</fpage>
          -
          <lpage>2868</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>