<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The Methodology for Assessing Information Security Risks for Robotic Systems</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alexander Basan</string-name>
          <email>tftrtu @mail.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Elena Basan</string-name>
          <email>ebasan@sfedu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dept. Information security, Southern Federal University</institution>
          ,
          <addr-line>Taganrog</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <fpage>30</fpage>
      <lpage>35</lpage>
      <abstract>
        <p>-Today, robotic systems are becoming very popular. They are typically used to monitor critical objects. Human lives often depend on the correct operation of a robotic system. Therefore, risk analysis of a robotic information system is an important task. However, to date there is no standard that describes this process. We conducted a study of existing standards for industrial control system and typical information systems. We have identified one common problem. If the risk assessment process is still described in these documents, then the analysis of initial security is not considered at all. This assessment of the initial level of security, the analysis of structural and functional characteristics is a very important task. If we are not completely knowledgeable about our system, then we may not fully assess the risks. Therefore, an attacker can take advantage of this. This article also discusses security incidents related to robotic systems. We concluded that an attacker may not have special means to attack, and at the same time causes substantial damage to the robotic system. Indeed, the main problem in the analysis of robotic systems is the difference of this type of network from the typical computer networks, which in turn requires the creation of new methods and approaches to the analysis of the security of a network of mobile robots.</p>
      </abstract>
      <kwd-group>
        <kwd>attack</kwd>
        <kwd>robotic system</kwd>
        <kwd>risk</kwd>
        <kwd>security</kwd>
        <kwd>threats</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>INTRODUCTION</p>
      <p>
        As is well known, the industry associated with robotic
systems is actively developing. Automation in production,
military areas is becoming a mass phenomenon. Special
types of networks are being created; new ways of data
processing and decision-making methods are being
introduced, as well as artificial intelligence [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. To date,
topics related to the creation of robotic systems are quite
relevant. Such systems are created not only for industrial and
military purposes, but also for consumer services (such as
Smart City, Smart Home) and farms (Smart Farm, Smart
Greenhouse). Systems equipped with artificial intelligence,
are capable of varying degrees of autonomy, gaining
widespread popularity. Unmanned vehicles, surface
autonomous vehicles, submarine and air autonomous
vehicles, and much more can be attributed to such systems.
All systems listed above, ranging from autonomous robots to
complex intelligent robotic systems have common features,
and especially in terms of information security. In this study,
assume that a robotic system is a group of robotic devices,
joined to decided one or several similar tasks perform their
functions through communication channel or autonomous
mode. Elements of robotic and intelligent systems are used in
practice in industrial control system (ICS), in smart home
systems or the Internet of things. Due to the fact that these
systems are only developing and there are no any
information security standards for them, certified security
equipment, etc., improving the security of such systems
becomes a problem. In addition, most approaches to creating
robotic systems are also not standardized. Scientists have
developed a large number of methods and algorithms for
controlling a robotic system [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Conducting a security
analysis of a robotic system is really become a problem. The
process of creating a security system for any information
system has a clearly structured algorithm [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. At the first
stage, information security risks are analyzed, protection
requirements are defined, and a security policy is built. But
in order to analyze the risks or determine the protection
requirements, to develop a security policy, you need to
clearly understand what you are dealing with. The operator
of the information system must clearly know the structure of
his system; understand its functionality and capabilities.
Typically, information security risks are associated with a
violation of the integrity, confidentiality, accessibility of
information that can be presented in the form of electronic
resources (databases, web resources, electronic documents,
etc.) and information resources on solid media (servers,
paper documents, hard drives, etc.) [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Unlike a typical
information system, a robotic system or an automatic process
control system works not only with the processing, storage,
transmission, collection of information, but also with the
control object. Thus, the attacker has more opportunities to
influence the system and obtaining benefits can be achieved
not only by violating confidentiality, integrity, accessibility
of information, but also by disrupting the object [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The
object in this study means a certain entity that is controlled
by a robotic system.
      </p>
      <p>The novelty of this research lies in the fact that the
authors proposed a technique for assessing initial security as
well as risk assessment and information security threats.
Thus, the main goal of our study is to develop a methodology
for assessing information security risks for a robotic system
by assessing the initial security. To achieve this goal, it is
necessary to perform the following tasks:</p>
      <p>• Researching for the features of robotic systems, and
the architecture of robotic systems.</p>
      <p>• Structuring and systematization information about
robotic systems.</p>
      <p>• Determination of indicators to assess the degree of
protection of the robotic system.</p>
      <p>• Development of the methodology of assessing the
level of degrees of criticality, initial security, degree of
difficulty of attack realization, negative consequences of the
threat.</p>
      <p>The remainder of the paper is structured as follows.
Section 2 summarizes related work. Section 3 described
analyses of the structural and functional characteristics of
robotic systems, Section 4 view аassessment of the level of
initial security, in Section 5 is described degree of difficulty
of attack realization, in Section 6 represents negative
consequences of the threat and Section 7 is conclusion and
future work.</p>
      <p>II.</p>
      <p>RELATED WORK</p>
      <p>
        The closest methodical document, which describes a
process of evaluating the initial security level, is a: Method
for determining threat to the security information in
information systems by FSTEK [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. This technique describes
the procedure for developing a threat model and an intruder
model for a typical information system. A method for
assessing initial security is described. The method of
assessing the initial security described in the methodology
basically uses an analysis of the structural and functional
characteristics of the system. If it is necessary to assess the
initial security of the robotic system, this method is not
suitable for two reasons. Firstly, because the structural and
functional characteristics of a typical information system and
a robotic system differ significantly. Secondly, it is not
completely clear based on what the degree of security of a
characteristic was determined.
      </p>
      <p>
        FSTEC Order No. 31 «Approval requirements for the
provision information security in the industrial control
systems (ICS) on critical infrastructure, potentially
dangerous objects, and objects posing an increased danger to
life and health and for the environment» was published in
2014 [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. This order addresses issues of ACS TP structuring,
and also offers a variety of security subsystem. The standard
describes the structural and functional characteristics of
process control systems and gives the following levels:
•
•
      </p>
    </sec>
    <sec id="sec-2">
      <title>Operator (dispatch) control level (upper level);</title>
    </sec>
    <sec id="sec-3">
      <title>Automatic control level (middle level);</title>
      <p>• Level of input (output) of data of executive devices
(lower (field) level).</p>
      <p>Despite the fact, that in the order to allocate separately
autonomous management level, directly implying the
protection of actuators and sensor system in the section,
which deals with the protection subsystem, the specific
features of the Autonomous level not taken into account. In
addition, this document does not consider that executive
mechanisms (which may include sensor nodes, robots)
themselves autonomous controls may take decisions or act in
a separate group. At the same time, intermediaries between
the group of executing devices and the operator (devices at
the automatic control level) can often be absent when it
comes to a fully distributed system. Currently, group
management systems, group intelligence are gaining more
and more popularity [8]. These systems will provide greater
economic efficiency and eliminate a single point of failure.</p>
      <p>
        In 2008, a safety standard for industrial control systems
was issued. National Institute of Standards and Technology
represents SP 800-82 Guide to Industrial Control Systems.
For example, is the NIST, the ISO, but these standards are
mainly aimed at examining protection systems for the
Internet of things. NIST has developed a Framework for
Improving Critical Infrastructure Cybersecurity, where
represented the necessary security subsystems that should be
implemented in information systems [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. For each of the
proposed security subsystems, there are specified sections of
the standards where the procedure for developing each
subsystem [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. This Framework presents many
requirements, but it is also not clear how to select a specific
requirement for the system, how to assess the need to protect
one or another component of the system. The organization
has established and implemented the processes to identify,
assess and manage supply chain risks [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. In 2008, the
NIST Special Publication 800-82 standard was introduced.
This standard defines key components are [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]:
      </p>
      <p>• Control node. The control node consists of
measurement sensors, a controller (includes equipment and
actuators, such as PLC controllers, valves, switches, levers,
motors) and variable systems.</p>
      <p>• Human Machine Interface (HMI). Operators and
engineers use the HMI to monitor, control and change set
points, algorithms, control and set controller parameters.</p>
      <p>• Remote diagnosis and support program. Remote
diagnostic and support programs are used to prevent,
recognize, and correct malfunctions.</p>
      <p>
        This structure is fundamentally different from that
presented in the FSTEC. In May 2015, the standard was
released in the second version. The document describes the
structure of ICS as follows. A typical ICS contains numerous
control loops, human interfaces, and remote diagnostics and
maintenance tools built using an array of network protocols
on layered network architectures. Control loops utilize
sensors, actuators, and controllers (e.g., PLCs) to manipulate
some controlled process [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Another example is the Robot
Security Framework (RSF) [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. This article describes a
security assessment system. Robotic system is divided into 4
components and evaluates the safety of each of them. At the
same time, the assessment does not rely at all on the possible
threats characteristic of each component of the system, and
considers only the physical, network, firmware, and
application. This Framework also lacks the ability to evaluate
the intelligent control system of the robot, evaluate the robot
if it is mobile, and the group control system. Authors hereby
propose a framework based on four layers that are relevant
divide them into aspects considered relevant to be covered.
Also, they provide relevant criteria applicable for security
assessment. For each of these criteria they identify what
needs to be assessed (objective), why to address such
(rationale) and how to systematize evaluation (method).
      </p>
      <p>III.</p>
    </sec>
    <sec id="sec-4">
      <title>ANALYSES OF THE STRUCTURAL AND FUNCTIONAL</title>
      <p>CHARACTERISTICS OF ROBOTIC SYSTEMS</p>
      <p>
        The nodes of the robotic system collect information and,
if necessary, control a remote object. Robots can be both
stationary and mobile. Robots can act as autonomous, or they
can be remotely controlled. Robots could be in active mode
or in sleep mode if necessary. Sensor nodes provide the
ability to track various physical processes. A group of nodes
can be networked according to the IEEE 802.11n, s standard,
which is part of the IEEE 802.11 standards and allows to
organize hierarchical wireless Ad-Hoc and mesh networks.
In addition, ZigBee, 6LoWPAN, Thread, RPL, BLE, and
other protocols support for communication [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. The robots
can be carried out by the group control system of robots
(GCSR) [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. The GCSR solves the problems of forming
subgroups and the distribution of tasks between them. There
are two main ways to organize robots into group: centralized,
decentralized [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. The action of the robots in group or each
subgroup is also planning to solve different tasks. In other
words, with a centralized strategy, the control system of each
robot receives an algorithm of actions of this robot through
information channels and implements it. The decentralized
management strategy that leads to distributed group
management systems seems more promising. In this case, the
group control system is implemented by the dissemination of
information among several robots or all robots of a group or
subgroup [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. In contrast to the robotic structure, which is
presented in the work of the Robotic security framework, we
offer the following architecture of the robotic system, as
shown in Figure 1.
      </p>
      <p>
        The main differences are that we separately distinguish
such subsystems as: smart management and security system.
This is very important when assessing threats and
vulnerabilities since these subsystems are significantly
different from others. In addition, in the hardware system, we
single out separately computing mechanisms, a sensory
system and actuators, and auxiliary hardware [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. In the
case of a robotic system, it is not entirely correct to consider
hardware as a single subsystem. This is because the influence
of the sensory system and computing by the attacker
mechanisms or aggressive environments may vary and lead
to different outcomes, and therefore leads to various risks.
We define 10 security subsystems for a robotic system.
These subsystems are suitable precisely for that part of the
system where robots are represented. In our classification,
there are no protection subsystems associated with the
operator and the human factor. But we added such a
subsystem as trust management, in our opinion this is a very
important and basic subsystem. This is because robots are
often in an untrusted and uncertain environment and can be
captured. Therefore, it is very important that robots
communicate only with trusted agents. We consider each
module of the robotic system from the point of view of
criticality. We define three degrees of criticality for
evaluation:


      </p>
      <p>High - The implementation of an attack on a
particular security attribute will lead to serious
consequences such as denial of service, system
damage, system destruction, system malfunction,
control interception, system destruction, landing
system for further research and data collection, as
well as entail for itself damage in the field of state
security, in the field of defense, political field,
economic, man-made consequences.</p>
      <p>Medium - The implementation of an attack on a
particular security attribute will lead to minor
consequences such as a short-term system shutdown,
partial destabilization of the network due to the
failure of one or more mobile devices. The
introduction of an attacker can lead to disruption of
the system’s functioning, as well as to disrupt the
process of achieving goals. The application of a
destructive effect on the network, and a partial failure
of the system, as well as the implementation of the

attack, are detrimental in the field of economy,
reputation, and political.</p>
      <p>Low - The implementation of an attack on a particular
security attribute leads to minimal consequences such
as a partial destabilization of the network, short-term
interference with data transmission, as well as the
implementation of the attack is harmful in the social,
reputational and economic fields.</p>
    </sec>
    <sec id="sec-5">
      <title>ASSESSMENT OF THE LEVEL OF INITIAL SECURITY</title>
      <p>When identifying information security threats at the stage
of creating an information system (IS) in the case when
information protection measures are not implemented or
their sufficiency and effectiveness are not assessed, the
assessment of the possibility of realizing a threat, which is
characterized by how likely it is. Robotic IS with given
structural and functional characteristics and features of
functioning, is carried out relative to the level of initial
security of IS. The level of initial security is understood to be
the security of the IS, due to the structural and functional
characteristics set in the design and the conditions of its
operation. The level of initial security is determined based on
the analysis of design structural and functional characteristics.
During the creation of a robotic IS, the level of its initial
security is determined as follows, as described in table 1. It
is necessary to determine how to assess the impact of certain
factors on the structural and functional characteristics of the
information system and its operating conditions, such as
physical influence or the effect on the communication
channels of a robot. To assets this it is necessary to
determine the reason for assigning a characteristic to each
level. This can be done in an expert way, but in this study, it
was proposed to use the evaluation of factors. These factors
were chosen based on what effect an attacker could have on a
particular structural-functional characteristic. In determining
the level of initial security for each of the characteristics, it
was assessed whether the attacker could disrupt the
functioning of a particular characteristic according to these
factors: Violation of the hardware performance; Violation of
the software; Violation of communication channels;
Violation of the navigation system; Negative impact on the
robotic IS operator; Impact on data transmission process. The
results of the assessment of the impact of factors on the
structural and functional characteristics are presented in table
1.</p>
      <p>The result of the analysis of the structural and functional
characteristics of the robotic IS, the conditions of its
operation, as well as the effects of various factors on each of
the security levels of the robotic complexes, is table 2.
During the creation of a robotic IS, the level of its initial
security is determined as follows, as described below.
Robotic IS has a high level of initial security, if at least 80%
of IS characteristics correspond to the “high” level, and the
rest - to the average level.IS has an average level of initial
security, if the conditions under at least 90% of the
characteristics of the IS correspond to a level no lower than
“medium”, and the rest - to a low level of security.IS has a
low level of project security, if the conditions in “high” level
and “medium” level are not met.down to the next line. This
is the author sequence that will be used in future citations
and by indexing services.
software, which can be purchased online for as little as
$ 25.95.</p>
      <p>In 2011, Iran planted on its territory the American secret
UAV RQ-170 Sentinel, using such vulnerability as
GPSspoofing. As a result of these actions, the UAV automatically,
guided by the global navigation system, began returning
home. Since the true signal of the satellites was drowned out
by a false one, the RQ-170 took the Iranian airfield, taking it
as its “home” one.</p>
      <p>In 2013, Sami Kamkar used the Aircrack-ng utility to
hack the AR.Drone UAV wireless network, on the base of
the Raspberry Pi, a Wi-Fi transmitter and receiver. The
attacker explained that the quadcopters on the network could
be detected thanks to the peculiarities of their MAC address.
Special software monitors the MAC addresses of Wi-Fi
networks in the signal coverage area, and then blocks them
using its UAV and disconnects from the IOS or Android
device from which it was controlled. After that, the hacker
can control the direction, speed, and altitude of the flight of
the UAV, as well as receive an image from the cameras.</p>
      <p>In 2014, in the sky over the Crimea, the Russian military
managed to seize control of the American MQ-5B Hunter
UAV. Specialists from the University of Washington
managed to carry out a successful attack on the medical
robot Raven II, which is analogous to the robot Da Vinci. At
the first stage of the experiment, data packets addressed to
the Raven II robot were intercepted, which made it possible
to change their sequence during transmission. The robot
manipulator began to produce chaotic movements and ceased
to obey the doctor’s management. As a result, the specialists
managed to get full control over the actions of the Raven II,
and the impact on the robot turned out to be so serious that
the robot surgeon did not even react to the command to
reboot the system and continued to perform the actions
imposed on it.</p>
      <p>As from the incidents presented above, it is clear that to
cause damage for the robotic system is easy, even using
publicly available software. Thus, Figure 2 (a) shows the
result of determining which goals an attacker most often
pursues. pursues. From this diagram, many incidents in the
area of the violation of the security of robotic systems are
connected with the conduct of terrorist acts. Such statistics
say that first the interests of the state and civilians may be
affected.</p>
      <p>It is necessary to pay more attention to the security of
robotic systems, since so much depends on it. According to
the analysis, the attacker does not always need to develop a
means to attack himself or use special technical means.
Figure 2 (b) presents a diagram showing the results of the
analysis of indentations associated with robotic systems to
determine the capabilities of the intruder. From the diagram,
most of the incidents were carried out using software that is
freely available. To assess the complexity of the attack, we
introduce two evaluation criteria. Tools for conducting an
attack (T):</p>
      <p>• The attack is implemented by standard software
tools available on the Internet, which do not require
additional refinement, and use skills.</p>
      <p>• The attack is implemented by standard software
available on the Internet, requiring additional refinement, and
special skills of use.</p>
      <p>V. DEGREE OF DIFFICULTY OF ATTACK REALIZATION
In order to determine the degree of difficulty in
implementing an attack, it is necessary to understand what
goals and opportunities an attacker has. For this, a number of
incidents related to the violation of the safety of robotic tools
were considered. For example, in 2009 in Iran, the rebels,
using a data channel from the UAV to the ground control
center, managed to intercept the video data stream from the
UAV. At the same time, they used cheap SkyGrabber</p>
      <p>• The attack is implemented by software and
hardware available in the consumer market for purchase, not
requiring additional refinement, and skills of use.</p>
      <p>• The attack is implemented by software and
hardware available in the consumer market for purchase,
while requiring additional refinement, and special skills of
use.</p>
      <p>• The attack is carried out using specially developed
software tools.</p>
      <p>• The attack is carried out using specially developed
software and hardware.</p>
      <p>a)</p>
      <p>b)</p>
    </sec>
    <sec id="sec-6">
      <title>Staged implementation of the attack (S). • • access.</title>
    </sec>
    <sec id="sec-7">
      <title>The attack is implemented by remote access.</title>
      <p>The attack is implemented through direct physical
• The attack is implemented by directly affecting the
structural and functional characteristics.</p>
      <p>• The attack is implemented by indirectly affecting
the structural and functional characteristics (impact on
environmental parameters, etc.)</p>
      <p>• The attack is carried out by acting on one structural
- functional characteristic through another structural and
functional characteristic (multi-stage attack).</p>
      <p>VI.</p>
    </sec>
    <sec id="sec-8">
      <title>NEGATIVE CONSEQUENCES OF THE THREAT</title>
      <p>Next, you need to determine what consequences may
occur as a result of a particular attack. The following types of
damage are usually highlighted as one of the manifestations
of damage. We define the following types of damage and the
degree of their influence on the consequences that occur
because of the implementation of the attack:



</p>
    </sec>
    <sec id="sec-9">
      <title>Economic,</title>
    </sec>
    <sec id="sec-10">
      <title>Social,</title>
    </sec>
    <sec id="sec-11">
      <title>Political, Reputational,</title>
      <p>





</p>
    </sec>
    <sec id="sec-12">
      <title>Ecological,</title>
    </sec>
    <sec id="sec-13">
      <title>Technogenic,</title>
    </sec>
    <sec id="sec-14">
      <title>In the field of defense,</title>
    </sec>
    <sec id="sec-15">
      <title>State security.</title>
      <p>At the same time, for each type of damper, three degrees
are determined: low, medium, high. This characterization
should be evaluated by the system owner.</p>
      <p>In addition, the damage can be estimated considering the
value of the assets that the system owner has. We propose to
add to the standard set of resources an entity controlled by an
information system, or a product that is the result of work.
Adding this entity is important, because an attacker can, for
example, act on environmental parameters and introduce a
system that measures. And vice versa, the results of an attack
can affect the system that measures the environment, an
attacker can spoof data or block a network. In this case, the
management entity will be violated:
</p>
      <p>information;
 software and hardware (including automated
workstations, servers, including industrial, machine storage
media, telecommunications equipment and communication
lines, information display tools, programmable logic
controllers, production, technological equipment (executive
devices);
software;
information security tools;
supporting systems;
 the entity that is controlled by the information
system, or the product that is the result of the information
system (temperature, production results, gas supply, etc.).</p>
      <p>For each asset, three levels of value are also determined:
high, medium, low.</p>
      <p>VII.</p>
    </sec>
    <sec id="sec-16">
      <title>CONCLUSION AND FUTURE WORK</title>
      <p>As a result, having determined the values of the previous
evaluation criteria, we can determine the degree of danger of
the realization of the threat for each potentially dangerous
threat (PDT):</p>
      <p>PDT = (dd*va*dc + T*S)/ds
where dd - degree of damage, va- value of assets, dc
degrees of criticality, ds- design security</p>
      <p>In conclusion, it should be noted that robotic systems
differ significantly in their design and functionality from the
process control system, the Internet of things, etc. They are
usually equipped with an intelligent control system and
decision-making, which imposes additional security
requirements. Often robotic systems are mobile and can be
located outside the controlled area. In addition, many threats
arise in connection with the use of wireless communication
channels. This article attempted to structure information
about robotic systems, collected the maximum amount of
information from open sources, and carried out its
classification. An analysis of potential offenders, their goals
and capabilities revealed several important points. Due to the
peculiarities of the operation and the conditions for the
creation of robotic systems, they are very vulnerable to
attacks by the intruder. Robots have limited computing and
energy resources, and the use of software and hardware
protection tools is not at all possible. Thus, research and
development in this area is very relevant and necessary.</p>
      <p>In future work, we plan to supplement the risk
assessment process with a set of threats that are specific to
the robotic system. In previous works, we gave examples and
bases of such threats. In future work, we plan to supplement
the risk assessment process with a set of threats that are
specific to the robotic system. In previous works, we gave
examples and bases of such threats. And we also plan to
automate the process of determining current threats for given
conditions. To solve this problem, we plan to use machine
learning methods. Today, many industrial enterprises and
critical facilities are automated. In addition, the economic
effect of using automated systems has already been proven in
practice.</p>
    </sec>
    <sec id="sec-17">
      <title>ACKNOWLEDGMENT</title>
      <p>This work was supported by the RFBR grant
18-0700212 "Development of a method and decision protocol for
detecting anomalous node behavior in group control systems
for autonomous mobile robots".</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D.</given-names>
            <surname>Avery</surname>
          </string-name>
          , “
          <source>The Evolution of Flight Management Systems,” IEEE Software</source>
          , vol.
          <volume>28</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>11</fpage>
          -
          <lpage>13</lpage>
          ,
          <year>2011</year>
          . DOI:
          <volume>10</volume>
          .1109/MS.
          <year>2011</year>
          .
          <volume>17</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>E. M.</given-names>
            <surname>Amullen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Shetty</surname>
          </string-name>
          and
          <string-name>
            <given-names>L. H.</given-names>
            <surname>Keel</surname>
          </string-name>
          , “
          <article-title>Model-based resilient control for a multi-agent system against Denial of Service attacks</article-title>
          ,”
          <source>World Automation Congress (WAC)</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          ,
          <year>2016</year>
          . DOI:
          <volume>10</volume>
          .1109/ WAC.
          <year>2016</year>
          .
          <volume>7582963</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>U.</given-names>
            <surname>P. D. Ani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. M.</given-names>
            <surname>He</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Tiwari</surname>
          </string-name>
          , “
          <article-title>Review of cybersecurity issues in industrial critical infrastructure: manufacturing in perspective</article-title>
          ,
          <source>” Journal of Cyber Security Technology</source>
          , vol.
          <volume>1</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>32</fpage>
          -
          <lpage>74</lpage>
          ,
          <year>2016</year>
          . DOI:
          <volume>10</volume>
          .1080/23742917.
          <year>2016</year>
          .
          <volume>1252211</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>E.</given-names>
            <surname>Basan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Basan</surname>
          </string-name>
          ,
          <string-name>
            <surname>A</surname>
          </string-name>
          . Grutsynin, “
          <article-title>Overview of Information Issues for a Robotic System,”</article-title>
          <source>Proceedings of 19th Interantional Conference on Communication Technology (IEEE ICCT)</source>
          , pp.
          <fpage>1275</fpage>
          -
          <lpage>1280</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Basan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Basan</surname>
          </string-name>
          and
          <string-name>
            <given-names>O.</given-names>
            <surname>Makarevich</surname>
          </string-name>
          , “
          <article-title>Analysis of ways to secure group control for autonomous mobile robots</article-title>
          ,
          <source>” Proceedings of the 10th International Conference on Security of Information and Networks</source>
          , pp.
          <fpage>134</fpage>
          -
          <lpage>139</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.S.</given-names>
            <surname>Basan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.S.</given-names>
            <surname>Basan</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.A.</given-names>
            <surname>Stepenkin</surname>
          </string-name>
          , “
          <article-title>Analysis and implementation of threats for mobile robot management systems</article-title>
          ,
          <source>” Proceedings of the XIII Russian Scientific-practical Conference Mathematical Methods and Information Technology means</source>
          , pp.
          <fpage>20</fpage>
          -
          <lpage>23</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>K.</given-names>
            <surname>Faizal</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.L.</given-names>
            <surname>Palaniappan</surname>
          </string-name>
          , “
          <article-title>Risk Assessment and</article-title>
          Management in Supply Chain,” Global Journal of Researches in Engineering: G Industrial Engineering, vol.
          <volume>14</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>19</fpage>
          -
          <lpage>30</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>M.</given-names>
            <surname>Hagele</surname>
          </string-name>
          , “Robots conquer the world,
          <source>” IEEE Robotics &amp; Automation Magazine</source>
          , vol.
          <volume>23</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>118</fpage>
          -
          <lpage>120</lpage>
          ,
          <year>2016</year>
          . DOI:
          <volume>10</volume>
          .1109/MRA.
          <year>2015</year>
          .
          <volume>2512741</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>T.</given-names>
            <surname>Hoang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Kirichek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Paramonov</surname>
          </string-name>
          and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Koucheryavy</surname>
          </string-name>
          , “
          <article-title>Supernodes-based solution for terrestrial segment of flying ubiquitous sensor network under intentional electromagnetic interference</article-title>
          ,
          <source>” Proceedings of the ruSMART: Conference on Internet of Things Smart Spaces and NEW2AN: International Conference on Next Generation Wired/Wireless Networking</source>
          , pp.
          <fpage>351</fpage>
          -
          <lpage>359</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>H.</given-names>
            <surname>Holm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Karresand</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Vidström</surname>
          </string-name>
          and
          <string-name>
            <given-names>E.A.</given-names>
            <surname>Westring</surname>
          </string-name>
          , “Virtual Industrial Control System Testbed,” Swedish Defence Research Agency, Stockholm, Sweden,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>R.V.</given-names>
            <surname>Kirichek</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.E.</given-names>
            <surname>Kucheryavy</surname>
          </string-name>
          , “
          <article-title>Flying sensor networks</article-title>
          ,
          <source>” Electrosvyaz</source>
          , vol.
          <volume>11</volume>
          , pp.
          <fpage>2</fpage>
          -
          <lpage>5</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>L.</given-names>
            <surname>Liang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Song</surname>
          </string-name>
          , H. Hu, “
          <article-title>The state of the art of risk assessment and management for information systems</article-title>
          ,
          <source>” Proceedings of 9th International Conference on Information Assurance and Security (IAS)</source>
          , pp.
          <fpage>43</fpage>
          -
          <lpage>56</lpage>
          ,
          <year>2013</year>
          . DOI:
          <volume>10</volume>
          .1109/ISIAS.
          <year>2013</year>
          .
          <volume>6947735</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>R.</given-names>
            <surname>Mitchel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.R.</given-names>
            <surname>Chen</surname>
          </string-name>
          , “
          <article-title>Adaptive Intrusion Detection of Malicious Unmanned Air Vehicles Using Behavior Rule Specifications,” IEEE transactions on systems, man, and cybernetics: systems</article-title>
          , vol.
          <volume>44</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>2168</fpage>
          -
          <lpage>2216</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <article-title>“National Institute of Standards and Technology,” Framework for Improving Critical Infrastructure Cybersecurity, version 1</article-title>
          .1, pp.
          <fpage>1</fpage>
          -
          <lpage>48</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>V.</given-names>
            <surname>Pshikhopov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Medvedev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kolesnikov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Fedorenko</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Gurenko</surname>
          </string-name>
          , “
          <article-title>Decentralized control of a group of homogeneous vehicles in obstructed environment</article-title>
          ,
          <source>” Journal of Control Science and Engineering</source>
          , vol.
          <year>2016</year>
          , no.
          <issue>7192371</issue>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          ,
          <year>2016</year>
          . DOI:
          <volume>10</volume>
          .1155/
          <year>2016</year>
          /7192371.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>V.</given-names>
            <surname>Pshikhopov</surname>
          </string-name>
          and
          <string-name>
            <surname>A</surname>
          </string-name>
          . Al, “
          <article-title>Hybrid motion control of a mobile robot in dynamic environments</article-title>
          ,
          <source>” Proceedings of the IEEE International Conference on Mechatronics</source>
          , Istanbul, Turkey, pp.
          <fpage>540</fpage>
          -
          <lpage>545</lpage>
          ,
          <year>2011</year>
          . DOI:
          <volume>10</volume>
          .1109/ICMECH.
          <year>2011</year>
          .
          <volume>5971345</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>V.K.</given-names>
            <surname>Pshikhopov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.Y.</given-names>
            <surname>Medvedev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.R.</given-names>
            <surname>Gaiduk</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.V.</given-names>
            <surname>Gurenko</surname>
          </string-name>
          , “
          <article-title>Control system design for autonomous underwater vehicle</article-title>
          ,
          <source>” Proceedings of the Robotics Symposium and Competition (LARS/LARC)</source>
          , Arequipa, Peru, pp.
          <fpage>77</fpage>
          -
          <lpage>82</lpage>
          ,
          <year>2013</year>
          . DOI:
          <volume>10</volume>
          .1109/ LARS.
          <year>2013</year>
          .
          <volume>61</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>G.</given-names>
            <surname>Phillips-Wren</surname>
          </string-name>
          , “
          <article-title>Ai Tools in Decision Making Support Systems: a Review,”</article-title>
          <source>International Journal of Artificial Intelligence Tools</source>
          , vol.
          <volume>21</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          ,
          <year>2012</year>
          . DOI:
          <volume>10</volume>
          .1142/S0218213012400052.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>J.F.</given-names>
            <surname>Ruiz</surname>
          </string-name>
          , С. Rudolph, А. Maña, М. Arjona, “
          <article-title>A security engineering process for systems of systems using security patterns</article-title>
          ,
          <source>” Proceedings of IEEE International Systems Conference, рр. 1-8</source>
          ,
          <year>2014</year>
          . DOI:
          <volume>10</volume>
          .1109/SysCon.
          <year>2014</year>
          .
          <volume>6819228</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>Y.A.</given-names>
            <surname>Kropotov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.Y.</given-names>
            <surname>Proskuryakov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.A.</given-names>
            <surname>Belov</surname>
          </string-name>
          , “
          <article-title>Method for forecasting changes in time series parameters in digital information management systems</article-title>
          ,” Computer Optics, vol.
          <volume>42</volume>
          , no.
          <issue>6</issue>
          , pp.
          <fpage>1093</fpage>
          -
          <lpage>1100</lpage>
          ,
          <year>2018</year>
          . DOI:
          <volume>10</volume>
          .18287/
          <fpage>2412</fpage>
          -6179-2018-42-6-
          <fpage>1093</fpage>
          -1100.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>