<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Attack Protection Trees ?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Aliyu Tanko Ali</string-name>
          <email>aliyu.ali@fmph.uniba.sk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Damas Gruska</string-name>
          <email>gruska@fmph.uniba.sk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of applied informatics, Comenius University</institution>
          ,
          <country country="SK">Slovakia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this paper, an extended model for attack tree, called attack protection tree, is presented. The traditional attack trees threat model is extended with protection actions on the leaf nodes to protect the intermediate nodes from malicious attack. The proposed formalism allows the protection actions to be de ned at the leaf nodes, by doing so, eliminating the chances of attack(s) being successful through ORre nement. The concepts are illustrated through examples and we use a model checker for attack protection tree analyses.</p>
      </abstract>
      <kwd-group>
        <kwd>Attack trees</kwd>
        <kwd>attack-defence trees</kwd>
        <kwd>attack protection trees</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Security is a di cult topic to discuss and it remains a challenge to both users
and developers of modern systems. More than ever before, systems are
experiencing threats from both competitors (intellectuals theft), motivated hackers,
unintended mistakes done by users and governmental agencies as part of
cyber warfare between competing nations. Most of the system attacks are done
through existing vulnerabilities. Often, system developers relay on an informal
testing process to identify system vulnerabilities. However, a testing technique
can only certify that the system meets the business (user) requirements or can
only detect the presence of errors, and not their absence. As a result, it is di cult
to capture a potential threat to a system using a testing process.</p>
      <p>
        In recent times, the application of formal methods for the development and
veri cation of systems is gaining momentum. Formal methods are a
particular kind of mathematically based technique that is used for the speci cation,
development, and veri cation of complex systems. The systems are model as
mathematical entities such that; their properties can be proven and veri ed.
Using formal methods, it is possible to verify the system's properties in a more
thorough fashion than empirical testing. There are many diverse formal methods
and veri cation techniques for modeling and checking of security properties, one
of which is attack trees (ATs) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        Attack trees are formal methods used in modeling varying ways in which a
system can be attacked, in a tree structure. They are one of the popular formal
security engineering formalism used to reason about multi-step attack scenarios.
AT is rst introduced by Schneier [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] to provide a formal way of describing the
security of a system, they are best known for their graphical representation of
attack in a tree structure where the root node of the tree is the target goal
of an attacker. Intermediate nodes (sub-trees) are re nements of this goal, and
leaf nodes representing the attacker's actions (also called basic actions). An
attacker interacts with the system (tree) through the leaf nodes. Schneier de ned
the re nement of nodes in attack tree to be of two types: AND (conjunctive)
and OR (disjunctive). In order to reach the root node, all of its AND children
(aggregation) or at least one of its OR children (choice) must be accomplished.
      </p>
      <p>In the literature, di erent symbols are used to represents attack tree
diagrams. For instance, logic gate symbols can be used to represents nodes (goal,
sub-goal) instead of the used of conventional circle or rectangle, while in some
paper, a rectangle with the gate symbol just below it is used.</p>
      <p>
        ATs are straightforward, and easy to work with, these results to them being
adopted and used by non-security professionals in both academia and industry
to model many practical case studies such as automated teller machine (ATMs)
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], SCADA communication systems [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], BGP routing protocols [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], to name a
few. One of the most important features of attack trees is to provide a simple
and non-technical way of understanding security problems in IT systems.
However, the overwhelming growth of vulnerabilities in modern systems is increasing
spontaneously. As well as ATs lack the expressing power to represents the order
in which attacks are executed (sequential, parallel), attack deference strategy,
etc. Furthermore, there is little work done in both the industrial and academic
literature on extending the use of attack trees beyond depicting ways in which
threats can be identi ed.
      </p>
      <p>Related work. There are several discussions about general issues and
challenges in the use of attack trees for threat modeling. The basic formalism of ATs
does not include any defence mechanisms. It can only statically shows varying
ways in which a system can be attacked. Ever since the introduction of ATs, a
wide range of research areas has emerged from them, this includes; threat
modeling, extending re nement with introduced new gates to cover di erent attack
scenarios, using attack trees to analyze probabilistic attack to systems, to name
a few. We will look at some of the work done in these areas.</p>
      <p>
        Threat modeling. One of the common practices for assessing risk in
businesses or systems is through the use of risk management techniques, and there
exist several processes for identifying and prioritizing risks. The concept of threat
modeling is one of those processes. Traditionally, it involved the use of
theoretical and mathematical concepts. Several research and projects adopted the use of
attack trees to this end. For example, the work in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] used attack tree to identify
possible attacks to automated teller machine (ATMs), SCADA communication
systems attacks using attack trees was presented in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], BGP routing protocols
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and medical implant in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        Extending attack trees. Several attack tree extensions have been proposed,
amongst which are attack-defence trees (ADT) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], attack response tree (ART)
and attack countermeasures tree (ACT) [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. ADT is an extension of attack trees
that include, not only the attackers' actions but also the defenders' actions
and model their interplay in the form of game theory portraying the
attackerdefenders repelling each other move [
        <xref ref-type="bibr" rid="ref2 ref6 ref7">6, 2, 7</xref>
        ]. ACT, on the other hand, extends
the defence tree with countermeasures to mitigate attackers' actions. Attack
response tree (ART) formalism extends the attacker-defender game to nd an
optimal policy from a list of countermeasures. ART is not popular as they
suffer a state-space explosion problem. The work in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] used defence tree for the
evaluation of Information Technology (IT) security investments, sequential
conjunction SAND gates were introduced in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] to model attacks that are executed
in an orderly manner.
      </p>
      <p>
        Quantitative and qualitative analysis. An excellent survey on attack trees
and related formalism was presented by Kordy et al. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. The work in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] model
the attackers' behaviour by introducing temporal order to the attackers'
decisionmaking process. In another e ort, attack net for penetration texting was
introduced in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. A time-dependent technique to analyze attack time was presented
in [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. A large number of AT analysis and veri cation frameworks has been
developed, model-driven engineering approach [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ],timed automata [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], Petri nets
[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] e.t.c. There have been quite a several tools developed for verifying di erent
attack scenarios. ADTool is free, open-source software assisting graphical
modeling and quantitative analysis of security properties using attackdefence trees,
others include SeaMonster[
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] and, ATSyRa [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. The work in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] introduced
SPTool, an equivalence model checker for SAND ATs and attack trees in Isabel
is presented in [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>Aim. This paper aims to go beyond attack trees, identify varying ways in which
a system can be attacked and also de ning a set of protection actions at the
point at which the attacker interacts with the system. We plan to achieve this in
two ways, rstly we will adopt the concept of attack trees and introduce
protection actions to counter basic attack steps. Secondly, we will use a model checker
to model our approach, verifying whether the designed protection actions are
satis ed in the model and also if the attackers' actions can lead to an
undesirable state. The results obtained in this work will serve as preliminary work
that will further investigate towards dynamic attackers' actions. We also plan to
investigate the notion of time, the ow of information within the system. This is
particularly interesting because attack trees only represent static varying ways in
which a system can be attacked while the attackers' actions are dynamic. Also,
there are di erent ways in which information systems can be attacked which is
almost impossible to be captured using attack trees; for example side-channel
attacks.</p>
      <p>This paper is organized as follows, section 1 provides an introduction and
related work on the use of attack trees for threat modeling. Section 2 provides a
review of the concepts of attack tree, we de ned attack protection tree in section
3. Section 4 analyses attack protection tree using UPPAAL model checker and
end the section with the conclusion and future work direction.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Attack Trees</title>
      <p>In this section, we provide a gentle introduction to attack trees and de ne the
working formalism of attack protection tree. Attack Tree (AT) is a
methodological way of describing the security of a system on di erent varying attacks with
a clear path description of possible ways to refute them. As the name implies, it
is represented in the form of a tree (read bottom-up), with the root node as the
attack target, children nodes (sub-goals) and leaf. The goal of an attacker is to
reach to the root node, children nodes are the re nement of the root node. For
any successful attack, the conditions (OR, AND) on the children nodes have to
be satis ed.</p>
      <p>
        The underlying concept of attack tree threat modeling is similar to that of
popular divide and conquer technique [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] where a problem is recursively broken
down into smaller problems that are theoretically simpler to reason about and
solve. Although, unlike divide and conquer technique, AT consist of two types
of nodes:
{ Event nodes: This is made up of basic attack steps (BASs), intermediate
events and top event. The BASs model malicious actions carried out by the
attacker and they are modelled as the leaves of AT. The intermediate events
are caused as the results of the achievement of BASs and are referred to as
internal nodes, sub-goals or child nodes and nally, the top event is modelled
as the root of the tree.
{ Gate nodes: The gates combined the BASs, representing how and in which
temporal order the successful execution of BASs results in the compromise
of node above (parent node). The OR and AND are two of the most popular
gates used to modelled simple attacks. OR gates represent di erent ways
and the AND to represent necessary steps toward achieving (sub)goal. For
a successful attack to be carried out through an AND-gate, the attacker has
to succeed in all of its child nodes, while through the OR-gate requires the
attacker to execute at least one child node successfully. Other gate extensions
such as SOR and SAND were introduced to model the sequential attack
process.
      </p>
      <p>
        Besides presenting the visual attack scenarios to a system, attack trees can also
be used as formal models with assigned semantics that can be used to answer
several quantitative and qualitative questions such as; "What is the probability
of reaching to the top node? [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], What is the cheapest attack cost? [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], Which
attacks do not require special equipment to execute an attack? [
        <xref ref-type="bibr" rid="ref21 ref22">22, 21</xref>
        ] e.t.c.
The work in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] introduced attack-defence trees to analyze threats and provide
countermeasures to attacks on ATMs, the work extended attack trees by adding
countermeasure nodes and termed it as defence trees. The defence methods only
have OR relationships with the leaf(s) it is said to defend, meaning once the
countermeasures failed as a result of introducing another attack vector, the
defence mechanism will fail as well. For example, in the black box attack, a sensor
to detect ATM modules deactivation can be spoofed and that can result in a
failed defence mechanism.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Attack Protection Tree (APT)</title>
      <p>In this section, we de ne the working formalism of attack protection trees.
Firstly, we introduce some notations that will be used to formalise the attack
protection tree de nition.
3.1</p>
      <sec id="sec-3-1">
        <title>APT formalism</title>
        <p>APT is an extension of attack trees with protection actions. As stated in the
previous section, the root node is the attackers' ultimate goal, intermediate nodes
represent sub-goals necessary to achieve the root node. We exclusively de ne
leaf nodes as the point of interaction between an attacker and the tree. An
attacker can only in uence the tree by interacting with the leaves. All other
nodes are derived from attacker actions, meaning, only by successfully achieving
the leaf node(s) does the attacker move to the next node (intermediate). Hence,
an attacker cannot penetrate the attack tree at intermediate nodes. We formalise
APT as follows.</p>
        <p>An attacker denoted by A, is an outsider that interact with the system to
per-take in malicious activities. A defender denoted by D, could be either human
or automated designed to counter the attackers' actions. We represent the set of
actions which can be performed by an attacker as B. While the set of defenders
(protection) actions as P. We denoted by L = fs1; :::; sng the set of leaves
in the tree. The attackers' actions are de ned on the leaf nodes as a function
A : L ! 2B, and protection actions are associated with the leaves to block the
attackers' action D : L ! 2P . This interprets that an attacker try to perform on
a given leaf node action b 2 A(s), and that there is a protection action assigned
by the defender 2 D(s) that will block the malicious activity. For simplicity,
we denoted this as s =b. Whereas for a leaf s, if each b 2 A(s) is associated
with protection action 2 D(s) then the leaf is said to be protected, denoted as
s ` (A; D). For instance, protection action 2 P to password attack (attackers'
action b) could be multi-factor authentication. The general syntax of APT
is generated by the following.</p>
        <p>T = op(S (t(S1); :::::; t(SN )))
(1)
Where T is a tree, op = fAN D; ORg, is the gates re nement, each node which
is not a leaf is either AND or OR node. S is the root of the tree (goal) and
t(Si) is a subtree/ intermediate (I) with the root Si. Based on this syntax, we
de ne attack protection trees as follows;
De nition 1. An attack protection tree is a tuple T = (S ; E; B; P; A; D). Where
S = fS g [ fIg [ fLg is the set of nodes, E is the set of edges that link two
nodes in the tree, B; P are the disjoint actions of the attacker and the defender.
A; D representing the attacker A : L ! 2B and defender D : L ! 2P respectively.</p>
        <p>Lets assume Sfs1; ::::sng is an intermediate node with set of leaves. The
intermediate node S is said to be secure if 8si; 8b 2 A(si):f9 2 D(si) : si =bg (i.e.
for each si we have si ` (A; D)). This is being denoted as S ` (A; D).
Another instance of malicious activity password attack can be viewed as the
goal of an attacker A. To achieve this, some basic actions b 2 B has to be
carried out such as brute force. We can de ne more protection action to defend
against this attack. Example, the protection actions 2 P for brute force
could be restricting the number of times the attacker can make an attempt or
using a delay in between the actions and additional password masking as a
protection action to the password attack.</p>
        <p>Example 1. Consider Fig 1 were a tree with two child nodes and three leaf nodes
is depicted. we presented in equation (2) the corresponding attack protection tree
construction that can captured both the attacker actions and the protection
actions.</p>
        <p>S (S1(s =b; s =b); (S2(s =b)):
(2)</p>
        <p>Assuming that gates OR, AND (denoted by _; ^) construction are included
in the nodes, the semantics representation of the tree in equation (2) is as follows;
S _(S1(s =b; s =b)); (S2(s =b)) = S f(S1)=P _ (S2)=Pg;
S ^(S1(s =b; s =b)); (S2(s =b)) = S f(S1)=P ^ (S2)=Pg:
(3)</p>
        <p>Note that, this is di erent from inserting a defence node on an attack path
as each intermediate (sub-tree) node S1; S2 in the tree will be protected by
protection action(s) at the leaf nodes, as shown in Fig 2.</p>
        <p>
          Example 2. To demonstrate further example using this approach, we look at an
IoT device compromise (see Fig. 3), whose attack tree was presented in [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
We work with the same set(s) of goal, sub-goals and leafs presented in the paper
and, introduced sets of basic attackers actions and protection actions which can
be seen in Table 1.
        </p>
        <p>The goal (S ) of the attack is to compromise an IoT device, the
intermediate nodes (attack re nement) includes; access home network as (S1), gain access
to a private network (S2), access LAN (S3) and access WAN (S4). The leaf nodes
are; exploit software vulnerabilities (s1), run malicious scripts (s2), get
credentials (s3), nd LAN access point (s4), spoof MAC address (s5), nd WAN (s6),
and break WPA keys (s7). Attackers' point of interaction with the tree is at the
leaf(s) nodes and therefore, protection at the attackers' point of interaction with
the tree (leaves) will be reduced drastically the possibility of the system being
compromised. As it is often the case in security analysis, it is di cult to obtain
precise data (all basic action and protection action), and our guesses are not
intended to re ect reality, but rather to illustrate our formalism.</p>
        <p>S ^(S1^(s 1=b1 ; S2_(S3^(s 2=b2 ; s 3=b3 ); S4^(s 4=b4 ; s 5=b5 ))); s 6=b6 ; s 7=b7 ):
(4)</p>
        <p>Securing the leaf node (in our belief) provide better protection rather than
a single defence node to protects the intermediate node, by applying
protection actions at each leaf node, the risk of an attack occurring through the OR
re nement will be eliminated.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Analysing Attack Protection Trees via Automata</title>
      <p>
        Formal methods play an essential role in developing safety-critical systems. At
the heart of formal methods, (formal) speci cation and veri cation are used to
model and analyse security, safety, and system behaviour. Model-checking has
proven to be a successful technique for requirements veri cation, design, and
analysis for various real-time systems [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. Although at this point, we did not
consider attributes for attack protection tree, we make use of UPPAAL [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ],
a model checker, to analyze attack protection trees. One of the strengths of
UPPAAL is; the ability to model systems with quantitative attributes (time,
cost. e.t.c).
      </p>
      <p>
        We provide a compositional semantics of APT in terms of nite-state
automata (FSM). We translate the entire APT element into an FSM and then
analyse the APTs by formulating security and safety properties of interest as
queries in CTL logic [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
      </p>
      <p>
        As an example, consider a modern critical infrastructure where di erent
independent systems made up of a larger critical system that is essential for the
functioning of a society and economy [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]. Sometimes, these systems can be
composed of di erent inter-dependent components (systems) to provide
better performance. For example, agriculture and water supply; modern irrigation
systems (agriculture) heavily depend on the use of water (water supply) from
sources such as a local reservoir or dams. However, cyber-attacks are considered
one of the major threats and most challenging problems to such critical
infrastructures. To model and analyze this system using attack protection tree, we
partition it into 3 three; the infrastructure model, the attacker model, and the
protection model.
4.1
      </p>
      <sec id="sec-4-1">
        <title>Infrastructure model</title>
        <p>The infrastructure model provides an abstract interaction view of the behaviour
of di erent components in the system. Using UPPAAL, we model these
components as locations, create channels that synchronise B 2 A to indicates the
desire of the attacker to in uence the locations. In Fig 4, we presented the
infrastructure model in UPPAAL, we created 4 channels (attck, succ, unsucc,
attack failed) and use them to trace the attackers actions. The attck
channel is for initiating the action, succ channel synchronises successful actions of
the attacker while the failed actions are passes through unsucc channel. The
attack failed channel returns the attacker to the initial location. The
locations in Fig. 4 for the infrastructure model are; S0; S1; S2; S3. S0 indicates the
initial state where the attacker execute actions, when the actions are successful,
In the case of protection action 2 D(s) is true on b 2 A(s), the attacker will
be left with no option since the transition will be to failed location. S1 and S2
are intermediate locations which could be reach depending the actions of the
attacker, while S3 is represent the target goal.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Attacker model</title>
        <p>Since the attacker has no strong in uence on the system without b 2 A(s) being
successful, successful execution of the action will results in a transition to the
next location while unsuccessful will force the system to failed location. The
attacker model in Fig. 4 models the behaviour of the received broadcast from
the infrastructure model.
As for the protection model, the main aim is to have a protection action that
will counter the basic action of the attacker. We set this as a guard condition,
depicted as protect model in one of the sections in Fig 4. In the Figure, the
expression a == f alse at location S0 ! S1 restrict the transition of attck while
be possible only then the variable a is false while the assignment b = f alse, is
an update whenever the basic action is failed in the attack failed.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and future work</title>
      <p>This paper provides a gentle introduction to attack protection tree, we formalise
the de nition and apply the concept in some examples. As for this work, we
did not consider scenarios concerning a given parameter (quanti cation) to
analyze APT. As earlier mentioned, this work serves as preliminary for the future
work ahead. We plan to extend APT to analyze case studies incorporating
realistic values, dynamic attackers' actions. Furthermore, we plan to introduce time
information in the future.</p>
      <p>This is particularly interesting because attack trees only represent static
varying ways in which a system can be attacked. Applying realistic values will allow
us to analyze properties such as time, cost, di culty, etc. At the same time, since
the attackers' actions are dynamic, we will investigate the timing of actions in
the system. This will lead our work to study information ow properties as a
new way in which a system can be attacked, we will model the system with
scenarios whereby some attacks/ protection could be available only in some given
time. Hence we plan to associate with functions A; D other parameters such as
time, cost, e.t.c. For example, by A(s; t) and D(s; t) we will express attacker's
and defender's actions at time t, respectively.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Bruce</given-names>
            <surname>Schneier</surname>
          </string-name>
          .
          <article-title>Attack trees</article-title>
          .
          <source>Dr. Dobbs journal</source>
          ,
          <volume>24</volume>
          (
          <issue>12</issue>
          ):
          <volume>21</volume>
          {
          <fpage>29</fpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Marlon</given-names>
            <surname>Fraile</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Margaret</given-names>
            <surname>Ford</surname>
          </string-name>
          , Olga Gadyatskaya, Rajesh Kumar, Marielle Stoelinga, and
          <string-name>
            <surname>Rolando</surname>
          </string-name>
          Trujillo-Rasua.
          <article-title>Using attack-defense trees to analyze threats and countermeasures in an atm: a case study</article-title>
          .
          <source>In IFIP Working Conference on The Practice of Enterprise Modeling</source>
          , pages
          <volume>326</volume>
          {
          <fpage>334</fpage>
          . Springer,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Chee-Wooi</surname>
            <given-names>Ten</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen-Ching Liu</surname>
            , and
            <given-names>Manimaran</given-names>
          </string-name>
          <string-name>
            <surname>Govindarasu</surname>
          </string-name>
          .
          <article-title>Vulnerability assessment of cybersecurity for scada systems using attack trees</article-title>
          .
          <source>In 2007 IEEE Power Engineering Society General Meeting</source>
          , pages
          <fpage>1</fpage>
          <article-title>{8</article-title>
          . IEEE,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Arpan</given-names>
            <surname>Roy</surname>
          </string-name>
          ,
          <article-title>Dong Seong Kim, and Kishor S Trivedi. Attack countermeasure trees (act): towards unifying the constructs of attack and fense trees</article-title>
          .
          <source>Security and Communication Networks</source>
          ,
          <volume>5</volume>
          (
          <issue>8</issue>
          ):
          <volume>929</volume>
          {
          <fpage>943</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Muhammad</given-names>
            <surname>Ali</surname>
          </string-name>
          <string-name>
            <surname>Siddiqi</surname>
          </string-name>
          , Robert M Seepers,
          <string-name>
            <given-names>Mohammad</given-names>
            <surname>Hamad</surname>
          </string-name>
          , Vassilis Prevelakis, and
          <string-name>
            <given-names>Christos</given-names>
            <surname>Strydis</surname>
          </string-name>
          .
          <article-title>Attack-tree-based threat modeling of medical implants</article-title>
          .
          <source>In PROOFS@ CHES</source>
          , pages
          <volume>32</volume>
          {
          <fpage>49</fpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Zaruhi</given-names>
            <surname>Aslanyan</surname>
          </string-name>
          and
          <string-name>
            <given-names>Flemming</given-names>
            <surname>Nielson</surname>
          </string-name>
          .
          <article-title>Pareto e cient solutions of attack-defence trees</article-title>
          .
          <source>In International Conference on Principles of Security and Trust</source>
          , pages
          <volume>95</volume>
          {
          <fpage>114</fpage>
          . Springer,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Stefano</given-names>
            <surname>Bistarelli</surname>
          </string-name>
          , Marco DallAglio, and Pamela Peretti.
          <article-title>Strategic games on defense trees</article-title>
          .
          <source>In International Workshop on Formal Aspects in Security and Trust</source>
          , pages
          <fpage>1</fpage>
          <lpage>{</lpage>
          15. Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Barbara</given-names>
            <surname>Kordy</surname>
          </string-name>
          , Piotr Kordy, and Yoann van den Boom.
          <article-title>Sptool{equivalence checker for SAND attack trees</article-title>
          .
          <source>In International Conference on Risks and Security of Internet and Systems</source>
          , pages
          <fpage>105</fpage>
          {
          <fpage>113</fpage>
          . Springer,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Stefano</given-names>
            <surname>Bistarelli</surname>
          </string-name>
          , Fabio Fioravanti, and
          <string-name>
            <given-names>Pamela</given-names>
            <surname>Peretti</surname>
          </string-name>
          .
          <article-title>Defense trees for economic evaluation of security investments</article-title>
          .
          <source>In First International Conference on Availability, Reliability and Security (ARES'06)</source>
          , pages
          <fpage>8</fpage>
          <lpage>{</lpage>
          pp.
          <source>IEEE</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Ravi</surname>
            <given-names>Jhawar</given-names>
          </string-name>
          , Barbara Kordy, Sjouke Mauw, Sasa Radomirovic, and
          <string-name>
            <surname>Rolando</surname>
          </string-name>
          Trujillo-Rasua.
          <article-title>Attack trees with sequential conjunction</article-title>
          .
          <source>In IFIP International Information Security and Privacy Conference</source>
          , pages
          <volume>339</volume>
          {
          <fpage>353</fpage>
          . Springer,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Aivo</surname>
          </string-name>
          <article-title>Jurgenson and Jan Willemson</article-title>
          .
          <article-title>Serial model for attack tree computations</article-title>
          .
          <source>In International Conference on Information Security and Cryptology</source>
          , pages
          <volume>118</volume>
          {
          <fpage>128</fpage>
          . Springer,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>James P McDermott.</surname>
          </string-name>
          <article-title>Attack net penetration testing</article-title>
          .
          <source>In NSPW</source>
          , pages
          <volume>15</volume>
          {
          <fpage>21</fpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Florian</surname>
            <given-names>Arnold</given-names>
          </string-name>
          , Holger Hermanns, Reza Pulungan, and Marielle Stoelinga.
          <article-title>Timedependent analysis of attacks</article-title>
          .
          <source>In International Conference on Principles of Security and Trust</source>
          , pages
          <volume>285</volume>
          {
          <fpage>305</fpage>
          . Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Rajesh</surname>
            <given-names>Kumar</given-names>
          </string-name>
          , Stefano Schivo, Enno Ruijters, Bura Mehmet Yildiz, David Huistra,
          <string-name>
            <given-names>Jacco</given-names>
            <surname>Brandt</surname>
          </string-name>
          , Arend Rensink, and Marielle Stoelinga.
          <article-title>E ective analysis of attack trees: A model-driven approach</article-title>
          . In International Conference on Fundamental Approaches to Software Engineering, pages
          <volume>56</volume>
          {
          <fpage>73</fpage>
          . Springer, Cham,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Olga</surname>
            <given-names>Gadyatskaya</given-names>
          </string-name>
          , Rene Rydhof Hansen, Kim Guldstrand Larsen, Axel Legay, Mads Chr Olesen, and
          <article-title>Danny B gsted Poulsen</article-title>
          .
          <article-title>Modelling attack-defense trees using timed automata</article-title>
          .
          <source>In International Conference on Formal Modeling and Analysis of Timed Systems</source>
          , pages
          <fpage>35</fpage>
          {
          <fpage>50</fpage>
          . Springer,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Florian</surname>
          </string-name>
          <article-title>Kammuller. Attack trees in isabelle</article-title>
          .
          <source>In International Conference on Information and Communications Security</source>
          , pages
          <volume>611</volume>
          {
          <fpage>628</fpage>
          . Springer,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17. GC Dalton, Robert F Mills, John M Colombi, Richard A Raines, et al.
          <article-title>Analyzing attack trees using generalized stochastic petri nets</article-title>
          .
          <source>In Information Assurance Workshop</source>
          , pages
          <volume>116</volume>
          {
          <fpage>123</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18. Per Hakon Meland, Daniele G Spampinato,
          <article-title>Eilev Hagen</article-title>
          , Egil Trygve Baadshaug,
          <string-name>
            <surname>Krister-Mikael Krister</surname>
          </string-name>
          , and Ketil Sandanger Velle. Seamonster:
          <article-title>Providing tool support for security modeling</article-title>
          .
          <source>Norsk informasjonssikkerhetskonferanse, NISK</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Sophie</surname>
            <given-names>Pinchinat</given-names>
          </string-name>
          , Mathieu Acher, and
          <string-name>
            <given-names>Didier</given-names>
            <surname>Vojtisek</surname>
          </string-name>
          .
          <article-title>Atsyra: an integrated environment for synthesizing attack trees</article-title>
          .
          <source>In International Workshop on Graphical Models for Security</source>
          , pages
          <volume>97</volume>
          {
          <fpage>101</fpage>
          . Springer,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Xiaochun</surname>
            <given-names>Wang</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Xiali</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D Mitchell</given-names>
            <surname>Wilkes</surname>
          </string-name>
          .
          <article-title>A divide-and-conquer approach for minimum spanning tree-based clustering</article-title>
          .
          <source>IEEE Transactions on Knowledge and Data Engineering</source>
          ,
          <volume>21</volume>
          (
          <issue>7</issue>
          ):
          <volume>945</volume>
          {
          <fpage>958</fpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Vineet</surname>
            <given-names>Saini</given-names>
          </string-name>
          , Qiang Duan, and
          <string-name>
            <given-names>Vamsi</given-names>
            <surname>Paruchuri</surname>
          </string-name>
          .
          <article-title>Threat modeling using attack trees</article-title>
          .
          <source>Journal of Computing Sciences in Colleges</source>
          ,
          <volume>23</volume>
          (
          <issue>4</issue>
          ):
          <volume>124</volume>
          {
          <fpage>131</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Arpan</surname>
            <given-names>Roy</given-names>
          </string-name>
          ,
          <article-title>Dong Seong Kim, and Kishor S Trivedi. Cyber security analysis using attack countermeasure trees</article-title>
          .
          <source>In Proceedings of the Sixth Annual Workshop on Cyber Security and Information Intelligence Research, page 28. ACM</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Anders</surname>
            <given-names>Hessel</given-names>
          </string-name>
          , Kim G Larsen,
          <article-title>Marius Mikucionis</article-title>
          , Brian Nielsen, Paul Pettersson, and
          <string-name>
            <given-names>Arne</given-names>
            <surname>Skou</surname>
          </string-name>
          .
          <article-title>Testing real-time systems using uppaal</article-title>
          .
          <source>In Formal methods and testing</source>
          , pages
          <volume>77</volume>
          {
          <fpage>117</fpage>
          . Springer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Gerd</surname>
            <given-names>Behrmann</given-names>
          </string-name>
          , Alexandre David, Kim Guldstrand Larsen, John Hakansson, Paul Pettersson,
          <source>Wang Yi, and Martijn Hendriks. Uppaal 4.0</source>
          .
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <given-names>Francois</given-names>
            <surname>Laroussinie</surname>
          </string-name>
          and
          <string-name>
            <given-names>Ph</given-names>
            <surname>Schnoebelen</surname>
          </string-name>
          .
          <article-title>Speci cation in ctl+ past for veri cation in ctl</article-title>
          .
          <source>Information and Computation</source>
          ,
          <volume>156</volume>
          (
          <issue>1-2</issue>
          ):
          <volume>236</volume>
          {
          <fpage>263</fpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26. John Mote , Claudia Copeland,
          <string-name>
            <given-names>and John</given-names>
            <surname>Fischer</surname>
          </string-name>
          .
          <article-title>Critical infrastructures: What makes an infrastructure critical</article-title>
          ? Library of Congress Washington DC Congressional Research Service,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>