<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Minimal Structurally Overdetermined Sets Selection for Distributed Fault Detection</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Hamed Khorasgani</string-name>
          <email>hamed.g.khorasgani@vanderbilt.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gautam Biswas</string-name>
          <email>gautam.biswas@vanderbilt.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Daniel Jung</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dept. of Electrical Engineering, Linkoping University</institution>
          ,
          <country country="SE">Sweden</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Institute of Software Integrated Systems, Vanderbilt University</institution>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <fpage>75</fpage>
      <lpage>82</lpage>
      <abstract>
        <p>This paper discusses a distributed diagnosis approach, where each subsystem diagnoser operates independently without a coordinator that combines local results and generates the correct global diagnosis. In addition, the distributed diagnosis algorithm is designed to minimize communication between the subsystems. A Minimal Structurally Overdetermined (MSO) set selection approach is developed as a Binary Integer Linear Programming (BILP) optimization problem for subsystem diagnoser design. For cases, where a complete global model of the system may not be available, we develop a heuristic approach, where individual subsystem diagnosers are designed incrementally, starting with the local system MSOs and progressively extending the local set to include MSOs from the immediate neighbors of the subsystem. The inclusion of additional neighbors continues till the MSO set ensures correct global diagnosis results. A multi-tank system is used to demonstrate and validate the proposed methods.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>The Minimal Structurally Overdetermined (MSO) sets
approach has been used extensively for designing model based
fault detection and isolation (FDI) schemes for complex
systems [Krysander et al., 2008a; Krysander et al., 2008b;
Svard et al., 2012]. However, for large complex systems
such as aircraft and other transportation systems,
manufacturing processes, supply chain and distribution networks,
and power generation and the power grid it is becoming
imperative to develop distributed approaches to monitoring
and diagnosis to overcome the need for complete global
models, while also addressing computational complexity
and reliability problems for the diagnosers [Leger et al.,
1999; Shum et al., 1988; Deb et al., 1998; Lanigan et al.,
2011].</p>
      <p>Unlike centralized approaches, distributed approaches are
more reliable because they avoid single points of failure.
In addition, they can reduce the problems of noise,
corruption, and losses that can occur when transmitting
signals from individual subsystems to a centralized fault
diagnosis unit. Measurement noise and signal corruption can
significantly affect diagnoser robustness and
accuracy[Ferrari et al., 2012]. Transmission delays not only increase
detection time, but can also affect the order of detection,
which can further affect diagnostic accuracy. Detection time
is important for the safe and reliable operation of
safetycritical systems. Faster fault detection and isolation
enables accompanying fault tolerant control units to react in
a timely manner, thus reducing damage and down time of
systems [Roychoudhury et al., 2009; Daigle et al., 2007;
Duarte Jr and Nanya, 1998; Rish et al., 2005; Bregon et al.,
2014]. The computational intractability of building
centralized diagnosers for the large systems is another important
reason to develop distributed solutions for FDI problems.</p>
      <p>In this paper, we formulate the distributed minimal
structurally overdetermined set selection as a binary integer
linear programming (BILP) problem [Wolsey, 1998]. The
approach efficiently picks a minimal number of measurements
from a subsystem and its neighboring subsystems to develop
a local diagnoser for each subsystem of the larger, complex
dynamic system. We start with an efficient algorithm
designed by [Krysander et al., 2008a] for finding minimally
overdetermined sets of constraints to generate the minimal
structurally overdetermined (MSO) sets for designing the
diagnoser. Other researchers have employed binary
integer programming and binary linear integer programming for
optimal sensor placement for fault detection and isolation
[Sarrate et al., 2007; Rosich et al., 2009]. In this paper, we
utilize BILP for distributed MSO selection to facilitate an
efficient distributed diagnosis approach.</p>
      <p>Our method is designed in a way that the subsystem
diagnosers, once designed can operate independently with no
communication with the other subsystem diagnosers (other
than a minimal number of shared measurements), but still
provide globally correct diagnosis results. Unlike
[Lafortune, 2007; Debouk et al., 2000; Indra et al., 2012] this
method does not require the use of a centralized
coordinator during on-line operations. Therefore, we avoid the
single point-of-failure problem of centralized diagnosers. Our
method assumes the availability of a global system model
from which the set of MSOs for the system can be derived.
The independent subsystem diagnosers are designed to
minimize the sharing of measurements across subsystems, thus
decreasing the cost, and increasing the reliability of the
overall system diagnosis.</p>
      <p>However, global models of a complex system are hard to
construct and may not be readily available. Subsystems are
often provided by different manufacturers, who are not
willing to pass along all of the intellectual property associated
with the subsystem to the system integrator. Therefore, to
avoid the unrealistic assumption that the complete model of
the complex system is available for subsystem diagnoser
design, we propose a second algorithm that constructs the
individual subsystem diagnosers without assuming the
availability of a global model. The modified algorithm is
computationally more efficient, but we cannot guarantee that the
shared measurements between the subsystems is minimal
globally (i.e., across the entire system).</p>
      <p>The rest of this paper is organized as follows. The
background material, definitions and the running example, a
four-tank system, are presented in Section 2. The distributed
diagnosis problem formulation is presented in Section 3.
Algorithm 1 for distributed MSO set selection is described in
Section 4. The heuristic modifications to Algorithm 1 given
the global model is not available is presented in Section 5 as
the incremental algorithm. Section 6 discusses the
contributions of the paper in relation to previous work, and presents
the conclusion of the paper.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Background</title>
      <p>This section introduces the basic concepts associated with
MSO set selection for structural diagnosis of dynamic
systems. The system model S is defined as follows.
Definition 1 (System model). A system model S is a
fourtuple: (V , M , E, F ), where V is the set of variables, M is
the set of measurements, E is the set of equations and F is
the set of system faults.</p>
      <p>We use a configured four tank system, shown in
Figure 1, as a running example throughout this paper to
describe the problem, and to illustrate the algorithms for
distributed MSO set selection. We assume each tank, and the
outlet pipe to its right, constitute a subsystem. Therefore,
this system has four subsystems. Two of the subsystems,
1 and 3, also have inflows into their tanks. We assume the
subsystems are disjoint, i.e., they have no overlapping
components. Associated with each subsystem are a set of
measurements that are shown as encircled variables in the figure.</p>
      <p>S1
u1</p>
      <p>S2</p>
      <p>P2
y4
u2</p>
      <p>T3
T1
y1</p>
      <p>P
1
y2</p>
      <p>T2
y3</p>
      <p>P
3
y5</p>
      <p>T4
y6</p>
      <p>P4</p>
      <p>More generally, we assume the system, S has n
predefined subsystems, S1, S2, ....Sn. Each subsystem model
is defined as:
Definition 2 (Subsystem model). A subsystem model of
system model S, Si (1 ≤ i ≤ k) is also a four-tuple: (Vi, Mi,
Ei, Fi), where Vi ⊆ V , Mi ⊆ M , Ei ⊆ E and Fi ⊆ F .
Also, S1 ∪ S2 ∪ ....Sk = S.</p>
      <p>For illustration, the first subsystem in our running
example is described by the following set of equations:
e4 : qin1 = u1
e5 : p1 = y1
e6 : q1 = y2.
e10 : p2 = y3
e11 : q2 = y4.
e1 : p˙1 =
e2 : q1 =
e3 : p1 =
(1)
Therefore, E1 = {e1, e2, e3, e4, e5, e6} defines the set of
equations, V1 = {p˙1, p1, p2, qin1, q1} defines the set of
variables, M1 = {u1, y1, y2} defines the set of subsystem
measurements, and F1 = {f1, f2} defines the set of faults
associated with this subsystem model.</p>
      <p>Similarly, the second subsystem model is defined by the
following equations:
(2)
For this subsystem the set of equations is E2 =
{e7, e8, e9, e10, e11}, the set of variable is V2 = {p˙2, p2,
p3, q1, q2}, the set of measurements is M2 = {y2, y4}, and
F2 = {f3, f4} is the set of faults.</p>
      <p>In this paper, we assume there are no overlapping
components among the subsystems. However, the subsystems
may share variables at their interface. For example, the
liquid flowrate at outlet pipe of subsystem qi = qi0, the liquid
flowrate at input to connected tank i + 1.</p>
      <p>Definition 3 (First Order Connected Subsystems). Two
subsystems, Si and Sj are defined to be first order connected if
and only if they have at least one shared variable.</p>
      <p>In the running example, subsystems S1 and S2 are first
order connected and their shared variables are V1 ∩ V2 =
{p2, , q1}. The two other subsystems in the running example
are:</p>
      <p>(qin2 + q2 − q3)
e12 : p˙3 =
e13 : q3 =
e14 : p3 =
e17 : p˙4 =
e18 : q4 =</p>
      <p>1
CT 3
p3 − p4
RP 3 + f5
Z
p˙3 dt</p>
      <p>1
CT 4 + f6
p4
RP 4
(q3 − q4)
(4)</p>
      <p>In more general terms, ith order connected subsystem
models are defined as follows.</p>
      <p>Definition 4 (ith Order Connected Subsystems). Two
subsystems, Sk and Sj are defined to be i th order connected
if and only if there exists a subsystem model Sm that is
(i−1)th order connected to Sk, and is first-order connected
to Sj , or Sm is (i − 1)th order connected to Sj , and is
firstorder connected to Sk .
e15 : qin2 = u2
e16 : q3 = y5.</p>
      <p>(3)</p>
      <p>Z
e19 : p4 =</p>
      <p>p˙4 dt
e20 : p4 = y6.
For example in the four tank system, S1 and S3 are
second order connected because both of them are first order
connected to S2.</p>
      <p>In this paper, we use MSO sets [Krysander et al., 2008b]
as the primary conceptual approach for fault detection and
isolation. The formal definitions of Structurally
Overdetermined (SO) and MSO sets are:
Definition 5. (Structural Overdetermined Set) Consider a
set of equations and its associated variables, measurements,
and faults: (E, V, M, F ). This set of equations is
structurally overdetermined (SO) if the cardinality of the set {E}
is greater than the cardinality of set {V }, i.e. |E| &gt; |V |.
Definition 6. (Minimal Structurally Overdetermined Set)
A set of over determined equations is minimal structurally
overdetermined (MSO) if it has no subset of structurally
overdetermined equations.</p>
      <p>Consider subsystem S1 of the four tank system in
equation (1). Using the software developed by [Krysander
et al., 2008a], we can compute the only minimal
structurally overdetermined set in this subsystem as M SO11 =
(E11, V11, M11, F11), where E11 = {e1, e3, e4, e5, e6},
V11 = {p˙1, p1, qin1, q1}, M11 = {u1, y1, y2} and F11 =
{f1}. For the sake of brevity and simplification we simply
say a specific equation, variable, measurement, or fault is a
member of a MSO in the rest of the paper. For example, we
say f1 ∈ M SO11.</p>
      <p>MSOs represent the redundancies in the system and can
form the basis for fault detection and isolation. Global and
Local fault detectability are defined as:
Definition 7. (Globally detectable fault) A fault f ∈ F is
globally detectable in system S if there is a minimal
structurally overdetermined set M SOi in the system, such that f
∈ M SOi.</p>
      <p>Definition 8. (Locally detectable fault) A fault f ∈ Fi is
locally detectable in subsystem Si if there is a minimal
structurally overdetermined set M SOi in the subsystem that f ∈
M SOi.</p>
      <p>Consider Definition 8 and equation (1). Fault f1 is
locally detectable because f1 ∈ M SO11 but f2 is not
locally detectable since there is no MSO in this subsystem
that includes f2. To detect f2 locally, the diagnosis
subsystem needs to include additional measurements. Global and
Local fault isolability are defined as:
Definition 9. (Globally isolable fault) A fault fi ∈ F is
globally isolable from fault fj ∈ F if there exists a
minimal structurally overdetermined set M SOi in the system S,
such that fi ∈ M SOi and fj 6∈ M SOi .</p>
      <p>Definition 10. (Locally isolable fault) A fault fi ∈ Fi is
locally isolable from fault fj ∈ F if there exists a
minimal structurally overdetermined set M SOi in subsystem Si,
such that fi ∈ M SOi and fj 6∈ M SOi .</p>
      <p>Note that if a fault fi is locally detectable in a
subsystem Si, it is globally detectable too, and if a fault fi is
locally isolable from a fault fj , it is globally isolable from fj
as well. The problem of MSO selection is presented as a
binary integer linear programming (BILP) problem in this
paper. BILP is a special case of the integer linear
programming problem (ILP), where the unknowns to be solved for
are binary variables.1</p>
      <p>1See definition in Wikipedia: https://en.wikipedia.
org/wiki/Integer_programming.</p>
      <p>Definition 11. (Binary integer linear programming problem
(BILP)) A Binary integer linear programming problem is a
special case of an integer linear programming (ILP)
optimization problem in which some or all the unknown
variables to be solved for are required to be binary, and the
constraints in the problem and the objective function, like
ILP, are linear.</p>
      <p>The mathematical formulation of BILP is as follows.
min cT x
Ax ≤ b
∃xb ⊂ x
(5)
∀xk ∈ xb ⇒ xk ∈ {0, 1},
where vector c is the cost weights and matrix A and vector
b define linear constraints, x represents the variables, and
xb represents the binary variables [Wolsey and Nemhauser,
2014].
3</p>
    </sec>
    <sec id="sec-3">
      <title>Problem Formulation</title>
      <p>Designing a set of distributed diagnosers that together have
the same diagnosability as a centralized diagnoser is the
focus of our work in this paper. In the ideal case, each
subsystem includes sufficient redundancies, such that its set
of MSOs is sufficient to detect and isolate all of its faults,
Fi uniquely and unambiguously. In that case, we can
associate an independent diagnoser Di with each subsystem
Si; 1 ≤ i ≤ k, and each diagnoser operates with no
centralized control, and no exchange of information with other
diagnosers. If the independence among diagnosers does not
hold, then the subsystems need to communicate some of
their measurements to other subsystems to detect and
isolate the faults. To address this problem in an efficient way,
we derive an integrated approach to select a set of MSOs for
each subsystem that guarantee full diagnosability and
minimum exchange of measurements among subsystems.</p>
      <p>Given subsystems, Si; 1 ≤ i ≤ k, with a set of local fault
candidates, Fi, such that Si=1kFi = F . We may need to
augment each subsystem with additional measurements that
are typically acquired from the (nearest) neighbors of the
subsystem, such that all of the faults associated with the
extended model of this subsystem are detectable and isolable.
In the worst case, all of the measurements from another
subsystem may have to be included to make the current
subsystem diagnosable. When such a situation occurs, we say the
two subsystems are merged and represented by a common
diagnoser, therefore, the total number of independent
distributed diagnosers may be less than k.</p>
      <p>Each MSO is sensitive to a set of faults and, therefore can
be used to detect them and isolate them from the other faults
in the system. For each subsystem Si, our goal is to find a
minimal set of MSOs that provide maximum detectability
and isolability to that subsystem. A set of MSOs is
minimal if there is no subset of MSOs that provides the same
detectability and isolability. To achieve distributed fault
diagnosis, we also want each subsystem to use the minimum
number of measurements from the other subsystems. In
other words, we want to minimize communication or the
amount of data (measurements) to be transmitted between
the subsystems. More formally, the problem for designing a
diagnoser for a particular subsystem Si can be described as
follows:
(
(
(6)
x(k + l) =
1 if
0 if</p>
      <sec id="sec-3-1">
        <title>M SOk ∈ MSOi</title>
        <p>M SOk ∈/ MSOi.
x(k) =
1 if
0 if
mk ∈ Mi ∪ Mo
mk ∈/ Mi ∪ Mo,
where Mo is the answer to problem (6). We also define
x(k + l): 1 ≤ k ≤ r, for MSO M SOk in the system as
follows.</p>
        <p>To formulate the problem (6) as a BILP problem we
define a binary variable x(k): 1 ≤ k ≤ l, for measurement
mk in the system as follows:</p>
        <p>To minimize the number of measurements from the other
subsystems, we develop the following cost function c as:
Consider MSO = {M SO1, M SO2, . . . , M SOr} as the
set of possible MSOs for the subsystem Si. We need to
develop an algorithm to select a minimal subset of MSO that
guarantees maximal structural detectability and isolability
for faults Fi associated with the subsystem, and include a
minimum number of measurements from the other
subsystems in the system to assure the equivalence of local and
global diagnosability , i.e.,</p>
        <p>∀Si; 1 ≤ i ≤ k
Select
s.t.</p>
      </sec>
      <sec id="sec-3-2">
        <title>M SOSi ⊂ MSO</title>
        <p>Mmo ⊆inM |Mo|
Di(Mi ∪ Mo) = Di(M ),</p>
        <p>Ii(Mi ∪ Mo) = Ii(M ),
where Mo represents the set of measurement we need to
communicate to the subsystem Si along with the set of
measurements, Mi associated with the subsystem Si. M
represents the set of all measurements in the system. For a given
set of measurements, X, Di(X) represents the set of
detectable faults in Fi, and Ii(X) represents the set of isolable
faults in Fi from the system faults, F .</p>
        <p>In the next section we formulate the problem as a BILP
problem. Formulating the problem as a BILP, enables us to
use a number of well-developed tools like branch and bound
algorithms [Land and Doig, 1960] and branch and cut
algorithms [Mitchell, 2002] to solve the problem. However,
much like integer linear programming, the general BILP
solution is exponential.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>MSOs Selection for Distributed Fault</title>
    </sec>
    <sec id="sec-5">
      <title>Detection Using Global Model</title>
      <p>In this section, we present our algorithm to select a
minimal set of residuals for each subsystem of a system whose
global model is available as a set of equations. In the next
section, we modify this algorithm to make it applicable to
much larger systems, where a compiled global model is not
available.</p>
      <p>For the situation in which the global model is known,
M in equation (6) is the set of all system measurements.
Assume we have l measurements in the system: M =
{m1, m2, ..., ml}. The measurements imply redundancies
in the system model that form the basis for generating
MSOs. Let us assume we can generate r MSOs given
M : MSO = {M SO1, M SO2, . . . , M SOr}. Our goal
is to design an algorithm that selects MSOi ⊆ MSO in
a way that we add a minimum number of measurements
Mo ⊆ M, Mi∩Mo = ∅, i.e., measurements from the system
not belonging to subsystem i, to a subsystem to make all its
faults globally diagnosable. Note that this is equivalent to
the set covering problem and, therefore, any algorithm for
finding the minimal measurements is exponential, in
general. In the past, we have adopted heuristic search methods
for solving this problem. Our approach for designing
subsystem diagnosers used the Temporal Causal Graph (TCG)
approach [Roychoudhury et al., 2009]. In this paper, we
formulate the search for minimal sensors as a BILP problem.
The general formulation of BILP is presented in (5), and
there are several tools available for solving this problem.2
2For example, see
mathworks.com/help/optim/ug/
http://www.
(7)
(8)
(9)
c(k) =
( 0 if
1 if
0 if</p>
      <p>mk ∈ Mi
mk ∈ M \Mi
l &lt; k ≤ l + r,
where l is the number system measurements and r is the
number of MSOs in the system. Using the algorithm
proposed in [Krysander et al., 2008a] 165 MSOs are generated
for the running example, the four tank system. Since there
are 8 measurements in the system c is a vector with 173
elements for this example.</p>
      <p>Consider subsystem Si with local faults Fi and the set of
system faults, F . Each local fault fj ∈ Fi has to be
locally detectable. Given definition 8, we can guarantee local
detectability of all the faults fj ∈ Fi with the following
constraints in the optimization problem (5).</p>
      <p>A(j, k) =
Note that l is the number of measurements in the system.
By considering b(j) = −1 for 1 ≤ j ≤ g, where g is the
number of faults in Fi, we make sure that we have selected
at least one MSO to detect each fault.</p>
      <p>To address isolability requirement we follow the same
procedure. To isolate fj ∈ Fi from any other fault in
system, i.e., fh ∈ F we need to have:</p>
      <p>A(j + g, k) =
(11)
Setting b(j) = −1 for g &lt; j ≤ g ∗ h, where h is the number
of faults in the system, h = |F |, we make sure that there
is at least one MSO to isolate each of the subsystem faults
from the other faults in the system.</p>
      <p>In addition to the constraints that guarantee maximum
detectability and isolability for the distributed diagnosis
system, we need a set of constraints that capture the
relationship between the measurements and MSOs in the distributed
diagnosis system. Using a MSO is equivalent to using the
measurements that are included in the MSO, and we need
to include this in the optimization problem. For
example, consider M SO11, it has three measurements M11 =
{u1, y1, y2}. Using M SO11 in a local diagnosis subsystem
means we need to communicate these measurement streams
to that subsystem to achieve global diagnosability for the
mixed-integer-linear-programming-algorithms.
html in the MatlabTMlinear integer programming toolbox.
faults that belong to that subsystem. The following
equation represents this constraint.</p>
      <p>− x(1) − x(2) − x(3) + |M1|x(7) ≤ 0,
(12)
where |M1| = 3 is the cardinality number of M1 and x(1),
x(2), x(3) and x(7) are binary variables that are 1 if we use
u1, y1, y2 and M SO11 in the diagnosis system and are zero
otherwise. This constraint implies that if we use M SO1:
x(7) = 1, its associated measurements are used by the
subsystem too: x(1) = x(2) = x(3) = 1.</p>
      <p>Equation (13) represents these set of constraints in A
matrix.</p>
      <p>A(j + g ∗ h, k) =
(13)
where |Mj | is the cardinality number of set of
measurements in M SOj and |M | is the cardinality number of set
of all the measurements in the system. Setting b(j) = 0 for
g ∗ h &lt; j ≤ g ∗ h + n, where n is the number of MSOs
in the system. The optimization problem takes into account
the relationship between measurements and MSOs. For the
running example we generated 165 MSOs, there are also 3
measurements in the subsystem 1, and 8 measurements for
the entire system. Similarly, subsystem 1 has two faults of
interest, and the goal is to be able to isolate them from any of
the 6 faults in the complete system. Therefore, to solve the
optimization problem (5) for subsystem 1, matrix A has 177
rows (equal to the number of constraints: 2 constraints to
guarantee the local detectability of f1 and f2, 10 constraints
to guarantee the local isolability of f1 and f2 from the other
faults, and 165 constraints to capture the relationship
between the MSOs and the measurements) and 173 columns
(equal to the number of binary variables: 8 for the
measurements and 165 for the MSOs) and b is a vector with 177
elements (equal to the number of constraints).</p>
      <p>Table 1 shows the set of measurements that we need to
add for each of the subsystem diagnosers to achieve
maximum possible detectability and isolability using our
proposed algorithm. To find the optimum measurements, we
solved the optimization problem (5) for each subsystem.</p>
      <p>Considering the expanded measurement set the schematic
of the four tank system with the four distributed diagnosers
is shown in Figure 2. The figure shows the complete set
of measurements required by the four subsystem diagnosers
to achieve global detectability and isolability for the set of
faults they contain. For example subsystem 1 includes three
measurements M1 = {u1, y1, y2}, and to achieve global
diagnosability for its faults, y3 must be communicated to its
diagnoser from subsystem 2. Subsystem 2 is the only
subsystem that shares a variable with a second order connected
subsystem, all the other subsystems only need to
communicate with their first order connected subsystems. Note that
communicated measurements typically will incur additional
cost and may lower reliability of the system diagnoser. But
keeping them to a minimum (see results in Table 1) reduces
that cost and uncertainty, while maintaining global
diagnosability.</p>
      <p>A common way to validate a distributed fault detection
and isolation approach is to compare the result with the
maximum global detectability and isolability. Adopting the
exoneration assumption, Table 2 shows the detectability and
isolability performance of the centralized approach. An X
in the table shows that the fault in the row and the fault in
the column are not isolable from each other. An X in the
first column (NF) means the fault in the corresponding row
is not isolable from NF (No Fault) or simply it is not
detectable. Table 2 shows that with a centralized approach we
can detect and isolate all the faults.</p>
      <p>However, Table 3 shows that using the original
subsystems for distributed diagnosis does not provide the same
results as the centralized global diagnoser.
(Figure 2) we achieve the same performance as the global
diagnoser as shown in Table 4.</p>
      <p>This demonstrates that the distributed approach can
achieve the same performance with the centralized approach
for fault detection and isolation in the running example. In
general, the worst case scenario for a system with strongly
connected subsystems (i.e., all subsystems are connected to
each other) will typically require a large number of
measurements from other subsystems to be communicated to
each subsystem diagnoser. In those situations, subsystem
diagnosers just get rid of the single point of failure, but each
subsystem diagnoser may require a large number of
measurements to be communicated to it from all of the other
subsystems.</p>
      <p>In our case study, the four tank system model included
165 MSOs, which means for each subsystem there was 2165
different MSO candidate sets. This creates a very large
search space (in general the search space is exponential in
the number of MSOs, and generating all MSOs is in itself
an exponential problem. This justifies the formulation of the
problem as a BILP problem that provides efficient tools, like
the bintprog function in MatlabTM(see earlier footnote), to
solve it. However, given the exponential nature of the
solution, this method will not scale up for larger systems, even
if the subsystem diagnoser design is performed off-line. In
addition to the computational complexity, the availability of
global models for large, complex systems is unlikely
because of the issues discussed in Section 1. To overcome this
problem, we sacrifice minimality of the solution to some
extent, and propose an incremental algorithm for designing the
subsystem diagnosers.
5</p>
    </sec>
    <sec id="sec-6">
      <title>MSOs Selection for Distributed Fault</title>
    </sec>
    <sec id="sec-7">
      <title>Detection Using Neighboring Subsystems</title>
      <p>The proposed approach in the previous section used the
global model of the system to generate the residuals, and
then derived the subsystem diagnosers using the BILP
algorithm run on the global MSO set. In this section, we
achieve global diagnosability of a subsystem diagnoser by
incrementally adding a minimum number of measurements
from the neighbors of this subsystem till the global
diagnosability property is established. The algorithm starts with the
set of equations for the subsystem whose diagnoser is being
designed, and if global diagnosability is not achieved using
this model, it expands to include equation sets that
correspond to the models of its immediate neighbors. If global
diagnosability is achieved, the algorithm terminates,
otherwise the algorithm expands to use the next higher order
of neighbors and repeats the search for minimal MSOs to
achieve complete diagnosability. The process of including
successively higher order neighbors is shown in Figure 3.</p>
      <p>In the worst case, this process continues, till the complete
set of system equations are required to generate all
possible MSOs, and establish global diagnosability for the
subsystem. Therefore, it is guaranteed that the method has the
same diagnosability performance as the best centralized
diagnoser for the same set of measurements. Algorithm 1
deSr</p>
      <p>Sq</p>
      <p>Ss
Sm</p>
      <p>Sp</p>
      <p>Sj
Firstorder
connected
subsystems</p>
      <p>Si</p>
      <p>Sl
Sk</p>
      <p>Sn</p>
      <p>Sw</p>
      <p>So
Second
order
connected
subsystems</p>
      <p>St</p>
      <p>Sv
scribes the algorithm for our proposed method.</p>
      <p>Algorithm 1 Incremental Algorithm
1: for each Si ∈ S do
2: SS = Si
3: j = 0
4: while Di(SS) 6= Di(S) or Ii(SS) 6= Ii(S) do
5: j = j + 1
6: SS =SS ∪ (jth order connected subsystems of Si)</p>
      <p>Consider the running example. To design the
diagnosis system for the first subsystem, we start with its set of
equations and we can only generate one MSO which is not
enough to detect subsystem faults and isolate them from the
system faults. We then augment the subsystem model with
the model from its nearest neighbor subsystem 2, and
generate the set of MSOs for the augmented model. The total
number of MSOs for the augmented subsystem (Subsystem
1 + subsystem 2) is 11 which leads to 211 MSO set
candidates which is much smaller than 2165 candidates.
Solving the optimization problem presented in this section gives
the same result with the global method for this subsystem,
but the computation time is reduced significantly. Using
the same approach for every subsystem, the set of
measurements that we need to transfer to each subsystem of the
running example are presented in Table 5.</p>
      <p>Figure 4 shows that for the four tank case study, all the
subsystems share variables with their first order connected
subsystems. This provides a practical advantage to this
algorithm because usually the subsystems with shared
variables are physically closer to each other (corresponding to
our definition of nearest neighbors) and, therefore, we do
not need to transfer data over long distances, which, as
discussed earlier, can be costly and error-prone.</p>
      <p>The proposed algorithm provides the maximum possible
detectability and isolability that can be achieved. The
advantage of this algorithm is that not only we do not need a
global model for detecting and isolating the faults, but also
we do not use the global model in the design process of the
supervisory system. This makes the approach suitable for
large, complex systems, such as aircraft and power plants
where the global systems models are likely to be
unavailable or unknown.
6</p>
    </sec>
    <sec id="sec-8">
      <title>Discussion and Conclusions</title>
      <p>A distributed approach to the problem of fault detection and
isolation is presented in this paper. We proposed two
algorithms for MSOs selection for the distributed diagnosis.
The proposed algorithms provide the maximum possible
detectability and isolability that can be achieved for a
system given a set of measurements. The first algorithm also
guarantees that the subsystems share the minimum number
of measurements, implying that we minimize the
communication of measurement streams across subsystems of the
global system. This is important because sending the data
to other subsystems is costly in large scale systems. On the
other hand, the second algorithm does not need to use the
global model in the design process of the supervisory
system . This makes the algorithm more practical, specially for
the complex systems. However, the second algorithm does
not guarantee that the number of shared variables among the
subsystems are globally minimum.</p>
      <p>Unlike previous work, such as [Bregon et al., 2014;
Daigle et al., 2007] this method directly works with MSOs
generated from subsystem and system equations, and
therefore, does not need to use the temporal response and event
ordering in the diagnosis, all of which are derived
properties, and, therefore, require additional computation. Using a
purely structural approach, reduces the overall
diagnosability of the system for the given set of measurements.
However, it also reduces the number of assumptions we need to
make about the fault characteristics, order of events in the
diagnoses subsystems (which can be error-prone), and we
dot have to analyze in detail the subsystem dynamics.</p>
      <p>
        Moreover, in the incremental algorithm we do not need
to have the full global model to design the individual
subsystem diagnosers. This is an important practical
contribution of this paper in comparison to our previous work
        <xref ref-type="bibr" rid="ref18 ref19">(e.g.,
[Roychoudhury et al., 2009])</xref>
        . Requiring the global model
may render the approach to be impractical for the large-scale
complex systems, such as aircraft and power plants where
the global systems models are likely to be unavailable or
unknown.
      </p>
      <p>Finally, in the proposed methods, we generate the MSOs
first to design our subsystem diagnosers. The total
number of MSOs is exponential in terms of the system
measurements. This increases the computational cost of the
problem. To make our diagnoser derivation process more
efficient, we used BILP framework. On the other hand, having
all the MSOs beforehand, makes robustness analysis
[Khorasgani et al., 2014a; Khorasgani et al., 2014b] possible for
robust distributed MSOs selection. In future work, we will
consider noise and uncertainty in the system and will
extend the proposed method to robust distributed fault
detection and isolation.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [Bregon et al.,
          <year>2014</year>
          ]
          <string-name>
            <given-names>Anibal</given-names>
            <surname>Bregon</surname>
          </string-name>
          , Matthew Daigle, Indranil Roychoudhury, Gautam Biswas, Xenofon Koutsoukos, and
          <string-name>
            <given-names>Belarmino</given-names>
            <surname>Pulido</surname>
          </string-name>
          .
          <article-title>An event-based distributed diagnosis framework using structural model decomposition</article-title>
          .
          <source>Artificial Intelligence</source>
          ,
          <volume>210</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>35</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [Daigle et al.,
          <year>2007</year>
          ]
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Daigle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X. D.</given-names>
            <surname>Koutsoukos</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G.</given-names>
            <surname>Biswas</surname>
          </string-name>
          .
          <article-title>Distributed diagnosis in formations of mobile robots</article-title>
          .
          <source>Robotics</source>
          , IEEE Transactions,
          <volume>23</volume>
          (
          <issue>2</issue>
          ):
          <fpage>353</fpage>
          -
          <lpage>369</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [Deb et al.,
          <year>1998</year>
          ]
          <string-name>
            <given-names>S.</given-names>
            <surname>Deb</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Mathur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. K.</given-names>
            <surname>Willett</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K. R.</given-names>
            <surname>Pattipati</surname>
          </string-name>
          .
          <article-title>Decentralized real-time monitoring and diagnosis</article-title>
          .
          <source>In Systems, Man, and Cybernetics</source>
          . IEEE International Conference,
          <volume>3</volume>
          :
          <fpage>2998</fpage>
          -
          <lpage>3003</lpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [Debouk et al.,
          <year>2000</year>
          ]
          <string-name>
            <given-names>R.</given-names>
            <surname>Debouk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Lafortune</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Teneketzis</surname>
          </string-name>
          .
          <article-title>Coordinated decentralized protocols for failure diagnosis of discrete event systems</article-title>
          . Discrete Event Dynamic System:
          <volume>10</volume>
          (
          <issue>1-2</issue>
          ):
          <fpage>33</fpage>
          -
          <lpage>86</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Theory</surname>
          </string-name>
          and Applications,
          <source>[Duarte Jr and Nanya</source>
          , 1998]
          <string-name>
            <given-names>E. P Duarte</given-names>
            <surname>Jr</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.</given-names>
            <surname>Nanya</surname>
          </string-name>
          .
          <article-title>A hierarchical adaptive distributed system-level diagnosis algorithm</article-title>
          . Computers, IEEE Transactions,
          <volume>47</volume>
          (
          <issue>1</issue>
          ):
          <fpage>34</fpage>
          -
          <lpage>45</lpage>
          ,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [Ferrari et al.,
          <year>2012</year>
          ] Riccardo MG Ferrari, Thomas Parisini, and
          <string-name>
            <surname>Marios M Polycarpou.</surname>
          </string-name>
          <article-title>Distributed fault detection and isolation of large-scale discrete-time nonlinear systems: An adaptive approximation approach</article-title>
          .
          <source>Automatic Control</source>
          , IEEE Transactions on,
          <volume>57</volume>
          (
          <issue>2</issue>
          ):
          <fpage>275</fpage>
          -
          <lpage>290</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [Indra et al.,
          <year>2012</year>
          ]
          <string-name>
            <given-names>Saurabh</given-names>
            <surname>Indra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Trave-Massuyes</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Elodie</given-names>
            <surname>Chanthery</surname>
          </string-name>
          .
          <article-title>Decentralized diagnosis with isolation on request for spacecraft</article-title>
          .
          <source>Proceedings of the 8th IFAC Symposium on Fault Detection, Supervision and Safety for Technical Processes (Safeprocess)</source>
          ,
          <source>Mexico City</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [Khorasgani et al., 2014a] Hamed Khorasgani, Daniel E. Jung, Gautam Biswas, Erik Frisk, and
          <string-name>
            <given-names>Mattias</given-names>
            <surname>Krysander</surname>
          </string-name>
          .
          <article-title>Off-line robust residual selection using sensitivity analysis</article-title>
          .
          <source>International Workshop on Principles of Diagnosis (DX-14)</source>
          , Graz, Austria,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [Khorasgani et al., 2014b] Hamed Khorasgani, Daniel E. Jung, Gautam Biswas, Erik Frisk, and
          <string-name>
            <given-names>Mattias</given-names>
            <surname>Krysander</surname>
          </string-name>
          .
          <article-title>Robust residual selection for fault detection. Decision and Control (CDC)</article-title>
          ,
          <source>IEEE 53rd Annual Conference on</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [Krysander et al., 2008a]
          <string-name>
            <given-names>Mattias</given-names>
            <surname>Krysander</surname>
          </string-name>
          , Jan Åslund, and
          <string-name>
            <given-names>Mattias</given-names>
            <surname>Nyberg</surname>
          </string-name>
          .
          <article-title>An efficient algorithm for finding minimal overconstrained subsystems for model based diagnosis</article-title>
          .
          <source>IEEE Transactions on Systems, Man, and Cybernetics</source>
          ,
          <string-name>
            <surname>Part</surname>
            <given-names>A</given-names>
          </string-name>
          : Systems and Humans,
          <volume>38</volume>
          (
          <issue>1</issue>
          ),
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [Krysander et al., 2008b]
          <string-name>
            <given-names>Mattias</given-names>
            <surname>Krysander</surname>
          </string-name>
          , Jan Aslund, and
          <string-name>
            <given-names>Mattias</given-names>
            <surname>Nyberg</surname>
          </string-name>
          .
          <article-title>An efficient algorithm for finding minimal overconstrained subsystems for model-based diagnosis</article-title>
          .
          <source>Systems, Man and Cybernetics</source>
          ,
          <string-name>
            <surname>Part</surname>
            <given-names>A</given-names>
          </string-name>
          :
          <article-title>Systems and Humans</article-title>
          , IEEE Transactions on,
          <volume>38</volume>
          (
          <issue>1</issue>
          ):
          <fpage>197</fpage>
          -
          <lpage>206</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <source>[Lafortune</source>
          , 2007]
          <string-name>
            <given-names>S.</given-names>
            <surname>Lafortune</surname>
          </string-name>
          .
          <article-title>On decentralized and distributed control of partially-observed discrete event systems</article-title>
          .
          <source>in advances in control theory and applications</source>
          . Springer Berlin Heidelberg, pages
          <fpage>171</fpage>
          -
          <lpage>184</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <source>[Land and Doig</source>
          , 1960]
          <string-name>
            <given-names>A. H.</given-names>
            <surname>Land</surname>
          </string-name>
          and
          <string-name>
            <surname>A. G. Doig.</surname>
          </string-name>
          <article-title>An automatic method of solving discrete programming problems</article-title>
          .
          <source>Econometrica: Journal of the Econometric Society</source>
          , pages
          <fpage>497</fpage>
          -
          <lpage>520</lpage>
          ,
          <year>1960</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [Lanigan et al.,
          <year>2011</year>
          ]
          <string-name>
            <given-names>Patrick E.</given-names>
            <surname>Lanigan</surname>
          </string-name>
          , Soila Kavulya, and
          <string-name>
            <given-names>Priya</given-names>
            <surname>Narasimhan</surname>
          </string-name>
          .
          <article-title>Diagnosis in automotive systems: A survey</article-title>
          .
          <source>Technical Report CMU-PDL-11-110</source>
          , Carnegie Mellon University PDL,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [Leger et al.,
          <year>1999</year>
          ]
          <string-name>
            <given-names>J. B.</given-names>
            <surname>Leger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Iung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ferro De Beca</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Pinoteau</surname>
          </string-name>
          .
          <article-title>An innovative approach for new distributed maintenance system: application to hydro power plants of the remafex project</article-title>
          . Computers in industry,
          <volume>38</volume>
          (
          <issue>2</issue>
          ):
          <fpage>131</fpage>
          -
          <lpage>148</lpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [Mitchell,
          <year>2002</year>
          ] John E. Mitchell.
          <article-title>Branch-and-cut algorithms for combinatorial optimization problems</article-title>
          .
          <source>Handbook of applied optimization</source>
          , pages
          <fpage>65</fpage>
          -
          <lpage>77</lpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [Rish et al.,
          <year>2005</year>
          ]
          <string-name>
            <given-names>I.</given-names>
            <surname>Rish</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Brodie</surname>
          </string-name>
          , S. Ma,
          <string-name>
            <given-names>N.</given-names>
            <surname>Odintsova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Beygelzimer</surname>
          </string-name>
          , G. Grabarnik, and
          <string-name>
            <given-names>K</given-names>
            <surname>Hernandez</surname>
          </string-name>
          .
          <article-title>Adaptive diagnosis in distributed systems</article-title>
          .
          <source>Neural Networks, IEEE Transactions</source>
          ,
          <volume>16</volume>
          (
          <issue>5</issue>
          ):
          <fpage>1088</fpage>
          -
          <lpage>1109</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [Rosich et al.,
          <year>2009</year>
          ]
          <string-name>
            <given-names>Albert</given-names>
            <surname>Rosich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Ramon</given-names>
            <surname>Sarrate</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Fatiha</given-names>
            <surname>Nejjari</surname>
          </string-name>
          .
          <article-title>Optimal sensor placement for fdi using binary integer programming</article-title>
          .
          <source>International Workshop on Principles of Diagnosis</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [Roychoudhury et al.,
          <year>2009</year>
          ]
          <string-name>
            <given-names>Indranil</given-names>
            <surname>Roychoudhury</surname>
          </string-name>
          , Gautam Biswas, and
          <string-name>
            <given-names>Xenofon</given-names>
            <surname>Koutsoukos</surname>
          </string-name>
          .
          <article-title>Designing distributed diagnosers for complex continuous systems</article-title>
          .
          <source>Automation Science and Engineering</source>
          , IEEE Transactions on,
          <volume>6</volume>
          (
          <issue>2</issue>
          ):
          <fpage>277</fpage>
          -
          <lpage>290</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [Sarrate et al.,
          <year>2007</year>
          ]
          <string-name>
            <given-names>Ramon</given-names>
            <surname>Sarrate</surname>
          </string-name>
          , Puig Vicenc, Escobet Teresa, and
          <string-name>
            <given-names>Rosich</given-names>
            <surname>Albert</surname>
          </string-name>
          .
          <article-title>Optimal sensor placement for model-based fault detection and isolation</article-title>
          . pages
          <fpage>2584</fpage>
          -
          <lpage>2589</lpage>
          .
          <source>46th IEEE Conference In Decision and Control</source>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [Shum et al.,
          <year>1988</year>
          ]
          <string-name>
            <given-names>S. K.</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. F.</given-names>
            <surname>Davis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. F.</given-names>
            <surname>Punch</surname>
          </string-name>
          <string-name>
            <surname>III</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Chandrasekaran</surname>
          </string-name>
          .
          <article-title>An expert system approach to malfunction diagnosis in chemical plants</article-title>
          .
          <source>Computers and chemical engineering</source>
          ,
          <volume>12</volume>
          (
          <issue>1</issue>
          ):
          <fpage>27</fpage>
          -
          <lpage>36</lpage>
          ,
          <year>1988</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [Svard et al.,
          <year>2012</year>
          ]
          <string-name>
            <given-names>C.</given-names>
            <surname>Svard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Nyberg</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Stoustrup</surname>
          </string-name>
          .
          <article-title>Automated design of an fdi system for the wind turbine benchmark</article-title>
          .
          <source>JCSE Journal of Control Science and Engineering</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <source>[Wolsey and Nemhauser</source>
          , 2014]
          <article-title>Laurence A. Wolsey and George L Nemhauser</article-title>
          .
          <article-title>Integer and combinatorial optimization</article-title>
          . John Wiley and Sons,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <source>[Wolsey</source>
          , 1998]
          <article-title>Laurence A. Wolsey. Integer programming</article-title>
          , volume
          <volume>42</volume>
          . Wiley, New York,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>