<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Quality Assessment of Unmanned Aerial Systems Using Bayesian Trust Networks Processing of Testing Data</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ol'ha Bashyns'ka</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Volodymyr Kazymyr</string-name>
          <email>vvkazymyr@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sergii Nesterenko</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Chernihiv National University of Technology</institution>
          ,
          <addr-line>95 Shevchenka Str., 14035 Chernihiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>State Scientific and Research Institute of Arms Testing and Certification of the Ukraine Armed Forces</institution>
          ,
          <addr-line>1 Strilets'ka Str., 14033 Chernihiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Unmanned aerial systems (UAS) recently have been rapidly developing both conceptually and technically. The reason for this is that they have become an effective alternative to traditional means and technical systems in a number of applications. The tasks, which are solved with the help of UAS, traditionally include air surveillance, intelligence and communication support both at daytime or at night and in different meteorological conditions. At the same time, the suitability of the UAS for the performance of certain tasks is determined by their qualitative metrics, which must first be evaluated during the tests. As a rule, this is done according to the technical diagnostics because its results are reflected in the quality metrics. But in this case there is a problem of the determination the required duration and content of testing to ensure the economy of resources and time. With proper planning and execution of expertise, it is possible to avoid situations where further testing becomes ineffective. The article describes an express method for assessing the qualitative metrics of UAS by data of technical diagnostics based on use of Bayesian trust networks (BNT). The proposed method allows not only quickly determine the duration of test program, but also a list of the most important characteristics that affect the quality of UAS. In addition, the use of BNT allows to evaluate these characteristics and to correct test plan in real time that increasing the reliability and efficiency of the conformity assessment.</p>
      </abstract>
      <kwd-group>
        <kwd>Unmanned Aerial Systems</kwd>
        <kwd>Testing</kwd>
        <kwd>Quality Metrics</kwd>
        <kwd>Technical Diagnosis</kwd>
        <kwd>Bayesian Networks of Trust</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Unmanned aerial systems recently have been rapidly developing [1] both
conceptually and technically. The reason for this is they quite unexpectedly found as effective
alternative to traditional means and technical systems in a number of areas of use. The
tasks that are solved with the help of UAS traditionally include air surveillance,
reconnaissance and communication support both in daytime and at night, and under
different meteorological conditions. Recently, the task of using UAS for delivery to
the required place cargo, both civil and military, is becoming more and more
important. For these reasons becomes understandable constant attention of scientists and
industry to the issues of further improvement of UAS, increasing their quality and
efficiency.</p>
      <p>As in most modern technical systems, energy, material and information flows
interact in the UAS by complicated way, which greatly complicates the realization the
tasks of all phases of the life cycle (Fig. 1).</p>
      <p>The examinations perform a special role in the lifecycle of the UAS. Their purpose
is to determine experimentally the actual (achieved) properties’ characteristics of the
sample tested and determine the degree of its compliance with the technical task or
technical specifications received from the developer. Thus the task of rational
organization of examinations is relevant.
The testing of the UAS is a complex operation. For their implementation the
considerable material, time and organizational resources are spent, so the practice put
forward the following objectives in relation to the examinations:
 to reduce the examination duration and cost, if possible to eliminate non-rational
time expenditures;
 to increase the conclusions validity of the examinations, reduce the influence of
subjectivity.</p>
      <p>In the process of examination, the decision making person (DMP) constantly
receives technical diagnostic data. These data affect qualitative metrics (QM)
assessment of which is the purpose of the expertise. The use of BNT allows DMP to assess
which test factors affect quality metrics most strongly. By proper planning and
performing the test program it allows to avoiding situations where further testing
becomes inefficient.</p>
      <p>The purpose of the article is to describe the method of assessing the UAS quality of
by the technical diagnostics data and BNT to increase the validity of decisions on
their compliance with the system requirements.
2</p>
      <p>Actual Scientific Researches and Issues Analysis
In accordance with [2], under the test of industrial products (engineering samples),
one understood an experimental determination of the quantitative or qualitative
characteristics of the test object that arises from:
 result of the impact on it;
 it’s functioning;
 process of modeling an object or affecting it.</p>
      <p>In [3] the traditional method of UAS examination is described. Here it is offered to
design the systems and technologies to UAS self-control for predict them technical
condition. The proposed self-diagnostic approach is capable to facilitate and speed up
the testing process. But it not decides the problem of express analysis of quality
metrics and correction the test plan in real time.</p>
      <p>The article formulates the proposals, how it is possible on the basis of modeling:
 to automate the process of identifying complex failures;
 to analyze impacts and generate recommendations;
 to use this information to assist in assessing the diagnostic capabilities and to make
the right choice of sensor types and models.</p>
      <p>At the same time, more and more researchers’ attention is attracted [4] to the
methodology of using BNT to solve a variety of technical problems, especially those related
to uncertainty and the need to combine expert estimates with numerical data
accumulated in various databases.</p>
      <p>BNT now deservedly occupies [5] the place of one of the most productive
mathematical approaches that allows flexible and adequate description of decision making
by qualified experts in the diagnosis of complex systems under uncertainty. Models
built on these principles show themselves well in the tasks associated with incomplete
and inaccurate information. With the help of BNT significant advances have been
made in such areas as medicine (diagnosis of lymph nodes, refinement of diagnoses),
automatic speech recognition systems, image processing, classification of data of
various natures, and others.</p>
      <p>The author rightly points out that the probabilistic approach to the solution of
complex technical problems based on the mathematical apparatus of BNT has the
following main advantages:</p>
      <p>
        ied.
tion.
3
network are more reliable;
the form of BNT;
 the simulation results obtained by experts’ knowledge and presented as the
structure of the trust graph and as the form of probabilistic tables in nodes of the trust
 here is the ability to save time and resources;
 there is more possibility of a quick understanding of situations and visual
representation of the elements (variables) interactions when technical system is modeled in
 there is the possibility to adjust the models used and their parameters, taking into
account the receipt of new information about the behavior of the object being
studDespite the fact that Bayesian networks are given a lot of attention in the world
scientific literature, the principles of their construction and use are not yet sufficiently
covered in domestic publications, which greatly impedes their understanding and
applica(
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
(
        <xref ref-type="bibr" rid="ref2">2</xref>
        )
(
        <xref ref-type="bibr" rid="ref3">3</xref>
        )
UAS QM is semantically defined as a tuple
      </p>
      <p>= 〈 ,  〉,
where Y={Yi} is a set of functions (properties) of a technical sample that are relevant
to Q and which are tested during its examination;</p>
      <p>M – the numerical representation of the QM which serves to quantify it. In most
cases, according to [6, 7], MQ are calculated as relative values:</p>
      <p>Definition Methodology for UAS Quality Indicators with Use
the Data of Technical Diagnosis
  =
| |
| | or   =
| |,
| |
where |А| means the power (number of elements) of the set A.</p>
      <p>
        In the formula (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ):
Х={Хj}, X  Y is the set of functions (properties) of the technical sample that are
performed according to the Q during the examination;
      </p>
      <p>=  \ is the set of functions (properties) of the technical sample that are not
performed according to the Q during the examination.</p>
      <p>Properties Y get defined during the technical samples testing through the
implementation of diagnostic procedures which are components of technical diagnostics
(TD).
in turn, corresponds to the system of sets</p>
      <p>The semantics of technical diagnostics is determined on the logical model, which,
  = 〈 ,  〉
where T = {Ti | i (1…m), Хi  Ti} is a set of tests that are performed (or symptoms
observed) when technical sample is examining;</p>
      <p>
        М = {Mj | j (1…k)} – is the set of QM, which are calculated from the results of
tests T by the formulas (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ).
      </p>
      <p>The logical connection between T and M can be illustrated by the incidence matrix
TM:</p>
      <p>TM =
Т1
1
0
1
…
0
Т2
0
1
0
…
1
Т3
0
0
1
…
0
…
…
…
…
…
. .
.</p>
      <p>Тm
1
…
1
0</p>
      <p>
        M1
M2
M3
…
Мk
(
        <xref ref-type="bibr" rid="ref4">4</xref>
        )
In the matrix (
        <xref ref-type="bibr" rid="ref5">5</xref>
        ) RTij = 1 if the failure Ri is one of the reasons which affects to the
result of test Tj.
      </p>
      <p>The analysis of the TD process and the logical connections found in it allow us to
construct a diagram of causes and consequences in determining of UAS QM(Fig. 2).</p>
      <p>
        Thus, objects that participate in the UAS examining can be grouped logically into the
diagnostic layer {R}, the effects layer {T}, and the layer of QM {M}, as shown in
Fig. 2. The matrixes (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ), (
        <xref ref-type="bibr" rid="ref5">5</xref>
        ) are acting as interfaces between these layers.
      </p>
      <p>
        In Fig. 2 also there is the node of generalization of quality metrics G which is not
mandatory in terms of normative documents. It looks useful technically for ensuring
the possibility of final result obtaining and it can be interpreted simply in process of
results analysis. Traditionally, it is calculated as a weighted sum of metrics Mi:
 = ∑ =1     .,
(
        <xref ref-type="bibr" rid="ref6">6</xref>
        )
where i is a weight of metric Mi:
      </p>
      <p>The sequence of determination of UAS quality indices according to the TD data
corresponds to the following algorithm.
1. The R, T and M sets must be determined based on the UAS technical
documentation and the existing regulations. Their elements determine the course and results
of the UAS assessment.
2. The matrices RT and TM are to be filled up. They determine the structure of
causative relationships in the test procedure.
3. A test is conducted, during which:
a) TD is performed and by this way the results of measurements and failures
observation R become actualized;
b) the results of the T test are determined, from which the X-sets for each metric of
the set M become actualized;
4. If necessary, the generalized index G is calculated according to the customer’s test
method.
5. To use the model in Fig. 2 as BNT, further it is necessary to define a priori
probabilities for each of its objects. These a priori probabilities are determined either on
the basis of the statistics of previous examinations, and/or on the basis of expert
information.</p>
      <p>The given algorithm has the following disadvantages:
1. The dimensions of RT and TM matrices can be quite large:</p>
      <p>|RT| = |R||T| and |TM| = |T||M|. Their filling is a labor-intensive work,
therefore its simplification is urgent.</p>
      <p>2. The wording of p.3b above defines a slow consecutive procedure based on the
RT and TM matrices obtained in p.2. Such an approach does not pay attention to the
possibility of a logical problem decomposition, taking into account the mutual
different tests independence in the UAS structure, which belongs to different subsystems of
it. The method described below shows how using BNT gets a solution to this
problem.</p>
      <p>3. Execution of p.5 of the above algorithm is a daunting task, since for each object
it is necessary to determine a priori probabilities for the full range of common
distribution of the probability of parent nodes. The situation may be much easier when:
 it is possible to determine the independence some objects from others in the model;
 when the objects of the model have a discrete distribution of values.
4</p>
      <p>Construction the BNT for the UAS Examination
The diagram in Fig. 2 corresponds to the deterministic process of determining UAS
QM, while the purpose of this study is to improve the mentioned process with the use
of existing causal relationships between layers of test objects (Fig. 2), which opens up
the possibility to use a powerful apparatus [4] estimation of conditional probabilities
(degrees of confidence) between them. This math is based on the notion of trust
networks, whose interconnection of elements is based on the well-known Bayesian
theorem.</p>
      <p>BNT is a graphical, high-quality illustration of the interactions between the
plurality of variables it simulates. The structure of the “casual” oriented graph can simulate
the cause-and-effect structure of the simulated subject area, although this is not
necessary. When BNT is casual, it provides useful, structured information about the
interactions between variables and allows predicting the effects of external manipulations.</p>
      <p>The distribution of common probabilities presented in the BNT is based on the
socalled “subjectivist” definition of probability. Given new observations (test results),
the subjective distribution of common probabilities at the vertices of the graph is
updated using the well-known Bayes formula:
 ( | ) =
 ( | )∙ ( )
 ( )
where P(A|B) is probability of event А provided that event В occurred;
P(В|A) – the likelihood of event B provided that event A occurred;
P(A) – a priori probability of event A;
P(B) – complete (marginal) probability of event B.</p>
      <p>The calculation P(B) is related to fairly voluminous computations by the general
formula</p>
      <p>
        in which:
 set R – different kinds of failure, inconsistency and malfunction in UAS;
(
        <xref ref-type="bibr" rid="ref7">7</xref>
        )
(
        <xref ref-type="bibr" rid="ref8">8</xref>
        )
(
        <xref ref-type="bibr" rid="ref9">9</xref>
        )
(
        <xref ref-type="bibr" rid="ref10">10</xref>
        )
 ( ) = ∫
      </p>
      <p>( | ) ∙  ( ) ∙   ,
 ( ) = ∑ =1  ( |  ) ∙  (  )..</p>
      <p>= 〈 ,  ,  ,  〉
or, in the case when the set A consists of a discrete set of values – by the formula
Let’s apply the above-mentioned method of constructing BNT for its creating in the
case of analysis of the conditional examining procedure of UAS.</p>
      <p>
        The examination procedure can be formally-logical imagined as a tuple
 set T – the consequences to which R leads. This may be:
1. the results of tests that are specifically performed by the testers during the
examination;
2. symptoms that are directly observed;
 the set of M is the metric of UAS QM (formula (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ));
 a generalized UAS quality index G .
      </p>
      <p>These elements can be grouped according to the layers, as shown in Fig. 3.
5</p>
      <p>Determination of the Relative Impact of UAS Examining’s
Factors for Improving the Examination Procedure
As noted in [8], the notion of conditional probability is not limited to the recalculation
of the occurrence quantities some events, but means the mathematical dependence
some random variables from others. That is why BNT in Fig. 4 can be considered as
“a black box”. Let its inputs to be consistent with the actualization of objects from the
diagnostic layer {R}, and with the variable G that is target function as well. The
transfer function of the “black box” is formed by the set J of common probability
distributions in BNT.</p>
      <p>The relative influence of the inputs {R} to the formation of the value of the target
function G can be estimated [10] by the values of partial derivatives
which in [10] have been called levels of influence (LI), or impact factors.</p>
      <p>The calculation values fi requires a numerical differentiation (11), which, as noted
above, involves performing calculations of common probabilities. In the worst case
these calculations have the computational complexity level of O(NP) [8]. To solve the
problems the BNT BayesFusion GeNIe Modeler 2.3 [10] modeling application was
used. The model which had been constructed in this application is shown in Fig. 3.</p>
      <p>Further, according to the above goal of the study, we will define as the target node
GQM (Fig.5).</p>
      <p>After this application can estimate the degree of influence of other nodes, after
which the graph of the model takes the view on Fig. 5.</p>
      <p>A detailed level influence (LI) analysis was carried out using numerical estimates
exported from the simulation environment. According to these data a diagram (Fig. 6)
was constructed.
1. The proposed method for assessment UAS QM that use BNT in combination with
technical diagnostic data had allowed to obtain information about the efficiency of
the complex test in the early stages of its implementation. In real conditions this
will allow to organize efficiently the examination process, reduce the time needed
for its execution and reduce material spending.
2. Developed algorithms that use the BNT to determine UAS QM provide the
definition which tests are expected to be implemented during the expertise up to the final
result. This opens the opportunity to determine the most efficient test which
includes the only significant checks that give a reliable and fast result.
3. Bayesian trust network allows to quickly finding the most probable causes of test
failures in the process of examining, localize their causes and quickly eliminate
them, which is an important factor in accelerating the testing.
4. This study may be further developed in the direction of creating semi-automatic
planning and testing systems using BNT for purpose of the determination the most
effective strategy for UAS expertise.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Valavanis</surname>
            ,
            <given-names>K.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vachtsevanos</surname>
            ,
            <given-names>G.J</given-names>
          </string-name>
          , (eds.):
          <source>Handbook of Unmanned Aerial Vehicles</source>
          . Springer Science+Business Media, Dordrecht (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. NASA-STD-
          <volume>8739</volume>
          .
          <fpage>10</fpage>
          .
          <string-name>
            <surname>Electrical</surname>
          </string-name>
          , Electronic, and
          <article-title>Electromechanical (EEE) Parts Assurance Standard. Measurement System Identification: Metric/SI. NASA technical standard</article-title>
          .
          <source>National Aeronautics and Space Administration Approved:</source>
          <fpage>2017</fpage>
          -06-13 Washington, DC 20546-
          <issue>0001</issue>
          , 39 p. (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Snooke</surname>
          </string-name>
          , N.:
          <article-title>Automated Failure Effect Analysis for PHM of UAV</article-title>
          . In Valavanis,
          <string-name>
            <given-names>K.P.</given-names>
            ,
            <surname>Vachtsevanos</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.J</surname>
          </string-name>
          , (eds.) Handbook of Unmanned Aerial Vehicles. Springer Science+Business Media, Dordrecht (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Azzimonti</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Corani</surname>
          </string-name>
          ,G.:
          <article-title>Hierarchical estimation of parameters in Bayesian networks</article-title>
          .
          <source>Computational Statistics and Data Analysis</source>
          <volume>137</volume>
          ,
          <fpage>67</fpage>
          -
          <lpage>91</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Icen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ersel</surname>
            ,
            <given-names>D.:</given-names>
          </string-name>
          <article-title>A new approach for probability calculation of fuzzy events in Bayesian Networks</article-title>
          .
          <source>International Journal of Approximate Reasoning</source>
          , vol.
          <volume>108</volume>
          ,
          <fpage>76</fpage>
          -
          <lpage>88</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6. ISO 9001:
          <year>2015</year>
          . Quality Management Principles.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. AQAP-
          <volume>2210</volume>
          :
          <year>2015</year>
          .
          <article-title>NATO Supplementary Software Quality Assurance Requirements to AQAP-2110 or 2310</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Kjaerulff</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Madsen</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Probabilistic Networks. In Bayesian Networks and Influence Diagrams: A Guide to Construction and Analysis</article-title>
          .
          <source>Information Science and Statistics</source>
          , vol
          <volume>22</volume>
          , Springer, New York, NY (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Sahoo</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Probability And Mathematical Statistics. University of Louisville, USA,
          <string-name>
            <surname>Louisville</surname>
          </string-name>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>GeNIe</given-names>
            <surname>Modeler</surname>
          </string-name>
          .
          <source>User Manual. Version 2</source>
          .3.R4. BayesFusion, LLC (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>