<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Synthesis and analysis of doubly stochastic models of images</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Konstantin K. Vasiliev</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nikita A. Andriyanov</string-name>
          <email>nikita-and-nov@mail.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ulyanovsk State Technical University</institution>
          ,
          <addr-line>Severny Venets, 32, 432027</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>145</fpage>
      <lpage>154</lpage>
      <abstract>
        <p>The problem of describing inhomogeneous images by the models with varying parameters is considered in the paper. Synthesis of doubly stochastic images based on autoregressive random elds was performed. In addition, the possibility of simulating various images is shown under taking into account the choice of parameters and methods of their transformation. We investigate the characteristics of inhomogeneous images and get the \image-correlation" dependences. Particular attention is paid to the problems of estimating the doubly stochastic models' parameters. We describe a technique that allows one to form a doubly stochastic model with its implementation for real images. We also consider algorithms for detecting point anomalies against a background of doubly stochastic signals and images. An optimal detection algorithm has been developed. The algorithm provides a gain in comparison with a detector based on the autoregressive models. The results of practical application of the elaborated algorithms to real images are presented.</p>
      </abstract>
      <kwd-group>
        <kwd>Doubly stochastic models</kwd>
        <kwd>inhomogeneous images</kwd>
        <kwd>statistical analysis of images</kwd>
        <kwd>model parameters estimation</kwd>
        <kwd>anomalies detection</kwd>
        <kwd>random processes and elds</kwd>
        <kwd>image processing</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Classical regression with constant correlation coe cients is widely used in
scienti c studies [1{7]. However, the constant coe cients do not allow describing real
satellite data, which are characterized by spatial heterogeneity. Indeed, to
simulate the image to be similar to the real one, its formation on a multidimensional
grid can not be performed at each point by the same model. Therefore, the
problem of regression models \dynamization" is so urgent. One of the approaches to
ensuring such \dynamization" is a recurrent change in the parameters of the
model.</p>
    </sec>
    <sec id="sec-2">
      <title>Synthesis of doubly stochastic model</title>
      <p>Consider the synthesis of a doubly stochastic model both on the basis of
statistical modeling and on the basis of real data.</p>
      <sec id="sec-2-1">
        <title>The idea of doubly stochastic model</title>
        <p>
          Let the modeling of the image take place in accordance with the three-stage
simulation algorithm [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. The rst stage involves generation of a component of
a homogeneous random eld (RF) % (basic RF). In the second stage, it is needed
to perform transformation of the obtained RF % to make the RF with correlation
parameters f j ; j 2 (j1; j2; :::; jM )g, where M is a parameter describing the
dimensions of the simulated image. These parameters characterize the correlation
between the generated pixel of the image and its neighbors, similarly to the usual
autoregression (AR) model. Finally, using RF with the parameters j , we can
get the main image.
        </p>
        <p>
          To form the basic RF, we may use di erent models of RF [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. Let us take,
for example, the presentation of a two-dimension RF X=fxi; i 2 g, that we
can get by presentation of rst order AR model. If we use this model, we need to
get the basic RF, and then transform its values into a row correlation f xij ; i =
1; 2; :::; M1; j = 1; 2; :::; M2g and column correlation f yij ; i = 1; 2; :::; M1; j =
1; 2; :::; M2g
~xi;j = r1x ~xi 1;j + r2x ~xi;j 1
~yi;j = r1y ~yi 1;j + r2y ~yi;j 1
r1xr2x ~xi 1;j 1 + &amp;xi;j ;
r1yr2y ~yi 1;j 1 + &amp;yi;j ;
(1)
where &amp;xi;j and &amp;yi;j are the two-dimensional RF of independent Gaussian
random values (RV) with zero means and variances
        </p>
        <p>M f&amp;x2i;j g = &amp;2x;</p>
        <p>&amp;2x = 2x 1 r12x 1 r22x ,
M f&amp;y2i;j g = &amp;2y = 2y 1 r12y 1 r22y ;</p>
        <p>2x and 2y de ne the variances of the basic random elds of correlation
parameters for the row and column, respectively.</p>
        <p>Parameters ~xi;j and ~yi;j allow us to adjust the geometric characteristics of
objects imitated on the image while we are simulating the basic RF. The closer
their values to unity, the larger the area in the image is occupied by such an
object.</p>
        <p>Meanwhile, choosing the method of the basic RF transformation into a set of
correlation coe cients, it is possible to provide acceptable covariance functions
(CF) of the images. Usually, the selected conversion method may contain some
desired correlation structure of the original image. Thus, the proposed algorithm
can be used to simulate images that are close (in probability) to real images from
satellites.</p>
        <p>The averages of RF &amp;xi;j and &amp;yi;j are equal to zero; so, the average for ~xi;j
and ~yi;j (1) is also equal to zero. In view of the foregoing, we restrict ourselves
to such a choice of the transformation of the values of the basic RF, at which
the value of the RF ~xi;j and ~yi;j will be increased by a constant at every point,
i.e. mathematical expectations m x and m y will be the following:
xi;j = ~xi;jbase + m x ;
yi;j = ~yi;jbase + m y ;
(2)
where index \base" characterizes the value of the basic RF.</p>
        <p>Figure 1 shows the way to imitate an image whose correlation parameters
change according to the transformation of another simulated image based on the
rst-order AR model, so called the Habibi model.</p>
        <p>Figure 2 shows an example of using the algorithm according to the scheme of
Fig. 1 for generating doubly stochastic RF, whose parameters vary in accordance
with the equations of the AR. Here, (a, d, h) are presentations of the basic RF
f xi;j g; (b, e, i) are presentations of the basic RF f yi;j g; (c, f, i) are presentations
of the doubly stochastic model based on AR model.</p>
        <p>Analysis of the results (Fig. 2) shows that application of a doubly stochastic
model of a RF allows imitating images with given correlation properties.
Calculating the variances of the obtained RF, we can conclude that they are close to
the given ones, and the implementation of the doubly stochastic RF is
stationary. The additional advantage of this approach is that the formation of small
images does not require large computational costs.</p>
        <p>Figure 3 shows examples of images generated by the doubly stochastic models
with di erent average values of correlation coe cients.</p>
        <p>Investigation of the correlation properties of the basic image % =f i; i 2 g
has shown that on its basis it is possible to obtain objects of di erent geometric
shapes against the background of the main image. At the same time, by
increasing the dimension of N -dimensional rectangular grid , we can make a model
for RF of higher orders. This provides a description of the images, which are
inherent in a fairly complex terrain.</p>
        <p>Obviously, changing the parameters allows us to form very di erent images.
In this case, di erent algorithms for parameter transformation are possible. Thus,
the simplest models of images were obtained.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Synthesis using parameters estimation</title>
        <p>
          The problem of estimating parameters is reduced to estimating the elds xi;j
and yi;j in model (1) [
          <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
          ]. In the considered case, in order to identify the
parameters of such a model, it is necessary to evaluate the statistical parameters
m x , m y , 2x and 2y . To do this, we shall use the sliding window method.
Using some simple mathematical transformations, we can obtain the following
estimates of the mathematical expectation, variance, and correlation by row and
column at each point, proceeding from the necessity of presentation of an AR of
the second order
mz(i+ N2 1 )(j+ N2 1 ) = N12 Pli=+iN 1 Pjk+=Nj 1 Xlk,
z2(i+ N2 1 )(j+ N2 1 ) = N21 1 Pli=+iN 1 Pjk+=Nj 1(Xlk mzlk)2,
        </p>
        <p>v
1 ut1 ( Pli=+iN 2 Pjk+=Nj 1(Xlk mzlk) (X(l+1)k mz(l+1)k) )2</p>
        <p>u
xz(i+ N2 1 )(j+ N2 1 ) = Pli=+iN 2 Pjk+=(NjN 11()X(lNk) mzz2l(ki+) N(X2(1l+)(1j)+k Nm2z1()l+1)k) ,
(N 1) (N) z2(i+ N2 1 )(j+ N2 1 )
v
1 ut1 ( Pli=+iN 1 Pjk+=Nj 2(Xlk mzlk) (Xl(k+1) mzl(k+1)) )2
u</p>
        <p>(N 1) (N) z2(i+ N2 1 )(j+ N2 1 )
yz(i+ N2 1 )(j+ N2 1 ) = Pli=+iN 1 Pjk+=Nj 2(Xlk mzlk) (Xl(k+1) mzl(k+1))
(N 1) (N) z2(i+ N2 1 )(j+ N2 1 )
z-index is introduced to descript the observed data.</p>
        <p>It should be noted that the relations found for the mathematical expectation
and variance remain valid for other versions of the doubly stochastic model.
. where
We shall use the Neyman-Pearson approach, according to which we choose the
detection rule, that ensures the maximum probability of correct detection. This</p>
        <p>If
If</p>
        <p>Else if
noise variance.</p>
        <p>= S(zi 2x^Ei) &gt;</p>
        <p>n
= S(zi 2x^Ei)</p>
        <p>n
M f =H1g = S22 ,</p>
        <p>n</p>
        <p>M f =H0g = 0,
is provided by the fact that the probability of a false alarm does not exceed a
predetermined value PF 0. Thus, the optimal detection rule (in the sense of the
Neyman-Pearson test) maximizes the probability</p>
        <p>PD = 1</p>
        <p>PM = RG1 ::: R !(z=H1)dz
with an additional restriction
RG1 ::: R !(z=H0)dz = PF 0.</p>
        <p>We shall calculate the characteristics of the detection of a point signal with
level S, which can appear at a discrete point in time i. We write down the
decisive rule [11{13] as follows:
= ST (PE + Vn) 1(zS
x^E ) &gt;</p>
        <p>0, then there is the signal S,
Else if
= ST (PE + Vn) 1(zS</p>
        <p>x^E )
Then it can be reduced to the form
0, then there is not the signal S.
0, then there is the signal S,
0, then there is not the signal S, where
n2 is the</p>
        <p>On the next step, we nd the mathematical expectations and variances of
the left part of the detection rule under conditions of presence and absence of a
signal
de nes variance of main RF.
e2), where
e2 is parameter that</p>
        <p>Then the probabilities of false alarm and missed target can be written as
follows:</p>
        <p>PF = 0:5</p>
        <p>0( 0 ) is the false alarm probability,</p>
        <p>PM = 0:5 0( h
function, h = S2= n2.</p>
        <p>0 ) is the missed target probability, where
0 is Laplace</p>
        <p>So, to calculate the probability of correct detection it is necessary to subtract
from the unit the probability of the missed target. We nd the threshold value
0 considering that the probability of the false alarms is PF 0 = 0:001.</p>
        <p>Figures 5a and 5b show graphs of the correct detection probability depending
on the signal-to-noise ratio q in the forecast using one and two observations,
respectively. It is seen that the detection on the basis of a doubly stochastic
RF model is more e ective than detection based on the classic AR model. In
Fig. 5 the solid line is the theoretical probability for the algorithm based on the
doubly stochastic RF model, the dashed line is the experimental probability for
the algorithm based on the doubly stochastic RF model, the dot-and-dashed line
is the probability for the algorithm based on the AR model.</p>
        <p>Analysis of the graphs in Fig. 5 shows that the detection e ciency increases
in the case of using the doubly stochastic RF model and the larger volume of
information for forecasting. The gain on 0.5 correct detection probability level
is about 5-6% if we use two observations for prediction.
3.2</p>
      </sec>
      <sec id="sec-2-3">
        <title>Extensive anomalies detection on real data</title>
        <p>Now let us compare the work of two detectors of anomalies constructed on the
basis of the doubly stochastic model (Algorithm 1) and on the basis of the
autoregressive model (Algorithm 2). In this case, the detection will be performed
on the real images obtained from the LandSat-8 satellite. Studies are conducted
for three images. At the same time, in each image, 4 regions are selected where an
anomaly can be located. It is worth to note that the areas are selected based on
the structure of the images being examined with taking into account the greater
and less heterogeneity and the fact that the detection procedures are performed
not for the entire image, but only for these areas.</p>
        <p>Figure 6 shows an example of one of the processed images with signals located
in di erent parts of the images. The picture also re ects the probabilities of
correct detection obtained using two algorithms. The dimensions of all images
are 250x250. The images are distorted by the white Gaussian noise with a single
dispersion. The size of the square is 4x4, the radius of the circle is 2. The
signalto-noise ratio is 1. The statistics are taken out 500 times. We also provide the
probability of correct detection. The probabilities for Algorithm 1 are at the left
, the probabilities for Algorithm 2 are at the top.</p>
        <p>Analysis of the results shows that the algorithm based on the doubly
stochastic model works better than the algorithm based on a simple autoregressive
model and provides reliable detection of the signal in 90-95% of cases.</p>
        <p>Analysis of data presented in Fig. 7 shows that a similar situation is in terms
of ensuring at least the same e ciency. But in some cases, a signi cant gain
is retained in the case of processing other heterogeneous satellite images. The
probability of correct detection depends not only on the shape and size of the
signal itself, but, also on the brightness values in its closest neighborhood. In
this sense, a more universal algorithm is an algorithm based on doubly stochastic
models.
4</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Conclusion</title>
      <p>Thus, application of the doubly stochastic models provides an adequate
description of heterogeneous images, and the detection algorithms developed for such
models lead to a gain in the detection of point signals of the order of 5-10%. We
also can improve the correct detection probability by introducing more points
for prediction or by increasing the signal level. We have investigated the
modeling data, but the performed algorithms can become useful tool to detect various
anomalies in the real multispectral images. In addition, the processing of real
images also yielded gains in the detection of extended anomalies of di erent
shapes on the average of the order of 10-15% with respect to the signal-to-noise
ratio. It is worth to note that the novelty is o ered by the proposed model with
varying parameters, since it, unlike autoregressive models, makes it possible to
generate images with di erent correlation properties. A comparison of the
proposed algorithms based on a doubly stochastic model was performed with known
autoregressive algorithms.</p>
      <p>Acknowledgements. The study was supported by RFBR, project
16-41732027.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Kashyap</surname>
            ,
            <given-names>R.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rao</surname>
            ,
            <given-names>A.R.</given-names>
          </string-name>
          :
          <article-title>Construction of dynamic stochastic models from experimental data</article-title>
          .
          <source>Trans. from the English</source>
          , ed. by
          <string-name>
            <given-names>V.</given-names>
            <surname>Pugachev</surname>
          </string-name>
          . Moscow. Nauka,
          <volume>384</volume>
          (
          <year>1983</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Shalygin</surname>
            ,
            <given-names>A.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Palagin</surname>
          </string-name>
          , Yu.A.:
          <article-title>Applied methods of statistical modeling</article-title>
          .
          <source>Mechanical Engineering</source>
          ,
          <volume>320</volume>
          (
          <year>1986</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Spektor</surname>
            ,
            <given-names>A.A.</given-names>
          </string-name>
          :
          <article-title>Digital image processing</article-title>
          .
          <source>Novosibirsk, NSTU</source>
          ,
          <volume>350</volume>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          et al:
          <article-title>Applied theory of random processes and elds</article-title>
          . Ulyanovsk, UlSTU,
          <volume>256</volume>
          (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Popov</surname>
            ,
            <given-names>O.V.</given-names>
          </string-name>
          :
          <article-title>Autoregressive models of random elds with multiple roots</article-title>
          .
          <source>Proceedings of the 4th Conf</source>
          .
          <article-title>\Image recognition and image analysis: new information technologies."</article-title>
          , Novosibirsk,
          <volume>4</volume>
          .1,
          <issue>258</issue>
          {
          <fpage>260</fpage>
          (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sluzhivy</surname>
            ,
            <given-names>M.N.</given-names>
          </string-name>
          :
          <article-title>Mathematical modeling of communication systems</article-title>
          . Ulyanovsk, UlSTU,
          <volume>170</volume>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Boxing</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jenkins</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>Analysis of time series. Forecast and management</article-title>
          .
          <source>Trans. from the English</source>
          , ed. by
          <string-name>
            <given-names>V.P.</given-names>
            <surname>Pisarenko</surname>
          </string-name>
          . Moscow, Mir.
          <volume>1</volume>
          ,
          <issue>406</issue>
          (
          <year>1974</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Vasil</surname>
          </string-name>
          <article-title>'ev, K. K</article-title>
          .,
          <string-name>
            <surname>Dement</surname>
          </string-name>
          'ev, V. E.,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          :
          <article-title>Doubly stochastic models of images</article-title>
          .
          <source>Pattern Recognition and Image Analysis</source>
          .
          <volume>25</volume>
          (
          <issue>1</issue>
          ),
          <volume>105</volume>
          {
          <fpage>110</fpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dementiev</surname>
            ,
            <given-names>V.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          :
          <article-title>Estimation of the parameters of doubly stochastic random elds</article-title>
          .
          <source>Radiotekhnika</source>
          .
          <volume>7</volume>
          ,
          <issue>103</issue>
          {
          <fpage>106</fpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dementiev</surname>
            ,
            <given-names>V.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          :
          <article-title>Analysis of the e ectiveness of estimating the changing parameters of a doubly stochastic model</article-title>
          .
          <source>Radiotekhnika</source>
          .
          <volume>6</volume>
          ,
          <issue>12</issue>
          {
          <fpage>15</fpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          :
          <article-title>Investigation of the e ciency of correct detection of signals against the background of one-dimensional doubly stochastic random processes</article-title>
          .
          <source>Technical Sciences: Problems and Perspectives Materials of the IV International Scienti c Conference</source>
          ,
          <volume>37</volume>
          -
          <fpage>40</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dementiev</surname>
            ,
            <given-names>V.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          :
          <article-title>Detection of extended signals on a background of doubly stochastic images</article-title>
          .
          <source>Radiotekhnika</source>
          .
          <volume>9</volume>
          ,
          <issue>23</issue>
          {
          <fpage>27</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dementiev</surname>
            ,
            <given-names>V.E.</given-names>
          </string-name>
          :
          <article-title>Anomalies detection on spatially inhomogeneous polyzonal images</article-title>
          .
          <source>CEUR Workshop Proceedings. Volume</source>
          <year>1901</year>
          ,
          <source>2017 International Conference Information Technology and Nanotechnology. Session Image Processing, Geoinformation Technology and Information Security, IPGTIS-ITNT 2017; Samara; Russian Federation</source>
          ,
          <fpage>10</fpage>
          -
          <lpage>15</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dementiev</surname>
            ,
            <given-names>V.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          :
          <article-title>Filtration and restoration of satellite images using doubly stochastic random elds</article-title>
          .
          <source>CEUR Workshop Proceedings, \REIT 2017 - Proceedings of the 1st International Workshop on Radio Electronics and Information Technologies"</source>
          ,
          <year>1814</year>
          ,
          <fpage>10</fpage>
          -
          <lpage>20</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>