<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Image Models and Segmentation Algorithms Based on Discrete Doubly Stochastic Autoregressions with Multiple Roots of Characteristic Equations</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nikita A. Andriyanov</string-name>
          <email>nikita-and-nov@mail.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yuliya N. Gavrilina</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ulyanovsk State Technical University</institution>
          ,
          <addr-line>Severny Venets, 32, 432027</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>19</fpage>
      <lpage>28</lpage>
      <abstract>
        <p>One of the most important problems of image processing is the problem of mathematical description of objects appearing on image's background. There are many algorithms for current imitation of images, but unfortunately they have some drawbacks. Often, such models are not able to describe images that are inhomogeneous in space, or they can describe only images with slowly changing properties. Therefore, a model is proposed for describing sharp change in the properties of an image. However, due to the use of autoregression with multiple roots, the discrete model will also contain objects with slowly changing brightness characteristics. The paper is devoted to the development of images' models with variable parameters, which can take a limited number of values. We propose methods for discretizing the obtained random parameter elds by transforming the initial elds with a continuous distribution. Furthermore, the probabilistic properties of the proposed model are analyzed. We also describe in details methods for simulating images containing a given number of structures and investigate segmentation algorithms for the proposed model of images.</p>
      </abstract>
      <kwd-group>
        <kwd>image processing</kwd>
        <kwd>doubly stochastic models</kwd>
        <kwd>random elds</kwd>
        <kwd>image modeling</kwd>
        <kwd>image analysis</kwd>
        <kwd>covariation functions</kwd>
        <kwd>multiple roots</kwd>
        <kwd>characteristic equations</kwd>
        <kwd>image segmentation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Solutions to a number of important problems in various elds of science and
technology can be achieved by using the results of processing multidimensional
data sets. Among the image processing tasks, a special place is occupied by
problems of segmentation, detecting anomalies, reconstruction, and prediction.
One of the most important sources of such data arrays are various
multidimensional images. Examples of such images are various information signals, digital
photographs and video sequences, remote sensing data of the Earth (RS), etc.</p>
      <p>The particular urgency of solving these problems is associated with wide
dissemination of methods for recording images of various objects including
multispectral (up to 10 spectral ranges) and hyperspectral (up to 300 ranges) of
recording the Earth areas. As a result of such registration, multidimensional
arrays of information are obtained. Thus, there is an increase in the volume of
information received, and although signi cant amounts of processed information
potentially improve the quality of satellite material processing, new methods are
necessary for qualitative and quantitative analysis of aerospace observations as
a single multidimensional aggregate.</p>
      <p>In addition, the problem of describing images can not be regarded as solved.
Despite the variety of random elds (RF) and random processes models [1{11],
most of them do not give a satisfactory description of real images and signals
due to a number of reasons. The main problem is presence on an image of several
objects having di erent nature, description of which is di cult for one model.
Digital image processing algorithms [11] can be synthesized for some particular
cases of mixed image models [7, 8]. In such models, auxiliary RFs are used to
implement the basic RF, which are also a set of model parameters.</p>
      <p>In this article, we will consider modi cation of a doubly stochastic model [1,
3, 4, 7{9], which allows one to obtain a smooth change in the brightness properties
of an image, as well as the possibility of using a given number of correlation levels.
Finally, we show that the use of a countable number of correlation levels allows
one to perform e ective segmentation of such images.
2</p>
      <p>
        Doubly stochastic model of images based on Habibi
and autoregression with multiple roots of characteristic
equations models
The main drawbacks of the doubly stochastic model based on the Habibi model
or the usual rst-order autoregressive (AR) model are its anisotropy, as well as
the use of only three neighboring elements to form a new element of the RF.
Indeed, it is obvious that the Habibi model is a special case of an AR model
with multiple roots of the characteristic equations [2, 6, 10]. The multiplicity
of such a model is (
        <xref ref-type="bibr" rid="ref1 ref1">1,1</xref>
        ). In addition, increasing the multiplicity of the model
can expand the number of links between the elements. We now form a doubly
stochastic model combining AR models with multiple roots.
      </p>
      <p>The process of such model synthesis is analogous to the process considered in
[1], but it has its own peculiarities and is implemented in three stages. First, the
basic RFs are created. Secondly, the values of the obtained RFs are converted
into a set of correlation parameters f j ; j 2 (j1; j2; :::; jM )g, where M is the
dimension of the image being formed. These parameters characterize the
connection between the current pixel of the simulated image and the neighboring
image elements. Finally, the image is formed as a model of a RF with varying
correlation parameters j .</p>
      <p>For simplicity, the basic RFs are simulated using the rst order AR model
as well as the doubly stochastic RF model based on the Habibi model. After
the formation of two basic RFs, the brightness values of one of them should
be transformed into a set of correlation parameters f xij ; i = 1; 2; :::; M1; j =
1; 2; :::; M2g, and the second RF should be transformed into correlation
parameters f yij ; i = 1; 2; :::; M1; j = 1; 2; :::; M2g.</p>
      <p>
        We can write AR with multiple roots of characteristic equations of the second
order in the one-dimensional case as follows:
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
(
        <xref ref-type="bibr" rid="ref2">2</xref>
        )
xi = 2 xi 1
      </p>
      <p>
        2xi 2 + i:
On the basis of formula (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ), we can obtain a two-dimensional model
xi;j = 2 xxi 1;j + 2 yxi;j 1
      </p>
      <p>4 x yxi 1;j 1
2xxi 2;j</p>
      <p>2yxi;j 2 + 2 2x yxi 2;j 1
+2 2y xxi 1;j 2</p>
      <p>2x 2yxi 2;j 2 + b i;j ;
where b is the coe cient ensuring the equality of the variance of the simulated
RF to a given value.</p>
      <p>
        It should be noted that model (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) is an eight-point model, i.e. in it we
use 8 previous pixels for the formation of the next element of the RF fxg.
Similarly, for the model multiplicity (
        <xref ref-type="bibr" rid="ref3 ref3">3,3</xref>
        ), we can obtain a 15-point model, for
the model multiplicity (
        <xref ref-type="bibr" rid="ref4 ref4">4,4</xref>
        ), we obtain a model consisting of 24 points from the
neighborhood.
      </p>
      <p>
        Making coe cients of model (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) to be random with the help of the
rstorder AR model leads to the obtaining of a doubly stochastic RF model based
on Habibi and AR with multiple roots of characteristic equations models.
      </p>
      <p>Thus, using the doubly stochastic AR models, one can generate images and
their sequences adequate to real multi-zone images at relatively low
computational costs. This allows us to use such models for statistical analysis of the
e ciency of image processing algorithms. In this case, it is possible to achieve
a smooth change in the brightness properties of the image due to models with
multiple roots of the characteristic equations.</p>
      <p>
        In model (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ), parameters xij and yij are not constant values, but by
application of two basic RFs, their brightness values are transformed into a set of
correlation parameters in accordance with the following relationships:
~xi;j = r1x ~xi 1;j + r2x ~xi;j 1 r1xr2x ~xi 1;j 1 + &amp;xi;j ;
~yi;j = r1y ~yi 1;j + r2y ~yi;j 1 r1yr2y ~yi 1;j 1 + &amp;yi;j ;
xij = ~xi;j + m x ; yij = ~yi;j + m y ;
(
        <xref ref-type="bibr" rid="ref3">3</xref>
        )
(
        <xref ref-type="bibr" rid="ref4">4</xref>
        )
where &amp;xi;j and &amp;yi;j are two-dimensional RF of independent Gaussian random
variables with zero means and variances M f&amp;x2i;j g = &amp;2x; &amp;2x = 2x 1 r12x 1 r22x ,
      </p>
      <p>M f&amp;y2i;j g = &amp;2y = 2y 1 r12y 1 r22y , 2x = M f 2xij g and
m x and m y de ne average correlation in row and column.
2y = M f 2yij g,</p>
      <p>
        The correlation coe cients obtained from expression (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ) are continuous random
variables and usually take di erent values at each point. To make the correlation
coe cients of the basic RF (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) to take a countable number of values, it is necessary to
discretize expression (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ) as follows:
xij = round(
      </p>
      <p>
        xij L
maxf xij g
minf xij g
);
(
        <xref ref-type="bibr" rid="ref5">5</xref>
        )
where round() is the rounding operator, L is the number of sampling levels, max and
min are respectively the maximum and minimum values of the RF.
      </p>
      <p>
        Then it is necessary to convert the obtained discrete RF (
        <xref ref-type="bibr" rid="ref5">5</xref>
        ) so that its minimum
value corresponds to the minimum value of the continuous RF, and the analogous
equality for the maximum values would be satis ed by using expression
xij = minf xij g +
( xij
minf xij g)(maxf xij g
maxf xij g
minf xij g
minf xij g) :
(
        <xref ref-type="bibr" rid="ref6">6</xref>
        )
Similar actions can be performed for the coe cients by column.
      </p>
      <p>
        Thus, by varying the number of discretization levels L, it is possible even for
identical model parameters to obtain its various implementations. We also can see that on
the graphs of Figure 3 the covariance relationships of discrete models decrease more
slowly than those in continuous ones.
Let us nd the number of elements of the vector obtained after the transformation (
        <xref ref-type="bibr" rid="ref7">7</xref>
        ),
which corresponds to each gradation of brightness. We will use a histogram to nd the
brightness value between its peaks. Since at this formation the histogram should have
two peaks, the threshold value of brightness can be found by the formula
Lthr =
      </p>
      <p>Lmax1 + Lmax2 ;
2
where Lmax1 and Lmax2 are the brightness values of the rst and second maximum of
the histogram.</p>
      <p>Let us transform the equalized image f~xijeqg with 256 gradations of brightness
into an image fRxij g with 2 gradations of brightness. So the image fRxij g is binary
image, which is obtained by the formula</p>
      <p>
        Rxij = 0; if f~xijeqg &lt; Lthr; Rxij = 255; else:
Expression (
        <xref ref-type="bibr" rid="ref9">9</xref>
        ) in this case is a segmented image. Furthermore, the proportion of
correctly assigned to the rst or second area pixels is considered. This proportion is based
on the assumption that homogeneous zones are segmented on the binary image of the
basic RF. Then the percentage e ciency of segmentation can be found after comparing
the resulting image with the segmentation of the basic image.
      </p>
      <p>Figure 4 shows histogram of an image simulated by doubly stochastic model with
possible parameter values x1 = y1 = 0:8 and x2 = y2 = 0:95.
4</p>
      <p>Segmentation of images with varying correlation
properties
Now consider the segmentation algorithm for the generated images in the case where
the number of correlation levels is two. To select homogeneous areas, you need to build
a histogram of the image. To do this, all the values of the RF f xij g are written in the
vector of brightness values. It should be noted that all the values have before passed
the equalization procedure, and we also taking into account the average additive. So,
the result vector is written as follows:</p>
      <p>
        L(k) = ~xijeq; i = 1; 2; :::; M1; j = 1; 2; :::; M2; 1; 2; :::; M1xM2:
(
        <xref ref-type="bibr" rid="ref7">7</xref>
        )
Note that in this case we have the threshold value Lthr = 135.
(
        <xref ref-type="bibr" rid="ref8">8</xref>
        )
(
        <xref ref-type="bibr" rid="ref9">9</xref>
        )
      </p>
      <p>It is clear that the best segmentation will be provided by combinational processing
of correlation parameters by row and column.</p>
      <p>Figure 5 shows the result of the segmentation algorithm using the histogram: Figure
5a corresponds to basic RF; Figure 5b corresponds to nonhomogeneous image with
homogeneous regions; Figure 5c corresponds to binarization of the basic RF; Figure 5d
corresponds to segmentation of the nonhomogeneous image.</p>
      <p>The percentage of the correspondence between Figure 5c and Figure 5d is quite
large, namely, 85.7%. Analysis of Figure 5 shows that it is possible to increase
segmentation e ciency if small objects are included in a larger neighboring area.</p>
      <p>Nevertheless, the result obtained for simulated images allows us to reasonably hope
that in the case of applying more complex segmentation procedures in processing the
correlation parameter eld, the segmentation algorithm found can be applied to real
images. Indeed, Figure 6 shows the results of 2-level segmentation (binarization) of a
satellite image by applying a combination of the proposed algorithm and the ISODATA
algorithm to the eld of correlation parameters. In this case, Figure 6a is the original
image; Figure 6b shows the correlation parameter elds for the original image; Figure
6c shows the results of segmentation by correlation parameters jointly ISODATA
algorithm; and Figure 6d shows the results of applying the ISODATA algorithm to the
original image.</p>
      <p>The gain for the presented case on segmentation accuracy was about 6%. However,
it is worth to note that the task of assessing the accuracy of segmentation when
processing real images is signi cantly complicated, since there is no predetermined correct
version, and most often, we have to use expert estimates.
5</p>
      <p>Conclusion
Doubly stochastic models of images based on the AR with multiple roots of
characteristic equations are considered. The transition to the discrete case is carried out.
Probabilistic properties of the proposed models are analyzed. An algorithm for image
segmentation by correlation parameters is described. Gains are obtained when
processing images consisting of two structures. The gains are about of 6 {10% in comparison
with segmentation by the ISODATA algorithm.</p>
      <p>Acknowledgements. The study was supported by RFBR, project 17-01-00179 A.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          :
          <article-title>Synthesis and analysis of doubly stochastic models of images</article-title>
          .
          <source>REIT 2017. Proceedings of 2nd International Workshop on Radio Electronics and Information Technologies. CEUR Workshop Proceedings</source>
          . Vol.
          <year>2005</year>
          ,
          <volume>145</volume>
          {
          <fpage>154</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          :
          <article-title>Analysis of autoregressions with multiple roots of characteristic equations</article-title>
          .
          <source>Radiotekhnika</source>
          .
          <volume>6</volume>
          ,
          <issue>13</issue>
          {
          <fpage>17</fpage>
          . (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Xin</given-names>
            <surname>Xu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Deren</given-names>
            <surname>Li</surname>
          </string-name>
          , Hong Sun:
          <article-title>Doubly stochastic MRF-based segmentation of SAR images</article-title>
          .
          <source>Proceedings of SPIE 5095. Algorithms for Synthetic Aperture Radar Imagery X</source>
          .
          <volume>8</volume>
          {
          <issue>16</issue>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Xin</given-names>
            <surname>Xu</surname>
          </string-name>
          , Hong Sun:
          <article-title>Multiscale SAR image segmentation using a double Markov random eld model</article-title>
          .
          <source>Proceedings Seventh International Symposium on Signal Processing and Its Applications</source>
          . Vol.
          <volume>1</volume>
          ,
          <issue>6</issue>
          {
          <fpage>12</fpage>
          (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Aykroyd</surname>
          </string-name>
          , R. G.:
          <article-title>Bayesian estimation for homogeneous and inhomogeneous Gaussian random elds</article-title>
          .
          <source>IEEE Transactions on Pattern Analysis and Machine Intelligence</source>
          . Vol.
          <volume>20</volume>
          ,
          <string-name>
            <surname>Iss</surname>
          </string-name>
          .
          <volume>5</volume>
          ,
          <issue>533</issue>
          {
          <fpage>539</fpage>
          (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Buynova</surname>
            ,
            <given-names>S. N.</given-names>
          </string-name>
          :
          <article-title>Checking the presence of a single root in the autoregression process by the correlation method</article-title>
          .
          <source>St. Petersburg</source>
          (
          <year>2010</year>
          ) http://www.statmod.ru/ _diploma/
          <year>2010</year>
          /2_01_buynova.pdf
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Vasil</surname>
          </string-name>
          <article-title>'ev, K. K</article-title>
          .,
          <string-name>
            <surname>Dement</surname>
          </string-name>
          'ev, V. E.,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          :
          <article-title>Application of mixed models for solving the problem on restoring and estimating image parameters. Pattern Recognition and Image Analysis</article-title>
          . Vol.
          <volume>26</volume>
          (
          <issue>1</issue>
          ),
          <volume>240</volume>
          {
          <fpage>247</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dementiev</surname>
            ,
            <given-names>V. E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          :
          <article-title>Filtration and restoration of satellite images using doubly stochastic random elds</article-title>
          .
          <source>REIT 2017. Proceedings of 1st International Workshop on Radio Electronics and Information Technologies. CEUR Workshop Proceedings</source>
          . Vol.
          <year>1814</year>
          ,
          <volume>10</volume>
          {
          <fpage>20</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vasiliev</surname>
            ,
            <given-names>K. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dementiev</surname>
            ,
            <given-names>V. E.</given-names>
          </string-name>
          :
          <article-title>Anomalies detection on spatially inhomogeneous polyzonal images</article-title>
          .
          <source>CEUR Workshop Proceedings. Volume</source>
          <year>1901</year>
          ,
          <source>2017 International Conference Information Technology and Nanotechnology. Session Image Processing, Geoinformation Technology and Information Security, IPGTIS-ITNT 2017; Samara; Russian Federation</source>
          ,
          <volume>10</volume>
          {
          <fpage>15</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Vasiliev</surname>
            , K. K, Gavrilina,
            <given-names>Yu. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andriyanov</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          :
          <article-title>E ciency of ltering an autoregressive model with multiple roots of characteristic equations. Modern problems of design, production and operation of radio engineering systems: a collection of scienti c papers</article-title>
          .
          <source>Tenth edition. UlSTU</source>
          , Ulyanovsk.
          <volume>130</volume>
          {
          <issue>133</issue>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Gonzalez</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Woods</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>Digital image processing</article-title>
          .
          <source>Edition 3rd, revised and enlarged. Technosphere</source>
          , Moscow.
          <volume>1104</volume>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>